2024-09-12T17:15:59.397 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T17:15:59.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T17:15:59.525 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902728 branch: wip-rgw-meta-handlers description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7902728' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rgw-meta-handlers ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 valgrind: - --tool=memcheck - --max-threads=1024 compression type: random ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-meta-handlers sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 6279 sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-meta-handlers suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b targets: smithi098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJK2mem+aBNuRmY7XJUxTFaAlRXD0vlMPCGoA5a4SkPRG98Mg8l64F0M0tqoxud88Wxz2+r1P5fCJOOORonGqcI= smithi187.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFgDFTXAgojqxIFr5k/5rq+ybpP4j80cSs7mNcXzH50QSYXoki1iWyY48ybNIIjKJJRQlB44IQzYjXVXZ0QDk5c= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_15:39:52 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T17:15:59.525 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa; will attempt to use it 2024-09-12T17:15:59.526 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa/tasks 2024-09-12T17:15:59.526 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T17:15:59.527 INFO:teuthology.task.internal:Checking packages... 2024-09-12T17:15:59.550 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bad475c18c96ec20c5778159aa33ba72b84e9c1b' 2024-09-12T17:15:59.550 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T17:15:59.550 INFO:teuthology.packaging:ref: None 2024-09-12T17:15:59.550 INFO:teuthology.packaging:tag: None 2024-09-12T17:15:59.550 INFO:teuthology.packaging:branch: wip-rgw-meta-handlers 2024-09-12T17:15:59.550 INFO:teuthology.packaging:sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:15:59.550 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rgw-meta-handlers 2024-09-12T17:15:59.702 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:15:59.705 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T17:15:59.710 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T17:15:59.710 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T17:15:59.724 INFO:teuthology.task.internal:Saving configuration 2024-09-12T17:15:59.745 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T17:15:59.751 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T17:15:59.776 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902728', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:10:29.559904', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIA/mgZmyujxURwbiaBUJLyE+YfVve5pCfFK2aAr6QojA'} 2024-09-12T17:15:59.802 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902728', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 17:10:29.561271', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGk4RNth/iil1KAMYPF8PKWGC2AOV0trl1Q+L1/mYAyy'} 2024-09-12T17:15:59.802 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T17:15:59.808 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T17:15:59.809 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T17:15:59.809 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T17:15:59.871 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2d968632e0>, signals=[15]) 2024-09-12T17:15:59.871 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T17:15:59.875 INFO:teuthology.task.internal:Opening connections... 2024-09-12T17:15:59.875 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2024-09-12T17:15:59.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:15:59.959 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T17:15:59.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:16:00.039 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T17:16:00.045 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-09-12T17:16:00.050 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-09-12T17:16:00.050 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-09-12T17:16:00.099 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T17:16:00.099 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu" 2024-09-12T17:16:00.100 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="22.04" 2024-09-12T17:16:00.100 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T17:16:00.100 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=jammy 2024-09-12T17:16:00.100 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu 2024-09-12T17:16:00.100 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian 2024-09-12T17:16:00.100 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T17:16:00.100 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T17:16:00.100 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T17:16:00.100 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T17:16:00.100 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=jammy 2024-09-12T17:16:00.101 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-09-12T17:16:00.118 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2024-09-12T17:16:00.123 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2024-09-12T17:16:00.123 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-09-12T17:16:00.170 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T17:16:00.170 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Ubuntu" 2024-09-12T17:16:00.170 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="22.04" 2024-09-12T17:16:00.170 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T17:16:00.170 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_CODENAME=jammy 2024-09-12T17:16:00.170 INFO:teuthology.orchestra.run.smithi187.stdout:ID=ubuntu 2024-09-12T17:16:00.170 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE=debian 2024-09-12T17:16:00.170 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T17:16:00.171 INFO:teuthology.orchestra.run.smithi187.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T17:16:00.171 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T17:16:00.171 INFO:teuthology.orchestra.run.smithi187.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T17:16:00.171 INFO:teuthology.orchestra.run.smithi187.stdout:UBUNTU_CODENAME=jammy 2024-09-12T17:16:00.171 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-09-12T17:16:00.193 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T17:16:00.203 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T17:16:00.208 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T17:16:00.209 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:16:00.211 DEBUG:teuthology.orchestra.run.smithi187:> test '!' -e /home/ubuntu/cephtest 2024-09-12T17:16:00.217 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T17:16:00.222 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T17:16:00.222 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:16:00.257 DEBUG:teuthology.orchestra.run.smithi187:> test -z $(ls -A /var/lib/ceph) 2024-09-12T17:16:00.269 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T17:16:00.326 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T17:16:00.347 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T17:16:00.347 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T17:16:00.347 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:16:00.348 DEBUG:teuthology.orchestra.run.smithi187:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T17:16:00.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:16:00.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:16:00.353 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-12T17:16:00.353 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2024-09-12T17:16:00.400 INFO:teuthology.orchestra.run.smithi098.stdout:5.15.0-56-generic 2024-09-12T17:16:00.400 INFO:teuthology.task.kernel:Running kernel on smithi098: 5.15.0-56-generic 2024-09-12T17:16:00.400 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-get clean 2024-09-12T17:16:00.402 INFO:teuthology.orchestra.run.smithi187.stdout:5.15.0-56-generic 2024-09-12T17:16:00.403 INFO:teuthology.task.kernel:Running kernel on smithi187: 5.15.0-56-generic 2024-09-12T17:16:00.403 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get clean 2024-09-12T17:16:00.540 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-get update 2024-09-12T17:16:00.541 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get update 2024-09-12T17:16:00.660 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:16:00.681 INFO:teuthology.orchestra.run.smithi098.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T17:16:00.683 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T17:16:00.766 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T17:16:00.778 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T17:16:00.799 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:16:00.850 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T17:16:00.881 INFO:teuthology.orchestra.run.smithi098.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T17:16:00.912 INFO:teuthology.orchestra.run.smithi098.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T17:16:00.947 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T17:16:00.951 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T17:16:00.953 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T17:16:00.954 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T17:16:00.954 INFO:teuthology.orchestra.run.smithi187.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T17:16:00.972 INFO:teuthology.orchestra.run.smithi187.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T17:16:00.975 INFO:teuthology.orchestra.run.smithi187.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T17:16:00.975 INFO:teuthology.orchestra.run.smithi187.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T17:16:00.980 INFO:teuthology.orchestra.run.smithi098.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T17:16:00.982 INFO:teuthology.orchestra.run.smithi187.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T17:16:00.988 INFO:teuthology.orchestra.run.smithi187.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T17:16:00.990 INFO:teuthology.orchestra.run.smithi187.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T17:16:00.995 INFO:teuthology.orchestra.run.smithi187.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T17:16:01.002 INFO:teuthology.orchestra.run.smithi187.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T17:16:01.017 INFO:teuthology.orchestra.run.smithi098.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T17:16:01.020 INFO:teuthology.orchestra.run.smithi098.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T17:16:01.020 INFO:teuthology.orchestra.run.smithi098.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T17:16:01.020 INFO:teuthology.orchestra.run.smithi098.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T17:16:01.025 INFO:teuthology.orchestra.run.smithi187.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T17:16:01.025 INFO:teuthology.orchestra.run.smithi187.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T17:16:01.025 INFO:teuthology.orchestra.run.smithi187.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T17:16:01.026 INFO:teuthology.orchestra.run.smithi187.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T17:16:01.027 INFO:teuthology.orchestra.run.smithi187.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T17:16:01.027 INFO:teuthology.orchestra.run.smithi187.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T17:16:01.027 INFO:teuthology.orchestra.run.smithi187.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T17:16:01.027 INFO:teuthology.orchestra.run.smithi187.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T17:16:01.039 INFO:teuthology.orchestra.run.smithi098.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T17:16:01.041 INFO:teuthology.orchestra.run.smithi098.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T17:16:01.042 INFO:teuthology.orchestra.run.smithi098.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T17:16:01.042 INFO:teuthology.orchestra.run.smithi187.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T17:16:01.046 INFO:teuthology.orchestra.run.smithi098.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T17:16:01.051 INFO:teuthology.orchestra.run.smithi098.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T17:16:01.053 INFO:teuthology.orchestra.run.smithi098.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T17:16:01.053 INFO:teuthology.orchestra.run.smithi098.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T17:16:01.054 INFO:teuthology.orchestra.run.smithi098.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T17:16:01.059 INFO:teuthology.orchestra.run.smithi187.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T17:16:01.084 INFO:teuthology.orchestra.run.smithi098.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T17:16:01.084 INFO:teuthology.orchestra.run.smithi098.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T17:16:01.222 INFO:teuthology.orchestra.run.smithi187.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T17:16:01.236 INFO:teuthology.orchestra.run.smithi098.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T17:16:01.375 INFO:teuthology.orchestra.run.smithi098.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T17:16:01.640 INFO:teuthology.orchestra.run.smithi187.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T17:16:01.657 INFO:teuthology.orchestra.run.smithi187.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T17:16:01.665 INFO:teuthology.orchestra.run.smithi187.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T17:16:01.666 INFO:teuthology.orchestra.run.smithi187.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T17:16:01.667 INFO:teuthology.orchestra.run.smithi187.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T17:16:01.689 INFO:teuthology.orchestra.run.smithi098.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T17:16:01.726 INFO:teuthology.orchestra.run.smithi098.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T17:16:01.741 INFO:teuthology.orchestra.run.smithi098.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T17:16:01.741 INFO:teuthology.orchestra.run.smithi098.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T17:16:01.742 INFO:teuthology.orchestra.run.smithi098.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T17:16:01.763 INFO:teuthology.orchestra.run.smithi187.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T17:16:01.774 INFO:teuthology.orchestra.run.smithi187.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T17:16:01.774 INFO:teuthology.orchestra.run.smithi187.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T17:16:01.790 INFO:teuthology.orchestra.run.smithi187.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T17:16:01.811 INFO:teuthology.orchestra.run.smithi098.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T17:16:01.816 INFO:teuthology.orchestra.run.smithi187.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T17:16:01.822 INFO:teuthology.orchestra.run.smithi098.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T17:16:01.822 INFO:teuthology.orchestra.run.smithi098.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T17:16:01.823 INFO:teuthology.orchestra.run.smithi187.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T17:16:01.824 INFO:teuthology.orchestra.run.smithi187.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T17:16:01.825 INFO:teuthology.orchestra.run.smithi187.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T17:16:01.825 INFO:teuthology.orchestra.run.smithi187.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T17:16:01.847 INFO:teuthology.orchestra.run.smithi098.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T17:16:01.879 INFO:teuthology.orchestra.run.smithi098.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T17:16:01.885 INFO:teuthology.orchestra.run.smithi098.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T17:16:01.885 INFO:teuthology.orchestra.run.smithi098.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T17:16:01.886 INFO:teuthology.orchestra.run.smithi098.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T17:16:01.886 INFO:teuthology.orchestra.run.smithi098.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T17:16:01.903 INFO:teuthology.orchestra.run.smithi187.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T17:16:01.936 INFO:teuthology.orchestra.run.smithi098.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T17:16:01.936 INFO:teuthology.orchestra.run.smithi098.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T17:16:01.937 INFO:teuthology.orchestra.run.smithi098.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T17:16:01.937 INFO:teuthology.orchestra.run.smithi098.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T17:16:02.018 INFO:teuthology.orchestra.run.smithi098.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T17:16:02.018 INFO:teuthology.orchestra.run.smithi098.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T17:16:02.018 INFO:teuthology.orchestra.run.smithi098.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T17:16:02.018 INFO:teuthology.orchestra.run.smithi098.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T17:16:02.019 INFO:teuthology.orchestra.run.smithi098.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T17:16:07.229 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 15.8 MB in 2s (7,648 kB/s) 2024-09-12T17:16:07.483 INFO:teuthology.orchestra.run.smithi098.stdout:Fetched 15.8 MB in 2s (7,439 kB/s) 2024-09-12T17:16:08.643 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-12T17:16:08.660 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:16:08.713 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-12T17:16:08.898 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2024-09-12T17:16:08.898 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2024-09-12T17:16:08.930 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-12T17:16:08.947 DEBUG:teuthology.orchestra.run.smithi098:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:16:09.000 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-12T17:16:09.063 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:16:09.063 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:16:09.063 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:16:09.064 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:16:09.064 INFO:teuthology.orchestra.run.smithi187.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T17:16:09.064 INFO:teuthology.orchestra.run.smithi187.stdout: python2.7-minimal 2024-09-12T17:16:09.064 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:16:09.065 INFO:teuthology.orchestra.run.smithi187.stdout:The following additional packages will be installed: 2024-09-12T17:16:09.065 INFO:teuthology.orchestra.run.smithi187.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:16:09.065 INFO:teuthology.orchestra.run.smithi187.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T17:16:09.066 INFO:teuthology.orchestra.run.smithi187.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T17:16:09.067 INFO:teuthology.orchestra.run.smithi187.stdout:Suggested packages: 2024-09-12T17:16:09.067 INFO:teuthology.orchestra.run.smithi187.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T17:16:09.067 INFO:teuthology.orchestra.run.smithi187.stdout:Recommended packages: 2024-09-12T17:16:09.067 INFO:teuthology.orchestra.run.smithi187.stdout: thermald 2024-09-12T17:16:09.114 INFO:teuthology.orchestra.run.smithi187.stdout:The following NEW packages will be installed: 2024-09-12T17:16:09.115 INFO:teuthology.orchestra.run.smithi187.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:16:09.115 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T17:16:09.115 INFO:teuthology.orchestra.run.smithi187.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T17:16:09.116 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages will be upgraded: 2024-09-12T17:16:09.117 INFO:teuthology.orchestra.run.smithi187.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T17:16:09.187 INFO:teuthology.orchestra.run.smithi098.stdout:Building dependency tree... 2024-09-12T17:16:09.187 INFO:teuthology.orchestra.run.smithi098.stdout:Reading state information... 2024-09-12T17:16:09.296 INFO:teuthology.orchestra.run.smithi187.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:16:09.297 INFO:teuthology.orchestra.run.smithi187.stdout:Need to get 113 MB of archives. 2024-09-12T17:16:09.297 INFO:teuthology.orchestra.run.smithi187.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T17:16:09.297 INFO:teuthology.orchestra.run.smithi187.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T17:16:09.355 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:16:09.355 INFO:teuthology.orchestra.run.smithi098.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:16:09.355 INFO:teuthology.orchestra.run.smithi098.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:16:09.356 INFO:teuthology.orchestra.run.smithi098.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:16:09.356 INFO:teuthology.orchestra.run.smithi098.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T17:16:09.356 INFO:teuthology.orchestra.run.smithi098.stdout: python2.7-minimal 2024-09-12T17:16:09.356 INFO:teuthology.orchestra.run.smithi098.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:16:09.357 INFO:teuthology.orchestra.run.smithi098.stdout:The following additional packages will be installed: 2024-09-12T17:16:09.357 INFO:teuthology.orchestra.run.smithi098.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:16:09.357 INFO:teuthology.orchestra.run.smithi098.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T17:16:09.361 INFO:teuthology.orchestra.run.smithi098.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T17:16:09.361 INFO:teuthology.orchestra.run.smithi098.stdout:Suggested packages: 2024-09-12T17:16:09.361 INFO:teuthology.orchestra.run.smithi098.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T17:16:09.361 INFO:teuthology.orchestra.run.smithi098.stdout:Recommended packages: 2024-09-12T17:16:09.361 INFO:teuthology.orchestra.run.smithi098.stdout: thermald 2024-09-12T17:16:09.401 INFO:teuthology.orchestra.run.smithi098.stdout:The following NEW packages will be installed: 2024-09-12T17:16:09.401 INFO:teuthology.orchestra.run.smithi098.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T17:16:09.401 INFO:teuthology.orchestra.run.smithi098.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T17:16:09.402 INFO:teuthology.orchestra.run.smithi098.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T17:16:09.403 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages will be upgraded: 2024-09-12T17:16:09.403 INFO:teuthology.orchestra.run.smithi098.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T17:16:09.581 INFO:teuthology.orchestra.run.smithi098.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:16:09.582 INFO:teuthology.orchestra.run.smithi098.stdout:Need to get 113 MB of archives. 2024-09-12T17:16:09.582 INFO:teuthology.orchestra.run.smithi098.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T17:16:09.582 INFO:teuthology.orchestra.run.smithi098.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T17:16:10.713 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T17:16:11.061 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T17:16:11.075 INFO:teuthology.orchestra.run.smithi098.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T17:16:11.424 INFO:teuthology.orchestra.run.smithi098.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T17:16:13.260 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T17:16:13.260 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T17:16:13.260 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T17:16:13.652 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T17:16:13.652 INFO:teuthology.orchestra.run.smithi098.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T17:16:13.653 INFO:teuthology.orchestra.run.smithi098.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T17:16:13.653 INFO:teuthology.orchestra.run.smithi098.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T17:16:13.704 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T17:16:14.012 INFO:teuthology.orchestra.run.smithi098.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T17:16:14.097 INFO:teuthology.orchestra.run.smithi098.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T17:16:14.129 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 113 MB in 5s (24.7 MB/s) 2024-09-12T17:16:14.301 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T17:16:14.509 INFO:teuthology.orchestra.run.smithi098.stdout:Fetched 113 MB in 5s (24.2 MB/s) 2024-09-12T17:16:14.688 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T17:16:16.306 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T17:16:16.311 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:16:16.382 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:16:16.649 INFO:teuthology.orchestra.run.smithi098.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T17:16:16.653 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:16:16.720 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:16:18.933 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T17:16:18.954 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:16:19.048 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:16:19.089 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T17:16:19.110 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:16:19.289 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:16:19.513 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T17:16:19.534 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:16:19.571 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:16:20.034 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T17:16:20.055 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:16:20.092 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:16:25.799 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:16:25.926 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:16:26.276 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:16:26.405 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:16:26.708 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T17:16:26.719 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T17:16:26.749 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T17:16:26.787 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:16:26.912 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:16:27.219 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:16:27.340 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:16:27.652 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T17:16:27.674 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T17:16:27.718 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T17:16:32.336 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T17:16:32.373 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:16:32.427 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:16:33.249 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T17:16:33.286 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T17:16:33.324 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:16:35.040 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:16:35.163 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:16:35.504 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T17:16:35.626 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:16:35.752 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T17:16:35.881 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:16:37.227 INFO:teuthology.orchestra.run.smithi187.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:16:37.227 INFO:teuthology.orchestra.run.smithi187.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T17:16:37.227 INFO:teuthology.orchestra.run.smithi187.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:16:37.227 INFO:teuthology.orchestra.run.smithi187.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T17:16:37.415 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:16:37.480 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T17:16:37.595 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T17:16:37.919 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T17:16:38.042 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:16:38.168 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T17:16:38.297 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:16:38.817 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:16:39.614 INFO:teuthology.orchestra.run.smithi098.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:16:39.614 INFO:teuthology.orchestra.run.smithi098.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T17:16:39.614 INFO:teuthology.orchestra.run.smithi098.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:16:39.614 INFO:teuthology.orchestra.run.smithi098.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T17:16:39.765 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:16:40.184 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T17:16:40.302 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T17:16:40.437 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:16:40.501 INFO:teuthology.orchestra.run.smithi187.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T17:16:40.501 INFO:teuthology.orchestra.run.smithi187.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:16:41.183 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:16:43.002 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T17:16:43.119 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T17:16:43.262 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T17:16:43.330 INFO:teuthology.orchestra.run.smithi098.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T17:16:43.330 INFO:teuthology.orchestra.run.smithi098.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:16:54.635 INFO:teuthology.orchestra.run.smithi187.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T17:16:54.635 INFO:teuthology.orchestra.run.smithi187.stdout:Sourcing file `/etc/default/grub' 2024-09-12T17:16:54.646 INFO:teuthology.orchestra.run.smithi187.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T17:16:54.681 INFO:teuthology.orchestra.run.smithi187.stdout:Generating grub configuration file ... 2024-09-12T17:16:55.055 INFO:teuthology.orchestra.run.smithi187.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:16:55.076 INFO:teuthology.orchestra.run.smithi187.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:16:55.458 INFO:teuthology.orchestra.run.smithi187.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:16:55.464 INFO:teuthology.orchestra.run.smithi187.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T17:16:55.536 INFO:teuthology.orchestra.run.smithi187.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T17:16:55.542 INFO:teuthology.orchestra.run.smithi187.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T17:16:55.696 INFO:teuthology.orchestra.run.smithi187.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T17:16:55.696 INFO:teuthology.orchestra.run.smithi187.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T17:16:55.696 INFO:teuthology.orchestra.run.smithi187.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T17:16:55.733 INFO:teuthology.orchestra.run.smithi187.stdout:done 2024-09-12T17:16:56.216 DEBUG:teuthology.orchestra.run.smithi187:> dpkg -s linux-image-generic 2024-09-12T17:16:56.233 INFO:teuthology.orchestra.run.smithi187.stdout:Package: linux-image-generic 2024-09-12T17:16:56.233 INFO:teuthology.orchestra.run.smithi187.stdout:Status: install ok installed 2024-09-12T17:16:56.233 INFO:teuthology.orchestra.run.smithi187.stdout:Priority: optional 2024-09-12T17:16:56.234 INFO:teuthology.orchestra.run.smithi187.stdout:Section: kernel 2024-09-12T17:16:56.234 INFO:teuthology.orchestra.run.smithi187.stdout:Installed-Size: 21 2024-09-12T17:16:56.234 INFO:teuthology.orchestra.run.smithi187.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T17:16:56.234 INFO:teuthology.orchestra.run.smithi187.stdout:Architecture: amd64 2024-09-12T17:16:56.234 INFO:teuthology.orchestra.run.smithi187.stdout:Source: linux-meta 2024-09-12T17:16:56.235 INFO:teuthology.orchestra.run.smithi187.stdout:Version: 5.15.0.119.119 2024-09-12T17:16:56.235 INFO:teuthology.orchestra.run.smithi187.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T17:16:56.235 INFO:teuthology.orchestra.run.smithi187.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T17:16:56.235 INFO:teuthology.orchestra.run.smithi187.stdout:Recommends: thermald 2024-09-12T17:16:56.235 INFO:teuthology.orchestra.run.smithi187.stdout:Description: Generic Linux kernel image 2024-09-12T17:16:56.235 INFO:teuthology.orchestra.run.smithi187.stdout: This package will always depend on the latest generic kernel image 2024-09-12T17:16:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: available. 2024-09-12T17:16:56.236 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T17:16:56.236 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:16:56.236 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:16:56.237 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T17:16:56.237 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi187.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:16:56.237 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get clean 2024-09-12T17:16:56.434 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get update 2024-09-12T17:16:56.689 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:16:56.689 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:16:56.761 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:16:56.842 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:16:57.488 INFO:teuthology.orchestra.run.smithi098.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T17:16:57.488 INFO:teuthology.orchestra.run.smithi098.stdout:Sourcing file `/etc/default/grub' 2024-09-12T17:16:57.501 INFO:teuthology.orchestra.run.smithi098.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T17:16:57.525 INFO:teuthology.orchestra.run.smithi098.stdout:Generating grub configuration file ... 2024-09-12T17:16:57.808 INFO:teuthology.orchestra.run.smithi098.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:16:57.830 INFO:teuthology.orchestra.run.smithi098.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:16:58.106 INFO:teuthology.orchestra.run.smithi098.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:16:58.110 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-12T17:16:58.112 INFO:teuthology.orchestra.run.smithi098.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T17:16:58.129 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:16:58.174 INFO:teuthology.orchestra.run.smithi098.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T17:16:58.180 INFO:teuthology.orchestra.run.smithi098.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T17:16:58.190 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-12T17:16:58.345 INFO:teuthology.orchestra.run.smithi098.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T17:16:58.345 INFO:teuthology.orchestra.run.smithi098.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T17:16:58.345 INFO:teuthology.orchestra.run.smithi098.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T17:16:58.383 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2024-09-12T17:16:58.384 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2024-09-12T17:16:58.394 INFO:teuthology.orchestra.run.smithi098.stdout:done 2024-09-12T17:16:58.549 INFO:teuthology.orchestra.run.smithi187.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T17:16:58.550 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:16:58.550 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:16:58.550 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:16:58.550 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:16:58.553 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:16:58.553 INFO:teuthology.orchestra.run.smithi187.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:16:58.553 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:16:58.591 INFO:teuthology.orchestra.run.smithi187.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:16:58.592 DEBUG:teuthology.orchestra.run.smithi187:> dpkg -s linux-image-generic 2024-09-12T17:16:58.607 INFO:teuthology.orchestra.run.smithi187.stdout:Package: linux-image-generic 2024-09-12T17:16:58.607 INFO:teuthology.orchestra.run.smithi187.stdout:Status: install ok installed 2024-09-12T17:16:58.608 INFO:teuthology.orchestra.run.smithi187.stdout:Priority: optional 2024-09-12T17:16:58.608 INFO:teuthology.orchestra.run.smithi187.stdout:Section: kernel 2024-09-12T17:16:58.608 INFO:teuthology.orchestra.run.smithi187.stdout:Installed-Size: 21 2024-09-12T17:16:58.608 INFO:teuthology.orchestra.run.smithi187.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T17:16:58.608 INFO:teuthology.orchestra.run.smithi187.stdout:Architecture: amd64 2024-09-12T17:16:58.608 INFO:teuthology.orchestra.run.smithi187.stdout:Source: linux-meta 2024-09-12T17:16:58.608 INFO:teuthology.orchestra.run.smithi187.stdout:Version: 5.15.0.119.119 2024-09-12T17:16:58.608 INFO:teuthology.orchestra.run.smithi187.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T17:16:58.608 INFO:teuthology.orchestra.run.smithi187.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T17:16:58.608 INFO:teuthology.orchestra.run.smithi187.stdout:Recommends: thermald 2024-09-12T17:16:58.608 INFO:teuthology.orchestra.run.smithi187.stdout:Description: Generic Linux kernel image 2024-09-12T17:16:58.608 INFO:teuthology.orchestra.run.smithi187.stdout: This package will always depend on the latest generic kernel image 2024-09-12T17:16:58.609 INFO:teuthology.orchestra.run.smithi187.stdout: available. 2024-09-12T17:16:58.609 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2024-09-12T17:16:58.654 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.GmSxrGDGGQ 2024-09-12T17:16:58.654 DEBUG:teuthology.orchestra.run.smithi187:> sudo cp /boot/grub/grub.cfg /tmp/tmp.GmSxrGDGGQ 2024-09-12T17:16:58.710 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.GmSxrGDGGQ 2024-09-12T17:16:58.833 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.GmSxrGDGGQ is 10KB 2024-09-12T17:16:58.846 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.GmSxrGDGGQ 2024-09-12T17:16:58.850 DEBUG:teuthology.orchestra.run.smithi098:> dpkg -s linux-image-generic 2024-09-12T17:16:58.851 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T17:16:58.870 INFO:teuthology.orchestra.run.smithi098.stdout:Package: linux-image-generic 2024-09-12T17:16:58.870 INFO:teuthology.orchestra.run.smithi098.stdout:Status: install ok installed 2024-09-12T17:16:58.870 INFO:teuthology.orchestra.run.smithi098.stdout:Priority: optional 2024-09-12T17:16:58.870 INFO:teuthology.orchestra.run.smithi098.stdout:Section: kernel 2024-09-12T17:16:58.870 INFO:teuthology.orchestra.run.smithi098.stdout:Installed-Size: 21 2024-09-12T17:16:58.870 INFO:teuthology.orchestra.run.smithi098.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T17:16:58.871 INFO:teuthology.orchestra.run.smithi098.stdout:Architecture: amd64 2024-09-12T17:16:58.871 INFO:teuthology.orchestra.run.smithi098.stdout:Source: linux-meta 2024-09-12T17:16:58.871 INFO:teuthology.orchestra.run.smithi098.stdout:Version: 5.15.0.119.119 2024-09-12T17:16:58.871 INFO:teuthology.orchestra.run.smithi098.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T17:16:58.871 INFO:teuthology.orchestra.run.smithi098.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T17:16:58.871 INFO:teuthology.orchestra.run.smithi098.stdout:Recommends: thermald 2024-09-12T17:16:58.871 INFO:teuthology.orchestra.run.smithi098.stdout:Description: Generic Linux kernel image 2024-09-12T17:16:58.871 INFO:teuthology.orchestra.run.smithi098.stdout: This package will always depend on the latest generic kernel image 2024-09-12T17:16:58.872 INFO:teuthology.orchestra.run.smithi098.stdout: available. 2024-09-12T17:16:58.872 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T17:16:58.872 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T17:16:58.872 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T17:16:58.872 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T17:16:58.872 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi098.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T17:16:58.873 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-get clean 2024-09-12T17:16:58.905 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T17:16:58.905 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T17:16:58.905 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T17:16:58.972 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T17:16:58.973 DEBUG:teuthology.orchestra.run.smithi187:> sudo update-grub 2024-09-12T17:16:59.048 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-get update 2024-09-12T17:16:59.313 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:16:59.314 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:16:59.372 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:16:59.454 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:17:00.283 INFO:teuthology.orchestra.run.smithi187.stderr:Sourcing file `/etc/default/grub' 2024-09-12T17:17:00.284 INFO:teuthology.orchestra.run.smithi187.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T17:17:00.286 INFO:teuthology.orchestra.run.smithi187.stderr:Generating grub configuration file ... 2024-09-12T17:17:00.548 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:17:00.553 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:17:00.681 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-12T17:17:00.699 DEBUG:teuthology.orchestra.run.smithi098:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T17:17:00.762 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-12T17:17:00.842 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:17:00.848 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T17:17:00.888 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T17:17:00.894 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T17:17:00.968 INFO:teuthology.orchestra.run.smithi098.stdout:Building dependency tree... 2024-09-12T17:17:00.969 INFO:teuthology.orchestra.run.smithi098.stdout:Reading state information... 2024-09-12T17:17:01.053 INFO:teuthology.orchestra.run.smithi187.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T17:17:01.054 INFO:teuthology.orchestra.run.smithi187.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T17:17:01.054 INFO:teuthology.orchestra.run.smithi187.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T17:17:01.075 INFO:teuthology.orchestra.run.smithi187.stderr:done 2024-09-12T17:17:01.084 DEBUG:teuthology.orchestra.run.smithi187:> sudo shutdown -r now 2024-09-12T17:17:01.148 INFO:teuthology.orchestra.run.smithi098.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T17:17:01.148 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:17:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:17:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:17:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:17:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:17:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:17:01.149 INFO:teuthology.orchestra.run.smithi098.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:17:01.189 INFO:teuthology.orchestra.run.smithi098.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T17:17:01.191 DEBUG:teuthology.orchestra.run.smithi098:> dpkg -s linux-image-generic 2024-09-12T17:17:01.203 INFO:teuthology.orchestra.run.smithi098.stdout:Package: linux-image-generic 2024-09-12T17:17:01.203 INFO:teuthology.orchestra.run.smithi098.stdout:Status: install ok installed 2024-09-12T17:17:01.203 INFO:teuthology.orchestra.run.smithi098.stdout:Priority: optional 2024-09-12T17:17:01.203 INFO:teuthology.orchestra.run.smithi098.stdout:Section: kernel 2024-09-12T17:17:01.203 INFO:teuthology.orchestra.run.smithi098.stdout:Installed-Size: 21 2024-09-12T17:17:01.204 INFO:teuthology.orchestra.run.smithi098.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T17:17:01.204 INFO:teuthology.orchestra.run.smithi098.stdout:Architecture: amd64 2024-09-12T17:17:01.204 INFO:teuthology.orchestra.run.smithi098.stdout:Source: linux-meta 2024-09-12T17:17:01.204 INFO:teuthology.orchestra.run.smithi098.stdout:Version: 5.15.0.119.119 2024-09-12T17:17:01.204 INFO:teuthology.orchestra.run.smithi098.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T17:17:01.204 INFO:teuthology.orchestra.run.smithi098.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T17:17:01.204 INFO:teuthology.orchestra.run.smithi098.stdout:Recommends: thermald 2024-09-12T17:17:01.204 INFO:teuthology.orchestra.run.smithi098.stdout:Description: Generic Linux kernel image 2024-09-12T17:17:01.204 INFO:teuthology.orchestra.run.smithi098.stdout: This package will always depend on the latest generic kernel image 2024-09-12T17:17:01.204 INFO:teuthology.orchestra.run.smithi098.stdout: available. 2024-09-12T17:17:01.205 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2024-09-12T17:17:01.250 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.vBT5q2JZ4A 2024-09-12T17:17:01.250 DEBUG:teuthology.orchestra.run.smithi098:> sudo cp /boot/grub/grub.cfg /tmp/tmp.vBT5q2JZ4A 2024-09-12T17:17:01.303 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.vBT5q2JZ4A 2024-09-12T17:17:01.419 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.vBT5q2JZ4A is 10KB 2024-09-12T17:17:01.473 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.vBT5q2JZ4A 2024-09-12T17:17:01.478 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T17:17:01.535 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:17:01.535 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T17:17:01.535 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T17:17:01.611 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T17:17:01.612 DEBUG:teuthology.orchestra.run.smithi098:> sudo update-grub 2024-09-12T17:17:02.924 INFO:teuthology.orchestra.run.smithi098.stderr:Sourcing file `/etc/default/grub' 2024-09-12T17:17:02.925 INFO:teuthology.orchestra.run.smithi098.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T17:17:02.927 INFO:teuthology.orchestra.run.smithi098.stderr:Generating grub configuration file ... 2024-09-12T17:17:03.110 INFO:teuthology.orchestra.run.smithi098.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T17:17:03.116 INFO:teuthology.orchestra.run.smithi098.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T17:17:03.337 INFO:teuthology.orchestra.run.smithi098.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T17:17:03.343 INFO:teuthology.orchestra.run.smithi098.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T17:17:03.386 INFO:teuthology.orchestra.run.smithi098.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T17:17:03.391 INFO:teuthology.orchestra.run.smithi098.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T17:17:03.537 INFO:teuthology.orchestra.run.smithi098.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T17:17:03.537 INFO:teuthology.orchestra.run.smithi098.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T17:17:03.538 INFO:teuthology.orchestra.run.smithi098.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T17:17:03.552 INFO:teuthology.orchestra.run.smithi098.stderr:done 2024-09-12T17:17:03.555 DEBUG:teuthology.orchestra.run.smithi098:> sudo shutdown -r now 2024-09-12T17:17:31.113 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T17:17:31.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-12T17:17:31.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:17:33.561 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T17:17:34.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-12T17:17:34.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:18:05.629 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-09-12T17:18:14.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-12T17:18:14.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:18:33.021 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-09-12T17:18:34.242 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T17:18:43.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-12T17:18:43.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:18:44.191 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-12T17:18:45.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-12T17:18:45.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:18:45.061 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-12T17:18:45.061 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-12T17:18:45.061 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-12T17:18:45.109 INFO:teuthology.orchestra.run.smithi098.stdout:5.15.0-119-generic 2024-09-12T17:18:45.109 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T17:18:45.109 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:18:45.109 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T17:18:45.282 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-09-12T17:18:45.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-12T17:18:45.871 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-12T17:18:45.871 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2024-09-12T17:18:45.917 INFO:teuthology.orchestra.run.smithi187.stdout:5.15.0-119-generic 2024-09-12T17:18:45.918 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T17:18:45.918 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:18:45.918 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T17:18:46.110 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T17:18:46.110 DEBUG:teuthology.orchestra.run.smithi098:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:18:46.666 INFO:teuthology.orchestra.run.smithi098.stdout:ttyS1 2024-09-12T17:18:46.707 DEBUG:teuthology.parallel:result is None 2024-09-12T17:18:46.918 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T17:18:46.919 DEBUG:teuthology.orchestra.run.smithi187:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:18:46.979 INFO:teuthology.orchestra.run.smithi187.stdout:ttyS1 2024-09-12T17:18:46.998 DEBUG:teuthology.parallel:result is None 2024-09-12T17:18:46.998 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T17:18:47.006 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T17:18:47.006 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:18:47.009 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:18:47.015 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T17:18:47.066 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T17:18:47.075 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T17:18:47.076 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:18:47.078 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:18:47.104 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T17:18:47.111 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T17:18:47.111 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:18:47.134 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:18:47.152 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:18:47.160 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:18:47.165 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:18:47.173 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:18:47.174 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T17:18:47.180 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T17:18:47.180 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:18:47.210 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:18:47.230 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T17:18:47.239 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T17:18:47.239 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:18:47.276 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:18:47.282 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:18:47.325 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:18:47.373 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:18:47.373 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:18:47.437 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:18:47.442 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:18:47.489 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T17:18:47.489 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:18:47.555 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2024-09-12T17:18:47.558 DEBUG:teuthology.orchestra.run.smithi187:> sudo service rsyslog restart 2024-09-12T17:18:47.634 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T17:18:47.642 INFO:teuthology.task.internal:Starting timer... 2024-09-12T17:18:47.642 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T17:18:47.654 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T17:18:47.662 DEBUG:teuthology.task.selinux:Excluding smithi098: OS 'ubuntu' does not support SELinux 2024-09-12T17:18:47.663 DEBUG:teuthology.task.selinux:Excluding smithi187: OS 'ubuntu' does not support SELinux 2024-09-12T17:18:47.663 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T17:18:47.663 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T17:18:47.663 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T17:18:47.663 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T17:18:47.671 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T17:18:47.674 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T17:18:47.793 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T17:18:47.805 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T17:18:47.806 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi098.front.sepia.ceph.com,smithi187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T17:26:14.586 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi098.front.sepia.ceph.com'), Remote(name='ubuntu@smithi187.front.sepia.ceph.com')] 2024-09-12T17:26:14.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-12T17:26:14.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:26:14.670 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-12T17:26:14.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-12T17:26:14.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-12T17:26:14.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:26:14.831 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-09-12T17:26:14.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-09-12T17:26:14.905 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T17:26:14.916 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T17:26:14.916 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:26:14.917 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:26:14.919 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:26:14.920 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:26:14.948 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:14 ntpd[18462]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T17:26:14.948 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:14 ntpd[18462]: Command line: ntpd -gq 2024-09-12T17:26:14.948 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:14 ntpd[18462]: ---------------------------------------------------- 2024-09-12T17:26:14.948 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:14 ntpd[18462]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T17:26:14.948 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:14 ntpd[18462]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T17:26:14.948 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:14 ntpd[18462]: corporation. Support and training for ntp-4 are 2024-09-12T17:26:14.948 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:14 ntpd[18462]: available at https://www.nwtime.org/support 2024-09-12T17:26:14.948 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:14 ntpd[18462]: ---------------------------------------------------- 2024-09-12T17:26:14.949 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:14 ntpd[18462]: proto: precision = 0.058 usec (-24) 2024-09-12T17:26:14.949 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:14 ntpd[18462]: basedate set to 2022-02-04 2024-09-12T17:26:14.949 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:14 ntpd[18462]: gps base set to 2022-02-06 (week 2196) 2024-09-12T17:26:14.949 INFO:teuthology.orchestra.run.smithi098.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:26:14.950 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:14 ntpd[18462]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:26:14.950 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:14 ntpd[18462]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:26:14.950 INFO:teuthology.orchestra.run.smithi098.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:26:14.951 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:14 ntpd[18462]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T17:26:14.951 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:14 ntpd[18462]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T17:26:14.951 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:14 ntpd[18462]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T17:26:14.951 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:14 ntpd[18462]: Listen normally on 3 enp3s0f1 172.21.15.98:123 2024-09-12T17:26:14.951 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:14 ntpd[18462]: Listen normally on 4 lo [::1]:123 2024-09-12T17:26:14.951 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:14 ntpd[18462]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d26b%5]:123 2024-09-12T17:26:14.951 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:14 ntpd[18462]: Listening on routing socket on fd #22 for interface updates 2024-09-12T17:26:14.977 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:14 ntpd[18472]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T17:26:14.977 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:14 ntpd[18472]: Command line: ntpd -gq 2024-09-12T17:26:14.977 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:14 ntpd[18472]: ---------------------------------------------------- 2024-09-12T17:26:14.977 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:14 ntpd[18472]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T17:26:14.977 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:14 ntpd[18472]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T17:26:14.977 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:14 ntpd[18472]: corporation. Support and training for ntp-4 are 2024-09-12T17:26:14.977 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:14 ntpd[18472]: available at https://www.nwtime.org/support 2024-09-12T17:26:14.977 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:14 ntpd[18472]: ---------------------------------------------------- 2024-09-12T17:26:14.978 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:14 ntpd[18472]: proto: precision = 0.046 usec (-24) 2024-09-12T17:26:14.978 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:14 ntpd[18472]: basedate set to 2022-02-04 2024-09-12T17:26:14.978 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:14 ntpd[18472]: gps base set to 2022-02-06 (week 2196) 2024-09-12T17:26:14.978 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:14 ntpd[18472]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:26:14.979 INFO:teuthology.orchestra.run.smithi187.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:26:14.979 INFO:teuthology.orchestra.run.smithi187.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:26:14.980 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:14 ntpd[18472]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:26:14.980 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:14 ntpd[18472]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T17:26:14.980 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:14 ntpd[18472]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T17:26:14.980 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:14 ntpd[18472]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T17:26:14.980 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:14 ntpd[18472]: Listen normally on 3 enp3s0f1 172.21.15.187:123 2024-09-12T17:26:14.980 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:14 ntpd[18472]: Listen normally on 4 lo [::1]:123 2024-09-12T17:26:14.980 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:14 ntpd[18472]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:77b1%5]:123 2024-09-12T17:26:14.980 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:14 ntpd[18472]: Listening on routing socket on fd #22 for interface updates 2024-09-12T17:26:15.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:15 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:15.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:15 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:15.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:15 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:15.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:15 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:15.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:15 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:15.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:15 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:15.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:15 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:26:15.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:15 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:26:15.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:15 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:15.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:15 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:15.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:15 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:26:15.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:15 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:26:16.948 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:16 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:16.948 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:16 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:16.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:16 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:16.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:16 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:16.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:16 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:26:16.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:16 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:26:17.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:17 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:17.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:17 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:17.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:17 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:17.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:17 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:17.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:17 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:17.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:17 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:17.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:17 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:26:17.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:17 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:26:17.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:17 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:17.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:17 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:17.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:17 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:26:17.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:17 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:26:17.977 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:17 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:17.977 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:17 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:18.948 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:18 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:18.948 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:18 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:18.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:18 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:18.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:18 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:18.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:18 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:26:18.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:18 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:26:18.977 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:18 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:18.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:18 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:18.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:18 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:18.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:18 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:18.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:18 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:26:18.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:18 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:26:19.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:19 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:19.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:19 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:19.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:19 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:19.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:19 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:19.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:19 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:19.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:19 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:19.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:19 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:19.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:19 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:19.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:19 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:26:19.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:19 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:26:19.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:19 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:19.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:19 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:19.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:19 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:26:19.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:19 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:26:19.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:19 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:19.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:19 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:19.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:19 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:19.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:19 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:19.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:19 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:19.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:19 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:19.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:19 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:26:19.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:19 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:26:19.979 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:19 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:19.979 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:19 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:19.979 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:19 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:26:19.979 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:19 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:26:20.948 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:20 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:20.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:20 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:20.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:20 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:20.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:20 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:20.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:20 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:26:20.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:20 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:26:20.977 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:20 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:20.977 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:20 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:20.977 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:20 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:20.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:20 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:20.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:20 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:26:20.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:20 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:26:21.948 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:21 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:21.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:21 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:21.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:21 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:21.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:21 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:21.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:21 ntpd[18462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:21.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:21 ntpd[18462]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:21.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:21 ntpd[18462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:26:21.949 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:21 ntpd[18462]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:26:21.949 INFO:teuthology.orchestra.run.smithi098.stdout:12 Sep 17:26:21 ntpd[18462]: ntpd: time slew -0.000039 s 2024-09-12T17:26:21.949 INFO:teuthology.orchestra.run.smithi098.stdout:ntpd: time slew -0.000039s 2024-09-12T17:26:21.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:21 ntpd[18462]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T17:26:21.950 INFO:teuthology.orchestra.run.smithi098.stderr:12 Sep 17:26:21 ntpd[18462]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T17:26:21.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:21 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:21.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:21 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:21.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:21 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:21.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:21 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:21.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:21 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:21.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:21 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:21.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:21 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:26:21.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:21 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:26:21.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:21 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:21.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:21 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:21.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:21 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:26:21.979 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:21 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:26:21.998 INFO:teuthology.orchestra.run.smithi098.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:26:21.998 INFO:teuthology.orchestra.run.smithi098.stdout:============================================================================== 2024-09-12T17:26:21.998 INFO:teuthology.orchestra.run.smithi098.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:26:21.998 INFO:teuthology.orchestra.run.smithi098.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:26:21.998 INFO:teuthology.orchestra.run.smithi098.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:26:21.998 INFO:teuthology.orchestra.run.smithi098.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:26:22.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:22 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:22.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:22 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:22.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:22 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:22.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:22 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:22.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:22 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:26:22.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:22 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:26:23.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:23 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:23.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:23 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:23.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:23 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:23.979 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:23 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:23.979 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:23 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:23.979 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:23 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:23.979 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:23 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:26:23.979 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:23 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:26:23.979 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:23 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:23.979 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:23 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:23.979 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:23 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:26:23.979 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:23 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:26:24.977 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:24 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:24.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:24 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:24.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:24 ntpd[18472]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:26:24.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:24 ntpd[18472]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:26:24.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:24 ntpd[18472]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:26:24.978 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:24 ntpd[18472]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:26:24.978 INFO:teuthology.orchestra.run.smithi187.stdout:12 Sep 17:26:24 ntpd[18472]: ntpd: time slew -0.000877 s 2024-09-12T17:26:24.978 INFO:teuthology.orchestra.run.smithi187.stdout:ntpd: time slew -0.000877s 2024-09-12T17:26:24.979 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:24 ntpd[18472]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T17:26:24.979 INFO:teuthology.orchestra.run.smithi187.stderr:12 Sep 17:26:24 ntpd[18472]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T17:26:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:26:25.034 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================== 2024-09-12T17:26:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:26:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:26:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:26:25.034 INFO:teuthology.orchestra.run.smithi187.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:26:25.035 INFO:teuthology.run_tasks:Running task install... 2024-09-12T17:26:25.045 DEBUG:teuthology.task.install:project ceph 2024-09-12T17:26:25.046 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}} 2024-09-12T17:26:25.046 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'} 2024-09-12T17:26:25.046 INFO:teuthology.task.install:Using flavor: default 2024-09-12T17:26:25.052 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T17:26:25.052 INFO:teuthology.task.install:extra packages: [] 2024-09-12T17:26:25.053 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-key list | grep Ceph 2024-09-12T17:26:25.053 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-key list | grep Ceph 2024-09-12T17:26:25.118 INFO:teuthology.orchestra.run.smithi098.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T17:26:25.128 INFO:teuthology.orchestra.run.smithi187.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T17:26:25.147 INFO:teuthology.orchestra.run.smithi098.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T17:26:25.147 INFO:teuthology.orchestra.run.smithi098.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T17:26:25.148 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T17:26:25.148 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T17:26:25.149 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:26:25.158 INFO:teuthology.orchestra.run.smithi187.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T17:26:25.158 INFO:teuthology.orchestra.run.smithi187.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T17:26:25.158 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T17:26:25.158 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T17:26:25.158 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:26:25.295 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default/ 2024-09-12T17:26:25.295 INFO:teuthology.task.install.deb:Package version is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:26:25.306 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default/ 2024-09-12T17:26:25.306 INFO:teuthology.task.install.deb:Package version is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:26:25.413 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:26:25.413 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T17:26:25.416 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T17:26:25.416 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T17:26:25.429 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get update 2024-09-12T17:26:25.430 DEBUG:teuthology.orchestra.run.smithi098:> sudo apt-get update 2024-09-12T17:26:25.594 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:26:25.604 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:26:25.622 INFO:teuthology.orchestra.run.smithi098.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:26:25.649 INFO:teuthology.orchestra.run.smithi098.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T17:26:25.651 INFO:teuthology.orchestra.run.smithi187.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T17:26:25.671 INFO:teuthology.orchestra.run.smithi098.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-12T17:26:25.672 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-12T17:26:25.693 INFO:teuthology.orchestra.run.smithi098.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T17:26:25.695 INFO:teuthology.orchestra.run.smithi187.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T17:26:25.714 INFO:teuthology.orchestra.run.smithi098.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-12T17:26:25.719 INFO:teuthology.orchestra.run.smithi098.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T17:26:25.726 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:26:25.726 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:26:25.726 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-12T17:26:25.740 INFO:teuthology.orchestra.run.smithi098.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T17:26:25.757 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T17:26:25.798 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T17:26:26.153 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:26:26.174 INFO:teuthology.orchestra.run.smithi098.stdout:Fetched 158 kB in 1s (280 kB/s) 2024-09-12T17:26:26.315 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 157 kB in 1s (223 kB/s) 2024-09-12T17:26:27.165 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-12T17:26:27.181 DEBUG:teuthology.orchestra.run.smithi098:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4762-gbad475c1-1jammy cephadm=19.3.0-4762-gbad475c1-1jammy ceph-mds=19.3.0-4762-gbad475c1-1jammy ceph-mgr=19.3.0-4762-gbad475c1-1jammy ceph-common=19.3.0-4762-gbad475c1-1jammy ceph-fuse=19.3.0-4762-gbad475c1-1jammy ceph-test=19.3.0-4762-gbad475c1-1jammy ceph-volume=19.3.0-4762-gbad475c1-1jammy radosgw=19.3.0-4762-gbad475c1-1jammy python3-rados=19.3.0-4762-gbad475c1-1jammy python3-rgw=19.3.0-4762-gbad475c1-1jammy python3-cephfs=19.3.0-4762-gbad475c1-1jammy python3-rbd=19.3.0-4762-gbad475c1-1jammy libcephfs2=19.3.0-4762-gbad475c1-1jammy libcephfs-dev=19.3.0-4762-gbad475c1-1jammy librados2=19.3.0-4762-gbad475c1-1jammy librbd1=19.3.0-4762-gbad475c1-1jammy rbd-fuse=19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:26:27.243 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-12T17:26:27.343 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-12T17:26:27.360 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4762-gbad475c1-1jammy cephadm=19.3.0-4762-gbad475c1-1jammy ceph-mds=19.3.0-4762-gbad475c1-1jammy ceph-mgr=19.3.0-4762-gbad475c1-1jammy ceph-common=19.3.0-4762-gbad475c1-1jammy ceph-fuse=19.3.0-4762-gbad475c1-1jammy ceph-test=19.3.0-4762-gbad475c1-1jammy ceph-volume=19.3.0-4762-gbad475c1-1jammy radosgw=19.3.0-4762-gbad475c1-1jammy python3-rados=19.3.0-4762-gbad475c1-1jammy python3-rgw=19.3.0-4762-gbad475c1-1jammy python3-cephfs=19.3.0-4762-gbad475c1-1jammy python3-rbd=19.3.0-4762-gbad475c1-1jammy libcephfs2=19.3.0-4762-gbad475c1-1jammy libcephfs-dev=19.3.0-4762-gbad475c1-1jammy librados2=19.3.0-4762-gbad475c1-1jammy librbd1=19.3.0-4762-gbad475c1-1jammy rbd-fuse=19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:26:27.414 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-12T17:26:27.450 INFO:teuthology.orchestra.run.smithi098.stdout:Building dependency tree... 2024-09-12T17:26:27.451 INFO:teuthology.orchestra.run.smithi098.stdout:Reading state information... 2024-09-12T17:26:27.601 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2024-09-12T17:26:27.601 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2024-09-12T17:26:27.640 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:26:27.640 INFO:teuthology.orchestra.run.smithi098.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:26:27.640 INFO:teuthology.orchestra.run.smithi098.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:26:27.640 INFO:teuthology.orchestra.run.smithi098.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:26:27.641 INFO:teuthology.orchestra.run.smithi098.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:26:27.641 INFO:teuthology.orchestra.run.smithi098.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:26:27.641 INFO:teuthology.orchestra.run.smithi098.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:26:27.643 INFO:teuthology.orchestra.run.smithi098.stdout:The following additional packages will be installed: 2024-09-12T17:26:27.643 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T17:26:27.643 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T17:26:27.643 INFO:teuthology.orchestra.run.smithi098.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T17:26:27.643 INFO:teuthology.orchestra.run.smithi098.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T17:26:27.643 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T17:26:27.643 INFO:teuthology.orchestra.run.smithi098.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T17:26:27.643 INFO:teuthology.orchestra.run.smithi098.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T17:26:27.643 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T17:26:27.643 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T17:26:27.643 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:26:27.644 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:26:27.644 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:26:27.644 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:26:27.644 INFO:teuthology.orchestra.run.smithi098.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:26:27.644 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:26:27.644 INFO:teuthology.orchestra.run.smithi098.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:26:27.644 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T17:26:27.644 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T17:26:27.644 INFO:teuthology.orchestra.run.smithi098.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T17:26:27.644 INFO:teuthology.orchestra.run.smithi098.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T17:26:27.644 INFO:teuthology.orchestra.run.smithi098.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T17:26:27.644 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T17:26:27.644 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T17:26:27.645 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet zip 2024-09-12T17:26:27.645 INFO:teuthology.orchestra.run.smithi098.stdout:Suggested packages: 2024-09-12T17:26:27.645 INFO:teuthology.orchestra.run.smithi098.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T17:26:27.645 INFO:teuthology.orchestra.run.smithi098.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T17:26:27.645 INFO:teuthology.orchestra.run.smithi098.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T17:26:27.645 INFO:teuthology.orchestra.run.smithi098.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T17:26:27.645 INFO:teuthology.orchestra.run.smithi098.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T17:26:27.645 INFO:teuthology.orchestra.run.smithi098.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T17:26:27.645 INFO:teuthology.orchestra.run.smithi098.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T17:26:27.645 INFO:teuthology.orchestra.run.smithi098.stdout:Recommended packages: 2024-09-12T17:26:27.646 INFO:teuthology.orchestra.run.smithi098.stdout: btrfs-tools 2024-09-12T17:26:27.745 INFO:teuthology.orchestra.run.smithi098.stdout:The following NEW packages will be installed: 2024-09-12T17:26:27.746 INFO:teuthology.orchestra.run.smithi098.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T17:26:27.746 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T17:26:27.746 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T17:26:27.746 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T17:26:27.746 INFO:teuthology.orchestra.run.smithi098.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T17:26:27.746 INFO:teuthology.orchestra.run.smithi098.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T17:26:27.747 INFO:teuthology.orchestra.run.smithi098.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T17:26:27.747 INFO:teuthology.orchestra.run.smithi098.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi098.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi098.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi098.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T17:26:27.748 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T17:26:27.749 INFO:teuthology.orchestra.run.smithi098.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T17:26:27.749 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T17:26:27.749 INFO:teuthology.orchestra.run.smithi098.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T17:26:27.749 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T17:26:27.749 INFO:teuthology.orchestra.run.smithi098.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T17:26:27.788 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:26:27.789 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:26:27.789 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:26:27.789 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:26:27.789 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:26:27.790 INFO:teuthology.orchestra.run.smithi187.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:26:27.790 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:26:27.790 INFO:teuthology.orchestra.run.smithi187.stdout:The following additional packages will be installed: 2024-09-12T17:26:27.790 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T17:26:27.790 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T17:26:27.790 INFO:teuthology.orchestra.run.smithi187.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T17:26:27.790 INFO:teuthology.orchestra.run.smithi187.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T17:26:27.791 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T17:26:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T17:26:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T17:26:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T17:26:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T17:26:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:26:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:26:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:26:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:26:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:26:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:26:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:26:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T17:26:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T17:26:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T17:26:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T17:26:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T17:26:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T17:26:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T17:26:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet zip 2024-09-12T17:26:27.793 INFO:teuthology.orchestra.run.smithi187.stdout:Suggested packages: 2024-09-12T17:26:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T17:26:27.794 INFO:teuthology.orchestra.run.smithi187.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T17:26:27.794 INFO:teuthology.orchestra.run.smithi187.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T17:26:27.794 INFO:teuthology.orchestra.run.smithi187.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T17:26:27.794 INFO:teuthology.orchestra.run.smithi187.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T17:26:27.794 INFO:teuthology.orchestra.run.smithi187.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T17:26:27.794 INFO:teuthology.orchestra.run.smithi187.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T17:26:27.794 INFO:teuthology.orchestra.run.smithi187.stdout:Recommended packages: 2024-09-12T17:26:27.794 INFO:teuthology.orchestra.run.smithi187.stdout: btrfs-tools 2024-09-12T17:26:27.805 INFO:teuthology.orchestra.run.smithi098.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:26:27.805 INFO:teuthology.orchestra.run.smithi098.stdout:Need to get 243 MB of archives. 2024-09-12T17:26:27.805 INFO:teuthology.orchestra.run.smithi098.stdout:After this operation, 908 MB of additional disk space will be used. 2024-09-12T17:26:27.805 INFO:teuthology.orchestra.run.smithi098.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T17:26:27.889 INFO:teuthology.orchestra.run.smithi098.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4762-gbad475c1-1jammy [3,629 kB] 2024-09-12T17:26:27.895 INFO:teuthology.orchestra.run.smithi187.stdout:The following NEW packages will be installed: 2024-09-12T17:26:27.895 INFO:teuthology.orchestra.run.smithi187.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T17:26:27.895 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T17:26:27.896 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T17:26:27.896 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T17:26:27.896 INFO:teuthology.orchestra.run.smithi187.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T17:26:27.896 INFO:teuthology.orchestra.run.smithi187.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T17:26:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T17:26:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T17:26:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T17:26:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T17:26:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T17:26:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:26:27.897 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:26:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:26:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:26:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:26:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:26:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:26:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T17:26:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T17:26:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T17:26:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T17:26:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T17:26:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T17:26:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T17:26:27.898 INFO:teuthology.orchestra.run.smithi187.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T17:26:27.899 INFO:teuthology.orchestra.run.smithi098.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T17:26:27.901 INFO:teuthology.orchestra.run.smithi098.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T17:26:27.919 INFO:teuthology.orchestra.run.smithi098.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T17:26:27.957 INFO:teuthology.orchestra.run.smithi187.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:26:27.957 INFO:teuthology.orchestra.run.smithi187.stdout:Need to get 243 MB of archives. 2024-09-12T17:26:27.957 INFO:teuthology.orchestra.run.smithi187.stdout:After this operation, 908 MB of additional disk space will be used. 2024-09-12T17:26:27.957 INFO:teuthology.orchestra.run.smithi187.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T17:26:27.980 INFO:teuthology.orchestra.run.smithi098.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T17:26:27.985 INFO:teuthology.orchestra.run.smithi098.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T17:26:27.997 INFO:teuthology.orchestra.run.smithi098.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T17:26:28.001 INFO:teuthology.orchestra.run.smithi098.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T17:26:28.002 INFO:teuthology.orchestra.run.smithi098.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T17:26:28.003 INFO:teuthology.orchestra.run.smithi098.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T17:26:28.011 INFO:teuthology.orchestra.run.smithi098.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T17:26:28.013 INFO:teuthology.orchestra.run.smithi098.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T17:26:28.015 INFO:teuthology.orchestra.run.smithi098.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T17:26:28.016 INFO:teuthology.orchestra.run.smithi098.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T17:26:28.018 INFO:teuthology.orchestra.run.smithi098.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T17:26:28.034 INFO:teuthology.orchestra.run.smithi098.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T17:26:28.036 INFO:teuthology.orchestra.run.smithi098.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T17:26:28.038 INFO:teuthology.orchestra.run.smithi098.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T17:26:28.039 INFO:teuthology.orchestra.run.smithi098.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T17:26:28.039 INFO:teuthology.orchestra.run.smithi098.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T17:26:28.040 INFO:teuthology.orchestra.run.smithi098.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T17:26:28.040 INFO:teuthology.orchestra.run.smithi098.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T17:26:28.041 INFO:teuthology.orchestra.run.smithi098.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T17:26:28.041 INFO:teuthology.orchestra.run.smithi098.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T17:26:28.045 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4762-gbad475c1-1jammy [3,629 kB] 2024-09-12T17:26:28.045 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T17:26:28.048 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T17:26:28.053 INFO:teuthology.orchestra.run.smithi098.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T17:26:28.059 INFO:teuthology.orchestra.run.smithi098.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T17:26:28.059 INFO:teuthology.orchestra.run.smithi098.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T17:26:28.062 INFO:teuthology.orchestra.run.smithi098.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T17:26:28.063 INFO:teuthology.orchestra.run.smithi098.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T17:26:28.063 INFO:teuthology.orchestra.run.smithi098.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T17:26:28.064 INFO:teuthology.orchestra.run.smithi098.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T17:26:28.064 INFO:teuthology.orchestra.run.smithi098.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T17:26:28.065 INFO:teuthology.orchestra.run.smithi098.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T17:26:28.065 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T17:26:28.071 INFO:teuthology.orchestra.run.smithi098.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T17:26:28.081 INFO:teuthology.orchestra.run.smithi098.stdout:Get:36 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4762-gbad475c1-1jammy [3,322 kB] 2024-09-12T17:26:28.083 INFO:teuthology.orchestra.run.smithi098.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T17:26:28.084 INFO:teuthology.orchestra.run.smithi098.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T17:26:28.084 INFO:teuthology.orchestra.run.smithi098.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T17:26:28.089 INFO:teuthology.orchestra.run.smithi098.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T17:26:28.090 INFO:teuthology.orchestra.run.smithi098.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T17:26:28.090 INFO:teuthology.orchestra.run.smithi098.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T17:26:28.091 INFO:teuthology.orchestra.run.smithi098.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T17:26:28.092 INFO:teuthology.orchestra.run.smithi098.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T17:26:28.094 INFO:teuthology.orchestra.run.smithi098.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T17:26:28.104 INFO:teuthology.orchestra.run.smithi098.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T17:26:28.106 INFO:teuthology.orchestra.run.smithi098.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T17:26:28.106 INFO:teuthology.orchestra.run.smithi098.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T17:26:28.122 INFO:teuthology.orchestra.run.smithi098.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T17:26:28.122 INFO:teuthology.orchestra.run.smithi098.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T17:26:28.123 INFO:teuthology.orchestra.run.smithi098.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T17:26:28.126 INFO:teuthology.orchestra.run.smithi098.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T17:26:28.127 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T17:26:28.129 INFO:teuthology.orchestra.run.smithi098.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4762-gbad475c1-1jammy [721 kB] 2024-09-12T17:26:28.132 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T17:26:28.140 INFO:teuthology.orchestra.run.smithi098.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4762-gbad475c1-1jammy [357 kB] 2024-09-12T17:26:28.144 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T17:26:28.146 INFO:teuthology.orchestra.run.smithi098.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4762-gbad475c1-1jammy [32.8 kB] 2024-09-12T17:26:28.146 INFO:teuthology.orchestra.run.smithi098.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4762-gbad475c1-1jammy [180 kB] 2024-09-12T17:26:28.148 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T17:26:28.148 INFO:teuthology.orchestra.run.smithi187.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T17:26:28.149 INFO:teuthology.orchestra.run.smithi187.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T17:26:28.149 INFO:teuthology.orchestra.run.smithi098.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4762-gbad475c1-1jammy [71.2 kB] 2024-09-12T17:26:28.150 INFO:teuthology.orchestra.run.smithi098.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4762-gbad475c1-1jammy [338 kB] 2024-09-12T17:26:28.157 INFO:teuthology.orchestra.run.smithi187.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T17:26:28.158 INFO:teuthology.orchestra.run.smithi098.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4762-gbad475c1-1jammy [7,972 kB] 2024-09-12T17:26:28.159 INFO:teuthology.orchestra.run.smithi187.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T17:26:28.161 INFO:teuthology.orchestra.run.smithi187.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T17:26:28.162 INFO:teuthology.orchestra.run.smithi187.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T17:26:28.165 INFO:teuthology.orchestra.run.smithi187.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T17:26:28.170 INFO:teuthology.orchestra.run.smithi187.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T17:26:28.180 INFO:teuthology.orchestra.run.smithi187.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T17:26:28.181 INFO:teuthology.orchestra.run.smithi098.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T17:26:28.181 INFO:teuthology.orchestra.run.smithi098.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T17:26:28.182 INFO:teuthology.orchestra.run.smithi187.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T17:26:28.183 INFO:teuthology.orchestra.run.smithi098.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T17:26:28.183 INFO:teuthology.orchestra.run.smithi098.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T17:26:28.184 INFO:teuthology.orchestra.run.smithi098.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T17:26:28.185 INFO:teuthology.orchestra.run.smithi187.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T17:26:28.185 INFO:teuthology.orchestra.run.smithi187.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T17:26:28.185 INFO:teuthology.orchestra.run.smithi187.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T17:26:28.185 INFO:teuthology.orchestra.run.smithi187.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T17:26:28.185 INFO:teuthology.orchestra.run.smithi187.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T17:26:28.186 INFO:teuthology.orchestra.run.smithi187.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T17:26:28.201 INFO:teuthology.orchestra.run.smithi098.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T17:26:28.203 INFO:teuthology.orchestra.run.smithi187.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T17:26:28.203 INFO:teuthology.orchestra.run.smithi098.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T17:26:28.203 INFO:teuthology.orchestra.run.smithi098.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T17:26:28.204 INFO:teuthology.orchestra.run.smithi187.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T17:26:28.204 INFO:teuthology.orchestra.run.smithi187.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T17:26:28.206 INFO:teuthology.orchestra.run.smithi187.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T17:26:28.206 INFO:teuthology.orchestra.run.smithi187.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T17:26:28.207 INFO:teuthology.orchestra.run.smithi187.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T17:26:28.207 INFO:teuthology.orchestra.run.smithi187.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T17:26:28.208 INFO:teuthology.orchestra.run.smithi187.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T17:26:28.218 INFO:teuthology.orchestra.run.smithi098.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T17:26:28.218 INFO:teuthology.orchestra.run.smithi098.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T17:26:28.220 INFO:teuthology.orchestra.run.smithi187.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T17:26:28.220 INFO:teuthology.orchestra.run.smithi187.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T17:26:28.226 INFO:teuthology.orchestra.run.smithi098.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T17:26:28.226 INFO:teuthology.orchestra.run.smithi098.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T17:26:28.227 INFO:teuthology.orchestra.run.smithi098.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T17:26:28.228 INFO:teuthology.orchestra.run.smithi098.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T17:26:28.228 INFO:teuthology.orchestra.run.smithi098.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T17:26:28.228 INFO:teuthology.orchestra.run.smithi098.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T17:26:28.231 INFO:teuthology.orchestra.run.smithi098.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T17:26:28.237 INFO:teuthology.orchestra.run.smithi187.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T17:26:28.238 INFO:teuthology.orchestra.run.smithi187.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T17:26:28.238 INFO:teuthology.orchestra.run.smithi187.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T17:26:28.243 INFO:teuthology.orchestra.run.smithi098.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T17:26:28.244 INFO:teuthology.orchestra.run.smithi187.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T17:26:28.244 INFO:teuthology.orchestra.run.smithi187.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T17:26:28.244 INFO:teuthology.orchestra.run.smithi187.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T17:26:28.245 INFO:teuthology.orchestra.run.smithi098.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T17:26:28.245 INFO:teuthology.orchestra.run.smithi187.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T17:26:28.245 INFO:teuthology.orchestra.run.smithi098.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T17:26:28.246 INFO:teuthology.orchestra.run.smithi187.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T17:26:28.254 INFO:teuthology.orchestra.run.smithi187.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T17:26:28.255 INFO:teuthology.orchestra.run.smithi187.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T17:26:28.260 INFO:teuthology.orchestra.run.smithi098.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T17:26:28.263 INFO:teuthology.orchestra.run.smithi098.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T17:26:28.264 INFO:teuthology.orchestra.run.smithi098.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T17:26:28.264 INFO:teuthology.orchestra.run.smithi098.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T17:26:28.266 INFO:teuthology.orchestra.run.smithi187.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T17:26:28.266 INFO:teuthology.orchestra.run.smithi187.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T17:26:28.268 INFO:teuthology.orchestra.run.smithi098.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T17:26:28.269 INFO:teuthology.orchestra.run.smithi098.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T17:26:28.269 INFO:teuthology.orchestra.run.smithi187.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T17:26:28.269 INFO:teuthology.orchestra.run.smithi187.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T17:26:28.270 INFO:teuthology.orchestra.run.smithi187.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T17:26:28.271 INFO:teuthology.orchestra.run.smithi098.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T17:26:28.273 INFO:teuthology.orchestra.run.smithi187.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T17:26:28.277 INFO:teuthology.orchestra.run.smithi098.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T17:26:28.278 INFO:teuthology.orchestra.run.smithi098.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T17:26:28.278 INFO:teuthology.orchestra.run.smithi098.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T17:26:28.295 INFO:teuthology.orchestra.run.smithi098.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T17:26:28.295 INFO:teuthology.orchestra.run.smithi098.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T17:26:28.296 INFO:teuthology.orchestra.run.smithi098.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4762-gbad475c1-1jammy [112 kB] 2024-09-12T17:26:28.298 INFO:teuthology.orchestra.run.smithi098.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4762-gbad475c1-1jammy [473 kB] 2024-09-12T17:26:28.302 INFO:teuthology.orchestra.run.smithi098.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T17:26:28.303 INFO:teuthology.orchestra.run.smithi098.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T17:26:28.303 INFO:teuthology.orchestra.run.smithi098.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T17:26:28.305 INFO:teuthology.orchestra.run.smithi098.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T17:26:28.305 INFO:teuthology.orchestra.run.smithi098.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T17:26:28.326 INFO:teuthology.orchestra.run.smithi187.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T17:26:28.327 INFO:teuthology.orchestra.run.smithi187.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T17:26:28.328 INFO:teuthology.orchestra.run.smithi187.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T17:26:28.328 INFO:teuthology.orchestra.run.smithi187.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T17:26:28.329 INFO:teuthology.orchestra.run.smithi187.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T17:26:28.341 INFO:teuthology.orchestra.run.smithi098.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4762-gbad475c1-1jammy [28.2 MB] 2024-09-12T17:26:28.347 INFO:teuthology.orchestra.run.smithi187.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T17:26:28.348 INFO:teuthology.orchestra.run.smithi187.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T17:26:28.348 INFO:teuthology.orchestra.run.smithi187.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T17:26:28.363 INFO:teuthology.orchestra.run.smithi187.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T17:26:28.364 INFO:teuthology.orchestra.run.smithi187.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T17:26:28.364 INFO:teuthology.orchestra.run.smithi187.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T17:26:28.364 INFO:teuthology.orchestra.run.smithi187.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T17:26:28.365 INFO:teuthology.orchestra.run.smithi187.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T17:26:28.365 INFO:teuthology.orchestra.run.smithi187.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T17:26:28.380 INFO:teuthology.orchestra.run.smithi187.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T17:26:28.380 INFO:teuthology.orchestra.run.smithi187.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T17:26:28.383 INFO:teuthology.orchestra.run.smithi187.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T17:26:28.397 INFO:teuthology.orchestra.run.smithi187.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T17:26:28.398 INFO:teuthology.orchestra.run.smithi187.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T17:26:28.399 INFO:teuthology.orchestra.run.smithi187.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T17:26:28.402 INFO:teuthology.orchestra.run.smithi187.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T17:26:28.404 INFO:teuthology.orchestra.run.smithi187.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T17:26:28.405 INFO:teuthology.orchestra.run.smithi187.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T17:26:28.405 INFO:teuthology.orchestra.run.smithi187.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T17:26:28.414 INFO:teuthology.orchestra.run.smithi187.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T17:26:28.414 INFO:teuthology.orchestra.run.smithi187.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T17:26:28.417 INFO:teuthology.orchestra.run.smithi187.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T17:26:28.431 INFO:teuthology.orchestra.run.smithi187.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T17:26:28.432 INFO:teuthology.orchestra.run.smithi187.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T17:26:28.432 INFO:teuthology.orchestra.run.smithi187.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T17:26:28.434 INFO:teuthology.orchestra.run.smithi187.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T17:26:28.434 INFO:teuthology.orchestra.run.smithi187.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T17:26:28.440 INFO:teuthology.orchestra.run.smithi187.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T17:26:28.440 INFO:teuthology.orchestra.run.smithi187.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T17:26:28.448 INFO:teuthology.orchestra.run.smithi187.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T17:26:28.450 INFO:teuthology.orchestra.run.smithi187.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T17:26:28.451 INFO:teuthology.orchestra.run.smithi187.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T17:26:28.905 INFO:teuthology.orchestra.run.smithi187.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4762-gbad475c1-1jammy [3,322 kB] 2024-09-12T17:26:28.941 INFO:teuthology.orchestra.run.smithi098.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4762-gbad475c1-1jammy [5,206 kB] 2024-09-12T17:26:29.006 INFO:teuthology.orchestra.run.smithi098.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4762-gbad475c1-1jammy [251 kB] 2024-09-12T17:26:29.009 INFO:teuthology.orchestra.run.smithi098.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4762-gbad475c1-1jammy [124 kB] 2024-09-12T17:26:29.010 INFO:teuthology.orchestra.run.smithi098.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4762-gbad475c1-1jammy [1,562 kB] 2024-09-12T17:26:29.023 INFO:teuthology.orchestra.run.smithi098.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4762-gbad475c1-1jammy [6,310 kB] 2024-09-12T17:26:29.146 INFO:teuthology.orchestra.run.smithi098.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4762-gbad475c1-1jammy [23.1 MB] 2024-09-12T17:26:29.194 INFO:teuthology.orchestra.run.smithi187.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4762-gbad475c1-1jammy [721 kB] 2024-09-12T17:26:29.304 INFO:teuthology.orchestra.run.smithi187.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4762-gbad475c1-1jammy [357 kB] 2024-09-12T17:26:29.311 INFO:teuthology.orchestra.run.smithi187.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4762-gbad475c1-1jammy [32.8 kB] 2024-09-12T17:26:29.312 INFO:teuthology.orchestra.run.smithi187.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4762-gbad475c1-1jammy [180 kB] 2024-09-12T17:26:29.364 INFO:teuthology.orchestra.run.smithi187.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4762-gbad475c1-1jammy [71.2 kB] 2024-09-12T17:26:29.366 INFO:teuthology.orchestra.run.smithi187.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4762-gbad475c1-1jammy [338 kB] 2024-09-12T17:26:29.373 INFO:teuthology.orchestra.run.smithi187.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4762-gbad475c1-1jammy [7,972 kB] 2024-09-12T17:26:29.692 INFO:teuthology.orchestra.run.smithi098.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4762-gbad475c1-1jammy [14.1 kB] 2024-09-12T17:26:29.692 INFO:teuthology.orchestra.run.smithi098.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4762-gbad475c1-1jammy [880 kB] 2024-09-12T17:26:29.706 INFO:teuthology.orchestra.run.smithi098.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4762-gbad475c1-1jammy [2,438 kB] 2024-09-12T17:26:29.742 INFO:teuthology.orchestra.run.smithi098.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4762-gbad475c1-1jammy [812 kB] 2024-09-12T17:26:29.752 INFO:teuthology.orchestra.run.smithi098.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4762-gbad475c1-1jammy [160 kB] 2024-09-12T17:26:29.754 INFO:teuthology.orchestra.run.smithi098.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4762-gbad475c1-1jammy [61.4 MB] 2024-09-12T17:26:29.865 INFO:teuthology.orchestra.run.smithi187.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4762-gbad475c1-1jammy [112 kB] 2024-09-12T17:26:29.867 INFO:teuthology.orchestra.run.smithi187.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4762-gbad475c1-1jammy [473 kB] 2024-09-12T17:26:29.911 INFO:teuthology.orchestra.run.smithi187.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4762-gbad475c1-1jammy [28.2 MB] 2024-09-12T17:26:31.357 INFO:teuthology.orchestra.run.smithi187.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4762-gbad475c1-1jammy [5,206 kB] 2024-09-12T17:26:31.436 INFO:teuthology.orchestra.run.smithi187.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4762-gbad475c1-1jammy [251 kB] 2024-09-12T17:26:31.439 INFO:teuthology.orchestra.run.smithi187.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4762-gbad475c1-1jammy [124 kB] 2024-09-12T17:26:31.440 INFO:teuthology.orchestra.run.smithi187.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4762-gbad475c1-1jammy [1,562 kB] 2024-09-12T17:26:31.453 INFO:teuthology.orchestra.run.smithi187.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4762-gbad475c1-1jammy [6,310 kB] 2024-09-12T17:26:31.537 INFO:teuthology.orchestra.run.smithi187.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4762-gbad475c1-1jammy [23.1 MB] 2024-09-12T17:26:31.572 INFO:teuthology.orchestra.run.smithi098.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4762-gbad475c1-1jammy [8,625 kB] 2024-09-12T17:26:31.738 INFO:teuthology.orchestra.run.smithi098.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4762-gbad475c1-1jammy [14.2 kB] 2024-09-12T17:26:31.739 INFO:teuthology.orchestra.run.smithi098.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4762-gbad475c1-1jammy [48.5 MB] 2024-09-12T17:26:32.521 INFO:teuthology.orchestra.run.smithi187.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4762-gbad475c1-1jammy [14.1 kB] 2024-09-12T17:26:32.521 INFO:teuthology.orchestra.run.smithi187.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4762-gbad475c1-1jammy [880 kB] 2024-09-12T17:26:32.538 INFO:teuthology.orchestra.run.smithi187.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4762-gbad475c1-1jammy [2,438 kB] 2024-09-12T17:26:32.581 INFO:teuthology.orchestra.run.smithi187.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4762-gbad475c1-1jammy [812 kB] 2024-09-12T17:26:32.626 INFO:teuthology.orchestra.run.smithi187.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4762-gbad475c1-1jammy [160 kB] 2024-09-12T17:26:32.630 INFO:teuthology.orchestra.run.smithi187.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4762-gbad475c1-1jammy [61.4 MB] 2024-09-12T17:26:33.262 INFO:teuthology.orchestra.run.smithi098.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4762-gbad475c1-1jammy [130 kB] 2024-09-12T17:26:33.265 INFO:teuthology.orchestra.run.smithi098.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4762-gbad475c1-1jammy [39.0 kB] 2024-09-12T17:26:33.266 INFO:teuthology.orchestra.run.smithi098.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4762-gbad475c1-1jammy [15.8 MB] 2024-09-12T17:26:33.703 INFO:teuthology.orchestra.run.smithi098.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4762-gbad475c1-1jammy [91.2 kB] 2024-09-12T17:26:34.273 INFO:teuthology.orchestra.run.smithi098.stdout:Fetched 243 MB in 6s (40.9 MB/s) 2024-09-12T17:26:34.427 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T17:26:34.462 INFO:teuthology.orchestra.run.smithi187.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4762-gbad475c1-1jammy [8,625 kB] 2024-09-12T17:26:34.526 INFO:teuthology.orchestra.run.smithi098.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T17:26:34.532 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T17:26:34.571 INFO:teuthology.orchestra.run.smithi187.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4762-gbad475c1-1jammy [14.2 kB] 2024-09-12T17:26:34.571 INFO:teuthology.orchestra.run.smithi187.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4762-gbad475c1-1jammy [48.5 MB] 2024-09-12T17:26:34.617 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:26:34.954 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T17:26:34.980 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T17:26:35.020 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:26:35.357 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T17:26:35.383 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T17:26:35.415 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:26:35.545 INFO:teuthology.orchestra.run.smithi187.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4762-gbad475c1-1jammy [130 kB] 2024-09-12T17:26:35.622 INFO:teuthology.orchestra.run.smithi187.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4762-gbad475c1-1jammy [39.0 kB] 2024-09-12T17:26:35.623 INFO:teuthology.orchestra.run.smithi187.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4762-gbad475c1-1jammy [15.8 MB] 2024-09-12T17:26:35.852 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T17:26:35.878 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:26:35.925 INFO:teuthology.orchestra.run.smithi187.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4762-gbad475c1-1jammy [91.2 kB] 2024-09-12T17:26:35.927 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:26:36.331 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T17:26:36.357 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:26:36.397 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:26:36.513 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 243 MB in 8s (30.4 MB/s) 2024-09-12T17:26:36.671 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T17:26:36.692 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T17:26:36.718 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:26:36.758 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:26:36.766 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T17:26:36.772 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T17:26:36.853 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:26:37.095 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T17:26:37.122 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T17:26:37.157 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T17:26:37.170 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:26:37.184 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T17:26:37.224 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:26:37.490 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package librados2. 2024-09-12T17:26:37.516 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../007-librados2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:37.552 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T17:26:37.556 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:37.578 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T17:26:37.610 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:26:37.981 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T17:26:38.001 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package librbd1. 2024-09-12T17:26:38.007 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:26:38.027 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../008-librbd1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:38.056 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:26:38.068 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:38.452 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T17:26:38.477 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:26:38.496 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T17:26:38.517 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:26:38.522 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:38.554 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:38.806 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-rados. 2024-09-12T17:26:38.821 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:38.853 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T17:26:38.864 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:38.879 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:26:38.920 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:26:39.184 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T17:26:39.210 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:26:39.257 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T17:26:39.267 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:39.283 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T17:26:39.323 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:26:39.503 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T17:26:39.518 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:39.562 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:39.626 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librados2. 2024-09-12T17:26:39.652 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../007-librados2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:39.692 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:39.848 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T17:26:39.876 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:26:39.906 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:40.162 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librbd1. 2024-09-12T17:26:40.176 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T17:26:40.188 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../008-librbd1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:40.202 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T17:26:40.228 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:40.242 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:26:40.545 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T17:26:40.571 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T17:26:40.612 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T17:26:40.657 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T17:26:40.672 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:40.715 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:40.856 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T17:26:40.871 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:40.914 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:40.993 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rados. 2024-09-12T17:26:41.019 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:41.059 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:41.210 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T17:26:41.236 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T17:26:41.267 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:26:41.362 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T17:26:41.388 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:26:41.428 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:41.529 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T17:26:41.544 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T17:26:41.587 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:26:41.681 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T17:26:41.696 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:41.739 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:41.890 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T17:26:41.905 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T17:26:41.948 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:26:42.009 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T17:26:42.035 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:26:42.075 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:42.277 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package lua5.1. 2024-09-12T17:26:42.303 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T17:26:42.404 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T17:26:42.430 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T17:26:42.470 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:26:42.527 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:26:42.781 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T17:26:42.808 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T17:26:42.821 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package lua-any. 2024-09-12T17:26:42.836 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T17:26:42.848 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T17:26:42.871 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T17:26:43.084 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T17:26:43.099 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:43.107 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package zip. 2024-09-12T17:26:43.123 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T17:26:43.166 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T17:26:43.267 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:43.511 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package unzip. 2024-09-12T17:26:43.537 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T17:26:43.577 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:26:43.679 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T17:26:43.705 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T17:26:43.745 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:26:43.973 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package luarocks. 2024-09-12T17:26:43.999 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T17:26:44.023 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T17:26:44.031 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:26:44.038 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T17:26:44.081 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:26:44.384 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T17:26:44.411 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T17:26:44.414 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package librgw2. 2024-09-12T17:26:44.441 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../025-librgw2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:44.451 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:26:44.481 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:44.746 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua5.1. 2024-09-12T17:26:44.772 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T17:26:44.812 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:26:45.117 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T17:26:45.132 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:45.149 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua-any. 2024-09-12T17:26:45.164 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T17:26:45.175 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:45.207 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T17:26:45.460 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package zip. 2024-09-12T17:26:45.461 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T17:26:45.486 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T17:26:45.488 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T17:26:45.520 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:26:45.526 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T17:26:45.805 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package unzip. 2024-09-12T17:26:45.820 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T17:26:45.823 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T17:26:45.849 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:45.863 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:26:45.889 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:46.250 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package luarocks. 2024-09-12T17:26:46.277 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T17:26:46.317 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:26:46.335 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-common. 2024-09-12T17:26:46.362 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:46.401 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:46.692 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librgw2. 2024-09-12T17:26:46.718 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../025-librgw2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:46.758 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:47.352 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T17:26:47.368 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:47.402 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:47.730 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T17:26:47.757 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T17:26:47.797 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:26:47.823 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-base. 2024-09-12T17:26:47.850 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:47.899 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:48.108 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T17:26:48.135 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:48.192 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:48.461 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T17:26:48.487 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T17:26:48.527 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:26:48.604 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-common. 2024-09-12T17:26:48.630 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:48.661 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:48.814 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T17:26:48.840 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T17:26:48.880 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:26:49.209 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T17:26:49.235 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T17:26:49.275 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:26:49.520 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T17:26:49.535 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T17:26:49.570 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:26:49.873 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T17:26:49.899 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T17:26:49.939 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:26:50.151 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-base. 2024-09-12T17:26:50.177 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:26:50.226 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T17:26:50.226 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:50.252 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T17:26:50.292 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T17:26:50.570 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-portend. 2024-09-12T17:26:50.585 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T17:26:50.620 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T17:26:50.788 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T17:26:50.815 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T17:26:50.855 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:26:50.898 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T17:26:50.924 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T17:26:50.965 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T17:26:51.141 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T17:26:51.168 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T17:26:51.199 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:26:51.285 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T17:26:51.311 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T17:26:51.351 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:26:51.503 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T17:26:51.529 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T17:26:51.569 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:26:51.722 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T17:26:51.748 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T17:26:51.788 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T17:26:51.872 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T17:26:51.898 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T17:26:51.939 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:26:52.100 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T17:26:52.126 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T17:26:52.166 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T17:26:52.242 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T17:26:52.268 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T17:26:52.308 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:26:52.453 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T17:26:52.479 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T17:26:52.522 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:26:52.611 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T17:26:52.638 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T17:26:52.678 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T17:26:52.973 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-portend. 2024-09-12T17:26:52.999 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T17:26:53.031 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T17:26:53.181 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-mako. 2024-09-12T17:26:53.207 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T17:26:53.247 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:26:53.317 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T17:26:53.343 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T17:26:53.384 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T17:26:53.584 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T17:26:53.610 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T17:26:53.650 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:26:53.870 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T17:26:53.897 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T17:26:53.903 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T17:26:53.919 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T17:26:53.937 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:26:53.962 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:26:54.256 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-webob. 2024-09-12T17:26:54.282 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T17:26:54.282 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T17:26:54.309 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T17:26:54.322 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:26:54.348 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T17:26:54.643 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T17:26:54.660 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T17:26:54.669 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T17:26:54.675 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T17:26:54.704 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:26:54.718 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T17:26:54.971 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T17:26:54.997 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T17:26:55.021 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T17:26:55.037 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:26:55.048 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T17:26:55.088 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:26:55.332 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-mako. 2024-09-12T17:26:55.340 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-paste. 2024-09-12T17:26:55.348 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T17:26:55.366 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T17:26:55.391 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:26:55.406 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:26:55.711 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T17:26:55.719 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T17:26:55.734 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T17:26:55.737 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T17:26:55.768 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:26:55.777 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:26:56.071 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T17:26:56.089 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T17:26:56.098 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T17:26:56.115 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T17:26:56.138 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:26:56.155 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:26:56.444 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T17:26:56.458 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-webob. 2024-09-12T17:26:56.467 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T17:26:56.485 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T17:26:56.507 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T17:26:56.525 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:26:56.811 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T17:26:56.837 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T17:26:56.877 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:26:56.895 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T17:26:56.921 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T17:26:56.964 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:26:57.233 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T17:26:57.260 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T17:26:57.281 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T17:26:57.299 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T17:26:57.308 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T17:26:57.348 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:26:57.617 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-paste. 2024-09-12T17:26:57.627 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-idna. 2024-09-12T17:26:57.644 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T17:26:57.653 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T17:26:57.684 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:26:57.693 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:26:58.020 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T17:26:58.047 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T17:26:58.087 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:26:58.365 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T17:26:58.392 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T17:26:58.431 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:26:58.735 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T17:26:58.761 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T17:26:58.801 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T17:26:58.806 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T17:26:58.833 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T17:26:58.864 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:26:59.121 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T17:26:59.125 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-requests. 2024-09-12T17:26:59.148 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T17:26:59.152 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T17:26:59.188 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:26:59.192 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:26:59.497 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T17:26:59.524 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T17:26:59.526 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T17:26:59.552 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T17:26:59.563 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:26:59.592 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T17:26:59.858 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T17:26:59.876 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:26:59.879 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-idna. 2024-09-12T17:26:59.905 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T17:26:59.916 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:26:59.945 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:27:00.265 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T17:27:00.291 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T17:27:00.313 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T17:27:00.333 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:27:00.340 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:00.380 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:00.660 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-requests. 2024-09-12T17:27:00.674 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T17:27:00.687 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T17:27:00.701 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T17:27:00.726 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:27:00.732 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:27:01.011 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T17:27:01.037 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T17:27:01.077 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T17:27:01.414 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T17:27:01.440 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:01.480 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:01.864 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T17:27:01.875 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T17:27:01.890 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T17:27:01.901 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:01.930 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:27:01.941 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:02.225 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T17:27:02.240 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:27:02.283 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:02.512 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T17:27:02.539 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:02.579 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:02.680 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T17:27:02.706 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:02.746 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:03.067 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T17:27:03.093 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T17:27:03.133 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:27:03.436 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T17:27:03.462 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T17:27:03.502 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T17:27:03.648 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph. 2024-09-12T17:27:03.663 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../066-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:03.706 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:03.797 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T17:27:03.823 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:03.863 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:04.051 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T17:27:04.078 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:04.120 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:04.394 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T17:27:04.420 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:04.429 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T17:27:04.456 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:04.460 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:04.496 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:04.891 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package cephadm. 2024-09-12T17:27:04.917 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../069-cephadm_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:04.957 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:05.072 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T17:27:05.099 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:05.130 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:05.276 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T17:27:05.303 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T17:27:05.343 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T17:27:05.654 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T17:27:05.669 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:27:05.712 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:27:06.192 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph. 2024-09-12T17:27:06.219 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../066-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:06.258 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:06.577 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T17:27:06.604 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:06.644 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:06.709 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-babel. 2024-09-12T17:27:06.736 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:27:06.775 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:27:07.006 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T17:27:07.033 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:07.072 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:07.112 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T17:27:07.139 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T17:27:07.178 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:27:07.442 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package cephadm. 2024-09-12T17:27:07.468 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../069-cephadm_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:07.515 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T17:27:07.516 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:07.542 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:27:07.581 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:07.828 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T17:27:07.855 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T17:27:07.894 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T17:27:07.927 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T17:27:07.954 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T17:27:07.993 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T17:27:08.189 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T17:27:08.215 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:27:08.255 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:27:08.288 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-routes. 2024-09-12T17:27:08.315 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T17:27:08.354 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:27:08.691 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T17:27:08.718 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:27:08.757 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:09.302 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-babel. 2024-09-12T17:27:09.329 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:27:09.368 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:27:09.687 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T17:27:09.714 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T17:27:09.754 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:27:10.082 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T17:27:10.109 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:27:10.148 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:10.494 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T17:27:10.521 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T17:27:10.560 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T17:27:10.838 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-routes. 2024-09-12T17:27:10.865 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T17:27:10.904 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:27:11.249 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T17:27:11.276 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:27:11.315 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:11.363 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T17:27:11.393 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T17:27:11.437 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:27:11.924 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T17:27:11.952 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T17:27:12.016 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:27:12.369 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T17:27:12.397 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T17:27:12.436 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:27:12.739 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T17:27:12.766 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T17:27:12.805 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:27:13.498 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T17:27:13.525 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:27:13.649 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:13.987 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T17:27:14.004 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T17:27:14.045 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:27:14.515 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T17:27:14.543 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T17:27:14.581 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:27:14.770 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T17:27:14.797 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T17:27:14.836 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T17:27:14.935 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T17:27:14.951 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T17:27:14.993 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:27:15.123 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T17:27:15.150 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T17:27:15.189 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:27:15.279 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T17:27:15.307 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T17:27:15.346 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:27:15.526 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T17:27:15.554 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T17:27:15.593 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:27:15.904 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T17:27:15.931 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T17:27:15.979 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T17:27:16.096 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T17:27:16.124 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:27:16.248 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:16.274 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T17:27:16.290 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T17:27:16.324 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T17:27:16.636 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T17:27:16.664 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T17:27:16.702 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:27:17.031 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T17:27:17.058 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T17:27:17.097 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T17:27:17.210 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T17:27:17.237 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T17:27:17.276 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T17:27:17.409 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T17:27:17.436 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T17:27:17.475 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:27:17.579 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T17:27:17.607 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T17:27:17.645 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:27:17.974 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T17:27:18.002 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T17:27:18.040 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:27:18.148 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T17:27:18.176 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:27:18.214 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:18.351 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T17:27:18.368 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T17:27:18.410 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T17:27:18.542 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T17:27:18.572 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T17:27:18.608 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:27:18.689 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T17:27:18.716 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T17:27:18.755 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T17:27:18.887 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T17:27:18.903 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:27:18.945 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:27:19.016 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T17:27:19.033 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T17:27:19.066 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:27:19.206 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package jq. 2024-09-12T17:27:19.222 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:27:19.264 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T17:27:19.783 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T17:27:19.811 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T17:27:19.820 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package socat. 2024-09-12T17:27:19.844 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T17:27:19.848 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T17:27:19.900 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:27:20.164 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T17:27:20.193 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T17:27:20.212 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T17:27:20.230 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:27:20.240 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T17:27:20.278 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:27:20.633 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-test. 2024-09-12T17:27:20.649 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:20.691 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:20.853 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T17:27:20.869 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:27:20.911 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:21.239 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T17:27:21.267 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T17:27:21.305 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:27:21.641 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T17:27:21.669 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:27:21.708 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:27:21.927 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package jq. 2024-09-12T17:27:21.955 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:27:21.994 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T17:27:22.250 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package socat. 2024-09-12T17:27:22.274 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T17:27:22.313 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:27:22.633 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T17:27:22.649 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T17:27:22.691 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:27:23.012 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T17:27:23.036 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:27:23.037 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-test. 2024-09-12T17:27:23.065 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:23.070 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:23.103 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:23.358 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T17:27:23.386 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:23.424 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:23.694 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T17:27:23.710 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T17:27:23.744 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:27:24.058 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T17:27:24.085 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T17:27:24.123 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:27:24.519 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T17:27:24.547 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T17:27:24.586 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:27:25.016 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package pkg-config. 2024-09-12T17:27:25.044 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T17:27:25.099 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:27:25.216 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T17:27:25.232 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:27:25.274 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:25.361 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T17:27:25.388 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T17:27:25.427 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:27:25.569 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T17:27:25.586 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:25.619 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:25.855 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T17:27:25.883 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T17:27:25.905 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T17:27:25.921 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T17:27:25.934 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T17:27:25.972 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:27:26.191 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T17:27:26.219 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T17:27:26.249 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T17:27:26.293 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T17:27:26.321 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T17:27:26.360 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:27:26.545 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T17:27:26.573 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T17:27:26.611 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:27:26.730 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T17:27:26.759 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T17:27:26.797 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:27:26.923 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T17:27:26.950 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T17:27:26.989 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T17:27:27.185 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package pkg-config. 2024-09-12T17:27:27.202 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T17:27:27.243 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:27:27.317 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-py. 2024-09-12T17:27:27.345 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T17:27:27.383 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T17:27:27.479 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T17:27:27.496 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T17:27:27.538 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:27:27.704 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T17:27:27.732 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T17:27:27.770 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:27:27.915 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T17:27:27.932 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T17:27:27.965 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T17:27:28.233 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T17:27:28.252 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T17:27:28.261 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T17:27:28.280 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T17:27:28.299 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:27:28.318 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T17:27:28.627 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-toml. 2024-09-12T17:27:28.630 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T17:27:28.655 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T17:27:28.658 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T17:27:28.693 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T17:27:28.696 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:27:28.954 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T17:27:28.971 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T17:27:29.004 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:27:29.007 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T17:27:29.024 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T17:27:29.065 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T17:27:29.325 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T17:27:29.353 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T17:27:29.391 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:27:29.394 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-py. 2024-09-12T17:27:29.422 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T17:27:29.460 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T17:27:29.669 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T17:27:29.685 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T17:27:29.727 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:27:29.780 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T17:27:29.808 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T17:27:29.855 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:27:30.301 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T17:27:30.329 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T17:27:30.367 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:27:30.407 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package radosgw. 2024-09-12T17:27:30.435 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../116-radosgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:30.473 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:30.670 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-toml. 2024-09-12T17:27:30.698 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T17:27:30.736 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T17:27:31.006 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T17:27:31.022 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T17:27:31.055 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:27:31.401 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T17:27:31.418 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T17:27:31.429 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T17:27:31.446 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:31.467 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:27:31.484 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:31.753 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T17:27:31.781 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T17:27:31.782 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T17:27:31.819 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:27:32.039 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:27:32.141 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:27:32.394 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T17:27:32.465 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package radosgw. 2024-09-12T17:27:32.494 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../116-radosgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:32.531 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:32.730 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T17:27:33.177 INFO:teuthology.orchestra.run.smithi098.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T17:27:33.242 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:33.435 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T17:27:33.463 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:27:33.501 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:33.789 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T17:27:33.818 INFO:teuthology.orchestra.run.smithi098.stdout:Adding system user cephadm....done 2024-09-12T17:27:33.957 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:27:34.039 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:27:34.165 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:27:34.217 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:27:34.429 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T17:27:34.468 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:27:34.594 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:27:34.748 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T17:27:34.854 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T17:27:35.113 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:27:35.180 INFO:teuthology.orchestra.run.smithi187.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T17:27:35.248 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T17:27:35.250 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:35.725 INFO:teuthology.orchestra.run.smithi187.stdout:Adding system user cephadm....done 2024-09-12T17:27:35.816 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:27:35.881 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:27:36.160 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:27:36.168 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T17:27:36.417 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:27:36.419 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T17:27:36.543 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:27:36.704 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:27:36.819 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T17:27:36.964 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:27:37.070 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:27:37.188 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T17:27:37.223 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:27:37.466 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:27:37.490 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:27:37.717 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:37.850 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T17:27:37.976 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:27:38.102 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:27:38.110 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T17:27:38.228 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:27:38.354 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:27:38.386 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:27:38.614 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:27:38.712 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:27:38.955 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:27:39.008 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T17:27:39.045 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T17:27:39.109 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:27:39.206 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:27:39.235 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T17:27:39.512 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:39.594 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:27:39.720 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T17:27:39.841 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:27:39.967 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:27:39.980 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:27:40.093 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:27:40.219 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:27:40.248 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:27:40.470 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:27:40.532 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T17:27:40.633 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:27:41.041 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T17:27:41.068 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T17:27:41.133 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:27:41.258 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T17:27:41.318 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:27:41.570 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:27:41.626 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:27:41.695 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:27:41.752 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T17:27:41.822 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:27:42.019 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:27:42.117 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T17:27:42.262 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:27:42.493 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T17:27:42.555 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T17:27:42.681 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:27:42.735 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:27:43.095 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:27:43.333 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:27:43.388 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:27:43.584 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:27:43.710 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:27:43.723 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:27:43.827 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:27:43.966 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:27:44.067 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:44.112 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T17:27:44.368 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:27:44.480 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T17:27:44.686 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:27:44.722 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:27:45.099 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:27:45.392 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:27:45.735 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:27:45.978 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:27:46.095 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:46.112 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:27:46.376 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:27:46.379 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:27:46.510 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T17:27:46.689 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:27:46.770 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:27:46.896 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:27:47.022 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:27:47.323 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:27:47.566 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T17:27:47.817 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:27:47.936 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:27:47.943 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:27:48.188 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:27:48.245 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:27:48.322 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T17:27:48.504 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T17:27:48.590 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:27:48.718 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:27:48.772 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T17:27:48.827 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:27:49.048 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:27:49.120 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:27:49.282 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T17:27:49.380 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T17:27:49.525 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:27:49.631 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:27:49.651 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T17:27:49.757 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:27:49.935 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:27:50.058 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:27:50.061 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:27:50.326 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T17:27:50.363 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:27:50.664 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:27:50.819 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T17:27:50.890 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:27:50.999 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:27:51.070 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:27:51.125 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:27:51.213 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T17:27:51.304 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T17:27:51.460 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:27:51.580 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:27:51.586 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:27:51.706 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T17:27:51.979 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:27:51.992 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:27:52.117 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:27:52.239 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T17:27:52.356 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T17:27:52.418 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:27:52.633 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:27:52.727 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:27:52.734 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:27:52.962 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:27:53.051 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:27:53.079 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:27:53.205 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:27:53.294 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T17:27:53.344 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:27:53.557 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:27:53.620 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T17:27:53.683 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:27:53.746 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T17:27:54.022 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T17:27:54.084 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:27:54.290 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:27:54.360 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T17:27:54.478 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T17:27:54.610 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:27:54.720 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:27:54.847 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:27:54.987 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T17:27:55.164 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:27:55.288 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:27:55.457 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:27:55.616 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:27:55.733 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T17:27:55.742 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:55.859 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T17:27:55.868 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:55.994 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:27:56.127 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T17:27:56.330 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:56.378 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:27:56.448 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:56.574 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T17:27:56.723 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:27:56.826 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:56.952 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:57.103 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:57.133 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T17:27:57.318 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:27:57.318 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:27:57.443 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:27:57.787 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:27:57.804 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:57.913 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:57.947 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:58.039 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:58.073 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:58.165 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:27:58.182 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:27:58.510 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:58.627 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:58.728 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T17:27:58.997 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:59.122 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:59.248 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:59.319 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:59.445 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:59.459 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:27:59.459 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:27:59.574 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:59.697 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:59.815 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:27:59.975 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:00.101 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:00.252 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:00.333 INFO:teuthology.orchestra.run.smithi098.stdout:Adding group ceph....done 2024-09-12T17:28:00.369 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:28:00.668 INFO:teuthology.orchestra.run.smithi098.stdout:Adding system user ceph....done 2024-09-12T17:28:00.836 INFO:teuthology.orchestra.run.smithi098.stdout:Setting system user ceph properties....done 2024-09-12T17:28:00.847 INFO:teuthology.orchestra.run.smithi098.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T17:28:00.983 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T17:28:01.280 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T17:28:01.556 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:01.682 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:01.808 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:01.934 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:02.009 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:02.052 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:02.160 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:02.570 INFO:teuthology.orchestra.run.smithi187.stdout:Adding group ceph....done 2024-09-12T17:28:02.622 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:28:02.622 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:28:02.929 INFO:teuthology.orchestra.run.smithi187.stdout:Adding system user ceph....done 2024-09-12T17:28:03.045 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:03.114 INFO:teuthology.orchestra.run.smithi187.stdout:Setting system user ceph properties....done 2024-09-12T17:28:03.129 INFO:teuthology.orchestra.run.smithi187.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T17:28:03.265 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T17:28:03.390 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T17:28:03.563 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T17:28:03.855 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:04.028 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:04.079 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:28:04.079 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:28:04.146 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:04.582 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:04.619 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:28:04.619 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:28:04.793 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:28:04.793 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:28:05.081 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:05.411 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:05.444 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T17:28:05.698 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:28:05.698 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:28:05.947 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:06.213 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:06.331 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:06.333 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:28:06.333 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:28:06.465 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:06.685 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:28:06.686 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:28:06.813 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:07.031 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:28:07.031 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:28:07.175 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:07.327 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:07.461 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:07.531 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:07.604 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:07.842 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:28:07.842 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:28:08.024 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T17:28:08.187 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T17:28:08.341 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:08.438 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:28:08.467 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:08.627 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:08.834 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:28:08.834 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:28:09.286 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:09.428 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:09.538 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:09.685 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T17:28:09.726 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:28:10.200 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T17:28:10.309 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T17:28:10.319 INFO:teuthology.orchestra.run.smithi098.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T17:28:10.323 DEBUG:teuthology.orchestra.run.smithi098:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T17:28:10.384 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-12T17:28:10.453 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:28:10.595 INFO:teuthology.orchestra.run.smithi098.stdout:Building dependency tree... 2024-09-12T17:28:10.596 INFO:teuthology.orchestra.run.smithi098.stdout:Reading state information... 2024-09-12T17:28:10.801 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:28:10.801 INFO:teuthology.orchestra.run.smithi098.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:28:10.802 INFO:teuthology.orchestra.run.smithi098.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:28:10.802 INFO:teuthology.orchestra.run.smithi098.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:28:10.802 INFO:teuthology.orchestra.run.smithi098.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:28:10.802 INFO:teuthology.orchestra.run.smithi098.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:28:10.802 INFO:teuthology.orchestra.run.smithi098.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:28:10.803 INFO:teuthology.orchestra.run.smithi098.stdout:The following additional packages will be installed: 2024-09-12T17:28:10.803 INFO:teuthology.orchestra.run.smithi098.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T17:28:10.804 INFO:teuthology.orchestra.run.smithi098.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T17:28:10.804 INFO:teuthology.orchestra.run.smithi098.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T17:28:10.804 INFO:teuthology.orchestra.run.smithi098.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T17:28:10.804 INFO:teuthology.orchestra.run.smithi098.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T17:28:10.804 INFO:teuthology.orchestra.run.smithi098.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T17:28:10.804 INFO:teuthology.orchestra.run.smithi098.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T17:28:10.804 INFO:teuthology.orchestra.run.smithi098.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T17:28:10.804 INFO:teuthology.orchestra.run.smithi098.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T17:28:10.804 INFO:teuthology.orchestra.run.smithi098.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T17:28:10.805 INFO:teuthology.orchestra.run.smithi098.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T17:28:10.805 INFO:teuthology.orchestra.run.smithi098.stdout:Suggested packages: 2024-09-12T17:28:10.805 INFO:teuthology.orchestra.run.smithi098.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T17:28:10.805 INFO:teuthology.orchestra.run.smithi098.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T17:28:10.805 INFO:teuthology.orchestra.run.smithi098.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T17:28:10.806 INFO:teuthology.orchestra.run.smithi098.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T17:28:10.806 INFO:teuthology.orchestra.run.smithi098.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T17:28:10.845 INFO:teuthology.orchestra.run.smithi098.stdout:The following NEW packages will be installed: 2024-09-12T17:28:10.845 INFO:teuthology.orchestra.run.smithi098.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T17:28:10.845 INFO:teuthology.orchestra.run.smithi098.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T17:28:10.845 INFO:teuthology.orchestra.run.smithi098.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T17:28:10.846 INFO:teuthology.orchestra.run.smithi098.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T17:28:10.846 INFO:teuthology.orchestra.run.smithi098.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T17:28:10.846 INFO:teuthology.orchestra.run.smithi098.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T17:28:10.846 INFO:teuthology.orchestra.run.smithi098.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T17:28:10.846 INFO:teuthology.orchestra.run.smithi098.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T17:28:10.846 INFO:teuthology.orchestra.run.smithi098.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T17:28:10.846 INFO:teuthology.orchestra.run.smithi098.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T17:28:10.847 INFO:teuthology.orchestra.run.smithi098.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T17:28:10.847 INFO:teuthology.orchestra.run.smithi098.stdout: s3cmd 2024-09-12T17:28:10.896 INFO:teuthology.orchestra.run.smithi098.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:28:10.897 INFO:teuthology.orchestra.run.smithi098.stdout:Need to get 10.4 MB of archives. 2024-09-12T17:28:10.897 INFO:teuthology.orchestra.run.smithi098.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T17:28:10.897 INFO:teuthology.orchestra.run.smithi098.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T17:28:10.914 INFO:teuthology.orchestra.run.smithi098.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T17:28:10.914 INFO:teuthology.orchestra.run.smithi098.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T17:28:10.918 INFO:teuthology.orchestra.run.smithi098.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T17:28:10.952 INFO:teuthology.orchestra.run.smithi098.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T17:28:10.967 INFO:teuthology.orchestra.run.smithi098.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T17:28:10.969 INFO:teuthology.orchestra.run.smithi098.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T17:28:10.998 INFO:teuthology.orchestra.run.smithi098.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T17:28:11.019 INFO:teuthology.orchestra.run.smithi098.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T17:28:11.019 INFO:teuthology.orchestra.run.smithi098.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T17:28:11.021 INFO:teuthology.orchestra.run.smithi098.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T17:28:11.067 INFO:teuthology.orchestra.run.smithi098.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T17:28:11.067 INFO:teuthology.orchestra.run.smithi098.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T17:28:11.084 INFO:teuthology.orchestra.run.smithi098.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T17:28:11.084 INFO:teuthology.orchestra.run.smithi098.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T17:28:11.085 INFO:teuthology.orchestra.run.smithi098.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T17:28:11.086 INFO:teuthology.orchestra.run.smithi098.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T17:28:11.086 INFO:teuthology.orchestra.run.smithi098.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T17:28:11.089 INFO:teuthology.orchestra.run.smithi098.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T17:28:11.089 INFO:teuthology.orchestra.run.smithi098.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T17:28:11.095 INFO:teuthology.orchestra.run.smithi098.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T17:28:11.102 INFO:teuthology.orchestra.run.smithi098.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T17:28:11.102 INFO:teuthology.orchestra.run.smithi098.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T17:28:11.114 INFO:teuthology.orchestra.run.smithi098.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T17:28:11.114 INFO:teuthology.orchestra.run.smithi098.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T17:28:11.115 INFO:teuthology.orchestra.run.smithi098.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T17:28:11.115 INFO:teuthology.orchestra.run.smithi098.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T17:28:11.117 INFO:teuthology.orchestra.run.smithi098.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T17:28:11.120 INFO:teuthology.orchestra.run.smithi098.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T17:28:11.122 INFO:teuthology.orchestra.run.smithi098.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T17:28:11.136 INFO:teuthology.orchestra.run.smithi098.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T17:28:11.136 INFO:teuthology.orchestra.run.smithi098.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T17:28:11.153 INFO:teuthology.orchestra.run.smithi098.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T17:28:11.153 INFO:teuthology.orchestra.run.smithi098.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T17:28:11.154 INFO:teuthology.orchestra.run.smithi098.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T17:28:11.461 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T17:28:11.595 INFO:teuthology.orchestra.run.smithi098.stdout:Fetched 10.4 MB in 0s (34.3 MB/s) 2024-09-12T17:28:11.719 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T17:28:11.808 INFO:teuthology.orchestra.run.smithi098.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T17:28:11.813 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T17:28:11.859 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T17:28:12.103 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T17:28:12.119 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T17:28:12.161 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T17:28:12.414 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T17:28:12.430 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T17:28:12.435 INFO:teuthology.orchestra.run.smithi187.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T17:28:12.438 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T17:28:12.472 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T17:28:12.542 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2024-09-12T17:28:12.716 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T17:28:12.732 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T17:28:12.754 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2024-09-12T17:28:12.755 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2024-09-12T17:28:12.792 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T17:28:12.946 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:28:12.946 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:28:12.946 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:28:12.946 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:28:12.947 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:28:12.947 INFO:teuthology.orchestra.run.smithi187.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:28:12.947 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:28:12.948 INFO:teuthology.orchestra.run.smithi187.stdout:The following additional packages will be installed: 2024-09-12T17:28:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T17:28:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T17:28:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T17:28:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T17:28:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T17:28:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T17:28:12.948 INFO:teuthology.orchestra.run.smithi187.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T17:28:12.949 INFO:teuthology.orchestra.run.smithi187.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T17:28:12.949 INFO:teuthology.orchestra.run.smithi187.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T17:28:12.949 INFO:teuthology.orchestra.run.smithi187.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T17:28:12.949 INFO:teuthology.orchestra.run.smithi187.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T17:28:12.950 INFO:teuthology.orchestra.run.smithi187.stdout:Suggested packages: 2024-09-12T17:28:12.950 INFO:teuthology.orchestra.run.smithi187.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T17:28:12.950 INFO:teuthology.orchestra.run.smithi187.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T17:28:12.950 INFO:teuthology.orchestra.run.smithi187.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T17:28:12.950 INFO:teuthology.orchestra.run.smithi187.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T17:28:12.950 INFO:teuthology.orchestra.run.smithi187.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T17:28:12.989 INFO:teuthology.orchestra.run.smithi187.stdout:The following NEW packages will be installed: 2024-09-12T17:28:12.989 INFO:teuthology.orchestra.run.smithi187.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T17:28:12.989 INFO:teuthology.orchestra.run.smithi187.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T17:28:12.989 INFO:teuthology.orchestra.run.smithi187.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T17:28:12.989 INFO:teuthology.orchestra.run.smithi187.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T17:28:12.990 INFO:teuthology.orchestra.run.smithi187.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T17:28:12.990 INFO:teuthology.orchestra.run.smithi187.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T17:28:12.990 INFO:teuthology.orchestra.run.smithi187.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T17:28:12.990 INFO:teuthology.orchestra.run.smithi187.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T17:28:12.990 INFO:teuthology.orchestra.run.smithi187.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T17:28:12.990 INFO:teuthology.orchestra.run.smithi187.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T17:28:12.990 INFO:teuthology.orchestra.run.smithi187.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T17:28:12.990 INFO:teuthology.orchestra.run.smithi187.stdout: s3cmd 2024-09-12T17:28:13.011 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T17:28:13.039 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T17:28:13.077 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T17:28:13.173 INFO:teuthology.orchestra.run.smithi187.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:28:13.173 INFO:teuthology.orchestra.run.smithi187.stdout:Need to get 10.4 MB of archives. 2024-09-12T17:28:13.173 INFO:teuthology.orchestra.run.smithi187.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T17:28:13.173 INFO:teuthology.orchestra.run.smithi187.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T17:28:13.255 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T17:28:13.255 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T17:28:13.272 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T17:28:13.330 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T17:28:13.346 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T17:28:13.388 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T17:28:13.436 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T17:28:13.506 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T17:28:13.514 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T17:28:13.632 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T17:28:13.649 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T17:28:13.649 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T17:28:13.682 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T17:28:13.741 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T17:28:13.742 INFO:teuthology.orchestra.run.smithi187.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T17:28:13.746 INFO:teuthology.orchestra.run.smithi187.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T17:28:13.890 INFO:teuthology.orchestra.run.smithi187.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T17:28:13.891 INFO:teuthology.orchestra.run.smithi187.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T17:28:13.932 INFO:teuthology.orchestra.run.smithi187.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T17:28:13.932 INFO:teuthology.orchestra.run.smithi187.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T17:28:13.934 INFO:teuthology.orchestra.run.smithi187.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T17:28:13.934 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T17:28:13.935 INFO:teuthology.orchestra.run.smithi187.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T17:28:13.936 INFO:teuthology.orchestra.run.smithi187.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T17:28:13.941 INFO:teuthology.orchestra.run.smithi187.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T17:28:13.942 INFO:teuthology.orchestra.run.smithi187.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T17:28:13.951 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T17:28:13.987 INFO:teuthology.orchestra.run.smithi187.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T17:28:13.990 INFO:teuthology.orchestra.run.smithi187.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T17:28:14.001 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T17:28:14.038 INFO:teuthology.orchestra.run.smithi187.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T17:28:14.040 INFO:teuthology.orchestra.run.smithi187.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T17:28:14.040 INFO:teuthology.orchestra.run.smithi187.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T17:28:14.043 INFO:teuthology.orchestra.run.smithi187.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T17:28:14.044 INFO:teuthology.orchestra.run.smithi187.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T17:28:14.069 INFO:teuthology.orchestra.run.smithi187.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T17:28:14.077 INFO:teuthology.orchestra.run.smithi187.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T17:28:14.081 INFO:teuthology.orchestra.run.smithi187.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T17:28:14.150 INFO:teuthology.orchestra.run.smithi187.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T17:28:14.150 INFO:teuthology.orchestra.run.smithi187.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T17:28:14.181 INFO:teuthology.orchestra.run.smithi187.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T17:28:14.182 INFO:teuthology.orchestra.run.smithi187.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T17:28:14.182 INFO:teuthology.orchestra.run.smithi187.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T17:28:14.295 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T17:28:14.311 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T17:28:14.353 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T17:28:14.606 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T17:28:14.616 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 10.4 MB in 1s (8,753 kB/s) 2024-09-12T17:28:14.623 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T17:28:14.665 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T17:28:14.712 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T17:28:14.794 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T17:28:14.799 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T17:28:14.852 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T17:28:15.071 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T17:28:15.084 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libguava-java. 2024-09-12T17:28:15.088 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T17:28:15.100 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T17:28:15.130 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T17:28:15.134 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T17:28:15.399 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T17:28:15.416 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T17:28:15.457 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T17:28:15.528 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T17:28:15.545 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T17:28:15.586 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T17:28:15.718 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T17:28:15.747 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T17:28:15.785 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T17:28:15.839 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libguice-java. 2024-09-12T17:28:15.855 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T17:28:15.898 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T17:28:16.021 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T17:28:16.037 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T17:28:16.079 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T17:28:16.277 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T17:28:16.298 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T17:28:16.305 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T17:28:16.327 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T17:28:16.343 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T17:28:16.365 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T17:28:16.570 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T17:28:16.583 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T17:28:16.587 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T17:28:16.600 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T17:28:16.620 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T17:28:16.642 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T17:28:16.903 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T17:28:16.931 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T17:28:16.969 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T17:28:17.250 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T17:28:17.272 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T17:28:17.279 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T17:28:17.288 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T17:28:17.323 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T17:28:17.330 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T17:28:17.582 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T17:28:17.600 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T17:28:17.610 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T17:28:17.628 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T17:28:17.649 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T17:28:17.675 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T17:28:17.885 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libguava-java. 2024-09-12T17:28:17.902 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T17:28:17.928 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T17:28:17.935 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T17:28:17.956 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T17:28:17.994 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T17:28:18.246 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T17:28:18.263 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T17:28:18.297 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T17:28:18.354 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T17:28:18.371 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T17:28:18.413 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T17:28:18.541 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T17:28:18.558 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T17:28:18.599 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T17:28:18.648 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libguice-java. 2024-09-12T17:28:18.664 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T17:28:18.707 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T17:28:18.886 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T17:28:18.903 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T17:28:18.945 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T17:28:19.086 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T17:28:19.102 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T17:28:19.144 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T17:28:19.205 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T17:28:19.222 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T17:28:19.264 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T17:28:19.388 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T17:28:19.405 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T17:28:19.438 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T17:28:19.508 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T17:28:19.525 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T17:28:19.558 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T17:28:19.674 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T17:28:19.690 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T17:28:19.732 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T17:28:19.786 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T17:28:19.803 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T17:28:19.836 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T17:28:19.993 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T17:28:20.009 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T17:28:20.051 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T17:28:20.088 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T17:28:20.105 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T17:28:20.146 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T17:28:20.287 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T17:28:20.303 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T17:28:20.345 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T17:28:20.390 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T17:28:20.407 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T17:28:20.440 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T17:28:20.597 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T17:28:20.614 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T17:28:20.671 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T17:28:20.676 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T17:28:20.693 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T17:28:20.735 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T17:28:20.975 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T17:28:20.991 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T17:28:21.022 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T17:28:21.033 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T17:28:21.038 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T17:28:21.080 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T17:28:21.345 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T17:28:21.361 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T17:28:21.366 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T17:28:21.394 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T17:28:21.404 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T17:28:21.433 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T17:28:21.682 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T17:28:21.693 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T17:28:21.712 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T17:28:21.712 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T17:28:21.744 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T17:28:21.748 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T17:28:21.984 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T17:28:22.000 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T17:28:22.034 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T17:28:22.140 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T17:28:22.165 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T17:28:22.206 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T17:28:22.286 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T17:28:22.303 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T17:28:22.345 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T17:28:22.467 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T17:28:22.483 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T17:28:22.528 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T17:28:22.597 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T17:28:22.613 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T17:28:22.655 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T17:28:22.970 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package maven. 2024-09-12T17:28:22.991 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T17:28:22.998 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T17:28:23.007 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T17:28:23.037 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T17:28:23.049 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T17:28:23.302 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T17:28:23.306 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package python3-magic. 2024-09-12T17:28:23.318 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T17:28:23.335 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T17:28:23.352 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T17:28:23.373 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T17:28:23.605 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T17:28:23.622 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T17:28:23.664 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T17:28:23.676 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package s3cmd. 2024-09-12T17:28:23.704 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T17:28:23.742 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T17:28:23.949 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T17:28:23.966 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T17:28:24.008 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T17:28:24.113 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T17:28:24.214 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T17:28:24.286 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T17:28:24.302 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T17:28:24.324 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T17:28:24.344 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T17:28:24.450 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T17:28:24.576 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T17:28:24.685 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T17:28:24.715 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T17:28:24.731 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T17:28:24.765 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T17:28:24.811 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T17:28:24.937 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T17:28:24.992 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T17:28:25.008 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T17:28:25.063 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T17:28:25.067 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T17:28:25.189 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T17:28:25.315 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T17:28:25.441 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T17:28:25.520 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package maven. 2024-09-12T17:28:25.548 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T17:28:25.567 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T17:28:25.586 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T17:28:25.693 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T17:28:25.827 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T17:28:25.898 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-magic. 2024-09-12T17:28:25.926 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T17:28:25.962 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T17:28:25.964 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T17:28:26.213 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T17:28:26.226 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package s3cmd. 2024-09-12T17:28:26.254 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T17:28:26.292 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T17:28:26.314 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T17:28:26.415 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T17:28:26.532 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T17:28:26.655 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T17:28:26.658 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T17:28:26.772 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T17:28:26.784 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T17:28:26.873 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T17:28:26.919 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T17:28:26.999 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T17:28:27.125 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T17:28:27.212 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T17:28:27.260 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T17:28:27.338 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T17:28:27.386 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T17:28:27.439 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T17:28:27.512 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T17:28:27.540 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T17:28:27.638 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T17:28:27.649 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T17:28:27.763 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T17:28:27.775 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T17:28:27.873 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T17:28:27.901 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T17:28:27.974 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T17:28:28.044 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T17:28:28.091 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T17:28:28.170 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T17:28:28.217 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T17:28:28.296 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T17:28:28.352 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T17:28:28.438 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T17:28:28.478 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T17:28:28.564 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T17:28:28.737 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T17:28:28.821 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T17:28:28.863 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T17:28:28.885 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:28:28.989 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T17:28:29.115 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T17:28:29.233 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T17:28:29.334 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T17:28:29.451 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T17:28:29.745 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T17:28:29.871 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T17:28:29.996 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T17:28:30.114 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T17:28:30.239 INFO:teuthology.orchestra.run.smithi098.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T17:28:30.240 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T17:28:30.245 DEBUG:teuthology.parallel:result is None 2024-09-12T17:28:30.341 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T17:28:30.467 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T17:28:30.593 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T17:28:30.719 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T17:28:30.862 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T17:28:30.987 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T17:28:31.113 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T17:28:31.372 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T17:28:31.434 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:28:32.824 INFO:teuthology.orchestra.run.smithi187.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T17:28:32.829 DEBUG:teuthology.parallel:result is None 2024-09-12T17:28:32.829 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:28:32.971 DEBUG:teuthology.orchestra.run.smithi098:> dpkg-query -W -f '${Version}' ceph 2024-09-12T17:28:32.990 INFO:teuthology.orchestra.run.smithi098.stdout:19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:28:32.990 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:28:32.991 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762-gbad475c1-1jammy is installed. 2024-09-12T17:28:32.992 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:28:33.142 DEBUG:teuthology.orchestra.run.smithi187:> dpkg-query -W -f '${Version}' ceph 2024-09-12T17:28:33.161 INFO:teuthology.orchestra.run.smithi187.stdout:19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:28:33.161 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:28:33.162 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762-gbad475c1-1jammy is installed. 2024-09-12T17:28:33.164 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T17:28:33.165 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:28:33.165 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:28:33.181 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T17:28:33.182 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:28:33.216 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T17:28:33.217 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:28:33.217 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:28:33.234 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:28:33.290 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T17:28:33.291 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:28:33.304 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:28:33.358 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T17:28:33.358 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:28:33.358 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:28:33.370 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:28:33.427 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T17:28:33.427 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:28:33.440 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:28:33.494 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T17:28:33.495 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:28:33.495 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:28:33.508 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:28:33.563 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T17:28:33.563 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:28:33.576 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:28:33.630 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T17:28:33.714 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T17:28:33.715 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /var/log/ceph 2024-09-12T17:28:33.718 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 777 /var/log/ceph 2024-09-12T17:28:33.731 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T17:28:33.731 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:28:33.773 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:28:33.787 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T17:28:33.787 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:28:33.829 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:28:33.854 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T17:28:33.854 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T17:28:33.854 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902728', 'branch': 'wip-rgw-meta-handlers', 'description': 'rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7902728', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rgw-meta-handlers'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-meta-handlers', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6279, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-meta-handlers', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'targets': {'smithi098.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJK2mem+aBNuRmY7XJUxTFaAlRXD0vlMPCGoA5a4SkPRG98Mg8l64F0M0tqoxud88Wxz2+r1P5fCJOOORonGqcI=', 'smithi187.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFgDFTXAgojqxIFr5k/5rq+ybpP4j80cSs7mNcXzH50QSYXoki1iWyY48ybNIIjKJJRQlB44IQzYjXVXZ0QDk5c='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_15:39:52', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T17:28:33.855 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:28:33.884 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:28:33.892 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:28:33.932 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:28:33.947 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:28:33.947 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:28:33.991 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:28:33.992 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2024-09-12T17:28:34.039 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:28:34.040 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:28:34.040 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 875 Links: 1 2024-09-12T17:28:34.040 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:28:34.040 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-12 17:22:46.027283765 +0000 2024-09-12T17:28:34.040 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-12 17:22:45.755286195 +0000 2024-09-12T17:28:34.040 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-12 17:22:45.755286195 +0000 2024-09-12T17:28:34.040 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2024-09-12T17:28:34.040 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:28:34.094 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-12T17:28:34.094 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-12T17:28:34.094 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.00044341 s, 1.2 MB/s 2024-09-12T17:28:34.095 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:28:34.145 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2024-09-12T17:28:34.191 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:28:34.192 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:28:34.192 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-09-12T17:28:34.192 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:28:34.192 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-12 17:22:46.479279728 +0000 2024-09-12T17:28:34.192 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-12 17:22:46.247281800 +0000 2024-09-12T17:28:34.192 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-12 17:22:46.247281800 +0000 2024-09-12T17:28:34.192 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2024-09-12T17:28:34.192 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:28:34.246 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-12T17:28:34.246 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-12T17:28:34.246 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.00037629 s, 1.4 MB/s 2024-09-12T17:28:34.247 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:28:34.296 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2024-09-12T17:28:34.343 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:28:34.343 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:28:34.344 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-09-12T17:28:34.344 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:28:34.344 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-12 17:22:46.951275512 +0000 2024-09-12T17:28:34.344 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-12 17:22:46.715277620 +0000 2024-09-12T17:28:34.344 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-12 17:22:46.715277620 +0000 2024-09-12T17:28:34.344 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2024-09-12T17:28:34.344 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:28:34.397 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-12T17:28:34.397 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-12T17:28:34.397 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000350879 s, 1.5 MB/s 2024-09-12T17:28:34.399 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:28:34.449 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2024-09-12T17:28:34.496 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:28:34.496 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:28:34.496 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-09-12T17:28:34.496 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:28:34.496 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-12 17:22:47.191273368 +0000 2024-09-12T17:28:34.496 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-12 17:22:47.187273404 +0000 2024-09-12T17:28:34.496 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-12 17:22:47.187273404 +0000 2024-09-12T17:28:34.496 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: - 2024-09-12T17:28:34.497 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:28:34.549 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-12T17:28:34.549 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-12T17:28:34.550 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.00038653 s, 1.3 MB/s 2024-09-12T17:28:34.551 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:28:34.604 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:28:34.604 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T17:28:34.605 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:28:34.612 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:28:34.612 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_1 2024-09-12T17:28:34.660 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:28:34.660 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:28:34.660 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-09-12T17:28:34.660 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:28:34.660 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-12 17:22:46.674884283 +0000 2024-09-12T17:28:34.660 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-12 17:22:46.406886677 +0000 2024-09-12T17:28:34.660 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-12 17:22:46.406886677 +0000 2024-09-12T17:28:34.660 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-09-12T17:28:34.661 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:28:34.714 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-12T17:28:34.715 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-12T17:28:34.715 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000444974 s, 1.2 MB/s 2024-09-12T17:28:34.716 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:28:34.765 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_2 2024-09-12T17:28:34.811 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:28:34.811 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:28:34.811 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-09-12T17:28:34.812 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:28:34.812 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-12 17:22:47.158879960 +0000 2024-09-12T17:28:34.812 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-12 17:22:46.906882211 +0000 2024-09-12T17:28:34.812 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-12 17:22:46.906882211 +0000 2024-09-12T17:28:34.812 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-09-12T17:28:34.812 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:28:34.865 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-12T17:28:34.866 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-12T17:28:34.866 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000434991 s, 1.2 MB/s 2024-09-12T17:28:34.867 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:28:34.917 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_3 2024-09-12T17:28:34.964 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:28:34.964 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:28:34.964 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-09-12T17:28:34.964 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:28:34.964 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-12 17:22:47.410877710 +0000 2024-09-12T17:28:34.964 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-12 17:22:47.406877745 +0000 2024-09-12T17:28:34.964 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-12 17:22:47.406877745 +0000 2024-09-12T17:28:34.964 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-09-12T17:28:34.965 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:28:35.017 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-12T17:28:35.018 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-12T17:28:35.018 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000419577 s, 1.2 MB/s 2024-09-12T17:28:35.019 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:28:35.069 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_4 2024-09-12T17:28:35.115 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:28:35.115 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:28:35.115 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-09-12T17:28:35.115 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:28:35.115 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-09-12 17:22:48.222870457 +0000 2024-09-12T17:28:35.115 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-09-12 17:22:47.942872957 +0000 2024-09-12T17:28:35.115 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-09-12 17:22:47.942872957 +0000 2024-09-12T17:28:35.116 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-09-12T17:28:35.116 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:28:35.169 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-09-12T17:28:35.169 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-09-12T17:28:35.170 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000351415 s, 1.5 MB/s 2024-09-12T17:28:35.171 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:28:35.220 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:28:35.221 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T17:28:35.221 INFO:tasks.ceph:Generating config... 2024-09-12T17:28:35.222 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T17:28:35.222 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T17:28:35.222 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T17:28:35.222 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T17:28:35.222 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T17:28:35.222 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:28:35.223 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-12T17:28:35.223 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-12T17:28:35.223 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T17:28:35.223 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T17:28:35.223 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T17:28:35.223 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T17:28:35.223 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T17:28:35.223 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T17:28:35.223 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T17:28:35.223 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T17:28:35.224 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T17:28:35.224 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-12T17:28:35.224 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T17:28:35.224 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T17:28:35.224 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T17:28:35.224 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T17:28:35.224 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T17:28:35.224 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T17:28:35.224 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T17:28:35.224 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-12T17:28:35.224 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T17:28:35.224 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T17:28:35.224 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T17:28:35.225 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T17:28:35.225 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T17:28:35.225 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T17:28:35.225 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T17:28:35.225 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T17:28:35.225 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T17:28:35.225 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T17:28:35.225 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T17:28:35.225 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T17:28:35.226 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T17:28:35.226 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T17:28:35.226 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T17:28:35.226 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-12T17:28:35.226 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T17:28:35.226 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T17:28:35.226 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T17:28:35.226 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T17:28:35.261 INFO:teuthology.orchestra.run.smithi098.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T17:28:35.274 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T17:28:35.349 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:28:35.403 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.98'), ('mon.c', '[v2:172.21.15.98:3301,v1:172.21.15.98:6790]'), ('mon.b', '172.21.15.187')] 2024-09-12T17:28:35.404 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.98,[v2:172.21.15.98:3301,v1:172.21.15.98:6790],172.21.15.187', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T17:28:35.405 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:28:35.405 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:28:35.452 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.98 --addv c '[v2:172.21.15.98:3301,v1:172.21.15.98:6790]' --add b 172.21.15.187 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:28:35.537 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:28:35.537 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:28:35.538 INFO:teuthology.orchestra.run.smithi098.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:28:35.538 INFO:teuthology.orchestra.run.smithi098.stdout:monmaptool: generated fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:28:35.538 INFO:teuthology.orchestra.run.smithi098.stdout:setting min_mon_release = quincy 2024-09-12T17:28:35.538 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 0 2024-09-12T17:28:35.538 INFO:teuthology.orchestra.run.smithi098.stdout:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:28:35.538 INFO:teuthology.orchestra.run.smithi098.stdout:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:28:35.538 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:28:35.538 INFO:teuthology.orchestra.run.smithi098.stdout:min_mon_release 17 (quincy) 2024-09-12T17:28:35.538 INFO:teuthology.orchestra.run.smithi098.stdout:election_strategy: 1 2024-09-12T17:28:35.539 INFO:teuthology.orchestra.run.smithi098.stdout:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:28:35.539 INFO:teuthology.orchestra.run.smithi098.stdout:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:28:35.539 INFO:teuthology.orchestra.run.smithi098.stdout:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:28:35.539 INFO:teuthology.orchestra.run.smithi098.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T17:28:35.540 DEBUG:teuthology.orchestra.run.smithi098:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:28:35.587 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b... 2024-09-12T17:28:35.588 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:28:35.633 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:28:35.661 INFO:teuthology.orchestra.run.smithi098.stdout:[global] 2024-09-12T17:28:35.661 INFO:teuthology.orchestra.run.smithi098.stdout: chdir = "" 2024-09-12T17:28:35.661 INFO:teuthology.orchestra.run.smithi098.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:28:35.661 INFO:teuthology.orchestra.run.smithi098.stdout: auth supported = cephx 2024-09-12T17:28:35.661 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: filestore xattr use omap = true 2024-09-12T17:28:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: mon clock drift allowed = 1.000 2024-09-12T17:28:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: osd crush chooseleaf type = 0 2024-09-12T17:28:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: auth debug = true 2024-09-12T17:28:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on old message = true 2024-09-12T17:28:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on bug = true 2024-09-12T17:28:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:28:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: mon pg warn max object skew = 0 2024-09-12T17:28:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.662 INFO:teuthology.orchestra.run.smithi098.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:28:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:28:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default size = 2 2024-09-12T17:28:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow primary affinity = true 2024-09-12T17:28:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow pg remap = true 2024-09-12T17:28:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:28:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:28:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on no sortbitwise = false 2024-09-12T17:28:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:28:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on too few osds = false 2024-09-12T17:28:35.663 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:28:35.664 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:28:35.664 INFO:teuthology.orchestra.run.smithi098.stdout: mon_allow_pool_size_one = true 2024-09-12T17:28:35.664 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.664 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:28:35.664 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.664 INFO:teuthology.orchestra.run.smithi098.stdout: osd default data pool replay window = 5 2024-09-12T17:28:35.664 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.664 INFO:teuthology.orchestra.run.smithi098.stdout: mon allow pool delete = true 2024-09-12T17:28:35.664 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.664 INFO:teuthology.orchestra.run.smithi098.stdout: mon cluster log file level = debug 2024-09-12T17:28:35.664 INFO:teuthology.orchestra.run.smithi098.stdout: debug asserts on shutdown = true 2024-09-12T17:28:35.664 INFO:teuthology.orchestra.run.smithi098.stdout: mon health detail to clog = false 2024-09-12T17:28:35.665 INFO:teuthology.orchestra.run.smithi098.stdout: mon host = "172.21.15.98,[v2:172.21.15.98:3301,v1:172.21.15.98:6790],172.21.15.187" 2024-09-12T17:28:35.665 INFO:teuthology.orchestra.run.smithi098.stdout: mon client directed command retry = 5 2024-09-12T17:28:35.665 INFO:teuthology.orchestra.run.smithi098.stdout: ms inject socket failures = 5000 2024-09-12T17:28:35.665 INFO:teuthology.orchestra.run.smithi098.stdout: osd heartbeat grace = 40 2024-09-12T17:28:35.665 INFO:teuthology.orchestra.run.smithi098.stdout: osd_max_pg_log_entries = 10 2024-09-12T17:28:35.665 INFO:teuthology.orchestra.run.smithi098.stdout: osd_min_pg_log_entries = 10 2024-09-12T17:28:35.665 INFO:teuthology.orchestra.run.smithi098.stdout: fsid = 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:28:35.665 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.665 INFO:teuthology.orchestra.run.smithi098.stdout:[osd] 2024-09-12T17:28:35.665 INFO:teuthology.orchestra.run.smithi098.stdout: osd journal size = 100 2024-09-12T17:28:35.665 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.665 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub load threshold = 5.0 2024-09-12T17:28:35.665 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub max interval = 600 2024-09-12T17:28:35.665 INFO:teuthology.orchestra.run.smithi098.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:28:35.666 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.666 INFO:teuthology.orchestra.run.smithi098.stdout: osd recover clone overlap = true 2024-09-12T17:28:35.666 INFO:teuthology.orchestra.run.smithi098.stdout: osd recovery max chunk = 1048576 2024-09-12T17:28:35.666 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.666 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug shutdown = true 2024-09-12T17:28:35.666 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug op order = true 2024-09-12T17:28:35.666 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug verify stray on activate = true 2024-09-12T17:28:35.666 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug trim objects = true 2024-09-12T17:28:35.667 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.667 INFO:teuthology.orchestra.run.smithi098.stdout: osd open classes on start = true 2024-09-12T17:28:35.667 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug pg log writeout = true 2024-09-12T17:28:35.667 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.667 INFO:teuthology.orchestra.run.smithi098.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:28:35.667 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.667 INFO:teuthology.orchestra.run.smithi098.stdout: osd map max advance = 10 2024-09-12T17:28:35.667 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.667 INFO:teuthology.orchestra.run.smithi098.stdout: journal zero on create = true 2024-09-12T17:28:35.668 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.668 INFO:teuthology.orchestra.run.smithi098.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:28:35.668 INFO:teuthology.orchestra.run.smithi098.stdout: filestore apply finisher threads = 3 2024-09-12T17:28:35.668 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.668 INFO:teuthology.orchestra.run.smithi098.stdout: bdev debug aio = true 2024-09-12T17:28:35.668 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug misdirected ops = true 2024-09-12T17:28:35.668 INFO:teuthology.orchestra.run.smithi098.stdout: bdev async discard = True 2024-09-12T17:28:35.668 INFO:teuthology.orchestra.run.smithi098.stdout: bdev enable discard = True 2024-09-12T17:28:35.668 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore allocator = bitmap 2024-09-12T17:28:35.668 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore block size = 96636764160 2024-09-12T17:28:35.668 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore fsck on mount = True 2024-09-12T17:28:35.668 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluefs = 1/20 2024-09-12T17:28:35.668 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluestore = 1/20 2024-09-12T17:28:35.669 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-12T17:28:35.669 INFO:teuthology.orchestra.run.smithi098.stdout: debug objclass = 20 2024-09-12T17:28:35.669 INFO:teuthology.orchestra.run.smithi098.stdout: debug osd = 20 2024-09-12T17:28:35.669 INFO:teuthology.orchestra.run.smithi098.stdout: debug rocksdb = 4/10 2024-09-12T17:28:35.669 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:28:35.669 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd full ratio = 0.9 2024-09-12T17:28:35.669 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:28:35.669 INFO:teuthology.orchestra.run.smithi098.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:28:35.669 INFO:teuthology.orchestra.run.smithi098.stdout: osd fast shutdown = False 2024-09-12T17:28:35.669 INFO:teuthology.orchestra.run.smithi098.stdout: osd objectstore = bluestore 2024-09-12T17:28:35.669 INFO:teuthology.orchestra.run.smithi098.stdout: osd shutdown pgref assert = True 2024-09-12T17:28:35.669 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.670 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr] 2024-09-12T17:28:35.670 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-12T17:28:35.670 INFO:teuthology.orchestra.run.smithi098.stdout: debug mgr = 20 2024-09-12T17:28:35.670 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2024-09-12T17:28:35.670 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2024-09-12T17:28:35.670 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:28:35.670 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:28:35.670 INFO:teuthology.orchestra.run.smithi098.stdout: mgr/telemetry/nag = false 2024-09-12T17:28:35.670 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.670 INFO:teuthology.orchestra.run.smithi098.stdout:[mon] 2024-09-12T17:28:35.670 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-12T17:28:35.670 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2024-09-12T17:28:35.670 INFO:teuthology.orchestra.run.smithi098.stdout: debug paxos = 20 2024-09-12T17:28:35.671 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2024-09-12T17:28:35.671 INFO:teuthology.orchestra.run.smithi098.stdout: mon data avail warn = 5 2024-09-12T17:28:35.671 INFO:teuthology.orchestra.run.smithi098.stdout: mon mgr mkfs grace = 240 2024-09-12T17:28:35.671 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:28:35.671 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd reporter subtree level = osd 2024-09-12T17:28:35.671 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd prime pg temp = true 2024-09-12T17:28:35.671 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:28:35.671 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.671 INFO:teuthology.orchestra.run.smithi098.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:28:35.671 INFO:teuthology.orchestra.run.smithi098.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:28:35.671 INFO:teuthology.orchestra.run.smithi098.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:28:35.671 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.671 INFO:teuthology.orchestra.run.smithi098.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:28:35.672 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:28:35.672 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:28:35.672 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.672 INFO:teuthology.orchestra.run.smithi098.stdout: # 1m isn't quite enough 2024-09-12T17:28:35.672 INFO:teuthology.orchestra.run.smithi098.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:28:35.672 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.672 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:28:35.672 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd crush smoke test = False 2024-09-12T17:28:35.672 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:28:35.672 INFO:teuthology.orchestra.run.smithi098.stdout:[client] 2024-09-12T17:28:35.672 INFO:teuthology.orchestra.run.smithi098.stdout: rgw cache enabled = true 2024-09-12T17:28:35.672 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable ops log = true 2024-09-12T17:28:35.672 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable usage log = true 2024-09-12T17:28:35.673 INFO:teuthology.orchestra.run.smithi098.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:28:35.673 INFO:teuthology.orchestra.run.smithi098.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:28:35.673 INFO:teuthology.orchestra.run.smithi098.stdout: debug rgw = 20 2024-09-12T17:28:35.673 INFO:teuthology.orchestra.run.smithi098.stdout: debug rgw notification = 20 2024-09-12T17:28:35.673 INFO:teuthology.orchestra.run.smithi098.stdout: rgw bucket counters cache = True 2024-09-12T17:28:35.673 INFO:teuthology.orchestra.run.smithi098.stdout: rgw crypt require ssl = False 2024-09-12T17:28:35.673 INFO:teuthology.orchestra.run.smithi098.stdout: rgw crypt s3 kms backend = testing 2024-09-12T17:28:35.673 INFO:teuthology.orchestra.run.smithi098.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:28:35.673 INFO:teuthology.orchestra.run.smithi098.stdout: rgw max chunk size = 4194304 2024-09-12T17:28:35.673 INFO:teuthology.orchestra.run.smithi098.stdout: rgw obj stripe size = 6291456 2024-09-12T17:28:35.673 INFO:teuthology.orchestra.run.smithi098.stdout: rgw reshard progress judge interval = 10 2024-09-12T17:28:35.673 INFO:teuthology.orchestra.run.smithi098.stdout: rgw s3 auth use sts = True 2024-09-12T17:28:35.674 INFO:teuthology.orchestra.run.smithi098.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T17:28:35.674 INFO:teuthology.orchestra.run.smithi098.stdout: rgw torrent flag = True 2024-09-12T17:28:35.674 INFO:teuthology.orchestra.run.smithi098.stdout: rgw user counters cache = True 2024-09-12T17:28:35.674 INFO:teuthology.orchestra.run.smithi098.stdout: setgroup = ceph 2024-09-12T17:28:35.674 INFO:teuthology.orchestra.run.smithi098.stdout: setuser = ceph 2024-09-12T17:28:35.674 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.a] 2024-09-12T17:28:35.674 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.c] 2024-09-12T17:28:35.674 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.b] 2024-09-12T17:28:35.676 INFO:teuthology.orchestra.run.smithi187.stdout:[global] 2024-09-12T17:28:35.676 INFO:teuthology.orchestra.run.smithi187.stdout: chdir = "" 2024-09-12T17:28:35.676 INFO:teuthology.orchestra.run.smithi187.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:28:35.676 INFO:teuthology.orchestra.run.smithi187.stdout: auth supported = cephx 2024-09-12T17:28:35.676 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.676 INFO:teuthology.orchestra.run.smithi187.stdout: filestore xattr use omap = true 2024-09-12T17:28:35.677 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.677 INFO:teuthology.orchestra.run.smithi187.stdout: mon clock drift allowed = 1.000 2024-09-12T17:28:35.677 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.677 INFO:teuthology.orchestra.run.smithi187.stdout: osd crush chooseleaf type = 0 2024-09-12T17:28:35.677 INFO:teuthology.orchestra.run.smithi187.stdout: auth debug = true 2024-09-12T17:28:35.677 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.677 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on old message = true 2024-09-12T17:28:35.677 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on bug = true 2024-09-12T17:28:35.677 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.677 INFO:teuthology.orchestra.run.smithi187.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:28:35.677 INFO:teuthology.orchestra.run.smithi187.stdout: mon pg warn max object skew = 0 2024-09-12T17:28:35.677 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.678 INFO:teuthology.orchestra.run.smithi187.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:28:35.678 INFO:teuthology.orchestra.run.smithi187.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:28:35.678 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.678 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default size = 2 2024-09-12T17:28:35.678 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.678 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow primary affinity = true 2024-09-12T17:28:35.678 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow pg remap = true 2024-09-12T17:28:35.678 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:28:35.679 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:28:35.679 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on no sortbitwise = false 2024-09-12T17:28:35.679 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:28:35.679 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on too few osds = false 2024-09-12T17:28:35.679 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:28:35.679 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:28:35.679 INFO:teuthology.orchestra.run.smithi187.stdout: mon_allow_pool_size_one = true 2024-09-12T17:28:35.679 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.679 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:28:35.679 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.679 INFO:teuthology.orchestra.run.smithi187.stdout: osd default data pool replay window = 5 2024-09-12T17:28:35.679 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.679 INFO:teuthology.orchestra.run.smithi187.stdout: mon allow pool delete = true 2024-09-12T17:28:35.679 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.680 INFO:teuthology.orchestra.run.smithi187.stdout: mon cluster log file level = debug 2024-09-12T17:28:35.680 INFO:teuthology.orchestra.run.smithi187.stdout: debug asserts on shutdown = true 2024-09-12T17:28:35.680 INFO:teuthology.orchestra.run.smithi187.stdout: mon health detail to clog = false 2024-09-12T17:28:35.680 INFO:teuthology.orchestra.run.smithi187.stdout: mon host = "172.21.15.98,[v2:172.21.15.98:3301,v1:172.21.15.98:6790],172.21.15.187" 2024-09-12T17:28:35.680 INFO:teuthology.orchestra.run.smithi187.stdout: mon client directed command retry = 5 2024-09-12T17:28:35.680 INFO:teuthology.orchestra.run.smithi187.stdout: ms inject socket failures = 5000 2024-09-12T17:28:35.680 INFO:teuthology.orchestra.run.smithi187.stdout: osd heartbeat grace = 40 2024-09-12T17:28:35.680 INFO:teuthology.orchestra.run.smithi187.stdout: osd_max_pg_log_entries = 10 2024-09-12T17:28:35.680 INFO:teuthology.orchestra.run.smithi187.stdout: osd_min_pg_log_entries = 10 2024-09-12T17:28:35.680 INFO:teuthology.orchestra.run.smithi187.stdout: fsid = 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:28:35.680 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.680 INFO:teuthology.orchestra.run.smithi187.stdout:[osd] 2024-09-12T17:28:35.680 INFO:teuthology.orchestra.run.smithi187.stdout: osd journal size = 100 2024-09-12T17:28:35.681 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.681 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub load threshold = 5.0 2024-09-12T17:28:35.681 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub max interval = 600 2024-09-12T17:28:35.681 INFO:teuthology.orchestra.run.smithi187.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:28:35.681 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.681 INFO:teuthology.orchestra.run.smithi187.stdout: osd recover clone overlap = true 2024-09-12T17:28:35.681 INFO:teuthology.orchestra.run.smithi187.stdout: osd recovery max chunk = 1048576 2024-09-12T17:28:35.681 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.681 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug shutdown = true 2024-09-12T17:28:35.681 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug op order = true 2024-09-12T17:28:35.682 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug verify stray on activate = true 2024-09-12T17:28:35.682 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug trim objects = true 2024-09-12T17:28:35.682 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.682 INFO:teuthology.orchestra.run.smithi187.stdout: osd open classes on start = true 2024-09-12T17:28:35.682 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug pg log writeout = true 2024-09-12T17:28:35.682 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.682 INFO:teuthology.orchestra.run.smithi187.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:28:35.682 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.682 INFO:teuthology.orchestra.run.smithi187.stdout: osd map max advance = 10 2024-09-12T17:28:35.682 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.682 INFO:teuthology.orchestra.run.smithi187.stdout: journal zero on create = true 2024-09-12T17:28:35.682 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.682 INFO:teuthology.orchestra.run.smithi187.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:28:35.683 INFO:teuthology.orchestra.run.smithi187.stdout: filestore apply finisher threads = 3 2024-09-12T17:28:35.683 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.683 INFO:teuthology.orchestra.run.smithi187.stdout: bdev debug aio = true 2024-09-12T17:28:35.683 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug misdirected ops = true 2024-09-12T17:28:35.683 INFO:teuthology.orchestra.run.smithi187.stdout: bdev async discard = True 2024-09-12T17:28:35.683 INFO:teuthology.orchestra.run.smithi187.stdout: bdev enable discard = True 2024-09-12T17:28:35.683 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore allocator = bitmap 2024-09-12T17:28:35.683 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore block size = 96636764160 2024-09-12T17:28:35.683 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore fsck on mount = True 2024-09-12T17:28:35.683 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluefs = 1/20 2024-09-12T17:28:35.683 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluestore = 1/20 2024-09-12T17:28:35.683 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-09-12T17:28:35.683 INFO:teuthology.orchestra.run.smithi187.stdout: debug objclass = 20 2024-09-12T17:28:35.684 INFO:teuthology.orchestra.run.smithi187.stdout: debug osd = 20 2024-09-12T17:28:35.684 INFO:teuthology.orchestra.run.smithi187.stdout: debug rocksdb = 4/10 2024-09-12T17:28:35.684 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:28:35.684 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd full ratio = 0.9 2024-09-12T17:28:35.684 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:28:35.684 INFO:teuthology.orchestra.run.smithi187.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:28:35.684 INFO:teuthology.orchestra.run.smithi187.stdout: osd fast shutdown = False 2024-09-12T17:28:35.684 INFO:teuthology.orchestra.run.smithi187.stdout: osd objectstore = bluestore 2024-09-12T17:28:35.684 INFO:teuthology.orchestra.run.smithi187.stdout: osd shutdown pgref assert = True 2024-09-12T17:28:35.684 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.684 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr] 2024-09-12T17:28:35.684 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-09-12T17:28:35.684 INFO:teuthology.orchestra.run.smithi187.stdout: debug mgr = 20 2024-09-12T17:28:35.685 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2024-09-12T17:28:35.685 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2024-09-12T17:28:35.685 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:28:35.685 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:28:35.685 INFO:teuthology.orchestra.run.smithi187.stdout: mgr/telemetry/nag = false 2024-09-12T17:28:35.685 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.685 INFO:teuthology.orchestra.run.smithi187.stdout:[mon] 2024-09-12T17:28:35.685 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-09-12T17:28:35.685 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2024-09-12T17:28:35.685 INFO:teuthology.orchestra.run.smithi187.stdout: debug paxos = 20 2024-09-12T17:28:35.685 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2024-09-12T17:28:35.685 INFO:teuthology.orchestra.run.smithi187.stdout: mon data avail warn = 5 2024-09-12T17:28:35.686 INFO:teuthology.orchestra.run.smithi187.stdout: mon mgr mkfs grace = 240 2024-09-12T17:28:35.686 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:28:35.686 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd reporter subtree level = osd 2024-09-12T17:28:35.686 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd prime pg temp = true 2024-09-12T17:28:35.686 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:28:35.686 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.686 INFO:teuthology.orchestra.run.smithi187.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:28:35.686 INFO:teuthology.orchestra.run.smithi187.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:28:35.686 INFO:teuthology.orchestra.run.smithi187.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:28:35.686 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.686 INFO:teuthology.orchestra.run.smithi187.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:28:35.686 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:28:35.687 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:28:35.687 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.687 INFO:teuthology.orchestra.run.smithi187.stdout: # 1m isn't quite enough 2024-09-12T17:28:35.687 INFO:teuthology.orchestra.run.smithi187.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:28:35.687 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.687 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:28:35.687 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd crush smoke test = False 2024-09-12T17:28:35.687 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-09-12T17:28:35.687 INFO:teuthology.orchestra.run.smithi187.stdout:[client] 2024-09-12T17:28:35.687 INFO:teuthology.orchestra.run.smithi187.stdout: rgw cache enabled = true 2024-09-12T17:28:35.687 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable ops log = true 2024-09-12T17:28:35.687 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable usage log = true 2024-09-12T17:28:35.687 INFO:teuthology.orchestra.run.smithi187.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:28:35.688 INFO:teuthology.orchestra.run.smithi187.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:28:35.688 INFO:teuthology.orchestra.run.smithi187.stdout: debug rgw = 20 2024-09-12T17:28:35.688 INFO:teuthology.orchestra.run.smithi187.stdout: debug rgw notification = 20 2024-09-12T17:28:35.688 INFO:teuthology.orchestra.run.smithi187.stdout: rgw bucket counters cache = True 2024-09-12T17:28:35.688 INFO:teuthology.orchestra.run.smithi187.stdout: rgw crypt require ssl = False 2024-09-12T17:28:35.688 INFO:teuthology.orchestra.run.smithi187.stdout: rgw crypt s3 kms backend = testing 2024-09-12T17:28:35.688 INFO:teuthology.orchestra.run.smithi187.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T17:28:35.688 INFO:teuthology.orchestra.run.smithi187.stdout: rgw max chunk size = 4194304 2024-09-12T17:28:35.688 INFO:teuthology.orchestra.run.smithi187.stdout: rgw obj stripe size = 6291456 2024-09-12T17:28:35.688 INFO:teuthology.orchestra.run.smithi187.stdout: rgw reshard progress judge interval = 10 2024-09-12T17:28:35.688 INFO:teuthology.orchestra.run.smithi187.stdout: rgw s3 auth use sts = True 2024-09-12T17:28:35.688 INFO:teuthology.orchestra.run.smithi187.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T17:28:35.688 INFO:teuthology.orchestra.run.smithi187.stdout: rgw torrent flag = True 2024-09-12T17:28:35.689 INFO:teuthology.orchestra.run.smithi187.stdout: rgw user counters cache = True 2024-09-12T17:28:35.689 INFO:teuthology.orchestra.run.smithi187.stdout: setgroup = ceph 2024-09-12T17:28:35.689 INFO:teuthology.orchestra.run.smithi187.stdout: setuser = ceph 2024-09-12T17:28:35.689 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.a] 2024-09-12T17:28:35.689 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.c] 2024-09-12T17:28:35.689 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.b] 2024-09-12T17:28:35.689 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T17:28:35.689 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T17:28:35.765 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T17:28:35.766 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:28:35.766 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T17:28:35.811 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:28:35.811 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T17:28:35.860 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi098.front.sepia.ceph.com 2024-09-12T17:28:35.860 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:28:35.860 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:28:35.860 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:28:35.926 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:28:35.926 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:28:35.976 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T17:28:35.976 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T17:28:35.976 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:28:35.976 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:28:35.999 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T17:28:35.999 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:28:36.047 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T17:28:36.048 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T17:28:36.048 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T17:28:36.092 INFO:teuthology.orchestra.run.smithi098.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T17:28:36.095 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:28:36.140 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:28:36.151 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T17:28:36.152 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T17:28:36.152 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T17:28:36.187 INFO:teuthology.orchestra.run.smithi098.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T17:28:36.199 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T17:28:36.234 INFO:teuthology.orchestra.run.smithi187.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T17:28:36.245 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T17:28:36.245 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T17:28:36.245 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T17:28:36.261 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:28:36.261 INFO:tasks.ceph:role: osd.0 2024-09-12T17:28:36.261 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-12T17:28:36.261 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:28:36.322 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:28:36.323 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:28:36.323 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:28:36.323 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:28:36.323 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:28:36.323 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:28:36.323 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:28:36.323 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:28:36.323 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:28:36.323 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:28:36.802 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-12T17:28:36.804 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-12T17:28:36.804 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T17:28:36.950 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T17:28:36.961 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:28:36.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:28:36.962 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T17:28:37.017 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:28:37.017 INFO:tasks.ceph:role: osd.1 2024-09-12T17:28:37.017 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-12T17:28:37.017 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:28:37.080 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:28:37.080 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:28:37.080 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:28:37.080 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:28:37.080 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:28:37.080 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:28:37.080 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:28:37.080 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:28:37.080 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:28:37.080 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:28:37.506 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-12T17:28:37.508 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-12T17:28:37.508 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T17:28:37.572 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T17:28:37.627 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:28:37.628 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:28:37.628 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T17:28:37.681 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:28:37.681 INFO:tasks.ceph:role: osd.2 2024-09-12T17:28:37.681 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-12T17:28:37.681 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:28:37.743 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:28:37.743 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:28:37.743 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:28:37.743 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:28:37.743 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:28:37.743 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:28:37.743 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:28:37.743 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:28:37.744 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:28:37.744 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:28:38.217 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-12T17:28:38.219 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-12T17:28:38.219 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T17:28:38.311 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T17:28:38.322 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:28:38.323 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:28:38.323 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T17:28:38.379 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:28:38.379 INFO:tasks.ceph:role: osd.3 2024-09-12T17:28:38.379 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-12T17:28:38.379 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T17:28:38.443 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:28:38.444 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:28:38.444 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:28:38.444 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:28:38.444 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:28:38.444 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:28:38.444 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:28:38.444 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:28:38.444 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:28:38.444 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:28:38.906 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-12T17:28:38.908 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-12T17:28:38.908 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T17:28:39.072 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T17:28:39.083 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:28:39.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:28:39.084 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:28:39.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:28:39.199+0000 7f865a1d77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T17:28:39.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:28:39.203+0000 7f865a1d77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T17:28:39.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:28:39.203+0000 7f865a1d77c0 -1 bdev(0x559b4ad2f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T17:28:39.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:28:39.203+0000 7f865a1d77c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T17:28:42.331 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T17:28:42.345 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:28:42.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:28:42.423+0000 7f5d880ad7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T17:28:42.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:28:42.423+0000 7f5d880ad7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T17:28:42.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:28:42.423+0000 7f5d880ad7c0 -1 bdev(0x5555e76b5800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T17:28:42.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:28:42.423+0000 7f5d880ad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T17:28:45.591 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T17:28:45.647 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:28:45.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:28:45.730+0000 7efc2c1f47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T17:28:45.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:28:45.730+0000 7efc2c1f47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T17:28:45.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:28:45.730+0000 7efc2c1f47c0 -1 bdev(0x55717542d800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T17:28:45.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:28:45.730+0000 7efc2c1f47c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T17:28:48.890 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T17:28:48.951 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:28:49.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:28:49.034+0000 7f3844b0a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T17:28:49.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:28:49.034+0000 7f3844b0a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T17:28:49.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:28:49.034+0000 7f3844b0a7c0 -1 bdev(0x55d5474bd800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T17:28:49.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:28:49.034+0000 7f3844b0a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T17:28:52.193 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T17:28:52.247 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T17:28:52.261 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:28:52.261 INFO:tasks.ceph:role: osd.4 2024-09-12T17:28:52.261 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T17:28:52.262 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:28:52.322 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:28:52.323 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:28:52.323 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:28:52.323 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:28:52.323 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:28:52.323 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:28:52.323 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:28:52.323 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:28:52.323 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:28:52.323 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:28:52.783 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2024-09-12T17:28:52.785 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2024-09-12T17:28:52.785 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T17:28:52.873 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T17:28:52.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:28:52.926 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:28:52.926 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T17:28:52.980 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:28:52.980 INFO:tasks.ceph:role: osd.5 2024-09-12T17:28:52.980 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T17:28:52.980 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:28:53.044 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:28:53.044 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:28:53.044 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:28:53.044 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:28:53.045 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:28:53.045 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:28:53.045 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:28:53.045 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:28:53.045 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:28:53.045 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:28:53.516 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2024-09-12T17:28:53.519 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2024-09-12T17:28:53.519 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T17:28:53.685 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T17:28:53.696 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:28:53.697 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:28:53.697 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T17:28:53.751 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:28:53.752 INFO:tasks.ceph:role: osd.6 2024-09-12T17:28:53.752 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T17:28:53.752 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:28:53.819 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:28:53.819 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:28:53.819 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:28:53.819 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:28:53.820 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:28:53.820 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:28:53.820 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:28:53.820 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:28:53.820 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:28:53.820 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:28:54.290 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2024-09-12T17:28:54.292 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2024-09-12T17:28:54.292 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T17:28:54.428 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T17:28:54.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:28:54.440 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:28:54.441 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T17:28:54.494 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:28:54.494 INFO:tasks.ceph:role: osd.7 2024-09-12T17:28:54.495 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T17:28:54.495 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T17:28:54.559 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:28:54.559 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:28:54.559 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:28:54.559 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:28:54.559 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:28:54.559 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:28:54.559 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:28:54.559 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:28:54.560 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:28:54.560 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:28:54.983 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2024-09-12T17:28:54.985 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2024-09-12T17:28:54.985 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T17:28:55.076 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T17:28:55.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:28:55.087 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:28:55.088 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:28:55.218 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T17:28:55.212+0000 7f000fd9c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T17:28:55.223 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T17:28:55.220+0000 7f000fd9c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T17:28:55.223 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T17:28:55.220+0000 7f000fd9c7c0 -1 bdev(0x55f1ea961800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T17:28:55.224 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T17:28:55.220+0000 7f000fd9c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T17:28:58.369 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T17:28:58.383 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:28:58.466 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T17:28:58.460+0000 7f12369fe7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T17:28:58.467 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T17:28:58.464+0000 7f12369fe7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T17:28:58.467 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T17:28:58.464+0000 7f12369fe7c0 -1 bdev(0x56269eab9800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T17:28:58.467 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T17:28:58.464+0000 7f12369fe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T17:29:01.579 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T17:29:01.642 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:29:01.722 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T17:29:01.716+0000 7f3912e9d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T17:29:01.722 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T17:29:01.716+0000 7f3912e9d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T17:29:01.723 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T17:29:01.716+0000 7f3912e9d7c0 -1 bdev(0x55b2088b9800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T17:29:01.723 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T17:29:01.716+0000 7f3912e9d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T17:29:04.850 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T17:29:04.903 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:29:04.984 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T17:29:04.980+0000 7f75132d17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T17:29:04.985 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T17:29:04.980+0000 7f75132d17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T17:29:04.985 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T17:29:04.980+0000 7f75132d17c0 -1 bdev(0x56523e95b800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T17:29:04.985 INFO:teuthology.orchestra.run.smithi187.stderr:2024-09-12T17:29:04.980+0000 7f75132d17c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T17:29:08.118 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T17:29:08.179 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T17:29:08.179 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:29:08.179 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T17:29:08.194 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:29:08.194 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T17:29:08.246 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:29:08.246 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T17:29:08.303 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:29:08.303 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T17:29:08.358 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:29:08.359 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T17:29:08.415 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T17:29:08.415 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T17:29:08.428 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T17:29:08.428 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T17:29:08.483 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T17:29:08.484 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T17:29:08.539 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T17:29:08.539 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T17:29:08.598 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T17:29:08.598 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T17:29:08.655 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:29:08.655 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T17:29:08.663 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T17:29:08.663 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T17:29:08.703 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T17:29:08.703 DEBUG:teuthology.orchestra.run.smithi098:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:29:08.708 DEBUG:teuthology.orchestra.run.smithi187:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:29:08.749 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr.y] 2024-09-12T17:29:08.749 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDEJONmB9CVBRAAdJGUhAqgQt/q1cQLqgl/TA== 2024-09-12T17:29:08.749 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.0] 2024-09-12T17:29:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDHJONmSvAUDBAAUDT/bvvo8rBKE+Sxw4E4+A== 2024-09-12T17:29:08.750 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.1] 2024-09-12T17:29:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDKJONmZMRkGRAAXamLsXEzZMKUrfyJuxM49Q== 2024-09-12T17:29:08.750 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.2] 2024-09-12T17:29:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDNJONmrKqvKxAAyE5O2gjU8aeW7wP2z1j4sA== 2024-09-12T17:29:08.750 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.3] 2024-09-12T17:29:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDRJONmKxw1AhAAiYBFte+vLR4T7TeSvgzVvA== 2024-09-12T17:29:08.750 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr.x] 2024-09-12T17:29:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDEJONmdX9XCBAABVUgUAGeCYjrCXKhvWHitw== 2024-09-12T17:29:08.750 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.4] 2024-09-12T17:29:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDXJONm+hsQDRAAZNyILJualW4vxK0uxxifKg== 2024-09-12T17:29:08.750 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.5] 2024-09-12T17:29:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDaJONmuBLWGxAAd2Ik4dQGswy//y9n+2qofw== 2024-09-12T17:29:08.751 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.6] 2024-09-12T17:29:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDdJONmhlAQKxAARABiP6zVsnk/Mj8FZNJHBw== 2024-09-12T17:29:08.751 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.7] 2024-09-12T17:29:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDgJONm5Z64OhAAS9DPLrSeVDHG2Ig61WP9zQ== 2024-09-12T17:29:08.751 INFO:teuthology.orchestra.run.smithi098.stdout:[client.0] 2024-09-12T17:29:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDEJONmdS4/CxAA72yRNn/JAQwZl4cNrPvZKA== 2024-09-12T17:29:08.751 INFO:teuthology.orchestra.run.smithi098.stdout:[client.1] 2024-09-12T17:29:08.751 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDEJONmPn/1DRAAnPXQiiVYNEU1hviIim1qig== 2024-09-12T17:29:08.757 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr.y] 2024-09-12T17:29:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDEJONmB9CVBRAAdJGUhAqgQt/q1cQLqgl/TA== 2024-09-12T17:29:08.757 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.0] 2024-09-12T17:29:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDHJONmSvAUDBAAUDT/bvvo8rBKE+Sxw4E4+A== 2024-09-12T17:29:08.757 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.1] 2024-09-12T17:29:08.757 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDKJONmZMRkGRAAXamLsXEzZMKUrfyJuxM49Q== 2024-09-12T17:29:08.757 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.2] 2024-09-12T17:29:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDNJONmrKqvKxAAyE5O2gjU8aeW7wP2z1j4sA== 2024-09-12T17:29:08.758 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.3] 2024-09-12T17:29:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDRJONmKxw1AhAAiYBFte+vLR4T7TeSvgzVvA== 2024-09-12T17:29:08.758 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr.x] 2024-09-12T17:29:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDEJONmdX9XCBAABVUgUAGeCYjrCXKhvWHitw== 2024-09-12T17:29:08.758 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.4] 2024-09-12T17:29:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDXJONm+hsQDRAAZNyILJualW4vxK0uxxifKg== 2024-09-12T17:29:08.758 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.5] 2024-09-12T17:29:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDaJONmuBLWGxAAd2Ik4dQGswy//y9n+2qofw== 2024-09-12T17:29:08.758 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.6] 2024-09-12T17:29:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDdJONmhlAQKxAARABiP6zVsnk/Mj8FZNJHBw== 2024-09-12T17:29:08.758 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.7] 2024-09-12T17:29:08.758 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDgJONm5Z64OhAAS9DPLrSeVDHG2Ig61WP9zQ== 2024-09-12T17:29:08.759 INFO:teuthology.orchestra.run.smithi187.stdout:[client.0] 2024-09-12T17:29:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDEJONmdS4/CxAA72yRNn/JAQwZl4cNrPvZKA== 2024-09-12T17:29:08.759 INFO:teuthology.orchestra.run.smithi187.stdout:[client.1] 2024-09-12T17:29:08.759 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDEJONmPn/1DRAAnPXQiiVYNEU1hviIim1qig== 2024-09-12T17:29:08.760 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:29:08.796 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:29:08.848 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:08.850 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:08.935 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:08.938 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:09.019 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:09.028 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:09.100 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:09.116 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:09.187 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:29:09.190 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:29:09.230 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:09.273 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:09.316 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:09.357 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:09.402 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:09.444 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:09.488 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:09.490 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:29:09.568 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:29:09.572 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:29:09.654 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:29:09.656 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:29:09.743 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T17:29:09.743 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T17:29:09.757 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:29:09.850 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T17:29:09.861 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T17:29:09.914 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:29:10.005 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T17:29:10.016 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T17:29:10.029 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:29:10.126 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T17:29:10.139 DEBUG:teuthology.orchestra.run.smithi098:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:29:10.141 DEBUG:teuthology.orchestra.run.smithi187:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:29:10.187 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T17:29:10.187 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T17:29:10.187 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T17:29:10.189 INFO:tasks.ceph.mon.a:Started 2024-09-12T17:29:10.190 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T17:29:10.190 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T17:29:10.192 INFO:tasks.ceph.mon.c:Started 2024-09-12T17:29:10.192 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T17:29:10.192 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T17:29:10.233 INFO:tasks.ceph.mon.b:Started 2024-09-12T17:29:10.233 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T17:29:10.233 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T17:29:10.234 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T17:29:10.236 INFO:tasks.ceph.mgr.y:Started 2024-09-12T17:29:10.236 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T17:29:10.236 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T17:29:10.238 INFO:tasks.ceph.mgr.x:Started 2024-09-12T17:29:10.239 DEBUG:tasks.ceph:set 0 configs 2024-09-12T17:29:10.239 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T17:29:10.239 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T17:29:15.735 INFO:teuthology.orchestra.run.smithi098.stderr:adjusted tunables profile to default 2024-09-12T17:29:15.753 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T17:29:15.753 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T17:29:15.754 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:29:15.754 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T17:29:15.766 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:29:15.766 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T17:29:15.821 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:29:15.821 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T17:29:15.874 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:29:15.874 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T17:29:15.926 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T17:29:15.926 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T17:29:15.940 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T17:29:15.940 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T17:29:15.995 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T17:29:15.995 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T17:29:16.050 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-09-12T17:29:16.050 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T17:29:16.102 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 59393804-5b55-40e7-a02c-d59adbad3262 0 2024-09-12T17:29:16.354 INFO:teuthology.orchestra.run.smithi187.stdout:0 2024-09-12T17:29:16.372 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new bc65fc46-f716-4759-9674-f4d52e841fe1 1 2024-09-12T17:29:16.579 INFO:teuthology.orchestra.run.smithi187.stdout:1 2024-09-12T17:29:16.595 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 892166b4-6977-44db-89ef-a3ce55a26482 2 2024-09-12T17:29:16.789 INFO:teuthology.orchestra.run.smithi187.stdout:2 2024-09-12T17:29:16.806 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new dea4c29d-1e7d-4fae-8d26-cbf492e6c4cc 3 2024-09-12T17:29:16.999 INFO:teuthology.orchestra.run.smithi187.stdout:3 2024-09-12T17:29:17.015 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new ca8f7737-483e-4494-8b72-95033eff0979 4 2024-09-12T17:29:17.206 INFO:teuthology.orchestra.run.smithi187.stdout:4 2024-09-12T17:29:17.223 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 637e9483-a6fe-419d-9e91-b06499296fa9 5 2024-09-12T17:29:17.415 INFO:teuthology.orchestra.run.smithi187.stdout:5 2024-09-12T17:29:17.431 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new e0469cf4-de40-41af-9c71-b636e2d12fa2 6 2024-09-12T17:29:17.622 INFO:teuthology.orchestra.run.smithi187.stdout:6 2024-09-12T17:29:17.639 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new b00f9fd0-896f-4ccd-8a8e-e948942ab9d2 7 2024-09-12T17:29:17.829 INFO:teuthology.orchestra.run.smithi187.stdout:7 2024-09-12T17:29:17.846 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T17:29:17.846 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T17:29:17.849 INFO:tasks.ceph.osd.0:Started 2024-09-12T17:29:17.849 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T17:29:17.849 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T17:29:17.851 INFO:tasks.ceph.osd.1:Started 2024-09-12T17:29:17.852 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T17:29:17.852 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T17:29:17.854 INFO:tasks.ceph.osd.2:Started 2024-09-12T17:29:17.854 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T17:29:17.854 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T17:29:17.857 INFO:tasks.ceph.osd.3:Started 2024-09-12T17:29:17.857 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T17:29:17.857 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T17:29:17.859 INFO:tasks.ceph.osd.4:Started 2024-09-12T17:29:17.859 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T17:29:17.859 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T17:29:17.861 INFO:tasks.ceph.osd.5:Started 2024-09-12T17:29:17.861 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T17:29:17.861 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T17:29:17.863 INFO:tasks.ceph.osd.6:Started 2024-09-12T17:29:17.863 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T17:29:17.864 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T17:29:17.865 INFO:tasks.ceph.osd.7:Started 2024-09-12T17:29:17.866 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:29:18.085 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:29:18.085 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":10,"fsid":"3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b","created":"2024-09-12T17:29:15.601521+0000","modified":"2024-09-12T17:29:17.827643+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:29:17.827643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"59393804-5b55-40e7-a02c-d59adbad3262","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bc65fc46-f716-4759-9674-f4d52e841fe1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"892166b4-6977-44db-89ef-a3ce55a26482","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"dea4c29d-1e7d-4fae-8d26-cbf492e6c4cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ca8f7737-483e-4494-8b72-95033eff0979","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"637e9483-a6fe-419d-9e91-b06499296fa9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e0469cf4-de40-41af-9c71-b636e2d12fa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b00f9fd0-896f-4ccd-8a8e-e948942ab9d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:29:18.100 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T17:29:18.100 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T17:29:18.656 INFO:tasks.ceph.mgr.x.smithi187.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T17:29:18.656 INFO:tasks.ceph.mgr.x.smithi187.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T17:29:18.656 INFO:tasks.ceph.mgr.x.smithi187.stderr: from numpy import show_config as show_numpy_config 2024-09-12T17:29:18.906 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:29:18.984 INFO:tasks.ceph.osd.4.smithi187.stderr:2024-09-12T17:29:18.980+0000 7fbebcd327c0 -1 Falling back to public interface 2024-09-12T17:29:18.987 INFO:tasks.ceph.osd.3.smithi098.stderr:2024-09-12T17:29:18.986+0000 7fcc813757c0 -1 Falling back to public interface 2024-09-12T17:29:19.052 INFO:tasks.ceph.osd.7.smithi187.stderr:2024-09-12T17:29:19.048+0000 7fc4003567c0 -1 Falling back to public interface 2024-09-12T17:29:19.100 INFO:teuthology.misc.health.smithi098.stdout: 2024-09-12T17:29:19.101 INFO:teuthology.misc.health.smithi098.stdout:{"epoch":10,"fsid":"3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b","created":"2024-09-12T17:29:15.601521+0000","modified":"2024-09-12T17:29:17.827643+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:29:17.827643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"59393804-5b55-40e7-a02c-d59adbad3262","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bc65fc46-f716-4759-9674-f4d52e841fe1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"892166b4-6977-44db-89ef-a3ce55a26482","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"dea4c29d-1e7d-4fae-8d26-cbf492e6c4cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ca8f7737-483e-4494-8b72-95033eff0979","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"637e9483-a6fe-419d-9e91-b06499296fa9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e0469cf4-de40-41af-9c71-b636e2d12fa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b00f9fd0-896f-4ccd-8a8e-e948942ab9d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:29:19.111 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-12T17:29:19.110+0000 7fde0b3ad7c0 -1 Falling back to public interface 2024-09-12T17:29:19.116 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T17:29:19.234 INFO:tasks.ceph.mgr.y.smithi098.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T17:29:19.234 INFO:tasks.ceph.mgr.y.smithi098.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T17:29:19.234 INFO:tasks.ceph.mgr.y.smithi098.stderr: from numpy import show_config as show_numpy_config 2024-09-12T17:29:19.291 INFO:tasks.ceph.osd.6.smithi187.stderr:2024-09-12T17:29:19.288+0000 7fc23355a7c0 -1 Falling back to public interface 2024-09-12T17:29:19.517 INFO:tasks.ceph.osd.2.smithi098.stderr:2024-09-12T17:29:19.514+0000 7f224af337c0 -1 Falling back to public interface 2024-09-12T17:29:19.528 INFO:tasks.ceph.osd.5.smithi187.stderr:2024-09-12T17:29:19.524+0000 7f6c7a3657c0 -1 Falling back to public interface 2024-09-12T17:29:19.740 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-09-12T17:29:19.738+0000 7f49181047c0 -1 Falling back to public interface 2024-09-12T17:29:21.586 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-12T17:29:21.580+0000 7fa096118640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T17:29:21.586 INFO:tasks.ceph.mgr.x.smithi187.stderr:2024-09-12T17:29:21.580+0000 7fa096118640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T17:29:23.005 INFO:tasks.ceph.osd.4.smithi187.stderr:2024-09-12T17:29:23.000+0000 7fbebcd327c0 -1 osd.4 0 log_to_monitors true 2024-09-12T17:29:23.132 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-12T17:29:23.130+0000 7fde0b3ad7c0 -1 osd.1 0 log_to_monitors true 2024-09-12T17:29:23.319 INFO:tasks.ceph.osd.3.smithi098.stderr:2024-09-12T17:29:23.318+0000 7fcc813757c0 -1 osd.3 0 log_to_monitors true 2024-09-12T17:29:23.390 INFO:tasks.ceph.osd.7.smithi187.stderr:2024-09-12T17:29:23.384+0000 7fc4003567c0 -1 osd.7 0 log_to_monitors true 2024-09-12T17:29:23.591 INFO:tasks.ceph.osd.6.smithi187.stderr:2024-09-12T17:29:23.588+0000 7fc23355a7c0 -1 osd.6 0 log_to_monitors true 2024-09-12T17:29:23.627 INFO:tasks.ceph.osd.5.smithi187.stderr:2024-09-12T17:29:23.624+0000 7f6c7a3657c0 -1 osd.5 0 log_to_monitors true 2024-09-12T17:29:23.796 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-09-12T17:29:23.794+0000 7f49181047c0 -1 osd.0 0 log_to_monitors true 2024-09-12T17:29:24.192 INFO:tasks.ceph.osd.2.smithi098.stderr:2024-09-12T17:29:24.190+0000 7f224af337c0 -1 osd.2 0 log_to_monitors true 2024-09-12T17:29:25.923 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:29:26.226 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-12T17:29:26.222+0000 7fde07356640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T17:29:26.264 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-12T17:29:26.262+0000 7fddff188640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:29:26.306 INFO:tasks.ceph.osd.3.smithi098.stderr:2024-09-12T17:29:26.302+0000 7fcc7db30640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T17:29:26.344 INFO:teuthology.misc.health.smithi098.stdout: 2024-09-12T17:29:26.344 INFO:teuthology.misc.health.smithi098.stdout:{"epoch":13,"fsid":"3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b","created":"2024-09-12T17:29:15.601521+0000","modified":"2024-09-12T17:29:25.653223+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:29:17.827643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"59393804-5b55-40e7-a02c-d59adbad3262","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bc65fc46-f716-4759-9674-f4d52e841fe1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"892166b4-6977-44db-89ef-a3ce55a26482","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"dea4c29d-1e7d-4fae-8d26-cbf492e6c4cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ca8f7737-483e-4494-8b72-95033eff0979","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"637e9483-a6fe-419d-9e91-b06499296fa9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e0469cf4-de40-41af-9c71-b636e2d12fa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b00f9fd0-896f-4ccd-8a8e-e948942ab9d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:29:26.368 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T17:29:26.373 INFO:tasks.ceph.osd.3.smithi098.stderr:2024-09-12T17:29:26.370+0000 7fcc75150640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:29:26.825 INFO:tasks.ceph.osd.7.smithi187.stderr:2024-09-12T17:29:26.820+0000 7fc3fc2ff640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T17:29:26.836 INFO:tasks.ceph.osd.6.smithi187.stderr:2024-09-12T17:29:26.832+0000 7fc22fd15640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T17:29:26.843 INFO:tasks.ceph.osd.5.smithi187.stderr:2024-09-12T17:29:26.840+0000 7f6c7630e640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T17:29:26.851 INFO:tasks.ceph.osd.7.smithi187.stderr:2024-09-12T17:29:26.848+0000 7fc3f4131640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:29:26.854 INFO:tasks.ceph.osd.4.smithi187.stderr:2024-09-12T17:29:26.848+0000 7fbeb8cdb640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T17:29:26.871 INFO:tasks.ceph.osd.5.smithi187.stderr:2024-09-12T17:29:26.868+0000 7f6c6e140640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:29:26.872 INFO:tasks.ceph.osd.6.smithi187.stderr:2024-09-12T17:29:26.868+0000 7fc227335640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:29:26.879 INFO:tasks.ceph.osd.4.smithi187.stderr:2024-09-12T17:29:26.876+0000 7fbeb0b0d640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:29:27.056 INFO:tasks.ceph.osd.2.smithi098.stderr:2024-09-12T17:29:27.054+0000 7f2246edc640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T17:29:27.076 INFO:tasks.ceph.osd.2.smithi098.stderr:2024-09-12T17:29:27.074+0000 7f223ed0e640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:29:27.076 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-09-12T17:29:27.074+0000 7f49140ad640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T17:29:27.112 INFO:tasks.ceph.osd.0.smithi098.stderr:2024-09-12T17:29:27.110+0000 7f490bedf640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:29:33.176 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:29:33.524 INFO:teuthology.misc.health.smithi098.stdout: 2024-09-12T17:29:33.524 INFO:teuthology.misc.health.smithi098.stdout:{"epoch":18,"fsid":"3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b","created":"2024-09-12T17:29:15.601521+0000","modified":"2024-09-12T17:29:31.259419+0000","last_up_change":"2024-09-12T17:29:27.235782+0000","last_in_change":"2024-09-12T17:29:17.827643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:29:28.604898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59393804-5b55-40e7-a02c-d59adbad3262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4243656823},{"type":"v1","addr":"172.21.15.98:6825","nonce":4243656823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4243656823},{"type":"v1","addr":"172.21.15.98:6827","nonce":4243656823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4243656823},{"type":"v1","addr":"172.21.15.98:6831","nonce":4243656823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4243656823},{"type":"v1","addr":"172.21.15.98:6829","nonce":4243656823}]},"public_addr":"172.21.15.98:6825/4243656823","cluster_addr":"172.21.15.98:6827/4243656823","heartbeat_back_addr":"172.21.15.98:6831/4243656823","heartbeat_front_addr":"172.21.15.98:6829/4243656823","state":["exists","up"]},{"osd":1,"uuid":"bc65fc46-f716-4759-9674-f4d52e841fe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2797286459},{"type":"v1","addr":"172.21.15.98:6809","nonce":2797286459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2797286459},{"type":"v1","addr":"172.21.15.98:6811","nonce":2797286459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2797286459},{"type":"v1","addr":"172.21.15.98:6815","nonce":2797286459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2797286459},{"type":"v1","addr":"172.21.15.98:6813","nonce":2797286459}]},"public_addr":"172.21.15.98:6809/2797286459","cluster_addr":"172.21.15.98:6811/2797286459","heartbeat_back_addr":"172.21.15.98:6815/2797286459","heartbeat_front_addr":"172.21.15.98:6813/2797286459","state":["exists","up"]},{"osd":2,"uuid":"892166b4-6977-44db-89ef-a3ce55a26482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1225764258},{"type":"v1","addr":"172.21.15.98:6817","nonce":1225764258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1225764258},{"type":"v1","addr":"172.21.15.98:6819","nonce":1225764258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1225764258},{"type":"v1","addr":"172.21.15.98:6823","nonce":1225764258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1225764258},{"type":"v1","addr":"172.21.15.98:6821","nonce":1225764258}]},"public_addr":"172.21.15.98:6817/1225764258","cluster_addr":"172.21.15.98:6819/1225764258","heartbeat_back_addr":"172.21.15.98:6823/1225764258","heartbeat_front_addr":"172.21.15.98:6821/1225764258","state":["exists","up"]},{"osd":3,"uuid":"dea4c29d-1e7d-4fae-8d26-cbf492e6c4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3702628629},{"type":"v1","addr":"172.21.15.98:6801","nonce":3702628629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3702628629},{"type":"v1","addr":"172.21.15.98:6803","nonce":3702628629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3702628629},{"type":"v1","addr":"172.21.15.98:6807","nonce":3702628629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3702628629},{"type":"v1","addr":"172.21.15.98:6805","nonce":3702628629}]},"public_addr":"172.21.15.98:6801/3702628629","cluster_addr":"172.21.15.98:6803/3702628629","heartbeat_back_addr":"172.21.15.98:6807/3702628629","heartbeat_front_addr":"172.21.15.98:6805/3702628629","state":["exists","up"]},{"osd":4,"uuid":"ca8f7737-483e-4494-8b72-95033eff0979","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2100658905},{"type":"v1","addr":"172.21.15.187:6801","nonce":2100658905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2100658905},{"type":"v1","addr":"172.21.15.187:6803","nonce":2100658905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2100658905},{"type":"v1","addr":"172.21.15.187:6807","nonce":2100658905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2100658905},{"type":"v1","addr":"172.21.15.187:6805","nonce":2100658905}]},"public_addr":"172.21.15.187:6801/2100658905","cluster_addr":"172.21.15.187:6803/2100658905","heartbeat_back_addr":"172.21.15.187:6807/2100658905","heartbeat_front_addr":"172.21.15.187:6805/2100658905","state":["exists","up"]},{"osd":5,"uuid":"637e9483-a6fe-419d-9e91-b06499296fa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2426426364},{"type":"v1","addr":"172.21.15.187:6825","nonce":2426426364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":2426426364},{"type":"v1","addr":"172.21.15.187:6827","nonce":2426426364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2426426364},{"type":"v1","addr":"172.21.15.187:6831","nonce":2426426364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2426426364},{"type":"v1","addr":"172.21.15.187:6829","nonce":2426426364}]},"public_addr":"172.21.15.187:6825/2426426364","cluster_addr":"172.21.15.187:6827/2426426364","heartbeat_back_addr":"172.21.15.187:6831/2426426364","heartbeat_front_addr":"172.21.15.187:6829/2426426364","state":["exists","up"]},{"osd":6,"uuid":"e0469cf4-de40-41af-9c71-b636e2d12fa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":1254463716},{"type":"v1","addr":"172.21.15.187:6817","nonce":1254463716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":1254463716},{"type":"v1","addr":"172.21.15.187:6819","nonce":1254463716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":1254463716},{"type":"v1","addr":"172.21.15.187:6823","nonce":1254463716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":1254463716},{"type":"v1","addr":"172.21.15.187:6821","nonce":1254463716}]},"public_addr":"172.21.15.187:6817/1254463716","cluster_addr":"172.21.15.187:6819/1254463716","heartbeat_back_addr":"172.21.15.187:6823/1254463716","heartbeat_front_addr":"172.21.15.187:6821/1254463716","state":["exists","up"]},{"osd":7,"uuid":"b00f9fd0-896f-4ccd-8a8e-e948942ab9d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1025052779},{"type":"v1","addr":"172.21.15.187:6809","nonce":1025052779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1025052779},{"type":"v1","addr":"172.21.15.187:6811","nonce":1025052779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1025052779},{"type":"v1","addr":"172.21.15.187:6815","nonce":1025052779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1025052779},{"type":"v1","addr":"172.21.15.187:6813","nonce":1025052779}]},"public_addr":"172.21.15.187:6809/1025052779","cluster_addr":"172.21.15.187:6811/1025052779","heartbeat_back_addr":"172.21.15.187:6815/1025052779","heartbeat_front_addr":"172.21.15.187:6813/1025052779","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.757876+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.182429+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:25.146448+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.343732+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.019438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:26.843873+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.594080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.397391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:29:33.542 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T17:29:33.542 INFO:tasks.ceph:Creating RBD pool 2024-09-12T17:29:33.542 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T17:29:34.316 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'rbd' created 2024-09-12T17:29:34.341 DEBUG:teuthology.orchestra.run.smithi098:> rbd --cluster ceph pool init rbd 2024-09-12T17:29:34.392 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:34.392 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:37.377 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T17:29:37.378 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T17:29:37.379 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T17:29:37.695 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:29:37.714 INFO:teuthology.orchestra.run.smithi098.stdout:[{"version":9,"timestamp":"2024-09-12T17:29:27.078575+0000","name":"","changes":[{"name":"osd.0/osd_mclock_max_capacity_iops_ssd","new_value":"5979.962128"}]}] 2024-09-12T17:29:37.714 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T17:29:37.714 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T17:29:37.714 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T17:29:37.715 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T17:29:38.043 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:29:38.060 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3605168434},{"type":"v1","addr":"172.21.15.187:6833","nonce":3605168434}]},"active_addr":"172.21.15.187:6833/3605168434","active_change":"2024-09-12T17:29:20.558779+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4109,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":173123648}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":3209525875}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":927873255}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.187:0","nonce":1057589142}]}]} 2024-09-12T17:29:38.065 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T17:29:38.065 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T17:29:38.065 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:29:38.367 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:29:38.367 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":22,"fsid":"3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b","created":"2024-09-12T17:29:15.601521+0000","modified":"2024-09-12T17:29:37.334162+0000","last_up_change":"2024-09-12T17:29:27.235782+0000","last_in_change":"2024-09-12T17:29:17.827643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:29:28.604898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:29:33.831944+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59393804-5b55-40e7-a02c-d59adbad3262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4243656823},{"type":"v1","addr":"172.21.15.98:6825","nonce":4243656823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4243656823},{"type":"v1","addr":"172.21.15.98:6827","nonce":4243656823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4243656823},{"type":"v1","addr":"172.21.15.98:6831","nonce":4243656823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4243656823},{"type":"v1","addr":"172.21.15.98:6829","nonce":4243656823}]},"public_addr":"172.21.15.98:6825/4243656823","cluster_addr":"172.21.15.98:6827/4243656823","heartbeat_back_addr":"172.21.15.98:6831/4243656823","heartbeat_front_addr":"172.21.15.98:6829/4243656823","state":["exists","up"]},{"osd":1,"uuid":"bc65fc46-f716-4759-9674-f4d52e841fe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2797286459},{"type":"v1","addr":"172.21.15.98:6809","nonce":2797286459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2797286459},{"type":"v1","addr":"172.21.15.98:6811","nonce":2797286459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2797286459},{"type":"v1","addr":"172.21.15.98:6815","nonce":2797286459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2797286459},{"type":"v1","addr":"172.21.15.98:6813","nonce":2797286459}]},"public_addr":"172.21.15.98:6809/2797286459","cluster_addr":"172.21.15.98:6811/2797286459","heartbeat_back_addr":"172.21.15.98:6815/2797286459","heartbeat_front_addr":"172.21.15.98:6813/2797286459","state":["exists","up"]},{"osd":2,"uuid":"892166b4-6977-44db-89ef-a3ce55a26482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1225764258},{"type":"v1","addr":"172.21.15.98:6817","nonce":1225764258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1225764258},{"type":"v1","addr":"172.21.15.98:6819","nonce":1225764258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1225764258},{"type":"v1","addr":"172.21.15.98:6823","nonce":1225764258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1225764258},{"type":"v1","addr":"172.21.15.98:6821","nonce":1225764258}]},"public_addr":"172.21.15.98:6817/1225764258","cluster_addr":"172.21.15.98:6819/1225764258","heartbeat_back_addr":"172.21.15.98:6823/1225764258","heartbeat_front_addr":"172.21.15.98:6821/1225764258","state":["exists","up"]},{"osd":3,"uuid":"dea4c29d-1e7d-4fae-8d26-cbf492e6c4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3702628629},{"type":"v1","addr":"172.21.15.98:6801","nonce":3702628629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3702628629},{"type":"v1","addr":"172.21.15.98:6803","nonce":3702628629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3702628629},{"type":"v1","addr":"172.21.15.98:6807","nonce":3702628629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3702628629},{"type":"v1","addr":"172.21.15.98:6805","nonce":3702628629}]},"public_addr":"172.21.15.98:6801/3702628629","cluster_addr":"172.21.15.98:6803/3702628629","heartbeat_back_addr":"172.21.15.98:6807/3702628629","heartbeat_front_addr":"172.21.15.98:6805/3702628629","state":["exists","up"]},{"osd":4,"uuid":"ca8f7737-483e-4494-8b72-95033eff0979","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2100658905},{"type":"v1","addr":"172.21.15.187:6801","nonce":2100658905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2100658905},{"type":"v1","addr":"172.21.15.187:6803","nonce":2100658905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2100658905},{"type":"v1","addr":"172.21.15.187:6807","nonce":2100658905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2100658905},{"type":"v1","addr":"172.21.15.187:6805","nonce":2100658905}]},"public_addr":"172.21.15.187:6801/2100658905","cluster_addr":"172.21.15.187:6803/2100658905","heartbeat_back_addr":"172.21.15.187:6807/2100658905","heartbeat_front_addr":"172.21.15.187:6805/2100658905","state":["exists","up"]},{"osd":5,"uuid":"637e9483-a6fe-419d-9e91-b06499296fa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2426426364},{"type":"v1","addr":"172.21.15.187:6825","nonce":2426426364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":2426426364},{"type":"v1","addr":"172.21.15.187:6827","nonce":2426426364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2426426364},{"type":"v1","addr":"172.21.15.187:6831","nonce":2426426364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2426426364},{"type":"v1","addr":"172.21.15.187:6829","nonce":2426426364}]},"public_addr":"172.21.15.187:6825/2426426364","cluster_addr":"172.21.15.187:6827/2426426364","heartbeat_back_addr":"172.21.15.187:6831/2426426364","heartbeat_front_addr":"172.21.15.187:6829/2426426364","state":["exists","up"]},{"osd":6,"uuid":"e0469cf4-de40-41af-9c71-b636e2d12fa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":1254463716},{"type":"v1","addr":"172.21.15.187:6817","nonce":1254463716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":1254463716},{"type":"v1","addr":"172.21.15.187:6819","nonce":1254463716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":1254463716},{"type":"v1","addr":"172.21.15.187:6823","nonce":1254463716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":1254463716},{"type":"v1","addr":"172.21.15.187:6821","nonce":1254463716}]},"public_addr":"172.21.15.187:6817/1254463716","cluster_addr":"172.21.15.187:6819/1254463716","heartbeat_back_addr":"172.21.15.187:6823/1254463716","heartbeat_front_addr":"172.21.15.187:6821/1254463716","state":["exists","up"]},{"osd":7,"uuid":"b00f9fd0-896f-4ccd-8a8e-e948942ab9d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1025052779},{"type":"v1","addr":"172.21.15.187:6809","nonce":1025052779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1025052779},{"type":"v1","addr":"172.21.15.187:6811","nonce":1025052779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1025052779},{"type":"v1","addr":"172.21.15.187:6815","nonce":1025052779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1025052779},{"type":"v1","addr":"172.21.15.187:6813","nonce":1025052779}]},"public_addr":"172.21.15.187:6809/1025052779","cluster_addr":"172.21.15.187:6811/1025052779","heartbeat_back_addr":"172.21.15.187:6815/1025052779","heartbeat_front_addr":"172.21.15.187:6813/1025052779","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.757876+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.182429+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:25.146448+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.343732+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.019438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:26.843873+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.594080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.397391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:29:38.386 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T17:29:38.386 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:29:38.675 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:29:38.675 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":22,"fsid":"3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b","created":"2024-09-12T17:29:15.601521+0000","modified":"2024-09-12T17:29:37.334162+0000","last_up_change":"2024-09-12T17:29:27.235782+0000","last_in_change":"2024-09-12T17:29:17.827643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:29:28.604898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:29:33.831944+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59393804-5b55-40e7-a02c-d59adbad3262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4243656823},{"type":"v1","addr":"172.21.15.98:6825","nonce":4243656823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4243656823},{"type":"v1","addr":"172.21.15.98:6827","nonce":4243656823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4243656823},{"type":"v1","addr":"172.21.15.98:6831","nonce":4243656823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4243656823},{"type":"v1","addr":"172.21.15.98:6829","nonce":4243656823}]},"public_addr":"172.21.15.98:6825/4243656823","cluster_addr":"172.21.15.98:6827/4243656823","heartbeat_back_addr":"172.21.15.98:6831/4243656823","heartbeat_front_addr":"172.21.15.98:6829/4243656823","state":["exists","up"]},{"osd":1,"uuid":"bc65fc46-f716-4759-9674-f4d52e841fe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2797286459},{"type":"v1","addr":"172.21.15.98:6809","nonce":2797286459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2797286459},{"type":"v1","addr":"172.21.15.98:6811","nonce":2797286459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2797286459},{"type":"v1","addr":"172.21.15.98:6815","nonce":2797286459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2797286459},{"type":"v1","addr":"172.21.15.98:6813","nonce":2797286459}]},"public_addr":"172.21.15.98:6809/2797286459","cluster_addr":"172.21.15.98:6811/2797286459","heartbeat_back_addr":"172.21.15.98:6815/2797286459","heartbeat_front_addr":"172.21.15.98:6813/2797286459","state":["exists","up"]},{"osd":2,"uuid":"892166b4-6977-44db-89ef-a3ce55a26482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1225764258},{"type":"v1","addr":"172.21.15.98:6817","nonce":1225764258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1225764258},{"type":"v1","addr":"172.21.15.98:6819","nonce":1225764258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1225764258},{"type":"v1","addr":"172.21.15.98:6823","nonce":1225764258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1225764258},{"type":"v1","addr":"172.21.15.98:6821","nonce":1225764258}]},"public_addr":"172.21.15.98:6817/1225764258","cluster_addr":"172.21.15.98:6819/1225764258","heartbeat_back_addr":"172.21.15.98:6823/1225764258","heartbeat_front_addr":"172.21.15.98:6821/1225764258","state":["exists","up"]},{"osd":3,"uuid":"dea4c29d-1e7d-4fae-8d26-cbf492e6c4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3702628629},{"type":"v1","addr":"172.21.15.98:6801","nonce":3702628629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3702628629},{"type":"v1","addr":"172.21.15.98:6803","nonce":3702628629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3702628629},{"type":"v1","addr":"172.21.15.98:6807","nonce":3702628629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3702628629},{"type":"v1","addr":"172.21.15.98:6805","nonce":3702628629}]},"public_addr":"172.21.15.98:6801/3702628629","cluster_addr":"172.21.15.98:6803/3702628629","heartbeat_back_addr":"172.21.15.98:6807/3702628629","heartbeat_front_addr":"172.21.15.98:6805/3702628629","state":["exists","up"]},{"osd":4,"uuid":"ca8f7737-483e-4494-8b72-95033eff0979","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2100658905},{"type":"v1","addr":"172.21.15.187:6801","nonce":2100658905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2100658905},{"type":"v1","addr":"172.21.15.187:6803","nonce":2100658905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2100658905},{"type":"v1","addr":"172.21.15.187:6807","nonce":2100658905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2100658905},{"type":"v1","addr":"172.21.15.187:6805","nonce":2100658905}]},"public_addr":"172.21.15.187:6801/2100658905","cluster_addr":"172.21.15.187:6803/2100658905","heartbeat_back_addr":"172.21.15.187:6807/2100658905","heartbeat_front_addr":"172.21.15.187:6805/2100658905","state":["exists","up"]},{"osd":5,"uuid":"637e9483-a6fe-419d-9e91-b06499296fa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2426426364},{"type":"v1","addr":"172.21.15.187:6825","nonce":2426426364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":2426426364},{"type":"v1","addr":"172.21.15.187:6827","nonce":2426426364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2426426364},{"type":"v1","addr":"172.21.15.187:6831","nonce":2426426364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2426426364},{"type":"v1","addr":"172.21.15.187:6829","nonce":2426426364}]},"public_addr":"172.21.15.187:6825/2426426364","cluster_addr":"172.21.15.187:6827/2426426364","heartbeat_back_addr":"172.21.15.187:6831/2426426364","heartbeat_front_addr":"172.21.15.187:6829/2426426364","state":["exists","up"]},{"osd":6,"uuid":"e0469cf4-de40-41af-9c71-b636e2d12fa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":1254463716},{"type":"v1","addr":"172.21.15.187:6817","nonce":1254463716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":1254463716},{"type":"v1","addr":"172.21.15.187:6819","nonce":1254463716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":1254463716},{"type":"v1","addr":"172.21.15.187:6823","nonce":1254463716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":1254463716},{"type":"v1","addr":"172.21.15.187:6821","nonce":1254463716}]},"public_addr":"172.21.15.187:6817/1254463716","cluster_addr":"172.21.15.187:6819/1254463716","heartbeat_back_addr":"172.21.15.187:6823/1254463716","heartbeat_front_addr":"172.21.15.187:6821/1254463716","state":["exists","up"]},{"osd":7,"uuid":"b00f9fd0-896f-4ccd-8a8e-e948942ab9d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1025052779},{"type":"v1","addr":"172.21.15.187:6809","nonce":1025052779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1025052779},{"type":"v1","addr":"172.21.15.187:6811","nonce":1025052779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1025052779},{"type":"v1","addr":"172.21.15.187:6815","nonce":1025052779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1025052779},{"type":"v1","addr":"172.21.15.187:6813","nonce":1025052779}]},"public_addr":"172.21.15.187:6809/1025052779","cluster_addr":"172.21.15.187:6811/1025052779","heartbeat_back_addr":"172.21.15.187:6815/1025052779","heartbeat_front_addr":"172.21.15.187:6813/1025052779","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.757876+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.182429+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:25.146448+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.343732+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.019438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:26.843873+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.594080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.397391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:29:38.693 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T17:29:38.693 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T17:29:38.694 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T17:29:38.694 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T17:29:38.694 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T17:29:38.695 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T17:29:38.695 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T17:29:38.696 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T17:29:38.936 INFO:teuthology.orchestra.run.smithi098.stdout:60129542148 2024-09-12T17:29:38.936 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:29:38.948 INFO:teuthology.orchestra.run.smithi098.stdout:60129542150 2024-09-12T17:29:38.948 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:29:38.967 INFO:teuthology.orchestra.run.smithi098.stdout:60129542148 2024-09-12T17:29:38.967 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:29:38.968 INFO:teuthology.orchestra.run.smithi098.stdout:60129542150 2024-09-12T17:29:38.968 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:29:38.969 INFO:teuthology.orchestra.run.smithi098.stdout:60129542149 2024-09-12T17:29:38.969 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:29:38.970 INFO:teuthology.orchestra.run.smithi098.stdout:60129542148 2024-09-12T17:29:38.971 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:29:38.972 INFO:teuthology.orchestra.run.smithi098.stdout:60129542148 2024-09-12T17:29:38.972 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:29:38.986 INFO:teuthology.orchestra.run.smithi098.stdout:60129542149 2024-09-12T17:29:38.986 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:29:39.480 INFO:teuthology.orchestra.run.smithi098.stdout:60129542147 2024-09-12T17:29:39.491 INFO:teuthology.orchestra.run.smithi098.stdout:60129542149 2024-09-12T17:29:39.491 INFO:teuthology.orchestra.run.smithi098.stdout:60129542149 2024-09-12T17:29:39.509 INFO:teuthology.orchestra.run.smithi098.stdout:60129542148 2024-09-12T17:29:39.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.3 2024-09-12T17:29:39.513 INFO:teuthology.orchestra.run.smithi098.stdout:60129542147 2024-09-12T17:29:39.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2024-09-12T17:29:39.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.0 2024-09-12T17:29:39.530 INFO:teuthology.orchestra.run.smithi098.stdout:60129542147 2024-09-12T17:29:39.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.2 2024-09-12T17:29:39.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.5 2024-09-12T17:29:39.553 INFO:teuthology.orchestra.run.smithi098.stdout:60129542147 2024-09-12T17:29:39.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.4 2024-09-12T17:29:39.565 INFO:teuthology.orchestra.run.smithi098.stdout:60129542148 2024-09-12T17:29:39.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.1 2024-09-12T17:29:39.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.6 2024-09-12T17:29:40.511 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:29:40.520 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:29:40.524 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:29:40.533 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:29:40.546 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:29:40.556 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:29:40.571 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:29:40.583 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:29:41.074 INFO:teuthology.orchestra.run.smithi098.stdout:60129542147 2024-09-12T17:29:41.076 INFO:teuthology.orchestra.run.smithi098.stdout:60129542149 2024-09-12T17:29:41.100 INFO:teuthology.orchestra.run.smithi098.stdout:60129542148 2024-09-12T17:29:41.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.3 2024-09-12T17:29:41.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.0 2024-09-12T17:29:41.105 INFO:teuthology.orchestra.run.smithi098.stdout:60129542149 2024-09-12T17:29:41.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2024-09-12T17:29:41.126 INFO:teuthology.orchestra.run.smithi098.stdout:60129542147 2024-09-12T17:29:41.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.2 2024-09-12T17:29:41.128 INFO:teuthology.orchestra.run.smithi098.stdout:60129542147 2024-09-12T17:29:41.135 INFO:teuthology.orchestra.run.smithi098.stdout:60129542147 2024-09-12T17:29:41.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.4 2024-09-12T17:29:41.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.1 2024-09-12T17:29:41.158 INFO:teuthology.orchestra.run.smithi098.stdout:60129542148 2024-09-12T17:29:41.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.5 2024-09-12T17:29:41.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.6 2024-09-12T17:29:42.101 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:29:42.104 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:29:42.127 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:29:42.127 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:29:42.155 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:29:42.156 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:29:42.164 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:29:42.176 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:29:42.579 INFO:teuthology.orchestra.run.smithi098.stdout:60129542148 2024-09-12T17:29:42.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.3 2024-09-12T17:29:42.602 DEBUG:teuthology.parallel:result is None 2024-09-12T17:29:42.649 INFO:teuthology.orchestra.run.smithi098.stdout:60129542150 2024-09-12T17:29:42.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-09-12T17:29:42.667 DEBUG:teuthology.parallel:result is None 2024-09-12T17:29:42.675 INFO:teuthology.orchestra.run.smithi098.stdout:60129542150 2024-09-12T17:29:42.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2024-09-12T17:29:42.693 INFO:teuthology.orchestra.run.smithi098.stdout:60129542149 2024-09-12T17:29:42.693 DEBUG:teuthology.parallel:result is None 2024-09-12T17:29:42.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.2 2024-09-12T17:29:42.717 DEBUG:teuthology.parallel:result is None 2024-09-12T17:29:42.717 INFO:teuthology.orchestra.run.smithi098.stdout:60129542148 2024-09-12T17:29:42.718 INFO:teuthology.orchestra.run.smithi098.stdout:60129542149 2024-09-12T17:29:42.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.6 2024-09-12T17:29:42.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2024-09-12T17:29:42.738 DEBUG:teuthology.parallel:result is None 2024-09-12T17:29:42.738 DEBUG:teuthology.parallel:result is None 2024-09-12T17:29:42.740 INFO:teuthology.orchestra.run.smithi098.stdout:60129542148 2024-09-12T17:29:42.763 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.5 2024-09-12T17:29:42.763 DEBUG:teuthology.parallel:result is None 2024-09-12T17:29:42.766 INFO:teuthology.orchestra.run.smithi098.stdout:60129542148 2024-09-12T17:29:42.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.4 2024-09-12T17:29:42.783 DEBUG:teuthology.parallel:result is None 2024-09-12T17:29:42.783 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T17:29:42.783 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:29:43.103 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:29:43.103 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-12T17:29:43.120 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-12T17:29:42.570727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219192,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755528,"statfs":{"total":773094113280,"available":772869660672,"internally_reserved":0,"allocated":2998272,"data_stored":1795142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.236476"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:29:37.541991+0000","last_change":"2024-09-12T17:29:37.541991+0000","last_active":"2024-09-12T17:29:37.541991+0000","last_peered":"2024-09-12T17:29:37.541991+0000","last_clean":"2024-09-12T17:29:37.541991+0000","last_became_active":"2024-09-12T17:29:35.337998+0000","last_became_peered":"2024-09-12T17:29:35.337998+0000","last_unstale":"2024-09-12T17:29:37.541991+0000","last_undegraded":"2024-09-12T17:29:37.541991+0000","last_fullsized":"2024-09-12T17:29:37.541991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:23.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011850280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:29:37.346714+0000","last_change":"2024-09-12T17:29:37.346714+0000","last_active":"2024-09-12T17:29:37.346714+0000","last_peered":"2024-09-12T17:29:37.346714+0000","last_clean":"2024-09-12T17:29:37.346714+0000","last_became_active":"2024-09-12T17:29:35.337987+0000","last_became_peered":"2024-09-12T17:29:35.337987+0000","last_unstale":"2024-09-12T17:29:37.346714+0000","last_undegraded":"2024-09-12T17:29:37.346714+0000","last_fullsized":"2024-09-12T17:29:37.346714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:46.254256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011496340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:29:37.541831+0000","last_change":"2024-09-12T17:29:37.541831+0000","last_active":"2024-09-12T17:29:37.541831+0000","last_peered":"2024-09-12T17:29:37.541831+0000","last_clean":"2024-09-12T17:29:37.541831+0000","last_became_active":"2024-09-12T17:29:35.406653+0000","last_became_peered":"2024-09-12T17:29:35.406653+0000","last_unstale":"2024-09-12T17:29:37.541831+0000","last_undegraded":"2024-09-12T17:29:37.541831+0000","last_fullsized":"2024-09-12T17:29:37.541831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:04.148521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001315566,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:29:37.346858+0000","last_change":"2024-09-12T17:29:37.346858+0000","last_active":"2024-09-12T17:29:37.346858+0000","last_peered":"2024-09-12T17:29:37.346858+0000","last_clean":"2024-09-12T17:29:37.346858+0000","last_became_active":"2024-09-12T17:29:35.407492+0000","last_became_peered":"2024-09-12T17:29:35.407492+0000","last_unstale":"2024-09-12T17:29:37.346858+0000","last_undegraded":"2024-09-12T17:29:37.346858+0000","last_fullsized":"2024-09-12T17:29:37.346858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:34.824127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098134900000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:29:37.356624+0000","last_change":"2024-09-12T17:29:37.352917+0000","last_active":"2024-09-12T17:29:37.356624+0000","last_peered":"2024-09-12T17:29:37.356624+0000","last_clean":"2024-09-12T17:29:37.356624+0000","last_became_active":"2024-09-12T17:29:35.340113+0000","last_became_peered":"2024-09-12T17:29:35.340113+0000","last_unstale":"2024-09-12T17:29:37.356624+0000","last_undegraded":"2024-09-12T17:29:37.356624+0000","last_fullsized":"2024-09-12T17:29:37.356624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:23.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020086050000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:29:37.348932+0000","last_change":"2024-09-12T17:29:37.348932+0000","last_active":"2024-09-12T17:29:37.348932+0000","last_peered":"2024-09-12T17:29:37.348932+0000","last_clean":"2024-09-12T17:29:37.348932+0000","last_became_active":"2024-09-12T17:29:35.331504+0000","last_became_peered":"2024-09-12T17:29:35.331504+0000","last_unstale":"2024-09-12T17:29:37.348932+0000","last_undegraded":"2024-09-12T17:29:37.348932+0000","last_fullsized":"2024-09-12T17:29:37.348932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:24.198110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001034428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:29:37.541726+0000","last_change":"2024-09-12T17:29:37.541726+0000","last_active":"2024-09-12T17:29:37.541726+0000","last_peered":"2024-09-12T17:29:37.541726+0000","last_clean":"2024-09-12T17:29:37.541726+0000","last_became_active":"2024-09-12T17:29:35.336475+0000","last_became_peered":"2024-09-12T17:29:35.336475+0000","last_unstale":"2024-09-12T17:29:37.541726+0000","last_undegraded":"2024-09-12T17:29:37.541726+0000","last_fullsized":"2024-09-12T17:29:37.541726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:17.489304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012883599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:29:37.351871+0000","last_change":"2024-09-12T17:29:37.351871+0000","last_active":"2024-09-12T17:29:37.351871+0000","last_peered":"2024-09-12T17:29:37.351871+0000","last_clean":"2024-09-12T17:29:37.351871+0000","last_became_active":"2024-09-12T17:29:35.340342+0000","last_became_peered":"2024-09-12T17:29:35.340342+0000","last_unstale":"2024-09-12T17:29:37.351871+0000","last_undegraded":"2024-09-12T17:29:37.351871+0000","last_fullsized":"2024-09-12T17:29:37.351871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:04.662413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097602599999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:29:37.540233+0000","last_change":"2024-09-12T17:29:30.603974+0000","last_active":"2024-09-12T17:29:37.540233+0000","last_peered":"2024-09-12T17:29:37.540233+0000","last_clean":"2024-09-12T17:29:37.540233+0000","last_became_active":"2024-09-12T17:29:30.601518+0000","last_became_peered":"2024-09-12T17:29:30.601518+0000","last_unstale":"2024-09-12T17:29:37.540233+0000","last_undegraded":"2024-09-12T17:29:37.540233+0000","last_fullsized":"2024-09-12T17:29:37.540233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:29.241459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:29.241459+0000","last_clean_scrub_stamp":"2024-09-12T17:29:29.241459+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:32.039824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":667164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":667164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:29:43.121 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:29:43.404 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:29:43.405 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-12T17:29:43.421 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-12T17:29:42.570727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219192,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755528,"statfs":{"total":773094113280,"available":772869660672,"internally_reserved":0,"allocated":2998272,"data_stored":1795142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.236476"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:29:37.541991+0000","last_change":"2024-09-12T17:29:37.541991+0000","last_active":"2024-09-12T17:29:37.541991+0000","last_peered":"2024-09-12T17:29:37.541991+0000","last_clean":"2024-09-12T17:29:37.541991+0000","last_became_active":"2024-09-12T17:29:35.337998+0000","last_became_peered":"2024-09-12T17:29:35.337998+0000","last_unstale":"2024-09-12T17:29:37.541991+0000","last_undegraded":"2024-09-12T17:29:37.541991+0000","last_fullsized":"2024-09-12T17:29:37.541991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:23.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011850280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:29:37.346714+0000","last_change":"2024-09-12T17:29:37.346714+0000","last_active":"2024-09-12T17:29:37.346714+0000","last_peered":"2024-09-12T17:29:37.346714+0000","last_clean":"2024-09-12T17:29:37.346714+0000","last_became_active":"2024-09-12T17:29:35.337987+0000","last_became_peered":"2024-09-12T17:29:35.337987+0000","last_unstale":"2024-09-12T17:29:37.346714+0000","last_undegraded":"2024-09-12T17:29:37.346714+0000","last_fullsized":"2024-09-12T17:29:37.346714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:46.254256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011496340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:29:37.541831+0000","last_change":"2024-09-12T17:29:37.541831+0000","last_active":"2024-09-12T17:29:37.541831+0000","last_peered":"2024-09-12T17:29:37.541831+0000","last_clean":"2024-09-12T17:29:37.541831+0000","last_became_active":"2024-09-12T17:29:35.406653+0000","last_became_peered":"2024-09-12T17:29:35.406653+0000","last_unstale":"2024-09-12T17:29:37.541831+0000","last_undegraded":"2024-09-12T17:29:37.541831+0000","last_fullsized":"2024-09-12T17:29:37.541831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:04.148521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001315566,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:29:37.346858+0000","last_change":"2024-09-12T17:29:37.346858+0000","last_active":"2024-09-12T17:29:37.346858+0000","last_peered":"2024-09-12T17:29:37.346858+0000","last_clean":"2024-09-12T17:29:37.346858+0000","last_became_active":"2024-09-12T17:29:35.407492+0000","last_became_peered":"2024-09-12T17:29:35.407492+0000","last_unstale":"2024-09-12T17:29:37.346858+0000","last_undegraded":"2024-09-12T17:29:37.346858+0000","last_fullsized":"2024-09-12T17:29:37.346858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:34.824127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098134900000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:29:37.356624+0000","last_change":"2024-09-12T17:29:37.352917+0000","last_active":"2024-09-12T17:29:37.356624+0000","last_peered":"2024-09-12T17:29:37.356624+0000","last_clean":"2024-09-12T17:29:37.356624+0000","last_became_active":"2024-09-12T17:29:35.340113+0000","last_became_peered":"2024-09-12T17:29:35.340113+0000","last_unstale":"2024-09-12T17:29:37.356624+0000","last_undegraded":"2024-09-12T17:29:37.356624+0000","last_fullsized":"2024-09-12T17:29:37.356624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:23.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020086050000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:29:37.348932+0000","last_change":"2024-09-12T17:29:37.348932+0000","last_active":"2024-09-12T17:29:37.348932+0000","last_peered":"2024-09-12T17:29:37.348932+0000","last_clean":"2024-09-12T17:29:37.348932+0000","last_became_active":"2024-09-12T17:29:35.331504+0000","last_became_peered":"2024-09-12T17:29:35.331504+0000","last_unstale":"2024-09-12T17:29:37.348932+0000","last_undegraded":"2024-09-12T17:29:37.348932+0000","last_fullsized":"2024-09-12T17:29:37.348932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:24.198110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001034428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:29:37.541726+0000","last_change":"2024-09-12T17:29:37.541726+0000","last_active":"2024-09-12T17:29:37.541726+0000","last_peered":"2024-09-12T17:29:37.541726+0000","last_clean":"2024-09-12T17:29:37.541726+0000","last_became_active":"2024-09-12T17:29:35.336475+0000","last_became_peered":"2024-09-12T17:29:35.336475+0000","last_unstale":"2024-09-12T17:29:37.541726+0000","last_undegraded":"2024-09-12T17:29:37.541726+0000","last_fullsized":"2024-09-12T17:29:37.541726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:17.489304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012883599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:29:37.351871+0000","last_change":"2024-09-12T17:29:37.351871+0000","last_active":"2024-09-12T17:29:37.351871+0000","last_peered":"2024-09-12T17:29:37.351871+0000","last_clean":"2024-09-12T17:29:37.351871+0000","last_became_active":"2024-09-12T17:29:35.340342+0000","last_became_peered":"2024-09-12T17:29:35.340342+0000","last_unstale":"2024-09-12T17:29:37.351871+0000","last_undegraded":"2024-09-12T17:29:37.351871+0000","last_fullsized":"2024-09-12T17:29:37.351871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:04.662413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097602599999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:29:37.540233+0000","last_change":"2024-09-12T17:29:30.603974+0000","last_active":"2024-09-12T17:29:37.540233+0000","last_peered":"2024-09-12T17:29:37.540233+0000","last_clean":"2024-09-12T17:29:37.540233+0000","last_became_active":"2024-09-12T17:29:30.601518+0000","last_became_peered":"2024-09-12T17:29:30.601518+0000","last_unstale":"2024-09-12T17:29:37.540233+0000","last_undegraded":"2024-09-12T17:29:37.540233+0000","last_fullsized":"2024-09-12T17:29:37.540233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:29.241459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:29.241459+0000","last_clean_scrub_stamp":"2024-09-12T17:29:29.241459+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:32.039824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":667164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":76796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":667164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:29:43.422 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T17:29:43.422 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T17:29:43.422 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T17:29:43.423 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T17:29:43.733 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:29:43.734 INFO:teuthology.orchestra.run.smithi098.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T17:29:43.751 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T17:29:43.751 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T17:29:43.765 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-12T17:29:43.765 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T17:29:43.771 DEBUG:teuthology.orchestra.run.smithi098:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-12T17:29:44.870 INFO:teuthology.orchestra.run.smithi098.stderr:...+...+............+.+........+..........+............+.........+...+..+......+...+.+...+.....+.+..+.......+...+..+.............+..+.+.....................+......+.....+...+..........+.........+.....+...+...+............+....+...+...+...+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+.........+.....+.............+...+..+......+......+...+......+...................+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+............+......+.........+..+......+....+...+............+...+...+.....+.........+...+...............+.+.....+.......+.........+...+..+.+.....+...+....+..+....+......+...............+.......................+.+..............+..........+........+....+...+......+..+.........+...+.......+........+.......+........+.............+........+..........+......+...+..+.+..............+.+..................+......+........+.......+...+...............+......+............+...+.....+............+...............+.........+......+.............+..+...+....+.................+...+.......+......+........+....+..+.+.......................+......+...+..........+......+......+........+............+.+...+......+......+..............+.........+......+....+.........+...............+.....+.+.....+.+......+........+....+..+.+..............................+........+.+.....+.+.....+...+........................+...+...+...............+.+...+..+.........+......+......+....+...........+.............+.....+............+.........+...+.+.........+...............+......+......+........+............+.+............+..........................................+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T17:29:45.127 INFO:teuthology.orchestra.run.smithi098.stderr:..+............................+..+.......+...+...+.....+.......+.....+...+......+.+........+.+...+...........+......+.+..+...+.......+..+...+...+....+...+.....+......+.+.....+..........+......+.....+............+......+.+...+...+...+............+...+.........+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+...+.......+...+..+.+......+........+.+.........+........+...+.+...+..+.+...............+..+.+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+......+.........+.......+...............+.....+......+.............+..+.......+...+........................+...+...+...+..+............+.............+..+.+.................+.......+...........+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T17:29:45.143 INFO:teuthology.orchestra.run.smithi098.stderr:----- 2024-09-12T17:29:45.151 DEBUG:teuthology.orchestra.run.smithi098:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/local/share/ca-certificates/root.crt 2024-09-12T17:29:45.220 DEBUG:teuthology.orchestra.run.smithi098:> sudo update-ca-certificates 2024-09-12T17:29:45.283 INFO:teuthology.orchestra.run.smithi098.stdout:Updating certificates in /etc/ssl/certs... 2024-09-12T17:29:45.930 INFO:teuthology.orchestra.run.smithi098.stderr:rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL 2024-09-12T17:29:45.951 INFO:teuthology.orchestra.run.smithi098.stdout:1 added, 0 removed; done. 2024-09-12T17:29:45.955 INFO:teuthology.orchestra.run.smithi098.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-12T17:29:45.959 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:29:47.860 INFO:teuthology.orchestra.run.smithi098.stdout:Adding debian:root.pem 2024-09-12T17:29:47.881 INFO:teuthology.orchestra.run.smithi098.stdout:done. 2024-09-12T17:29:47.882 INFO:teuthology.orchestra.run.smithi098.stdout:done. 2024-09-12T17:29:47.886 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T17:29:47.931 DEBUG:teuthology.orchestra.run.smithi098:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi098.front.sepia.ceph.com 2024-09-12T17:29:48.026 INFO:teuthology.orchestra.run.smithi098.stderr:....+...+.+...+..+.........+....+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.......+.....+.......+...........+...+...................+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+...+...+.....+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T17:29:48.041 INFO:teuthology.orchestra.run.smithi098.stderr:..+....+...+..+.+........+.+.....+......+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+.....+.+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+.+.....+.+.....+.+........+.+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T17:29:48.044 INFO:teuthology.orchestra.run.smithi098.stderr:----- 2024-09-12T17:29:48.047 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:29:48.047 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T17:29:48.096 DEBUG:teuthology.orchestra.run.smithi098:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T17:29:48.146 INFO:teuthology.orchestra.run.smithi098.stderr:Certificate request self-signature ok 2024-09-12T17:29:48.146 INFO:teuthology.orchestra.run.smithi098.stderr:subject=CN = smithi098.front.sepia.ceph.com 2024-09-12T17:29:48.158 DEBUG:teuthology.orchestra.run.smithi098:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T17:29:48.207 DEBUG:teuthology.orchestra.run.smithi098:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T17:29:48.260 INFO:teuthology.orchestra.run.smithi098.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-12T17:29:48.260 DEBUG:teuthology.orchestra.run.smithi098:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T17:29:48.309 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T17:29:48.325 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-12T17:29:48.325 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T17:29:48.325 INFO:tasks.rgw:Creating data pools 2024-09-12T17:29:48.325 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T17:29:48.326 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-12T17:29:49.679 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-12T17:29:51.672 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T17:29:51.708 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T17:29:52.698 INFO:teuthology.orchestra.run.smithi098.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T17:29:52.741 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T17:29:53.723 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T17:29:53.754 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T17:29:54.746 INFO:teuthology.orchestra.run.smithi098.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T17:29:54.785 DEBUG:tasks.rgw:Pools created 2024-09-12T17:29:54.785 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T17:29:54.785 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:29:54.785 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:29:54.785 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:29:54.826 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:29:54.826 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:29:57.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.033+0000 7f1064b99640 0 -- 172.21.15.98:0/1805156416 >> [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] conn(0x7f0f400709f0 msgr2=0x7f0f40072eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:29:57.041 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.037+0000 7f10670939c0 20 rados->read ofs=0 len=0 2024-09-12T17:29:57.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.037+0000 7f1064b99640 0 -- 172.21.15.98:0/1071199986 >> [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] conn(0x7f0f2c070ae0 msgr2=0x7f0f2c072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:29:57.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.041+0000 7f10670939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:57.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.041+0000 7f10670939c0 20 realm 2024-09-12T17:29:57.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.041+0000 7f10670939c0 20 rados->read ofs=0 len=0 2024-09-12T17:29:57.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.041+0000 7f10670939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:57.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.041+0000 7f10670939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:29:57.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.041+0000 7f10670939c0 20 rados->read ofs=0 len=0 2024-09-12T17:29:57.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.041+0000 7f10670939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:57.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.041+0000 7f10670939c0 20 rados->read ofs=0 len=0 2024-09-12T17:29:57.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.041+0000 7f10670939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:57.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.041+0000 7f10670939c0 20 rados->read ofs=0 len=0 2024-09-12T17:29:57.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.041+0000 7f10670939c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:29:57.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.041+0000 7f10670939c0 20 searching for the correct realm 2024-09-12T17:29:57.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.061+0000 7f10670939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:29:57.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.061+0000 7f10670939c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:29:57.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.061+0000 7f10670939c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:29:57.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.061+0000 7f10670939c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:29:57.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.061+0000 7f10670939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:29:57.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.061+0000 7f10670939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:29:57.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.061+0000 7f10670939c0 20 rados->read ofs=0 len=0 2024-09-12T17:29:57.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.065+0000 7f10670939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:57.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.065+0000 7f10670939c0 20 rados->read ofs=0 len=0 2024-09-12T17:29:57.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.065+0000 7f10670939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:29:57.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.065+0000 7f10670939c0 20 rados->read ofs=0 len=0 2024-09-12T17:29:57.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.065+0000 7f10670939c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:29:57.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.065+0000 7f10670939c0 20 zone default found 2024-09-12T17:29:57.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.065+0000 7f10670939c0 4 Realm: () 2024-09-12T17:29:57.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.065+0000 7f10670939c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:29:57.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.065+0000 7f10670939c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:29:57.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.065+0000 7f10670939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:29:57.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.065+0000 7f10670939c0 20 zonegroup default 2024-09-12T17:29:57.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.065+0000 7f10670939c0 20 rados->read ofs=0 len=0 2024-09-12T17:29:57.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.065+0000 7f10670939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:57.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:57.065+0000 7f10670939c0 20 rados->read ofs=0 len=0 2024-09-12T17:29:58.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:58.769+0000 7f10670939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:58.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:58.769+0000 7f10670939c0 20 rados->read ofs=0 len=0 2024-09-12T17:29:58.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:58.769+0000 7f10670939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:29:58.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:58.769+0000 7f10670939c0 20 started sync module instance, tier type = 2024-09-12T17:29:58.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:29:58.769+0000 7f10670939c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:30:00.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.829+0000 7f10670939c0 20 add_watcher() i=0 2024-09-12T17:30:00.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.829+0000 7f10670939c0 20 add_watcher() i=1 2024-09-12T17:30:00.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.829+0000 7f10670939c0 20 add_watcher() i=2 2024-09-12T17:30:00.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.829+0000 7f10670939c0 20 add_watcher() i=3 2024-09-12T17:30:00.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.829+0000 7f10670939c0 20 add_watcher() i=4 2024-09-12T17:30:00.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.829+0000 7f10670939c0 20 add_watcher() i=5 2024-09-12T17:30:00.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.829+0000 7f10670939c0 20 add_watcher() i=6 2024-09-12T17:30:00.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.829+0000 7f10670939c0 20 add_watcher() i=7 2024-09-12T17:30:00.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.829+0000 7f10670939c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:00.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T17:30:00.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T17:30:00.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T17:30:00.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T17:30:00.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T17:30:00.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T17:30:00.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T17:30:00.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T17:30:00.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T17:30:00.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T17:30:00.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T17:30:00.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T17:30:00.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T17:30:00.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T17:30:00.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.833+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T17:30:00.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T17:30:00.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T17:30:00.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T17:30:00.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T17:30:00.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T17:30:00.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T17:30:00.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T17:30:00.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T17:30:00.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T17:30:00.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T17:30:00.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T17:30:00.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T17:30:00.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T17:30:00.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.837+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T17:30:00.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T17:30:00.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T17:30:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T17:30:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T17:30:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T17:30:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T17:30:00.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T17:30:00.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T17:30:00.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T17:30:00.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T17:30:00.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T17:30:00.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T17:30:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T17:30:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.841+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.845+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T17:30:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.845+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T17:30:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.845+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.845+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T17:30:00.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.845+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T17:30:00.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.845+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.845+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T17:30:00.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.845+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T17:30:00.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.845+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.845+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T17:30:00.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.845+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T17:30:00.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.845+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.845+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T17:30:00.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.845+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T17:30:00.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.845+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.845+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T17:30:00.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.845+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T17:30:00.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.845+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T17:30:00.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T17:30:00.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T17:30:00.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T17:30:00.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T17:30:00.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T17:30:00.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T17:30:00.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T17:30:00.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T17:30:00.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T17:30:00.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T17:30:00.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T17:30:00.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T17:30:00.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T17:30:00.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.849+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T17:30:00.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T17:30:00.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T17:30:00.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T17:30:00.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T17:30:00.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T17:30:00.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T17:30:00.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T17:30:00.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T17:30:00.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T17:30:00.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T17:30:00.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T17:30:00.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T17:30:00.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T17:30:00.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.853+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.857+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T17:30:00.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.857+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T17:30:00.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.857+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.857+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T17:30:00.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.857+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T17:30:00.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.857+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.857+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T17:30:00.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.857+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T17:30:00.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.857+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.857+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T17:30:00.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.857+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T17:30:00.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.857+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.857+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T17:30:00.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.857+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T17:30:00.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.857+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.857+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T17:30:00.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.857+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T17:30:00.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.857+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T17:30:00.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T17:30:00.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T17:30:00.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T17:30:00.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T17:30:00.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T17:30:00.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T17:30:00.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T17:30:00.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T17:30:00.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T17:30:00.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T17:30:00.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T17:30:00.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T17:30:00.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T17:30:00.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T17:30:00.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T17:30:00.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T17:30:00.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T17:30:00.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.861+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T17:30:00.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T17:30:00.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T17:30:00.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T17:30:00.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T17:30:00.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T17:30:00.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T17:30:00.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T17:30:00.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T17:30:00.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T17:30:00.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T17:30:00.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T17:30:00.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T17:30:00.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T17:30:00.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.865+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T17:30:00.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T17:30:00.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T17:30:00.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T17:30:00.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T17:30:00.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T17:30:00.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T17:30:00.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T17:30:00.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T17:30:00.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T17:30:00.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T17:30:00.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T17:30:00.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T17:30:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T17:30:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.869+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.873+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T17:30:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.873+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T17:30:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.873+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.873+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T17:30:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.873+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T17:30:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.873+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.873+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T17:30:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.873+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T17:30:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.873+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.873+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T17:30:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.873+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T17:30:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.873+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.873+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T17:30:00.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.873+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T17:30:00.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.873+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.877+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T17:30:00.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.877+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T17:30:00.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.877+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.877+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T17:30:00.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.877+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T17:30:00.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.877+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.877+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T17:30:00.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.877+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T17:30:00.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.877+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.877+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T17:30:00.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.877+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T17:30:00.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.877+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.877+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T17:30:00.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.877+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T17:30:00.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.877+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.877+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T17:30:00.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.877+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T17:30:00.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.877+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T17:30:00.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T17:30:00.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T17:30:00.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T17:30:00.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T17:30:00.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T17:30:00.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T17:30:00.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T17:30:00.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T17:30:00.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T17:30:00.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T17:30:00.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T17:30:00.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T17:30:00.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T17:30:00.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.881+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.885+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T17:30:00.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.885+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T17:30:00.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.885+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.885+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T17:30:00.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.885+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T17:30:00.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.885+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.885+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T17:30:00.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.885+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T17:30:00.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.885+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.885+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T17:30:00.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.885+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T17:30:00.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.885+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.885+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T17:30:00.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.885+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T17:30:00.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.885+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.885+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T17:30:00.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.885+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T17:30:00.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.885+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.889+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T17:30:00.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.889+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T17:30:00.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.889+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.889+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T17:30:00.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.889+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T17:30:00.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.889+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.889+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T17:30:00.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.889+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T17:30:00.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.889+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.889+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T17:30:00.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.889+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T17:30:00.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.889+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.889+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T17:30:00.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.889+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T17:30:00.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.889+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.893+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T17:30:00.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.893+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T17:30:00.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.893+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.893+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T17:30:00.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.893+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T17:30:00.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.893+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.893+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T17:30:00.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.893+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T17:30:00.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.893+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.893+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T17:30:00.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.893+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T17:30:00.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.893+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.893+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T17:30:00.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.893+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T17:30:00.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.893+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.893+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T17:30:00.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.893+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T17:30:00.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.893+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T17:30:00.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T17:30:00.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T17:30:00.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T17:30:00.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T17:30:00.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T17:30:00.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T17:30:00.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T17:30:00.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T17:30:00.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T17:30:00.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T17:30:00.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T17:30:00.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T17:30:00.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T17:30:00.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.897+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T17:30:00.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T17:30:00.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T17:30:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T17:30:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T17:30:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T17:30:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T17:30:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T17:30:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T17:30:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T17:30:00.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T17:30:00.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T17:30:00.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T17:30:00.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T17:30:00.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.901+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T17:30:00.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T17:30:00.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T17:30:00.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T17:30:00.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T17:30:00.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T17:30:00.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T17:30:00.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T17:30:00.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T17:30:00.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T17:30:00.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T17:30:00.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T17:30:00.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T17:30:00.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T17:30:00.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.905+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.909+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T17:30:00.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.909+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T17:30:00.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.909+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.909+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T17:30:00.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.909+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T17:30:00.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.909+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.909+0000 7f10670939c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T17:30:00.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.909+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T17:30:00.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.913+0000 7f10670939c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T17:30:00.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.921+0000 7f0f16fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.921+0000 7f10670939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:00.921+0000 7f10670939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:03.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:03.769+0000 7f10670939c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T17:30:03.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:03.769+0000 7f10670939c0 5 note: GC not initialized 2024-09-12T17:30:03.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:03.781+0000 7f0f15fe3640 20 reqs_thread_entry: start 2024-09-12T17:30:03.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:03.781+0000 7f10670939c0 20 init_complete bucket index max shards: 11 2024-09-12T17:30:03.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:03.781+0000 7f10670939c0 20 Filter name: none 2024-09-12T17:30:03.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:03.781+0000 7f0e777fe640 20 reqs_thread_entry: start 2024-09-12T17:30:03.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:03.837+0000 7f0f16fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:03.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:03.841+0000 7f10670939c0 20 remove_watcher() i=0 2024-09-12T17:30:03.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:03.841+0000 7f10670939c0 2 removed watcher, disabling cache 2024-09-12T17:30:03.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:03.845+0000 7f10670939c0 20 remove_watcher() i=1 2024-09-12T17:30:03.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:03.845+0000 7f10670939c0 20 remove_watcher() i=2 2024-09-12T17:30:03.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:03.849+0000 7f10670939c0 20 remove_watcher() i=3 2024-09-12T17:30:03.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:03.853+0000 7f10670939c0 20 remove_watcher() i=4 2024-09-12T17:30:03.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:03.853+0000 7f10670939c0 20 remove_watcher() i=5 2024-09-12T17:30:03.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:03.857+0000 7f10670939c0 20 remove_watcher() i=6 2024-09-12T17:30:03.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:03.857+0000 7f10670939c0 20 remove_watcher() i=7 2024-09-12T17:30:03.882 INFO:teuthology.orchestra.run.smithi098.stdout:[] 2024-09-12T17:30:03.882 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:30:03.882 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T17:30:03.882 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T17:30:03.883 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T17:30:03.966 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:03.966 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:03.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:03.993+0000 7fa899b6e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:03.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:03.993+0000 7fa899b6e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:04.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:03.997+0000 7fa6ddffb640 20 reqs_thread_entry: start 2024-09-12T17:30:04.022 INFO:teuthology.orchestra.run.smithi098.stdout:{"id":"a01e4849-e968-46ce-97f1-a673c26b3735","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T17:30:04.022 DEBUG:tasks.util.rgw: json result: {'id': 'a01e4849-e968-46ce-97f1-a673c26b3735', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T17:30:04.023 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:30:04.023 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:30:04.023 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:30:04.100 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:04.101 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:04.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.137+0000 7fda3c87f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.137+0000 7fda3c87f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.137+0000 7fda3c87f9c0 20 realm 2024-09-12T17:30:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.137+0000 7fda3c87f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.137+0000 7fda3c87f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.137+0000 7fda3c87f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.137+0000 7fda3c87f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.137+0000 7fda3c87f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.137+0000 7fda3c87f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.141+0000 7fda3c87f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.141+0000 7fda3c87f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.141+0000 7fda3c87f9c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T17:30:04.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.141+0000 7fda3c87f9c0 20 searching for the correct realm 2024-09-12T17:30:04.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.349+0000 7fda39b84640 0 -- 172.21.15.98:0/3197841397 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x563aecfc9a40 msgr2=0x563aecfcbf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:04.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.361+0000 7fda3a385640 0 -- 172.21.15.98:0/3197841397 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fda3002c8e0 msgr2=0x7fda30097310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:04.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:04.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:30:04.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:04.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:30:04.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:04.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:04.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:04.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:30:04.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 20 zone default found 2024-09-12T17:30:04.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 4 Realm: () 2024-09-12T17:30:04.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:30:04.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:30:04.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:04.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 20 zonegroup default 2024-09-12T17:30:04.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.373+0000 7fda3c87f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.377+0000 7fda3c87f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.377+0000 7fda3c87f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.377+0000 7fda3c87f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.377+0000 7fda3c87f9c0 20 started sync module instance, tier type = 2024-09-12T17:30:04.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.377+0000 7fda3c87f9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:30:04.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.401+0000 7fda3c87f9c0 20 add_watcher() i=0 2024-09-12T17:30:04.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.401+0000 7fda3c87f9c0 20 add_watcher() i=1 2024-09-12T17:30:04.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.401+0000 7fda3c87f9c0 20 add_watcher() i=2 2024-09-12T17:30:04.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.401+0000 7fda3c87f9c0 20 add_watcher() i=3 2024-09-12T17:30:04.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.401+0000 7fda3c87f9c0 20 add_watcher() i=4 2024-09-12T17:30:04.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.401+0000 7fda3c87f9c0 20 add_watcher() i=5 2024-09-12T17:30:04.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.401+0000 7fda3c87f9c0 20 add_watcher() i=6 2024-09-12T17:30:04.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.405+0000 7fda3c87f9c0 20 add_watcher() i=7 2024-09-12T17:30:04.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.405+0000 7fda3c87f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:04.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.409+0000 7fd8f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:04.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.409+0000 7fda3c87f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:04.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.409+0000 7fda3c87f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:04.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.409+0000 7fda3c87f9c0 5 note: GC not initialized 2024-09-12T17:30:04.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.409+0000 7fd86b7fe640 20 reqs_thread_entry: start 2024-09-12T17:30:04.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.409+0000 7fda3c87f9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:30:04.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.409+0000 7fda3c87f9c0 20 Filter name: none 2024-09-12T17:30:04.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.409+0000 7fd8697fa640 20 reqs_thread_entry: start 2024-09-12T17:30:04.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.429+0000 7fd8f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:04.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.437+0000 7fda3c87f9c0 20 remove_watcher() i=0 2024-09-12T17:30:04.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.437+0000 7fda3c87f9c0 2 removed watcher, disabling cache 2024-09-12T17:30:04.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.437+0000 7fda3c87f9c0 20 remove_watcher() i=1 2024-09-12T17:30:04.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.441+0000 7fda3c87f9c0 20 remove_watcher() i=2 2024-09-12T17:30:04.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.445+0000 7fda3c87f9c0 20 remove_watcher() i=3 2024-09-12T17:30:04.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.445+0000 7fda3c87f9c0 20 remove_watcher() i=4 2024-09-12T17:30:04.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.445+0000 7fda3c87f9c0 20 remove_watcher() i=5 2024-09-12T17:30:04.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.449+0000 7fda3c87f9c0 20 remove_watcher() i=6 2024-09-12T17:30:04.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.449+0000 7fda3c87f9c0 20 remove_watcher() i=7 2024-09-12T17:30:04.472 INFO:teuthology.orchestra.run.smithi098.stdout:[] 2024-09-12T17:30:04.472 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:30:04.473 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T17:30:04.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T17:30:04.473 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-12T17:30:04.557 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:04.557 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:04.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.581+0000 7f0b7ea219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:04.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.581+0000 7f0b7ea219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:04.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.585+0000 7f09d27fc640 20 reqs_thread_entry: start 2024-09-12T17:30:04.611 INFO:teuthology.orchestra.run.smithi098.stdout:{"id":"a01e4849-e968-46ce-97f1-a673c26b3735","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:30:04.611 DEBUG:tasks.util.rgw: json result: {'id': 'a01e4849-e968-46ce-97f1-a673c26b3735', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:30:04.612 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T17:30:04.612 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T17:30:04.612 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T17:30:04.686 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:04.686 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:04.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.721+0000 7f12ea2569c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.721+0000 7f12ea2569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.721+0000 7f12ea2569c0 20 realm 2024-09-12T17:30:04.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.721+0000 7f12ea2569c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.721+0000 7f12ea2569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.721+0000 7f12ea2569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:30:04.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.721+0000 7f12ea2569c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.725+0000 7f12ea2569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.725+0000 7f12ea2569c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.725+0000 7f12ea2569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:04.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.725+0000 7f12ea2569c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.725+0000 7f12ea2569c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T17:30:04.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.725+0000 7f12ea2569c0 20 searching for the correct realm 2024-09-12T17:30:04.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.729+0000 7f12e855d640 0 -- 172.21.15.98:0/2789935726 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x5642be104d00 msgr2=0x5642be107170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:04.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.737+0000 7f12e7d5c640 0 -- 172.21.15.98:0/2789935726 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f12dc0fcdd0 msgr2=0x7f12dc105040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:30:04.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.953+0000 7f12ea2569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:30:04.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.953+0000 7f12ea2569c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:30:04.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.953+0000 7f12ea2569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:30:04.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.953+0000 7f12ea2569c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:30:04.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.953+0000 7f12ea2569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:30:04.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.953+0000 7f12ea2569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:30:04.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.953+0000 7f12ea2569c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.953+0000 7f12ea2569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.953+0000 7f12ea2569c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.957+0000 7f12ea2569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:30:04.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.957+0000 7f12ea2569c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.957+0000 7f12ea2569c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:30:04.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.957+0000 7f12ea2569c0 20 zone default found 2024-09-12T17:30:04.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.957+0000 7f12ea2569c0 4 Realm: () 2024-09-12T17:30:04.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.957+0000 7f12ea2569c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:30:04.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.957+0000 7f12ea2569c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:30:04.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.957+0000 7f12ea2569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:30:04.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.957+0000 7f12ea2569c0 20 zonegroup default 2024-09-12T17:30:04.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.957+0000 7f12ea2569c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.957+0000 7f12ea2569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.957+0000 7f12ea2569c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.957+0000 7f12ea2569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.957+0000 7f12ea2569c0 20 rados->read ofs=0 len=0 2024-09-12T17:30:04.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.957+0000 7f12ea2569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:30:04.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.957+0000 7f12ea2569c0 20 started sync module instance, tier type = 2024-09-12T17:30:04.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.957+0000 7f12ea2569c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:30:04.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.981+0000 7f12ea2569c0 20 add_watcher() i=0 2024-09-12T17:30:04.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.981+0000 7f12ea2569c0 20 add_watcher() i=1 2024-09-12T17:30:04.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.981+0000 7f12ea2569c0 20 add_watcher() i=2 2024-09-12T17:30:04.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.981+0000 7f12ea2569c0 20 add_watcher() i=3 2024-09-12T17:30:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.981+0000 7f12ea2569c0 20 add_watcher() i=4 2024-09-12T17:30:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.981+0000 7f12ea2569c0 20 add_watcher() i=5 2024-09-12T17:30:04.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.981+0000 7f12ea2569c0 20 add_watcher() i=6 2024-09-12T17:30:04.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.985+0000 7f12ea2569c0 20 add_watcher() i=7 2024-09-12T17:30:04.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.985+0000 7f12ea2569c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:30:04.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.989+0000 7f119dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:04.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.989+0000 7f12ea2569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:04.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.989+0000 7f12ea2569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:04.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.989+0000 7f12ea2569c0 5 note: GC not initialized 2024-09-12T17:30:04.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.989+0000 7f119cfe1640 20 reqs_thread_entry: start 2024-09-12T17:30:04.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.989+0000 7f12ea2569c0 20 init_complete bucket index max shards: 11 2024-09-12T17:30:04.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.989+0000 7f12ea2569c0 20 Filter name: none 2024-09-12T17:30:04.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:04.989+0000 7f11167fc640 20 reqs_thread_entry: start 2024-09-12T17:30:05.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.013+0000 7f119dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:30:05.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.017+0000 7f12ea2569c0 20 remove_watcher() i=0 2024-09-12T17:30:05.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.017+0000 7f12ea2569c0 2 removed watcher, disabling cache 2024-09-12T17:30:05.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.021+0000 7f12ea2569c0 20 remove_watcher() i=1 2024-09-12T17:30:05.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.025+0000 7f12ea2569c0 20 remove_watcher() i=2 2024-09-12T17:30:05.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.029+0000 7f12ea2569c0 20 remove_watcher() i=3 2024-09-12T17:30:05.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.029+0000 7f12ea2569c0 20 remove_watcher() i=4 2024-09-12T17:30:05.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.033+0000 7f12ea2569c0 20 remove_watcher() i=5 2024-09-12T17:30:05.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.033+0000 7f12ea2569c0 20 remove_watcher() i=6 2024-09-12T17:30:05.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.033+0000 7f12ea2569c0 20 remove_watcher() i=7 2024-09-12T17:30:05.053 INFO:teuthology.orchestra.run.smithi098.stdout:[] 2024-09-12T17:30:05.053 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:30:05.053 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T17:30:05.053 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T17:30:05.053 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T17:30:05.054 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T17:30:05.138 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:05.138 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:05.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.165+0000 7f94ff75a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:05.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.165+0000 7f94ff75a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:05.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.165+0000 7f93bb7fe640 20 reqs_thread_entry: start 2024-09-12T17:30:05.190 INFO:teuthology.orchestra.run.smithi098.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T17:30:05.190 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T17:30:05.191 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T17:30:05.191 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T17:30:05.191 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T17:30:05.274 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:05.274 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:05.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.297+0000 7fb2a738c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:05.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.297+0000 7fb2a738c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:05.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.301+0000 7fb162ffd640 20 reqs_thread_entry: start 2024-09-12T17:30:05.328 INFO:teuthology.orchestra.run.smithi098.stdout:{"id":"a01e4849-e968-46ce-97f1-a673c26b3735","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:30:05.328 DEBUG:tasks.util.rgw: json result: {'id': 'a01e4849-e968-46ce-97f1-a673c26b3735', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:30:05.328 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T17:30:05.328 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T17:30:05.328 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T17:30:05.329 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T17:30:05.406 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:05.406 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:05.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.429+0000 7f927907e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:05.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.429+0000 7f927907e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:05.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.433+0000 7f9134ff9640 20 reqs_thread_entry: start 2024-09-12T17:30:05.456 INFO:teuthology.orchestra.run.smithi098.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T17:30:05.456 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T17:30:05.457 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T17:30:05.457 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T17:30:05.457 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T17:30:05.542 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:30:05.543 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:30:05.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.565+0000 7f3af09019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:30:05.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.565+0000 7f3af09019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:30:05.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:30:05.569+0000 7f39b17e2640 20 reqs_thread_entry: start 2024-09-12T17:30:05.597 INFO:teuthology.orchestra.run.smithi098.stdout:{"id":"a01e4849-e968-46ce-97f1-a673c26b3735","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:30:05.598 DEBUG:tasks.util.rgw: json result: {'id': 'a01e4849-e968-46ce-97f1-a673c26b3735', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:30:05.598 INFO:tasks.rgw:Starting rgw... 2024-09-12T17:30:05.598 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-12T17:30:05.598 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T17:30:05.598 DEBUG:teuthology.orchestra.run.smithi098:> sudo echo -n https://smithi098.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T17:30:05.650 INFO:teuthology.orchestra.run.smithi098.stdout:https://smithi098.front.sepia.ceph.com:443 2024-09-12T17:30:05.651 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T17:30:05.711 DEBUG:teuthology.orchestra.run.smithi098:> sudo keytool -import -alias smithi098.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-12T17:30:06.106 INFO:teuthology.orchestra.run.smithi098.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-12T17:30:06.368 INFO:teuthology.orchestra.run.smithi098.stderr:Certificate was added to keystore 2024-09-12T17:30:06.400 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-12T17:30:06.401 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T17:30:06.401 DEBUG:teuthology.orchestra.run.smithi098:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T17:30:06.403 INFO:tasks.rgw.client.0:Started 2024-09-12T17:30:06.403 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi098.front.sepia.ceph.com:443/ 2024-09-12T17:30:06.404 DEBUG:teuthology.orchestra.run.smithi098:> curl https://smithi098.front.sepia.ceph.com:443/ 2024-09-12T17:30:06.423 INFO:teuthology.orchestra.run.smithi098.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:30:06.423 INFO:teuthology.orchestra.run.smithi098.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:30:06.423 INFO:teuthology.orchestra.run.smithi098.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:30:06.424 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:30:06.424 INFO:teuthology.orchestra.run.smithi098.stderr:curl: (7) Failed to connect to smithi098.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-12T17:30:07.426 DEBUG:teuthology.orchestra.run.smithi098:> curl https://smithi098.front.sepia.ceph.com:443/ 2024-09-12T17:30:07.437 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:30:07.437 INFO:teuthology.orchestra.run.smithi098.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:30:07.437 INFO:teuthology.orchestra.run.smithi098.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:30:07.437 INFO:teuthology.orchestra.run.smithi098.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:30:07.437 INFO:teuthology.orchestra.run.smithi098.stderr:curl: (7) Failed to connect to smithi098.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-12T17:30:09.439 DEBUG:teuthology.orchestra.run.smithi098:> curl https://smithi098.front.sepia.ceph.com:443/ 2024-09-12T17:30:09.450 INFO:teuthology.orchestra.run.smithi098.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:30:09.450 INFO:teuthology.orchestra.run.smithi098.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:30:09.450 INFO:teuthology.orchestra.run.smithi098.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:30:09.450 INFO:teuthology.orchestra.run.smithi098.stderr:curl: (7) Failed to connect to smithi098.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-12T17:30:09.450 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:30:13.451 DEBUG:teuthology.orchestra.run.smithi098:> curl https://smithi098.front.sepia.ceph.com:443/ 2024-09-12T17:30:13.463 INFO:teuthology.orchestra.run.smithi098.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:30:13.463 INFO:teuthology.orchestra.run.smithi098.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:30:13.463 INFO:teuthology.orchestra.run.smithi098.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:30:13.464 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:30:13.465 INFO:teuthology.orchestra.run.smithi098.stderr:curl: (7) Failed to connect to smithi098.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-12T17:30:21.466 DEBUG:teuthology.orchestra.run.smithi098:> curl https://smithi098.front.sepia.ceph.com:443/ 2024-09-12T17:30:21.477 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:30:21.478 INFO:teuthology.orchestra.run.smithi098.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:30:21.478 INFO:teuthology.orchestra.run.smithi098.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:30:21.478 INFO:teuthology.orchestra.run.smithi098.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:30:21.478 INFO:teuthology.orchestra.run.smithi098.stderr:curl: (7) Failed to connect to smithi098.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-12T17:30:31.305 INFO:tasks.rgw.client.0.smithi098.stdout:2024-09-12T17:30:30.948+0000 8ed9f80 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-12T17:30:37.479 DEBUG:teuthology.orchestra.run.smithi098:> curl https://smithi098.front.sepia.ceph.com:443/ 2024-09-12T17:30:37.491 INFO:teuthology.orchestra.run.smithi098.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:30:37.491 INFO:teuthology.orchestra.run.smithi098.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:30:38.572 INFO:teuthology.orchestra.run.smithi098.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0 100 187 0 187 0 0 173 0 --:--:-- 0:00:01 --:--:-- 173 2024-09-12T17:30:38.576 INFO:teuthology.orchestra.run.smithi098.stdout:anonymous 2024-09-12T17:30:38.576 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T17:30:38.590 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T17:30:38.591 DEBUG:teuthology.orchestra.run.smithi098:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T17:30:41.591 DEBUG:teuthology.orchestra.run.smithi098:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T17:30:42.292 INFO:teuthology.orchestra.run.smithi098.stdout:Collecting tox==3.15.0 2024-09-12T17:30:42.396 INFO:teuthology.orchestra.run.smithi098.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T17:30:42.455 INFO:teuthology.orchestra.run.smithi098.stdout: ---------------------------------------- 82.1/82.1 KB 1.3 MB/s eta 0:00:00 2024-09-12T17:30:42.561 INFO:teuthology.orchestra.run.smithi098.stdout:Collecting toml>=0.9.4 2024-09-12T17:30:42.576 INFO:teuthology.orchestra.run.smithi098.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T17:30:42.683 INFO:teuthology.orchestra.run.smithi098.stdout:Collecting six<2,>=1.14.0 2024-09-12T17:30:42.699 INFO:teuthology.orchestra.run.smithi098.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:30:42.843 INFO:teuthology.orchestra.run.smithi098.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T17:30:42.858 INFO:teuthology.orchestra.run.smithi098.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T17:30:42.995 INFO:teuthology.orchestra.run.smithi098.stdout:Collecting packaging>=14 2024-09-12T17:30:43.012 INFO:teuthology.orchestra.run.smithi098.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T17:30:43.059 INFO:teuthology.orchestra.run.smithi098.stdout: --------------------------------------- 54.0/54.0 KB 999.1 kB/s eta 0:00:00 2024-09-12T17:30:43.310 INFO:teuthology.orchestra.run.smithi098.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T17:30:43.326 INFO:teuthology.orchestra.run.smithi098.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T17:30:43.863 INFO:teuthology.orchestra.run.smithi098.stdout: ---------------------------------------- 6.0/6.0 MB 11.3 MB/s eta 0:00:00 2024-09-12T17:30:43.990 INFO:teuthology.orchestra.run.smithi098.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T17:30:44.005 INFO:teuthology.orchestra.run.smithi098.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T17:30:44.126 INFO:teuthology.orchestra.run.smithi098.stdout:Collecting py<2,>=1.4.17 2024-09-12T17:30:44.141 INFO:teuthology.orchestra.run.smithi098.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T17:30:44.177 INFO:teuthology.orchestra.run.smithi098.stdout: ---------------------------------------- 98.7/98.7 KB 2.8 MB/s eta 0:00:00 2024-09-12T17:30:44.338 INFO:teuthology.orchestra.run.smithi098.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T17:30:44.353 INFO:teuthology.orchestra.run.smithi098.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T17:30:44.459 INFO:teuthology.orchestra.run.smithi098.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T17:30:44.474 INFO:teuthology.orchestra.run.smithi098.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T17:30:44.530 INFO:teuthology.orchestra.run.smithi098.stdout: --------------------------------------- 468.9/468.9 KB 8.9 MB/s eta 0:00:00 2024-09-12T17:30:44.696 INFO:teuthology.orchestra.run.smithi098.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-09-12T17:30:45.655 INFO:teuthology.orchestra.run.smithi098.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T17:30:45.741 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:30:45.766 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:30:45.766 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:30:45.767 DEBUG:teuthology.orchestra.run.smithi098:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:30:45.772 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:30:45.773 INFO:teuthology.orchestra.run.smithi098.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:30:45.774 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:30:45.819 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:30:45.819 DEBUG:teuthology.orchestra.run.smithi098:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:30:45.868 INFO:tasks.workunit:timeout=3h 2024-09-12T17:30:45.868 INFO:tasks.workunit:cleanup=True 2024-09-12T17:30:45.868 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:30:45.918 INFO:tasks.workunit.client.0.smithi098.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:31:43.732 INFO:tasks.workunit.client.0.smithi098.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:31:43.733 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:31:43.733 INFO:tasks.workunit.client.0.smithi098.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:31:43.733 INFO:tasks.workunit.client.0.smithi098.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:31:43.733 INFO:tasks.workunit.client.0.smithi098.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:31:43.733 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:31:43.733 INFO:tasks.workunit.client.0.smithi098.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:31:43.733 INFO:tasks.workunit.client.0.smithi098.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:31:43.733 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:31:43.734 INFO:tasks.workunit.client.0.smithi098.stderr: git switch -c 2024-09-12T17:31:43.734 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:31:43.734 INFO:tasks.workunit.client.0.smithi098.stderr:Or undo this operation with: 2024-09-12T17:31:43.734 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:31:43.734 INFO:tasks.workunit.client.0.smithi098.stderr: git switch - 2024-09-12T17:31:43.734 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:31:43.734 INFO:tasks.workunit.client.0.smithi098.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:31:43.734 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:31:43.734 INFO:tasks.workunit.client.0.smithi098.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:31:43.739 DEBUG:teuthology.orchestra.run.smithi098:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:31:43.786 INFO:tasks.workunit.client.0.smithi098.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:31:43.788 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:31:43.788 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:31:44.600 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:31:44.676 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:31:44.741 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:31:44.742 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:31:44.742 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:31:44.791 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:31:44.795 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:31:44.795 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:31:44.841 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T17:31:44.842 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T17:31:44.842 DEBUG:teuthology.orchestra.run.smithi098:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T17:31:44.893 INFO:tasks.workunit.client.0.smithi098.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T17:31:44.894 INFO:tasks.workunit.client.0.smithi098.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:31:44.894 INFO:tasks.workunit.client.0.smithi098.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:31:47.814 INFO:tasks.workunit.client.0.smithi098.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:31:47.814 INFO:tasks.workunit.client.0.smithi098.stderr:++ deactivate nondestructive 2024-09-12T17:31:47.814 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -n '' ']' 2024-09-12T17:31:47.814 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -n '' ']' 2024-09-12T17:31:47.814 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:31:47.814 INFO:tasks.workunit.client.0.smithi098.stderr:++ hash -r 2024-09-12T17:31:47.814 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -n '' ']' 2024-09-12T17:31:47.814 INFO:tasks.workunit.client.0.smithi098.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:31:47.814 INFO:tasks.workunit.client.0.smithi098.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T17:31:47.815 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:31:47.815 INFO:tasks.workunit.client.0.smithi098.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:31:47.815 INFO:tasks.workunit.client.0.smithi098.stderr:++ export VIRTUAL_ENV 2024-09-12T17:31:47.815 INFO:tasks.workunit.client.0.smithi098.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:31:47.815 INFO:tasks.workunit.client.0.smithi098.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:31:47.815 INFO:tasks.workunit.client.0.smithi098.stderr:++ export PATH 2024-09-12T17:31:47.815 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -n '' ']' 2024-09-12T17:31:47.815 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -z '' ']' 2024-09-12T17:31:47.815 INFO:tasks.workunit.client.0.smithi098.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:31:47.815 INFO:tasks.workunit.client.0.smithi098.stderr:++ PS1='(rgw) ' 2024-09-12T17:31:47.815 INFO:tasks.workunit.client.0.smithi098.stderr:++ export PS1 2024-09-12T17:31:47.815 INFO:tasks.workunit.client.0.smithi098.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T17:31:47.815 INFO:tasks.workunit.client.0.smithi098.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T17:31:47.815 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:31:47.816 INFO:tasks.workunit.client.0.smithi098.stderr:++ hash -r 2024-09-12T17:31:47.816 INFO:tasks.workunit.client.0.smithi098.stderr:+ pip install pip --upgrade 2024-09-12T17:31:48.169 INFO:tasks.workunit.client.0.smithi098.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T17:31:48.409 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting pip 2024-09-12T17:31:48.508 INFO:tasks.workunit.client.0.smithi098.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:31:48.780 INFO:tasks.workunit.client.0.smithi098.stdout: ---------------------------------------- 1.8/1.8 MB 6.8 MB/s eta 0:00:00 2024-09-12T17:31:48.852 INFO:tasks.workunit.client.0.smithi098.stdout:Installing collected packages: pip 2024-09-12T17:31:48.852 INFO:tasks.workunit.client.0.smithi098.stdout: Attempting uninstall: pip 2024-09-12T17:31:48.852 INFO:tasks.workunit.client.0.smithi098.stdout: Found existing installation: pip 22.0.2 2024-09-12T17:31:49.140 INFO:tasks.workunit.client.0.smithi098.stdout: Uninstalling pip-22.0.2: 2024-09-12T17:31:49.147 INFO:tasks.workunit.client.0.smithi098.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T17:31:50.177 INFO:tasks.workunit.client.0.smithi098.stdout:Successfully installed pip-24.2 2024-09-12T17:31:50.246 INFO:tasks.workunit.client.0.smithi098.stderr:+ pip install boto3 2024-09-12T17:31:51.255 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting boto3 2024-09-12T17:31:51.298 INFO:tasks.workunit.client.0.smithi098.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:31:51.965 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:31:51.976 INFO:tasks.workunit.client.0.smithi098.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:31:52.103 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:31:52.117 INFO:tasks.workunit.client.0.smithi098.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:31:52.254 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:31:52.271 INFO:tasks.workunit.client.0.smithi098.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:31:52.394 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:31:52.411 INFO:tasks.workunit.client.0.smithi098.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:31:52.620 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:31:52.635 INFO:tasks.workunit.client.0.smithi098.stdout: Downloading urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T17:31:52.901 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:31:52.916 INFO:tasks.workunit.client.0.smithi098.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:31:52.988 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:31:53.077 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:31:53.343 INFO:tasks.workunit.client.0.smithi098.stdout: ---------------------------------------- 12.5/12.5 MB 49.1 MB/s eta 0:00:00 2024-09-12T17:31:53.360 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:31:53.426 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:31:53.485 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:31:53.553 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T17:31:53.619 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:31:53.796 INFO:tasks.workunit.client.0.smithi098.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:31:54.900 INFO:tasks.workunit.client.0.smithi098.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T17:31:55.345 INFO:tasks.workunit.client.0.smithi098.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T17:31:55.492 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T17:31:55.531 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:31:55.531 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:31:55.573 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.571+0000 7f087d6609c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:55.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.571+0000 7f087d6609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:55.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.571+0000 7f087d6609c0 20 realm 2024-09-12T17:31:55.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.571+0000 7f087d6609c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:55.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.571+0000 7f087d6609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:55.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.571+0000 7f087d6609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:31:55.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.571+0000 7f087d6609c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:55.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.571+0000 7f087d6609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:55.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.571+0000 7f087d6609c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:55.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.575+0000 7f087d6609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:55.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.575+0000 7f087d6609c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:55.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.575+0000 7f087d6609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:31:55.578 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.575+0000 7f087d6609c0 20 searching for the correct realm 2024-09-12T17:31:55.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.583+0000 7f087b967640 0 -- 172.21.15.98:0/3272365056 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f0870063260 msgr2=0x7f087005b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:55.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.799+0000 7f087b166640 0 -- 172.21.15.98:0/3272365056 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x559b126349c0 msgr2=0x559b12636dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:31:55.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.807+0000 7f087d6609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:31:55.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.807+0000 7f087d6609c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:31:55.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.807+0000 7f087d6609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:31:55.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.807+0000 7f087d6609c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:31:55.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.807+0000 7f087d6609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:31:55.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.807+0000 7f087d6609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:31:55.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.807+0000 7f087d6609c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:55.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.807+0000 7f087d6609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:55.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.807+0000 7f087d6609c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:55.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.807+0000 7f087d6609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:31:55.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.807+0000 7f087d6609c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:55.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.811+0000 7f087d6609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:31:55.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.811+0000 7f087d6609c0 20 zone default found 2024-09-12T17:31:55.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.811+0000 7f087d6609c0 4 Realm: () 2024-09-12T17:31:55.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.811+0000 7f087d6609c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:31:55.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.811+0000 7f087d6609c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:31:55.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.811+0000 7f087d6609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:31:55.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.811+0000 7f087d6609c0 20 zonegroup default 2024-09-12T17:31:55.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.811+0000 7f087d6609c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:55.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.811+0000 7f087d6609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:55.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.811+0000 7f087d6609c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:55.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.811+0000 7f087d6609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:55.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.811+0000 7f087d6609c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:55.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.811+0000 7f087d6609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:55.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.811+0000 7f087d6609c0 20 started sync module instance, tier type = 2024-09-12T17:31:55.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.811+0000 7f087d6609c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:31:55.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.835+0000 7f087d6609c0 20 add_watcher() i=0 2024-09-12T17:31:55.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.835+0000 7f087d6609c0 20 add_watcher() i=1 2024-09-12T17:31:55.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.835+0000 7f087d6609c0 20 add_watcher() i=2 2024-09-12T17:31:55.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.835+0000 7f087d6609c0 20 add_watcher() i=3 2024-09-12T17:31:55.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.835+0000 7f087d6609c0 20 add_watcher() i=4 2024-09-12T17:31:55.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.835+0000 7f087d6609c0 20 add_watcher() i=5 2024-09-12T17:31:55.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.835+0000 7f087d6609c0 20 add_watcher() i=6 2024-09-12T17:31:55.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.839+0000 7f087d6609c0 20 add_watcher() i=7 2024-09-12T17:31:55.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.839+0000 7f087d6609c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:31:55.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.843+0000 7f0731fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:55.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.843+0000 7f087d6609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:31:55.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.843+0000 7f087d6609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:31:55.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.843+0000 7f087d6609c0 5 note: GC not initialized 2024-09-12T17:31:55.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.843+0000 7f0730fe1640 20 reqs_thread_entry: start 2024-09-12T17:31:55.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.843+0000 7f087d6609c0 20 init_complete bucket index max shards: 11 2024-09-12T17:31:55.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.843+0000 7f087d6609c0 20 Filter name: none 2024-09-12T17:31:55.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.843+0000 7f06aa7fc640 20 reqs_thread_entry: start 2024-09-12T17:31:55.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.843+0000 7f087d6609c0 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T17:31:55.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.843+0000 7f087d6609c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:55.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.843+0000 7f087d6609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:55.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.843+0000 7f087d6609c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T17:31:55.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.843+0000 7f087d6609c0 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:31:55.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.843+0000 7f087d6609c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T17:31:55.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.843+0000 7f087d6609c0 20 rados->read ofs=0 len=0 2024-09-12T17:31:55.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.847+0000 7f087d6609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:31:55.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.847+0000 7f087d6609c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T17:31:55.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.847+0000 7f087d6609c0 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:31:55.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.847+0000 7f087d6609c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T17:31:55.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.847+0000 7f087d6609c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T17:31:55.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.847+0000 7f087d6609c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T17:31:55.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.847+0000 7f087d6609c0 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:31:55.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.847+0000 7f087d6609c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T17:31:55.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.851+0000 7f075effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691840 cookie 94124516825408 notifier 4544 bl.length()=593 2024-09-12T17:31:55.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.851+0000 7f075effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T17:31:55.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.851+0000 7f075effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T17:31:55.926 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.923+0000 7f087d6609c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T17:31:55.927 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.923+0000 7f087d6609c0 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:31:55.927 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.923+0000 7f087d6609c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T17:31:55.927 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.923+0000 7f075effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691840 cookie 94124516796816 notifier 4544 bl.length()=186 2024-09-12T17:31:55.927 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.923+0000 7f075effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T17:31:55.927 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.923+0000 7f075effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T17:31:55.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.931+0000 7f0731fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:31:55.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.935+0000 7f087d6609c0 20 remove_watcher() i=0 2024-09-12T17:31:55.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.935+0000 7f087d6609c0 2 removed watcher, disabling cache 2024-09-12T17:31:55.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.939+0000 7f087d6609c0 20 remove_watcher() i=1 2024-09-12T17:31:55.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.939+0000 7f087d6609c0 20 remove_watcher() i=2 2024-09-12T17:31:55.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.943+0000 7f087d6609c0 20 remove_watcher() i=3 2024-09-12T17:31:55.947 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.943+0000 7f087d6609c0 20 remove_watcher() i=4 2024-09-12T17:31:55.951 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.947+0000 7f087d6609c0 20 remove_watcher() i=5 2024-09-12T17:31:55.952 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.951+0000 7f087d6609c0 20 remove_watcher() i=6 2024-09-12T17:31:55.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:31:55.951+0000 7f087d6609c0 20 remove_watcher() i=7 2024-09-12T17:31:56.254 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:31:56.254 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:31:56.520 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:31:56.520 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:31:56.710 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:31:56.710 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:31:57.304 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:31:57.304 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:31:58.062 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:31:58.062 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:31:58.325 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:31:58.325 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:31:58.467 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:31:58.467 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:31:58.541 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:31:58.541 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:31:58.716 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:31:58.716 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:31:59.080 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:31:59.081 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:31:59.183 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:31:59.183 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:31:59.363 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:31:59.363 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:31:59.432 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:31:59.432 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:31:59.646 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:31:59.646 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:31:59.715 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:31:59.715 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:31:59.862 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:31:59.862 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:31:59.931 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T17:31:59.931 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:31:59.931 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:31:59.966 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:31:59.966 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:00.011 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.007+0000 7f588eb399c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.011+0000 7f588eb399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.011+0000 7f588eb399c0 20 realm 2024-09-12T17:32:00.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.011+0000 7f588eb399c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.011+0000 7f588eb399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.011+0000 7f588eb399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:00.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.011+0000 7f588eb399c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.011+0000 7f588eb399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.011+0000 7f588eb399c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.011+0000 7f588eb399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:00.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.011+0000 7f588eb399c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.011+0000 7f588eb399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:00.016 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.011+0000 7f588eb399c0 20 searching for the correct realm 2024-09-12T17:32:00.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.019+0000 7f588be3e640 0 -- 172.21.15.98:0/3383760098 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55da868595c0 msgr2=0x55da8685b9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:00.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.023+0000 7f588c63f640 0 -- 172.21.15.98:0/3383760098 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f5880063220 msgr2=0x7f5880081900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:00.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:00.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:00.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:00.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:00.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:00.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:00.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:00.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:00.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 zone default found 2024-09-12T17:32:00.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 4 Realm: () 2024-09-12T17:32:00.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:00.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:00.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:00.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 zonegroup default 2024-09-12T17:32:00.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 started sync module instance, tier type = 2024-09-12T17:32:00.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.031+0000 7f588eb399c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:00.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.047+0000 7f588eb399c0 20 add_watcher() i=0 2024-09-12T17:32:00.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.047+0000 7f588eb399c0 20 add_watcher() i=1 2024-09-12T17:32:00.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.047+0000 7f588eb399c0 20 add_watcher() i=2 2024-09-12T17:32:00.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.047+0000 7f588eb399c0 20 add_watcher() i=3 2024-09-12T17:32:00.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.047+0000 7f588eb399c0 20 add_watcher() i=4 2024-09-12T17:32:00.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.047+0000 7f588eb399c0 20 add_watcher() i=5 2024-09-12T17:32:00.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.047+0000 7f588eb399c0 20 add_watcher() i=6 2024-09-12T17:32:00.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.047+0000 7f588eb399c0 20 add_watcher() i=7 2024-09-12T17:32:00.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.047+0000 7f588eb399c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:00.053 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f5742fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:00.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f588eb399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:00.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f588eb399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:00.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f588eb399c0 5 note: GC not initialized 2024-09-12T17:32:00.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f5741fe3640 20 reqs_thread_entry: start 2024-09-12T17:32:00.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f588eb399c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:00.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f588eb399c0 20 Filter name: none 2024-09-12T17:32:00.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f573affd640 20 reqs_thread_entry: start 2024-09-12T17:32:00.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f588eb399c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:32:00.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f588eb399c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f588eb399c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:00.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f588eb399c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:32:00.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f588eb399c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:32:00.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f588eb399c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 : miss 2024-09-12T17:32:00.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f588eb399c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f588eb399c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:00.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f588eb399c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 info.flags=0x17 2024-09-12T17:32:00.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f588eb399c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 to cache LRU end 2024-09-12T17:32:00.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f588eb399c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:00.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f588eb399c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:32:00.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f588eb399c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 2024-09-12T17:32:00.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.051+0000 7f588eb399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:00.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.055+0000 7f588eb399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:00.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.055+0000 7f588eb399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:00.058 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.055+0000 7f588eb399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:00.059 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.055+0000 7f588eb399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:00.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.059+0000 7f588eb399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:00.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.059+0000 7f588eb399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:00.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.059+0000 7f588eb399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:00.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.059+0000 7f588eb399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:00.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.059+0000 7f588eb399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:00.065 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.063+0000 7f588eb399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:00.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.071+0000 7f5742fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:00.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.075+0000 7f588eb399c0 20 remove_watcher() i=0 2024-09-12T17:32:00.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.075+0000 7f588eb399c0 2 removed watcher, disabling cache 2024-09-12T17:32:00.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.075+0000 7f588eb399c0 20 remove_watcher() i=1 2024-09-12T17:32:00.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.079+0000 7f588eb399c0 20 remove_watcher() i=2 2024-09-12T17:32:00.082 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.079+0000 7f588eb399c0 20 remove_watcher() i=3 2024-09-12T17:32:00.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.079+0000 7f588eb399c0 20 remove_watcher() i=4 2024-09-12T17:32:00.085 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.083+0000 7f588eb399c0 20 remove_watcher() i=5 2024-09-12T17:32:00.086 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.083+0000 7f588eb399c0 20 remove_watcher() i=6 2024-09-12T17:32:00.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.083+0000 7f588eb399c0 20 remove_watcher() i=7 2024-09-12T17:32:00.101 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:32:00.130 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:00.130 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:00.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.171+0000 7fdee48169c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.171+0000 7fdee48169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.175 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.171+0000 7fdee48169c0 20 realm 2024-09-12T17:32:00.175 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.171+0000 7fdee48169c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.175 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.171+0000 7fdee48169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.175 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.171+0000 7fdee48169c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:00.175 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.171+0000 7fdee48169c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.175 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.171+0000 7fdee48169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.175 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.171+0000 7fdee48169c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.176 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.175+0000 7fdee48169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:00.176 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.175+0000 7fdee48169c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.175+0000 7fdee48169c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:00.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.175+0000 7fdee48169c0 20 searching for the correct realm 2024-09-12T17:32:00.182 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.179+0000 7fdee2b1d640 0 -- 172.21.15.98:0/2543475657 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55d7926c73c0 msgr2=0x55d7926c9860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:00.188 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.187+0000 7fdee1b1b640 0 -- 172.21.15.98:0/2543475657 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fded406eb30 msgr2=0x7fded409a3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:00.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.191+0000 7fdee48169c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:00.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.191+0000 7fdee48169c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:00.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.191+0000 7fdee48169c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:00.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.191+0000 7fdee48169c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:00.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.191+0000 7fdee48169c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:00.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.191+0000 7fdee48169c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:00.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.191+0000 7fdee48169c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.195+0000 7fdee48169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.195+0000 7fdee48169c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.195+0000 7fdee48169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:00.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.195+0000 7fdee48169c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.195+0000 7fdee48169c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:00.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.195+0000 7fdee48169c0 20 zone default found 2024-09-12T17:32:00.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.195+0000 7fdee48169c0 4 Realm: () 2024-09-12T17:32:00.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.195+0000 7fdee48169c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:00.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.195+0000 7fdee48169c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:00.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.195+0000 7fdee48169c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:00.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.195+0000 7fdee48169c0 20 zonegroup default 2024-09-12T17:32:00.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.195+0000 7fdee48169c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.195+0000 7fdee48169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.195+0000 7fdee48169c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.195+0000 7fdee48169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.195+0000 7fdee48169c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.195+0000 7fdee48169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.195+0000 7fdee48169c0 20 started sync module instance, tier type = 2024-09-12T17:32:00.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.195+0000 7fdee48169c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:00.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.215+0000 7fdee48169c0 20 add_watcher() i=0 2024-09-12T17:32:00.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.215+0000 7fdee48169c0 20 add_watcher() i=1 2024-09-12T17:32:00.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.215+0000 7fdee48169c0 20 add_watcher() i=2 2024-09-12T17:32:00.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.215+0000 7fdee48169c0 20 add_watcher() i=3 2024-09-12T17:32:00.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.215+0000 7fdee48169c0 20 add_watcher() i=4 2024-09-12T17:32:00.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.215+0000 7fdee48169c0 20 add_watcher() i=5 2024-09-12T17:32:00.218 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.215+0000 7fdee48169c0 20 add_watcher() i=6 2024-09-12T17:32:00.218 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.215+0000 7fdee48169c0 20 add_watcher() i=7 2024-09-12T17:32:00.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.215+0000 7fdee48169c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:00.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.219+0000 7fdd98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:00.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.219+0000 7fdee48169c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:00.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.219+0000 7fdee48169c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:00.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.219+0000 7fdee48169c0 5 note: GC not initialized 2024-09-12T17:32:00.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.219+0000 7fdd137fe640 20 reqs_thread_entry: start 2024-09-12T17:32:00.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.219+0000 7fdee48169c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:00.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.219+0000 7fdee48169c0 20 Filter name: none 2024-09-12T17:32:00.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.219+0000 7fdd117fa640 20 reqs_thread_entry: start 2024-09-12T17:32:00.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.219+0000 7fdee48169c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.219+0000 7fdee48169c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:00.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.219+0000 7fdee48169c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.219+0000 7fdee48169c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:00.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.219+0000 7fdee48169c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:00.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.219+0000 7fdee48169c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.219+0000 7fdee48169c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:00.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.219+0000 7fdee48169c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.219+0000 7fdee48169c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:00.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.219+0000 7fdee48169c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:00.226 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.223+0000 7fdd98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:00.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.227+0000 7fdee48169c0 20 remove_watcher() i=0 2024-09-12T17:32:00.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.227+0000 7fdee48169c0 2 removed watcher, disabling cache 2024-09-12T17:32:00.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.231+0000 7fdee48169c0 20 remove_watcher() i=1 2024-09-12T17:32:00.236 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.235+0000 7fdee48169c0 20 remove_watcher() i=2 2024-09-12T17:32:00.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.235+0000 7fdee48169c0 20 remove_watcher() i=3 2024-09-12T17:32:00.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.239+0000 7fdee48169c0 20 remove_watcher() i=4 2024-09-12T17:32:00.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.239+0000 7fdee48169c0 20 remove_watcher() i=5 2024-09-12T17:32:00.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.239+0000 7fdee48169c0 20 remove_watcher() i=6 2024-09-12T17:32:00.244 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.243+0000 7fdee48169c0 20 remove_watcher() i=7 2024-09-12T17:32:00.258 INFO:tasks.workunit.client.0.smithi098.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 88, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T17:32:00.258 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T17:32:00.258 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:32:00.258 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:32:00.289 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:00.289 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:00.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.539+0000 7fe55b1a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.543+0000 7fe55b1a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.543+0000 7fe55b1a59c0 20 realm 2024-09-12T17:32:00.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.543+0000 7fe55b1a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.543+0000 7fe55b1a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.543+0000 7fe55b1a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:00.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.543+0000 7fe55b1a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.543+0000 7fe55b1a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.543+0000 7fe55b1a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.543+0000 7fe55b1a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:00.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.543+0000 7fe55b1a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.547+0000 7fe55b1a59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:00.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.547+0000 7fe55b1a59c0 20 searching for the correct realm 2024-09-12T17:32:00.553 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.551+0000 7fe5594ac640 0 -- 172.21.15.98:0/1731525674 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7fe54c015070 msgr2=0x7fe54c03c440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:00.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.555+0000 7fe558cab640 0 -- 172.21.15.98:0/1731525674 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fe54c02a910 msgr2=0x7fe54c0083e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:00.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.771+0000 7fe55b1a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:00.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.771+0000 7fe55b1a59c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:00.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.771+0000 7fe55b1a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:00.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.771+0000 7fe55b1a59c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:00.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.771+0000 7fe55b1a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:00.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.771+0000 7fe55b1a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:00.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.771+0000 7fe55b1a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.775+0000 7fe55b1a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.775+0000 7fe55b1a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.775+0000 7fe55b1a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:00.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.775+0000 7fe55b1a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.775+0000 7fe55b1a59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:00.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.775+0000 7fe55b1a59c0 20 zone default found 2024-09-12T17:32:00.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.775+0000 7fe55b1a59c0 4 Realm: () 2024-09-12T17:32:00.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.775+0000 7fe55b1a59c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:00.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.775+0000 7fe55b1a59c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:00.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.775+0000 7fe55b1a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:00.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.775+0000 7fe55b1a59c0 20 zonegroup default 2024-09-12T17:32:00.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.775+0000 7fe55b1a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.775+0000 7fe55b1a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.775+0000 7fe55b1a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.775+0000 7fe55b1a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.775+0000 7fe55b1a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.775+0000 7fe55b1a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:00.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.779+0000 7fe55b1a59c0 20 started sync module instance, tier type = 2024-09-12T17:32:00.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.779+0000 7fe55b1a59c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:00.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.803+0000 7fe55b1a59c0 20 add_watcher() i=0 2024-09-12T17:32:00.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.803+0000 7fe55b1a59c0 20 add_watcher() i=1 2024-09-12T17:32:00.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.803+0000 7fe55b1a59c0 20 add_watcher() i=2 2024-09-12T17:32:00.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.803+0000 7fe55b1a59c0 20 add_watcher() i=3 2024-09-12T17:32:00.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.803+0000 7fe55b1a59c0 20 add_watcher() i=4 2024-09-12T17:32:00.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.803+0000 7fe55b1a59c0 20 add_watcher() i=5 2024-09-12T17:32:00.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.803+0000 7fe55b1a59c0 20 add_watcher() i=6 2024-09-12T17:32:00.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.803+0000 7fe55b1a59c0 20 add_watcher() i=7 2024-09-12T17:32:00.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.803+0000 7fe55b1a59c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:00.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.807+0000 7fe40f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:00.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe55b1a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:00.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe55b1a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:00.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe55b1a59c0 5 note: GC not initialized 2024-09-12T17:32:00.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe40e7e4640 20 reqs_thread_entry: start 2024-09-12T17:32:00.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe55b1a59c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:00.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe55b1a59c0 20 Filter name: none 2024-09-12T17:32:00.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe407fff640 20 reqs_thread_entry: start 2024-09-12T17:32:00.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe55b1a59c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:32:00.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe55b1a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe55b1a59c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:00.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe55b1a59c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:32:00.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe55b1a59c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:32:00.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe55b1a59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 : miss 2024-09-12T17:32:00.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe55b1a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:00.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe55b1a59c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:00.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe55b1a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 info.flags=0x17 2024-09-12T17:32:00.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe55b1a59c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 to cache LRU end 2024-09-12T17:32:00.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe55b1a59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:00.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe55b1a59c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:32:00.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe55b1a59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 2024-09-12T17:32:00.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.811+0000 7fe55b1a59c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:00.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.815+0000 7fe55b1a59c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:32:00.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.815+0000 7fe55b1a59c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:00.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.815+0000 7fe55b1a59c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:32:00.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.815+0000 7fe55b1a59c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:00.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.815+0000 7fe55b1a59c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:32:00.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.815+0000 7fe55b1a59c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:00.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.819+0000 7fe55b1a59c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:32:00.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.819+0000 7fe55b1a59c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:00.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.819+0000 7fe55b1a59c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:32:00.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.819+0000 7fe55b1a59c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:00.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.819+0000 7fe55b1a59c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:32:00.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.819+0000 7fe55b1a59c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:00.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.819+0000 7fe55b1a59c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:32:00.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.819+0000 7fe55b1a59c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:00.824 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.819+0000 7fe55b1a59c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:32:00.824 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.819+0000 7fe55b1a59c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:00.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.823+0000 7fe55b1a59c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:32:00.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.823+0000 7fe55b1a59c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:00.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.823+0000 7fe55b1a59c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:32:00.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.823+0000 7fe55b1a59c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:00.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.823+0000 7fe55b1a59c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:32:00.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.823+0000 7fe55b1a59c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:32:00.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.827+0000 7fe40f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:00.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.831+0000 7fe55b1a59c0 20 remove_watcher() i=0 2024-09-12T17:32:00.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.831+0000 7fe55b1a59c0 2 removed watcher, disabling cache 2024-09-12T17:32:00.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.835+0000 7fe55b1a59c0 20 remove_watcher() i=1 2024-09-12T17:32:00.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.835+0000 7fe55b1a59c0 20 remove_watcher() i=2 2024-09-12T17:32:00.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.839+0000 7fe55b1a59c0 20 remove_watcher() i=3 2024-09-12T17:32:00.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.843+0000 7fe55b1a59c0 20 remove_watcher() i=4 2024-09-12T17:32:00.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.843+0000 7fe55b1a59c0 20 remove_watcher() i=5 2024-09-12T17:32:00.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.843+0000 7fe55b1a59c0 20 remove_watcher() i=6 2024-09-12T17:32:00.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:00.847+0000 7fe55b1a59c0 20 remove_watcher() i=7 2024-09-12T17:32:00.870 INFO:tasks.workunit.client.0.smithi098.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:32:01.308 INFO:tasks.workunit.client.0.smithi098.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:32:02.750 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:02.958 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:02.959 INFO:tasks.workunit.client.0.smithi098.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:32:02.959 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:32:02.993 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:02.993 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:03.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.035+0000 7fd4fe3a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.035+0000 7fd4fe3a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.035+0000 7fd4fe3a89c0 20 realm 2024-09-12T17:32:03.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.035+0000 7fd4fe3a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.035+0000 7fd4fe3a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.035+0000 7fd4fe3a89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:03.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.035+0000 7fd4fe3a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.039+0000 7fd4fe3a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.039+0000 7fd4fe3a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.039+0000 7fd4fe3a89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:03.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.039+0000 7fd4fe3a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.039+0000 7fd4fe3a89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:03.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.039+0000 7fd4fe3a89c0 20 searching for the correct realm 2024-09-12T17:32:03.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.043+0000 7fd4fb6ad640 0 -- 172.21.15.98:0/1774244457 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x5647865ec3e0 msgr2=0x5647865ee7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:03.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.051+0000 7fd4fbeae640 0 -- 172.21.15.98:0/1774244457 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fd4f00feba0 msgr2=0x7fd4f00c05c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:03.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:03.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:03.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:03.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:03.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:03.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:03.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:03.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:03.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 zone default found 2024-09-12T17:32:03.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 4 Realm: () 2024-09-12T17:32:03.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:03.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:03.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:03.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 zonegroup default 2024-09-12T17:32:03.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 started sync module instance, tier type = 2024-09-12T17:32:03.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.059+0000 7fd4fe3a89c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:03.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.079+0000 7fd4fe3a89c0 20 add_watcher() i=0 2024-09-12T17:32:03.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.079+0000 7fd4fe3a89c0 20 add_watcher() i=1 2024-09-12T17:32:03.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.079+0000 7fd4fe3a89c0 20 add_watcher() i=2 2024-09-12T17:32:03.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.079+0000 7fd4fe3a89c0 20 add_watcher() i=3 2024-09-12T17:32:03.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.079+0000 7fd4fe3a89c0 20 add_watcher() i=4 2024-09-12T17:32:03.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.079+0000 7fd4fe3a89c0 20 add_watcher() i=5 2024-09-12T17:32:03.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.079+0000 7fd4fe3a89c0 20 add_watcher() i=6 2024-09-12T17:32:03.084 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.079+0000 7fd4fe3a89c0 20 add_watcher() i=7 2024-09-12T17:32:03.084 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.079+0000 7fd4fe3a89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:03.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.083+0000 7fd3b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:03.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.083+0000 7fd4fe3a89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:03.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.083+0000 7fd4fe3a89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:03.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.083+0000 7fd4fe3a89c0 5 note: GC not initialized 2024-09-12T17:32:03.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.083+0000 7fd3b0fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:03.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.083+0000 7fd4fe3a89c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:03.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.083+0000 7fd4fe3a89c0 20 Filter name: none 2024-09-12T17:32:03.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.083+0000 7fd32a7fc640 20 reqs_thread_entry: start 2024-09-12T17:32:03.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.083+0000 7fd4fe3a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.087+0000 7fd4fe3a89c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:03.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.087+0000 7fd4fe3a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.087+0000 7fd4fe3a89c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:03.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.087+0000 7fd4fe3a89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:03.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.087+0000 7fd4fe3a89c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:32:03.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.087+0000 7fd4fe3a89c0 20 INFO: main: starting shard=0 2024-09-12T17:32:03.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.087+0000 7fd4fe3a89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:03.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.087+0000 7fd4fe3a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.087+0000 7fd4fe3a89c0 20 INFO: main: starting shard=1 2024-09-12T17:32:03.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.087+0000 7fd4fe3a89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:03.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.087+0000 7fd4fe3a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.087+0000 7fd4fe3a89c0 20 INFO: main: starting shard=2 2024-09-12T17:32:03.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.087+0000 7fd4fe3a89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:03.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.091+0000 7fd4fe3a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.091+0000 7fd4fe3a89c0 20 INFO: main: starting shard=3 2024-09-12T17:32:03.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.091+0000 7fd4fe3a89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:03.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.091+0000 7fd4fe3a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.091+0000 7fd4fe3a89c0 20 INFO: main: starting shard=4 2024-09-12T17:32:03.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.091+0000 7fd4fe3a89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:03.095 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.091+0000 7fd4fe3a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.095 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.091+0000 7fd4fe3a89c0 20 INFO: main: starting shard=5 2024-09-12T17:32:03.095 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.091+0000 7fd4fe3a89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:03.095 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.091+0000 7fd4fe3a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.095 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.091+0000 7fd4fe3a89c0 20 INFO: main: starting shard=6 2024-09-12T17:32:03.096 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.091+0000 7fd4fe3a89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:03.096 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.095+0000 7fd4fe3a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.096 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.095+0000 7fd4fe3a89c0 20 INFO: main: starting shard=7 2024-09-12T17:32:03.096 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.095+0000 7fd4fe3a89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:03.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.095+0000 7fd4fe3a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.095+0000 7fd4fe3a89c0 20 INFO: main: starting shard=8 2024-09-12T17:32:03.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.095+0000 7fd4fe3a89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:03.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.095+0000 7fd4fe3a89c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:32:03.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.095+0000 7fd4fe3a89c0 20 INFO: main: starting shard=9 2024-09-12T17:32:03.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.095+0000 7fd4fe3a89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:03.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.095+0000 7fd4fe3a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.095+0000 7fd4fe3a89c0 20 INFO: main: starting shard=10 2024-09-12T17:32:03.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.095+0000 7fd4fe3a89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:03.100 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.099+0000 7fd4fe3a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.101 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.099+0000 7fd4fe3a89c0 20 INFO: main: done 2024-09-12T17:32:03.101 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.099+0000 7fd3b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:03.106 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.103+0000 7fd4fe3a89c0 20 remove_watcher() i=0 2024-09-12T17:32:03.107 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.103+0000 7fd4fe3a89c0 2 removed watcher, disabling cache 2024-09-12T17:32:03.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.107+0000 7fd4fe3a89c0 20 remove_watcher() i=1 2024-09-12T17:32:03.111 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.107+0000 7fd4fe3a89c0 20 remove_watcher() i=2 2024-09-12T17:32:03.113 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.111+0000 7fd4fe3a89c0 20 remove_watcher() i=3 2024-09-12T17:32:03.115 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.111+0000 7fd4fe3a89c0 20 remove_watcher() i=4 2024-09-12T17:32:03.116 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.115+0000 7fd4fe3a89c0 20 remove_watcher() i=5 2024-09-12T17:32:03.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.115+0000 7fd4fe3a89c0 20 remove_watcher() i=6 2024-09-12T17:32:03.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.115+0000 7fd4fe3a89c0 20 remove_watcher() i=7 2024-09-12T17:32:03.135 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:03.135 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:03.163 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:03.163 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:03.197 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:03.197 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:03.337 INFO:tasks.workunit.client.0.smithi098.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:32:03.338 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:32:03.373 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:03.373 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:03.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.415+0000 7f6accf469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.420 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.419+0000 7f6accf469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.419+0000 7f6accf469c0 20 realm 2024-09-12T17:32:03.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.419+0000 7f6accf469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.419+0000 7f6accf469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.419+0000 7f6accf469c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:03.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.419+0000 7f6accf469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.419+0000 7f6accf469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.419+0000 7f6accf469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.419+0000 7f6accf469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:03.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.419+0000 7f6accf469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.419+0000 7f6accf469c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:03.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.419+0000 7f6accf469c0 20 searching for the correct realm 2024-09-12T17:32:03.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.423+0000 7f6acaa4c640 0 -- 172.21.15.98:0/1386906506 >> [v2:172.21.15.98:6816/1225764258,v1:172.21.15.98:6817/1225764258] conn(0x7f6ab4003ac0 msgr2=0x7f6ac405dc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:03.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.431+0000 7f6acaa4c640 0 -- 172.21.15.98:0/1386906506 >> [v2:172.21.15.98:6816/1225764258,v1:172.21.15.98:6817/1225764258] conn(0x7f699407e6c0 msgr2=0x7f6994080af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:03.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.439+0000 7f6accf469c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:03.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.439+0000 7f6accf469c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:03.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.439+0000 7f6accf469c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:03.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.439+0000 7f6accf469c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:03.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.439+0000 7f6accf469c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:03.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.439+0000 7f6accf469c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:03.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.439+0000 7f6accf469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.439+0000 7f6accf469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.439+0000 7f6accf469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.443+0000 7f6accf469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:03.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.443+0000 7f6accf469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.443+0000 7f6accf469c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:03.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.443+0000 7f6accf469c0 20 zone default found 2024-09-12T17:32:03.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.443+0000 7f6accf469c0 4 Realm: () 2024-09-12T17:32:03.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.443+0000 7f6accf469c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:03.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.443+0000 7f6accf469c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:03.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.443+0000 7f6accf469c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:03.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.443+0000 7f6accf469c0 20 zonegroup default 2024-09-12T17:32:03.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.443+0000 7f6accf469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.443+0000 7f6accf469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.443+0000 7f6accf469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.443+0000 7f6accf469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.443+0000 7f6accf469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.443+0000 7f6accf469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.443+0000 7f6accf469c0 20 started sync module instance, tier type = 2024-09-12T17:32:03.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.443+0000 7f6accf469c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:03.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.463+0000 7f6accf469c0 20 add_watcher() i=0 2024-09-12T17:32:03.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.463+0000 7f6accf469c0 20 add_watcher() i=1 2024-09-12T17:32:03.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.463+0000 7f6accf469c0 20 add_watcher() i=2 2024-09-12T17:32:03.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.463+0000 7f6accf469c0 20 add_watcher() i=3 2024-09-12T17:32:03.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.463+0000 7f6accf469c0 20 add_watcher() i=4 2024-09-12T17:32:03.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.463+0000 7f6accf469c0 20 add_watcher() i=5 2024-09-12T17:32:03.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.463+0000 7f6accf469c0 20 add_watcher() i=6 2024-09-12T17:32:03.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.463+0000 7f6accf469c0 20 add_watcher() i=7 2024-09-12T17:32:03.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.463+0000 7f6accf469c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:03.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.463+0000 7f6981fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:03.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.467+0000 7f6accf469c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:03.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.467+0000 7f6accf469c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:03.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.467+0000 7f6accf469c0 5 note: GC not initialized 2024-09-12T17:32:03.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.467+0000 7f6980fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:03.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.467+0000 7f6accf469c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:03.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.467+0000 7f6accf469c0 20 Filter name: none 2024-09-12T17:32:03.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.467+0000 7f6979ffb640 20 reqs_thread_entry: start 2024-09-12T17:32:03.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.467+0000 7f6accf469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.467+0000 7f6accf469c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:03.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.467+0000 7f6accf469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.467+0000 7f6accf469c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:03.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.467+0000 7f6accf469c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:03.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.467+0000 7f6accf469c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:32:03.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.467+0000 7f6accf469c0 20 INFO: main: starting shard=0 2024-09-12T17:32:03.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.467+0000 7f6accf469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:03.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.467+0000 7f6accf469c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.467+0000 7f6accf469c0 20 INFO: main: starting shard=1 2024-09-12T17:32:03.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.467+0000 7f6accf469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:03.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.471+0000 7f6accf469c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.471+0000 7f6accf469c0 20 INFO: main: starting shard=2 2024-09-12T17:32:03.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.471+0000 7f6accf469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:03.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.471+0000 7f6accf469c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.471+0000 7f6accf469c0 20 INFO: main: starting shard=3 2024-09-12T17:32:03.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.471+0000 7f6accf469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:03.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.471+0000 7f6accf469c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.471+0000 7f6accf469c0 20 INFO: main: starting shard=4 2024-09-12T17:32:03.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.471+0000 7f6accf469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:03.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.471+0000 7f6accf469c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.471+0000 7f6accf469c0 20 INFO: main: starting shard=5 2024-09-12T17:32:03.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.471+0000 7f6accf469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:03.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.475+0000 7f6accf469c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:32:03.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.475+0000 7f6accf469c0 20 INFO: main: starting shard=6 2024-09-12T17:32:03.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.475+0000 7f6accf469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:03.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.475+0000 7f6accf469c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.475+0000 7f6accf469c0 20 INFO: main: starting shard=7 2024-09-12T17:32:03.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.475+0000 7f6accf469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:03.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.475+0000 7f6accf469c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.475+0000 7f6accf469c0 20 INFO: main: starting shard=8 2024-09-12T17:32:03.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.475+0000 7f6accf469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:03.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.475+0000 7f6accf469c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.475+0000 7f6accf469c0 20 INFO: main: starting shard=9 2024-09-12T17:32:03.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.475+0000 7f6accf469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:03.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.475+0000 7f6accf469c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.480 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.475+0000 7f6accf469c0 20 INFO: main: starting shard=10 2024-09-12T17:32:03.480 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.475+0000 7f6accf469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:03.481 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.479+0000 7f6accf469c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.481 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.479+0000 7f6accf469c0 20 INFO: main: done 2024-09-12T17:32:03.482 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.479+0000 7f6981fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:03.487 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.483+0000 7f6accf469c0 20 remove_watcher() i=0 2024-09-12T17:32:03.487 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.483+0000 7f6accf469c0 2 removed watcher, disabling cache 2024-09-12T17:32:03.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.487+0000 7f6accf469c0 20 remove_watcher() i=1 2024-09-12T17:32:03.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.491+0000 7f6accf469c0 20 remove_watcher() i=2 2024-09-12T17:32:03.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.491+0000 7f6accf469c0 20 remove_watcher() i=3 2024-09-12T17:32:03.496 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.495+0000 7f6accf469c0 20 remove_watcher() i=4 2024-09-12T17:32:03.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.495+0000 7f6accf469c0 20 remove_watcher() i=5 2024-09-12T17:32:03.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.495+0000 7f6accf469c0 20 remove_watcher() i=6 2024-09-12T17:32:03.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.499+0000 7f6accf469c0 20 remove_watcher() i=7 2024-09-12T17:32:03.515 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:03.515 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:03.542 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:03.542 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:03.701 INFO:tasks.workunit.client.0.smithi098.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:32:03.701 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:32:03.737 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:03.737 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:03.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.779+0000 7f0fd87ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.779+0000 7f0fd87ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.779+0000 7f0fd87ed9c0 20 realm 2024-09-12T17:32:03.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.779+0000 7f0fd87ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.779+0000 7f0fd87ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.779+0000 7f0fd87ed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:03.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.779+0000 7f0fd87ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.779+0000 7f0fd87ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.779+0000 7f0fd87ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.783+0000 7f0fd87ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:03.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.783+0000 7f0fd87ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.783+0000 7f0fd87ed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:03.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.783+0000 7f0fd87ed9c0 20 searching for the correct realm 2024-09-12T17:32:03.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.787+0000 7f0fd5af2640 0 -- 172.21.15.98:0/1421807177 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x5622b3b1eb90 msgr2=0x5622b3b20ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:03.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.795+0000 7f0fd5af2640 0 -- 172.21.15.98:0/1421807177 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f0fc80ce040 msgr2=0x7f0fc80b7030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:03.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:03.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:03.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:03.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:03.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:03.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:03.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:03.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:03.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 20 zone default found 2024-09-12T17:32:03.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 4 Realm: () 2024-09-12T17:32:03.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:03.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:03.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:03.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 20 zonegroup default 2024-09-12T17:32:03.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.803+0000 7f0fd87ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.807+0000 7f0fd87ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.807+0000 7f0fd87ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.807+0000 7f0fd87ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:03.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.807+0000 7f0fd87ed9c0 20 started sync module instance, tier type = 2024-09-12T17:32:03.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.807+0000 7f0fd87ed9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:03.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.827+0000 7f0fd87ed9c0 20 add_watcher() i=0 2024-09-12T17:32:03.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.827+0000 7f0fd87ed9c0 20 add_watcher() i=1 2024-09-12T17:32:03.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.827+0000 7f0fd87ed9c0 20 add_watcher() i=2 2024-09-12T17:32:03.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.827+0000 7f0fd87ed9c0 20 add_watcher() i=3 2024-09-12T17:32:03.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.827+0000 7f0fd87ed9c0 20 add_watcher() i=4 2024-09-12T17:32:03.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.827+0000 7f0fd87ed9c0 20 add_watcher() i=5 2024-09-12T17:32:03.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.827+0000 7f0fd87ed9c0 20 add_watcher() i=6 2024-09-12T17:32:03.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.827+0000 7f0fd87ed9c0 20 add_watcher() i=7 2024-09-12T17:32:03.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.827+0000 7f0fd87ed9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:03.835 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.831+0000 7f0e8d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:03.836 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.831+0000 7f0fd87ed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:03.836 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.831+0000 7f0fd87ed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:03.836 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.831+0000 7f0fd87ed9c0 5 note: GC not initialized 2024-09-12T17:32:03.836 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.831+0000 7f0e877fe640 20 reqs_thread_entry: start 2024-09-12T17:32:03.836 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.831+0000 7f0fd87ed9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:03.836 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.831+0000 7f0fd87ed9c0 20 Filter name: none 2024-09-12T17:32:03.836 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.835+0000 7f0e857fa640 20 reqs_thread_entry: start 2024-09-12T17:32:03.836 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.835+0000 7f0fd87ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.835+0000 7f0fd87ed9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:03.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.835+0000 7f0fd87ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:03.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.835+0000 7f0fd87ed9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:03.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.835+0000 7f0fd87ed9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:03.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.835+0000 7f0fd87ed9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:32:03.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.835+0000 7f0fd87ed9c0 20 INFO: main: starting shard=0 2024-09-12T17:32:03.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.835+0000 7f0fd87ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:03.838 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.835+0000 7f0fd87ed9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.838 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.835+0000 7f0fd87ed9c0 20 INFO: main: starting shard=1 2024-09-12T17:32:03.838 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.835+0000 7f0fd87ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:03.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.839+0000 7f0fd87ed9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:32:03.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.839+0000 7f0fd87ed9c0 20 INFO: main: starting shard=2 2024-09-12T17:32:03.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.839+0000 7f0fd87ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:03.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.839+0000 7f0fd87ed9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.839+0000 7f0fd87ed9c0 20 INFO: main: starting shard=3 2024-09-12T17:32:03.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.839+0000 7f0fd87ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:03.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.839+0000 7f0fd87ed9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.839+0000 7f0fd87ed9c0 20 INFO: main: starting shard=4 2024-09-12T17:32:03.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.839+0000 7f0fd87ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:03.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.839+0000 7f0fd87ed9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.839+0000 7f0fd87ed9c0 20 INFO: main: starting shard=5 2024-09-12T17:32:03.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.839+0000 7f0fd87ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:03.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.843+0000 7f0fd87ed9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.843+0000 7f0fd87ed9c0 20 INFO: main: starting shard=6 2024-09-12T17:32:03.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.843+0000 7f0fd87ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:03.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.843+0000 7f0fd87ed9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.843+0000 7f0fd87ed9c0 20 INFO: main: starting shard=7 2024-09-12T17:32:03.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.843+0000 7f0fd87ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:03.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.843+0000 7f0fd87ed9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.843+0000 7f0fd87ed9c0 20 INFO: main: starting shard=8 2024-09-12T17:32:03.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.843+0000 7f0fd87ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:03.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.843+0000 7f0fd87ed9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.843+0000 7f0fd87ed9c0 20 INFO: main: starting shard=9 2024-09-12T17:32:03.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.843+0000 7f0fd87ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:03.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.843+0000 7f0fd87ed9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.843+0000 7f0fd87ed9c0 20 INFO: main: starting shard=10 2024-09-12T17:32:03.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.843+0000 7f0fd87ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:03.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.847+0000 7f0fd87ed9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:03.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.847+0000 7f0fd87ed9c0 20 INFO: main: done 2024-09-12T17:32:03.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.847+0000 7f0e8d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:03.855 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.851+0000 7f0fd87ed9c0 20 remove_watcher() i=0 2024-09-12T17:32:03.855 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.851+0000 7f0fd87ed9c0 2 removed watcher, disabling cache 2024-09-12T17:32:03.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.855+0000 7f0fd87ed9c0 20 remove_watcher() i=1 2024-09-12T17:32:03.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.855+0000 7f0fd87ed9c0 20 remove_watcher() i=2 2024-09-12T17:32:03.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.859+0000 7f0fd87ed9c0 20 remove_watcher() i=3 2024-09-12T17:32:03.864 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.859+0000 7f0fd87ed9c0 20 remove_watcher() i=4 2024-09-12T17:32:03.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.863+0000 7f0fd87ed9c0 20 remove_watcher() i=5 2024-09-12T17:32:03.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.863+0000 7f0fd87ed9c0 20 remove_watcher() i=6 2024-09-12T17:32:03.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:03.867+0000 7f0fd87ed9c0 20 remove_watcher() i=7 2024-09-12T17:32:03.885 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:03.885 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:03.912 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:03.912 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:04.025 INFO:tasks.workunit.client.0.smithi098.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:32:04.025 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:32:04.061 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:04.061 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:04.106 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.103+0000 7ff1c182d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.107 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.103+0000 7ff1c182d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:04.107 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.103+0000 7ff1c182d9c0 20 realm 2024-09-12T17:32:04.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.103+0000 7ff1c182d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.107+0000 7ff1c182d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:04.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.107+0000 7ff1c182d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:04.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.107+0000 7ff1c182d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.107+0000 7ff1c182d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:04.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.107+0000 7ff1c182d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.110 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.107+0000 7ff1c182d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:04.110 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.107+0000 7ff1c182d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.110 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.107+0000 7ff1c182d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:04.111 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.107+0000 7ff1c182d9c0 20 searching for the correct realm 2024-09-12T17:32:04.116 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.115+0000 7ff1bfb34640 0 -- 172.21.15.98:0/2113044659 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x5583b9c6c6f0 msgr2=0x5583b9c6eb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:04.123 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.119+0000 7ff1beb32640 0 -- 172.21.15.98:0/2113044659 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7ff1b0018070 msgr2=0x7ff1b0002a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:04.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.127+0000 7ff1c182d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:04.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.127+0000 7ff1c182d9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:04.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.127+0000 7ff1c182d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:04.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.127+0000 7ff1c182d9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:04.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.127+0000 7ff1c182d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:04.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.127+0000 7ff1c182d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:04.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.127+0000 7ff1c182d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.127+0000 7ff1c182d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:04.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.127+0000 7ff1c182d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.127+0000 7ff1c182d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:04.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.127+0000 7ff1c182d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.127+0000 7ff1c182d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:04.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.127+0000 7ff1c182d9c0 20 zone default found 2024-09-12T17:32:04.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.127+0000 7ff1c182d9c0 4 Realm: () 2024-09-12T17:32:04.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.127+0000 7ff1c182d9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:04.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.127+0000 7ff1c182d9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:04.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.127+0000 7ff1c182d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:04.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.127+0000 7ff1c182d9c0 20 zonegroup default 2024-09-12T17:32:04.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.127+0000 7ff1c182d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.131+0000 7ff1c182d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:04.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.131+0000 7ff1c182d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.131+0000 7ff1c182d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:04.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.131+0000 7ff1c182d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.131+0000 7ff1c182d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:04.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.131+0000 7ff1c182d9c0 20 started sync module instance, tier type = 2024-09-12T17:32:04.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.131+0000 7ff1c182d9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:04.154 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.151+0000 7ff1c182d9c0 20 add_watcher() i=0 2024-09-12T17:32:04.154 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.151+0000 7ff1c182d9c0 20 add_watcher() i=1 2024-09-12T17:32:04.154 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.151+0000 7ff1c182d9c0 20 add_watcher() i=2 2024-09-12T17:32:04.154 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.151+0000 7ff1c182d9c0 20 add_watcher() i=3 2024-09-12T17:32:04.154 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.151+0000 7ff1c182d9c0 20 add_watcher() i=4 2024-09-12T17:32:04.155 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.151+0000 7ff1c182d9c0 20 add_watcher() i=5 2024-09-12T17:32:04.155 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.151+0000 7ff1c182d9c0 20 add_watcher() i=6 2024-09-12T17:32:04.156 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.155+0000 7ff1c182d9c0 20 add_watcher() i=7 2024-09-12T17:32:04.156 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.155+0000 7ff1c182d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:04.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.155+0000 7ff075fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:04.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.155+0000 7ff1c182d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:04.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.155+0000 7ff1c182d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:04.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.155+0000 7ff1c182d9c0 5 note: GC not initialized 2024-09-12T17:32:04.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.155+0000 7ff074fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:04.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.159+0000 7ff1c182d9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:04.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.159+0000 7ff1c182d9c0 20 Filter name: none 2024-09-12T17:32:04.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.159+0000 7fefee7fc640 20 reqs_thread_entry: start 2024-09-12T17:32:04.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.159+0000 7ff1c182d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.159+0000 7ff1c182d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:04.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.159+0000 7ff1c182d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:04.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.159+0000 7ff1c182d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:04.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.159+0000 7ff1c182d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:04.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.159+0000 7ff1c182d9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:32:04.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.159+0000 7ff1c182d9c0 20 INFO: main: starting shard=0 2024-09-12T17:32:04.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.159+0000 7ff1c182d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:04.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.159+0000 7ff1c182d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:04.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.159+0000 7ff1c182d9c0 20 INFO: main: starting shard=1 2024-09-12T17:32:04.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.159+0000 7ff1c182d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:04.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.159+0000 7ff1c182d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:04.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.159+0000 7ff1c182d9c0 20 INFO: main: starting shard=2 2024-09-12T17:32:04.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.159+0000 7ff1c182d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:04.165 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.163+0000 7ff1c182d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:04.165 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.163+0000 7ff1c182d9c0 20 INFO: main: starting shard=3 2024-09-12T17:32:04.165 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.163+0000 7ff1c182d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:04.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.163+0000 7ff1c182d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:04.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.163+0000 7ff1c182d9c0 20 INFO: main: starting shard=4 2024-09-12T17:32:04.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.163+0000 7ff1c182d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:04.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.163+0000 7ff1c182d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:04.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.163+0000 7ff1c182d9c0 20 INFO: main: starting shard=5 2024-09-12T17:32:04.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.163+0000 7ff1c182d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:04.168 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.167+0000 7ff1c182d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:04.168 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.167+0000 7ff1c182d9c0 20 INFO: main: starting shard=6 2024-09-12T17:32:04.168 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.167+0000 7ff1c182d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:04.168 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.167+0000 7ff1c182d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:04.169 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.167+0000 7ff1c182d9c0 20 INFO: main: starting shard=7 2024-09-12T17:32:04.169 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.167+0000 7ff1c182d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:04.169 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.167+0000 7ff1c182d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:04.169 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.167+0000 7ff1c182d9c0 20 INFO: main: starting shard=8 2024-09-12T17:32:04.169 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.167+0000 7ff1c182d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:04.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.167+0000 7ff1c182d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:04.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.167+0000 7ff1c182d9c0 20 INFO: main: starting shard=9 2024-09-12T17:32:04.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.167+0000 7ff1c182d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:04.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.167+0000 7ff1c182d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:04.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.167+0000 7ff1c182d9c0 20 INFO: main: starting shard=10 2024-09-12T17:32:04.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.167+0000 7ff1c182d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:04.173 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.171+0000 7ff1c182d9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:32:04.173 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.171+0000 7ff1c182d9c0 20 INFO: main: done 2024-09-12T17:32:04.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.171+0000 7ff075fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:04.180 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.175+0000 7ff1c182d9c0 20 remove_watcher() i=0 2024-09-12T17:32:04.180 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.175+0000 7ff1c182d9c0 2 removed watcher, disabling cache 2024-09-12T17:32:04.182 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.179+0000 7ff1c182d9c0 20 remove_watcher() i=1 2024-09-12T17:32:04.184 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.183+0000 7ff1c182d9c0 20 remove_watcher() i=2 2024-09-12T17:32:04.186 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.183+0000 7ff1c182d9c0 20 remove_watcher() i=3 2024-09-12T17:32:04.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.187+0000 7ff1c182d9c0 20 remove_watcher() i=4 2024-09-12T17:32:04.190 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.187+0000 7ff1c182d9c0 20 remove_watcher() i=5 2024-09-12T17:32:04.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.191+0000 7ff1c182d9c0 20 remove_watcher() i=6 2024-09-12T17:32:04.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:04.191+0000 7ff1c182d9c0 20 remove_watcher() i=7 2024-09-12T17:32:04.210 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:04.210 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:04.236 INFO:tasks.workunit.client.0.smithi098.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:32:04.663 INFO:tasks.workunit.client.0.smithi098.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:32:05.090 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T17:32:05.090 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:32:05.090 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:32:05.125 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:05.125 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:05.168 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.167+0000 7f81684849c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.167+0000 7f81684849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.167+0000 7f81684849c0 20 realm 2024-09-12T17:32:05.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.167+0000 7f81684849c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.167+0000 7f81684849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.167+0000 7f81684849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:05.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.167+0000 7f81684849c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.167+0000 7f81684849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.167+0000 7f81684849c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.167+0000 7f81684849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:05.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.167+0000 7f81684849c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.167+0000 7f81684849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:05.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.167+0000 7f81684849c0 20 searching for the correct realm 2024-09-12T17:32:05.176 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.175+0000 7f816678b640 0 -- 172.21.15.98:0/3372539969 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f8150040060 msgr2=0x7f8150065fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:05.182 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.179+0000 7f8165f8a640 0 -- 172.21.15.98:0/3372539969 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f8150067540 msgr2=0x7f81500369b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:05.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.395+0000 7f81684849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:05.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.395+0000 7f81684849c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:05.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.395+0000 7f81684849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:05.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.395+0000 7f81684849c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:05.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.395+0000 7f81684849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:05.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.395+0000 7f81684849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:05.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.395+0000 7f81684849c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.395+0000 7f81684849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.395+0000 7f81684849c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.399+0000 7f81684849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:05.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.399+0000 7f81684849c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.399+0000 7f81684849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:05.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.399+0000 7f81684849c0 20 zone default found 2024-09-12T17:32:05.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.399+0000 7f81684849c0 4 Realm: () 2024-09-12T17:32:05.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.399+0000 7f81684849c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:05.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.399+0000 7f81684849c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:05.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.399+0000 7f81684849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:05.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.399+0000 7f81684849c0 20 zonegroup default 2024-09-12T17:32:05.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.399+0000 7f81684849c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.399+0000 7f81684849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.399+0000 7f81684849c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.399+0000 7f81684849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.399+0000 7f81684849c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.399+0000 7f81684849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.399+0000 7f81684849c0 20 started sync module instance, tier type = 2024-09-12T17:32:05.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.399+0000 7f81684849c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:05.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.427+0000 7f81684849c0 20 add_watcher() i=0 2024-09-12T17:32:05.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.427+0000 7f81684849c0 20 add_watcher() i=1 2024-09-12T17:32:05.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.427+0000 7f81684849c0 20 add_watcher() i=2 2024-09-12T17:32:05.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.427+0000 7f81684849c0 20 add_watcher() i=3 2024-09-12T17:32:05.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.427+0000 7f81684849c0 20 add_watcher() i=4 2024-09-12T17:32:05.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.427+0000 7f81684849c0 20 add_watcher() i=5 2024-09-12T17:32:05.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.427+0000 7f81684849c0 20 add_watcher() i=6 2024-09-12T17:32:05.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.427+0000 7f81684849c0 20 add_watcher() i=7 2024-09-12T17:32:05.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.427+0000 7f81684849c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:05.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.431+0000 7f801bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:05.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f81684849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:05.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f81684849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:05.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f81684849c0 5 note: GC not initialized 2024-09-12T17:32:05.437 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f801afe5640 20 reqs_thread_entry: start 2024-09-12T17:32:05.437 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f81684849c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:05.437 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f81684849c0 20 Filter name: none 2024-09-12T17:32:05.437 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f8018fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:05.437 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f81684849c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:32:05.437 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f81684849c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f81684849c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:05.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f81684849c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:32:05.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f81684849c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:32:05.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f81684849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 : miss 2024-09-12T17:32:05.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f81684849c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f81684849c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:05.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f81684849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 info.flags=0x17 2024-09-12T17:32:05.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f81684849c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 to cache LRU end 2024-09-12T17:32:05.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f81684849c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:05.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f81684849c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:32:05.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f81684849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 2024-09-12T17:32:05.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.435+0000 7f81684849c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:05.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.439+0000 7f81684849c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:32:05.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.439+0000 7f81684849c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:05.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.439+0000 7f81684849c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:05.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.439+0000 7f81684849c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:32:05.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.439+0000 7f81684849c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:05.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.439+0000 7f81684849c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:32:05.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.439+0000 7f81684849c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:05.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.443+0000 7f81684849c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:32:05.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.443+0000 7f81684849c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:05.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.443+0000 7f81684849c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:05.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.443+0000 7f81684849c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:32:05.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.443+0000 7f81684849c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:05.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.443+0000 7f81684849c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:32:05.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.443+0000 7f81684849c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:05.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.443+0000 7f81684849c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:05.449 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.447+0000 7f81684849c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:32:05.449 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.447+0000 7f81684849c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:05.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.447+0000 7f81684849c0 1 NOTICE: finished shard 1 (1 entries found) 2024-09-12T17:32:05.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.447+0000 7f81684849c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T17:32:05.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.447+0000 7f81684849c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T17:32:05.451 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.447+0000 7f81684849c0 1 NOTICE: finished shard 10 (1 entries found) 2024-09-12T17:32:05.451 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.447+0000 7f81684849c0 1 NOTICE: finished all shards (4 entries found) 2024-09-12T17:32:05.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.451+0000 7f801bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:05.458 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.455+0000 7f81684849c0 20 remove_watcher() i=0 2024-09-12T17:32:05.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.455+0000 7f81684849c0 2 removed watcher, disabling cache 2024-09-12T17:32:05.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.459+0000 7f81684849c0 20 remove_watcher() i=1 2024-09-12T17:32:05.463 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.459+0000 7f81684849c0 20 remove_watcher() i=2 2024-09-12T17:32:05.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.463+0000 7f81684849c0 20 remove_watcher() i=3 2024-09-12T17:32:05.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.467+0000 7f81684849c0 20 remove_watcher() i=4 2024-09-12T17:32:05.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.467+0000 7f81684849c0 20 remove_watcher() i=5 2024-09-12T17:32:05.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.467+0000 7f81684849c0 20 remove_watcher() i=6 2024-09-12T17:32:05.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.471+0000 7f81684849c0 20 remove_watcher() i=7 2024-09-12T17:32:05.488 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: unlinked entries are not listable 2024-09-12T17:32:05.488 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:32:05.491 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:05.492 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:05.652 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T17:32:05.653 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:32:05.658 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:05.658 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:05.758 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:05.758 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:05.861 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T17:32:05.861 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:32:05.862 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:32:05.903 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:05.903 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:05.948 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.943+0000 7f133e3579c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.947+0000 7f133e3579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.947+0000 7f133e3579c0 20 realm 2024-09-12T17:32:05.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.947+0000 7f133e3579c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.947+0000 7f133e3579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.947+0000 7f133e3579c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:05.951 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.947+0000 7f133e3579c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.951 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.947+0000 7f133e3579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:05.951 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.947+0000 7f133e3579c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.952 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.947+0000 7f133e3579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:05.952 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.947+0000 7f133e3579c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:05.952 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.947+0000 7f133e3579c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:05.953 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.947+0000 7f133e3579c0 20 searching for the correct realm 2024-09-12T17:32:05.957 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.955+0000 7f133c65e640 0 -- 172.21.15.98:0/2751001507 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f133002e960 msgr2=0x7f1330030410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:05.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:05.959+0000 7f133be5d640 0 -- 172.21.15.98:0/2751001507 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f1330045960 msgr2=0x7f13300203d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:06.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.175+0000 7f133e3579c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:06.182 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.175+0000 7f133e3579c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:06.182 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.175+0000 7f133e3579c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:06.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.175+0000 7f133e3579c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:06.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.175+0000 7f133e3579c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:06.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.175+0000 7f133e3579c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:06.184 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.175+0000 7f133e3579c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.184 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.175+0000 7f133e3579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:06.184 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.175+0000 7f133e3579c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.185 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.179+0000 7f133e3579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:06.185 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.179+0000 7f133e3579c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.188 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.179+0000 7f133e3579c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:06.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.179+0000 7f133e3579c0 20 zone default found 2024-09-12T17:32:06.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.179+0000 7f133e3579c0 4 Realm: () 2024-09-12T17:32:06.190 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.179+0000 7f133e3579c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:06.191 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.179+0000 7f133e3579c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:06.191 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.179+0000 7f133e3579c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:06.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.179+0000 7f133e3579c0 20 zonegroup default 2024-09-12T17:32:06.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.179+0000 7f133e3579c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.179+0000 7f133e3579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:06.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.179+0000 7f133e3579c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.183+0000 7f133e3579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:06.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.183+0000 7f133e3579c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.183+0000 7f133e3579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:06.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.183+0000 7f133e3579c0 20 started sync module instance, tier type = 2024-09-12T17:32:06.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.183+0000 7f133e3579c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:06.212 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.207+0000 7f133e3579c0 20 add_watcher() i=0 2024-09-12T17:32:06.212 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.207+0000 7f133e3579c0 20 add_watcher() i=1 2024-09-12T17:32:06.213 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.207+0000 7f133e3579c0 20 add_watcher() i=2 2024-09-12T17:32:06.213 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.207+0000 7f133e3579c0 20 add_watcher() i=3 2024-09-12T17:32:06.213 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.207+0000 7f133e3579c0 20 add_watcher() i=4 2024-09-12T17:32:06.213 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.207+0000 7f133e3579c0 20 add_watcher() i=5 2024-09-12T17:32:06.214 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.207+0000 7f133e3579c0 20 add_watcher() i=6 2024-09-12T17:32:06.214 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.211+0000 7f133e3579c0 20 add_watcher() i=7 2024-09-12T17:32:06.214 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.211+0000 7f133e3579c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:06.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.215+0000 7f11f27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:06.218 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.215+0000 7f133e3579c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:06.218 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.215+0000 7f133e3579c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:06.218 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.215+0000 7f133e3579c0 5 note: GC not initialized 2024-09-12T17:32:06.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.215+0000 7f11f17e2640 20 reqs_thread_entry: start 2024-09-12T17:32:06.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.215+0000 7f133e3579c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:06.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.215+0000 7f133e3579c0 20 Filter name: none 2024-09-12T17:32:06.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.215+0000 7f11ea7fc640 20 reqs_thread_entry: start 2024-09-12T17:32:06.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.215+0000 7f133e3579c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:32:06.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.215+0000 7f133e3579c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.215+0000 7f133e3579c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:06.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.215+0000 7f133e3579c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:32:06.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.215+0000 7f133e3579c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:32:06.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.219+0000 7f133e3579c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 : miss 2024-09-12T17:32:06.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.219+0000 7f133e3579c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:06.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.219+0000 7f133e3579c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:06.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.219+0000 7f133e3579c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 info.flags=0x17 2024-09-12T17:32:06.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.219+0000 7f133e3579c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 to cache LRU end 2024-09-12T17:32:06.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.219+0000 7f133e3579c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:06.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.219+0000 7f133e3579c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:32:06.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.219+0000 7f133e3579c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 2024-09-12T17:32:06.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.219+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:06.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.219+0000 7f133e3579c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:32:06.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.219+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:06.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.219+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:06.227 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.223+0000 7f133e3579c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:32:06.227 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.223+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:06.229 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.223+0000 7f133e3579c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:32:06.229 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.223+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:06.229 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.223+0000 7f133e3579c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:32:06.229 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.223+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:06.230 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.223+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:06.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.227+0000 7f133e3579c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:32:06.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.227+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:06.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.227+0000 7f133e3579c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:32:06.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.227+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:06.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.227+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:06.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.227+0000 7f133e3579c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:32:06.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.227+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:06.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.231+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:06.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.231+0000 7f133e3579c0 20 get_obj_state: octx=0x55b687ae93b0 obj=check-bucket:e state=0x55b687e23bf8 s->prefetch_data=0 2024-09-12T17:32:06.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.231+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:06.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.231+0000 7f133e3579c0 20 get_obj_state: octx=0x55b687b8e3a0 obj=check-bucket:d state=0x55b687e2b7a8 s->prefetch_data=0 2024-09-12T17:32:06.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.231+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:06.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.231+0000 7f133e3579c0 20 get_obj_state: octx=0x55b687e2c820 obj=check-bucket:c state=0x55b687e24758 s->prefetch_data=0 2024-09-12T17:32:06.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.231+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:06.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.235+0000 7f133e3579c0 20 get_obj_state: octx=0x55b687e2a3f0 obj=check-bucket:f state=0x55b687e26be8 s->prefetch_data=0 2024-09-12T17:32:06.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.235+0000 7f133e3579c0 20 get_obj_state: setting s->obj_tag to wtnifi4fxg6kab3i53d4aqfgxvcs7hav 2024-09-12T17:32:06.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.235+0000 7f133e3579c0 20 get_obj_state_impl: setting s->olh_tag to u98muyxtohx8yn2t358fwxqxxhx1xnoz 2024-09-12T17:32:06.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.235+0000 7f133e3579c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=u98muyxtohx8yn2t358fwxqxxhx1xnoz 2024-09-12T17:32:06.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.235+0000 7f133e3579c0 20 get_obj_state: setting s->obj_tag to 2paa5l8r6606cktccgszb592zmf4fp84 2024-09-12T17:32:06.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.235+0000 7f133e3579c0 20 get_obj_state_impl: setting s->olh_tag to iiwd3jz64t4zviy5n6x18twghh08ggf2 2024-09-12T17:32:06.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.235+0000 7f133e3579c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=iiwd3jz64t4zviy5n6x18twghh08ggf2 2024-09-12T17:32:06.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.235+0000 7f133e3579c0 20 get_obj_state: setting s->obj_tag to 2232d1wk1o8v4mta6k60l0je1z1fygcd 2024-09-12T17:32:06.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.235+0000 7f133e3579c0 20 get_obj_state_impl: setting s->olh_tag to 6lz9mojrgqu1uyjri4mqhsncu3cktnja 2024-09-12T17:32:06.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.235+0000 7f133e3579c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6lz9mojrgqu1uyjri4mqhsncu3cktnja 2024-09-12T17:32:06.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.235+0000 7f133e3579c0 20 get_obj_state: setting s->obj_tag to 33q8j6fd4chr9pqnyer8slsc6r0a4z27 2024-09-12T17:32:06.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.235+0000 7f133e3579c0 20 get_obj_state_impl: setting s->olh_tag to ffxcct3uof643rsh6cf8gpdm5q5mwe1u 2024-09-12T17:32:06.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.235+0000 7f133e3579c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ffxcct3uof643rsh6cf8gpdm5q5mwe1u 2024-09-12T17:32:06.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.239+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:06.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.239+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:06.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.239+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:06.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.239+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:06.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.243+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:06.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.243+0000 7f133e3579c0 20 olh_log_entry: epoch=3 op=3 key=d[DsSO5ORh-KHhCWM1N6fhwuSRPKoo0In] 2024-09-12T17:32:06.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.243+0000 7f133e3579c0 20 get_obj_state: octx=0x55b687b8e3a0 obj=check-bucket:_:DsSO5ORh-KHhCWM1N6fhwuSRPKoo0In_d state=0x55b687ecfa58 s->prefetch_data=0 2024-09-12T17:32:06.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.243+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:06.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.243+0000 7f133e3579c0 10 manifest: total_size = 11 2024-09-12T17:32:06.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.243+0000 7f133e3579c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.10975222594297675272 2024-09-12T17:32:06.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.243+0000 7f133e3579c0 20 get_obj_state: octx=0x55b687b8e3a0 obj=check-bucket:_:DsSO5ORh-KHhCWM1N6fhwuSRPKoo0In_d state=0x55b687ecfa58 s->prefetch_data=0 2024-09-12T17:32:06.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.243+0000 7f133e3579c0 20 prepare_atomic_modification: state is not atomic. state=0x55b687ecfa58 2024-09-12T17:32:06.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.243+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:06.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.243+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:06.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.243+0000 7f133e3579c0 20 olh_log_entry: epoch=3 op=3 key=c[reHM3jsbkmsHe-gd28PGpZC84brX3Bi] 2024-09-12T17:32:06.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.247+0000 7f133e3579c0 20 get_obj_state: octx=0x55b687e2c820 obj=check-bucket:_:reHM3jsbkmsHe-gd28PGpZC84brX3Bi_c state=0x55b687ed6918 s->prefetch_data=0 2024-09-12T17:32:06.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.247+0000 7f133e3579c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:32:06.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.247+0000 7f133e3579c0 20 olh_log_entry: epoch=2 op=3 key=f[byw2oTdkrZw6gCS28nuBgRdjTjT71KD] 2024-09-12T17:32:06.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.247+0000 7f133e3579c0 20 get_obj_state: octx=0x55b687e2a3f0 obj=check-bucket:_:byw2oTdkrZw6gCS28nuBgRdjTjT71KD_f state=0x55b687edd158 s->prefetch_data=0 2024-09-12T17:32:06.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.247+0000 7f133e3579c0 10 manifest: total_size = 22 2024-09-12T17:32:06.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.247+0000 7f133e3579c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.8181792101522209605 2024-09-12T17:32:06.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.247+0000 7f133e3579c0 20 get_obj_state: octx=0x55b687e2c820 obj=check-bucket:_:reHM3jsbkmsHe-gd28PGpZC84brX3Bi_c state=0x55b687ed6918 s->prefetch_data=0 2024-09-12T17:32:06.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.247+0000 7f133e3579c0 20 prepare_atomic_modification: state is not atomic. state=0x55b687ed6918 2024-09-12T17:32:06.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.247+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:06.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.247+0000 7f133e3579c0 10 manifest: total_size = 12 2024-09-12T17:32:06.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.247+0000 7f133e3579c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.15975105079806204246 2024-09-12T17:32:06.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.247+0000 7f133e3579c0 20 get_obj_state: octx=0x55b687e2a3f0 obj=check-bucket:_:byw2oTdkrZw6gCS28nuBgRdjTjT71KD_f state=0x55b687edd158 s->prefetch_data=0 2024-09-12T17:32:06.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.247+0000 7f133e3579c0 20 prepare_atomic_modification: state is not atomic. state=0x55b687edd158 2024-09-12T17:32:06.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.247+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:06.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.247+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:06.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.247+0000 7f133e3579c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:32:06.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.247+0000 7f133e3579c0 20 olh_log_entry: epoch=2 op=3 key=e[hSniurXLsQFeNaZxNWNDgqxkWTu1SHT] 2024-09-12T17:32:06.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.247+0000 7f133e3579c0 20 get_obj_state: octx=0x55b687ae93b0 obj=check-bucket:_:hSniurXLsQFeNaZxNWNDgqxkWTu1SHT_e state=0x55b687ee94e8 s->prefetch_data=0 2024-09-12T17:32:06.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.251+0000 7f133e3579c0 10 manifest: total_size = 22 2024-09-12T17:32:06.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.251+0000 7f133e3579c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.13426829882217018298 2024-09-12T17:32:06.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.251+0000 7f133e3579c0 20 get_obj_state: octx=0x55b687ae93b0 obj=check-bucket:_:hSniurXLsQFeNaZxNWNDgqxkWTu1SHT_e state=0x55b687ee94e8 s->prefetch_data=0 2024-09-12T17:32:06.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.251+0000 7f133e3579c0 20 prepare_atomic_modification: state is not atomic. state=0x55b687ee94e8 2024-09-12T17:32:06.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.251+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:06.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.251+0000 7f133e3579c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:32:06.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.251+0000 7f133e3579c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T17:32:06.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.251+0000 7f133e3579c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:32:06.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.251+0000 7f133e3579c0 5 delete_objs_inline: removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1__shadow:DsSO5ORh-KHhCWM1N6fhwuSRPKoo0In_._FjLKZr2jQxDjFCcEsTxmUT5Ut0Ll50_0 2024-09-12T17:32:06.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.255+0000 7f121affd640 20 handle_completion(): completion ok for obj=d[DsSO5ORh-KHhCWM1N6fhwuSRPKoo0In] 2024-09-12T17:32:06.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.255+0000 7f133e3579c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:32:06.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.255+0000 7f133e3579c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:32:06.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.255+0000 7f133e3579c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:32:06.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.255+0000 7f133e3579c0 5 delete_objs_inline: removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1__shadow:reHM3jsbkmsHe-gd28PGpZC84brX3Bi_.XT0npc2I9KIuACtuz7fdI9vWJV6gSU8_0 2024-09-12T17:32:06.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.259+0000 7f133e3579c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:32:06.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.259+0000 7f121affd640 20 handle_completion(): completion ok for obj=c[reHM3jsbkmsHe-gd28PGpZC84brX3Bi] 2024-09-12T17:32:06.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.263+0000 7f133e3579c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:32:06.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.263+0000 7f133e3579c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T17:32:06.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.263+0000 7f133e3579c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:32:06.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.263+0000 7f133e3579c0 5 delete_objs_inline: removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1__shadow:byw2oTdkrZw6gCS28nuBgRdjTjT71KD_.x6R56cx7pknND3JOqoOQboDNi3Xpbx-_0 2024-09-12T17:32:06.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.263+0000 7f133e3579c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:32:06.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.267+0000 7f133e3579c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:32:06.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.267+0000 7f133e3579c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:32:06.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.267+0000 7f133e3579c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:32:06.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.267+0000 7f133e3579c0 5 delete_objs_inline: removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1__shadow:hSniurXLsQFeNaZxNWNDgqxkWTu1SHT_.Jyc1ZEJ119YhnjNhnJ6xEz1tlBbqJu-_0 2024-09-12T17:32:06.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.267+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:06.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.267+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:06.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.267+0000 7f121a7fc640 20 handle_completion(): completion ok for obj=f[byw2oTdkrZw6gCS28nuBgRdjTjT71KD] 2024-09-12T17:32:06.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.271+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:06.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.271+0000 7f133e3579c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:32:06.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.271+0000 7f133e3579c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:32:06.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.271+0000 7f133e3579c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:32:06.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.271+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:06.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.271+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:06.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.271+0000 7f121affd640 20 handle_completion(): completion ok for obj=e[hSniurXLsQFeNaZxNWNDgqxkWTu1SHT] 2024-09-12T17:32:06.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.275+0000 7f133e3579c0 20 get_obj_state: octx=0x55b687e2a3f0 obj=check-bucket:f state=0x55b687e26be8 s->prefetch_data=0 2024-09-12T17:32:06.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.275+0000 7f133e3579c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ffxcct3uof643rsh6cf8gpdm5q5mwe1u 2024-09-12T17:32:06.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.275+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:06.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.275+0000 7f133e3579c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:32:06.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.279+0000 7f133e3579c0 20 get_obj_state: octx=0x55b687ae93b0 obj=check-bucket:e state=0x55b687e23bf8 s->prefetch_data=0 2024-09-12T17:32:06.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.279+0000 7f133e3579c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=u98muyxtohx8yn2t358fwxqxxhx1xnoz 2024-09-12T17:32:06.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.287+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:06.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.287+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:06.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.287+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:06.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.287+0000 7f133e3579c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T17:32:06.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.291+0000 7f133e3579c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:06.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.291+0000 7f133e3579c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T17:32:06.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.291+0000 7f133e3579c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:32:06.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.291+0000 7f11f27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:06.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.295+0000 7f133e3579c0 20 remove_watcher() i=0 2024-09-12T17:32:06.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.295+0000 7f133e3579c0 2 removed watcher, disabling cache 2024-09-12T17:32:06.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.299+0000 7f133e3579c0 20 remove_watcher() i=1 2024-09-12T17:32:06.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.299+0000 7f133e3579c0 20 remove_watcher() i=2 2024-09-12T17:32:06.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.303+0000 7f133e3579c0 20 remove_watcher() i=3 2024-09-12T17:32:06.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.307+0000 7f133e3579c0 20 remove_watcher() i=4 2024-09-12T17:32:06.312 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.307+0000 7f133e3579c0 20 remove_watcher() i=5 2024-09-12T17:32:06.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.311+0000 7f133e3579c0 20 remove_watcher() i=6 2024-09-12T17:32:06.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.311+0000 7f133e3579c0 20 remove_watcher() i=7 2024-09-12T17:32:06.333 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:06.334 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:06.364 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:06.365 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:06.405 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:06.405 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:06.461 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:06.462 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:06.517 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T17:32:06.518 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:32:06.520 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:06.520 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:06.648 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:06.648 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:06.712 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:06.713 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:06.784 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:06.784 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:06.854 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:06.854 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:06.914 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T17:32:06.914 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:32:06.914 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T17:32:06.952 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:06.952 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:06.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.995+0000 7efc6ad6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.999+0000 7efc6ad6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.999+0000 7efc6ad6e9c0 20 realm 2024-09-12T17:32:07.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.999+0000 7efc6ad6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.999+0000 7efc6ad6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.999+0000 7efc6ad6e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:07.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.999+0000 7efc6ad6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.999+0000 7efc6ad6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.999+0000 7efc6ad6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.999+0000 7efc6ad6e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:07.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.999+0000 7efc6ad6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.999+0000 7efc6ad6e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:07.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:06.999+0000 7efc6ad6e9c0 20 searching for the correct realm 2024-09-12T17:32:07.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.003+0000 7efc68073640 0 -- 172.21.15.98:0/4082291020 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7efc5804b040 msgr2=0x7efc5805b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:07.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.011+0000 7efc68874640 0 -- 172.21.15.98:0/4082291020 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7efc50042930 msgr2=0x7efc50053410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:07.230 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.227+0000 7efc6ad6e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:07.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.227+0000 7efc6ad6e9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:07.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.227+0000 7efc6ad6e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:07.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.227+0000 7efc6ad6e9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:07.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.227+0000 7efc6ad6e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:07.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.227+0000 7efc6ad6e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:07.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.227+0000 7efc6ad6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.227+0000 7efc6ad6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.227+0000 7efc6ad6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.231+0000 7efc6ad6e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:07.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.231+0000 7efc6ad6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.231+0000 7efc6ad6e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:07.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.231+0000 7efc6ad6e9c0 20 zone default found 2024-09-12T17:32:07.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.231+0000 7efc6ad6e9c0 4 Realm: () 2024-09-12T17:32:07.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.231+0000 7efc6ad6e9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:07.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.231+0000 7efc6ad6e9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:07.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.231+0000 7efc6ad6e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:07.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.231+0000 7efc6ad6e9c0 20 zonegroup default 2024-09-12T17:32:07.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.231+0000 7efc6ad6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.231+0000 7efc6ad6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.231+0000 7efc6ad6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.231+0000 7efc6ad6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.231+0000 7efc6ad6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.231+0000 7efc6ad6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.231+0000 7efc6ad6e9c0 20 started sync module instance, tier type = 2024-09-12T17:32:07.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.231+0000 7efc6ad6e9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:07.259 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.255+0000 7efc6ad6e9c0 20 add_watcher() i=0 2024-09-12T17:32:07.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.255+0000 7efc6ad6e9c0 20 add_watcher() i=1 2024-09-12T17:32:07.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.255+0000 7efc6ad6e9c0 20 add_watcher() i=2 2024-09-12T17:32:07.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.255+0000 7efc6ad6e9c0 20 add_watcher() i=3 2024-09-12T17:32:07.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.255+0000 7efc6ad6e9c0 20 add_watcher() i=4 2024-09-12T17:32:07.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.255+0000 7efc6ad6e9c0 20 add_watcher() i=5 2024-09-12T17:32:07.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.259+0000 7efc6ad6e9c0 20 add_watcher() i=6 2024-09-12T17:32:07.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.259+0000 7efc6ad6e9c0 20 add_watcher() i=7 2024-09-12T17:32:07.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.259+0000 7efc6ad6e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:07.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.263+0000 7efb1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:07.268 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.263+0000 7efc6ad6e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:07.268 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.263+0000 7efc6ad6e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:07.268 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.267+0000 7efc6ad6e9c0 5 note: GC not initialized 2024-09-12T17:32:07.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.267+0000 7efb1e7e4640 20 reqs_thread_entry: start 2024-09-12T17:32:07.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.267+0000 7efc6ad6e9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:07.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.267+0000 7efc6ad6e9c0 20 Filter name: none 2024-09-12T17:32:07.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.267+0000 7efb177fe640 20 reqs_thread_entry: start 2024-09-12T17:32:07.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.267+0000 7efc6ad6e9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:32:07.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.267+0000 7efc6ad6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.267+0000 7efc6ad6e9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:07.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.267+0000 7efc6ad6e9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:32:07.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.267+0000 7efc6ad6e9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:32:07.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.267+0000 7efc6ad6e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 : miss 2024-09-12T17:32:07.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.267+0000 7efc6ad6e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.267+0000 7efc6ad6e9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:07.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.267+0000 7efc6ad6e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 info.flags=0x17 2024-09-12T17:32:07.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.267+0000 7efc6ad6e9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 to cache LRU end 2024-09-12T17:32:07.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.267+0000 7efc6ad6e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:07.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.267+0000 7efc6ad6e9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:32:07.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.267+0000 7efc6ad6e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 2024-09-12T17:32:07.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.267+0000 7efc6ad6e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:07.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.271+0000 7efc6ad6e9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:32:07.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.271+0000 7efc6ad6e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:07.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.271+0000 7efc6ad6e9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:32:07.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.271+0000 7efc6ad6e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:07.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.271+0000 7efc6ad6e9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:32:07.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.271+0000 7efc6ad6e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:07.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.275+0000 7efc6ad6e9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:32:07.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.275+0000 7efc6ad6e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:07.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.275+0000 7efc6ad6e9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:32:07.278 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.275+0000 7efc6ad6e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:07.278 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.275+0000 7efc6ad6e9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:32:07.278 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.275+0000 7efc6ad6e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:07.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.275+0000 7efc6ad6e9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:32:07.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.275+0000 7efc6ad6e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:07.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.279+0000 7efc6ad6e9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:32:07.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.279+0000 7efc6ad6e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:07.282 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.279+0000 7efc6ad6e9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:32:07.282 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.279+0000 7efc6ad6e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:07.283 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.279+0000 7efc6ad6e9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:32:07.283 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.279+0000 7efc6ad6e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:07.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.283+0000 7efc6ad6e9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:32:07.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.283+0000 7efc6ad6e9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:32:07.285 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.283+0000 7efb1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:07.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.287+0000 7efc6ad6e9c0 20 remove_watcher() i=0 2024-09-12T17:32:07.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.287+0000 7efc6ad6e9c0 2 removed watcher, disabling cache 2024-09-12T17:32:07.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.291+0000 7efc6ad6e9c0 20 remove_watcher() i=1 2024-09-12T17:32:07.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.291+0000 7efc6ad6e9c0 20 remove_watcher() i=2 2024-09-12T17:32:07.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.295+0000 7efc6ad6e9c0 20 remove_watcher() i=3 2024-09-12T17:32:07.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.299+0000 7efc6ad6e9c0 20 remove_watcher() i=4 2024-09-12T17:32:07.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.299+0000 7efc6ad6e9c0 20 remove_watcher() i=5 2024-09-12T17:32:07.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.303+0000 7efc6ad6e9c0 20 remove_watcher() i=6 2024-09-12T17:32:07.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.303+0000 7efc6ad6e9c0 20 remove_watcher() i=7 2024-09-12T17:32:07.324 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:07.325 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:07.638 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:07.639 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:07.780 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:32:07.815 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:07.815 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:07.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.855+0000 7f29964759c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.859+0000 7f29964759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.859+0000 7f29964759c0 20 realm 2024-09-12T17:32:07.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.859+0000 7f29964759c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.859+0000 7f29964759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.859+0000 7f29964759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:07.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.859+0000 7f29964759c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.859+0000 7f29964759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.859+0000 7f29964759c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.859+0000 7f29964759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:07.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.859+0000 7f29964759c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.864 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.863+0000 7f29964759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:07.864 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.863+0000 7f29964759c0 20 searching for the correct realm 2024-09-12T17:32:07.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.867+0000 7f298bfff640 0 -- 172.21.15.98:0/296639995 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x56539d95c720 msgr2=0x56539d95eb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:07.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.871+0000 7f2993f7b640 0 -- 172.21.15.98:0/296639995 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f297c00f3d0 msgr2=0x7f297c00f830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:07.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.879+0000 7f29964759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:07.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.879+0000 7f29964759c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:07.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.879+0000 7f29964759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:07.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.879+0000 7f29964759c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:07.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.879+0000 7f29964759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:07.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.879+0000 7f29964759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:07.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.879+0000 7f29964759c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.883+0000 7f29964759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.883+0000 7f29964759c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.883+0000 7f29964759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:07.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.883+0000 7f29964759c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.883+0000 7f29964759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:07.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.883+0000 7f29964759c0 20 zone default found 2024-09-12T17:32:07.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.883+0000 7f29964759c0 4 Realm: () 2024-09-12T17:32:07.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.883+0000 7f29964759c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:07.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.883+0000 7f29964759c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:07.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.883+0000 7f29964759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:07.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.883+0000 7f29964759c0 20 zonegroup default 2024-09-12T17:32:07.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.883+0000 7f29964759c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.883+0000 7f29964759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.883+0000 7f29964759c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.883+0000 7f29964759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.883+0000 7f29964759c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.883+0000 7f29964759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:07.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.883+0000 7f29964759c0 20 started sync module instance, tier type = 2024-09-12T17:32:07.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.883+0000 7f29964759c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:07.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.903+0000 7f29964759c0 20 add_watcher() i=0 2024-09-12T17:32:07.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.903+0000 7f29964759c0 20 add_watcher() i=1 2024-09-12T17:32:07.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.903+0000 7f29964759c0 20 add_watcher() i=2 2024-09-12T17:32:07.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.903+0000 7f29964759c0 20 add_watcher() i=3 2024-09-12T17:32:07.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.903+0000 7f29964759c0 20 add_watcher() i=4 2024-09-12T17:32:07.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.903+0000 7f29964759c0 20 add_watcher() i=5 2024-09-12T17:32:07.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.903+0000 7f29964759c0 20 add_watcher() i=6 2024-09-12T17:32:07.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.907+0000 7f29964759c0 20 add_watcher() i=7 2024-09-12T17:32:07.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.907+0000 7f29964759c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:07.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.907+0000 7f2849fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:07.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.907+0000 7f29964759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:07.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.907+0000 7f29964759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:07.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.907+0000 7f29964759c0 5 note: GC not initialized 2024-09-12T17:32:07.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.911+0000 7f2848fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:07.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.911+0000 7f29964759c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:07.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.911+0000 7f29964759c0 20 Filter name: none 2024-09-12T17:32:07.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.911+0000 7f27c27fc640 20 reqs_thread_entry: start 2024-09-12T17:32:07.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.911+0000 7f29964759c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.911+0000 7f29964759c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:07.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.911+0000 7f29964759c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:07.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.911+0000 7f29964759c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:07.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.911+0000 7f29964759c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:07.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.911+0000 7f29964759c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:32:07.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.911+0000 7f29964759c0 20 INFO: main: starting shard=0 2024-09-12T17:32:07.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.911+0000 7f29964759c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:07.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.911+0000 7f29964759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:07.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.911+0000 7f29964759c0 20 INFO: main: starting shard=1 2024-09-12T17:32:07.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.911+0000 7f29964759c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:07.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.915+0000 7f29964759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:07.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.915+0000 7f29964759c0 20 INFO: main: starting shard=2 2024-09-12T17:32:07.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.915+0000 7f29964759c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:07.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.915+0000 7f29964759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:07.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.915+0000 7f29964759c0 20 INFO: main: starting shard=3 2024-09-12T17:32:07.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.915+0000 7f29964759c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:07.919 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.915+0000 7f29964759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:07.919 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.915+0000 7f29964759c0 20 INFO: main: starting shard=4 2024-09-12T17:32:07.919 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.915+0000 7f29964759c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:07.919 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.915+0000 7f29964759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:07.919 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.915+0000 7f29964759c0 20 INFO: main: starting shard=5 2024-09-12T17:32:07.919 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.915+0000 7f29964759c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:07.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.919+0000 7f29964759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:07.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.919+0000 7f29964759c0 20 INFO: main: starting shard=6 2024-09-12T17:32:07.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.919+0000 7f29964759c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:07.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.919+0000 7f29964759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:07.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.919+0000 7f29964759c0 20 INFO: main: starting shard=7 2024-09-12T17:32:07.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.919+0000 7f29964759c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:07.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.919+0000 7f29964759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:07.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.919+0000 7f29964759c0 20 INFO: main: starting shard=8 2024-09-12T17:32:07.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.919+0000 7f29964759c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:07.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.919+0000 7f29964759c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:32:07.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.919+0000 7f29964759c0 20 INFO: main: starting shard=9 2024-09-12T17:32:07.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.919+0000 7f29964759c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:07.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.923+0000 7f29964759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:07.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.923+0000 7f29964759c0 20 INFO: main: starting shard=10 2024-09-12T17:32:07.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.923+0000 7f29964759c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:07.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.923+0000 7f29964759c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:07.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.923+0000 7f29964759c0 20 INFO: main: done 2024-09-12T17:32:07.926 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.923+0000 7f2849fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:07.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.927+0000 7f29964759c0 20 remove_watcher() i=0 2024-09-12T17:32:07.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.927+0000 7f29964759c0 2 removed watcher, disabling cache 2024-09-12T17:32:07.934 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.931+0000 7f29964759c0 20 remove_watcher() i=1 2024-09-12T17:32:07.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.935+0000 7f29964759c0 20 remove_watcher() i=2 2024-09-12T17:32:07.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.935+0000 7f29964759c0 20 remove_watcher() i=3 2024-09-12T17:32:07.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.939+0000 7f29964759c0 20 remove_watcher() i=4 2024-09-12T17:32:07.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.939+0000 7f29964759c0 20 remove_watcher() i=5 2024-09-12T17:32:07.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.943+0000 7f29964759c0 20 remove_watcher() i=6 2024-09-12T17:32:07.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:07.943+0000 7f29964759c0 20 remove_watcher() i=7 2024-09-12T17:32:07.960 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:32:07.989 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:07.989 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:08.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.031+0000 7f73535879c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.031+0000 7f73535879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:08.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.031+0000 7f73535879c0 20 realm 2024-09-12T17:32:08.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.031+0000 7f73535879c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.031+0000 7f73535879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:08.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.031+0000 7f73535879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:08.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.031+0000 7f73535879c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.031+0000 7f73535879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:08.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.031+0000 7f73535879c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.035+0000 7f73535879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:08.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.035+0000 7f73535879c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.035+0000 7f73535879c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:08.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.035+0000 7f73535879c0 20 searching for the correct realm 2024-09-12T17:32:08.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.243+0000 7f735108d640 0 -- 172.21.15.98:0/3716623348 >> [v2:172.21.15.98:6816/1225764258,v1:172.21.15.98:6817/1225764258] conn(0x7f734c015030 msgr2=0x7f734c05f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:08.659 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.655+0000 7f735188e640 0 -- 172.21.15.98:0/3716623348 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f7348010040 msgr2=0x7f734805c150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:08.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.671+0000 7f73535879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:08.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.671+0000 7f73535879c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:08.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.671+0000 7f73535879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:08.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.671+0000 7f73535879c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:08.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.671+0000 7f73535879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:08.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.671+0000 7f73535879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:08.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.675+0000 7f73535879c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.675+0000 7f73535879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:08.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.675+0000 7f73535879c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.679 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.675+0000 7f73535879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:08.679 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.675+0000 7f73535879c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.679 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.675+0000 7f73535879c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:08.680 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.675+0000 7f73535879c0 20 zone default found 2024-09-12T17:32:08.680 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.675+0000 7f73535879c0 4 Realm: () 2024-09-12T17:32:08.680 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.675+0000 7f73535879c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:08.680 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.675+0000 7f73535879c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:08.680 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.675+0000 7f73535879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:08.680 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.675+0000 7f73535879c0 20 zonegroup default 2024-09-12T17:32:08.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.675+0000 7f73535879c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.675+0000 7f73535879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:08.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.675+0000 7f73535879c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.675+0000 7f73535879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:08.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.675+0000 7f73535879c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.683 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.679+0000 7f73535879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:08.683 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.679+0000 7f73535879c0 20 started sync module instance, tier type = 2024-09-12T17:32:08.683 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.679+0000 7f73535879c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:08.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.703+0000 7f73535879c0 20 add_watcher() i=0 2024-09-12T17:32:08.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.703+0000 7f73535879c0 20 add_watcher() i=1 2024-09-12T17:32:08.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.703+0000 7f73535879c0 20 add_watcher() i=2 2024-09-12T17:32:08.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.703+0000 7f73535879c0 20 add_watcher() i=3 2024-09-12T17:32:08.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.703+0000 7f73535879c0 20 add_watcher() i=4 2024-09-12T17:32:08.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.703+0000 7f73535879c0 20 add_watcher() i=5 2024-09-12T17:32:08.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.703+0000 7f73535879c0 20 add_watcher() i=6 2024-09-12T17:32:08.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.707+0000 7f73535879c0 20 add_watcher() i=7 2024-09-12T17:32:08.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.707+0000 7f73535879c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:08.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.707+0000 7f7207fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:08.713 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.711+0000 7f73535879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:08.713 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.711+0000 7f73535879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:08.713 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.711+0000 7f73535879c0 5 note: GC not initialized 2024-09-12T17:32:08.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.711+0000 7f7206fe5640 20 reqs_thread_entry: start 2024-09-12T17:32:08.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.711+0000 7f73535879c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:08.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.711+0000 7f73535879c0 20 Filter name: none 2024-09-12T17:32:08.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.711+0000 7f7204fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:08.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.711+0000 7f73535879c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.711+0000 7f73535879c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:08.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.711+0000 7f73535879c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.711+0000 7f73535879c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:08.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.711+0000 7f73535879c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:08.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.711+0000 7f73535879c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:32:08.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.711+0000 7f73535879c0 20 INFO: main: starting shard=0 2024-09-12T17:32:08.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.711+0000 7f73535879c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:08.716 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.715+0000 7f73535879c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:08.716 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.715+0000 7f73535879c0 20 INFO: main: starting shard=1 2024-09-12T17:32:08.716 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.715+0000 7f73535879c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:08.717 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.715+0000 7f73535879c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:08.717 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.715+0000 7f73535879c0 20 INFO: main: starting shard=2 2024-09-12T17:32:08.717 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.715+0000 7f73535879c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:08.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.715+0000 7f73535879c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:08.719 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.715+0000 7f73535879c0 20 INFO: main: starting shard=3 2024-09-12T17:32:08.719 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.715+0000 7f73535879c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:08.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.719+0000 7f73535879c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:08.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.719+0000 7f73535879c0 20 INFO: main: starting shard=4 2024-09-12T17:32:08.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.719+0000 7f73535879c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:08.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.719+0000 7f73535879c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:08.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.719+0000 7f73535879c0 20 INFO: main: starting shard=5 2024-09-12T17:32:08.721 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.719+0000 7f73535879c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:08.721 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.719+0000 7f73535879c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T17:32:08.721 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.719+0000 7f73535879c0 20 INFO: main: starting shard=6 2024-09-12T17:32:08.721 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.719+0000 7f73535879c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:08.722 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.719+0000 7f73535879c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:08.722 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.719+0000 7f73535879c0 20 INFO: main: starting shard=7 2024-09-12T17:32:08.722 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.719+0000 7f73535879c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:08.723 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.719+0000 7f73535879c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:08.723 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.719+0000 7f73535879c0 20 INFO: main: starting shard=8 2024-09-12T17:32:08.723 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.719+0000 7f73535879c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:08.724 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.723+0000 7f73535879c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:08.724 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.723+0000 7f73535879c0 20 INFO: main: starting shard=9 2024-09-12T17:32:08.724 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.723+0000 7f73535879c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:08.725 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.723+0000 7f73535879c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:08.725 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.723+0000 7f73535879c0 20 INFO: main: starting shard=10 2024-09-12T17:32:08.725 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.723+0000 7f73535879c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:08.727 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.723+0000 7f73535879c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:08.727 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.723+0000 7f73535879c0 20 INFO: main: done 2024-09-12T17:32:08.728 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.727+0000 7f7207fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:08.733 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.731+0000 7f73535879c0 20 remove_watcher() i=0 2024-09-12T17:32:08.733 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.731+0000 7f73535879c0 2 removed watcher, disabling cache 2024-09-12T17:32:08.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.735+0000 7f73535879c0 20 remove_watcher() i=1 2024-09-12T17:32:08.738 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.735+0000 7f73535879c0 20 remove_watcher() i=2 2024-09-12T17:32:08.740 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.739+0000 7f73535879c0 20 remove_watcher() i=3 2024-09-12T17:32:08.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.739+0000 7f73535879c0 20 remove_watcher() i=4 2024-09-12T17:32:08.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.743+0000 7f73535879c0 20 remove_watcher() i=5 2024-09-12T17:32:08.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.743+0000 7f73535879c0 20 remove_watcher() i=6 2024-09-12T17:32:08.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.743+0000 7f73535879c0 20 remove_watcher() i=7 2024-09-12T17:32:08.762 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T17:32:08.762 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:32:08.762 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:32:08.794 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:08.794 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:08.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.839+0000 7efc7b5469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.839+0000 7efc7b5469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:08.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.839+0000 7efc7b5469c0 20 realm 2024-09-12T17:32:08.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.839+0000 7efc7b5469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.839+0000 7efc7b5469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:08.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.839+0000 7efc7b5469c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:08.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.839+0000 7efc7b5469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.839+0000 7efc7b5469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:08.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.839+0000 7efc7b5469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.843+0000 7efc7b5469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:08.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.843+0000 7efc7b5469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.843+0000 7efc7b5469c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:08.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.843+0000 7efc7b5469c0 20 searching for the correct realm 2024-09-12T17:32:08.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.847+0000 7efc7904c640 0 -- 172.21.15.98:0/2894903504 >> [v2:172.21.15.98:6816/1225764258,v1:172.21.15.98:6817/1225764258] conn(0x7efc740791d0 msgr2=0x7efc74019750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:08.855 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.851+0000 7efc7984d640 0 -- 172.21.15.98:0/2894903504 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7efc700f8c50 msgr2=0x7efc700f76c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:08.865 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:08.865 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:08.865 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:08.865 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:08.865 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:08.865 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:08.865 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:08.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:08.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:08.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 20 zone default found 2024-09-12T17:32:08.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 4 Realm: () 2024-09-12T17:32:08.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:08.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:08.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:08.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 20 zonegroup default 2024-09-12T17:32:08.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:08.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.863+0000 7efc7b5469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.867+0000 7efc7b5469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:08.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.867+0000 7efc7b5469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.867+0000 7efc7b5469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:08.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.867+0000 7efc7b5469c0 20 started sync module instance, tier type = 2024-09-12T17:32:08.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.867+0000 7efc7b5469c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:08.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.883+0000 7efc7b5469c0 20 add_watcher() i=0 2024-09-12T17:32:08.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.883+0000 7efc7b5469c0 20 add_watcher() i=1 2024-09-12T17:32:08.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.883+0000 7efc7b5469c0 20 add_watcher() i=2 2024-09-12T17:32:08.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.883+0000 7efc7b5469c0 20 add_watcher() i=3 2024-09-12T17:32:08.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.883+0000 7efc7b5469c0 20 add_watcher() i=4 2024-09-12T17:32:08.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.883+0000 7efc7b5469c0 20 add_watcher() i=5 2024-09-12T17:32:08.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.883+0000 7efc7b5469c0 20 add_watcher() i=6 2024-09-12T17:32:08.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.883+0000 7efc7b5469c0 20 add_watcher() i=7 2024-09-12T17:32:08.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.883+0000 7efc7b5469c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:08.890 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efb2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:08.890 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efc7b5469c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:08.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efc7b5469c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:08.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efc7b5469c0 5 note: GC not initialized 2024-09-12T17:32:08.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efb2a7e4640 20 reqs_thread_entry: start 2024-09-12T17:32:08.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efc7b5469c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:08.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efc7b5469c0 20 Filter name: none 2024-09-12T17:32:08.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efa9bfff640 20 reqs_thread_entry: start 2024-09-12T17:32:08.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efc7b5469c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:32:08.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efc7b5469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efc7b5469c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:08.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efc7b5469c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:32:08.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efc7b5469c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:32:08.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efc7b5469c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 : miss 2024-09-12T17:32:08.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efc7b5469c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:08.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efc7b5469c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:08.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efc7b5469c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 info.flags=0x17 2024-09-12T17:32:08.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efc7b5469c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 to cache LRU end 2024-09-12T17:32:08.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efc7b5469c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:08.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efc7b5469c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:32:08.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efc7b5469c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 2024-09-12T17:32:08.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.887+0000 7efc7b5469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:08.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.891+0000 7efc7b5469c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:32:08.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.891+0000 7efc7b5469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:08.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.891+0000 7efc7b5469c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:32:08.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.891+0000 7efc7b5469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:08.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.891+0000 7efc7b5469c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:32:08.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.891+0000 7efc7b5469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:08.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.895+0000 7efc7b5469c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:32:08.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.895+0000 7efc7b5469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:08.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.895+0000 7efc7b5469c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:32:08.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.895+0000 7efc7b5469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:08.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.895+0000 7efc7b5469c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T17:32:08.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.895+0000 7efc7b5469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:08.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.895+0000 7efc7b5469c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:32:08.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.895+0000 7efc7b5469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:08.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.895+0000 7efc7b5469c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:32:08.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.895+0000 7efc7b5469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:08.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.895+0000 7efc7b5469c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T17:32:08.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.895+0000 7efc7b5469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:08.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.899+0000 7efc7b5469c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:32:08.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.899+0000 7efc7b5469c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:08.902 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.899+0000 7efc7b5469c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:32:08.902 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.899+0000 7efc7b5469c0 1 NOTICE: finished all shards (2 entries found) 2024-09-12T17:32:08.903 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.899+0000 7efb2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:08.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.907+0000 7efc7b5469c0 20 remove_watcher() i=0 2024-09-12T17:32:08.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.907+0000 7efc7b5469c0 2 removed watcher, disabling cache 2024-09-12T17:32:08.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.907+0000 7efc7b5469c0 20 remove_watcher() i=1 2024-09-12T17:32:08.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.911+0000 7efc7b5469c0 20 remove_watcher() i=2 2024-09-12T17:32:08.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.911+0000 7efc7b5469c0 20 remove_watcher() i=3 2024-09-12T17:32:08.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.915+0000 7efc7b5469c0 20 remove_watcher() i=4 2024-09-12T17:32:08.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.915+0000 7efc7b5469c0 20 remove_watcher() i=5 2024-09-12T17:32:08.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.919+0000 7efc7b5469c0 20 remove_watcher() i=6 2024-09-12T17:32:08.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:08.919+0000 7efc7b5469c0 20 remove_watcher() i=7 2024-09-12T17:32:08.935 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T17:32:08.935 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:32:08.935 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:32:08.966 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:08.966 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:09.205 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.203+0000 7f678ae07640 0 --2- 172.21.15.98:0/547142281 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55f5fa524450 0x55f5fa538700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:32:09.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.215+0000 7f678d3019c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.219+0000 7f678d3019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:09.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.219+0000 7f678d3019c0 20 realm 2024-09-12T17:32:09.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.219+0000 7f678d3019c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.219+0000 7f678d3019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:09.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.219+0000 7f678d3019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:09.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.219+0000 7f678d3019c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.219+0000 7f678d3019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:09.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.219+0000 7f678d3019c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.219+0000 7f678d3019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:09.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.219+0000 7f678d3019c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.219+0000 7f678d3019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:09.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.219+0000 7f678d3019c0 20 searching for the correct realm 2024-09-12T17:32:09.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.223+0000 7f678b608640 0 -- 172.21.15.98:0/3105466631 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f6780023c20 msgr2=0x7f678004d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:09.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.435+0000 7f678b608640 0 -- 172.21.15.98:0/3105466631 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f6780021040 msgr2=0x7f678000a450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:09.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.659+0000 7f678d3019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:09.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.659+0000 7f678d3019c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:09.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.659+0000 7f678d3019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:09.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.659+0000 7f678d3019c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:09.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.659+0000 7f678d3019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:09.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.659+0000 7f678d3019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:09.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.659+0000 7f678d3019c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.659+0000 7f678d3019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:09.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.659+0000 7f678d3019c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.659+0000 7f678d3019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:09.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.659+0000 7f678d3019c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.663+0000 7f678d3019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:09.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.663+0000 7f678d3019c0 20 zone default found 2024-09-12T17:32:09.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.663+0000 7f678d3019c0 4 Realm: () 2024-09-12T17:32:09.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.663+0000 7f678d3019c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:09.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.663+0000 7f678d3019c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:09.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.663+0000 7f678d3019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:09.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.663+0000 7f678d3019c0 20 zonegroup default 2024-09-12T17:32:09.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.663+0000 7f678d3019c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.663+0000 7f678d3019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:09.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.663+0000 7f678d3019c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.663+0000 7f678d3019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:09.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.663+0000 7f678d3019c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.663+0000 7f678d3019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:09.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.663+0000 7f678d3019c0 20 started sync module instance, tier type = 2024-09-12T17:32:09.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.663+0000 7f678d3019c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:09.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.687+0000 7f678d3019c0 20 add_watcher() i=0 2024-09-12T17:32:09.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.687+0000 7f678d3019c0 20 add_watcher() i=1 2024-09-12T17:32:09.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.687+0000 7f678d3019c0 20 add_watcher() i=2 2024-09-12T17:32:09.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.687+0000 7f678d3019c0 20 add_watcher() i=3 2024-09-12T17:32:09.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.687+0000 7f678d3019c0 20 add_watcher() i=4 2024-09-12T17:32:09.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.687+0000 7f678d3019c0 20 add_watcher() i=5 2024-09-12T17:32:09.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.687+0000 7f678d3019c0 20 add_watcher() i=6 2024-09-12T17:32:09.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.691+0000 7f678d3019c0 20 add_watcher() i=7 2024-09-12T17:32:09.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.691+0000 7f678d3019c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:09.698 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.695+0000 7f6641fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:09.699 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.695+0000 7f678d3019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:09.699 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.695+0000 7f678d3019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:09.700 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.695+0000 7f678d3019c0 5 note: GC not initialized 2024-09-12T17:32:09.700 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.695+0000 7f6640fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:09.700 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.699+0000 7f678d3019c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:09.700 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.699+0000 7f678d3019c0 20 Filter name: none 2024-09-12T17:32:09.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.699+0000 7f6639ffb640 20 reqs_thread_entry: start 2024-09-12T17:32:09.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.699+0000 7f678d3019c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:32:09.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.699+0000 7f678d3019c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.699+0000 7f678d3019c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:09.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.699+0000 7f678d3019c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:32:09.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.699+0000 7f678d3019c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:32:09.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.699+0000 7f678d3019c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 : miss 2024-09-12T17:32:09.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.699+0000 7f678d3019c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.699+0000 7f678d3019c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:09.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.699+0000 7f678d3019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 info.flags=0x17 2024-09-12T17:32:09.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.699+0000 7f678d3019c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 to cache LRU end 2024-09-12T17:32:09.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.699+0000 7f678d3019c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:09.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.699+0000 7f678d3019c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:32:09.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.699+0000 7f678d3019c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 2024-09-12T17:32:09.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.699+0000 7f678d3019c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:09.703 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.699+0000 7f678d3019c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:32:09.703 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.699+0000 7f678d3019c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:09.704 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.703+0000 7f678d3019c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T17:32:09.704 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.703+0000 7f678d3019c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:09.705 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.703+0000 7f678d3019c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:32:09.705 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.703+0000 7f678d3019c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:09.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.703+0000 7f678d3019c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:32:09.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.703+0000 7f678d3019c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:09.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.703+0000 7f678d3019c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:32:09.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.703+0000 7f678d3019c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:09.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.703+0000 7f678d3019c0 20 get_obj_state: octx=0x55f5fa28f3b0 obj=check-bucket:d state=0x55f5fa5cc468 s->prefetch_data=0 2024-09-12T17:32:09.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.703+0000 7f678d3019c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:09.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.707+0000 7f678d3019c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:32:09.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.707+0000 7f678d3019c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:09.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.707+0000 7f678d3019c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:32:09.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.707+0000 7f678d3019c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:09.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.707+0000 7f678d3019c0 20 get_obj_state: octx=0x55f5fa334390 obj=check-bucket:c state=0x55f5fa5c80c8 s->prefetch_data=0 2024-09-12T17:32:09.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.707+0000 7f678d3019c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:09.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.707+0000 7f678d3019c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:32:09.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.707+0000 7f678d3019c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:09.713 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.711+0000 7f678d3019c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T17:32:09.713 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.711+0000 7f678d3019c0 20 get_obj_state: setting s->obj_tag to 2paa5l8r6606cktccgszb592zmf4fp84 2024-09-12T17:32:09.713 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.711+0000 7f678d3019c0 20 get_obj_state_impl: setting s->olh_tag to iiwd3jz64t4zviy5n6x18twghh08ggf2 2024-09-12T17:32:09.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.711+0000 7f678d3019c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:09.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.711+0000 7f678d3019c0 20 get_obj_state: setting s->obj_tag to 2232d1wk1o8v4mta6k60l0je1z1fygcd 2024-09-12T17:32:09.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.711+0000 7f678d3019c0 20 get_obj_state_impl: setting s->olh_tag to 6lz9mojrgqu1uyjri4mqhsncu3cktnja 2024-09-12T17:32:09.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.711+0000 7f678d3019c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:09.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.711+0000 7f678d3019c0 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T17:32:09.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.711+0000 7f678d3019c0 20 olh_log_entry: epoch=4 op=3 key=d[RoH71g9CfdMwwtf9YVn63cIHtiecVyN] 2024-09-12T17:32:09.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.711+0000 7f678d3019c0 20 get_obj_state: octx=0x55f5fa5f4da0 obj=check-bucket:_:RoH71g9CfdMwwtf9YVn63cIHtiecVyN_d state=0x55f5fa6187c8 s->prefetch_data=0 2024-09-12T17:32:09.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.711+0000 7f678d3019c0 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T17:32:09.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.711+0000 7f678d3019c0 20 olh_log_entry: epoch=4 op=3 key=c[A7s5K2A9MpiSucHqXlTK8uk0HuYDbcy] 2024-09-12T17:32:09.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.711+0000 7f678d3019c0 20 get_obj_state: octx=0x55f5fa614da0 obj=check-bucket:_:A7s5K2A9MpiSucHqXlTK8uk0HuYDbcy_c state=0x55f5fa61e828 s->prefetch_data=0 2024-09-12T17:32:09.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.715+0000 7f678d3019c0 20 get_obj_state: octx=0x55f5fa614da0 obj=check-bucket:c state=0x55f5fa5c59a8 s->prefetch_data=0 2024-09-12T17:32:09.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.715+0000 7f678d3019c0 20 get_obj_state: octx=0x55f5fa5f4da0 obj=check-bucket:d state=0x55f5fa5c21e8 s->prefetch_data=0 2024-09-12T17:32:09.719 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.715+0000 7f678d3019c0 20 get_obj_state: setting s->obj_tag to 2232d1wk1o8v4mta6k60l0je1z1fygcd 2024-09-12T17:32:09.719 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.715+0000 7f678d3019c0 20 get_obj_state_impl: setting s->olh_tag to 6lz9mojrgqu1uyjri4mqhsncu3cktnja 2024-09-12T17:32:09.719 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.715+0000 7f678d3019c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6lz9mojrgqu1uyjri4mqhsncu3cktnja 2024-09-12T17:32:09.719 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.715+0000 7f678d3019c0 20 get_obj_state: setting s->obj_tag to 2paa5l8r6606cktccgszb592zmf4fp84 2024-09-12T17:32:09.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.715+0000 7f678d3019c0 20 get_obj_state_impl: setting s->olh_tag to iiwd3jz64t4zviy5n6x18twghh08ggf2 2024-09-12T17:32:09.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.715+0000 7f678d3019c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=iiwd3jz64t4zviy5n6x18twghh08ggf2 2024-09-12T17:32:09.732 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.727+0000 7f678d3019c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:09.732 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.731+0000 7f678d3019c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:09.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.731+0000 7f678d3019c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:32:09.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.731+0000 7f678d3019c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:32:09.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.731+0000 7f678d3019c0 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T17:32:09.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.735+0000 7f6641fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:09.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.739+0000 7f678d3019c0 20 remove_watcher() i=0 2024-09-12T17:32:09.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.739+0000 7f678d3019c0 2 removed watcher, disabling cache 2024-09-12T17:32:09.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.743+0000 7f678d3019c0 20 remove_watcher() i=1 2024-09-12T17:32:09.746 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.743+0000 7f678d3019c0 20 remove_watcher() i=2 2024-09-12T17:32:09.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.747+0000 7f678d3019c0 20 remove_watcher() i=3 2024-09-12T17:32:09.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.747+0000 7f678d3019c0 20 remove_watcher() i=4 2024-09-12T17:32:09.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.751+0000 7f678d3019c0 20 remove_watcher() i=5 2024-09-12T17:32:09.754 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.751+0000 7f678d3019c0 20 remove_watcher() i=6 2024-09-12T17:32:09.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.755+0000 7f678d3019c0 20 remove_watcher() i=7 2024-09-12T17:32:09.772 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:32:09.804 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:09.804 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:09.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.847+0000 7f59be7d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.847+0000 7f59be7d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:09.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.847+0000 7f59be7d19c0 20 realm 2024-09-12T17:32:09.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.847+0000 7f59be7d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.851+0000 7f59be7d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:09.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.851+0000 7f59be7d19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:09.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.851+0000 7f59be7d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.851+0000 7f59be7d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:09.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.851+0000 7f59be7d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.851+0000 7f59be7d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:09.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.851+0000 7f59be7d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.855 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.851+0000 7f59be7d19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:09.855 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.851+0000 7f59be7d19c0 20 searching for the correct realm 2024-09-12T17:32:09.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.859+0000 7f59bbad6640 0 -- 172.21.15.98:0/4293775167 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x564888feb9e0 msgr2=0x564888feddd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:09.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.863+0000 7f59bc2d7640 0 -- 172.21.15.98:0/4293775167 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f59b0022450 msgr2=0x7f59b00228b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:09.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.871+0000 7f59be7d19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:09.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.871+0000 7f59be7d19c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:09.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.871+0000 7f59be7d19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:09.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.871+0000 7f59be7d19c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:09.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.871+0000 7f59be7d19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:09.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.871+0000 7f59be7d19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:09.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.871+0000 7f59be7d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.871+0000 7f59be7d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:09.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.871+0000 7f59be7d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.876 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.871+0000 7f59be7d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:09.876 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.871+0000 7f59be7d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.875+0000 7f59be7d19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:09.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.875+0000 7f59be7d19c0 20 zone default found 2024-09-12T17:32:09.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.875+0000 7f59be7d19c0 4 Realm: () 2024-09-12T17:32:09.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.875+0000 7f59be7d19c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:09.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.875+0000 7f59be7d19c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:09.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.875+0000 7f59be7d19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:09.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.875+0000 7f59be7d19c0 20 zonegroup default 2024-09-12T17:32:09.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.875+0000 7f59be7d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.875+0000 7f59be7d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:09.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.875+0000 7f59be7d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.878 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.875+0000 7f59be7d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:09.878 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.875+0000 7f59be7d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.878 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.875+0000 7f59be7d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:09.878 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.875+0000 7f59be7d19c0 20 started sync module instance, tier type = 2024-09-12T17:32:09.878 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.875+0000 7f59be7d19c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:09.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.899+0000 7f59be7d19c0 20 add_watcher() i=0 2024-09-12T17:32:09.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.899+0000 7f59be7d19c0 20 add_watcher() i=1 2024-09-12T17:32:09.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.899+0000 7f59be7d19c0 20 add_watcher() i=2 2024-09-12T17:32:09.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.899+0000 7f59be7d19c0 20 add_watcher() i=3 2024-09-12T17:32:09.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.899+0000 7f59be7d19c0 20 add_watcher() i=4 2024-09-12T17:32:09.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.899+0000 7f59be7d19c0 20 add_watcher() i=5 2024-09-12T17:32:09.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.899+0000 7f59be7d19c0 20 add_watcher() i=6 2024-09-12T17:32:09.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.899+0000 7f59be7d19c0 20 add_watcher() i=7 2024-09-12T17:32:09.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.899+0000 7f59be7d19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:09.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.899+0000 7f5872fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:09.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.903+0000 7f59be7d19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:09.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.903+0000 7f59be7d19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:09.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.903+0000 7f59be7d19c0 5 note: GC not initialized 2024-09-12T17:32:09.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.903+0000 7f5871fdb640 20 reqs_thread_entry: start 2024-09-12T17:32:09.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.903+0000 7f59be7d19c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:09.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.903+0000 7f59be7d19c0 20 Filter name: none 2024-09-12T17:32:09.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.903+0000 7f57e37fe640 20 reqs_thread_entry: start 2024-09-12T17:32:09.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.903+0000 7f59be7d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.903+0000 7f59be7d19c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:09.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.903+0000 7f59be7d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:09.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.903+0000 7f59be7d19c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:09.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.903+0000 7f59be7d19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:09.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.903+0000 7f59be7d19c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:32:09.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.903+0000 7f59be7d19c0 20 INFO: main: starting shard=0 2024-09-12T17:32:09.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.903+0000 7f59be7d19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:09.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.903+0000 7f59be7d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:09.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.903+0000 7f59be7d19c0 20 INFO: main: starting shard=1 2024-09-12T17:32:09.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.903+0000 7f59be7d19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:09.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.907+0000 7f59be7d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:09.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.907+0000 7f59be7d19c0 20 INFO: main: starting shard=2 2024-09-12T17:32:09.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.907+0000 7f59be7d19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:09.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.907+0000 7f59be7d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:09.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.907+0000 7f59be7d19c0 20 INFO: main: starting shard=3 2024-09-12T17:32:09.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.907+0000 7f59be7d19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:09.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.907+0000 7f59be7d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:09.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.907+0000 7f59be7d19c0 20 INFO: main: starting shard=4 2024-09-12T17:32:09.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.907+0000 7f59be7d19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:09.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.911+0000 7f59be7d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:09.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.911+0000 7f59be7d19c0 20 INFO: main: starting shard=5 2024-09-12T17:32:09.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.911+0000 7f59be7d19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:09.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.911+0000 7f59be7d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:09.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.911+0000 7f59be7d19c0 20 INFO: main: starting shard=6 2024-09-12T17:32:09.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.911+0000 7f59be7d19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:09.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.911+0000 7f59be7d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:09.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.911+0000 7f59be7d19c0 20 INFO: main: starting shard=7 2024-09-12T17:32:09.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.911+0000 7f59be7d19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:09.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.911+0000 7f59be7d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:09.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.911+0000 7f59be7d19c0 20 INFO: main: starting shard=8 2024-09-12T17:32:09.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.911+0000 7f59be7d19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:09.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.911+0000 7f59be7d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:09.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.911+0000 7f59be7d19c0 20 INFO: main: starting shard=9 2024-09-12T17:32:09.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.911+0000 7f59be7d19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:09.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.915+0000 7f59be7d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:09.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.915+0000 7f59be7d19c0 20 INFO: main: starting shard=10 2024-09-12T17:32:09.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.915+0000 7f59be7d19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:09.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.915+0000 7f59be7d19c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:09.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.915+0000 7f59be7d19c0 20 INFO: main: done 2024-09-12T17:32:09.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.915+0000 7f5872fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:09.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.923+0000 7f59be7d19c0 20 remove_watcher() i=0 2024-09-12T17:32:09.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.923+0000 7f59be7d19c0 2 removed watcher, disabling cache 2024-09-12T17:32:09.927 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.923+0000 7f59be7d19c0 20 remove_watcher() i=1 2024-09-12T17:32:09.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.927+0000 7f59be7d19c0 20 remove_watcher() i=2 2024-09-12T17:32:09.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.927+0000 7f59be7d19c0 20 remove_watcher() i=3 2024-09-12T17:32:09.933 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.931+0000 7f59be7d19c0 20 remove_watcher() i=4 2024-09-12T17:32:09.935 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.931+0000 7f59be7d19c0 20 remove_watcher() i=5 2024-09-12T17:32:09.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.935+0000 7f59be7d19c0 20 remove_watcher() i=6 2024-09-12T17:32:09.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:09.935+0000 7f59be7d19c0 20 remove_watcher() i=7 2024-09-12T17:32:09.951 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:32:09.981 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:09.981 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:10.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.019+0000 7fe199d209c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.023+0000 7fe199d209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:10.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.023+0000 7fe199d209c0 20 realm 2024-09-12T17:32:10.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.023+0000 7fe199d209c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.023+0000 7fe199d209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:10.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.023+0000 7fe199d209c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:10.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.023+0000 7fe199d209c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.023+0000 7fe199d209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:10.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.023+0000 7fe199d209c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.023+0000 7fe199d209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:10.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.023+0000 7fe199d209c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.023+0000 7fe199d209c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:10.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.023+0000 7fe199d209c0 20 searching for the correct realm 2024-09-12T17:32:10.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.031+0000 7fe197025640 0 -- 172.21.15.98:0/1768645233 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fe1880e3550 msgr2=0x7fe1880ed400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:10.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.035+0000 7fe197025640 0 -- 172.21.15.98:0/1768645233 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fe06007e6f0 msgr2=0x7fe060080b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:10.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:10.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:10.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:10.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:10.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:10.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:10.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.046 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:10.046 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.046 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:10.046 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:10.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 20 zone default found 2024-09-12T17:32:10.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 4 Realm: () 2024-09-12T17:32:10.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:10.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:10.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:10.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 20 zonegroup default 2024-09-12T17:32:10.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:10.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.043+0000 7fe199d209c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.047+0000 7fe199d209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:10.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.047+0000 7fe199d209c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.047+0000 7fe199d209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:10.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.047+0000 7fe199d209c0 20 started sync module instance, tier type = 2024-09-12T17:32:10.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.047+0000 7fe199d209c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:10.069 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.067+0000 7fe199d209c0 20 add_watcher() i=0 2024-09-12T17:32:10.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.067+0000 7fe199d209c0 20 add_watcher() i=1 2024-09-12T17:32:10.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.067+0000 7fe199d209c0 20 add_watcher() i=2 2024-09-12T17:32:10.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.067+0000 7fe199d209c0 20 add_watcher() i=3 2024-09-12T17:32:10.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.067+0000 7fe199d209c0 20 add_watcher() i=4 2024-09-12T17:32:10.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.067+0000 7fe199d209c0 20 add_watcher() i=5 2024-09-12T17:32:10.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.067+0000 7fe199d209c0 20 add_watcher() i=6 2024-09-12T17:32:10.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.071+0000 7fe199d209c0 20 add_watcher() i=7 2024-09-12T17:32:10.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.071+0000 7fe199d209c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:10.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.071+0000 7fe04dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:10.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.071+0000 7fe199d209c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:10.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.071+0000 7fe199d209c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:10.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.071+0000 7fe199d209c0 5 note: GC not initialized 2024-09-12T17:32:10.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.071+0000 7fe04cfe1640 20 reqs_thread_entry: start 2024-09-12T17:32:10.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.071+0000 7fe199d209c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:10.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.071+0000 7fe199d209c0 20 Filter name: none 2024-09-12T17:32:10.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.071+0000 7fdfc67fc640 20 reqs_thread_entry: start 2024-09-12T17:32:10.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.071+0000 7fe199d209c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.075+0000 7fe199d209c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:10.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.075+0000 7fe199d209c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.075+0000 7fe199d209c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:10.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.075+0000 7fe199d209c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:10.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.075+0000 7fe199d209c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:32:10.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.075+0000 7fe199d209c0 20 INFO: main: starting shard=0 2024-09-12T17:32:10.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.075+0000 7fe199d209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:10.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.075+0000 7fe199d209c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:10.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.075+0000 7fe199d209c0 20 INFO: main: starting shard=1 2024-09-12T17:32:10.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.075+0000 7fe199d209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:10.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.075+0000 7fe199d209c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:10.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.075+0000 7fe199d209c0 20 INFO: main: starting shard=2 2024-09-12T17:32:10.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.075+0000 7fe199d209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:10.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.079+0000 7fe199d209c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:10.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.079+0000 7fe199d209c0 20 INFO: main: starting shard=3 2024-09-12T17:32:10.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.079+0000 7fe199d209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:10.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.079+0000 7fe199d209c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:10.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.079+0000 7fe199d209c0 20 INFO: main: starting shard=4 2024-09-12T17:32:10.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.079+0000 7fe199d209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:10.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.079+0000 7fe199d209c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:10.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.079+0000 7fe199d209c0 20 INFO: main: starting shard=5 2024-09-12T17:32:10.082 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.079+0000 7fe199d209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:10.082 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.079+0000 7fe199d209c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:10.082 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.079+0000 7fe199d209c0 20 INFO: main: starting shard=6 2024-09-12T17:32:10.082 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.079+0000 7fe199d209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:10.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.079+0000 7fe199d209c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:10.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.079+0000 7fe199d209c0 20 INFO: main: starting shard=7 2024-09-12T17:32:10.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.079+0000 7fe199d209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:10.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.079+0000 7fe199d209c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:10.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.079+0000 7fe199d209c0 20 INFO: main: starting shard=8 2024-09-12T17:32:10.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.079+0000 7fe199d209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:10.084 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.083+0000 7fe199d209c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:10.084 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.083+0000 7fe199d209c0 20 INFO: main: starting shard=9 2024-09-12T17:32:10.084 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.083+0000 7fe199d209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:10.085 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.083+0000 7fe199d209c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:10.085 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.083+0000 7fe199d209c0 20 INFO: main: starting shard=10 2024-09-12T17:32:10.086 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.083+0000 7fe199d209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:10.086 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.083+0000 7fe199d209c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:10.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.083+0000 7fe199d209c0 20 INFO: main: done 2024-09-12T17:32:10.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.083+0000 7fe04dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:10.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.091+0000 7fe199d209c0 20 remove_watcher() i=0 2024-09-12T17:32:10.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.091+0000 7fe199d209c0 2 removed watcher, disabling cache 2024-09-12T17:32:10.095 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.091+0000 7fe199d209c0 20 remove_watcher() i=1 2024-09-12T17:32:10.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.095+0000 7fe199d209c0 20 remove_watcher() i=2 2024-09-12T17:32:10.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.095+0000 7fe199d209c0 20 remove_watcher() i=3 2024-09-12T17:32:10.101 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.099+0000 7fe199d209c0 20 remove_watcher() i=4 2024-09-12T17:32:10.102 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.099+0000 7fe199d209c0 20 remove_watcher() i=5 2024-09-12T17:32:10.104 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.103+0000 7fe199d209c0 20 remove_watcher() i=6 2024-09-12T17:32:10.105 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.103+0000 7fe199d209c0 20 remove_watcher() i=7 2024-09-12T17:32:10.118 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T17:32:10.118 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:32:10.119 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T17:32:10.148 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:10.149 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:10.191 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.187+0000 7f0a289979c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.191+0000 7f0a289979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:10.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.191+0000 7f0a289979c0 20 realm 2024-09-12T17:32:10.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.191+0000 7f0a289979c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.191+0000 7f0a289979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:10.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.191+0000 7f0a289979c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:10.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.191+0000 7f0a289979c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.191+0000 7f0a289979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:10.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.191+0000 7f0a289979c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.191+0000 7f0a289979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:10.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.191+0000 7f0a289979c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.191+0000 7f0a289979c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:10.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.191+0000 7f0a289979c0 20 searching for the correct realm 2024-09-12T17:32:10.205 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.195+0000 7f0a26c9e640 0 -- 172.21.15.98:0/3298622546 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f0a1c0bf040 msgr2=0x7f0a1c108620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:10.205 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.203+0000 7f0a2649d640 0 -- 172.21.15.98:0/3298622546 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f0a1c103b30 msgr2=0x7f0a1c108620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:10.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.419+0000 7f0a289979c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:10.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.419+0000 7f0a289979c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:10.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.419+0000 7f0a289979c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:10.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.419+0000 7f0a289979c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:10.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.419+0000 7f0a289979c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:10.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.419+0000 7f0a289979c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:10.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.419+0000 7f0a289979c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.419+0000 7f0a289979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:10.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.419+0000 7f0a289979c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.424 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.423+0000 7f0a289979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:10.424 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.423+0000 7f0a289979c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.423+0000 7f0a289979c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:10.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.423+0000 7f0a289979c0 20 zone default found 2024-09-12T17:32:10.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.423+0000 7f0a289979c0 4 Realm: () 2024-09-12T17:32:10.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.423+0000 7f0a289979c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:10.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.423+0000 7f0a289979c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:10.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.423+0000 7f0a289979c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:10.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.423+0000 7f0a289979c0 20 zonegroup default 2024-09-12T17:32:10.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.423+0000 7f0a289979c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.423+0000 7f0a289979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:10.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.423+0000 7f0a289979c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.423+0000 7f0a289979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:10.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.423+0000 7f0a289979c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.423+0000 7f0a289979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:10.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.423+0000 7f0a289979c0 20 started sync module instance, tier type = 2024-09-12T17:32:10.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.423+0000 7f0a289979c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:10.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.451+0000 7f0a289979c0 20 add_watcher() i=0 2024-09-12T17:32:10.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.451+0000 7f0a289979c0 20 add_watcher() i=1 2024-09-12T17:32:10.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.451+0000 7f0a289979c0 20 add_watcher() i=2 2024-09-12T17:32:10.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.451+0000 7f0a289979c0 20 add_watcher() i=3 2024-09-12T17:32:10.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.451+0000 7f0a289979c0 20 add_watcher() i=4 2024-09-12T17:32:10.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.451+0000 7f0a289979c0 20 add_watcher() i=5 2024-09-12T17:32:10.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.451+0000 7f0a289979c0 20 add_watcher() i=6 2024-09-12T17:32:10.458 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.455+0000 7f0a289979c0 20 add_watcher() i=7 2024-09-12T17:32:10.458 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.455+0000 7f0a289979c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:10.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.459+0000 7f08dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:10.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f0a289979c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:10.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f0a289979c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:10.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f0a289979c0 5 note: GC not initialized 2024-09-12T17:32:10.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f08577fe640 20 reqs_thread_entry: start 2024-09-12T17:32:10.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f0a289979c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:10.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f0a289979c0 20 Filter name: none 2024-09-12T17:32:10.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f08557fa640 20 reqs_thread_entry: start 2024-09-12T17:32:10.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f0a289979c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:32:10.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f0a289979c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f0a289979c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:10.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f0a289979c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:32:10.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f0a289979c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:32:10.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f0a289979c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 : miss 2024-09-12T17:32:10.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f0a289979c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:10.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f0a289979c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:10.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f0a289979c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 info.flags=0x17 2024-09-12T17:32:10.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f0a289979c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 to cache LRU end 2024-09-12T17:32:10.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f0a289979c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:10.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f0a289979c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:32:10.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f0a289979c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 2024-09-12T17:32:10.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.463+0000 7f0a289979c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:10.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.467+0000 7f0a289979c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T17:32:10.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.467+0000 7f0a289979c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:10.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.467+0000 7f0a289979c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T17:32:10.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.467+0000 7f0a289979c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:10.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.471+0000 7f0a289979c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T17:32:10.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.471+0000 7f0a289979c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:10.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.471+0000 7f0a289979c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T17:32:10.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.471+0000 7f0a289979c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:10.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.471+0000 7f0a289979c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T17:32:10.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.471+0000 7f0a289979c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:10.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.471+0000 7f0a289979c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T17:32:10.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.471+0000 7f0a289979c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:10.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.471+0000 7f0a289979c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T17:32:10.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.471+0000 7f0a289979c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:10.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.475+0000 7f0a289979c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T17:32:10.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.475+0000 7f0a289979c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:10.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.475+0000 7f0a289979c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T17:32:10.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.475+0000 7f0a289979c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:10.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.475+0000 7f0a289979c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T17:32:10.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.475+0000 7f0a289979c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:10.480 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.479+0000 7f0a289979c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T17:32:10.481 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.479+0000 7f0a289979c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T17:32:10.482 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.479+0000 7f08dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:10.487 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.483+0000 7f0a289979c0 20 remove_watcher() i=0 2024-09-12T17:32:10.487 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.483+0000 7f0a289979c0 2 removed watcher, disabling cache 2024-09-12T17:32:10.489 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.487+0000 7f0a289979c0 20 remove_watcher() i=1 2024-09-12T17:32:10.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.491+0000 7f0a289979c0 20 remove_watcher() i=2 2024-09-12T17:32:10.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.491+0000 7f0a289979c0 20 remove_watcher() i=3 2024-09-12T17:32:10.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.495+0000 7f0a289979c0 20 remove_watcher() i=4 2024-09-12T17:32:10.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.495+0000 7f0a289979c0 20 remove_watcher() i=5 2024-09-12T17:32:10.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.499+0000 7f0a289979c0 20 remove_watcher() i=6 2024-09-12T17:32:10.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:10.499+0000 7f0a289979c0 20 remove_watcher() i=7 2024-09-12T17:32:10.524 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T17:32:10.525 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:32:10.526 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:10.526 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:10.580 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:10.580 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:10.651 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:10.651 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:10.788 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T17:32:10.788 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:32:10.790 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:10.791 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:10.924 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:10.924 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:11.420 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:11.421 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:11.571 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:11.571 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:11.630 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:11.630 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:11.762 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:11.762 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:11.799 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:11.799 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:11.942 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:11.942 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:12.009 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:12.010 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:12.164 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:12.165 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:12.225 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:12.225 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:12.358 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:12.358 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:12.426 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:12.426 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:12.545 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:12.545 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:12.610 INFO:tasks.workunit.client.0.smithi098.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T17:32:13.056 INFO:tasks.workunit.client.0.smithi098.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T17:32:14.490 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:14.491 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:14.661 INFO:tasks.workunit.client.0.smithi098.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:32:14.661 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T17:32:14.697 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:14.697 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:14.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.738+0000 7f2144f719c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:14.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.742+0000 7f2144f719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:14.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.742+0000 7f2144f719c0 20 realm 2024-09-12T17:32:14.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.742+0000 7f2144f719c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:14.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.742+0000 7f2144f719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:14.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.742+0000 7f2144f719c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:14.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.742+0000 7f2144f719c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:14.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.742+0000 7f2144f719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:14.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.742+0000 7f2144f719c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:14.746 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.742+0000 7f2144f719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:14.746 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.742+0000 7f2144f719c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:14.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.742+0000 7f2144f719c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:14.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.742+0000 7f2144f719c0 20 searching for the correct realm 2024-09-12T17:32:14.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.746+0000 7f2142a77640 0 -- 172.21.15.98:0/3879972377 >> [v2:172.21.15.98:6816/1225764258,v1:172.21.15.98:6817/1225764258] conn(0x7f213c0c4040 msgr2=0x7f213c0b4450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:14.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.962+0000 7f2143278640 0 -- 172.21.15.98:0/3879972377 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f2138008050 msgr2=0x7f2138016930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:14.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.974+0000 7f2144f719c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:14.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.974+0000 7f2144f719c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:14.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.974+0000 7f2144f719c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:14.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.974+0000 7f2144f719c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:14.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.974+0000 7f2144f719c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:14.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.974+0000 7f2144f719c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:14.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.974+0000 7f2144f719c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:14.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.978+0000 7f2144f719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:14.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.978+0000 7f2144f719c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:14.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.978+0000 7f2144f719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:14.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.978+0000 7f2144f719c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:14.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.978+0000 7f2144f719c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:14.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.978+0000 7f2144f719c0 20 zone default found 2024-09-12T17:32:14.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.978+0000 7f2144f719c0 4 Realm: () 2024-09-12T17:32:14.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.978+0000 7f2144f719c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:14.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.978+0000 7f2144f719c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:14.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.978+0000 7f2144f719c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:14.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.978+0000 7f2144f719c0 20 zonegroup default 2024-09-12T17:32:14.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.978+0000 7f2144f719c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:14.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.978+0000 7f2144f719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:14.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.978+0000 7f2144f719c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:14.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.978+0000 7f2144f719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:14.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.978+0000 7f2144f719c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:14.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.982+0000 7f2144f719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:14.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.982+0000 7f2144f719c0 20 started sync module instance, tier type = 2024-09-12T17:32:14.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:14.982+0000 7f2144f719c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:15.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.006+0000 7f2144f719c0 20 add_watcher() i=0 2024-09-12T17:32:15.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.006+0000 7f2144f719c0 20 add_watcher() i=1 2024-09-12T17:32:15.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.006+0000 7f2144f719c0 20 add_watcher() i=2 2024-09-12T17:32:15.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.006+0000 7f2144f719c0 20 add_watcher() i=3 2024-09-12T17:32:15.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.006+0000 7f2144f719c0 20 add_watcher() i=4 2024-09-12T17:32:15.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.006+0000 7f2144f719c0 20 add_watcher() i=5 2024-09-12T17:32:15.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.006+0000 7f2144f719c0 20 add_watcher() i=6 2024-09-12T17:32:15.011 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.006+0000 7f2144f719c0 20 add_watcher() i=7 2024-09-12T17:32:15.011 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.006+0000 7f2144f719c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:15.016 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.010+0000 7f1ff97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:15.016 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.014+0000 7f2144f719c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:15.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.014+0000 7f2144f719c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:15.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.014+0000 7f2144f719c0 5 note: GC not initialized 2024-09-12T17:32:15.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.014+0000 7f1f73fff640 20 reqs_thread_entry: start 2024-09-12T17:32:15.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.014+0000 7f2144f719c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:15.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.014+0000 7f2144f719c0 20 Filter name: none 2024-09-12T17:32:15.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.014+0000 7f1f71ffb640 20 reqs_thread_entry: start 2024-09-12T17:32:15.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.014+0000 7f2144f719c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.014+0000 7f2144f719c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:15.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.014+0000 7f2144f719c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.014+0000 7f2144f719c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:15.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.014+0000 7f2144f719c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:15.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.014+0000 7f2144f719c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:32:15.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.014+0000 7f2144f719c0 20 INFO: main: starting shard=0 2024-09-12T17:32:15.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.014+0000 7f2144f719c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:15.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.018+0000 7f2144f719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.018+0000 7f2144f719c0 20 INFO: main: starting shard=1 2024-09-12T17:32:15.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.018+0000 7f2144f719c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:15.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.018+0000 7f2144f719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.018+0000 7f2144f719c0 20 INFO: main: starting shard=2 2024-09-12T17:32:15.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.018+0000 7f2144f719c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:15.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.022+0000 7f2144f719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.022+0000 7f2144f719c0 20 INFO: main: starting shard=3 2024-09-12T17:32:15.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.022+0000 7f2144f719c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:15.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.022+0000 7f2144f719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.022+0000 7f2144f719c0 20 INFO: main: starting shard=4 2024-09-12T17:32:15.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.022+0000 7f2144f719c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:15.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.022+0000 7f2144f719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.022+0000 7f2144f719c0 20 INFO: main: starting shard=5 2024-09-12T17:32:15.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.022+0000 7f2144f719c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:15.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.022+0000 7f2144f719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.022+0000 7f2144f719c0 20 INFO: main: starting shard=6 2024-09-12T17:32:15.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.022+0000 7f2144f719c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:15.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.026+0000 7f2144f719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.026+0000 7f2144f719c0 20 INFO: main: starting shard=7 2024-09-12T17:32:15.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.026+0000 7f2144f719c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:15.029 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.026+0000 7f2144f719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.030 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.026+0000 7f2144f719c0 20 INFO: main: starting shard=8 2024-09-12T17:32:15.030 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.026+0000 7f2144f719c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:15.030 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.026+0000 7f2144f719c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:32:15.030 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.026+0000 7f2144f719c0 20 INFO: main: starting shard=9 2024-09-12T17:32:15.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.026+0000 7f2144f719c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:15.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.026+0000 7f2144f719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.026+0000 7f2144f719c0 20 INFO: main: starting shard=10 2024-09-12T17:32:15.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.026+0000 7f2144f719c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:15.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.030+0000 7f2144f719c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.030+0000 7f2144f719c0 20 INFO: main: done 2024-09-12T17:32:15.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.030+0000 7f1ff97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:15.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.038+0000 7f2144f719c0 20 remove_watcher() i=0 2024-09-12T17:32:15.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.038+0000 7f2144f719c0 2 removed watcher, disabling cache 2024-09-12T17:32:15.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.038+0000 7f2144f719c0 20 remove_watcher() i=1 2024-09-12T17:32:15.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.042+0000 7f2144f719c0 20 remove_watcher() i=2 2024-09-12T17:32:15.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.046+0000 7f2144f719c0 20 remove_watcher() i=3 2024-09-12T17:32:15.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.046+0000 7f2144f719c0 20 remove_watcher() i=4 2024-09-12T17:32:15.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.046+0000 7f2144f719c0 20 remove_watcher() i=5 2024-09-12T17:32:15.053 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.050+0000 7f2144f719c0 20 remove_watcher() i=6 2024-09-12T17:32:15.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.050+0000 7f2144f719c0 20 remove_watcher() i=7 2024-09-12T17:32:15.079 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:15.080 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:15.114 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:15.114 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:15.277 INFO:tasks.workunit.client.0.smithi098.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:32:15.278 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T17:32:15.314 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:15.314 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:15.360 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.358+0000 7f71821e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.362 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.358+0000 7f71821e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:15.362 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.358+0000 7f71821e49c0 20 realm 2024-09-12T17:32:15.362 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.358+0000 7f71821e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.362 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.358+0000 7f71821e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:15.362 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.358+0000 7f71821e49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:15.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.358+0000 7f71821e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.358+0000 7f71821e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:15.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.358+0000 7f71821e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.362+0000 7f71821e49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:15.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.362+0000 7f71821e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.362+0000 7f71821e49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:15.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.362+0000 7f71821e49c0 20 searching for the correct realm 2024-09-12T17:32:15.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.366+0000 7f717f4e9640 0 -- 172.21.15.98:0/3763647906 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x557d5a94ed10 msgr2=0x557d5a951100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:15.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.370+0000 7f717fcea640 0 -- 172.21.15.98:0/3763647906 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f71740920b0 msgr2=0x7f717405b630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:15.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.378+0000 7f71821e49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:15.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.378+0000 7f71821e49c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:15.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.378+0000 7f71821e49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:15.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.378+0000 7f71821e49c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:15.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.378+0000 7f71821e49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:15.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.378+0000 7f71821e49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:15.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.378+0000 7f71821e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.378+0000 7f71821e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:15.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.378+0000 7f71821e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.384 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.378+0000 7f71821e49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:15.384 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.378+0000 7f71821e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.382+0000 7f71821e49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:15.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.382+0000 7f71821e49c0 20 zone default found 2024-09-12T17:32:15.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.382+0000 7f71821e49c0 4 Realm: () 2024-09-12T17:32:15.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.382+0000 7f71821e49c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:15.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.382+0000 7f71821e49c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:15.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.382+0000 7f71821e49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:15.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.382+0000 7f71821e49c0 20 zonegroup default 2024-09-12T17:32:15.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.382+0000 7f71821e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.382+0000 7f71821e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:15.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.382+0000 7f71821e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.382+0000 7f71821e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:15.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.382+0000 7f71821e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.382+0000 7f71821e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:15.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.382+0000 7f71821e49c0 20 started sync module instance, tier type = 2024-09-12T17:32:15.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.382+0000 7f71821e49c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:15.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.398+0000 7f71821e49c0 20 add_watcher() i=0 2024-09-12T17:32:15.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.398+0000 7f71821e49c0 20 add_watcher() i=1 2024-09-12T17:32:15.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.398+0000 7f71821e49c0 20 add_watcher() i=2 2024-09-12T17:32:15.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.398+0000 7f71821e49c0 20 add_watcher() i=3 2024-09-12T17:32:15.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.398+0000 7f71821e49c0 20 add_watcher() i=4 2024-09-12T17:32:15.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.398+0000 7f71821e49c0 20 add_watcher() i=5 2024-09-12T17:32:15.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.398+0000 7f71821e49c0 20 add_watcher() i=6 2024-09-12T17:32:15.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.398+0000 7f71821e49c0 20 add_watcher() i=7 2024-09-12T17:32:15.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.398+0000 7f71821e49c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:15.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.402+0000 7f70367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:15.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.402+0000 7f71821e49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:15.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.402+0000 7f71821e49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:15.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.402+0000 7f71821e49c0 5 note: GC not initialized 2024-09-12T17:32:15.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.402+0000 7f70357e2640 20 reqs_thread_entry: start 2024-09-12T17:32:15.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.402+0000 7f71821e49c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:15.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.402+0000 7f71821e49c0 20 Filter name: none 2024-09-12T17:32:15.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.402+0000 7f702e7fc640 20 reqs_thread_entry: start 2024-09-12T17:32:15.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.402+0000 7f71821e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.407 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.402+0000 7f71821e49c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:15.407 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.402+0000 7f71821e49c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.407 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.402+0000 7f71821e49c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:15.407 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.402+0000 7f71821e49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:15.407 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.402+0000 7f71821e49c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:32:15.407 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.402+0000 7f71821e49c0 20 INFO: main: starting shard=0 2024-09-12T17:32:15.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.402+0000 7f71821e49c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:15.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.406+0000 7f71821e49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.406+0000 7f71821e49c0 20 INFO: main: starting shard=1 2024-09-12T17:32:15.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.406+0000 7f71821e49c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:15.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.406+0000 7f71821e49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.406+0000 7f71821e49c0 20 INFO: main: starting shard=2 2024-09-12T17:32:15.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.406+0000 7f71821e49c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:15.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.406+0000 7f71821e49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.406+0000 7f71821e49c0 20 INFO: main: starting shard=3 2024-09-12T17:32:15.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.406+0000 7f71821e49c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:15.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.410+0000 7f71821e49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.410+0000 7f71821e49c0 20 INFO: main: starting shard=4 2024-09-12T17:32:15.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.410+0000 7f71821e49c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:15.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.410+0000 7f71821e49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.410+0000 7f71821e49c0 20 INFO: main: starting shard=5 2024-09-12T17:32:15.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.410+0000 7f71821e49c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:15.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.410+0000 7f71821e49c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T17:32:15.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.410+0000 7f71821e49c0 20 INFO: main: starting shard=6 2024-09-12T17:32:15.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.410+0000 7f71821e49c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:15.415 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.410+0000 7f71821e49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.415 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.410+0000 7f71821e49c0 20 INFO: main: starting shard=7 2024-09-12T17:32:15.415 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.410+0000 7f71821e49c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:15.416 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.410+0000 7f71821e49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.416 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.410+0000 7f71821e49c0 20 INFO: main: starting shard=8 2024-09-12T17:32:15.416 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.410+0000 7f71821e49c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:15.417 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.414+0000 7f71821e49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.417 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.414+0000 7f71821e49c0 20 INFO: main: starting shard=9 2024-09-12T17:32:15.417 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.414+0000 7f71821e49c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:15.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.414+0000 7f71821e49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.414+0000 7f71821e49c0 20 INFO: main: starting shard=10 2024-09-12T17:32:15.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.414+0000 7f71821e49c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:15.420 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.414+0000 7f71821e49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.420 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.414+0000 7f71821e49c0 20 INFO: main: done 2024-09-12T17:32:15.420 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.418+0000 7f70367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:15.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.422+0000 7f71821e49c0 20 remove_watcher() i=0 2024-09-12T17:32:15.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.422+0000 7f71821e49c0 2 removed watcher, disabling cache 2024-09-12T17:32:15.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.422+0000 7f71821e49c0 20 remove_watcher() i=1 2024-09-12T17:32:15.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.426+0000 7f71821e49c0 20 remove_watcher() i=2 2024-09-12T17:32:15.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.426+0000 7f71821e49c0 20 remove_watcher() i=3 2024-09-12T17:32:15.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.430+0000 7f71821e49c0 20 remove_watcher() i=4 2024-09-12T17:32:15.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.430+0000 7f71821e49c0 20 remove_watcher() i=5 2024-09-12T17:32:15.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.434+0000 7f71821e49c0 20 remove_watcher() i=6 2024-09-12T17:32:15.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.434+0000 7f71821e49c0 20 remove_watcher() i=7 2024-09-12T17:32:15.454 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:15.454 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:15.482 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:15.482 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:15.601 INFO:tasks.workunit.client.0.smithi098.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:32:15.602 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T17:32:15.636 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:15.636 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:15.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.678+0000 7ff0814ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.684 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.678+0000 7ff0814ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:15.685 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.678+0000 7ff0814ff9c0 20 realm 2024-09-12T17:32:15.685 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.678+0000 7ff0814ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.685 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.678+0000 7ff0814ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:15.685 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.678+0000 7ff0814ff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:15.685 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.678+0000 7ff0814ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.686 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.678+0000 7ff0814ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:15.686 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.678+0000 7ff0814ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.687 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.682+0000 7ff0814ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:15.687 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.682+0000 7ff0814ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.687 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.682+0000 7ff0814ff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:15.688 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.682+0000 7ff0814ff9c0 20 searching for the correct realm 2024-09-12T17:32:15.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.686+0000 7ff07e804640 0 -- 172.21.15.98:0/3379770559 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7ff070004040 msgr2=0x7ff070125750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:32:15.698 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.694+0000 7ff07e804640 0 -- 172.21.15.98:0/3379770559 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fef4807e6a0 msgr2=0x7fef48080ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:15.705 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:15.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:15.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:15.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:15.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:15.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:15.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:15.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:15.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:15.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 20 zone default found 2024-09-12T17:32:15.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 4 Realm: () 2024-09-12T17:32:15.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:15.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:15.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:15.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 20 zonegroup default 2024-09-12T17:32:15.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:15.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.702+0000 7ff0814ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.706+0000 7ff0814ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:15.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.706+0000 7ff0814ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.706+0000 7ff0814ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:15.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.706+0000 7ff0814ff9c0 20 started sync module instance, tier type = 2024-09-12T17:32:15.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.706+0000 7ff0814ff9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:15.730 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.726+0000 7ff0814ff9c0 20 add_watcher() i=0 2024-09-12T17:32:15.730 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.726+0000 7ff0814ff9c0 20 add_watcher() i=1 2024-09-12T17:32:15.730 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.726+0000 7ff0814ff9c0 20 add_watcher() i=2 2024-09-12T17:32:15.730 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.726+0000 7ff0814ff9c0 20 add_watcher() i=3 2024-09-12T17:32:15.730 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.726+0000 7ff0814ff9c0 20 add_watcher() i=4 2024-09-12T17:32:15.731 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.726+0000 7ff0814ff9c0 20 add_watcher() i=5 2024-09-12T17:32:15.731 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.726+0000 7ff0814ff9c0 20 add_watcher() i=6 2024-09-12T17:32:15.731 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.726+0000 7ff0814ff9c0 20 add_watcher() i=7 2024-09-12T17:32:15.731 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.726+0000 7ff0814ff9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:15.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.730+0000 7fef35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:15.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.730+0000 7ff0814ff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:15.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.730+0000 7ff0814ff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:15.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.730+0000 7ff0814ff9c0 5 note: GC not initialized 2024-09-12T17:32:15.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.730+0000 7fef34fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:15.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.730+0000 7ff0814ff9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:15.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.730+0000 7ff0814ff9c0 20 Filter name: none 2024-09-12T17:32:15.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.730+0000 7feeae7fc640 20 reqs_thread_entry: start 2024-09-12T17:32:15.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.730+0000 7ff0814ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.730+0000 7ff0814ff9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:15.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.730+0000 7ff0814ff9c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:15.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.730+0000 7ff0814ff9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:15.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.730+0000 7ff0814ff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:15.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.730+0000 7ff0814ff9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:32:15.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.730+0000 7ff0814ff9c0 20 INFO: main: starting shard=0 2024-09-12T17:32:15.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.730+0000 7ff0814ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:15.737 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.734+0000 7ff0814ff9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.737 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.734+0000 7ff0814ff9c0 20 INFO: main: starting shard=1 2024-09-12T17:32:15.737 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.734+0000 7ff0814ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:15.738 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.734+0000 7ff0814ff9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:32:15.738 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.734+0000 7ff0814ff9c0 20 INFO: main: starting shard=2 2024-09-12T17:32:15.738 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.734+0000 7ff0814ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:15.739 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.734+0000 7ff0814ff9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.739 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.734+0000 7ff0814ff9c0 20 INFO: main: starting shard=3 2024-09-12T17:32:15.739 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.734+0000 7ff0814ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:15.740 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.738+0000 7ff0814ff9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.738+0000 7ff0814ff9c0 20 INFO: main: starting shard=4 2024-09-12T17:32:15.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.738+0000 7ff0814ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:15.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.738+0000 7ff0814ff9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.738+0000 7ff0814ff9c0 20 INFO: main: starting shard=5 2024-09-12T17:32:15.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.738+0000 7ff0814ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:15.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.738+0000 7ff0814ff9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.738+0000 7ff0814ff9c0 20 INFO: main: starting shard=6 2024-09-12T17:32:15.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.738+0000 7ff0814ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:15.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.738+0000 7ff0814ff9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.738+0000 7ff0814ff9c0 20 INFO: main: starting shard=7 2024-09-12T17:32:15.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.738+0000 7ff0814ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:15.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.738+0000 7ff0814ff9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.738+0000 7ff0814ff9c0 20 INFO: main: starting shard=8 2024-09-12T17:32:15.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.738+0000 7ff0814ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:15.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.742+0000 7ff0814ff9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.742+0000 7ff0814ff9c0 20 INFO: main: starting shard=9 2024-09-12T17:32:15.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.742+0000 7ff0814ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:15.746 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.742+0000 7ff0814ff9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.746 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.742+0000 7ff0814ff9c0 20 INFO: main: starting shard=10 2024-09-12T17:32:15.746 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.742+0000 7ff0814ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:15.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.742+0000 7ff0814ff9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:15.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.742+0000 7ff0814ff9c0 20 INFO: main: done 2024-09-12T17:32:15.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.746+0000 7fef35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:15.753 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.750+0000 7ff0814ff9c0 20 remove_watcher() i=0 2024-09-12T17:32:15.753 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.750+0000 7ff0814ff9c0 2 removed watcher, disabling cache 2024-09-12T17:32:15.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.750+0000 7ff0814ff9c0 20 remove_watcher() i=1 2024-09-12T17:32:15.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.754+0000 7ff0814ff9c0 20 remove_watcher() i=2 2024-09-12T17:32:15.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.754+0000 7ff0814ff9c0 20 remove_watcher() i=3 2024-09-12T17:32:15.762 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.758+0000 7ff0814ff9c0 20 remove_watcher() i=4 2024-09-12T17:32:15.763 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.758+0000 7ff0814ff9c0 20 remove_watcher() i=5 2024-09-12T17:32:15.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.762+0000 7ff0814ff9c0 20 remove_watcher() i=6 2024-09-12T17:32:15.767 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:15.762+0000 7ff0814ff9c0 20 remove_watcher() i=7 2024-09-12T17:32:15.783 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:15.784 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:15.809 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:15.810 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:15.937 INFO:tasks.workunit.client.0.smithi098.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T17:32:15.937 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T17:32:15.973 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:15.973 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:16.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.014+0000 7f661f8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:16.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.014+0000 7f661f8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:16.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.014+0000 7f661f8189c0 20 realm 2024-09-12T17:32:16.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.014+0000 7f661f8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:16.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.014+0000 7f661f8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:16.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.014+0000 7f661f8189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:16.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.014+0000 7f661f8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:16.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.014+0000 7f661f8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:16.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.014+0000 7f661f8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:16.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.018+0000 7f661f8189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:16.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.018+0000 7f661f8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:16.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.018+0000 7f661f8189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:16.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.018+0000 7f661f8189c0 20 searching for the correct realm 2024-09-12T17:32:16.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.022+0000 7f661db1f640 0 -- 172.21.15.98:0/4064982840 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f66140c1020 msgr2=0x7f66140f6c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:16.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.030+0000 7f661d31e640 0 -- 172.21.15.98:0/4064982840 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f6614111bb0 msgr2=0x7f6614111360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:16.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.246+0000 7f661f8189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:16.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.246+0000 7f661f8189c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:16.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.246+0000 7f661f8189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:16.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.246+0000 7f661f8189c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:16.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.246+0000 7f661f8189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:16.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.246+0000 7f661f8189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:16.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.246+0000 7f661f8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:16.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.246+0000 7f661f8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:16.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.246+0000 7f661f8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:16.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.250+0000 7f661f8189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:16.253 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.250+0000 7f661f8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:16.253 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.250+0000 7f661f8189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:16.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.250+0000 7f661f8189c0 20 zone default found 2024-09-12T17:32:16.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.250+0000 7f661f8189c0 4 Realm: () 2024-09-12T17:32:16.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.250+0000 7f661f8189c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:16.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.250+0000 7f661f8189c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:16.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.250+0000 7f661f8189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:16.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.250+0000 7f661f8189c0 20 zonegroup default 2024-09-12T17:32:16.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.250+0000 7f661f8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:16.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.250+0000 7f661f8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:16.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.250+0000 7f661f8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:16.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.250+0000 7f661f8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:16.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.250+0000 7f661f8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:16.256 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.250+0000 7f661f8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:16.256 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.250+0000 7f661f8189c0 20 started sync module instance, tier type = 2024-09-12T17:32:16.256 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.250+0000 7f661f8189c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:16.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.274+0000 7f661f8189c0 20 add_watcher() i=0 2024-09-12T17:32:16.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.274+0000 7f661f8189c0 20 add_watcher() i=1 2024-09-12T17:32:16.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.274+0000 7f661f8189c0 20 add_watcher() i=2 2024-09-12T17:32:16.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.274+0000 7f661f8189c0 20 add_watcher() i=3 2024-09-12T17:32:16.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.274+0000 7f661f8189c0 20 add_watcher() i=4 2024-09-12T17:32:16.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.274+0000 7f661f8189c0 20 add_watcher() i=5 2024-09-12T17:32:16.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.274+0000 7f661f8189c0 20 add_watcher() i=6 2024-09-12T17:32:16.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.278+0000 7f661f8189c0 20 add_watcher() i=7 2024-09-12T17:32:16.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.278+0000 7f661f8189c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:16.285 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.282+0000 7f64d3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:16.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.282+0000 7f661f8189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:16.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.282+0000 7f661f8189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:16.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.282+0000 7f661f8189c0 5 note: GC not initialized 2024-09-12T17:32:16.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.282+0000 7f64d2fe5640 20 reqs_thread_entry: start 2024-09-12T17:32:16.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.282+0000 7f661f8189c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:16.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.282+0000 7f661f8189c0 20 Filter name: none 2024-09-12T17:32:16.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.282+0000 7f64d0fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:16.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.286+0000 7f661f8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:16.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.286+0000 7f661f8189c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:16.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.286+0000 7f661f8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:16.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.286+0000 7f661f8189c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:16.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.286+0000 7f661f8189c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:16.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.286+0000 7f661f8189c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T17:32:16.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.286+0000 7f661f8189c0 20 INFO: main: starting shard=0 2024-09-12T17:32:16.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.286+0000 7f661f8189c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:16.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.286+0000 7f661f8189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:16.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.286+0000 7f661f8189c0 20 INFO: main: starting shard=1 2024-09-12T17:32:16.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.286+0000 7f661f8189c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:16.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.290+0000 7f661f8189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:16.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.290+0000 7f661f8189c0 20 INFO: main: starting shard=2 2024-09-12T17:32:16.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.290+0000 7f661f8189c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:16.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.290+0000 7f661f8189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:16.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.290+0000 7f661f8189c0 20 INFO: main: starting shard=3 2024-09-12T17:32:16.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.290+0000 7f661f8189c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:16.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.290+0000 7f661f8189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:16.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.290+0000 7f661f8189c0 20 INFO: main: starting shard=4 2024-09-12T17:32:16.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.290+0000 7f661f8189c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:16.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.290+0000 7f661f8189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:16.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.290+0000 7f661f8189c0 20 INFO: main: starting shard=5 2024-09-12T17:32:16.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.290+0000 7f661f8189c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:16.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.294+0000 7f661f8189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:16.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.294+0000 7f661f8189c0 20 INFO: main: starting shard=6 2024-09-12T17:32:16.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.294+0000 7f661f8189c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:16.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.294+0000 7f661f8189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:16.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.294+0000 7f661f8189c0 20 INFO: main: starting shard=7 2024-09-12T17:32:16.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.294+0000 7f661f8189c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:16.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.294+0000 7f661f8189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:16.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.294+0000 7f661f8189c0 20 INFO: main: starting shard=8 2024-09-12T17:32:16.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.294+0000 7f661f8189c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:16.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.294+0000 7f661f8189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:16.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.294+0000 7f661f8189c0 20 INFO: main: starting shard=9 2024-09-12T17:32:16.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.294+0000 7f661f8189c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:16.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.298+0000 7f661f8189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T17:32:16.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.298+0000 7f661f8189c0 20 INFO: main: starting shard=10 2024-09-12T17:32:16.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.298+0000 7f661f8189c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:16.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.298+0000 7f661f8189c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T17:32:16.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.298+0000 7f661f8189c0 20 INFO: main: done 2024-09-12T17:32:16.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.298+0000 7f64d3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:16.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.306+0000 7f661f8189c0 20 remove_watcher() i=0 2024-09-12T17:32:16.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.306+0000 7f661f8189c0 2 removed watcher, disabling cache 2024-09-12T17:32:16.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.306+0000 7f661f8189c0 20 remove_watcher() i=1 2024-09-12T17:32:16.312 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.310+0000 7f661f8189c0 20 remove_watcher() i=2 2024-09-12T17:32:16.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.310+0000 7f661f8189c0 20 remove_watcher() i=3 2024-09-12T17:32:16.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.314+0000 7f661f8189c0 20 remove_watcher() i=4 2024-09-12T17:32:16.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.314+0000 7f661f8189c0 20 remove_watcher() i=5 2024-09-12T17:32:16.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.318+0000 7f661f8189c0 20 remove_watcher() i=6 2024-09-12T17:32:16.323 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:16.318+0000 7f661f8189c0 20 remove_watcher() i=7 2024-09-12T17:32:16.339 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:16.339 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:16.366 INFO:tasks.workunit.client.0.smithi098.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T17:32:16.811 INFO:tasks.workunit.client.0.smithi098.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T17:32:17.249 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T17:32:17.281 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:17.281 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:17.509 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.506+0000 7fe6c2bfc640 0 --2- 172.21.15.98:0/2749892247 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55a0152b23d0 0x55a01541e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:32:17.539 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.534+0000 7fe6c58f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.540 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.538+0000 7fe6c58f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:17.540 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.538+0000 7fe6c58f79c0 20 realm 2024-09-12T17:32:17.540 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.538+0000 7fe6c58f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.540 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.538+0000 7fe6c58f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:17.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.538+0000 7fe6c58f79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:17.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.538+0000 7fe6c58f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.538+0000 7fe6c58f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:17.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.538+0000 7fe6c58f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.538+0000 7fe6c58f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:17.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.538+0000 7fe6c58f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.538+0000 7fe6c58f79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:17.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.538+0000 7fe6c58f79c0 20 searching for the correct realm 2024-09-12T17:32:17.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.542+0000 7fe6c33fd640 0 -- 172.21.15.98:0/136900885 >> [v2:172.21.15.98:6816/1225764258,v1:172.21.15.98:6817/1225764258] conn(0x7fe6bc0d1410 msgr2=0x7fe6bc0d1830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:17.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.550+0000 7fe6c3bfe640 0 -- 172.21.15.98:0/136900885 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7fe6b8065040 msgr2=0x7fe6b805d730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:17.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.558+0000 7fe6c58f79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:17.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.558+0000 7fe6c58f79c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:17.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.558+0000 7fe6c58f79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:17.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.558+0000 7fe6c58f79c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:17.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.558+0000 7fe6c58f79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:17.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.558+0000 7fe6c58f79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:17.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.558+0000 7fe6c58f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.558+0000 7fe6c58f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:17.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.558+0000 7fe6c58f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.562+0000 7fe6c58f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:17.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.562+0000 7fe6c58f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.562+0000 7fe6c58f79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:17.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.562+0000 7fe6c58f79c0 20 zone default found 2024-09-12T17:32:17.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.562+0000 7fe6c58f79c0 4 Realm: () 2024-09-12T17:32:17.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.562+0000 7fe6c58f79c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:17.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.562+0000 7fe6c58f79c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:17.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.562+0000 7fe6c58f79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:17.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.562+0000 7fe6c58f79c0 20 zonegroup default 2024-09-12T17:32:17.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.562+0000 7fe6c58f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.562+0000 7fe6c58f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:17.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.562+0000 7fe6c58f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.562+0000 7fe6c58f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:17.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.562+0000 7fe6c58f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.562+0000 7fe6c58f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:17.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.562+0000 7fe6c58f79c0 20 started sync module instance, tier type = 2024-09-12T17:32:17.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.562+0000 7fe6c58f79c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:17.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.582+0000 7fe6c58f79c0 20 add_watcher() i=0 2024-09-12T17:32:17.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.582+0000 7fe6c58f79c0 20 add_watcher() i=1 2024-09-12T17:32:17.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.582+0000 7fe6c58f79c0 20 add_watcher() i=2 2024-09-12T17:32:17.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.582+0000 7fe6c58f79c0 20 add_watcher() i=3 2024-09-12T17:32:17.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.582+0000 7fe6c58f79c0 20 add_watcher() i=4 2024-09-12T17:32:17.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.582+0000 7fe6c58f79c0 20 add_watcher() i=5 2024-09-12T17:32:17.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.582+0000 7fe6c58f79c0 20 add_watcher() i=6 2024-09-12T17:32:17.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.582+0000 7fe6c58f79c0 20 add_watcher() i=7 2024-09-12T17:32:17.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.582+0000 7fe6c58f79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:17.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe57a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:17.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe6c58f79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:17.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe6c58f79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:17.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe6c58f79c0 5 note: GC not initialized 2024-09-12T17:32:17.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe5797e2640 20 reqs_thread_entry: start 2024-09-12T17:32:17.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe6c58f79c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:17.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe6c58f79c0 20 Filter name: none 2024-09-12T17:32:17.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe5727fc640 20 reqs_thread_entry: start 2024-09-12T17:32:17.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe6c58f79c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:32:17.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe6c58f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe6c58f79c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:17.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe6c58f79c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:32:17.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe6c58f79c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:32:17.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe6c58f79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 : miss 2024-09-12T17:32:17.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe6c58f79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe6c58f79c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:17.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe6c58f79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 info.flags=0x17 2024-09-12T17:32:17.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe6c58f79c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 to cache LRU end 2024-09-12T17:32:17.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe6c58f79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:17.595 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe6c58f79c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:32:17.595 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.586+0000 7fe6c58f79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 2024-09-12T17:32:17.595 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.590+0000 7fe6c58f79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:17.595 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.590+0000 7fe6c58f79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:17.595 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.590+0000 7fe6c58f79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:17.596 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.594+0000 7fe6c58f79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:17.598 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.594+0000 7fe6c58f79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:17.598 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.594+0000 7fe6c58f79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:17.599 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.594+0000 7fe6c58f79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:17.600 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.598+0000 7fe6c58f79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:17.600 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.598+0000 7fe6c58f79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:17.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.598+0000 7fe6c58f79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:17.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.598+0000 7fe6c58f79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:17.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.614+0000 7fe57a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:17.621 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.618+0000 7fe6c58f79c0 20 remove_watcher() i=0 2024-09-12T17:32:17.621 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.618+0000 7fe6c58f79c0 2 removed watcher, disabling cache 2024-09-12T17:32:17.623 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.618+0000 7fe6c58f79c0 20 remove_watcher() i=1 2024-09-12T17:32:17.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.622+0000 7fe6c58f79c0 20 remove_watcher() i=2 2024-09-12T17:32:17.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.622+0000 7fe6c58f79c0 20 remove_watcher() i=3 2024-09-12T17:32:17.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.626+0000 7fe6c58f79c0 20 remove_watcher() i=4 2024-09-12T17:32:17.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.626+0000 7fe6c58f79c0 20 remove_watcher() i=5 2024-09-12T17:32:17.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.630+0000 7fe6c58f79c0 20 remove_watcher() i=6 2024-09-12T17:32:17.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.630+0000 7fe6c58f79c0 20 remove_watcher() i=7 2024-09-12T17:32:17.648 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T17:32:17.683 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:17.683 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:17.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.906+0000 7f57530fe640 0 --2- 172.21.15.98:0/1819073680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e76b8128b0 0x55e76b837920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:32:17.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.934+0000 7f5754df79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.934+0000 7f5754df79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:17.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.934+0000 7f5754df79c0 20 realm 2024-09-12T17:32:17.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.934+0000 7f5754df79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.934+0000 7f5754df79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:17.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.934+0000 7f5754df79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:17.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.934+0000 7f5754df79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.934+0000 7f5754df79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:17.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.934+0000 7f5754df79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.938+0000 7f5754df79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:17.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.938+0000 7f5754df79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.938+0000 7f5754df79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:17.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.938+0000 7f5754df79c0 20 searching for the correct realm 2024-09-12T17:32:17.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.938+0000 7f57528fd640 0 -- 172.21.15.98:0/1619178450 >> [v2:172.21.15.98:6816/1225764258,v1:172.21.15.98:6817/1225764258] conn(0x7f574c0c4040 msgr2=0x7f574c0033b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:17.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.946+0000 7f57530fe640 0 -- 172.21.15.98:0/1619178450 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f5748021060 msgr2=0x7f5748089050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:17.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.954+0000 7f5754df79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:17.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.954+0000 7f5754df79c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:17.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.954+0000 7f5754df79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:17.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.954+0000 7f5754df79c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:17.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.954+0000 7f5754df79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:17.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.954+0000 7f5754df79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:17.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.954+0000 7f5754df79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.958+0000 7f5754df79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:17.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.958+0000 7f5754df79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.958+0000 7f5754df79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:17.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.958+0000 7f5754df79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.958+0000 7f5754df79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:17.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.958+0000 7f5754df79c0 20 zone default found 2024-09-12T17:32:17.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.958+0000 7f5754df79c0 4 Realm: () 2024-09-12T17:32:17.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.958+0000 7f5754df79c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:17.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.958+0000 7f5754df79c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:17.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.958+0000 7f5754df79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:17.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.958+0000 7f5754df79c0 20 zonegroup default 2024-09-12T17:32:17.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.958+0000 7f5754df79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.958+0000 7f5754df79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:17.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.958+0000 7f5754df79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.958+0000 7f5754df79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:17.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.958+0000 7f5754df79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.958+0000 7f5754df79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:17.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.958+0000 7f5754df79c0 20 started sync module instance, tier type = 2024-09-12T17:32:17.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.958+0000 7f5754df79c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:17.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.978+0000 7f5754df79c0 20 add_watcher() i=0 2024-09-12T17:32:17.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.978+0000 7f5754df79c0 20 add_watcher() i=1 2024-09-12T17:32:17.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.978+0000 7f5754df79c0 20 add_watcher() i=2 2024-09-12T17:32:17.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.978+0000 7f5754df79c0 20 add_watcher() i=3 2024-09-12T17:32:17.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.978+0000 7f5754df79c0 20 add_watcher() i=4 2024-09-12T17:32:17.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.978+0000 7f5754df79c0 20 add_watcher() i=5 2024-09-12T17:32:17.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.978+0000 7f5754df79c0 20 add_watcher() i=6 2024-09-12T17:32:17.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.982+0000 7f5754df79c0 20 add_watcher() i=7 2024-09-12T17:32:17.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.982+0000 7f5754df79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:17.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.982+0000 7f56097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:17.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:17.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:17.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 5 note: GC not initialized 2024-09-12T17:32:17.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5583fff640 20 reqs_thread_entry: start 2024-09-12T17:32:17.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:17.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 20 Filter name: none 2024-09-12T17:32:17.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5581ffb640 20 reqs_thread_entry: start 2024-09-12T17:32:17.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T17:32:17.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.990 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:17.990 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T17:32:17.991 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T17:32:17.991 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 : miss 2024-09-12T17:32:17.991 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:17.991 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:17.991 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 info.flags=0x17 2024-09-12T17:32:17.991 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 to cache LRU end 2024-09-12T17:32:17.991 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:32:17.991 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T17:32:17.991 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1 2024-09-12T17:32:17.991 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.0 2024-09-12T17:32:17.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T17:32:17.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.986+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:17.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.990+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.2 2024-09-12T17:32:17.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.990+0000 7f5754df79c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T17:32:17.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.990+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.3 2024-09-12T17:32:17.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.990+0000 7f5754df79c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T17:32:17.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.990+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.4 2024-09-12T17:32:17.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.994+0000 7f5754df79c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T17:32:17.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.994+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:17.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.994+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.6 2024-09-12T17:32:17.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.994+0000 7f5754df79c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T17:32:17.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.994+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.7 2024-09-12T17:32:17.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.994+0000 7f5754df79c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T17:32:17.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.994+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:17.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.994+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.9 2024-09-12T17:32:18.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.998+0000 7f5754df79c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T17:32:18.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.998+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:18.002 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.998+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:18.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.998+0000 7f5754df79c0 20 get_obj_state: octx=0x55e76b5f53b0 obj=check-bucket:e state=0x55e76b93a0f8 s->prefetch_data=0 2024-09-12T17:32:18.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.998+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:18.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.998+0000 7f5754df79c0 20 get_obj_state: octx=0x55e76b69a3a0 obj=check-bucket:d state=0x55e76b9350c8 s->prefetch_data=0 2024-09-12T17:32:18.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:17.998+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:18.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.002+0000 7f5754df79c0 20 get_obj_state: octx=0x55e76b935a40 obj=check-bucket:c state=0x55e76b92f6e8 s->prefetch_data=0 2024-09-12T17:32:18.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.002+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:18.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.002+0000 7f5754df79c0 20 get_obj_state: octx=0x55e76b930750 obj=check-bucket:f state=0x55e76b931868 s->prefetch_data=0 2024-09-12T17:32:18.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.002+0000 7f5754df79c0 20 get_obj_state: setting s->obj_tag to 7aklphtzq25bnkb5bi3f3axm2ap3rmzp 2024-09-12T17:32:18.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.002+0000 7f5754df79c0 20 get_obj_state_impl: setting s->olh_tag to 7qeqitkr6809ejy1beloorpv0uzpoa2a 2024-09-12T17:32:18.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.002+0000 7f5754df79c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7qeqitkr6809ejy1beloorpv0uzpoa2a 2024-09-12T17:32:18.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.002+0000 7f5754df79c0 20 get_obj_state: setting s->obj_tag to srf7an4izlkezlhby5kd0q6hykai8e8w 2024-09-12T17:32:18.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.002+0000 7f5754df79c0 20 get_obj_state_impl: setting s->olh_tag to 59cvaqw0okj0r70983ksurdsdpduvs7x 2024-09-12T17:32:18.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.002+0000 7f5754df79c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=59cvaqw0okj0r70983ksurdsdpduvs7x 2024-09-12T17:32:18.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.002+0000 7f5754df79c0 20 get_obj_state: setting s->obj_tag to 6y9r0xxzdkc6tfp5zm10ydk159m62ln2 2024-09-12T17:32:18.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.002+0000 7f5754df79c0 20 get_obj_state_impl: setting s->olh_tag to comkfghwqxnwiopn02zf2862zntgf1fl 2024-09-12T17:32:18.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.002+0000 7f5754df79c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=comkfghwqxnwiopn02zf2862zntgf1fl 2024-09-12T17:32:18.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.002+0000 7f5754df79c0 20 get_obj_state: setting s->obj_tag to vqv6z81dwlq33mbag6p9egfwr429vl5e 2024-09-12T17:32:18.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.002+0000 7f5754df79c0 20 get_obj_state_impl: setting s->olh_tag to zvtzil5zy98335y1qe2q6wgzhgkmpmpe 2024-09-12T17:32:18.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.002+0000 7f5754df79c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zvtzil5zy98335y1qe2q6wgzhgkmpmpe 2024-09-12T17:32:18.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.006+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:18.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.006+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:18.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.006+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:18.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.010+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:18.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.010+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:18.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.010+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:18.016 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.010+0000 7f5754df79c0 20 olh_log_entry: epoch=3 op=3 key=c[BwW6I-0tsz2-651Vtcvqpk2b0xJWI9U] 2024-09-12T17:32:18.016 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.010+0000 7f5754df79c0 20 get_obj_state: octx=0x55e76b935a40 obj=check-bucket:_:BwW6I-0tsz2-651Vtcvqpk2b0xJWI9U_c state=0x55e76b9da5d8 s->prefetch_data=0 2024-09-12T17:32:18.016 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T17:32:18.016 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 olh_log_entry: epoch=2 op=3 key=e[yWVb5ft9Ar3KvRkAOrQ3jKvWEtAtVFm] 2024-09-12T17:32:18.016 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 get_obj_state: octx=0x55e76b5f53b0 obj=check-bucket:_:yWVb5ft9Ar3KvRkAOrQ3jKvWEtAtVFm_e state=0x55e76b9e0188 s->prefetch_data=0 2024-09-12T17:32:18.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:18.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:18.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 10 manifest: total_size = 12 2024-09-12T17:32:18.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.16762956320466089528 2024-09-12T17:32:18.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 get_obj_state: octx=0x55e76b935a40 obj=check-bucket:_:BwW6I-0tsz2-651Vtcvqpk2b0xJWI9U_c state=0x55e76b9da5d8 s->prefetch_data=0 2024-09-12T17:32:18.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 prepare_atomic_modification: state is not atomic. state=0x55e76b9da5d8 2024-09-12T17:32:18.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:18.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 olh_log_entry: epoch=3 op=3 key=d[0yn--dUGPWQgBtVJw4WToNIhXGzuIVI] 2024-09-12T17:32:18.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 get_obj_state: octx=0x55e76b69a3a0 obj=check-bucket:_:0yn--dUGPWQgBtVJw4WToNIhXGzuIVI_d state=0x55e76b9e6e38 s->prefetch_data=0 2024-09-12T17:32:18.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T17:32:18.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 olh_log_entry: epoch=2 op=3 key=f[j4ishKri7jESeejUgfEG5.19YFvAcaV] 2024-09-12T17:32:18.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 get_obj_state: octx=0x55e76b930750 obj=check-bucket:_:j4ishKri7jESeejUgfEG5.19YFvAcaV_f state=0x55e76b9ed0c8 s->prefetch_data=0 2024-09-12T17:32:18.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 10 manifest: total_size = 22 2024-09-12T17:32:18.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.12160870891794398974 2024-09-12T17:32:18.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 get_obj_state: octx=0x55e76b5f53b0 obj=check-bucket:_:yWVb5ft9Ar3KvRkAOrQ3jKvWEtAtVFm_e state=0x55e76b9e0188 s->prefetch_data=0 2024-09-12T17:32:18.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 prepare_atomic_modification: state is not atomic. state=0x55e76b9e0188 2024-09-12T17:32:18.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:18.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 10 manifest: total_size = 12 2024-09-12T17:32:18.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.612019547188679926 2024-09-12T17:32:18.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 get_obj_state: octx=0x55e76b69a3a0 obj=check-bucket:_:0yn--dUGPWQgBtVJw4WToNIhXGzuIVI_d state=0x55e76b9e6e38 s->prefetch_data=0 2024-09-12T17:32:18.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 prepare_atomic_modification: state is not atomic. state=0x55e76b9e6e38 2024-09-12T17:32:18.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:18.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 10 manifest: total_size = 22 2024-09-12T17:32:18.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.14480904024578556444 2024-09-12T17:32:18.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 get_obj_state: octx=0x55e76b930750 obj=check-bucket:_:j4ishKri7jESeejUgfEG5.19YFvAcaV_f state=0x55e76b9ed0c8 s->prefetch_data=0 2024-09-12T17:32:18.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 prepare_atomic_modification: state is not atomic. state=0x55e76b9ed0c8 2024-09-12T17:32:18.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.014+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:18.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.022+0000 7f5754df79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:32:18.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.022+0000 7f5754df79c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T17:32:18.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.022+0000 7f5754df79c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:32:18.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.022+0000 7f5754df79c0 5 delete_objs_inline: removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1__shadow:BwW6I-0tsz2-651Vtcvqpk2b0xJWI9U_.OQArG0gj30yKySxRvzDxuOTT8u1GROg_0 2024-09-12T17:32:18.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.022+0000 7f5754df79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:32:18.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.022+0000 7f5754df79c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T17:32:18.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.022+0000 7f5754df79c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:32:18.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.022+0000 7f5754df79c0 5 delete_objs_inline: removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1__shadow:0yn--dUGPWQgBtVJw4WToNIhXGzuIVI_.T5QlVy7OJHJVDhDmVB_Lg8xIi2iqzr8_0 2024-09-12T17:32:18.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.026+0000 7f56367fc640 20 handle_completion(): completion ok for obj=c[BwW6I-0tsz2-651Vtcvqpk2b0xJWI9U] 2024-09-12T17:32:18.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.026+0000 7f5754df79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:32:18.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.026+0000 7f5754df79c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:32:18.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.026+0000 7f5754df79c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:32:18.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.026+0000 7f5754df79c0 5 delete_objs_inline: removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1__shadow:j4ishKri7jESeejUgfEG5.19YFvAcaV_.v4tMrGAvbwy_UmKExhpQD7YMPZgizCK_0 2024-09-12T17:32:18.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.026+0000 7f5635ffb640 20 handle_completion(): completion ok for obj=d[0yn--dUGPWQgBtVJw4WToNIhXGzuIVI] 2024-09-12T17:32:18.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.030+0000 7f5754df79c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:32:18.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.030+0000 7f5754df79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:32:18.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.030+0000 7f5754df79c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T17:32:18.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.030+0000 7f5754df79c0 0 deleting objects inline since gc isn't initialized 2024-09-12T17:32:18.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.030+0000 7f5754df79c0 5 delete_objs_inline: removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.1__shadow:yWVb5ft9Ar3KvRkAOrQ3jKvWEtAtVFm_.-zDtE4ytIx3Lncg6HlDJwJLqulx92g4_0 2024-09-12T17:32:18.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.030+0000 7f5754df79c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:32:18.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.034+0000 7f5754df79c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:32:18.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.034+0000 7f56367fc640 20 handle_completion(): completion ok for obj=f[j4ishKri7jESeejUgfEG5.19YFvAcaV] 2024-09-12T17:32:18.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.034+0000 7f5754df79c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T17:32:18.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.034+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:18.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.034+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:18.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.038+0000 7f5635ffb640 20 handle_completion(): completion ok for obj=e[yWVb5ft9Ar3KvRkAOrQ3jKvWEtAtVFm] 2024-09-12T17:32:18.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.038+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:18.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.038+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:18.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.038+0000 7f5754df79c0 20 get_obj_state: octx=0x55e76b930750 obj=check-bucket:f state=0x55e76b931868 s->prefetch_data=0 2024-09-12T17:32:18.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.038+0000 7f5754df79c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zvtzil5zy98335y1qe2q6wgzhgkmpmpe 2024-09-12T17:32:18.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.038+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.8 2024-09-12T17:32:18.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.038+0000 7f5754df79c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T17:32:18.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.038+0000 7f5754df79c0 20 get_obj_state: octx=0x55e76b5f53b0 obj=check-bucket:e state=0x55e76b93a0f8 s->prefetch_data=0 2024-09-12T17:32:18.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.038+0000 7f5754df79c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7qeqitkr6809ejy1beloorpv0uzpoa2a 2024-09-12T17:32:18.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.042+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.5 2024-09-12T17:32:18.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.042+0000 7f5754df79c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T17:32:18.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.046+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:18.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.046+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:18.053 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.050+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.10 2024-09-12T17:32:18.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.050+0000 7f5754df79c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T17:32:18.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.050+0000 7f5754df79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.1.1 2024-09-12T17:32:18.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.050+0000 7f5754df79c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T17:32:18.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.050+0000 7f5754df79c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T17:32:18.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.050+0000 7f56097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:18.059 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.054+0000 7f5754df79c0 20 remove_watcher() i=0 2024-09-12T17:32:18.059 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.054+0000 7f5754df79c0 2 removed watcher, disabling cache 2024-09-12T17:32:18.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.058+0000 7f5754df79c0 20 remove_watcher() i=1 2024-09-12T17:32:18.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.058+0000 7f5754df79c0 20 remove_watcher() i=2 2024-09-12T17:32:18.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.062+0000 7f5754df79c0 20 remove_watcher() i=3 2024-09-12T17:32:18.068 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.066+0000 7f5754df79c0 20 remove_watcher() i=4 2024-09-12T17:32:18.069 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.066+0000 7f5754df79c0 20 remove_watcher() i=5 2024-09-12T17:32:18.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.066+0000 7f5754df79c0 20 remove_watcher() i=6 2024-09-12T17:32:18.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.070+0000 7f5754df79c0 20 remove_watcher() i=7 2024-09-12T17:32:18.092 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:18.092 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:18.141 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:18.141 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:18.613 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T17:32:18.645 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:32:18.645 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:32:18.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.686+0000 7f86935b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:18.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.690+0000 7f86935b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:18.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.690+0000 7f86935b19c0 20 realm 2024-09-12T17:32:18.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.690+0000 7f86935b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:18.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.690+0000 7f86935b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:18.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.690+0000 7f86935b19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:32:18.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.690+0000 7f86935b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:18.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.690+0000 7f86935b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:18.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.690+0000 7f86935b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:18.695 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.690+0000 7f86935b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:18.695 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.690+0000 7f86935b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:18.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.694+0000 7f86935b19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:32:18.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.694+0000 7f86935b19c0 20 searching for the correct realm 2024-09-12T17:32:18.698 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.694+0000 7f86910b7640 0 -- 172.21.15.98:0/1641463367 >> [v2:172.21.15.98:6816/1225764258,v1:172.21.15.98:6817/1225764258] conn(0x7f868c010040 msgr2=0x7f868c05ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:18.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.910+0000 7f86918b8640 0 -- 172.21.15.98:0/1641463367 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f86880f7df0 msgr2=0x7f86880f7860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:32:18.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:32:18.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:32:18.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:32:18.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:32:18.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:32:18.930 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:32:18.930 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:18.930 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:18.930 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:18.930 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:32:18.930 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:18.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:32:18.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 20 zone default found 2024-09-12T17:32:18.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 4 Realm: () 2024-09-12T17:32:18.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:32:18.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:32:18.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:32:18.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 20 zonegroup default 2024-09-12T17:32:18.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:18.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:18.933 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.926+0000 7f86935b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:18.933 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.930+0000 7f86935b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:18.933 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.930+0000 7f86935b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:18.933 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.930+0000 7f86935b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:32:18.934 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.930+0000 7f86935b19c0 20 started sync module instance, tier type = 2024-09-12T17:32:18.934 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.930+0000 7f86935b19c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:32:18.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.954+0000 7f86935b19c0 20 add_watcher() i=0 2024-09-12T17:32:18.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.954+0000 7f86935b19c0 20 add_watcher() i=1 2024-09-12T17:32:18.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.954+0000 7f86935b19c0 20 add_watcher() i=2 2024-09-12T17:32:18.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.954+0000 7f86935b19c0 20 add_watcher() i=3 2024-09-12T17:32:18.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.954+0000 7f86935b19c0 20 add_watcher() i=4 2024-09-12T17:32:18.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.954+0000 7f86935b19c0 20 add_watcher() i=5 2024-09-12T17:32:18.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.954+0000 7f86935b19c0 20 add_watcher() i=6 2024-09-12T17:32:18.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.958+0000 7f86935b19c0 20 add_watcher() i=7 2024-09-12T17:32:18.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.958+0000 7f86935b19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:32:18.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.962+0000 7f8547fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:18.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.962+0000 7f86935b19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:32:18.967 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.962+0000 7f86935b19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:32:18.967 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.962+0000 7f86935b19c0 5 note: GC not initialized 2024-09-12T17:32:18.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.962+0000 7f8546fe5640 20 reqs_thread_entry: start 2024-09-12T17:32:18.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.962+0000 7f86935b19c0 20 init_complete bucket index max shards: 11 2024-09-12T17:32:18.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.962+0000 7f86935b19c0 20 Filter name: none 2024-09-12T17:32:18.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.962+0000 7f8544fe1640 20 reqs_thread_entry: start 2024-09-12T17:32:18.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.966+0000 7f86935b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:18.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.966+0000 7f86935b19c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:18.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.966+0000 7f86935b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:18.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.966+0000 7f86935b19c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:18.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.966+0000 7f86935b19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:18.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.966+0000 7f86935b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:18.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.966+0000 7f86935b19c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T17:32:18.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.966+0000 7f86935b19c0 20 rados->read ofs=0 len=0 2024-09-12T17:32:18.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.966+0000 7f86935b19c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T17:32:18.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.966+0000 7f86935b19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:32:18.974 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.970+0000 7f8547fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:32:18.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.974+0000 7f86935b19c0 20 remove_watcher() i=0 2024-09-12T17:32:18.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.974+0000 7f86935b19c0 2 removed watcher, disabling cache 2024-09-12T17:32:18.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.978+0000 7f86935b19c0 20 remove_watcher() i=1 2024-09-12T17:32:18.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.978+0000 7f86935b19c0 20 remove_watcher() i=2 2024-09-12T17:32:18.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.982+0000 7f86935b19c0 20 remove_watcher() i=3 2024-09-12T17:32:18.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.986+0000 7f86935b19c0 20 remove_watcher() i=4 2024-09-12T17:32:18.990 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.986+0000 7f86935b19c0 20 remove_watcher() i=5 2024-09-12T17:32:18.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.990+0000 7f86935b19c0 20 remove_watcher() i=6 2024-09-12T17:32:18.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:32:18.990+0000 7f86935b19c0 20 remove_watcher() i=7 2024-09-12T17:32:19.009 INFO:tasks.workunit.client.0.smithi098.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T17:32:19.009 INFO:tasks.workunit.client.0.smithi098.stderr:Deleting bucket check-bucket 2024-09-12T17:32:19.010 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:19.010 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:19.057 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:32:19.057 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:32:19.570 INFO:tasks.workunit.client.0.smithi098.stderr:Completed bucket check tests 2024-09-12T17:32:19.571 INFO:tasks.workunit.client.0.smithi098.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T17:32:19.571 INFO:tasks.workunit.client.0.smithi098.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T17:32:19.571 INFO:tasks.workunit.client.0.smithi098.stdout:connected to https://localhost:443 2024-09-12T17:32:19.668 INFO:tasks.workunit.client.0.smithi098.stderr:+ deactivate 2024-09-12T17:32:19.668 INFO:tasks.workunit.client.0.smithi098.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T17:32:19.668 INFO:tasks.workunit.client.0.smithi098.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:32:19.668 INFO:tasks.workunit.client.0.smithi098.stderr:+ export PATH 2024-09-12T17:32:19.668 INFO:tasks.workunit.client.0.smithi098.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T17:32:19.668 INFO:tasks.workunit.client.0.smithi098.stderr:+ '[' -n '' ']' 2024-09-12T17:32:19.668 INFO:tasks.workunit.client.0.smithi098.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:32:19.668 INFO:tasks.workunit.client.0.smithi098.stderr:+ hash -r 2024-09-12T17:32:19.668 INFO:tasks.workunit.client.0.smithi098.stderr:+ '[' -n '' ']' 2024-09-12T17:32:19.668 INFO:tasks.workunit.client.0.smithi098.stderr:+ unset VIRTUAL_ENV 2024-09-12T17:32:19.669 INFO:tasks.workunit.client.0.smithi098.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T17:32:19.669 INFO:tasks.workunit.client.0.smithi098.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T17:32:19.669 INFO:tasks.workunit.client.0.smithi098.stderr:+ unset -f deactivate 2024-09-12T17:32:19.669 INFO:tasks.workunit.client.0.smithi098.stderr:+ echo OK. 2024-09-12T17:32:19.670 INFO:tasks.workunit.client.0.smithi098.stdout:OK. 2024-09-12T17:32:19.670 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:32:19.670 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:32:19.683 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T17:32:19.684 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:32:20.099 DEBUG:teuthology.parallel:result is None 2024-09-12T17:32:20.100 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:32:20.113 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:32:20.113 DEBUG:teuthology.orchestra.run.smithi098:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:32:20.171 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:32:20.172 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:32:20.183 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:32:20.183 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:32:20.183 DEBUG:teuthology.orchestra.run.smithi098:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:32:20.220 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:32:20.221 INFO:teuthology.orchestra.run.smithi098.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:32:20.221 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:32:20.269 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:32:20.269 DEBUG:teuthology.orchestra.run.smithi098:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:32:20.317 INFO:tasks.workunit:timeout=3h 2024-09-12T17:32:20.318 INFO:tasks.workunit:cleanup=True 2024-09-12T17:32:20.319 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:32:20.366 INFO:tasks.workunit.client.0.smithi098.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:33:16.975 INFO:tasks.workunit.client.0.smithi098.stderr:Updating files: 97% (12405/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:33:17.879 INFO:tasks.workunit.client.0.smithi098.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:33:17.879 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:33:17.879 INFO:tasks.workunit.client.0.smithi098.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:33:17.880 INFO:tasks.workunit.client.0.smithi098.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:33:17.880 INFO:tasks.workunit.client.0.smithi098.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:33:17.880 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:33:17.880 INFO:tasks.workunit.client.0.smithi098.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:33:17.880 INFO:tasks.workunit.client.0.smithi098.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:33:17.880 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:33:17.880 INFO:tasks.workunit.client.0.smithi098.stderr: git switch -c 2024-09-12T17:33:17.880 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:33:17.880 INFO:tasks.workunit.client.0.smithi098.stderr:Or undo this operation with: 2024-09-12T17:33:17.880 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:33:17.880 INFO:tasks.workunit.client.0.smithi098.stderr: git switch - 2024-09-12T17:33:17.880 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:33:17.881 INFO:tasks.workunit.client.0.smithi098.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:33:17.881 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:33:17.881 INFO:tasks.workunit.client.0.smithi098.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:33:17.888 DEBUG:teuthology.orchestra.run.smithi098:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:33:17.942 INFO:tasks.workunit.client.0.smithi098.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:33:17.945 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:33:17.945 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:33:18.001 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:33:18.055 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:33:18.097 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:33:18.098 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:33:18.098 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:33:18.144 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:33:18.147 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:33:18.147 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:33:18.196 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T17:33:18.198 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T17:33:18.198 DEBUG:teuthology.orchestra.run.smithi098:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T17:33:18.264 INFO:tasks.workunit.client.0.smithi098.stdout:Running main() from gmock_main.cc 2024-09-12T17:33:18.265 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:33:18.265 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:33:18.265 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 11 tests from ClsLock 2024-09-12T17:33:18.265 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T17:33:19.425 INFO:tasks.workunit.client.0.smithi098.stdout:lock: mylock 2024-09-12T17:33:19.425 INFO:tasks.workunit.client.0.smithi098.stdout: lock_type: exclusive 2024-09-12T17:33:19.425 INFO:tasks.workunit.client.0.smithi098.stdout: tag: 2024-09-12T17:33:19.425 INFO:tasks.workunit.client.0.smithi098.stdout: lockers: 2024-09-12T17:33:19.425 INFO:tasks.workunit.client.0.smithi098.stdout: client.4976 expiration=2024-09-12T17:35:19.419311+0000 addr=v1:172.21.15.98:0/3007818528 cookie= 2024-09-12T17:33:19.433 INFO:tasks.workunit.client.0.smithi098.stdout:lock: mylock 2024-09-12T17:33:19.433 INFO:tasks.workunit.client.0.smithi098.stdout: lock_type: shared 2024-09-12T17:33:19.433 INFO:tasks.workunit.client.0.smithi098.stdout: tag: 2024-09-12T17:33:19.433 INFO:tasks.workunit.client.0.smithi098.stdout: lockers: 2024-09-12T17:33:19.433 INFO:tasks.workunit.client.0.smithi098.stdout: client.4976 expiration=2024-09-12T17:35:19.431183+0000 addr=v1:172.21.15.98:0/3007818528 cookie= 2024-09-12T17:33:19.433 INFO:tasks.workunit.client.0.smithi098.stdout: client.4982 expiration=0.000000 addr=v1:172.21.15.98:0/1839441897 cookie= 2024-09-12T17:33:19.435 INFO:tasks.workunit.client.0.smithi098.stdout:lock: mylock 2024-09-12T17:33:19.435 INFO:tasks.workunit.client.0.smithi098.stdout: lock_type: shared 2024-09-12T17:33:19.435 INFO:tasks.workunit.client.0.smithi098.stdout: tag: 2024-09-12T17:33:19.436 INFO:tasks.workunit.client.0.smithi098.stdout: lockers: 2024-09-12T17:33:19.436 INFO:tasks.workunit.client.0.smithi098.stdout: client.4982 expiration=0.000000 addr=v1:172.21.15.98:0/1839441897 cookie= 2024-09-12T17:33:20.373 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] ClsLock.TestMultiLocking (2109 ms) 2024-09-12T17:33:20.373 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T17:33:22.876 INFO:tasks.workunit.client.0.smithi098.stdout:lock: mylock 2024-09-12T17:33:22.876 INFO:tasks.workunit.client.0.smithi098.stdout: lock_type: shared 2024-09-12T17:33:22.876 INFO:tasks.workunit.client.0.smithi098.stdout: tag: 2024-09-12T17:33:22.876 INFO:tasks.workunit.client.0.smithi098.stdout: lockers: 2024-09-12T17:33:22.876 INFO:tasks.workunit.client.0.smithi098.stdout: client.5250 expiration=0.000000 addr=v1:172.21.15.98:0/2351041069 cookie= 2024-09-12T17:33:22.883 INFO:tasks.workunit.client.0.smithi098.stdout:lock: mylock 2024-09-12T17:33:22.883 INFO:tasks.workunit.client.0.smithi098.stdout: lock_type: exclusive 2024-09-12T17:33:22.883 INFO:tasks.workunit.client.0.smithi098.stdout: tag: new_tag 2024-09-12T17:33:22.883 INFO:tasks.workunit.client.0.smithi098.stdout: lockers: 2024-09-12T17:33:22.883 INFO:tasks.workunit.client.0.smithi098.stdout: client.5241 expiration=0.000000 addr=v1:172.21.15.98:0/202478284 cookie= 2024-09-12T17:33:23.397 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] ClsLock.TestMeta (3025 ms) 2024-09-12T17:33:23.398 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T17:33:25.479 INFO:tasks.workunit.client.0.smithi098.stdout:lock: mylock 2024-09-12T17:33:25.479 INFO:tasks.workunit.client.0.smithi098.stdout: lock_type: exclusive 2024-09-12T17:33:25.479 INFO:tasks.workunit.client.0.smithi098.stdout: tag: 2024-09-12T17:33:25.479 INFO:tasks.workunit.client.0.smithi098.stdout: lockers: 2024-09-12T17:33:25.483 INFO:tasks.workunit.client.0.smithi098.stdout:lock: mylock 2024-09-12T17:33:25.484 INFO:tasks.workunit.client.0.smithi098.stdout: lock_type: shared 2024-09-12T17:33:25.484 INFO:tasks.workunit.client.0.smithi098.stdout: tag: 2024-09-12T17:33:25.484 INFO:tasks.workunit.client.0.smithi098.stdout: lockers: 2024-09-12T17:33:25.484 INFO:tasks.workunit.client.0.smithi098.stdout: client.5253 expiration=0.000000 addr=v1:172.21.15.98:0/383129552 cookie= 2024-09-12T17:33:25.484 INFO:tasks.workunit.client.0.smithi098.stdout: client.5253 expiration=0.000000 addr=v1:172.21.15.98:0/383129552 cookie=new cookie 2024-09-12T17:33:26.472 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] ClsLock.TestCookie (3070 ms) 2024-09-12T17:33:26.472 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T17:33:29.498 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] ClsLock.TestMultipleLocks (3030 ms) 2024-09-12T17:33:29.498 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T17:33:36.667 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] ClsLock.TestLockDuration (7169 ms) 2024-09-12T17:33:36.668 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T17:33:39.677 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] ClsLock.TestAssertLocked (3010 ms) 2024-09-12T17:33:39.677 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T17:33:42.726 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] ClsLock.TestSetCookie (3050 ms) 2024-09-12T17:33:42.727 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T17:34:02.910 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] ClsLock.TestRenew (20183 ms) 2024-09-12T17:34:02.910 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T17:34:09.039 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6129 ms) 2024-09-12T17:34:09.039 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T17:34:16.148 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7107 ms) 2024-09-12T17:34:16.148 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T17:34:24.186 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8040 ms) 2024-09-12T17:34:24.186 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 11 tests from ClsLock (65922 ms total) 2024-09-12T17:34:24.186 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:34:24.186 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:34:24.186 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 11 tests from 1 test suite ran. (65922 ms total) 2024-09-12T17:34:24.187 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 11 tests. 2024-09-12T17:34:24.191 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:34:24.191 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:34:24.244 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T17:34:24.246 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T17:34:24.246 DEBUG:teuthology.orchestra.run.smithi098:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T17:34:24.312 INFO:tasks.workunit.client.0.smithi098.stdout:Running main() from gmock_main.cc 2024-09-12T17:34:24.313 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:34:24.313 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:34:24.313 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 4 tests from cls_log 2024-09-12T17:34:24.313 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T17:34:27.214 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_log.test_log_add_same_time (2901 ms) 2024-09-12T17:34:27.214 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T17:34:30.262 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_log.test_log_add_different_time (3047 ms) 2024-09-12T17:34:30.262 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T17:34:33.271 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_log.trim_by_time (3004 ms) 2024-09-12T17:34:33.272 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T17:34:36.325 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_log.trim_by_marker (3053 ms) 2024-09-12T17:34:36.326 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 4 tests from cls_log (12006 ms total) 2024-09-12T17:34:36.326 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:34:36.326 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:34:36.326 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 4 tests from 1 test suite ran. (12006 ms total) 2024-09-12T17:34:36.326 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 4 tests. 2024-09-12T17:34:36.330 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:34:36.330 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:34:36.397 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T17:34:36.399 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T17:34:36.399 DEBUG:teuthology.orchestra.run.smithi098:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T17:34:36.500 INFO:tasks.workunit.client.0.smithi098.stdout:Running main() from gmock_main.cc 2024-09-12T17:34:36.500 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:34:36.500 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:34:36.500 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 10 tests from cls_refcount 2024-09-12T17:34:36.501 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T17:34:39.360 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_refcount.test_implicit (2866 ms) 2024-09-12T17:34:39.361 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T17:34:42.436 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3075 ms) 2024-09-12T17:34:42.436 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T17:34:51.520 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_refcount.test_put_snap (9079 ms) 2024-09-12T17:34:51.521 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T17:34:54.558 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_refcount.test_explicit (3043 ms) 2024-09-12T17:34:54.558 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_refcount.set 2024-09-12T17:34:57.617 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_refcount.set (3060 ms) 2024-09-12T17:34:57.617 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T17:35:04.722 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_refcount.test_implicit_ec (7104 ms) 2024-09-12T17:35:04.722 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T17:35:11.804 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7082 ms) 2024-09-12T17:35:11.804 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T17:35:24.885 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_refcount.test_put_snap_ec (13082 ms) 2024-09-12T17:35:24.885 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T17:35:31.975 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_refcount.test_explicit_ec (7090 ms) 2024-09-12T17:35:31.976 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T17:35:39.056 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_refcount.set_ec (7080 ms) 2024-09-12T17:35:39.057 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 10 tests from cls_refcount (62561 ms total) 2024-09-12T17:35:39.057 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:35:39.057 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:35:39.057 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 10 tests from 1 test suite ran. (62561 ms total) 2024-09-12T17:35:39.058 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 10 tests. 2024-09-12T17:35:39.062 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:35:39.062 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:35:39.121 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T17:35:39.124 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T17:35:39.124 DEBUG:teuthology.orchestra.run.smithi098:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T17:35:39.183 INFO:tasks.workunit.client.0.smithi098.stdout:Running main() from gmock_main.cc 2024-09-12T17:35:39.184 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-12T17:35:39.184 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:35:39.184 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 18 tests from cls_rgw 2024-09-12T17:35:41.072 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T17:35:41.138 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw.index_basic (65 ms) 2024-09-12T17:35:41.138 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T17:35:41.214 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (77 ms) 2024-09-12T17:35:41.214 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T17:35:41.335 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw.index_remove_object (120 ms) 2024-09-12T17:35:41.335 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T17:35:43.779 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw.index_suggest (2445 ms) 2024-09-12T17:35:43.780 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T17:35:43.794 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw.index_suggest_complete (15 ms) 2024-09-12T17:35:43.794 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T17:35:43.847 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw.index_list (53 ms) 2024-09-12T17:35:43.848 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T17:36:29.280 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw.index_list_delimited (45432 ms) 2024-09-12T17:36:29.280 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T17:36:29.450 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw.bi_list (170 ms) 2024-09-12T17:36:29.450 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T17:36:29.473 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw.gc_set (23 ms) 2024-09-12T17:36:29.476 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T17:36:29.493 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw.gc_list (20 ms) 2024-09-12T17:36:29.493 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T17:36:37.343 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw.gc_defer (7849 ms) 2024-09-12T17:36:37.344 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T17:36:37.533 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw.usage_basic (190 ms) 2024-09-12T17:36:37.533 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T17:36:37.536 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw.usage_clear_no_obj (3 ms) 2024-09-12T17:36:37.536 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T17:36:37.743 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw.usage_clear (207 ms) 2024-09-12T17:36:37.744 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T17:36:37.885 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw.bi_log_trim (141 ms) 2024-09-12T17:36:37.885 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T17:36:37.931 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw.index_racing_removes (45 ms) 2024-09-12T17:36:37.931 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T17:36:37.966 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw.reshardlog_list (36 ms) 2024-09-12T17:36:37.966 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T17:36:37.993 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw.reshardlog_num (26 ms) 2024-09-12T17:36:38.351 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 18 tests from cls_rgw (56921 ms total) 2024-09-12T17:36:38.351 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:36:38.351 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:36:38.351 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 18 tests from 1 test suite ran. (59165 ms total) 2024-09-12T17:36:38.351 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 18 tests. 2024-09-12T17:36:38.353 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:36:38.353 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:36:38.407 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T17:36:38.408 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T17:36:38.408 DEBUG:teuthology.orchestra.run.smithi098:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T17:36:38.474 INFO:tasks.workunit.client.0.smithi098.stdout:Running main() from gmock_main.cc 2024-09-12T17:36:38.474 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:36:38.474 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:36:38.474 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T17:36:38.474 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T17:36:40.364 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw_gc.init (1891 ms) 2024-09-12T17:36:40.365 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T17:36:40.400 INFO:tasks.workunit.client.0.smithi098.stderr:[ ] list info tag = chain-0 2024-09-12T17:36:40.401 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (36 ms) 2024-09-12T17:36:40.401 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T17:36:40.412 INFO:tasks.workunit.client.0.smithi098.stderr:[ ] next_marker is: = 0/4263 2024-09-12T17:36:40.413 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (13 ms) 2024-09-12T17:36:40.413 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T17:36:40.427 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (14 ms) 2024-09-12T17:36:40.428 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T17:36:40.442 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (15 ms) 2024-09-12T17:36:40.442 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T17:36:40.664 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (222 ms) 2024-09-12T17:36:40.664 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T17:36:40.684 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (20 ms) 2024-09-12T17:36:40.684 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T17:36:40.702 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (18 ms) 2024-09-12T17:36:40.702 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T17:36:41.398 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw_gc.finalize (695 ms) 2024-09-12T17:36:41.398 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 9 tests from cls_rgw_gc (2924 ms total) 2024-09-12T17:36:41.398 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:36:41.398 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:36:41.398 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 9 tests from 1 test suite ran. (2925 ms total) 2024-09-12T17:36:41.398 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 9 tests. 2024-09-12T17:36:41.403 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:36:41.403 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:36:41.460 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T17:36:41.461 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T17:36:41.461 DEBUG:teuthology.orchestra.run.smithi098:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T17:36:41.535 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:36:41.535 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:36:41.536 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T17:36:41.536 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:36:43.410 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T17:36:43.411 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T17:36:43.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.440+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~N6SUCEPPRCEW.0 size=255023 2024-09-12T17:36:43.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.440+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=N6SUCEPPRCEW tag=43J06MJM01RS type=write size=1303599 2024-09-12T17:36:43.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.444+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~QUCBN5VVA0R0.0 size=1048576 2024-09-12T17:36:43.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.444+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~QUCBN5VVA0R0.1 size=229068 2024-09-12T17:36:43.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.444+0000 7f1ad43488c0 1 > prepared multipart upload key=SIZ0Z1KWTGUJ upload=QUCBN5VVA0R0 tag=CMTTBX6DM1GV type=write size=2326220 2024-09-12T17:36:43.449 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.448+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=VDUEY03CKWG0 type=del size=103944 2024-09-12T17:36:43.451 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.452+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=RMEH5SR8C5TC type=del size=2629110 2024-09-12T17:36:43.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.456+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~R4CVOS0EUOM0.0 size=46738 2024-09-12T17:36:43.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.456+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=R4CVOS0EUOM0 tag=59P1T23OLPWG type=write size=1095314 2024-09-12T17:36:43.460 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.460+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~4W4SOTUUP0Y0.0 size=1048576 2024-09-12T17:36:43.462 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.460+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~4W4SOTUUP0Y0.1 size=345060 2024-09-12T17:36:43.462 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.460+0000 7f1ad43488c0 1 > prepared multipart upload key=SIZ0Z1KWTGUJ upload=4W4SOTUUP0Y0 tag=L3UNS1N0AIMF type=write size=2442212 2024-09-12T17:36:43.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.464+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=3NFYUEWDXSCV type=del size=491133 2024-09-12T17:36:43.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.468+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~797L09YL65A8.0 size=1048576 2024-09-12T17:36:43.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.468+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~797L09YL65A8.1 size=1048576 2024-09-12T17:36:43.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.472+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~797L09YL65A8.2 size=701241 2024-09-12T17:36:43.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.472+0000 7f1ad43488c0 1 > prepared multipart upload key=3N1YT9TC0M3O upload=797L09YL65A8 tag=APFCI6IPUVFH type=write size=3846969 2024-09-12T17:36:43.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.472+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=T37736OCYFNA type=del size=3198380 2024-09-12T17:36:43.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.476+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=IPUO3AXJG26P type=del size=408621 2024-09-12T17:36:43.480 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.480+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~MFPO7W2ROSGY.0 size=1048576 2024-09-12T17:36:43.482 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.480+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~MFPO7W2ROSGY.1 size=1048576 2024-09-12T17:36:43.483 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.484+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~MFPO7W2ROSGY.2 size=1021126 2024-09-12T17:36:43.483 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.484+0000 7f1ad43488c0 1 > prepared multipart upload key=3N1YT9TC0M3O upload=MFPO7W2ROSGY tag=722QFJAJPM14 type=write size=4166854 2024-09-12T17:36:43.488 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.488+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~8RURGO20K442.0 size=404860 2024-09-12T17:36:43.488 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.488+0000 7f1ad43488c0 1 > prepared multipart upload key=RH4HYE315U5Y upload=8RURGO20K442 tag=GHXL98R876QZ type=write size=1453436 2024-09-12T17:36:43.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.488+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=SN36JUVJB2HB type=write size=490819 2024-09-12T17:36:43.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.492+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=ZDZI43EHXLFM type=write size=965763 2024-09-12T17:36:43.496 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.496+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=LRQFWFRLD7SZ type=del size=2198619 2024-09-12T17:36:43.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.496+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=HB5L5CN152V2 type=del size=141024 2024-09-12T17:36:43.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.500+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~N6SUCEPPRCEW.0 size=255023 2024-09-12T17:36:43.504 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.504+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=N6SUCEPPRCEW tag=43J06MJM01RS type=write size=1303599 2024-09-12T17:36:43.508 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.508+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~921MVUUOE44Z.0 size=1048576 2024-09-12T17:36:43.510 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.508+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~921MVUUOE44Z.1 size=234005 2024-09-12T17:36:43.510 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.508+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=921MVUUOE44Z tag=OJH9XYGK63MY type=write size=2331157 2024-09-12T17:36:43.513 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.512+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~QUCBN5VVA0R0.0 size=1048576 2024-09-12T17:36:43.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.516+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~QUCBN5VVA0R0.1 size=229068 2024-09-12T17:36:43.519 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.520+0000 7f1ad43488c0 1 < completed multipart upload key=SIZ0Z1KWTGUJ upload=QUCBN5VVA0R0 tag=CMTTBX6DM1GV type=write size=2326220 2024-09-12T17:36:43.521 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.520+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=IAWF3BQJRC9H type=write size=594397 2024-09-12T17:36:43.527 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.524+0000 7f1ad43488c0 1 < suggested update operation key=4QO60GZ9V0GK tag=VDUEY03CKWG0 type=del size=103944 2024-09-12T17:36:43.530 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.528+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=G0E07KDD3DKI type=del size=4039881 2024-09-12T17:36:43.533 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.532+0000 7f1ad43488c0 1 < completed delete operation key=XOEPYERWY6IT tag=RMEH5SR8C5TC type=del 2024-09-12T17:36:43.538 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.536+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~XLZHIOGPJEID.0 size=1048576 2024-09-12T17:36:43.540 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.540+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~XLZHIOGPJEID.1 size=1048576 2024-09-12T17:36:43.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.540+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~XLZHIOGPJEID.2 size=794674 2024-09-12T17:36:43.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.540+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=XLZHIOGPJEID tag=8MG2EK3YJS5Y type=write size=3940402 2024-09-12T17:36:43.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.544+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~R4CVOS0EUOM0.0 size=46738 2024-09-12T17:36:43.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.548+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=R4CVOS0EUOM0 tag=59P1T23OLPWG type=write size=1095314 2024-09-12T17:36:43.554 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.552+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~ESKDTXDAJ9MN.0 size=1048576 2024-09-12T17:36:43.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.556+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~ESKDTXDAJ9MN.1 size=1048576 2024-09-12T17:36:43.558 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.556+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~ESKDTXDAJ9MN.2 size=979911 2024-09-12T17:36:43.558 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.556+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=ESKDTXDAJ9MN tag=K8YWKZPNEDVO type=write size=4125639 2024-09-12T17:36:43.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.560+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~4W4SOTUUP0Y0.0 size=1048576 2024-09-12T17:36:43.562 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.560+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~4W4SOTUUP0Y0.1 size=345060 2024-09-12T17:36:43.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.568+0000 7f1ad43488c0 1 < completed multipart upload key=SIZ0Z1KWTGUJ upload=4W4SOTUUP0Y0 tag=L3UNS1N0AIMF type=write size=2442212 2024-09-12T17:36:43.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.568+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=PVF381Q30HF3 type=del size=3101101 2024-09-12T17:36:43.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.576+0000 7f1ad43488c0 1 < suggested update operation key=7RSHIZRKK2OY tag=3NFYUEWDXSCV type=del size=491133 2024-09-12T17:36:43.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.580+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=F54S5RW8RRTL type=del size=261519 2024-09-12T17:36:43.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.580+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~797L09YL65A8.0 size=1048576 2024-09-12T17:36:43.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.584+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~797L09YL65A8.1 size=1048576 2024-09-12T17:36:43.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.584+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~797L09YL65A8.2 size=701241 2024-09-12T17:36:43.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.592+0000 7f1ad43488c0 1 < completed multipart upload key=3N1YT9TC0M3O upload=797L09YL65A8 tag=APFCI6IPUVFH type=write size=3846969 2024-09-12T17:36:43.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.592+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=V0YOWOT66I5U type=del size=573159 2024-09-12T17:36:43.599 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.600+0000 7f1ad43488c0 1 < suggested remove operation key=7RSHIZRKK2OY tag=T37736OCYFNA type=del 2024-09-12T17:36:43.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.600+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=GL84GPS813SL type=del size=1824225 2024-09-12T17:36:43.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.604+0000 7f1ad43488c0 -1 < failed to complete operation key=4QO60GZ9V0GK tag=IPUO3AXJG26P type=del size=408621: (22) Invalid argument 2024-09-12T17:36:43.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.608+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=ZYA03BU6H6QI type=del size=801901 2024-09-12T17:36:43.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.608+0000 7f1ad43488c0 1 < canceled part key=_multipart_3N1YT9TC0M3O.2~MFPO7W2ROSGY.0 size=1048576 2024-09-12T17:36:43.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.608+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~MFPO7W2ROSGY.1 size=1048576 2024-09-12T17:36:43.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.612+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~MFPO7W2ROSGY.2 size=1021126 2024-09-12T17:36:43.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.616+0000 7f1ad43488c0 1 < canceled multipart upload key=3N1YT9TC0M3O upload=MFPO7W2ROSGY tag=722QFJAJPM14 type=write size=4166854 2024-09-12T17:36:43.619 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.620+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=DUGUSFV11I30 type=del size=842012 2024-09-12T17:36:43.622 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.620+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~8RURGO20K442.0 size=404860 2024-09-12T17:36:43.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.624+0000 7f1ad43488c0 1 < completed multipart upload key=RH4HYE315U5Y upload=8RURGO20K442 tag=GHXL98R876QZ type=write size=1453436 2024-09-12T17:36:43.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.628+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=GTXSHJV8K8I0 type=del size=1170395 2024-09-12T17:36:43.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.632+0000 7f1ad43488c0 1 < completed write operation key=XOEPYERWY6IT tag=SN36JUVJB2HB type=write size=490819 2024-09-12T17:36:43.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.632+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=S5PL4LY9VQUS type=del size=1135019 2024-09-12T17:36:43.639 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.640+0000 7f1ad43488c0 1 < suggested remove operation key=MB3FVGKV0ZNQ tag=ZDZI43EHXLFM type=write 2024-09-12T17:36:43.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.644+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~C70EFYOFD6A2.0 size=1048576 2024-09-12T17:36:43.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.644+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~C70EFYOFD6A2.1 size=306666 2024-09-12T17:36:43.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.644+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=C70EFYOFD6A2 tag=1S6KO3TJ15CM type=write size=2403818 2024-09-12T17:36:43.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.648+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=LRQFWFRLD7SZ type=del 2024-09-12T17:36:43.652 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.652+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=TZ4TEYA4IHVJ type=del size=2407404 2024-09-12T17:36:43.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.652+0000 7f1ad43488c0 1 < completed delete operation key=GWJ78NNXOL1R tag=HB5L5CN152V2 type=del 2024-09-12T17:36:43.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.656+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=YYSFLDMRW5AV type=del size=1699630 2024-09-12T17:36:43.660 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.660+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~921MVUUOE44Z.0 size=1048576 2024-09-12T17:36:43.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.660+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~921MVUUOE44Z.1 size=234005 2024-09-12T17:36:43.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.664+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=921MVUUOE44Z tag=OJH9XYGK63MY type=write size=2331157 2024-09-12T17:36:43.668 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.668+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=FYY33J1U29MV type=del size=3563571 2024-09-12T17:36:43.671 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.672+0000 7f1ad43488c0 1 < completed write operation key=2SDYAQRNWAJK tag=IAWF3BQJRC9H type=write size=594397 2024-09-12T17:36:43.675 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.676+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~L98HQFXEY01K.0 size=1048576 2024-09-12T17:36:43.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.676+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~L98HQFXEY01K.1 size=769665 2024-09-12T17:36:43.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.676+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=L98HQFXEY01K tag=XJCLMIZY8CID type=write size=2866817 2024-09-12T17:36:43.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.680+0000 7f1ad43488c0 1 < suggested update operation key=WWB6LAHAMIR9 tag=G0E07KDD3DKI type=del size=4039881 2024-09-12T17:36:43.685 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.684+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=JNJ80ZLKI5ES type=del size=162779 2024-09-12T17:36:43.689 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.688+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~XLZHIOGPJEID.0 size=1048576 2024-09-12T17:36:43.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.692+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~XLZHIOGPJEID.1 size=1048576 2024-09-12T17:36:43.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.692+0000 7f1ad43488c0 1 < canceled part key=_multipart_ECEF8IJGU4Z8.2~XLZHIOGPJEID.2 size=794674 2024-09-12T17:36:43.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.700+0000 7f1ad43488c0 1 < canceled multipart upload key=ECEF8IJGU4Z8 upload=XLZHIOGPJEID tag=8MG2EK3YJS5Y type=write size=3940402 2024-09-12T17:36:43.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.708+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~JEAMVNQESIVE.0 size=240971 2024-09-12T17:36:43.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.708+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=JEAMVNQESIVE tag=QPLCOPD9KO3M type=write size=1289547 2024-09-12T17:36:43.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.708+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~ESKDTXDAJ9MN.0 size=1048576 2024-09-12T17:36:43.713 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.712+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~ESKDTXDAJ9MN.1 size=1048576 2024-09-12T17:36:43.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.716+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~ESKDTXDAJ9MN.2 size=979911 2024-09-12T17:36:43.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.720+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=ESKDTXDAJ9MN tag=K8YWKZPNEDVO type=write size=4125639 2024-09-12T17:36:43.723 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.724+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=P0UZAEW40249 type=write size=341943 2024-09-12T17:36:43.726 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.724+0000 7f1ad43488c0 -1 < failed to complete operation key=MB3FVGKV0ZNQ tag=PVF381Q30HF3 type=del size=3101101: (22) Invalid argument 2024-09-12T17:36:43.729 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.728+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=LVDRW2F5NY9O type=del size=1220249 2024-09-12T17:36:43.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.736+0000 7f1ad43488c0 1 < suggested update operation key=ECEF8IJGU4Z8 tag=F54S5RW8RRTL type=del size=261519 2024-09-12T17:36:43.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.740+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~HLIVW2OT9AMN.0 size=1048576 2024-09-12T17:36:43.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.744+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~HLIVW2OT9AMN.1 size=136448 2024-09-12T17:36:43.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.744+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=HLIVW2OT9AMN tag=HFSRRJZEK4NS type=write size=2233600 2024-09-12T17:36:43.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.748+0000 7f1ad43488c0 1 < completed delete operation key=PKC1RR4FZWE0 tag=V0YOWOT66I5U type=del 2024-09-12T17:36:43.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.748+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=55KV9K759MOG type=del size=934042 2024-09-12T17:36:43.754 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.752+0000 7f1ad43488c0 1 < completed delete operation key=X0HT3K3OREL7 tag=GL84GPS813SL type=del 2024-09-12T17:36:43.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.756+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~SVMZSDQ4MK7R.0 size=1048576 2024-09-12T17:36:43.761 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.760+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~SVMZSDQ4MK7R.1 size=945492 2024-09-12T17:36:43.762 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.760+0000 7f1ad43488c0 1 > prepared multipart upload key=CHMM14VRIOQH upload=SVMZSDQ4MK7R tag=K3VE8RCAAC9K type=write size=3042644 2024-09-12T17:36:43.765 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.764+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=ZYA03BU6H6QI type=del 2024-09-12T17:36:43.770 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.768+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~9AN1BRJ3FOIL.0 size=340008 2024-09-12T17:36:43.770 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.768+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=9AN1BRJ3FOIL tag=P228COMACW0N type=write size=1388584 2024-09-12T17:36:43.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.772+0000 7f1ad43488c0 1 < completed delete operation key=SDJ53NSPOIRC tag=DUGUSFV11I30 type=del 2024-09-12T17:36:43.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.776+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~12Y1ODT226AR.0 size=1048576 2024-09-12T17:36:43.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.780+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~12Y1ODT226AR.1 size=1048576 2024-09-12T17:36:43.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.784+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~12Y1ODT226AR.2 size=99315 2024-09-12T17:36:43.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.784+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=12Y1ODT226AR tag=X3LB8LCWBUG9 type=write size=3245043 2024-09-12T17:36:43.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.784+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=GTXSHJV8K8I0 type=del 2024-09-12T17:36:43.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.792+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~70CCBPZWPPSZ.0 size=1013644 2024-09-12T17:36:43.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.792+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=70CCBPZWPPSZ tag=VU9PCLLXQGDZ type=write size=2062220 2024-09-12T17:36:43.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.796+0000 7f1ad43488c0 1 < completed delete operation key=WFEJLVRCKIUU tag=S5PL4LY9VQUS type=del 2024-09-12T17:36:43.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.800+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~0CZUSWIY1NPN.0 size=466999 2024-09-12T17:36:43.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.800+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=0CZUSWIY1NPN tag=9KQ47TZG5XZB type=write size=1515575 2024-09-12T17:36:43.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.804+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~C70EFYOFD6A2.0 size=1048576 2024-09-12T17:36:43.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.808+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~C70EFYOFD6A2.1 size=306666 2024-09-12T17:36:43.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.812+0000 7f1ad43488c0 1 < completed multipart upload key=MB3FVGKV0ZNQ upload=C70EFYOFD6A2 tag=1S6KO3TJ15CM type=write size=2403818 2024-09-12T17:36:43.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.816+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~AJ5XPKGOR61T.0 size=268049 2024-09-12T17:36:43.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.816+0000 7f1ad43488c0 1 > prepared multipart upload key=GWJ78NNXOL1R upload=AJ5XPKGOR61T tag=DB2AOS7ULMMI type=write size=1316625 2024-09-12T17:36:43.822 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.820+0000 7f1ad43488c0 1 < completed delete operation key=SDJ53NSPOIRC tag=TZ4TEYA4IHVJ type=del 2024-09-12T17:36:43.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.824+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=DFPYMO7TR5ID type=del size=51161 2024-09-12T17:36:43.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.828+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=YYSFLDMRW5AV type=del 2024-09-12T17:36:43.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.832+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=M8B71YP5JEZN type=del size=3823496 2024-09-12T17:36:43.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.836+0000 7f1ad43488c0 1 < suggested remove operation key=0MV3GCBTWZD0 tag=FYY33J1U29MV type=del 2024-09-12T17:36:43.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.840+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=1GLT096GMG83 type=del size=1862600 2024-09-12T17:36:43.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.840+0000 7f1ad43488c0 1 < canceled part key=_multipart_PKC1RR4FZWE0.2~L98HQFXEY01K.0 size=1048576 2024-09-12T17:36:43.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.844+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~L98HQFXEY01K.1 size=769665 2024-09-12T17:36:43.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.848+0000 7f1ad43488c0 1 < canceled multipart upload key=PKC1RR4FZWE0 upload=L98HQFXEY01K tag=XJCLMIZY8CID type=write size=2866817 2024-09-12T17:36:43.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.852+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=GCCIY249C0ZE type=del size=1848169 2024-09-12T17:36:43.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.856+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=JNJ80ZLKI5ES type=del 2024-09-12T17:36:43.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.860+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=WNWBA7CSHB64 type=del size=1035672 2024-09-12T17:36:43.864 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.864+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~JEAMVNQESIVE.0 size=240971 2024-09-12T17:36:43.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.868+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=JEAMVNQESIVE tag=QPLCOPD9KO3M type=write size=1289547 2024-09-12T17:36:43.879 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.880+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~AKKDNR35888Z.0 size=355530 2024-09-12T17:36:43.879 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.880+0000 7f1ad43488c0 1 > prepared multipart upload key=3N1YT9TC0M3O upload=AKKDNR35888Z tag=JK4UXO1KKBK8 type=write size=1404106 2024-09-12T17:36:43.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.880+0000 7f1ad43488c0 1 < completed write operation key=PKC1RR4FZWE0 tag=P0UZAEW40249 type=write size=341943 2024-09-12T17:36:43.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.888+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~M92CQOORYXTG.0 size=1048576 2024-09-12T17:36:43.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.888+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~M92CQOORYXTG.1 size=1048576 2024-09-12T17:36:43.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.892+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~M92CQOORYXTG.2 size=806219 2024-09-12T17:36:43.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.892+0000 7f1ad43488c0 1 > prepared multipart upload key=ZHFRKX9YY8P5 upload=M92CQOORYXTG tag=S2AMEEY8101E type=write size=3951947 2024-09-12T17:36:43.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.896+0000 7f1ad43488c0 1 < completed delete operation key=MB3FVGKV0ZNQ tag=LVDRW2F5NY9O type=del 2024-09-12T17:36:43.902 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.900+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~EKBHGV9X098U.0 size=1048576 2024-09-12T17:36:43.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.904+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~EKBHGV9X098U.1 size=1048576 2024-09-12T17:36:43.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.908+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~EKBHGV9X098U.2 size=360082 2024-09-12T17:36:43.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.908+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=EKBHGV9X098U tag=7D0TG4ECEK9Y type=write size=3505810 2024-09-12T17:36:43.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.912+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~HLIVW2OT9AMN.0 size=1048576 2024-09-12T17:36:43.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.912+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~HLIVW2OT9AMN.1 size=136448 2024-09-12T17:36:43.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.920+0000 7f1ad43488c0 1 < completed multipart upload key=WWB6LAHAMIR9 upload=HLIVW2OT9AMN tag=HFSRRJZEK4NS type=write size=2233600 2024-09-12T17:36:43.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.920+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=5O79XVBUMNEY type=write size=747213 2024-09-12T17:36:43.926 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.924+0000 7f1ad43488c0 1 < completed delete operation key=MB3FVGKV0ZNQ tag=55KV9K759MOG type=del 2024-09-12T17:36:43.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.928+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=M2VLPSI91P0M type=del size=4044544 2024-09-12T17:36:43.933 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.932+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~SVMZSDQ4MK7R.0 size=1048576 2024-09-12T17:36:43.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.936+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~SVMZSDQ4MK7R.1 size=945492 2024-09-12T17:36:43.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.940+0000 7f1ad43488c0 1 < completed multipart upload key=CHMM14VRIOQH upload=SVMZSDQ4MK7R tag=K3VE8RCAAC9K type=write size=3042644 2024-09-12T17:36:43.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.944+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=7W0XBV7CC2IO type=del size=3191459 2024-09-12T17:36:43.947 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.948+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~9AN1BRJ3FOIL.0 size=340008 2024-09-12T17:36:43.952 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.952+0000 7f1ad43488c0 1 < completed multipart upload key=7RSHIZRKK2OY upload=9AN1BRJ3FOIL tag=P228COMACW0N type=write size=1388584 2024-09-12T17:36:43.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.956+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=LRD61HUVZ3IL type=del size=700789 2024-09-12T17:36:43.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.956+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~12Y1ODT226AR.0 size=1048576 2024-09-12T17:36:43.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.960+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~12Y1ODT226AR.1 size=1048576 2024-09-12T17:36:43.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.960+0000 7f1ad43488c0 1 < canceled part key=_multipart_4QO60GZ9V0GK.2~12Y1ODT226AR.2 size=99315 2024-09-12T17:36:43.967 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.964+0000 7f1ad43488c0 1 < canceled multipart upload key=4QO60GZ9V0GK upload=12Y1ODT226AR tag=X3LB8LCWBUG9 type=write size=3245043 2024-09-12T17:36:43.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.972+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~JTHHF7HOD8WB.0 size=1048576 2024-09-12T17:36:43.975 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.972+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~JTHHF7HOD8WB.1 size=1048576 2024-09-12T17:36:43.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.976+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~JTHHF7HOD8WB.2 size=869966 2024-09-12T17:36:43.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.976+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=JTHHF7HOD8WB tag=8DU0REBDY7O9 type=write size=4015694 2024-09-12T17:36:43.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.980+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~70CCBPZWPPSZ.0 size=1013644 2024-09-12T17:36:43.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.984+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=70CCBPZWPPSZ tag=VU9PCLLXQGDZ type=write size=2062220 2024-09-12T17:36:43.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.988+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=B008MXVUU0RR type=del size=3159880 2024-09-12T17:36:43.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:43.992+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~0CZUSWIY1NPN.0 size=466999 2024-09-12T17:36:44.000 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.000+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=0CZUSWIY1NPN tag=9KQ47TZG5XZB type=write size=1515575 2024-09-12T17:36:44.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.004+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=TPUVEZSYJACK type=write size=174807 2024-09-12T17:36:44.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.004+0000 7f1ad43488c0 1 < canceled part key=_multipart_GWJ78NNXOL1R.2~AJ5XPKGOR61T.0 size=268049 2024-09-12T17:36:44.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.008+0000 7f1ad43488c0 1 < canceled multipart upload key=GWJ78NNXOL1R upload=AJ5XPKGOR61T tag=DB2AOS7ULMMI type=write size=1316625 2024-09-12T17:36:44.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.012+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=YHM1745XENFQ type=write size=126913 2024-09-12T17:36:44.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.016+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=DFPYMO7TR5ID type=del 2024-09-12T17:36:44.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.020+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~ZVXZCJ2CV4C4.0 size=1048576 2024-09-12T17:36:44.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.024+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~ZVXZCJ2CV4C4.1 size=1048576 2024-09-12T17:36:44.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.028+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~ZVXZCJ2CV4C4.2 size=441403 2024-09-12T17:36:44.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.028+0000 7f1ad43488c0 1 > prepared multipart upload key=WFEJLVRCKIUU upload=ZVXZCJ2CV4C4 tag=ZBXGZS0Q05CQ type=write size=3587131 2024-09-12T17:36:44.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.028+0000 7f1ad43488c0 1 < completed delete operation key=X0HT3K3OREL7 tag=M8B71YP5JEZN type=del 2024-09-12T17:36:44.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.032+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=GDBJXF8G06DL type=del size=2639165 2024-09-12T17:36:44.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.036+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=1GLT096GMG83 type=del 2024-09-12T17:36:44.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.044+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~UGDAHQ6LPO7Y.0 size=1048576 2024-09-12T17:36:44.046 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.044+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~UGDAHQ6LPO7Y.1 size=667532 2024-09-12T17:36:44.046 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.044+0000 7f1ad43488c0 1 > prepared multipart upload key=CHMM14VRIOQH upload=UGDAHQ6LPO7Y tag=I392TK2CCBZV type=write size=2764684 2024-09-12T17:36:44.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.048+0000 7f1ad43488c0 1 < completed delete operation key=9Z2EHQA8T5F4 tag=GCCIY249C0ZE type=del 2024-09-12T17:36:44.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.052+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=PW3WL83AORHM type=del size=1606505 2024-09-12T17:36:44.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.056+0000 7f1ad43488c0 1 < completed delete operation key=2SDYAQRNWAJK tag=WNWBA7CSHB64 type=del 2024-09-12T17:36:44.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.060+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~TIQWRGSSSB3W.0 size=1048576 2024-09-12T17:36:44.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.064+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~TIQWRGSSSB3W.1 size=195391 2024-09-12T17:36:44.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.064+0000 7f1ad43488c0 1 > prepared multipart upload key=Y3NQLDWQJ37Z upload=TIQWRGSSSB3W tag=3S06EFQ2EY7C type=write size=2292543 2024-09-12T17:36:44.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.064+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~AKKDNR35888Z.0 size=355530 2024-09-12T17:36:44.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.072+0000 7f1ad43488c0 1 < completed multipart upload key=3N1YT9TC0M3O upload=AKKDNR35888Z tag=JK4UXO1KKBK8 type=write size=1404106 2024-09-12T17:36:44.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.072+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=87SJ74B2FOOY type=del size=1609840 2024-09-12T17:36:44.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.076+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~M92CQOORYXTG.0 size=1048576 2024-09-12T17:36:44.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.076+0000 7f1ad43488c0 1 < canceled part key=_multipart_ZHFRKX9YY8P5.2~M92CQOORYXTG.1 size=1048576 2024-09-12T17:36:44.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.080+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~M92CQOORYXTG.2 size=806219 2024-09-12T17:36:44.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.084+0000 7f1ad43488c0 1 < canceled multipart upload key=ZHFRKX9YY8P5 upload=M92CQOORYXTG tag=S2AMEEY8101E type=write size=3951947 2024-09-12T17:36:44.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.088+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=M4UMTPM46K21 type=del size=210255 2024-09-12T17:36:44.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.092+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~EKBHGV9X098U.0 size=1048576 2024-09-12T17:36:44.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.096+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~EKBHGV9X098U.1 size=1048576 2024-09-12T17:36:44.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.096+0000 7f1ad43488c0 1 < canceled part key=_multipart_4QO60GZ9V0GK.2~EKBHGV9X098U.2 size=360082 2024-09-12T17:36:44.102 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.100+0000 7f1ad43488c0 1 < canceled multipart upload key=4QO60GZ9V0GK upload=EKBHGV9X098U tag=7D0TG4ECEK9Y type=write size=3505810 2024-09-12T17:36:44.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.108+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~5647JFCH57H4.0 size=1048576 2024-09-12T17:36:44.111 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.112+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~5647JFCH57H4.1 size=906737 2024-09-12T17:36:44.111 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.112+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=5647JFCH57H4 tag=R5QG2J9N2GAC type=write size=3003889 2024-09-12T17:36:44.115 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.116+0000 7f1ad43488c0 1 < completed write operation key=PKC1RR4FZWE0 tag=5O79XVBUMNEY type=write size=747213 2024-09-12T17:36:44.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.116+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=K9UOMWX9HZDK type=del size=1891161 2024-09-12T17:36:44.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.124+0000 7f1ad43488c0 1 < suggested remove operation key=BCPDXAL027U2 tag=M2VLPSI91P0M type=del 2024-09-12T17:36:44.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.132+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~94M1PCZ7MRT5.0 size=445045 2024-09-12T17:36:44.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.132+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=94M1PCZ7MRT5 tag=AR9IIAAS8GH0 type=write size=1493621 2024-09-12T17:36:44.136 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.136+0000 7f1ad43488c0 1 < completed delete operation key=9Z2EHQA8T5F4 tag=7W0XBV7CC2IO type=del 2024-09-12T17:36:44.142 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.140+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~J03U0K14X2N6.0 size=1048576 2024-09-12T17:36:44.144 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.144+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~J03U0K14X2N6.1 size=1048576 2024-09-12T17:36:44.147 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.148+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~J03U0K14X2N6.2 size=6488 2024-09-12T17:36:44.147 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.148+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=J03U0K14X2N6 tag=DHKPYUNZOGRI type=write size=3152216 2024-09-12T17:36:44.151 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.148+0000 7f1ad43488c0 1 < completed delete operation key=GWJ78NNXOL1R tag=LRD61HUVZ3IL type=del 2024-09-12T17:36:44.154 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.152+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=AOCV11W1B050 type=del size=3549448 2024-09-12T17:36:44.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.156+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~JTHHF7HOD8WB.0 size=1048576 2024-09-12T17:36:44.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.160+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~JTHHF7HOD8WB.1 size=1048576 2024-09-12T17:36:44.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.164+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~JTHHF7HOD8WB.2 size=869966 2024-09-12T17:36:44.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.168+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=JTHHF7HOD8WB tag=8DU0REBDY7O9 type=write size=4015694 2024-09-12T17:36:44.176 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.176+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~Z4W1NW8E6YFW.0 size=114784 2024-09-12T17:36:44.176 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.176+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=Z4W1NW8E6YFW tag=39U1BKUNDE3N type=write size=1163360 2024-09-12T17:36:44.180 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.180+0000 7f1ad43488c0 1 < completed delete operation key=SDJ53NSPOIRC tag=B008MXVUU0RR type=del 2024-09-12T17:36:44.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.184+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=8YQ120V7MZ8F type=del size=512068 2024-09-12T17:36:44.187 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.188+0000 7f1ad43488c0 1 < completed write operation key=4QO60GZ9V0GK tag=TPUVEZSYJACK type=write size=174807 2024-09-12T17:36:44.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.192+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~XYHK7HTIVCWM.0 size=1048576 2024-09-12T17:36:44.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.196+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~XYHK7HTIVCWM.1 size=1048576 2024-09-12T17:36:44.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.196+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~XYHK7HTIVCWM.2 size=394409 2024-09-12T17:36:44.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.196+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=XYHK7HTIVCWM tag=RUOKDROZBE3R type=write size=3540137 2024-09-12T17:36:44.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.200+0000 7f1ad43488c0 1 < completed write operation key=CHMM14VRIOQH tag=YHM1745XENFQ type=write size=126913 2024-09-12T17:36:44.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.204+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=VJXAN9JW9NUN type=del size=1576756 2024-09-12T17:36:44.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.208+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~ZVXZCJ2CV4C4.0 size=1048576 2024-09-12T17:36:44.212 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.212+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~ZVXZCJ2CV4C4.1 size=1048576 2024-09-12T17:36:44.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.216+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~ZVXZCJ2CV4C4.2 size=441403 2024-09-12T17:36:44.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.220+0000 7f1ad43488c0 1 < completed multipart upload key=WFEJLVRCKIUU upload=ZVXZCJ2CV4C4 tag=ZBXGZS0Q05CQ type=write size=3587131 2024-09-12T17:36:44.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.224+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=L1Z428MIBGUP type=write size=636935 2024-09-12T17:36:44.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.232+0000 7f1ad43488c0 1 < suggested remove operation key=6Z3F28JHHEQS tag=GDBJXF8G06DL type=del 2024-09-12T17:36:44.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.232+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=QLB8RLFY02W6 type=del size=3246344 2024-09-12T17:36:44.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.236+0000 7f1ad43488c0 1 < canceled part key=_multipart_CHMM14VRIOQH.2~UGDAHQ6LPO7Y.0 size=1048576 2024-09-12T17:36:44.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.236+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~UGDAHQ6LPO7Y.1 size=667532 2024-09-12T17:36:44.244 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.244+0000 7f1ad43488c0 1 < canceled multipart upload key=CHMM14VRIOQH upload=UGDAHQ6LPO7Y tag=I392TK2CCBZV type=write size=2764684 2024-09-12T17:36:44.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.248+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~HAFFP6BIXG2P.0 size=956563 2024-09-12T17:36:44.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.248+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=HAFFP6BIXG2P tag=D1YBZZIGO3UB type=write size=2005139 2024-09-12T17:36:44.253 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.252+0000 7f1ad43488c0 1 < canceled operation key=RXJJOPR32OD5 tag=PW3WL83AORHM type=del size=1606505 2024-09-12T17:36:44.257 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.256+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=AWJAQK78GUWE type=write size=363381 2024-09-12T17:36:44.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.260+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~TIQWRGSSSB3W.0 size=1048576 2024-09-12T17:36:44.263 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.260+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~TIQWRGSSSB3W.1 size=195391 2024-09-12T17:36:44.268 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.268+0000 7f1ad43488c0 1 < completed multipart upload key=Y3NQLDWQJ37Z upload=TIQWRGSSSB3W tag=3S06EFQ2EY7C type=write size=2292543 2024-09-12T17:36:44.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.272+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=5Y5OT6A9WGVG type=write size=168639 2024-09-12T17:36:44.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.276+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=87SJ74B2FOOY type=del 2024-09-12T17:36:44.282 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.280+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~6K4BW0KME3ED.0 size=1048576 2024-09-12T17:36:44.285 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.284+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~6K4BW0KME3ED.1 size=320483 2024-09-12T17:36:44.285 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.284+0000 7f1ad43488c0 1 > prepared multipart upload key=WFEJLVRCKIUU upload=6K4BW0KME3ED tag=QNSHCYJ3IVZR type=write size=2417635 2024-09-12T17:36:44.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.288+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=M4UMTPM46K21 type=del 2024-09-12T17:36:44.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.292+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=W2HXV4Y8GF3B type=del size=2096897 2024-09-12T17:36:44.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.292+0000 7f1ad43488c0 1 < canceled part key=_multipart_2SDYAQRNWAJK.2~5647JFCH57H4.0 size=1048576 2024-09-12T17:36:44.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.296+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~5647JFCH57H4.1 size=906737 2024-09-12T17:36:44.301 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.300+0000 7f1ad43488c0 1 < canceled multipart upload key=2SDYAQRNWAJK upload=5647JFCH57H4 tag=R5QG2J9N2GAC type=write size=3003889 2024-09-12T17:36:44.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.304+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~0031I8BKLP3H.0 size=878841 2024-09-12T17:36:44.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.304+0000 7f1ad43488c0 1 > prepared multipart upload key=GWJ78NNXOL1R upload=0031I8BKLP3H tag=NPJ7LUDITBHK type=write size=1927417 2024-09-12T17:36:44.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.316+0000 7f1ad43488c0 1 < suggested remove operation key=3N1YT9TC0M3O tag=K9UOMWX9HZDK type=del 2024-09-12T17:36:44.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.320+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=M7RLLMQXO6D4 type=del size=3330632 2024-09-12T17:36:44.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.324+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~94M1PCZ7MRT5.0 size=445045 2024-09-12T17:36:44.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.328+0000 7f1ad43488c0 1 < completed multipart upload key=7RSHIZRKK2OY upload=94M1PCZ7MRT5 tag=AR9IIAAS8GH0 type=write size=1493621 2024-09-12T17:36:44.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.332+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=12QX9E6FQVQC type=write size=688578 2024-09-12T17:36:44.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.336+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~J03U0K14X2N6.0 size=1048576 2024-09-12T17:36:44.341 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.340+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~J03U0K14X2N6.1 size=1048576 2024-09-12T17:36:44.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.344+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~J03U0K14X2N6.2 size=6488 2024-09-12T17:36:44.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.352+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=J03U0K14X2N6 tag=DHKPYUNZOGRI type=write size=3152216 2024-09-12T17:36:44.355 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.352+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=7HCFD2OEJJDP type=del size=2637815 2024-09-12T17:36:44.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.360+0000 7f1ad43488c0 1 < completed delete operation key=PKC1RR4FZWE0 tag=AOCV11W1B050 type=del 2024-09-12T17:36:44.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.364+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=LXIWK1RJBDCO type=write size=786229 2024-09-12T17:36:44.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.368+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~Z4W1NW8E6YFW.0 size=114784 2024-09-12T17:36:44.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.372+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=Z4W1NW8E6YFW tag=39U1BKUNDE3N type=write size=1163360 2024-09-12T17:36:44.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.380+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~U7NVHWXADO8I.0 size=1048576 2024-09-12T17:36:44.384 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.384+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~U7NVHWXADO8I.1 size=191800 2024-09-12T17:36:44.384 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.384+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=U7NVHWXADO8I tag=1OK8DS1WTU3F type=write size=2288952 2024-09-12T17:36:44.390 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.388+0000 7f1ad43488c0 1 < suggested update operation key=ECEF8IJGU4Z8 tag=8YQ120V7MZ8F type=del size=512068 2024-09-12T17:36:44.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.396+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=V9EY2930F1K8 type=del size=1922838 2024-09-12T17:36:44.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.408+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~XYHK7HTIVCWM.0 size=1048576 2024-09-12T17:36:44.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.420+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~XYHK7HTIVCWM.1 size=1048576 2024-09-12T17:36:44.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.424+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~XYHK7HTIVCWM.2 size=394409 2024-09-12T17:36:44.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.432+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=XYHK7HTIVCWM tag=RUOKDROZBE3R type=write size=3540137 2024-09-12T17:36:44.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.436+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=WP6IPNR1V387 type=write size=937262 2024-09-12T17:36:44.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.440+0000 7f1ad43488c0 1 < completed delete operation key=GWJ78NNXOL1R tag=VJXAN9JW9NUN type=del 2024-09-12T17:36:44.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.448+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~HBXTZC3GVVZB.0 size=1048576 2024-09-12T17:36:44.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.448+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~HBXTZC3GVVZB.1 size=327325 2024-09-12T17:36:44.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.448+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=HBXTZC3GVVZB tag=I8T88E9L1YU1 type=write size=2424477 2024-09-12T17:36:44.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.456+0000 7f1ad43488c0 1 < suggested update operation key=MB3FVGKV0ZNQ tag=L1Z428MIBGUP type=write size=636935 2024-09-12T17:36:44.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.460+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~6EBN6PXG0YXM.0 size=1048576 2024-09-12T17:36:44.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.464+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~6EBN6PXG0YXM.1 size=273275 2024-09-12T17:36:44.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.464+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=6EBN6PXG0YXM tag=ZYXL10E70FVQ type=write size=2370427 2024-09-12T17:36:44.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.464+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=QLB8RLFY02W6 type=del 2024-09-12T17:36:44.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.468+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=561ABUHY3KJC type=del size=589817 2024-09-12T17:36:44.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.472+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~HAFFP6BIXG2P.0 size=956563 2024-09-12T17:36:44.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.476+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=HAFFP6BIXG2P tag=D1YBZZIGO3UB type=write size=2005139 2024-09-12T17:36:44.481 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.480+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=1N2B6OEC30RP type=del size=3619545 2024-09-12T17:36:44.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.484+0000 7f1ad43488c0 1 < completed write operation key=WFEJLVRCKIUU tag=AWJAQK78GUWE type=write size=363381 2024-09-12T17:36:44.489 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.488+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=F0HJ3DWTPYHG type=write size=404205 2024-09-12T17:36:44.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.492+0000 7f1ad43488c0 1 < completed write operation key=LU7XIBO5YUOR tag=5Y5OT6A9WGVG type=write size=168639 2024-09-12T17:36:44.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.496+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~SQUUS43QLZFX.0 size=1048576 2024-09-12T17:36:44.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.500+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~SQUUS43QLZFX.1 size=1048576 2024-09-12T17:36:44.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.504+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~SQUUS43QLZFX.2 size=962116 2024-09-12T17:36:44.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.504+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=SQUUS43QLZFX tag=FJ1YLQI0GIQ9 type=write size=4107844 2024-09-12T17:36:44.507 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.504+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~6K4BW0KME3ED.0 size=1048576 2024-09-12T17:36:44.507 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.504+0000 7f1ad43488c0 1 < canceled part key=_multipart_WFEJLVRCKIUU.2~6K4BW0KME3ED.1 size=320483 2024-09-12T17:36:44.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.512+0000 7f1ad43488c0 1 < canceled multipart upload key=WFEJLVRCKIUU upload=6K4BW0KME3ED tag=QNSHCYJ3IVZR type=write size=2417635 2024-09-12T17:36:44.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.516+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~TNEITFXD0VGW.0 size=1048576 2024-09-12T17:36:44.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.520+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~TNEITFXD0VGW.1 size=1048576 2024-09-12T17:36:44.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.520+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~TNEITFXD0VGW.2 size=324491 2024-09-12T17:36:44.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.520+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=TNEITFXD0VGW tag=6JJ71PV10TV8 type=write size=3470219 2024-09-12T17:36:44.525 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.524+0000 7f1ad43488c0 1 < completed delete operation key=9Z2EHQA8T5F4 tag=W2HXV4Y8GF3B type=del 2024-09-12T17:36:44.528 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.528+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=5ZA7VX46O31L type=del size=2949580 2024-09-12T17:36:44.532 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.532+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~0031I8BKLP3H.0 size=878841 2024-09-12T17:36:44.537 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.536+0000 7f1ad43488c0 1 < completed multipart upload key=GWJ78NNXOL1R upload=0031I8BKLP3H tag=NPJ7LUDITBHK type=write size=1927417 2024-09-12T17:36:44.543 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.544+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~5MSYW0GFOUOF.0 size=1048576 2024-09-12T17:36:44.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.544+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~5MSYW0GFOUOF.1 size=732294 2024-09-12T17:36:44.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.544+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=5MSYW0GFOUOF tag=GJXC2RKFYMWM type=write size=2829446 2024-09-12T17:36:44.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.548+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=M7RLLMQXO6D4 type=del 2024-09-12T17:36:44.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.552+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=L4YTI8CJH8OG type=del size=3148968 2024-09-12T17:36:44.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.556+0000 7f1ad43488c0 1 < completed write operation key=05PAFB226IFP tag=12QX9E6FQVQC type=write size=688578 2024-09-12T17:36:44.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.560+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~1TVKQX96XYCP.0 size=1048576 2024-09-12T17:36:44.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.564+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~1TVKQX96XYCP.1 size=759572 2024-09-12T17:36:44.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.564+0000 7f1ad43488c0 1 > prepared multipart upload key=Y3NQLDWQJ37Z upload=1TVKQX96XYCP tag=HME2ULL469D1 type=write size=2856724 2024-09-12T17:36:44.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.564+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=7HCFD2OEJJDP type=del 2024-09-12T17:36:44.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.568+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=KGULETH7VAQI type=del size=3119839 2024-09-12T17:36:44.573 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.572+0000 7f1ad43488c0 1 < canceled operation key=LU7XIBO5YUOR tag=LXIWK1RJBDCO type=write size=786229 2024-09-12T17:36:44.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.576+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=2WPR8OAI59D2 type=del size=2154373 2024-09-12T17:36:44.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.576+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~U7NVHWXADO8I.0 size=1048576 2024-09-12T17:36:44.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.580+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~U7NVHWXADO8I.1 size=191800 2024-09-12T17:36:44.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.584+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=U7NVHWXADO8I tag=1OK8DS1WTU3F type=write size=2288952 2024-09-12T17:36:44.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.588+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=RF6Q17K568KL type=del size=2537259 2024-09-12T17:36:44.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.592+0000 7f1ad43488c0 1 < suggested update operation key=LU7XIBO5YUOR tag=V9EY2930F1K8 type=del size=1922838 2024-09-12T17:36:44.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.592+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=B7EWRMPCOLGH type=del size=1879024 2024-09-12T17:36:44.597 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.596+0000 7f1ad43488c0 1 < completed write operation key=NHOG1WG3VT6N tag=WP6IPNR1V387 type=write size=937262 2024-09-12T17:36:44.599 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.600+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=818AN9854Q7U type=del size=811110 2024-09-12T17:36:44.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.600+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~HBXTZC3GVVZB.0 size=1048576 2024-09-12T17:36:44.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.604+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~HBXTZC3GVVZB.1 size=327325 2024-09-12T17:36:44.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.608+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=HBXTZC3GVVZB tag=I8T88E9L1YU1 type=write size=2424477 2024-09-12T17:36:44.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.608+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=RRR70IYC9RP0 type=del size=2039725 2024-09-12T17:36:44.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.612+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~6EBN6PXG0YXM.0 size=1048576 2024-09-12T17:36:44.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.616+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~6EBN6PXG0YXM.1 size=273275 2024-09-12T17:36:44.620 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.620+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=6EBN6PXG0YXM tag=ZYXL10E70FVQ type=write size=2370427 2024-09-12T17:36:44.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.624+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~WSWQY47RO9RK.0 size=1048576 2024-09-12T17:36:44.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.628+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~WSWQY47RO9RK.1 size=1048576 2024-09-12T17:36:44.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.628+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~WSWQY47RO9RK.2 size=826950 2024-09-12T17:36:44.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.628+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=WSWQY47RO9RK tag=U3LFSFBRIE5D type=write size=3972678 2024-09-12T17:36:44.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.632+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=561ABUHY3KJC type=del 2024-09-12T17:36:44.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.636+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=0RX35WZD23P5 type=del size=373944 2024-09-12T17:36:44.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.636+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=1N2B6OEC30RP type=del 2024-09-12T17:36:44.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.644+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~7GRB23H1GDVO.0 size=1048576 2024-09-12T17:36:44.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.644+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~7GRB23H1GDVO.1 size=1048576 2024-09-12T17:36:44.647 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.648+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~7GRB23H1GDVO.2 size=581185 2024-09-12T17:36:44.647 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.648+0000 7f1ad43488c0 1 > prepared multipart upload key=Y3NQLDWQJ37Z upload=7GRB23H1GDVO tag=WUKI82ZGQGJD type=write size=3726913 2024-09-12T17:36:44.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.648+0000 7f1ad43488c0 1 < completed write operation key=X078SB1ITNII tag=F0HJ3DWTPYHG type=write size=404205 2024-09-12T17:36:44.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.652+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~RKD275SV6EJM.0 size=1048576 2024-09-12T17:36:44.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.656+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~RKD275SV6EJM.1 size=1048576 2024-09-12T17:36:44.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.656+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~RKD275SV6EJM.2 size=765276 2024-09-12T17:36:44.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.656+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=RKD275SV6EJM tag=AZ18L8AU0WJP type=write size=3911004 2024-09-12T17:36:44.660 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.660+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~SQUUS43QLZFX.0 size=1048576 2024-09-12T17:36:44.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.660+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~SQUUS43QLZFX.1 size=1048576 2024-09-12T17:36:44.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.660+0000 7f1ad43488c0 1 < canceled part key=_multipart_8U3L46JDJ8VS.2~SQUUS43QLZFX.2 size=962116 2024-09-12T17:36:44.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.664+0000 7f1ad43488c0 1 < canceled multipart upload key=8U3L46JDJ8VS upload=SQUUS43QLZFX tag=FJ1YLQI0GIQ9 type=write size=4107844 2024-09-12T17:36:44.671 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.672+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~L1YHA3P8UN7V.0 size=866885 2024-09-12T17:36:44.671 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.672+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=L1YHA3P8UN7V tag=BQEMDKEDGDYX type=write size=1915461 2024-09-12T17:36:44.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.672+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~TNEITFXD0VGW.0 size=1048576 2024-09-12T17:36:44.675 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.676+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~TNEITFXD0VGW.1 size=1048576 2024-09-12T17:36:44.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.676+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~TNEITFXD0VGW.2 size=324491 2024-09-12T17:36:44.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.680+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=TNEITFXD0VGW tag=6JJ71PV10TV8 type=write size=3470219 2024-09-12T17:36:44.685 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.684+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~HJ6ATUKJY9VK.0 size=1048576 2024-09-12T17:36:44.687 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.684+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~HJ6ATUKJY9VK.1 size=450502 2024-09-12T17:36:44.687 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.684+0000 7f1ad43488c0 1 > prepared multipart upload key=3N1YT9TC0M3O upload=HJ6ATUKJY9VK tag=6YK0LO8H96YS type=write size=2547654 2024-09-12T17:36:44.689 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.688+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=5ZA7VX46O31L type=del 2024-09-12T17:36:44.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.692+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=KSELTZBS73FP type=del size=855627 2024-09-12T17:36:44.693 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.692+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~5MSYW0GFOUOF.0 size=1048576 2024-09-12T17:36:44.695 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.696+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~5MSYW0GFOUOF.1 size=732294 2024-09-12T17:36:44.699 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.700+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=5MSYW0GFOUOF tag=GJXC2RKFYMWM type=write size=2829446 2024-09-12T17:36:44.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.700+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=E7GR8P58K11P type=del size=2453977 2024-09-12T17:36:44.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.704+0000 7f1ad43488c0 1 < suggested update operation key=6Z3F28JHHEQS tag=L4YTI8CJH8OG type=del size=3148968 2024-09-12T17:36:44.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.708+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~KLRKUISBCM41.0 size=469723 2024-09-12T17:36:44.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.708+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=KLRKUISBCM41 tag=0R88RMY9BQKW type=write size=1518299 2024-09-12T17:36:44.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.708+0000 7f1ad43488c0 1 < canceled part key=_multipart_Y3NQLDWQJ37Z.2~1TVKQX96XYCP.0 size=1048576 2024-09-12T17:36:44.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.712+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~1TVKQX96XYCP.1 size=759572 2024-09-12T17:36:44.716 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.716+0000 7f1ad43488c0 1 < canceled multipart upload key=Y3NQLDWQJ37Z upload=1TVKQX96XYCP tag=HME2ULL469D1 type=write size=2856724 2024-09-12T17:36:44.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.716+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=7R4KKAN1H7T8 type=del size=3568064 2024-09-12T17:36:44.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.720+0000 7f1ad43488c0 1 < completed delete operation key=C7QSOK3D3IWJ tag=KGULETH7VAQI type=del 2024-09-12T17:36:44.723 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.720+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=GY3P8DQSGL1C type=del size=415833 2024-09-12T17:36:44.725 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.724+0000 7f1ad43488c0 1 < canceled operation key=CHMM14VRIOQH tag=2WPR8OAI59D2 type=del size=2154373 2024-09-12T17:36:44.728 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.728+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=CT031PL2JJA6 type=del size=160055 2024-09-12T17:36:44.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.732+0000 7f1ad43488c0 1 < suggested update operation key=IY2AM7CJDUZG tag=RF6Q17K568KL type=del size=2537259 2024-09-12T17:36:44.739 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.736+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~K8XJTACCNES3.0 size=1048576 2024-09-12T17:36:44.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.740+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~K8XJTACCNES3.1 size=1048576 2024-09-12T17:36:44.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.744+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~K8XJTACCNES3.2 size=1013730 2024-09-12T17:36:44.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.744+0000 7f1ad43488c0 1 > prepared multipart upload key=9Z2EHQA8T5F4 upload=K8XJTACCNES3 tag=XBKUP01IB3YJ type=write size=4159458 2024-09-12T17:36:44.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.748+0000 7f1ad43488c0 1 < completed delete operation key=RH4HYE315U5Y tag=B7EWRMPCOLGH type=del 2024-09-12T17:36:44.754 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.752+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~ATNB30J8EEYM.0 size=898138 2024-09-12T17:36:44.754 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.752+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=ATNB30J8EEYM tag=F84XSA5S1AOR type=write size=1946714 2024-09-12T17:36:44.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.756+0000 7f1ad43488c0 1 < completed delete operation key=ECEF8IJGU4Z8 tag=818AN9854Q7U type=del 2024-09-12T17:36:44.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.760+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=VBBXG0AH2U28 type=del size=1003114 2024-09-12T17:36:44.763 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.764+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=RRR70IYC9RP0 type=del 2024-09-12T17:36:44.768 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.768+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~PUASWI7FDPJU.0 size=684945 2024-09-12T17:36:44.768 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.768+0000 7f1ad43488c0 1 > prepared multipart upload key=Y3NQLDWQJ37Z upload=PUASWI7FDPJU tag=UCS4RRT4GTSR type=write size=1733521 2024-09-12T17:36:44.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.772+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~WSWQY47RO9RK.0 size=1048576 2024-09-12T17:36:44.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.772+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~WSWQY47RO9RK.1 size=1048576 2024-09-12T17:36:44.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.776+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~WSWQY47RO9RK.2 size=826950 2024-09-12T17:36:44.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.780+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=WSWQY47RO9RK tag=U3LFSFBRIE5D type=write size=3972678 2024-09-12T17:36:44.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.784+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=T9K5U1KL5I12 type=del size=2515373 2024-09-12T17:36:44.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.784+0000 7f1ad43488c0 -1 < failed to complete operation key=6Z3F28JHHEQS tag=0RX35WZD23P5 type=del size=373944: (22) Invalid argument 2024-09-12T17:36:44.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.788+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=0562MOC5XOCS type=del size=3619278 2024-09-12T17:36:44.792 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.792+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~7GRB23H1GDVO.0 size=1048576 2024-09-12T17:36:44.792 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.792+0000 7f1ad43488c0 1 < canceled part key=_multipart_Y3NQLDWQJ37Z.2~7GRB23H1GDVO.1 size=1048576 2024-09-12T17:36:44.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.792+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~7GRB23H1GDVO.2 size=581185 2024-09-12T17:36:44.799 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.800+0000 7f1ad43488c0 1 < canceled multipart upload key=Y3NQLDWQJ37Z upload=7GRB23H1GDVO tag=WUKI82ZGQGJD type=write size=3726913 2024-09-12T17:36:44.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.804+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~JA49X2JR5ZEY.0 size=85242 2024-09-12T17:36:44.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.804+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=JA49X2JR5ZEY tag=N6AIC6YP1C3L type=write size=1133818 2024-09-12T17:36:44.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.808+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~RKD275SV6EJM.0 size=1048576 2024-09-12T17:36:44.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.808+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~RKD275SV6EJM.1 size=1048576 2024-09-12T17:36:44.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.812+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~RKD275SV6EJM.2 size=765276 2024-09-12T17:36:44.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.816+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=RKD275SV6EJM tag=AZ18L8AU0WJP type=write size=3911004 2024-09-12T17:36:44.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.820+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~DVO7L8E3WB1P.0 size=1048576 2024-09-12T17:36:44.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.824+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~DVO7L8E3WB1P.1 size=1048576 2024-09-12T17:36:44.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.828+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~DVO7L8E3WB1P.2 size=321323 2024-09-12T17:36:44.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.828+0000 7f1ad43488c0 1 > prepared multipart upload key=GWJ78NNXOL1R upload=DVO7L8E3WB1P tag=PJ5K1R7QA2E5 type=write size=3467051 2024-09-12T17:36:44.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.832+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~L1YHA3P8UN7V.0 size=866885 2024-09-12T17:36:44.836 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.836+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=L1YHA3P8UN7V tag=BQEMDKEDGDYX type=write size=1915461 2024-09-12T17:36:44.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.840+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~VLNC4VSP5PAW.0 size=1048576 2024-09-12T17:36:44.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.844+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~VLNC4VSP5PAW.1 size=1048576 2024-09-12T17:36:44.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.844+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~VLNC4VSP5PAW.2 size=253604 2024-09-12T17:36:44.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.844+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=VLNC4VSP5PAW tag=XLFQ8IR7NOHI type=write size=3399332 2024-09-12T17:36:44.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.848+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~HJ6ATUKJY9VK.0 size=1048576 2024-09-12T17:36:44.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.848+0000 7f1ad43488c0 1 < canceled part key=_multipart_3N1YT9TC0M3O.2~HJ6ATUKJY9VK.1 size=450502 2024-09-12T17:36:44.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.852+0000 7f1ad43488c0 1 < canceled multipart upload key=3N1YT9TC0M3O upload=HJ6ATUKJY9VK tag=6YK0LO8H96YS type=write size=2547654 2024-09-12T17:36:44.856 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.856+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=RPVQQEBUF97B type=del size=1361905 2024-09-12T17:36:44.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.856+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=KSELTZBS73FP type=del 2024-09-12T17:36:44.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.864+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~U5S61WSBC61U.0 size=1048576 2024-09-12T17:36:44.865 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.864+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~U5S61WSBC61U.1 size=1048576 2024-09-12T17:36:44.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.868+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~U5S61WSBC61U.2 size=606852 2024-09-12T17:36:44.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.868+0000 7f1ad43488c0 1 > prepared multipart upload key=Y3NQLDWQJ37Z upload=U5S61WSBC61U tag=EXS6DJXZAHAZ type=write size=3752580 2024-09-12T17:36:44.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.868+0000 7f1ad43488c0 1 < completed delete operation key=PKC1RR4FZWE0 tag=E7GR8P58K11P type=del 2024-09-12T17:36:44.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.872+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=9ZN417OMAXC8 type=del size=535825 2024-09-12T17:36:44.876 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.876+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~KLRKUISBCM41.0 size=469723 2024-09-12T17:36:44.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.880+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=KLRKUISBCM41 tag=0R88RMY9BQKW type=write size=1518299 2024-09-12T17:36:44.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.884+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=LDWI59ODNNEK type=write size=912971 2024-09-12T17:36:44.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.888+0000 7f1ad43488c0 1 < suggested remove operation key=MB3FVGKV0ZNQ tag=7R4KKAN1H7T8 type=del 2024-09-12T17:36:44.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.892+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=3UJCXP2U74U4 type=del size=514392 2024-09-12T17:36:44.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.896+0000 7f1ad43488c0 1 < suggested update operation key=4QO60GZ9V0GK tag=GY3P8DQSGL1C type=del size=415833 2024-09-12T17:36:44.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.904+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~DHH6VGDP03MA.0 size=1048576 2024-09-12T17:36:44.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.904+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~DHH6VGDP03MA.1 size=1048576 2024-09-12T17:36:44.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.908+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~DHH6VGDP03MA.2 size=875003 2024-09-12T17:36:44.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.908+0000 7f1ad43488c0 1 > prepared multipart upload key=WFEJLVRCKIUU upload=DHH6VGDP03MA tag=4IWEUSL5H5NK type=write size=4020731 2024-09-12T17:36:44.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.912+0000 7f1ad43488c0 1 < canceled operation key=3N1YT9TC0M3O tag=CT031PL2JJA6 type=del size=160055 2024-09-12T17:36:44.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.916+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~SWD9DM0XJ2ML.0 size=1048576 2024-09-12T17:36:44.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.916+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~SWD9DM0XJ2ML.1 size=1048576 2024-09-12T17:36:44.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.920+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~SWD9DM0XJ2ML.2 size=505185 2024-09-12T17:36:44.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.920+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=SWD9DM0XJ2ML tag=2IALJT410R5Z type=write size=3650913 2024-09-12T17:36:44.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.920+0000 7f1ad43488c0 1 < canceled part key=_multipart_9Z2EHQA8T5F4.2~K8XJTACCNES3.0 size=1048576 2024-09-12T17:36:44.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.924+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~K8XJTACCNES3.1 size=1048576 2024-09-12T17:36:44.927 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.924+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~K8XJTACCNES3.2 size=1013730 2024-09-12T17:36:44.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.932+0000 7f1ad43488c0 1 < canceled multipart upload key=9Z2EHQA8T5F4 upload=K8XJTACCNES3 tag=XBKUP01IB3YJ type=write size=4159458 2024-09-12T17:36:44.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.936+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~0ION1HT0TY34.0 size=899993 2024-09-12T17:36:44.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.936+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=0ION1HT0TY34 tag=Q268YLD8Q7OJ type=write size=1948569 2024-09-12T17:36:44.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.940+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~ATNB30J8EEYM.0 size=898138 2024-09-12T17:36:44.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.944+0000 7f1ad43488c0 1 < completed multipart upload key=MB3FVGKV0ZNQ upload=ATNB30J8EEYM tag=F84XSA5S1AOR type=write size=1946714 2024-09-12T17:36:44.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.948+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~9OZPT90K3D98.0 size=435779 2024-09-12T17:36:44.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.948+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=9OZPT90K3D98 tag=3L35GIHZ9QC2 type=write size=1484355 2024-09-12T17:36:44.952 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.952+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=VBBXG0AH2U28 type=del 2024-09-12T17:36:44.957 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.956+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~1DOFLWLF1CQT.0 size=683004 2024-09-12T17:36:44.958 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.956+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=1DOFLWLF1CQT tag=7SNDGCN9JA01 type=write size=1731580 2024-09-12T17:36:44.958 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.956+0000 7f1ad43488c0 1 < canceled part key=_multipart_Y3NQLDWQJ37Z.2~PUASWI7FDPJU.0 size=684945 2024-09-12T17:36:44.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.960+0000 7f1ad43488c0 1 < canceled multipart upload key=Y3NQLDWQJ37Z upload=PUASWI7FDPJU tag=UCS4RRT4GTSR type=write size=1733521 2024-09-12T17:36:44.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.964+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=7ISHTTVF82QF type=del size=29308 2024-09-12T17:36:44.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.968+0000 7f1ad43488c0 1 < suggested remove operation key=MB3FVGKV0ZNQ tag=T9K5U1KL5I12 type=del 2024-09-12T17:36:44.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.972+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=BGIB1UCBXOB7 type=del size=446221 2024-09-12T17:36:44.975 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.976+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=0562MOC5XOCS type=del 2024-09-12T17:36:44.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.976+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=SJ06KLJCAZS6 type=del size=259592 2024-09-12T17:36:44.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.980+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~JA49X2JR5ZEY.0 size=85242 2024-09-12T17:36:44.987 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.988+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=JA49X2JR5ZEY tag=N6AIC6YP1C3L type=write size=1133818 2024-09-12T17:36:44.990 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.988+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=PGYYCUM0GSZY type=del size=2327106 2024-09-12T17:36:44.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.992+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~DVO7L8E3WB1P.0 size=1048576 2024-09-12T17:36:44.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.996+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~DVO7L8E3WB1P.1 size=1048576 2024-09-12T17:36:44.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:44.996+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~DVO7L8E3WB1P.2 size=321323 2024-09-12T17:36:45.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.004+0000 7f1ad43488c0 1 < completed multipart upload key=GWJ78NNXOL1R upload=DVO7L8E3WB1P tag=PJ5K1R7QA2E5 type=write size=3467051 2024-09-12T17:36:45.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.004+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=IBH44GRJG9NA type=del size=2522324 2024-09-12T17:36:45.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.008+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~VLNC4VSP5PAW.0 size=1048576 2024-09-12T17:36:45.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.012+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~VLNC4VSP5PAW.1 size=1048576 2024-09-12T17:36:45.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.012+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~VLNC4VSP5PAW.2 size=253604 2024-09-12T17:36:45.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.020+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=VLNC4VSP5PAW tag=XLFQ8IR7NOHI type=write size=3399332 2024-09-12T17:36:45.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.024+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~XBFSMZMUHZFJ.0 size=1048576 2024-09-12T17:36:45.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.028+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~XBFSMZMUHZFJ.1 size=1048576 2024-09-12T17:36:45.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.028+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~XBFSMZMUHZFJ.2 size=133899 2024-09-12T17:36:45.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.028+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=XBFSMZMUHZFJ tag=WKXXKEOHL274 type=write size=3279627 2024-09-12T17:36:45.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.036+0000 7f1ad43488c0 1 < suggested update operation key=4QO60GZ9V0GK tag=RPVQQEBUF97B type=del size=1361905 2024-09-12T17:36:45.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.040+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=69LDGG0YHTJS type=del size=564827 2024-09-12T17:36:45.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.044+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~U5S61WSBC61U.0 size=1048576 2024-09-12T17:36:45.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.044+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~U5S61WSBC61U.1 size=1048576 2024-09-12T17:36:45.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.048+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~U5S61WSBC61U.2 size=606852 2024-09-12T17:36:45.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.052+0000 7f1ad43488c0 1 < completed multipart upload key=Y3NQLDWQJ37Z upload=U5S61WSBC61U tag=EXS6DJXZAHAZ type=write size=3752580 2024-09-12T17:36:45.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.060+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~UDD4SDKMXWP1.0 size=476806 2024-09-12T17:36:45.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.060+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=UDD4SDKMXWP1 tag=JJ35PAGUW5WQ type=write size=1525382 2024-09-12T17:36:45.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.060+0000 7f1ad43488c0 1 < completed delete operation key=RH4HYE315U5Y tag=9ZN417OMAXC8 type=del 2024-09-12T17:36:45.065 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.064+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=F954BUYQRWTG type=del size=1354471 2024-09-12T17:36:45.068 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.068+0000 7f1ad43488c0 1 < completed write operation key=CHMM14VRIOQH tag=LDWI59ODNNEK type=write size=912971 2024-09-12T17:36:45.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.072+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=AM8ZJD5TXUF5 type=del size=1158162 2024-09-12T17:36:45.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.072+0000 7f1ad43488c0 1 < completed delete operation key=05PAFB226IFP tag=3UJCXP2U74U4 type=del 2024-09-12T17:36:45.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.080+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~JEVBRMVBJ7KH.0 size=1048576 2024-09-12T17:36:45.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.080+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~JEVBRMVBJ7KH.1 size=1048576 2024-09-12T17:36:45.084 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.084+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~JEVBRMVBJ7KH.2 size=1003993 2024-09-12T17:36:45.084 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.084+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=JEVBRMVBJ7KH tag=3R0DXRBBA4HO type=write size=4149721 2024-09-12T17:36:45.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.088+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~DHH6VGDP03MA.0 size=1048576 2024-09-12T17:36:45.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.088+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~DHH6VGDP03MA.1 size=1048576 2024-09-12T17:36:45.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.092+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~DHH6VGDP03MA.2 size=875003 2024-09-12T17:36:45.098 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.096+0000 7f1ad43488c0 1 < completed multipart upload key=WFEJLVRCKIUU upload=DHH6VGDP03MA tag=4IWEUSL5H5NK type=write size=4020731 2024-09-12T17:36:45.103 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.100+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~ZRNC4IEYATWG.0 size=1048576 2024-09-12T17:36:45.105 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.104+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~ZRNC4IEYATWG.1 size=1048576 2024-09-12T17:36:45.107 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.108+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~ZRNC4IEYATWG.2 size=1045807 2024-09-12T17:36:45.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.108+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=ZRNC4IEYATWG tag=P6QRW2SSF2WA type=write size=4191535 2024-09-12T17:36:45.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.108+0000 7f1ad43488c0 1 < canceled part key=_multipart_RXJJOPR32OD5.2~SWD9DM0XJ2ML.0 size=1048576 2024-09-12T17:36:45.110 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.108+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~SWD9DM0XJ2ML.1 size=1048576 2024-09-12T17:36:45.112 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.112+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~SWD9DM0XJ2ML.2 size=505185 2024-09-12T17:36:45.117 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.116+0000 7f1ad43488c0 1 < canceled multipart upload key=RXJJOPR32OD5 upload=SWD9DM0XJ2ML tag=2IALJT410R5Z type=write size=3650913 2024-09-12T17:36:45.122 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.120+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~KA69MFX5AYTT.0 size=913854 2024-09-12T17:36:45.122 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.120+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=KA69MFX5AYTT tag=4FW647LX69LE type=write size=1962430 2024-09-12T17:36:45.124 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.124+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~0ION1HT0TY34.0 size=899993 2024-09-12T17:36:45.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.128+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=0ION1HT0TY34 tag=Q268YLD8Q7OJ type=write size=1948569 2024-09-12T17:36:45.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.132+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=VH4M2ZAQ4KMY type=del size=3689013 2024-09-12T17:36:45.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.132+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~9OZPT90K3D98.0 size=435779 2024-09-12T17:36:45.140 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.140+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=9OZPT90K3D98 tag=3L35GIHZ9QC2 type=write size=1484355 2024-09-12T17:36:45.143 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.140+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=PU9SYT811LTB type=del size=1380692 2024-09-12T17:36:45.148 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.148+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~1DOFLWLF1CQT.0 size=683004 2024-09-12T17:36:45.153 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.152+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=1DOFLWLF1CQT tag=7SNDGCN9JA01 type=write size=1731580 2024-09-12T17:36:45.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.156+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~DSQBDF8QCHV2.0 size=1048576 2024-09-12T17:36:45.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.160+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~DSQBDF8QCHV2.1 size=881685 2024-09-12T17:36:45.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.160+0000 7f1ad43488c0 1 > prepared multipart upload key=WFEJLVRCKIUU upload=DSQBDF8QCHV2 tag=3K47BYEM3KBI type=write size=2978837 2024-09-12T17:36:45.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.164+0000 7f1ad43488c0 1 < suggested update operation key=8U3L46JDJ8VS tag=7ISHTTVF82QF type=del size=29308 2024-09-12T17:36:45.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.172+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~RH9R5KBA739V.0 size=264006 2024-09-12T17:36:45.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.172+0000 7f1ad43488c0 1 > prepared multipart upload key=CHMM14VRIOQH upload=RH9R5KBA739V tag=9XB4G55E2R7B type=write size=1312582 2024-09-12T17:36:45.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.172+0000 7f1ad43488c0 1 < completed delete operation key=XOEPYERWY6IT tag=BGIB1UCBXOB7 type=del 2024-09-12T17:36:45.180 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.180+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~XL924OF3XOQM.0 size=708287 2024-09-12T17:36:45.180 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.180+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=XL924OF3XOQM tag=R0WN2YAK1FFR type=write size=1756863 2024-09-12T17:36:45.186 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.184+0000 7f1ad43488c0 1 < suggested update operation key=XOEPYERWY6IT tag=SJ06KLJCAZS6 type=del size=259592 2024-09-12T17:36:45.188 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.188+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=MISX42BN53D2 type=del size=2570461 2024-09-12T17:36:45.191 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.192+0000 7f1ad43488c0 1 < completed delete operation key=WFEJLVRCKIUU tag=PGYYCUM0GSZY type=del 2024-09-12T17:36:45.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.196+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~SLMFVH7BARQL.0 size=1048576 2024-09-12T17:36:45.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.200+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~SLMFVH7BARQL.1 size=1048576 2024-09-12T17:36:45.201 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.200+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~SLMFVH7BARQL.2 size=486553 2024-09-12T17:36:45.201 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.200+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=SLMFVH7BARQL tag=Y021ZVA20ITM type=write size=3632281 2024-09-12T17:36:45.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.204+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=IBH44GRJG9NA type=del 2024-09-12T17:36:45.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.208+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~MOF9CDYDMGHG.0 size=490492 2024-09-12T17:36:45.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.208+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=MOF9CDYDMGHG tag=YYDX9F80YFMO type=write size=1539068 2024-09-12T17:36:45.213 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.212+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~XBFSMZMUHZFJ.0 size=1048576 2024-09-12T17:36:45.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.216+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~XBFSMZMUHZFJ.1 size=1048576 2024-09-12T17:36:45.218 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.216+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~XBFSMZMUHZFJ.2 size=133899 2024-09-12T17:36:45.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.224+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=XBFSMZMUHZFJ tag=WKXXKEOHL274 type=write size=3279627 2024-09-12T17:36:45.226 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.224+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=V3A62SAY3INU type=del size=2336885 2024-09-12T17:36:45.229 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.228+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=69LDGG0YHTJS type=del 2024-09-12T17:36:45.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.232+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=G1C70WB49W39 type=write size=375134 2024-09-12T17:36:45.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.236+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~UDD4SDKMXWP1.0 size=476806 2024-09-12T17:36:45.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.240+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=UDD4SDKMXWP1 tag=JJ35PAGUW5WQ type=write size=1525382 2024-09-12T17:36:45.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.244+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=OQ5MCBCRBWO7 type=write size=324451 2024-09-12T17:36:45.247 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.244+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=F954BUYQRWTG type=del 2024-09-12T17:36:45.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.248+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=LXON5CVC0WKZ type=write size=136473 2024-09-12T17:36:45.253 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.252+0000 7f1ad43488c0 -1 < failed to complete operation key=8U3L46JDJ8VS tag=AM8ZJD5TXUF5 type=del size=1158162: (22) Invalid argument 2024-09-12T17:36:45.256 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.256+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=302SRJACEGKK type=del size=3872550 2024-09-12T17:36:45.259 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.260+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~JEVBRMVBJ7KH.0 size=1048576 2024-09-12T17:36:45.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.260+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~JEVBRMVBJ7KH.1 size=1048576 2024-09-12T17:36:45.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.260+0000 7f1ad43488c0 1 < canceled part key=_multipart_WWB6LAHAMIR9.2~JEVBRMVBJ7KH.2 size=1003993 2024-09-12T17:36:45.268 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.268+0000 7f1ad43488c0 1 < canceled multipart upload key=WWB6LAHAMIR9 upload=JEVBRMVBJ7KH tag=3R0DXRBBA4HO type=write size=4149721 2024-09-12T17:36:45.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.268+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=U5DH1FQ7BYH2 type=del size=2238025 2024-09-12T17:36:45.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.272+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~ZRNC4IEYATWG.0 size=1048576 2024-09-12T17:36:45.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.276+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~ZRNC4IEYATWG.1 size=1048576 2024-09-12T17:36:45.278 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.276+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~ZRNC4IEYATWG.2 size=1045807 2024-09-12T17:36:45.283 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.284+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=ZRNC4IEYATWG tag=P6QRW2SSF2WA type=write size=4191535 2024-09-12T17:36:45.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.288+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~HI6CU763ET8C.0 size=1048576 2024-09-12T17:36:45.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.292+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~HI6CU763ET8C.1 size=1048576 2024-09-12T17:36:45.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.292+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~HI6CU763ET8C.2 size=514006 2024-09-12T17:36:45.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.292+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=HI6CU763ET8C tag=8G3C9ESL124T type=write size=3659734 2024-09-12T17:36:45.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.296+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~KA69MFX5AYTT.0 size=913854 2024-09-12T17:36:45.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.300+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=KA69MFX5AYTT tag=4FW647LX69LE type=write size=1962430 2024-09-12T17:36:45.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.304+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=6G1ZGX18M9N3 type=write size=431421 2024-09-12T17:36:45.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.308+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=VH4M2ZAQ4KMY type=del 2024-09-12T17:36:45.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.312+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=R3N33X4L1NWK type=del size=69742 2024-09-12T17:36:45.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.316+0000 7f1ad43488c0 -1 < failed to complete operation key=8U3L46JDJ8VS tag=PU9SYT811LTB type=del size=1380692: (22) Invalid argument 2024-09-12T17:36:45.323 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.320+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~1SENMIO3D229.0 size=1048576 2024-09-12T17:36:45.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.324+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~1SENMIO3D229.1 size=1048576 2024-09-12T17:36:45.328 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.328+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~1SENMIO3D229.2 size=53632 2024-09-12T17:36:45.328 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.328+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=1SENMIO3D229 tag=JRIQEU6L3MJT type=write size=3199360 2024-09-12T17:36:45.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.328+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~DSQBDF8QCHV2.0 size=1048576 2024-09-12T17:36:45.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.332+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~DSQBDF8QCHV2.1 size=881685 2024-09-12T17:36:45.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.336+0000 7f1ad43488c0 1 < completed multipart upload key=WFEJLVRCKIUU upload=DSQBDF8QCHV2 tag=3K47BYEM3KBI type=write size=2978837 2024-09-12T17:36:45.342 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.340+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=V7E28JLG6UFZ type=del size=210223 2024-09-12T17:36:45.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.344+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~RH9R5KBA739V.0 size=264006 2024-09-12T17:36:45.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.348+0000 7f1ad43488c0 1 < completed multipart upload key=CHMM14VRIOQH upload=RH9R5KBA739V tag=9XB4G55E2R7B type=write size=1312582 2024-09-12T17:36:45.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.356+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~RLTTENDKH7UT.0 size=1048576 2024-09-12T17:36:45.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.360+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~RLTTENDKH7UT.1 size=317317 2024-09-12T17:36:45.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.360+0000 7f1ad43488c0 1 > prepared multipart upload key=Y3NQLDWQJ37Z upload=RLTTENDKH7UT tag=HLFPO2LC4LE8 type=write size=2414469 2024-09-12T17:36:45.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.360+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~XL924OF3XOQM.0 size=708287 2024-09-12T17:36:45.369 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.368+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=XL924OF3XOQM tag=R0WN2YAK1FFR type=write size=1756863 2024-09-12T17:36:45.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.372+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=TPGFH5IJN0AA type=del size=93659 2024-09-12T17:36:45.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.376+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=MISX42BN53D2 type=del 2024-09-12T17:36:45.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.380+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=C882XZAKFE04 type=del size=1343078 2024-09-12T17:36:45.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.384+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~SLMFVH7BARQL.0 size=1048576 2024-09-12T17:36:45.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.384+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~SLMFVH7BARQL.1 size=1048576 2024-09-12T17:36:45.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.388+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~SLMFVH7BARQL.2 size=486553 2024-09-12T17:36:45.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.392+0000 7f1ad43488c0 1 < completed multipart upload key=WWB6LAHAMIR9 upload=SLMFVH7BARQL tag=Y021ZVA20ITM type=write size=3632281 2024-09-12T17:36:45.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.396+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=C2BZ0760CMMJ type=del size=738537 2024-09-12T17:36:45.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.400+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~MOF9CDYDMGHG.0 size=490492 2024-09-12T17:36:45.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.404+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=MOF9CDYDMGHG tag=YYDX9F80YFMO type=write size=1539068 2024-09-12T17:36:45.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.412+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~X3T3FGJKH347.0 size=1048576 2024-09-12T17:36:45.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.412+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~X3T3FGJKH347.1 size=622765 2024-09-12T17:36:45.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.412+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=X3T3FGJKH347 tag=WP2RWU48R5S6 type=write size=2719917 2024-09-12T17:36:45.417 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.416+0000 7f1ad43488c0 1 < completed delete operation key=GWJ78NNXOL1R tag=V3A62SAY3INU type=del 2024-09-12T17:36:45.420 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.420+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=XLGIW1NLLWB5 type=del size=1182532 2024-09-12T17:36:45.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.424+0000 7f1ad43488c0 1 < suggested remove operation key=BCPDXAL027U2 tag=G1C70WB49W39 type=write 2024-09-12T17:36:45.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.428+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=DSSGOVS12YOD type=del size=559084 2024-09-12T17:36:45.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.432+0000 7f1ad43488c0 1 < completed write operation key=2SDYAQRNWAJK tag=OQ5MCBCRBWO7 type=write size=324451 2024-09-12T17:36:45.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.436+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=YAI7IPN7IJNE type=del size=2586458 2024-09-12T17:36:45.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.440+0000 7f1ad43488c0 1 < completed write operation key=IY2AM7CJDUZG tag=LXON5CVC0WKZ type=write size=136473 2024-09-12T17:36:45.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.444+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=KWQK4V2QP93J type=del size=2711868 2024-09-12T17:36:45.449 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.448+0000 7f1ad43488c0 1 < completed delete operation key=ECEF8IJGU4Z8 tag=302SRJACEGKK type=del 2024-09-12T17:36:45.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.452+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=7QFCY8FXQYHS type=del size=2160409 2024-09-12T17:36:45.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.456+0000 7f1ad43488c0 1 < canceled operation key=X0HT3K3OREL7 tag=U5DH1FQ7BYH2 type=del size=2238025 2024-09-12T17:36:45.462 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.460+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~FLU0RD65H67G.0 size=1048576 2024-09-12T17:36:45.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.464+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~FLU0RD65H67G.1 size=429013 2024-09-12T17:36:45.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.464+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=FLU0RD65H67G tag=4BX08D0NKBJT type=write size=2526165 2024-09-12T17:36:45.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.468+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~HI6CU763ET8C.0 size=1048576 2024-09-12T17:36:45.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.468+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~HI6CU763ET8C.1 size=1048576 2024-09-12T17:36:45.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.472+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~HI6CU763ET8C.2 size=514006 2024-09-12T17:36:45.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.476+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=HI6CU763ET8C tag=8G3C9ESL124T type=write size=3659734 2024-09-12T17:36:45.481 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.480+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=8IRGL62NN6MK type=del size=2343179 2024-09-12T17:36:45.484 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.484+0000 7f1ad43488c0 1 < canceled operation key=8U3L46JDJ8VS tag=6G1ZGX18M9N3 type=write size=431421 2024-09-12T17:36:45.487 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.488+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=C95FBI3ODB3R type=del size=3119934 2024-09-12T17:36:45.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.488+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=R3N33X4L1NWK type=del 2024-09-12T17:36:45.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.492+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=0HIMBEVG8KU8 type=del size=2460098 2024-09-12T17:36:45.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.496+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~1SENMIO3D229.0 size=1048576 2024-09-12T17:36:45.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.500+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~1SENMIO3D229.1 size=1048576 2024-09-12T17:36:45.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.500+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~1SENMIO3D229.2 size=53632 2024-09-12T17:36:45.507 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.504+0000 7f1ad43488c0 1 < completed multipart upload key=IY2AM7CJDUZG upload=1SENMIO3D229 tag=JRIQEU6L3MJT type=write size=3199360 2024-09-12T17:36:45.510 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.508+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=FCTB4190DK1F type=del size=3635376 2024-09-12T17:36:45.513 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.512+0000 7f1ad43488c0 1 < completed delete operation key=RH4HYE315U5Y tag=V7E28JLG6UFZ type=del 2024-09-12T17:36:45.518 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.516+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~56VKGFSCY9BQ.0 size=820789 2024-09-12T17:36:45.518 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.516+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=56VKGFSCY9BQ tag=BRZH6TU02BHG type=write size=1869365 2024-09-12T17:36:45.521 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.520+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~RLTTENDKH7UT.0 size=1048576 2024-09-12T17:36:45.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.524+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~RLTTENDKH7UT.1 size=317317 2024-09-12T17:36:45.528 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.528+0000 7f1ad43488c0 1 < completed multipart upload key=Y3NQLDWQJ37Z upload=RLTTENDKH7UT tag=HLFPO2LC4LE8 type=write size=2414469 2024-09-12T17:36:45.534 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.532+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~QYWOL8N31SVV.0 size=1048576 2024-09-12T17:36:45.536 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.536+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~QYWOL8N31SVV.1 size=1048576 2024-09-12T17:36:45.538 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.536+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~QYWOL8N31SVV.2 size=696533 2024-09-12T17:36:45.538 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.536+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=QYWOL8N31SVV tag=60W6H14JIZDJ type=write size=3842261 2024-09-12T17:36:45.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.544+0000 7f1ad43488c0 1 < suggested remove operation key=05PAFB226IFP tag=TPGFH5IJN0AA type=del 2024-09-12T17:36:45.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.544+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=Q6GCCYYY21IG type=write size=829916 2024-09-12T17:36:45.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.548+0000 7f1ad43488c0 1 < canceled operation key=CHMM14VRIOQH tag=C882XZAKFE04 type=del size=1343078 2024-09-12T17:36:45.553 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.552+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=0ZSFO0QOBO60 type=del size=632676 2024-09-12T17:36:45.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.556+0000 7f1ad43488c0 1 < suggested remove operation key=RXJJOPR32OD5 tag=C2BZ0760CMMJ type=del 2024-09-12T17:36:45.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.564+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~FAXKDZMY4Q2Q.0 size=1048576 2024-09-12T17:36:45.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.564+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~FAXKDZMY4Q2Q.1 size=1008248 2024-09-12T17:36:45.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.564+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=FAXKDZMY4Q2Q tag=ZPFXJUNVYHGQ type=write size=3105400 2024-09-12T17:36:45.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.568+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~X3T3FGJKH347.0 size=1048576 2024-09-12T17:36:45.572 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.572+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~X3T3FGJKH347.1 size=622765 2024-09-12T17:36:45.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.576+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=X3T3FGJKH347 tag=WP2RWU48R5S6 type=write size=2719917 2024-09-12T17:36:45.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.584+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~3Y38SRYIIYL3.0 size=1048576 2024-09-12T17:36:45.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.584+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~3Y38SRYIIYL3.1 size=1048576 2024-09-12T17:36:45.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.588+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~3Y38SRYIIYL3.2 size=971683 2024-09-12T17:36:45.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.588+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=3Y38SRYIIYL3 tag=6DV6G58MHJ8S type=write size=4117411 2024-09-12T17:36:45.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.592+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=XLGIW1NLLWB5 type=del 2024-09-12T17:36:45.597 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.596+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~TLYSHJNYS0TS.0 size=1048576 2024-09-12T17:36:45.600 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.600+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~TLYSHJNYS0TS.1 size=997251 2024-09-12T17:36:45.600 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.600+0000 7f1ad43488c0 1 > prepared multipart upload key=3N1YT9TC0M3O upload=TLYSHJNYS0TS tag=TJ0DI04FRH1P type=write size=3094403 2024-09-12T17:36:45.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.600+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=DSSGOVS12YOD type=del 2024-09-12T17:36:45.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.604+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=66F0HY99GT3S type=write size=944786 2024-09-12T17:36:45.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.608+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=YAI7IPN7IJNE type=del 2024-09-12T17:36:45.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.612+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=C349KK2HOOTU type=del size=2976376 2024-09-12T17:36:45.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.612+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=KWQK4V2QP93J type=del 2024-09-12T17:36:45.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.616+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=6DSK1P68Z00L type=del size=1180795 2024-09-12T17:36:45.620 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.620+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=7QFCY8FXQYHS type=del 2024-09-12T17:36:45.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.624+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~AFEKA39C56UQ.0 size=294921 2024-09-12T17:36:45.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.624+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=AFEKA39C56UQ tag=BG3MH7N87AOJ type=write size=1343497 2024-09-12T17:36:45.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.624+0000 7f1ad43488c0 1 < canceled part key=_multipart_2SDYAQRNWAJK.2~FLU0RD65H67G.0 size=1048576 2024-09-12T17:36:45.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.628+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~FLU0RD65H67G.1 size=429013 2024-09-12T17:36:45.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.632+0000 7f1ad43488c0 1 < canceled multipart upload key=2SDYAQRNWAJK upload=FLU0RD65H67G tag=4BX08D0NKBJT type=write size=2526165 2024-09-12T17:36:45.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.636+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=XCFGUDRYUE76 type=del size=3768251 2024-09-12T17:36:45.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.640+0000 7f1ad43488c0 1 < suggested remove operation key=8U3L46JDJ8VS tag=8IRGL62NN6MK type=del 2024-09-12T17:36:45.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.644+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=OCGTW69TY8AL type=write size=1044281 2024-09-12T17:36:45.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.648+0000 7f1ad43488c0 1 < completed delete operation key=PKC1RR4FZWE0 tag=C95FBI3ODB3R type=del 2024-09-12T17:36:45.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.652+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~GRUU1T38KBXJ.0 size=915636 2024-09-12T17:36:45.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.652+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=GRUU1T38KBXJ tag=PUO092EDVEMV type=write size=1964212 2024-09-12T17:36:45.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.656+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=0HIMBEVG8KU8 type=del 2024-09-12T17:36:45.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.660+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~2WXH2Q24EM5N.0 size=166710 2024-09-12T17:36:45.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.660+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=2WXH2Q24EM5N tag=XHAE7OKAB61W type=write size=1215286 2024-09-12T17:36:45.669 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.668+0000 7f1ad43488c0 1 < suggested remove operation key=6Z3F28JHHEQS tag=FCTB4190DK1F type=del 2024-09-12T17:36:45.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.672+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~DSGWD0SMF5ZF.0 size=1048576 2024-09-12T17:36:45.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.676+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~DSGWD0SMF5ZF.1 size=528856 2024-09-12T17:36:45.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.676+0000 7f1ad43488c0 1 > prepared multipart upload key=RH4HYE315U5Y upload=DSGWD0SMF5ZF tag=E6V4TE108S7C type=write size=2626008 2024-09-12T17:36:45.680 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.680+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~56VKGFSCY9BQ.0 size=820789 2024-09-12T17:36:45.686 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.684+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=56VKGFSCY9BQ tag=BRZH6TU02BHG type=write size=1869365 2024-09-12T17:36:45.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.692+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~8QP6VV0A6EFC.0 size=216381 2024-09-12T17:36:45.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.692+0000 7f1ad43488c0 1 > prepared multipart upload key=NHOG1WG3VT6N upload=8QP6VV0A6EFC tag=MKIMA4Y963HN type=write size=1264957 2024-09-12T17:36:45.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.692+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~QYWOL8N31SVV.0 size=1048576 2024-09-12T17:36:45.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.696+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~QYWOL8N31SVV.1 size=1048576 2024-09-12T17:36:45.699 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.696+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~QYWOL8N31SVV.2 size=696533 2024-09-12T17:36:45.704 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.704+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=QYWOL8N31SVV tag=60W6H14JIZDJ type=write size=3842261 2024-09-12T17:36:45.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.704+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=2RGQN1KAPVXZ type=del size=3050721 2024-09-12T17:36:45.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.708+0000 7f1ad43488c0 1 < completed write operation key=BCPDXAL027U2 tag=Q6GCCYYY21IG type=write size=829916 2024-09-12T17:36:45.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.712+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=0KYDL2FG3QSZ type=del size=2077004 2024-09-12T17:36:45.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.716+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=0ZSFO0QOBO60 type=del 2024-09-12T17:36:45.723 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.720+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~O2QH5RV3EJB4.0 size=1048576 2024-09-12T17:36:45.725 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.724+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~O2QH5RV3EJB4.1 size=724736 2024-09-12T17:36:45.725 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.724+0000 7f1ad43488c0 1 > prepared multipart upload key=NHOG1WG3VT6N upload=O2QH5RV3EJB4 tag=D61W9YX8SQDM type=write size=2821888 2024-09-12T17:36:45.728 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.728+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~FAXKDZMY4Q2Q.0 size=1048576 2024-09-12T17:36:45.730 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.728+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~FAXKDZMY4Q2Q.1 size=1008248 2024-09-12T17:36:45.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.732+0000 7f1ad43488c0 1 < completed multipart upload key=8U3L46JDJ8VS upload=FAXKDZMY4Q2Q tag=ZPFXJUNVYHGQ type=write size=3105400 2024-09-12T17:36:45.740 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.740+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~BOM4O30F6UGF.0 size=1048576 2024-09-12T17:36:45.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.740+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~BOM4O30F6UGF.1 size=1048576 2024-09-12T17:36:45.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.744+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~BOM4O30F6UGF.2 size=592134 2024-09-12T17:36:45.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.744+0000 7f1ad43488c0 1 > prepared multipart upload key=NHOG1WG3VT6N upload=BOM4O30F6UGF tag=UF0WDUPSAWRN type=write size=3737862 2024-09-12T17:36:45.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.744+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~3Y38SRYIIYL3.0 size=1048576 2024-09-12T17:36:45.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.748+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~3Y38SRYIIYL3.1 size=1048576 2024-09-12T17:36:45.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.752+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~3Y38SRYIIYL3.2 size=971683 2024-09-12T17:36:45.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.756+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=3Y38SRYIIYL3 tag=6DV6G58MHJ8S type=write size=4117411 2024-09-12T17:36:45.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.756+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=GHBDKCKQM3TE type=write size=356369 2024-09-12T17:36:45.761 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.760+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~TLYSHJNYS0TS.0 size=1048576 2024-09-12T17:36:45.763 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.764+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~TLYSHJNYS0TS.1 size=997251 2024-09-12T17:36:45.768 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.768+0000 7f1ad43488c0 1 < completed multipart upload key=3N1YT9TC0M3O upload=TLYSHJNYS0TS tag=TJ0DI04FRH1P type=write size=3094403 2024-09-12T17:36:45.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.772+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~G6F2OI2VVTKT.0 size=1048576 2024-09-12T17:36:45.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.772+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~G6F2OI2VVTKT.1 size=796779 2024-09-12T17:36:45.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.772+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=G6F2OI2VVTKT tag=CWSU5EH4NHYM type=write size=2893931 2024-09-12T17:36:45.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.776+0000 7f1ad43488c0 1 < completed write operation key=Y3NQLDWQJ37Z tag=66F0HY99GT3S type=write size=944786 2024-09-12T17:36:45.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.780+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~WQTSDRXGEZW4.0 size=593664 2024-09-12T17:36:45.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.780+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=WQTSDRXGEZW4 tag=EEZLDC0CPJVJ type=write size=1642240 2024-09-12T17:36:45.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.784+0000 7f1ad43488c0 1 < completed delete operation key=X0HT3K3OREL7 tag=C349KK2HOOTU type=del 2024-09-12T17:36:45.787 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.788+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=SBM3GVE7LVW4 type=del size=2217265 2024-09-12T17:36:45.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.788+0000 7f1ad43488c0 1 < completed delete operation key=XOEPYERWY6IT tag=6DSK1P68Z00L type=del 2024-09-12T17:36:45.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.792+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~2Y6BKGOKCD6V.0 size=936068 2024-09-12T17:36:45.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.792+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=2Y6BKGOKCD6V tag=X66JGRPA9N13 type=write size=1984644 2024-09-12T17:36:45.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.796+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~AFEKA39C56UQ.0 size=294921 2024-09-12T17:36:45.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.800+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=AFEKA39C56UQ tag=BG3MH7N87AOJ type=write size=1343497 2024-09-12T17:36:45.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.804+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=OEITR7FZLZG0 type=write size=531679 2024-09-12T17:36:45.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.804+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=XCFGUDRYUE76 type=del 2024-09-12T17:36:45.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.808+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=DL1K5LDTMRXE type=del size=3424452 2024-09-12T17:36:45.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.812+0000 7f1ad43488c0 1 < completed write operation key=X0HT3K3OREL7 tag=OCGTW69TY8AL type=write size=1044281 2024-09-12T17:36:45.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.816+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~PUVXHPE29V2S.0 size=1048576 2024-09-12T17:36:45.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.820+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~PUVXHPE29V2S.1 size=1048576 2024-09-12T17:36:45.822 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.820+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~PUVXHPE29V2S.2 size=1022905 2024-09-12T17:36:45.822 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.820+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=PUVXHPE29V2S tag=ZAPDY8E77U5O type=write size=4168633 2024-09-12T17:36:45.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.824+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~GRUU1T38KBXJ.0 size=915636 2024-09-12T17:36:45.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.828+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=GRUU1T38KBXJ tag=PUO092EDVEMV type=write size=1964212 2024-09-12T17:36:45.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.832+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~VRO9N0QCBBSV.0 size=965964 2024-09-12T17:36:45.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.832+0000 7f1ad43488c0 1 > prepared multipart upload key=3N1YT9TC0M3O upload=VRO9N0QCBBSV tag=2KCTJFD7I66A type=write size=2014540 2024-09-12T17:36:45.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.836+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~2WXH2Q24EM5N.0 size=166710 2024-09-12T17:36:45.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.840+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=2WXH2Q24EM5N tag=XHAE7OKAB61W type=write size=1215286 2024-09-12T17:36:45.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.848+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~N2YGL1WZ5TQE.0 size=1048576 2024-09-12T17:36:45.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.848+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~N2YGL1WZ5TQE.1 size=604878 2024-09-12T17:36:45.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.848+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=N2YGL1WZ5TQE tag=3NMD5J63AN94 type=write size=2702030 2024-09-12T17:36:45.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.852+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~DSGWD0SMF5ZF.0 size=1048576 2024-09-12T17:36:45.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.852+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~DSGWD0SMF5ZF.1 size=528856 2024-09-12T17:36:45.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.856+0000 7f1ad43488c0 1 < completed multipart upload key=RH4HYE315U5Y upload=DSGWD0SMF5ZF tag=E6V4TE108S7C type=write size=2626008 2024-09-12T17:36:45.864 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.864+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~P6ND7SU1CWYG.0 size=1048576 2024-09-12T17:36:45.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.864+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~P6ND7SU1CWYG.1 size=1048576 2024-09-12T17:36:45.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.868+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~P6ND7SU1CWYG.2 size=593921 2024-09-12T17:36:45.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.868+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=P6ND7SU1CWYG tag=6QJ66W7U4ZMY type=write size=3739649 2024-09-12T17:36:45.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.872+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~8QP6VV0A6EFC.0 size=216381 2024-09-12T17:36:45.876 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.876+0000 7f1ad43488c0 1 < completed multipart upload key=NHOG1WG3VT6N upload=8QP6VV0A6EFC tag=MKIMA4Y963HN type=write size=1264957 2024-09-12T17:36:45.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.880+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=PUDRQZS5RQME type=del size=4155129 2024-09-12T17:36:45.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.880+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=2RGQN1KAPVXZ type=del 2024-09-12T17:36:45.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.888+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~IS8UNPEZ8F0C.0 size=634200 2024-09-12T17:36:45.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.888+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=IS8UNPEZ8F0C tag=KORZI94M9CX7 type=write size=1682776 2024-09-12T17:36:45.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.892+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=0KYDL2FG3QSZ type=del 2024-09-12T17:36:45.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.896+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=XYMDF3Z1OC4G type=del size=3315665 2024-09-12T17:36:45.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.896+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~O2QH5RV3EJB4.0 size=1048576 2024-09-12T17:36:45.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.900+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~O2QH5RV3EJB4.1 size=724736 2024-09-12T17:36:45.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.904+0000 7f1ad43488c0 1 < completed multipart upload key=NHOG1WG3VT6N upload=O2QH5RV3EJB4 tag=D61W9YX8SQDM type=write size=2821888 2024-09-12T17:36:45.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.912+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~5RWHNF8SO2IW.0 size=1048576 2024-09-12T17:36:45.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.912+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~5RWHNF8SO2IW.1 size=831197 2024-09-12T17:36:45.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.912+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=5RWHNF8SO2IW tag=WHLV3W9A89H9 type=write size=2928349 2024-09-12T17:36:45.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.916+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~BOM4O30F6UGF.0 size=1048576 2024-09-12T17:36:45.919 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.920+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~BOM4O30F6UGF.1 size=1048576 2024-09-12T17:36:45.922 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.920+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~BOM4O30F6UGF.2 size=592134 2024-09-12T17:36:45.926 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.924+0000 7f1ad43488c0 1 < completed multipart upload key=NHOG1WG3VT6N upload=BOM4O30F6UGF tag=UF0WDUPSAWRN type=write size=3737862 2024-09-12T17:36:45.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.928+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=FFAEZM6WVLPG type=del size=300742 2024-09-12T17:36:45.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.932+0000 7f1ad43488c0 1 < completed write operation key=4QO60GZ9V0GK tag=GHBDKCKQM3TE type=write size=356369 2024-09-12T17:36:45.935 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.936+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=X1UDHVPK4N0V type=del size=2905437 2024-09-12T17:36:45.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.936+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~G6F2OI2VVTKT.0 size=1048576 2024-09-12T17:36:45.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.940+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~G6F2OI2VVTKT.1 size=796779 2024-09-12T17:36:45.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.944+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=G6F2OI2VVTKT tag=CWSU5EH4NHYM type=write size=2893931 2024-09-12T17:36:45.948 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.948+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=DP155MWSQO2D type=del size=1629501 2024-09-12T17:36:45.951 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.952+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~WQTSDRXGEZW4.0 size=593664 2024-09-12T17:36:45.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.956+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=WQTSDRXGEZW4 tag=EEZLDC0CPJVJ type=write size=1642240 2024-09-12T17:36:45.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.960+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=20W6JLWZ049J type=del size=3685330 2024-09-12T17:36:45.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.960+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=SBM3GVE7LVW4 type=del 2024-09-12T17:36:45.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.964+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=6Y3T8XHE75FS type=del size=2681780 2024-09-12T17:36:45.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.968+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~2Y6BKGOKCD6V.0 size=936068 2024-09-12T17:36:45.974 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.972+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=2Y6BKGOKCD6V tag=X66JGRPA9N13 type=write size=1984644 2024-09-12T17:36:45.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.976+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=PDEMFJQAKGRJ type=del size=816980 2024-09-12T17:36:45.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.980+0000 7f1ad43488c0 1 < completed write operation key=05PAFB226IFP tag=OEITR7FZLZG0 type=write size=531679 2024-09-12T17:36:45.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.984+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=AQSMSVD1A1PT type=del size=1084763 2024-09-12T17:36:45.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.992+0000 7f1ad43488c0 1 < suggested remove operation key=WWB6LAHAMIR9 tag=DL1K5LDTMRXE type=del 2024-09-12T17:36:45.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.996+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=A9K1REI4IG52 type=del size=1519352 2024-09-12T17:36:45.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:45.996+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~PUVXHPE29V2S.0 size=1048576 2024-09-12T17:36:46.000 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.000+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~PUVXHPE29V2S.1 size=1048576 2024-09-12T17:36:46.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.004+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~PUVXHPE29V2S.2 size=1022905 2024-09-12T17:36:46.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.008+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=PUVXHPE29V2S tag=ZAPDY8E77U5O type=write size=4168633 2024-09-12T17:36:46.011 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.012+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=H4VNAUHIK32F type=del size=576161 2024-09-12T17:36:46.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.012+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~VRO9N0QCBBSV.0 size=965964 2024-09-12T17:36:46.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.020+0000 7f1ad43488c0 1 < completed multipart upload key=3N1YT9TC0M3O upload=VRO9N0QCBBSV tag=2KCTJFD7I66A type=write size=2014540 2024-09-12T17:36:46.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.024+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~W83OHXINUD2O.0 size=1048576 2024-09-12T17:36:46.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.028+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~W83OHXINUD2O.1 size=1048576 2024-09-12T17:36:46.030 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.028+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~W83OHXINUD2O.2 size=298725 2024-09-12T17:36:46.030 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.028+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=W83OHXINUD2O tag=W2KH8LM07HB8 type=write size=3444453 2024-09-12T17:36:46.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.032+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~N2YGL1WZ5TQE.0 size=1048576 2024-09-12T17:36:46.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.036+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~N2YGL1WZ5TQE.1 size=604878 2024-09-12T17:36:46.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.040+0000 7f1ad43488c0 1 < completed multipart upload key=WWB6LAHAMIR9 upload=N2YGL1WZ5TQE tag=3NMD5J63AN94 type=write size=2702030 2024-09-12T17:36:46.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.044+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=SZ2KIZY0JQR6 type=del size=2927900 2024-09-12T17:36:46.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.048+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~P6ND7SU1CWYG.0 size=1048576 2024-09-12T17:36:46.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.048+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~P6ND7SU1CWYG.1 size=1048576 2024-09-12T17:36:46.053 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.052+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~P6ND7SU1CWYG.2 size=593921 2024-09-12T17:36:46.058 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.056+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=P6ND7SU1CWYG tag=6QJ66W7U4ZMY type=write size=3739649 2024-09-12T17:36:46.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.064+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~A0KKDGDNM3HV.0 size=1048576 2024-09-12T17:36:46.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.064+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~A0KKDGDNM3HV.1 size=375958 2024-09-12T17:36:46.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.064+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=A0KKDGDNM3HV tag=8SDQI1XCAQ09 type=write size=2473110 2024-09-12T17:36:46.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.068+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=PUDRQZS5RQME type=del 2024-09-12T17:36:46.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.076+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~TF7NDTB2YVJ2.0 size=1048576 2024-09-12T17:36:46.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.076+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~TF7NDTB2YVJ2.1 size=279977 2024-09-12T17:36:46.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.076+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=TF7NDTB2YVJ2 tag=WGO1M69WLBYR type=write size=2377129 2024-09-12T17:36:46.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.080+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~IS8UNPEZ8F0C.0 size=634200 2024-09-12T17:36:46.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.084+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=IS8UNPEZ8F0C tag=KORZI94M9CX7 type=write size=1682776 2024-09-12T17:36:46.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.088+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=QCM2T5IXGY3Y type=del size=2430789 2024-09-12T17:36:46.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.092+0000 7f1ad43488c0 1 < completed delete operation key=SDJ53NSPOIRC tag=XYMDF3Z1OC4G type=del 2024-09-12T17:36:46.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.100+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~9U0F6OB0PZK3.0 size=1048576 2024-09-12T17:36:46.102 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.100+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~9U0F6OB0PZK3.1 size=908610 2024-09-12T17:36:46.102 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.100+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=9U0F6OB0PZK3 tag=ND91C19XDN0E type=write size=3005762 2024-09-12T17:36:46.105 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.104+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~5RWHNF8SO2IW.0 size=1048576 2024-09-12T17:36:46.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.108+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~5RWHNF8SO2IW.1 size=831197 2024-09-12T17:36:46.113 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.112+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=5RWHNF8SO2IW tag=WHLV3W9A89H9 type=write size=2928349 2024-09-12T17:36:46.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.120+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~Z6T500KQBJHA.0 size=709247 2024-09-12T17:36:46.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.120+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=Z6T500KQBJHA tag=BPZ9UDZGT9UL type=write size=1757823 2024-09-12T17:36:46.123 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.120+0000 7f1ad43488c0 1 < canceled operation key=7RSHIZRKK2OY tag=FFAEZM6WVLPG type=del size=300742 2024-09-12T17:36:46.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.128+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~GKQ5M96A10IF.0 size=1048576 2024-09-12T17:36:46.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.132+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~GKQ5M96A10IF.1 size=361284 2024-09-12T17:36:46.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.132+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=GKQ5M96A10IF tag=8BU8YOM8BNE7 type=write size=2458436 2024-09-12T17:36:46.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.132+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=X1UDHVPK4N0V type=del 2024-09-12T17:36:46.138 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.136+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=73CYY5KEBPKD type=del size=959102 2024-09-12T17:36:46.142 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.140+0000 7f1ad43488c0 1 < completed delete operation key=ZHFRKX9YY8P5 tag=DP155MWSQO2D type=del 2024-09-12T17:36:46.146 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.144+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=TW5RW7AKDTNP type=write size=935678 2024-09-12T17:36:46.150 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.148+0000 7f1ad43488c0 1 < canceled operation key=8U3L46JDJ8VS tag=20W6JLWZ049J type=del size=3685330 2024-09-12T17:36:46.155 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.156+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~OPRGUYKYT02W.0 size=1048576 2024-09-12T17:36:46.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.156+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~OPRGUYKYT02W.1 size=721062 2024-09-12T17:36:46.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.156+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=OPRGUYKYT02W tag=A7HWG2ZXKORO type=write size=2818214 2024-09-12T17:36:46.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.160+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=6Y3T8XHE75FS type=del 2024-09-12T17:36:46.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.168+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~95Y2N7E73FPU.0 size=310231 2024-09-12T17:36:46.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.168+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=95Y2N7E73FPU tag=7N02LCY19OHI type=write size=1358807 2024-09-12T17:36:46.173 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.172+0000 7f1ad43488c0 1 < suggested remove operation key=9Z2EHQA8T5F4 tag=PDEMFJQAKGRJ type=del 2024-09-12T17:36:46.176 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.176+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=DZ3AFK13ZTZY type=del size=264890 2024-09-12T17:36:46.179 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.180+0000 7f1ad43488c0 1 < completed delete operation key=WFEJLVRCKIUU tag=AQSMSVD1A1PT type=del 2024-09-12T17:36:46.182 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.180+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=OCIXGZMCU04N type=del size=2915498 2024-09-12T17:36:46.185 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.184+0000 7f1ad43488c0 1 < completed delete operation key=WWB6LAHAMIR9 tag=A9K1REI4IG52 type=del 2024-09-12T17:36:46.190 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.188+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~NNPSH7JM0RQM.0 size=1048576 2024-09-12T17:36:46.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.192+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~NNPSH7JM0RQM.1 size=489157 2024-09-12T17:36:46.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.192+0000 7f1ad43488c0 1 > prepared multipart upload key=C7QSOK3D3IWJ upload=NNPSH7JM0RQM tag=JHBABCI5V6WS type=write size=2586309 2024-09-12T17:36:46.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.196+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=H4VNAUHIK32F type=del 2024-09-12T17:36:46.201 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.200+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=JASD7CO6AB6E type=del size=2850341 2024-09-12T17:36:46.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.204+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~W83OHXINUD2O.0 size=1048576 2024-09-12T17:36:46.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.204+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~W83OHXINUD2O.1 size=1048576 2024-09-12T17:36:46.207 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.204+0000 7f1ad43488c0 1 < canceled part key=_multipart_X078SB1ITNII.2~W83OHXINUD2O.2 size=298725 2024-09-12T17:36:46.213 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.212+0000 7f1ad43488c0 1 < canceled multipart upload key=X078SB1ITNII upload=W83OHXINUD2O tag=W2KH8LM07HB8 type=write size=3444453 2024-09-12T17:36:46.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.220+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~MBMP6L76E8KL.0 size=694563 2024-09-12T17:36:46.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.220+0000 7f1ad43488c0 1 > prepared multipart upload key=9Z2EHQA8T5F4 upload=MBMP6L76E8KL tag=NS5I4SKKJO63 type=write size=1743139 2024-09-12T17:36:46.226 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.224+0000 7f1ad43488c0 1 < suggested remove operation key=NHOG1WG3VT6N tag=SZ2KIZY0JQR6 type=del 2024-09-12T17:36:46.229 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.228+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=JRBIU9RX9UHR type=del size=2040336 2024-09-12T17:36:46.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.232+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~A0KKDGDNM3HV.0 size=1048576 2024-09-12T17:36:46.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.232+0000 7f1ad43488c0 1 < canceled part key=_multipart_8U3L46JDJ8VS.2~A0KKDGDNM3HV.1 size=375958 2024-09-12T17:36:46.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.236+0000 7f1ad43488c0 1 < canceled multipart upload key=8U3L46JDJ8VS upload=A0KKDGDNM3HV tag=8SDQI1XCAQ09 type=write size=2473110 2024-09-12T17:36:46.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.244+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~NU05SNGNNWGN.0 size=682836 2024-09-12T17:36:46.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.244+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=NU05SNGNNWGN tag=W2YSFU9BLKLG type=write size=1731412 2024-09-12T17:36:46.248 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.248+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~TF7NDTB2YVJ2.0 size=1048576 2024-09-12T17:36:46.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.252+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~TF7NDTB2YVJ2.1 size=279977 2024-09-12T17:36:46.257 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.256+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=TF7NDTB2YVJ2 tag=WGO1M69WLBYR type=write size=2377129 2024-09-12T17:36:46.264 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.264+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~VMCO962AFNQK.0 size=1048576 2024-09-12T17:36:46.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.264+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~VMCO962AFNQK.1 size=110423 2024-09-12T17:36:46.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.264+0000 7f1ad43488c0 1 > prepared multipart upload key=RH4HYE315U5Y upload=VMCO962AFNQK tag=BZRK1U25MW2S type=write size=2207575 2024-09-12T17:36:46.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.268+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=QCM2T5IXGY3Y type=del 2024-09-12T17:36:46.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.272+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=VFIL9NY53HPN type=del size=746779 2024-09-12T17:36:46.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.276+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~9U0F6OB0PZK3.0 size=1048576 2024-09-12T17:36:46.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.280+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~9U0F6OB0PZK3.1 size=908610 2024-09-12T17:36:46.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.288+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=9U0F6OB0PZK3 tag=ND91C19XDN0E type=write size=3005762 2024-09-12T17:36:46.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.288+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=TV0ZRR29DV5J type=del size=831677 2024-09-12T17:36:46.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.292+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~Z6T500KQBJHA.0 size=709247 2024-09-12T17:36:46.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.300+0000 7f1ad43488c0 1 < completed multipart upload key=IY2AM7CJDUZG upload=Z6T500KQBJHA tag=BPZ9UDZGT9UL type=write size=1757823 2024-09-12T17:36:46.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.300+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=ZFCGL07CJES4 type=del size=2931318 2024-09-12T17:36:46.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.304+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~GKQ5M96A10IF.0 size=1048576 2024-09-12T17:36:46.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.304+0000 7f1ad43488c0 1 < canceled part key=_multipart_IY2AM7CJDUZG.2~GKQ5M96A10IF.1 size=361284 2024-09-12T17:36:46.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.312+0000 7f1ad43488c0 1 < canceled multipart upload key=IY2AM7CJDUZG upload=GKQ5M96A10IF tag=8BU8YOM8BNE7 type=write size=2458436 2024-09-12T17:36:46.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.316+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~MNQ0R4USB6CQ.0 size=1048576 2024-09-12T17:36:46.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.320+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~MNQ0R4USB6CQ.1 size=322855 2024-09-12T17:36:46.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.320+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=MNQ0R4USB6CQ tag=VHIPTRO8GDPR type=write size=2420007 2024-09-12T17:36:46.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.324+0000 7f1ad43488c0 1 < suggested remove operation key=C7QSOK3D3IWJ tag=73CYY5KEBPKD type=del 2024-09-12T17:36:46.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.328+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=GN674NAAMJ5T type=del size=3570216 2024-09-12T17:36:46.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.336+0000 7f1ad43488c0 1 < suggested remove operation key=ECEF8IJGU4Z8 tag=TW5RW7AKDTNP type=write 2024-09-12T17:36:46.342 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.340+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~01CAN1UB7F4Q.0 size=728247 2024-09-12T17:36:46.342 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.340+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=01CAN1UB7F4Q tag=3HXB53BJKR2A type=write size=1776823 2024-09-12T17:36:46.343 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.344+0000 7f1ad43488c0 1 < canceled part key=_multipart_RXJJOPR32OD5.2~OPRGUYKYT02W.0 size=1048576 2024-09-12T17:36:46.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.344+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~OPRGUYKYT02W.1 size=721062 2024-09-12T17:36:46.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.352+0000 7f1ad43488c0 1 < canceled multipart upload key=RXJJOPR32OD5 upload=OPRGUYKYT02W tag=A7HWG2ZXKORO type=write size=2818214 2024-09-12T17:36:46.355 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.352+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=SMTDFOH9HKK6 type=del size=2743666 2024-09-12T17:36:46.358 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.356+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~95Y2N7E73FPU.0 size=310231 2024-09-12T17:36:46.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.364+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=95Y2N7E73FPU tag=7N02LCY19OHI type=write size=1358807 2024-09-12T17:36:46.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.368+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=ZMV4Q20RICM6 type=del size=769485 2024-09-12T17:36:46.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.372+0000 7f1ad43488c0 1 < completed delete operation key=PKC1RR4FZWE0 tag=DZ3AFK13ZTZY type=del 2024-09-12T17:36:46.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.372+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=CLIEIXU72VRV type=write size=1017640 2024-09-12T17:36:46.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.376+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=OCIXGZMCU04N type=del 2024-09-12T17:36:46.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.384+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~2Q6UUIB3YMLX.0 size=1048576 2024-09-12T17:36:46.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.384+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~2Q6UUIB3YMLX.1 size=283934 2024-09-12T17:36:46.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.384+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=2Q6UUIB3YMLX tag=BUHBLIA57IFI type=write size=2381086 2024-09-12T17:36:46.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.388+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~NNPSH7JM0RQM.0 size=1048576 2024-09-12T17:36:46.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.388+0000 7f1ad43488c0 1 < canceled part key=_multipart_C7QSOK3D3IWJ.2~NNPSH7JM0RQM.1 size=489157 2024-09-12T17:36:46.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.392+0000 7f1ad43488c0 1 < canceled multipart upload key=C7QSOK3D3IWJ upload=NNPSH7JM0RQM tag=JHBABCI5V6WS type=write size=2586309 2024-09-12T17:36:46.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.400+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~1P0GWKH09K2G.0 size=1048576 2024-09-12T17:36:46.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.400+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~1P0GWKH09K2G.1 size=1048576 2024-09-12T17:36:46.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.404+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~1P0GWKH09K2G.2 size=81544 2024-09-12T17:36:46.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.404+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=1P0GWKH09K2G tag=3E2A972Z9KL0 type=write size=3227272 2024-09-12T17:36:46.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.408+0000 7f1ad43488c0 1 < completed delete operation key=IY2AM7CJDUZG tag=JASD7CO6AB6E type=del 2024-09-12T17:36:46.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.408+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=AC095HEF26V9 type=write size=300141 2024-09-12T17:36:46.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.412+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~MBMP6L76E8KL.0 size=694563 2024-09-12T17:36:46.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.416+0000 7f1ad43488c0 1 < completed multipart upload key=9Z2EHQA8T5F4 upload=MBMP6L76E8KL tag=NS5I4SKKJO63 type=write size=1743139 2024-09-12T17:36:46.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.420+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=FJAW06QGB9ZX type=del size=2788844 2024-09-12T17:36:46.424 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.424+0000 7f1ad43488c0 1 < completed delete operation key=SIZ0Z1KWTGUJ tag=JRBIU9RX9UHR type=del 2024-09-12T17:36:46.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.428+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~KF6BGKX4Q3GG.0 size=1048576 2024-09-12T17:36:46.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.432+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~KF6BGKX4Q3GG.1 size=1032311 2024-09-12T17:36:46.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.432+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=KF6BGKX4Q3GG tag=ODG4ZHE73AND type=write size=3129463 2024-09-12T17:36:46.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.436+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~NU05SNGNNWGN.0 size=682836 2024-09-12T17:36:46.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.440+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=NU05SNGNNWGN tag=W2YSFU9BLKLG type=write size=1731412 2024-09-12T17:36:46.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.444+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=N0LR4V92JG25 type=del size=2006354 2024-09-12T17:36:46.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.448+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~VMCO962AFNQK.0 size=1048576 2024-09-12T17:36:46.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.448+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~VMCO962AFNQK.1 size=110423 2024-09-12T17:36:46.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.456+0000 7f1ad43488c0 1 < completed multipart upload key=RH4HYE315U5Y upload=VMCO962AFNQK tag=BZRK1U25MW2S type=write size=2207575 2024-09-12T17:36:46.462 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.456+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=5WDLWY0SP5H3 type=del size=2690565 2024-09-12T17:36:46.462 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.460+0000 7f1ad43488c0 -1 < failed to complete operation key=C7QSOK3D3IWJ tag=VFIL9NY53HPN type=del size=746779: (22) Invalid argument 2024-09-12T17:36:46.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.464+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=I0CQ6218MCMA type=write size=272510 2024-09-12T17:36:46.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.468+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=TV0ZRR29DV5J type=del 2024-09-12T17:36:46.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.472+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~TOFG9W9GO3D2.0 size=968614 2024-09-12T17:36:46.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.472+0000 7f1ad43488c0 1 > prepared multipart upload key=WFEJLVRCKIUU upload=TOFG9W9GO3D2 tag=FO76LML1QGP9 type=write size=2017190 2024-09-12T17:36:46.481 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.480+0000 7f1ad43488c0 1 < suggested remove operation key=XOEPYERWY6IT tag=ZFCGL07CJES4 type=del 2024-09-12T17:36:46.484 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.484+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=X0PT8YGO152P type=del size=467286 2024-09-12T17:36:46.487 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.488+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~MNQ0R4USB6CQ.0 size=1048576 2024-09-12T17:36:46.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.488+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~MNQ0R4USB6CQ.1 size=322855 2024-09-12T17:36:46.495 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.492+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=MNQ0R4USB6CQ tag=VHIPTRO8GDPR type=write size=2420007 2024-09-12T17:36:46.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.500+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~PYTSG8VSV05H.0 size=862662 2024-09-12T17:36:46.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.500+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=PYTSG8VSV05H tag=7N998XNKE77V type=write size=1911238 2024-09-12T17:36:46.504 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.504+0000 7f1ad43488c0 1 < completed delete operation key=X0HT3K3OREL7 tag=GN674NAAMJ5T type=del 2024-09-12T17:36:46.507 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.508+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=V05UHB8WOLUB type=write size=538669 2024-09-12T17:36:46.510 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.508+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~01CAN1UB7F4Q.0 size=728247 2024-09-12T17:36:46.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.512+0000 7f1ad43488c0 1 < completed multipart upload key=8U3L46JDJ8VS upload=01CAN1UB7F4Q tag=3HXB53BJKR2A type=write size=1776823 2024-09-12T17:36:46.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.516+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=1J11KWDV5Z27 type=del size=391777 2024-09-12T17:36:46.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.520+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=SMTDFOH9HKK6 type=del 2024-09-12T17:36:46.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.520+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=EIYUEGQXRHB7 type=del size=3212140 2024-09-12T17:36:46.528 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.528+0000 7f1ad43488c0 1 < suggested remove operation key=ZHFRKX9YY8P5 tag=ZMV4Q20RICM6 type=del 2024-09-12T17:36:46.531 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.532+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=9KZS6XGKB0L6 type=del size=605195 2024-09-12T17:36:46.534 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.532+0000 7f1ad43488c0 1 < completed write operation key=Y3NQLDWQJ37Z tag=CLIEIXU72VRV type=write size=1017640 2024-09-12T17:36:46.537 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.536+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=5EGFJKRR4QDV type=del size=4186661 2024-09-12T17:36:46.540 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.540+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~2Q6UUIB3YMLX.0 size=1048576 2024-09-12T17:36:46.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.540+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~2Q6UUIB3YMLX.1 size=283934 2024-09-12T17:36:46.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.548+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=2Q6UUIB3YMLX tag=BUHBLIA57IFI type=write size=2381086 2024-09-12T17:36:46.551 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.552+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=Z6ETZ54YPFAI type=del size=1196255 2024-09-12T17:36:46.554 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.552+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~1P0GWKH09K2G.0 size=1048576 2024-09-12T17:36:46.557 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.556+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~1P0GWKH09K2G.1 size=1048576 2024-09-12T17:36:46.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.560+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~1P0GWKH09K2G.2 size=81544 2024-09-12T17:36:46.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.564+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=1P0GWKH09K2G tag=3E2A972Z9KL0 type=write size=3227272 2024-09-12T17:36:46.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.568+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=H3B6MDI9W2IA type=del size=225643 2024-09-12T17:36:46.571 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.568+0000 7f1ad43488c0 1 < completed write operation key=LU7XIBO5YUOR tag=AC095HEF26V9 type=write size=300141 2024-09-12T17:36:46.578 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.576+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~SQW3LYQAVTU2.0 size=169967 2024-09-12T17:36:46.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.576+0000 7f1ad43488c0 1 > prepared multipart upload key=Y3NQLDWQJ37Z upload=SQW3LYQAVTU2 tag=BMVUVGP30N2I type=write size=1218543 2024-09-12T17:36:46.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.584+0000 7f1ad43488c0 1 < suggested remove operation key=MB3FVGKV0ZNQ tag=FJAW06QGB9ZX type=del 2024-09-12T17:36:46.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.588+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=5N705UHVSPX6 type=write size=575177 2024-09-12T17:36:46.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.592+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~KF6BGKX4Q3GG.0 size=1048576 2024-09-12T17:36:46.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.592+0000 7f1ad43488c0 1 < canceled part key=_multipart_BCPDXAL027U2.2~KF6BGKX4Q3GG.1 size=1032311 2024-09-12T17:36:46.596 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.596+0000 7f1ad43488c0 1 < canceled multipart upload key=BCPDXAL027U2 upload=KF6BGKX4Q3GG tag=ODG4ZHE73AND type=write size=3129463 2024-09-12T17:36:46.599 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.596+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=0C4GF1DO3AXV type=del size=3438766 2024-09-12T17:36:46.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.600+0000 7f1ad43488c0 1 < completed delete operation key=SDJ53NSPOIRC tag=N0LR4V92JG25 type=del 2024-09-12T17:36:46.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.604+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=PIFQQ6DTB5UF type=write size=343367 2024-09-12T17:36:46.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.608+0000 7f1ad43488c0 1 < suggested remove operation key=LU7XIBO5YUOR tag=5WDLWY0SP5H3 type=del 2024-09-12T17:36:46.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.616+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~P652N6FFNQKE.0 size=1048576 2024-09-12T17:36:46.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.616+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~P652N6FFNQKE.1 size=1048576 2024-09-12T17:36:46.621 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.620+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~P652N6FFNQKE.2 size=702925 2024-09-12T17:36:46.621 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.620+0000 7f1ad43488c0 1 > prepared multipart upload key=GWJ78NNXOL1R upload=P652N6FFNQKE tag=QR5ZQZG7M8AK type=write size=3848653 2024-09-12T17:36:46.624 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.624+0000 7f1ad43488c0 1 < completed write operation key=ECEF8IJGU4Z8 tag=I0CQ6218MCMA type=write size=272510 2024-09-12T17:36:46.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.624+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=9U7SW85B3YZN type=del size=3141092 2024-09-12T17:36:46.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.628+0000 7f1ad43488c0 1 < canceled part key=_multipart_WFEJLVRCKIUU.2~TOFG9W9GO3D2.0 size=968614 2024-09-12T17:36:46.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.632+0000 7f1ad43488c0 1 < canceled multipart upload key=WFEJLVRCKIUU upload=TOFG9W9GO3D2 tag=FO76LML1QGP9 type=write size=2017190 2024-09-12T17:36:46.637 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.636+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~WUBDG9SV5KSF.0 size=1048576 2024-09-12T17:36:46.639 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.640+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~WUBDG9SV5KSF.1 size=1048576 2024-09-12T17:36:46.641 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.640+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~WUBDG9SV5KSF.2 size=799002 2024-09-12T17:36:46.642 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.640+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=WUBDG9SV5KSF tag=0S3IZ272XEMC type=write size=3944730 2024-09-12T17:36:46.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.644+0000 7f1ad43488c0 1 < canceled operation key=SIZ0Z1KWTGUJ tag=X0PT8YGO152P type=del size=467286 2024-09-12T17:36:46.647 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.648+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=S23XZ14GEBZ5 type=del size=3684659 2024-09-12T17:36:46.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.648+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~PYTSG8VSV05H.0 size=862662 2024-09-12T17:36:46.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.656+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=PYTSG8VSV05H tag=7N998XNKE77V type=write size=1911238 2024-09-12T17:36:46.659 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.660+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=8A5AS1XJ2QH5 type=del size=1153760 2024-09-12T17:36:46.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.660+0000 7f1ad43488c0 -1 < no bi entry to suggest for operation key=LU7XIBO5YUOR tag=V05UHB8WOLUB type=write size=538669: (2) No such file or directory 2024-09-12T17:36:46.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.664+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=YYHBXRFE2J4C type=del size=3583381 2024-09-12T17:36:46.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.668+0000 7f1ad43488c0 1 < completed delete operation key=SDJ53NSPOIRC tag=1J11KWDV5Z27 type=del 2024-09-12T17:36:46.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.672+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~0BDZUNBILEU3.0 size=423342 2024-09-12T17:36:46.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.672+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=0BDZUNBILEU3 tag=PI1JXC3MJ75M type=write size=1471918 2024-09-12T17:36:46.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.676+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=EIYUEGQXRHB7 type=del 2024-09-12T17:36:46.684 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.684+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~MR0KLJTNLHO8.0 size=291707 2024-09-12T17:36:46.684 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.684+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=MR0KLJTNLHO8 tag=IK248YGCRWGW type=write size=1340283 2024-09-12T17:36:46.690 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.688+0000 7f1ad43488c0 1 < suggested update operation key=NHOG1WG3VT6N tag=9KZS6XGKB0L6 type=del size=605195 2024-09-12T17:36:46.693 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.692+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=FK33IB2NXD3J type=del size=28932 2024-09-12T17:36:46.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.696+0000 7f1ad43488c0 -1 < failed to complete operation key=LU7XIBO5YUOR tag=5EGFJKRR4QDV type=del size=4186661: (22) Invalid argument 2024-09-12T17:36:46.699 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.700+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=SXEIY9BPLNIF type=del size=2790200 2024-09-12T17:36:46.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.700+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=Z6ETZ54YPFAI type=del 2024-09-12T17:36:46.705 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.704+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=YOLY3AM0S70N type=write size=321375 2024-09-12T17:36:46.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.708+0000 7f1ad43488c0 1 < suggested remove operation key=GWJ78NNXOL1R tag=H3B6MDI9W2IA type=del 2024-09-12T17:36:46.713 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.712+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=M0XWXJUNVZ3H type=del size=2320498 2024-09-12T17:36:46.717 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.716+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~SQW3LYQAVTU2.0 size=169967 2024-09-12T17:36:46.721 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.720+0000 7f1ad43488c0 1 < completed multipart upload key=Y3NQLDWQJ37Z upload=SQW3LYQAVTU2 tag=BMVUVGP30N2I type=write size=1218543 2024-09-12T17:36:46.724 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.724+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=1PYTQ3ZZGE0X type=del size=3783148 2024-09-12T17:36:46.727 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.724+0000 7f1ad43488c0 1 < completed write operation key=ECEF8IJGU4Z8 tag=5N705UHVSPX6 type=write size=575177 2024-09-12T17:36:46.731 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.732+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~OJTPG3R5EHKQ.0 size=1048576 2024-09-12T17:36:46.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.732+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~OJTPG3R5EHKQ.1 size=1048576 2024-09-12T17:36:46.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.736+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~OJTPG3R5EHKQ.2 size=269496 2024-09-12T17:36:46.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.736+0000 7f1ad43488c0 1 > prepared multipart upload key=CHMM14VRIOQH upload=OJTPG3R5EHKQ tag=FJ4PJFKW5SWL type=write size=3415224 2024-09-12T17:36:46.739 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.740+0000 7f1ad43488c0 1 < completed delete operation key=SDJ53NSPOIRC tag=0C4GF1DO3AXV type=del 2024-09-12T17:36:46.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.744+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~VNQ4E42XUMIB.0 size=410286 2024-09-12T17:36:46.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.744+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=VNQ4E42XUMIB tag=V5A74U5KXCE9 type=write size=1458862 2024-09-12T17:36:46.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.748+0000 7f1ad43488c0 1 < completed write operation key=9Z2EHQA8T5F4 tag=PIFQQ6DTB5UF type=write size=343367 2024-09-12T17:36:46.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.748+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=4Q9V3PUT95GK type=del size=1589520 2024-09-12T17:36:46.753 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.752+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~P652N6FFNQKE.0 size=1048576 2024-09-12T17:36:46.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.756+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~P652N6FFNQKE.1 size=1048576 2024-09-12T17:36:46.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.756+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~P652N6FFNQKE.2 size=702925 2024-09-12T17:36:46.763 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.764+0000 7f1ad43488c0 1 < completed multipart upload key=GWJ78NNXOL1R upload=P652N6FFNQKE tag=QR5ZQZG7M8AK type=write size=3848653 2024-09-12T17:36:46.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.764+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=4M49KDUWB63S type=del size=609779 2024-09-12T17:36:46.770 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.768+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=9U7SW85B3YZN type=del 2024-09-12T17:36:46.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.776+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~4PDP5MPWVE32.0 size=336094 2024-09-12T17:36:46.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.776+0000 7f1ad43488c0 1 > prepared multipart upload key=NHOG1WG3VT6N upload=4PDP5MPWVE32 tag=OGKEGNQW9WS3 type=write size=1384670 2024-09-12T17:36:46.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.780+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~WUBDG9SV5KSF.0 size=1048576 2024-09-12T17:36:46.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.780+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~WUBDG9SV5KSF.1 size=1048576 2024-09-12T17:36:46.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.784+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~WUBDG9SV5KSF.2 size=799002 2024-09-12T17:36:46.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.788+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=WUBDG9SV5KSF tag=0S3IZ272XEMC type=write size=3944730 2024-09-12T17:36:46.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.796+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~ITUSDNJJZMIW.0 size=1048576 2024-09-12T17:36:46.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.796+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~ITUSDNJJZMIW.1 size=744490 2024-09-12T17:36:46.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.796+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=ITUSDNJJZMIW tag=4WA6CG8LSY4R type=write size=2841642 2024-09-12T17:36:46.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.800+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=S23XZ14GEBZ5 type=del 2024-09-12T17:36:46.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.804+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=XN700NDESW2V type=write size=73027 2024-09-12T17:36:46.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.804+0000 7f1ad43488c0 1 < canceled operation key=ZHFRKX9YY8P5 tag=8A5AS1XJ2QH5 type=del size=1153760 2024-09-12T17:36:46.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.808+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=E6OHZ8F9LM83 type=del size=3609706 2024-09-12T17:36:46.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.816+0000 7f1ad43488c0 1 < suggested remove operation key=ZHFRKX9YY8P5 tag=YYHBXRFE2J4C type=del 2024-09-12T17:36:46.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.816+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=JAJK6YAAQSP8 type=write size=1042547 2024-09-12T17:36:46.822 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.820+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~0BDZUNBILEU3.0 size=423342 2024-09-12T17:36:46.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.824+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=0BDZUNBILEU3 tag=PI1JXC3MJ75M type=write size=1471918 2024-09-12T17:36:46.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.828+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=R7IE0APHF8VE type=del size=3221503 2024-09-12T17:36:46.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.832+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~MR0KLJTNLHO8.0 size=291707 2024-09-12T17:36:46.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.836+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=MR0KLJTNLHO8 tag=IK248YGCRWGW type=write size=1340283 2024-09-12T17:36:46.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.840+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=3LCMW3G96EC8 type=del size=1776061 2024-09-12T17:36:46.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.844+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=FK33IB2NXD3J type=del 2024-09-12T17:36:46.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.844+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=E31PHLKXNLYJ type=del size=3001748 2024-09-12T17:36:46.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.848+0000 7f1ad43488c0 1 < completed delete operation key=SDJ53NSPOIRC tag=SXEIY9BPLNIF type=del 2024-09-12T17:36:46.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.852+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~L9ABN3RMMP21.0 size=1048576 2024-09-12T17:36:46.856 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.856+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~L9ABN3RMMP21.1 size=914453 2024-09-12T17:36:46.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.856+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=L9ABN3RMMP21 tag=50PUW5K0UVTG type=write size=3011605 2024-09-12T17:36:46.865 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.864+0000 7f1ad43488c0 1 < suggested remove operation key=2SDYAQRNWAJK tag=YOLY3AM0S70N type=write 2024-09-12T17:36:46.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.868+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=51OFCVFWTY7V type=del size=2123445 2024-09-12T17:36:46.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.872+0000 7f1ad43488c0 1 < suggested remove operation key=GZ7LGZQHW4CY tag=M0XWXJUNVZ3H type=del 2024-09-12T17:36:46.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.876+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=72CEQIDXHDOF type=del size=3595873 2024-09-12T17:36:46.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.880+0000 7f1ad43488c0 1 < completed delete operation key=MB3FVGKV0ZNQ tag=1PYTQ3ZZGE0X type=del 2024-09-12T17:36:46.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.880+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=FUILOF67FBIU type=del size=1900267 2024-09-12T17:36:46.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.884+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~OJTPG3R5EHKQ.0 size=1048576 2024-09-12T17:36:46.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.888+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~OJTPG3R5EHKQ.1 size=1048576 2024-09-12T17:36:46.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.888+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~OJTPG3R5EHKQ.2 size=269496 2024-09-12T17:36:46.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.892+0000 7f1ad43488c0 1 < completed multipart upload key=CHMM14VRIOQH upload=OJTPG3R5EHKQ tag=FJ4PJFKW5SWL type=write size=3415224 2024-09-12T17:36:46.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.900+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~4QFIOE2PX4N7.0 size=264917 2024-09-12T17:36:46.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.900+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=4QFIOE2PX4N7 tag=KNO2ZBK55XGJ type=write size=1313493 2024-09-12T17:36:46.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.900+0000 7f1ad43488c0 1 < canceled part key=_multipart_LU7XIBO5YUOR.2~VNQ4E42XUMIB.0 size=410286 2024-09-12T17:36:46.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.904+0000 7f1ad43488c0 1 < canceled multipart upload key=LU7XIBO5YUOR upload=VNQ4E42XUMIB tag=V5A74U5KXCE9 type=write size=1458862 2024-09-12T17:36:46.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.908+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~KB27PWGGGXTY.0 size=1048576 2024-09-12T17:36:46.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.912+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~KB27PWGGGXTY.1 size=1048576 2024-09-12T17:36:46.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.912+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~KB27PWGGGXTY.2 size=750326 2024-09-12T17:36:46.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.912+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=KB27PWGGGXTY tag=D5N4FQRRPWDE type=write size=3896054 2024-09-12T17:36:46.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.916+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=4Q9V3PUT95GK type=del 2024-09-12T17:36:46.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.920+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=3Z7CR7572UKD type=del size=1330414 2024-09-12T17:36:46.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.924+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=4M49KDUWB63S type=del 2024-09-12T17:36:46.926 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.924+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=CUNXIW3978QR type=del size=2492677 2024-09-12T17:36:46.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.928+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~4PDP5MPWVE32.0 size=336094 2024-09-12T17:36:46.934 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.932+0000 7f1ad43488c0 1 < completed multipart upload key=NHOG1WG3VT6N upload=4PDP5MPWVE32 tag=OGKEGNQW9WS3 type=write size=1384670 2024-09-12T17:36:46.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.940+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~ABS48Z9BBNZT.0 size=1006651 2024-09-12T17:36:46.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.940+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=ABS48Z9BBNZT tag=UW3PUFI1A8F0 type=write size=2055227 2024-09-12T17:36:46.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.940+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~ITUSDNJJZMIW.0 size=1048576 2024-09-12T17:36:46.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.944+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~ITUSDNJJZMIW.1 size=744490 2024-09-12T17:36:46.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.948+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=ITUSDNJJZMIW tag=4WA6CG8LSY4R type=write size=2841642 2024-09-12T17:36:46.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.956+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~8TUY1ZS2TMTH.0 size=389289 2024-09-12T17:36:46.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.956+0000 7f1ad43488c0 1 > prepared multipart upload key=Y3NQLDWQJ37Z upload=8TUY1ZS2TMTH tag=JAKR8VWAKNZJ type=write size=1437865 2024-09-12T17:36:46.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.960+0000 7f1ad43488c0 1 < completed write operation key=8U3L46JDJ8VS tag=XN700NDESW2V type=write size=73027 2024-09-12T17:36:46.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.964+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~DRSDC9P1B6F1.0 size=1048576 2024-09-12T17:36:46.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.964+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~DRSDC9P1B6F1.1 size=1048576 2024-09-12T17:36:46.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.968+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~DRSDC9P1B6F1.2 size=65048 2024-09-12T17:36:46.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.968+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=DRSDC9P1B6F1 tag=HJE3HJRC7L3P type=write size=3210776 2024-09-12T17:36:46.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.972+0000 7f1ad43488c0 1 < completed delete operation key=NHOG1WG3VT6N tag=E6OHZ8F9LM83 type=del 2024-09-12T17:36:46.974 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.972+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=6QXCS25S4YUO type=del size=1688368 2024-09-12T17:36:46.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.976+0000 7f1ad43488c0 1 < suggested remove operation key=C7QSOK3D3IWJ tag=JAJK6YAAQSP8 type=write 2024-09-12T17:36:46.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.980+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=DHL5INA00IUB type=del size=3284008 2024-09-12T17:36:46.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.984+0000 7f1ad43488c0 1 < completed delete operation key=NHOG1WG3VT6N tag=R7IE0APHF8VE type=del 2024-09-12T17:36:46.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.988+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=IH7H17NLDG6L type=del size=2424139 2024-09-12T17:36:46.990 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.988+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=3LCMW3G96EC8 type=del 2024-09-12T17:36:46.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.992+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=OZR4Y5POJT9P type=del size=1244134 2024-09-12T17:36:46.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:46.996+0000 7f1ad43488c0 1 < completed delete operation key=SIZ0Z1KWTGUJ tag=E31PHLKXNLYJ type=del 2024-09-12T17:36:46.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.000+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=SRIB1WPDHP1X type=write size=670972 2024-09-12T17:36:47.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.004+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~L9ABN3RMMP21.0 size=1048576 2024-09-12T17:36:47.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.004+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~L9ABN3RMMP21.1 size=914453 2024-09-12T17:36:47.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.012+0000 7f1ad43488c0 1 < completed multipart upload key=7RSHIZRKK2OY upload=L9ABN3RMMP21 tag=50PUW5K0UVTG type=write size=3011605 2024-09-12T17:36:47.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.016+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~VXISNUQKPP9O.0 size=1032463 2024-09-12T17:36:47.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.016+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=VXISNUQKPP9O tag=2Q6QKZ508Y1J type=write size=2081039 2024-09-12T17:36:47.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.020+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=51OFCVFWTY7V type=del 2024-09-12T17:36:47.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.024+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=SNR53PHNWGDT type=del size=1366940 2024-09-12T17:36:47.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.024+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=72CEQIDXHDOF type=del 2024-09-12T17:36:47.030 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.028+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=2PSWH68UQ7OO type=del size=1375757 2024-09-12T17:36:47.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.032+0000 7f1ad43488c0 1 < canceled operation key=3N1YT9TC0M3O tag=FUILOF67FBIU type=del size=1900267 2024-09-12T17:36:47.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.036+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=07Y0GIZVLF5R type=del size=3066318 2024-09-12T17:36:47.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.036+0000 7f1ad43488c0 1 < canceled part key=_multipart_X0HT3K3OREL7.2~4QFIOE2PX4N7.0 size=264917 2024-09-12T17:36:47.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.040+0000 7f1ad43488c0 1 < canceled multipart upload key=X0HT3K3OREL7 upload=4QFIOE2PX4N7 tag=KNO2ZBK55XGJ type=write size=1313493 2024-09-12T17:36:47.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.044+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=U8KMI2TLG0WM type=del size=221871 2024-09-12T17:36:47.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.048+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~KB27PWGGGXTY.0 size=1048576 2024-09-12T17:36:47.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.048+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~KB27PWGGGXTY.1 size=1048576 2024-09-12T17:36:47.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.052+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~KB27PWGGGXTY.2 size=750326 2024-09-12T17:36:47.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.056+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=KB27PWGGGXTY tag=D5N4FQRRPWDE type=write size=3896054 2024-09-12T17:36:47.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.060+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=HRGJ750VS4U9 type=del size=3893971 2024-09-12T17:36:47.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.064+0000 7f1ad43488c0 1 < canceled operation key=PKC1RR4FZWE0 tag=3Z7CR7572UKD type=del size=1330414 2024-09-12T17:36:47.069 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.068+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~3GVXHDNTM00L.0 size=1048576 2024-09-12T17:36:47.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.072+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~3GVXHDNTM00L.1 size=797766 2024-09-12T17:36:47.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.072+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=3GVXHDNTM00L tag=XQ51RTL7XA3C type=write size=2894918 2024-09-12T17:36:47.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.072+0000 7f1ad43488c0 1 < completed delete operation key=NHOG1WG3VT6N tag=CUNXIW3978QR type=del 2024-09-12T17:36:47.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.076+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=MB0HH0I73BT3 type=del size=246552 2024-09-12T17:36:47.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.076+0000 7f1ad43488c0 1 < canceled part key=_multipart_ECEF8IJGU4Z8.2~ABS48Z9BBNZT.0 size=1006651 2024-09-12T17:36:47.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.080+0000 7f1ad43488c0 1 < canceled multipart upload key=ECEF8IJGU4Z8 upload=ABS48Z9BBNZT tag=UW3PUFI1A8F0 type=write size=2055227 2024-09-12T17:36:47.086 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.084+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=PCO53LZHU0Z4 type=del size=890632 2024-09-12T17:36:47.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.088+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~8TUY1ZS2TMTH.0 size=389289 2024-09-12T17:36:47.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.092+0000 7f1ad43488c0 1 < completed multipart upload key=Y3NQLDWQJ37Z upload=8TUY1ZS2TMTH tag=JAKR8VWAKNZJ type=write size=1437865 2024-09-12T17:36:47.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.096+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=KSL42WKUL3CS type=del size=2399241 2024-09-12T17:36:47.100 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.100+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~DRSDC9P1B6F1.0 size=1048576 2024-09-12T17:36:47.102 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.100+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~DRSDC9P1B6F1.1 size=1048576 2024-09-12T17:36:47.104 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.104+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~DRSDC9P1B6F1.2 size=65048 2024-09-12T17:36:47.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.108+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=DRSDC9P1B6F1 tag=HJE3HJRC7L3P type=write size=3210776 2024-09-12T17:36:47.115 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.112+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~BZCZIGF8BOJB.0 size=1048576 2024-09-12T17:36:47.117 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.116+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~BZCZIGF8BOJB.1 size=1048576 2024-09-12T17:36:47.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.120+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~BZCZIGF8BOJB.2 size=318451 2024-09-12T17:36:47.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.120+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=BZCZIGF8BOJB tag=ZR0K0N7IO0F9 type=write size=3464179 2024-09-12T17:36:47.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.124+0000 7f1ad43488c0 1 < suggested remove operation key=2SDYAQRNWAJK tag=6QXCS25S4YUO type=del 2024-09-12T17:36:47.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.128+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=381OCEVAM0RP type=del size=2004504 2024-09-12T17:36:47.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.132+0000 7f1ad43488c0 1 < completed delete operation key=IY2AM7CJDUZG tag=DHL5INA00IUB type=del 2024-09-12T17:36:47.138 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.136+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~Z9TX3ROYAN51.0 size=1048576 2024-09-12T17:36:47.143 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.140+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~Z9TX3ROYAN51.1 size=47317 2024-09-12T17:36:47.143 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.144+0000 7f1ad43488c0 1 > prepared multipart upload key=ZHFRKX9YY8P5 upload=Z9TX3ROYAN51 tag=IKVT7I6NAHT9 type=write size=2144469 2024-09-12T17:36:47.146 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.144+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=IH7H17NLDG6L type=del 2024-09-12T17:36:47.151 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.152+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~31S5DPUPLRH0.0 size=1048576 2024-09-12T17:36:47.154 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.152+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~31S5DPUPLRH0.1 size=860972 2024-09-12T17:36:47.154 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.152+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=31S5DPUPLRH0 tag=7JFQ8Z3YIKHO type=write size=2958124 2024-09-12T17:36:47.157 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.156+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=OZR4Y5POJT9P type=del 2024-09-12T17:36:47.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.160+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~7E7JSQRY1O7R.0 size=521514 2024-09-12T17:36:47.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.160+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=7E7JSQRY1O7R tag=CJJSJKLPHY5J type=write size=1570090 2024-09-12T17:36:47.169 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.168+0000 7f1ad43488c0 1 < suggested remove operation key=X0HT3K3OREL7 tag=SRIB1WPDHP1X type=write 2024-09-12T17:36:47.175 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.176+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~P9Z919R1WRI4.0 size=1048576 2024-09-12T17:36:47.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.176+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~P9Z919R1WRI4.1 size=313789 2024-09-12T17:36:47.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.176+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=P9Z919R1WRI4 tag=2JMNZWZETDQY type=write size=2410941 2024-09-12T17:36:47.178 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.176+0000 7f1ad43488c0 1 < canceled part key=_multipart_PKC1RR4FZWE0.2~VXISNUQKPP9O.0 size=1032463 2024-09-12T17:36:47.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.184+0000 7f1ad43488c0 1 < canceled multipart upload key=PKC1RR4FZWE0 upload=VXISNUQKPP9O tag=2Q6QKZ508Y1J type=write size=2081039 2024-09-12T17:36:47.188 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.188+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~EI7TTAHGWCKE.0 size=1048576 2024-09-12T17:36:47.191 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.188+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~EI7TTAHGWCKE.1 size=1048576 2024-09-12T17:36:47.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.192+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~EI7TTAHGWCKE.2 size=556612 2024-09-12T17:36:47.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.192+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=EI7TTAHGWCKE tag=DFABXOIEBWY7 type=write size=3702340 2024-09-12T17:36:47.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.196+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=SNR53PHNWGDT type=del 2024-09-12T17:36:47.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.200+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=N9VRXPIBFQVF type=del size=2393792 2024-09-12T17:36:47.203 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.200+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=2PSWH68UQ7OO type=del 2024-09-12T17:36:47.208 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.208+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~OUJETQIP81TH.0 size=1048576 2024-09-12T17:36:47.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.208+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~OUJETQIP81TH.1 size=961923 2024-09-12T17:36:47.211 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.208+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=OUJETQIP81TH tag=0WYVZSZST59V type=write size=3059075 2024-09-12T17:36:47.214 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.212+0000 7f1ad43488c0 1 < canceled operation key=A49CE02X3L2L tag=07Y0GIZVLF5R type=del size=3066318 2024-09-12T17:36:47.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.220+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~C9RB41ALJCRC.0 size=767545 2024-09-12T17:36:47.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.220+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=C9RB41ALJCRC tag=HOE7DEUSJTLW type=write size=1816121 2024-09-12T17:36:47.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.224+0000 7f1ad43488c0 1 < suggested update operation key=Y3NQLDWQJ37Z tag=U8KMI2TLG0WM type=del size=221871 2024-09-12T17:36:47.228 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.228+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=4HON64JPMMCT type=write size=68897 2024-09-12T17:36:47.230 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.228+0000 7f1ad43488c0 1 < completed delete operation key=SIZ0Z1KWTGUJ tag=HRGJ750VS4U9 type=del 2024-09-12T17:36:47.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.232+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=XVZL6JXKPCQY type=del size=45179 2024-09-12T17:36:47.236 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.236+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~3GVXHDNTM00L.0 size=1048576 2024-09-12T17:36:47.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.236+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~3GVXHDNTM00L.1 size=797766 2024-09-12T17:36:47.242 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.240+0000 7f1ad43488c0 1 < completed multipart upload key=7RSHIZRKK2OY upload=3GVXHDNTM00L tag=XQ51RTL7XA3C type=write size=2894918 2024-09-12T17:36:47.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.244+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=M3GZU69SM0S4 type=write size=1035054 2024-09-12T17:36:47.248 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.248+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=MB0HH0I73BT3 type=del 2024-09-12T17:36:47.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.248+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=WYNV6JI5ZR1A type=del size=3149218 2024-09-12T17:36:47.253 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.252+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=PCO53LZHU0Z4 type=del 2024-09-12T17:36:47.258 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.256+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~7XIH552YWROD.0 size=1048576 2024-09-12T17:36:47.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.260+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~7XIH552YWROD.1 size=1048576 2024-09-12T17:36:47.263 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.260+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~7XIH552YWROD.2 size=1033914 2024-09-12T17:36:47.263 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.260+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=7XIH552YWROD tag=CA7MWJPUVA7M type=write size=4179642 2024-09-12T17:36:47.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.264+0000 7f1ad43488c0 1 < completed delete operation key=C7QSOK3D3IWJ tag=KSL42WKUL3CS type=del 2024-09-12T17:36:47.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.272+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~V1ZFA5LSPJ3H.0 size=1048576 2024-09-12T17:36:47.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.272+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~V1ZFA5LSPJ3H.1 size=650917 2024-09-12T17:36:47.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.272+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=V1ZFA5LSPJ3H tag=KTT9Z262Z9OW type=write size=2748069 2024-09-12T17:36:47.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.276+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~BZCZIGF8BOJB.0 size=1048576 2024-09-12T17:36:47.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.276+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~BZCZIGF8BOJB.1 size=1048576 2024-09-12T17:36:47.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.280+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~BZCZIGF8BOJB.2 size=318451 2024-09-12T17:36:47.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.284+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=BZCZIGF8BOJB tag=ZR0K0N7IO0F9 type=write size=3464179 2024-09-12T17:36:47.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.288+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=J21C1TTLIYXS type=del size=1021769 2024-09-12T17:36:47.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.292+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=381OCEVAM0RP type=del 2024-09-12T17:36:47.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.296+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=3F54YCGKF1MN type=del size=3850509 2024-09-12T17:36:47.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.296+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~Z9TX3ROYAN51.0 size=1048576 2024-09-12T17:36:47.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.300+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~Z9TX3ROYAN51.1 size=47317 2024-09-12T17:36:47.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.304+0000 7f1ad43488c0 1 < completed multipart upload key=ZHFRKX9YY8P5 upload=Z9TX3ROYAN51 tag=IKVT7I6NAHT9 type=write size=2144469 2024-09-12T17:36:47.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.308+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~S91N1N1XPPER.0 size=510516 2024-09-12T17:36:47.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.308+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=S91N1N1XPPER tag=1JZFTY059HFP type=write size=1559092 2024-09-12T17:36:47.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.312+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~31S5DPUPLRH0.0 size=1048576 2024-09-12T17:36:47.316 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.316+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~31S5DPUPLRH0.1 size=860972 2024-09-12T17:36:47.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.320+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=31S5DPUPLRH0 tag=7JFQ8Z3YIKHO type=write size=2958124 2024-09-12T17:36:47.323 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.324+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=D4VGXDDGZW98 type=write size=766625 2024-09-12T17:36:47.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.324+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~7E7JSQRY1O7R.0 size=521514 2024-09-12T17:36:47.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.332+0000 7f1ad43488c0 1 < completed multipart upload key=8U3L46JDJ8VS upload=7E7JSQRY1O7R tag=CJJSJKLPHY5J type=write size=1570090 2024-09-12T17:36:47.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.332+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=KVS8AMNGBH0H type=write size=969679 2024-09-12T17:36:47.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.332+0000 7f1ad43488c0 1 < canceled part key=_multipart_RXJJOPR32OD5.2~P9Z919R1WRI4.0 size=1048576 2024-09-12T17:36:47.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.336+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~P9Z919R1WRI4.1 size=313789 2024-09-12T17:36:47.342 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.340+0000 7f1ad43488c0 1 < canceled multipart upload key=RXJJOPR32OD5 upload=P9Z919R1WRI4 tag=2JMNZWZETDQY type=write size=2410941 2024-09-12T17:36:47.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.344+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=CJ7H7OA536EZ type=del size=3604232 2024-09-12T17:36:47.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.348+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~EI7TTAHGWCKE.0 size=1048576 2024-09-12T17:36:47.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.348+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~EI7TTAHGWCKE.1 size=1048576 2024-09-12T17:36:47.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.352+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~EI7TTAHGWCKE.2 size=556612 2024-09-12T17:36:47.356 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.356+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=EI7TTAHGWCKE tag=DFABXOIEBWY7 type=write size=3702340 2024-09-12T17:36:47.358 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.356+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=NBHASH9GK6KN type=del size=2775791 2024-09-12T17:36:47.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.364+0000 7f1ad43488c0 1 < suggested update operation key=7RSHIZRKK2OY tag=N9VRXPIBFQVF type=del size=2393792 2024-09-12T17:36:47.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.364+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=G1KXFFX6C6BF type=write size=965522 2024-09-12T17:36:47.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.368+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~OUJETQIP81TH.0 size=1048576 2024-09-12T17:36:47.369 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.368+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~OUJETQIP81TH.1 size=961923 2024-09-12T17:36:47.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.372+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=OUJETQIP81TH tag=0WYVZSZST59V type=write size=3059075 2024-09-12T17:36:47.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.376+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=V1S2DWPRYA69 type=del size=3621537 2024-09-12T17:36:47.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.376+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~C9RB41ALJCRC.0 size=767545 2024-09-12T17:36:47.381 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.380+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=C9RB41ALJCRC tag=HOE7DEUSJTLW type=write size=1816121 2024-09-12T17:36:47.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.384+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=TXXPHFD0Z1JL type=del size=3690616 2024-09-12T17:36:47.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.384+0000 7f1ad43488c0 1 < completed write operation key=A49CE02X3L2L tag=4HON64JPMMCT type=write size=68897 2024-09-12T17:36:47.390 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.388+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~N46VUCYAPARU.0 size=1048576 2024-09-12T17:36:47.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.392+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~N46VUCYAPARU.1 size=1048576 2024-09-12T17:36:47.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.392+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~N46VUCYAPARU.2 size=165800 2024-09-12T17:36:47.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.392+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=N46VUCYAPARU tag=ZET7ZC3Q6IFR type=write size=3311528 2024-09-12T17:36:47.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.396+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=XVZL6JXKPCQY type=del 2024-09-12T17:36:47.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.404+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~8I4P3ZA5W7W7.0 size=1048576 2024-09-12T17:36:47.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.404+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~8I4P3ZA5W7W7.1 size=1048576 2024-09-12T17:36:47.407 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.404+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~8I4P3ZA5W7W7.2 size=127862 2024-09-12T17:36:47.407 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.404+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=8I4P3ZA5W7W7 tag=BLAEQAZU92NL type=write size=3273590 2024-09-12T17:36:47.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.408+0000 7f1ad43488c0 1 < completed write operation key=MB3FVGKV0ZNQ tag=M3GZU69SM0S4 type=write size=1035054 2024-09-12T17:36:47.412 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.412+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=WLHB6DSCEVPY type=del size=2387820 2024-09-12T17:36:47.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.412+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=WYNV6JI5ZR1A type=del 2024-09-12T17:36:47.417 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.416+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=VZ8JFP9GV0EZ type=del size=953001 2024-09-12T17:36:47.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.420+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~7XIH552YWROD.0 size=1048576 2024-09-12T17:36:47.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.420+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~7XIH552YWROD.1 size=1048576 2024-09-12T17:36:47.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.420+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~7XIH552YWROD.2 size=1033914 2024-09-12T17:36:47.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.424+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=7XIH552YWROD tag=CA7MWJPUVA7M type=write size=4179642 2024-09-12T17:36:47.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.428+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=WIWWHWHN6Y4L type=del size=3025810 2024-09-12T17:36:47.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.428+0000 7f1ad43488c0 1 < canceled part key=_multipart_A49CE02X3L2L.2~V1ZFA5LSPJ3H.0 size=1048576 2024-09-12T17:36:47.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.432+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~V1ZFA5LSPJ3H.1 size=650917 2024-09-12T17:36:47.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.436+0000 7f1ad43488c0 1 < canceled multipart upload key=A49CE02X3L2L upload=V1ZFA5LSPJ3H tag=KTT9Z262Z9OW type=write size=2748069 2024-09-12T17:36:47.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.436+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=HZZ783PXT3E6 type=del size=4012456 2024-09-12T17:36:47.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.440+0000 7f1ad43488c0 1 < completed delete operation key=XOEPYERWY6IT tag=J21C1TTLIYXS type=del 2024-09-12T17:36:47.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.444+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=V3L4BB2EM8V0 type=del size=927968 2024-09-12T17:36:47.448 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.448+0000 7f1ad43488c0 1 < suggested update operation key=Y3NQLDWQJ37Z tag=3F54YCGKF1MN type=del size=3850509 2024-09-12T17:36:47.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.448+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=840IMFM8PC9K type=del size=2533299 2024-09-12T17:36:47.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.452+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~S91N1N1XPPER.0 size=510516 2024-09-12T17:36:47.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.456+0000 7f1ad43488c0 1 < completed multipart upload key=WWB6LAHAMIR9 upload=S91N1N1XPPER tag=1JZFTY059HFP type=write size=1559092 2024-09-12T17:36:47.462 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.460+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~PDB7O6N42W7Q.0 size=224773 2024-09-12T17:36:47.462 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.460+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=PDB7O6N42W7Q tag=Z5BMMVPZH8D2 type=write size=1273349 2024-09-12T17:36:47.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.464+0000 7f1ad43488c0 1 < completed write operation key=A49CE02X3L2L tag=D4VGXDDGZW98 type=write size=766625 2024-09-12T17:36:47.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.468+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=1E8J3B62DCA6 type=del size=3258048 2024-09-12T17:36:47.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.468+0000 7f1ad43488c0 1 < completed write operation key=C7QSOK3D3IWJ tag=KVS8AMNGBH0H type=write size=969679 2024-09-12T17:36:47.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.472+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=KGCW3GJDM099 type=del size=2728093 2024-09-12T17:36:47.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.472+0000 7f1ad43488c0 1 < completed delete operation key=NHOG1WG3VT6N tag=CJ7H7OA536EZ type=del 2024-09-12T17:36:47.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.476+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=KDXU7MHWMG19 type=del size=1858604 2024-09-12T17:36:47.480 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.480+0000 7f1ad43488c0 -1 < failed to complete operation key=7RSHIZRKK2OY tag=NBHASH9GK6KN type=del size=2775791: (22) Invalid argument 2024-09-12T17:36:47.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.484+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~04JDMU9407CA.0 size=1048576 2024-09-12T17:36:47.489 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.484+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~04JDMU9407CA.1 size=1048576 2024-09-12T17:36:47.489 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.488+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~04JDMU9407CA.2 size=994115 2024-09-12T17:36:47.489 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.488+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=04JDMU9407CA tag=XV08MC1K0LCU type=write size=4139843 2024-09-12T17:36:47.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.492+0000 7f1ad43488c0 1 < completed write operation key=LU7XIBO5YUOR tag=G1KXFFX6C6BF type=write size=965522 2024-09-12T17:36:47.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.492+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=Q2A8FB9G6KUY type=del size=3323325 2024-09-12T17:36:47.496 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.496+0000 7f1ad43488c0 -1 < failed to complete operation key=Y3NQLDWQJ37Z tag=V1S2DWPRYA69 type=del size=3621537: (22) Invalid argument 2024-09-12T17:36:47.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.500+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~TNX4B0NQQTNI.0 size=630945 2024-09-12T17:36:47.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.500+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=TNX4B0NQQTNI tag=FF1XTUONZAKJ type=write size=1679521 2024-09-12T17:36:47.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.504+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=TXXPHFD0Z1JL type=del 2024-09-12T17:36:47.507 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.508+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~97URSW844P6R.0 size=1048576 2024-09-12T17:36:47.509 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.508+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~97URSW844P6R.1 size=1048576 2024-09-12T17:36:47.511 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.512+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~97URSW844P6R.2 size=686538 2024-09-12T17:36:47.511 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.512+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=97URSW844P6R tag=U17T8Y379UZC type=write size=3832266 2024-09-12T17:36:47.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.512+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~N46VUCYAPARU.0 size=1048576 2024-09-12T17:36:47.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.516+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~N46VUCYAPARU.1 size=1048576 2024-09-12T17:36:47.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.516+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~N46VUCYAPARU.2 size=165800 2024-09-12T17:36:47.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.520+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=N46VUCYAPARU tag=ZET7ZC3Q6IFR type=write size=3311528 2024-09-12T17:36:47.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.524+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=B1XV1CQUMMUI type=write size=122738 2024-09-12T17:36:47.526 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.524+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~8I4P3ZA5W7W7.0 size=1048576 2024-09-12T17:36:47.528 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.528+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~8I4P3ZA5W7W7.1 size=1048576 2024-09-12T17:36:47.530 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.528+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~8I4P3ZA5W7W7.2 size=127862 2024-09-12T17:36:47.535 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.532+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=8I4P3ZA5W7W7 tag=BLAEQAZU92NL type=write size=3273590 2024-09-12T17:36:47.537 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.536+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=SK0PY1RHVWW3 type=write size=314950 2024-09-12T17:36:47.539 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.540+0000 7f1ad43488c0 1 < completed delete operation key=C7QSOK3D3IWJ tag=WLHB6DSCEVPY type=del 2024-09-12T17:36:47.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.544+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~U98QGHICWPIL.0 size=1048576 2024-09-12T17:36:47.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.544+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~U98QGHICWPIL.1 size=227197 2024-09-12T17:36:47.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.544+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=U98QGHICWPIL tag=BQJ0MYD73UM6 type=write size=2324349 2024-09-12T17:36:47.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.548+0000 7f1ad43488c0 1 < completed delete operation key=XOEPYERWY6IT tag=VZ8JFP9GV0EZ type=del 2024-09-12T17:36:47.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.552+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~2EPVTOJLR7L5.0 size=1048576 2024-09-12T17:36:47.554 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.552+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~2EPVTOJLR7L5.1 size=647454 2024-09-12T17:36:47.554 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.552+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=2EPVTOJLR7L5 tag=6TFLS6JSF0IP type=write size=2744606 2024-09-12T17:36:47.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.556+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=WIWWHWHN6Y4L type=del 2024-09-12T17:36:47.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.560+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~Z5WJYUZS0ZPK.0 size=1048576 2024-09-12T17:36:47.562 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.560+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~Z5WJYUZS0ZPK.1 size=1048576 2024-09-12T17:36:47.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.564+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~Z5WJYUZS0ZPK.2 size=929796 2024-09-12T17:36:47.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.564+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=Z5WJYUZS0ZPK tag=8ZHOY5THY64O type=write size=4075524 2024-09-12T17:36:47.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.568+0000 7f1ad43488c0 1 < suggested update operation key=IY2AM7CJDUZG tag=HZZ783PXT3E6 type=del size=4012456 2024-09-12T17:36:47.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.572+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~F1XNTQO3RRLV.0 size=483039 2024-09-12T17:36:47.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.572+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=F1XNTQO3RRLV tag=V74RYUBZPE92 type=write size=1531615 2024-09-12T17:36:47.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.576+0000 7f1ad43488c0 1 < completed delete operation key=9Z2EHQA8T5F4 tag=V3L4BB2EM8V0 type=del 2024-09-12T17:36:47.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.580+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=8SVDRS6DI5T3 type=del size=30323 2024-09-12T17:36:47.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.584+0000 7f1ad43488c0 1 < suggested remove operation key=8U3L46JDJ8VS tag=840IMFM8PC9K type=del 2024-09-12T17:36:47.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.584+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=XSNUKYDRKEU4 type=del size=2922060 2024-09-12T17:36:47.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.588+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~PDB7O6N42W7Q.0 size=224773 2024-09-12T17:36:47.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.592+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=PDB7O6N42W7Q tag=Z5BMMVPZH8D2 type=write size=1273349 2024-09-12T17:36:47.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.592+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=ZJTEC4NVV50O type=del size=4127216 2024-09-12T17:36:47.597 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.596+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=1E8J3B62DCA6 type=del 2024-09-12T17:36:47.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.600+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~CBSCNU209S3G.0 size=1048576 2024-09-12T17:36:47.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.604+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~CBSCNU209S3G.1 size=539021 2024-09-12T17:36:47.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.604+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=CBSCNU209S3G tag=1A6J9WHYJOF2 type=write size=2636173 2024-09-12T17:36:47.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.604+0000 7f1ad43488c0 1 < completed delete operation key=WFEJLVRCKIUU tag=KGCW3GJDM099 type=del 2024-09-12T17:36:47.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.608+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=I20QPX2E4L0C type=write size=963502 2024-09-12T17:36:47.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.608+0000 7f1ad43488c0 1 < completed delete operation key=C7QSOK3D3IWJ tag=KDXU7MHWMG19 type=del 2024-09-12T17:36:47.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.612+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=R1XQERI405B5 type=del size=2586949 2024-09-12T17:36:47.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.616+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~04JDMU9407CA.0 size=1048576 2024-09-12T17:36:47.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.616+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~04JDMU9407CA.1 size=1048576 2024-09-12T17:36:47.619 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.616+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~04JDMU9407CA.2 size=994115 2024-09-12T17:36:47.622 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.620+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=04JDMU9407CA tag=XV08MC1K0LCU type=write size=4139843 2024-09-12T17:36:47.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.624+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=MD05B6T9KXRT type=del size=29078 2024-09-12T17:36:47.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.628+0000 7f1ad43488c0 1 < suggested remove operation key=2SDYAQRNWAJK tag=Q2A8FB9G6KUY type=del 2024-09-12T17:36:47.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.632+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~1GSD2TDLLRRW.0 size=1008360 2024-09-12T17:36:47.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.632+0000 7f1ad43488c0 1 > prepared multipart upload key=NHOG1WG3VT6N upload=1GSD2TDLLRRW tag=WUGZ0NID3MU6 type=write size=2056936 2024-09-12T17:36:47.637 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.636+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~TNX4B0NQQTNI.0 size=630945 2024-09-12T17:36:47.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.640+0000 7f1ad43488c0 1 < completed multipart upload key=WWB6LAHAMIR9 upload=TNX4B0NQQTNI tag=FF1XTUONZAKJ type=write size=1679521 2024-09-12T17:36:47.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.644+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~7QGGMMQJMK5M.0 size=1048576 2024-09-12T17:36:47.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.644+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~7QGGMMQJMK5M.1 size=1048576 2024-09-12T17:36:47.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.648+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~7QGGMMQJMK5M.2 size=346442 2024-09-12T17:36:47.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.648+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=7QGGMMQJMK5M tag=ENSWIWD3NRML type=write size=3492170 2024-09-12T17:36:47.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.648+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~97URSW844P6R.0 size=1048576 2024-09-12T17:36:47.652 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.652+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~97URSW844P6R.1 size=1048576 2024-09-12T17:36:47.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.652+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~97URSW844P6R.2 size=686538 2024-09-12T17:36:47.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.656+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=97URSW844P6R tag=U17T8Y379UZC type=write size=3832266 2024-09-12T17:36:47.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.660+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~LTI5Y6XLKP65.0 size=1048576 2024-09-12T17:36:47.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.664+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~LTI5Y6XLKP65.1 size=917009 2024-09-12T17:36:47.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.664+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=LTI5Y6XLKP65 tag=756U6EVU840L type=write size=3014161 2024-09-12T17:36:47.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.668+0000 7f1ad43488c0 -1 < failed to complete operation key=IY2AM7CJDUZG tag=B1XV1CQUMMUI type=write size=122738: (22) Invalid argument 2024-09-12T17:36:47.671 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.672+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~PIO4SC8597JV.0 size=1048576 2024-09-12T17:36:47.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.672+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~PIO4SC8597JV.1 size=491828 2024-09-12T17:36:47.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.672+0000 7f1ad43488c0 1 > prepared multipart upload key=C7QSOK3D3IWJ upload=PIO4SC8597JV tag=D1FRZWBVSOB1 type=write size=2588980 2024-09-12T17:36:47.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.676+0000 7f1ad43488c0 1 < canceled operation key=PKC1RR4FZWE0 tag=SK0PY1RHVWW3 type=write size=314950 2024-09-12T17:36:47.679 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.680+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=LBTI1AXN02VW type=del size=3902671 2024-09-12T17:36:47.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.680+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~U98QGHICWPIL.0 size=1048576 2024-09-12T17:36:47.684 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.684+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~U98QGHICWPIL.1 size=227197 2024-09-12T17:36:47.687 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.688+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=U98QGHICWPIL tag=BQJ0MYD73UM6 type=write size=2324349 2024-09-12T17:36:47.689 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.688+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=P1EDHHT4TFEV type=del size=2791437 2024-09-12T17:36:47.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.692+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~2EPVTOJLR7L5.0 size=1048576 2024-09-12T17:36:47.693 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.692+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~2EPVTOJLR7L5.1 size=647454 2024-09-12T17:36:47.697 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.696+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=2EPVTOJLR7L5 tag=6TFLS6JSF0IP type=write size=2744606 2024-09-12T17:36:47.699 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.700+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=T94H0P3ONK7G type=write size=384036 2024-09-12T17:36:47.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.700+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~Z5WJYUZS0ZPK.0 size=1048576 2024-09-12T17:36:47.703 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.704+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~Z5WJYUZS0ZPK.1 size=1048576 2024-09-12T17:36:47.705 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.704+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~Z5WJYUZS0ZPK.2 size=929796 2024-09-12T17:36:47.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.708+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=Z5WJYUZS0ZPK tag=8ZHOY5THY64O type=write size=4075524 2024-09-12T17:36:47.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.708+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=TNCXQ0TJRKAH type=del size=3719348 2024-09-12T17:36:47.713 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.712+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~F1XNTQO3RRLV.0 size=483039 2024-09-12T17:36:47.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.716+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=F1XNTQO3RRLV tag=V74RYUBZPE92 type=write size=1531615 2024-09-12T17:36:47.722 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.720+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~K344383ADP1X.0 size=1048576 2024-09-12T17:36:47.723 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.724+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~K344383ADP1X.1 size=1048576 2024-09-12T17:36:47.725 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.724+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~K344383ADP1X.2 size=626044 2024-09-12T17:36:47.725 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.724+0000 7f1ad43488c0 1 > prepared multipart upload key=9Z2EHQA8T5F4 upload=K344383ADP1X tag=7DFYDXQB2NEO type=write size=3771772 2024-09-12T17:36:47.727 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.728+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=8SVDRS6DI5T3 type=del 2024-09-12T17:36:47.731 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.728+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~Y8ZQJVTHL0RK.0 size=1048576 2024-09-12T17:36:47.733 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.732+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~Y8ZQJVTHL0RK.1 size=975917 2024-09-12T17:36:47.733 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.732+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=Y8ZQJVTHL0RK tag=2FH96HM7XZOX type=write size=3073069 2024-09-12T17:36:47.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.732+0000 7f1ad43488c0 1 < canceled operation key=A49CE02X3L2L tag=XSNUKYDRKEU4 type=del size=2922060 2024-09-12T17:36:47.737 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.736+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=VV55G1QK23VI type=del size=632565 2024-09-12T17:36:47.739 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.740+0000 7f1ad43488c0 1 < completed delete operation key=ECEF8IJGU4Z8 tag=ZJTEC4NVV50O type=del 2024-09-12T17:36:47.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.740+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=N5MDDMWQ2UNQ type=del size=622560 2024-09-12T17:36:47.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.744+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~CBSCNU209S3G.0 size=1048576 2024-09-12T17:36:47.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.744+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~CBSCNU209S3G.1 size=539021 2024-09-12T17:36:47.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.748+0000 7f1ad43488c0 1 < completed multipart upload key=IY2AM7CJDUZG upload=CBSCNU209S3G tag=1A6J9WHYJOF2 type=write size=2636173 2024-09-12T17:36:47.753 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.752+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~WUCI49AK1MR5.0 size=688950 2024-09-12T17:36:47.753 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.752+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=WUCI49AK1MR5 tag=FTIXZXBVFC8W type=write size=1737526 2024-09-12T17:36:47.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.756+0000 7f1ad43488c0 1 < completed write operation key=7RSHIZRKK2OY tag=I20QPX2E4L0C type=write size=963502 2024-09-12T17:36:47.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.756+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=F6B4AR2SFR2G type=del size=17308 2024-09-12T17:36:47.764 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.764+0000 7f1ad43488c0 1 < suggested remove operation key=A49CE02X3L2L tag=R1XQERI405B5 type=del 2024-09-12T17:36:47.768 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.768+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~Z44QYPARQLR2.0 size=1048576 2024-09-12T17:36:47.770 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.768+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~Z44QYPARQLR2.1 size=1048576 2024-09-12T17:36:47.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.772+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~Z44QYPARQLR2.2 size=12564 2024-09-12T17:36:47.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.772+0000 7f1ad43488c0 1 > prepared multipart upload key=GWJ78NNXOL1R upload=Z44QYPARQLR2 tag=KZ5O5YI18E50 type=write size=3158292 2024-09-12T17:36:47.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.772+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=MD05B6T9KXRT type=del 2024-09-12T17:36:47.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.776+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~HOTILUE4K7KX.0 size=1048576 2024-09-12T17:36:47.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.780+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~HOTILUE4K7KX.1 size=1048576 2024-09-12T17:36:47.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.780+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~HOTILUE4K7KX.2 size=932714 2024-09-12T17:36:47.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.780+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=HOTILUE4K7KX tag=ZLBQAMQWKE4J type=write size=4078442 2024-09-12T17:36:47.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.784+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~1GSD2TDLLRRW.0 size=1008360 2024-09-12T17:36:47.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.788+0000 7f1ad43488c0 1 < completed multipart upload key=NHOG1WG3VT6N upload=1GSD2TDLLRRW tag=WUGZ0NID3MU6 type=write size=2056936 2024-09-12T17:36:47.792 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.792+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=HQAH8GW47686 type=del size=1944012 2024-09-12T17:36:47.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.796+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~7QGGMMQJMK5M.0 size=1048576 2024-09-12T17:36:47.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.796+0000 7f1ad43488c0 1 < canceled part key=_multipart_X078SB1ITNII.2~7QGGMMQJMK5M.1 size=1048576 2024-09-12T17:36:47.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.796+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~7QGGMMQJMK5M.2 size=346442 2024-09-12T17:36:47.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.800+0000 7f1ad43488c0 1 < canceled multipart upload key=X078SB1ITNII upload=7QGGMMQJMK5M tag=ENSWIWD3NRML type=write size=3492170 2024-09-12T17:36:47.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.804+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=KIB1LFV3OT5M type=del size=1636200 2024-09-12T17:36:47.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.808+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~LTI5Y6XLKP65.0 size=1048576 2024-09-12T17:36:47.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.808+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~LTI5Y6XLKP65.1 size=917009 2024-09-12T17:36:47.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.816+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=LTI5Y6XLKP65 tag=756U6EVU840L type=write size=3014161 2024-09-12T17:36:47.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.816+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=OMKQJINPOPTM type=del size=666296 2024-09-12T17:36:47.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.820+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~PIO4SC8597JV.0 size=1048576 2024-09-12T17:36:47.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.824+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~PIO4SC8597JV.1 size=491828 2024-09-12T17:36:47.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.828+0000 7f1ad43488c0 1 < completed multipart upload key=C7QSOK3D3IWJ upload=PIO4SC8597JV tag=D1FRZWBVSOB1 type=write size=2588980 2024-09-12T17:36:47.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.832+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~4FMU9NLDB1QS.0 size=1048576 2024-09-12T17:36:47.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.832+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~4FMU9NLDB1QS.1 size=1048576 2024-09-12T17:36:47.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.836+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~4FMU9NLDB1QS.2 size=697305 2024-09-12T17:36:47.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.836+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=4FMU9NLDB1QS tag=0XPDP97E71DT type=write size=3843033 2024-09-12T17:36:47.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.840+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=LBTI1AXN02VW type=del 2024-09-12T17:36:47.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.840+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=6NULOX7AAIDU type=del size=3687589 2024-09-12T17:36:47.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.848+0000 7f1ad43488c0 1 < completed delete operation key=PKC1RR4FZWE0 tag=P1EDHHT4TFEV type=del 2024-09-12T17:36:47.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.848+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=R9KJVZF96VBF type=del size=3112597 2024-09-12T17:36:47.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.856+0000 7f1ad43488c0 1 < suggested update operation key=05PAFB226IFP tag=T94H0P3ONK7G type=write size=384036 2024-09-12T17:36:47.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.860+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~H0KQFBCSZLRE.0 size=1048576 2024-09-12T17:36:47.864 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.864+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~H0KQFBCSZLRE.1 size=708619 2024-09-12T17:36:47.864 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.864+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=H0KQFBCSZLRE tag=YV3GR7SE8XGY type=write size=2805771 2024-09-12T17:36:47.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.864+0000 7f1ad43488c0 1 < canceled operation key=X078SB1ITNII tag=TNCXQ0TJRKAH type=del size=3719348 2024-09-12T17:36:47.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.868+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=HB78RMS39FZC type=del size=3544894 2024-09-12T17:36:47.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.868+0000 7f1ad43488c0 1 < canceled part key=_multipart_9Z2EHQA8T5F4.2~K344383ADP1X.0 size=1048576 2024-09-12T17:36:47.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.872+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~K344383ADP1X.1 size=1048576 2024-09-12T17:36:47.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.872+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~K344383ADP1X.2 size=626044 2024-09-12T17:36:47.879 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.880+0000 7f1ad43488c0 1 < canceled multipart upload key=9Z2EHQA8T5F4 upload=K344383ADP1X tag=7DFYDXQB2NEO type=write size=3771772 2024-09-12T17:36:47.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.880+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=3A35ZJY8NPUO type=del size=2201406 2024-09-12T17:36:47.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.880+0000 7f1ad43488c0 1 < canceled part key=_multipart_MB3FVGKV0ZNQ.2~Y8ZQJVTHL0RK.0 size=1048576 2024-09-12T17:36:47.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.884+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~Y8ZQJVTHL0RK.1 size=975917 2024-09-12T17:36:47.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.888+0000 7f1ad43488c0 1 < canceled multipart upload key=MB3FVGKV0ZNQ upload=Y8ZQJVTHL0RK tag=2FH96HM7XZOX type=write size=3073069 2024-09-12T17:36:47.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.892+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=D7L39ZO3IDTQ type=del size=976100 2024-09-12T17:36:47.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.896+0000 7f1ad43488c0 1 < completed delete operation key=C7QSOK3D3IWJ tag=VV55G1QK23VI type=del 2024-09-12T17:36:47.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.900+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~PHVDLWF7H0RJ.0 size=1048576 2024-09-12T17:36:47.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.904+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~PHVDLWF7H0RJ.1 size=1048576 2024-09-12T17:36:47.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.904+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~PHVDLWF7H0RJ.2 size=253890 2024-09-12T17:36:47.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.904+0000 7f1ad43488c0 1 > prepared multipart upload key=RH4HYE315U5Y upload=PHVDLWF7H0RJ tag=XN20KVNFL4BI type=write size=3399618 2024-09-12T17:36:47.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.908+0000 7f1ad43488c0 1 < canceled operation key=XOEPYERWY6IT tag=N5MDDMWQ2UNQ type=del size=622560 2024-09-12T17:36:47.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.916+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~RSHF3SAYNPOR.0 size=398941 2024-09-12T17:36:47.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.916+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=RSHF3SAYNPOR tag=M2YUGPWZ43NH type=write size=1447517 2024-09-12T17:36:47.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.916+0000 7f1ad43488c0 1 < canceled part key=_multipart_7RSHIZRKK2OY.2~WUCI49AK1MR5.0 size=688950 2024-09-12T17:36:47.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.920+0000 7f1ad43488c0 1 < canceled multipart upload key=7RSHIZRKK2OY upload=WUCI49AK1MR5 tag=FTIXZXBVFC8W type=write size=1737526 2024-09-12T17:36:47.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.920+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=6UNEN5X2T6P4 type=write size=1037780 2024-09-12T17:36:47.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.924+0000 7f1ad43488c0 1 < completed delete operation key=C7QSOK3D3IWJ tag=F6B4AR2SFR2G type=del 2024-09-12T17:36:47.930 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.928+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~W69IYAY02W2Z.0 size=1048576 2024-09-12T17:36:47.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.932+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~W69IYAY02W2Z.1 size=56169 2024-09-12T17:36:47.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.932+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=W69IYAY02W2Z tag=NSZPE988LO9W type=write size=2153321 2024-09-12T17:36:47.935 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.932+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~Z44QYPARQLR2.0 size=1048576 2024-09-12T17:36:47.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.936+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~Z44QYPARQLR2.1 size=1048576 2024-09-12T17:36:47.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.936+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~Z44QYPARQLR2.2 size=12564 2024-09-12T17:36:47.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.940+0000 7f1ad43488c0 1 < completed multipart upload key=GWJ78NNXOL1R upload=Z44QYPARQLR2 tag=KZ5O5YI18E50 type=write size=3158292 2024-09-12T17:36:47.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.944+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=6WTKH8TZWFKX type=del size=2288752 2024-09-12T17:36:47.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.948+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~HOTILUE4K7KX.0 size=1048576 2024-09-12T17:36:47.951 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.952+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~HOTILUE4K7KX.1 size=1048576 2024-09-12T17:36:47.951 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.952+0000 7f1ad43488c0 1 < canceled part key=_multipart_BCPDXAL027U2.2~HOTILUE4K7KX.2 size=932714 2024-09-12T17:36:47.955 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.956+0000 7f1ad43488c0 1 < canceled multipart upload key=BCPDXAL027U2 upload=HOTILUE4K7KX tag=ZLBQAMQWKE4J type=write size=4078442 2024-09-12T17:36:47.958 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.956+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=ZUJ4GQ0UEVW7 type=write size=791804 2024-09-12T17:36:47.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.960+0000 7f1ad43488c0 -1 < failed to complete operation key=05PAFB226IFP tag=HQAH8GW47686 type=del size=1944012: (22) Invalid argument 2024-09-12T17:36:47.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.960+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=PH9LDTCRDDBV type=del size=1116927 2024-09-12T17:36:47.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.964+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=KIB1LFV3OT5M type=del 2024-09-12T17:36:47.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.968+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~3F336CLO1R6Y.0 size=260555 2024-09-12T17:36:47.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.968+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=3F336CLO1R6Y tag=BGNNNJBJX1KL type=write size=1309131 2024-09-12T17:36:47.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.972+0000 7f1ad43488c0 1 < completed delete operation key=MB3FVGKV0ZNQ tag=OMKQJINPOPTM type=del 2024-09-12T17:36:47.974 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.972+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=0DJ4GDJ9BY3T type=del size=632193 2024-09-12T17:36:47.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.976+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~4FMU9NLDB1QS.0 size=1048576 2024-09-12T17:36:47.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.980+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~4FMU9NLDB1QS.1 size=1048576 2024-09-12T17:36:47.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.980+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~4FMU9NLDB1QS.2 size=697305 2024-09-12T17:36:47.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.984+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=4FMU9NLDB1QS tag=0XPDP97E71DT type=write size=3843033 2024-09-12T17:36:47.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.992+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~I7RRPUJU6P9S.0 size=1048576 2024-09-12T17:36:47.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.992+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~I7RRPUJU6P9S.1 size=295469 2024-09-12T17:36:47.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.992+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=I7RRPUJU6P9S tag=0THPYO1EHD09 type=write size=2392621 2024-09-12T17:36:47.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:47.996+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=6NULOX7AAIDU type=del 2024-09-12T17:36:47.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.000+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=PZOBZ8U1G61O type=del size=415003 2024-09-12T17:36:48.002 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.000+0000 7f1ad43488c0 1 < completed delete operation key=GWJ78NNXOL1R tag=R9KJVZF96VBF type=del 2024-09-12T17:36:48.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.004+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=0YV903I6AV31 type=del size=3116127 2024-09-12T17:36:48.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.004+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~H0KQFBCSZLRE.0 size=1048576 2024-09-12T17:36:48.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.008+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~H0KQFBCSZLRE.1 size=708619 2024-09-12T17:36:48.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.012+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=H0KQFBCSZLRE tag=YV3GR7SE8XGY type=write size=2805771 2024-09-12T17:36:48.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.012+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=3Z1SMHS1RRSS type=del size=2226439 2024-09-12T17:36:48.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.020+0000 7f1ad43488c0 1 < suggested update operation key=8U3L46JDJ8VS tag=HB78RMS39FZC type=del size=3544894 2024-09-12T17:36:48.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.020+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=Y2NKPQVG87OB type=write size=778304 2024-09-12T17:36:48.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.024+0000 7f1ad43488c0 1 < completed delete operation key=RH4HYE315U5Y tag=3A35ZJY8NPUO type=del 2024-09-12T17:36:48.029 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.028+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~G6SY3N3800KE.0 size=626810 2024-09-12T17:36:48.029 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.028+0000 7f1ad43488c0 1 > prepared multipart upload key=SIZ0Z1KWTGUJ upload=G6SY3N3800KE tag=EIRY23IBRJYV type=write size=1675386 2024-09-12T17:36:48.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.032+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=D7L39ZO3IDTQ type=del 2024-09-12T17:36:48.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.032+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=4F7JGWV9XE0M type=del size=1714486 2024-09-12T17:36:48.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.036+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~PHVDLWF7H0RJ.0 size=1048576 2024-09-12T17:36:48.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.040+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~PHVDLWF7H0RJ.1 size=1048576 2024-09-12T17:36:48.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.040+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~PHVDLWF7H0RJ.2 size=253890 2024-09-12T17:36:48.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.044+0000 7f1ad43488c0 1 < completed multipart upload key=RH4HYE315U5Y upload=PHVDLWF7H0RJ tag=XN20KVNFL4BI type=write size=3399618 2024-09-12T17:36:48.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.048+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=ZK3B6ANPFXKX type=del size=3025312 2024-09-12T17:36:48.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.048+0000 7f1ad43488c0 1 < canceled part key=_multipart_SDJ53NSPOIRC.2~RSHF3SAYNPOR.0 size=398941 2024-09-12T17:36:48.053 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.052+0000 7f1ad43488c0 1 < canceled multipart upload key=SDJ53NSPOIRC upload=RSHF3SAYNPOR tag=M2YUGPWZ43NH type=write size=1447517 2024-09-12T17:36:48.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.056+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=8XLRO0AAJA5S type=del size=1137633 2024-09-12T17:36:48.058 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.056+0000 7f1ad43488c0 1 < completed write operation key=RXJJOPR32OD5 tag=6UNEN5X2T6P4 type=write size=1037780 2024-09-12T17:36:48.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.060+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~Y15VERVZGR0F.0 size=1048576 2024-09-12T17:36:48.065 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.064+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~Y15VERVZGR0F.1 size=191819 2024-09-12T17:36:48.065 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.064+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=Y15VERVZGR0F tag=7V0797YY31OU type=write size=2288971 2024-09-12T17:36:48.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.068+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~W69IYAY02W2Z.0 size=1048576 2024-09-12T17:36:48.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.068+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~W69IYAY02W2Z.1 size=56169 2024-09-12T17:36:48.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.072+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=W69IYAY02W2Z tag=NSZPE988LO9W type=write size=2153321 2024-09-12T17:36:48.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.076+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=HYJ9DSCAJUUO type=write size=336066 2024-09-12T17:36:48.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.076+0000 7f1ad43488c0 1 < canceled operation key=SDJ53NSPOIRC tag=6WTKH8TZWFKX type=del size=2288752 2024-09-12T17:36:48.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.080+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=ABIEWEBNRCOT type=del size=3518695 2024-09-12T17:36:48.085 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.084+0000 7f1ad43488c0 1 < suggested remove operation key=SIZ0Z1KWTGUJ tag=ZUJ4GQ0UEVW7 type=write 2024-09-12T17:36:48.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.088+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~GE305LM1Z788.0 size=628999 2024-09-12T17:36:48.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.088+0000 7f1ad43488c0 1 > prepared multipart upload key=CHMM14VRIOQH upload=GE305LM1Z788 tag=YIISK19O25SP type=write size=1677575 2024-09-12T17:36:48.095 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.092+0000 7f1ad43488c0 1 < canceled operation key=GZ7LGZQHW4CY tag=PH9LDTCRDDBV type=del size=1116927 2024-09-12T17:36:48.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.100+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~RVSYECTC27HL.0 size=4823 2024-09-12T17:36:48.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.100+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=RVSYECTC27HL tag=BB0MWR1W8PCF type=write size=1053399 2024-09-12T17:36:48.102 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.100+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~3F336CLO1R6Y.0 size=260555 2024-09-12T17:36:48.106 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.104+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=3F336CLO1R6Y tag=BGNNNJBJX1KL type=write size=1309131 2024-09-12T17:36:48.110 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.108+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~6US702EYQBS5.0 size=1048576 2024-09-12T17:36:48.112 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.112+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~6US702EYQBS5.1 size=483316 2024-09-12T17:36:48.112 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.112+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=6US702EYQBS5 tag=AEMMJ7D1FKBV type=write size=2580468 2024-09-12T17:36:48.114 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.112+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=0DJ4GDJ9BY3T type=del 2024-09-12T17:36:48.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.116+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~SCQRGUFAKBAC.0 size=1048576 2024-09-12T17:36:48.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.120+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~SCQRGUFAKBAC.1 size=1021700 2024-09-12T17:36:48.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.120+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=SCQRGUFAKBAC tag=NFKTTYU2Q8JH type=write size=3118852 2024-09-12T17:36:48.122 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.120+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~I7RRPUJU6P9S.0 size=1048576 2024-09-12T17:36:48.124 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.124+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~I7RRPUJU6P9S.1 size=295469 2024-09-12T17:36:48.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.128+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=I7RRPUJU6P9S tag=0THPYO1EHD09 type=write size=2392621 2024-09-12T17:36:48.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.128+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=LVMFFD9SPCGC type=del size=3325872 2024-09-12T17:36:48.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.132+0000 7f1ad43488c0 1 < canceled operation key=PKC1RR4FZWE0 tag=PZOBZ8U1G61O type=del size=415003 2024-09-12T17:36:48.136 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.136+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=KXOILP68WYI0 type=write size=875849 2024-09-12T17:36:48.139 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.136+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=0YV903I6AV31 type=del 2024-09-12T17:36:48.144 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.144+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~54D4ZAT9TQM4.0 size=1048576 2024-09-12T17:36:48.146 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.144+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~54D4ZAT9TQM4.1 size=1048576 2024-09-12T17:36:48.149 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.148+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~54D4ZAT9TQM4.2 size=82116 2024-09-12T17:36:48.149 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.148+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=54D4ZAT9TQM4 tag=RKA2JSZLCOWZ type=write size=3227844 2024-09-12T17:36:48.152 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.152+0000 7f1ad43488c0 1 < canceled operation key=NHOG1WG3VT6N tag=3Z1SMHS1RRSS type=del size=2226439 2024-09-12T17:36:48.155 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.152+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=SJ5LTNE04H9K type=del size=4145527 2024-09-12T17:36:48.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.156+0000 7f1ad43488c0 1 < canceled operation key=MB3FVGKV0ZNQ tag=Y2NKPQVG87OB type=write size=778304 2024-09-12T17:36:48.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.164+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~FKNIGQ1VLXCF.0 size=537782 2024-09-12T17:36:48.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.164+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=FKNIGQ1VLXCF tag=ERYTJGP23CJ3 type=write size=1586358 2024-09-12T17:36:48.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.164+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~G6SY3N3800KE.0 size=626810 2024-09-12T17:36:48.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.172+0000 7f1ad43488c0 1 < completed multipart upload key=SIZ0Z1KWTGUJ upload=G6SY3N3800KE tag=EIRY23IBRJYV type=write size=1675386 2024-09-12T17:36:48.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.172+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=0I52CDD6F4W2 type=del size=284155 2024-09-12T17:36:48.178 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.176+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=4F7JGWV9XE0M type=del 2024-09-12T17:36:48.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.184+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~K9SDZ970L5VX.0 size=1048576 2024-09-12T17:36:48.186 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.184+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~K9SDZ970L5VX.1 size=54718 2024-09-12T17:36:48.186 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.184+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=K9SDZ970L5VX tag=SS2ZBDE58O41 type=write size=2151870 2024-09-12T17:36:48.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.188+0000 7f1ad43488c0 1 < completed delete operation key=PKC1RR4FZWE0 tag=ZK3B6ANPFXKX type=del 2024-09-12T17:36:48.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.192+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~OYVCVV3Y53MX.0 size=1048576 2024-09-12T17:36:48.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.196+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~OYVCVV3Y53MX.1 size=806942 2024-09-12T17:36:48.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.196+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=OYVCVV3Y53MX tag=FWPVNR3OG91V type=write size=2904094 2024-09-12T17:36:48.203 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.204+0000 7f1ad43488c0 1 < suggested remove operation key=4QO60GZ9V0GK tag=8XLRO0AAJA5S type=del 2024-09-12T17:36:48.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.208+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~5K1C9S6YFZB8.0 size=1048576 2024-09-12T17:36:48.211 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.212+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~5K1C9S6YFZB8.1 size=1048576 2024-09-12T17:36:48.214 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.212+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~5K1C9S6YFZB8.2 size=618059 2024-09-12T17:36:48.214 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.212+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=5K1C9S6YFZB8 tag=M8IKJS4NLO1B type=write size=3763787 2024-09-12T17:36:48.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.216+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~Y15VERVZGR0F.0 size=1048576 2024-09-12T17:36:48.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.220+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~Y15VERVZGR0F.1 size=191819 2024-09-12T17:36:48.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.224+0000 7f1ad43488c0 1 < completed multipart upload key=IY2AM7CJDUZG upload=Y15VERVZGR0F tag=7V0797YY31OU type=write size=2288971 2024-09-12T17:36:48.228 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.228+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=H1BG6GA9F8RK type=del size=1932975 2024-09-12T17:36:48.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.232+0000 7f1ad43488c0 1 < completed write operation key=Y3NQLDWQJ37Z tag=HYJ9DSCAJUUO type=write size=336066 2024-09-12T17:36:48.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.236+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~D4K83C037BIZ.0 size=129424 2024-09-12T17:36:48.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.236+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=D4K83C037BIZ tag=B42CIKVDOGW4 type=write size=1178000 2024-09-12T17:36:48.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.244+0000 7f1ad43488c0 1 < suggested update operation key=ECEF8IJGU4Z8 tag=ABIEWEBNRCOT type=del size=3518695 2024-09-12T17:36:48.249 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.248+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~8ZEDSV54WYPD.0 size=1048576 2024-09-12T17:36:48.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.252+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~8ZEDSV54WYPD.1 size=1048576 2024-09-12T17:36:48.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.252+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~8ZEDSV54WYPD.2 size=102976 2024-09-12T17:36:48.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.252+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=8ZEDSV54WYPD tag=40YJ7INX09JP type=write size=3248704 2024-09-12T17:36:48.257 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.256+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~GE305LM1Z788.0 size=628999 2024-09-12T17:36:48.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.260+0000 7f1ad43488c0 1 < completed multipart upload key=CHMM14VRIOQH upload=GE305LM1Z788 tag=YIISK19O25SP type=write size=1677575 2024-09-12T17:36:48.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.264+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=L5UCF87Y9665 type=del size=3348433 2024-09-12T17:36:48.268 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.268+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~RVSYECTC27HL.0 size=4823 2024-09-12T17:36:48.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.272+0000 7f1ad43488c0 1 < completed multipart upload key=IY2AM7CJDUZG upload=RVSYECTC27HL tag=BB0MWR1W8PCF type=write size=1053399 2024-09-12T17:36:48.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.276+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=PTB9QV7HR994 type=write size=91888 2024-09-12T17:36:48.278 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.276+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~6US702EYQBS5.0 size=1048576 2024-09-12T17:36:48.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.280+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~6US702EYQBS5.1 size=483316 2024-09-12T17:36:48.285 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.284+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=6US702EYQBS5 tag=AEMMJ7D1FKBV type=write size=2580468 2024-09-12T17:36:48.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.288+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=OAT82RKB3XSQ type=del size=2841917 2024-09-12T17:36:48.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.292+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~SCQRGUFAKBAC.0 size=1048576 2024-09-12T17:36:48.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.292+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~SCQRGUFAKBAC.1 size=1021700 2024-09-12T17:36:48.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.296+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=SCQRGUFAKBAC tag=NFKTTYU2Q8JH type=write size=3118852 2024-09-12T17:36:48.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.304+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~QRWQVNSRPH6T.0 size=1048576 2024-09-12T17:36:48.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.304+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~QRWQVNSRPH6T.1 size=916867 2024-09-12T17:36:48.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.304+0000 7f1ad43488c0 1 > prepared multipart upload key=Y3NQLDWQJ37Z upload=QRWQVNSRPH6T tag=F5Q3S5SD98NA type=write size=3014019 2024-09-12T17:36:48.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.308+0000 7f1ad43488c0 -1 < failed to complete operation key=4QO60GZ9V0GK tag=LVMFFD9SPCGC type=del size=3325872: (22) Invalid argument 2024-09-12T17:36:48.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.316+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~JLWHMB4TMEO8.0 size=1048576 2024-09-12T17:36:48.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.316+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~JLWHMB4TMEO8.1 size=22177 2024-09-12T17:36:48.318 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.316+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=JLWHMB4TMEO8 tag=BIW3EVARK1OS type=write size=2119329 2024-09-12T17:36:48.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.320+0000 7f1ad43488c0 1 < completed write operation key=LU7XIBO5YUOR tag=KXOILP68WYI0 type=write size=875849 2024-09-12T17:36:48.323 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.324+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=6XJUCY6ASGSN type=del size=483030 2024-09-12T17:36:48.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.324+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~54D4ZAT9TQM4.0 size=1048576 2024-09-12T17:36:48.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.328+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~54D4ZAT9TQM4.1 size=1048576 2024-09-12T17:36:48.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.332+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~54D4ZAT9TQM4.2 size=82116 2024-09-12T17:36:48.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.336+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=54D4ZAT9TQM4 tag=RKA2JSZLCOWZ type=write size=3227844 2024-09-12T17:36:48.339 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.340+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=P6STW3ZN0RM9 type=del size=3070968 2024-09-12T17:36:48.342 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.340+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=SJ5LTNE04H9K type=del 2024-09-12T17:36:48.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.348+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~0WVDZQGRE0M2.0 size=1048576 2024-09-12T17:36:48.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.348+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~0WVDZQGRE0M2.1 size=118209 2024-09-12T17:36:48.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.348+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=0WVDZQGRE0M2 tag=ZKJ3WFY6S768 type=write size=2215361 2024-09-12T17:36:48.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.352+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~FKNIGQ1VLXCF.0 size=537782 2024-09-12T17:36:48.361 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.360+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=FKNIGQ1VLXCF tag=ERYTJGP23CJ3 type=write size=1586358 2024-09-12T17:36:48.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.364+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=9ZOKY748MET5 type=del size=1130079 2024-09-12T17:36:48.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.364+0000 7f1ad43488c0 1 < completed delete operation key=SDJ53NSPOIRC tag=0I52CDD6F4W2 type=del 2024-09-12T17:36:48.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.368+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=MXFCPBUR8A0Z type=del size=905982 2024-09-12T17:36:48.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.372+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~K9SDZ970L5VX.0 size=1048576 2024-09-12T17:36:48.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.376+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~K9SDZ970L5VX.1 size=54718 2024-09-12T17:36:48.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.380+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=K9SDZ970L5VX tag=SS2ZBDE58O41 type=write size=2151870 2024-09-12T17:36:48.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.384+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~NH53ZV8N573X.0 size=1036115 2024-09-12T17:36:48.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.384+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=NH53ZV8N573X tag=UP2YKE9GIDMB type=write size=2084691 2024-09-12T17:36:48.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.388+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~OYVCVV3Y53MX.0 size=1048576 2024-09-12T17:36:48.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.392+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~OYVCVV3Y53MX.1 size=806942 2024-09-12T17:36:48.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.396+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=OYVCVV3Y53MX tag=FWPVNR3OG91V type=write size=2904094 2024-09-12T17:36:48.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.400+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=GP8PIRE53EUO type=del size=3370375 2024-09-12T17:36:48.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.400+0000 7f1ad43488c0 1 < canceled part key=_multipart_05PAFB226IFP.2~5K1C9S6YFZB8.0 size=1048576 2024-09-12T17:36:48.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.404+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~5K1C9S6YFZB8.1 size=1048576 2024-09-12T17:36:48.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.404+0000 7f1ad43488c0 1 < canceled part key=_multipart_05PAFB226IFP.2~5K1C9S6YFZB8.2 size=618059 2024-09-12T17:36:48.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.408+0000 7f1ad43488c0 1 < canceled multipart upload key=05PAFB226IFP upload=5K1C9S6YFZB8 tag=M8IKJS4NLO1B type=write size=3763787 2024-09-12T17:36:48.412 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.412+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=G6A010EABE3V type=write size=961483 2024-09-12T17:36:48.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.416+0000 7f1ad43488c0 1 < suggested remove operation key=7RSHIZRKK2OY tag=H1BG6GA9F8RK type=del 2024-09-12T17:36:48.424 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.424+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~S5FOMFF0IHN2.0 size=420468 2024-09-12T17:36:48.424 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.424+0000 7f1ad43488c0 1 > prepared multipart upload key=WFEJLVRCKIUU upload=S5FOMFF0IHN2 tag=XOZMGJ1YH32V type=write size=1469044 2024-09-12T17:36:48.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.424+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~D4K83C037BIZ.0 size=129424 2024-09-12T17:36:48.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.432+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=D4K83C037BIZ tag=B42CIKVDOGW4 type=write size=1178000 2024-09-12T17:36:48.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.436+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~W54N2RCJJ6BI.0 size=1048576 2024-09-12T17:36:48.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.440+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~W54N2RCJJ6BI.1 size=1048576 2024-09-12T17:36:48.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.440+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~W54N2RCJJ6BI.2 size=261440 2024-09-12T17:36:48.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.440+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=W54N2RCJJ6BI tag=G5M26POBJL00 type=write size=3407168 2024-09-12T17:36:48.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.444+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~8ZEDSV54WYPD.0 size=1048576 2024-09-12T17:36:48.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.444+0000 7f1ad43488c0 1 < canceled part key=_multipart_IY2AM7CJDUZG.2~8ZEDSV54WYPD.1 size=1048576 2024-09-12T17:36:48.448 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.448+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~8ZEDSV54WYPD.2 size=102976 2024-09-12T17:36:48.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.452+0000 7f1ad43488c0 1 < canceled multipart upload key=IY2AM7CJDUZG upload=8ZEDSV54WYPD tag=40YJ7INX09JP type=write size=3248704 2024-09-12T17:36:48.458 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.456+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=EP0AAWR3YOU2 type=del size=2286788 2024-09-12T17:36:48.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.460+0000 7f1ad43488c0 1 < completed delete operation key=C7QSOK3D3IWJ tag=L5UCF87Y9665 type=del 2024-09-12T17:36:48.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.464+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=7CFAXI8KDHNP type=del size=1731877 2024-09-12T17:36:48.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.472+0000 7f1ad43488c0 1 < suggested remove operation key=LU7XIBO5YUOR tag=PTB9QV7HR994 type=write 2024-09-12T17:36:48.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.476+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=QRIXKGF07XFT type=write size=909058 2024-09-12T17:36:48.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.476+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=OAT82RKB3XSQ type=del 2024-09-12T17:36:48.482 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.480+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=FP7UKDTTEPWK type=write size=38725 2024-09-12T17:36:48.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.484+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~QRWQVNSRPH6T.0 size=1048576 2024-09-12T17:36:48.488 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.488+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~QRWQVNSRPH6T.1 size=916867 2024-09-12T17:36:48.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.492+0000 7f1ad43488c0 1 < completed multipart upload key=Y3NQLDWQJ37Z upload=QRWQVNSRPH6T tag=F5Q3S5SD98NA type=write size=3014019 2024-09-12T17:36:48.496 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.496+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=ARUWFZYS2WER type=del size=915265 2024-09-12T17:36:48.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.500+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~JLWHMB4TMEO8.0 size=1048576 2024-09-12T17:36:48.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.500+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~JLWHMB4TMEO8.1 size=22177 2024-09-12T17:36:48.508 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.508+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=JLWHMB4TMEO8 tag=BIW3EVARK1OS type=write size=2119329 2024-09-12T17:36:48.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.512+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=WREYZJVRTK4X type=del size=3619408 2024-09-12T17:36:48.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.516+0000 7f1ad43488c0 1 < canceled operation key=NHOG1WG3VT6N tag=6XJUCY6ASGSN type=del size=483030 2024-09-12T17:36:48.518 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.516+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=GK0FM3E23RFG type=del size=3003949 2024-09-12T17:36:48.521 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.520+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=P6STW3ZN0RM9 type=del 2024-09-12T17:36:48.526 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.524+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~6WO5M0DZOSZX.0 size=1048576 2024-09-12T17:36:48.528 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.528+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~6WO5M0DZOSZX.1 size=243963 2024-09-12T17:36:48.529 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.528+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=6WO5M0DZOSZX tag=VSKWZYTLYKXB type=write size=2341115 2024-09-12T17:36:48.531 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.532+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~0WVDZQGRE0M2.0 size=1048576 2024-09-12T17:36:48.534 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.532+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~0WVDZQGRE0M2.1 size=118209 2024-09-12T17:36:48.538 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.536+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=0WVDZQGRE0M2 tag=ZKJ3WFY6S768 type=write size=2215361 2024-09-12T17:36:48.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.540+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=BZ0EC2V2E2IK type=del size=3068712 2024-09-12T17:36:48.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.544+0000 7f1ad43488c0 1 < completed delete operation key=05PAFB226IFP tag=9ZOKY748MET5 type=del 2024-09-12T17:36:48.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.544+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=D3BUHRAKRRZ6 type=del size=1199062 2024-09-12T17:36:48.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.548+0000 7f1ad43488c0 1 < completed delete operation key=ZHFRKX9YY8P5 tag=MXFCPBUR8A0Z type=del 2024-09-12T17:36:48.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.552+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=WVN6XMBZNO2U type=del size=1733270 2024-09-12T17:36:48.554 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.552+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~NH53ZV8N573X.0 size=1036115 2024-09-12T17:36:48.558 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.556+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=NH53ZV8N573X tag=UP2YKE9GIDMB type=write size=2084691 2024-09-12T17:36:48.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.560+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~KIOALKSW6Q3Y.0 size=1048576 2024-09-12T17:36:48.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.564+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~KIOALKSW6Q3Y.1 size=770947 2024-09-12T17:36:48.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.564+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=KIOALKSW6Q3Y tag=FIZ0WOMUM71G type=write size=2868099 2024-09-12T17:36:48.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.568+0000 7f1ad43488c0 1 < completed delete operation key=RH4HYE315U5Y tag=GP8PIRE53EUO type=del 2024-09-12T17:36:48.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.568+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=4O0YEHYCM7AL type=del size=1970056 2024-09-12T17:36:48.573 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.572+0000 7f1ad43488c0 1 < completed write operation key=RH4HYE315U5Y tag=G6A010EABE3V type=write size=961483 2024-09-12T17:36:48.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.576+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=KAPBI3AS1P1K type=del size=1659553 2024-09-12T17:36:48.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.576+0000 7f1ad43488c0 1 < canceled part key=_multipart_WFEJLVRCKIUU.2~S5FOMFF0IHN2.0 size=420468 2024-09-12T17:36:48.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.580+0000 7f1ad43488c0 1 < canceled multipart upload key=WFEJLVRCKIUU upload=S5FOMFF0IHN2 tag=XOZMGJ1YH32V type=write size=1469044 2024-09-12T17:36:48.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.584+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~2EDPL0Y9CPG1.0 size=1048576 2024-09-12T17:36:48.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.588+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~2EDPL0Y9CPG1.1 size=31985 2024-09-12T17:36:48.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.588+0000 7f1ad43488c0 1 > prepared multipart upload key=9Z2EHQA8T5F4 upload=2EDPL0Y9CPG1 tag=CCIFOEKQDX8D type=write size=2129137 2024-09-12T17:36:48.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.588+0000 7f1ad43488c0 1 < canceled part key=_multipart_6Z3F28JHHEQS.2~W54N2RCJJ6BI.0 size=1048576 2024-09-12T17:36:48.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.588+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~W54N2RCJJ6BI.1 size=1048576 2024-09-12T17:36:48.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.592+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~W54N2RCJJ6BI.2 size=261440 2024-09-12T17:36:48.596 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.596+0000 7f1ad43488c0 1 < canceled multipart upload key=6Z3F28JHHEQS upload=W54N2RCJJ6BI tag=G5M26POBJL00 type=write size=3407168 2024-09-12T17:36:48.599 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.600+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=TBZZBQIFM86S type=del size=1975927 2024-09-12T17:36:48.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.604+0000 7f1ad43488c0 1 < suggested remove operation key=MB3FVGKV0ZNQ tag=EP0AAWR3YOU2 type=del 2024-09-12T17:36:48.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.608+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~9BQDQ67922LM.0 size=1048576 2024-09-12T17:36:48.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.608+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~9BQDQ67922LM.1 size=1048576 2024-09-12T17:36:48.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.612+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~9BQDQ67922LM.2 size=999957 2024-09-12T17:36:48.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.612+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=9BQDQ67922LM tag=U2TG0B2O04AF type=write size=4145685 2024-09-12T17:36:48.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.616+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=7CFAXI8KDHNP type=del 2024-09-12T17:36:48.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.616+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=CGWPZKVM9L4B type=write size=474015 2024-09-12T17:36:48.621 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.620+0000 7f1ad43488c0 1 < completed write operation key=WFEJLVRCKIUU tag=QRIXKGF07XFT type=write size=909058 2024-09-12T17:36:48.623 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.624+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=S6YX85LS2HCX type=del size=715234 2024-09-12T17:36:48.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.624+0000 7f1ad43488c0 1 < completed write operation key=4QO60GZ9V0GK tag=FP7UKDTTEPWK type=write size=38725 2024-09-12T17:36:48.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.632+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~JTK94DP4OUD3.0 size=1048576 2024-09-12T17:36:48.635 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.636+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~JTK94DP4OUD3.1 size=638591 2024-09-12T17:36:48.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.636+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=JTK94DP4OUD3 tag=RD93FYOJCJIU type=write size=2735743 2024-09-12T17:36:48.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.636+0000 7f1ad43488c0 1 < completed delete operation key=XOEPYERWY6IT tag=ARUWFZYS2WER type=del 2024-09-12T17:36:48.641 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.640+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=5BD87RCZHIL7 type=del size=774805 2024-09-12T17:36:48.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.644+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=WREYZJVRTK4X type=del 2024-09-12T17:36:48.647 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.648+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=N1A5I4S7ATY9 type=del size=2054723 2024-09-12T17:36:48.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.648+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=GK0FM3E23RFG type=del 2024-09-12T17:36:48.652 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.652+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=HP1CTSEUNM9O type=del size=125383 2024-09-12T17:36:48.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.656+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~6WO5M0DZOSZX.0 size=1048576 2024-09-12T17:36:48.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.656+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~6WO5M0DZOSZX.1 size=243963 2024-09-12T17:36:48.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.660+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=6WO5M0DZOSZX tag=VSKWZYTLYKXB type=write size=2341115 2024-09-12T17:36:48.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.664+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=JH9F1DZVBBVI type=write size=354338 2024-09-12T17:36:48.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.664+0000 7f1ad43488c0 -1 < failed to complete operation key=MB3FVGKV0ZNQ tag=BZ0EC2V2E2IK type=del size=3068712: (22) Invalid argument 2024-09-12T17:36:48.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.668+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~18AT7ZHZZ8WI.0 size=1048576 2024-09-12T17:36:48.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.672+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~18AT7ZHZZ8WI.1 size=993793 2024-09-12T17:36:48.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.672+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=18AT7ZHZZ8WI tag=Q0HOS86OXGON type=write size=3090945 2024-09-12T17:36:48.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.676+0000 7f1ad43488c0 1 < completed delete operation key=SDJ53NSPOIRC tag=D3BUHRAKRRZ6 type=del 2024-09-12T17:36:48.679 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.676+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=WURLT26X928F type=del size=3913531 2024-09-12T17:36:48.685 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.684+0000 7f1ad43488c0 1 < suggested remove operation key=4QO60GZ9V0GK tag=WVN6XMBZNO2U type=del 2024-09-12T17:36:48.688 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.688+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=03C2G2R35KSN type=del size=3750388 2024-09-12T17:36:48.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.692+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~KIOALKSW6Q3Y.0 size=1048576 2024-09-12T17:36:48.693 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.692+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~KIOALKSW6Q3Y.1 size=770947 2024-09-12T17:36:48.698 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.696+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=KIOALKSW6Q3Y tag=FIZ0WOMUM71G type=write size=2868099 2024-09-12T17:36:48.703 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.704+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~5IOSKJXI28RM.0 size=1048576 2024-09-12T17:36:48.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.704+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~5IOSKJXI28RM.1 size=742510 2024-09-12T17:36:48.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.704+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=5IOSKJXI28RM tag=H6JOGFT94HXU type=write size=2839662 2024-09-12T17:36:48.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.708+0000 7f1ad43488c0 1 < completed delete operation key=WFEJLVRCKIUU tag=4O0YEHYCM7AL type=del 2024-09-12T17:36:48.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.712+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=PP12O8GEZWEZ type=del size=1748548 2024-09-12T17:36:48.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.712+0000 7f1ad43488c0 1 < completed delete operation key=WWB6LAHAMIR9 tag=KAPBI3AS1P1K type=del 2024-09-12T17:36:48.717 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.716+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=DQZIDNEXMRO8 type=write size=847115 2024-09-12T17:36:48.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.720+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~2EDPL0Y9CPG1.0 size=1048576 2024-09-12T17:36:48.723 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.724+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~2EDPL0Y9CPG1.1 size=31985 2024-09-12T17:36:48.729 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.728+0000 7f1ad43488c0 1 < completed multipart upload key=9Z2EHQA8T5F4 upload=2EDPL0Y9CPG1 tag=CCIFOEKQDX8D type=write size=2129137 2024-09-12T17:36:48.732 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.732+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=ZYC2T51ZSZQW type=del size=1710773 2024-09-12T17:36:48.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.736+0000 7f1ad43488c0 1 < completed delete operation key=ECEF8IJGU4Z8 tag=TBZZBQIFM86S type=del 2024-09-12T17:36:48.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.740+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~4BUVUFAESS87.0 size=1048576 2024-09-12T17:36:48.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.744+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~4BUVUFAESS87.1 size=1048576 2024-09-12T17:36:48.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.744+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~4BUVUFAESS87.2 size=704083 2024-09-12T17:36:48.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.744+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=4BUVUFAESS87 tag=YR0H0HWLKQPF type=write size=3849811 2024-09-12T17:36:48.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.748+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~9BQDQ67922LM.0 size=1048576 2024-09-12T17:36:48.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.748+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~9BQDQ67922LM.1 size=1048576 2024-09-12T17:36:48.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.752+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~9BQDQ67922LM.2 size=999957 2024-09-12T17:36:48.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.756+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=9BQDQ67922LM tag=U2TG0B2O04AF type=write size=4145685 2024-09-12T17:36:48.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.760+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=CZUU6BYQLEZO type=del size=3096758 2024-09-12T17:36:48.763 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.760+0000 7f1ad43488c0 1 < completed write operation key=2SDYAQRNWAJK tag=CGWPZKVM9L4B type=write size=474015 2024-09-12T17:36:48.767 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.768+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~C4CL237F9OE9.0 size=1048576 2024-09-12T17:36:48.769 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.768+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~C4CL237F9OE9.1 size=1048576 2024-09-12T17:36:48.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.772+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~C4CL237F9OE9.2 size=379014 2024-09-12T17:36:48.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.772+0000 7f1ad43488c0 1 > prepared multipart upload key=Y3NQLDWQJ37Z upload=C4CL237F9OE9 tag=EGTMZR6V8OZU type=write size=3524742 2024-09-12T17:36:48.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.776+0000 7f1ad43488c0 1 < completed delete operation key=RH4HYE315U5Y tag=S6YX85LS2HCX type=del 2024-09-12T17:36:48.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.776+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=OK57L4Z3R4D3 type=del size=4101771 2024-09-12T17:36:48.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.780+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~JTK94DP4OUD3.0 size=1048576 2024-09-12T17:36:48.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.780+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~JTK94DP4OUD3.1 size=638591 2024-09-12T17:36:48.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.784+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=JTK94DP4OUD3 tag=RD93FYOJCJIU type=write size=2735743 2024-09-12T17:36:48.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.788+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=K6YZOFH2NRYS type=del size=665624 2024-09-12T17:36:48.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.792+0000 7f1ad43488c0 1 < canceled operation key=ECEF8IJGU4Z8 tag=5BD87RCZHIL7 type=del size=774805 2024-09-12T17:36:48.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.796+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~VUOZSYB8RRVZ.0 size=1048576 2024-09-12T17:36:48.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.796+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~VUOZSYB8RRVZ.1 size=276511 2024-09-12T17:36:48.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.796+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=VUOZSYB8RRVZ tag=LDGKZ6G44JCB type=write size=2373663 2024-09-12T17:36:48.799 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.800+0000 7f1ad43488c0 1 < completed delete operation key=PKC1RR4FZWE0 tag=N1A5I4S7ATY9 type=del 2024-09-12T17:36:48.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.800+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=G1JBX5463ASM type=del size=465111 2024-09-12T17:36:48.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.804+0000 7f1ad43488c0 1 < suggested update operation key=A49CE02X3L2L tag=HP1CTSEUNM9O type=del size=125383 2024-09-12T17:36:48.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.808+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=7F6FECT0FWWV type=del size=3329917 2024-09-12T17:36:48.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.812+0000 7f1ad43488c0 1 < suggested remove operation key=ZHFRKX9YY8P5 tag=JH9F1DZVBBVI type=write 2024-09-12T17:36:48.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.816+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~PFK3L39JYR9E.0 size=1048576 2024-09-12T17:36:48.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.820+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~PFK3L39JYR9E.1 size=716083 2024-09-12T17:36:48.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.820+0000 7f1ad43488c0 1 > prepared multipart upload key=ZHFRKX9YY8P5 upload=PFK3L39JYR9E tag=EFJX25430LCM type=write size=2813235 2024-09-12T17:36:48.822 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.820+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~18AT7ZHZZ8WI.0 size=1048576 2024-09-12T17:36:48.822 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.820+0000 7f1ad43488c0 1 < canceled part key=_multipart_6Z3F28JHHEQS.2~18AT7ZHZZ8WI.1 size=993793 2024-09-12T17:36:48.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.824+0000 7f1ad43488c0 1 < canceled multipart upload key=6Z3F28JHHEQS upload=18AT7ZHZZ8WI tag=Q0HOS86OXGON type=write size=3090945 2024-09-12T17:36:48.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.828+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~TK2YEXMGUDCT.0 size=1048576 2024-09-12T17:36:48.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.832+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~TK2YEXMGUDCT.1 size=338144 2024-09-12T17:36:48.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.832+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=TK2YEXMGUDCT tag=YGI6LSK9AJ5H type=write size=2435296 2024-09-12T17:36:48.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.832+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=WURLT26X928F type=del 2024-09-12T17:36:48.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.836+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=EH3E8LDYOFJD type=del size=3469277 2024-09-12T17:36:48.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.840+0000 7f1ad43488c0 1 < completed delete operation key=05PAFB226IFP tag=03C2G2R35KSN type=del 2024-09-12T17:36:48.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.840+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=SADAY64X91FS type=del size=3073301 2024-09-12T17:36:48.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.844+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~5IOSKJXI28RM.0 size=1048576 2024-09-12T17:36:48.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.844+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~5IOSKJXI28RM.1 size=742510 2024-09-12T17:36:48.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.848+0000 7f1ad43488c0 1 < completed multipart upload key=WWB6LAHAMIR9 upload=5IOSKJXI28RM tag=H6JOGFT94HXU type=write size=2839662 2024-09-12T17:36:48.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.852+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=3QMKZF8G62K8 type=del size=3755672 2024-09-12T17:36:48.855 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.856+0000 7f1ad43488c0 1 < completed delete operation key=IY2AM7CJDUZG tag=PP12O8GEZWEZ type=del 2024-09-12T17:36:48.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.856+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=W13SPHTD2MA7 type=del size=3115608 2024-09-12T17:36:48.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.864+0000 7f1ad43488c0 1 < suggested update operation key=4QO60GZ9V0GK tag=DQZIDNEXMRO8 type=write size=847115 2024-09-12T17:36:48.865 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.864+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=NFMZR0EFHLAE type=write size=418101 2024-09-12T17:36:48.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.868+0000 7f1ad43488c0 1 < suggested update operation key=WWB6LAHAMIR9 tag=ZYC2T51ZSZQW type=del size=1710773 2024-09-12T17:36:48.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.872+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=YEJIHXZ52B47 type=del size=1041106 2024-09-12T17:36:48.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.872+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~4BUVUFAESS87.0 size=1048576 2024-09-12T17:36:48.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.876+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~4BUVUFAESS87.1 size=1048576 2024-09-12T17:36:48.878 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.876+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~4BUVUFAESS87.2 size=704083 2024-09-12T17:36:48.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.884+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=4BUVUFAESS87 tag=YR0H0HWLKQPF type=write size=3849811 2024-09-12T17:36:48.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.884+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=R61R7AXX79DR type=del size=1363013 2024-09-12T17:36:48.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.888+0000 7f1ad43488c0 1 < canceled operation key=RH4HYE315U5Y tag=CZUU6BYQLEZO type=del size=3096758 2024-09-12T17:36:48.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.892+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~ORZQCX5KKNEN.0 size=953708 2024-09-12T17:36:48.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.892+0000 7f1ad43488c0 1 > prepared multipart upload key=SIZ0Z1KWTGUJ upload=ORZQCX5KKNEN tag=4QEZN143PUJ5 type=write size=2002284 2024-09-12T17:36:48.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.896+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~C4CL237F9OE9.0 size=1048576 2024-09-12T17:36:48.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.896+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~C4CL237F9OE9.1 size=1048576 2024-09-12T17:36:48.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.896+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~C4CL237F9OE9.2 size=379014 2024-09-12T17:36:48.902 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.900+0000 7f1ad43488c0 1 < completed multipart upload key=Y3NQLDWQJ37Z upload=C4CL237F9OE9 tag=EGTMZR6V8OZU type=write size=3524742 2024-09-12T17:36:48.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.904+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=SW7YFVD6899E type=write size=973172 2024-09-12T17:36:48.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.904+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=OK57L4Z3R4D3 type=del 2024-09-12T17:36:48.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.908+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=HZ3VDV9Y2I10 type=write size=703397 2024-09-12T17:36:48.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.912+0000 7f1ad43488c0 1 < canceled operation key=SIZ0Z1KWTGUJ tag=K6YZOFH2NRYS type=del size=665624 2024-09-12T17:36:48.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.912+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=RDSA9476A06J type=del size=3523843 2024-09-12T17:36:48.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.916+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~VUOZSYB8RRVZ.0 size=1048576 2024-09-12T17:36:48.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.916+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~VUOZSYB8RRVZ.1 size=276511 2024-09-12T17:36:48.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.920+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=VUOZSYB8RRVZ tag=LDGKZ6G44JCB type=write size=2373663 2024-09-12T17:36:48.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.924+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=R3O3KP0OJJOQ type=del size=443449 2024-09-12T17:36:48.928 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.928+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=G1JBX5463ASM type=del 2024-09-12T17:36:48.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.932+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~MXAVMZGLMFFV.0 size=560121 2024-09-12T17:36:48.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.932+0000 7f1ad43488c0 1 > prepared multipart upload key=NHOG1WG3VT6N upload=MXAVMZGLMFFV tag=4T3WFOKZFRP0 type=write size=1608697 2024-09-12T17:36:48.934 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.932+0000 7f1ad43488c0 1 < completed delete operation key=9Z2EHQA8T5F4 tag=7F6FECT0FWWV type=del 2024-09-12T17:36:48.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.936+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=UTICVBRUNRWD type=del size=99192 2024-09-12T17:36:48.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.936+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~PFK3L39JYR9E.0 size=1048576 2024-09-12T17:36:48.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.940+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~PFK3L39JYR9E.1 size=716083 2024-09-12T17:36:48.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.944+0000 7f1ad43488c0 1 < completed multipart upload key=ZHFRKX9YY8P5 upload=PFK3L39JYR9E tag=EFJX25430LCM type=write size=2813235 2024-09-12T17:36:48.948 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.948+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~JP4N6FEY8WNR.0 size=564302 2024-09-12T17:36:48.948 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.948+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=JP4N6FEY8WNR tag=6594B54YYFDU type=write size=1612878 2024-09-12T17:36:48.951 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.948+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~TK2YEXMGUDCT.0 size=1048576 2024-09-12T17:36:48.952 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.952+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~TK2YEXMGUDCT.1 size=338144 2024-09-12T17:36:48.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.956+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=TK2YEXMGUDCT tag=YGI6LSK9AJ5H type=write size=2435296 2024-09-12T17:36:48.958 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.956+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=3Q7D0OTLA63C type=del size=3946806 2024-09-12T17:36:48.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.960+0000 7f1ad43488c0 1 < completed delete operation key=IY2AM7CJDUZG tag=EH3E8LDYOFJD type=del 2024-09-12T17:36:48.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.960+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=0L1T7U23M113 type=del size=872561 2024-09-12T17:36:48.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.964+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=SADAY64X91FS type=del 2024-09-12T17:36:48.967 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.968+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=DA1OJ8C17ECJ type=del size=3241253 2024-09-12T17:36:48.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.968+0000 7f1ad43488c0 -1 < failed to complete operation key=4QO60GZ9V0GK tag=3QMKZF8G62K8 type=del size=3755672: (22) Invalid argument 2024-09-12T17:36:48.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.972+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=ZIWMFE6QKYGG type=del size=90968 2024-09-12T17:36:48.974 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.972+0000 7f1ad43488c0 1 < completed delete operation key=05PAFB226IFP tag=W13SPHTD2MA7 type=del 2024-09-12T17:36:48.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.976+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~86D8NRA2G952.0 size=109425 2024-09-12T17:36:48.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.976+0000 7f1ad43488c0 1 > prepared multipart upload key=RH4HYE315U5Y upload=86D8NRA2G952 tag=PLUFEJMU70K3 type=write size=1158001 2024-09-12T17:36:48.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.980+0000 7f1ad43488c0 1 < suggested update operation key=LU7XIBO5YUOR tag=NFMZR0EFHLAE type=write size=418101 2024-09-12T17:36:48.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.984+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=26B4MTYD0F29 type=del size=4101953 2024-09-12T17:36:48.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.984+0000 7f1ad43488c0 1 < completed delete operation key=IY2AM7CJDUZG tag=YEJIHXZ52B47 type=del 2024-09-12T17:36:48.990 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.988+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~85O2DWD34WLX.0 size=839615 2024-09-12T17:36:48.990 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.988+0000 7f1ad43488c0 1 > prepared multipart upload key=GWJ78NNXOL1R upload=85O2DWD34WLX tag=TNBUXYN7DZ9H type=write size=1888191 2024-09-12T17:36:48.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.992+0000 7f1ad43488c0 1 < completed delete operation key=IY2AM7CJDUZG tag=R61R7AXX79DR type=del 2024-09-12T17:36:48.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.992+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=PJ411BDUNHNC type=write size=242882 2024-09-12T17:36:48.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:48.996+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~ORZQCX5KKNEN.0 size=953708 2024-09-12T17:36:49.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.000+0000 7f1ad43488c0 1 < completed multipart upload key=SIZ0Z1KWTGUJ upload=ORZQCX5KKNEN tag=4QEZN143PUJ5 type=write size=2002284 2024-09-12T17:36:49.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.004+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=JBTUYGZQOBGQ type=del size=260728 2024-09-12T17:36:49.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.004+0000 7f1ad43488c0 1 < completed write operation key=MB3FVGKV0ZNQ tag=SW7YFVD6899E type=write size=973172 2024-09-12T17:36:49.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.008+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=HBX5K0LN068K type=write size=347577 2024-09-12T17:36:49.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.008+0000 7f1ad43488c0 1 < canceled operation key=RH4HYE315U5Y tag=HZ3VDV9Y2I10 type=write size=703397 2024-09-12T17:36:49.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.012+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=PP3GD7GPZVXJ type=del size=1153460 2024-09-12T17:36:49.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.016+0000 7f1ad43488c0 1 < completed delete operation key=PKC1RR4FZWE0 tag=RDSA9476A06J type=del 2024-09-12T17:36:49.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.016+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=BOFPA0UAJKHM type=del size=1697388 2024-09-12T17:36:49.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.020+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=R3O3KP0OJJOQ type=del 2024-09-12T17:36:49.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.024+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=BZXRQFD304Y2 type=write size=251326 2024-09-12T17:36:49.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.024+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~MXAVMZGLMFFV.0 size=560121 2024-09-12T17:36:49.030 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.028+0000 7f1ad43488c0 1 < completed multipart upload key=NHOG1WG3VT6N upload=MXAVMZGLMFFV tag=4T3WFOKZFRP0 type=write size=1608697 2024-09-12T17:36:49.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.032+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~3IYXFD353A4M.0 size=1048576 2024-09-12T17:36:49.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.036+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~3IYXFD353A4M.1 size=1048576 2024-09-12T17:36:49.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.040+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~3IYXFD353A4M.2 size=68539 2024-09-12T17:36:49.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.040+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=3IYXFD353A4M tag=ME2NMUJWA4TO type=write size=3214267 2024-09-12T17:36:49.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.040+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=UTICVBRUNRWD type=del 2024-09-12T17:36:49.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.044+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=Y3UIXT7K5GWR type=del size=2796104 2024-09-12T17:36:49.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.048+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~JP4N6FEY8WNR.0 size=564302 2024-09-12T17:36:49.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.052+0000 7f1ad43488c0 1 < completed multipart upload key=WWB6LAHAMIR9 upload=JP4N6FEY8WNR tag=6594B54YYFDU type=write size=1612878 2024-09-12T17:36:49.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.052+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=I9XW0L66ENPB type=del size=3967946 2024-09-12T17:36:49.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.056+0000 7f1ad43488c0 -1 < failed to complete operation key=LU7XIBO5YUOR tag=3Q7D0OTLA63C type=del size=3946806: (22) Invalid argument 2024-09-12T17:36:49.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.060+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=KV7KH31JPWPE type=write size=168289 2024-09-12T17:36:49.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.064+0000 7f1ad43488c0 1 < canceled operation key=C7QSOK3D3IWJ tag=0L1T7U23M113 type=del size=872561 2024-09-12T17:36:49.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.064+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=F99CWP2U9VMH type=write size=501935 2024-09-12T17:36:49.068 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.068+0000 7f1ad43488c0 1 < completed delete operation key=9Z2EHQA8T5F4 tag=DA1OJ8C17ECJ type=del 2024-09-12T17:36:49.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.072+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~9JXMF7DSXY3E.0 size=470129 2024-09-12T17:36:49.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.072+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=9JXMF7DSXY3E tag=RFO9LQYN57KX type=write size=1518705 2024-09-12T17:36:49.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.076+0000 7f1ad43488c0 1 < completed delete operation key=C7QSOK3D3IWJ tag=ZIWMFE6QKYGG type=del 2024-09-12T17:36:49.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.076+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=TQOZNJQKKKFY type=del size=2704201 2024-09-12T17:36:49.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.080+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~86D8NRA2G952.0 size=109425 2024-09-12T17:36:49.085 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.084+0000 7f1ad43488c0 1 < completed multipart upload key=RH4HYE315U5Y upload=86D8NRA2G952 tag=PLUFEJMU70K3 type=write size=1158001 2024-09-12T17:36:49.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.088+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=NH8JTQ3XJL60 type=del size=272214 2024-09-12T17:36:49.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.088+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=26B4MTYD0F29 type=del 2024-09-12T17:36:49.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.092+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~ZTZUVZK5YPLM.0 size=1048576 2024-09-12T17:36:49.096 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.096+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~ZTZUVZK5YPLM.1 size=374430 2024-09-12T17:36:49.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.096+0000 7f1ad43488c0 1 > prepared multipart upload key=3N1YT9TC0M3O upload=ZTZUVZK5YPLM tag=EG6WGN8PCJ55 type=write size=2471582 2024-09-12T17:36:49.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.100+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~85O2DWD34WLX.0 size=839615 2024-09-12T17:36:49.103 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.104+0000 7f1ad43488c0 1 < completed multipart upload key=GWJ78NNXOL1R upload=85O2DWD34WLX tag=TNBUXYN7DZ9H type=write size=1888191 2024-09-12T17:36:49.110 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.108+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~S3T5UCHLZ3RH.0 size=412898 2024-09-12T17:36:49.110 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.108+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=S3T5UCHLZ3RH tag=WE3MTO87S26I type=write size=1461474 2024-09-12T17:36:49.113 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.112+0000 7f1ad43488c0 1 < completed write operation key=2SDYAQRNWAJK tag=PJ411BDUNHNC type=write size=242882 2024-09-12T17:36:49.115 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.116+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=GEFK4FMU2NUH type=write size=546089 2024-09-12T17:36:49.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.116+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=JBTUYGZQOBGQ type=del 2024-09-12T17:36:49.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.120+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=GAVKU86U2P33 type=del size=3321531 2024-09-12T17:36:49.122 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.120+0000 7f1ad43488c0 1 < completed write operation key=SIZ0Z1KWTGUJ tag=HBX5K0LN068K type=write size=347577 2024-09-12T17:36:49.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.128+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~43RPERKRFKSG.0 size=1048576 2024-09-12T17:36:49.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.128+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~43RPERKRFKSG.1 size=128192 2024-09-12T17:36:49.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.128+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=43RPERKRFKSG tag=E4M9JA15SXJR type=write size=2225344 2024-09-12T17:36:49.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.132+0000 7f1ad43488c0 1 < completed delete operation key=05PAFB226IFP tag=PP3GD7GPZVXJ type=del 2024-09-12T17:36:49.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.132+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=KPC8BJ4UQBOL type=del size=2746793 2024-09-12T17:36:49.139 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.136+0000 7f1ad43488c0 1 < suggested update operation key=MB3FVGKV0ZNQ tag=BOFPA0UAJKHM type=del size=1697388 2024-09-12T17:36:49.142 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.140+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=2XUJLENIAXAP type=del size=236882 2024-09-12T17:36:49.144 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.144+0000 7f1ad43488c0 1 < completed write operation key=LU7XIBO5YUOR tag=BZXRQFD304Y2 type=write size=251326 2024-09-12T17:36:49.149 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.148+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~L7T351S5D58Y.0 size=1048576 2024-09-12T17:36:49.151 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.148+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~L7T351S5D58Y.1 size=1048576 2024-09-12T17:36:49.153 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.152+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~L7T351S5D58Y.2 size=573274 2024-09-12T17:36:49.153 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.152+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=L7T351S5D58Y tag=0S3JJ8IGVDOX type=write size=3719002 2024-09-12T17:36:49.155 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.156+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~3IYXFD353A4M.0 size=1048576 2024-09-12T17:36:49.157 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.156+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~3IYXFD353A4M.1 size=1048576 2024-09-12T17:36:49.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.160+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~3IYXFD353A4M.2 size=68539 2024-09-12T17:36:49.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.164+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=3IYXFD353A4M tag=ME2NMUJWA4TO type=write size=3214267 2024-09-12T17:36:49.169 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.168+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~DC2G8F8LP3XT.0 size=1048576 2024-09-12T17:36:49.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.172+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~DC2G8F8LP3XT.1 size=1048576 2024-09-12T17:36:49.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.172+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~DC2G8F8LP3XT.2 size=113836 2024-09-12T17:36:49.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.172+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=DC2G8F8LP3XT tag=TZ2YL8OUSNUL type=write size=3259564 2024-09-12T17:36:49.176 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.176+0000 7f1ad43488c0 1 < completed delete operation key=ZHFRKX9YY8P5 tag=Y3UIXT7K5GWR type=del 2024-09-12T17:36:49.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.180+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~71R02023HD1E.0 size=1048576 2024-09-12T17:36:49.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.184+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~71R02023HD1E.1 size=199731 2024-09-12T17:36:49.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.184+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=71R02023HD1E tag=WSD7XPGNJP9F type=write size=2296883 2024-09-12T17:36:49.186 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.184+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=I9XW0L66ENPB type=del 2024-09-12T17:36:49.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.188+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=Q2CDX0S4FXRX type=write size=274614 2024-09-12T17:36:49.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.192+0000 7f1ad43488c0 1 < suggested remove operation key=SDJ53NSPOIRC tag=KV7KH31JPWPE type=write 2024-09-12T17:36:49.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.200+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~BNVFYH0330Y7.0 size=577882 2024-09-12T17:36:49.200 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.200+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=BNVFYH0330Y7 tag=OP1DNPUWT15T type=write size=1626458 2024-09-12T17:36:49.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.200+0000 7f1ad43488c0 1 < completed write operation key=BCPDXAL027U2 tag=F99CWP2U9VMH type=write size=501935 2024-09-12T17:36:49.208 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.208+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~DSOMFGVAJ5DC.0 size=74889 2024-09-12T17:36:49.208 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.208+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=DSOMFGVAJ5DC tag=DGJ9UINZ47G7 type=write size=1123465 2024-09-12T17:36:49.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.208+0000 7f1ad43488c0 1 < canceled part key=_multipart_RXJJOPR32OD5.2~9JXMF7DSXY3E.0 size=470129 2024-09-12T17:36:49.213 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.212+0000 7f1ad43488c0 1 < canceled multipart upload key=RXJJOPR32OD5 upload=9JXMF7DSXY3E tag=RFO9LQYN57KX type=write size=1518705 2024-09-12T17:36:49.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.216+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=51GXUT6GBWOD type=del size=3651935 2024-09-12T17:36:49.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.220+0000 7f1ad43488c0 1 < canceled operation key=C7QSOK3D3IWJ tag=TQOZNJQKKKFY type=del size=2704201 2024-09-12T17:36:49.226 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.224+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~CS2NM73ZKZ0Q.0 size=758985 2024-09-12T17:36:49.226 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.224+0000 7f1ad43488c0 1 > prepared multipart upload key=ZHFRKX9YY8P5 upload=CS2NM73ZKZ0Q tag=GK7KBO1OHEF4 type=write size=1807561 2024-09-12T17:36:49.229 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.228+0000 7f1ad43488c0 -1 < failed to complete operation key=SDJ53NSPOIRC tag=NH8JTQ3XJL60 type=del size=272214: (22) Invalid argument 2024-09-12T17:36:49.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.232+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=LBEM360LU30V type=del size=821038 2024-09-12T17:36:49.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.236+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~ZTZUVZK5YPLM.0 size=1048576 2024-09-12T17:36:49.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.236+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~ZTZUVZK5YPLM.1 size=374430 2024-09-12T17:36:49.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.240+0000 7f1ad43488c0 1 < completed multipart upload key=3N1YT9TC0M3O upload=ZTZUVZK5YPLM tag=EG6WGN8PCJ55 type=write size=2471582 2024-09-12T17:36:49.249 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.248+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~JB1XVMWC3YVS.0 size=1048576 2024-09-12T17:36:49.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.252+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~JB1XVMWC3YVS.1 size=1048576 2024-09-12T17:36:49.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.252+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~JB1XVMWC3YVS.2 size=164362 2024-09-12T17:36:49.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.252+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=JB1XVMWC3YVS tag=90PZSNX08H3N type=write size=3310090 2024-09-12T17:36:49.258 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.256+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~S3T5UCHLZ3RH.0 size=412898 2024-09-12T17:36:49.264 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.264+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=S3T5UCHLZ3RH tag=WE3MTO87S26I type=write size=1461474 2024-09-12T17:36:49.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.268+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~TF355GKZQJCV.0 size=718966 2024-09-12T17:36:49.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.268+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=TF355GKZQJCV tag=B4AQID7XES1Y type=write size=1767542 2024-09-12T17:36:49.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.272+0000 7f1ad43488c0 1 < completed write operation key=RXJJOPR32OD5 tag=GEFK4FMU2NUH type=write size=546089 2024-09-12T17:36:49.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.280+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~6IPP826GKOQW.0 size=1048576 2024-09-12T17:36:49.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.284+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~6IPP826GKOQW.1 size=265336 2024-09-12T17:36:49.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.284+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=6IPP826GKOQW tag=HQJ821T1GGKL type=write size=2362488 2024-09-12T17:36:49.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.288+0000 7f1ad43488c0 1 < suggested remove operation key=XOEPYERWY6IT tag=GAVKU86U2P33 type=del 2024-09-12T17:36:49.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.292+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=7Q8IXX38F3C0 type=del size=2077343 2024-09-12T17:36:49.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.296+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~43RPERKRFKSG.0 size=1048576 2024-09-12T17:36:49.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.300+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~43RPERKRFKSG.1 size=128192 2024-09-12T17:36:49.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.304+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=43RPERKRFKSG tag=E4M9JA15SXJR type=write size=2225344 2024-09-12T17:36:49.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.312+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~FHDOENPPJYX7.0 size=1048576 2024-09-12T17:36:49.316 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.316+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~FHDOENPPJYX7.1 size=464382 2024-09-12T17:36:49.316 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.316+0000 7f1ad43488c0 1 > prepared multipart upload key=CHMM14VRIOQH upload=FHDOENPPJYX7 tag=OGAGE2O6JWQI type=write size=2561534 2024-09-12T17:36:49.323 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.320+0000 7f1ad43488c0 1 < suggested remove operation key=9Z2EHQA8T5F4 tag=KPC8BJ4UQBOL type=del 2024-09-12T17:36:49.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.328+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~00SDZS6C2K8B.0 size=1048576 2024-09-12T17:36:49.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.332+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~00SDZS6C2K8B.1 size=307759 2024-09-12T17:36:49.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.332+0000 7f1ad43488c0 1 > prepared multipart upload key=CHMM14VRIOQH upload=00SDZS6C2K8B tag=2ZHAJDLWJU0B type=write size=2404911 2024-09-12T17:36:49.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.336+0000 7f1ad43488c0 1 < completed delete operation key=2SDYAQRNWAJK tag=2XUJLENIAXAP type=del 2024-09-12T17:36:49.339 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.340+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=WQZNMW2FJCPT type=del size=2033119 2024-09-12T17:36:49.343 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.340+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~L7T351S5D58Y.0 size=1048576 2024-09-12T17:36:49.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.344+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~L7T351S5D58Y.1 size=1048576 2024-09-12T17:36:49.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.348+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~L7T351S5D58Y.2 size=573274 2024-09-12T17:36:49.354 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.352+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=L7T351S5D58Y tag=0S3JJ8IGVDOX type=write size=3719002 2024-09-12T17:36:49.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.356+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=Y32N5X7HHCG1 type=del size=87606 2024-09-12T17:36:49.361 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.360+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~DC2G8F8LP3XT.0 size=1048576 2024-09-12T17:36:49.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.364+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~DC2G8F8LP3XT.1 size=1048576 2024-09-12T17:36:49.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.368+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~DC2G8F8LP3XT.2 size=113836 2024-09-12T17:36:49.374 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.372+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=DC2G8F8LP3XT tag=TZ2YL8OUSNUL type=write size=3259564 2024-09-12T17:36:49.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.380+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~WJAPXMMUDXJ5.0 size=677203 2024-09-12T17:36:49.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.380+0000 7f1ad43488c0 1 > prepared multipart upload key=9Z2EHQA8T5F4 upload=WJAPXMMUDXJ5 tag=LCN3UHAUOLJH type=write size=1725779 2024-09-12T17:36:49.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.384+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~71R02023HD1E.0 size=1048576 2024-09-12T17:36:49.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.384+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~71R02023HD1E.1 size=199731 2024-09-12T17:36:49.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.392+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=71R02023HD1E tag=WSD7XPGNJP9F type=write size=2296883 2024-09-12T17:36:49.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.400+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=XA3UX2FGKF2H type=del size=3950777 2024-09-12T17:36:49.407 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.404+0000 7f1ad43488c0 1 < suggested remove operation key=MB3FVGKV0ZNQ tag=Q2CDX0S4FXRX type=write 2024-09-12T17:36:49.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.408+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=UJA7NQW82ZMV type=del size=1051488 2024-09-12T17:36:49.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.412+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~BNVFYH0330Y7.0 size=577882 2024-09-12T17:36:49.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.420+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=BNVFYH0330Y7 tag=OP1DNPUWT15T type=write size=1626458 2024-09-12T17:36:49.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.420+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=NHCFQ9PCF902 type=del size=3917893 2024-09-12T17:36:49.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.424+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~DSOMFGVAJ5DC.0 size=74889 2024-09-12T17:36:49.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.432+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=DSOMFGVAJ5DC tag=DGJ9UINZ47G7 type=write size=1123465 2024-09-12T17:36:49.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.432+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=RYQX2ZGW9M1Z type=del size=1451538 2024-09-12T17:36:49.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.436+0000 7f1ad43488c0 1 < canceled operation key=WFEJLVRCKIUU tag=51GXUT6GBWOD type=del size=3651935 2024-09-12T17:36:49.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.444+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~1W7EEUNV6J8T.0 size=1048576 2024-09-12T17:36:49.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.444+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~1W7EEUNV6J8T.1 size=1012841 2024-09-12T17:36:49.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.444+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=1W7EEUNV6J8T tag=L9KP713J9TRL type=write size=3109993 2024-09-12T17:36:49.449 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.448+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~CS2NM73ZKZ0Q.0 size=758985 2024-09-12T17:36:49.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.452+0000 7f1ad43488c0 1 < completed multipart upload key=ZHFRKX9YY8P5 upload=CS2NM73ZKZ0Q tag=GK7KBO1OHEF4 type=write size=1807561 2024-09-12T17:36:49.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.460+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~H2BF0F6XOG8E.0 size=1048576 2024-09-12T17:36:49.463 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.464+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~H2BF0F6XOG8E.1 size=482749 2024-09-12T17:36:49.463 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.464+0000 7f1ad43488c0 1 > prepared multipart upload key=GWJ78NNXOL1R upload=H2BF0F6XOG8E tag=2TBMPBXFSQY2 type=write size=2579901 2024-09-12T17:36:49.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.464+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=LBEM360LU30V type=del 2024-09-12T17:36:49.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.472+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~OC5ALMCYC9FE.0 size=163647 2024-09-12T17:36:49.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.472+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=OC5ALMCYC9FE tag=PC2CTFZJC3Q1 type=write size=1212223 2024-09-12T17:36:49.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.472+0000 7f1ad43488c0 1 < canceled part key=_multipart_SDJ53NSPOIRC.2~JB1XVMWC3YVS.0 size=1048576 2024-09-12T17:36:49.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.476+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~JB1XVMWC3YVS.1 size=1048576 2024-09-12T17:36:49.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.480+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~JB1XVMWC3YVS.2 size=164362 2024-09-12T17:36:49.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.484+0000 7f1ad43488c0 1 < canceled multipart upload key=SDJ53NSPOIRC upload=JB1XVMWC3YVS tag=90PZSNX08H3N type=write size=3310090 2024-09-12T17:36:49.489 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.488+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=P8R2HRNVV04U type=del size=2196483 2024-09-12T17:36:49.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.492+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~TF355GKZQJCV.0 size=718966 2024-09-12T17:36:49.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.496+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=TF355GKZQJCV tag=B4AQID7XES1Y type=write size=1767542 2024-09-12T17:36:49.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.500+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=VE4B68IDIRBA type=del size=714704 2024-09-12T17:36:49.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.504+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~6IPP826GKOQW.0 size=1048576 2024-09-12T17:36:49.505 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.504+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~6IPP826GKOQW.1 size=265336 2024-09-12T17:36:49.511 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.512+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=6IPP826GKOQW tag=HQJ821T1GGKL type=write size=2362488 2024-09-12T17:36:49.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.516+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=Y0LX19C7G18O type=del size=1838818 2024-09-12T17:36:49.519 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.520+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=7Q8IXX38F3C0 type=del 2024-09-12T17:36:49.525 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.524+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~FRQGL13UEBFY.0 size=1048576 2024-09-12T17:36:49.528 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.528+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~FRQGL13UEBFY.1 size=454556 2024-09-12T17:36:49.528 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.528+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=FRQGL13UEBFY tag=EW1HN1ADIO8Z type=write size=2551708 2024-09-12T17:36:49.531 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.532+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~FHDOENPPJYX7.0 size=1048576 2024-09-12T17:36:49.534 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.532+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~FHDOENPPJYX7.1 size=464382 2024-09-12T17:36:49.540 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.540+0000 7f1ad43488c0 1 < completed multipart upload key=CHMM14VRIOQH upload=FHDOENPPJYX7 tag=OGAGE2O6JWQI type=write size=2561534 2024-09-12T17:36:49.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.544+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~R036KBIQGNMM.0 size=1048576 2024-09-12T17:36:49.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.548+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~R036KBIQGNMM.1 size=1048576 2024-09-12T17:36:49.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.552+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~R036KBIQGNMM.2 size=325835 2024-09-12T17:36:49.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.552+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=R036KBIQGNMM tag=8RFHAP1UOA9R type=write size=3471563 2024-09-12T17:36:49.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.556+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~00SDZS6C2K8B.0 size=1048576 2024-09-12T17:36:49.558 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.556+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~00SDZS6C2K8B.1 size=307759 2024-09-12T17:36:49.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.564+0000 7f1ad43488c0 1 < completed multipart upload key=CHMM14VRIOQH upload=00SDZS6C2K8B tag=2ZHAJDLWJU0B type=write size=2404911 2024-09-12T17:36:49.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.568+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=X53U2NB9IGSC type=del size=1025278 2024-09-12T17:36:49.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.568+0000 7f1ad43488c0 -1 < failed to complete operation key=MB3FVGKV0ZNQ tag=WQZNMW2FJCPT type=del size=2033119: (22) Invalid argument 2024-09-12T17:36:49.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.576+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~9P02BOPXPNGD.0 size=1048576 2024-09-12T17:36:49.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.580+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~9P02BOPXPNGD.1 size=1048576 2024-09-12T17:36:49.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.580+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~9P02BOPXPNGD.2 size=236417 2024-09-12T17:36:49.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.580+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=9P02BOPXPNGD tag=CVEIETCJ5P2D type=write size=3382145 2024-09-12T17:36:49.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.588+0000 7f1ad43488c0 1 < suggested update operation key=7RSHIZRKK2OY tag=Y32N5X7HHCG1 type=del size=87606 2024-09-12T17:36:49.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.592+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=J313Z9B7ADOK type=del size=2308816 2024-09-12T17:36:49.597 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.596+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~WJAPXMMUDXJ5.0 size=677203 2024-09-12T17:36:49.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.600+0000 7f1ad43488c0 1 < completed multipart upload key=9Z2EHQA8T5F4 upload=WJAPXMMUDXJ5 tag=LCN3UHAUOLJH type=write size=1725779 2024-09-12T17:36:49.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.604+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~W9EEKXK1YIIK.0 size=1048576 2024-09-12T17:36:49.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.608+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~W9EEKXK1YIIK.1 size=135773 2024-09-12T17:36:49.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.608+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=W9EEKXK1YIIK tag=0EHO4N6V7ET3 type=write size=2232925 2024-09-12T17:36:49.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.612+0000 7f1ad43488c0 1 < canceled operation key=Y3NQLDWQJ37Z tag=XA3UX2FGKF2H type=del size=3950777 2024-09-12T17:36:49.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.612+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=F9KGOYVMH2TH type=del size=2848085 2024-09-12T17:36:49.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.616+0000 7f1ad43488c0 1 < suggested remove operation key=CHMM14VRIOQH tag=UJA7NQW82ZMV type=del 2024-09-12T17:36:49.621 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.620+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=WX02FQXNGEQZ type=del size=3748053 2024-09-12T17:36:49.624 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.624+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=NHCFQ9PCF902 type=del 2024-09-12T17:36:49.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.628+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~YZLZKWDET7IY.0 size=1048576 2024-09-12T17:36:49.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.628+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~YZLZKWDET7IY.1 size=566389 2024-09-12T17:36:49.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.628+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=YZLZKWDET7IY tag=LA2TRGWDWRAQ type=write size=2663541 2024-09-12T17:36:49.635 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.636+0000 7f1ad43488c0 1 < suggested remove operation key=2SDYAQRNWAJK tag=RYQX2ZGW9M1Z type=del 2024-09-12T17:36:49.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.640+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~UNY2TN34TWAW.0 size=982988 2024-09-12T17:36:49.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.640+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=UNY2TN34TWAW tag=NPPHON8DNXMF type=write size=2031564 2024-09-12T17:36:49.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.640+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~1W7EEUNV6J8T.0 size=1048576 2024-09-12T17:36:49.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.644+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~1W7EEUNV6J8T.1 size=1012841 2024-09-12T17:36:49.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.648+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=1W7EEUNV6J8T tag=L9KP713J9TRL type=write size=3109993 2024-09-12T17:36:49.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.652+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=SABL1XSM9THP type=del size=727839 2024-09-12T17:36:49.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.656+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~H2BF0F6XOG8E.0 size=1048576 2024-09-12T17:36:49.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.656+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~H2BF0F6XOG8E.1 size=482749 2024-09-12T17:36:49.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.660+0000 7f1ad43488c0 1 < completed multipart upload key=GWJ78NNXOL1R upload=H2BF0F6XOG8E tag=2TBMPBXFSQY2 type=write size=2579901 2024-09-12T17:36:49.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.664+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=F56THWE4MPKQ type=del size=3357382 2024-09-12T17:36:49.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.664+0000 7f1ad43488c0 1 < canceled part key=_multipart_8U3L46JDJ8VS.2~OC5ALMCYC9FE.0 size=163647 2024-09-12T17:36:49.671 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.672+0000 7f1ad43488c0 1 < canceled multipart upload key=8U3L46JDJ8VS upload=OC5ALMCYC9FE tag=PC2CTFZJC3Q1 type=write size=1212223 2024-09-12T17:36:49.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.676+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~I97SDPTSH755.0 size=967133 2024-09-12T17:36:49.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.676+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=I97SDPTSH755 tag=IUGBHLTTSU9G type=write size=2015709 2024-09-12T17:36:49.679 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.680+0000 7f1ad43488c0 1 < completed delete operation key=X0HT3K3OREL7 tag=P8R2HRNVV04U type=del 2024-09-12T17:36:49.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.680+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=VBCDIUM4X0UB type=write size=25256 2024-09-12T17:36:49.685 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.684+0000 7f1ad43488c0 1 < canceled operation key=XOEPYERWY6IT tag=VE4B68IDIRBA type=del size=714704 2024-09-12T17:36:49.693 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.692+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~A92JTODLOZRU.0 size=1048576 2024-09-12T17:36:49.695 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.696+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~A92JTODLOZRU.1 size=1048576 2024-09-12T17:36:49.697 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.696+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~A92JTODLOZRU.2 size=741028 2024-09-12T17:36:49.697 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.696+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=A92JTODLOZRU tag=RP76559S3Y1A type=write size=3886756 2024-09-12T17:36:49.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.700+0000 7f1ad43488c0 1 < suggested remove operation key=C7QSOK3D3IWJ tag=Y0LX19C7G18O type=del 2024-09-12T17:36:49.705 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.704+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=M22S3HOOPVT9 type=del size=3085556 2024-09-12T17:36:49.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.708+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~FRQGL13UEBFY.0 size=1048576 2024-09-12T17:36:49.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.708+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~FRQGL13UEBFY.1 size=454556 2024-09-12T17:36:49.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.712+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=FRQGL13UEBFY tag=EW1HN1ADIO8Z type=write size=2551708 2024-09-12T17:36:49.717 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.716+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=MUOBOZY1BJ0U type=del size=543188 2024-09-12T17:36:49.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.720+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~R036KBIQGNMM.0 size=1048576 2024-09-12T17:36:49.722 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.720+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~R036KBIQGNMM.1 size=1048576 2024-09-12T17:36:49.724 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.724+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~R036KBIQGNMM.2 size=325835 2024-09-12T17:36:49.729 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.728+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=R036KBIQGNMM tag=8RFHAP1UOA9R type=write size=3471563 2024-09-12T17:36:49.733 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.732+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=XBMQCK2WKUA6 type=write size=549600 2024-09-12T17:36:49.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.736+0000 7f1ad43488c0 1 < completed delete operation key=GWJ78NNXOL1R tag=X53U2NB9IGSC type=del 2024-09-12T17:36:49.738 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.736+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=4I88YU41VHNT type=del size=158312 2024-09-12T17:36:49.740 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.740+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~9P02BOPXPNGD.0 size=1048576 2024-09-12T17:36:49.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.740+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~9P02BOPXPNGD.1 size=1048576 2024-09-12T17:36:49.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.744+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~9P02BOPXPNGD.2 size=236417 2024-09-12T17:36:49.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.748+0000 7f1ad43488c0 1 < completed multipart upload key=IY2AM7CJDUZG upload=9P02BOPXPNGD tag=CVEIETCJ5P2D type=write size=3382145 2024-09-12T17:36:49.754 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.752+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~NZHLGF1FV01S.0 size=1048576 2024-09-12T17:36:49.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.756+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~NZHLGF1FV01S.1 size=977870 2024-09-12T17:36:49.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.756+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=NZHLGF1FV01S tag=DWUNJVB5FROA type=write size=3075022 2024-09-12T17:36:49.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.756+0000 7f1ad43488c0 1 < completed delete operation key=SDJ53NSPOIRC tag=J313Z9B7ADOK type=del 2024-09-12T17:36:49.762 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.760+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=104GTN07JJ44 type=del size=526313 2024-09-12T17:36:49.764 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.764+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~W9EEKXK1YIIK.0 size=1048576 2024-09-12T17:36:49.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.764+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~W9EEKXK1YIIK.1 size=135773 2024-09-12T17:36:49.770 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.768+0000 7f1ad43488c0 1 < completed multipart upload key=7RSHIZRKK2OY upload=W9EEKXK1YIIK tag=0EHO4N6V7ET3 type=write size=2232925 2024-09-12T17:36:49.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.772+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=ZCMZTJBFM9YG type=del size=1350538 2024-09-12T17:36:49.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.776+0000 7f1ad43488c0 1 < suggested update operation key=4QO60GZ9V0GK tag=F9KGOYVMH2TH type=del size=2848085 2024-09-12T17:36:49.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.780+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=WYKZ32875315 type=write size=814843 2024-09-12T17:36:49.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.784+0000 7f1ad43488c0 1 < completed delete operation key=GWJ78NNXOL1R tag=WX02FQXNGEQZ type=del 2024-09-12T17:36:49.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.784+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=CV5EL5H0F2FB type=del size=1449625 2024-09-12T17:36:49.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.788+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~YZLZKWDET7IY.0 size=1048576 2024-09-12T17:36:49.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.788+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~YZLZKWDET7IY.1 size=566389 2024-09-12T17:36:49.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.792+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=YZLZKWDET7IY tag=LA2TRGWDWRAQ type=write size=2663541 2024-09-12T17:36:49.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.796+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=4R084U61ZQK4 type=del size=789342 2024-09-12T17:36:49.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.796+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~UNY2TN34TWAW.0 size=982988 2024-09-12T17:36:49.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.800+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=UNY2TN34TWAW tag=NPPHON8DNXMF type=write size=2031564 2024-09-12T17:36:49.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.804+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=DHSSH0HY8VRE type=del size=3202158 2024-09-12T17:36:49.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.808+0000 7f1ad43488c0 1 < completed delete operation key=NHOG1WG3VT6N tag=SABL1XSM9THP type=del 2024-09-12T17:36:49.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.808+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=LUYJBMQVBT7R type=del size=3428413 2024-09-12T17:36:49.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.812+0000 7f1ad43488c0 1 < suggested update operation key=WWB6LAHAMIR9 tag=F56THWE4MPKQ type=del size=3357382 2024-09-12T17:36:49.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.816+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=A1MJWBPC0CE3 type=write size=957191 2024-09-12T17:36:49.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.816+0000 7f1ad43488c0 1 < canceled part key=_multipart_6Z3F28JHHEQS.2~I97SDPTSH755.0 size=967133 2024-09-12T17:36:49.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.820+0000 7f1ad43488c0 1 < canceled multipart upload key=6Z3F28JHHEQS upload=I97SDPTSH755 tag=IUGBHLTTSU9G type=write size=2015709 2024-09-12T17:36:49.824 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.824+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=UBKC9KSU3FTB type=del size=2938209 2024-09-12T17:36:49.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.824+0000 7f1ad43488c0 1 < completed write operation key=NHOG1WG3VT6N tag=VBCDIUM4X0UB type=write size=25256 2024-09-12T17:36:49.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.828+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=4BWJWYGT9E8J type=del size=2330945 2024-09-12T17:36:49.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.828+0000 7f1ad43488c0 1 < canceled part key=_multipart_RXJJOPR32OD5.2~A92JTODLOZRU.0 size=1048576 2024-09-12T17:36:49.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.832+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~A92JTODLOZRU.1 size=1048576 2024-09-12T17:36:49.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.832+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~A92JTODLOZRU.2 size=741028 2024-09-12T17:36:49.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.840+0000 7f1ad43488c0 1 < canceled multipart upload key=RXJJOPR32OD5 upload=A92JTODLOZRU tag=RP76559S3Y1A type=write size=3886756 2024-09-12T17:36:49.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.844+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~YLSX7LONLQHD.0 size=1048576 2024-09-12T17:36:49.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.844+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~YLSX7LONLQHD.1 size=1048576 2024-09-12T17:36:49.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.848+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~YLSX7LONLQHD.2 size=519179 2024-09-12T17:36:49.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.848+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=YLSX7LONLQHD tag=LCBXPGK7ZRUB type=write size=3664907 2024-09-12T17:36:49.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.848+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=M22S3HOOPVT9 type=del 2024-09-12T17:36:49.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.852+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~0US1M6TGPYM2.0 size=580014 2024-09-12T17:36:49.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.852+0000 7f1ad43488c0 1 > prepared multipart upload key=C7QSOK3D3IWJ upload=0US1M6TGPYM2 tag=PYX6ROPZC32V type=write size=1628590 2024-09-12T17:36:49.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.860+0000 7f1ad43488c0 1 < suggested update operation key=SDJ53NSPOIRC tag=MUOBOZY1BJ0U type=del size=543188 2024-09-12T17:36:49.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.860+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=CAD3ZP2ZS1U7 type=del size=3130005 2024-09-12T17:36:49.864 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.864+0000 7f1ad43488c0 1 < completed write operation key=GZ7LGZQHW4CY tag=XBMQCK2WKUA6 type=write size=549600 2024-09-12T17:36:49.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.868+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~8JSBZAKYZ6TL.0 size=1048576 2024-09-12T17:36:49.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.868+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~8JSBZAKYZ6TL.1 size=205065 2024-09-12T17:36:49.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.868+0000 7f1ad43488c0 1 > prepared multipart upload key=3N1YT9TC0M3O upload=8JSBZAKYZ6TL tag=A96QBJ1O1PYC type=write size=2302217 2024-09-12T17:36:49.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.876+0000 7f1ad43488c0 1 < suggested update operation key=8U3L46JDJ8VS tag=4I88YU41VHNT type=del size=158312 2024-09-12T17:36:49.878 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.876+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=VF8EHRRS2DNZ type=write size=792506 2024-09-12T17:36:49.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.880+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~NZHLGF1FV01S.0 size=1048576 2024-09-12T17:36:49.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.880+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~NZHLGF1FV01S.1 size=977870 2024-09-12T17:36:49.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.888+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=NZHLGF1FV01S tag=DWUNJVB5FROA type=write size=3075022 2024-09-12T17:36:49.890 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.888+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=LDC6NSKQ2UF7 type=del size=2280279 2024-09-12T17:36:49.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.892+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=104GTN07JJ44 type=del 2024-09-12T17:36:49.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.896+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=0K05M9X6UN93 type=del size=497910 2024-09-12T17:36:49.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.900+0000 7f1ad43488c0 1 < suggested remove operation key=05PAFB226IFP tag=ZCMZTJBFM9YG type=del 2024-09-12T17:36:49.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.904+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~9DL4IKGVXQLS.0 size=1048576 2024-09-12T17:36:49.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.908+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~9DL4IKGVXQLS.1 size=573632 2024-09-12T17:36:49.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.908+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=9DL4IKGVXQLS tag=M65AQLRVV73S type=write size=2670784 2024-09-12T17:36:49.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.912+0000 7f1ad43488c0 1 < suggested update operation key=6Z3F28JHHEQS tag=WYKZ32875315 type=write size=814843 2024-09-12T17:36:49.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.916+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~7GTJGZ53MURC.0 size=1048576 2024-09-12T17:36:49.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.920+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~7GTJGZ53MURC.1 size=1048576 2024-09-12T17:36:49.922 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.920+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~7GTJGZ53MURC.2 size=507503 2024-09-12T17:36:49.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.920+0000 7f1ad43488c0 1 > prepared multipart upload key=GWJ78NNXOL1R upload=7GTJGZ53MURC tag=4M60NPWKIPDL type=write size=3653231 2024-09-12T17:36:49.928 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.928+0000 7f1ad43488c0 1 < suggested remove operation key=MB3FVGKV0ZNQ tag=CV5EL5H0F2FB type=del 2024-09-12T17:36:49.933 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.932+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=FH49T17N6XAQ type=del size=2079065 2024-09-12T17:36:49.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.936+0000 7f1ad43488c0 -1 < failed to complete operation key=8U3L46JDJ8VS tag=4R084U61ZQK4 type=del size=789342: (22) Invalid argument 2024-09-12T17:36:49.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.940+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~H1IWVIR4PCD4.0 size=1048576 2024-09-12T17:36:49.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.944+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~H1IWVIR4PCD4.1 size=637059 2024-09-12T17:36:49.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.944+0000 7f1ad43488c0 1 > prepared multipart upload key=NHOG1WG3VT6N upload=H1IWVIR4PCD4 tag=D9KPZDL3FRV6 type=write size=2734211 2024-09-12T17:36:49.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.944+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=DHSSH0HY8VRE type=del 2024-09-12T17:36:49.952 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.952+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~B7TCEBIU1014.0 size=1048576 2024-09-12T17:36:49.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.952+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~B7TCEBIU1014.1 size=1048576 2024-09-12T17:36:49.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.956+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~B7TCEBIU1014.2 size=249377 2024-09-12T17:36:49.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.956+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=B7TCEBIU1014 tag=6MXOAOJLVUBK type=write size=3395105 2024-09-12T17:36:49.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.960+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=LUYJBMQVBT7R type=del 2024-09-12T17:36:49.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.960+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=7E9O92P7277L type=write size=585370 2024-09-12T17:36:49.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.964+0000 7f1ad43488c0 1 < canceled operation key=ZHFRKX9YY8P5 tag=A1MJWBPC0CE3 type=write size=957191 2024-09-12T17:36:49.967 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.968+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=PRXIYU6FFGQH type=del size=2655273 2024-09-12T17:36:49.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.972+0000 7f1ad43488c0 1 < suggested update operation key=7RSHIZRKK2OY tag=UBKC9KSU3FTB type=del size=2938209 2024-09-12T17:36:49.975 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.976+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=B4WUGQMAEBEX type=write size=813796 2024-09-12T17:36:49.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.976+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=4BWJWYGT9E8J type=del 2024-09-12T17:36:49.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.980+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=23ATU47CYBQH type=del size=4101138 2024-09-12T17:36:49.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.984+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~YLSX7LONLQHD.0 size=1048576 2024-09-12T17:36:49.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.984+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~YLSX7LONLQHD.1 size=1048576 2024-09-12T17:36:49.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.988+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~YLSX7LONLQHD.2 size=519179 2024-09-12T17:36:49.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.992+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=YLSX7LONLQHD tag=LCBXPGK7ZRUB type=write size=3664907 2024-09-12T17:36:49.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:49.996+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~H0GP83DSW9QG.0 size=1048576 2024-09-12T17:36:49.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.000+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~H0GP83DSW9QG.1 size=1048576 2024-09-12T17:36:50.002 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.000+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~H0GP83DSW9QG.2 size=686857 2024-09-12T17:36:50.002 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.000+0000 7f1ad43488c0 1 > prepared multipart upload key=9Z2EHQA8T5F4 upload=H0GP83DSW9QG tag=3062FOIOZ036 type=write size=3832585 2024-09-12T17:36:50.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.004+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~0US1M6TGPYM2.0 size=580014 2024-09-12T17:36:50.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.008+0000 7f1ad43488c0 1 < completed multipart upload key=C7QSOK3D3IWJ upload=0US1M6TGPYM2 tag=PYX6ROPZC32V type=write size=1628590 2024-09-12T17:36:50.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.012+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=EZYQB1NS3OUD type=del size=139593 2024-09-12T17:36:50.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.016+0000 7f1ad43488c0 1 < suggested remove operation key=X078SB1ITNII tag=CAD3ZP2ZS1U7 type=del 2024-09-12T17:36:50.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.020+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=O2EZLG5DOF5N type=del size=2018623 2024-09-12T17:36:50.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.020+0000 7f1ad43488c0 1 < canceled part key=_multipart_3N1YT9TC0M3O.2~8JSBZAKYZ6TL.0 size=1048576 2024-09-12T17:36:50.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.024+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~8JSBZAKYZ6TL.1 size=205065 2024-09-12T17:36:50.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.028+0000 7f1ad43488c0 1 < canceled multipart upload key=3N1YT9TC0M3O upload=8JSBZAKYZ6TL tag=A96QBJ1O1PYC type=write size=2302217 2024-09-12T17:36:50.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.032+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~GGYLX1FLINDI.0 size=472129 2024-09-12T17:36:50.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.032+0000 7f1ad43488c0 1 > prepared multipart upload key=C7QSOK3D3IWJ upload=GGYLX1FLINDI tag=QX9F3QBFPXDQ type=write size=1520705 2024-09-12T17:36:50.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.036+0000 7f1ad43488c0 1 < completed write operation key=9Z2EHQA8T5F4 tag=VF8EHRRS2DNZ type=write size=792506 2024-09-12T17:36:50.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.036+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=P8E0QWPPXNR2 type=del size=3680636 2024-09-12T17:36:50.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.040+0000 7f1ad43488c0 -1 < failed to complete operation key=MB3FVGKV0ZNQ tag=LDC6NSKQ2UF7 type=del size=2280279: (22) Invalid argument 2024-09-12T17:36:50.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.044+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~3X1GPCFCMFZR.0 size=1048576 2024-09-12T17:36:50.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.048+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~3X1GPCFCMFZR.1 size=571952 2024-09-12T17:36:50.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.048+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=3X1GPCFCMFZR tag=4LF1QVMKJ6K8 type=write size=2669104 2024-09-12T17:36:50.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.048+0000 7f1ad43488c0 -1 < failed to complete operation key=05PAFB226IFP tag=0K05M9X6UN93 type=del size=497910: (22) Invalid argument 2024-09-12T17:36:50.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.052+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=XUTCHHLFVWW0 type=write size=137966 2024-09-12T17:36:50.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.052+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~9DL4IKGVXQLS.0 size=1048576 2024-09-12T17:36:50.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.052+0000 7f1ad43488c0 1 < canceled part key=_multipart_4QO60GZ9V0GK.2~9DL4IKGVXQLS.1 size=573632 2024-09-12T17:36:50.059 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.060+0000 7f1ad43488c0 1 < canceled multipart upload key=4QO60GZ9V0GK upload=9DL4IKGVXQLS tag=M65AQLRVV73S type=write size=2670784 2024-09-12T17:36:50.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.060+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=GUSK5ECFB74Z type=write size=743934 2024-09-12T17:36:50.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.064+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~7GTJGZ53MURC.0 size=1048576 2024-09-12T17:36:50.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.064+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~7GTJGZ53MURC.1 size=1048576 2024-09-12T17:36:50.069 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.068+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~7GTJGZ53MURC.2 size=507503 2024-09-12T17:36:50.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.072+0000 7f1ad43488c0 1 < completed multipart upload key=GWJ78NNXOL1R upload=7GTJGZ53MURC tag=4M60NPWKIPDL type=write size=3653231 2024-09-12T17:36:50.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.076+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=R5PKDFA5F48H type=write size=534711 2024-09-12T17:36:50.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.076+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=FH49T17N6XAQ type=del 2024-09-12T17:36:50.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.080+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=Y326BO1WHM7J type=del size=720580 2024-09-12T17:36:50.082 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.080+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~H1IWVIR4PCD4.0 size=1048576 2024-09-12T17:36:50.085 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.084+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~H1IWVIR4PCD4.1 size=637059 2024-09-12T17:36:50.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.088+0000 7f1ad43488c0 1 < completed multipart upload key=NHOG1WG3VT6N upload=H1IWVIR4PCD4 tag=D9KPZDL3FRV6 type=write size=2734211 2024-09-12T17:36:50.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.092+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=5URK6URCV5XS type=del size=1596417 2024-09-12T17:36:50.095 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.092+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~B7TCEBIU1014.0 size=1048576 2024-09-12T17:36:50.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.096+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~B7TCEBIU1014.1 size=1048576 2024-09-12T17:36:50.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.100+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~B7TCEBIU1014.2 size=249377 2024-09-12T17:36:50.103 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.100+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=B7TCEBIU1014 tag=6MXOAOJLVUBK type=write size=3395105 2024-09-12T17:36:50.105 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.104+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=V4V9MXCCC1RG type=del size=1616532 2024-09-12T17:36:50.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.108+0000 7f1ad43488c0 1 < completed write operation key=RH4HYE315U5Y tag=7E9O92P7277L type=write size=585370 2024-09-12T17:36:50.110 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.108+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=MHGZSBZXUQ1C type=write size=825829 2024-09-12T17:36:50.112 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.112+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=PRXIYU6FFGQH type=del 2024-09-12T17:36:50.114 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.112+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=0CVEZDM8JU0X type=del size=2735326 2024-09-12T17:36:50.116 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.116+0000 7f1ad43488c0 1 < completed write operation key=7RSHIZRKK2OY tag=B4WUGQMAEBEX type=write size=813796 2024-09-12T17:36:50.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.116+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=9FILHHW9WCG9 type=del size=1953480 2024-09-12T17:36:50.121 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.120+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=23ATU47CYBQH type=del 2024-09-12T17:36:50.123 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.124+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=SQ5ID4C77CEQ type=write size=387309 2024-09-12T17:36:50.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.124+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~H0GP83DSW9QG.0 size=1048576 2024-09-12T17:36:50.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.124+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~H0GP83DSW9QG.1 size=1048576 2024-09-12T17:36:50.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.128+0000 7f1ad43488c0 1 < canceled part key=_multipart_9Z2EHQA8T5F4.2~H0GP83DSW9QG.2 size=686857 2024-09-12T17:36:50.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.128+0000 7f1ad43488c0 1 < canceled multipart upload key=9Z2EHQA8T5F4 upload=H0GP83DSW9QG tag=3062FOIOZ036 type=write size=3832585 2024-09-12T17:36:50.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.132+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=UA7L7MV9C08K type=del size=3888526 2024-09-12T17:36:50.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.136+0000 7f1ad43488c0 1 < suggested remove operation key=C7QSOK3D3IWJ tag=EZYQB1NS3OUD type=del 2024-09-12T17:36:50.140 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.140+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=VS3ZL3R70FGU type=del size=2360931 2024-09-12T17:36:50.142 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.140+0000 7f1ad43488c0 1 < canceled operation key=4QO60GZ9V0GK tag=O2EZLG5DOF5N type=del size=2018623 2024-09-12T17:36:50.144 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.144+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=JIJG1COXNVMC type=del size=3658091 2024-09-12T17:36:50.146 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.144+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~GGYLX1FLINDI.0 size=472129 2024-09-12T17:36:50.150 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.148+0000 7f1ad43488c0 1 < completed multipart upload key=C7QSOK3D3IWJ upload=GGYLX1FLINDI tag=QX9F3QBFPXDQ type=write size=1520705 2024-09-12T17:36:50.152 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.152+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=UO2CPFYIXPY7 type=del size=413050 2024-09-12T17:36:50.155 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.152+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=P8E0QWPPXNR2 type=del 2024-09-12T17:36:50.157 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.156+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=7XTBIWJY7O21 type=del size=3164368 2024-09-12T17:36:50.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.160+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~3X1GPCFCMFZR.0 size=1048576 2024-09-12T17:36:50.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.160+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~3X1GPCFCMFZR.1 size=571952 2024-09-12T17:36:50.165 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.164+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=3X1GPCFCMFZR tag=4LF1QVMKJ6K8 type=write size=2669104 2024-09-12T17:36:50.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.168+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=2JVF9KMLRL2W type=del size=1806685 2024-09-12T17:36:50.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.172+0000 7f1ad43488c0 1 < completed write operation key=SDJ53NSPOIRC tag=XUTCHHLFVWW0 type=write size=137966 2024-09-12T17:36:50.173 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.172+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=Q2KST4FK076O type=write size=309268 2024-09-12T17:36:50.175 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.176+0000 7f1ad43488c0 1 < completed write operation key=GZ7LGZQHW4CY tag=GUSK5ECFB74Z type=write size=743934 2024-09-12T17:36:50.178 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.176+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~45LN2SVDVHIR.0 size=1048576 2024-09-12T17:36:50.180 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.180+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~45LN2SVDVHIR.1 size=555780 2024-09-12T17:36:50.180 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.180+0000 7f1ad43488c0 1 > prepared multipart upload key=SIZ0Z1KWTGUJ upload=45LN2SVDVHIR tag=5W9RR0KQFX67 type=write size=2652932 2024-09-12T17:36:50.182 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.180+0000 7f1ad43488c0 1 < completed write operation key=ZHFRKX9YY8P5 tag=R5PKDFA5F48H type=write size=534711 2024-09-12T17:36:50.184 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.184+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=QQ7U7ETFN97T type=del size=614972 2024-09-12T17:36:50.186 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.184+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=Y326BO1WHM7J type=del 2024-09-12T17:36:50.188 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.188+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=D1IDCKL61YAS type=del size=2671194 2024-09-12T17:36:50.190 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.188+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=5URK6URCV5XS type=del 2024-09-12T17:36:50.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.192+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=CD0PPE17DYE4 type=write size=653783 2024-09-12T17:36:50.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.192+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=V4V9MXCCC1RG type=del 2024-09-12T17:36:50.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.196+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~BU465PUZPIBE.0 size=1048576 2024-09-12T17:36:50.200 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.200+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~BU465PUZPIBE.1 size=1048576 2024-09-12T17:36:50.201 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.200+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~BU465PUZPIBE.2 size=523858 2024-09-12T17:36:50.201 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.200+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=BU465PUZPIBE tag=J8V5JCNB54K3 type=write size=3669586 2024-09-12T17:36:50.203 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.204+0000 7f1ad43488c0 1 < completed write operation key=IY2AM7CJDUZG tag=MHGZSBZXUQ1C type=write size=825829 2024-09-12T17:36:50.205 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.204+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=5YUNQW9FP9WP type=del size=2128505 2024-09-12T17:36:50.208 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.208+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=0CVEZDM8JU0X type=del 2024-09-12T17:36:50.212 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.212+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~4ROVSLVFK4RY.0 size=1048576 2024-09-12T17:36:50.213 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.212+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~4ROVSLVFK4RY.1 size=1048576 2024-09-12T17:36:50.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.216+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~4ROVSLVFK4RY.2 size=381146 2024-09-12T17:36:50.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.216+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=4ROVSLVFK4RY tag=Z681C3J8LD3W type=write size=3526874 2024-09-12T17:36:50.218 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.216+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=9FILHHW9WCG9 type=del 2024-09-12T17:36:50.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.220+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=KBTFR67SZP3Q type=write size=985074 2024-09-12T17:36:50.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.224+0000 7f1ad43488c0 1 < completed write operation key=SIZ0Z1KWTGUJ tag=SQ5ID4C77CEQ type=write size=387309 2024-09-12T17:36:50.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.224+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=L1XZJUYZOQJ9 type=del size=2995172 2024-09-12T17:36:50.228 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.228+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=UA7L7MV9C08K type=del 2024-09-12T17:36:50.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.232+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~TBYLGKEVQ2J3.0 size=1048576 2024-09-12T17:36:50.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.232+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~TBYLGKEVQ2J3.1 size=1048576 2024-09-12T17:36:50.236 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.236+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~TBYLGKEVQ2J3.2 size=429991 2024-09-12T17:36:50.236 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.236+0000 7f1ad43488c0 1 > prepared multipart upload key=Y3NQLDWQJ37Z upload=TBYLGKEVQ2J3 tag=LWIRZDD2C331 type=write size=3575719 2024-09-12T17:36:50.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.240+0000 7f1ad43488c0 1 < suggested remove operation key=0MV3GCBTWZD0 tag=VS3ZL3R70FGU type=del 2024-09-12T17:36:50.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.244+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~IL507TNSZI5S.0 size=1048576 2024-09-12T17:36:50.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.244+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~IL507TNSZI5S.1 size=783563 2024-09-12T17:36:50.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.244+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=IL507TNSZI5S tag=D6I76Z3CDJCK type=write size=2880715 2024-09-12T17:36:50.247 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.248+0000 7f1ad43488c0 1 < completed delete operation key=C7QSOK3D3IWJ tag=JIJG1COXNVMC type=del 2024-09-12T17:36:50.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.248+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~LK3ZSUBDZRSO.0 size=323706 2024-09-12T17:36:50.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.248+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=LK3ZSUBDZRSO tag=445EHQADFOCZ type=write size=1372282 2024-09-12T17:36:50.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.252+0000 7f1ad43488c0 1 < suggested update operation key=WFEJLVRCKIUU tag=UO2CPFYIXPY7 type=del size=413050 2024-09-12T17:36:50.257 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.256+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=6ZG9E8403AZL type=del size=152921 2024-09-12T17:36:50.259 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.260+0000 7f1ad43488c0 1 < completed delete operation key=XOEPYERWY6IT tag=7XTBIWJY7O21 type=del 2024-09-12T17:36:50.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.260+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=4MQTN9IJOG5B type=write size=544815 2024-09-12T17:36:50.264 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.264+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=2JVF9KMLRL2W type=del 2024-09-12T17:36:50.268 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.268+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~8S43885V0437.0 size=1048576 2024-09-12T17:36:50.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.268+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~8S43885V0437.1 size=396773 2024-09-12T17:36:50.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.268+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=8S43885V0437 tag=MZ2LVYMGW4B3 type=write size=2493925 2024-09-12T17:36:50.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.272+0000 7f1ad43488c0 1 < completed write operation key=8U3L46JDJ8VS tag=Q2KST4FK076O type=write size=309268 2024-09-12T17:36:50.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.276+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~DFP2LI23X6H9.0 size=1048576 2024-09-12T17:36:50.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.276+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~DFP2LI23X6H9.1 size=595089 2024-09-12T17:36:50.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.276+0000 7f1ad43488c0 1 > prepared multipart upload key=9Z2EHQA8T5F4 upload=DFP2LI23X6H9 tag=RF9FEO6MG9GV type=write size=2692241 2024-09-12T17:36:50.278 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.276+0000 7f1ad43488c0 1 < canceled part key=_multipart_SIZ0Z1KWTGUJ.2~45LN2SVDVHIR.0 size=1048576 2024-09-12T17:36:50.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.280+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~45LN2SVDVHIR.1 size=555780 2024-09-12T17:36:50.283 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.284+0000 7f1ad43488c0 1 < canceled multipart upload key=SIZ0Z1KWTGUJ upload=45LN2SVDVHIR tag=5W9RR0KQFX67 type=write size=2652932 2024-09-12T17:36:50.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.288+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~R128D0K6ZO1W.0 size=1014855 2024-09-12T17:36:50.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.288+0000 7f1ad43488c0 1 > prepared multipart upload key=CHMM14VRIOQH upload=R128D0K6ZO1W tag=LR96CTZ0IXEA type=write size=2063431 2024-09-12T17:36:50.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.292+0000 7f1ad43488c0 1 < suggested remove operation key=X0HT3K3OREL7 tag=QQ7U7ETFN97T type=del 2024-09-12T17:36:50.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.292+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=WE1XIM24L1V8 type=del size=705093 2024-09-12T17:36:50.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.296+0000 7f1ad43488c0 1 < completed delete operation key=05PAFB226IFP tag=D1IDCKL61YAS type=del 2024-09-12T17:36:50.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.296+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=6ZQHKVM56OA2 type=write size=373688 2024-09-12T17:36:50.301 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.300+0000 7f1ad43488c0 1 < completed write operation key=IY2AM7CJDUZG tag=CD0PPE17DYE4 type=write size=653783 2024-09-12T17:36:50.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.304+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=54A60OPN8ZFG type=del size=61646 2024-09-12T17:36:50.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.304+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~BU465PUZPIBE.0 size=1048576 2024-09-12T17:36:50.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.308+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~BU465PUZPIBE.1 size=1048576 2024-09-12T17:36:50.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.308+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~BU465PUZPIBE.2 size=523858 2024-09-12T17:36:50.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.312+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=BU465PUZPIBE tag=J8V5JCNB54K3 type=write size=3669586 2024-09-12T17:36:50.318 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.316+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~2V8MHL9D95UT.0 size=572522 2024-09-12T17:36:50.318 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.316+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=2V8MHL9D95UT tag=PTJZOGL82I5I type=write size=1621098 2024-09-12T17:36:50.323 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.320+0000 7f1ad43488c0 1 < suggested remove operation key=ZHFRKX9YY8P5 tag=5YUNQW9FP9WP type=del 2024-09-12T17:36:50.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.324+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=R9A2XNVFZCTN type=del size=313229 2024-09-12T17:36:50.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.328+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~4ROVSLVFK4RY.0 size=1048576 2024-09-12T17:36:50.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.328+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~4ROVSLVFK4RY.1 size=1048576 2024-09-12T17:36:50.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.332+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~4ROVSLVFK4RY.2 size=381146 2024-09-12T17:36:50.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.332+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=4ROVSLVFK4RY tag=Z681C3J8LD3W type=write size=3526874 2024-09-12T17:36:50.337 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.336+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=63WO4BLTBNK1 type=del size=703452 2024-09-12T17:36:50.342 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.340+0000 7f1ad43488c0 1 < suggested remove operation key=4QO60GZ9V0GK tag=KBTFR67SZP3Q type=write 2024-09-12T17:36:50.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.348+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~33OU0W9649WB.0 size=1048576 2024-09-12T17:36:50.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.348+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~33OU0W9649WB.1 size=706711 2024-09-12T17:36:50.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.348+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=33OU0W9649WB tag=3WOJACSJRSU9 type=write size=2803863 2024-09-12T17:36:50.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.352+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=L1XZJUYZOQJ9 type=del 2024-09-12T17:36:50.356 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.356+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~8CWMG6GXG01C.0 size=1048576 2024-09-12T17:36:50.358 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.356+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~8CWMG6GXG01C.1 size=252039 2024-09-12T17:36:50.358 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.356+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=8CWMG6GXG01C tag=NAIVNST6K2F4 type=write size=2349191 2024-09-12T17:36:50.358 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.356+0000 7f1ad43488c0 1 < canceled part key=_multipart_Y3NQLDWQJ37Z.2~TBYLGKEVQ2J3.0 size=1048576 2024-09-12T17:36:50.360 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.360+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~TBYLGKEVQ2J3.1 size=1048576 2024-09-12T17:36:50.362 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.360+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~TBYLGKEVQ2J3.2 size=429991 2024-09-12T17:36:50.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.364+0000 7f1ad43488c0 1 < canceled multipart upload key=Y3NQLDWQJ37Z upload=TBYLGKEVQ2J3 tag=LWIRZDD2C331 type=write size=3575719 2024-09-12T17:36:50.369 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.368+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=9QVJ5YHAV20E type=del size=3067191 2024-09-12T17:36:50.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.372+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~IL507TNSZI5S.0 size=1048576 2024-09-12T17:36:50.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.372+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~IL507TNSZI5S.1 size=783563 2024-09-12T17:36:50.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.376+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=IL507TNSZI5S tag=D6I76Z3CDJCK type=write size=2880715 2024-09-12T17:36:50.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.384+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~ZCDFO9CBZY14.0 size=1048576 2024-09-12T17:36:50.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.384+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~ZCDFO9CBZY14.1 size=1048576 2024-09-12T17:36:50.387 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.388+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~ZCDFO9CBZY14.2 size=871003 2024-09-12T17:36:50.387 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.388+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=ZCDFO9CBZY14 tag=AX3CJ86R7ACU type=write size=4016731 2024-09-12T17:36:50.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.388+0000 7f1ad43488c0 1 < canceled part key=_multipart_X078SB1ITNII.2~LK3ZSUBDZRSO.0 size=323706 2024-09-12T17:36:50.391 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.392+0000 7f1ad43488c0 1 < canceled multipart upload key=X078SB1ITNII upload=LK3ZSUBDZRSO tag=445EHQADFOCZ type=write size=1372282 2024-09-12T17:36:50.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.392+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=MAMIDH92LB80 type=del size=2460971 2024-09-12T17:36:50.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.396+0000 7f1ad43488c0 1 < canceled operation key=9Z2EHQA8T5F4 tag=6ZG9E8403AZL type=del size=152921 2024-09-12T17:36:50.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.396+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=B2IVD8VJMR1W type=write size=600377 2024-09-12T17:36:50.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.400+0000 7f1ad43488c0 1 < canceled operation key=XOEPYERWY6IT tag=4MQTN9IJOG5B type=write size=544815 2024-09-12T17:36:50.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.404+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~0S7ZA5R08AGB.0 size=1048576 2024-09-12T17:36:50.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.408+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~0S7ZA5R08AGB.1 size=446463 2024-09-12T17:36:50.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.408+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=0S7ZA5R08AGB tag=KELVSILNBOSS type=write size=2543615 2024-09-12T17:36:50.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.408+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~8S43885V0437.0 size=1048576 2024-09-12T17:36:50.412 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.412+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~8S43885V0437.1 size=396773 2024-09-12T17:36:50.415 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.416+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=8S43885V0437 tag=MZ2LVYMGW4B3 type=write size=2493925 2024-09-12T17:36:50.417 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.416+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=K46EKFOJBX4Y type=del size=2287514 2024-09-12T17:36:50.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.420+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~DFP2LI23X6H9.0 size=1048576 2024-09-12T17:36:50.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.420+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~DFP2LI23X6H9.1 size=595089 2024-09-12T17:36:50.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.424+0000 7f1ad43488c0 1 < completed multipart upload key=9Z2EHQA8T5F4 upload=DFP2LI23X6H9 tag=RF9FEO6MG9GV type=write size=2692241 2024-09-12T17:36:50.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.428+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~DXGDZA0NFY2N.0 size=845228 2024-09-12T17:36:50.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.428+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=DXGDZA0NFY2N tag=LKHYGP57WD45 type=write size=1893804 2024-09-12T17:36:50.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.432+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~R128D0K6ZO1W.0 size=1014855 2024-09-12T17:36:50.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.432+0000 7f1ad43488c0 1 < completed multipart upload key=CHMM14VRIOQH upload=R128D0K6ZO1W tag=LR96CTZ0IXEA type=write size=2063431 2024-09-12T17:36:50.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.436+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~TDEXXF17MF0B.0 size=1048576 2024-09-12T17:36:50.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.440+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~TDEXXF17MF0B.1 size=1048576 2024-09-12T17:36:50.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.440+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~TDEXXF17MF0B.2 size=863810 2024-09-12T17:36:50.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.440+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=TDEXXF17MF0B tag=N2PATBC8CT0U type=write size=4009538 2024-09-12T17:36:50.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.444+0000 7f1ad43488c0 1 < suggested remove operation key=Y3NQLDWQJ37Z tag=WE1XIM24L1V8 type=del 2024-09-12T17:36:50.449 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.448+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~SKTMATQXNZ1X.0 size=1046931 2024-09-12T17:36:50.449 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.448+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=SKTMATQXNZ1X tag=QXAU4HLRR30Y type=write size=2095507 2024-09-12T17:36:50.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.452+0000 7f1ad43488c0 1 < completed write operation key=SDJ53NSPOIRC tag=6ZQHKVM56OA2 type=write size=373688 2024-09-12T17:36:50.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.452+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=QNV6A5IWAWWZ type=del size=2363360 2024-09-12T17:36:50.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.456+0000 7f1ad43488c0 1 < completed delete operation key=MB3FVGKV0ZNQ tag=54A60OPN8ZFG type=del 2024-09-12T17:36:50.458 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.456+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=3J6VRRQ55I2T type=write size=68804 2024-09-12T17:36:50.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.460+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~2V8MHL9D95UT.0 size=572522 2024-09-12T17:36:50.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.464+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=2V8MHL9D95UT tag=PTJZOGL82I5I type=write size=1621098 2024-09-12T17:36:50.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.468+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~HWVZMZPL6B8O.0 size=1048576 2024-09-12T17:36:50.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.468+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~HWVZMZPL6B8O.1 size=626178 2024-09-12T17:36:50.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.468+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=HWVZMZPL6B8O tag=R9GH3YN6CW3S type=write size=2723330 2024-09-12T17:36:50.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.472+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=R9A2XNVFZCTN type=del 2024-09-12T17:36:50.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.476+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=B1VRY6TZY7UZ type=del size=2363949 2024-09-12T17:36:50.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.476+0000 7f1ad43488c0 1 < canceled operation key=WWB6LAHAMIR9 tag=63WO4BLTBNK1 type=del size=703452 2024-09-12T17:36:50.481 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.480+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~GQU3S0RGNCGM.0 size=1048576 2024-09-12T17:36:50.483 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.484+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~GQU3S0RGNCGM.1 size=362853 2024-09-12T17:36:50.483 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.484+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=GQU3S0RGNCGM tag=K7OJAY22A1JM type=write size=2460005 2024-09-12T17:36:50.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.484+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~33OU0W9649WB.0 size=1048576 2024-09-12T17:36:50.487 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.484+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~33OU0W9649WB.1 size=706711 2024-09-12T17:36:50.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.488+0000 7f1ad43488c0 1 < completed multipart upload key=7RSHIZRKK2OY upload=33OU0W9649WB tag=3WOJACSJRSU9 type=write size=2803863 2024-09-12T17:36:50.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.492+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=10HJTW9PE4JJ type=del size=1701637 2024-09-12T17:36:50.496 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.496+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~8CWMG6GXG01C.0 size=1048576 2024-09-12T17:36:50.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.496+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~8CWMG6GXG01C.1 size=252039 2024-09-12T17:36:50.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.500+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=8CWMG6GXG01C tag=NAIVNST6K2F4 type=write size=2349191 2024-09-12T17:36:50.504 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.504+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=XVEC5M1X160F type=del size=1859344 2024-09-12T17:36:50.507 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.504+0000 7f1ad43488c0 1 < canceled operation key=0MV3GCBTWZD0 tag=9QVJ5YHAV20E type=del size=3067191 2024-09-12T17:36:50.509 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.508+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=V0HAYHEX0ZZK type=write size=563902 2024-09-12T17:36:50.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.512+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~ZCDFO9CBZY14.0 size=1048576 2024-09-12T17:36:50.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.512+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~ZCDFO9CBZY14.1 size=1048576 2024-09-12T17:36:50.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.516+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~ZCDFO9CBZY14.2 size=871003 2024-09-12T17:36:50.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.520+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=ZCDFO9CBZY14 tag=AX3CJ86R7ACU type=write size=4016731 2024-09-12T17:36:50.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.520+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=0GC08APR4XZN type=write size=810142 2024-09-12T17:36:50.525 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.524+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=MAMIDH92LB80 type=del 2024-09-12T17:36:50.526 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.524+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=S5X44VM79R9R type=del size=1194148 2024-09-12T17:36:50.528 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.528+0000 7f1ad43488c0 1 < completed write operation key=GWJ78NNXOL1R tag=B2IVD8VJMR1W type=write size=600377 2024-09-12T17:36:50.530 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.528+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=UJ0N5M5J68NM type=write size=497791 2024-09-12T17:36:50.532 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.532+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~0S7ZA5R08AGB.0 size=1048576 2024-09-12T17:36:50.533 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.532+0000 7f1ad43488c0 1 < canceled part key=_multipart_BCPDXAL027U2.2~0S7ZA5R08AGB.1 size=446463 2024-09-12T17:36:50.536 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.536+0000 7f1ad43488c0 1 < canceled multipart upload key=BCPDXAL027U2 upload=0S7ZA5R08AGB tag=KELVSILNBOSS type=write size=2543615 2024-09-12T17:36:50.538 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.536+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=DJH4AQ44BE7W type=del size=2259192 2024-09-12T17:36:50.543 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.540+0000 7f1ad43488c0 1 < suggested update operation key=NHOG1WG3VT6N tag=K46EKFOJBX4Y type=del size=2287514 2024-09-12T17:36:50.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.548+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~O84TQ1GAWBVW.0 size=113000 2024-09-12T17:36:50.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.548+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=O84TQ1GAWBVW tag=K31WU6LPLX26 type=write size=1161576 2024-09-12T17:36:50.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.548+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~DXGDZA0NFY2N.0 size=845228 2024-09-12T17:36:50.553 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.552+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=DXGDZA0NFY2N tag=LKHYGP57WD45 type=write size=1893804 2024-09-12T17:36:50.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.556+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=CWL4WHE15EUL type=write size=55998 2024-09-12T17:36:50.557 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.556+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~TDEXXF17MF0B.0 size=1048576 2024-09-12T17:36:50.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.560+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~TDEXXF17MF0B.1 size=1048576 2024-09-12T17:36:50.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.560+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~TDEXXF17MF0B.2 size=863810 2024-09-12T17:36:50.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.564+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=TDEXXF17MF0B tag=N2PATBC8CT0U type=write size=4009538 2024-09-12T17:36:50.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.568+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~TWU43G6942SE.0 size=630980 2024-09-12T17:36:50.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.568+0000 7f1ad43488c0 1 > prepared multipart upload key=WFEJLVRCKIUU upload=TWU43G6942SE tag=0AUZGI1KJNZ7 type=write size=1679556 2024-09-12T17:36:50.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.568+0000 7f1ad43488c0 1 < canceled part key=_multipart_WWB6LAHAMIR9.2~SKTMATQXNZ1X.0 size=1046931 2024-09-12T17:36:50.572 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.572+0000 7f1ad43488c0 1 < canceled multipart upload key=WWB6LAHAMIR9 upload=SKTMATQXNZ1X tag=QXAU4HLRR30Y type=write size=2095507 2024-09-12T17:36:50.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.572+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=ZOKRF40II40D type=del size=931757 2024-09-12T17:36:50.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.576+0000 7f1ad43488c0 1 < completed delete operation key=GWJ78NNXOL1R tag=QNV6A5IWAWWZ type=del 2024-09-12T17:36:50.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.580+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=T6QHVOA331M3 type=del size=3707705 2024-09-12T17:36:50.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.584+0000 7f1ad43488c0 1 < suggested update operation key=GZ7LGZQHW4CY tag=3J6VRRQ55I2T type=write size=68804 2024-09-12T17:36:50.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.588+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~BLACLAB2IX54.0 size=457016 2024-09-12T17:36:50.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.588+0000 7f1ad43488c0 1 > prepared multipart upload key=GWJ78NNXOL1R upload=BLACLAB2IX54 tag=SW11KMVYM6OM type=write size=1505592 2024-09-12T17:36:50.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.592+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~HWVZMZPL6B8O.0 size=1048576 2024-09-12T17:36:50.595 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.596+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~HWVZMZPL6B8O.1 size=626178 2024-09-12T17:36:50.598 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.596+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=HWVZMZPL6B8O tag=R9GH3YN6CW3S type=write size=2723330 2024-09-12T17:36:50.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.600+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=E2CUPS3HYZL5 type=write size=1021821 2024-09-12T17:36:50.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.600+0000 7f1ad43488c0 1 < completed delete operation key=WFEJLVRCKIUU tag=B1VRY6TZY7UZ type=del 2024-09-12T17:36:50.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.604+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=YH89667U7G9B type=del size=2467902 2024-09-12T17:36:50.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.604+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~GQU3S0RGNCGM.0 size=1048576 2024-09-12T17:36:50.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.608+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~GQU3S0RGNCGM.1 size=362853 2024-09-12T17:36:50.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.612+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=GQU3S0RGNCGM tag=K7OJAY22A1JM type=write size=2460005 2024-09-12T17:36:50.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.612+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=V1ENRSV59X7P type=del size=445341 2024-09-12T17:36:50.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.616+0000 7f1ad43488c0 1 < canceled operation key=2SDYAQRNWAJK tag=10HJTW9PE4JJ type=del size=1701637 2024-09-12T17:36:50.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.616+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=GW3SAWQ3FRFA type=del size=3633290 2024-09-12T17:36:50.620 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.620+0000 7f1ad43488c0 1 < completed delete operation key=9Z2EHQA8T5F4 tag=XVEC5M1X160F type=del 2024-09-12T17:36:50.623 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.624+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~6JCC8QP4Y0FG.0 size=1048576 2024-09-12T17:36:50.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.624+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~6JCC8QP4Y0FG.1 size=1048576 2024-09-12T17:36:50.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.624+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~6JCC8QP4Y0FG.2 size=3049 2024-09-12T17:36:50.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.624+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=6JCC8QP4Y0FG tag=VZL34JROZJEK type=write size=3148777 2024-09-12T17:36:50.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.628+0000 7f1ad43488c0 1 < completed write operation key=X078SB1ITNII tag=V0HAYHEX0ZZK type=write size=563902 2024-09-12T17:36:50.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.632+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~NFEL0GU6FEKE.0 size=1048576 2024-09-12T17:36:50.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.632+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~NFEL0GU6FEKE.1 size=1048576 2024-09-12T17:36:50.635 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.636+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~NFEL0GU6FEKE.2 size=1021134 2024-09-12T17:36:50.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.636+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=NFEL0GU6FEKE tag=9EE830GM2ZOG type=write size=4166862 2024-09-12T17:36:50.637 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.636+0000 7f1ad43488c0 1 < completed write operation key=WWB6LAHAMIR9 tag=0GC08APR4XZN type=write size=810142 2024-09-12T17:36:50.639 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.640+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=9YPE61QVYTN2 type=del size=144612 2024-09-12T17:36:50.642 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.640+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=S5X44VM79R9R type=del 2024-09-12T17:36:50.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.644+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~6D3ZKGP31XDW.0 size=782313 2024-09-12T17:36:50.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.644+0000 7f1ad43488c0 1 > prepared multipart upload key=RH4HYE315U5Y upload=6D3ZKGP31XDW tag=O2NFUREDX63X type=write size=1830889 2024-09-12T17:36:50.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.648+0000 7f1ad43488c0 1 < suggested remove operation key=Y3NQLDWQJ37Z tag=UJ0N5M5J68NM type=write 2024-09-12T17:36:50.652 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.652+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=525CHWFN12S0 type=del size=362651 2024-09-12T17:36:50.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.652+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=DJH4AQ44BE7W type=del 2024-09-12T17:36:50.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.656+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~Q1SZQ23FTPV9.0 size=1048576 2024-09-12T17:36:50.660 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.660+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~Q1SZQ23FTPV9.1 size=460308 2024-09-12T17:36:50.660 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.660+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=Q1SZQ23FTPV9 tag=35ZEPW5DKNHP type=write size=2557460 2024-09-12T17:36:50.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.660+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~O84TQ1GAWBVW.0 size=113000 2024-09-12T17:36:50.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.664+0000 7f1ad43488c0 1 < completed multipart upload key=MB3FVGKV0ZNQ upload=O84TQ1GAWBVW tag=K31WU6LPLX26 type=write size=1161576 2024-09-12T17:36:50.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.668+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~4ZX41WVUTA9K.0 size=1048576 2024-09-12T17:36:50.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.672+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~4ZX41WVUTA9K.1 size=1048576 2024-09-12T17:36:50.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.672+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~4ZX41WVUTA9K.2 size=101842 2024-09-12T17:36:50.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.672+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=4ZX41WVUTA9K tag=RIRRTKKGP10V type=write size=3247570 2024-09-12T17:36:50.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.676+0000 7f1ad43488c0 1 < completed write operation key=WWB6LAHAMIR9 tag=CWL4WHE15EUL type=write size=55998 2024-09-12T17:36:50.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.676+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=4O4CJ8B8GMII type=del size=1612596 2024-09-12T17:36:50.680 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.680+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~TWU43G6942SE.0 size=630980 2024-09-12T17:36:50.685 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.684+0000 7f1ad43488c0 1 < completed multipart upload key=WFEJLVRCKIUU upload=TWU43G6942SE tag=0AUZGI1KJNZ7 type=write size=1679556 2024-09-12T17:36:50.687 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.684+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=G7USSLZ9TX3K type=del size=3279116 2024-09-12T17:36:50.689 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.688+0000 7f1ad43488c0 1 < canceled operation key=2SDYAQRNWAJK tag=ZOKRF40II40D type=del size=931757 2024-09-12T17:36:50.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.692+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=8QA8SFD6EE9K type=del size=534736 2024-09-12T17:36:50.695 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.692+0000 7f1ad43488c0 1 < completed delete operation key=2SDYAQRNWAJK tag=T6QHVOA331M3 type=del 2024-09-12T17:36:50.698 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.696+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~PQ76T6TI2YX0.0 size=1048576 2024-09-12T17:36:50.700 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.700+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~PQ76T6TI2YX0.1 size=1048576 2024-09-12T17:36:50.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.700+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~PQ76T6TI2YX0.2 size=955304 2024-09-12T17:36:50.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.700+0000 7f1ad43488c0 1 > prepared multipart upload key=9Z2EHQA8T5F4 upload=PQ76T6TI2YX0 tag=HZ7Q9E32A99Q type=write size=4101032 2024-09-12T17:36:50.704 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.704+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~BLACLAB2IX54.0 size=457016 2024-09-12T17:36:50.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.708+0000 7f1ad43488c0 1 < completed multipart upload key=GWJ78NNXOL1R upload=BLACLAB2IX54 tag=SW11KMVYM6OM type=write size=1505592 2024-09-12T17:36:50.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.708+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=2QZ5HHXUE4CS type=del size=433333 2024-09-12T17:36:50.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.712+0000 7f1ad43488c0 1 < canceled operation key=LU7XIBO5YUOR tag=E2CUPS3HYZL5 type=write size=1021821 2024-09-12T17:36:50.713 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.712+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=J69S1W7YMJPO type=write size=1011275 2024-09-12T17:36:50.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.716+0000 7f1ad43488c0 1 < completed delete operation key=2SDYAQRNWAJK tag=YH89667U7G9B type=del 2024-09-12T17:36:50.717 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.716+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=QK49XW9YDSDV type=del size=240338 2024-09-12T17:36:50.721 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.720+0000 7f1ad43488c0 1 < suggested update operation key=X078SB1ITNII tag=V1ENRSV59X7P type=del size=445341 2024-09-12T17:36:50.723 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.724+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=U6SGDJIOJAT8 type=write size=680457 2024-09-12T17:36:50.726 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.724+0000 7f1ad43488c0 1 < completed delete operation key=ZHFRKX9YY8P5 tag=GW3SAWQ3FRFA type=del 2024-09-12T17:36:50.728 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.728+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=GAKO0TU0VWPB type=write size=188511 2024-09-12T17:36:50.731 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.732+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~6JCC8QP4Y0FG.0 size=1048576 2024-09-12T17:36:50.733 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.732+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~6JCC8QP4Y0FG.1 size=1048576 2024-09-12T17:36:50.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.736+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~6JCC8QP4Y0FG.2 size=3049 2024-09-12T17:36:50.739 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.740+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=6JCC8QP4Y0FG tag=VZL34JROZJEK type=write size=3148777 2024-09-12T17:36:50.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.740+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=FFELTBFRHTGK type=write size=254391 2024-09-12T17:36:50.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.744+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~NFEL0GU6FEKE.0 size=1048576 2024-09-12T17:36:50.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.744+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~NFEL0GU6FEKE.1 size=1048576 2024-09-12T17:36:50.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.748+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~NFEL0GU6FEKE.2 size=1021134 2024-09-12T17:36:50.753 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.752+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=NFEL0GU6FEKE tag=9EE830GM2ZOG type=write size=4166862 2024-09-12T17:36:50.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.756+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~83B9DKPCZVFF.0 size=853628 2024-09-12T17:36:50.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.756+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=83B9DKPCZVFF tag=JVFI3NGJ5DMT type=write size=1902204 2024-09-12T17:36:50.761 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.760+0000 7f1ad43488c0 1 < completed delete operation key=RH4HYE315U5Y tag=9YPE61QVYTN2 type=del 2024-09-12T17:36:50.764 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.764+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=J36WU11RQNKZ type=del size=2011157 2024-09-12T17:36:50.767 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.764+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~6D3ZKGP31XDW.0 size=782313 2024-09-12T17:36:50.770 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.768+0000 7f1ad43488c0 1 < completed multipart upload key=RH4HYE315U5Y upload=6D3ZKGP31XDW tag=O2NFUREDX63X type=write size=1830889 2024-09-12T17:36:50.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.772+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=ELIA2UA6SIPH type=del size=606112 2024-09-12T17:36:50.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.776+0000 7f1ad43488c0 1 < canceled operation key=ZHFRKX9YY8P5 tag=525CHWFN12S0 type=del size=362651 2024-09-12T17:36:50.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.776+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=TTSCJ55I38N8 type=del size=714440 2024-09-12T17:36:50.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.780+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~Q1SZQ23FTPV9.0 size=1048576 2024-09-12T17:36:50.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.780+0000 7f1ad43488c0 1 < canceled part key=_multipart_PKC1RR4FZWE0.2~Q1SZQ23FTPV9.1 size=460308 2024-09-12T17:36:50.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.784+0000 7f1ad43488c0 1 < canceled multipart upload key=PKC1RR4FZWE0 upload=Q1SZQ23FTPV9 tag=35ZEPW5DKNHP type=write size=2557460 2024-09-12T17:36:50.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.784+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=I0Y170UJ3JK1 type=del size=3320711 2024-09-12T17:36:50.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.788+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~4ZX41WVUTA9K.0 size=1048576 2024-09-12T17:36:50.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.788+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~4ZX41WVUTA9K.1 size=1048576 2024-09-12T17:36:50.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.792+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~4ZX41WVUTA9K.2 size=101842 2024-09-12T17:36:50.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.792+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=4ZX41WVUTA9K tag=RIRRTKKGP10V type=write size=3247570 2024-09-12T17:36:50.799 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.800+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=QOV372N1TLLD type=del size=1995036 2024-09-12T17:36:50.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.800+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=4O4CJ8B8GMII type=del 2024-09-12T17:36:50.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.804+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=DE4BDSTO9A6H type=del size=1474126 2024-09-12T17:36:50.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.804+0000 7f1ad43488c0 1 < completed delete operation key=2SDYAQRNWAJK tag=G7USSLZ9TX3K type=del 2024-09-12T17:36:50.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.808+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=GXAZU7JAKCTM type=del size=3856660 2024-09-12T17:36:50.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.808+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=8QA8SFD6EE9K type=del 2024-09-12T17:36:50.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.812+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=LLM2RREW6Y7F type=del size=2060715 2024-09-12T17:36:50.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.812+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~PQ76T6TI2YX0.0 size=1048576 2024-09-12T17:36:50.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.816+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~PQ76T6TI2YX0.1 size=1048576 2024-09-12T17:36:50.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.816+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~PQ76T6TI2YX0.2 size=955304 2024-09-12T17:36:50.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.820+0000 7f1ad43488c0 1 < completed multipart upload key=9Z2EHQA8T5F4 upload=PQ76T6TI2YX0 tag=HZ7Q9E32A99Q type=write size=4101032 2024-09-12T17:36:50.822 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.820+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=M0ZQY07WMSDC type=del size=3530173 2024-09-12T17:36:50.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.824+0000 7f1ad43488c0 1 < suggested update operation key=CHMM14VRIOQH tag=2QZ5HHXUE4CS type=del size=433333 2024-09-12T17:36:50.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.828+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=53ETS277H5D1 type=del size=2320496 2024-09-12T17:36:50.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.832+0000 7f1ad43488c0 1 < suggested remove operation key=XOEPYERWY6IT tag=J69S1W7YMJPO type=write 2024-09-12T17:36:50.836 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.836+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~USL5U51HK3UV.0 size=1048576 2024-09-12T17:36:50.838 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.836+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~USL5U51HK3UV.1 size=1048576 2024-09-12T17:36:50.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.840+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~USL5U51HK3UV.2 size=182227 2024-09-12T17:36:50.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.840+0000 7f1ad43488c0 1 > prepared multipart upload key=Y3NQLDWQJ37Z upload=USL5U51HK3UV tag=3YLMQ4I516UN type=write size=3327955 2024-09-12T17:36:50.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.840+0000 7f1ad43488c0 1 < completed delete operation key=2SDYAQRNWAJK tag=QK49XW9YDSDV type=del 2024-09-12T17:36:50.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.844+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~Y4PWEO41B2MZ.0 size=1048576 2024-09-12T17:36:50.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.844+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~Y4PWEO41B2MZ.1 size=248220 2024-09-12T17:36:50.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.844+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=Y4PWEO41B2MZ tag=H31W7TXE4KTR type=write size=2345372 2024-09-12T17:36:50.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.848+0000 7f1ad43488c0 1 < completed write operation key=X0HT3K3OREL7 tag=U6SGDJIOJAT8 type=write size=680457 2024-09-12T17:36:50.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.848+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=0L1MHADNJ9E2 type=del size=2074905 2024-09-12T17:36:50.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.852+0000 7f1ad43488c0 1 < suggested update operation key=7RSHIZRKK2OY tag=GAKO0TU0VWPB type=write size=188511 2024-09-12T17:36:50.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.860+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~WNFKQR60LKFI.0 size=1048576 2024-09-12T17:36:50.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.860+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~WNFKQR60LKFI.1 size=417896 2024-09-12T17:36:50.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.860+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=WNFKQR60LKFI tag=YYWO17PJI8N5 type=write size=2515048 2024-09-12T17:36:50.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.864+0000 7f1ad43488c0 1 < completed write operation key=0MV3GCBTWZD0 tag=FFELTBFRHTGK type=write size=254391 2024-09-12T17:36:50.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.864+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=OY3PEJ2QWFNZ type=del size=3440189 2024-09-12T17:36:50.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.868+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~83B9DKPCZVFF.0 size=853628 2024-09-12T17:36:50.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.872+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=83B9DKPCZVFF tag=JVFI3NGJ5DMT type=write size=1902204 2024-09-12T17:36:50.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.876+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~DK8U9HIGI1QC.0 size=1048576 2024-09-12T17:36:50.878 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.876+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~DK8U9HIGI1QC.1 size=800055 2024-09-12T17:36:50.878 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.876+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=DK8U9HIGI1QC tag=4Q9FDXLQW13F type=write size=2897207 2024-09-12T17:36:50.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.880+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=J36WU11RQNKZ type=del 2024-09-12T17:36:50.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.880+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=2S9COYGE7MBI type=del size=1001151 2024-09-12T17:36:50.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.884+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=ELIA2UA6SIPH type=del 2024-09-12T17:36:50.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.888+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=QGJW9VLHJ3A0 type=write size=370991 2024-09-12T17:36:50.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.888+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=TTSCJ55I38N8 type=del 2024-09-12T17:36:50.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.892+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=JVI8FRMWX13A type=write size=462565 2024-09-12T17:36:50.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.892+0000 7f1ad43488c0 1 < completed delete operation key=NHOG1WG3VT6N tag=I0Y170UJ3JK1 type=del 2024-09-12T17:36:50.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.896+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=HRGS6H8IRMWV type=del size=3130761 2024-09-12T17:36:50.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.896+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=QOV372N1TLLD type=del 2024-09-12T17:36:50.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.900+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=WECIT8T5BY3G type=del size=1408734 2024-09-12T17:36:50.902 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.900+0000 7f1ad43488c0 1 < completed delete operation key=ZHFRKX9YY8P5 tag=DE4BDSTO9A6H type=del 2024-09-12T17:36:50.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.904+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=SQ96AWJK2RWZ type=del size=3533381 2024-09-12T17:36:50.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.904+0000 7f1ad43488c0 1 < completed delete operation key=C7QSOK3D3IWJ tag=GXAZU7JAKCTM type=del 2024-09-12T17:36:50.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.908+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~71CX2QGDTZU0.0 size=1048576 2024-09-12T17:36:50.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.912+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~71CX2QGDTZU0.1 size=1048576 2024-09-12T17:36:50.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.912+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~71CX2QGDTZU0.2 size=12236 2024-09-12T17:36:50.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.912+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=71CX2QGDTZU0 tag=9E3VL9P0H4P4 type=write size=3157964 2024-09-12T17:36:50.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.916+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=LLM2RREW6Y7F type=del 2024-09-12T17:36:50.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.916+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=112CLE5DXHPX type=del size=781771 2024-09-12T17:36:50.919 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.920+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=M0ZQY07WMSDC type=del 2024-09-12T17:36:50.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.920+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=TQEBA61SSU6B type=write size=616861 2024-09-12T17:36:50.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.924+0000 7f1ad43488c0 1 < completed delete operation key=SDJ53NSPOIRC tag=53ETS277H5D1 type=del 2024-09-12T17:36:50.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.924+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=EKBW7E3LSXFM type=del size=2457155 2024-09-12T17:36:50.927 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.928+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~USL5U51HK3UV.0 size=1048576 2024-09-12T17:36:50.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.928+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~USL5U51HK3UV.1 size=1048576 2024-09-12T17:36:50.930 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.928+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~USL5U51HK3UV.2 size=182227 2024-09-12T17:36:50.934 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.932+0000 7f1ad43488c0 1 < completed multipart upload key=Y3NQLDWQJ37Z upload=USL5U51HK3UV tag=3YLMQ4I516UN type=write size=3327955 2024-09-12T17:36:50.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.936+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=W743IVKGMFB8 type=write size=658141 2024-09-12T17:36:50.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.936+0000 7f1ad43488c0 1 < canceled part key=_multipart_LU7XIBO5YUOR.2~Y4PWEO41B2MZ.0 size=1048576 2024-09-12T17:36:50.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.936+0000 7f1ad43488c0 1 < canceled part key=_multipart_LU7XIBO5YUOR.2~Y4PWEO41B2MZ.1 size=248220 2024-09-12T17:36:50.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.940+0000 7f1ad43488c0 1 < canceled multipart upload key=LU7XIBO5YUOR upload=Y4PWEO41B2MZ tag=H31W7TXE4KTR type=write size=2345372 2024-09-12T17:36:50.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.940+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=0SUEQ75XIQUC type=del size=2192777 2024-09-12T17:36:50.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.944+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=0L1MHADNJ9E2 type=del 2024-09-12T17:36:50.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.944+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=IHPYYT075F3Y type=del size=99256 2024-09-12T17:36:50.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.948+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~WNFKQR60LKFI.0 size=1048576 2024-09-12T17:36:50.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.948+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~WNFKQR60LKFI.1 size=417896 2024-09-12T17:36:50.953 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.952+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=WNFKQR60LKFI tag=YYWO17PJI8N5 type=write size=2515048 2024-09-12T17:36:50.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.956+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=GGJOWOKM8721 type=del size=3543897 2024-09-12T17:36:50.958 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.956+0000 7f1ad43488c0 1 < canceled operation key=ZHFRKX9YY8P5 tag=OY3PEJ2QWFNZ type=del size=3440189 2024-09-12T17:36:50.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.960+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=QHGHVO0U5ILA type=del size=2662837 2024-09-12T17:36:50.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.960+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~DK8U9HIGI1QC.0 size=1048576 2024-09-12T17:36:50.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.964+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~DK8U9HIGI1QC.1 size=800055 2024-09-12T17:36:50.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.964+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=DK8U9HIGI1QC tag=4Q9FDXLQW13F type=write size=2897207 2024-09-12T17:36:50.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.968+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~ZUZ79RBPL79R.0 size=440686 2024-09-12T17:36:50.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.968+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=ZUZ79RBPL79R tag=4O2RS52L5OXO type=write size=1489262 2024-09-12T17:36:50.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.972+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=2S9COYGE7MBI type=del 2024-09-12T17:36:50.974 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.972+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=IXU9QSADSWMB type=del size=359267 2024-09-12T17:36:50.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.976+0000 7f1ad43488c0 1 < completed write operation key=X078SB1ITNII tag=QGJW9VLHJ3A0 type=write size=370991 2024-09-12T17:36:50.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.976+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=7FTNO948QV03 type=del size=517587 2024-09-12T17:36:50.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.980+0000 7f1ad43488c0 1 < completed write operation key=RH4HYE315U5Y tag=JVI8FRMWX13A type=write size=462565 2024-09-12T17:36:50.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.980+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=2IMFYD1W1V2P type=del size=3747303 2024-09-12T17:36:50.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.984+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=HRGS6H8IRMWV type=del 2024-09-12T17:36:50.987 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.988+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=O0KLZAK43FWC type=del size=3737885 2024-09-12T17:36:50.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.988+0000 7f1ad43488c0 1 < completed delete operation key=ECEF8IJGU4Z8 tag=WECIT8T5BY3G type=del 2024-09-12T17:36:50.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.992+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~OKN4GGEVM1M5.0 size=1048576 2024-09-12T17:36:50.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:50.996+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~OKN4GGEVM1M5.1 size=1048576 2024-09-12T17:36:50.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.000+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~OKN4GGEVM1M5.2 size=239094 2024-09-12T17:36:50.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.000+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=OKN4GGEVM1M5 tag=4MGEP55YDCXH type=write size=3384822 2024-09-12T17:36:51.002 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.000+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=SQ96AWJK2RWZ type=del 2024-09-12T17:36:51.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.004+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=9DLGQKTT6BGS type=del size=2106113 2024-09-12T17:36:51.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.004+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~71CX2QGDTZU0.0 size=1048576 2024-09-12T17:36:51.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.008+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~71CX2QGDTZU0.1 size=1048576 2024-09-12T17:36:51.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.008+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~71CX2QGDTZU0.2 size=12236 2024-09-12T17:36:51.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.012+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=71CX2QGDTZU0 tag=9E3VL9P0H4P4 type=write size=3157964 2024-09-12T17:36:51.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.016+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=JTZAU0W8P53R type=del size=2336622 2024-09-12T17:36:51.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.016+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=112CLE5DXHPX type=del 2024-09-12T17:36:51.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.020+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=68OB2KBFUPCN type=write size=981242 2024-09-12T17:36:51.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.024+0000 7f1ad43488c0 1 < suggested remove operation key=GWJ78NNXOL1R tag=TQEBA61SSU6B type=write 2024-09-12T17:36:51.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.028+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~0E8LALUIY5TP.0 size=1048576 2024-09-12T17:36:51.029 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.028+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~0E8LALUIY5TP.1 size=1048576 2024-09-12T17:36:51.030 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.028+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~0E8LALUIY5TP.2 size=428255 2024-09-12T17:36:51.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.028+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=0E8LALUIY5TP tag=8LD7VRRLA72P type=write size=3573983 2024-09-12T17:36:51.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.032+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=EKBW7E3LSXFM type=del 2024-09-12T17:36:51.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.036+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~1BHHXSFDISEI.0 size=1048576 2024-09-12T17:36:51.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.036+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~1BHHXSFDISEI.1 size=1048576 2024-09-12T17:36:51.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.040+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~1BHHXSFDISEI.2 size=245583 2024-09-12T17:36:51.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.040+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=1BHHXSFDISEI tag=7BMU4D01482G type=write size=3391311 2024-09-12T17:36:51.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.040+0000 7f1ad43488c0 1 < completed write operation key=05PAFB226IFP tag=W743IVKGMFB8 type=write size=658141 2024-09-12T17:36:51.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.044+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=ZZED6A1HHDRQ type=del size=4171449 2024-09-12T17:36:51.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.048+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=0SUEQ75XIQUC type=del 2024-09-12T17:36:51.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.052+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~D90KZZHTK48X.0 size=1048576 2024-09-12T17:36:51.053 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.052+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~D90KZZHTK48X.1 size=1048576 2024-09-12T17:36:51.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.052+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~D90KZZHTK48X.2 size=694083 2024-09-12T17:36:51.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.052+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=D90KZZHTK48X tag=17HJLAUNR0U1 type=write size=3839811 2024-09-12T17:36:51.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.056+0000 7f1ad43488c0 1 < completed delete operation key=RH4HYE315U5Y tag=IHPYYT075F3Y type=del 2024-09-12T17:36:51.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.060+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~8R1JU739DNIZ.0 size=842552 2024-09-12T17:36:51.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.060+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=8R1JU739DNIZ tag=YIAB6KT2FKMA type=write size=1891128 2024-09-12T17:36:51.065 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.064+0000 7f1ad43488c0 1 < suggested update operation key=05PAFB226IFP tag=GGJOWOKM8721 type=del size=3543897 2024-09-12T17:36:51.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.068+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=K5UUMDAENUJN type=del size=1180178 2024-09-12T17:36:51.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.068+0000 7f1ad43488c0 1 < completed delete operation key=WWB6LAHAMIR9 tag=QHGHVO0U5ILA type=del 2024-09-12T17:36:51.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.072+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~2AT3F2NIJ35P.0 size=887269 2024-09-12T17:36:51.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.072+0000 7f1ad43488c0 1 > prepared multipart upload key=CHMM14VRIOQH upload=2AT3F2NIJ35P tag=NSN80U61BBPE type=write size=1935845 2024-09-12T17:36:51.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.076+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~ZUZ79RBPL79R.0 size=440686 2024-09-12T17:36:51.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.080+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=ZUZ79RBPL79R tag=4O2RS52L5OXO type=write size=1489262 2024-09-12T17:36:51.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.084+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=G86DKBGXOUYJ type=del size=1893967 2024-09-12T17:36:51.085 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.084+0000 7f1ad43488c0 1 < completed delete operation key=2SDYAQRNWAJK tag=IXU9QSADSWMB type=del 2024-09-12T17:36:51.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.088+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=7445ALZXLLG4 type=del size=4007155 2024-09-12T17:36:51.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.092+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=7FTNO948QV03 type=del 2024-09-12T17:36:51.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.092+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=GAKCW3ZR9FYZ type=del size=96260 2024-09-12T17:36:51.096 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.096+0000 7f1ad43488c0 1 < completed delete operation key=SIZ0Z1KWTGUJ tag=2IMFYD1W1V2P type=del 2024-09-12T17:36:51.101 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.100+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~MRWMNX8W508G.0 size=1048576 2024-09-12T17:36:51.103 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.104+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~MRWMNX8W508G.1 size=145275 2024-09-12T17:36:51.103 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.104+0000 7f1ad43488c0 1 > prepared multipart upload key=GWJ78NNXOL1R upload=MRWMNX8W508G tag=EJ7DHFJN7JM1 type=write size=2242427 2024-09-12T17:36:51.106 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.104+0000 7f1ad43488c0 1 < canceled operation key=MB3FVGKV0ZNQ tag=O0KLZAK43FWC type=del size=3737885 2024-09-12T17:36:51.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.108+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=Q649MD01NTUV type=write size=615953 2024-09-12T17:36:51.111 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.112+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~OKN4GGEVM1M5.0 size=1048576 2024-09-12T17:36:51.113 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.112+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~OKN4GGEVM1M5.1 size=1048576 2024-09-12T17:36:51.115 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.116+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~OKN4GGEVM1M5.2 size=239094 2024-09-12T17:36:51.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.120+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=OKN4GGEVM1M5 tag=4MGEP55YDCXH type=write size=3384822 2024-09-12T17:36:51.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.124+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~ZTJIOQJSUFNW.0 size=1048576 2024-09-12T17:36:51.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.128+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~ZTJIOQJSUFNW.1 size=1048576 2024-09-12T17:36:51.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.128+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~ZTJIOQJSUFNW.2 size=767220 2024-09-12T17:36:51.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.128+0000 7f1ad43488c0 1 > prepared multipart upload key=SIZ0Z1KWTGUJ upload=ZTJIOQJSUFNW tag=IM4MLZ2A643M type=write size=3912948 2024-09-12T17:36:51.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.132+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=9DLGQKTT6BGS type=del 2024-09-12T17:36:51.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.136+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~WTK73E5YTBSK.0 size=1048576 2024-09-12T17:36:51.139 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.140+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~WTK73E5YTBSK.1 size=921080 2024-09-12T17:36:51.139 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.140+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=WTK73E5YTBSK tag=5K7F32DQG36O type=write size=3018232 2024-09-12T17:36:51.142 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.140+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=JTZAU0W8P53R type=del 2024-09-12T17:36:51.144 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.144+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=KL8FQKQXRLRZ type=write size=458401 2024-09-12T17:36:51.149 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.148+0000 7f1ad43488c0 1 < suggested remove operation key=BCPDXAL027U2 tag=68OB2KBFUPCN type=write 2024-09-12T17:36:51.153 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.152+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~WM5BLOECS5D3.0 size=1048576 2024-09-12T17:36:51.155 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.156+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~WM5BLOECS5D3.1 size=1048576 2024-09-12T17:36:51.157 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.156+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~WM5BLOECS5D3.2 size=525383 2024-09-12T17:36:51.157 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.156+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=WM5BLOECS5D3 tag=LKHO4BCZ0V71 type=write size=3671111 2024-09-12T17:36:51.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.160+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~0E8LALUIY5TP.0 size=1048576 2024-09-12T17:36:51.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.160+0000 7f1ad43488c0 1 < canceled part key=_multipart_X0HT3K3OREL7.2~0E8LALUIY5TP.1 size=1048576 2024-09-12T17:36:51.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.160+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~0E8LALUIY5TP.2 size=428255 2024-09-12T17:36:51.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.164+0000 7f1ad43488c0 1 < canceled multipart upload key=X0HT3K3OREL7 upload=0E8LALUIY5TP tag=8LD7VRRLA72P type=write size=3573983 2024-09-12T17:36:51.169 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.168+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=MROHKLIKOV9O type=del size=1593973 2024-09-12T17:36:51.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.172+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~1BHHXSFDISEI.0 size=1048576 2024-09-12T17:36:51.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.172+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~1BHHXSFDISEI.1 size=1048576 2024-09-12T17:36:51.176 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.176+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~1BHHXSFDISEI.2 size=245583 2024-09-12T17:36:51.180 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.180+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=1BHHXSFDISEI tag=7BMU4D01482G type=write size=3391311 2024-09-12T17:36:51.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.184+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=8J0LPK4B20W8 type=write size=737311 2024-09-12T17:36:51.185 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.184+0000 7f1ad43488c0 1 < completed delete operation key=ECEF8IJGU4Z8 tag=ZZED6A1HHDRQ type=del 2024-09-12T17:36:51.188 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.188+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=RBBTQMRLFPUL type=del size=1620694 2024-09-12T17:36:51.191 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.188+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~D90KZZHTK48X.0 size=1048576 2024-09-12T17:36:51.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.192+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~D90KZZHTK48X.1 size=1048576 2024-09-12T17:36:51.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.192+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~D90KZZHTK48X.2 size=694083 2024-09-12T17:36:51.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.200+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=D90KZZHTK48X tag=17HJLAUNR0U1 type=write size=3839811 2024-09-12T17:36:51.203 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.204+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~H5XRFOE48T0A.0 size=390394 2024-09-12T17:36:51.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.204+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=H5XRFOE48T0A tag=23VLEIXB1VPH type=write size=1438970 2024-09-12T17:36:51.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.204+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~8R1JU739DNIZ.0 size=842552 2024-09-12T17:36:51.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.208+0000 7f1ad43488c0 1 < completed multipart upload key=IY2AM7CJDUZG upload=8R1JU739DNIZ tag=YIAB6KT2FKMA type=write size=1891128 2024-09-12T17:36:51.213 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.212+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=95BEKJQBPUUB type=write size=526001 2024-09-12T17:36:51.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.216+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=K5UUMDAENUJN type=del 2024-09-12T17:36:51.218 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.216+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=AC3JO82MEGLQ type=del size=2368228 2024-09-12T17:36:51.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.220+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~2AT3F2NIJ35P.0 size=887269 2024-09-12T17:36:51.226 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.224+0000 7f1ad43488c0 1 < completed multipart upload key=CHMM14VRIOQH upload=2AT3F2NIJ35P tag=NSN80U61BBPE type=write size=1935845 2024-09-12T17:36:51.229 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.228+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=Q5RR5HEYUH4J type=write size=481145 2024-09-12T17:36:51.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.232+0000 7f1ad43488c0 1 < suggested remove operation key=X0HT3K3OREL7 tag=G86DKBGXOUYJ type=del 2024-09-12T17:36:51.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.236+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=ADZNAS2COVHI type=del size=1679792 2024-09-12T17:36:51.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.240+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=7445ALZXLLG4 type=del 2024-09-12T17:36:51.244 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.244+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~ERBSKO4Y3L7Y.0 size=1048576 2024-09-12T17:36:51.246 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.244+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~ERBSKO4Y3L7Y.1 size=51420 2024-09-12T17:36:51.246 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.244+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=ERBSKO4Y3L7Y tag=I340QUG2CHGR type=write size=2148572 2024-09-12T17:36:51.249 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.248+0000 7f1ad43488c0 1 < completed delete operation key=GWJ78NNXOL1R tag=GAKCW3ZR9FYZ type=del 2024-09-12T17:36:51.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.252+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=66VYB69L0UIO type=del size=787546 2024-09-12T17:36:51.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.252+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~MRWMNX8W508G.0 size=1048576 2024-09-12T17:36:51.256 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.256+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~MRWMNX8W508G.1 size=145275 2024-09-12T17:36:51.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.260+0000 7f1ad43488c0 1 < completed multipart upload key=GWJ78NNXOL1R upload=MRWMNX8W508G tag=EJ7DHFJN7JM1 type=write size=2242427 2024-09-12T17:36:51.263 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.264+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=0DY2DNJTFJNO type=write size=285727 2024-09-12T17:36:51.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.264+0000 7f1ad43488c0 1 < completed write operation key=4QO60GZ9V0GK tag=Q649MD01NTUV type=write size=615953 2024-09-12T17:36:51.268 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.268+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=XXBV1I5KM1T7 type=del size=177776 2024-09-12T17:36:51.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.272+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~ZTJIOQJSUFNW.0 size=1048576 2024-09-12T17:36:51.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.272+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~ZTJIOQJSUFNW.1 size=1048576 2024-09-12T17:36:51.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.276+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~ZTJIOQJSUFNW.2 size=767220 2024-09-12T17:36:51.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.280+0000 7f1ad43488c0 1 < completed multipart upload key=SIZ0Z1KWTGUJ upload=ZTJIOQJSUFNW tag=IM4MLZ2A643M type=write size=3912948 2024-09-12T17:36:51.282 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.280+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=4UZSLFECFISW type=del size=2577990 2024-09-12T17:36:51.282 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.280+0000 7f1ad43488c0 1 < canceled part key=_multipart_4QO60GZ9V0GK.2~WTK73E5YTBSK.0 size=1048576 2024-09-12T17:36:51.285 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.284+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~WTK73E5YTBSK.1 size=921080 2024-09-12T17:36:51.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.288+0000 7f1ad43488c0 1 < canceled multipart upload key=4QO60GZ9V0GK upload=WTK73E5YTBSK tag=5K7F32DQG36O type=write size=3018232 2024-09-12T17:36:51.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.292+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~XRVGKQSWXG46.0 size=1048576 2024-09-12T17:36:51.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.296+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~XRVGKQSWXG46.1 size=42055 2024-09-12T17:36:51.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.296+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=XRVGKQSWXG46 tag=I14RC9SCSCQ7 type=write size=2139207 2024-09-12T17:36:51.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.300+0000 7f1ad43488c0 1 < suggested remove operation key=NHOG1WG3VT6N tag=KL8FQKQXRLRZ type=write 2024-09-12T17:36:51.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.304+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=LPTEO16LB7AZ type=del size=1025065 2024-09-12T17:36:51.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.308+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~WM5BLOECS5D3.0 size=1048576 2024-09-12T17:36:51.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.312+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~WM5BLOECS5D3.1 size=1048576 2024-09-12T17:36:51.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.312+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~WM5BLOECS5D3.2 size=525383 2024-09-12T17:36:51.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.316+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=WM5BLOECS5D3 tag=LKHO4BCZ0V71 type=write size=3671111 2024-09-12T17:36:51.322 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.320+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~1KXGGZTPOUYB.0 size=1048576 2024-09-12T17:36:51.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.324+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~1KXGGZTPOUYB.1 size=1048576 2024-09-12T17:36:51.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.324+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~1KXGGZTPOUYB.2 size=167915 2024-09-12T17:36:51.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.324+0000 7f1ad43488c0 1 > prepared multipart upload key=ZHFRKX9YY8P5 upload=1KXGGZTPOUYB tag=P47O6XEOFT0F type=write size=3313643 2024-09-12T17:36:51.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.328+0000 7f1ad43488c0 1 < suggested update operation key=GWJ78NNXOL1R tag=MROHKLIKOV9O type=del size=1593973 2024-09-12T17:36:51.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.332+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=829KXTSO91ZD type=del size=4169748 2024-09-12T17:36:51.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.336+0000 7f1ad43488c0 1 < completed write operation key=8U3L46JDJ8VS tag=8J0LPK4B20W8 type=write size=737311 2024-09-12T17:36:51.341 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.340+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~6TB3GRWA15QS.0 size=1048576 2024-09-12T17:36:51.343 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.344+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~6TB3GRWA15QS.1 size=181543 2024-09-12T17:36:51.343 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.344+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=6TB3GRWA15QS tag=OQNBRAPWD05Q type=write size=2278695 2024-09-12T17:36:51.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.348+0000 7f1ad43488c0 1 < suggested update operation key=XOEPYERWY6IT tag=RBBTQMRLFPUL type=del size=1620694 2024-09-12T17:36:51.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.348+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=BWEJJQ3WJC2C type=del size=2161883 2024-09-12T17:36:51.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.352+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~H5XRFOE48T0A.0 size=390394 2024-09-12T17:36:51.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.356+0000 7f1ad43488c0 1 < completed multipart upload key=8U3L46JDJ8VS upload=H5XRFOE48T0A tag=23VLEIXB1VPH type=write size=1438970 2024-09-12T17:36:51.360 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.360+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=86C2THL5K0N1 type=del size=3987770 2024-09-12T17:36:51.361 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.360+0000 7f1ad43488c0 -1 < no bi entry to suggest for operation key=X0HT3K3OREL7 tag=95BEKJQBPUUB type=write size=526001: (2) No such file or directory 2024-09-12T17:36:51.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.364+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=SPM1US14O0VT type=del size=429441 2024-09-12T17:36:51.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.364+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=AC3JO82MEGLQ type=del 2024-09-12T17:36:51.369 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.368+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=EI6JHUVZM6XC type=del size=163361 2024-09-12T17:36:51.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.372+0000 7f1ad43488c0 1 < completed write operation key=RXJJOPR32OD5 tag=Q5RR5HEYUH4J type=write size=481145 2024-09-12T17:36:51.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.376+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~2D9OMEJ3FMT5.0 size=1048576 2024-09-12T17:36:51.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.376+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~2D9OMEJ3FMT5.1 size=1048576 2024-09-12T17:36:51.381 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.380+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~2D9OMEJ3FMT5.2 size=125209 2024-09-12T17:36:51.381 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.380+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=2D9OMEJ3FMT5 tag=3CQQAHN2GCAZ type=write size=3270937 2024-09-12T17:36:51.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.380+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=ADZNAS2COVHI type=del 2024-09-12T17:36:51.387 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.384+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~P4POWKJOVWNX.0 size=1048576 2024-09-12T17:36:51.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.388+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~P4POWKJOVWNX.1 size=993663 2024-09-12T17:36:51.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.388+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=P4POWKJOVWNX tag=SMRR3Z29IF8R type=write size=3090815 2024-09-12T17:36:51.390 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.388+0000 7f1ad43488c0 1 < canceled part key=_multipart_SDJ53NSPOIRC.2~ERBSKO4Y3L7Y.0 size=1048576 2024-09-12T17:36:51.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.392+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~ERBSKO4Y3L7Y.1 size=51420 2024-09-12T17:36:51.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.396+0000 7f1ad43488c0 1 < canceled multipart upload key=SDJ53NSPOIRC upload=ERBSKO4Y3L7Y tag=I340QUG2CHGR type=write size=2148572 2024-09-12T17:36:51.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.396+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=9Z3PZPWH7L89 type=del size=2273293 2024-09-12T17:36:51.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.400+0000 7f1ad43488c0 1 < completed delete operation key=9Z2EHQA8T5F4 tag=66VYB69L0UIO type=del 2024-09-12T17:36:51.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.404+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~V781AGC6ABRZ.0 size=1048576 2024-09-12T17:36:51.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.408+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~V781AGC6ABRZ.1 size=739790 2024-09-12T17:36:51.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.408+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=V781AGC6ABRZ tag=33T4HKQ207OI type=write size=2836942 2024-09-12T17:36:51.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.408+0000 7f1ad43488c0 1 < completed write operation key=MB3FVGKV0ZNQ tag=0DY2DNJTFJNO type=write size=285727 2024-09-12T17:36:51.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.412+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=LUUPE9CHKKHL type=write size=836097 2024-09-12T17:36:51.415 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.416+0000 7f1ad43488c0 1 < completed delete operation key=ECEF8IJGU4Z8 tag=XXBV1I5KM1T7 type=del 2024-09-12T17:36:51.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.416+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=07QCEDVC771Y type=write size=910871 2024-09-12T17:36:51.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.420+0000 7f1ad43488c0 1 < completed delete operation key=9Z2EHQA8T5F4 tag=4UZSLFECFISW type=del 2024-09-12T17:36:51.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.424+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=QFRYROQYC5ES type=del size=838740 2024-09-12T17:36:51.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.424+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~XRVGKQSWXG46.0 size=1048576 2024-09-12T17:36:51.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.428+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~XRVGKQSWXG46.1 size=42055 2024-09-12T17:36:51.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.432+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=XRVGKQSWXG46 tag=I14RC9SCSCQ7 type=write size=2139207 2024-09-12T17:36:51.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.436+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=16F3T8HXUDCH type=write size=214080 2024-09-12T17:36:51.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.440+0000 7f1ad43488c0 1 < suggested update operation key=8U3L46JDJ8VS tag=LPTEO16LB7AZ type=del size=1025065 2024-09-12T17:36:51.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.444+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~FTUBQJ7L9FYC.0 size=276686 2024-09-12T17:36:51.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.444+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=FTUBQJ7L9FYC tag=IDYUIKSGNYOG type=write size=1325262 2024-09-12T17:36:51.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.444+0000 7f1ad43488c0 1 < canceled part key=_multipart_ZHFRKX9YY8P5.2~1KXGGZTPOUYB.0 size=1048576 2024-09-12T17:36:51.448 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.448+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~1KXGGZTPOUYB.1 size=1048576 2024-09-12T17:36:51.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.448+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~1KXGGZTPOUYB.2 size=167915 2024-09-12T17:36:51.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.456+0000 7f1ad43488c0 1 < canceled multipart upload key=ZHFRKX9YY8P5 upload=1KXGGZTPOUYB tag=P47O6XEOFT0F type=write size=3313643 2024-09-12T17:36:51.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.460+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~WFXD0B1F7KYO.0 size=1048576 2024-09-12T17:36:51.463 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.464+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~WFXD0B1F7KYO.1 size=1048576 2024-09-12T17:36:51.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.464+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~WFXD0B1F7KYO.2 size=803338 2024-09-12T17:36:51.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.464+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=WFXD0B1F7KYO tag=5S9DU71TDX3X type=write size=3949066 2024-09-12T17:36:51.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.472+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=829KXTSO91ZD type=del 2024-09-12T17:36:51.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.476+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~LKG4N19INRP5.0 size=1048576 2024-09-12T17:36:51.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.476+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~LKG4N19INRP5.1 size=1048576 2024-09-12T17:36:51.481 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.480+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~LKG4N19INRP5.2 size=130839 2024-09-12T17:36:51.481 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.480+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=LKG4N19INRP5 tag=EY1LTGW7KTVR type=write size=3276567 2024-09-12T17:36:51.484 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.484+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~6TB3GRWA15QS.0 size=1048576 2024-09-12T17:36:51.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.484+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~6TB3GRWA15QS.1 size=181543 2024-09-12T17:36:51.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.492+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=6TB3GRWA15QS tag=OQNBRAPWD05Q type=write size=2278695 2024-09-12T17:36:51.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.496+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~L9VB3MRBAG1S.0 size=1048576 2024-09-12T17:36:51.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.500+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~L9VB3MRBAG1S.1 size=1048576 2024-09-12T17:36:51.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.500+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~L9VB3MRBAG1S.2 size=173929 2024-09-12T17:36:51.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.500+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=L9VB3MRBAG1S tag=HDGOEOICA4N9 type=write size=3319657 2024-09-12T17:36:51.508 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.508+0000 7f1ad43488c0 1 < suggested remove operation key=RXJJOPR32OD5 tag=BWEJJQ3WJC2C type=del 2024-09-12T17:36:51.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.512+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~LDC0FKPU71MC.0 size=1048576 2024-09-12T17:36:51.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.516+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~LDC0FKPU71MC.1 size=1048576 2024-09-12T17:36:51.518 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.516+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~LDC0FKPU71MC.2 size=829757 2024-09-12T17:36:51.518 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.516+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=LDC0FKPU71MC tag=HH0K2915FCS3 type=write size=3975485 2024-09-12T17:36:51.521 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.520+0000 7f1ad43488c0 1 < canceled operation key=A49CE02X3L2L tag=86C2THL5K0N1 type=del size=3987770 2024-09-12T17:36:51.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.524+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=KTVPMNP05NYL type=del size=1403399 2024-09-12T17:36:51.527 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.524+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=SPM1US14O0VT type=del 2024-09-12T17:36:51.529 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.528+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=LDLNWPV5OGDF type=write size=5555 2024-09-12T17:36:51.534 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.532+0000 7f1ad43488c0 1 < suggested remove operation key=C7QSOK3D3IWJ tag=EI6JHUVZM6XC type=del 2024-09-12T17:36:51.537 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.536+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=KK67HC6TLZYK type=del size=1930445 2024-09-12T17:36:51.539 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.540+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~2D9OMEJ3FMT5.0 size=1048576 2024-09-12T17:36:51.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.540+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~2D9OMEJ3FMT5.1 size=1048576 2024-09-12T17:36:51.543 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.544+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~2D9OMEJ3FMT5.2 size=125209 2024-09-12T17:36:51.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.548+0000 7f1ad43488c0 1 < completed multipart upload key=MB3FVGKV0ZNQ upload=2D9OMEJ3FMT5 tag=3CQQAHN2GCAZ type=write size=3270937 2024-09-12T17:36:51.551 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.548+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=LBSFOKH7VORT type=del size=2596538 2024-09-12T17:36:51.553 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.552+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~P4POWKJOVWNX.0 size=1048576 2024-09-12T17:36:51.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.556+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~P4POWKJOVWNX.1 size=993663 2024-09-12T17:36:51.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.560+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=P4POWKJOVWNX tag=SMRR3Z29IF8R type=write size=3090815 2024-09-12T17:36:51.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.564+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~KGSTCSZDNFFU.0 size=1048576 2024-09-12T17:36:51.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.564+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~KGSTCSZDNFFU.1 size=1048576 2024-09-12T17:36:51.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.568+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~KGSTCSZDNFFU.2 size=615155 2024-09-12T17:36:51.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.568+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=KGSTCSZDNFFU tag=Q8OMW8AKFPIX type=write size=3760883 2024-09-12T17:36:51.571 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.572+0000 7f1ad43488c0 1 < completed delete operation key=ZHFRKX9YY8P5 tag=9Z3PZPWH7L89 type=del 2024-09-12T17:36:51.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.572+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=4KQB6T6LGBMZ type=del size=4000412 2024-09-12T17:36:51.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.576+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~V781AGC6ABRZ.0 size=1048576 2024-09-12T17:36:51.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.576+0000 7f1ad43488c0 1 < canceled part key=_multipart_ECEF8IJGU4Z8.2~V781AGC6ABRZ.1 size=739790 2024-09-12T17:36:51.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.580+0000 7f1ad43488c0 1 < canceled multipart upload key=ECEF8IJGU4Z8 upload=V781AGC6ABRZ tag=33T4HKQ207OI type=write size=2836942 2024-09-12T17:36:51.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.584+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=8EXB6ZRVWFLK type=del size=579881 2024-09-12T17:36:51.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.588+0000 7f1ad43488c0 1 < suggested update operation key=BCPDXAL027U2 tag=LUUPE9CHKKHL type=write size=836097 2024-09-12T17:36:51.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.588+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=VKD8PQ0HY9P8 type=del size=2456294 2024-09-12T17:36:51.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.592+0000 7f1ad43488c0 1 < completed write operation key=PKC1RR4FZWE0 tag=07QCEDVC771Y type=write size=910871 2024-09-12T17:36:51.597 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.596+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~VPV5L92FRD65.0 size=1048576 2024-09-12T17:36:51.599 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.596+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~VPV5L92FRD65.1 size=983257 2024-09-12T17:36:51.599 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.596+0000 7f1ad43488c0 1 > prepared multipart upload key=9Z2EHQA8T5F4 upload=VPV5L92FRD65 tag=K4QQ5KUIEYTU type=write size=3080409 2024-09-12T17:36:51.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.600+0000 7f1ad43488c0 1 < completed delete operation key=X0HT3K3OREL7 tag=QFRYROQYC5ES type=del 2024-09-12T17:36:51.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.604+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=OXA87CTY8KUV type=del size=2359868 2024-09-12T17:36:51.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.604+0000 7f1ad43488c0 1 < completed write operation key=0MV3GCBTWZD0 tag=16F3T8HXUDCH type=write size=214080 2024-09-12T17:36:51.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.608+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~GSNRJKOGGSMN.0 size=1048576 2024-09-12T17:36:51.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.612+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~GSNRJKOGGSMN.1 size=1048576 2024-09-12T17:36:51.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.612+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~GSNRJKOGGSMN.2 size=139767 2024-09-12T17:36:51.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.612+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=GSNRJKOGGSMN tag=2JAPGX1G2D6H type=write size=3285495 2024-09-12T17:36:51.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.616+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~FTUBQJ7L9FYC.0 size=276686 2024-09-12T17:36:51.620 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.620+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=FTUBQJ7L9FYC tag=IDYUIKSGNYOG type=write size=1325262 2024-09-12T17:36:51.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.624+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~GPP3N2OZK869.0 size=1048576 2024-09-12T17:36:51.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.624+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~GPP3N2OZK869.1 size=1048576 2024-09-12T17:36:51.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.628+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~GPP3N2OZK869.2 size=171189 2024-09-12T17:36:51.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.628+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=GPP3N2OZK869 tag=T1YT1OF0FNG8 type=write size=3316917 2024-09-12T17:36:51.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.632+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~WFXD0B1F7KYO.0 size=1048576 2024-09-12T17:36:51.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.632+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~WFXD0B1F7KYO.1 size=1048576 2024-09-12T17:36:51.635 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.636+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~WFXD0B1F7KYO.2 size=803338 2024-09-12T17:36:51.639 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.636+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=WFXD0B1F7KYO tag=5S9DU71TDX3X type=write size=3949066 2024-09-12T17:36:51.642 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.640+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~OS8R45DR62SI.0 size=970717 2024-09-12T17:36:51.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.640+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=OS8R45DR62SI tag=FRMTAU2ARZBM type=write size=2019293 2024-09-12T17:36:51.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.644+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~LKG4N19INRP5.0 size=1048576 2024-09-12T17:36:51.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.644+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~LKG4N19INRP5.1 size=1048576 2024-09-12T17:36:51.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.648+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~LKG4N19INRP5.2 size=130839 2024-09-12T17:36:51.652 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.652+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=LKG4N19INRP5 tag=EY1LTGW7KTVR type=write size=3276567 2024-09-12T17:36:51.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.656+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~APK1R2WNYDGJ.0 size=493101 2024-09-12T17:36:51.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.656+0000 7f1ad43488c0 1 > prepared multipart upload key=CHMM14VRIOQH upload=APK1R2WNYDGJ tag=MKCESYGY9KP0 type=write size=1541677 2024-09-12T17:36:51.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.656+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~L9VB3MRBAG1S.0 size=1048576 2024-09-12T17:36:51.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.660+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~L9VB3MRBAG1S.1 size=1048576 2024-09-12T17:36:51.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.660+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~L9VB3MRBAG1S.2 size=173929 2024-09-12T17:36:51.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.664+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=L9VB3MRBAG1S tag=HDGOEOICA4N9 type=write size=3319657 2024-09-12T17:36:51.668 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.668+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=4Y6D4R129H7Y type=del size=3790821 2024-09-12T17:36:51.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.668+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~LDC0FKPU71MC.0 size=1048576 2024-09-12T17:36:51.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.672+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~LDC0FKPU71MC.1 size=1048576 2024-09-12T17:36:51.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.672+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~LDC0FKPU71MC.2 size=829757 2024-09-12T17:36:51.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.676+0000 7f1ad43488c0 1 < completed multipart upload key=WWB6LAHAMIR9 upload=LDC0FKPU71MC tag=HH0K2915FCS3 type=write size=3975485 2024-09-12T17:36:51.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.680+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~6S4Q2NWKVIRJ.0 size=1048576 2024-09-12T17:36:51.683 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.684+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~6S4Q2NWKVIRJ.1 size=457484 2024-09-12T17:36:51.683 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.684+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=6S4Q2NWKVIRJ tag=GS0R4206PYJU type=write size=2554636 2024-09-12T17:36:51.685 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.684+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=KTVPMNP05NYL type=del 2024-09-12T17:36:51.687 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.688+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=8LID5OBE8I15 type=write size=254843 2024-09-12T17:36:51.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.692+0000 7f1ad43488c0 1 < suggested update operation key=WFEJLVRCKIUU tag=LDLNWPV5OGDF type=write size=5555 2024-09-12T17:36:51.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.692+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=64S86BW902P1 type=del size=441822 2024-09-12T17:36:51.699 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.700+0000 7f1ad43488c0 1 < completed delete operation key=ECEF8IJGU4Z8 tag=KK67HC6TLZYK type=del 2024-09-12T17:36:51.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.700+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=9R9Z40OMM0CY type=del size=2567003 2024-09-12T17:36:51.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.704+0000 7f1ad43488c0 1 < suggested update operation key=ECEF8IJGU4Z8 tag=LBSFOKH7VORT type=del size=2596538 2024-09-12T17:36:51.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.708+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~P6MD0GSNPPBU.0 size=744808 2024-09-12T17:36:51.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.708+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=P6MD0GSNPPBU tag=7II0RH5GGZTJ type=write size=1793384 2024-09-12T17:36:51.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.712+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~KGSTCSZDNFFU.0 size=1048576 2024-09-12T17:36:51.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.712+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~KGSTCSZDNFFU.1 size=1048576 2024-09-12T17:36:51.716 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.716+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~KGSTCSZDNFFU.2 size=615155 2024-09-12T17:36:51.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.720+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=KGSTCSZDNFFU tag=Q8OMW8AKFPIX type=write size=3760883 2024-09-12T17:36:51.724 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.724+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~Q21M5247VY6T.0 size=943887 2024-09-12T17:36:51.724 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.724+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=Q21M5247VY6T tag=Q2ILOM3VGI9B type=write size=1992463 2024-09-12T17:36:51.726 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.724+0000 7f1ad43488c0 1 < completed delete operation key=WWB6LAHAMIR9 tag=4KQB6T6LGBMZ type=del 2024-09-12T17:36:51.729 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.728+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=QW5625WRQSAN type=del size=1771612 2024-09-12T17:36:51.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.732+0000 7f1ad43488c0 1 < suggested update operation key=SDJ53NSPOIRC tag=8EXB6ZRVWFLK type=del size=579881 2024-09-12T17:36:51.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.736+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=9DYITTD0P96S type=del size=2850554 2024-09-12T17:36:51.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.740+0000 7f1ad43488c0 1 < suggested update operation key=2SDYAQRNWAJK tag=VKD8PQ0HY9P8 type=del size=2456294 2024-09-12T17:36:51.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.744+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=19IAKV702TQO type=del size=3465395 2024-09-12T17:36:51.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.744+0000 7f1ad43488c0 1 < canceled part key=_multipart_9Z2EHQA8T5F4.2~VPV5L92FRD65.0 size=1048576 2024-09-12T17:36:51.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.744+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~VPV5L92FRD65.1 size=983257 2024-09-12T17:36:51.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.748+0000 7f1ad43488c0 1 < canceled multipart upload key=9Z2EHQA8T5F4 upload=VPV5L92FRD65 tag=K4QQ5KUIEYTU type=write size=3080409 2024-09-12T17:36:51.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.752+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=Z60JRMQ2ZVTR type=del size=1168621 2024-09-12T17:36:51.754 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.752+0000 7f1ad43488c0 -1 < failed to complete operation key=SDJ53NSPOIRC tag=OXA87CTY8KUV type=del size=2359868: (22) Invalid argument 2024-09-12T17:36:51.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.756+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=7YHZORM0CS1N type=del size=3447955 2024-09-12T17:36:51.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.760+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~GSNRJKOGGSMN.0 size=1048576 2024-09-12T17:36:51.761 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.760+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~GSNRJKOGGSMN.1 size=1048576 2024-09-12T17:36:51.764 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.764+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~GSNRJKOGGSMN.2 size=139767 2024-09-12T17:36:51.768 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.768+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=GSNRJKOGGSMN tag=2JAPGX1G2D6H type=write size=3285495 2024-09-12T17:36:51.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.772+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~HA3O2HZ102LO.0 size=170003 2024-09-12T17:36:51.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.772+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=HA3O2HZ102LO tag=9U2UFQ8IHQQP type=write size=1218579 2024-09-12T17:36:51.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.772+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~GPP3N2OZK869.0 size=1048576 2024-09-12T17:36:51.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.776+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~GPP3N2OZK869.1 size=1048576 2024-09-12T17:36:51.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.780+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~GPP3N2OZK869.2 size=171189 2024-09-12T17:36:51.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.784+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=GPP3N2OZK869 tag=T1YT1OF0FNG8 type=write size=3316917 2024-09-12T17:36:51.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.784+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=JMDKLCCLUEZK type=write size=610804 2024-09-12T17:36:51.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.788+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~OS8R45DR62SI.0 size=970717 2024-09-12T17:36:51.792 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.792+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=OS8R45DR62SI tag=FRMTAU2ARZBM type=write size=2019293 2024-09-12T17:36:51.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.796+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=JEX8QJ6JC9W2 type=write size=335828 2024-09-12T17:36:51.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.796+0000 7f1ad43488c0 1 < canceled part key=_multipart_CHMM14VRIOQH.2~APK1R2WNYDGJ.0 size=493101 2024-09-12T17:36:51.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.800+0000 7f1ad43488c0 1 < canceled multipart upload key=CHMM14VRIOQH upload=APK1R2WNYDGJ tag=MKCESYGY9KP0 type=write size=1541677 2024-09-12T17:36:51.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.804+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~G21S6RO8XNIP.0 size=452529 2024-09-12T17:36:51.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.804+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=G21S6RO8XNIP tag=V9RLJYB2ITNH type=write size=1501105 2024-09-12T17:36:51.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.808+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=4Y6D4R129H7Y type=del 2024-09-12T17:36:51.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.808+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=VWZ0ZRKF0VE0 type=del size=2043290 2024-09-12T17:36:51.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.812+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~6S4Q2NWKVIRJ.0 size=1048576 2024-09-12T17:36:51.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.816+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~6S4Q2NWKVIRJ.1 size=457484 2024-09-12T17:36:51.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.820+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=6S4Q2NWKVIRJ tag=GS0R4206PYJU type=write size=2554636 2024-09-12T17:36:51.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.824+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=0GTC35C4D7J8 type=del size=3936870 2024-09-12T17:36:51.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.824+0000 7f1ad43488c0 1 < completed write operation key=NHOG1WG3VT6N tag=8LID5OBE8I15 type=write size=254843 2024-09-12T17:36:51.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.828+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=Z0EE43HCVFK7 type=del size=1033626 2024-09-12T17:36:51.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.832+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=64S86BW902P1 type=del 2024-09-12T17:36:51.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.832+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=XSGNQ1K7L0KC type=del size=431366 2024-09-12T17:36:51.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.840+0000 7f1ad43488c0 1 < suggested update operation key=LU7XIBO5YUOR tag=9R9Z40OMM0CY type=del size=2567003 2024-09-12T17:36:51.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.844+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~BN1B7S0MN7PI.0 size=783786 2024-09-12T17:36:51.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.844+0000 7f1ad43488c0 1 > prepared multipart upload key=RH4HYE315U5Y upload=BN1B7S0MN7PI tag=R98DMCHM6FQ1 type=write size=1832362 2024-09-12T17:36:51.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.848+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~P6MD0GSNPPBU.0 size=744808 2024-09-12T17:36:51.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.852+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=P6MD0GSNPPBU tag=7II0RH5GGZTJ type=write size=1793384 2024-09-12T17:36:51.855 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.852+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=HMO6MHEQ3GTF type=del size=3927734 2024-09-12T17:36:51.855 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.856+0000 7f1ad43488c0 1 < canceled part key=_multipart_ECEF8IJGU4Z8.2~Q21M5247VY6T.0 size=943887 2024-09-12T17:36:51.860 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.860+0000 7f1ad43488c0 1 < canceled multipart upload key=ECEF8IJGU4Z8 upload=Q21M5247VY6T tag=Q2ILOM3VGI9B type=write size=1992463 2024-09-12T17:36:51.865 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.864+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~BKSE8CZCCGUK.0 size=92004 2024-09-12T17:36:51.865 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.864+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=BKSE8CZCCGUK tag=VC4FIM1GL4WS type=write size=1140580 2024-09-12T17:36:51.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.868+0000 7f1ad43488c0 1 < completed delete operation key=WWB6LAHAMIR9 tag=QW5625WRQSAN type=del 2024-09-12T17:36:51.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.872+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=S3I58PCZOTQQ type=write size=144990 2024-09-12T17:36:51.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.872+0000 7f1ad43488c0 1 < completed delete operation key=WFEJLVRCKIUU tag=9DYITTD0P96S type=del 2024-09-12T17:36:51.876 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.876+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=E1SGB03GLU42 type=write size=798923 2024-09-12T17:36:51.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.880+0000 7f1ad43488c0 1 < suggested update operation key=GWJ78NNXOL1R tag=19IAKV702TQO type=del size=3465395 2024-09-12T17:36:51.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.884+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=D1NOQQF2OS4D type=del size=1527534 2024-09-12T17:36:51.888 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.888+0000 7f1ad43488c0 1 < canceled operation key=Y3NQLDWQJ37Z tag=Z60JRMQ2ZVTR type=del size=1168621 2024-09-12T17:36:51.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.892+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=EAM62BBXMX9L type=del size=3354509 2024-09-12T17:36:51.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.892+0000 7f1ad43488c0 1 < completed delete operation key=2SDYAQRNWAJK tag=7YHZORM0CS1N type=del 2024-09-12T17:36:51.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.896+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=RY4HLI0505LS type=write size=139631 2024-09-12T17:36:51.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.900+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~HA3O2HZ102LO.0 size=170003 2024-09-12T17:36:51.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.904+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=HA3O2HZ102LO tag=9U2UFQ8IHQQP type=write size=1218579 2024-09-12T17:36:51.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.908+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~PUB7PFRJA9C4.0 size=1048576 2024-09-12T17:36:51.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.912+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~PUB7PFRJA9C4.1 size=1048576 2024-09-12T17:36:51.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.916+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~PUB7PFRJA9C4.2 size=390190 2024-09-12T17:36:51.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.916+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=PUB7PFRJA9C4 tag=9O5481ZOFUFA type=write size=3535918 2024-09-12T17:36:51.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.920+0000 7f1ad43488c0 1 < suggested update operation key=2SDYAQRNWAJK tag=JMDKLCCLUEZK type=write size=610804 2024-09-12T17:36:51.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.924+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=6X5IA36QDB83 type=del size=2147887 2024-09-12T17:36:51.926 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.924+0000 7f1ad43488c0 1 < completed write operation key=0MV3GCBTWZD0 tag=JEX8QJ6JC9W2 type=write size=335828 2024-09-12T17:36:51.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.932+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~J7XIY95C342H.0 size=257961 2024-09-12T17:36:51.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.932+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=J7XIY95C342H tag=O3J2ESAAHA04 type=write size=1306537 2024-09-12T17:36:51.935 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.932+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~G21S6RO8XNIP.0 size=452529 2024-09-12T17:36:51.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.940+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=G21S6RO8XNIP tag=V9RLJYB2ITNH type=write size=1501105 2024-09-12T17:36:51.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.944+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=5VOVEPCTEUIV type=del size=704655 2024-09-12T17:36:51.951 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.952+0000 7f1ad43488c0 1 < suggested update operation key=GZ7LGZQHW4CY tag=VWZ0ZRKF0VE0 type=del size=2043290 2024-09-12T17:36:51.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.952+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=8IPX7YY37VKB type=del size=2122220 2024-09-12T17:36:51.957 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.956+0000 7f1ad43488c0 1 < completed delete operation key=SDJ53NSPOIRC tag=0GTC35C4D7J8 type=del 2024-09-12T17:36:51.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.960+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=GNP5H3R7YUNW type=write size=313547 2024-09-12T17:36:51.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.964+0000 7f1ad43488c0 1 < completed delete operation key=ECEF8IJGU4Z8 tag=Z0EE43HCVFK7 type=del 2024-09-12T17:36:51.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.968+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~77W7E3GZXQ5F.0 size=1048576 2024-09-12T17:36:51.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.968+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~77W7E3GZXQ5F.1 size=977794 2024-09-12T17:36:51.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.968+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=77W7E3GZXQ5F tag=MESTSMRSX978 type=write size=3074946 2024-09-12T17:36:51.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.972+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=XSGNQ1K7L0KC type=del 2024-09-12T17:36:51.975 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.976+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=SP9W1M804T7X type=del size=3897500 2024-09-12T17:36:51.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.976+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~BN1B7S0MN7PI.0 size=783786 2024-09-12T17:36:51.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.980+0000 7f1ad43488c0 1 < completed multipart upload key=RH4HYE315U5Y upload=BN1B7S0MN7PI tag=R98DMCHM6FQ1 type=write size=1832362 2024-09-12T17:36:51.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.984+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=YHEAM3PF2Z9M type=del size=3402716 2024-09-12T17:36:51.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.988+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=HMO6MHEQ3GTF type=del 2024-09-12T17:36:51.991 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.988+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=2F3VD9D61VTB type=del size=1577727 2024-09-12T17:36:51.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.992+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~BKSE8CZCCGUK.0 size=92004 2024-09-12T17:36:51.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:51.996+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=BKSE8CZCCGUK tag=VC4FIM1GL4WS type=write size=1140580 2024-09-12T17:36:52.002 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.000+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~YQFQ319ZHFHT.0 size=1048576 2024-09-12T17:36:52.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.004+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~YQFQ319ZHFHT.1 size=1048576 2024-09-12T17:36:52.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.004+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~YQFQ319ZHFHT.2 size=989388 2024-09-12T17:36:52.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.004+0000 7f1ad43488c0 1 > prepared multipart upload key=GWJ78NNXOL1R upload=YQFQ319ZHFHT tag=V0OYWLFYZDF9 type=write size=4135116 2024-09-12T17:36:52.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.008+0000 7f1ad43488c0 1 < completed write operation key=PKC1RR4FZWE0 tag=S3I58PCZOTQQ type=write size=144990 2024-09-12T17:36:52.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.012+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=68VNVO3B3188 type=del size=4011824 2024-09-12T17:36:52.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.016+0000 7f1ad43488c0 1 < completed write operation key=SDJ53NSPOIRC tag=E1SGB03GLU42 type=write size=798923 2024-09-12T17:36:52.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.016+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=YIY4P96ZWCAF type=del size=675377 2024-09-12T17:36:52.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.020+0000 7f1ad43488c0 1 < canceled operation key=4QO60GZ9V0GK tag=D1NOQQF2OS4D type=del size=1527534 2024-09-12T17:36:52.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.024+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=RI0EJ9C52LKT type=del size=1019081 2024-09-12T17:36:52.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.024+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=EAM62BBXMX9L type=del 2024-09-12T17:36:52.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.032+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~1OQ1CY0ZW1KA.0 size=1048576 2024-09-12T17:36:52.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.032+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~1OQ1CY0ZW1KA.1 size=1048576 2024-09-12T17:36:52.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.036+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~1OQ1CY0ZW1KA.2 size=155924 2024-09-12T17:36:52.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.036+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=1OQ1CY0ZW1KA tag=W6FAKVGIRXJ2 type=write size=3301652 2024-09-12T17:36:52.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.044+0000 7f1ad43488c0 1 < suggested remove operation key=GZ7LGZQHW4CY tag=RY4HLI0505LS type=write 2024-09-12T17:36:52.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.044+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=LRBDXFG6ZEFA type=write size=411108 2024-09-12T17:36:52.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.048+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~PUB7PFRJA9C4.0 size=1048576 2024-09-12T17:36:52.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.052+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~PUB7PFRJA9C4.1 size=1048576 2024-09-12T17:36:52.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.052+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~PUB7PFRJA9C4.2 size=390190 2024-09-12T17:36:52.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.060+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=PUB7PFRJA9C4 tag=9O5481ZOFUFA type=write size=3535918 2024-09-12T17:36:52.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.064+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~8W00ZGICQX0X.0 size=1048576 2024-09-12T17:36:52.068 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.068+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~8W00ZGICQX0X.1 size=1048576 2024-09-12T17:36:52.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.072+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~8W00ZGICQX0X.2 size=648707 2024-09-12T17:36:52.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.072+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=8W00ZGICQX0X tag=QJZOOHUWX61G type=write size=3794435 2024-09-12T17:36:52.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.072+0000 7f1ad43488c0 1 < completed delete operation key=9Z2EHQA8T5F4 tag=6X5IA36QDB83 type=del 2024-09-12T17:36:52.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.080+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~2EK9HFYSPCGC.0 size=1048576 2024-09-12T17:36:52.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.080+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~2EK9HFYSPCGC.1 size=199256 2024-09-12T17:36:52.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.080+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=2EK9HFYSPCGC tag=4V99P7VEX39L type=write size=2296408 2024-09-12T17:36:52.086 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.084+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~J7XIY95C342H.0 size=257961 2024-09-12T17:36:52.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.092+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=J7XIY95C342H tag=O3J2ESAAHA04 type=write size=1306537 2024-09-12T17:36:52.098 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.096+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~V0JW4M7D54J4.0 size=1048576 2024-09-12T17:36:52.100 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.100+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~V0JW4M7D54J4.1 size=1048576 2024-09-12T17:36:52.103 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.100+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~V0JW4M7D54J4.2 size=340069 2024-09-12T17:36:52.103 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.100+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=V0JW4M7D54J4 tag=GME2JOHKN1MF type=write size=3485797 2024-09-12T17:36:52.106 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.104+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=5VOVEPCTEUIV type=del 2024-09-12T17:36:52.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.108+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=X588BYM9FZI1 type=del size=829096 2024-09-12T17:36:52.113 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.112+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=8IPX7YY37VKB type=del 2024-09-12T17:36:52.116 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.116+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=7PBGPFX97PSI type=write size=289698 2024-09-12T17:36:52.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.120+0000 7f1ad43488c0 1 < completed write operation key=9Z2EHQA8T5F4 tag=GNP5H3R7YUNW type=write size=313547 2024-09-12T17:36:52.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.124+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~UQFOKOF1S8B3.0 size=1048576 2024-09-12T17:36:52.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.128+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~UQFOKOF1S8B3.1 size=1048576 2024-09-12T17:36:52.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.128+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~UQFOKOF1S8B3.2 size=1005965 2024-09-12T17:36:52.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.128+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=UQFOKOF1S8B3 tag=54CJSJ99PWCJ type=write size=4151693 2024-09-12T17:36:52.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.132+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~77W7E3GZXQ5F.0 size=1048576 2024-09-12T17:36:52.136 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.136+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~77W7E3GZXQ5F.1 size=977794 2024-09-12T17:36:52.142 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.140+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=77W7E3GZXQ5F tag=MESTSMRSX978 type=write size=3074946 2024-09-12T17:36:52.148 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.148+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~LCB7NKETAQUS.0 size=746858 2024-09-12T17:36:52.148 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.148+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=LCB7NKETAQUS tag=5678WIZ3ECOY type=write size=1795434 2024-09-12T17:36:52.152 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.152+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=SP9W1M804T7X type=del 2024-09-12T17:36:52.157 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.156+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~4VO9V3WRSFO5.0 size=1048576 2024-09-12T17:36:52.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.160+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~4VO9V3WRSFO5.1 size=1048576 2024-09-12T17:36:52.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.160+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~4VO9V3WRSFO5.2 size=764632 2024-09-12T17:36:52.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.160+0000 7f1ad43488c0 1 > prepared multipart upload key=C7QSOK3D3IWJ upload=4VO9V3WRSFO5 tag=2BN00PDR3CSE type=write size=3910360 2024-09-12T17:36:52.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.164+0000 7f1ad43488c0 1 < completed delete operation key=IY2AM7CJDUZG tag=YHEAM3PF2Z9M type=del 2024-09-12T17:36:52.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.172+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~P3YPBKG0O4SP.0 size=1048576 2024-09-12T17:36:52.175 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.172+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~P3YPBKG0O4SP.1 size=1048576 2024-09-12T17:36:52.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.176+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~P3YPBKG0O4SP.2 size=80121 2024-09-12T17:36:52.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.176+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=P3YPBKG0O4SP tag=51V602I8JGHL type=write size=3225849 2024-09-12T17:36:52.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.180+0000 7f1ad43488c0 1 < canceled operation key=LU7XIBO5YUOR tag=2F3VD9D61VTB type=del size=1577727 2024-09-12T17:36:52.184 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.184+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=GK41JSD8H1O4 type=del size=1025287 2024-09-12T17:36:52.187 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.188+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~YQFQ319ZHFHT.0 size=1048576 2024-09-12T17:36:52.190 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.188+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~YQFQ319ZHFHT.1 size=1048576 2024-09-12T17:36:52.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.192+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~YQFQ319ZHFHT.2 size=989388 2024-09-12T17:36:52.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.196+0000 7f1ad43488c0 1 < completed multipart upload key=GWJ78NNXOL1R upload=YQFQ319ZHFHT tag=V0OYWLFYZDF9 type=write size=4135116 2024-09-12T17:36:52.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.200+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=JMCXFPY29T55 type=write size=289103 2024-09-12T17:36:52.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.208+0000 7f1ad43488c0 1 < suggested update operation key=A49CE02X3L2L tag=68VNVO3B3188 type=del size=4011824 2024-09-12T17:36:52.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.216+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~U1UBUCYDPU3Q.0 size=1048576 2024-09-12T17:36:52.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.220+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~U1UBUCYDPU3Q.1 size=1048576 2024-09-12T17:36:52.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.220+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~U1UBUCYDPU3Q.2 size=555064 2024-09-12T17:36:52.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.220+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=U1UBUCYDPU3Q tag=HKAAK8Y07BZ8 type=write size=3700792 2024-09-12T17:36:52.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.224+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=YIY4P96ZWCAF type=del 2024-09-12T17:36:52.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.232+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~AE87Y7UKN16V.0 size=1048576 2024-09-12T17:36:52.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.232+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~AE87Y7UKN16V.1 size=843543 2024-09-12T17:36:52.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.232+0000 7f1ad43488c0 1 > prepared multipart upload key=ZHFRKX9YY8P5 upload=AE87Y7UKN16V tag=8AJ452FFH14R type=write size=2940695 2024-09-12T17:36:52.242 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.240+0000 7f1ad43488c0 1 < completed delete operation key=XOEPYERWY6IT tag=RI0EJ9C52LKT type=del 2024-09-12T17:36:52.246 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.244+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=W67TC0ZM4F1O type=del size=2707405 2024-09-12T17:36:52.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.248+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~1OQ1CY0ZW1KA.0 size=1048576 2024-09-12T17:36:52.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.252+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~1OQ1CY0ZW1KA.1 size=1048576 2024-09-12T17:36:52.257 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.256+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~1OQ1CY0ZW1KA.2 size=155924 2024-09-12T17:36:52.264 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.264+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=1OQ1CY0ZW1KA tag=W6FAKVGIRXJ2 type=write size=3301652 2024-09-12T17:36:52.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.268+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~6LKE8AHCAR3B.0 size=1048576 2024-09-12T17:36:52.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.272+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~6LKE8AHCAR3B.1 size=272775 2024-09-12T17:36:52.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.272+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=6LKE8AHCAR3B tag=J02RM8A10LAM type=write size=2369927 2024-09-12T17:36:52.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.276+0000 7f1ad43488c0 1 < completed write operation key=RXJJOPR32OD5 tag=LRBDXFG6ZEFA type=write size=411108 2024-09-12T17:36:52.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.280+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~RT01686YGZ1W.0 size=1048576 2024-09-12T17:36:52.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.284+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~RT01686YGZ1W.1 size=626448 2024-09-12T17:36:52.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.284+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=RT01686YGZ1W tag=TWQ24890MV6F type=write size=2723600 2024-09-12T17:36:52.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.288+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~8W00ZGICQX0X.0 size=1048576 2024-09-12T17:36:52.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.288+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~8W00ZGICQX0X.1 size=1048576 2024-09-12T17:36:52.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.292+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~8W00ZGICQX0X.2 size=648707 2024-09-12T17:36:52.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.300+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=8W00ZGICQX0X tag=QJZOOHUWX61G type=write size=3794435 2024-09-12T17:36:52.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.300+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=POJYGFAJ3GUH type=del size=2287206 2024-09-12T17:36:52.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.304+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~2EK9HFYSPCGC.0 size=1048576 2024-09-12T17:36:52.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.308+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~2EK9HFYSPCGC.1 size=199256 2024-09-12T17:36:52.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.312+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=2EK9HFYSPCGC tag=4V99P7VEX39L type=write size=2296408 2024-09-12T17:36:52.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.316+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=UE0ITSKF276W type=write size=613181 2024-09-12T17:36:52.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.320+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~V0JW4M7D54J4.0 size=1048576 2024-09-12T17:36:52.322 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.320+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~V0JW4M7D54J4.1 size=1048576 2024-09-12T17:36:52.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.324+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~V0JW4M7D54J4.2 size=340069 2024-09-12T17:36:52.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.328+0000 7f1ad43488c0 1 < completed multipart upload key=WWB6LAHAMIR9 upload=V0JW4M7D54J4 tag=GME2JOHKN1MF type=write size=3485797 2024-09-12T17:36:52.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.336+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~QF20X2H8NAXG.0 size=1048576 2024-09-12T17:36:52.339 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.340+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~QF20X2H8NAXG.1 size=1048576 2024-09-12T17:36:52.342 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.340+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~QF20X2H8NAXG.2 size=582545 2024-09-12T17:36:52.342 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.340+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=QF20X2H8NAXG tag=3FR6B3X7LJSW type=write size=3728273 2024-09-12T17:36:52.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.344+0000 7f1ad43488c0 1 < completed delete operation key=MB3FVGKV0ZNQ tag=X588BYM9FZI1 type=del 2024-09-12T17:36:52.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.348+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=50ZPNUW0JVH7 type=write size=902827 2024-09-12T17:36:52.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.348+0000 7f1ad43488c0 1 < completed write operation key=3N1YT9TC0M3O tag=7PBGPFX97PSI type=write size=289698 2024-09-12T17:36:52.355 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.356+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~6ZDDFASX49XO.0 size=1048576 2024-09-12T17:36:52.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.356+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~6ZDDFASX49XO.1 size=447961 2024-09-12T17:36:52.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.356+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=6ZDDFASX49XO tag=IZU7MM1N4J3T type=write size=2545113 2024-09-12T17:36:52.360 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.360+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~UQFOKOF1S8B3.0 size=1048576 2024-09-12T17:36:52.362 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.360+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~UQFOKOF1S8B3.1 size=1048576 2024-09-12T17:36:52.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.364+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~UQFOKOF1S8B3.2 size=1005965 2024-09-12T17:36:52.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.372+0000 7f1ad43488c0 1 < completed multipart upload key=IY2AM7CJDUZG upload=UQFOKOF1S8B3 tag=54CJSJ99PWCJ type=write size=4151693 2024-09-12T17:36:52.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.376+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~BRXGIDM7S3XQ.0 size=1048576 2024-09-12T17:36:52.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.380+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~BRXGIDM7S3XQ.1 size=1048576 2024-09-12T17:36:52.381 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.380+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~BRXGIDM7S3XQ.2 size=958342 2024-09-12T17:36:52.381 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.380+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=BRXGIDM7S3XQ tag=PSGOVI1X03CD type=write size=4104070 2024-09-12T17:36:52.384 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.384+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~LCB7NKETAQUS.0 size=746858 2024-09-12T17:36:52.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.388+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=LCB7NKETAQUS tag=5678WIZ3ECOY type=write size=1795434 2024-09-12T17:36:52.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.392+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=K50OBIHU9IGX type=del size=1377929 2024-09-12T17:36:52.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.396+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~4VO9V3WRSFO5.0 size=1048576 2024-09-12T17:36:52.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.396+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~4VO9V3WRSFO5.1 size=1048576 2024-09-12T17:36:52.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.400+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~4VO9V3WRSFO5.2 size=764632 2024-09-12T17:36:52.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.404+0000 7f1ad43488c0 1 < completed multipart upload key=C7QSOK3D3IWJ upload=4VO9V3WRSFO5 tag=2BN00PDR3CSE type=write size=3910360 2024-09-12T17:36:52.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.408+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=P1YCHM3NZUOX type=del size=3890637 2024-09-12T17:36:52.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.412+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~P3YPBKG0O4SP.0 size=1048576 2024-09-12T17:36:52.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.412+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~P3YPBKG0O4SP.1 size=1048576 2024-09-12T17:36:52.415 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.416+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~P3YPBKG0O4SP.2 size=80121 2024-09-12T17:36:52.420 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.420+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=P3YPBKG0O4SP tag=51V602I8JGHL type=write size=3225849 2024-09-12T17:36:52.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.424+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=D8MUHEVQZ9XG type=del size=349573 2024-09-12T17:36:52.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.424+0000 7f1ad43488c0 1 < canceled operation key=MB3FVGKV0ZNQ tag=GK41JSD8H1O4 type=del size=1025287 2024-09-12T17:36:52.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.428+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~3S4B05WRM6CM.0 size=1048576 2024-09-12T17:36:52.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.432+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~3S4B05WRM6CM.1 size=1048576 2024-09-12T17:36:52.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.432+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~3S4B05WRM6CM.2 size=340950 2024-09-12T17:36:52.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.432+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=3S4B05WRM6CM tag=VM8KG342WOAD type=write size=3486678 2024-09-12T17:36:52.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.440+0000 7f1ad43488c0 1 < suggested update operation key=8U3L46JDJ8VS tag=JMCXFPY29T55 type=write size=289103 2024-09-12T17:36:52.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.440+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=3BPWP3JD15RJ type=del size=2648435 2024-09-12T17:36:52.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.444+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~U1UBUCYDPU3Q.0 size=1048576 2024-09-12T17:36:52.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.448+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~U1UBUCYDPU3Q.1 size=1048576 2024-09-12T17:36:52.449 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.448+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~U1UBUCYDPU3Q.2 size=555064 2024-09-12T17:36:52.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.452+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=U1UBUCYDPU3Q tag=HKAAK8Y07BZ8 type=write size=3700792 2024-09-12T17:36:52.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.456+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=6PYC1JUSCBQA type=del size=510987 2024-09-12T17:36:52.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.456+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~AE87Y7UKN16V.0 size=1048576 2024-09-12T17:36:52.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.460+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~AE87Y7UKN16V.1 size=843543 2024-09-12T17:36:52.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.464+0000 7f1ad43488c0 1 < completed multipart upload key=ZHFRKX9YY8P5 upload=AE87Y7UKN16V tag=8AJ452FFH14R type=write size=2940695 2024-09-12T17:36:52.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.468+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=H1RVFOLFX41V type=write size=586805 2024-09-12T17:36:52.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.468+0000 7f1ad43488c0 1 < completed delete operation key=IY2AM7CJDUZG tag=W67TC0ZM4F1O type=del 2024-09-12T17:36:52.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.472+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=SZ7ED72QVL1T type=del size=3033162 2024-09-12T17:36:52.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.476+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~6LKE8AHCAR3B.0 size=1048576 2024-09-12T17:36:52.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.476+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~6LKE8AHCAR3B.1 size=272775 2024-09-12T17:36:52.482 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.480+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=6LKE8AHCAR3B tag=J02RM8A10LAM type=write size=2369927 2024-09-12T17:36:52.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.484+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=WMZW3A44W4AZ type=del size=2375400 2024-09-12T17:36:52.488 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.488+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~RT01686YGZ1W.0 size=1048576 2024-09-12T17:36:52.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.488+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~RT01686YGZ1W.1 size=626448 2024-09-12T17:36:52.496 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.496+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=RT01686YGZ1W tag=TWQ24890MV6F type=write size=2723600 2024-09-12T17:36:52.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.496+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=R57Z274T38AR type=write size=816557 2024-09-12T17:36:52.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.500+0000 7f1ad43488c0 1 < completed delete operation key=9Z2EHQA8T5F4 tag=POJYGFAJ3GUH type=del 2024-09-12T17:36:52.507 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.504+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~F7MJIK8W2TKJ.0 size=1048576 2024-09-12T17:36:52.509 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.508+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~F7MJIK8W2TKJ.1 size=1048576 2024-09-12T17:36:52.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.516+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~F7MJIK8W2TKJ.2 size=91065 2024-09-12T17:36:52.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.516+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=F7MJIK8W2TKJ tag=RESTZUSUB1Z4 type=write size=3236793 2024-09-12T17:36:52.518 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.516+0000 7f1ad43488c0 1 < completed write operation key=SIZ0Z1KWTGUJ tag=UE0ITSKF276W type=write size=613181 2024-09-12T17:36:52.521 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.520+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=DE2VU7GIC85E type=del size=452556 2024-09-12T17:36:52.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.524+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~QF20X2H8NAXG.0 size=1048576 2024-09-12T17:36:52.526 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.524+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~QF20X2H8NAXG.1 size=1048576 2024-09-12T17:36:52.528 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.528+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~QF20X2H8NAXG.2 size=582545 2024-09-12T17:36:52.532 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.532+0000 7f1ad43488c0 1 < completed multipart upload key=8U3L46JDJ8VS upload=QF20X2H8NAXG tag=3FR6B3X7LJSW type=write size=3728273 2024-09-12T17:36:52.537 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.536+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~IB8IGVE9SRI1.0 size=1048576 2024-09-12T17:36:52.539 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.540+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~IB8IGVE9SRI1.1 size=918790 2024-09-12T17:36:52.539 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.540+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=IB8IGVE9SRI1 tag=9U4BMQKSP2EX type=write size=3015942 2024-09-12T17:36:52.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.540+0000 7f1ad43488c0 1 < completed write operation key=MB3FVGKV0ZNQ tag=50ZPNUW0JVH7 type=write size=902827 2024-09-12T17:36:52.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.544+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=U1D5IK0AWF6N type=del size=2542186 2024-09-12T17:36:52.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.544+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~6ZDDFASX49XO.0 size=1048576 2024-09-12T17:36:52.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.548+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~6ZDDFASX49XO.1 size=447961 2024-09-12T17:36:52.553 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.552+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=6ZDDFASX49XO tag=IZU7MM1N4J3T type=write size=2545113 2024-09-12T17:36:52.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.556+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=NN7KGD84PQEW type=del size=2773701 2024-09-12T17:36:52.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.556+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~BRXGIDM7S3XQ.0 size=1048576 2024-09-12T17:36:52.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.560+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~BRXGIDM7S3XQ.1 size=1048576 2024-09-12T17:36:52.562 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.560+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~BRXGIDM7S3XQ.2 size=958342 2024-09-12T17:36:52.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.568+0000 7f1ad43488c0 1 < completed multipart upload key=MB3FVGKV0ZNQ upload=BRXGIDM7S3XQ tag=PSGOVI1X03CD type=write size=4104070 2024-09-12T17:36:52.572 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.572+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~Y12W3N6UOGYD.0 size=1048576 2024-09-12T17:36:52.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.572+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~Y12W3N6UOGYD.1 size=1048576 2024-09-12T17:36:52.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.576+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~Y12W3N6UOGYD.2 size=381318 2024-09-12T17:36:52.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.576+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=Y12W3N6UOGYD tag=TY21DGVJDRMQ type=write size=3527046 2024-09-12T17:36:52.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.576+0000 7f1ad43488c0 1 < completed delete operation key=SIZ0Z1KWTGUJ tag=K50OBIHU9IGX type=del 2024-09-12T17:36:52.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.580+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=C6LCNLAH00GF type=write size=196607 2024-09-12T17:36:52.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.584+0000 7f1ad43488c0 1 < suggested remove operation key=RXJJOPR32OD5 tag=P1YCHM3NZUOX type=del 2024-09-12T17:36:52.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.588+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=MY9H4G0NXDDZ type=del size=2538037 2024-09-12T17:36:52.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.588+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=D8MUHEVQZ9XG type=del 2024-09-12T17:36:52.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.592+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=GDA0LBEAKRJG type=del size=1903694 2024-09-12T17:36:52.595 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.596+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~3S4B05WRM6CM.0 size=1048576 2024-09-12T17:36:52.597 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.596+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~3S4B05WRM6CM.1 size=1048576 2024-09-12T17:36:52.599 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.600+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~3S4B05WRM6CM.2 size=340950 2024-09-12T17:36:52.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.604+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=3S4B05WRM6CM tag=VM8KG342WOAD type=write size=3486678 2024-09-12T17:36:52.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.608+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~T1QJ4OVVAQWH.0 size=1048576 2024-09-12T17:36:52.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.608+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~T1QJ4OVVAQWH.1 size=697149 2024-09-12T17:36:52.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.608+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=T1QJ4OVVAQWH tag=KVRQYCIXL2PN type=write size=2794301 2024-09-12T17:36:52.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.616+0000 7f1ad43488c0 1 < suggested update operation key=ZHFRKX9YY8P5 tag=3BPWP3JD15RJ type=del size=2648435 2024-09-12T17:36:52.620 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.620+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~YZRFVE3KVXLC.0 size=1048576 2024-09-12T17:36:52.622 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.620+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~YZRFVE3KVXLC.1 size=1048576 2024-09-12T17:36:52.624 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.624+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~YZRFVE3KVXLC.2 size=10835 2024-09-12T17:36:52.624 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.624+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=YZRFVE3KVXLC tag=TGUJ7Q2V5HMI type=write size=3156563 2024-09-12T17:36:52.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.624+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=6PYC1JUSCBQA type=del 2024-09-12T17:36:52.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.632+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~4BU4NEF11WH2.0 size=1048576 2024-09-12T17:36:52.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.632+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~4BU4NEF11WH2.1 size=1048576 2024-09-12T17:36:52.635 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.636+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~4BU4NEF11WH2.2 size=395711 2024-09-12T17:36:52.635 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.636+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=4BU4NEF11WH2 tag=C3J76K7JQV17 type=write size=3541439 2024-09-12T17:36:52.641 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.640+0000 7f1ad43488c0 1 < suggested update operation key=ZHFRKX9YY8P5 tag=H1RVFOLFX41V type=write size=586805 2024-09-12T17:36:52.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.644+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~GP6MG61S2Z8V.0 size=155677 2024-09-12T17:36:52.647 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.644+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=GP6MG61S2Z8V tag=YWKN26K4LPU9 type=write size=1204253 2024-09-12T17:36:52.652 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.652+0000 7f1ad43488c0 1 < suggested update operation key=RH4HYE315U5Y tag=SZ7ED72QVL1T type=del size=3033162 2024-09-12T17:36:52.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.656+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~57OTLJIAG71I.0 size=1048576 2024-09-12T17:36:52.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.656+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~57OTLJIAG71I.1 size=497437 2024-09-12T17:36:52.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.656+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=57OTLJIAG71I tag=5VX10OHQ7KFO type=write size=2594589 2024-09-12T17:36:52.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.660+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=WMZW3A44W4AZ type=del 2024-09-12T17:36:52.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.664+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=PXGWYT226LXB type=del size=491312 2024-09-12T17:36:52.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.664+0000 7f1ad43488c0 1 < completed write operation key=A49CE02X3L2L tag=R57Z274T38AR type=write size=816557 2024-09-12T17:36:52.668 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.668+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=ADZ7B4ESAWPX type=del size=1172354 2024-09-12T17:36:52.671 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.672+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~F7MJIK8W2TKJ.0 size=1048576 2024-09-12T17:36:52.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.672+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~F7MJIK8W2TKJ.1 size=1048576 2024-09-12T17:36:52.675 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.676+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~F7MJIK8W2TKJ.2 size=91065 2024-09-12T17:36:52.679 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.680+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=F7MJIK8W2TKJ tag=RESTZUSUB1Z4 type=write size=3236793 2024-09-12T17:36:52.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.680+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=S2BQP9UA23C4 type=del size=2511667 2024-09-12T17:36:52.684 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.684+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=DE2VU7GIC85E type=del 2024-09-12T17:36:52.689 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.688+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~5SV07NIT2D77.0 size=1048576 2024-09-12T17:36:52.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.692+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~5SV07NIT2D77.1 size=840808 2024-09-12T17:36:52.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.692+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=5SV07NIT2D77 tag=1XBAVD9EL00B type=write size=2937960 2024-09-12T17:36:52.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.692+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~IB8IGVE9SRI1.0 size=1048576 2024-09-12T17:36:52.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.696+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~IB8IGVE9SRI1.1 size=918790 2024-09-12T17:36:52.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.700+0000 7f1ad43488c0 1 < completed multipart upload key=7RSHIZRKK2OY upload=IB8IGVE9SRI1 tag=9U4BMQKSP2EX type=write size=3015942 2024-09-12T17:36:52.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.704+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~JXEOZZWO5XZ9.0 size=1048576 2024-09-12T17:36:52.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.708+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~JXEOZZWO5XZ9.1 size=160300 2024-09-12T17:36:52.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.708+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=JXEOZZWO5XZ9 tag=Y602P3WDZ4X5 type=write size=2257452 2024-09-12T17:36:52.713 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.712+0000 7f1ad43488c0 1 < suggested update operation key=ZHFRKX9YY8P5 tag=U1D5IK0AWF6N type=del size=2542186 2024-09-12T17:36:52.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.716+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~UOQNLBRUKEV1.0 size=1048576 2024-09-12T17:36:52.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.720+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~UOQNLBRUKEV1.1 size=1048576 2024-09-12T17:36:52.722 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.720+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~UOQNLBRUKEV1.2 size=208646 2024-09-12T17:36:52.722 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.720+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=UOQNLBRUKEV1 tag=KOZBFD3KDQDR type=write size=3354374 2024-09-12T17:36:52.725 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.724+0000 7f1ad43488c0 1 < canceled operation key=Y3NQLDWQJ37Z tag=NN7KGD84PQEW type=del size=2773701 2024-09-12T17:36:52.728 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.728+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=BYS8RERL22PI type=write size=545934 2024-09-12T17:36:52.730 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.728+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~Y12W3N6UOGYD.0 size=1048576 2024-09-12T17:36:52.732 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.732+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~Y12W3N6UOGYD.1 size=1048576 2024-09-12T17:36:52.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.732+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~Y12W3N6UOGYD.2 size=381318 2024-09-12T17:36:52.738 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.736+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=Y12W3N6UOGYD tag=TY21DGVJDRMQ type=write size=3527046 2024-09-12T17:36:52.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.740+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=XDW83AI9D625 type=del size=617311 2024-09-12T17:36:52.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.744+0000 7f1ad43488c0 1 < completed write operation key=3N1YT9TC0M3O tag=C6LCNLAH00GF type=write size=196607 2024-09-12T17:36:52.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.748+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~1UEH5KEE4YI7.0 size=131895 2024-09-12T17:36:52.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.748+0000 7f1ad43488c0 1 > prepared multipart upload key=ZHFRKX9YY8P5 upload=1UEH5KEE4YI7 tag=DX7373Y6RVF4 type=write size=1180471 2024-09-12T17:36:52.754 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.752+0000 7f1ad43488c0 1 < canceled operation key=PKC1RR4FZWE0 tag=MY9H4G0NXDDZ type=del size=2538037 2024-09-12T17:36:52.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.760+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~ZOZ2ULPW2WC3.0 size=1048576 2024-09-12T17:36:52.761 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.760+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~ZOZ2ULPW2WC3.1 size=247530 2024-09-12T17:36:52.761 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.760+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=ZOZ2ULPW2WC3 tag=1PWX99MHNV09 type=write size=2344682 2024-09-12T17:36:52.764 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.764+0000 7f1ad43488c0 1 < canceled operation key=2SDYAQRNWAJK tag=GDA0LBEAKRJG type=del size=1903694 2024-09-12T17:36:52.769 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.768+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~QPDPLPL9I8YR.0 size=1048576 2024-09-12T17:36:52.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.772+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~QPDPLPL9I8YR.1 size=1048576 2024-09-12T17:36:52.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.772+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~QPDPLPL9I8YR.2 size=161974 2024-09-12T17:36:52.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.772+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=QPDPLPL9I8YR tag=WP611M53TPU3 type=write size=3307702 2024-09-12T17:36:52.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.776+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~T1QJ4OVVAQWH.0 size=1048576 2024-09-12T17:36:52.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.776+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~T1QJ4OVVAQWH.1 size=697149 2024-09-12T17:36:52.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.780+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=T1QJ4OVVAQWH tag=KVRQYCIXL2PN type=write size=2794301 2024-09-12T17:36:52.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.784+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=4Q6QY0EU1YG9 type=del size=1369853 2024-09-12T17:36:52.787 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.788+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~YZRFVE3KVXLC.0 size=1048576 2024-09-12T17:36:52.787 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.788+0000 7f1ad43488c0 1 < canceled part key=_multipart_BCPDXAL027U2.2~YZRFVE3KVXLC.1 size=1048576 2024-09-12T17:36:52.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.788+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~YZRFVE3KVXLC.2 size=10835 2024-09-12T17:36:52.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.792+0000 7f1ad43488c0 1 < canceled multipart upload key=BCPDXAL027U2 upload=YZRFVE3KVXLC tag=TGUJ7Q2V5HMI type=write size=3156563 2024-09-12T17:36:52.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.796+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=Y0SL2WLLU25O type=write size=922734 2024-09-12T17:36:52.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.796+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~4BU4NEF11WH2.0 size=1048576 2024-09-12T17:36:52.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.800+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~4BU4NEF11WH2.1 size=1048576 2024-09-12T17:36:52.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.800+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~4BU4NEF11WH2.2 size=395711 2024-09-12T17:36:52.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.804+0000 7f1ad43488c0 1 < completed multipart upload key=MB3FVGKV0ZNQ upload=4BU4NEF11WH2 tag=C3J76K7JQV17 type=write size=3541439 2024-09-12T17:36:52.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.812+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~0370120KTKQO.0 size=1048576 2024-09-12T17:36:52.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.812+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~0370120KTKQO.1 size=1048576 2024-09-12T17:36:52.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.816+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~0370120KTKQO.2 size=759881 2024-09-12T17:36:52.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.816+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=0370120KTKQO tag=8YT6EEJQBA01 type=write size=3905609 2024-09-12T17:36:52.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.816+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~GP6MG61S2Z8V.0 size=155677 2024-09-12T17:36:52.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.820+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=GP6MG61S2Z8V tag=YWKN26K4LPU9 type=write size=1204253 2024-09-12T17:36:52.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.824+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~5C67ACU9Q3HZ.0 size=629711 2024-09-12T17:36:52.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.824+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=5C67ACU9Q3HZ tag=VJ8M219B20MA type=write size=1678287 2024-09-12T17:36:52.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.828+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~57OTLJIAG71I.0 size=1048576 2024-09-12T17:36:52.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.828+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~57OTLJIAG71I.1 size=497437 2024-09-12T17:36:52.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.832+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=57OTLJIAG71I tag=5VX10OHQ7KFO type=write size=2594589 2024-09-12T17:36:52.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.836+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=CGFPLGKU1V24 type=del size=3330109 2024-09-12T17:36:52.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.840+0000 7f1ad43488c0 1 < canceled operation key=A49CE02X3L2L tag=PXGWYT226LXB type=del size=491312 2024-09-12T17:36:52.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.840+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=NGV0111QYLTH type=del size=1195362 2024-09-12T17:36:52.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.844+0000 7f1ad43488c0 1 < completed delete operation key=GWJ78NNXOL1R tag=ADZ7B4ESAWPX type=del 2024-09-12T17:36:52.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.848+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~61710WXUK0TU.0 size=1048576 2024-09-12T17:36:52.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.848+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~61710WXUK0TU.1 size=521918 2024-09-12T17:36:52.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.848+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=61710WXUK0TU tag=WYS7B4VIC0HB type=write size=2619070 2024-09-12T17:36:52.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.852+0000 7f1ad43488c0 1 < completed delete operation key=05PAFB226IFP tag=S2BQP9UA23C4 type=del 2024-09-12T17:36:52.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.856+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~8N1UDS9QPY5G.0 size=1048576 2024-09-12T17:36:52.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.856+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~8N1UDS9QPY5G.1 size=1045470 2024-09-12T17:36:52.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.856+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=8N1UDS9QPY5G tag=2545VCM5WLJS type=write size=3142622 2024-09-12T17:36:52.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.860+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~5SV07NIT2D77.0 size=1048576 2024-09-12T17:36:52.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.860+0000 7f1ad43488c0 1 < canceled part key=_multipart_MB3FVGKV0ZNQ.2~5SV07NIT2D77.1 size=840808 2024-09-12T17:36:52.864 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.864+0000 7f1ad43488c0 1 < canceled multipart upload key=MB3FVGKV0ZNQ upload=5SV07NIT2D77 tag=1XBAVD9EL00B type=write size=2937960 2024-09-12T17:36:52.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.864+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=2ESSYZJILV1T type=del size=2093141 2024-09-12T17:36:52.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.868+0000 7f1ad43488c0 1 < canceled part key=_multipart_X078SB1ITNII.2~JXEOZZWO5XZ9.0 size=1048576 2024-09-12T17:36:52.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.868+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~JXEOZZWO5XZ9.1 size=160300 2024-09-12T17:36:52.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.872+0000 7f1ad43488c0 1 < canceled multipart upload key=X078SB1ITNII upload=JXEOZZWO5XZ9 tag=Y602P3WDZ4X5 type=write size=2257452 2024-09-12T17:36:52.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.876+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=X81O1FOITSC8 type=write size=117416 2024-09-12T17:36:52.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.876+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~UOQNLBRUKEV1.0 size=1048576 2024-09-12T17:36:52.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.876+0000 7f1ad43488c0 1 < canceled part key=_multipart_8U3L46JDJ8VS.2~UOQNLBRUKEV1.1 size=1048576 2024-09-12T17:36:52.879 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.876+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~UOQNLBRUKEV1.2 size=208646 2024-09-12T17:36:52.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.880+0000 7f1ad43488c0 1 < canceled multipart upload key=8U3L46JDJ8VS upload=UOQNLBRUKEV1 tag=KOZBFD3KDQDR type=write size=3354374 2024-09-12T17:36:52.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.884+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~8FX1LDYDGMCR.0 size=1048576 2024-09-12T17:36:52.888 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.888+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~8FX1LDYDGMCR.1 size=626293 2024-09-12T17:36:52.888 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.888+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=8FX1LDYDGMCR tag=CGYXDKOLBY3L type=write size=2723445 2024-09-12T17:36:52.890 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.888+0000 7f1ad43488c0 1 < completed write operation key=RH4HYE315U5Y tag=BYS8RERL22PI type=write size=545934 2024-09-12T17:36:52.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.892+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=SFXW08HXTEXO type=del size=607879 2024-09-12T17:36:52.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.892+0000 7f1ad43488c0 1 < canceled operation key=NHOG1WG3VT6N tag=XDW83AI9D625 type=del size=617311 2024-09-12T17:36:52.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.896+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=H54BIFCM06RH type=del size=311818 2024-09-12T17:36:52.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.896+0000 7f1ad43488c0 1 < canceled part key=_multipart_ZHFRKX9YY8P5.2~1UEH5KEE4YI7.0 size=131895 2024-09-12T17:36:52.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.900+0000 7f1ad43488c0 1 < canceled multipart upload key=ZHFRKX9YY8P5 upload=1UEH5KEE4YI7 tag=DX7373Y6RVF4 type=write size=1180471 2024-09-12T17:36:52.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.904+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~E0KRQR8Z99O1.0 size=1048576 2024-09-12T17:36:52.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.904+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~E0KRQR8Z99O1.1 size=880265 2024-09-12T17:36:52.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.904+0000 7f1ad43488c0 1 > prepared multipart upload key=ZHFRKX9YY8P5 upload=E0KRQR8Z99O1 tag=BCWRPG1K06TH type=write size=2977417 2024-09-12T17:36:52.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.908+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~ZOZ2ULPW2WC3.0 size=1048576 2024-09-12T17:36:52.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.908+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~ZOZ2ULPW2WC3.1 size=247530 2024-09-12T17:36:52.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.912+0000 7f1ad43488c0 1 < completed multipart upload key=7RSHIZRKK2OY upload=ZOZ2ULPW2WC3 tag=1PWX99MHNV09 type=write size=2344682 2024-09-12T17:36:52.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.916+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=593RTIMCBO9A type=del size=2235403 2024-09-12T17:36:52.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.916+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~QPDPLPL9I8YR.0 size=1048576 2024-09-12T17:36:52.919 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.920+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~QPDPLPL9I8YR.1 size=1048576 2024-09-12T17:36:52.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.920+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~QPDPLPL9I8YR.2 size=161974 2024-09-12T17:36:52.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.924+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=QPDPLPL9I8YR tag=WP611M53TPU3 type=write size=3307702 2024-09-12T17:36:52.927 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.924+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=4NOOUMZ8DNJK type=write size=888194 2024-09-12T17:36:52.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.932+0000 7f1ad43488c0 1 < suggested update operation key=9Z2EHQA8T5F4 tag=4Q6QY0EU1YG9 type=del size=1369853 2024-09-12T17:36:52.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.936+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~1TQ0IIOVMWJF.0 size=1048576 2024-09-12T17:36:52.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.936+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~1TQ0IIOVMWJF.1 size=71358 2024-09-12T17:36:52.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.936+0000 7f1ad43488c0 1 > prepared multipart upload key=3N1YT9TC0M3O upload=1TQ0IIOVMWJF tag=VZTY0I3LAYPV type=write size=2168510 2024-09-12T17:36:52.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.940+0000 7f1ad43488c0 1 < completed write operation key=4QO60GZ9V0GK tag=Y0SL2WLLU25O type=write size=922734 2024-09-12T17:36:52.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.944+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=F5VRP4RS1JTO type=del size=1621738 2024-09-12T17:36:52.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.944+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~0370120KTKQO.0 size=1048576 2024-09-12T17:36:52.947 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.948+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~0370120KTKQO.1 size=1048576 2024-09-12T17:36:52.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.948+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~0370120KTKQO.2 size=759881 2024-09-12T17:36:52.953 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.952+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=0370120KTKQO tag=8YT6EEJQBA01 type=write size=3905609 2024-09-12T17:36:52.957 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.956+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~8KIJ6MVSJ74L.0 size=1048576 2024-09-12T17:36:52.958 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.956+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~8KIJ6MVSJ74L.1 size=1048576 2024-09-12T17:36:52.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.960+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~8KIJ6MVSJ74L.2 size=423692 2024-09-12T17:36:52.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.960+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=8KIJ6MVSJ74L tag=HVR35HOVMN0A type=write size=3569420 2024-09-12T17:36:52.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.960+0000 7f1ad43488c0 1 < canceled part key=_multipart_XOEPYERWY6IT.2~5C67ACU9Q3HZ.0 size=629711 2024-09-12T17:36:52.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.964+0000 7f1ad43488c0 1 < canceled multipart upload key=XOEPYERWY6IT upload=5C67ACU9Q3HZ tag=VJ8M219B20MA type=write size=1678287 2024-09-12T17:36:52.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.968+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~NY7TC7KBEZ5Q.0 size=1048576 2024-09-12T17:36:52.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.972+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~NY7TC7KBEZ5Q.1 size=1048576 2024-09-12T17:36:52.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.972+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~NY7TC7KBEZ5Q.2 size=428320 2024-09-12T17:36:52.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.972+0000 7f1ad43488c0 1 > prepared multipart upload key=NHOG1WG3VT6N upload=NY7TC7KBEZ5Q tag=N8EKVK5C87FX type=write size=3574048 2024-09-12T17:36:52.975 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.972+0000 7f1ad43488c0 1 < completed delete operation key=05PAFB226IFP tag=CGFPLGKU1V24 type=del 2024-09-12T17:36:52.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.976+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=IQCR8D8P70XG type=del size=3151552 2024-09-12T17:36:52.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.980+0000 7f1ad43488c0 1 < completed delete operation key=WWB6LAHAMIR9 tag=NGV0111QYLTH type=del 2024-09-12T17:36:52.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.980+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=LQ7XD3442T76 type=del size=374593 2024-09-12T17:36:52.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.980+0000 7f1ad43488c0 1 < canceled part key=_multipart_6Z3F28JHHEQS.2~61710WXUK0TU.0 size=1048576 2024-09-12T17:36:52.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.980+0000 7f1ad43488c0 1 < canceled part key=_multipart_6Z3F28JHHEQS.2~61710WXUK0TU.1 size=521918 2024-09-12T17:36:52.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.984+0000 7f1ad43488c0 1 < canceled multipart upload key=6Z3F28JHHEQS upload=61710WXUK0TU tag=WYS7B4VIC0HB type=write size=2619070 2024-09-12T17:36:52.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.988+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=CXQF2MYYWORV type=del size=1676416 2024-09-12T17:36:52.990 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.988+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~8N1UDS9QPY5G.0 size=1048576 2024-09-12T17:36:52.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.992+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~8N1UDS9QPY5G.1 size=1045470 2024-09-12T17:36:52.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.996+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=8N1UDS9QPY5G tag=2545VCM5WLJS type=write size=3142622 2024-09-12T17:36:52.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:52.996+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=C1VV98L8HGN2 type=del size=3076761 2024-09-12T17:36:53.000 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.000+0000 7f1ad43488c0 -1 < failed to complete operation key=9Z2EHQA8T5F4 tag=2ESSYZJILV1T type=del size=2093141: (22) Invalid argument 2024-09-12T17:36:53.002 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.000+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=JSFQ3RCAP9D3 type=del size=2116716 2024-09-12T17:36:53.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.004+0000 7f1ad43488c0 1 < completed write operation key=LU7XIBO5YUOR tag=X81O1FOITSC8 type=write size=117416 2024-09-12T17:36:53.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.008+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~1FPPQ9X8XNC8.0 size=340252 2024-09-12T17:36:53.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.008+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=1FPPQ9X8XNC8 tag=YEQTW3KAAL9J type=write size=1388828 2024-09-12T17:36:53.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.012+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~8FX1LDYDGMCR.0 size=1048576 2024-09-12T17:36:53.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.012+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~8FX1LDYDGMCR.1 size=626293 2024-09-12T17:36:53.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.016+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=8FX1LDYDGMCR tag=CGYXDKOLBY3L type=write size=2723445 2024-09-12T17:36:53.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.020+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=9S3W64CDSSZ5 type=del size=2038132 2024-09-12T17:36:53.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.020+0000 7f1ad43488c0 1 < canceled operation key=SDJ53NSPOIRC tag=SFXW08HXTEXO type=del size=607879 2024-09-12T17:36:53.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.024+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=E0Z0DIFFU97B type=write size=510827 2024-09-12T17:36:53.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.028+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=H54BIFCM06RH type=del 2024-09-12T17:36:53.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.032+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~95RQL00KGZFF.0 size=1048576 2024-09-12T17:36:53.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.032+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~95RQL00KGZFF.1 size=1048576 2024-09-12T17:36:53.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.036+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~95RQL00KGZFF.2 size=128005 2024-09-12T17:36:53.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.036+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=95RQL00KGZFF tag=S1ASJA6812XK type=write size=3273733 2024-09-12T17:36:53.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.036+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~E0KRQR8Z99O1.0 size=1048576 2024-09-12T17:36:53.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.040+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~E0KRQR8Z99O1.1 size=880265 2024-09-12T17:36:53.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.044+0000 7f1ad43488c0 1 < completed multipart upload key=ZHFRKX9YY8P5 upload=E0KRQR8Z99O1 tag=BCWRPG1K06TH type=write size=2977417 2024-09-12T17:36:53.046 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.044+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=62C72J0RAHXU type=del size=3228841 2024-09-12T17:36:53.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.048+0000 7f1ad43488c0 -1 < failed to complete operation key=9Z2EHQA8T5F4 tag=593RTIMCBO9A type=del size=2235403: (22) Invalid argument 2024-09-12T17:36:53.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.052+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~KGOFERDM45U7.0 size=1048576 2024-09-12T17:36:53.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.052+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~KGOFERDM45U7.1 size=1048576 2024-09-12T17:36:53.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.056+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~KGOFERDM45U7.2 size=849226 2024-09-12T17:36:53.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.056+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=KGOFERDM45U7 tag=LYPUI84IFVHK type=write size=3994954 2024-09-12T17:36:53.058 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.056+0000 7f1ad43488c0 1 < completed write operation key=WFEJLVRCKIUU tag=4NOOUMZ8DNJK type=write size=888194 2024-09-12T17:36:53.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.060+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=L6NJASI2GZU7 type=del size=596360 2024-09-12T17:36:53.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.060+0000 7f1ad43488c0 1 < canceled part key=_multipart_3N1YT9TC0M3O.2~1TQ0IIOVMWJF.0 size=1048576 2024-09-12T17:36:53.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.060+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~1TQ0IIOVMWJF.1 size=71358 2024-09-12T17:36:53.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.064+0000 7f1ad43488c0 1 < canceled multipart upload key=3N1YT9TC0M3O upload=1TQ0IIOVMWJF tag=VZTY0I3LAYPV type=write size=2168510 2024-09-12T17:36:53.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.068+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~HPED04KGRWZ7.0 size=1048576 2024-09-12T17:36:53.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.072+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~HPED04KGRWZ7.1 size=1048576 2024-09-12T17:36:53.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.072+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~HPED04KGRWZ7.2 size=1008138 2024-09-12T17:36:53.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.072+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=HPED04KGRWZ7 tag=89PIXETD38N7 type=write size=4153866 2024-09-12T17:36:53.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.076+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=F5VRP4RS1JTO type=del 2024-09-12T17:36:53.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.076+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=0EHN28NC1KR5 type=del size=1632788 2024-09-12T17:36:53.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.080+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~8KIJ6MVSJ74L.0 size=1048576 2024-09-12T17:36:53.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.084+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~8KIJ6MVSJ74L.1 size=1048576 2024-09-12T17:36:53.085 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.084+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~8KIJ6MVSJ74L.2 size=423692 2024-09-12T17:36:53.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.088+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=8KIJ6MVSJ74L tag=HVR35HOVMN0A type=write size=3569420 2024-09-12T17:36:53.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.092+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=3UD2LGNR2MJ6 type=write size=210113 2024-09-12T17:36:53.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.092+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~NY7TC7KBEZ5Q.0 size=1048576 2024-09-12T17:36:53.095 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.096+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~NY7TC7KBEZ5Q.1 size=1048576 2024-09-12T17:36:53.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.096+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~NY7TC7KBEZ5Q.2 size=428320 2024-09-12T17:36:53.102 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.100+0000 7f1ad43488c0 1 < completed multipart upload key=NHOG1WG3VT6N upload=NY7TC7KBEZ5Q tag=N8EKVK5C87FX type=write size=3574048 2024-09-12T17:36:53.104 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.104+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=VZAL1LJBTLJR type=write size=85079 2024-09-12T17:36:53.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.108+0000 7f1ad43488c0 1 < suggested remove operation key=NHOG1WG3VT6N tag=IQCR8D8P70XG type=del 2024-09-12T17:36:53.112 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.112+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=XLC6KIAS1MXA type=del size=1538368 2024-09-12T17:36:53.115 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.112+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=LQ7XD3442T76 type=del 2024-09-12T17:36:53.117 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.116+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=IOZFALD5S90Y type=del size=1373531 2024-09-12T17:36:53.123 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.120+0000 7f1ad43488c0 1 < suggested update operation key=ZHFRKX9YY8P5 tag=CXQF2MYYWORV type=del size=1676416 2024-09-12T17:36:53.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.124+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=H5SL1TB5BMC9 type=del size=3074789 2024-09-12T17:36:53.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.128+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=C1VV98L8HGN2 type=del 2024-09-12T17:36:53.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.132+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=QGX4HIFC0XNY type=del size=3156089 2024-09-12T17:36:53.136 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.136+0000 7f1ad43488c0 1 < canceled operation key=LU7XIBO5YUOR tag=JSFQ3RCAP9D3 type=del size=2116716 2024-09-12T17:36:53.139 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.140+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=97O2Z6JIY17M type=write size=247059 2024-09-12T17:36:53.140 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.140+0000 7f1ad43488c0 1 < canceled part key=_multipart_0MV3GCBTWZD0.2~1FPPQ9X8XNC8.0 size=340252 2024-09-12T17:36:53.144 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.144+0000 7f1ad43488c0 1 < canceled multipart upload key=0MV3GCBTWZD0 upload=1FPPQ9X8XNC8 tag=YEQTW3KAAL9J type=write size=1388828 2024-09-12T17:36:53.147 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.148+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=BZUHXR9TT78P type=write size=256131 2024-09-12T17:36:53.150 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.148+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=9S3W64CDSSZ5 type=del 2024-09-12T17:36:53.155 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.156+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~77Q01RAKHTXF.0 size=1048576 2024-09-12T17:36:53.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.156+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~77Q01RAKHTXF.1 size=580568 2024-09-12T17:36:53.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.156+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=77Q01RAKHTXF tag=BA4ULESWYZ08 type=write size=2677720 2024-09-12T17:36:53.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.160+0000 7f1ad43488c0 1 < completed write operation key=4QO60GZ9V0GK tag=E0Z0DIFFU97B type=write size=510827 2024-09-12T17:36:53.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.164+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=CU4SW8JMR13I type=del size=4004889 2024-09-12T17:36:53.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.164+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~95RQL00KGZFF.0 size=1048576 2024-09-12T17:36:53.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.164+0000 7f1ad43488c0 1 < canceled part key=_multipart_ECEF8IJGU4Z8.2~95RQL00KGZFF.1 size=1048576 2024-09-12T17:36:53.168 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.168+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~95RQL00KGZFF.2 size=128005 2024-09-12T17:36:53.173 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.172+0000 7f1ad43488c0 1 < canceled multipart upload key=ECEF8IJGU4Z8 upload=95RQL00KGZFF tag=S1ASJA6812XK type=write size=3273733 2024-09-12T17:36:53.176 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.176+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=GKPJ7CAXTF0L type=del size=1799031 2024-09-12T17:36:53.179 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.176+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=62C72J0RAHXU type=del 2024-09-12T17:36:53.182 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.180+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=2CQG20KKHPQN type=del size=3319100 2024-09-12T17:36:53.185 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.184+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~KGOFERDM45U7.0 size=1048576 2024-09-12T17:36:53.187 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.188+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~KGOFERDM45U7.1 size=1048576 2024-09-12T17:36:53.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.188+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~KGOFERDM45U7.2 size=849226 2024-09-12T17:36:53.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.192+0000 7f1ad43488c0 1 < completed multipart upload key=MB3FVGKV0ZNQ upload=KGOFERDM45U7 tag=LYPUI84IFVHK type=write size=3994954 2024-09-12T17:36:53.201 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.200+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=SGJ820LOL8DV type=del size=73623 2024-09-12T17:36:53.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.204+0000 7f1ad43488c0 1 < completed delete operation key=IY2AM7CJDUZG tag=L6NJASI2GZU7 type=del 2024-09-12T17:36:53.207 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.204+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=5HN11P4WRETB type=del size=3051884 2024-09-12T17:36:53.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.208+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~HPED04KGRWZ7.0 size=1048576 2024-09-12T17:36:53.213 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.212+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~HPED04KGRWZ7.1 size=1048576 2024-09-12T17:36:53.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.216+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~HPED04KGRWZ7.2 size=1008138 2024-09-12T17:36:53.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.220+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=HPED04KGRWZ7 tag=89PIXETD38N7 type=write size=4153866 2024-09-12T17:36:53.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.224+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=AR9OAR765UGP type=del size=1257905 2024-09-12T17:36:53.228 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.228+0000 7f1ad43488c0 1 < completed delete operation key=RH4HYE315U5Y tag=0EHN28NC1KR5 type=del 2024-09-12T17:36:53.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.232+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~CL6VN94VLM8V.0 size=1048576 2024-09-12T17:36:53.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.236+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~CL6VN94VLM8V.1 size=508120 2024-09-12T17:36:53.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.236+0000 7f1ad43488c0 1 > prepared multipart upload key=3N1YT9TC0M3O upload=CL6VN94VLM8V tag=BUHYC73O4UXA type=write size=2605272 2024-09-12T17:36:53.244 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.244+0000 7f1ad43488c0 1 < suggested update operation key=2SDYAQRNWAJK tag=3UD2LGNR2MJ6 type=write size=210113 2024-09-12T17:36:53.248 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.248+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=TVUMR46QH9KN type=write size=786203 2024-09-12T17:36:53.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.252+0000 7f1ad43488c0 1 < suggested remove operation key=C7QSOK3D3IWJ tag=VZAL1LJBTLJR type=write 2024-09-12T17:36:53.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.260+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~NKQAPN833F61.0 size=1048576 2024-09-12T17:36:53.263 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.264+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~NKQAPN833F61.1 size=1048576 2024-09-12T17:36:53.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.264+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~NKQAPN833F61.2 size=83269 2024-09-12T17:36:53.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.264+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=NKQAPN833F61 tag=Q2KORIB71FR0 type=write size=3228997 2024-09-12T17:36:53.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.268+0000 7f1ad43488c0 1 < completed delete operation key=NHOG1WG3VT6N tag=XLC6KIAS1MXA type=del 2024-09-12T17:36:53.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.272+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=EAQB1D708KEI type=write size=306256 2024-09-12T17:36:53.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.276+0000 7f1ad43488c0 -1 < failed to complete operation key=C7QSOK3D3IWJ tag=IOZFALD5S90Y type=del size=1373531: (22) Invalid argument 2024-09-12T17:36:53.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.280+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=5SA9PL4MSAGM type=del size=1115836 2024-09-12T17:36:53.283 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.280+0000 7f1ad43488c0 1 < completed delete operation key=NHOG1WG3VT6N tag=H5SL1TB5BMC9 type=del 2024-09-12T17:36:53.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.284+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=7DHPVQDMI7GU type=del size=3916154 2024-09-12T17:36:53.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.288+0000 7f1ad43488c0 1 < completed delete operation key=ZHFRKX9YY8P5 tag=QGX4HIFC0XNY type=del 2024-09-12T17:36:53.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.296+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~NEAKD3YFTVF7.0 size=1048576 2024-09-12T17:36:53.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.296+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~NEAKD3YFTVF7.1 size=1048576 2024-09-12T17:36:53.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.300+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~NEAKD3YFTVF7.2 size=1033940 2024-09-12T17:36:53.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.300+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=NEAKD3YFTVF7 tag=OL9LEMZSIPLB type=write size=4179668 2024-09-12T17:36:53.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.304+0000 7f1ad43488c0 1 < completed write operation key=IY2AM7CJDUZG tag=97O2Z6JIY17M type=write size=247059 2024-09-12T17:36:53.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.308+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~2SC8G548M5S0.0 size=1048576 2024-09-12T17:36:53.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.312+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~2SC8G548M5S0.1 size=749582 2024-09-12T17:36:53.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.312+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=2SC8G548M5S0 tag=7GIWNND8J2LH type=write size=2846734 2024-09-12T17:36:53.318 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.316+0000 7f1ad43488c0 1 < completed write operation key=X0HT3K3OREL7 tag=BZUHXR9TT78P type=write size=256131 2024-09-12T17:36:53.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.320+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=XP3W3GHEIHL1 type=del size=1827608 2024-09-12T17:36:53.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.324+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~77Q01RAKHTXF.0 size=1048576 2024-09-12T17:36:53.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.324+0000 7f1ad43488c0 1 < canceled part key=_multipart_LU7XIBO5YUOR.2~77Q01RAKHTXF.1 size=580568 2024-09-12T17:36:53.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.328+0000 7f1ad43488c0 1 < canceled multipart upload key=LU7XIBO5YUOR upload=77Q01RAKHTXF tag=BA4ULESWYZ08 type=write size=2677720 2024-09-12T17:36:53.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.332+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=3E4L5E852GVX type=del size=373978 2024-09-12T17:36:53.337 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.336+0000 7f1ad43488c0 -1 < failed to complete operation key=C7QSOK3D3IWJ tag=CU4SW8JMR13I type=del size=4004889: (22) Invalid argument 2024-09-12T17:36:53.343 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.344+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~OC23HQ3PJM8Z.0 size=1048576 2024-09-12T17:36:53.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.344+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~OC23HQ3PJM8Z.1 size=245283 2024-09-12T17:36:53.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.344+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=OC23HQ3PJM8Z tag=UX4R6Q4CHKDT type=write size=2342435 2024-09-12T17:36:53.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.348+0000 7f1ad43488c0 1 < canceled operation key=4QO60GZ9V0GK tag=GKPJ7CAXTF0L type=del size=1799031 2024-09-12T17:36:53.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.352+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=TFMMXGUA1SIE type=del size=1922664 2024-09-12T17:36:53.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.360+0000 7f1ad43488c0 1 < suggested remove operation key=0MV3GCBTWZD0 tag=2CQG20KKHPQN type=del 2024-09-12T17:36:53.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.364+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~QEPBWSFF9GG9.0 size=1034369 2024-09-12T17:36:53.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.364+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=QEPBWSFF9GG9 tag=BW32AMS6I5BA type=write size=2082945 2024-09-12T17:36:53.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.372+0000 7f1ad43488c0 1 < suggested remove operation key=3N1YT9TC0M3O tag=SGJ820LOL8DV type=del 2024-09-12T17:36:53.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.376+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~HHQTFM31NOIA.0 size=1048576 2024-09-12T17:36:53.381 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.380+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~HHQTFM31NOIA.1 size=104189 2024-09-12T17:36:53.381 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.380+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=HHQTFM31NOIA tag=V5SYZTMKOB4W type=write size=2201341 2024-09-12T17:36:53.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.384+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=5HN11P4WRETB type=del 2024-09-12T17:36:53.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.388+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=WKGU4Q6CVHSR type=del size=2855983 2024-09-12T17:36:53.391 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.392+0000 7f1ad43488c0 -1 < failed to complete operation key=2SDYAQRNWAJK tag=AR9OAR765UGP type=del size=1257905: (22) Invalid argument 2024-09-12T17:36:53.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.392+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=MX3WDHNFR4UN type=del size=2077887 2024-09-12T17:36:53.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.396+0000 7f1ad43488c0 1 < canceled part key=_multipart_3N1YT9TC0M3O.2~CL6VN94VLM8V.0 size=1048576 2024-09-12T17:36:53.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.396+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~CL6VN94VLM8V.1 size=508120 2024-09-12T17:36:53.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.404+0000 7f1ad43488c0 1 < canceled multipart upload key=3N1YT9TC0M3O upload=CL6VN94VLM8V tag=BUHYC73O4UXA type=write size=2605272 2024-09-12T17:36:53.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.404+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=9XMPW3OCUR91 type=del size=2742865 2024-09-12T17:36:53.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.408+0000 7f1ad43488c0 1 < completed write operation key=Y3NQLDWQJ37Z tag=TVUMR46QH9KN type=write size=786203 2024-09-12T17:36:53.415 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.416+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~57IFIEMN9QEL.0 size=1048576 2024-09-12T17:36:53.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.416+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~57IFIEMN9QEL.1 size=428296 2024-09-12T17:36:53.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.416+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=57IFIEMN9QEL tag=VG32O4P6J33W type=write size=2525448 2024-09-12T17:36:53.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.420+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~NKQAPN833F61.0 size=1048576 2024-09-12T17:36:53.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.424+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~NKQAPN833F61.1 size=1048576 2024-09-12T17:36:53.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.424+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~NKQAPN833F61.2 size=83269 2024-09-12T17:36:53.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.432+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=NKQAPN833F61 tag=Q2KORIB71FR0 type=write size=3228997 2024-09-12T17:36:53.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.436+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=3GA0KD8849JU type=del size=3259702 2024-09-12T17:36:53.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.436+0000 7f1ad43488c0 1 < completed write operation key=X078SB1ITNII tag=EAQB1D708KEI type=write size=306256 2024-09-12T17:36:53.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.440+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=CFWZB6ZLJM2B type=del size=839566 2024-09-12T17:36:53.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.444+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=5SA9PL4MSAGM type=del 2024-09-12T17:36:53.451 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.448+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~FELBHN7T0UNU.0 size=1048576 2024-09-12T17:36:53.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.452+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~FELBHN7T0UNU.1 size=1048576 2024-09-12T17:36:53.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.456+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~FELBHN7T0UNU.2 size=505538 2024-09-12T17:36:53.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.456+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=FELBHN7T0UNU tag=7PSGMJYSUT8P type=write size=3651266 2024-09-12T17:36:53.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.460+0000 7f1ad43488c0 1 < completed delete operation key=05PAFB226IFP tag=7DHPVQDMI7GU type=del 2024-09-12T17:36:53.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.464+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~JZBIEOURWPAF.0 size=231313 2024-09-12T17:36:53.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.464+0000 7f1ad43488c0 1 > prepared multipart upload key=GWJ78NNXOL1R upload=JZBIEOURWPAF tag=DW5BVMXGVGD2 type=write size=1279889 2024-09-12T17:36:53.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.468+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~NEAKD3YFTVF7.0 size=1048576 2024-09-12T17:36:53.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.468+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~NEAKD3YFTVF7.1 size=1048576 2024-09-12T17:36:53.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.472+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~NEAKD3YFTVF7.2 size=1033940 2024-09-12T17:36:53.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.476+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=NEAKD3YFTVF7 tag=OL9LEMZSIPLB type=write size=4179668 2024-09-12T17:36:53.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.484+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~Q7N64GOQ152F.0 size=634658 2024-09-12T17:36:53.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.484+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=Q7N64GOQ152F tag=5O0TTD9SBUVQ type=write size=1683234 2024-09-12T17:36:53.488 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.488+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~2SC8G548M5S0.0 size=1048576 2024-09-12T17:36:53.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.492+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~2SC8G548M5S0.1 size=749582 2024-09-12T17:36:53.496 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.496+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=2SC8G548M5S0 tag=7GIWNND8J2LH type=write size=2846734 2024-09-12T17:36:53.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.500+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=HG63XLKF66CH type=write size=360445 2024-09-12T17:36:53.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.500+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=XP3W3GHEIHL1 type=del 2024-09-12T17:36:53.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.512+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~8LPE3WXKJ2IA.0 size=1048576 2024-09-12T17:36:53.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.512+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~8LPE3WXKJ2IA.1 size=1048576 2024-09-12T17:36:53.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.516+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~8LPE3WXKJ2IA.2 size=989707 2024-09-12T17:36:53.518 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.516+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=8LPE3WXKJ2IA tag=H29M2SS5861Y type=write size=4135435 2024-09-12T17:36:53.521 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.520+0000 7f1ad43488c0 1 < completed delete operation key=NHOG1WG3VT6N tag=3E4L5E852GVX type=del 2024-09-12T17:36:53.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.524+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=7R2GHWQEWX8O type=write size=35137 2024-09-12T17:36:53.527 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.528+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~OC23HQ3PJM8Z.0 size=1048576 2024-09-12T17:36:53.529 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.528+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~OC23HQ3PJM8Z.1 size=245283 2024-09-12T17:36:53.534 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.532+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=OC23HQ3PJM8Z tag=UX4R6Q4CHKDT type=write size=2342435 2024-09-12T17:36:53.540 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.540+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~TQYX018X01JL.0 size=1048576 2024-09-12T17:36:53.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.540+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~TQYX018X01JL.1 size=534691 2024-09-12T17:36:53.543 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.540+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=TQYX018X01JL tag=T749C1L3XL6Z type=write size=2631843 2024-09-12T17:36:53.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.544+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=TFMMXGUA1SIE type=del 2024-09-12T17:36:53.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.548+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=FOLCE9QGI9VU type=del size=3164344 2024-09-12T17:36:53.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.548+0000 7f1ad43488c0 1 < canceled part key=_multipart_6Z3F28JHHEQS.2~QEPBWSFF9GG9.0 size=1034369 2024-09-12T17:36:53.554 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.552+0000 7f1ad43488c0 1 < canceled multipart upload key=6Z3F28JHHEQS upload=QEPBWSFF9GG9 tag=BW32AMS6I5BA type=write size=2082945 2024-09-12T17:36:53.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.560+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~FPSGNSZUPTRQ.0 size=1048576 2024-09-12T17:36:53.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.560+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~FPSGNSZUPTRQ.1 size=1048576 2024-09-12T17:36:53.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.564+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~FPSGNSZUPTRQ.2 size=865559 2024-09-12T17:36:53.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.564+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=FPSGNSZUPTRQ tag=A5BXJ8B1YN7L type=write size=4011287 2024-09-12T17:36:53.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.568+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~HHQTFM31NOIA.0 size=1048576 2024-09-12T17:36:53.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.568+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~HHQTFM31NOIA.1 size=104189 2024-09-12T17:36:53.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.576+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=HHQTFM31NOIA tag=V5SYZTMKOB4W type=write size=2201341 2024-09-12T17:36:53.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.576+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=5SDKOVFUWXTY type=del size=613204 2024-09-12T17:36:53.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.580+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=WKGU4Q6CVHSR type=del 2024-09-12T17:36:53.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.584+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=9Z0P87K7OQ4B type=write size=665083 2024-09-12T17:36:53.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.588+0000 7f1ad43488c0 1 < completed delete operation key=SIZ0Z1KWTGUJ tag=MX3WDHNFR4UN type=del 2024-09-12T17:36:53.595 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.596+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~I8NUO6P75GTE.0 size=1048576 2024-09-12T17:36:53.598 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.596+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~I8NUO6P75GTE.1 size=1048576 2024-09-12T17:36:53.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.600+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~I8NUO6P75GTE.2 size=857590 2024-09-12T17:36:53.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.600+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=I8NUO6P75GTE tag=IUWBIOOM9TY6 type=write size=4003318 2024-09-12T17:36:53.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.604+0000 7f1ad43488c0 1 < completed delete operation key=ECEF8IJGU4Z8 tag=9XMPW3OCUR91 type=del 2024-09-12T17:36:53.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.608+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=FW8VYUE8ZPWO type=del size=577764 2024-09-12T17:36:53.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.612+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~57IFIEMN9QEL.0 size=1048576 2024-09-12T17:36:53.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.616+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~57IFIEMN9QEL.1 size=428296 2024-09-12T17:36:53.623 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.620+0000 7f1ad43488c0 1 < completed multipart upload key=8U3L46JDJ8VS upload=57IFIEMN9QEL tag=VG32O4P6J33W type=write size=2525448 2024-09-12T17:36:53.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.624+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=AV0BCX2M99UR type=del size=359075 2024-09-12T17:36:53.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.628+0000 7f1ad43488c0 1 < canceled operation key=A49CE02X3L2L tag=3GA0KD8849JU type=del size=3259702 2024-09-12T17:36:53.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.636+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~AY1SE68GBPTD.0 size=1048576 2024-09-12T17:36:53.639 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.636+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~AY1SE68GBPTD.1 size=705378 2024-09-12T17:36:53.639 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.636+0000 7f1ad43488c0 1 > prepared multipart upload key=ZHFRKX9YY8P5 upload=AY1SE68GBPTD tag=FVBJWF01XS61 type=write size=2802530 2024-09-12T17:36:53.642 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.640+0000 7f1ad43488c0 1 < canceled operation key=RH4HYE315U5Y tag=CFWZB6ZLJM2B type=del size=839566 2024-09-12T17:36:53.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.644+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=RKPTM1FAP1F0 type=del size=3979814 2024-09-12T17:36:53.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.648+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~FELBHN7T0UNU.0 size=1048576 2024-09-12T17:36:53.652 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.652+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~FELBHN7T0UNU.1 size=1048576 2024-09-12T17:36:53.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.656+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~FELBHN7T0UNU.2 size=505538 2024-09-12T17:36:53.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.660+0000 7f1ad43488c0 1 < completed multipart upload key=IY2AM7CJDUZG upload=FELBHN7T0UNU tag=7PSGMJYSUT8P type=write size=3651266 2024-09-12T17:36:53.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.668+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~GRYPYSR4YWA8.0 size=127906 2024-09-12T17:36:53.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.668+0000 7f1ad43488c0 1 > prepared multipart upload key=9Z2EHQA8T5F4 upload=GRYPYSR4YWA8 tag=NSEBZYRN7OW1 type=write size=1176482 2024-09-12T17:36:53.668 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.668+0000 7f1ad43488c0 1 < canceled part key=_multipart_GWJ78NNXOL1R.2~JZBIEOURWPAF.0 size=231313 2024-09-12T17:36:53.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.672+0000 7f1ad43488c0 1 < canceled multipart upload key=GWJ78NNXOL1R upload=JZBIEOURWPAF tag=DW5BVMXGVGD2 type=write size=1279889 2024-09-12T17:36:53.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.676+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=CB524LNJ2LZI type=del size=4083507 2024-09-12T17:36:53.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.676+0000 7f1ad43488c0 1 < canceled part key=_multipart_0MV3GCBTWZD0.2~Q7N64GOQ152F.0 size=634658 2024-09-12T17:36:53.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.680+0000 7f1ad43488c0 1 < canceled multipart upload key=0MV3GCBTWZD0 upload=Q7N64GOQ152F tag=5O0TTD9SBUVQ type=write size=1683234 2024-09-12T17:36:53.686 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.684+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=JIJMI5AWX587 type=del size=1031432 2024-09-12T17:36:53.690 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.688+0000 7f1ad43488c0 1 < completed write operation key=GZ7LGZQHW4CY tag=HG63XLKF66CH type=write size=360445 2024-09-12T17:36:53.693 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.692+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=WWB53W6HNLV5 type=del size=771478 2024-09-12T17:36:53.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.696+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~8LPE3WXKJ2IA.0 size=1048576 2024-09-12T17:36:53.699 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.700+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~8LPE3WXKJ2IA.1 size=1048576 2024-09-12T17:36:53.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.700+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~8LPE3WXKJ2IA.2 size=989707 2024-09-12T17:36:53.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.708+0000 7f1ad43488c0 1 < completed multipart upload key=MB3FVGKV0ZNQ upload=8LPE3WXKJ2IA tag=H29M2SS5861Y type=write size=4135435 2024-09-12T17:36:53.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.712+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~KRDYYTUJ2D8I.0 size=1048576 2024-09-12T17:36:53.716 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.716+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~KRDYYTUJ2D8I.1 size=777742 2024-09-12T17:36:53.717 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.716+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=KRDYYTUJ2D8I tag=IH4CPSKUHAOH type=write size=2874894 2024-09-12T17:36:53.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.720+0000 7f1ad43488c0 1 < completed write operation key=GWJ78NNXOL1R tag=7R2GHWQEWX8O type=write size=35137 2024-09-12T17:36:53.726 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.724+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~L5RPTF8GAHLP.0 size=1048576 2024-09-12T17:36:53.729 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.728+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~L5RPTF8GAHLP.1 size=168327 2024-09-12T17:36:53.729 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.728+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=L5RPTF8GAHLP tag=EFQGSD8T14A7 type=write size=2265479 2024-09-12T17:36:53.732 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.732+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~TQYX018X01JL.0 size=1048576 2024-09-12T17:36:53.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.732+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~TQYX018X01JL.1 size=534691 2024-09-12T17:36:53.740 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.740+0000 7f1ad43488c0 1 < completed multipart upload key=IY2AM7CJDUZG upload=TQYX018X01JL tag=T749C1L3XL6Z type=write size=2631843 2024-09-12T17:36:53.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.744+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=L7SW4RUUYO6J type=del size=1175241 2024-09-12T17:36:53.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.748+0000 7f1ad43488c0 1 < suggested update operation key=GZ7LGZQHW4CY tag=FOLCE9QGI9VU type=del size=3164344 2024-09-12T17:36:53.753 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.752+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=J9SAFRPE0FEO type=del size=2926366 2024-09-12T17:36:53.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.756+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~FPSGNSZUPTRQ.0 size=1048576 2024-09-12T17:36:53.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.756+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~FPSGNSZUPTRQ.1 size=1048576 2024-09-12T17:36:53.761 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.760+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~FPSGNSZUPTRQ.2 size=865559 2024-09-12T17:36:53.765 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.764+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=FPSGNSZUPTRQ tag=A5BXJ8B1YN7L type=write size=4011287 2024-09-12T17:36:53.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.768+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~5DQWYET0LJHX.0 size=350411 2024-09-12T17:36:53.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.768+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=5DQWYET0LJHX tag=852A1YBYPRW7 type=write size=1398987 2024-09-12T17:36:53.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.772+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=5SDKOVFUWXTY type=del 2024-09-12T17:36:53.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.780+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~P6FZIMJCTCRM.0 size=1048576 2024-09-12T17:36:53.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.780+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~P6FZIMJCTCRM.1 size=1048576 2024-09-12T17:36:53.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.784+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~P6FZIMJCTCRM.2 size=714800 2024-09-12T17:36:53.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.784+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=P6FZIMJCTCRM tag=11S39VS8S2CE type=write size=3860528 2024-09-12T17:36:53.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.788+0000 7f1ad43488c0 1 < completed write operation key=RXJJOPR32OD5 tag=9Z0P87K7OQ4B type=write size=665083 2024-09-12T17:36:53.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.792+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~5696Z08R4I6Y.0 size=1048576 2024-09-12T17:36:53.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.796+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~5696Z08R4I6Y.1 size=1048576 2024-09-12T17:36:53.799 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.796+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~5696Z08R4I6Y.2 size=187263 2024-09-12T17:36:53.799 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.796+0000 7f1ad43488c0 1 > prepared multipart upload key=Y3NQLDWQJ37Z upload=5696Z08R4I6Y tag=61NPRBU9ZD65 type=write size=3332991 2024-09-12T17:36:53.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.800+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~I8NUO6P75GTE.0 size=1048576 2024-09-12T17:36:53.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.804+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~I8NUO6P75GTE.1 size=1048576 2024-09-12T17:36:53.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.808+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~I8NUO6P75GTE.2 size=857590 2024-09-12T17:36:53.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.816+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=I8NUO6P75GTE tag=IUWBIOOM9TY6 type=write size=4003318 2024-09-12T17:36:53.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.820+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~BBA4JX1FAE6E.0 size=1048576 2024-09-12T17:36:53.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.820+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~BBA4JX1FAE6E.1 size=1048576 2024-09-12T17:36:53.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.824+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~BBA4JX1FAE6E.2 size=840377 2024-09-12T17:36:53.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.824+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=BBA4JX1FAE6E tag=PBD47A5W4S1F type=write size=3986105 2024-09-12T17:36:53.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.828+0000 7f1ad43488c0 1 < completed delete operation key=ZHFRKX9YY8P5 tag=FW8VYUE8ZPWO type=del 2024-09-12T17:36:53.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.832+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=PQ8VJQ2WC0YU type=del size=785282 2024-09-12T17:36:53.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.832+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=AV0BCX2M99UR type=del 2024-09-12T17:36:53.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.840+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~7FV707FIMQFD.0 size=1048576 2024-09-12T17:36:53.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.840+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~7FV707FIMQFD.1 size=1048576 2024-09-12T17:36:53.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.844+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~7FV707FIMQFD.2 size=625693 2024-09-12T17:36:53.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.844+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=7FV707FIMQFD tag=8CO3W65C0D4H type=write size=3771421 2024-09-12T17:36:53.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.844+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~AY1SE68GBPTD.0 size=1048576 2024-09-12T17:36:53.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.848+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~AY1SE68GBPTD.1 size=705378 2024-09-12T17:36:53.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.852+0000 7f1ad43488c0 1 < completed multipart upload key=ZHFRKX9YY8P5 upload=AY1SE68GBPTD tag=FVBJWF01XS61 type=write size=2802530 2024-09-12T17:36:53.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.856+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=DT6H97A53EFN type=write size=588416 2024-09-12T17:36:53.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.860+0000 7f1ad43488c0 1 < suggested remove operation key=X0HT3K3OREL7 tag=RKPTM1FAP1F0 type=del 2024-09-12T17:36:53.865 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.864+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=Z3D0A1KHO28W type=del size=1100144 2024-09-12T17:36:53.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.868+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~GRYPYSR4YWA8.0 size=127906 2024-09-12T17:36:53.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.872+0000 7f1ad43488c0 1 < completed multipart upload key=9Z2EHQA8T5F4 upload=GRYPYSR4YWA8 tag=NSEBZYRN7OW1 type=write size=1176482 2024-09-12T17:36:53.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.880+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~36HDK7QOYH8R.0 size=1048576 2024-09-12T17:36:53.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.880+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~36HDK7QOYH8R.1 size=959677 2024-09-12T17:36:53.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.880+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=36HDK7QOYH8R tag=RW2C43ZSJW5M type=write size=3056829 2024-09-12T17:36:53.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.884+0000 7f1ad43488c0 1 < canceled operation key=9Z2EHQA8T5F4 tag=CB524LNJ2LZI type=del size=4083507 2024-09-12T17:36:53.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.888+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=G9JWFWYG6HL9 type=del size=2430331 2024-09-12T17:36:53.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.892+0000 7f1ad43488c0 -1 < failed to complete operation key=GZ7LGZQHW4CY tag=JIJMI5AWX587 type=del size=1031432: (22) Invalid argument 2024-09-12T17:36:53.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.896+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=P0M1TU68U2EY type=write size=176820 2024-09-12T17:36:53.902 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.900+0000 7f1ad43488c0 1 < suggested update operation key=C7QSOK3D3IWJ tag=WWB53W6HNLV5 type=del size=771478 2024-09-12T17:36:53.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.904+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=LG064AN1C3DP type=del size=125035 2024-09-12T17:36:53.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.904+0000 7f1ad43488c0 1 < canceled part key=_multipart_XOEPYERWY6IT.2~KRDYYTUJ2D8I.0 size=1048576 2024-09-12T17:36:53.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.908+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~KRDYYTUJ2D8I.1 size=777742 2024-09-12T17:36:53.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.912+0000 7f1ad43488c0 1 < canceled multipart upload key=XOEPYERWY6IT upload=KRDYYTUJ2D8I tag=IH4CPSKUHAOH type=write size=2874894 2024-09-12T17:36:53.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.920+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~TFOJUXGA510S.0 size=1003027 2024-09-12T17:36:53.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.920+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=TFOJUXGA510S tag=SN75AKO3KY7K type=write size=2051603 2024-09-12T17:36:53.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.924+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~L5RPTF8GAHLP.0 size=1048576 2024-09-12T17:36:53.926 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.924+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~L5RPTF8GAHLP.1 size=168327 2024-09-12T17:36:53.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.932+0000 7f1ad43488c0 1 < completed multipart upload key=IY2AM7CJDUZG upload=L5RPTF8GAHLP tag=EFQGSD8T14A7 type=write size=2265479 2024-09-12T17:36:53.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.936+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~QDZRJ0GA8AGJ.0 size=190251 2024-09-12T17:36:53.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.936+0000 7f1ad43488c0 1 > prepared multipart upload key=Y3NQLDWQJ37Z upload=QDZRJ0GA8AGJ tag=X9IZFS7JGAT0 type=write size=1238827 2024-09-12T17:36:53.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.940+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=L7SW4RUUYO6J type=del 2024-09-12T17:36:53.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.944+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=P2W5HOT05L5J type=del size=928639 2024-09-12T17:36:53.948 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.948+0000 7f1ad43488c0 1 < completed delete operation key=NHOG1WG3VT6N tag=J9SAFRPE0FEO type=del 2024-09-12T17:36:53.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.952+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~Q49NKWZM0VKZ.0 size=1048576 2024-09-12T17:36:53.958 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.956+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~Q49NKWZM0VKZ.1 size=1048576 2024-09-12T17:36:53.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.960+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~Q49NKWZM0VKZ.2 size=380260 2024-09-12T17:36:53.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.960+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=Q49NKWZM0VKZ tag=XEPCH8AY4F2H type=write size=3525988 2024-09-12T17:36:53.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.964+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~5DQWYET0LJHX.0 size=350411 2024-09-12T17:36:53.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.968+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=5DQWYET0LJHX tag=852A1YBYPRW7 type=write size=1398987 2024-09-12T17:36:53.975 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.972+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~M5RPNEW1YUW7.0 size=1048576 2024-09-12T17:36:53.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.976+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~M5RPNEW1YUW7.1 size=1048576 2024-09-12T17:36:53.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.980+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~M5RPNEW1YUW7.2 size=316926 2024-09-12T17:36:53.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.980+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=M5RPNEW1YUW7 tag=LR5D5WZCNX7G type=write size=3462654 2024-09-12T17:36:53.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.984+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~P6FZIMJCTCRM.0 size=1048576 2024-09-12T17:36:53.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.984+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~P6FZIMJCTCRM.1 size=1048576 2024-09-12T17:36:53.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.988+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~P6FZIMJCTCRM.2 size=714800 2024-09-12T17:36:53.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.992+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=P6FZIMJCTCRM tag=11S39VS8S2CE type=write size=3860528 2024-09-12T17:36:53.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:53.996+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=34YIB7SL320J type=del size=3497290 2024-09-12T17:36:54.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.000+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~5696Z08R4I6Y.0 size=1048576 2024-09-12T17:36:54.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.004+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~5696Z08R4I6Y.1 size=1048576 2024-09-12T17:36:54.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.004+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~5696Z08R4I6Y.2 size=187263 2024-09-12T17:36:54.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.012+0000 7f1ad43488c0 1 < completed multipart upload key=Y3NQLDWQJ37Z upload=5696Z08R4I6Y tag=61NPRBU9ZD65 type=write size=3332991 2024-09-12T17:36:54.016 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.016+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=YC3CLMSU01KN type=write size=901353 2024-09-12T17:36:54.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.020+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~BBA4JX1FAE6E.0 size=1048576 2024-09-12T17:36:54.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.020+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~BBA4JX1FAE6E.1 size=1048576 2024-09-12T17:36:54.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.024+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~BBA4JX1FAE6E.2 size=840377 2024-09-12T17:36:54.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.032+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=BBA4JX1FAE6E tag=PBD47A5W4S1F type=write size=3986105 2024-09-12T17:36:54.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.032+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=3ZT9PC53ZPN9 type=del size=740935 2024-09-12T17:36:54.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.040+0000 7f1ad43488c0 1 < suggested update operation key=C7QSOK3D3IWJ tag=PQ8VJQ2WC0YU type=del size=785282 2024-09-12T17:36:54.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.044+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=EE0EM2JI90WB type=del size=1926908 2024-09-12T17:36:54.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.048+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~7FV707FIMQFD.0 size=1048576 2024-09-12T17:36:54.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.052+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~7FV707FIMQFD.1 size=1048576 2024-09-12T17:36:54.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.052+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~7FV707FIMQFD.2 size=625693 2024-09-12T17:36:54.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.060+0000 7f1ad43488c0 1 < completed multipart upload key=WWB6LAHAMIR9 upload=7FV707FIMQFD tag=8CO3W65C0D4H type=write size=3771421 2024-09-12T17:36:54.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.064+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=2855IOERQVDR type=write size=250414 2024-09-12T17:36:54.068 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.068+0000 7f1ad43488c0 1 < completed write operation key=PKC1RR4FZWE0 tag=DT6H97A53EFN type=write size=588416 2024-09-12T17:36:54.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.072+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=ZS37QJQ444CF type=del size=2523273 2024-09-12T17:36:54.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.080+0000 7f1ad43488c0 1 < suggested remove operation key=9Z2EHQA8T5F4 tag=Z3D0A1KHO28W type=del 2024-09-12T17:36:54.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.084+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=8AOC9T3BD23Z type=del size=1042141 2024-09-12T17:36:54.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.088+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~36HDK7QOYH8R.0 size=1048576 2024-09-12T17:36:54.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.088+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~36HDK7QOYH8R.1 size=959677 2024-09-12T17:36:54.096 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.096+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=36HDK7QOYH8R tag=RW2C43ZSJW5M type=write size=3056829 2024-09-12T17:36:54.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.100+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=V5MFQSASPZHP type=del size=753012 2024-09-12T17:36:54.103 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.100+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=G9JWFWYG6HL9 type=del 2024-09-12T17:36:54.106 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.104+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=NHD516GJYQ07 type=del size=3487712 2024-09-12T17:36:54.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.108+0000 7f1ad43488c0 1 < completed write operation key=8U3L46JDJ8VS tag=P0M1TU68U2EY type=write size=176820 2024-09-12T17:36:54.112 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.112+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=CS8O0D6E8JOF type=del size=24523 2024-09-12T17:36:54.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.116+0000 7f1ad43488c0 1 < canceled operation key=GZ7LGZQHW4CY tag=LG064AN1C3DP type=del size=125035 2024-09-12T17:36:54.121 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.120+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=H1Y24KWMZFK2 type=del size=1381823 2024-09-12T17:36:54.124 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.124+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~TFOJUXGA510S.0 size=1003027 2024-09-12T17:36:54.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.128+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=TFOJUXGA510S tag=SN75AKO3KY7K type=write size=2051603 2024-09-12T17:36:54.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.132+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=2UCAC3BA537Z type=del size=898071 2024-09-12T17:36:54.135 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.132+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~QDZRJ0GA8AGJ.0 size=190251 2024-09-12T17:36:54.140 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.140+0000 7f1ad43488c0 1 < completed multipart upload key=Y3NQLDWQJ37Z upload=QDZRJ0GA8AGJ tag=X9IZFS7JGAT0 type=write size=1238827 2024-09-12T17:36:54.143 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.140+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=PFOYBENRTRZX type=del size=103398 2024-09-12T17:36:54.146 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.144+0000 7f1ad43488c0 1 < completed delete operation key=ZHFRKX9YY8P5 tag=P2W5HOT05L5J type=del 2024-09-12T17:36:54.152 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.152+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~1RR1HD5G51MF.0 size=1048576 2024-09-12T17:36:54.154 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.152+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~1RR1HD5G51MF.1 size=917091 2024-09-12T17:36:54.154 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.152+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=1RR1HD5G51MF tag=PPIBRJ0763ZY type=write size=3014243 2024-09-12T17:36:54.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.156+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~Q49NKWZM0VKZ.0 size=1048576 2024-09-12T17:36:54.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.160+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~Q49NKWZM0VKZ.1 size=1048576 2024-09-12T17:36:54.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.164+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~Q49NKWZM0VKZ.2 size=380260 2024-09-12T17:36:54.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.168+0000 7f1ad43488c0 1 < completed multipart upload key=8U3L46JDJ8VS upload=Q49NKWZM0VKZ tag=XEPCH8AY4F2H type=write size=3525988 2024-09-12T17:36:54.173 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.172+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=FN4P4JI101KA type=del size=3639190 2024-09-12T17:36:54.176 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.176+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~M5RPNEW1YUW7.0 size=1048576 2024-09-12T17:36:54.179 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.180+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~M5RPNEW1YUW7.1 size=1048576 2024-09-12T17:36:54.182 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.180+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~M5RPNEW1YUW7.2 size=316926 2024-09-12T17:36:54.188 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.188+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=M5RPNEW1YUW7 tag=LR5D5WZCNX7G type=write size=3462654 2024-09-12T17:36:54.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.192+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~8HQGP81JZ0LQ.0 size=1048576 2024-09-12T17:36:54.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.196+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~8HQGP81JZ0LQ.1 size=18039 2024-09-12T17:36:54.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.196+0000 7f1ad43488c0 1 > prepared multipart upload key=9Z2EHQA8T5F4 upload=8HQGP81JZ0LQ tag=53HBB6FCO23S type=write size=2115191 2024-09-12T17:36:54.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.204+0000 7f1ad43488c0 1 < suggested remove operation key=7RSHIZRKK2OY tag=34YIB7SL320J type=del 2024-09-12T17:36:54.207 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.208+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=Y36EHPIIBFBH type=del size=3846372 2024-09-12T17:36:54.211 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.208+0000 7f1ad43488c0 1 < completed write operation key=PKC1RR4FZWE0 tag=YC3CLMSU01KN type=write size=901353 2024-09-12T17:36:54.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.216+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~VSZUQWAJ3AW5.0 size=418129 2024-09-12T17:36:54.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.216+0000 7f1ad43488c0 1 > prepared multipart upload key=3N1YT9TC0M3O upload=VSZUQWAJ3AW5 tag=G8PVBHT5P72Y type=write size=1466705 2024-09-12T17:36:54.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.220+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=3ZT9PC53ZPN9 type=del 2024-09-12T17:36:54.227 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.228+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~DROM2TN3TID4.0 size=595551 2024-09-12T17:36:54.227 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.228+0000 7f1ad43488c0 1 > prepared multipart upload key=C7QSOK3D3IWJ upload=DROM2TN3TID4 tag=ZU9D516HQX4M type=write size=1644127 2024-09-12T17:36:54.230 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.228+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=EE0EM2JI90WB type=del 2024-09-12T17:36:54.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.232+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=C3EP8OQM7IFO type=del size=3603325 2024-09-12T17:36:54.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.236+0000 7f1ad43488c0 1 < completed write operation key=WFEJLVRCKIUU tag=2855IOERQVDR type=write size=250414 2024-09-12T17:36:54.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.240+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=RW7DB15ECE1S type=del size=48249 2024-09-12T17:36:54.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.244+0000 7f1ad43488c0 1 < completed delete operation key=NHOG1WG3VT6N tag=ZS37QJQ444CF type=del 2024-09-12T17:36:54.247 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.248+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=5FATG6KGR7PR type=del size=3362399 2024-09-12T17:36:54.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.252+0000 7f1ad43488c0 1 < suggested update operation key=A49CE02X3L2L tag=8AOC9T3BD23Z type=del size=1042141 2024-09-12T17:36:54.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.260+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~3H2NL64YC596.0 size=733693 2024-09-12T17:36:54.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.260+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=3H2NL64YC596 tag=KN2P0C9WPCO6 type=write size=1782269 2024-09-12T17:36:54.264 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.264+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=V5MFQSASPZHP type=del 2024-09-12T17:36:54.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.268+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~6P1T6WLRTH4Z.0 size=1048576 2024-09-12T17:36:54.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.272+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~6P1T6WLRTH4Z.1 size=280593 2024-09-12T17:36:54.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.272+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=6P1T6WLRTH4Z tag=A28P9XPDQ0MB type=write size=2377745 2024-09-12T17:36:54.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.280+0000 7f1ad43488c0 1 < suggested remove operation key=WFEJLVRCKIUU tag=NHD516GJYQ07 type=del 2024-09-12T17:36:54.283 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.284+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=OCQX089E02GR type=del size=3032985 2024-09-12T17:36:54.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.284+0000 7f1ad43488c0 1 < completed delete operation key=GWJ78NNXOL1R tag=CS8O0D6E8JOF type=del 2024-09-12T17:36:54.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.292+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~0VDKVMBP5BV6.0 size=600304 2024-09-12T17:36:54.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.292+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=0VDKVMBP5BV6 tag=WRB9KHSNV11E type=write size=1648880 2024-09-12T17:36:54.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.296+0000 7f1ad43488c0 -1 < failed to complete operation key=7RSHIZRKK2OY tag=H1Y24KWMZFK2 type=del size=1381823: (22) Invalid argument 2024-09-12T17:36:54.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.304+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~Q4JE83V6MBC2.0 size=392838 2024-09-12T17:36:54.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.304+0000 7f1ad43488c0 1 > prepared multipart upload key=ZHFRKX9YY8P5 upload=Q4JE83V6MBC2 tag=XYVNC67WX53V type=write size=1441414 2024-09-12T17:36:54.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.304+0000 7f1ad43488c0 1 < completed delete operation key=XOEPYERWY6IT tag=2UCAC3BA537Z type=del 2024-09-12T17:36:54.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.308+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=I8PY50LBFA0H type=write size=434215 2024-09-12T17:36:54.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.312+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=PFOYBENRTRZX type=del 2024-09-12T17:36:54.318 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.316+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=XS2EUB4XCD86 type=del size=3894633 2024-09-12T17:36:54.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.320+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~1RR1HD5G51MF.0 size=1048576 2024-09-12T17:36:54.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.324+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~1RR1HD5G51MF.1 size=917091 2024-09-12T17:36:54.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.328+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=1RR1HD5G51MF tag=PPIBRJ0763ZY type=write size=3014243 2024-09-12T17:36:54.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.332+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=Z4WX8R55DS5P type=del size=4171856 2024-09-12T17:36:54.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.336+0000 7f1ad43488c0 1 < completed delete operation key=MB3FVGKV0ZNQ tag=FN4P4JI101KA type=del 2024-09-12T17:36:54.341 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.340+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=NG1HSETWUMBP type=del size=2896171 2024-09-12T17:36:54.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.344+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~8HQGP81JZ0LQ.0 size=1048576 2024-09-12T17:36:54.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.348+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~8HQGP81JZ0LQ.1 size=18039 2024-09-12T17:36:54.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.352+0000 7f1ad43488c0 1 < completed multipart upload key=9Z2EHQA8T5F4 upload=8HQGP81JZ0LQ tag=53HBB6FCO23S type=write size=2115191 2024-09-12T17:36:54.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.356+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~R61Z1QE154UM.0 size=1048576 2024-09-12T17:36:54.361 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.360+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~R61Z1QE154UM.1 size=928637 2024-09-12T17:36:54.361 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.360+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=R61Z1QE154UM tag=WIS06Q0UVSB5 type=write size=3025789 2024-09-12T17:36:54.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.364+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=Y36EHPIIBFBH type=del 2024-09-12T17:36:54.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.368+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=ZY1L7B1WOPCT type=del size=3037383 2024-09-12T17:36:54.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.372+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~VSZUQWAJ3AW5.0 size=418129 2024-09-12T17:36:54.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.376+0000 7f1ad43488c0 1 < completed multipart upload key=3N1YT9TC0M3O upload=VSZUQWAJ3AW5 tag=G8PVBHT5P72Y type=write size=1466705 2024-09-12T17:36:54.384 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.384+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~S93RB3SVML0F.0 size=1048576 2024-09-12T17:36:54.387 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.388+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~S93RB3SVML0F.1 size=1048576 2024-09-12T17:36:54.390 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.388+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~S93RB3SVML0F.2 size=865750 2024-09-12T17:36:54.390 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.388+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=S93RB3SVML0F tag=4RONN1ZIHLQG type=write size=4011478 2024-09-12T17:36:54.390 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.388+0000 7f1ad43488c0 1 < canceled part key=_multipart_C7QSOK3D3IWJ.2~DROM2TN3TID4.0 size=595551 2024-09-12T17:36:54.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.396+0000 7f1ad43488c0 1 < canceled multipart upload key=C7QSOK3D3IWJ upload=DROM2TN3TID4 tag=ZU9D516HQX4M type=write size=1644127 2024-09-12T17:36:54.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.400+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=79DRAJ8ON6QC type=write size=534743 2024-09-12T17:36:54.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.404+0000 7f1ad43488c0 1 < completed delete operation key=IY2AM7CJDUZG tag=C3EP8OQM7IFO type=del 2024-09-12T17:36:54.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.404+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=LNYM9VHCVHV0 type=del size=3393121 2024-09-12T17:36:54.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.408+0000 7f1ad43488c0 1 < canceled operation key=8U3L46JDJ8VS tag=RW7DB15ECE1S type=del size=48249 2024-09-12T17:36:54.416 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.416+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~BQUAKAY20V3O.0 size=1048576 2024-09-12T17:36:54.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.420+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~BQUAKAY20V3O.1 size=1043201 2024-09-12T17:36:54.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.420+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=BQUAKAY20V3O tag=MT1554BVVO33 type=write size=3140353 2024-09-12T17:36:54.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.424+0000 7f1ad43488c0 1 < suggested update operation key=GWJ78NNXOL1R tag=5FATG6KGR7PR type=del size=3362399 2024-09-12T17:36:54.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.428+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=ZN7GZ31I39JU type=del size=2219473 2024-09-12T17:36:54.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.432+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~3H2NL64YC596.0 size=733693 2024-09-12T17:36:54.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.440+0000 7f1ad43488c0 1 < completed multipart upload key=8U3L46JDJ8VS upload=3H2NL64YC596 tag=KN2P0C9WPCO6 type=write size=1782269 2024-09-12T17:36:54.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.448+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~BS5IJEJ37TG0.0 size=857890 2024-09-12T17:36:54.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.448+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=BS5IJEJ37TG0 tag=LYMTEFVN48QX type=write size=1906466 2024-09-12T17:36:54.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.452+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~6P1T6WLRTH4Z.0 size=1048576 2024-09-12T17:36:54.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.452+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~6P1T6WLRTH4Z.1 size=280593 2024-09-12T17:36:54.460 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.460+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=6P1T6WLRTH4Z tag=A28P9XPDQ0MB type=write size=2377745 2024-09-12T17:36:54.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.464+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~D1TED7TA66GF.0 size=1048576 2024-09-12T17:36:54.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.468+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~D1TED7TA66GF.1 size=554257 2024-09-12T17:36:54.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.468+0000 7f1ad43488c0 1 > prepared multipart upload key=C7QSOK3D3IWJ upload=D1TED7TA66GF tag=YNM4U47U7QO8 type=write size=2651409 2024-09-12T17:36:54.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.472+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=OCQX089E02GR type=del 2024-09-12T17:36:54.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.476+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=Q1J0USJLSG56 type=del size=3022366 2024-09-12T17:36:54.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.480+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~0VDKVMBP5BV6.0 size=600304 2024-09-12T17:36:54.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.484+0000 7f1ad43488c0 1 < completed multipart upload key=MB3FVGKV0ZNQ upload=0VDKVMBP5BV6 tag=WRB9KHSNV11E type=write size=1648880 2024-09-12T17:36:54.488 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.488+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=E9EEK78P1ZPG type=del size=2662215 2024-09-12T17:36:54.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.492+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~Q4JE83V6MBC2.0 size=392838 2024-09-12T17:36:54.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.496+0000 7f1ad43488c0 1 < completed multipart upload key=ZHFRKX9YY8P5 upload=Q4JE83V6MBC2 tag=XYVNC67WX53V type=write size=1441414 2024-09-12T17:36:54.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.500+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=KBUAUGKK57IP type=del size=2916427 2024-09-12T17:36:54.504 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.504+0000 7f1ad43488c0 1 < completed write operation key=WFEJLVRCKIUU tag=I8PY50LBFA0H type=write size=434215 2024-09-12T17:36:54.510 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.508+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~HDRICD1GSGXH.0 size=51426 2024-09-12T17:36:54.511 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.508+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=HDRICD1GSGXH tag=XDDC515A3X50 type=write size=1100002 2024-09-12T17:36:54.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.516+0000 7f1ad43488c0 1 < suggested remove operation key=NHOG1WG3VT6N tag=XS2EUB4XCD86 type=del 2024-09-12T17:36:54.521 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.520+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=A7JDXX71LQQ5 type=del size=2337453 2024-09-12T17:36:54.528 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.528+0000 7f1ad43488c0 1 < suggested update operation key=7RSHIZRKK2OY tag=Z4WX8R55DS5P type=del size=4171856 2024-09-12T17:36:54.534 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.532+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~8PNDYS8F3HGJ.0 size=168418 2024-09-12T17:36:54.534 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.532+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=8PNDYS8F3HGJ tag=YFLBQBYFKT19 type=write size=1216994 2024-09-12T17:36:54.538 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.536+0000 7f1ad43488c0 1 < canceled operation key=CHMM14VRIOQH tag=NG1HSETWUMBP type=del size=2896171 2024-09-12T17:36:54.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.540+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=82HHRTC9TUB7 type=del size=1144208 2024-09-12T17:36:54.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.540+0000 7f1ad43488c0 1 < canceled part key=_multipart_4QO60GZ9V0GK.2~R61Z1QE154UM.0 size=1048576 2024-09-12T17:36:54.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.544+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~R61Z1QE154UM.1 size=928637 2024-09-12T17:36:54.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.548+0000 7f1ad43488c0 1 < canceled multipart upload key=4QO60GZ9V0GK upload=R61Z1QE154UM tag=WIS06Q0UVSB5 type=write size=3025789 2024-09-12T17:36:54.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.552+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=3AGZVSFAU19K type=del size=4060040 2024-09-12T17:36:54.557 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.556+0000 7f1ad43488c0 1 < suggested remove operation key=C7QSOK3D3IWJ tag=ZY1L7B1WOPCT type=del 2024-09-12T17:36:54.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.560+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=L8CBOYXRIHGK type=del size=981806 2024-09-12T17:36:54.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.564+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~S93RB3SVML0F.0 size=1048576 2024-09-12T17:36:54.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.564+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~S93RB3SVML0F.1 size=1048576 2024-09-12T17:36:54.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.568+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~S93RB3SVML0F.2 size=865750 2024-09-12T17:36:54.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.572+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=S93RB3SVML0F tag=4RONN1ZIHLQG type=write size=4011478 2024-09-12T17:36:54.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.576+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=LZ2FOTZP9MV3 type=del size=2569854 2024-09-12T17:36:54.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.580+0000 7f1ad43488c0 1 < completed write operation key=WFEJLVRCKIUU tag=79DRAJ8ON6QC type=write size=534743 2024-09-12T17:36:54.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.584+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=8MMGXJKJWJOZ type=del size=2525678 2024-09-12T17:36:54.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.588+0000 7f1ad43488c0 1 < completed delete operation key=XOEPYERWY6IT tag=LNYM9VHCVHV0 type=del 2024-09-12T17:36:54.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.592+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=LCD64OKLMHPL type=del size=3462056 2024-09-12T17:36:54.597 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.596+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~BQUAKAY20V3O.0 size=1048576 2024-09-12T17:36:54.600 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.600+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~BQUAKAY20V3O.1 size=1043201 2024-09-12T17:36:54.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.604+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=BQUAKAY20V3O tag=MT1554BVVO33 type=write size=3140353 2024-09-12T17:36:54.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.612+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~0RUVEHL06ITZ.0 size=403717 2024-09-12T17:36:54.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.612+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=0RUVEHL06ITZ tag=UFK4QDIKOPRQ type=write size=1452293 2024-09-12T17:36:54.619 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.616+0000 7f1ad43488c0 1 < suggested update operation key=CHMM14VRIOQH tag=ZN7GZ31I39JU type=del size=2219473 2024-09-12T17:36:54.624 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.624+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~TFFPI0JBHQVR.0 size=1048576 2024-09-12T17:36:54.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.628+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~TFFPI0JBHQVR.1 size=930472 2024-09-12T17:36:54.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.628+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=TFFPI0JBHQVR tag=LA4PY7YGGOZ3 type=write size=3027624 2024-09-12T17:36:54.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.628+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~BS5IJEJ37TG0.0 size=857890 2024-09-12T17:36:54.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.636+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=BS5IJEJ37TG0 tag=LYMTEFVN48QX type=write size=1906466 2024-09-12T17:36:54.641 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.640+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~CKKWTK99XSJ9.0 size=1048576 2024-09-12T17:36:54.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.644+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~CKKWTK99XSJ9.1 size=1048576 2024-09-12T17:36:54.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.644+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~CKKWTK99XSJ9.2 size=1004691 2024-09-12T17:36:54.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.644+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=CKKWTK99XSJ9 tag=3OA00VW2KQPD type=write size=4150419 2024-09-12T17:36:54.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.648+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~D1TED7TA66GF.0 size=1048576 2024-09-12T17:36:54.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.652+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~D1TED7TA66GF.1 size=554257 2024-09-12T17:36:54.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.656+0000 7f1ad43488c0 1 < completed multipart upload key=C7QSOK3D3IWJ upload=D1TED7TA66GF tag=YNM4U47U7QO8 type=write size=2651409 2024-09-12T17:36:54.660 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.660+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=5OVQW0ORTXN2 type=del size=1563157 2024-09-12T17:36:54.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.664+0000 7f1ad43488c0 -1 < failed to complete operation key=C7QSOK3D3IWJ tag=Q1J0USJLSG56 type=del size=3022366: (22) Invalid argument 2024-09-12T17:36:54.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.664+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=R9OKO7EG9I3E type=del size=1797255 2024-09-12T17:36:54.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.668+0000 7f1ad43488c0 1 < completed delete operation key=RH4HYE315U5Y tag=E9EEK78P1ZPG type=del 2024-09-12T17:36:54.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.676+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~ES15YZIZ2TYD.0 size=141562 2024-09-12T17:36:54.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.676+0000 7f1ad43488c0 1 > prepared multipart upload key=9Z2EHQA8T5F4 upload=ES15YZIZ2TYD tag=0ECCVPL6XLAB type=write size=1190138 2024-09-12T17:36:54.679 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.676+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=KBUAUGKK57IP type=del 2024-09-12T17:36:54.683 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.684+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~WBM8SVF2S7F4.0 size=1048576 2024-09-12T17:36:54.685 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.684+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~WBM8SVF2S7F4.1 size=959045 2024-09-12T17:36:54.686 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.684+0000 7f1ad43488c0 1 > prepared multipart upload key=C7QSOK3D3IWJ upload=WBM8SVF2S7F4 tag=KUFTKKWIJM0N type=write size=3056197 2024-09-12T17:36:54.689 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.688+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~HDRICD1GSGXH.0 size=51426 2024-09-12T17:36:54.693 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.692+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=HDRICD1GSGXH tag=XDDC515A3X50 type=write size=1100002 2024-09-12T17:36:54.698 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.696+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~TV3NQX2CMD2Z.0 size=436036 2024-09-12T17:36:54.698 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.696+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=TV3NQX2CMD2Z tag=R01ZF3WAS7B2 type=write size=1484612 2024-09-12T17:36:54.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.700+0000 7f1ad43488c0 1 < completed delete operation key=WFEJLVRCKIUU tag=A7JDXX71LQQ5 type=del 2024-09-12T17:36:54.704 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.704+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=KTXPLWRS1EA8 type=del size=2883883 2024-09-12T17:36:54.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.704+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~8PNDYS8F3HGJ.0 size=168418 2024-09-12T17:36:54.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.712+0000 7f1ad43488c0 1 < completed multipart upload key=MB3FVGKV0ZNQ upload=8PNDYS8F3HGJ tag=YFLBQBYFKT19 type=write size=1216994 2024-09-12T17:36:54.716 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.716+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~HAD6YFWIPWF0.0 size=1048576 2024-09-12T17:36:54.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.716+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~HAD6YFWIPWF0.1 size=728768 2024-09-12T17:36:54.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.716+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=HAD6YFWIPWF0 tag=5JSUWV94YNDN type=write size=2825920 2024-09-12T17:36:54.721 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.720+0000 7f1ad43488c0 1 < completed delete operation key=05PAFB226IFP tag=82HHRTC9TUB7 type=del 2024-09-12T17:36:54.724 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.724+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=W7G65UZS18WB type=del size=1080882 2024-09-12T17:36:54.727 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.728+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=3AGZVSFAU19K type=del 2024-09-12T17:36:54.730 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.728+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=DWRYPLGEW31Q type=write size=909795 2024-09-12T17:36:54.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.732+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=L8CBOYXRIHGK type=del 2024-09-12T17:36:54.740 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.740+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=UAGFON7FQG3B type=write size=991230 2024-09-12T17:36:54.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.748+0000 7f1ad43488c0 1 < suggested update operation key=RH4HYE315U5Y tag=LZ2FOTZP9MV3 type=del size=2569854 2024-09-12T17:36:54.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.748+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=ZX1VRTTL3EF2 type=write size=172628 2024-09-12T17:36:54.754 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.752+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=8MMGXJKJWJOZ type=del 2024-09-12T17:36:54.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.756+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=XNVBXZRX8QUA type=del size=2856017 2024-09-12T17:36:54.762 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.760+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=LCD64OKLMHPL type=del 2024-09-12T17:36:54.765 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.764+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=0RKTS7Y2FY7T type=write size=817288 2024-09-12T17:36:54.769 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.768+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~0RUVEHL06ITZ.0 size=403717 2024-09-12T17:36:54.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.772+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=0RUVEHL06ITZ tag=UFK4QDIKOPRQ type=write size=1452293 2024-09-12T17:36:54.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.776+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=UI66IVUVCNO3 type=del size=3193394 2024-09-12T17:36:54.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.780+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~TFFPI0JBHQVR.0 size=1048576 2024-09-12T17:36:54.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.784+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~TFFPI0JBHQVR.1 size=930472 2024-09-12T17:36:54.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.788+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=TFFPI0JBHQVR tag=LA4PY7YGGOZ3 type=write size=3027624 2024-09-12T17:36:54.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.792+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~GOCG22D3K2W9.0 size=570285 2024-09-12T17:36:54.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.792+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=GOCG22D3K2W9 tag=7KPX4NKD0CED type=write size=1618861 2024-09-12T17:36:54.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.796+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~CKKWTK99XSJ9.0 size=1048576 2024-09-12T17:36:54.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.796+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~CKKWTK99XSJ9.1 size=1048576 2024-09-12T17:36:54.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.796+0000 7f1ad43488c0 1 < canceled part key=_multipart_MB3FVGKV0ZNQ.2~CKKWTK99XSJ9.2 size=1004691 2024-09-12T17:36:54.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.800+0000 7f1ad43488c0 1 < canceled multipart upload key=MB3FVGKV0ZNQ upload=CKKWTK99XSJ9 tag=3OA00VW2KQPD type=write size=4150419 2024-09-12T17:36:54.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.804+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~AL95IC9XG513.0 size=153180 2024-09-12T17:36:54.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.804+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=AL95IC9XG513 tag=ZVQVD3F0E6IP type=write size=1201756 2024-09-12T17:36:54.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.808+0000 7f1ad43488c0 1 < suggested update operation key=CHMM14VRIOQH tag=5OVQW0ORTXN2 type=del size=1563157 2024-09-12T17:36:54.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.812+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=WQ8UV1VXO8J2 type=del size=461777 2024-09-12T17:36:54.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.816+0000 7f1ad43488c0 1 < completed delete operation key=NHOG1WG3VT6N tag=R9OKO7EG9I3E type=del 2024-09-12T17:36:54.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.816+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=IR42ZW9O6TLH type=del size=337087 2024-09-12T17:36:54.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.820+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~ES15YZIZ2TYD.0 size=141562 2024-09-12T17:36:54.824 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.824+0000 7f1ad43488c0 1 < completed multipart upload key=9Z2EHQA8T5F4 upload=ES15YZIZ2TYD tag=0ECCVPL6XLAB type=write size=1190138 2024-09-12T17:36:54.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.824+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=QFJE0KKKTL58 type=del size=3009628 2024-09-12T17:36:54.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.828+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~WBM8SVF2S7F4.0 size=1048576 2024-09-12T17:36:54.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.828+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~WBM8SVF2S7F4.1 size=959045 2024-09-12T17:36:54.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.832+0000 7f1ad43488c0 1 < completed multipart upload key=C7QSOK3D3IWJ upload=WBM8SVF2S7F4 tag=KUFTKKWIJM0N type=write size=3056197 2024-09-12T17:36:54.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.836+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=EMFHDLDWIKUO type=write size=933217 2024-09-12T17:36:54.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.840+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~TV3NQX2CMD2Z.0 size=436036 2024-09-12T17:36:54.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.844+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=TV3NQX2CMD2Z tag=R01ZF3WAS7B2 type=write size=1484612 2024-09-12T17:36:54.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.844+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=OTZAD5PUI65A type=write size=421221 2024-09-12T17:36:54.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.848+0000 7f1ad43488c0 1 < completed delete operation key=XOEPYERWY6IT tag=KTXPLWRS1EA8 type=del 2024-09-12T17:36:54.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.852+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=9I883M1EYRS3 type=del size=1466139 2024-09-12T17:36:54.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.856+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~HAD6YFWIPWF0.0 size=1048576 2024-09-12T17:36:54.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.856+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~HAD6YFWIPWF0.1 size=728768 2024-09-12T17:36:54.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.860+0000 7f1ad43488c0 1 < completed multipart upload key=MB3FVGKV0ZNQ upload=HAD6YFWIPWF0 tag=5JSUWV94YNDN type=write size=2825920 2024-09-12T17:36:54.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.868+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~KSSVJOPU30AZ.0 size=1048576 2024-09-12T17:36:54.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.868+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~KSSVJOPU30AZ.1 size=871687 2024-09-12T17:36:54.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.868+0000 7f1ad43488c0 1 > prepared multipart upload key=C7QSOK3D3IWJ upload=KSSVJOPU30AZ tag=ZP9YML2OGTUN type=write size=2968839 2024-09-12T17:36:54.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.872+0000 7f1ad43488c0 1 < suggested remove operation key=WWB6LAHAMIR9 tag=W7G65UZS18WB type=del 2024-09-12T17:36:54.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.876+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=4S7LMITUA5UZ type=del size=2613968 2024-09-12T17:36:54.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.880+0000 7f1ad43488c0 -1 < failed to complete operation key=WWB6LAHAMIR9 tag=DWRYPLGEW31Q type=write size=909795: (22) Invalid argument 2024-09-12T17:36:54.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.884+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=88YHFJEH4RUF type=del size=3013262 2024-09-12T17:36:54.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.884+0000 7f1ad43488c0 1 < completed write operation key=C7QSOK3D3IWJ tag=UAGFON7FQG3B type=write size=991230 2024-09-12T17:36:54.888 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.888+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=WK7EZJJMEPIW type=del size=1175292 2024-09-12T17:36:54.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.892+0000 7f1ad43488c0 1 < completed write operation key=Y3NQLDWQJ37Z tag=ZX1VRTTL3EF2 type=write size=172628 2024-09-12T17:36:54.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.892+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=0E6ISK0C06YA type=del size=3341468 2024-09-12T17:36:54.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.896+0000 7f1ad43488c0 1 < completed delete operation key=RH4HYE315U5Y tag=XNVBXZRX8QUA type=del 2024-09-12T17:36:54.903 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.904+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~UQ6951UB796W.0 size=1048576 2024-09-12T17:36:54.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.904+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~UQ6951UB796W.1 size=1048576 2024-09-12T17:36:54.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.908+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~UQ6951UB796W.2 size=477162 2024-09-12T17:36:54.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.908+0000 7f1ad43488c0 1 > prepared multipart upload key=9Z2EHQA8T5F4 upload=UQ6951UB796W tag=T3RPWLAPBQ7B type=write size=3622890 2024-09-12T17:36:54.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.912+0000 7f1ad43488c0 1 < completed write operation key=LU7XIBO5YUOR tag=0RKTS7Y2FY7T type=write size=817288 2024-09-12T17:36:54.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.916+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=4V4FQHFWIDX2 type=write size=247924 2024-09-12T17:36:54.919 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.916+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=UI66IVUVCNO3 type=del 2024-09-12T17:36:54.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.924+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~E0QE4FS7DHT5.0 size=20230 2024-09-12T17:36:54.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.924+0000 7f1ad43488c0 1 > prepared multipart upload key=RH4HYE315U5Y upload=E0QE4FS7DHT5 tag=PDBYSLW6MACM type=write size=1068806 2024-09-12T17:36:54.928 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.928+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~GOCG22D3K2W9.0 size=570285 2024-09-12T17:36:54.933 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.932+0000 7f1ad43488c0 1 < completed multipart upload key=8U3L46JDJ8VS upload=GOCG22D3K2W9 tag=7KPX4NKD0CED type=write size=1618861 2024-09-12T17:36:54.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.936+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=8XEV6OSEHREZ type=del size=3557398 2024-09-12T17:36:54.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.936+0000 7f1ad43488c0 1 < canceled part key=_multipart_0MV3GCBTWZD0.2~AL95IC9XG513.0 size=153180 2024-09-12T17:36:54.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.940+0000 7f1ad43488c0 1 < canceled multipart upload key=0MV3GCBTWZD0 upload=AL95IC9XG513 tag=ZVQVD3F0E6IP type=write size=1201756 2024-09-12T17:36:54.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.944+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=PX6GUOF6U6LB type=write size=628158 2024-09-12T17:36:54.951 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.948+0000 7f1ad43488c0 1 < suggested update operation key=SDJ53NSPOIRC tag=WQ8UV1VXO8J2 type=del size=461777 2024-09-12T17:36:54.957 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.956+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~H8BT7T3NP8N3.0 size=82751 2024-09-12T17:36:54.958 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.956+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=H8BT7T3NP8N3 tag=DIB3381CV6PA type=write size=1131327 2024-09-12T17:36:54.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.960+0000 7f1ad43488c0 1 < completed delete operation key=05PAFB226IFP tag=IR42ZW9O6TLH type=del 2024-09-12T17:36:54.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.964+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~QMA6GDI72K2S.0 size=1048576 2024-09-12T17:36:54.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.968+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~QMA6GDI72K2S.1 size=1048576 2024-09-12T17:36:54.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.972+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~QMA6GDI72K2S.2 size=200871 2024-09-12T17:36:54.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.972+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=QMA6GDI72K2S tag=MFZ9XD420J1J type=write size=3346599 2024-09-12T17:36:54.975 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.972+0000 7f1ad43488c0 1 < completed delete operation key=ZHFRKX9YY8P5 tag=QFJE0KKKTL58 type=del 2024-09-12T17:36:54.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.976+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=WRS6O1GW45K6 type=write size=81466 2024-09-12T17:36:54.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.980+0000 7f1ad43488c0 -1 < failed to complete operation key=SDJ53NSPOIRC tag=EMFHDLDWIKUO type=write size=933217: (22) Invalid argument 2024-09-12T17:36:54.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.984+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=FG0GC6BJZKHQ type=del size=3302135 2024-09-12T17:36:54.990 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.988+0000 7f1ad43488c0 1 < suggested update operation key=7RSHIZRKK2OY tag=OTZAD5PUI65A type=write size=421221 2024-09-12T17:36:54.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.996+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~ZCLGQSBZLP4S.0 size=1048576 2024-09-12T17:36:54.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.996+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~ZCLGQSBZLP4S.1 size=764242 2024-09-12T17:36:54.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:54.996+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=ZCLGQSBZLP4S tag=QGLKO0YKP1VR type=write size=2861394 2024-09-12T17:36:55.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.000+0000 7f1ad43488c0 1 < completed delete operation key=9Z2EHQA8T5F4 tag=9I883M1EYRS3 type=del 2024-09-12T17:36:55.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.004+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=911MXVIJE1A9 type=del size=3457091 2024-09-12T17:36:55.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.008+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~KSSVJOPU30AZ.0 size=1048576 2024-09-12T17:36:55.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.012+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~KSSVJOPU30AZ.1 size=871687 2024-09-12T17:36:55.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.020+0000 7f1ad43488c0 1 < completed multipart upload key=C7QSOK3D3IWJ upload=KSSVJOPU30AZ tag=ZP9YML2OGTUN type=write size=2968839 2024-09-12T17:36:55.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.024+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=9EJ26Q12QAAI type=del size=1801191 2024-09-12T17:36:55.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.024+0000 7f1ad43488c0 1 < completed delete operation key=XOEPYERWY6IT tag=4S7LMITUA5UZ type=del 2024-09-12T17:36:55.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.032+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~WV5U07DVQ3CF.0 size=1048576 2024-09-12T17:36:55.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.032+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~WV5U07DVQ3CF.1 size=149082 2024-09-12T17:36:55.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.032+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=WV5U07DVQ3CF tag=EAL9FJ2GJR1A type=write size=2246234 2024-09-12T17:36:55.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.036+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=88YHFJEH4RUF type=del 2024-09-12T17:36:55.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.040+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=YJQ1WF0EFRBW type=del size=1073045 2024-09-12T17:36:55.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.044+0000 7f1ad43488c0 1 < completed delete operation key=GWJ78NNXOL1R tag=WK7EZJJMEPIW type=del 2024-09-12T17:36:55.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.044+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=4DGJBF65C7P3 type=del size=9642 2024-09-12T17:36:55.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.048+0000 7f1ad43488c0 1 < completed delete operation key=GWJ78NNXOL1R tag=0E6ISK0C06YA type=del 2024-09-12T17:36:55.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.052+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=Q00GYWNH8N3G type=del size=1026267 2024-09-12T17:36:55.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.056+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~UQ6951UB796W.0 size=1048576 2024-09-12T17:36:55.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.056+0000 7f1ad43488c0 1 < canceled part key=_multipart_9Z2EHQA8T5F4.2~UQ6951UB796W.1 size=1048576 2024-09-12T17:36:55.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.056+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~UQ6951UB796W.2 size=477162 2024-09-12T17:36:55.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.060+0000 7f1ad43488c0 1 < canceled multipart upload key=9Z2EHQA8T5F4 upload=UQ6951UB796W tag=T3RPWLAPBQ7B type=write size=3622890 2024-09-12T17:36:55.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.068+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~HTASYJFPD3OT.0 size=1048576 2024-09-12T17:36:55.069 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.068+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~HTASYJFPD3OT.1 size=221005 2024-09-12T17:36:55.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.068+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=HTASYJFPD3OT tag=6BA570E3HAYK type=write size=2318157 2024-09-12T17:36:55.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.072+0000 7f1ad43488c0 1 < completed write operation key=6Z3F28JHHEQS tag=4V4FQHFWIDX2 type=write size=247924 2024-09-12T17:36:55.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.076+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~JLRK8AMH5UPY.0 size=1048576 2024-09-12T17:36:55.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.080+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~JLRK8AMH5UPY.1 size=1048576 2024-09-12T17:36:55.082 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.080+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~JLRK8AMH5UPY.2 size=941974 2024-09-12T17:36:55.082 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.080+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=JLRK8AMH5UPY tag=SZOYQZ3ZULP2 type=write size=4087702 2024-09-12T17:36:55.085 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.084+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~E0QE4FS7DHT5.0 size=20230 2024-09-12T17:36:55.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.088+0000 7f1ad43488c0 1 < completed multipart upload key=RH4HYE315U5Y upload=E0QE4FS7DHT5 tag=PDBYSLW6MACM type=write size=1068806 2024-09-12T17:36:55.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.092+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=1IUHSESC5X6V type=del size=1786 2024-09-12T17:36:55.098 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.096+0000 7f1ad43488c0 1 < suggested update operation key=X0HT3K3OREL7 tag=8XEV6OSEHREZ type=del size=3557398 2024-09-12T17:36:55.102 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.100+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=Z2XDIRG64R5O type=del size=112453 2024-09-12T17:36:55.105 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.104+0000 7f1ad43488c0 1 < completed write operation key=SIZ0Z1KWTGUJ tag=PX6GUOF6U6LB type=write size=628158 2024-09-12T17:36:55.111 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.112+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~LU5CZ49TA7BJ.0 size=1048576 2024-09-12T17:36:55.114 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.112+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~LU5CZ49TA7BJ.1 size=930039 2024-09-12T17:36:55.114 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.112+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=LU5CZ49TA7BJ tag=8LYI734TBRRI type=write size=3027191 2024-09-12T17:36:55.117 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.116+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~H8BT7T3NP8N3.0 size=82751 2024-09-12T17:36:55.122 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.120+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=H8BT7T3NP8N3 tag=DIB3381CV6PA type=write size=1131327 2024-09-12T17:36:55.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.124+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=8M9WWP4JS87S type=del size=1072595 2024-09-12T17:36:55.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.128+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~QMA6GDI72K2S.0 size=1048576 2024-09-12T17:36:55.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.132+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~QMA6GDI72K2S.1 size=1048576 2024-09-12T17:36:55.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.132+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~QMA6GDI72K2S.2 size=200871 2024-09-12T17:36:55.139 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.140+0000 7f1ad43488c0 1 < completed multipart upload key=7RSHIZRKK2OY upload=QMA6GDI72K2S tag=MFZ9XD420J1J type=write size=3346599 2024-09-12T17:36:55.143 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.140+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=O5IX5AA7FC6N type=del size=1396979 2024-09-12T17:36:55.146 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.144+0000 7f1ad43488c0 1 < completed write operation key=PKC1RR4FZWE0 tag=WRS6O1GW45K6 type=write size=81466 2024-09-12T17:36:55.152 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.152+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~0GSFHFATOXC5.0 size=923681 2024-09-12T17:36:55.152 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.152+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=0GSFHFATOXC5 tag=P9SMMM66E7X8 type=write size=1972257 2024-09-12T17:36:55.155 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.156+0000 7f1ad43488c0 1 < completed delete operation key=GWJ78NNXOL1R tag=FG0GC6BJZKHQ type=del 2024-09-12T17:36:55.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.156+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=0YU512JTOKSB type=del size=391792 2024-09-12T17:36:55.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.160+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~ZCLGQSBZLP4S.0 size=1048576 2024-09-12T17:36:55.165 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.164+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~ZCLGQSBZLP4S.1 size=764242 2024-09-12T17:36:55.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.168+0000 7f1ad43488c0 1 < completed multipart upload key=IY2AM7CJDUZG upload=ZCLGQSBZLP4S tag=QGLKO0YKP1VR type=write size=2861394 2024-09-12T17:36:55.176 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.176+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~MXORCHPFX4YV.0 size=906457 2024-09-12T17:36:55.176 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.176+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=MXORCHPFX4YV tag=V59FFNUP1DX3 type=write size=1955033 2024-09-12T17:36:55.179 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.180+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=911MXVIJE1A9 type=del 2024-09-12T17:36:55.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.184+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=KFEHGYHE0B1Y type=del size=9477 2024-09-12T17:36:55.186 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.184+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=9EJ26Q12QAAI type=del 2024-09-12T17:36:55.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.188+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=Z84JIMZ88OND type=del size=353720 2024-09-12T17:36:55.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.192+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~WV5U07DVQ3CF.0 size=1048576 2024-09-12T17:36:55.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.196+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~WV5U07DVQ3CF.1 size=149082 2024-09-12T17:36:55.201 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.200+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=WV5U07DVQ3CF tag=EAL9FJ2GJR1A type=write size=2246234 2024-09-12T17:36:55.207 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.204+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~PVPYV7ZP27KC.0 size=1048576 2024-09-12T17:36:55.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.208+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~PVPYV7ZP27KC.1 size=630556 2024-09-12T17:36:55.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.208+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=PVPYV7ZP27KC tag=1E11S9FL2GMS type=write size=2727708 2024-09-12T17:36:55.213 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.212+0000 7f1ad43488c0 1 < completed delete operation key=2SDYAQRNWAJK tag=YJQ1WF0EFRBW type=del 2024-09-12T17:36:55.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.216+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=0AHZN57TCTWL type=write size=684405 2024-09-12T17:36:55.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.220+0000 7f1ad43488c0 1 < suggested update operation key=0MV3GCBTWZD0 tag=4DGJBF65C7P3 type=del size=9642 2024-09-12T17:36:55.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.224+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=XPXTRNP3QDP8 type=del size=3729971 2024-09-12T17:36:55.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.228+0000 7f1ad43488c0 1 < suggested update operation key=C7QSOK3D3IWJ tag=Q00GYWNH8N3G type=del size=1026267 2024-09-12T17:36:55.236 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.236+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~1ZLKRBO7D3DB.0 size=1048576 2024-09-12T17:36:55.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.236+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~1ZLKRBO7D3DB.1 size=59570 2024-09-12T17:36:55.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.236+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=1ZLKRBO7D3DB tag=MUM6342SFU68 type=write size=2156722 2024-09-12T17:36:55.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.240+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~HTASYJFPD3OT.0 size=1048576 2024-09-12T17:36:55.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.244+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~HTASYJFPD3OT.1 size=221005 2024-09-12T17:36:55.248 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.248+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=HTASYJFPD3OT tag=6BA570E3HAYK type=write size=2318157 2024-09-12T17:36:55.253 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.252+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~IYORCWLS4APT.0 size=1048576 2024-09-12T17:36:55.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.256+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~IYORCWLS4APT.1 size=355643 2024-09-12T17:36:55.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.256+0000 7f1ad43488c0 1 > prepared multipart upload key=NHOG1WG3VT6N upload=IYORCWLS4APT tag=C8BPPGPFQJXD type=write size=2452795 2024-09-12T17:36:55.258 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.256+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~JLRK8AMH5UPY.0 size=1048576 2024-09-12T17:36:55.264 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.260+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~JLRK8AMH5UPY.1 size=1048576 2024-09-12T17:36:55.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.264+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~JLRK8AMH5UPY.2 size=941974 2024-09-12T17:36:55.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.268+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=JLRK8AMH5UPY tag=SZOYQZ3ZULP2 type=write size=4087702 2024-09-12T17:36:55.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.272+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=0ADTEIU7JSPQ type=del size=904136 2024-09-12T17:36:55.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.276+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=1IUHSESC5X6V type=del 2024-09-12T17:36:55.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.276+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=ZCW2O78O0O0X type=del size=454011 2024-09-12T17:36:55.282 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.280+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=Z2XDIRG64R5O type=del 2024-09-12T17:36:55.285 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.284+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=VT1ILLHZF65M type=del size=2597883 2024-09-12T17:36:55.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.288+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~LU5CZ49TA7BJ.0 size=1048576 2024-09-12T17:36:55.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.288+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~LU5CZ49TA7BJ.1 size=930039 2024-09-12T17:36:55.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.296+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=LU5CZ49TA7BJ tag=8LYI734TBRRI type=write size=3027191 2024-09-12T17:36:55.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.296+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=DHM7X4RJBDH2 type=del size=1409387 2024-09-12T17:36:55.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.300+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=8M9WWP4JS87S type=del 2024-09-12T17:36:55.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.308+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=U687HHCIK11X type=del size=2335203 2024-09-12T17:36:55.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.316+0000 7f1ad43488c0 1 < suggested update operation key=BCPDXAL027U2 tag=O5IX5AA7FC6N type=del size=1396979 2024-09-12T17:36:55.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.320+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~9JTYJAMU5EX8.0 size=972892 2024-09-12T17:36:55.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.320+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=9JTYJAMU5EX8 tag=8I3AJ06KZOOM type=write size=2021468 2024-09-12T17:36:55.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.324+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~0GSFHFATOXC5.0 size=923681 2024-09-12T17:36:55.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.328+0000 7f1ad43488c0 1 < completed multipart upload key=8U3L46JDJ8VS upload=0GSFHFATOXC5 tag=P9SMMM66E7X8 type=write size=1972257 2024-09-12T17:36:55.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.332+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~5IZGZYICUDNN.0 size=775717 2024-09-12T17:36:55.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.332+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=5IZGZYICUDNN tag=EBZ3RBE81QHS type=write size=1824293 2024-09-12T17:36:55.337 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.336+0000 7f1ad43488c0 1 < completed delete operation key=XOEPYERWY6IT tag=0YU512JTOKSB type=del 2024-09-12T17:36:55.342 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.340+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~N4BD1Q6NMYW7.0 size=769535 2024-09-12T17:36:55.342 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.340+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=N4BD1Q6NMYW7 tag=7IL1ATOPR9AU type=write size=1818111 2024-09-12T17:36:55.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.344+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~MXORCHPFX4YV.0 size=906457 2024-09-12T17:36:55.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.348+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=MXORCHPFX4YV tag=V59FFNUP1DX3 type=write size=1955033 2024-09-12T17:36:55.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.352+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=A7JX52BJJ3FO type=del size=1941543 2024-09-12T17:36:55.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.356+0000 7f1ad43488c0 1 < completed delete operation key=2SDYAQRNWAJK tag=KFEHGYHE0B1Y type=del 2024-09-12T17:36:55.362 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.360+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~JLO0LUHSGQFO.0 size=1048576 2024-09-12T17:36:55.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.364+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~JLO0LUHSGQFO.1 size=1048576 2024-09-12T17:36:55.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.368+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~JLO0LUHSGQFO.2 size=149437 2024-09-12T17:36:55.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.368+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=JLO0LUHSGQFO tag=LYNYQSVGYORF type=write size=3295165 2024-09-12T17:36:55.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.372+0000 7f1ad43488c0 1 < suggested remove operation key=GZ7LGZQHW4CY tag=Z84JIMZ88OND type=del 2024-09-12T17:36:55.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.376+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=SJZTJZEM4UD6 type=del size=546557 2024-09-12T17:36:55.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.380+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~PVPYV7ZP27KC.0 size=1048576 2024-09-12T17:36:55.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.380+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~PVPYV7ZP27KC.1 size=630556 2024-09-12T17:36:55.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.388+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=PVPYV7ZP27KC tag=1E11S9FL2GMS type=write size=2727708 2024-09-12T17:36:55.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.392+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~DGPQ0BIHND1V.0 size=1048576 2024-09-12T17:36:55.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.396+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~DGPQ0BIHND1V.1 size=1048576 2024-09-12T17:36:55.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.400+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~DGPQ0BIHND1V.2 size=257357 2024-09-12T17:36:55.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.400+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=DGPQ0BIHND1V tag=RZBWOOCJ3OEG type=write size=3403085 2024-09-12T17:36:55.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.400+0000 7f1ad43488c0 -1 < failed to complete operation key=GZ7LGZQHW4CY tag=0AHZN57TCTWL type=write size=684405: (22) Invalid argument 2024-09-12T17:36:55.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.408+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~9A9U8S78VYVH.0 size=1048576 2024-09-12T17:36:55.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.412+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~9A9U8S78VYVH.1 size=686820 2024-09-12T17:36:55.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.412+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=9A9U8S78VYVH tag=1Y32NRVNAG0M type=write size=2783972 2024-09-12T17:36:55.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.412+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=XPXTRNP3QDP8 type=del 2024-09-12T17:36:55.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.420+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~562NMEV4MB1X.0 size=1048576 2024-09-12T17:36:55.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.424+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~562NMEV4MB1X.1 size=1048576 2024-09-12T17:36:55.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.424+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~562NMEV4MB1X.2 size=47265 2024-09-12T17:36:55.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.424+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=562NMEV4MB1X tag=DOA8HKXFHREG type=write size=3192993 2024-09-12T17:36:55.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.428+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~1ZLKRBO7D3DB.0 size=1048576 2024-09-12T17:36:55.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.432+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~1ZLKRBO7D3DB.1 size=59570 2024-09-12T17:36:55.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.436+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=1ZLKRBO7D3DB tag=MUM6342SFU68 type=write size=2156722 2024-09-12T17:36:55.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.444+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~6M0ARGN9VIAF.0 size=1048576 2024-09-12T17:36:55.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.444+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~6M0ARGN9VIAF.1 size=1048576 2024-09-12T17:36:55.449 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.448+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~6M0ARGN9VIAF.2 size=922628 2024-09-12T17:36:55.449 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.448+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=6M0ARGN9VIAF tag=SXRIC9UFVUTI type=write size=4068356 2024-09-12T17:36:55.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.452+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~IYORCWLS4APT.0 size=1048576 2024-09-12T17:36:55.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.452+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~IYORCWLS4APT.1 size=355643 2024-09-12T17:36:55.460 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.460+0000 7f1ad43488c0 1 < completed multipart upload key=NHOG1WG3VT6N upload=IYORCWLS4APT tag=C8BPPGPFQJXD type=write size=2452795 2024-09-12T17:36:55.463 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.464+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=ZHCFUVJIKJX9 type=del size=2154795 2024-09-12T17:36:55.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.464+0000 7f1ad43488c0 1 < completed delete operation key=05PAFB226IFP tag=0ADTEIU7JSPQ type=del 2024-09-12T17:36:55.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.468+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=PDCJENSUG6LH type=del size=2704437 2024-09-12T17:36:55.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.472+0000 7f1ad43488c0 1 < completed delete operation key=SIZ0Z1KWTGUJ tag=ZCW2O78O0O0X type=del 2024-09-12T17:36:55.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.476+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=240MTLOEX7DL type=del size=2080406 2024-09-12T17:36:55.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.484+0000 7f1ad43488c0 1 < suggested update operation key=XOEPYERWY6IT tag=VT1ILLHZF65M type=del size=2597883 2024-09-12T17:36:55.489 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.488+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=AG6CIK78O5CI type=del size=603111 2024-09-12T17:36:55.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.492+0000 7f1ad43488c0 1 < canceled operation key=PKC1RR4FZWE0 tag=DHM7X4RJBDH2 type=del size=1409387 2024-09-12T17:36:55.495 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.496+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=IAV3PC7ZPYS1 type=del size=1189317 2024-09-12T17:36:55.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.496+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=U687HHCIK11X type=del 2024-09-12T17:36:55.504 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.504+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~EYURYEI1H7JY.0 size=1048576 2024-09-12T17:36:55.507 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.508+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~EYURYEI1H7JY.1 size=1048576 2024-09-12T17:36:55.509 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.508+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~EYURYEI1H7JY.2 size=33023 2024-09-12T17:36:55.510 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.508+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=EYURYEI1H7JY tag=EA44ONG3XW70 type=write size=3178751 2024-09-12T17:36:55.513 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.512+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~9JTYJAMU5EX8.0 size=972892 2024-09-12T17:36:55.519 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.520+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=9JTYJAMU5EX8 tag=8I3AJ06KZOOM type=write size=2021468 2024-09-12T17:36:55.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.524+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=YULQY4AS55NW type=del size=4078466 2024-09-12T17:36:55.527 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.524+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~5IZGZYICUDNN.0 size=775717 2024-09-12T17:36:55.532 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.532+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=5IZGZYICUDNN tag=EBZ3RBE81QHS type=write size=1824293 2024-09-12T17:36:55.534 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.532+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=V3TIKHL21C26 type=write size=422928 2024-09-12T17:36:55.539 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.536+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~N4BD1Q6NMYW7.0 size=769535 2024-09-12T17:36:55.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.544+0000 7f1ad43488c0 1 < completed multipart upload key=7RSHIZRKK2OY upload=N4BD1Q6NMYW7 tag=7IL1ATOPR9AU type=write size=1818111 2024-09-12T17:36:55.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.544+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=A98RRIDDZ2CX type=del size=1396653 2024-09-12T17:36:55.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.548+0000 7f1ad43488c0 1 < completed delete operation key=SIZ0Z1KWTGUJ tag=A7JX52BJJ3FO type=del 2024-09-12T17:36:55.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.556+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~65C2172STXFF.0 size=1048576 2024-09-12T17:36:55.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.556+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~65C2172STXFF.1 size=1048576 2024-09-12T17:36:55.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.560+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~65C2172STXFF.2 size=820717 2024-09-12T17:36:55.562 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.560+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=65C2172STXFF tag=BMT8B05KMP7N type=write size=3966445 2024-09-12T17:36:55.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.564+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~JLO0LUHSGQFO.0 size=1048576 2024-09-12T17:36:55.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.568+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~JLO0LUHSGQFO.1 size=1048576 2024-09-12T17:36:55.571 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.568+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~JLO0LUHSGQFO.2 size=149437 2024-09-12T17:36:55.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.576+0000 7f1ad43488c0 1 < completed multipart upload key=WWB6LAHAMIR9 upload=JLO0LUHSGQFO tag=LYNYQSVGYORF type=write size=3295165 2024-09-12T17:36:55.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.580+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=W03YMDP2S6O7 type=del size=1348390 2024-09-12T17:36:55.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.584+0000 7f1ad43488c0 1 < completed delete operation key=ECEF8IJGU4Z8 tag=SJZTJZEM4UD6 type=del 2024-09-12T17:36:55.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.588+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=9KA615C7WKW9 type=del size=1440797 2024-09-12T17:36:55.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.588+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~DGPQ0BIHND1V.0 size=1048576 2024-09-12T17:36:55.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.592+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~DGPQ0BIHND1V.1 size=1048576 2024-09-12T17:36:55.596 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.596+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~DGPQ0BIHND1V.2 size=257357 2024-09-12T17:36:55.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.600+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=DGPQ0BIHND1V tag=RZBWOOCJ3OEG type=write size=3403085 2024-09-12T17:36:55.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.604+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=RHMUVOGOXXBE type=del size=1129479 2024-09-12T17:36:55.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.604+0000 7f1ad43488c0 1 < canceled part key=_multipart_SDJ53NSPOIRC.2~9A9U8S78VYVH.0 size=1048576 2024-09-12T17:36:55.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.612+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~9A9U8S78VYVH.1 size=686820 2024-09-12T17:36:55.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.616+0000 7f1ad43488c0 1 < canceled multipart upload key=SDJ53NSPOIRC upload=9A9U8S78VYVH tag=1Y32NRVNAG0M type=write size=2783972 2024-09-12T17:36:55.621 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.620+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=B77KBEBJCPE9 type=del size=660266 2024-09-12T17:36:55.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.624+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~562NMEV4MB1X.0 size=1048576 2024-09-12T17:36:55.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.628+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~562NMEV4MB1X.1 size=1048576 2024-09-12T17:36:55.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.628+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~562NMEV4MB1X.2 size=47265 2024-09-12T17:36:55.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.636+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=562NMEV4MB1X tag=DOA8HKXFHREG type=write size=3192993 2024-09-12T17:36:55.639 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.640+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=C1WNTKCNDREF type=del size=3248906 2024-09-12T17:36:55.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.640+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~6M0ARGN9VIAF.0 size=1048576 2024-09-12T17:36:55.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.644+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~6M0ARGN9VIAF.1 size=1048576 2024-09-12T17:36:55.647 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.648+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~6M0ARGN9VIAF.2 size=922628 2024-09-12T17:36:55.652 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.652+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=6M0ARGN9VIAF tag=SXRIC9UFVUTI type=write size=4068356 2024-09-12T17:36:55.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.656+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=AWBCD2NCNFWI type=del size=483861 2024-09-12T17:36:55.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.656+0000 7f1ad43488c0 1 < canceled operation key=WWB6LAHAMIR9 tag=ZHCFUVJIKJX9 type=del size=2154795 2024-09-12T17:36:55.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.660+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=JM3NCPUDPJRV type=write size=313798 2024-09-12T17:36:55.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.664+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=PDCJENSUG6LH type=del 2024-09-12T17:36:55.668 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.668+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=UAEH6IFPEM4I type=del size=1116077 2024-09-12T17:36:55.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.672+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=240MTLOEX7DL type=del 2024-09-12T17:36:55.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.676+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~1FPE5WH2WN09.0 size=892054 2024-09-12T17:36:55.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.676+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=1FPE5WH2WN09 tag=8FARMYUWG5V5 type=write size=1940630 2024-09-12T17:36:55.683 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.680+0000 7f1ad43488c0 1 < suggested update operation key=2SDYAQRNWAJK tag=AG6CIK78O5CI type=del size=603111 2024-09-12T17:36:55.686 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.684+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=UKL5HTYPZSEJ type=del size=1114198 2024-09-12T17:36:55.689 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.688+0000 7f1ad43488c0 1 < completed delete operation key=X0HT3K3OREL7 tag=IAV3PC7ZPYS1 type=del 2024-09-12T17:36:55.695 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.696+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~ZSTRMMAN91YJ.0 size=1048576 2024-09-12T17:36:55.698 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.696+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~ZSTRMMAN91YJ.1 size=791394 2024-09-12T17:36:55.698 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.696+0000 7f1ad43488c0 1 > prepared multipart upload key=CHMM14VRIOQH upload=ZSTRMMAN91YJ tag=6PERW89JXIUY type=write size=2888546 2024-09-12T17:36:55.698 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.696+0000 7f1ad43488c0 1 < canceled part key=_multipart_A49CE02X3L2L.2~EYURYEI1H7JY.0 size=1048576 2024-09-12T17:36:55.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.700+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~EYURYEI1H7JY.1 size=1048576 2024-09-12T17:36:55.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.700+0000 7f1ad43488c0 1 < canceled part key=_multipart_A49CE02X3L2L.2~EYURYEI1H7JY.2 size=33023 2024-09-12T17:36:55.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.704+0000 7f1ad43488c0 1 < canceled multipart upload key=A49CE02X3L2L upload=EYURYEI1H7JY tag=EA44ONG3XW70 type=write size=3178751 2024-09-12T17:36:55.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.708+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=GFAA4338OIFP type=del size=1875252 2024-09-12T17:36:55.713 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.712+0000 7f1ad43488c0 1 < completed delete operation key=SIZ0Z1KWTGUJ tag=YULQY4AS55NW type=del 2024-09-12T17:36:55.716 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.716+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=HAON5H4YAQO3 type=del size=427561 2024-09-12T17:36:55.719 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.720+0000 7f1ad43488c0 1 < completed write operation key=7RSHIZRKK2OY tag=V3TIKHL21C26 type=write size=422928 2024-09-12T17:36:55.722 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.720+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=2C6ITLZHZ1EF type=del size=2557509 2024-09-12T17:36:55.728 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.728+0000 7f1ad43488c0 1 < suggested update operation key=GZ7LGZQHW4CY tag=A98RRIDDZ2CX type=del size=1396653 2024-09-12T17:36:55.731 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.732+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=MBLRGU63Q3C6 type=del size=962437 2024-09-12T17:36:55.732 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.732+0000 7f1ad43488c0 1 < canceled part key=_multipart_XOEPYERWY6IT.2~65C2172STXFF.0 size=1048576 2024-09-12T17:36:55.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.732+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~65C2172STXFF.1 size=1048576 2024-09-12T17:36:55.737 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.736+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~65C2172STXFF.2 size=820717 2024-09-12T17:36:55.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.744+0000 7f1ad43488c0 1 < canceled multipart upload key=XOEPYERWY6IT upload=65C2172STXFF tag=BMT8B05KMP7N type=write size=3966445 2024-09-12T17:36:55.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.748+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~5L3KSC6EIR42.0 size=1048576 2024-09-12T17:36:55.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.752+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~5L3KSC6EIR42.1 size=1048576 2024-09-12T17:36:55.754 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.752+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~5L3KSC6EIR42.2 size=43312 2024-09-12T17:36:55.754 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.752+0000 7f1ad43488c0 1 > prepared multipart upload key=SIZ0Z1KWTGUJ upload=5L3KSC6EIR42 tag=9ESH31ADCFPI type=write size=3189040 2024-09-12T17:36:55.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.756+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=W03YMDP2S6O7 type=del 2024-09-12T17:36:55.762 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.760+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~76QNASPCG3UA.0 size=1048576 2024-09-12T17:36:55.764 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.764+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~76QNASPCG3UA.1 size=1048576 2024-09-12T17:36:55.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.764+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~76QNASPCG3UA.2 size=621742 2024-09-12T17:36:55.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.764+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=76QNASPCG3UA tag=URRO5DWO3X4S type=write size=3767470 2024-09-12T17:36:55.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.772+0000 7f1ad43488c0 1 < suggested update operation key=WWB6LAHAMIR9 tag=9KA615C7WKW9 type=del size=1440797 2024-09-12T17:36:55.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.776+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=LAJ0RR1N99Q6 type=del size=3964191 2024-09-12T17:36:55.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.776+0000 7f1ad43488c0 1 < completed delete operation key=SIZ0Z1KWTGUJ tag=RHMUVOGOXXBE type=del 2024-09-12T17:36:55.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.784+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~6TCR87QZH0NZ.0 size=565732 2024-09-12T17:36:55.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.784+0000 7f1ad43488c0 1 > prepared multipart upload key=GWJ78NNXOL1R upload=6TCR87QZH0NZ tag=2MXLAQ43N1Z9 type=write size=1614308 2024-09-12T17:36:55.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.784+0000 7f1ad43488c0 -1 < failed to complete operation key=WWB6LAHAMIR9 tag=B77KBEBJCPE9 type=del size=660266: (22) Invalid argument 2024-09-12T17:36:55.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.788+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=OIY67EJ5RWCT type=del size=4065936 2024-09-12T17:36:55.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.792+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=C1WNTKCNDREF type=del 2024-09-12T17:36:55.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.792+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=XWKDWKU57YOF type=write size=688408 2024-09-12T17:36:55.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.800+0000 7f1ad43488c0 1 < suggested update operation key=NHOG1WG3VT6N tag=AWBCD2NCNFWI type=del size=483861 2024-09-12T17:36:55.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.804+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~X90EC0ENERBZ.0 size=770925 2024-09-12T17:36:55.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.804+0000 7f1ad43488c0 1 > prepared multipart upload key=WFEJLVRCKIUU upload=X90EC0ENERBZ tag=XP772HHWP4SC type=write size=1819501 2024-09-12T17:36:55.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.808+0000 7f1ad43488c0 1 < completed write operation key=RH4HYE315U5Y tag=JM3NCPUDPJRV type=write size=313798 2024-09-12T17:36:55.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.808+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=64YGPC5FAJ2A type=del size=1981475 2024-09-12T17:36:55.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.812+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=UAEH6IFPEM4I type=del 2024-09-12T17:36:55.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.816+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=B0L1SQ0JUQ8M type=del size=1636711 2024-09-12T17:36:55.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.816+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~1FPE5WH2WN09.0 size=892054 2024-09-12T17:36:55.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.824+0000 7f1ad43488c0 1 < completed multipart upload key=7RSHIZRKK2OY upload=1FPE5WH2WN09 tag=8FARMYUWG5V5 type=write size=1940630 2024-09-12T17:36:55.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.828+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~5Q02H6TVVWJG.0 size=1048576 2024-09-12T17:36:55.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.828+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~5Q02H6TVVWJG.1 size=1048576 2024-09-12T17:36:55.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.832+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~5Q02H6TVVWJG.2 size=938890 2024-09-12T17:36:55.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.832+0000 7f1ad43488c0 1 > prepared multipart upload key=SIZ0Z1KWTGUJ upload=5Q02H6TVVWJG tag=8IRGPQUARSSW type=write size=4084618 2024-09-12T17:36:55.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.832+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=UKL5HTYPZSEJ type=del 2024-09-12T17:36:55.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.836+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=C26ZGFF1VIFW type=del size=1743435 2024-09-12T17:36:55.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.840+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~ZSTRMMAN91YJ.0 size=1048576 2024-09-12T17:36:55.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.840+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~ZSTRMMAN91YJ.1 size=791394 2024-09-12T17:36:55.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.844+0000 7f1ad43488c0 1 < completed multipart upload key=CHMM14VRIOQH upload=ZSTRMMAN91YJ tag=6PERW89JXIUY type=write size=2888546 2024-09-12T17:36:55.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.848+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=OJ2LDVTTWGTH type=del size=662453 2024-09-12T17:36:55.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.852+0000 7f1ad43488c0 1 < completed delete operation key=XOEPYERWY6IT tag=GFAA4338OIFP type=del 2024-09-12T17:36:55.855 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.856+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=Q0BQ8RLFYXPX type=del size=2064931 2024-09-12T17:36:55.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.860+0000 7f1ad43488c0 1 < suggested remove operation key=GZ7LGZQHW4CY tag=HAON5H4YAQO3 type=del 2024-09-12T17:36:55.864 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.864+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=CVK035MIEBZA type=write size=969069 2024-09-12T17:36:55.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.868+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=2C6ITLZHZ1EF type=del 2024-09-12T17:36:55.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.872+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~KQFEHOTU352C.0 size=557127 2024-09-12T17:36:55.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.872+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=KQFEHOTU352C tag=TEB6LI5YVVZG type=write size=1605703 2024-09-12T17:36:55.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.876+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=MBLRGU63Q3C6 type=del 2024-09-12T17:36:55.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.876+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=4YN968PR6UB0 type=del size=3565290 2024-09-12T17:36:55.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.880+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~5L3KSC6EIR42.0 size=1048576 2024-09-12T17:36:55.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.884+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~5L3KSC6EIR42.1 size=1048576 2024-09-12T17:36:55.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.884+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~5L3KSC6EIR42.2 size=43312 2024-09-12T17:36:55.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.892+0000 7f1ad43488c0 1 < completed multipart upload key=SIZ0Z1KWTGUJ upload=5L3KSC6EIR42 tag=9ESH31ADCFPI type=write size=3189040 2024-09-12T17:36:55.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.896+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=L4DKJ2QVGQTM type=del size=3034852 2024-09-12T17:36:55.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.900+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~76QNASPCG3UA.0 size=1048576 2024-09-12T17:36:55.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.904+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~76QNASPCG3UA.1 size=1048576 2024-09-12T17:36:55.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.904+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~76QNASPCG3UA.2 size=621742 2024-09-12T17:36:55.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.912+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=76QNASPCG3UA tag=URRO5DWO3X4S type=write size=3767470 2024-09-12T17:36:55.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.916+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=PZ5DR8889APM type=del size=1430889 2024-09-12T17:36:55.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.916+0000 7f1ad43488c0 1 < completed delete operation key=X0HT3K3OREL7 tag=LAJ0RR1N99Q6 type=del 2024-09-12T17:36:55.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.920+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=X0K7LN419TCU type=del size=2468531 2024-09-12T17:36:55.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.924+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~6TCR87QZH0NZ.0 size=565732 2024-09-12T17:36:55.930 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.928+0000 7f1ad43488c0 1 < completed multipart upload key=GWJ78NNXOL1R upload=6TCR87QZH0NZ tag=2MXLAQ43N1Z9 type=write size=1614308 2024-09-12T17:36:55.933 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.932+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=2MM8D2720V7M type=del size=1900748 2024-09-12T17:36:55.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.936+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=OIY67EJ5RWCT type=del 2024-09-12T17:36:55.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.940+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~540F0PEAJIHY.0 size=243647 2024-09-12T17:36:55.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.940+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=540F0PEAJIHY tag=L8YW0D95UPDM type=write size=1292223 2024-09-12T17:36:55.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.944+0000 7f1ad43488c0 1 < completed write operation key=05PAFB226IFP tag=XWKDWKU57YOF type=write size=688408 2024-09-12T17:36:55.948 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.948+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=4JZK2OI3KENI type=del size=456055 2024-09-12T17:36:55.951 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.948+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~X90EC0ENERBZ.0 size=770925 2024-09-12T17:36:55.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.956+0000 7f1ad43488c0 1 < completed multipart upload key=WFEJLVRCKIUU upload=X90EC0ENERBZ tag=XP772HHWP4SC type=write size=1819501 2024-09-12T17:36:55.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.956+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=CVJWHRMZQ50A type=write size=430914 2024-09-12T17:36:55.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.960+0000 7f1ad43488c0 1 < completed delete operation key=SIZ0Z1KWTGUJ tag=64YGPC5FAJ2A type=del 2024-09-12T17:36:55.967 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.968+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~XR37ULGS81C3.0 size=1048576 2024-09-12T17:36:55.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.968+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~XR37ULGS81C3.1 size=1048576 2024-09-12T17:36:55.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.972+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~XR37ULGS81C3.2 size=492754 2024-09-12T17:36:55.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.972+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=XR37ULGS81C3 tag=02CNYVTCD31U type=write size=3638482 2024-09-12T17:36:55.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.976+0000 7f1ad43488c0 1 < suggested remove operation key=NHOG1WG3VT6N tag=B0L1SQ0JUQ8M type=del 2024-09-12T17:36:55.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.980+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=BO6FWBDN2L14 type=del size=1806831 2024-09-12T17:36:55.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.980+0000 7f1ad43488c0 1 < canceled part key=_multipart_SIZ0Z1KWTGUJ.2~5Q02H6TVVWJG.0 size=1048576 2024-09-12T17:36:55.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.984+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~5Q02H6TVVWJG.1 size=1048576 2024-09-12T17:36:55.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.988+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~5Q02H6TVVWJG.2 size=938890 2024-09-12T17:36:55.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.992+0000 7f1ad43488c0 1 < canceled multipart upload key=SIZ0Z1KWTGUJ upload=5Q02H6TVVWJG tag=8IRGPQUARSSW type=write size=4084618 2024-09-12T17:36:55.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:55.996+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=TDE4Y7VZANL4 type=del size=1221329 2024-09-12T17:36:56.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.000+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=C26ZGFF1VIFW type=del 2024-09-12T17:36:56.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.004+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=J32DMKMOTDEG type=del size=3786377 2024-09-12T17:36:56.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.008+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=OJ2LDVTTWGTH type=del 2024-09-12T17:36:56.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.012+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~47FR55XK4XZV.0 size=1048576 2024-09-12T17:36:56.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.016+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~47FR55XK4XZV.1 size=796698 2024-09-12T17:36:56.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.016+0000 7f1ad43488c0 1 > prepared multipart upload key=GWJ78NNXOL1R upload=47FR55XK4XZV tag=6UI00QI3NUD6 type=write size=2893850 2024-09-12T17:36:56.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.020+0000 7f1ad43488c0 1 < suggested remove operation key=X078SB1ITNII tag=Q0BQ8RLFYXPX type=del 2024-09-12T17:36:56.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.024+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=CBX9WM66A40Z type=del size=1726260 2024-09-12T17:36:56.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.028+0000 7f1ad43488c0 1 < completed write operation key=GZ7LGZQHW4CY tag=CVK035MIEBZA type=write size=969069 2024-09-12T17:36:56.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.032+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=3ESAJVZ0K1PP type=del size=3911959 2024-09-12T17:36:56.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.032+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~KQFEHOTU352C.0 size=557127 2024-09-12T17:36:56.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.040+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=KQFEHOTU352C tag=TEB6LI5YVVZG type=write size=1605703 2024-09-12T17:36:56.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.044+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~JOFAWO38KA0S.0 size=1048576 2024-09-12T17:36:56.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.044+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~JOFAWO38KA0S.1 size=1048576 2024-09-12T17:36:56.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.048+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~JOFAWO38KA0S.2 size=112011 2024-09-12T17:36:56.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.048+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=JOFAWO38KA0S tag=RHRYXE06FSTK type=write size=3257739 2024-09-12T17:36:56.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.052+0000 7f1ad43488c0 1 < completed delete operation key=IY2AM7CJDUZG tag=4YN968PR6UB0 type=del 2024-09-12T17:36:56.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.052+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=9X42K1RV263K type=del size=78237 2024-09-12T17:36:56.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.056+0000 7f1ad43488c0 1 < completed delete operation key=C7QSOK3D3IWJ tag=L4DKJ2QVGQTM type=del 2024-09-12T17:36:56.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.060+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=WUUJPQ7FML2J type=del size=3160368 2024-09-12T17:36:56.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.064+0000 7f1ad43488c0 1 < suggested update operation key=SDJ53NSPOIRC tag=PZ5DR8889APM type=del size=1430889 2024-09-12T17:36:56.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.072+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~WC6SGGWDJQ7B.0 size=1048576 2024-09-12T17:36:56.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.072+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~WC6SGGWDJQ7B.1 size=531356 2024-09-12T17:36:56.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.072+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=WC6SGGWDJQ7B tag=M60A9RIV60BL type=write size=2628508 2024-09-12T17:36:56.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.080+0000 7f1ad43488c0 1 < suggested update operation key=X0HT3K3OREL7 tag=X0K7LN419TCU type=del size=2468531 2024-09-12T17:36:56.086 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.084+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~GB5IE2Z5FZT2.0 size=1048576 2024-09-12T17:36:56.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.088+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~GB5IE2Z5FZT2.1 size=1048576 2024-09-12T17:36:56.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.092+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~GB5IE2Z5FZT2.2 size=273655 2024-09-12T17:36:56.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.092+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=GB5IE2Z5FZT2 tag=ZAQ1ZF3ARIOP type=write size=3419383 2024-09-12T17:36:56.095 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.096+0000 7f1ad43488c0 1 < canceled operation key=4QO60GZ9V0GK tag=2MM8D2720V7M type=del size=1900748 2024-09-12T17:36:56.100 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.100+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~YTOJ8SVAKDZK.0 size=1048576 2024-09-12T17:36:56.102 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.100+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~YTOJ8SVAKDZK.1 size=1048576 2024-09-12T17:36:56.104 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.104+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~YTOJ8SVAKDZK.2 size=202196 2024-09-12T17:36:56.104 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.104+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=YTOJ8SVAKDZK tag=N43IZKJEY2G5 type=write size=3347924 2024-09-12T17:36:56.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.108+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~540F0PEAJIHY.0 size=243647 2024-09-12T17:36:56.114 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.112+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=540F0PEAJIHY tag=L8YW0D95UPDM type=write size=1292223 2024-09-12T17:36:56.117 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.116+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=VE9A8475RMWD type=del size=1745450 2024-09-12T17:36:56.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.120+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=4JZK2OI3KENI type=del 2024-09-12T17:36:56.123 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.124+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=G7OLZ2WGMJR9 type=del size=4188443 2024-09-12T17:36:56.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.124+0000 7f1ad43488c0 1 < completed write operation key=ECEF8IJGU4Z8 tag=CVJWHRMZQ50A type=write size=430914 2024-09-12T17:36:56.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.128+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=VSIJYWQBX068 type=write size=332069 2024-09-12T17:36:56.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.128+0000 7f1ad43488c0 1 < canceled part key=_multipart_GZ7LGZQHW4CY.2~XR37ULGS81C3.0 size=1048576 2024-09-12T17:36:56.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.128+0000 7f1ad43488c0 1 < canceled part key=_multipart_GZ7LGZQHW4CY.2~XR37ULGS81C3.1 size=1048576 2024-09-12T17:36:56.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.132+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~XR37ULGS81C3.2 size=492754 2024-09-12T17:36:56.139 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.140+0000 7f1ad43488c0 1 < canceled multipart upload key=GZ7LGZQHW4CY upload=XR37ULGS81C3 tag=02CNYVTCD31U type=write size=3638482 2024-09-12T17:36:56.143 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.140+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=KY8LEQY10KPJ type=del size=927491 2024-09-12T17:36:56.149 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.148+0000 7f1ad43488c0 1 < suggested remove operation key=X0HT3K3OREL7 tag=BO6FWBDN2L14 type=del 2024-09-12T17:36:56.152 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.152+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=22O0CLAKYYOA type=del size=2628866 2024-09-12T17:36:56.156 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.156+0000 7f1ad43488c0 1 < completed delete operation key=WWB6LAHAMIR9 tag=TDE4Y7VZANL4 type=del 2024-09-12T17:36:56.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.156+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=M50O1X0ZIRXV type=del size=3090978 2024-09-12T17:36:56.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.160+0000 7f1ad43488c0 -1 < failed to complete operation key=X0HT3K3OREL7 tag=J32DMKMOTDEG type=del size=3786377: (22) Invalid argument 2024-09-12T17:36:56.165 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.164+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=VI8EAYYORF2V type=del size=2389454 2024-09-12T17:36:56.165 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.164+0000 7f1ad43488c0 1 < canceled part key=_multipart_GWJ78NNXOL1R.2~47FR55XK4XZV.0 size=1048576 2024-09-12T17:36:56.168 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.168+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~47FR55XK4XZV.1 size=796698 2024-09-12T17:36:56.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.172+0000 7f1ad43488c0 1 < canceled multipart upload key=GWJ78NNXOL1R upload=47FR55XK4XZV tag=6UI00QI3NUD6 type=write size=2893850 2024-09-12T17:36:56.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.176+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=JS0DNJ02N9EB type=del size=2618859 2024-09-12T17:36:56.180 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.180+0000 7f1ad43488c0 1 < completed delete operation key=2SDYAQRNWAJK tag=CBX9WM66A40Z type=del 2024-09-12T17:36:56.185 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.184+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~A2K2NTFC9ZC2.0 size=1048576 2024-09-12T17:36:56.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.192+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~A2K2NTFC9ZC2.1 size=1048576 2024-09-12T17:36:56.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.192+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~A2K2NTFC9ZC2.2 size=388879 2024-09-12T17:36:56.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.192+0000 7f1ad43488c0 1 > prepared multipart upload key=ZHFRKX9YY8P5 upload=A2K2NTFC9ZC2 tag=V69R8BUIVIZ3 type=write size=3534607 2024-09-12T17:36:56.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.196+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=3ESAJVZ0K1PP type=del 2024-09-12T17:36:56.201 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.200+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=N6G1XQWDMEMT type=del size=3691869 2024-09-12T17:36:56.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.204+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~JOFAWO38KA0S.0 size=1048576 2024-09-12T17:36:56.207 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.204+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~JOFAWO38KA0S.1 size=1048576 2024-09-12T17:36:56.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.208+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~JOFAWO38KA0S.2 size=112011 2024-09-12T17:36:56.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.216+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=JOFAWO38KA0S tag=RHRYXE06FSTK type=write size=3257739 2024-09-12T17:36:56.218 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.216+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=0FCJJV3EHI4B type=del size=3682002 2024-09-12T17:36:56.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.220+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=9X42K1RV263K type=del 2024-09-12T17:36:56.228 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.228+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~RLLX2U15541S.0 size=964525 2024-09-12T17:36:56.228 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.228+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=RLLX2U15541S tag=3YV4TKNPVHLB type=write size=2013101 2024-09-12T17:36:56.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.228+0000 7f1ad43488c0 1 < completed delete operation key=PKC1RR4FZWE0 tag=WUUJPQ7FML2J type=del 2024-09-12T17:36:56.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.236+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~9S311ZKXDK7C.0 size=1048576 2024-09-12T17:36:56.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.240+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~9S311ZKXDK7C.1 size=1048576 2024-09-12T17:36:56.242 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.240+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~9S311ZKXDK7C.2 size=163557 2024-09-12T17:36:56.242 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.240+0000 7f1ad43488c0 1 > prepared multipart upload key=SIZ0Z1KWTGUJ upload=9S311ZKXDK7C tag=DP45LLEK2UZN type=write size=3309285 2024-09-12T17:36:56.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.244+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~WC6SGGWDJQ7B.0 size=1048576 2024-09-12T17:36:56.248 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.248+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~WC6SGGWDJQ7B.1 size=531356 2024-09-12T17:36:56.253 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.252+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=WC6SGGWDJQ7B tag=M60A9RIV60BL type=write size=2628508 2024-09-12T17:36:56.258 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.256+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=QMD7F9USLJC5 type=write size=149663 2024-09-12T17:36:56.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.260+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~GB5IE2Z5FZT2.0 size=1048576 2024-09-12T17:36:56.263 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.260+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~GB5IE2Z5FZT2.1 size=1048576 2024-09-12T17:36:56.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.264+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~GB5IE2Z5FZT2.2 size=273655 2024-09-12T17:36:56.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.268+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=GB5IE2Z5FZT2 tag=ZAQ1ZF3ARIOP type=write size=3419383 2024-09-12T17:36:56.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.272+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=29UWOFVTV8L7 type=del size=2867994 2024-09-12T17:36:56.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.276+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~YTOJ8SVAKDZK.0 size=1048576 2024-09-12T17:36:56.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.276+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~YTOJ8SVAKDZK.1 size=1048576 2024-09-12T17:36:56.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.280+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~YTOJ8SVAKDZK.2 size=202196 2024-09-12T17:36:56.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.284+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=YTOJ8SVAKDZK tag=N43IZKJEY2G5 type=write size=3347924 2024-09-12T17:36:56.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.288+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=LX0ANTZP0T9S type=del size=2213938 2024-09-12T17:36:56.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.296+0000 7f1ad43488c0 1 < suggested update operation key=WWB6LAHAMIR9 tag=VE9A8475RMWD type=del size=1745450 2024-09-12T17:36:56.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.296+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=8EOIP370WBZS type=del size=4040292 2024-09-12T17:36:56.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.304+0000 7f1ad43488c0 1 < suggested remove operation key=SIZ0Z1KWTGUJ tag=G7OLZ2WGMJR9 type=del 2024-09-12T17:36:56.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.304+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=M9HFWI8UTBVH type=del size=1799740 2024-09-12T17:36:56.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.308+0000 7f1ad43488c0 1 < completed write operation key=2SDYAQRNWAJK tag=VSIJYWQBX068 type=write size=332069 2024-09-12T17:36:56.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.316+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~EBNXSMM5VPWW.0 size=1048576 2024-09-12T17:36:56.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.316+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~EBNXSMM5VPWW.1 size=787868 2024-09-12T17:36:56.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.316+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=EBNXSMM5VPWW tag=1GJ5BE9LFQ6T type=write size=2885020 2024-09-12T17:36:56.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.320+0000 7f1ad43488c0 1 < completed delete operation key=NHOG1WG3VT6N tag=KY8LEQY10KPJ type=del 2024-09-12T17:36:56.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.324+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~4ZF0N6YJFQYZ.0 size=1048576 2024-09-12T17:36:56.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.328+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~4ZF0N6YJFQYZ.1 size=1048576 2024-09-12T17:36:56.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.332+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~4ZF0N6YJFQYZ.2 size=331098 2024-09-12T17:36:56.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.332+0000 7f1ad43488c0 1 > prepared multipart upload key=GWJ78NNXOL1R upload=4ZF0N6YJFQYZ tag=WNF6SF0KZ56G type=write size=3476826 2024-09-12T17:36:56.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.332+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=22O0CLAKYYOA type=del 2024-09-12T17:36:56.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.336+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=OED7CGORLO8H type=write size=695732 2024-09-12T17:36:56.341 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.340+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=M50O1X0ZIRXV type=del 2024-09-12T17:36:56.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.344+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=1O0USWHNI9EZ type=del size=3295209 2024-09-12T17:36:56.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.348+0000 7f1ad43488c0 1 < completed delete operation key=XOEPYERWY6IT tag=VI8EAYYORF2V type=del 2024-09-12T17:36:56.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.352+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~0V8HPQ5KLDY9.0 size=1048576 2024-09-12T17:36:56.355 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.352+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~0V8HPQ5KLDY9.1 size=956710 2024-09-12T17:36:56.355 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.352+0000 7f1ad43488c0 1 > prepared multipart upload key=ZHFRKX9YY8P5 upload=0V8HPQ5KLDY9 tag=RPGIR6AJFW8B type=write size=3053862 2024-09-12T17:36:56.360 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.360+0000 7f1ad43488c0 1 < suggested remove operation key=4QO60GZ9V0GK tag=JS0DNJ02N9EB type=del 2024-09-12T17:36:56.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.364+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=AENL1HAM51P0 type=write size=130543 2024-09-12T17:36:56.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.364+0000 7f1ad43488c0 1 < canceled part key=_multipart_ZHFRKX9YY8P5.2~A2K2NTFC9ZC2.0 size=1048576 2024-09-12T17:36:56.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.368+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~A2K2NTFC9ZC2.1 size=1048576 2024-09-12T17:36:56.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.368+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~A2K2NTFC9ZC2.2 size=388879 2024-09-12T17:36:56.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.376+0000 7f1ad43488c0 1 < canceled multipart upload key=ZHFRKX9YY8P5 upload=A2K2NTFC9ZC2 tag=V69R8BUIVIZ3 type=write size=3534607 2024-09-12T17:36:56.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.376+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=BF6VPC7Y03DT type=del size=938962 2024-09-12T17:36:56.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.384+0000 7f1ad43488c0 1 < suggested update operation key=X078SB1ITNII tag=N6G1XQWDMEMT type=del size=3691869 2024-09-12T17:36:56.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.388+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=KAKPOUUF5IEM type=del size=314482 2024-09-12T17:36:56.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.392+0000 7f1ad43488c0 1 < completed delete operation key=WFEJLVRCKIUU tag=0FCJJV3EHI4B type=del 2024-09-12T17:36:56.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.396+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=Q0BIIY7YSSF2 type=del size=3119875 2024-09-12T17:36:56.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.396+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~RLLX2U15541S.0 size=964525 2024-09-12T17:36:56.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.404+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=RLLX2U15541S tag=3YV4TKNPVHLB type=write size=2013101 2024-09-12T17:36:56.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.408+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~Z9718O6YCLH2.0 size=1048576 2024-09-12T17:36:56.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.412+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~Z9718O6YCLH2.1 size=1048576 2024-09-12T17:36:56.415 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.416+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~Z9718O6YCLH2.2 size=636066 2024-09-12T17:36:56.415 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.416+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=Z9718O6YCLH2 tag=TQ78UUALWM33 type=write size=3781794 2024-09-12T17:36:56.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.416+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~9S311ZKXDK7C.0 size=1048576 2024-09-12T17:36:56.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.416+0000 7f1ad43488c0 1 < canceled part key=_multipart_SIZ0Z1KWTGUJ.2~9S311ZKXDK7C.1 size=1048576 2024-09-12T17:36:56.420 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.420+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~9S311ZKXDK7C.2 size=163557 2024-09-12T17:36:56.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.424+0000 7f1ad43488c0 1 < canceled multipart upload key=SIZ0Z1KWTGUJ upload=9S311ZKXDK7C tag=DP45LLEK2UZN type=write size=3309285 2024-09-12T17:36:56.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.432+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~36PHST5UZE94.0 size=310401 2024-09-12T17:36:56.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.432+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=36PHST5UZE94 tag=HA0GA1VX9TYV type=write size=1358977 2024-09-12T17:36:56.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.432+0000 7f1ad43488c0 -1 < failed to complete operation key=X078SB1ITNII tag=QMD7F9USLJC5 type=write size=149663: (22) Invalid argument 2024-09-12T17:36:56.437 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.436+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=G1XLXKPJPBY2 type=del size=2370851 2024-09-12T17:36:56.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.440+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=29UWOFVTV8L7 type=del 2024-09-12T17:36:56.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.444+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=2ZV3HJ464AMD type=del size=3660811 2024-09-12T17:36:56.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.444+0000 7f1ad43488c0 -1 < failed to complete operation key=X078SB1ITNII tag=LX0ANTZP0T9S type=del size=2213938: (22) Invalid argument 2024-09-12T17:36:56.449 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.448+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=HO70ZX8FTCU5 type=del size=816227 2024-09-12T17:36:56.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.452+0000 7f1ad43488c0 1 < completed delete operation key=ZHFRKX9YY8P5 tag=8EOIP370WBZS type=del 2024-09-12T17:36:56.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.456+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=NH0WX9TNVO8T type=del size=1440435 2024-09-12T17:36:56.458 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.456+0000 7f1ad43488c0 1 < completed delete operation key=RH4HYE315U5Y tag=M9HFWI8UTBVH type=del 2024-09-12T17:36:56.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.460+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=YGNWUZZSCSMY type=del size=3912189 2024-09-12T17:36:56.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.464+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~EBNXSMM5VPWW.0 size=1048576 2024-09-12T17:36:56.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.468+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~EBNXSMM5VPWW.1 size=787868 2024-09-12T17:36:56.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.472+0000 7f1ad43488c0 1 < completed multipart upload key=7RSHIZRKK2OY upload=EBNXSMM5VPWW tag=1GJ5BE9LFQ6T type=write size=2885020 2024-09-12T17:36:56.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.472+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=J3FANHJKYH1H type=del size=2018167 2024-09-12T17:36:56.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.476+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~4ZF0N6YJFQYZ.0 size=1048576 2024-09-12T17:36:56.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.484+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~4ZF0N6YJFQYZ.1 size=1048576 2024-09-12T17:36:56.487 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.488+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~4ZF0N6YJFQYZ.2 size=331098 2024-09-12T17:36:56.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.492+0000 7f1ad43488c0 1 < completed multipart upload key=GWJ78NNXOL1R upload=4ZF0N6YJFQYZ tag=WNF6SF0KZ56G type=write size=3476826 2024-09-12T17:36:56.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.496+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~QB0XSPOZWT94.0 size=1048576 2024-09-12T17:36:56.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.500+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~QB0XSPOZWT94.1 size=488730 2024-09-12T17:36:56.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.500+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=QB0XSPOZWT94 tag=E20VD2JMK1LR type=write size=2585882 2024-09-12T17:36:56.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.504+0000 7f1ad43488c0 1 < completed write operation key=0MV3GCBTWZD0 tag=OED7CGORLO8H type=write size=695732 2024-09-12T17:36:56.509 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.508+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~0RB7FURH3T8P.0 size=1048576 2024-09-12T17:36:56.511 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.508+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~0RB7FURH3T8P.1 size=1048576 2024-09-12T17:36:56.513 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.512+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~0RB7FURH3T8P.2 size=750613 2024-09-12T17:36:56.513 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.512+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=0RB7FURH3T8P tag=YUI0ZP1SNB9T type=write size=3896341 2024-09-12T17:36:56.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.516+0000 7f1ad43488c0 1 < completed delete operation key=X0HT3K3OREL7 tag=1O0USWHNI9EZ type=del 2024-09-12T17:36:56.521 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.520+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~N2FNBFWHP17N.0 size=1048576 2024-09-12T17:36:56.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.524+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~N2FNBFWHP17N.1 size=14253 2024-09-12T17:36:56.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.524+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=N2FNBFWHP17N tag=DECKL2FWGYLT type=write size=2111405 2024-09-12T17:36:56.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.524+0000 7f1ad43488c0 1 < canceled part key=_multipart_ZHFRKX9YY8P5.2~0V8HPQ5KLDY9.0 size=1048576 2024-09-12T17:36:56.527 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.524+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~0V8HPQ5KLDY9.1 size=956710 2024-09-12T17:36:56.531 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.532+0000 7f1ad43488c0 1 < canceled multipart upload key=ZHFRKX9YY8P5 upload=0V8HPQ5KLDY9 tag=RPGIR6AJFW8B type=write size=3053862 2024-09-12T17:36:56.534 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.532+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=8GKDAGG9TS9P type=write size=538067 2024-09-12T17:36:56.536 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.536+0000 7f1ad43488c0 1 < completed write operation key=LU7XIBO5YUOR tag=AENL1HAM51P0 type=write size=130543 2024-09-12T17:36:56.539 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.540+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=0ZKP7QEQXM8O type=del size=3714768 2024-09-12T17:36:56.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.540+0000 7f1ad43488c0 1 < completed delete operation key=GWJ78NNXOL1R tag=BF6VPC7Y03DT type=del 2024-09-12T17:36:56.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.544+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=PA5B7DTUGUA3 type=del size=758848 2024-09-12T17:36:56.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.548+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=KAKPOUUF5IEM type=del 2024-09-12T17:36:56.553 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.552+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~SSD0K36FBAPJ.0 size=1048576 2024-09-12T17:36:56.555 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.552+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~SSD0K36FBAPJ.1 size=1048576 2024-09-12T17:36:56.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.556+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~SSD0K36FBAPJ.2 size=763186 2024-09-12T17:36:56.557 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.556+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=SSD0K36FBAPJ tag=98LMK2762ZRK type=write size=3908914 2024-09-12T17:36:56.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.560+0000 7f1ad43488c0 1 < completed delete operation key=PKC1RR4FZWE0 tag=Q0BIIY7YSSF2 type=del 2024-09-12T17:36:56.562 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.560+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=AETYX1ARF1SV type=del size=370455 2024-09-12T17:36:56.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.564+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~Z9718O6YCLH2.0 size=1048576 2024-09-12T17:36:56.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.564+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~Z9718O6YCLH2.1 size=1048576 2024-09-12T17:36:56.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.568+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~Z9718O6YCLH2.2 size=636066 2024-09-12T17:36:56.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.572+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=Z9718O6YCLH2 tag=TQ78UUALWM33 type=write size=3781794 2024-09-12T17:36:56.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.576+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=96KW3RK8VK97 type=del size=3225966 2024-09-12T17:36:56.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.580+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~36PHST5UZE94.0 size=310401 2024-09-12T17:36:56.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.584+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=36PHST5UZE94 tag=HA0GA1VX9TYV type=write size=1358977 2024-09-12T17:36:56.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.584+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=I86IESHSFVST type=del size=1438051 2024-09-12T17:36:56.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.588+0000 7f1ad43488c0 1 < suggested update operation key=SIZ0Z1KWTGUJ tag=G1XLXKPJPBY2 type=del size=2370851 2024-09-12T17:36:56.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.592+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=SEIMVKA98BP5 type=del size=1615546 2024-09-12T17:36:56.595 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.596+0000 7f1ad43488c0 1 < canceled operation key=NHOG1WG3VT6N tag=2ZV3HJ464AMD type=del size=3660811 2024-09-12T17:36:56.597 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.596+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=A3PFHMF7VQIA type=del size=1817925 2024-09-12T17:36:56.600 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.600+0000 7f1ad43488c0 1 < completed delete operation key=ECEF8IJGU4Z8 tag=HO70ZX8FTCU5 type=del 2024-09-12T17:36:56.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.604+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~HKCYM8LPDIH5.0 size=1048576 2024-09-12T17:36:56.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.604+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~HKCYM8LPDIH5.1 size=1048576 2024-09-12T17:36:56.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.608+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~HKCYM8LPDIH5.2 size=614712 2024-09-12T17:36:56.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.608+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=HKCYM8LPDIH5 tag=3D7CDTYETKU8 type=write size=3760440 2024-09-12T17:36:56.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.608+0000 7f1ad43488c0 1 < canceled operation key=SDJ53NSPOIRC tag=NH0WX9TNVO8T type=del size=1440435 2024-09-12T17:36:56.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.616+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~XMA0OJB8OB4S.0 size=1048576 2024-09-12T17:36:56.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.616+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~XMA0OJB8OB4S.1 size=1048576 2024-09-12T17:36:56.619 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.620+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~XMA0OJB8OB4S.2 size=226949 2024-09-12T17:36:56.619 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.620+0000 7f1ad43488c0 1 > prepared multipart upload key=Y3NQLDWQJ37Z upload=XMA0OJB8OB4S tag=H0E884E9VJI2 type=write size=3372677 2024-09-12T17:36:56.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.624+0000 7f1ad43488c0 1 < suggested remove operation key=GZ7LGZQHW4CY tag=YGNWUZZSCSMY type=del 2024-09-12T17:36:56.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.628+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~YQA5EED54FFV.0 size=122400 2024-09-12T17:36:56.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.628+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=YQA5EED54FFV tag=WH4DG5ZCO2J4 type=write size=1170976 2024-09-12T17:36:56.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.632+0000 7f1ad43488c0 1 < canceled operation key=SDJ53NSPOIRC tag=J3FANHJKYH1H type=del size=2018167 2024-09-12T17:36:56.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.632+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=HTRRG3LU9O1M type=del size=369343 2024-09-12T17:36:56.637 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.636+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~QB0XSPOZWT94.0 size=1048576 2024-09-12T17:36:56.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.636+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~QB0XSPOZWT94.1 size=488730 2024-09-12T17:36:56.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.640+0000 7f1ad43488c0 1 < completed multipart upload key=MB3FVGKV0ZNQ upload=QB0XSPOZWT94 tag=E20VD2JMK1LR type=write size=2585882 2024-09-12T17:36:56.647 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.648+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~UXZQNT501RJJ.0 size=539788 2024-09-12T17:36:56.647 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.648+0000 7f1ad43488c0 1 > prepared multipart upload key=NHOG1WG3VT6N upload=UXZQNT501RJJ tag=R6U46EZIZEXD type=write size=1588364 2024-09-12T17:36:56.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.648+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~0RB7FURH3T8P.0 size=1048576 2024-09-12T17:36:56.652 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.652+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~0RB7FURH3T8P.1 size=1048576 2024-09-12T17:36:56.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.652+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~0RB7FURH3T8P.2 size=750613 2024-09-12T17:36:56.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.656+0000 7f1ad43488c0 1 < completed multipart upload key=8U3L46JDJ8VS upload=0RB7FURH3T8P tag=YUI0ZP1SNB9T type=write size=3896341 2024-09-12T17:36:56.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.660+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=V79N3XFIL4NM type=del size=877296 2024-09-12T17:36:56.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.664+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~N2FNBFWHP17N.0 size=1048576 2024-09-12T17:36:56.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.664+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~N2FNBFWHP17N.1 size=14253 2024-09-12T17:36:56.669 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.668+0000 7f1ad43488c0 1 < completed multipart upload key=MB3FVGKV0ZNQ upload=N2FNBFWHP17N tag=DECKL2FWGYLT type=write size=2111405 2024-09-12T17:36:56.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.672+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=EERZ5M4BG96M type=del size=840917 2024-09-12T17:36:56.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.672+0000 7f1ad43488c0 1 < canceled operation key=ZHFRKX9YY8P5 tag=8GKDAGG9TS9P type=write size=538067 2024-09-12T17:36:56.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.676+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=63U08QXI4XMR type=del size=3800061 2024-09-12T17:36:56.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.676+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=0ZKP7QEQXM8O type=del 2024-09-12T17:36:56.683 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.684+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~RWATPK94GFYZ.0 size=1048576 2024-09-12T17:36:56.685 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.684+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~RWATPK94GFYZ.1 size=552807 2024-09-12T17:36:56.685 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.684+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=RWATPK94GFYZ tag=07KN4PFH5LQO type=write size=2649959 2024-09-12T17:36:56.687 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.688+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=PA5B7DTUGUA3 type=del 2024-09-12T17:36:56.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.692+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~3A1Y7FFDBCUB.0 size=728835 2024-09-12T17:36:56.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.692+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=3A1Y7FFDBCUB tag=WQ9XLWS9V819 type=write size=1777411 2024-09-12T17:36:56.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.692+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~SSD0K36FBAPJ.0 size=1048576 2024-09-12T17:36:56.697 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.696+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~SSD0K36FBAPJ.1 size=1048576 2024-09-12T17:36:56.700 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.696+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~SSD0K36FBAPJ.2 size=763186 2024-09-12T17:36:56.703 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.704+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=SSD0K36FBAPJ tag=98LMK2762ZRK type=write size=3908914 2024-09-12T17:36:56.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.708+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~DG0K6MA6R2XU.0 size=1048576 2024-09-12T17:36:56.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.712+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~DG0K6MA6R2XU.1 size=398264 2024-09-12T17:36:56.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.712+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=DG0K6MA6R2XU tag=IN12ZHL8N38A type=write size=2495416 2024-09-12T17:36:56.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.712+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=AETYX1ARF1SV type=del 2024-09-12T17:36:56.717 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.716+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=H5XCV94HWFPV type=del size=4155717 2024-09-12T17:36:56.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.720+0000 7f1ad43488c0 -1 < failed to complete operation key=SIZ0Z1KWTGUJ tag=96KW3RK8VK97 type=del size=3225966: (22) Invalid argument 2024-09-12T17:36:56.728 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.728+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~DUDDO6BUISPF.0 size=1048576 2024-09-12T17:36:56.731 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.728+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~DUDDO6BUISPF.1 size=143236 2024-09-12T17:36:56.731 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.728+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=DUDDO6BUISPF tag=FFTNSI3EWZQA type=write size=2240388 2024-09-12T17:36:56.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.732+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=I86IESHSFVST type=del 2024-09-12T17:36:56.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.736+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=H2Y0JSOPDI5O type=del size=3669215 2024-09-12T17:36:56.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.740+0000 7f1ad43488c0 1 < suggested update operation key=7RSHIZRKK2OY tag=SEIMVKA98BP5 type=del size=1615546 2024-09-12T17:36:56.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.744+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=HQXRWPM58CZL type=del size=3561069 2024-09-12T17:36:56.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.744+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=A3PFHMF7VQIA type=del 2024-09-12T17:36:56.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.748+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=1ODMCH4W83LM type=write size=31566 2024-09-12T17:36:56.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.752+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~HKCYM8LPDIH5.0 size=1048576 2024-09-12T17:36:56.754 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.752+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~HKCYM8LPDIH5.1 size=1048576 2024-09-12T17:36:56.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.756+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~HKCYM8LPDIH5.2 size=614712 2024-09-12T17:36:56.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.760+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=HKCYM8LPDIH5 tag=3D7CDTYETKU8 type=write size=3760440 2024-09-12T17:36:56.765 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.764+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~CBI43IL8MEX4.0 size=1038714 2024-09-12T17:36:56.765 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.764+0000 7f1ad43488c0 1 > prepared multipart upload key=ZHFRKX9YY8P5 upload=CBI43IL8MEX4 tag=RVSJ7N40S4IQ type=write size=2087290 2024-09-12T17:36:56.767 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.768+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~XMA0OJB8OB4S.0 size=1048576 2024-09-12T17:36:56.769 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.768+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~XMA0OJB8OB4S.1 size=1048576 2024-09-12T17:36:56.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.772+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~XMA0OJB8OB4S.2 size=226949 2024-09-12T17:36:56.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.776+0000 7f1ad43488c0 1 < completed multipart upload key=Y3NQLDWQJ37Z upload=XMA0OJB8OB4S tag=H0E884E9VJI2 type=write size=3372677 2024-09-12T17:36:56.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.776+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=KAP53TZEDE5T type=del size=1218658 2024-09-12T17:36:56.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.780+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~YQA5EED54FFV.0 size=122400 2024-09-12T17:36:56.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.784+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=YQA5EED54FFV tag=WH4DG5ZCO2J4 type=write size=1170976 2024-09-12T17:36:56.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.788+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~RCB51AKQR5MV.0 size=175335 2024-09-12T17:36:56.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.788+0000 7f1ad43488c0 1 > prepared multipart upload key=CHMM14VRIOQH upload=RCB51AKQR5MV tag=HF85YZK6R80M type=write size=1223911 2024-09-12T17:36:56.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.792+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=HTRRG3LU9O1M type=del 2024-09-12T17:36:56.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.796+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=LODJ9GSM0706 type=del size=243922 2024-09-12T17:36:56.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.796+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~UXZQNT501RJJ.0 size=539788 2024-09-12T17:36:56.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.800+0000 7f1ad43488c0 1 < completed multipart upload key=NHOG1WG3VT6N upload=UXZQNT501RJJ tag=R6U46EZIZEXD type=write size=1588364 2024-09-12T17:36:56.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.804+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=OQ339QDN3P82 type=del size=1568925 2024-09-12T17:36:56.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.808+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=V79N3XFIL4NM type=del 2024-09-12T17:36:56.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.812+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~2Y0HGQZFX3IV.0 size=1048576 2024-09-12T17:36:56.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.812+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~2Y0HGQZFX3IV.1 size=1048576 2024-09-12T17:36:56.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.816+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~2Y0HGQZFX3IV.2 size=49872 2024-09-12T17:36:56.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.816+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=2Y0HGQZFX3IV tag=6G4DW4WT36YI type=write size=3195600 2024-09-12T17:36:56.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.816+0000 7f1ad43488c0 1 < canceled operation key=05PAFB226IFP tag=EERZ5M4BG96M type=del size=840917 2024-09-12T17:36:56.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.820+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=F2Y6UWNMSGA9 type=del size=4034211 2024-09-12T17:36:56.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.824+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=63U08QXI4XMR type=del 2024-09-12T17:36:56.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.828+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~9HYP61WEEBG1.0 size=1048576 2024-09-12T17:36:56.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.828+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~9HYP61WEEBG1.1 size=1048576 2024-09-12T17:36:56.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.828+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~9HYP61WEEBG1.2 size=49085 2024-09-12T17:36:56.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.828+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=9HYP61WEEBG1 tag=IIUI50IA9NT2 type=write size=3194813 2024-09-12T17:36:56.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.832+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~RWATPK94GFYZ.0 size=1048576 2024-09-12T17:36:56.835 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.832+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~RWATPK94GFYZ.1 size=552807 2024-09-12T17:36:56.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.840+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=RWATPK94GFYZ tag=07KN4PFH5LQO type=write size=2649959 2024-09-12T17:36:56.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.840+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=YRYAZLAQMD8L type=del size=1719508 2024-09-12T17:36:56.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.844+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~3A1Y7FFDBCUB.0 size=728835 2024-09-12T17:36:56.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.848+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=3A1Y7FFDBCUB tag=WQ9XLWS9V819 type=write size=1777411 2024-09-12T17:36:56.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.852+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=2ZS4NC8J610B type=del size=213583 2024-09-12T17:36:56.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.852+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~DG0K6MA6R2XU.0 size=1048576 2024-09-12T17:36:56.855 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.856+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~DG0K6MA6R2XU.1 size=398264 2024-09-12T17:36:56.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.860+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=DG0K6MA6R2XU tag=IN12ZHL8N38A type=write size=2495416 2024-09-12T17:36:56.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.860+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=UXJFGGF3KPJG type=del size=1377292 2024-09-12T17:36:56.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.864+0000 7f1ad43488c0 1 < suggested update operation key=NHOG1WG3VT6N tag=H5XCV94HWFPV type=del size=4155717 2024-09-12T17:36:56.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.868+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~71CJO8DA7CGN.0 size=1048576 2024-09-12T17:36:56.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.872+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~71CJO8DA7CGN.1 size=1048576 2024-09-12T17:36:56.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.872+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~71CJO8DA7CGN.2 size=389848 2024-09-12T17:36:56.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.872+0000 7f1ad43488c0 1 > prepared multipart upload key=9Z2EHQA8T5F4 upload=71CJO8DA7CGN tag=V91A1T27HYS8 type=write size=3535576 2024-09-12T17:36:56.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.876+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~DUDDO6BUISPF.0 size=1048576 2024-09-12T17:36:56.879 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.880+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~DUDDO6BUISPF.1 size=143236 2024-09-12T17:36:56.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.884+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=DUDDO6BUISPF tag=FFTNSI3EWZQA type=write size=2240388 2024-09-12T17:36:56.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.888+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~2VCSIPTP1HO1.0 size=372975 2024-09-12T17:36:56.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.888+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=2VCSIPTP1HO1 tag=C1SF27XWBI6Q type=write size=1421551 2024-09-12T17:36:56.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.892+0000 7f1ad43488c0 1 < suggested update operation key=IY2AM7CJDUZG tag=H2Y0JSOPDI5O type=del size=3669215 2024-09-12T17:36:56.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.892+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=TX49QLY1844E type=del size=4140820 2024-09-12T17:36:56.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.900+0000 7f1ad43488c0 1 < suggested remove operation key=4QO60GZ9V0GK tag=HQXRWPM58CZL type=del 2024-09-12T17:36:56.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.904+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~WCDI9OKVQQDF.0 size=1048576 2024-09-12T17:36:56.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.904+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~WCDI9OKVQQDF.1 size=992140 2024-09-12T17:36:56.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.904+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=WCDI9OKVQQDF tag=1PDZE2DBALVM type=write size=3089292 2024-09-12T17:36:56.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.908+0000 7f1ad43488c0 1 < completed write operation key=ECEF8IJGU4Z8 tag=1ODMCH4W83LM type=write size=31566 2024-09-12T17:36:56.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.912+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=PS2MXDGTU49S type=del size=311112 2024-09-12T17:36:56.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.912+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~CBI43IL8MEX4.0 size=1038714 2024-09-12T17:36:56.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.916+0000 7f1ad43488c0 1 < completed multipart upload key=ZHFRKX9YY8P5 upload=CBI43IL8MEX4 tag=RVSJ7N40S4IQ type=write size=2087290 2024-09-12T17:36:56.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.920+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=WZNXUVYXUMW4 type=del size=2698206 2024-09-12T17:36:56.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.924+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=KAP53TZEDE5T type=del 2024-09-12T17:36:56.928 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.928+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~HML7F3A3A7J0.0 size=1045416 2024-09-12T17:36:56.928 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.928+0000 7f1ad43488c0 1 > prepared multipart upload key=RH4HYE315U5Y upload=HML7F3A3A7J0 tag=S3FJBWTSC9DR type=write size=2093992 2024-09-12T17:36:56.930 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.928+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~RCB51AKQR5MV.0 size=175335 2024-09-12T17:36:56.935 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.932+0000 7f1ad43488c0 1 < completed multipart upload key=CHMM14VRIOQH upload=RCB51AKQR5MV tag=HF85YZK6R80M type=write size=1223911 2024-09-12T17:36:56.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.936+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=BQUI02O0H2E2 type=write size=219666 2024-09-12T17:36:56.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.940+0000 7f1ad43488c0 -1 < failed to complete operation key=4QO60GZ9V0GK tag=LODJ9GSM0706 type=del size=243922: (22) Invalid argument 2024-09-12T17:36:56.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.944+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=5ZWC4X2V6UOC type=del size=145799 2024-09-12T17:36:56.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.944+0000 7f1ad43488c0 1 < canceled operation key=6Z3F28JHHEQS tag=OQ339QDN3P82 type=del size=1568925 2024-09-12T17:36:56.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.948+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=UA65M9YVK1ZG type=del size=3905619 2024-09-12T17:36:56.952 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.952+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~2Y0HGQZFX3IV.0 size=1048576 2024-09-12T17:36:56.955 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.952+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~2Y0HGQZFX3IV.1 size=1048576 2024-09-12T17:36:56.957 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.956+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~2Y0HGQZFX3IV.2 size=49872 2024-09-12T17:36:56.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.964+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=2Y0HGQZFX3IV tag=6G4DW4WT36YI type=write size=3195600 2024-09-12T17:36:56.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.968+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~JWJ9526WDXZX.0 size=1048576 2024-09-12T17:36:56.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.972+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~JWJ9526WDXZX.1 size=157093 2024-09-12T17:36:56.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.972+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=JWJ9526WDXZX tag=6ZUZI2BTR6W7 type=write size=2254245 2024-09-12T17:36:56.975 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.972+0000 7f1ad43488c0 -1 < failed to complete operation key=4QO60GZ9V0GK tag=F2Y6UWNMSGA9 type=del size=4034211: (22) Invalid argument 2024-09-12T17:36:56.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.980+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~W82U5HD7E8BQ.0 size=1048576 2024-09-12T17:36:56.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.980+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~W82U5HD7E8BQ.1 size=1048576 2024-09-12T17:36:56.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.984+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~W82U5HD7E8BQ.2 size=10226 2024-09-12T17:36:56.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.984+0000 7f1ad43488c0 1 > prepared multipart upload key=WFEJLVRCKIUU upload=W82U5HD7E8BQ tag=W70AXLTMG0UA type=write size=3155954 2024-09-12T17:36:56.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.984+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~9HYP61WEEBG1.0 size=1048576 2024-09-12T17:36:56.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.988+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~9HYP61WEEBG1.1 size=1048576 2024-09-12T17:36:56.991 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.988+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~9HYP61WEEBG1.2 size=49085 2024-09-12T17:36:56.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.995+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=9HYP61WEEBG1 tag=IIUI50IA9NT2 type=write size=3194813 2024-09-12T17:36:57.000 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.999+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~B24BITUFF5BV.0 size=1048576 2024-09-12T17:36:57.002 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.999+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~B24BITUFF5BV.1 size=575926 2024-09-12T17:36:57.002 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:56.999+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=B24BITUFF5BV tag=3WFFTWCEX7S1 type=write size=2673078 2024-09-12T17:36:57.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.003+0000 7f1ad43488c0 1 < completed delete operation key=2SDYAQRNWAJK tag=YRYAZLAQMD8L type=del 2024-09-12T17:36:57.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.007+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=3BHWUC6WZWWN type=del size=2236002 2024-09-12T17:36:57.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.007+0000 7f1ad43488c0 -1 < failed to complete operation key=NHOG1WG3VT6N tag=2ZS4NC8J610B type=del size=213583: (22) Invalid argument 2024-09-12T17:36:57.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.011+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=WUHP46KM42JG type=del size=1746512 2024-09-12T17:36:57.016 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.015+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=UXJFGGF3KPJG type=del 2024-09-12T17:36:57.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.015+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=NVCWIJ67TRKH type=del size=1213382 2024-09-12T17:36:57.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.019+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~71CJO8DA7CGN.0 size=1048576 2024-09-12T17:36:57.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.023+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~71CJO8DA7CGN.1 size=1048576 2024-09-12T17:36:57.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.023+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~71CJO8DA7CGN.2 size=389848 2024-09-12T17:36:57.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.027+0000 7f1ad43488c0 1 < completed multipart upload key=9Z2EHQA8T5F4 upload=71CJO8DA7CGN tag=V91A1T27HYS8 type=write size=3535576 2024-09-12T17:36:57.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.035+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~QGOLOIQL50NA.0 size=1048576 2024-09-12T17:36:57.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.035+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~QGOLOIQL50NA.1 size=861787 2024-09-12T17:36:57.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.035+0000 7f1ad43488c0 1 > prepared multipart upload key=C7QSOK3D3IWJ upload=QGOLOIQL50NA tag=3I6BWEHIXIXS type=write size=2958939 2024-09-12T17:36:57.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.039+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~2VCSIPTP1HO1.0 size=372975 2024-09-12T17:36:57.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.043+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=2VCSIPTP1HO1 tag=C1SF27XWBI6Q type=write size=1421551 2024-09-12T17:36:57.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.047+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~XIVN8VO7U0JW.0 size=1048576 2024-09-12T17:36:57.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.051+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~XIVN8VO7U0JW.1 size=257869 2024-09-12T17:36:57.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.051+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=XIVN8VO7U0JW tag=VU3YEA5Y7TLB type=write size=2355021 2024-09-12T17:36:57.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.055+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=TX49QLY1844E type=del 2024-09-12T17:36:57.058 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.055+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=PR9RPMMY8C4K type=write size=945063 2024-09-12T17:36:57.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.059+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~WCDI9OKVQQDF.0 size=1048576 2024-09-12T17:36:57.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.059+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~WCDI9OKVQQDF.1 size=992140 2024-09-12T17:36:57.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.067+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=WCDI9OKVQQDF tag=1PDZE2DBALVM type=write size=3089292 2024-09-12T17:36:57.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.071+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~HWQXXEA5DBZF.0 size=1048576 2024-09-12T17:36:57.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.071+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~HWQXXEA5DBZF.1 size=97343 2024-09-12T17:36:57.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.071+0000 7f1ad43488c0 1 > prepared multipart upload key=CHMM14VRIOQH upload=HWQXXEA5DBZF tag=U5O0H9AJTR21 type=write size=2194495 2024-09-12T17:36:57.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.075+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=PS2MXDGTU49S type=del 2024-09-12T17:36:57.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.079+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=703X0H2FNBHK type=del size=3587761 2024-09-12T17:36:57.082 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.079+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=WZNXUVYXUMW4 type=del 2024-09-12T17:36:57.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.087+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~85IJ9LMDYNZ4.0 size=1048576 2024-09-12T17:36:57.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.087+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~85IJ9LMDYNZ4.1 size=1048576 2024-09-12T17:36:57.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.091+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~85IJ9LMDYNZ4.2 size=395415 2024-09-12T17:36:57.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.091+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=85IJ9LMDYNZ4 tag=0BW4YTKUWSO6 type=write size=3541143 2024-09-12T17:36:57.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.091+0000 7f1ad43488c0 1 < canceled part key=_multipart_RH4HYE315U5Y.2~HML7F3A3A7J0.0 size=1045416 2024-09-12T17:36:57.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.095+0000 7f1ad43488c0 1 < canceled multipart upload key=RH4HYE315U5Y upload=HML7F3A3A7J0 tag=S3FJBWTSC9DR type=write size=2093992 2024-09-12T17:36:57.101 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.099+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~MAWBRPV50I69.0 size=1048576 2024-09-12T17:36:57.103 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.103+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~MAWBRPV50I69.1 size=1048576 2024-09-12T17:36:57.106 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.103+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~MAWBRPV50I69.2 size=1001789 2024-09-12T17:36:57.106 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.103+0000 7f1ad43488c0 1 > prepared multipart upload key=9Z2EHQA8T5F4 upload=MAWBRPV50I69 tag=VTZWTFG1PBTV type=write size=4147517 2024-09-12T17:36:57.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.107+0000 7f1ad43488c0 1 < canceled operation key=3N1YT9TC0M3O tag=BQUI02O0H2E2 type=write size=219666 2024-09-12T17:36:57.111 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.111+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=HKQ6KJK5G5BG type=del size=3275149 2024-09-12T17:36:57.116 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.115+0000 7f1ad43488c0 1 < suggested remove operation key=7RSHIZRKK2OY tag=5ZWC4X2V6UOC type=del 2024-09-12T17:36:57.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.119+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=UUKMB43YJHHW type=write size=1010576 2024-09-12T17:36:57.122 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.119+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=UA65M9YVK1ZG type=del 2024-09-12T17:36:57.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.123+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=2Q5KDL3Z551P type=del size=4126728 2024-09-12T17:36:57.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.127+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~JWJ9526WDXZX.0 size=1048576 2024-09-12T17:36:57.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.127+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~JWJ9526WDXZX.1 size=157093 2024-09-12T17:36:57.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.131+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=JWJ9526WDXZX tag=6ZUZI2BTR6W7 type=write size=2254245 2024-09-12T17:36:57.136 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.135+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=77ZY5CO4ASZ6 type=del size=3082153 2024-09-12T17:36:57.139 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.139+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~W82U5HD7E8BQ.0 size=1048576 2024-09-12T17:36:57.141 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.139+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~W82U5HD7E8BQ.1 size=1048576 2024-09-12T17:36:57.143 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.143+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~W82U5HD7E8BQ.2 size=10226 2024-09-12T17:36:57.148 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.147+0000 7f1ad43488c0 1 < completed multipart upload key=WFEJLVRCKIUU upload=W82U5HD7E8BQ tag=W70AXLTMG0UA type=write size=3155954 2024-09-12T17:36:57.153 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.151+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~I3CLIXZHNYPM.0 size=28276 2024-09-12T17:36:57.153 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.151+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=I3CLIXZHNYPM tag=4L3UG9A9NJIB type=write size=1076852 2024-09-12T17:36:57.156 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.155+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~B24BITUFF5BV.0 size=1048576 2024-09-12T17:36:57.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.155+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~B24BITUFF5BV.1 size=575926 2024-09-12T17:36:57.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.159+0000 7f1ad43488c0 1 < completed multipart upload key=8U3L46JDJ8VS upload=B24BITUFF5BV tag=3WFFTWCEX7S1 type=write size=2673078 2024-09-12T17:36:57.165 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.163+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=5CVUJ1M9SGH0 type=del size=3852498 2024-09-12T17:36:57.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.171+0000 7f1ad43488c0 1 < suggested update operation key=6Z3F28JHHEQS tag=3BHWUC6WZWWN type=del size=2236002 2024-09-12T17:36:57.175 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.175+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=60F35B4EE7NP type=write size=501516 2024-09-12T17:36:57.178 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.175+0000 7f1ad43488c0 1 < completed delete operation key=RH4HYE315U5Y tag=WUHP46KM42JG type=del 2024-09-12T17:36:57.184 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.183+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~T9NL1D2CKN2C.0 size=1048576 2024-09-12T17:36:57.187 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.183+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~T9NL1D2CKN2C.1 size=208939 2024-09-12T17:36:57.187 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.183+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=T9NL1D2CKN2C tag=DMEICTSJG92T type=write size=2306091 2024-09-12T17:36:57.190 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.187+0000 7f1ad43488c0 1 < completed delete operation key=X0HT3K3OREL7 tag=NVCWIJ67TRKH type=del 2024-09-12T17:36:57.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.191+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=3YE93UO542F2 type=del size=2427533 2024-09-12T17:36:57.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.195+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~QGOLOIQL50NA.0 size=1048576 2024-09-12T17:36:57.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.199+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~QGOLOIQL50NA.1 size=861787 2024-09-12T17:36:57.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.203+0000 7f1ad43488c0 1 < completed multipart upload key=C7QSOK3D3IWJ upload=QGOLOIQL50NA tag=3I6BWEHIXIXS type=write size=2958939 2024-09-12T17:36:57.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.207+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=33AITH391JIC type=del size=2268613 2024-09-12T17:36:57.212 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.211+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~XIVN8VO7U0JW.0 size=1048576 2024-09-12T17:36:57.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.215+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~XIVN8VO7U0JW.1 size=257869 2024-09-12T17:36:57.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.223+0000 7f1ad43488c0 1 < completed multipart upload key=8U3L46JDJ8VS upload=XIVN8VO7U0JW tag=VU3YEA5Y7TLB type=write size=2355021 2024-09-12T17:36:57.228 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.227+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=6PW53JV24EJA type=del size=1543211 2024-09-12T17:36:57.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.227+0000 7f1ad43488c0 1 < completed write operation key=IY2AM7CJDUZG tag=PR9RPMMY8C4K type=write size=945063 2024-09-12T17:36:57.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.235+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~8ES48GJ1UEKP.0 size=1048576 2024-09-12T17:36:57.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.239+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~8ES48GJ1UEKP.1 size=734448 2024-09-12T17:36:57.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.239+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=8ES48GJ1UEKP tag=ADTOMJHPFYO7 type=write size=2831600 2024-09-12T17:36:57.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.243+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~HWQXXEA5DBZF.0 size=1048576 2024-09-12T17:36:57.246 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.243+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~HWQXXEA5DBZF.1 size=97343 2024-09-12T17:36:57.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.251+0000 7f1ad43488c0 1 < completed multipart upload key=CHMM14VRIOQH upload=HWQXXEA5DBZF tag=U5O0H9AJTR21 type=write size=2194495 2024-09-12T17:36:57.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.251+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=5LECQTK7R1JE type=write size=63390 2024-09-12T17:36:57.258 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.255+0000 7f1ad43488c0 1 < completed delete operation key=GWJ78NNXOL1R tag=703X0H2FNBHK type=del 2024-09-12T17:36:57.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.263+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~MU192L0MYA2Y.0 size=1048576 2024-09-12T17:36:57.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.267+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~MU192L0MYA2Y.1 size=519689 2024-09-12T17:36:57.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.267+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=MU192L0MYA2Y tag=OYYT4FA8QH9C type=write size=2616841 2024-09-12T17:36:57.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.271+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~85IJ9LMDYNZ4.0 size=1048576 2024-09-12T17:36:57.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.271+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~85IJ9LMDYNZ4.1 size=1048576 2024-09-12T17:36:57.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.275+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~85IJ9LMDYNZ4.2 size=395415 2024-09-12T17:36:57.282 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.279+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=85IJ9LMDYNZ4 tag=0BW4YTKUWSO6 type=write size=3541143 2024-09-12T17:36:57.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.283+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=6HJ2D2KJCJSN type=write size=409355 2024-09-12T17:36:57.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.287+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~MAWBRPV50I69.0 size=1048576 2024-09-12T17:36:57.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.291+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~MAWBRPV50I69.1 size=1048576 2024-09-12T17:36:57.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.295+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~MAWBRPV50I69.2 size=1001789 2024-09-12T17:36:57.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.303+0000 7f1ad43488c0 1 < completed multipart upload key=9Z2EHQA8T5F4 upload=MAWBRPV50I69 tag=VTZWTFG1PBTV type=write size=4147517 2024-09-12T17:36:57.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.307+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=4HI21UFMVK9Z type=del size=1242863 2024-09-12T17:36:57.312 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.311+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=HKQ6KJK5G5BG type=del 2024-09-12T17:36:57.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.315+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=F43JN6Z3KJCB type=del size=777845 2024-09-12T17:36:57.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.319+0000 7f1ad43488c0 1 < completed write operation key=LU7XIBO5YUOR tag=UUKMB43YJHHW type=write size=1010576 2024-09-12T17:36:57.323 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.323+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=5C5AISUR40AJ type=write size=358545 2024-09-12T17:36:57.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.327+0000 7f1ad43488c0 1 < completed delete operation key=IY2AM7CJDUZG tag=2Q5KDL3Z551P type=del 2024-09-12T17:36:57.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.331+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=FUQYOWTAIA3P type=write size=160295 2024-09-12T17:36:57.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.335+0000 7f1ad43488c0 1 < canceled operation key=05PAFB226IFP tag=77ZY5CO4ASZ6 type=del size=3082153 2024-09-12T17:36:57.343 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.343+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~B8Q0N36MPZXQ.0 size=1048576 2024-09-12T17:36:57.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.343+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~B8Q0N36MPZXQ.1 size=1048576 2024-09-12T17:36:57.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.347+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~B8Q0N36MPZXQ.2 size=234714 2024-09-12T17:36:57.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.347+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=B8Q0N36MPZXQ tag=G6WV4CO28771 type=write size=3380442 2024-09-12T17:36:57.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.351+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~I3CLIXZHNYPM.0 size=28276 2024-09-12T17:36:57.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.355+0000 7f1ad43488c0 1 < completed multipart upload key=7RSHIZRKK2OY upload=I3CLIXZHNYPM tag=4L3UG9A9NJIB type=write size=1076852 2024-09-12T17:36:57.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.363+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~YZ0AI6VXE39J.0 size=32916 2024-09-12T17:36:57.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.363+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=YZ0AI6VXE39J tag=QJRDHXPND9JI type=write size=1081492 2024-09-12T17:36:57.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.367+0000 7f1ad43488c0 1 < suggested update operation key=2SDYAQRNWAJK tag=5CVUJ1M9SGH0 type=del size=3852498 2024-09-12T17:36:57.374 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.371+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=1GIT1LU2MK1Y type=del size=903444 2024-09-12T17:36:57.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.379+0000 7f1ad43488c0 1 < suggested update operation key=SIZ0Z1KWTGUJ tag=60F35B4EE7NP type=write size=501516 2024-09-12T17:36:57.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.383+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~E8NHKWSWU81H.0 size=1048576 2024-09-12T17:36:57.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.387+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~E8NHKWSWU81H.1 size=971983 2024-09-12T17:36:57.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.387+0000 7f1ad43488c0 1 > prepared multipart upload key=C7QSOK3D3IWJ upload=E8NHKWSWU81H tag=UC7O75XMC642 type=write size=3069135 2024-09-12T17:36:57.391 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.387+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~T9NL1D2CKN2C.0 size=1048576 2024-09-12T17:36:57.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.391+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~T9NL1D2CKN2C.1 size=208939 2024-09-12T17:36:57.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.395+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=T9NL1D2CKN2C tag=DMEICTSJG92T type=write size=2306091 2024-09-12T17:36:57.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.403+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~9VX6BPTWEGFM.0 size=1048576 2024-09-12T17:36:57.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.403+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~9VX6BPTWEGFM.1 size=1048576 2024-09-12T17:36:57.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.407+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~9VX6BPTWEGFM.2 size=158205 2024-09-12T17:36:57.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.407+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=9VX6BPTWEGFM tag=RY8DEN6262QQ type=write size=3303933 2024-09-12T17:36:57.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.407+0000 7f1ad43488c0 1 < completed delete operation key=9Z2EHQA8T5F4 tag=3YE93UO542F2 type=del 2024-09-12T17:36:57.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.411+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=WIHMQ5U214C2 type=del size=2305233 2024-09-12T17:36:57.420 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.419+0000 7f1ad43488c0 1 < suggested remove operation key=LU7XIBO5YUOR tag=33AITH391JIC type=del 2024-09-12T17:36:57.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.423+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~9O4BLT1L3IFQ.0 size=1048576 2024-09-12T17:36:57.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.427+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~9O4BLT1L3IFQ.1 size=1048576 2024-09-12T17:36:57.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.427+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~9O4BLT1L3IFQ.2 size=919127 2024-09-12T17:36:57.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.427+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=9O4BLT1L3IFQ tag=O1J5AAHOLR4D type=write size=4064855 2024-09-12T17:36:57.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.431+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=6PW53JV24EJA type=del 2024-09-12T17:36:57.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.435+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=4RSNNORGSXAC type=write size=390149 2024-09-12T17:36:57.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.439+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~8ES48GJ1UEKP.0 size=1048576 2024-09-12T17:36:57.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.439+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~8ES48GJ1UEKP.1 size=734448 2024-09-12T17:36:57.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.447+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=8ES48GJ1UEKP tag=ADTOMJHPFYO7 type=write size=2831600 2024-09-12T17:36:57.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.451+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~NA2NRYJMCHNA.0 size=1048576 2024-09-12T17:36:57.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.451+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~NA2NRYJMCHNA.1 size=1048576 2024-09-12T17:36:57.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.455+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~NA2NRYJMCHNA.2 size=385762 2024-09-12T17:36:57.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.455+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=NA2NRYJMCHNA tag=HHI3BO029XX9 type=write size=3531490 2024-09-12T17:36:57.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.455+0000 7f1ad43488c0 1 < completed write operation key=WWB6LAHAMIR9 tag=5LECQTK7R1JE type=write size=63390 2024-09-12T17:36:57.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.463+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~L6OA4ZHRNPI9.0 size=1048576 2024-09-12T17:36:57.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.463+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~L6OA4ZHRNPI9.1 size=210598 2024-09-12T17:36:57.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.463+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=L6OA4ZHRNPI9 tag=PIK1VHVHH32S type=write size=2307750 2024-09-12T17:36:57.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.467+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~MU192L0MYA2Y.0 size=1048576 2024-09-12T17:36:57.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.471+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~MU192L0MYA2Y.1 size=519689 2024-09-12T17:36:57.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.475+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=MU192L0MYA2Y tag=OYYT4FA8QH9C type=write size=2616841 2024-09-12T17:36:57.480 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.479+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=V1U5F952ATPF type=write size=912570 2024-09-12T17:36:57.483 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.483+0000 7f1ad43488c0 1 < completed write operation key=IY2AM7CJDUZG tag=6HJ2D2KJCJSN type=write size=409355 2024-09-12T17:36:57.488 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.487+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~DUQRV0G1HASY.0 size=1048576 2024-09-12T17:36:57.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.487+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~DUQRV0G1HASY.1 size=1048576 2024-09-12T17:36:57.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.491+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~DUQRV0G1HASY.2 size=119322 2024-09-12T17:36:57.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.491+0000 7f1ad43488c0 1 > prepared multipart upload key=SIZ0Z1KWTGUJ upload=DUQRV0G1HASY tag=KVS1HG9NA0XV type=write size=3265050 2024-09-12T17:36:57.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.495+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=4HI21UFMVK9Z type=del 2024-09-12T17:36:57.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.499+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=HP4CW7K3PKG4 type=del size=231171 2024-09-12T17:36:57.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.503+0000 7f1ad43488c0 1 < completed delete operation key=WWB6LAHAMIR9 tag=F43JN6Z3KJCB type=del 2024-09-12T17:36:57.506 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.503+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=6EXE4NMBC193 type=del size=1338648 2024-09-12T17:36:57.509 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.507+0000 7f1ad43488c0 1 < completed write operation key=X078SB1ITNII tag=5C5AISUR40AJ type=write size=358545 2024-09-12T17:36:57.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.511+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=EVYGKVEPY251 type=del size=3700806 2024-09-12T17:36:57.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.515+0000 7f1ad43488c0 1 < completed write operation key=3N1YT9TC0M3O tag=FUQYOWTAIA3P type=write size=160295 2024-09-12T17:36:57.519 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.515+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=ALAYD53TH8SC type=del size=1592706 2024-09-12T17:36:57.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.519+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~B8Q0N36MPZXQ.0 size=1048576 2024-09-12T17:36:57.529 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.527+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~B8Q0N36MPZXQ.1 size=1048576 2024-09-12T17:36:57.532 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.531+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~B8Q0N36MPZXQ.2 size=234714 2024-09-12T17:36:57.538 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.535+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=B8Q0N36MPZXQ tag=G6WV4CO28771 type=write size=3380442 2024-09-12T17:36:57.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.539+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=PMP6UILKBV9K type=write size=823749 2024-09-12T17:36:57.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.543+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~YZ0AI6VXE39J.0 size=32916 2024-09-12T17:36:57.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.547+0000 7f1ad43488c0 1 < completed multipart upload key=MB3FVGKV0ZNQ upload=YZ0AI6VXE39J tag=QJRDHXPND9JI type=write size=1081492 2024-09-12T17:36:57.553 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.551+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=VJ038VFQYMQA type=del size=2008567 2024-09-12T17:36:57.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.555+0000 7f1ad43488c0 -1 < failed to complete operation key=SIZ0Z1KWTGUJ tag=1GIT1LU2MK1Y type=del size=903444: (22) Invalid argument 2024-09-12T17:36:57.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.559+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~OGB7EQR6H21B.0 size=1048576 2024-09-12T17:36:57.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.563+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~OGB7EQR6H21B.1 size=544272 2024-09-12T17:36:57.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.563+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=OGB7EQR6H21B tag=7SXTU6DWQ2UL type=write size=2641424 2024-09-12T17:36:57.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.563+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~E8NHKWSWU81H.0 size=1048576 2024-09-12T17:36:57.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.567+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~E8NHKWSWU81H.1 size=971983 2024-09-12T17:36:57.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.571+0000 7f1ad43488c0 1 < completed multipart upload key=C7QSOK3D3IWJ upload=E8NHKWSWU81H tag=UC7O75XMC642 type=write size=3069135 2024-09-12T17:36:57.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.575+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=72UU0L72KBK8 type=del size=1897025 2024-09-12T17:36:57.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.579+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~9VX6BPTWEGFM.0 size=1048576 2024-09-12T17:36:57.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.579+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~9VX6BPTWEGFM.1 size=1048576 2024-09-12T17:36:57.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.583+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~9VX6BPTWEGFM.2 size=158205 2024-09-12T17:36:57.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.587+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=9VX6BPTWEGFM tag=RY8DEN6262QQ type=write size=3303933 2024-09-12T17:36:57.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.591+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=Y1O7JNY76GA8 type=del size=896458 2024-09-12T17:36:57.598 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.595+0000 7f1ad43488c0 1 < suggested update operation key=PKC1RR4FZWE0 tag=WIHMQ5U214C2 type=del size=2305233 2024-09-12T17:36:57.600 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.599+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=PAAA9ZMHPCRG type=del size=61263 2024-09-12T17:36:57.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.599+0000 7f1ad43488c0 1 < canceled part key=_multipart_ECEF8IJGU4Z8.2~9O4BLT1L3IFQ.0 size=1048576 2024-09-12T17:36:57.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.603+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~9O4BLT1L3IFQ.1 size=1048576 2024-09-12T17:36:57.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.603+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~9O4BLT1L3IFQ.2 size=919127 2024-09-12T17:36:57.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.607+0000 7f1ad43488c0 1 < canceled multipart upload key=ECEF8IJGU4Z8 upload=9O4BLT1L3IFQ tag=O1J5AAHOLR4D type=write size=4064855 2024-09-12T17:36:57.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.611+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=BQ87WKHAHMH7 type=write size=856631 2024-09-12T17:36:57.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.615+0000 7f1ad43488c0 1 < completed write operation key=LU7XIBO5YUOR tag=4RSNNORGSXAC type=write size=390149 2024-09-12T17:36:57.620 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.619+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=VOV0Q6CD7HTP type=del size=3556163 2024-09-12T17:36:57.620 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.619+0000 7f1ad43488c0 1 < canceled part key=_multipart_IY2AM7CJDUZG.2~NA2NRYJMCHNA.0 size=1048576 2024-09-12T17:36:57.623 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.623+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~NA2NRYJMCHNA.1 size=1048576 2024-09-12T17:36:57.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.623+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~NA2NRYJMCHNA.2 size=385762 2024-09-12T17:36:57.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.627+0000 7f1ad43488c0 1 < canceled multipart upload key=IY2AM7CJDUZG upload=NA2NRYJMCHNA tag=HHI3BO029XX9 type=write size=3531490 2024-09-12T17:36:57.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.631+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=1LAT7BCU91MZ type=del size=2820550 2024-09-12T17:36:57.635 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.635+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~L6OA4ZHRNPI9.0 size=1048576 2024-09-12T17:36:57.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.635+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~L6OA4ZHRNPI9.1 size=210598 2024-09-12T17:36:57.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.643+0000 7f1ad43488c0 1 < completed multipart upload key=7RSHIZRKK2OY upload=L6OA4ZHRNPI9 tag=PIK1VHVHH32S type=write size=2307750 2024-09-12T17:36:57.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.643+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=UECZWN1YT4ID type=del size=421704 2024-09-12T17:36:57.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.647+0000 7f1ad43488c0 1 < completed write operation key=GWJ78NNXOL1R tag=V1U5F952ATPF type=write size=912570 2024-09-12T17:36:57.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.651+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~GTB0YS8SR559.0 size=1048576 2024-09-12T17:36:57.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.655+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~GTB0YS8SR559.1 size=1048576 2024-09-12T17:36:57.659 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.659+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~GTB0YS8SR559.2 size=603075 2024-09-12T17:36:57.659 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.659+0000 7f1ad43488c0 1 > prepared multipart upload key=3N1YT9TC0M3O upload=GTB0YS8SR559 tag=IAJQH3BXNCE3 type=write size=3748803 2024-09-12T17:36:57.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.659+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~DUQRV0G1HASY.0 size=1048576 2024-09-12T17:36:57.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.663+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~DUQRV0G1HASY.1 size=1048576 2024-09-12T17:36:57.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.663+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~DUQRV0G1HASY.2 size=119322 2024-09-12T17:36:57.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.671+0000 7f1ad43488c0 1 < completed multipart upload key=SIZ0Z1KWTGUJ upload=DUQRV0G1HASY tag=KVS1HG9NA0XV type=write size=3265050 2024-09-12T17:36:57.675 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.671+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=IMR09WI7KIDY type=write size=1007603 2024-09-12T17:36:57.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.675+0000 7f1ad43488c0 1 < completed delete operation key=C7QSOK3D3IWJ tag=HP4CW7K3PKG4 type=del 2024-09-12T17:36:57.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.679+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=USWLBTXBCD79 type=del size=1434201 2024-09-12T17:36:57.684 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.683+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=6EXE4NMBC193 type=del 2024-09-12T17:36:57.690 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.687+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~NFVX7CZBLESZ.0 size=289054 2024-09-12T17:36:57.690 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.687+0000 7f1ad43488c0 1 > prepared multipart upload key=GWJ78NNXOL1R upload=NFVX7CZBLESZ tag=3J775W62CT9B type=write size=1337630 2024-09-12T17:36:57.693 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.691+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=EVYGKVEPY251 type=del 2024-09-12T17:36:57.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.695+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=WEM5EUIQK3M7 type=del size=3096919 2024-09-12T17:36:57.699 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.699+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=ALAYD53TH8SC type=del 2024-09-12T17:36:57.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.699+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=E3F4FB1M61WY type=del size=1583087 2024-09-12T17:36:57.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.707+0000 7f1ad43488c0 1 < suggested update operation key=05PAFB226IFP tag=PMP6UILKBV9K type=write size=823749 2024-09-12T17:36:57.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.711+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=P2P9VNKNSYZU type=del size=367271 2024-09-12T17:36:57.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.711+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=VJ038VFQYMQA type=del 2024-09-12T17:36:57.719 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.715+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=KK7GNDUZI9Y1 type=del size=2581362 2024-09-12T17:36:57.722 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.719+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~OGB7EQR6H21B.0 size=1048576 2024-09-12T17:36:57.725 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.723+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~OGB7EQR6H21B.1 size=544272 2024-09-12T17:36:57.730 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.727+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=OGB7EQR6H21B tag=7SXTU6DWQ2UL type=write size=2641424 2024-09-12T17:36:57.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.735+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~4CR7ZUC0F303.0 size=1048576 2024-09-12T17:36:57.739 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.735+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~4CR7ZUC0F303.1 size=71910 2024-09-12T17:36:57.739 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.735+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=4CR7ZUC0F303 tag=PJ0UI2BBQJZQ type=write size=2169062 2024-09-12T17:36:57.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.739+0000 7f1ad43488c0 1 < completed delete operation key=NHOG1WG3VT6N tag=72UU0L72KBK8 type=del 2024-09-12T17:36:57.746 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.743+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=22T8ZQK5UIFP type=del size=2097947 2024-09-12T17:36:57.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.751+0000 7f1ad43488c0 1 < suggested remove operation key=ECEF8IJGU4Z8 tag=Y1O7JNY76GA8 type=del 2024-09-12T17:36:57.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.755+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=OHHXGQ3UNE17 type=del size=2677645 2024-09-12T17:36:57.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.755+0000 7f1ad43488c0 -1 < failed to complete operation key=05PAFB226IFP tag=PAAA9ZMHPCRG type=del size=61263: (22) Invalid argument 2024-09-12T17:36:57.762 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.759+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=NERN67NEC9AJ type=del size=2018833 2024-09-12T17:36:57.765 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.763+0000 7f1ad43488c0 1 < completed write operation key=4QO60GZ9V0GK tag=BQ87WKHAHMH7 type=write size=856631 2024-09-12T17:36:57.770 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.767+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~IGQMM1BHNMG0.0 size=665540 2024-09-12T17:36:57.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.767+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=IGQMM1BHNMG0 tag=IROJYIPKYETT type=write size=1714116 2024-09-12T17:36:57.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.775+0000 7f1ad43488c0 1 < suggested remove operation key=LU7XIBO5YUOR tag=VOV0Q6CD7HTP type=del 2024-09-12T17:36:57.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.783+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~PZWNX0T5LJRK.0 size=703716 2024-09-12T17:36:57.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.783+0000 7f1ad43488c0 1 > prepared multipart upload key=NHOG1WG3VT6N upload=PZWNX0T5LJRK tag=7XYZI7398RV2 type=write size=1752292 2024-09-12T17:36:57.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.783+0000 7f1ad43488c0 1 < completed delete operation key=WFEJLVRCKIUU tag=1LAT7BCU91MZ type=del 2024-09-12T17:36:57.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.791+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~JQQ8XXHDUA6G.0 size=1048576 2024-09-12T17:36:57.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.791+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~JQQ8XXHDUA6G.1 size=1048576 2024-09-12T17:36:57.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.795+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~JQQ8XXHDUA6G.2 size=878735 2024-09-12T17:36:57.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.795+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=JQQ8XXHDUA6G tag=7PJHW0Y12PYN type=write size=4024463 2024-09-12T17:36:57.799 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.795+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=UECZWN1YT4ID type=del 2024-09-12T17:36:57.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.803+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~SZHS5VC929TM.0 size=1048576 2024-09-12T17:36:57.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.803+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~SZHS5VC929TM.1 size=58714 2024-09-12T17:36:57.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.803+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=SZHS5VC929TM tag=427JD8VY3SAM type=write size=2155866 2024-09-12T17:36:57.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.807+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~GTB0YS8SR559.0 size=1048576 2024-09-12T17:36:57.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.815+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~GTB0YS8SR559.1 size=1048576 2024-09-12T17:36:57.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.819+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~GTB0YS8SR559.2 size=603075 2024-09-12T17:36:57.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.823+0000 7f1ad43488c0 1 < completed multipart upload key=3N1YT9TC0M3O upload=GTB0YS8SR559 tag=IAJQH3BXNCE3 type=write size=3748803 2024-09-12T17:36:57.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.827+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=ZI6E4IO9887J type=del size=1268247 2024-09-12T17:36:57.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.831+0000 7f1ad43488c0 1 < canceled operation key=SDJ53NSPOIRC tag=IMR09WI7KIDY type=write size=1007603 2024-09-12T17:36:57.838 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.835+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~8D690QA21ZSZ.0 size=1048576 2024-09-12T17:36:57.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.839+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~8D690QA21ZSZ.1 size=1048576 2024-09-12T17:36:57.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.843+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~8D690QA21ZSZ.2 size=779806 2024-09-12T17:36:57.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.843+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=8D690QA21ZSZ tag=PVJ3PZ27AQE4 type=write size=3925534 2024-09-12T17:36:57.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.847+0000 7f1ad43488c0 1 < suggested remove operation key=6Z3F28JHHEQS tag=USWLBTXBCD79 type=del 2024-09-12T17:36:57.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.851+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=0VKQ23O9WYEW type=write size=388931 2024-09-12T17:36:57.855 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.855+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~NFVX7CZBLESZ.0 size=289054 2024-09-12T17:36:57.860 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.859+0000 7f1ad43488c0 1 < completed multipart upload key=GWJ78NNXOL1R upload=NFVX7CZBLESZ tag=3J775W62CT9B type=write size=1337630 2024-09-12T17:36:57.864 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.863+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=CD8ID5LLOVVN type=write size=587730 2024-09-12T17:36:57.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.867+0000 7f1ad43488c0 1 < completed delete operation key=NHOG1WG3VT6N tag=WEM5EUIQK3M7 type=del 2024-09-12T17:36:57.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.871+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=C4G51TAPB0O8 type=write size=506695 2024-09-12T17:36:57.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.871+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=E3F4FB1M61WY type=del 2024-09-12T17:36:57.878 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.875+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=ZT0EP17VZ4QY type=del size=1752710 2024-09-12T17:36:57.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.879+0000 7f1ad43488c0 1 < completed delete operation key=9Z2EHQA8T5F4 tag=P2P9VNKNSYZU type=del 2024-09-12T17:36:57.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.883+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=OYZ0VOEGKQ2Z type=del size=97368 2024-09-12T17:36:57.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.887+0000 7f1ad43488c0 1 < completed delete operation key=9Z2EHQA8T5F4 tag=KK7GNDUZI9Y1 type=del 2024-09-12T17:36:57.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.891+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=2R1Z1293ZU5K type=del size=270430 2024-09-12T17:36:57.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.895+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~4CR7ZUC0F303.0 size=1048576 2024-09-12T17:36:57.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.899+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~4CR7ZUC0F303.1 size=71910 2024-09-12T17:36:57.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.903+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=4CR7ZUC0F303 tag=PJ0UI2BBQJZQ type=write size=2169062 2024-09-12T17:36:57.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.907+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~YTEGOLVXECVW.0 size=1048576 2024-09-12T17:36:57.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.911+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~YTEGOLVXECVW.1 size=882065 2024-09-12T17:36:57.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.911+0000 7f1ad43488c0 1 > prepared multipart upload key=RH4HYE315U5Y upload=YTEGOLVXECVW tag=30QQ0GXG6E4W type=write size=2979217 2024-09-12T17:36:57.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.915+0000 7f1ad43488c0 1 < completed delete operation key=ZHFRKX9YY8P5 tag=22T8ZQK5UIFP type=del 2024-09-12T17:36:57.919 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.919+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=FHB2W574CUXQ type=write size=951616 2024-09-12T17:36:57.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.919+0000 7f1ad43488c0 1 < completed delete operation key=05PAFB226IFP tag=OHHXGQ3UNE17 type=del 2024-09-12T17:36:57.926 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.923+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=5JXMM9V2FHAG type=del size=3542950 2024-09-12T17:36:57.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.931+0000 7f1ad43488c0 1 < suggested remove operation key=05PAFB226IFP tag=NERN67NEC9AJ type=del 2024-09-12T17:36:57.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.935+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~8S7X14B3VALQ.0 size=1048576 2024-09-12T17:36:57.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.939+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~8S7X14B3VALQ.1 size=370396 2024-09-12T17:36:57.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.939+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=8S7X14B3VALQ tag=JC1HDTA6QSQJ type=write size=2467548 2024-09-12T17:36:57.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.943+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~IGQMM1BHNMG0.0 size=665540 2024-09-12T17:36:57.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.947+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=IGQMM1BHNMG0 tag=IROJYIPKYETT type=write size=1714116 2024-09-12T17:36:57.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.951+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=3KTF0B892F2V type=write size=393633 2024-09-12T17:36:57.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.955+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~PZWNX0T5LJRK.0 size=703716 2024-09-12T17:36:57.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.963+0000 7f1ad43488c0 1 < completed multipart upload key=NHOG1WG3VT6N upload=PZWNX0T5LJRK tag=7XYZI7398RV2 type=write size=1752292 2024-09-12T17:36:57.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.967+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=8N1WWOUZOFIO type=del size=2153256 2024-09-12T17:36:57.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.971+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~JQQ8XXHDUA6G.0 size=1048576 2024-09-12T17:36:57.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.975+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~JQQ8XXHDUA6G.1 size=1048576 2024-09-12T17:36:57.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.975+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~JQQ8XXHDUA6G.2 size=878735 2024-09-12T17:36:57.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.983+0000 7f1ad43488c0 1 < completed multipart upload key=8U3L46JDJ8VS upload=JQQ8XXHDUA6G tag=7PJHW0Y12PYN type=write size=4024463 2024-09-12T17:36:57.991 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.991+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~YOE1HY904443.0 size=1048576 2024-09-12T17:36:57.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.991+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~YOE1HY904443.1 size=1048576 2024-09-12T17:36:57.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.995+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~YOE1HY904443.2 size=583430 2024-09-12T17:36:57.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.995+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=YOE1HY904443 tag=0UTLN01JQSAA type=write size=3729158 2024-09-12T17:36:58.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:57.999+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~SZHS5VC929TM.0 size=1048576 2024-09-12T17:36:58.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.003+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~SZHS5VC929TM.1 size=58714 2024-09-12T17:36:58.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.007+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=SZHS5VC929TM tag=427JD8VY3SAM type=write size=2155866 2024-09-12T17:36:58.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.011+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=SDBKH0IU2S6L type=del size=4134667 2024-09-12T17:36:58.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.015+0000 7f1ad43488c0 1 < completed delete operation key=C7QSOK3D3IWJ tag=ZI6E4IO9887J type=del 2024-09-12T17:36:58.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.023+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~N8O3LMV5XJCP.0 size=1048576 2024-09-12T17:36:58.029 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.027+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~N8O3LMV5XJCP.1 size=7390 2024-09-12T17:36:58.029 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.027+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=N8O3LMV5XJCP tag=H95BNAL343KG type=write size=2104542 2024-09-12T17:36:58.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.031+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~8D690QA21ZSZ.0 size=1048576 2024-09-12T17:36:58.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.031+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~8D690QA21ZSZ.1 size=1048576 2024-09-12T17:36:58.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.035+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~8D690QA21ZSZ.2 size=779806 2024-09-12T17:36:58.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.043+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=8D690QA21ZSZ tag=PVJ3PZ27AQE4 type=write size=3925534 2024-09-12T17:36:58.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.047+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~M9XLD62JS1CL.0 size=1048576 2024-09-12T17:36:58.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.051+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~M9XLD62JS1CL.1 size=1048576 2024-09-12T17:36:58.053 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.051+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~M9XLD62JS1CL.2 size=966378 2024-09-12T17:36:58.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.051+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=M9XLD62JS1CL tag=27NQHSS8ZXS8 type=write size=4112106 2024-09-12T17:36:58.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.055+0000 7f1ad43488c0 -1 < failed to complete operation key=05PAFB226IFP tag=0VKQ23O9WYEW type=write size=388931: (22) Invalid argument 2024-09-12T17:36:58.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.059+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=PU9U0EK2QC98 type=del size=3365824 2024-09-12T17:36:58.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.063+0000 7f1ad43488c0 1 < completed write operation key=RXJJOPR32OD5 tag=CD8ID5LLOVVN type=write size=587730 2024-09-12T17:36:58.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.067+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~NLJQUGPSA1VY.0 size=1048576 2024-09-12T17:36:58.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.071+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~NLJQUGPSA1VY.1 size=1048576 2024-09-12T17:36:58.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.075+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~NLJQUGPSA1VY.2 size=42045 2024-09-12T17:36:58.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.075+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=NLJQUGPSA1VY tag=BD545606OIMW type=write size=3187773 2024-09-12T17:36:58.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.075+0000 7f1ad43488c0 1 < completed write operation key=MB3FVGKV0ZNQ tag=C4G51TAPB0O8 type=write size=506695 2024-09-12T17:36:58.084 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.083+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~WYD50PNJ0PR0.0 size=424379 2024-09-12T17:36:58.084 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.083+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=WYD50PNJ0PR0 tag=A7AZ5IPHKA62 type=write size=1472955 2024-09-12T17:36:58.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.087+0000 7f1ad43488c0 1 < completed delete operation key=PKC1RR4FZWE0 tag=ZT0EP17VZ4QY type=del 2024-09-12T17:36:58.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.091+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=IG2KD2T954FQ type=del size=3481722 2024-09-12T17:36:58.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.091+0000 7f1ad43488c0 1 < completed delete operation key=SIZ0Z1KWTGUJ tag=OYZ0VOEGKQ2Z type=del 2024-09-12T17:36:58.098 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.095+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=EE9QHT3XYWO7 type=del size=1066625 2024-09-12T17:36:58.101 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.099+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=2R1Z1293ZU5K type=del 2024-09-12T17:36:58.107 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.107+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~ROKWGACXRRN1.0 size=1048576 2024-09-12T17:36:58.110 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.107+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~ROKWGACXRRN1.1 size=825974 2024-09-12T17:36:58.110 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.107+0000 7f1ad43488c0 1 > prepared multipart upload key=9Z2EHQA8T5F4 upload=ROKWGACXRRN1 tag=AQRJARE9LQDH type=write size=2923126 2024-09-12T17:36:58.113 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.111+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~YTEGOLVXECVW.0 size=1048576 2024-09-12T17:36:58.116 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.115+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~YTEGOLVXECVW.1 size=882065 2024-09-12T17:36:58.121 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.119+0000 7f1ad43488c0 1 < completed multipart upload key=RH4HYE315U5Y upload=YTEGOLVXECVW tag=30QQ0GXG6E4W type=write size=2979217 2024-09-12T17:36:58.124 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.123+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=DMJ1ZMA4F00G type=del size=3529774 2024-09-12T17:36:58.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.127+0000 7f1ad43488c0 1 < completed write operation key=C7QSOK3D3IWJ tag=FHB2W574CUXQ type=write size=951616 2024-09-12T17:36:58.136 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.135+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=3SW4LSQGNZ5F type=del size=1012171 2024-09-12T17:36:58.140 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.139+0000 7f1ad43488c0 1 < completed delete operation key=X0HT3K3OREL7 tag=5JXMM9V2FHAG type=del 2024-09-12T17:36:58.146 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.143+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~NFYDXXLXI1G4.0 size=519933 2024-09-12T17:36:58.146 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.143+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=NFYDXXLXI1G4 tag=3SHQ23SVG53T type=write size=1568509 2024-09-12T17:36:58.149 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.147+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~8S7X14B3VALQ.0 size=1048576 2024-09-12T17:36:58.152 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.151+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~8S7X14B3VALQ.1 size=370396 2024-09-12T17:36:58.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.155+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=8S7X14B3VALQ tag=JC1HDTA6QSQJ type=write size=2467548 2024-09-12T17:36:58.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.159+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=ORSNEF933BZR type=del size=1352175 2024-09-12T17:36:58.165 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.163+0000 7f1ad43488c0 1 < completed write operation key=RH4HYE315U5Y tag=3KTF0B892F2V type=write size=393633 2024-09-12T17:36:58.168 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.167+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=TXC3B76U6OCY type=del size=220738 2024-09-12T17:36:58.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.171+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=8N1WWOUZOFIO type=del 2024-09-12T17:36:58.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.175+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~KQ3XX1YS5ZQU.0 size=1048576 2024-09-12T17:36:58.180 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.179+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~KQ3XX1YS5ZQU.1 size=1048576 2024-09-12T17:36:58.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.179+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~KQ3XX1YS5ZQU.2 size=417455 2024-09-12T17:36:58.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.179+0000 7f1ad43488c0 1 > prepared multipart upload key=C7QSOK3D3IWJ upload=KQ3XX1YS5ZQU tag=CWF14107DJNI type=write size=3563183 2024-09-12T17:36:58.186 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.183+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~YOE1HY904443.0 size=1048576 2024-09-12T17:36:58.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.187+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~YOE1HY904443.1 size=1048576 2024-09-12T17:36:58.191 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.191+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~YOE1HY904443.2 size=583430 2024-09-12T17:36:58.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.195+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=YOE1HY904443 tag=0UTLN01JQSAA type=write size=3729158 2024-09-12T17:36:58.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.199+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~7G1Z3ADSX9Y5.0 size=854420 2024-09-12T17:36:58.203 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.199+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=7G1Z3ADSX9Y5 tag=CQF1AQDR5ZNG type=write size=1902996 2024-09-12T17:36:58.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.203+0000 7f1ad43488c0 1 < completed delete operation key=SIZ0Z1KWTGUJ tag=SDBKH0IU2S6L type=del 2024-09-12T17:36:58.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.207+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=N02AL06TYMS2 type=del size=1766360 2024-09-12T17:36:58.212 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.211+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~N8O3LMV5XJCP.0 size=1048576 2024-09-12T17:36:58.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.211+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~N8O3LMV5XJCP.1 size=7390 2024-09-12T17:36:58.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.219+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=N8O3LMV5XJCP tag=H95BNAL343KG type=write size=2104542 2024-09-12T17:36:58.227 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.227+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~32H367DKVPK6.0 size=1048576 2024-09-12T17:36:58.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.227+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~32H367DKVPK6.1 size=1048576 2024-09-12T17:36:58.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.231+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~32H367DKVPK6.2 size=741727 2024-09-12T17:36:58.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.231+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=32H367DKVPK6 tag=0Y0J5JJIPCEU type=write size=3887455 2024-09-12T17:36:58.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.235+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~M9XLD62JS1CL.0 size=1048576 2024-09-12T17:36:58.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.239+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~M9XLD62JS1CL.1 size=1048576 2024-09-12T17:36:58.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.239+0000 7f1ad43488c0 1 < canceled part key=_multipart_RXJJOPR32OD5.2~M9XLD62JS1CL.2 size=966378 2024-09-12T17:36:58.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.243+0000 7f1ad43488c0 1 < canceled multipart upload key=RXJJOPR32OD5 upload=M9XLD62JS1CL tag=27NQHSS8ZXS8 type=write size=4112106 2024-09-12T17:36:58.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.251+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~UMO2NGFZIW7C.0 size=804855 2024-09-12T17:36:58.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.251+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=UMO2NGFZIW7C tag=01IIOEIU9F00 type=write size=1853431 2024-09-12T17:36:58.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.251+0000 7f1ad43488c0 1 < completed delete operation key=ZHFRKX9YY8P5 tag=PU9U0EK2QC98 type=del 2024-09-12T17:36:58.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.259+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~FZH9CB107DR5.0 size=156364 2024-09-12T17:36:58.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.259+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=FZH9CB107DR5 tag=Q4S3Y4YA8WHC type=write size=1204940 2024-09-12T17:36:58.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.263+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~NLJQUGPSA1VY.0 size=1048576 2024-09-12T17:36:58.268 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.267+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~NLJQUGPSA1VY.1 size=1048576 2024-09-12T17:36:58.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.267+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~NLJQUGPSA1VY.2 size=42045 2024-09-12T17:36:58.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.275+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=NLJQUGPSA1VY tag=BD545606OIMW type=write size=3187773 2024-09-12T17:36:58.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.279+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=WWA40G1SFA1V type=del size=3394531 2024-09-12T17:36:58.283 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.279+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~WYD50PNJ0PR0.0 size=424379 2024-09-12T17:36:58.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.287+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=WYD50PNJ0PR0 tag=A7AZ5IPHKA62 type=write size=1472955 2024-09-12T17:36:58.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.291+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~656XEV31FI71.0 size=1048576 2024-09-12T17:36:58.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.295+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~656XEV31FI71.1 size=1048576 2024-09-12T17:36:58.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.299+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~656XEV31FI71.2 size=880946 2024-09-12T17:36:58.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.299+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=656XEV31FI71 tag=KSEVN019QXPE type=write size=4026674 2024-09-12T17:36:58.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.303+0000 7f1ad43488c0 1 < completed delete operation key=9Z2EHQA8T5F4 tag=IG2KD2T954FQ type=del 2024-09-12T17:36:58.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.303+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=GWPD41WO4L4K type=del size=2822419 2024-09-12T17:36:58.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.307+0000 7f1ad43488c0 1 < completed delete operation key=SDJ53NSPOIRC tag=EE9QHT3XYWO7 type=del 2024-09-12T17:36:58.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.311+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=0IUG7CY9EMCL type=del size=2357366 2024-09-12T17:36:58.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.315+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~ROKWGACXRRN1.0 size=1048576 2024-09-12T17:36:58.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.319+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~ROKWGACXRRN1.1 size=825974 2024-09-12T17:36:58.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.323+0000 7f1ad43488c0 1 < completed multipart upload key=9Z2EHQA8T5F4 upload=ROKWGACXRRN1 tag=AQRJARE9LQDH type=write size=2923126 2024-09-12T17:36:58.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.327+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=X4A3GC1I7SKL type=del size=3583468 2024-09-12T17:36:58.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.335+0000 7f1ad43488c0 1 < suggested remove operation key=IY2AM7CJDUZG tag=DMJ1ZMA4F00G type=del 2024-09-12T17:36:58.340 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.339+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=B7C90NM0ZJTX type=del size=76821 2024-09-12T17:36:58.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.347+0000 7f1ad43488c0 1 < suggested remove operation key=SIZ0Z1KWTGUJ tag=3SW4LSQGNZ5F type=del 2024-09-12T17:36:58.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.351+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~VALPFDNLLVU5.0 size=1048576 2024-09-12T17:36:58.356 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.355+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~VALPFDNLLVU5.1 size=321453 2024-09-12T17:36:58.356 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.355+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=VALPFDNLLVU5 tag=L1SKNEIH8N9Y type=write size=2418605 2024-09-12T17:36:58.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.359+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~NFYDXXLXI1G4.0 size=519933 2024-09-12T17:36:58.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.363+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=NFYDXXLXI1G4 tag=3SHQ23SVG53T type=write size=1568509 2024-09-12T17:36:58.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.367+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=VLUUAT0W5BPU type=del size=1270552 2024-09-12T17:36:58.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.375+0000 7f1ad43488c0 1 < suggested remove operation key=NHOG1WG3VT6N tag=ORSNEF933BZR type=del 2024-09-12T17:36:58.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.379+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=ZB7ACSB0MXQA type=del size=2207400 2024-09-12T17:36:58.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.379+0000 7f1ad43488c0 1 < completed delete operation key=2SDYAQRNWAJK tag=TXC3B76U6OCY type=del 2024-09-12T17:36:58.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.387+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~RCU0APO5XWEO.0 size=1048576 2024-09-12T17:36:58.391 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.391+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~RCU0APO5XWEO.1 size=586931 2024-09-12T17:36:58.391 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.391+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=RCU0APO5XWEO tag=JSZV7TZ54RMD type=write size=2684083 2024-09-12T17:36:58.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.395+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~KQ3XX1YS5ZQU.0 size=1048576 2024-09-12T17:36:58.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.395+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~KQ3XX1YS5ZQU.1 size=1048576 2024-09-12T17:36:58.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.399+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~KQ3XX1YS5ZQU.2 size=417455 2024-09-12T17:36:58.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.403+0000 7f1ad43488c0 1 < completed multipart upload key=C7QSOK3D3IWJ upload=KQ3XX1YS5ZQU tag=CWF14107DJNI type=write size=3563183 2024-09-12T17:36:58.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.407+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=TZ8FWZF4RA5W type=del size=886850 2024-09-12T17:36:58.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.411+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~7G1Z3ADSX9Y5.0 size=854420 2024-09-12T17:36:58.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.419+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=7G1Z3ADSX9Y5 tag=CQF1AQDR5ZNG type=write size=1902996 2024-09-12T17:36:58.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.419+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=M052SZMRWN1D type=del size=2194682 2024-09-12T17:36:58.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.427+0000 7f1ad43488c0 1 < suggested update operation key=BCPDXAL027U2 tag=N02AL06TYMS2 type=del size=1766360 2024-09-12T17:36:58.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.431+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=H4GVFTDINCK9 type=write size=702131 2024-09-12T17:36:58.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.431+0000 7f1ad43488c0 1 < canceled part key=_multipart_PKC1RR4FZWE0.2~32H367DKVPK6.0 size=1048576 2024-09-12T17:36:58.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.435+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~32H367DKVPK6.1 size=1048576 2024-09-12T17:36:58.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.439+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~32H367DKVPK6.2 size=741727 2024-09-12T17:36:58.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.443+0000 7f1ad43488c0 1 < canceled multipart upload key=PKC1RR4FZWE0 upload=32H367DKVPK6 tag=0Y0J5JJIPCEU type=write size=3887455 2024-09-12T17:36:58.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.451+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=MPC0C42HA1TO type=write size=819058 2024-09-12T17:36:58.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.455+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~UMO2NGFZIW7C.0 size=804855 2024-09-12T17:36:58.462 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.459+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=UMO2NGFZIW7C tag=01IIOEIU9F00 type=write size=1853431 2024-09-12T17:36:58.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.463+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=L0HUTWP4ZJVL type=del size=3058180 2024-09-12T17:36:58.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.467+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~FZH9CB107DR5.0 size=156364 2024-09-12T17:36:58.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.471+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=FZH9CB107DR5 tag=Q4S3Y4YA8WHC type=write size=1204940 2024-09-12T17:36:58.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.475+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=NC371KYHXW29 type=del size=1192868 2024-09-12T17:36:58.481 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.479+0000 7f1ad43488c0 1 < completed delete operation key=WWB6LAHAMIR9 tag=WWA40G1SFA1V type=del 2024-09-12T17:36:58.487 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.483+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~T9K1ZWD5DRHV.0 size=535852 2024-09-12T17:36:58.487 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.483+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=T9K1ZWD5DRHV tag=LEL6GNO51NCJ type=write size=1584428 2024-09-12T17:36:58.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.487+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~656XEV31FI71.0 size=1048576 2024-09-12T17:36:58.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.491+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~656XEV31FI71.1 size=1048576 2024-09-12T17:36:58.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.491+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~656XEV31FI71.2 size=880946 2024-09-12T17:36:58.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.495+0000 7f1ad43488c0 1 < completed multipart upload key=IY2AM7CJDUZG upload=656XEV31FI71 tag=KSEVN019QXPE type=write size=4026674 2024-09-12T17:36:58.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.499+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=5P87C6O28TQS type=del size=4138139 2024-09-12T17:36:58.505 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.503+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=GWPD41WO4L4K type=del 2024-09-12T17:36:58.510 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.507+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~05FM243Z4AJV.0 size=913722 2024-09-12T17:36:58.510 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.507+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=05FM243Z4AJV tag=DH1B2UIYQ561 type=write size=1962298 2024-09-12T17:36:58.513 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.511+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=0IUG7CY9EMCL type=del 2024-09-12T17:36:58.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.515+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=XOPUY6NLOWHI type=del size=190199 2024-09-12T17:36:58.519 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.515+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=X4A3GC1I7SKL type=del 2024-09-12T17:36:58.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.523+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~TFKIZPBMGBIE.0 size=1048576 2024-09-12T17:36:58.526 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.523+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~TFKIZPBMGBIE.1 size=1048576 2024-09-12T17:36:58.529 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.527+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~TFKIZPBMGBIE.2 size=440672 2024-09-12T17:36:58.529 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.527+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=TFKIZPBMGBIE tag=7SYNRVK1KJUR type=write size=3586400 2024-09-12T17:36:58.533 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.531+0000 7f1ad43488c0 1 < completed delete operation key=PKC1RR4FZWE0 tag=B7C90NM0ZJTX type=del 2024-09-12T17:36:58.536 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.535+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=3D3KDUUP05GN type=write size=151917 2024-09-12T17:36:58.538 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.535+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~VALPFDNLLVU5.0 size=1048576 2024-09-12T17:36:58.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.539+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~VALPFDNLLVU5.1 size=321453 2024-09-12T17:36:58.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.543+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=VALPFDNLLVU5 tag=L1SKNEIH8N9Y type=write size=2418605 2024-09-12T17:36:58.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.547+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=VWP8QM4MW520 type=del size=2067852 2024-09-12T17:36:58.551 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.551+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=VLUUAT0W5BPU type=del 2024-09-12T17:36:58.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.555+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~W5O1MGVANAIR.0 size=1048576 2024-09-12T17:36:58.558 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.555+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~W5O1MGVANAIR.1 size=1048576 2024-09-12T17:36:58.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.559+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~W5O1MGVANAIR.2 size=664120 2024-09-12T17:36:58.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.559+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=W5O1MGVANAIR tag=6JEUE7BT9W75 type=write size=3809848 2024-09-12T17:36:58.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.563+0000 7f1ad43488c0 1 < completed delete operation key=05PAFB226IFP tag=ZB7ACSB0MXQA type=del 2024-09-12T17:36:58.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.567+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~C9PINC918P74.0 size=1048576 2024-09-12T17:36:58.571 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.571+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~C9PINC918P74.1 size=879726 2024-09-12T17:36:58.571 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.571+0000 7f1ad43488c0 1 > prepared multipart upload key=ZHFRKX9YY8P5 upload=C9PINC918P74 tag=L9WBLXP16RXX type=write size=2976878 2024-09-12T17:36:58.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.571+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~RCU0APO5XWEO.0 size=1048576 2024-09-12T17:36:58.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.571+0000 7f1ad43488c0 1 < canceled part key=_multipart_8U3L46JDJ8VS.2~RCU0APO5XWEO.1 size=586931 2024-09-12T17:36:58.578 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.575+0000 7f1ad43488c0 1 < canceled multipart upload key=8U3L46JDJ8VS upload=RCU0APO5XWEO tag=JSZV7TZ54RMD type=write size=2684083 2024-09-12T17:36:58.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.579+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=6IBXOR0PHULS type=write size=220291 2024-09-12T17:36:58.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.583+0000 7f1ad43488c0 1 < canceled operation key=X0HT3K3OREL7 tag=TZ8FWZF4RA5W type=del size=886850 2024-09-12T17:36:58.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.587+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~7QEKGJHOA63G.0 size=1048576 2024-09-12T17:36:58.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.587+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~7QEKGJHOA63G.1 size=491263 2024-09-12T17:36:58.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.587+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=7QEKGJHOA63G tag=BTENNV934KQ3 type=write size=2588415 2024-09-12T17:36:58.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.591+0000 7f1ad43488c0 1 < completed delete operation key=IY2AM7CJDUZG tag=M052SZMRWN1D type=del 2024-09-12T17:36:58.599 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.595+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~S1ZWRB25E2QO.0 size=1048576 2024-09-12T17:36:58.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.599+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~S1ZWRB25E2QO.1 size=66511 2024-09-12T17:36:58.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.599+0000 7f1ad43488c0 1 > prepared multipart upload key=9Z2EHQA8T5F4 upload=S1ZWRB25E2QO tag=ZZ532R503AVY type=write size=2163663 2024-09-12T17:36:58.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.603+0000 7f1ad43488c0 1 < canceled operation key=A49CE02X3L2L tag=H4GVFTDINCK9 type=write size=702131 2024-09-12T17:36:58.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.607+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~VZ6GGSCTI9CT.0 size=198059 2024-09-12T17:36:58.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.607+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=VZ6GGSCTI9CT tag=6FO60KN930SY type=write size=1246635 2024-09-12T17:36:58.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.611+0000 7f1ad43488c0 1 < completed write operation key=Y3NQLDWQJ37Z tag=MPC0C42HA1TO type=write size=819058 2024-09-12T17:36:58.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.615+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~0QD6Z9QYIEPM.0 size=306497 2024-09-12T17:36:58.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.615+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=0QD6Z9QYIEPM tag=R3SY0CZNY9NN type=write size=1355073 2024-09-12T17:36:58.621 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.619+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=L0HUTWP4ZJVL type=del 2024-09-12T17:36:58.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.623+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~L6DM3UZA0KLB.0 size=669584 2024-09-12T17:36:58.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.623+0000 7f1ad43488c0 1 > prepared multipart upload key=WFEJLVRCKIUU upload=L6DM3UZA0KLB tag=SG55KD3XSJ6I type=write size=1718160 2024-09-12T17:36:58.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.627+0000 7f1ad43488c0 1 < completed delete operation key=NHOG1WG3VT6N tag=NC371KYHXW29 type=del 2024-09-12T17:36:58.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.631+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=LNV4Y2BG7GSC type=del size=2705048 2024-09-12T17:36:58.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.631+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~T9K1ZWD5DRHV.0 size=535852 2024-09-12T17:36:58.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.635+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=T9K1ZWD5DRHV tag=LEL6GNO51NCJ type=write size=1584428 2024-09-12T17:36:58.642 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.639+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=E1W44TTNMXFT type=write size=378099 2024-09-12T17:36:58.647 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.647+0000 7f1ad43488c0 1 < suggested update operation key=RH4HYE315U5Y tag=5P87C6O28TQS type=del size=4138139 2024-09-12T17:36:58.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.647+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=4MZOAX2S1J02 type=write size=690862 2024-09-12T17:36:58.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.651+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~05FM243Z4AJV.0 size=913722 2024-09-12T17:36:58.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.655+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=05FM243Z4AJV tag=DH1B2UIYQ561 type=write size=1962298 2024-09-12T17:36:58.660 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.659+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=XJDXKA8HL7Z5 type=del size=2677399 2024-09-12T17:36:58.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.663+0000 7f1ad43488c0 1 < completed delete operation key=WWB6LAHAMIR9 tag=XOPUY6NLOWHI type=del 2024-09-12T17:36:58.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.663+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=XK6VT0YG2VUH type=write size=821245 2024-09-12T17:36:58.669 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.667+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~TFKIZPBMGBIE.0 size=1048576 2024-09-12T17:36:58.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.671+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~TFKIZPBMGBIE.1 size=1048576 2024-09-12T17:36:58.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.671+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~TFKIZPBMGBIE.2 size=440672 2024-09-12T17:36:58.680 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.679+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=TFKIZPBMGBIE tag=7SYNRVK1KJUR type=write size=3586400 2024-09-12T17:36:58.685 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.683+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~LMS011ELO5HB.0 size=1048576 2024-09-12T17:36:58.688 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.687+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~LMS011ELO5HB.1 size=567786 2024-09-12T17:36:58.688 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.687+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=LMS011ELO5HB tag=9USMP7718BKJ type=write size=2664938 2024-09-12T17:36:58.690 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.687+0000 7f1ad43488c0 1 < completed write operation key=WFEJLVRCKIUU tag=3D3KDUUP05GN type=write size=151917 2024-09-12T17:36:58.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.691+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=09QJQ1JT7FPR type=del size=944274 2024-09-12T17:36:58.697 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.695+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=VWP8QM4MW520 type=del 2024-09-12T17:36:58.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.699+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~99SJIQM9ZWSQ.0 size=655495 2024-09-12T17:36:58.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.699+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=99SJIQM9ZWSQ tag=85GLNYGXQTNS type=write size=1704071 2024-09-12T17:36:58.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.699+0000 7f1ad43488c0 1 < canceled part key=_multipart_6Z3F28JHHEQS.2~W5O1MGVANAIR.0 size=1048576 2024-09-12T17:36:58.705 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.703+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~W5O1MGVANAIR.1 size=1048576 2024-09-12T17:36:58.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.707+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~W5O1MGVANAIR.2 size=664120 2024-09-12T17:36:58.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.711+0000 7f1ad43488c0 1 < canceled multipart upload key=6Z3F28JHHEQS upload=W5O1MGVANAIR tag=6JEUE7BT9W75 type=write size=3809848 2024-09-12T17:36:58.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.715+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=YGI1ZUJZRGR5 type=del size=2893897 2024-09-12T17:36:58.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.715+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~C9PINC918P74.0 size=1048576 2024-09-12T17:36:58.721 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.719+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~C9PINC918P74.1 size=879726 2024-09-12T17:36:58.730 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.727+0000 7f1ad43488c0 1 < completed multipart upload key=ZHFRKX9YY8P5 upload=C9PINC918P74 tag=L9WBLXP16RXX type=write size=2976878 2024-09-12T17:36:58.737 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.735+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~33BDA7IZFHQJ.0 size=1048576 2024-09-12T17:36:58.740 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.739+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~33BDA7IZFHQJ.1 size=1048576 2024-09-12T17:36:58.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.739+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~33BDA7IZFHQJ.2 size=1003936 2024-09-12T17:36:58.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.739+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=33BDA7IZFHQJ tag=7BLNTJFT0Q7B type=write size=4149664 2024-09-12T17:36:58.746 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.743+0000 7f1ad43488c0 1 < completed write operation key=NHOG1WG3VT6N tag=6IBXOR0PHULS type=write size=220291 2024-09-12T17:36:58.753 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.751+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~249X1A06E55U.0 size=1048576 2024-09-12T17:36:58.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.755+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~249X1A06E55U.1 size=166649 2024-09-12T17:36:58.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.755+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=249X1A06E55U tag=M5EE0C57ZYMU type=write size=2263801 2024-09-12T17:36:58.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.755+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~7QEKGJHOA63G.0 size=1048576 2024-09-12T17:36:58.761 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.759+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~7QEKGJHOA63G.1 size=491263 2024-09-12T17:36:58.767 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.767+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=7QEKGJHOA63G tag=BTENNV934KQ3 type=write size=2588415 2024-09-12T17:36:58.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.771+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~9KA4295384S8.0 size=225804 2024-09-12T17:36:58.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.771+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=9KA4295384S8 tag=8QZRVY300AFE type=write size=1274380 2024-09-12T17:36:58.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.775+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~S1ZWRB25E2QO.0 size=1048576 2024-09-12T17:36:58.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.779+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~S1ZWRB25E2QO.1 size=66511 2024-09-12T17:36:58.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.783+0000 7f1ad43488c0 1 < completed multipart upload key=9Z2EHQA8T5F4 upload=S1ZWRB25E2QO tag=ZZ532R503AVY type=write size=2163663 2024-09-12T17:36:58.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.791+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~34CLC817KTM4.0 size=537316 2024-09-12T17:36:58.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.791+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=34CLC817KTM4 tag=GTB1JEPZNMYE type=write size=1585892 2024-09-12T17:36:58.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.791+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~VZ6GGSCTI9CT.0 size=198059 2024-09-12T17:36:58.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.799+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=VZ6GGSCTI9CT tag=6FO60KN930SY type=write size=1246635 2024-09-12T17:36:58.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.803+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=PMCJNTK00YKY type=del size=3592131 2024-09-12T17:36:58.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.803+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~0QD6Z9QYIEPM.0 size=306497 2024-09-12T17:36:58.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.811+0000 7f1ad43488c0 1 < completed multipart upload key=8U3L46JDJ8VS upload=0QD6Z9QYIEPM tag=R3SY0CZNY9NN type=write size=1355073 2024-09-12T17:36:58.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.815+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=TECXGND7WX62 type=write size=640063 2024-09-12T17:36:58.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.815+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~L6DM3UZA0KLB.0 size=669584 2024-09-12T17:36:58.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.823+0000 7f1ad43488c0 1 < completed multipart upload key=WFEJLVRCKIUU upload=L6DM3UZA0KLB tag=SG55KD3XSJ6I type=write size=1718160 2024-09-12T17:36:58.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.823+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=42M6KF5ADK3J type=del size=2845480 2024-09-12T17:36:58.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.827+0000 7f1ad43488c0 1 < completed delete operation key=SIZ0Z1KWTGUJ tag=LNV4Y2BG7GSC type=del 2024-09-12T17:36:58.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.831+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~XBHS59DVW004.0 size=1048576 2024-09-12T17:36:58.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.835+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~XBHS59DVW004.1 size=346509 2024-09-12T17:36:58.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.835+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=XBHS59DVW004 tag=UZB23KE6EGPO type=write size=2443661 2024-09-12T17:36:58.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.839+0000 7f1ad43488c0 1 < completed write operation key=NHOG1WG3VT6N tag=E1W44TTNMXFT type=write size=378099 2024-09-12T17:36:58.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.843+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~9V0SVTFCOM8B.0 size=132969 2024-09-12T17:36:58.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.843+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=9V0SVTFCOM8B tag=NYRTO2XBEMS0 type=write size=1181545 2024-09-12T17:36:58.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.847+0000 7f1ad43488c0 1 < completed write operation key=RH4HYE315U5Y tag=4MZOAX2S1J02 type=write size=690862 2024-09-12T17:36:58.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.851+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=BQ0G8PP5UP2P type=write size=942119 2024-09-12T17:36:58.855 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.851+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=XJDXKA8HL7Z5 type=del 2024-09-12T17:36:58.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.855+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=C5U09B7GQ6DG type=write size=33896 2024-09-12T17:36:58.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.859+0000 7f1ad43488c0 1 < completed write operation key=05PAFB226IFP tag=XK6VT0YG2VUH type=write size=821245 2024-09-12T17:36:58.864 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.863+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=0BYR4JNKFIKV type=write size=196492 2024-09-12T17:36:58.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.867+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~LMS011ELO5HB.0 size=1048576 2024-09-12T17:36:58.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.867+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~LMS011ELO5HB.1 size=567786 2024-09-12T17:36:58.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.871+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=LMS011ELO5HB tag=9USMP7718BKJ type=write size=2664938 2024-09-12T17:36:58.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.875+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=KI17JYILTK3Y type=del size=3614548 2024-09-12T17:36:58.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.879+0000 7f1ad43488c0 1 < completed delete operation key=WWB6LAHAMIR9 tag=09QJQ1JT7FPR type=del 2024-09-12T17:36:58.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.883+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=DYC0I63A2YOY type=del size=1326236 2024-09-12T17:36:58.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.883+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~99SJIQM9ZWSQ.0 size=655495 2024-09-12T17:36:58.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.891+0000 7f1ad43488c0 1 < completed multipart upload key=WWB6LAHAMIR9 upload=99SJIQM9ZWSQ tag=85GLNYGXQTNS type=write size=1704071 2024-09-12T17:36:58.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.895+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~FR97A0WNULR0.0 size=1048576 2024-09-12T17:36:58.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.895+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~FR97A0WNULR0.1 size=1048576 2024-09-12T17:36:58.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.899+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~FR97A0WNULR0.2 size=136602 2024-09-12T17:36:58.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.899+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=FR97A0WNULR0 tag=89TR0EAU3YNL type=write size=3282330 2024-09-12T17:36:58.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.903+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=YGI1ZUJZRGR5 type=del 2024-09-12T17:36:58.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.907+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=R984BOUZRQKC type=write size=968097 2024-09-12T17:36:58.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.911+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~33BDA7IZFHQJ.0 size=1048576 2024-09-12T17:36:58.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.911+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~33BDA7IZFHQJ.1 size=1048576 2024-09-12T17:36:58.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.915+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~33BDA7IZFHQJ.2 size=1003936 2024-09-12T17:36:58.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.919+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=33BDA7IZFHQJ tag=7BLNTJFT0Q7B type=write size=4149664 2024-09-12T17:36:58.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.923+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=9SO29SR2SNDE type=del size=3460853 2024-09-12T17:36:58.927 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.927+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~249X1A06E55U.0 size=1048576 2024-09-12T17:36:58.930 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.927+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~249X1A06E55U.1 size=166649 2024-09-12T17:36:58.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.935+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=249X1A06E55U tag=M5EE0C57ZYMU type=write size=2263801 2024-09-12T17:36:58.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.939+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~B9CLU1G3EA4Z.0 size=1048576 2024-09-12T17:36:58.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.943+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~B9CLU1G3EA4Z.1 size=1048576 2024-09-12T17:36:58.948 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.947+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~B9CLU1G3EA4Z.2 size=111177 2024-09-12T17:36:58.948 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.947+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=B9CLU1G3EA4Z tag=W0L1KHQP80SL type=write size=3256905 2024-09-12T17:36:58.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.947+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~9KA4295384S8.0 size=225804 2024-09-12T17:36:58.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.955+0000 7f1ad43488c0 1 < completed multipart upload key=WWB6LAHAMIR9 upload=9KA4295384S8 tag=8QZRVY300AFE type=write size=1274380 2024-09-12T17:36:58.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.959+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=G0WXXM0SLCHE type=del size=3863621 2024-09-12T17:36:58.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.959+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~34CLC817KTM4.0 size=537316 2024-09-12T17:36:58.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.967+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=34CLC817KTM4 tag=GTB1JEPZNMYE type=write size=1585892 2024-09-12T17:36:58.974 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.971+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~622BMR32TABC.0 size=1048576 2024-09-12T17:36:58.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.975+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~622BMR32TABC.1 size=791420 2024-09-12T17:36:58.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.975+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=622BMR32TABC tag=RJFBH2U5JE6R type=write size=2888572 2024-09-12T17:36:58.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.983+0000 7f1ad43488c0 1 < suggested update operation key=MB3FVGKV0ZNQ tag=PMCJNTK00YKY type=del size=3592131 2024-09-12T17:36:58.990 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.987+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~RLPBECMX0BBG.0 size=1048576 2024-09-12T17:36:58.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.991+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~RLPBECMX0BBG.1 size=610219 2024-09-12T17:36:58.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.991+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=RLPBECMX0BBG tag=PYHBXCF9JLO5 type=write size=2707371 2024-09-12T17:36:58.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.995+0000 7f1ad43488c0 1 < completed write operation key=4QO60GZ9V0GK tag=TECXGND7WX62 type=write size=640063 2024-09-12T17:36:59.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.999+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~OBF8VJOVT4V3.0 size=373472 2024-09-12T17:36:59.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:58.999+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=OBF8VJOVT4V3 tag=6L1R6F8RPLIM type=write size=1422048 2024-09-12T17:36:59.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.003+0000 7f1ad43488c0 1 < suggested update operation key=ECEF8IJGU4Z8 tag=42M6KF5ADK3J type=del size=2845480 2024-09-12T17:36:59.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.007+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=ODEQP3H13D5N type=write size=813009 2024-09-12T17:36:59.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.011+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~XBHS59DVW004.0 size=1048576 2024-09-12T17:36:59.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.011+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~XBHS59DVW004.1 size=346509 2024-09-12T17:36:59.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.019+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=XBHS59DVW004 tag=UZB23KE6EGPO type=write size=2443661 2024-09-12T17:36:59.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.023+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=JLPX68243CZR type=write size=854594 2024-09-12T17:36:59.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.023+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~9V0SVTFCOM8B.0 size=132969 2024-09-12T17:36:59.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.031+0000 7f1ad43488c0 1 < completed multipart upload key=WWB6LAHAMIR9 upload=9V0SVTFCOM8B tag=NYRTO2XBEMS0 type=write size=1181545 2024-09-12T17:36:59.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.035+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~VOY5F6B8NVSR.0 size=183443 2024-09-12T17:36:59.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.035+0000 7f1ad43488c0 1 > prepared multipart upload key=ZHFRKX9YY8P5 upload=VOY5F6B8NVSR tag=DJR7JA4X8ZY1 type=write size=1232019 2024-09-12T17:36:59.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.039+0000 7f1ad43488c0 1 < suggested update operation key=SIZ0Z1KWTGUJ tag=BQ0G8PP5UP2P type=write size=942119 2024-09-12T17:36:59.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.043+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=O211T9R529EO type=write size=405198 2024-09-12T17:36:59.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.047+0000 7f1ad43488c0 1 < completed write operation key=X0HT3K3OREL7 tag=C5U09B7GQ6DG type=write size=33896 2024-09-12T17:36:59.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.047+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=6I77THXDPF7M type=del size=2124195 2024-09-12T17:36:59.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.051+0000 7f1ad43488c0 1 < suggested remove operation key=MB3FVGKV0ZNQ tag=0BYR4JNKFIKV type=write 2024-09-12T17:36:59.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.055+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=HB55K2U9WP5F type=del size=1482819 2024-09-12T17:36:59.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.059+0000 7f1ad43488c0 1 < suggested update operation key=SIZ0Z1KWTGUJ tag=KI17JYILTK3Y type=del size=3614548 2024-09-12T17:36:59.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.063+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~CGGSUN9LBF4S.0 size=1048576 2024-09-12T17:36:59.069 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.067+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~CGGSUN9LBF4S.1 size=1048576 2024-09-12T17:36:59.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.071+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~CGGSUN9LBF4S.2 size=137969 2024-09-12T17:36:59.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.071+0000 7f1ad43488c0 1 > prepared multipart upload key=WFEJLVRCKIUU upload=CGGSUN9LBF4S tag=L860P829P5OC type=write size=3283697 2024-09-12T17:36:59.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.071+0000 7f1ad43488c0 1 < completed delete operation key=SDJ53NSPOIRC tag=DYC0I63A2YOY type=del 2024-09-12T17:36:59.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.079+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~AW3ZIXGV2LCX.0 size=1048576 2024-09-12T17:36:59.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.079+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~AW3ZIXGV2LCX.1 size=1048576 2024-09-12T17:36:59.084 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.083+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~AW3ZIXGV2LCX.2 size=945123 2024-09-12T17:36:59.084 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.083+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=AW3ZIXGV2LCX tag=A5PVYRH219DR type=write size=4090851 2024-09-12T17:36:59.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.083+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~FR97A0WNULR0.0 size=1048576 2024-09-12T17:36:59.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.087+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~FR97A0WNULR0.1 size=1048576 2024-09-12T17:36:59.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.091+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~FR97A0WNULR0.2 size=136602 2024-09-12T17:36:59.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.095+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=FR97A0WNULR0 tag=89TR0EAU3YNL type=write size=3282330 2024-09-12T17:36:59.100 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.099+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=NXVRFMQBKQLE type=del size=1108945 2024-09-12T17:36:59.103 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.103+0000 7f1ad43488c0 1 < completed write operation key=BCPDXAL027U2 tag=R984BOUZRQKC type=write size=968097 2024-09-12T17:36:59.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.107+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~PRV34F8EVSP0.0 size=484955 2024-09-12T17:36:59.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.107+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=PRV34F8EVSP0 tag=XZMLSQHY9VCW type=write size=1533531 2024-09-12T17:36:59.112 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.111+0000 7f1ad43488c0 1 < canceled operation key=X0HT3K3OREL7 tag=9SO29SR2SNDE type=del size=3460853 2024-09-12T17:36:59.115 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.115+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=I6CATZB6WAKX type=write size=308201 2024-09-12T17:36:59.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.115+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~B9CLU1G3EA4Z.0 size=1048576 2024-09-12T17:36:59.121 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.119+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~B9CLU1G3EA4Z.1 size=1048576 2024-09-12T17:36:59.123 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.123+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~B9CLU1G3EA4Z.2 size=111177 2024-09-12T17:36:59.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.127+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=B9CLU1G3EA4Z tag=W0L1KHQP80SL type=write size=3256905 2024-09-12T17:36:59.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.131+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~L6XG1G2ET98N.0 size=141146 2024-09-12T17:36:59.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.131+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=L6XG1G2ET98N tag=QACCDPQJJQL5 type=write size=1189722 2024-09-12T17:36:59.136 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.135+0000 7f1ad43488c0 1 < canceled operation key=0MV3GCBTWZD0 tag=G0WXXM0SLCHE type=del size=3863621 2024-09-12T17:36:59.139 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.139+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=1GBB9NFFC138 type=del size=3523545 2024-09-12T17:36:59.142 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.139+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~622BMR32TABC.0 size=1048576 2024-09-12T17:36:59.144 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.143+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~622BMR32TABC.1 size=791420 2024-09-12T17:36:59.149 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.147+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=622BMR32TABC tag=RJFBH2U5JE6R type=write size=2888572 2024-09-12T17:36:59.152 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.151+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=RK93SBYDRUAF type=del size=443415 2024-09-12T17:36:59.156 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.155+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~RLPBECMX0BBG.0 size=1048576 2024-09-12T17:36:59.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.159+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~RLPBECMX0BBG.1 size=610219 2024-09-12T17:36:59.165 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.163+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=RLPBECMX0BBG tag=PYHBXCF9JLO5 type=write size=2707371 2024-09-12T17:36:59.169 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.167+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~I3K2IRO2OHRX.0 size=1048576 2024-09-12T17:36:59.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.171+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~I3K2IRO2OHRX.1 size=1048576 2024-09-12T17:36:59.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.171+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~I3K2IRO2OHRX.2 size=1041358 2024-09-12T17:36:59.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.171+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=I3K2IRO2OHRX tag=NQ300600SBIX type=write size=4187086 2024-09-12T17:36:59.178 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.175+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~OBF8VJOVT4V3.0 size=373472 2024-09-12T17:36:59.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.183+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=OBF8VJOVT4V3 tag=6L1R6F8RPLIM type=write size=1422048 2024-09-12T17:36:59.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.187+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~9KUOP07PH50D.0 size=481658 2024-09-12T17:36:59.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.187+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=9KUOP07PH50D tag=SY8U6WXU39Z2 type=write size=1530234 2024-09-12T17:36:59.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.191+0000 7f1ad43488c0 1 < completed write operation key=WWB6LAHAMIR9 tag=ODEQP3H13D5N type=write size=813009 2024-09-12T17:36:59.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.191+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=6ZWFFK6M4QX7 type=del size=728196 2024-09-12T17:36:59.200 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.199+0000 7f1ad43488c0 1 < suggested remove operation key=C7QSOK3D3IWJ tag=JLPX68243CZR type=write 2024-09-12T17:36:59.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.199+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=PILQ0YDSDAEO type=del size=269018 2024-09-12T17:36:59.205 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.203+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~VOY5F6B8NVSR.0 size=183443 2024-09-12T17:36:59.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.207+0000 7f1ad43488c0 1 < completed multipart upload key=ZHFRKX9YY8P5 upload=VOY5F6B8NVSR tag=DJR7JA4X8ZY1 type=write size=1232019 2024-09-12T17:36:59.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.211+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~IT8K75BNU0SG.0 size=1048576 2024-09-12T17:36:59.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.215+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~IT8K75BNU0SG.1 size=957558 2024-09-12T17:36:59.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.215+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=IT8K75BNU0SG tag=C21YFKCESHIO type=write size=3054710 2024-09-12T17:36:59.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.219+0000 7f1ad43488c0 1 < completed write operation key=X0HT3K3OREL7 tag=O211T9R529EO type=write size=405198 2024-09-12T17:36:59.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.223+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=KI8EOTEX1VCR type=del size=3402194 2024-09-12T17:36:59.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.223+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=6I77THXDPF7M type=del 2024-09-12T17:36:59.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.231+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~8RV3TKZTFYTH.0 size=666260 2024-09-12T17:36:59.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.231+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=8RV3TKZTFYTH tag=LC4SCE0A0MXC type=write size=1714836 2024-09-12T17:36:59.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.231+0000 7f1ad43488c0 1 < canceled operation key=WWB6LAHAMIR9 tag=HB55K2U9WP5F type=del size=1482819 2024-09-12T17:36:59.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.235+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=Q0OUVPD1CC9S type=del size=2698995 2024-09-12T17:36:59.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.235+0000 7f1ad43488c0 1 < canceled part key=_multipart_WFEJLVRCKIUU.2~CGGSUN9LBF4S.0 size=1048576 2024-09-12T17:36:59.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.239+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~CGGSUN9LBF4S.1 size=1048576 2024-09-12T17:36:59.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.239+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~CGGSUN9LBF4S.2 size=137969 2024-09-12T17:36:59.247 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.247+0000 7f1ad43488c0 1 < canceled multipart upload key=WFEJLVRCKIUU upload=CGGSUN9LBF4S tag=L860P829P5OC type=write size=3283697 2024-09-12T17:36:59.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.247+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=5U40D34ME7BC type=del size=2475077 2024-09-12T17:36:59.253 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.251+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~AW3ZIXGV2LCX.0 size=1048576 2024-09-12T17:36:59.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.255+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~AW3ZIXGV2LCX.1 size=1048576 2024-09-12T17:36:59.257 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.255+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~AW3ZIXGV2LCX.2 size=945123 2024-09-12T17:36:59.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.259+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=AW3ZIXGV2LCX tag=A5PVYRH219DR type=write size=4090851 2024-09-12T17:36:59.264 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.263+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=WD1L7VIN1N8J type=del size=968209 2024-09-12T17:36:59.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.267+0000 7f1ad43488c0 1 < suggested update operation key=Y3NQLDWQJ37Z tag=NXVRFMQBKQLE type=del size=1108945 2024-09-12T17:36:59.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.275+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~TVZSW22E2UMC.0 size=480808 2024-09-12T17:36:59.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.275+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=TVZSW22E2UMC tag=HQ38LG0SJPBC type=write size=1529384 2024-09-12T17:36:59.278 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.275+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~PRV34F8EVSP0.0 size=484955 2024-09-12T17:36:59.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.283+0000 7f1ad43488c0 1 < completed multipart upload key=7RSHIZRKK2OY upload=PRV34F8EVSP0 tag=XZMLSQHY9VCW type=write size=1533531 2024-09-12T17:36:59.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.287+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=RNU6CXD2MPKM type=del size=4172021 2024-09-12T17:36:59.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.291+0000 7f1ad43488c0 1 < canceled operation key=WFEJLVRCKIUU tag=I6CATZB6WAKX type=write size=308201 2024-09-12T17:36:59.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.295+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=6W46LUURYQEB type=del size=2561960 2024-09-12T17:36:59.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.295+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~L6XG1G2ET98N.0 size=141146 2024-09-12T17:36:59.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.303+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=L6XG1G2ET98N tag=QACCDPQJJQL5 type=write size=1189722 2024-09-12T17:36:59.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.307+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=M5EMLBZ1M75W type=del size=2273741 2024-09-12T17:36:59.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.307+0000 7f1ad43488c0 1 < completed delete operation key=GWJ78NNXOL1R tag=1GBB9NFFC138 type=del 2024-09-12T17:36:59.312 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.311+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=1ZZ3T0RC0MI9 type=del size=1416730 2024-09-12T17:36:59.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.315+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=RK93SBYDRUAF type=del 2024-09-12T17:36:59.318 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.315+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=CEN6O3FZ0GBW type=write size=732533 2024-09-12T17:36:59.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.319+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~I3K2IRO2OHRX.0 size=1048576 2024-09-12T17:36:59.322 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.319+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~I3K2IRO2OHRX.1 size=1048576 2024-09-12T17:36:59.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.323+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~I3K2IRO2OHRX.2 size=1041358 2024-09-12T17:36:59.328 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.327+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=I3K2IRO2OHRX tag=NQ300600SBIX type=write size=4187086 2024-09-12T17:36:59.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.331+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~WLEII0Q1OU15.0 size=1048576 2024-09-12T17:36:59.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.331+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~WLEII0Q1OU15.1 size=292685 2024-09-12T17:36:59.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.331+0000 7f1ad43488c0 1 > prepared multipart upload key=SIZ0Z1KWTGUJ upload=WLEII0Q1OU15 tag=1J5K6IM779EG type=write size=2389837 2024-09-12T17:36:59.337 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.335+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~9KUOP07PH50D.0 size=481658 2024-09-12T17:36:59.342 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.339+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=9KUOP07PH50D tag=SY8U6WXU39Z2 type=write size=1530234 2024-09-12T17:36:59.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.343+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=GJ8CILI3Z2HJ type=del size=533261 2024-09-12T17:36:59.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.347+0000 7f1ad43488c0 1 < completed delete operation key=WWB6LAHAMIR9 tag=6ZWFFK6M4QX7 type=del 2024-09-12T17:36:59.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.351+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~IOAPWVDQTBZQ.0 size=1048576 2024-09-12T17:36:59.354 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.351+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~IOAPWVDQTBZQ.1 size=1048576 2024-09-12T17:36:59.356 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.355+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~IOAPWVDQTBZQ.2 size=312672 2024-09-12T17:36:59.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.355+0000 7f1ad43488c0 1 > prepared multipart upload key=WFEJLVRCKIUU upload=IOAPWVDQTBZQ tag=Y57T7XLV31QX type=write size=3458400 2024-09-12T17:36:59.360 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.359+0000 7f1ad43488c0 1 < canceled operation key=WFEJLVRCKIUU tag=PILQ0YDSDAEO type=del size=269018 2024-09-12T17:36:59.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.363+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~SFIC6AA8PRSL.0 size=805270 2024-09-12T17:36:59.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.363+0000 7f1ad43488c0 1 > prepared multipart upload key=NHOG1WG3VT6N upload=SFIC6AA8PRSL tag=9BMVRZR9597U type=write size=1853846 2024-09-12T17:36:59.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.363+0000 7f1ad43488c0 1 < canceled part key=_multipart_WWB6LAHAMIR9.2~IT8K75BNU0SG.0 size=1048576 2024-09-12T17:36:59.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.367+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~IT8K75BNU0SG.1 size=957558 2024-09-12T17:36:59.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.371+0000 7f1ad43488c0 1 < canceled multipart upload key=WWB6LAHAMIR9 upload=IT8K75BNU0SG tag=C21YFKCESHIO type=write size=3054710 2024-09-12T17:36:59.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.375+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=82XVV9HEN2XT type=write size=798176 2024-09-12T17:36:59.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.383+0000 7f1ad43488c0 1 < suggested update operation key=XOEPYERWY6IT tag=KI8EOTEX1VCR type=del size=3402194 2024-09-12T17:36:59.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.387+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~JYINBUVO5YV6.0 size=1048576 2024-09-12T17:36:59.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.391+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~JYINBUVO5YV6.1 size=897979 2024-09-12T17:36:59.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.391+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=JYINBUVO5YV6 tag=28SFKYMMM4HG type=write size=2995131 2024-09-12T17:36:59.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.395+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~8RV3TKZTFYTH.0 size=666260 2024-09-12T17:36:59.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.399+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=8RV3TKZTFYTH tag=LC4SCE0A0MXC type=write size=1714836 2024-09-12T17:36:59.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.403+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=72QN4XXOIRT9 type=del size=329065 2024-09-12T17:36:59.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.403+0000 7f1ad43488c0 1 < canceled operation key=ECEF8IJGU4Z8 tag=Q0OUVPD1CC9S type=del size=2698995 2024-09-12T17:36:59.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.407+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=CPIZXUNKEN64 type=write size=328462 2024-09-12T17:36:59.412 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.411+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=5U40D34ME7BC type=del 2024-09-12T17:36:59.417 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.415+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~ION4PE0TTL1M.0 size=1048576 2024-09-12T17:36:59.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.419+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~ION4PE0TTL1M.1 size=1048576 2024-09-12T17:36:59.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.419+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~ION4PE0TTL1M.2 size=386339 2024-09-12T17:36:59.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.419+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=ION4PE0TTL1M tag=I5RXV2HJ87BR type=write size=3532067 2024-09-12T17:36:59.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.423+0000 7f1ad43488c0 1 < completed delete operation key=C7QSOK3D3IWJ tag=WD1L7VIN1N8J type=del 2024-09-12T17:36:59.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.427+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=BMVK2LSUHS3K type=del size=3218381 2024-09-12T17:36:59.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.427+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~TVZSW22E2UMC.0 size=480808 2024-09-12T17:36:59.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.435+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=TVZSW22E2UMC tag=HQ38LG0SJPBC type=write size=1529384 2024-09-12T17:36:59.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.439+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~GHDRIM57T211.0 size=827959 2024-09-12T17:36:59.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.439+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=GHDRIM57T211 tag=IWY36ZZQXHXN type=write size=1876535 2024-09-12T17:36:59.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.443+0000 7f1ad43488c0 1 < completed delete operation key=SDJ53NSPOIRC tag=RNU6CXD2MPKM type=del 2024-09-12T17:36:59.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.447+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~4ZHS5NZT0XG9.0 size=1048576 2024-09-12T17:36:59.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.451+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~4ZHS5NZT0XG9.1 size=493092 2024-09-12T17:36:59.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.451+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=4ZHS5NZT0XG9 tag=EYRQWPZGMMR5 type=write size=2590244 2024-09-12T17:36:59.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.451+0000 7f1ad43488c0 1 < canceled operation key=WWB6LAHAMIR9 tag=6W46LUURYQEB type=del size=2561960 2024-09-12T17:36:59.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.459+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~8V6IRWG8KD4G.0 size=1048576 2024-09-12T17:36:59.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.459+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~8V6IRWG8KD4G.1 size=377323 2024-09-12T17:36:59.462 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.459+0000 7f1ad43488c0 1 > prepared multipart upload key=CHMM14VRIOQH upload=8V6IRWG8KD4G tag=W95BM3OG59JY type=write size=2474475 2024-09-12T17:36:59.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.463+0000 7f1ad43488c0 1 < suggested update operation key=BCPDXAL027U2 tag=M5EMLBZ1M75W type=del size=2273741 2024-09-12T17:36:59.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.467+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=AI0YSSYM51GV type=del size=3451000 2024-09-12T17:36:59.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.471+0000 7f1ad43488c0 1 < completed delete operation key=2SDYAQRNWAJK tag=1ZZ3T0RC0MI9 type=del 2024-09-12T17:36:59.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.475+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~IOMV1VLY2UIV.0 size=583517 2024-09-12T17:36:59.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.475+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=IOMV1VLY2UIV tag=6A017UT3VZO2 type=write size=1632093 2024-09-12T17:36:59.483 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.479+0000 7f1ad43488c0 1 < suggested update operation key=PKC1RR4FZWE0 tag=CEN6O3FZ0GBW type=write size=732533 2024-09-12T17:36:59.488 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.487+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~H9GUUJOSR71Q.0 size=1048576 2024-09-12T17:36:59.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.487+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~H9GUUJOSR71Q.1 size=1048576 2024-09-12T17:36:59.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.491+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~H9GUUJOSR71Q.2 size=359493 2024-09-12T17:36:59.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.491+0000 7f1ad43488c0 1 > prepared multipart upload key=RH4HYE315U5Y upload=H9GUUJOSR71Q tag=I9HANPUMX53K type=write size=3505221 2024-09-12T17:36:59.495 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.495+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~WLEII0Q1OU15.0 size=1048576 2024-09-12T17:36:59.495 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.495+0000 7f1ad43488c0 1 < canceled part key=_multipart_SIZ0Z1KWTGUJ.2~WLEII0Q1OU15.1 size=292685 2024-09-12T17:36:59.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.499+0000 7f1ad43488c0 1 < canceled multipart upload key=SIZ0Z1KWTGUJ upload=WLEII0Q1OU15 tag=1J5K6IM779EG type=write size=2389837 2024-09-12T17:36:59.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.503+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=Z2DK7BG0Q7UO type=del size=3739778 2024-09-12T17:36:59.505 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.503+0000 7f1ad43488c0 1 < completed delete operation key=05PAFB226IFP tag=GJ8CILI3Z2HJ type=del 2024-09-12T17:36:59.508 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.507+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=269LNWCSXGB8 type=del size=329919 2024-09-12T17:36:59.511 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.511+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~IOAPWVDQTBZQ.0 size=1048576 2024-09-12T17:36:59.513 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.511+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~IOAPWVDQTBZQ.1 size=1048576 2024-09-12T17:36:59.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.515+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~IOAPWVDQTBZQ.2 size=312672 2024-09-12T17:36:59.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.519+0000 7f1ad43488c0 1 < completed multipart upload key=WFEJLVRCKIUU upload=IOAPWVDQTBZQ tag=Y57T7XLV31QX type=write size=3458400 2024-09-12T17:36:59.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.523+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=9TJLTCI18PJJ type=del size=2858515 2024-09-12T17:36:59.526 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.523+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~SFIC6AA8PRSL.0 size=805270 2024-09-12T17:36:59.532 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.531+0000 7f1ad43488c0 1 < completed multipart upload key=NHOG1WG3VT6N upload=SFIC6AA8PRSL tag=9BMVRZR9597U type=write size=1853846 2024-09-12T17:36:59.538 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.535+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~LXD1YKU8G3D0.0 size=1048576 2024-09-12T17:36:59.540 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.539+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~LXD1YKU8G3D0.1 size=1048576 2024-09-12T17:36:59.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.539+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~LXD1YKU8G3D0.2 size=33934 2024-09-12T17:36:59.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.539+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=LXD1YKU8G3D0 tag=SEVLJKW8BP2Q type=write size=3179662 2024-09-12T17:36:59.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.543+0000 7f1ad43488c0 1 < completed write operation key=GWJ78NNXOL1R tag=82XVV9HEN2XT type=write size=798176 2024-09-12T17:36:59.553 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.551+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~WSNCIVD74OG3.0 size=1048576 2024-09-12T17:36:59.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.555+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~WSNCIVD74OG3.1 size=898693 2024-09-12T17:36:59.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.555+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=WSNCIVD74OG3 tag=36L6LYMM7NM3 type=write size=2995845 2024-09-12T17:36:59.558 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.555+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~JYINBUVO5YV6.0 size=1048576 2024-09-12T17:36:59.558 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.555+0000 7f1ad43488c0 1 < canceled part key=_multipart_PKC1RR4FZWE0.2~JYINBUVO5YV6.1 size=897979 2024-09-12T17:36:59.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.559+0000 7f1ad43488c0 1 < canceled multipart upload key=PKC1RR4FZWE0 upload=JYINBUVO5YV6 tag=28SFKYMMM4HG type=write size=2995131 2024-09-12T17:36:59.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.567+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~HKDD15SUHNRB.0 size=1048576 2024-09-12T17:36:59.573 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.567+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~HKDD15SUHNRB.1 size=1048576 2024-09-12T17:36:59.573 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.571+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~HKDD15SUHNRB.2 size=127427 2024-09-12T17:36:59.573 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.571+0000 7f1ad43488c0 1 > prepared multipart upload key=WFEJLVRCKIUU upload=HKDD15SUHNRB tag=8HXW8KTSICPR type=write size=3273155 2024-09-12T17:36:59.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.575+0000 7f1ad43488c0 1 < suggested remove operation key=GZ7LGZQHW4CY tag=72QN4XXOIRT9 type=del 2024-09-12T17:36:59.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.579+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~DIM9ELWZW8TL.0 size=1048576 2024-09-12T17:36:59.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.583+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~DIM9ELWZW8TL.1 size=642604 2024-09-12T17:36:59.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.583+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=DIM9ELWZW8TL tag=BX93Z8IHDZW3 type=write size=2739756 2024-09-12T17:36:59.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.583+0000 7f1ad43488c0 1 < canceled operation key=SIZ0Z1KWTGUJ tag=CPIZXUNKEN64 type=write size=328462 2024-09-12T17:36:59.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.587+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=KB5D7BQN1NZB type=del size=764731 2024-09-12T17:36:59.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.591+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~ION4PE0TTL1M.0 size=1048576 2024-09-12T17:36:59.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.591+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~ION4PE0TTL1M.1 size=1048576 2024-09-12T17:36:59.595 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.595+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~ION4PE0TTL1M.2 size=386339 2024-09-12T17:36:59.599 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.599+0000 7f1ad43488c0 1 < completed multipart upload key=8U3L46JDJ8VS upload=ION4PE0TTL1M tag=I5RXV2HJ87BR type=write size=3532067 2024-09-12T17:36:59.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.603+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~HHIVRQCA38ME.0 size=1048576 2024-09-12T17:36:59.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.603+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~HHIVRQCA38ME.1 size=1048576 2024-09-12T17:36:59.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.607+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~HHIVRQCA38ME.2 size=80336 2024-09-12T17:36:59.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.607+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=HHIVRQCA38ME tag=1IU84HFP1Z9B type=write size=3226064 2024-09-12T17:36:59.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.607+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=BMVK2LSUHS3K type=del 2024-09-12T17:36:59.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.611+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=1H0VWCKOXLZG type=del size=1959069 2024-09-12T17:36:59.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.615+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~GHDRIM57T211.0 size=827959 2024-09-12T17:36:59.619 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.615+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=GHDRIM57T211 tag=IWY36ZZQXHXN type=write size=1876535 2024-09-12T17:36:59.623 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.623+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~A6T5R4LABDI3.0 size=1048576 2024-09-12T17:36:59.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.623+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~A6T5R4LABDI3.1 size=1048576 2024-09-12T17:36:59.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.623+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~A6T5R4LABDI3.2 size=505980 2024-09-12T17:36:59.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.623+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=A6T5R4LABDI3 tag=1O9N7A4LP7F8 type=write size=3651708 2024-09-12T17:36:59.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.627+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~4ZHS5NZT0XG9.0 size=1048576 2024-09-12T17:36:59.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.631+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~4ZHS5NZT0XG9.1 size=493092 2024-09-12T17:36:59.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.635+0000 7f1ad43488c0 1 < completed multipart upload key=MB3FVGKV0ZNQ upload=4ZHS5NZT0XG9 tag=EYRQWPZGMMR5 type=write size=2590244 2024-09-12T17:36:59.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.635+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=ON3E4H0AFO4P type=write size=1034147 2024-09-12T17:36:59.641 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.639+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~8V6IRWG8KD4G.0 size=1048576 2024-09-12T17:36:59.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.639+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~8V6IRWG8KD4G.1 size=377323 2024-09-12T17:36:59.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.643+0000 7f1ad43488c0 1 < completed multipart upload key=CHMM14VRIOQH upload=8V6IRWG8KD4G tag=W95BM3OG59JY type=write size=2474475 2024-09-12T17:36:59.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.647+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=9E9AHK3WJU8P type=del size=2140998 2024-09-12T17:36:59.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.651+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=AI0YSSYM51GV type=del 2024-09-12T17:36:59.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.655+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~KKT30W4IIF82.0 size=1048576 2024-09-12T17:36:59.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.655+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~KKT30W4IIF82.1 size=1048576 2024-09-12T17:36:59.659 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.659+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~KKT30W4IIF82.2 size=595653 2024-09-12T17:36:59.659 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.659+0000 7f1ad43488c0 1 > prepared multipart upload key=GWJ78NNXOL1R upload=KKT30W4IIF82 tag=7F8QIM7L2VF9 type=write size=3741381 2024-09-12T17:36:59.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.659+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~IOMV1VLY2UIV.0 size=583517 2024-09-12T17:36:59.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.663+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=IOMV1VLY2UIV tag=6A017UT3VZO2 type=write size=1632093 2024-09-12T17:36:59.668 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.667+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=SPGZI6RU8GD1 type=del size=4054533 2024-09-12T17:36:59.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.667+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~H9GUUJOSR71Q.0 size=1048576 2024-09-12T17:36:59.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.671+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~H9GUUJOSR71Q.1 size=1048576 2024-09-12T17:36:59.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.671+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~H9GUUJOSR71Q.2 size=359493 2024-09-12T17:36:59.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.675+0000 7f1ad43488c0 1 < completed multipart upload key=RH4HYE315U5Y upload=H9GUUJOSR71Q tag=I9HANPUMX53K type=write size=3505221 2024-09-12T17:36:59.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.679+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=W1GXSB0LIL0I type=del size=1538718 2024-09-12T17:36:59.683 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.683+0000 7f1ad43488c0 1 < completed delete operation key=XOEPYERWY6IT tag=Z2DK7BG0Q7UO type=del 2024-09-12T17:36:59.686 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.683+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=EHLEWCONJIEK type=del size=129359 2024-09-12T17:36:59.688 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.687+0000 7f1ad43488c0 1 < completed delete operation key=SDJ53NSPOIRC tag=269LNWCSXGB8 type=del 2024-09-12T17:36:59.690 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.687+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=7QGKKLBMWSRL type=del size=3345407 2024-09-12T17:36:59.695 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.695+0000 7f1ad43488c0 1 < suggested update operation key=X0HT3K3OREL7 tag=9TJLTCI18PJJ type=del size=2858515 2024-09-12T17:36:59.698 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.695+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=549SNOOVXPHI type=write size=184458 2024-09-12T17:36:59.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.699+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~LXD1YKU8G3D0.0 size=1048576 2024-09-12T17:36:59.704 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.703+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~LXD1YKU8G3D0.1 size=1048576 2024-09-12T17:36:59.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.703+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~LXD1YKU8G3D0.2 size=33934 2024-09-12T17:36:59.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.707+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=LXD1YKU8G3D0 tag=SEVLJKW8BP2Q type=write size=3179662 2024-09-12T17:36:59.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.715+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~INIWWFI6IQQL.0 size=1048576 2024-09-12T17:36:59.717 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.715+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~INIWWFI6IQQL.1 size=184360 2024-09-12T17:36:59.717 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.715+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=INIWWFI6IQQL tag=FNFO3F92H0NR type=write size=2281512 2024-09-12T17:36:59.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.719+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~WSNCIVD74OG3.0 size=1048576 2024-09-12T17:36:59.722 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.719+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~WSNCIVD74OG3.1 size=898693 2024-09-12T17:36:59.726 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.723+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=WSNCIVD74OG3 tag=36L6LYMM7NM3 type=write size=2995845 2024-09-12T17:36:59.729 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.727+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=C5SW3VONBA93 type=write size=1013579 2024-09-12T17:36:59.731 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.731+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~HKDD15SUHNRB.0 size=1048576 2024-09-12T17:36:59.733 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.731+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~HKDD15SUHNRB.1 size=1048576 2024-09-12T17:36:59.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.731+0000 7f1ad43488c0 1 < canceled part key=_multipart_WFEJLVRCKIUU.2~HKDD15SUHNRB.2 size=127427 2024-09-12T17:36:59.738 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.735+0000 7f1ad43488c0 1 < canceled multipart upload key=WFEJLVRCKIUU upload=HKDD15SUHNRB tag=8HXW8KTSICPR type=write size=3273155 2024-09-12T17:36:59.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.739+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~EFQ2CRQ76ZH3.0 size=1048576 2024-09-12T17:36:59.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.743+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~EFQ2CRQ76ZH3.1 size=1048576 2024-09-12T17:36:59.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.747+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~EFQ2CRQ76ZH3.2 size=543271 2024-09-12T17:36:59.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.747+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=EFQ2CRQ76ZH3 tag=K2IXKABAI8X2 type=write size=3688999 2024-09-12T17:36:59.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.747+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~DIM9ELWZW8TL.0 size=1048576 2024-09-12T17:36:59.753 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.751+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~DIM9ELWZW8TL.1 size=642604 2024-09-12T17:36:59.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.755+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=DIM9ELWZW8TL tag=BX93Z8IHDZW3 type=write size=2739756 2024-09-12T17:36:59.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.759+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=L9P1P2MOI8CP type=del size=3713096 2024-09-12T17:36:59.763 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.759+0000 7f1ad43488c0 1 < completed delete operation key=PKC1RR4FZWE0 tag=KB5D7BQN1NZB type=del 2024-09-12T17:36:59.767 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.767+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~1T2AWUWAP1AQ.0 size=1048576 2024-09-12T17:36:59.769 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.767+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~1T2AWUWAP1AQ.1 size=478552 2024-09-12T17:36:59.769 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.767+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=1T2AWUWAP1AQ tag=MEG3DIFCRTK2 type=write size=2575704 2024-09-12T17:36:59.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.771+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~HHIVRQCA38ME.0 size=1048576 2024-09-12T17:36:59.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.771+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~HHIVRQCA38ME.1 size=1048576 2024-09-12T17:36:59.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.775+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~HHIVRQCA38ME.2 size=80336 2024-09-12T17:36:59.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.783+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=HHIVRQCA38ME tag=1IU84HFP1Z9B type=write size=3226064 2024-09-12T17:36:59.787 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.787+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~ENL6KOFZCI5Z.0 size=1005646 2024-09-12T17:36:59.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.787+0000 7f1ad43488c0 1 > prepared multipart upload key=C7QSOK3D3IWJ upload=ENL6KOFZCI5Z tag=D50GI579AH4B type=write size=2054222 2024-09-12T17:36:59.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.787+0000 7f1ad43488c0 1 < completed delete operation key=PKC1RR4FZWE0 tag=1H0VWCKOXLZG type=del 2024-09-12T17:36:59.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.791+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~5984VG634OZ1.0 size=1048576 2024-09-12T17:36:59.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.795+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~5984VG634OZ1.1 size=250012 2024-09-12T17:36:59.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.795+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=5984VG634OZ1 tag=NOWZHHGV07AE type=write size=2347164 2024-09-12T17:36:59.799 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.799+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~A6T5R4LABDI3.0 size=1048576 2024-09-12T17:36:59.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.799+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~A6T5R4LABDI3.1 size=1048576 2024-09-12T17:36:59.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.803+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~A6T5R4LABDI3.2 size=505980 2024-09-12T17:36:59.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.807+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=A6T5R4LABDI3 tag=1O9N7A4LP7F8 type=write size=3651708 2024-09-12T17:36:59.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.811+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~Z5SMNZGKJ283.0 size=1048576 2024-09-12T17:36:59.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.815+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~Z5SMNZGKJ283.1 size=1048576 2024-09-12T17:36:59.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.815+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~Z5SMNZGKJ283.2 size=476300 2024-09-12T17:36:59.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.815+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=Z5SMNZGKJ283 tag=ZI30OVS0BZ84 type=write size=3622028 2024-09-12T17:36:59.822 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.819+0000 7f1ad43488c0 1 < completed write operation key=SDJ53NSPOIRC tag=ON3E4H0AFO4P type=write size=1034147 2024-09-12T17:36:59.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.827+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~0UA7U5B26AUH.0 size=1048576 2024-09-12T17:36:59.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.827+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~0UA7U5B26AUH.1 size=112061 2024-09-12T17:36:59.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.827+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=0UA7U5B26AUH tag=3J22A90A6UY0 type=write size=2209213 2024-09-12T17:36:59.835 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.835+0000 7f1ad43488c0 1 < suggested remove operation key=SDJ53NSPOIRC tag=9E9AHK3WJU8P type=del 2024-09-12T17:36:59.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.839+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~T31CIFCTQFLK.0 size=1048576 2024-09-12T17:36:59.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.839+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~T31CIFCTQFLK.1 size=624018 2024-09-12T17:36:59.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.839+0000 7f1ad43488c0 1 > prepared multipart upload key=ZHFRKX9YY8P5 upload=T31CIFCTQFLK tag=16LTLIQ3JMY3 type=write size=2721170 2024-09-12T17:36:59.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.843+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~KKT30W4IIF82.0 size=1048576 2024-09-12T17:36:59.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.843+0000 7f1ad43488c0 1 < canceled part key=_multipart_GWJ78NNXOL1R.2~KKT30W4IIF82.1 size=1048576 2024-09-12T17:36:59.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.847+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~KKT30W4IIF82.2 size=595653 2024-09-12T17:36:59.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.851+0000 7f1ad43488c0 1 < canceled multipart upload key=GWJ78NNXOL1R upload=KKT30W4IIF82 tag=7F8QIM7L2VF9 type=write size=3741381 2024-09-12T17:36:59.856 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.855+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=3L65ZDX5XAWJ type=del size=941495 2024-09-12T17:36:59.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.859+0000 7f1ad43488c0 1 < suggested remove operation key=RXJJOPR32OD5 tag=SPGZI6RU8GD1 type=del 2024-09-12T17:36:59.864 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.863+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=H6YXTYG81955 type=del size=123893 2024-09-12T17:36:59.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.863+0000 7f1ad43488c0 1 < completed delete operation key=2SDYAQRNWAJK tag=W1GXSB0LIL0I type=del 2024-09-12T17:36:59.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.867+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=TQKR3UY68GQB type=del size=1737435 2024-09-12T17:36:59.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.871+0000 7f1ad43488c0 1 < completed delete operation key=WWB6LAHAMIR9 tag=EHLEWCONJIEK type=del 2024-09-12T17:36:59.878 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.875+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~O1BF1IEV2ZVX.0 size=1048576 2024-09-12T17:36:59.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.879+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~O1BF1IEV2ZVX.1 size=803776 2024-09-12T17:36:59.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.879+0000 7f1ad43488c0 1 > prepared multipart upload key=GWJ78NNXOL1R upload=O1BF1IEV2ZVX tag=MA3IZ76K0YKW type=write size=2900928 2024-09-12T17:36:59.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.879+0000 7f1ad43488c0 1 < completed delete operation key=05PAFB226IFP tag=7QGKKLBMWSRL type=del 2024-09-12T17:36:59.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.883+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=I6XJ1Y7X7NC4 type=del size=3781924 2024-09-12T17:36:59.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.887+0000 7f1ad43488c0 1 < completed write operation key=SIZ0Z1KWTGUJ tag=549SNOOVXPHI type=write size=184458 2024-09-12T17:36:59.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.891+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=SLV8V2L17876 type=write size=622008 2024-09-12T17:36:59.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.895+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~INIWWFI6IQQL.0 size=1048576 2024-09-12T17:36:59.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.895+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~INIWWFI6IQQL.1 size=184360 2024-09-12T17:36:59.902 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.899+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=INIWWFI6IQQL tag=FNFO3F92H0NR type=write size=2281512 2024-09-12T17:36:59.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.907+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~0IUOI3CP3AM2.0 size=1048576 2024-09-12T17:36:59.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.907+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~0IUOI3CP3AM2.1 size=132787 2024-09-12T17:36:59.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.907+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=0IUOI3CP3AM2 tag=6PTOYQ63IGA1 type=write size=2229939 2024-09-12T17:36:59.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.915+0000 7f1ad43488c0 1 < suggested update operation key=SIZ0Z1KWTGUJ tag=C5SW3VONBA93 type=write size=1013579 2024-09-12T17:36:59.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.919+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~D6PVPUFAF4Y4.0 size=1048576 2024-09-12T17:36:59.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.923+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~D6PVPUFAF4Y4.1 size=738571 2024-09-12T17:36:59.926 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.923+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=D6PVPUFAF4Y4 tag=91ZZ8791JPNU type=write size=2835723 2024-09-12T17:36:59.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.927+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~EFQ2CRQ76ZH3.0 size=1048576 2024-09-12T17:36:59.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.931+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~EFQ2CRQ76ZH3.1 size=1048576 2024-09-12T17:36:59.934 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.931+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~EFQ2CRQ76ZH3.2 size=543271 2024-09-12T17:36:59.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.939+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=EFQ2CRQ76ZH3 tag=K2IXKABAI8X2 type=write size=3688999 2024-09-12T17:36:59.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.939+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=GWY8LZ1B6I5K type=del size=4097687 2024-09-12T17:36:59.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.943+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=L9P1P2MOI8CP type=del 2024-09-12T17:36:59.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.947+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=E0C3LJ43WUPT type=del size=4125056 2024-09-12T17:36:59.952 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.951+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~1T2AWUWAP1AQ.0 size=1048576 2024-09-12T17:36:59.955 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.955+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~1T2AWUWAP1AQ.1 size=478552 2024-09-12T17:36:59.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.959+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=1T2AWUWAP1AQ tag=MEG3DIFCRTK2 type=write size=2575704 2024-09-12T17:36:59.967 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.963+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~252CX902VAEZ.0 size=1048576 2024-09-12T17:36:59.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.967+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~252CX902VAEZ.1 size=602651 2024-09-12T17:36:59.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.967+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=252CX902VAEZ tag=5XFZ4RRC9E0M type=write size=2699803 2024-09-12T17:36:59.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.971+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~ENL6KOFZCI5Z.0 size=1005646 2024-09-12T17:36:59.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.975+0000 7f1ad43488c0 1 < completed multipart upload key=C7QSOK3D3IWJ upload=ENL6KOFZCI5Z tag=D50GI579AH4B type=write size=2054222 2024-09-12T17:36:59.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.979+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=RTJ5VAW1TWF6 type=del size=937749 2024-09-12T17:36:59.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.983+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~5984VG634OZ1.0 size=1048576 2024-09-12T17:36:59.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.983+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~5984VG634OZ1.1 size=250012 2024-09-12T17:36:59.991 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.991+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=5984VG634OZ1 tag=NOWZHHGV07AE type=write size=2347164 2024-09-12T17:36:59.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.995+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~8H5JMV6Y69YY.0 size=1048576 2024-09-12T17:37:00.000 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.999+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~8H5JMV6Y69YY.1 size=994614 2024-09-12T17:37:00.000 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:36:59.999+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=8H5JMV6Y69YY tag=4A1EKBC7NCUJ type=write size=3091766 2024-09-12T17:37:00.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.003+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~Z5SMNZGKJ283.0 size=1048576 2024-09-12T17:37:00.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.003+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~Z5SMNZGKJ283.1 size=1048576 2024-09-12T17:37:00.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.007+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~Z5SMNZGKJ283.2 size=476300 2024-09-12T17:37:00.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.011+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=Z5SMNZGKJ283 tag=ZI30OVS0BZ84 type=write size=3622028 2024-09-12T17:37:00.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.019+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~PVB0900M3QJE.0 size=1048576 2024-09-12T17:37:00.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.019+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~PVB0900M3QJE.1 size=652299 2024-09-12T17:37:00.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.019+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=PVB0900M3QJE tag=0D4VHRFBKL01 type=write size=2749451 2024-09-12T17:37:00.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.023+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~0UA7U5B26AUH.0 size=1048576 2024-09-12T17:37:00.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.027+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~0UA7U5B26AUH.1 size=112061 2024-09-12T17:37:00.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.031+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=0UA7U5B26AUH tag=3J22A90A6UY0 type=write size=2209213 2024-09-12T17:37:00.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.031+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=KCDE4M4BPMOC type=del size=2297815 2024-09-12T17:37:00.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.035+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~T31CIFCTQFLK.0 size=1048576 2024-09-12T17:37:00.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.039+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~T31CIFCTQFLK.1 size=624018 2024-09-12T17:37:00.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.043+0000 7f1ad43488c0 1 < completed multipart upload key=ZHFRKX9YY8P5 upload=T31CIFCTQFLK tag=16LTLIQ3JMY3 type=write size=2721170 2024-09-12T17:37:00.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.047+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=DDZMKSJQQHB0 type=del size=3458829 2024-09-12T17:37:00.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.051+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=3L65ZDX5XAWJ type=del 2024-09-12T17:37:00.058 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.055+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=I9XYB0KEXE1T type=del size=2691072 2024-09-12T17:37:00.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.059+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=H6YXTYG81955 type=del 2024-09-12T17:37:00.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.067+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~ITA1PVJA7YDP.0 size=370909 2024-09-12T17:37:00.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.067+0000 7f1ad43488c0 1 > prepared multipart upload key=3N1YT9TC0M3O upload=ITA1PVJA7YDP tag=410R6BJRTX2S type=write size=1419485 2024-09-12T17:37:00.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.067+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=TQKR3UY68GQB type=del 2024-09-12T17:37:00.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.071+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=FFDS72V1MFF2 type=del size=3296498 2024-09-12T17:37:00.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.075+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~O1BF1IEV2ZVX.0 size=1048576 2024-09-12T17:37:00.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.075+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~O1BF1IEV2ZVX.1 size=803776 2024-09-12T17:37:00.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.079+0000 7f1ad43488c0 1 < completed multipart upload key=GWJ78NNXOL1R upload=O1BF1IEV2ZVX tag=MA3IZ76K0YKW type=write size=2900928 2024-09-12T17:37:00.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.087+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~OXJD2URYRN5S.0 size=1048576 2024-09-12T17:37:00.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.087+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~OXJD2URYRN5S.1 size=1048576 2024-09-12T17:37:00.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.091+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~OXJD2URYRN5S.2 size=168281 2024-09-12T17:37:00.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.091+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=OXJD2URYRN5S tag=X63ID3WD1EYO type=write size=3314009 2024-09-12T17:37:00.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.091+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=I6XJ1Y7X7NC4 type=del 2024-09-12T17:37:00.096 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.095+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=NH3ISBCNVUDI type=del size=456775 2024-09-12T17:37:00.098 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.095+0000 7f1ad43488c0 1 < completed write operation key=3N1YT9TC0M3O tag=SLV8V2L17876 type=write size=622008 2024-09-12T17:37:00.100 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.099+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=ZJJ23QPHVMN2 type=del size=3590707 2024-09-12T17:37:00.103 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.103+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~0IUOI3CP3AM2.0 size=1048576 2024-09-12T17:37:00.105 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.103+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~0IUOI3CP3AM2.1 size=132787 2024-09-12T17:37:00.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.107+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=0IUOI3CP3AM2 tag=6PTOYQ63IGA1 type=write size=2229939 2024-09-12T17:37:00.111 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.111+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=DGMFIF7KXDLI type=del size=715766 2024-09-12T17:37:00.114 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.111+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~D6PVPUFAF4Y4.0 size=1048576 2024-09-12T17:37:00.114 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.111+0000 7f1ad43488c0 1 < canceled part key=_multipart_7RSHIZRKK2OY.2~D6PVPUFAF4Y4.1 size=738571 2024-09-12T17:37:00.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.115+0000 7f1ad43488c0 1 < canceled multipart upload key=7RSHIZRKK2OY upload=D6PVPUFAF4Y4 tag=91ZZ8791JPNU type=write size=2835723 2024-09-12T17:37:00.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.119+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=NMN3BZ7SJOJ5 type=del size=505110 2024-09-12T17:37:00.122 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.119+0000 7f1ad43488c0 1 < canceled operation key=WWB6LAHAMIR9 tag=GWY8LZ1B6I5K type=del size=4097687 2024-09-12T17:37:00.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.127+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~BLPJ9E9QGJSZ.0 size=177145 2024-09-12T17:37:00.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.127+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=BLPJ9E9QGJSZ tag=CSOFKM73AAIE type=write size=1225721 2024-09-12T17:37:00.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.127+0000 7f1ad43488c0 1 < completed delete operation key=ZHFRKX9YY8P5 tag=E0C3LJ43WUPT type=del 2024-09-12T17:37:00.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.131+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=2C4I1X8ZPPLB type=write size=670847 2024-09-12T17:37:00.136 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.135+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~252CX902VAEZ.0 size=1048576 2024-09-12T17:37:00.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.135+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~252CX902VAEZ.1 size=602651 2024-09-12T17:37:00.141 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.139+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=252CX902VAEZ tag=5XFZ4RRC9E0M type=write size=2699803 2024-09-12T17:37:00.143 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.143+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=Y7MNMK2GI8NX type=del size=1050786 2024-09-12T17:37:00.145 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.143+0000 7f1ad43488c0 1 < completed delete operation key=NHOG1WG3VT6N tag=RTJ5VAW1TWF6 type=del 2024-09-12T17:37:00.147 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.147+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=ZZUO4FRG9I80 type=del size=2948969 2024-09-12T17:37:00.150 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.147+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~8H5JMV6Y69YY.0 size=1048576 2024-09-12T17:37:00.151 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.151+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~8H5JMV6Y69YY.1 size=994614 2024-09-12T17:37:00.154 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.151+0000 7f1ad43488c0 1 < completed multipart upload key=IY2AM7CJDUZG upload=8H5JMV6Y69YY tag=4A1EKBC7NCUJ type=write size=3091766 2024-09-12T17:37:00.157 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.155+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=KFXMLQGZW40B type=write size=41397 2024-09-12T17:37:00.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.159+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~PVB0900M3QJE.0 size=1048576 2024-09-12T17:37:00.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.159+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~PVB0900M3QJE.1 size=652299 2024-09-12T17:37:00.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.163+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=PVB0900M3QJE tag=0D4VHRFBKL01 type=write size=2749451 2024-09-12T17:37:00.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.163+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=NHAVSNT0E1PA type=write size=726541 2024-09-12T17:37:00.169 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.167+0000 7f1ad43488c0 1 < completed delete operation key=GWJ78NNXOL1R tag=KCDE4M4BPMOC type=del 2024-09-12T17:37:00.173 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.171+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~9WGY5BWXAGMP.0 size=1048576 2024-09-12T17:37:00.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.171+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~9WGY5BWXAGMP.1 size=1048576 2024-09-12T17:37:00.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.175+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~9WGY5BWXAGMP.2 size=965358 2024-09-12T17:37:00.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.175+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=9WGY5BWXAGMP tag=CUGJMF3VD6QS type=write size=4111086 2024-09-12T17:37:00.179 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.179+0000 7f1ad43488c0 1 < completed delete operation key=WWB6LAHAMIR9 tag=DDZMKSJQQHB0 type=del 2024-09-12T17:37:00.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.179+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~42CNN2DNUTML.0 size=653037 2024-09-12T17:37:00.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.179+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=42CNN2DNUTML tag=3GN7VQSMX7ES type=write size=1701613 2024-09-12T17:37:00.187 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.183+0000 7f1ad43488c0 1 < suggested remove operation key=ECEF8IJGU4Z8 tag=I9XYB0KEXE1T type=del 2024-09-12T17:37:00.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.187+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=O2JGP1P3VIEA type=write size=959741 2024-09-12T17:37:00.191 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.191+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~ITA1PVJA7YDP.0 size=370909 2024-09-12T17:37:00.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.191+0000 7f1ad43488c0 1 < completed multipart upload key=3N1YT9TC0M3O upload=ITA1PVJA7YDP tag=410R6BJRTX2S type=write size=1419485 2024-09-12T17:37:00.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.195+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~KNXEBZCIT8Y4.0 size=1048576 2024-09-12T17:37:00.200 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.199+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~KNXEBZCIT8Y4.1 size=915818 2024-09-12T17:37:00.200 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.199+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=KNXEBZCIT8Y4 tag=5XZV8MPC1T2I type=write size=3012970 2024-09-12T17:37:00.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.199+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=FFDS72V1MFF2 type=del 2024-09-12T17:37:00.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.203+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~N66PQQ7YAIOU.0 size=1048576 2024-09-12T17:37:00.208 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.207+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~N66PQQ7YAIOU.1 size=538775 2024-09-12T17:37:00.208 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.207+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=N66PQQ7YAIOU tag=CAI52IC2A1EX type=write size=2635927 2024-09-12T17:37:00.211 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.207+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~OXJD2URYRN5S.0 size=1048576 2024-09-12T17:37:00.212 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.211+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~OXJD2URYRN5S.1 size=1048576 2024-09-12T17:37:00.214 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.211+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~OXJD2URYRN5S.2 size=168281 2024-09-12T17:37:00.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.215+0000 7f1ad43488c0 1 < completed multipart upload key=MB3FVGKV0ZNQ upload=OXJD2URYRN5S tag=X63ID3WD1EYO type=write size=3314009 2024-09-12T17:37:00.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.219+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=A9AJX503MOC8 type=del size=2968306 2024-09-12T17:37:00.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.223+0000 7f1ad43488c0 1 < canceled operation key=9Z2EHQA8T5F4 tag=NH3ISBCNVUDI type=del size=456775 2024-09-12T17:37:00.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.223+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=B7AAQEIZYBYA type=del size=2760480 2024-09-12T17:37:00.227 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.227+0000 7f1ad43488c0 1 < completed delete operation key=ZHFRKX9YY8P5 tag=ZJJ23QPHVMN2 type=del 2024-09-12T17:37:00.229 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.227+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=3RQ174ONCE6H type=del size=2257681 2024-09-12T17:37:00.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.227+0000 7f1ad43488c0 1 < canceled operation key=3N1YT9TC0M3O tag=DGMFIF7KXDLI type=del size=715766 2024-09-12T17:37:00.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.231+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=SQTPWGEC6VML type=del size=439506 2024-09-12T17:37:00.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.231+0000 7f1ad43488c0 1 < completed delete operation key=IY2AM7CJDUZG tag=NMN3BZ7SJOJ5 type=del 2024-09-12T17:37:00.236 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.235+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=RLEYMWUGEJ03 type=write size=944918 2024-09-12T17:37:00.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.235+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~BLPJ9E9QGJSZ.0 size=177145 2024-09-12T17:37:00.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.239+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=BLPJ9E9QGJSZ tag=CSOFKM73AAIE type=write size=1225721 2024-09-12T17:37:00.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.243+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=251UNT97P3C2 type=del size=2108985 2024-09-12T17:37:00.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.243+0000 7f1ad43488c0 1 < completed write operation key=RXJJOPR32OD5 tag=2C4I1X8ZPPLB type=write size=670847 2024-09-12T17:37:00.248 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.247+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~N3Z8P4P9GUCQ.0 size=1048576 2024-09-12T17:37:00.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.247+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~N3Z8P4P9GUCQ.1 size=904864 2024-09-12T17:37:00.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.247+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=N3Z8P4P9GUCQ tag=XXWC3UNTWTXC type=write size=3002016 2024-09-12T17:37:00.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.251+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=Y7MNMK2GI8NX type=del 2024-09-12T17:37:00.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.255+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~QRWRQBTNU1RC.0 size=1042777 2024-09-12T17:37:00.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.255+0000 7f1ad43488c0 1 > prepared multipart upload key=Y3NQLDWQJ37Z upload=QRWRQBTNU1RC tag=BJRV27MQS7FE type=write size=2091353 2024-09-12T17:37:00.257 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.255+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=ZZUO4FRG9I80 type=del 2024-09-12T17:37:00.259 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.259+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=WQUXDRTHE324 type=del size=12181 2024-09-12T17:37:00.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.259+0000 7f1ad43488c0 1 < completed write operation key=C7QSOK3D3IWJ tag=KFXMLQGZW40B type=write size=41397 2024-09-12T17:37:00.263 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.259+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=8GBYEAF2SX46 type=del size=2186989 2024-09-12T17:37:00.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.263+0000 7f1ad43488c0 1 < completed write operation key=PKC1RR4FZWE0 tag=NHAVSNT0E1PA type=write size=726541 2024-09-12T17:37:00.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.267+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=MCHAL7188FUR type=del size=389100 2024-09-12T17:37:00.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.271+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~9WGY5BWXAGMP.0 size=1048576 2024-09-12T17:37:00.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.271+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~9WGY5BWXAGMP.1 size=1048576 2024-09-12T17:37:00.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.271+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~9WGY5BWXAGMP.2 size=965358 2024-09-12T17:37:00.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.275+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=9WGY5BWXAGMP tag=CUGJMF3VD6QS type=write size=4111086 2024-09-12T17:37:00.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.279+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=IRPI6471OJEN type=write size=842655 2024-09-12T17:37:00.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.279+0000 7f1ad43488c0 1 < canceled part key=_multipart_2SDYAQRNWAJK.2~42CNN2DNUTML.0 size=653037 2024-09-12T17:37:00.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.283+0000 7f1ad43488c0 1 < canceled multipart upload key=2SDYAQRNWAJK upload=42CNN2DNUTML tag=3GN7VQSMX7ES type=write size=1701613 2024-09-12T17:37:00.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.287+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~55I3479NW9ZL.0 size=1048576 2024-09-12T17:37:00.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.287+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~55I3479NW9ZL.1 size=1048576 2024-09-12T17:37:00.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.291+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~55I3479NW9ZL.2 size=790644 2024-09-12T17:37:00.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.291+0000 7f1ad43488c0 1 > prepared multipart upload key=CHMM14VRIOQH upload=55I3479NW9ZL tag=5ZTE7ZXTZ7XN type=write size=3936372 2024-09-12T17:37:00.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.291+0000 7f1ad43488c0 1 < completed write operation key=SIZ0Z1KWTGUJ tag=O2JGP1P3VIEA type=write size=959741 2024-09-12T17:37:00.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.295+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~1LS3RNJC4K0D.0 size=1048576 2024-09-12T17:37:00.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.299+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~1LS3RNJC4K0D.1 size=1048576 2024-09-12T17:37:00.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.299+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~1LS3RNJC4K0D.2 size=954196 2024-09-12T17:37:00.301 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.299+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=1LS3RNJC4K0D tag=42N8NW3WF1IP type=write size=4099924 2024-09-12T17:37:00.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.299+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~KNXEBZCIT8Y4.0 size=1048576 2024-09-12T17:37:00.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.303+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~KNXEBZCIT8Y4.1 size=915818 2024-09-12T17:37:00.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.307+0000 7f1ad43488c0 1 < completed multipart upload key=7RSHIZRKK2OY upload=KNXEBZCIT8Y4 tag=5XZV8MPC1T2I type=write size=3012970 2024-09-12T17:37:00.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.307+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~TGAVG8JMTVO2.0 size=651137 2024-09-12T17:37:00.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.307+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=TGAVG8JMTVO2 tag=YTZ9DNV43PZI type=write size=1699713 2024-09-12T17:37:00.312 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.311+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~N66PQQ7YAIOU.0 size=1048576 2024-09-12T17:37:00.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.311+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~N66PQQ7YAIOU.1 size=538775 2024-09-12T17:37:00.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.315+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=N66PQQ7YAIOU tag=CAI52IC2A1EX type=write size=2635927 2024-09-12T17:37:00.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.319+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=JANU7G344LRX type=del size=3265899 2024-09-12T17:37:00.323 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.323+0000 7f1ad43488c0 1 < suggested remove operation key=PKC1RR4FZWE0 tag=A9AJX503MOC8 type=del 2024-09-12T17:37:00.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.323+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~YA7AAXFO6XUW.0 size=1048576 2024-09-12T17:37:00.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.327+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~YA7AAXFO6XUW.1 size=1048576 2024-09-12T17:37:00.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.327+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~YA7AAXFO6XUW.2 size=584692 2024-09-12T17:37:00.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.327+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=YA7AAXFO6XUW tag=T8T8Z6580OR9 type=write size=3730420 2024-09-12T17:37:00.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.327+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=B7AAQEIZYBYA type=del 2024-09-12T17:37:00.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.331+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=8DV20GQN8YOO type=del size=1942842 2024-09-12T17:37:00.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.331+0000 7f1ad43488c0 1 < completed delete operation key=ECEF8IJGU4Z8 tag=3RQ174ONCE6H type=del 2024-09-12T17:37:00.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.335+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=K888PU6WP3MN type=del size=4035616 2024-09-12T17:37:00.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.335+0000 7f1ad43488c0 1 < completed delete operation key=WFEJLVRCKIUU tag=SQTPWGEC6VML type=del 2024-09-12T17:37:00.340 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.339+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=TRD5U8KXXQTX type=del size=3626455 2024-09-12T17:37:00.343 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.343+0000 7f1ad43488c0 1 < suggested update operation key=C7QSOK3D3IWJ tag=RLEYMWUGEJ03 type=write size=944918 2024-09-12T17:37:00.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.343+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=6P070DBZ55RF type=del size=403545 2024-09-12T17:37:00.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.347+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=251UNT97P3C2 type=del 2024-09-12T17:37:00.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.347+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~MGYFF3O32RQO.0 size=1048576 2024-09-12T17:37:00.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.351+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~MGYFF3O32RQO.1 size=1048576 2024-09-12T17:37:00.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.351+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~MGYFF3O32RQO.2 size=683140 2024-09-12T17:37:00.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.351+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=MGYFF3O32RQO tag=C7O0RZ7C7DSC type=write size=3828868 2024-09-12T17:37:00.355 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.355+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~N3Z8P4P9GUCQ.0 size=1048576 2024-09-12T17:37:00.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.355+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~N3Z8P4P9GUCQ.1 size=904864 2024-09-12T17:37:00.360 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.359+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=N3Z8P4P9GUCQ tag=XXWC3UNTWTXC type=write size=3002016 2024-09-12T17:37:00.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.359+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~H36FPUSH04D7.0 size=705245 2024-09-12T17:37:00.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.359+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=H36FPUSH04D7 tag=LJGBKSFA026Q type=write size=1753821 2024-09-12T17:37:00.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.363+0000 7f1ad43488c0 1 < canceled part key=_multipart_Y3NQLDWQJ37Z.2~QRWRQBTNU1RC.0 size=1042777 2024-09-12T17:37:00.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.363+0000 7f1ad43488c0 1 < canceled multipart upload key=Y3NQLDWQJ37Z upload=QRWRQBTNU1RC tag=BJRV27MQS7FE type=write size=2091353 2024-09-12T17:37:00.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.367+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=7QDWEKZCF7TW type=del size=2357355 2024-09-12T17:37:00.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.367+0000 7f1ad43488c0 1 < completed delete operation key=XOEPYERWY6IT tag=WQUXDRTHE324 type=del 2024-09-12T17:37:00.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.371+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=3XLFM4IQLMK4 type=del size=1877857 2024-09-12T17:37:00.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.371+0000 7f1ad43488c0 1 < canceled operation key=CHMM14VRIOQH tag=8GBYEAF2SX46 type=del size=2186989 2024-09-12T17:37:00.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.375+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=JLAQOYSTLQ38 type=del size=1791927 2024-09-12T17:37:00.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.375+0000 7f1ad43488c0 -1 < failed to complete operation key=PKC1RR4FZWE0 tag=MCHAL7188FUR type=del size=389100: (22) Invalid argument 2024-09-12T17:37:00.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.379+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~AYYTLAQU1W7Y.0 size=1048576 2024-09-12T17:37:00.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.379+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~AYYTLAQU1W7Y.1 size=1048576 2024-09-12T17:37:00.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.383+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~AYYTLAQU1W7Y.2 size=925261 2024-09-12T17:37:00.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.383+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=AYYTLAQU1W7Y tag=UPG0RTII2LVV type=write size=4070989 2024-09-12T17:37:00.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.383+0000 7f1ad43488c0 1 < canceled operation key=X0HT3K3OREL7 tag=IRPI6471OJEN type=write size=842655 2024-09-12T17:37:00.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.387+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=A51KYLEX2MK0 type=del size=1073667 2024-09-12T17:37:00.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.387+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~55I3479NW9ZL.0 size=1048576 2024-09-12T17:37:00.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.391+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~55I3479NW9ZL.1 size=1048576 2024-09-12T17:37:00.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.391+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~55I3479NW9ZL.2 size=790644 2024-09-12T17:37:00.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.395+0000 7f1ad43488c0 1 < completed multipart upload key=CHMM14VRIOQH upload=55I3479NW9ZL tag=5ZTE7ZXTZ7XN type=write size=3936372 2024-09-12T17:37:00.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.399+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~1NBTMA9SQ2M4.0 size=1048576 2024-09-12T17:37:00.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.403+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~1NBTMA9SQ2M4.1 size=1048576 2024-09-12T17:37:00.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.403+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~1NBTMA9SQ2M4.2 size=1044054 2024-09-12T17:37:00.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.403+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=1NBTMA9SQ2M4 tag=LT1YZSA7UKLG type=write size=4189782 2024-09-12T17:37:00.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.403+0000 7f1ad43488c0 1 < canceled part key=_multipart_X078SB1ITNII.2~1LS3RNJC4K0D.0 size=1048576 2024-09-12T17:37:00.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.403+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~1LS3RNJC4K0D.1 size=1048576 2024-09-12T17:37:00.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.407+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~1LS3RNJC4K0D.2 size=954196 2024-09-12T17:37:00.412 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.411+0000 7f1ad43488c0 1 < canceled multipart upload key=X078SB1ITNII upload=1LS3RNJC4K0D tag=42N8NW3WF1IP type=write size=4099924 2024-09-12T17:37:00.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.411+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=0HGTP3BUJUNO type=write size=443563 2024-09-12T17:37:00.416 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.415+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~TGAVG8JMTVO2.0 size=651137 2024-09-12T17:37:00.420 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.419+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=TGAVG8JMTVO2 tag=YTZ9DNV43PZI type=write size=1699713 2024-09-12T17:37:00.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.419+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=T0L5ZZEFTHXV type=del size=385994 2024-09-12T17:37:00.424 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.423+0000 7f1ad43488c0 1 < completed delete operation key=NHOG1WG3VT6N tag=JANU7G344LRX type=del 2024-09-12T17:37:00.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.423+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=JQRTNRF2AMN0 type=del size=185765 2024-09-12T17:37:00.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.427+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~YA7AAXFO6XUW.0 size=1048576 2024-09-12T17:37:00.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.427+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~YA7AAXFO6XUW.1 size=1048576 2024-09-12T17:37:00.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.431+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~YA7AAXFO6XUW.2 size=584692 2024-09-12T17:37:00.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.435+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=YA7AAXFO6XUW tag=T8T8Z6580OR9 type=write size=3730420 2024-09-12T17:37:00.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.435+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=5P10EXIBPNE0 type=del size=1325560 2024-09-12T17:37:00.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.439+0000 7f1ad43488c0 1 < suggested remove operation key=SIZ0Z1KWTGUJ tag=8DV20GQN8YOO type=del 2024-09-12T17:37:00.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.443+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~9C751TT30EDE.0 size=1048576 2024-09-12T17:37:00.448 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.447+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~9C751TT30EDE.1 size=27346 2024-09-12T17:37:00.448 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.447+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=9C751TT30EDE tag=RHD4BEKEZ9BF type=write size=2124498 2024-09-12T17:37:00.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.451+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=K888PU6WP3MN type=del 2024-09-12T17:37:00.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.451+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=EL8VGV8JYS4K type=write size=198600 2024-09-12T17:37:00.458 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.455+0000 7f1ad43488c0 1 < suggested remove operation key=ECEF8IJGU4Z8 tag=TRD5U8KXXQTX type=del 2024-09-12T17:37:00.462 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.459+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~JSG7IBWIN8B3.0 size=1048576 2024-09-12T17:37:00.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.463+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~JSG7IBWIN8B3.1 size=1048576 2024-09-12T17:37:00.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.463+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~JSG7IBWIN8B3.2 size=573276 2024-09-12T17:37:00.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.463+0000 7f1ad43488c0 1 > prepared multipart upload key=3N1YT9TC0M3O upload=JSG7IBWIN8B3 tag=6Y7YN3ATIBA0 type=write size=3719004 2024-09-12T17:37:00.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.467+0000 7f1ad43488c0 1 < completed delete operation key=IY2AM7CJDUZG tag=6P070DBZ55RF type=del 2024-09-12T17:37:00.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.467+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=D7MFWVJGW206 type=del size=3577057 2024-09-12T17:37:00.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.467+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~MGYFF3O32RQO.0 size=1048576 2024-09-12T17:37:00.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.471+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~MGYFF3O32RQO.1 size=1048576 2024-09-12T17:37:00.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.471+0000 7f1ad43488c0 1 < canceled part key=_multipart_SDJ53NSPOIRC.2~MGYFF3O32RQO.2 size=683140 2024-09-12T17:37:00.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.475+0000 7f1ad43488c0 1 < canceled multipart upload key=SDJ53NSPOIRC upload=MGYFF3O32RQO tag=C7O0RZ7C7DSC type=write size=3828868 2024-09-12T17:37:00.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.475+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=6BPS3WKSRGQS type=del size=2669330 2024-09-12T17:37:00.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.475+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~H36FPUSH04D7.0 size=705245 2024-09-12T17:37:00.482 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.479+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=H36FPUSH04D7 tag=LJGBKSFA026Q type=write size=1753821 2024-09-12T17:37:00.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.483+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~HVZDVMAL2NTT.0 size=253669 2024-09-12T17:37:00.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.483+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=HVZDVMAL2NTT tag=1917RB2V4L52 type=write size=1302245 2024-09-12T17:37:00.487 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.487+0000 7f1ad43488c0 1 < canceled operation key=MB3FVGKV0ZNQ tag=7QDWEKZCF7TW type=del size=2357355 2024-09-12T17:37:00.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.491+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~P0A7UWWI6GVF.0 size=1048576 2024-09-12T17:37:00.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.491+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~P0A7UWWI6GVF.1 size=302300 2024-09-12T17:37:00.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.491+0000 7f1ad43488c0 1 > prepared multipart upload key=RH4HYE315U5Y upload=P0A7UWWI6GVF tag=0CMDCIV2USZD type=write size=2399452 2024-09-12T17:37:00.495 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.495+0000 7f1ad43488c0 1 < canceled operation key=WWB6LAHAMIR9 tag=3XLFM4IQLMK4 type=del size=1877857 2024-09-12T17:37:00.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.499+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~LPVQ0CREN3X3.0 size=1048576 2024-09-12T17:37:00.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.499+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~LPVQ0CREN3X3.1 size=370469 2024-09-12T17:37:00.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.499+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=LPVQ0CREN3X3 tag=1X8LKW7V9JRS type=write size=2467621 2024-09-12T17:37:00.504 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.503+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=JLAQOYSTLQ38 type=del 2024-09-12T17:37:00.508 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.507+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~9UAELICR1NYO.0 size=1031752 2024-09-12T17:37:00.508 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.507+0000 7f1ad43488c0 1 > prepared multipart upload key=WFEJLVRCKIUU upload=9UAELICR1NYO tag=V6ZMHZ9OQ0R8 type=write size=2080328 2024-09-12T17:37:00.510 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.507+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~AYYTLAQU1W7Y.0 size=1048576 2024-09-12T17:37:00.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.511+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~AYYTLAQU1W7Y.1 size=1048576 2024-09-12T17:37:00.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.511+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~AYYTLAQU1W7Y.2 size=925261 2024-09-12T17:37:00.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.515+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=AYYTLAQU1W7Y tag=UPG0RTII2LVV type=write size=4070989 2024-09-12T17:37:00.519 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.519+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=1OP5CXALZ8EU type=del size=2117845 2024-09-12T17:37:00.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.519+0000 7f1ad43488c0 1 < completed delete operation key=X0HT3K3OREL7 tag=A51KYLEX2MK0 type=del 2024-09-12T17:37:00.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.523+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=JESOE4IPERCK type=del size=153092 2024-09-12T17:37:00.526 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.523+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~1NBTMA9SQ2M4.0 size=1048576 2024-09-12T17:37:00.528 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.527+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~1NBTMA9SQ2M4.1 size=1048576 2024-09-12T17:37:00.528 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.527+0000 7f1ad43488c0 1 < canceled part key=_multipart_SDJ53NSPOIRC.2~1NBTMA9SQ2M4.2 size=1044054 2024-09-12T17:37:00.534 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.531+0000 7f1ad43488c0 1 < canceled multipart upload key=SDJ53NSPOIRC upload=1NBTMA9SQ2M4 tag=LT1YZSA7UKLG type=write size=4189782 2024-09-12T17:37:00.537 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.535+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=1BAH9YAANA5Q type=del size=1652689 2024-09-12T17:37:00.539 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.539+0000 7f1ad43488c0 1 < completed write operation key=XOEPYERWY6IT tag=0HGTP3BUJUNO type=write size=443563 2024-09-12T17:37:00.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.539+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=T7DQGQT9NEE1 type=del size=3176602 2024-09-12T17:37:00.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.543+0000 7f1ad43488c0 1 < suggested update operation key=A49CE02X3L2L tag=T0L5ZZEFTHXV type=del size=385994 2024-09-12T17:37:00.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.547+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~07Q915ANAL9Z.0 size=426173 2024-09-12T17:37:00.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.547+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=07Q915ANAL9Z tag=ZF35UJ96N557 type=write size=1474749 2024-09-12T17:37:00.551 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.551+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=JQRTNRF2AMN0 type=del 2024-09-12T17:37:00.553 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.551+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=NTOO52U1F35C type=del size=2900018 2024-09-12T17:37:00.555 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.555+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=5P10EXIBPNE0 type=del 2024-09-12T17:37:00.558 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.555+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=68A7UYNNJYE0 type=del size=2695197 2024-09-12T17:37:00.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.559+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~9C751TT30EDE.0 size=1048576 2024-09-12T17:37:00.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.559+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~9C751TT30EDE.1 size=27346 2024-09-12T17:37:00.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.563+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=9C751TT30EDE tag=RHD4BEKEZ9BF type=write size=2124498 2024-09-12T17:37:00.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.567+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=GQ81IIH7BYCL type=del size=2214675 2024-09-12T17:37:00.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.567+0000 7f1ad43488c0 1 < canceled operation key=LU7XIBO5YUOR tag=EL8VGV8JYS4K type=write size=198600 2024-09-12T17:37:00.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.571+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~KALKM9FF8OKL.0 size=1048576 2024-09-12T17:37:00.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.575+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~KALKM9FF8OKL.1 size=964232 2024-09-12T17:37:00.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.575+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=KALKM9FF8OKL tag=W0J0797CQ7XH type=write size=3061384 2024-09-12T17:37:00.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.575+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~JSG7IBWIN8B3.0 size=1048576 2024-09-12T17:37:00.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.579+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~JSG7IBWIN8B3.1 size=1048576 2024-09-12T17:37:00.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.579+0000 7f1ad43488c0 1 < canceled part key=_multipart_3N1YT9TC0M3O.2~JSG7IBWIN8B3.2 size=573276 2024-09-12T17:37:00.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.583+0000 7f1ad43488c0 1 < canceled multipart upload key=3N1YT9TC0M3O upload=JSG7IBWIN8B3 tag=6Y7YN3ATIBA0 type=write size=3719004 2024-09-12T17:37:00.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.587+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~8Z21YUJ3SUMG.0 size=1048576 2024-09-12T17:37:00.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.591+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~8Z21YUJ3SUMG.1 size=76943 2024-09-12T17:37:00.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.591+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=8Z21YUJ3SUMG tag=1NIG6PXUIAUS type=write size=2174095 2024-09-12T17:37:00.597 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.595+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=D7MFWVJGW206 type=del 2024-09-12T17:37:00.600 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.599+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~F5VT7Y20PHBA.0 size=843860 2024-09-12T17:37:00.600 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.599+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=F5VT7Y20PHBA tag=QU51116BTM88 type=write size=1892436 2024-09-12T17:37:00.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.599+0000 7f1ad43488c0 1 < completed delete operation key=C7QSOK3D3IWJ tag=6BPS3WKSRGQS type=del 2024-09-12T17:37:00.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.607+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~NN4O6WJA71AO.0 size=1048576 2024-09-12T17:37:00.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.607+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~NN4O6WJA71AO.1 size=113949 2024-09-12T17:37:00.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.607+0000 7f1ad43488c0 1 > prepared multipart upload key=ZHFRKX9YY8P5 upload=NN4O6WJA71AO tag=YZLF5FD4XBU0 type=write size=2211101 2024-09-12T17:37:00.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.611+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~HVZDVMAL2NTT.0 size=253669 2024-09-12T17:37:00.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.615+0000 7f1ad43488c0 1 < completed multipart upload key=8U3L46JDJ8VS upload=HVZDVMAL2NTT tag=1917RB2V4L52 type=write size=1302245 2024-09-12T17:37:00.620 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.619+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=PL5DGDZIMMRX type=del size=290111 2024-09-12T17:37:00.622 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.619+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~P0A7UWWI6GVF.0 size=1048576 2024-09-12T17:37:00.624 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.623+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~P0A7UWWI6GVF.1 size=302300 2024-09-12T17:37:00.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.627+0000 7f1ad43488c0 1 < completed multipart upload key=RH4HYE315U5Y upload=P0A7UWWI6GVF tag=0CMDCIV2USZD type=write size=2399452 2024-09-12T17:37:00.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.631+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~ITJKX49J8UDH.0 size=1048576 2024-09-12T17:37:00.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.635+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~ITJKX49J8UDH.1 size=1048576 2024-09-12T17:37:00.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.635+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~ITJKX49J8UDH.2 size=200260 2024-09-12T17:37:00.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.635+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=ITJKX49J8UDH tag=IY8T3ZCEEZ6Z type=write size=3345988 2024-09-12T17:37:00.641 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.639+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~LPVQ0CREN3X3.0 size=1048576 2024-09-12T17:37:00.641 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.639+0000 7f1ad43488c0 1 < canceled part key=_multipart_X078SB1ITNII.2~LPVQ0CREN3X3.1 size=370469 2024-09-12T17:37:00.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.643+0000 7f1ad43488c0 1 < canceled multipart upload key=X078SB1ITNII upload=LPVQ0CREN3X3 tag=1X8LKW7V9JRS type=write size=2467621 2024-09-12T17:37:00.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.647+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~VRMN0MCC6BD4.0 size=213235 2024-09-12T17:37:00.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.647+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=VRMN0MCC6BD4 tag=I73YZU6AG3NF type=write size=1261811 2024-09-12T17:37:00.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.651+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~9UAELICR1NYO.0 size=1031752 2024-09-12T17:37:00.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.655+0000 7f1ad43488c0 1 < completed multipart upload key=WFEJLVRCKIUU upload=9UAELICR1NYO tag=V6ZMHZ9OQ0R8 type=write size=2080328 2024-09-12T17:37:00.660 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.659+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=XK0WAT5XQRH7 type=del size=840856 2024-09-12T17:37:00.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.663+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=1OP5CXALZ8EU type=del 2024-09-12T17:37:00.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.663+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=O6WDLBIGR2LW type=del size=969395 2024-09-12T17:37:00.671 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.667+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=JESOE4IPERCK type=del 2024-09-12T17:37:00.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.671+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=6TNKRR4XOVMH type=del size=3376518 2024-09-12T17:37:00.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.675+0000 7f1ad43488c0 1 < completed delete operation key=IY2AM7CJDUZG tag=1BAH9YAANA5Q type=del 2024-09-12T17:37:00.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.675+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=FJJHSI0FQS1U type=del size=1126467 2024-09-12T17:37:00.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.679+0000 7f1ad43488c0 1 < canceled operation key=X0HT3K3OREL7 tag=T7DQGQT9NEE1 type=del size=3176602 2024-09-12T17:37:00.685 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.683+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~4DPSMSBLQPJV.0 size=1048576 2024-09-12T17:37:00.687 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.687+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~4DPSMSBLQPJV.1 size=488529 2024-09-12T17:37:00.687 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.687+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=4DPSMSBLQPJV tag=N65VG1Y7KK5L type=write size=2585681 2024-09-12T17:37:00.690 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.687+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~07Q915ANAL9Z.0 size=426173 2024-09-12T17:37:00.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.691+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=07Q915ANAL9Z tag=ZF35UJ96N557 type=write size=1474749 2024-09-12T17:37:00.697 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.695+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=S370K47NR2QS type=del size=1210979 2024-09-12T17:37:00.700 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.699+0000 7f1ad43488c0 1 < canceled operation key=IY2AM7CJDUZG tag=NTOO52U1F35C type=del size=2900018 2024-09-12T17:37:00.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.699+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=1MIVMBBEQTDF type=del size=2437157 2024-09-12T17:37:00.705 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.703+0000 7f1ad43488c0 1 < completed delete operation key=ECEF8IJGU4Z8 tag=68A7UYNNJYE0 type=del 2024-09-12T17:37:00.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.707+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=TK8D53VL1L69 type=write size=490255 2024-09-12T17:37:00.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.711+0000 7f1ad43488c0 1 < completed delete operation key=C7QSOK3D3IWJ tag=GQ81IIH7BYCL type=del 2024-09-12T17:37:00.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.711+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=7F2O7MFFMLO3 type=del size=3998928 2024-09-12T17:37:00.717 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.715+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~KALKM9FF8OKL.0 size=1048576 2024-09-12T17:37:00.719 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.719+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~KALKM9FF8OKL.1 size=964232 2024-09-12T17:37:00.724 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.723+0000 7f1ad43488c0 1 < completed multipart upload key=7RSHIZRKK2OY upload=KALKM9FF8OKL tag=W0J0797CQ7XH type=write size=3061384 2024-09-12T17:37:00.727 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.723+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=S151DK0UEZ9M type=del size=1439585 2024-09-12T17:37:00.729 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.727+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~8Z21YUJ3SUMG.0 size=1048576 2024-09-12T17:37:00.732 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.731+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~8Z21YUJ3SUMG.1 size=76943 2024-09-12T17:37:00.737 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.735+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=8Z21YUJ3SUMG tag=1NIG6PXUIAUS type=write size=2174095 2024-09-12T17:37:00.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.739+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~W3J4L00U7Y1H.0 size=1048576 2024-09-12T17:37:00.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.743+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~W3J4L00U7Y1H.1 size=168097 2024-09-12T17:37:00.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.743+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=W3J4L00U7Y1H tag=691OTH6AULXY type=write size=2265249 2024-09-12T17:37:00.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.747+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~F5VT7Y20PHBA.0 size=843860 2024-09-12T17:37:00.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.751+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=F5VT7Y20PHBA tag=QU51116BTM88 type=write size=1892436 2024-09-12T17:37:00.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.751+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=2CY2VN502BER type=del size=1073743 2024-09-12T17:37:00.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.755+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~NN4O6WJA71AO.0 size=1048576 2024-09-12T17:37:00.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.759+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~NN4O6WJA71AO.1 size=113949 2024-09-12T17:37:00.765 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.763+0000 7f1ad43488c0 1 < completed multipart upload key=ZHFRKX9YY8P5 upload=NN4O6WJA71AO tag=YZLF5FD4XBU0 type=write size=2211101 2024-09-12T17:37:00.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.767+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~3ZLUS3PC8OD6.0 size=950002 2024-09-12T17:37:00.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.767+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=3ZLUS3PC8OD6 tag=JATWWYGWIMEY type=write size=1998578 2024-09-12T17:37:00.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.771+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=PL5DGDZIMMRX type=del 2024-09-12T17:37:00.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.775+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=I4DGDV9RCEFP type=write size=849743 2024-09-12T17:37:00.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.779+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~ITJKX49J8UDH.0 size=1048576 2024-09-12T17:37:00.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.779+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~ITJKX49J8UDH.1 size=1048576 2024-09-12T17:37:00.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.783+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~ITJKX49J8UDH.2 size=200260 2024-09-12T17:37:00.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.787+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=ITJKX49J8UDH tag=IY8T3ZCEEZ6Z type=write size=3345988 2024-09-12T17:37:00.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.791+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=7V8ODWS5JSLI type=del size=3781884 2024-09-12T17:37:00.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.795+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~VRMN0MCC6BD4.0 size=213235 2024-09-12T17:37:00.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.799+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=VRMN0MCC6BD4 tag=I73YZU6AG3NF type=write size=1261811 2024-09-12T17:37:00.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.803+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~XYQ3LIFQKJ4P.0 size=1048576 2024-09-12T17:37:00.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.807+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~XYQ3LIFQKJ4P.1 size=1048576 2024-09-12T17:37:00.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.807+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~XYQ3LIFQKJ4P.2 size=745014 2024-09-12T17:37:00.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.807+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=XYQ3LIFQKJ4P tag=OZURGVJUNMR5 type=write size=3890742 2024-09-12T17:37:00.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.815+0000 7f1ad43488c0 1 < suggested update operation key=0MV3GCBTWZD0 tag=XK0WAT5XQRH7 type=del size=840856 2024-09-12T17:37:00.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.815+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=YATBB6P1X00K type=del size=1079322 2024-09-12T17:37:00.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.819+0000 7f1ad43488c0 1 < completed delete operation key=9Z2EHQA8T5F4 tag=O6WDLBIGR2LW type=del 2024-09-12T17:37:00.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.823+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~TT631S7OIL2R.0 size=537475 2024-09-12T17:37:00.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.823+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=TT631S7OIL2R tag=WXZQ2LLQZLYB type=write size=1586051 2024-09-12T17:37:00.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.827+0000 7f1ad43488c0 1 < canceled operation key=LU7XIBO5YUOR tag=6TNKRR4XOVMH type=del size=3376518 2024-09-12T17:37:00.835 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.835+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~G8Y4RZVYD5VZ.0 size=334492 2024-09-12T17:37:00.835 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.835+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=G8Y4RZVYD5VZ tag=RNRUBGHOZNOV type=write size=1383068 2024-09-12T17:37:00.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.839+0000 7f1ad43488c0 1 < suggested remove operation key=ZHFRKX9YY8P5 tag=FJJHSI0FQS1U type=del 2024-09-12T17:37:00.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.843+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=UP11J6YHUVWX type=del size=788390 2024-09-12T17:37:00.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.843+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~4DPSMSBLQPJV.0 size=1048576 2024-09-12T17:37:00.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.843+0000 7f1ad43488c0 1 < canceled part key=_multipart_2SDYAQRNWAJK.2~4DPSMSBLQPJV.1 size=488529 2024-09-12T17:37:00.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.851+0000 7f1ad43488c0 1 < canceled multipart upload key=2SDYAQRNWAJK upload=4DPSMSBLQPJV tag=N65VG1Y7KK5L type=write size=2585681 2024-09-12T17:37:00.856 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.855+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~LV8CUF5ZA9PT.0 size=1048576 2024-09-12T17:37:00.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.855+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~LV8CUF5ZA9PT.1 size=488017 2024-09-12T17:37:00.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.855+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=LV8CUF5ZA9PT tag=MF8IOKJ9XU8F type=write size=2585169 2024-09-12T17:37:00.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.859+0000 7f1ad43488c0 1 < completed delete operation key=SIZ0Z1KWTGUJ tag=S370K47NR2QS type=del 2024-09-12T17:37:00.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.863+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~NBQKM8N7W4XQ.0 size=561962 2024-09-12T17:37:00.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.863+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=NBQKM8N7W4XQ tag=SMGZ5WTBB7OY type=write size=1610538 2024-09-12T17:37:00.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.867+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=1MIVMBBEQTDF type=del 2024-09-12T17:37:00.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.871+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=B40LJ0EAD31H type=del size=1676731 2024-09-12T17:37:00.876 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.875+0000 7f1ad43488c0 1 < completed write operation key=WFEJLVRCKIUU tag=TK8D53VL1L69 type=write size=490255 2024-09-12T17:37:00.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.879+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~RZIEPNKVGRWG.0 size=1048576 2024-09-12T17:37:00.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.883+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~RZIEPNKVGRWG.1 size=1048576 2024-09-12T17:37:00.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.883+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~RZIEPNKVGRWG.2 size=761570 2024-09-12T17:37:00.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.883+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=RZIEPNKVGRWG tag=1P8LUUU3LJTF type=write size=3907298 2024-09-12T17:37:00.888 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.887+0000 7f1ad43488c0 1 < completed delete operation key=X0HT3K3OREL7 tag=7F2O7MFFMLO3 type=del 2024-09-12T17:37:00.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.891+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=YMR9BBIBCKB2 type=del size=2226329 2024-09-12T17:37:00.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.891+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=S151DK0UEZ9M type=del 2024-09-12T17:37:00.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.895+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=UDPM208BMORY type=del size=1243459 2024-09-12T17:37:00.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.899+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~W3J4L00U7Y1H.0 size=1048576 2024-09-12T17:37:00.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.899+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~W3J4L00U7Y1H.1 size=168097 2024-09-12T17:37:00.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.903+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=W3J4L00U7Y1H tag=691OTH6AULXY type=write size=2265249 2024-09-12T17:37:00.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.907+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~BE2KBFAF53ZB.0 size=1048576 2024-09-12T17:37:00.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.911+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~BE2KBFAF53ZB.1 size=1048576 2024-09-12T17:37:00.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.911+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~BE2KBFAF53ZB.2 size=187223 2024-09-12T17:37:00.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.911+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=BE2KBFAF53ZB tag=ZTJV6VBH0FJQ type=write size=3332951 2024-09-12T17:37:00.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.915+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=2CY2VN502BER type=del 2024-09-12T17:37:00.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.919+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~KVHJEOKHNANA.0 size=878144 2024-09-12T17:37:00.922 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.919+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=KVHJEOKHNANA tag=4LNFEFS5Q8D8 type=write size=1926720 2024-09-12T17:37:00.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.923+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~3ZLUS3PC8OD6.0 size=950002 2024-09-12T17:37:00.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.931+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=3ZLUS3PC8OD6 tag=JATWWYGWIMEY type=write size=1998578 2024-09-12T17:37:00.935 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.931+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=4656NCMKTOVI type=write size=916926 2024-09-12T17:37:00.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.935+0000 7f1ad43488c0 1 < canceled operation key=RXJJOPR32OD5 tag=I4DGDV9RCEFP type=write size=849743 2024-09-12T17:37:00.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.943+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~YXICWIKKPW6M.0 size=1048576 2024-09-12T17:37:00.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.943+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~YXICWIKKPW6M.1 size=20363 2024-09-12T17:37:00.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.943+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=YXICWIKKPW6M tag=BP3Z4PHDMQKX type=write size=2117515 2024-09-12T17:37:00.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.947+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=7V8ODWS5JSLI type=del 2024-09-12T17:37:00.953 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.951+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=0HXTERXNP8S1 type=del size=2748995 2024-09-12T17:37:00.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.951+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~XYQ3LIFQKJ4P.0 size=1048576 2024-09-12T17:37:00.957 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.955+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~XYQ3LIFQKJ4P.1 size=1048576 2024-09-12T17:37:00.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.959+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~XYQ3LIFQKJ4P.2 size=745014 2024-09-12T17:37:00.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.963+0000 7f1ad43488c0 1 < completed multipart upload key=WWB6LAHAMIR9 upload=XYQ3LIFQKJ4P tag=OZURGVJUNMR5 type=write size=3890742 2024-09-12T17:37:00.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.967+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~5OKSL682LN8L.0 size=1048576 2024-09-12T17:37:00.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.971+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~5OKSL682LN8L.1 size=371275 2024-09-12T17:37:00.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.971+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=5OKSL682LN8L tag=9PZDYWXCBGVD type=write size=2468427 2024-09-12T17:37:00.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.971+0000 7f1ad43488c0 -1 < failed to complete operation key=ZHFRKX9YY8P5 tag=YATBB6P1X00K type=del size=1079322: (22) Invalid argument 2024-09-12T17:37:00.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.975+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~A7QMDPMAW2BQ.0 size=1048576 2024-09-12T17:37:00.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.979+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~A7QMDPMAW2BQ.1 size=503693 2024-09-12T17:37:00.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.979+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=A7QMDPMAW2BQ tag=FOGKAIVN0IYH type=write size=2600845 2024-09-12T17:37:00.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.979+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~TT631S7OIL2R.0 size=537475 2024-09-12T17:37:00.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.983+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=TT631S7OIL2R tag=WXZQ2LLQZLYB type=write size=1586051 2024-09-12T17:37:00.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.987+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=07Q0MZGN582N type=write size=638331 2024-09-12T17:37:00.991 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.991+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~G8Y4RZVYD5VZ.0 size=334492 2024-09-12T17:37:00.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.995+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=G8Y4RZVYD5VZ tag=RNRUBGHOZNOV type=write size=1383068 2024-09-12T17:37:00.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.995+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=57IRZ9JFJLVB type=del size=1681733 2024-09-12T17:37:01.002 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:00.999+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=UP11J6YHUVWX type=del 2024-09-12T17:37:01.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.003+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=2NM1V4B0191B type=del size=4005264 2024-09-12T17:37:01.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.003+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~LV8CUF5ZA9PT.0 size=1048576 2024-09-12T17:37:01.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.007+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~LV8CUF5ZA9PT.1 size=488017 2024-09-12T17:37:01.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.011+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=LV8CUF5ZA9PT tag=MF8IOKJ9XU8F type=write size=2585169 2024-09-12T17:37:01.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.015+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~83G5UJHEKZYO.0 size=1048576 2024-09-12T17:37:01.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.019+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~83G5UJHEKZYO.1 size=1048576 2024-09-12T17:37:01.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.019+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~83G5UJHEKZYO.2 size=19171 2024-09-12T17:37:01.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.019+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=83G5UJHEKZYO tag=S5ZNL60DHCCY type=write size=3164899 2024-09-12T17:37:01.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.023+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~NBQKM8N7W4XQ.0 size=561962 2024-09-12T17:37:01.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.027+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=NBQKM8N7W4XQ tag=SMGZ5WTBB7OY type=write size=1610538 2024-09-12T17:37:01.029 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.027+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=4ZZ7XZMX4EG4 type=del size=368537 2024-09-12T17:37:01.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.031+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=B40LJ0EAD31H type=del 2024-09-12T17:37:01.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.031+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=915GL22T8JVH type=write size=545556 2024-09-12T17:37:01.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.035+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~RZIEPNKVGRWG.0 size=1048576 2024-09-12T17:37:01.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.039+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~RZIEPNKVGRWG.1 size=1048576 2024-09-12T17:37:01.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.039+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~RZIEPNKVGRWG.2 size=761570 2024-09-12T17:37:01.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.047+0000 7f1ad43488c0 1 < completed multipart upload key=X0HT3K3OREL7 upload=RZIEPNKVGRWG tag=1P8LUUU3LJTF type=write size=3907298 2024-09-12T17:37:01.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.051+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=BPU6MSG7LJCY type=del size=1312949 2024-09-12T17:37:01.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.051+0000 7f1ad43488c0 1 < completed delete operation key=ECEF8IJGU4Z8 tag=YMR9BBIBCKB2 type=del 2024-09-12T17:37:01.059 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.059+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~JQDYWNN7EBU5.0 size=1048576 2024-09-12T17:37:01.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.059+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~JQDYWNN7EBU5.1 size=153179 2024-09-12T17:37:01.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.059+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=JQDYWNN7EBU5 tag=H5MXP1YR0YGE type=write size=2250331 2024-09-12T17:37:01.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.063+0000 7f1ad43488c0 1 < completed delete operation key=XOEPYERWY6IT tag=UDPM208BMORY type=del 2024-09-12T17:37:01.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.067+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=MQASGLDJDG6T type=del size=2109074 2024-09-12T17:37:01.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.067+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~BE2KBFAF53ZB.0 size=1048576 2024-09-12T17:37:01.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.071+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~BE2KBFAF53ZB.1 size=1048576 2024-09-12T17:37:01.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.071+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~BE2KBFAF53ZB.2 size=187223 2024-09-12T17:37:01.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.075+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=BE2KBFAF53ZB tag=ZTJV6VBH0FJQ type=write size=3332951 2024-09-12T17:37:01.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.079+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=LJSTEHCAV3W9 type=del size=1661206 2024-09-12T17:37:01.084 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.083+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~KVHJEOKHNANA.0 size=878144 2024-09-12T17:37:01.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.087+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=KVHJEOKHNANA tag=4LNFEFS5Q8D8 type=write size=1926720 2024-09-12T17:37:01.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.091+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~NHYJWPU4C1OJ.0 size=516350 2024-09-12T17:37:01.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.091+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=NHYJWPU4C1OJ tag=QJ29X4VM3TSQ type=write size=1564926 2024-09-12T17:37:01.095 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.095+0000 7f1ad43488c0 1 < completed write operation key=WWB6LAHAMIR9 tag=4656NCMKTOVI type=write size=916926 2024-09-12T17:37:01.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.095+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=6FLGBVJMSKYR type=del size=1634019 2024-09-12T17:37:01.100 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.099+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~YXICWIKKPW6M.0 size=1048576 2024-09-12T17:37:01.101 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.099+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~YXICWIKKPW6M.1 size=20363 2024-09-12T17:37:01.105 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.103+0000 7f1ad43488c0 1 < completed multipart upload key=IY2AM7CJDUZG upload=YXICWIKKPW6M tag=BP3Z4PHDMQKX type=write size=2117515 2024-09-12T17:37:01.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.107+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~8A4SM8QHGR7S.0 size=199259 2024-09-12T17:37:01.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.107+0000 7f1ad43488c0 1 > prepared multipart upload key=C7QSOK3D3IWJ upload=8A4SM8QHGR7S tag=4OA7VG6F2Z3Z type=write size=1247835 2024-09-12T17:37:01.113 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.111+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=0HXTERXNP8S1 type=del 2024-09-12T17:37:01.115 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.115+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=LDFTNTUJT0LI type=del size=3649961 2024-09-12T17:37:01.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.115+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~5OKSL682LN8L.0 size=1048576 2024-09-12T17:37:01.121 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.119+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~5OKSL682LN8L.1 size=371275 2024-09-12T17:37:01.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.123+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=5OKSL682LN8L tag=9PZDYWXCBGVD type=write size=2468427 2024-09-12T17:37:01.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.131+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~800JYG0UYVCH.0 size=1048576 2024-09-12T17:37:01.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.131+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~800JYG0UYVCH.1 size=820147 2024-09-12T17:37:01.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.131+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=800JYG0UYVCH tag=GWQALMKTZRV4 type=write size=2917299 2024-09-12T17:37:01.135 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.135+0000 7f1ad43488c0 1 < canceled part key=_multipart_X078SB1ITNII.2~A7QMDPMAW2BQ.0 size=1048576 2024-09-12T17:37:01.138 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.135+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~A7QMDPMAW2BQ.1 size=503693 2024-09-12T17:37:01.143 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.143+0000 7f1ad43488c0 1 < canceled multipart upload key=X078SB1ITNII upload=A7QMDPMAW2BQ tag=FOGKAIVN0IYH type=write size=2600845 2024-09-12T17:37:01.147 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.147+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=3HI0E4S2N9H4 type=del size=2752898 2024-09-12T17:37:01.150 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.147+0000 7f1ad43488c0 1 < completed write operation key=X0HT3K3OREL7 tag=07Q0MZGN582N type=write size=638331 2024-09-12T17:37:01.153 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.151+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=GO061QA75H19 type=del size=3163148 2024-09-12T17:37:01.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.155+0000 7f1ad43488c0 1 < suggested remove operation key=CHMM14VRIOQH tag=57IRZ9JFJLVB type=del 2024-09-12T17:37:01.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.159+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=X9QWC4UX1JC6 type=del size=1366372 2024-09-12T17:37:01.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.163+0000 7f1ad43488c0 1 < completed delete operation key=ZHFRKX9YY8P5 tag=2NM1V4B0191B type=del 2024-09-12T17:37:01.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.167+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=Y49XXI0UDA70 type=del size=3062580 2024-09-12T17:37:01.168 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.167+0000 7f1ad43488c0 1 < canceled part key=_multipart_ECEF8IJGU4Z8.2~83G5UJHEKZYO.0 size=1048576 2024-09-12T17:37:01.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.167+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~83G5UJHEKZYO.1 size=1048576 2024-09-12T17:37:01.173 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.171+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~83G5UJHEKZYO.2 size=19171 2024-09-12T17:37:01.178 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.175+0000 7f1ad43488c0 1 < canceled multipart upload key=ECEF8IJGU4Z8 upload=83G5UJHEKZYO tag=S5ZNL60DHCCY type=write size=3164899 2024-09-12T17:37:01.185 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.183+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~SU3XDNP8P1HS.0 size=1048576 2024-09-12T17:37:01.187 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.187+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~SU3XDNP8P1HS.1 size=817482 2024-09-12T17:37:01.187 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.187+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=SU3XDNP8P1HS tag=0HXKRJZ2MDBV type=write size=2914634 2024-09-12T17:37:01.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.187+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=4ZZ7XZMX4EG4 type=del 2024-09-12T17:37:01.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.191+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=U1VQVAP0FOC9 type=write size=830781 2024-09-12T17:37:01.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.191+0000 7f1ad43488c0 1 < completed write operation key=6Z3F28JHHEQS tag=915GL22T8JVH type=write size=545556 2024-09-12T17:37:01.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.195+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=APNBDI4FRAX4 type=del size=3778409 2024-09-12T17:37:01.200 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.199+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=BPU6MSG7LJCY type=del 2024-09-12T17:37:01.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.203+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~8QVN9XLUACGK.0 size=1048576 2024-09-12T17:37:01.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.203+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~8QVN9XLUACGK.1 size=396225 2024-09-12T17:37:01.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.203+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=8QVN9XLUACGK tag=4AB33SGVVU5F type=write size=2493377 2024-09-12T17:37:01.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.207+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~JQDYWNN7EBU5.0 size=1048576 2024-09-12T17:37:01.212 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.211+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~JQDYWNN7EBU5.1 size=153179 2024-09-12T17:37:01.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.215+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=JQDYWNN7EBU5 tag=H5MXP1YR0YGE type=write size=2250331 2024-09-12T17:37:01.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.219+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=8GQ4RADC35CM type=del size=2020245 2024-09-12T17:37:01.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.219+0000 7f1ad43488c0 1 < completed delete operation key=NHOG1WG3VT6N tag=MQASGLDJDG6T type=del 2024-09-12T17:37:01.227 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.227+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~GQNF03G0SJ2L.0 size=1048576 2024-09-12T17:37:01.230 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.227+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~GQNF03G0SJ2L.1 size=982570 2024-09-12T17:37:01.230 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.227+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=GQNF03G0SJ2L tag=5XQO2TGVJD3S type=write size=3079722 2024-09-12T17:37:01.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.231+0000 7f1ad43488c0 1 < completed delete operation key=SIZ0Z1KWTGUJ tag=LJSTEHCAV3W9 type=del 2024-09-12T17:37:01.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.235+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~XHDRL0KWCKTA.0 size=1048576 2024-09-12T17:37:01.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.239+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~XHDRL0KWCKTA.1 size=1048576 2024-09-12T17:37:01.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.243+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~XHDRL0KWCKTA.2 size=853945 2024-09-12T17:37:01.244 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.243+0000 7f1ad43488c0 1 > prepared multipart upload key=WFEJLVRCKIUU upload=XHDRL0KWCKTA tag=410A4HG5JJI6 type=write size=3999673 2024-09-12T17:37:01.247 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.247+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~NHYJWPU4C1OJ.0 size=516350 2024-09-12T17:37:01.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.251+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=NHYJWPU4C1OJ tag=QJ29X4VM3TSQ type=write size=1564926 2024-09-12T17:37:01.256 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.255+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=2SG8RNQVH2G5 type=write size=230380 2024-09-12T17:37:01.259 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.259+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=6FLGBVJMSKYR type=del 2024-09-12T17:37:01.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.259+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=LG4P8X9X7CJA type=del size=3516822 2024-09-12T17:37:01.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.263+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~8A4SM8QHGR7S.0 size=199259 2024-09-12T17:37:01.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.271+0000 7f1ad43488c0 1 < completed multipart upload key=C7QSOK3D3IWJ upload=8A4SM8QHGR7S tag=4OA7VG6F2Z3Z type=write size=1247835 2024-09-12T17:37:01.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.271+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=EZFGXKMA4M44 type=del size=1030772 2024-09-12T17:37:01.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.275+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=LDFTNTUJT0LI type=del 2024-09-12T17:37:01.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.279+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=IWN2JOXNZM78 type=del size=1285417 2024-09-12T17:37:01.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.283+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~800JYG0UYVCH.0 size=1048576 2024-09-12T17:37:01.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.283+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~800JYG0UYVCH.1 size=820147 2024-09-12T17:37:01.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.291+0000 7f1ad43488c0 1 < completed multipart upload key=IY2AM7CJDUZG upload=800JYG0UYVCH tag=GWQALMKTZRV4 type=write size=2917299 2024-09-12T17:37:01.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.295+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~YHAFT8QAFGZE.0 size=937087 2024-09-12T17:37:01.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.295+0000 7f1ad43488c0 1 > prepared multipart upload key=C7QSOK3D3IWJ upload=YHAFT8QAFGZE tag=4LZVBP0U071Z type=write size=1985663 2024-09-12T17:37:01.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.299+0000 7f1ad43488c0 1 < suggested remove operation key=IY2AM7CJDUZG tag=3HI0E4S2N9H4 type=del 2024-09-12T17:37:01.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.303+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=L1CC18F4UXG5 type=write size=1025440 2024-09-12T17:37:01.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.307+0000 7f1ad43488c0 -1 < failed to complete operation key=CHMM14VRIOQH tag=GO061QA75H19 type=del size=3163148: (22) Invalid argument 2024-09-12T17:37:01.312 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.311+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=9E4A43BPU0E1 type=del size=1038863 2024-09-12T17:37:01.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.311+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=X9QWC4UX1JC6 type=del 2024-09-12T17:37:01.318 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.315+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=U2YXKRX9BM7N type=del size=3689864 2024-09-12T17:37:01.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.319+0000 7f1ad43488c0 1 < completed delete operation key=WWB6LAHAMIR9 tag=Y49XXI0UDA70 type=del 2024-09-12T17:37:01.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.323+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=QTV2ONZXP62F type=del size=31972 2024-09-12T17:37:01.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.327+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~SU3XDNP8P1HS.0 size=1048576 2024-09-12T17:37:01.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.327+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~SU3XDNP8P1HS.1 size=817482 2024-09-12T17:37:01.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.335+0000 7f1ad43488c0 1 < completed multipart upload key=MB3FVGKV0ZNQ upload=SU3XDNP8P1HS tag=0HXKRJZ2MDBV type=write size=2914634 2024-09-12T17:37:01.341 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.339+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~VX2ATCHWFAE6.0 size=1048576 2024-09-12T17:37:01.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.343+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~VX2ATCHWFAE6.1 size=691207 2024-09-12T17:37:01.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.343+0000 7f1ad43488c0 1 > prepared multipart upload key=CHMM14VRIOQH upload=VX2ATCHWFAE6 tag=EDC69Q659T1U type=write size=2788359 2024-09-12T17:37:01.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.347+0000 7f1ad43488c0 1 < completed write operation key=LU7XIBO5YUOR tag=U1VQVAP0FOC9 type=write size=830781 2024-09-12T17:37:01.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.347+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=S0471LGN70S0 type=del size=1270554 2024-09-12T17:37:01.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.355+0000 7f1ad43488c0 1 < suggested remove operation key=3N1YT9TC0M3O tag=APNBDI4FRAX4 type=del 2024-09-12T17:37:01.361 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.359+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=4N0WMNOQ2GJM type=del size=3587248 2024-09-12T17:37:01.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.363+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~8QVN9XLUACGK.0 size=1048576 2024-09-12T17:37:01.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.367+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~8QVN9XLUACGK.1 size=396225 2024-09-12T17:37:01.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.371+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=8QVN9XLUACGK tag=4AB33SGVVU5F type=write size=2493377 2024-09-12T17:37:01.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.379+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~CTKVN7DX2B6E.0 size=861115 2024-09-12T17:37:01.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.379+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=CTKVN7DX2B6E tag=AGIYA4MBKQF1 type=write size=1909691 2024-09-12T17:37:01.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.379+0000 7f1ad43488c0 1 < completed delete operation key=9Z2EHQA8T5F4 tag=8GQ4RADC35CM type=del 2024-09-12T17:37:01.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.383+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=KH3ITH37HT9H type=del size=3552316 2024-09-12T17:37:01.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.387+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~GQNF03G0SJ2L.0 size=1048576 2024-09-12T17:37:01.391 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.387+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~GQNF03G0SJ2L.1 size=982570 2024-09-12T17:37:01.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.395+0000 7f1ad43488c0 1 < completed multipart upload key=8U3L46JDJ8VS upload=GQNF03G0SJ2L tag=5XQO2TGVJD3S type=write size=3079722 2024-09-12T17:37:01.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.399+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~71E6J12578NE.0 size=1048576 2024-09-12T17:37:01.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.403+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~71E6J12578NE.1 size=165209 2024-09-12T17:37:01.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.403+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=71E6J12578NE tag=IBUFRTQU77Y5 type=write size=2262361 2024-09-12T17:37:01.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.407+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~XHDRL0KWCKTA.0 size=1048576 2024-09-12T17:37:01.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.407+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~XHDRL0KWCKTA.1 size=1048576 2024-09-12T17:37:01.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.411+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~XHDRL0KWCKTA.2 size=853945 2024-09-12T17:37:01.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.415+0000 7f1ad43488c0 1 < completed multipart upload key=WFEJLVRCKIUU upload=XHDRL0KWCKTA tag=410A4HG5JJI6 type=write size=3999673 2024-09-12T17:37:01.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.419+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=QRNLBWY3VLHI type=del size=395632 2024-09-12T17:37:01.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.427+0000 7f1ad43488c0 1 < suggested remove operation key=XOEPYERWY6IT tag=2SG8RNQVH2G5 type=write 2024-09-12T17:37:01.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.431+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=SIGKYM106NBP type=del size=4004709 2024-09-12T17:37:01.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.435+0000 7f1ad43488c0 1 < completed delete operation key=PKC1RR4FZWE0 tag=LG4P8X9X7CJA type=del 2024-09-12T17:37:01.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.435+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=O09OJPOPURH5 type=del size=1820098 2024-09-12T17:37:01.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.439+0000 7f1ad43488c0 1 < canceled operation key=WFEJLVRCKIUU tag=EZFGXKMA4M44 type=del size=1030772 2024-09-12T17:37:01.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.447+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~H1YUZ44C82MU.0 size=1048576 2024-09-12T17:37:01.449 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.447+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~H1YUZ44C82MU.1 size=1048576 2024-09-12T17:37:01.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.451+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~H1YUZ44C82MU.2 size=1002253 2024-09-12T17:37:01.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.451+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=H1YUZ44C82MU tag=QCIY4CL56X9B type=write size=4147981 2024-09-12T17:37:01.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.451+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=IWN2JOXNZM78 type=del 2024-09-12T17:37:01.458 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.455+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=MRN0BDHGKLDL type=del size=742404 2024-09-12T17:37:01.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.455+0000 7f1ad43488c0 1 < canceled part key=_multipart_C7QSOK3D3IWJ.2~YHAFT8QAFGZE.0 size=937087 2024-09-12T17:37:01.463 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.463+0000 7f1ad43488c0 1 < canceled multipart upload key=C7QSOK3D3IWJ upload=YHAFT8QAFGZE tag=4LZVBP0U071Z type=write size=1985663 2024-09-12T17:37:01.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.467+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=AC7RSFXZP5ZB type=del size=1895125 2024-09-12T17:37:01.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.467+0000 7f1ad43488c0 -1 < no bi entry to suggest for operation key=3N1YT9TC0M3O tag=L1CC18F4UXG5 type=write size=1025440: (2) No such file or directory 2024-09-12T17:37:01.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.475+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~ATCK9WJED6SA.0 size=1048576 2024-09-12T17:37:01.480 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.479+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~ATCK9WJED6SA.1 size=664771 2024-09-12T17:37:01.480 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.479+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=ATCK9WJED6SA tag=Y8HXG9VWJE1R type=write size=2761923 2024-09-12T17:37:01.483 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.479+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=9E4A43BPU0E1 type=del 2024-09-12T17:37:01.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.483+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=8KAOPDKEIJ3H type=del size=2063329 2024-09-12T17:37:01.489 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.487+0000 7f1ad43488c0 1 < completed delete operation key=05PAFB226IFP tag=U2YXKRX9BM7N type=del 2024-09-12T17:37:01.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.491+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=55IY3MRO4A1M type=del size=1640646 2024-09-12T17:37:01.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.491+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=QTV2ONZXP62F type=del 2024-09-12T17:37:01.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.499+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~E38VLKO9VFNW.0 size=1048576 2024-09-12T17:37:01.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.499+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~E38VLKO9VFNW.1 size=914541 2024-09-12T17:37:01.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.499+0000 7f1ad43488c0 1 > prepared multipart upload key=RH4HYE315U5Y upload=E38VLKO9VFNW tag=WY1YBRC6VDA5 type=write size=3011693 2024-09-12T17:37:01.504 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.503+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~VX2ATCHWFAE6.0 size=1048576 2024-09-12T17:37:01.504 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.503+0000 7f1ad43488c0 1 < canceled part key=_multipart_CHMM14VRIOQH.2~VX2ATCHWFAE6.1 size=691207 2024-09-12T17:37:01.509 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.507+0000 7f1ad43488c0 1 < canceled multipart upload key=CHMM14VRIOQH upload=VX2ATCHWFAE6 tag=EDC69Q659T1U type=write size=2788359 2024-09-12T17:37:01.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.511+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=JU2LGDBYYRRD type=write size=310212 2024-09-12T17:37:01.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.511+0000 7f1ad43488c0 1 < completed delete operation key=ECEF8IJGU4Z8 tag=S0471LGN70S0 type=del 2024-09-12T17:37:01.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.515+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=DSEMRXS1LIY6 type=del size=1116896 2024-09-12T17:37:01.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.519+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=4N0WMNOQ2GJM type=del 2024-09-12T17:37:01.526 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.523+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~J872P7V9L29F.0 size=1048576 2024-09-12T17:37:01.528 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.527+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~J872P7V9L29F.1 size=1033452 2024-09-12T17:37:01.528 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.527+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=J872P7V9L29F tag=Y3I781FIHJAW type=write size=3130604 2024-09-12T17:37:01.531 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.531+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~CTKVN7DX2B6E.0 size=861115 2024-09-12T17:37:01.536 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.535+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=CTKVN7DX2B6E tag=AGIYA4MBKQF1 type=write size=1909691 2024-09-12T17:37:01.539 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.539+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=9MWQ60WEC5U1 type=del size=2556959 2024-09-12T17:37:01.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.539+0000 7f1ad43488c0 1 < completed delete operation key=9Z2EHQA8T5F4 tag=KH3ITH37HT9H type=del 2024-09-12T17:37:01.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.547+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~FHUV2QQZZO4S.0 size=1048576 2024-09-12T17:37:01.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.547+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~FHUV2QQZZO4S.1 size=462052 2024-09-12T17:37:01.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.547+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=FHUV2QQZZO4S tag=8XHFQN4W5ADR type=write size=2559204 2024-09-12T17:37:01.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.551+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~71E6J12578NE.0 size=1048576 2024-09-12T17:37:01.555 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.551+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~71E6J12578NE.1 size=165209 2024-09-12T17:37:01.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.555+0000 7f1ad43488c0 1 < completed multipart upload key=IY2AM7CJDUZG upload=71E6J12578NE tag=IBUFRTQU77Y5 type=write size=2262361 2024-09-12T17:37:01.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.563+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~7J01CEITC5CL.0 size=943537 2024-09-12T17:37:01.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.563+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=7J01CEITC5CL tag=R7UTX5PWPSGH type=write size=1992113 2024-09-12T17:37:01.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.567+0000 7f1ad43488c0 1 < canceled operation key=GZ7LGZQHW4CY tag=QRNLBWY3VLHI type=del size=395632 2024-09-12T17:37:01.572 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.571+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~FJZCQCUXUQN9.0 size=1048576 2024-09-12T17:37:01.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.571+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~FJZCQCUXUQN9.1 size=1048576 2024-09-12T17:37:01.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.575+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~FJZCQCUXUQN9.2 size=59805 2024-09-12T17:37:01.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.575+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=FJZCQCUXUQN9 tag=JYL53YBR1VY5 type=write size=3205533 2024-09-12T17:37:01.578 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.575+0000 7f1ad43488c0 1 < completed delete operation key=IY2AM7CJDUZG tag=SIGKYM106NBP type=del 2024-09-12T17:37:01.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.579+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=TO6Q7TS7C0D8 type=del size=342149 2024-09-12T17:37:01.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.583+0000 7f1ad43488c0 1 < completed delete operation key=ZHFRKX9YY8P5 tag=O09OJPOPURH5 type=del 2024-09-12T17:37:01.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.583+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=07PNTLQALW0L type=del size=1030831 2024-09-12T17:37:01.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.587+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~H1YUZ44C82MU.0 size=1048576 2024-09-12T17:37:01.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.587+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~H1YUZ44C82MU.1 size=1048576 2024-09-12T17:37:01.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.591+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~H1YUZ44C82MU.2 size=1002253 2024-09-12T17:37:01.597 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.595+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=H1YUZ44C82MU tag=QCIY4CL56X9B type=write size=4147981 2024-09-12T17:37:01.599 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.599+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=SSA74UHPWNO8 type=del size=3490684 2024-09-12T17:37:01.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.603+0000 7f1ad43488c0 1 < suggested remove operation key=Y3NQLDWQJ37Z tag=MRN0BDHGKLDL type=del 2024-09-12T17:37:01.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.607+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~44DHORXY3P94.0 size=589951 2024-09-12T17:37:01.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.607+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=44DHORXY3P94 tag=OFZEVB1W57JW type=write size=1638527 2024-09-12T17:37:01.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.611+0000 7f1ad43488c0 1 < completed delete operation key=WWB6LAHAMIR9 tag=AC7RSFXZP5ZB type=del 2024-09-12T17:37:01.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.615+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~1CPPZH6TMC53.0 size=1048576 2024-09-12T17:37:01.620 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.615+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~1CPPZH6TMC53.1 size=1048576 2024-09-12T17:37:01.620 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.619+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~1CPPZH6TMC53.2 size=935651 2024-09-12T17:37:01.620 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.619+0000 7f1ad43488c0 1 > prepared multipart upload key=CHMM14VRIOQH upload=1CPPZH6TMC53 tag=B1JDI0YQRAKB type=write size=4081379 2024-09-12T17:37:01.622 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.619+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~ATCK9WJED6SA.0 size=1048576 2024-09-12T17:37:01.624 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.623+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~ATCK9WJED6SA.1 size=664771 2024-09-12T17:37:01.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.627+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=ATCK9WJED6SA tag=Y8HXG9VWJE1R type=write size=2761923 2024-09-12T17:37:01.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.631+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=1AK1GZKIHBP7 type=del size=1165848 2024-09-12T17:37:01.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.631+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=8KAOPDKEIJ3H type=del 2024-09-12T17:37:01.637 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.635+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=IKG5O1A12UDY type=del size=2478288 2024-09-12T17:37:01.639 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.639+0000 7f1ad43488c0 1 < completed delete operation key=PKC1RR4FZWE0 tag=55IY3MRO4A1M type=del 2024-09-12T17:37:01.642 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.639+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=AO78M0DASSMC type=del size=2507052 2024-09-12T17:37:01.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.643+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~E38VLKO9VFNW.0 size=1048576 2024-09-12T17:37:01.647 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.647+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~E38VLKO9VFNW.1 size=914541 2024-09-12T17:37:01.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.651+0000 7f1ad43488c0 1 < completed multipart upload key=RH4HYE315U5Y upload=E38VLKO9VFNW tag=WY1YBRC6VDA5 type=write size=3011693 2024-09-12T17:37:01.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.651+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=VKP8PRU1MZOL type=del size=2621399 2024-09-12T17:37:01.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.655+0000 7f1ad43488c0 1 < completed write operation key=0MV3GCBTWZD0 tag=JU2LGDBYYRRD type=write size=310212 2024-09-12T17:37:01.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.659+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~LWJ9OW2LHQI4.0 size=682525 2024-09-12T17:37:01.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.659+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=LWJ9OW2LHQI4 tag=NYXMFB6JEPXQ type=write size=1731101 2024-09-12T17:37:01.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.667+0000 7f1ad43488c0 1 < suggested update operation key=0MV3GCBTWZD0 tag=DSEMRXS1LIY6 type=del size=1116896 2024-09-12T17:37:01.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.667+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=50MH3FX9L00T type=del size=3710468 2024-09-12T17:37:01.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.671+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~J872P7V9L29F.0 size=1048576 2024-09-12T17:37:01.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.675+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~J872P7V9L29F.1 size=1033452 2024-09-12T17:37:01.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.679+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=J872P7V9L29F tag=Y3I781FIHJAW type=write size=3130604 2024-09-12T17:37:01.687 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.687+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=9GYV0740RSEY type=del size=1116471 2024-09-12T17:37:01.690 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.687+0000 7f1ad43488c0 -1 < failed to complete operation key=Y3NQLDWQJ37Z tag=9MWQ60WEC5U1 type=del size=2556959: (22) Invalid argument 2024-09-12T17:37:01.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.691+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=Z2TP74JBANQR type=del size=3870834 2024-09-12T17:37:01.695 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.695+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~FHUV2QQZZO4S.0 size=1048576 2024-09-12T17:37:01.697 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.695+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~FHUV2QQZZO4S.1 size=462052 2024-09-12T17:37:01.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.699+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=FHUV2QQZZO4S tag=8XHFQN4W5ADR type=write size=2559204 2024-09-12T17:37:01.705 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.703+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=VSUXJ92TQEAZ type=del size=808815 2024-09-12T17:37:01.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.707+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~7J01CEITC5CL.0 size=943537 2024-09-12T17:37:01.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.711+0000 7f1ad43488c0 1 < completed multipart upload key=IY2AM7CJDUZG upload=7J01CEITC5CL tag=R7UTX5PWPSGH type=write size=1992113 2024-09-12T17:37:01.716 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.715+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~Q9COU2KVM3Y6.0 size=618984 2024-09-12T17:37:01.716 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.715+0000 7f1ad43488c0 1 > prepared multipart upload key=C7QSOK3D3IWJ upload=Q9COU2KVM3Y6 tag=IF0LXRK8JH8O type=write size=1667560 2024-09-12T17:37:01.717 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.715+0000 7f1ad43488c0 1 < canceled part key=_multipart_8U3L46JDJ8VS.2~FJZCQCUXUQN9.0 size=1048576 2024-09-12T17:37:01.719 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.719+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~FJZCQCUXUQN9.1 size=1048576 2024-09-12T17:37:01.722 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.719+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~FJZCQCUXUQN9.2 size=59805 2024-09-12T17:37:01.727 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.723+0000 7f1ad43488c0 1 < canceled multipart upload key=8U3L46JDJ8VS upload=FJZCQCUXUQN9 tag=JYL53YBR1VY5 type=write size=3205533 2024-09-12T17:37:01.729 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.727+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=NQKRHVL5ZA04 type=del size=1244467 2024-09-12T17:37:01.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.735+0000 7f1ad43488c0 1 < completed delete operation key=X0HT3K3OREL7 tag=TO6Q7TS7C0D8 type=del 2024-09-12T17:37:01.738 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.735+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=RPQMK7N0ISS0 type=del size=2712610 2024-09-12T17:37:01.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.739+0000 7f1ad43488c0 1 < completed delete operation key=MB3FVGKV0ZNQ tag=07PNTLQALW0L type=del 2024-09-12T17:37:01.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.743+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~10KCPIKCLV9D.0 size=1048576 2024-09-12T17:37:01.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.747+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~10KCPIKCLV9D.1 size=985259 2024-09-12T17:37:01.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.747+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=10KCPIKCLV9D tag=UAJZYTIKS0ZA type=write size=3082411 2024-09-12T17:37:01.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.751+0000 7f1ad43488c0 1 < completed delete operation key=WFEJLVRCKIUU tag=SSA74UHPWNO8 type=del 2024-09-12T17:37:01.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.755+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~058SBBAHL126.0 size=879342 2024-09-12T17:37:01.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.755+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=058SBBAHL126 tag=DG85V8UJ3PS3 type=write size=1927918 2024-09-12T17:37:01.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.759+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~44DHORXY3P94.0 size=589951 2024-09-12T17:37:01.763 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.763+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=44DHORXY3P94 tag=OFZEVB1W57JW type=write size=1638527 2024-09-12T17:37:01.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.763+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=PTPY1RPH8LRZ type=del size=2157385 2024-09-12T17:37:01.768 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.767+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~1CPPZH6TMC53.0 size=1048576 2024-09-12T17:37:01.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.767+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~1CPPZH6TMC53.1 size=1048576 2024-09-12T17:37:01.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.771+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~1CPPZH6TMC53.2 size=935651 2024-09-12T17:37:01.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.775+0000 7f1ad43488c0 1 < completed multipart upload key=CHMM14VRIOQH upload=1CPPZH6TMC53 tag=B1JDI0YQRAKB type=write size=4081379 2024-09-12T17:37:01.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.779+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=W4PCE3BNKKAQ type=del size=68296 2024-09-12T17:37:01.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.783+0000 7f1ad43488c0 1 < suggested update operation key=XOEPYERWY6IT tag=1AK1GZKIHBP7 type=del size=1165848 2024-09-12T17:37:01.787 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.787+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=J6U0FTTCNNNV type=del size=947132 2024-09-12T17:37:01.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.787+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=IKG5O1A12UDY type=del 2024-09-12T17:37:01.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.791+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~INVVIT2QG3MF.0 size=1048576 2024-09-12T17:37:01.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.795+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~INVVIT2QG3MF.1 size=1048576 2024-09-12T17:37:01.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.795+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~INVVIT2QG3MF.2 size=418281 2024-09-12T17:37:01.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.795+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=INVVIT2QG3MF tag=18YFKEUWDPMB type=write size=3564009 2024-09-12T17:37:01.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.799+0000 7f1ad43488c0 1 < completed delete operation key=MB3FVGKV0ZNQ tag=AO78M0DASSMC type=del 2024-09-12T17:37:01.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.803+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~EQD4BHAU6MY6.0 size=349422 2024-09-12T17:37:01.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.803+0000 7f1ad43488c0 1 > prepared multipart upload key=RH4HYE315U5Y upload=EQD4BHAU6MY6 tag=196DXLM5L0V5 type=write size=1397998 2024-09-12T17:37:01.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.807+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=VKP8PRU1MZOL type=del 2024-09-12T17:37:01.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.811+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~V3O4UC2L4OX1.0 size=874252 2024-09-12T17:37:01.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.811+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=V3O4UC2L4OX1 tag=2N1P143W20GP type=write size=1922828 2024-09-12T17:37:01.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.811+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~LWJ9OW2LHQI4.0 size=682525 2024-09-12T17:37:01.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.815+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=LWJ9OW2LHQI4 tag=NYXMFB6JEPXQ type=write size=1731101 2024-09-12T17:37:01.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.819+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~38JRT8DD1AUY.0 size=1048576 2024-09-12T17:37:01.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.823+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~38JRT8DD1AUY.1 size=209042 2024-09-12T17:37:01.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.823+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=38JRT8DD1AUY tag=IQTIO3A067YY type=write size=2306194 2024-09-12T17:37:01.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.827+0000 7f1ad43488c0 1 < suggested update operation key=X0HT3K3OREL7 tag=50MH3FX9L00T type=del size=3710468 2024-09-12T17:37:01.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.831+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~2RZ7DK2MIF12.0 size=575144 2024-09-12T17:37:01.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.831+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=2RZ7DK2MIF12 tag=NFEZ1FKSZ3UQ type=write size=1623720 2024-09-12T17:37:01.835 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.835+0000 7f1ad43488c0 1 < completed delete operation key=MB3FVGKV0ZNQ tag=9GYV0740RSEY type=del 2024-09-12T17:37:01.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.839+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~2WSZ585WWDYR.0 size=1048576 2024-09-12T17:37:01.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.839+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~2WSZ585WWDYR.1 size=1048576 2024-09-12T17:37:01.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.843+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~2WSZ585WWDYR.2 size=1036365 2024-09-12T17:37:01.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.843+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=2WSZ585WWDYR tag=JGRWQNDJ0W6J type=write size=4182093 2024-09-12T17:37:01.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.843+0000 7f1ad43488c0 1 < completed delete operation key=05PAFB226IFP tag=Z2TP74JBANQR type=del 2024-09-12T17:37:01.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.847+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=J2MCWWB2041E type=del size=270613 2024-09-12T17:37:01.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.851+0000 7f1ad43488c0 1 < suggested remove operation key=9Z2EHQA8T5F4 tag=VSUXJ92TQEAZ type=del 2024-09-12T17:37:01.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.855+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~IZUC5P4F7CUV.0 size=1048576 2024-09-12T17:37:01.860 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.859+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~IZUC5P4F7CUV.1 size=324857 2024-09-12T17:37:01.860 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.859+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=IZUC5P4F7CUV tag=WYAB866I8O9R type=write size=2422009 2024-09-12T17:37:01.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.863+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~Q9COU2KVM3Y6.0 size=618984 2024-09-12T17:37:01.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.867+0000 7f1ad43488c0 1 < completed multipart upload key=C7QSOK3D3IWJ upload=Q9COU2KVM3Y6 tag=IF0LXRK8JH8O type=write size=1667560 2024-09-12T17:37:01.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.867+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=90T3DPBKQTHW type=del size=4085049 2024-09-12T17:37:01.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.871+0000 7f1ad43488c0 -1 < no bi entry to suggest for operation key=9Z2EHQA8T5F4 tag=NQKRHVL5ZA04 type=del size=1244467: (2) No such file or directory 2024-09-12T17:37:01.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.871+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=NXPY1IOPS9EI type=write size=852753 2024-09-12T17:37:01.876 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.875+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=RPQMK7N0ISS0 type=del 2024-09-12T17:37:01.879 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.879+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=5RZP32WX1U3Q type=del size=575205 2024-09-12T17:37:01.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.879+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~10KCPIKCLV9D.0 size=1048576 2024-09-12T17:37:01.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.883+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~10KCPIKCLV9D.1 size=985259 2024-09-12T17:37:01.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.887+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=10KCPIKCLV9D tag=UAJZYTIKS0ZA type=write size=3082411 2024-09-12T17:37:01.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.891+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=4CXSP9T99PJS type=del size=1168594 2024-09-12T17:37:01.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.891+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~058SBBAHL126.0 size=879342 2024-09-12T17:37:01.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.895+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=058SBBAHL126 tag=DG85V8UJ3PS3 type=write size=1927918 2024-09-12T17:37:01.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.899+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=EAM0NQRVYZOQ type=del size=4062582 2024-09-12T17:37:01.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.903+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=PTPY1RPH8LRZ type=del 2024-09-12T17:37:01.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.903+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=3Y0NIIE71KMB type=del size=1241452 2024-09-12T17:37:01.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.907+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=W4PCE3BNKKAQ type=del 2024-09-12T17:37:01.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.915+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~8101G2WE2HQU.0 size=670644 2024-09-12T17:37:01.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.915+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=8101G2WE2HQU tag=025RACA01HZN type=write size=1719220 2024-09-12T17:37:01.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.915+0000 7f1ad43488c0 1 < completed delete operation key=SIZ0Z1KWTGUJ tag=J6U0FTTCNNNV type=del 2024-09-12T17:37:01.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.919+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=VZVPK2QOE23P type=write size=691039 2024-09-12T17:37:01.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.919+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~INVVIT2QG3MF.0 size=1048576 2024-09-12T17:37:01.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.923+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~INVVIT2QG3MF.1 size=1048576 2024-09-12T17:37:01.927 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.923+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~INVVIT2QG3MF.2 size=418281 2024-09-12T17:37:01.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.931+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=INVVIT2QG3MF tag=18YFKEUWDPMB type=write size=3564009 2024-09-12T17:37:01.934 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.931+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=U699GLDAXYSH type=del size=2993361 2024-09-12T17:37:01.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.935+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~EQD4BHAU6MY6.0 size=349422 2024-09-12T17:37:01.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.939+0000 7f1ad43488c0 1 < completed multipart upload key=RH4HYE315U5Y upload=EQD4BHAU6MY6 tag=196DXLM5L0V5 type=write size=1397998 2024-09-12T17:37:01.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.939+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=BD97LO0WEF7I type=del size=3266780 2024-09-12T17:37:01.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.943+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~V3O4UC2L4OX1.0 size=874252 2024-09-12T17:37:01.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.947+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=V3O4UC2L4OX1 tag=2N1P143W20GP type=write size=1922828 2024-09-12T17:37:01.952 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.951+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=9TQBTDQYLUL9 type=write size=270689 2024-09-12T17:37:01.955 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.951+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~38JRT8DD1AUY.0 size=1048576 2024-09-12T17:37:01.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.955+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~38JRT8DD1AUY.1 size=209042 2024-09-12T17:37:01.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.959+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=38JRT8DD1AUY tag=IQTIO3A067YY type=write size=2306194 2024-09-12T17:37:01.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.959+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=1ZARFSBA2FK9 type=del size=2902880 2024-09-12T17:37:01.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.963+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~2RZ7DK2MIF12.0 size=575144 2024-09-12T17:37:01.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.967+0000 7f1ad43488c0 1 < completed multipart upload key=BCPDXAL027U2 upload=2RZ7DK2MIF12 tag=NFEZ1FKSZ3UQ type=write size=1623720 2024-09-12T17:37:01.974 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.971+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~0N32XFO8ZST7.0 size=1048576 2024-09-12T17:37:01.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.975+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~0N32XFO8ZST7.1 size=178509 2024-09-12T17:37:01.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.975+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=0N32XFO8ZST7 tag=32X8SRIU7064 type=write size=2275661 2024-09-12T17:37:01.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.975+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~2WSZ585WWDYR.0 size=1048576 2024-09-12T17:37:01.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.975+0000 7f1ad43488c0 1 < canceled part key=_multipart_ECEF8IJGU4Z8.2~2WSZ585WWDYR.1 size=1048576 2024-09-12T17:37:01.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.979+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~2WSZ585WWDYR.2 size=1036365 2024-09-12T17:37:01.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.983+0000 7f1ad43488c0 1 < canceled multipart upload key=ECEF8IJGU4Z8 upload=2WSZ585WWDYR tag=JGRWQNDJ0W6J type=write size=4182093 2024-09-12T17:37:01.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.983+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=WJJUNH1EGCXX type=del size=1121473 2024-09-12T17:37:01.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.987+0000 7f1ad43488c0 1 < canceled operation key=7RSHIZRKK2OY tag=J2MCWWB2041E type=del size=270613 2024-09-12T17:37:01.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.991+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~CGCM12CA65FM.0 size=459375 2024-09-12T17:37:01.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.991+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=CGCM12CA65FM tag=Q30NYCK71DU0 type=write size=1507951 2024-09-12T17:37:01.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.995+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~IZUC5P4F7CUV.0 size=1048576 2024-09-12T17:37:01.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.995+0000 7f1ad43488c0 1 < canceled part key=_multipart_SDJ53NSPOIRC.2~IZUC5P4F7CUV.1 size=324857 2024-09-12T17:37:01.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.999+0000 7f1ad43488c0 1 < canceled multipart upload key=SDJ53NSPOIRC upload=IZUC5P4F7CUV tag=WYAB866I8O9R type=write size=2422009 2024-09-12T17:37:02.002 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:01.999+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=RGVCP9TZ9OXY type=write size=611249 2024-09-12T17:37:02.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.003+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=90T3DPBKQTHW type=del 2024-09-12T17:37:02.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.003+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=1AU4PQIA7BHE type=del size=1170996 2024-09-12T17:37:02.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.011+0000 7f1ad43488c0 1 < suggested update operation key=GZ7LGZQHW4CY tag=NXPY1IOPS9EI type=write size=852753 2024-09-12T17:37:02.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.011+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=5TUTTB0OQM5W type=del size=3209083 2024-09-12T17:37:02.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.015+0000 7f1ad43488c0 1 < canceled operation key=7RSHIZRKK2OY tag=5RZP32WX1U3Q type=del size=575205 2024-09-12T17:37:02.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.019+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~BDTMNBAE361C.0 size=591714 2024-09-12T17:37:02.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.019+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=BDTMNBAE361C tag=8353LG63NH4D type=write size=1640290 2024-09-12T17:37:02.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.023+0000 7f1ad43488c0 1 < completed delete operation key=IY2AM7CJDUZG tag=4CXSP9T99PJS type=del 2024-09-12T17:37:02.030 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.027+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~KELV3NVH05EA.0 size=1048576 2024-09-12T17:37:02.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.031+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~KELV3NVH05EA.1 size=721370 2024-09-12T17:37:02.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.031+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=KELV3NVH05EA tag=E7EV2D7BCUC1 type=write size=2818522 2024-09-12T17:37:02.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.035+0000 7f1ad43488c0 1 < canceled operation key=6Z3F28JHHEQS tag=EAM0NQRVYZOQ type=del size=4062582 2024-09-12T17:37:02.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.039+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~HJS7QYQ0933L.0 size=1022780 2024-09-12T17:37:02.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.039+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=HJS7QYQ0933L tag=NVB8I7BWM18O type=write size=2071356 2024-09-12T17:37:02.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.039+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=3Y0NIIE71KMB type=del 2024-09-12T17:37:02.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.047+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~7MJ5CH5695VL.0 size=1048576 2024-09-12T17:37:02.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.047+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~7MJ5CH5695VL.1 size=547788 2024-09-12T17:37:02.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.047+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=7MJ5CH5695VL tag=G07XEWOJ1PRK type=write size=2644940 2024-09-12T17:37:02.053 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.051+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~8101G2WE2HQU.0 size=670644 2024-09-12T17:37:02.058 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.055+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=8101G2WE2HQU tag=025RACA01HZN type=write size=1719220 2024-09-12T17:37:02.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.059+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=ME7H2ACJ6QHF type=write size=513018 2024-09-12T17:37:02.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.059+0000 7f1ad43488c0 1 < completed write operation key=05PAFB226IFP tag=VZVPK2QOE23P type=write size=691039 2024-09-12T17:37:02.065 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.063+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=ZR3XLUTZBHBD type=del size=3413422 2024-09-12T17:37:02.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.067+0000 7f1ad43488c0 1 < suggested remove operation key=GWJ78NNXOL1R tag=U699GLDAXYSH type=del 2024-09-12T17:37:02.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.071+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=UCVWHXPHYRA4 type=del size=3212045 2024-09-12T17:37:02.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.075+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=BD97LO0WEF7I type=del 2024-09-12T17:37:02.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.079+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~47O5Z6VNQEJD.0 size=740867 2024-09-12T17:37:02.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.079+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=47O5Z6VNQEJD tag=KMDL7D9WWH1Q type=write size=1789443 2024-09-12T17:37:02.084 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.083+0000 7f1ad43488c0 1 < completed write operation key=XOEPYERWY6IT tag=9TQBTDQYLUL9 type=write size=270689 2024-09-12T17:37:02.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.087+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~MTQQ2W5TSTYY.0 size=1048576 2024-09-12T17:37:02.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.091+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~MTQQ2W5TSTYY.1 size=1048576 2024-09-12T17:37:02.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.091+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~MTQQ2W5TSTYY.2 size=55247 2024-09-12T17:37:02.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.091+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=MTQQ2W5TSTYY tag=11P47IJ7R46I type=write size=3200975 2024-09-12T17:37:02.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.095+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=1ZARFSBA2FK9 type=del 2024-09-12T17:37:02.102 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.099+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~7V6ER37CJZ52.0 size=1048576 2024-09-12T17:37:02.105 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.103+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~7V6ER37CJZ52.1 size=1048576 2024-09-12T17:37:02.107 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.107+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~7V6ER37CJZ52.2 size=636337 2024-09-12T17:37:02.107 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.107+0000 7f1ad43488c0 1 > prepared multipart upload key=3N1YT9TC0M3O upload=7V6ER37CJZ52 tag=ST2GS4U70OX9 type=write size=3782065 2024-09-12T17:37:02.110 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.107+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~0N32XFO8ZST7.0 size=1048576 2024-09-12T17:37:02.113 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.111+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~0N32XFO8ZST7.1 size=178509 2024-09-12T17:37:02.117 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.115+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=0N32XFO8ZST7 tag=32X8SRIU7064 type=write size=2275661 2024-09-12T17:37:02.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.119+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=R10SSSWM3TNB type=del size=1238686 2024-09-12T17:37:02.123 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.119+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=WJJUNH1EGCXX type=del 2024-09-12T17:37:02.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.123+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=T8GHHXZQ5LB8 type=del size=3686694 2024-09-12T17:37:02.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.127+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~CGCM12CA65FM.0 size=459375 2024-09-12T17:37:02.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.131+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=CGCM12CA65FM tag=Q30NYCK71DU0 type=write size=1507951 2024-09-12T17:37:02.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.135+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~QWAR81I3CGQG.0 size=52546 2024-09-12T17:37:02.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.135+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=QWAR81I3CGQG tag=MDN8YFA8E2IS type=write size=1101122 2024-09-12T17:37:02.140 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.139+0000 7f1ad43488c0 1 < completed write operation key=7RSHIZRKK2OY tag=RGVCP9TZ9OXY type=write size=611249 2024-09-12T17:37:02.143 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.139+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=48ABCSYCOJ6J type=del size=3144284 2024-09-12T17:37:02.145 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.143+0000 7f1ad43488c0 1 < completed delete operation key=0MV3GCBTWZD0 tag=1AU4PQIA7BHE type=del 2024-09-12T17:37:02.148 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.147+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=0U029PPO2J4D type=del size=1971930 2024-09-12T17:37:02.153 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.151+0000 7f1ad43488c0 1 < suggested remove operation key=7RSHIZRKK2OY tag=5TUTTB0OQM5W type=del 2024-09-12T17:37:02.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.155+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~F259YI7LA50O.0 size=1048576 2024-09-12T17:37:02.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.159+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~F259YI7LA50O.1 size=65161 2024-09-12T17:37:02.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.159+0000 7f1ad43488c0 1 > prepared multipart upload key=CHMM14VRIOQH upload=F259YI7LA50O tag=CWN35YHICTYZ type=write size=2162313 2024-09-12T17:37:02.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.159+0000 7f1ad43488c0 1 < completed part key=_multipart_8U3L46JDJ8VS.2~BDTMNBAE361C.0 size=591714 2024-09-12T17:37:02.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.167+0000 7f1ad43488c0 1 < completed multipart upload key=8U3L46JDJ8VS upload=BDTMNBAE361C tag=8353LG63NH4D type=write size=1640290 2024-09-12T17:37:02.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.171+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~8NDOJIC4QIIW.0 size=210992 2024-09-12T17:37:02.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.171+0000 7f1ad43488c0 1 > prepared multipart upload key=9Z2EHQA8T5F4 upload=8NDOJIC4QIIW tag=M2IMC4SIRLIB type=write size=1259568 2024-09-12T17:37:02.175 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.175+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~KELV3NVH05EA.0 size=1048576 2024-09-12T17:37:02.178 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.175+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~KELV3NVH05EA.1 size=721370 2024-09-12T17:37:02.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.183+0000 7f1ad43488c0 1 < completed multipart upload key=WWB6LAHAMIR9 upload=KELV3NVH05EA tag=E7EV2D7BCUC1 type=write size=2818522 2024-09-12T17:37:02.186 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.183+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=DAC56EPU5B3S type=del size=3711105 2024-09-12T17:37:02.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.187+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~HJS7QYQ0933L.0 size=1022780 2024-09-12T17:37:02.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.191+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=HJS7QYQ0933L tag=NVB8I7BWM18O type=write size=2071356 2024-09-12T17:37:02.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.195+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=TRIAS4EUHRMZ type=del size=2333145 2024-09-12T17:37:02.201 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.199+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~7MJ5CH5695VL.0 size=1048576 2024-09-12T17:37:02.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.203+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~7MJ5CH5695VL.1 size=547788 2024-09-12T17:37:02.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.207+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=7MJ5CH5695VL tag=G07XEWOJ1PRK type=write size=2644940 2024-09-12T17:37:02.212 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.211+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=P6MXK7YAFKUE type=del size=3383435 2024-09-12T17:37:02.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.215+0000 7f1ad43488c0 1 < suggested remove operation key=3N1YT9TC0M3O tag=ME7H2ACJ6QHF type=write 2024-09-12T17:37:02.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.219+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=86RB8YPYYEUL type=del size=2411247 2024-09-12T17:37:02.229 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.227+0000 7f1ad43488c0 1 < suggested remove operation key=CHMM14VRIOQH tag=ZR3XLUTZBHBD type=del 2024-09-12T17:37:02.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.231+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=8GI89LBTIGBK type=del size=3136793 2024-09-12T17:37:02.236 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.231+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=UCVWHXPHYRA4 type=del 2024-09-12T17:37:02.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.239+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~PUGSE674C48I.0 size=740944 2024-09-12T17:37:02.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.239+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=PUGSE674C48I tag=GRCK1FYY6EUW type=write size=1789520 2024-09-12T17:37:02.242 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.239+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~47O5Z6VNQEJD.0 size=740867 2024-09-12T17:37:02.246 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.243+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=47O5Z6VNQEJD tag=KMDL7D9WWH1Q type=write size=1789443 2024-09-12T17:37:02.249 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.247+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=3DMARH3NVX8V type=del size=2170687 2024-09-12T17:37:02.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.251+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~MTQQ2W5TSTYY.0 size=1048576 2024-09-12T17:37:02.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.251+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~MTQQ2W5TSTYY.1 size=1048576 2024-09-12T17:37:02.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.251+0000 7f1ad43488c0 1 < canceled part key=_multipart_X0HT3K3OREL7.2~MTQQ2W5TSTYY.2 size=55247 2024-09-12T17:37:02.258 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.255+0000 7f1ad43488c0 1 < canceled multipart upload key=X0HT3K3OREL7 upload=MTQQ2W5TSTYY tag=11P47IJ7R46I type=write size=3200975 2024-09-12T17:37:02.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.259+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=5K7FSU77IPPI type=del size=2523778 2024-09-12T17:37:02.264 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.263+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~7V6ER37CJZ52.0 size=1048576 2024-09-12T17:37:02.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.263+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~7V6ER37CJZ52.1 size=1048576 2024-09-12T17:37:02.268 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.267+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~7V6ER37CJZ52.2 size=636337 2024-09-12T17:37:02.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.271+0000 7f1ad43488c0 1 < completed multipart upload key=3N1YT9TC0M3O upload=7V6ER37CJZ52 tag=ST2GS4U70OX9 type=write size=3782065 2024-09-12T17:37:02.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.271+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=X5G8V53XQ23V type=del size=2595362 2024-09-12T17:37:02.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.275+0000 7f1ad43488c0 1 < completed delete operation key=MB3FVGKV0ZNQ tag=R10SSSWM3TNB type=del 2024-09-12T17:37:02.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.279+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=7YU5LM072XPD type=del size=3073202 2024-09-12T17:37:02.283 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.283+0000 7f1ad43488c0 1 < completed delete operation key=NHOG1WG3VT6N tag=T8GHHXZQ5LB8 type=del 2024-09-12T17:37:02.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.287+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~54Z99JBZH824.0 size=1048576 2024-09-12T17:37:02.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.287+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~54Z99JBZH824.1 size=1048576 2024-09-12T17:37:02.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.291+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~54Z99JBZH824.2 size=923710 2024-09-12T17:37:02.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.291+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=54Z99JBZH824 tag=JA4E745RKJUX type=write size=4069438 2024-09-12T17:37:02.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.295+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~QWAR81I3CGQG.0 size=52546 2024-09-12T17:37:02.301 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.299+0000 7f1ad43488c0 1 < completed multipart upload key=WWB6LAHAMIR9 upload=QWAR81I3CGQG tag=MDN8YFA8E2IS type=write size=1101122 2024-09-12T17:37:02.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.303+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=PR9FXBCM0STF type=del size=1373325 2024-09-12T17:37:02.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.307+0000 7f1ad43488c0 1 < suggested remove operation key=ECEF8IJGU4Z8 tag=48ABCSYCOJ6J type=del 2024-09-12T17:37:02.312 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.311+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=3130V1BWN2WP type=del size=3853619 2024-09-12T17:37:02.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.311+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=0U029PPO2J4D type=del 2024-09-12T17:37:02.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.315+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=GO1BKL1RK7N9 type=del size=780875 2024-09-12T17:37:02.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.319+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~F259YI7LA50O.0 size=1048576 2024-09-12T17:37:02.323 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.319+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~F259YI7LA50O.1 size=65161 2024-09-12T17:37:02.328 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.327+0000 7f1ad43488c0 1 < completed multipart upload key=CHMM14VRIOQH upload=F259YI7LA50O tag=CWN35YHICTYZ type=write size=2162313 2024-09-12T17:37:02.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.331+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~JH2VAQG0KHYF.0 size=1048576 2024-09-12T17:37:02.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.335+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~JH2VAQG0KHYF.1 size=29333 2024-09-12T17:37:02.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.335+0000 7f1ad43488c0 1 > prepared multipart upload key=9Z2EHQA8T5F4 upload=JH2VAQG0KHYF tag=09MA1KM7JBL9 type=write size=2126485 2024-09-12T17:37:02.339 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.339+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~8NDOJIC4QIIW.0 size=210992 2024-09-12T17:37:02.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.343+0000 7f1ad43488c0 1 < completed multipart upload key=9Z2EHQA8T5F4 upload=8NDOJIC4QIIW tag=M2IMC4SIRLIB type=write size=1259568 2024-09-12T17:37:02.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.347+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=J0DCSUVEEUVE type=del size=691398 2024-09-12T17:37:02.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.347+0000 7f1ad43488c0 -1 < failed to complete operation key=ECEF8IJGU4Z8 tag=DAC56EPU5B3S type=del size=3711105: (22) Invalid argument 2024-09-12T17:37:02.354 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.351+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=VV2A15L8JMXQ type=write size=852614 2024-09-12T17:37:02.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.355+0000 7f1ad43488c0 1 < completed delete operation key=IY2AM7CJDUZG tag=TRIAS4EUHRMZ type=del 2024-09-12T17:37:02.360 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.359+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=CFWD0V7DYLJA type=del size=2112660 2024-09-12T17:37:02.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.363+0000 7f1ad43488c0 1 < suggested update operation key=SDJ53NSPOIRC tag=P6MXK7YAFKUE type=del size=3383435 2024-09-12T17:37:02.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.367+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=HHXSTDH1CWSQ type=del size=2934346 2024-09-12T17:37:02.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.371+0000 7f1ad43488c0 1 < suggested remove operation key=4QO60GZ9V0GK tag=86RB8YPYYEUL type=del 2024-09-12T17:37:02.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.375+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=NC1BT8HAT97M type=del size=3125235 2024-09-12T17:37:02.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.375+0000 7f1ad43488c0 1 < completed delete operation key=9Z2EHQA8T5F4 tag=8GI89LBTIGBK type=del 2024-09-12T17:37:02.381 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.379+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=HIP755E0BSY8 type=del size=3992794 2024-09-12T17:37:02.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.383+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~PUGSE674C48I.0 size=740944 2024-09-12T17:37:02.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.383+0000 7f1ad43488c0 1 < completed multipart upload key=IY2AM7CJDUZG upload=PUGSE674C48I tag=GRCK1FYY6EUW type=write size=1789520 2024-09-12T17:37:02.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.387+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=B6GOUGJSIQXL type=del size=1038038 2024-09-12T17:37:02.391 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.391+0000 7f1ad43488c0 1 < completed delete operation key=SIZ0Z1KWTGUJ tag=3DMARH3NVX8V type=del 2024-09-12T17:37:02.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.395+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~91RZVMPFV1IL.0 size=109828 2024-09-12T17:37:02.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.395+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=91RZVMPFV1IL tag=GE9UK9V18VI2 type=write size=1158404 2024-09-12T17:37:02.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.395+0000 7f1ad43488c0 1 < completed delete operation key=05PAFB226IFP tag=5K7FSU77IPPI type=del 2024-09-12T17:37:02.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.399+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=EBCRC228C40U type=write size=156752 2024-09-12T17:37:02.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.399+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=X5G8V53XQ23V type=del 2024-09-12T17:37:02.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.403+0000 7f1ad43488c0 1 > prepared operation key=0MV3GCBTWZD0 tag=BDDYZ7EGSQ7R type=write size=489546 2024-09-12T17:37:02.407 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.407+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=7YU5LM072XPD type=del 2024-09-12T17:37:02.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.411+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~ADLAP91O4RJJ.0 size=1048576 2024-09-12T17:37:02.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.411+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~ADLAP91O4RJJ.1 size=945670 2024-09-12T17:37:02.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.411+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=ADLAP91O4RJJ tag=DWX54AXZ4KI3 type=write size=3042822 2024-09-12T17:37:02.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.411+0000 7f1ad43488c0 1 < canceled part key=_multipart_6Z3F28JHHEQS.2~54Z99JBZH824.0 size=1048576 2024-09-12T17:37:02.416 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.415+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~54Z99JBZH824.1 size=1048576 2024-09-12T17:37:02.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.415+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~54Z99JBZH824.2 size=923710 2024-09-12T17:37:02.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.419+0000 7f1ad43488c0 1 < canceled multipart upload key=6Z3F28JHHEQS upload=54Z99JBZH824 tag=JA4E745RKJUX type=write size=4069438 2024-09-12T17:37:02.424 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.423+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=9UNS0GW5CEFG type=del size=1876418 2024-09-12T17:37:02.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.423+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=PR9FXBCM0STF type=del 2024-09-12T17:37:02.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.431+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~EPWJ66CRXIAI.0 size=1048576 2024-09-12T17:37:02.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.431+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~EPWJ66CRXIAI.1 size=1048576 2024-09-12T17:37:02.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.435+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~EPWJ66CRXIAI.2 size=705580 2024-09-12T17:37:02.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.435+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=EPWJ66CRXIAI tag=YJT1PCWI3GLD type=write size=3851308 2024-09-12T17:37:02.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.435+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=3130V1BWN2WP type=del 2024-09-12T17:37:02.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.439+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=8T48DU7MH18Y type=del size=1666796 2024-09-12T17:37:02.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.443+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=GO1BKL1RK7N9 type=del 2024-09-12T17:37:02.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.443+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=GWUMUGSU6KRJ type=del size=1199992 2024-09-12T17:37:02.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.443+0000 7f1ad43488c0 1 < canceled part key=_multipart_9Z2EHQA8T5F4.2~JH2VAQG0KHYF.0 size=1048576 2024-09-12T17:37:02.449 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.447+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~JH2VAQG0KHYF.1 size=29333 2024-09-12T17:37:02.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.451+0000 7f1ad43488c0 1 < canceled multipart upload key=9Z2EHQA8T5F4 upload=JH2VAQG0KHYF tag=09MA1KM7JBL9 type=write size=2126485 2024-09-12T17:37:02.460 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.459+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~LOX9ZSGT5JZ5.0 size=1048576 2024-09-12T17:37:02.462 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.459+0000 7f1ad43488c0 1 > prepared part key=_multipart_RH4HYE315U5Y.2~LOX9ZSGT5JZ5.1 size=139725 2024-09-12T17:37:02.462 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.459+0000 7f1ad43488c0 1 > prepared multipart upload key=RH4HYE315U5Y upload=LOX9ZSGT5JZ5 tag=GCPRLPTUNWGJ type=write size=2236877 2024-09-12T17:37:02.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.463+0000 7f1ad43488c0 1 < completed delete operation key=MB3FVGKV0ZNQ tag=J0DCSUVEEUVE type=del 2024-09-12T17:37:02.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.467+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=CEIQMYPCFS3S type=del size=3295027 2024-09-12T17:37:02.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.471+0000 7f1ad43488c0 1 < completed write operation key=6Z3F28JHHEQS tag=VV2A15L8JMXQ type=write size=852614 2024-09-12T17:37:02.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.475+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=2MN531WP6A6F type=del size=769520 2024-09-12T17:37:02.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.475+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=CFWD0V7DYLJA type=del 2024-09-12T17:37:02.487 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.483+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~49DUX597H587.0 size=1048576 2024-09-12T17:37:02.489 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.487+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~49DUX597H587.1 size=1048576 2024-09-12T17:37:02.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.491+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~49DUX597H587.2 size=372387 2024-09-12T17:37:02.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.491+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=49DUX597H587 tag=WC055DXFT07V type=write size=3518115 2024-09-12T17:37:02.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.491+0000 7f1ad43488c0 1 < completed delete operation key=PKC1RR4FZWE0 tag=HHXSTDH1CWSQ type=del 2024-09-12T17:37:02.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.495+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=MK7O6LD174Y3 type=del size=1911850 2024-09-12T17:37:02.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.499+0000 7f1ad43488c0 1 < canceled operation key=GWJ78NNXOL1R tag=NC1BT8HAT97M type=del size=3125235 2024-09-12T17:37:02.504 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.503+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=RV0E1XG1OFAI type=del size=1181190 2024-09-12T17:37:02.507 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.503+0000 7f1ad43488c0 1 < completed delete operation key=WWB6LAHAMIR9 tag=HIP755E0BSY8 type=del 2024-09-12T17:37:02.509 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.507+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=9RDAP1EKW52K type=del size=3730859 2024-09-12T17:37:02.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.511+0000 7f1ad43488c0 1 < completed delete operation key=MB3FVGKV0ZNQ tag=B6GOUGJSIQXL type=del 2024-09-12T17:37:02.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.511+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=FQFHLJJ07R3N type=del size=3270115 2024-09-12T17:37:02.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.515+0000 7f1ad43488c0 1 < canceled part key=_multipart_PKC1RR4FZWE0.2~91RZVMPFV1IL.0 size=109828 2024-09-12T17:37:02.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.519+0000 7f1ad43488c0 1 < canceled multipart upload key=PKC1RR4FZWE0 upload=91RZVMPFV1IL tag=GE9UK9V18VI2 type=write size=1158404 2024-09-12T17:37:02.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.523+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=7K89A767GTJZ type=del size=3485222 2024-09-12T17:37:02.527 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.523+0000 7f1ad43488c0 1 < completed write operation key=CHMM14VRIOQH tag=EBCRC228C40U type=write size=156752 2024-09-12T17:37:02.529 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.527+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=YYZUAPNGURPM type=del size=2299176 2024-09-12T17:37:02.532 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.531+0000 7f1ad43488c0 1 < canceled operation key=0MV3GCBTWZD0 tag=BDDYZ7EGSQ7R type=write size=489546 2024-09-12T17:37:02.538 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.535+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~CZWH3R245FZA.0 size=645227 2024-09-12T17:37:02.538 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.535+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=CZWH3R245FZA tag=BUT0ZQF57ANM type=write size=1693803 2024-09-12T17:37:02.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.539+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~ADLAP91O4RJJ.0 size=1048576 2024-09-12T17:37:02.543 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.543+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~ADLAP91O4RJJ.1 size=945670 2024-09-12T17:37:02.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.547+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=ADLAP91O4RJJ tag=DWX54AXZ4KI3 type=write size=3042822 2024-09-12T17:37:02.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.547+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=P72MZY8R3A7T type=del size=135049 2024-09-12T17:37:02.553 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.551+0000 7f1ad43488c0 1 < canceled operation key=PKC1RR4FZWE0 tag=9UNS0GW5CEFG type=del size=1876418 2024-09-12T17:37:02.558 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.555+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~LTNXJVMUJODC.0 size=409411 2024-09-12T17:37:02.558 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.555+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=LTNXJVMUJODC tag=LGKHHGPSTG59 type=write size=1457987 2024-09-12T17:37:02.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.559+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~EPWJ66CRXIAI.0 size=1048576 2024-09-12T17:37:02.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.563+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~EPWJ66CRXIAI.1 size=1048576 2024-09-12T17:37:02.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.563+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~EPWJ66CRXIAI.2 size=705580 2024-09-12T17:37:02.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.567+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=EPWJ66CRXIAI tag=YJT1PCWI3GLD type=write size=3851308 2024-09-12T17:37:02.572 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.571+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=WKE5UUT9JXVR type=del size=4126611 2024-09-12T17:37:02.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.571+0000 7f1ad43488c0 1 < completed delete operation key=X0HT3K3OREL7 tag=8T48DU7MH18Y type=del 2024-09-12T17:37:02.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.579+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~6AO9UXQWILYC.0 size=1048576 2024-09-12T17:37:02.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.579+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~6AO9UXQWILYC.1 size=1048576 2024-09-12T17:37:02.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.583+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~6AO9UXQWILYC.2 size=766517 2024-09-12T17:37:02.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.583+0000 7f1ad43488c0 1 > prepared multipart upload key=ZHFRKX9YY8P5 upload=6AO9UXQWILYC tag=WYON22RCJXF5 type=write size=3912245 2024-09-12T17:37:02.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.587+0000 7f1ad43488c0 1 < suggested update operation key=RH4HYE315U5Y tag=GWUMUGSU6KRJ type=del size=1199992 2024-09-12T17:37:02.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.591+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~H51MCLIVFOYF.0 size=1048576 2024-09-12T17:37:02.597 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.595+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~H51MCLIVFOYF.1 size=509615 2024-09-12T17:37:02.597 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.595+0000 7f1ad43488c0 1 > prepared multipart upload key=SIZ0Z1KWTGUJ upload=H51MCLIVFOYF tag=YGXB8HF0X158 type=write size=2606767 2024-09-12T17:37:02.600 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.599+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~LOX9ZSGT5JZ5.0 size=1048576 2024-09-12T17:37:02.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.599+0000 7f1ad43488c0 1 < completed part key=_multipart_RH4HYE315U5Y.2~LOX9ZSGT5JZ5.1 size=139725 2024-09-12T17:37:02.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.607+0000 7f1ad43488c0 1 < completed multipart upload key=RH4HYE315U5Y upload=LOX9ZSGT5JZ5 tag=GCPRLPTUNWGJ type=write size=2236877 2024-09-12T17:37:02.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.611+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~GCBF64X1FL2T.0 size=1048576 2024-09-12T17:37:02.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.615+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~GCBF64X1FL2T.1 size=89372 2024-09-12T17:37:02.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.615+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=GCBF64X1FL2T tag=61BEGPPHYTDP type=write size=2186524 2024-09-12T17:37:02.619 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.619+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=CEIQMYPCFS3S type=del 2024-09-12T17:37:02.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.623+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~T2ENT60XAJF6.0 size=1048576 2024-09-12T17:37:02.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.627+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~T2ENT60XAJF6.1 size=1048576 2024-09-12T17:37:02.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.627+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~T2ENT60XAJF6.2 size=55829 2024-09-12T17:37:02.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.627+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=T2ENT60XAJF6 tag=6TWQZTJF4TMR type=write size=3201557 2024-09-12T17:37:02.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.631+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=2MN531WP6A6F type=del 2024-09-12T17:37:02.637 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.635+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=C4BHOE2ZWIAO type=del size=3817163 2024-09-12T17:37:02.641 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.639+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~49DUX597H587.0 size=1048576 2024-09-12T17:37:02.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.643+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~49DUX597H587.1 size=1048576 2024-09-12T17:37:02.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.643+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~49DUX597H587.2 size=372387 2024-09-12T17:37:02.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.651+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=49DUX597H587 tag=WC055DXFT07V type=write size=3518115 2024-09-12T17:37:02.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.655+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~JUTMKJPY63K2.0 size=1048576 2024-09-12T17:37:02.659 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.659+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~JUTMKJPY63K2.1 size=1048576 2024-09-12T17:37:02.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.659+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~JUTMKJPY63K2.2 size=46654 2024-09-12T17:37:02.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.659+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=JUTMKJPY63K2 tag=KB2SCY8IP7MS type=write size=3192382 2024-09-12T17:37:02.668 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.667+0000 7f1ad43488c0 1 < suggested remove operation key=RXJJOPR32OD5 tag=MK7O6LD174Y3 type=del 2024-09-12T17:37:02.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.671+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~UJ8FFNN7LZ2J.0 size=968922 2024-09-12T17:37:02.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.671+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=UJ8FFNN7LZ2J tag=PUO7JPIC2N7J type=write size=2017498 2024-09-12T17:37:02.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.675+0000 7f1ad43488c0 1 < completed delete operation key=GWJ78NNXOL1R tag=RV0E1XG1OFAI type=del 2024-09-12T17:37:02.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.675+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=23QK4M0PZC71 type=write size=674491 2024-09-12T17:37:02.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.679+0000 7f1ad43488c0 1 < completed delete operation key=ZHFRKX9YY8P5 tag=9RDAP1EKW52K type=del 2024-09-12T17:37:02.685 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.683+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=87XLKDDB7OGZ type=write size=362846 2024-09-12T17:37:02.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.691+0000 7f1ad43488c0 1 < suggested update operation key=ECEF8IJGU4Z8 tag=FQFHLJJ07R3N type=del size=3270115 2024-09-12T17:37:02.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.691+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=H0ZY3PJU4V20 type=del size=2169497 2024-09-12T17:37:02.697 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.695+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=7K89A767GTJZ type=del 2024-09-12T17:37:02.703 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.699+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~NJ522ORTS7VE.0 size=1048576 2024-09-12T17:37:02.705 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.703+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~NJ522ORTS7VE.1 size=945153 2024-09-12T17:37:02.705 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.703+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=NJ522ORTS7VE tag=SQNTTG5UKLVB type=write size=3042305 2024-09-12T17:37:02.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.707+0000 7f1ad43488c0 1 < canceled operation key=7RSHIZRKK2OY tag=YYZUAPNGURPM type=del size=2299176 2024-09-12T17:37:02.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.707+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=BVL528M6ZQLC type=del size=2781150 2024-09-12T17:37:02.713 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.711+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~CZWH3R245FZA.0 size=645227 2024-09-12T17:37:02.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.715+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=CZWH3R245FZA tag=BUT0ZQF57ANM type=write size=1693803 2024-09-12T17:37:02.724 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.723+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~T00S2ZI6L0CL.0 size=1048576 2024-09-12T17:37:02.726 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.723+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~T00S2ZI6L0CL.1 size=931158 2024-09-12T17:37:02.726 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.723+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=T00S2ZI6L0CL tag=LEUXZUMN1UM6 type=write size=3028310 2024-09-12T17:37:02.729 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.727+0000 7f1ad43488c0 1 < canceled operation key=LU7XIBO5YUOR tag=P72MZY8R3A7T type=del size=135049 2024-09-12T17:37:02.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.735+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~0QHX7DYNED52.0 size=1048576 2024-09-12T17:37:02.738 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.735+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~0QHX7DYNED52.1 size=727092 2024-09-12T17:37:02.738 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.735+0000 7f1ad43488c0 1 > prepared multipart upload key=SIZ0Z1KWTGUJ upload=0QHX7DYNED52 tag=8WK0D6MTC6O2 type=write size=2824244 2024-09-12T17:37:02.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.739+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~LTNXJVMUJODC.0 size=409411 2024-09-12T17:37:02.746 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.743+0000 7f1ad43488c0 1 < completed multipart upload key=MB3FVGKV0ZNQ upload=LTNXJVMUJODC tag=LGKHHGPSTG59 type=write size=1457987 2024-09-12T17:37:02.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.751+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~YTLTJFV09F9R.0 size=1030704 2024-09-12T17:37:02.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.751+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=YTLTJFV09F9R tag=PN38E3HZOWQS type=write size=2079280 2024-09-12T17:37:02.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.755+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=WKE5UUT9JXVR type=del 2024-09-12T17:37:02.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.759+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=CCEA3J2NCYBJ type=del size=945630 2024-09-12T17:37:02.765 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.763+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~6AO9UXQWILYC.0 size=1048576 2024-09-12T17:37:02.767 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.767+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~6AO9UXQWILYC.1 size=1048576 2024-09-12T17:37:02.770 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.767+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~6AO9UXQWILYC.2 size=766517 2024-09-12T17:37:02.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.771+0000 7f1ad43488c0 1 < completed multipart upload key=ZHFRKX9YY8P5 upload=6AO9UXQWILYC tag=WYON22RCJXF5 type=write size=3912245 2024-09-12T17:37:02.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.775+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~9L87E019WHZ0.0 size=834328 2024-09-12T17:37:02.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.775+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=9L87E019WHZ0 tag=VFFDH1KCTZQN type=write size=1882904 2024-09-12T17:37:02.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.779+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~H51MCLIVFOYF.0 size=1048576 2024-09-12T17:37:02.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.783+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~H51MCLIVFOYF.1 size=509615 2024-09-12T17:37:02.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.787+0000 7f1ad43488c0 1 < completed multipart upload key=SIZ0Z1KWTGUJ upload=H51MCLIVFOYF tag=YGXB8HF0X158 type=write size=2606767 2024-09-12T17:37:02.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.791+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=TZ17VSIX1BBC type=del size=2168257 2024-09-12T17:37:02.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.791+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~GCBF64X1FL2T.0 size=1048576 2024-09-12T17:37:02.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.795+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~GCBF64X1FL2T.1 size=89372 2024-09-12T17:37:02.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.799+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=GCBF64X1FL2T tag=61BEGPPHYTDP type=write size=2186524 2024-09-12T17:37:02.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.803+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=EFMMNH0ZJX42 type=del size=3754720 2024-09-12T17:37:02.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.807+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~T2ENT60XAJF6.0 size=1048576 2024-09-12T17:37:02.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.807+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~T2ENT60XAJF6.1 size=1048576 2024-09-12T17:37:02.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.811+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~T2ENT60XAJF6.2 size=55829 2024-09-12T17:37:02.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.815+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=T2ENT60XAJF6 tag=6TWQZTJF4TMR type=write size=3201557 2024-09-12T17:37:02.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.819+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~HCMRLWSY8FQ9.0 size=1048576 2024-09-12T17:37:02.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.823+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~HCMRLWSY8FQ9.1 size=644146 2024-09-12T17:37:02.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.823+0000 7f1ad43488c0 1 > prepared multipart upload key=C7QSOK3D3IWJ upload=HCMRLWSY8FQ9 tag=4K0WK0VR1U87 type=write size=2741298 2024-09-12T17:37:02.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.827+0000 7f1ad43488c0 1 < suggested remove operation key=C7QSOK3D3IWJ tag=C4BHOE2ZWIAO type=del 2024-09-12T17:37:02.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.831+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~SWN08YTSZJHJ.0 size=1048576 2024-09-12T17:37:02.836 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.835+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~SWN08YTSZJHJ.1 size=1048576 2024-09-12T17:37:02.838 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.835+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~SWN08YTSZJHJ.2 size=1011648 2024-09-12T17:37:02.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.835+0000 7f1ad43488c0 1 > prepared multipart upload key=NHOG1WG3VT6N upload=SWN08YTSZJHJ tag=Q2PN917H7ILD type=write size=4157376 2024-09-12T17:37:02.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.839+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~JUTMKJPY63K2.0 size=1048576 2024-09-12T17:37:02.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.843+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~JUTMKJPY63K2.1 size=1048576 2024-09-12T17:37:02.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.843+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~JUTMKJPY63K2.2 size=46654 2024-09-12T17:37:02.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.847+0000 7f1ad43488c0 1 < completed multipart upload key=MB3FVGKV0ZNQ upload=JUTMKJPY63K2 tag=KB2SCY8IP7MS type=write size=3192382 2024-09-12T17:37:02.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.851+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=32LV5T0ENMIB type=del size=2823300 2024-09-12T17:37:02.855 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.851+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~UJ8FFNN7LZ2J.0 size=968922 2024-09-12T17:37:02.860 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.859+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=UJ8FFNN7LZ2J tag=PUO7JPIC2N7J type=write size=2017498 2024-09-12T17:37:02.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.863+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=OROEZRORA32Z type=del size=445619 2024-09-12T17:37:02.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.867+0000 7f1ad43488c0 1 < suggested update operation key=MB3FVGKV0ZNQ tag=23QK4M0PZC71 type=write size=674491 2024-09-12T17:37:02.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.871+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=B0MO7PFZYX14 type=del size=454663 2024-09-12T17:37:02.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.871+0000 7f1ad43488c0 1 < completed write operation key=SDJ53NSPOIRC tag=87XLKDDB7OGZ type=write size=362846 2024-09-12T17:37:02.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.875+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=CDH31FETNPHW type=del size=796539 2024-09-12T17:37:02.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.879+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=H0ZY3PJU4V20 type=del 2024-09-12T17:37:02.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.883+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~OV7I2NHFL9Q0.0 size=1048576 2024-09-12T17:37:02.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.883+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~OV7I2NHFL9Q0.1 size=513349 2024-09-12T17:37:02.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.883+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=OV7I2NHFL9Q0 tag=TWX5EB968V1I type=write size=2610501 2024-09-12T17:37:02.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.887+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~NJ522ORTS7VE.0 size=1048576 2024-09-12T17:37:02.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.891+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~NJ522ORTS7VE.1 size=945153 2024-09-12T17:37:02.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.895+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=NJ522ORTS7VE tag=SQNTTG5UKLVB type=write size=3042305 2024-09-12T17:37:02.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.899+0000 7f1ad43488c0 1 > prepared operation key=9Z2EHQA8T5F4 tag=65PF93QBJHD9 type=write size=11683 2024-09-12T17:37:02.902 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.899+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=BVL528M6ZQLC type=del 2024-09-12T17:37:02.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.903+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=6H5LJDNYABQG type=del size=379774 2024-09-12T17:37:02.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.907+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~T00S2ZI6L0CL.0 size=1048576 2024-09-12T17:37:02.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.907+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~T00S2ZI6L0CL.1 size=931158 2024-09-12T17:37:02.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.911+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=T00S2ZI6L0CL tag=LEUXZUMN1UM6 type=write size=3028310 2024-09-12T17:37:02.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.915+0000 7f1ad43488c0 1 > prepared operation key=ECEF8IJGU4Z8 tag=35LHRXUBN6J7 type=write size=34920 2024-09-12T17:37:02.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.919+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~0QHX7DYNED52.0 size=1048576 2024-09-12T17:37:02.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.923+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~0QHX7DYNED52.1 size=727092 2024-09-12T17:37:02.927 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.927+0000 7f1ad43488c0 1 < completed multipart upload key=SIZ0Z1KWTGUJ upload=0QHX7DYNED52 tag=8WK0D6MTC6O2 type=write size=2824244 2024-09-12T17:37:02.933 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.931+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~916D29H3W40E.0 size=1048576 2024-09-12T17:37:02.935 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.935+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~916D29H3W40E.1 size=108926 2024-09-12T17:37:02.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.935+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=916D29H3W40E tag=69GPAAW28CA5 type=write size=2206078 2024-09-12T17:37:02.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.935+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~YTLTJFV09F9R.0 size=1030704 2024-09-12T17:37:02.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.943+0000 7f1ad43488c0 1 < completed multipart upload key=X078SB1ITNII upload=YTLTJFV09F9R tag=PN38E3HZOWQS type=write size=2079280 2024-09-12T17:37:02.948 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.947+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~VOT9PFZSH8MM.0 size=598268 2024-09-12T17:37:02.948 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.947+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=VOT9PFZSH8MM tag=E0ZF2HESMHGL type=write size=1646844 2024-09-12T17:37:02.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.951+0000 7f1ad43488c0 1 < suggested update operation key=CHMM14VRIOQH tag=CCEA3J2NCYBJ type=del size=945630 2024-09-12T17:37:02.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.955+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~PZ97RP11VYAY.0 size=1048576 2024-09-12T17:37:02.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.959+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~PZ97RP11VYAY.1 size=1048576 2024-09-12T17:37:02.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.963+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~PZ97RP11VYAY.2 size=583541 2024-09-12T17:37:02.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.963+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=PZ97RP11VYAY tag=DQ6DU73TZAH8 type=write size=3729269 2024-09-12T17:37:02.967 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.967+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~9L87E019WHZ0.0 size=834328 2024-09-12T17:37:02.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.971+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=9L87E019WHZ0 tag=VFFDH1KCTZQN type=write size=1882904 2024-09-12T17:37:02.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.975+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=EM1ZJ96J2ZFP type=del size=336872 2024-09-12T17:37:02.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.979+0000 7f1ad43488c0 1 < suggested remove operation key=CHMM14VRIOQH tag=TZ17VSIX1BBC type=del 2024-09-12T17:37:02.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.983+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=QF4G3BFDJ8FF type=del size=2371278 2024-09-12T17:37:02.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.987+0000 7f1ad43488c0 1 < completed delete operation key=2SDYAQRNWAJK tag=EFMMNH0ZJX42 type=del 2024-09-12T17:37:02.990 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.987+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=EOJ2XPPUWMWI type=del size=3537501 2024-09-12T17:37:02.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.991+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~HCMRLWSY8FQ9.0 size=1048576 2024-09-12T17:37:02.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.995+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~HCMRLWSY8FQ9.1 size=644146 2024-09-12T17:37:03.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:02.999+0000 7f1ad43488c0 1 < completed multipart upload key=C7QSOK3D3IWJ upload=HCMRLWSY8FQ9 tag=4K0WK0VR1U87 type=write size=2741298 2024-09-12T17:37:03.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.003+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~GPLY5S532I0Y.0 size=1048576 2024-09-12T17:37:03.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.007+0000 7f1ad43488c0 1 > prepared part key=_multipart_9Z2EHQA8T5F4.2~GPLY5S532I0Y.1 size=391921 2024-09-12T17:37:03.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.007+0000 7f1ad43488c0 1 > prepared multipart upload key=9Z2EHQA8T5F4 upload=GPLY5S532I0Y tag=G0N13ARVTFUI type=write size=2489073 2024-09-12T17:37:03.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.011+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~SWN08YTSZJHJ.0 size=1048576 2024-09-12T17:37:03.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.011+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~SWN08YTSZJHJ.1 size=1048576 2024-09-12T17:37:03.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.015+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~SWN08YTSZJHJ.2 size=1011648 2024-09-12T17:37:03.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.023+0000 7f1ad43488c0 1 < completed multipart upload key=NHOG1WG3VT6N upload=SWN08YTSZJHJ tag=Q2PN917H7ILD type=write size=4157376 2024-09-12T17:37:03.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.031+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~OPQ3Z7VDZNJR.0 size=1048576 2024-09-12T17:37:03.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.031+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~OPQ3Z7VDZNJR.1 size=1048576 2024-09-12T17:37:03.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.035+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~OPQ3Z7VDZNJR.2 size=1038539 2024-09-12T17:37:03.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.035+0000 7f1ad43488c0 1 > prepared multipart upload key=Y3NQLDWQJ37Z upload=OPQ3Z7VDZNJR tag=SINLBOEBYKC8 type=write size=4184267 2024-09-12T17:37:03.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.039+0000 7f1ad43488c0 1 < canceled operation key=9Z2EHQA8T5F4 tag=32LV5T0ENMIB type=del size=2823300 2024-09-12T17:37:03.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.043+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~U2Z9ECWH4CQ9.0 size=1048576 2024-09-12T17:37:03.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.047+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~U2Z9ECWH4CQ9.1 size=428510 2024-09-12T17:37:03.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.047+0000 7f1ad43488c0 1 > prepared multipart upload key=C7QSOK3D3IWJ upload=U2Z9ECWH4CQ9 tag=BXCN8W74Y3G1 type=write size=2525662 2024-09-12T17:37:03.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.047+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=OROEZRORA32Z type=del 2024-09-12T17:37:03.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.055+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~B14BLILBU82U.0 size=1048576 2024-09-12T17:37:03.059 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.055+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~B14BLILBU82U.1 size=516037 2024-09-12T17:37:03.059 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.055+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=B14BLILBU82U tag=53OQVG6IQQ38 type=write size=2613189 2024-09-12T17:37:03.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.059+0000 7f1ad43488c0 1 < completed delete operation key=WFEJLVRCKIUU tag=B0MO7PFZYX14 type=del 2024-09-12T17:37:03.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.067+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~LHPY6914IXJQ.0 size=1048576 2024-09-12T17:37:03.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.067+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~LHPY6914IXJQ.1 size=1048576 2024-09-12T17:37:03.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.071+0000 7f1ad43488c0 1 > prepared part key=_multipart_SDJ53NSPOIRC.2~LHPY6914IXJQ.2 size=622026 2024-09-12T17:37:03.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.071+0000 7f1ad43488c0 1 > prepared multipart upload key=SDJ53NSPOIRC upload=LHPY6914IXJQ tag=C11EF743O1DB type=write size=3767754 2024-09-12T17:37:03.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.075+0000 7f1ad43488c0 1 < suggested remove operation key=X078SB1ITNII tag=CDH31FETNPHW type=del 2024-09-12T17:37:03.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.083+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~94A40C1QG79E.0 size=1048576 2024-09-12T17:37:03.085 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.083+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~94A40C1QG79E.1 size=1048576 2024-09-12T17:37:03.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.087+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~94A40C1QG79E.2 size=117854 2024-09-12T17:37:03.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.087+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=94A40C1QG79E tag=MYPT82L5ZI5L type=write size=3263582 2024-09-12T17:37:03.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.087+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~OV7I2NHFL9Q0.0 size=1048576 2024-09-12T17:37:03.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.091+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~OV7I2NHFL9Q0.1 size=513349 2024-09-12T17:37:03.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.095+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=OV7I2NHFL9Q0 tag=TWX5EB968V1I type=write size=2610501 2024-09-12T17:37:03.100 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.099+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=H68VR3Z1GSLS type=del size=1121212 2024-09-12T17:37:03.103 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.099+0000 7f1ad43488c0 1 < canceled operation key=9Z2EHQA8T5F4 tag=65PF93QBJHD9 type=write size=11683 2024-09-12T17:37:03.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.107+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~EQEB825JPKTQ.0 size=1048576 2024-09-12T17:37:03.111 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.107+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~EQEB825JPKTQ.1 size=1048576 2024-09-12T17:37:03.113 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.111+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~EQEB825JPKTQ.2 size=82735 2024-09-12T17:37:03.113 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.111+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=EQEB825JPKTQ tag=Z2WV6KEGU6O9 type=write size=3228463 2024-09-12T17:37:03.116 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.115+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=6H5LJDNYABQG type=del 2024-09-12T17:37:03.121 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.119+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~NJA6FV6ATBA3.0 size=818472 2024-09-12T17:37:03.122 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.119+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=NJA6FV6ATBA3 tag=G7124JVTR9WQ type=write size=1867048 2024-09-12T17:37:03.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.123+0000 7f1ad43488c0 1 < completed write operation key=ECEF8IJGU4Z8 tag=35LHRXUBN6J7 type=write size=34920 2024-09-12T17:37:03.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.127+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~2QL5UOH8OT2J.0 size=1048576 2024-09-12T17:37:03.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.131+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~2QL5UOH8OT2J.1 size=1048576 2024-09-12T17:37:03.136 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.135+0000 7f1ad43488c0 1 > prepared part key=_multipart_BCPDXAL027U2.2~2QL5UOH8OT2J.2 size=180686 2024-09-12T17:37:03.136 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.135+0000 7f1ad43488c0 1 > prepared multipart upload key=BCPDXAL027U2 upload=2QL5UOH8OT2J tag=KVKORZ8YYW21 type=write size=3326414 2024-09-12T17:37:03.139 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.139+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~916D29H3W40E.0 size=1048576 2024-09-12T17:37:03.142 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.139+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~916D29H3W40E.1 size=108926 2024-09-12T17:37:03.147 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.143+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=916D29H3W40E tag=69GPAAW28CA5 type=write size=2206078 2024-09-12T17:37:03.150 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.147+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=2XWZMMCFY7OB type=del size=1620323 2024-09-12T17:37:03.154 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.151+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~VOT9PFZSH8MM.0 size=598268 2024-09-12T17:37:03.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.159+0000 7f1ad43488c0 1 < completed multipart upload key=7RSHIZRKK2OY upload=VOT9PFZSH8MM tag=E0ZF2HESMHGL type=write size=1646844 2024-09-12T17:37:03.165 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.163+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~WM2CWJJ9G6KM.0 size=1048576 2024-09-12T17:37:03.168 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.167+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~WM2CWJJ9G6KM.1 size=1048576 2024-09-12T17:37:03.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.167+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~WM2CWJJ9G6KM.2 size=486044 2024-09-12T17:37:03.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.167+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=WM2CWJJ9G6KM tag=1MDCYJX139MC type=write size=3631772 2024-09-12T17:37:03.173 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.171+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~PZ97RP11VYAY.0 size=1048576 2024-09-12T17:37:03.176 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.175+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~PZ97RP11VYAY.1 size=1048576 2024-09-12T17:37:03.178 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.175+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~PZ97RP11VYAY.2 size=583541 2024-09-12T17:37:03.184 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.183+0000 7f1ad43488c0 1 < completed multipart upload key=2SDYAQRNWAJK upload=PZ97RP11VYAY tag=DQ6DU73TZAH8 type=write size=3729269 2024-09-12T17:37:03.187 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.187+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=A8WDGAHW1P3V type=del size=2867267 2024-09-12T17:37:03.191 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.187+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=EM1ZJ96J2ZFP type=del 2024-09-12T17:37:03.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.191+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=GFRTVZJS51Y5 type=del size=3649996 2024-09-12T17:37:03.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.195+0000 7f1ad43488c0 1 < completed delete operation key=C7QSOK3D3IWJ tag=QF4G3BFDJ8FF type=del 2024-09-12T17:37:03.201 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.199+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=A1Q78EH4VADG type=del size=3857436 2024-09-12T17:37:03.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.203+0000 7f1ad43488c0 1 < completed delete operation key=WFEJLVRCKIUU tag=EOJ2XPPUWMWI type=del 2024-09-12T17:37:03.208 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.207+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=0SW8BZ9B9ZSW type=del size=3305985 2024-09-12T17:37:03.211 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.211+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~GPLY5S532I0Y.0 size=1048576 2024-09-12T17:37:03.214 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.211+0000 7f1ad43488c0 1 < completed part key=_multipart_9Z2EHQA8T5F4.2~GPLY5S532I0Y.1 size=391921 2024-09-12T17:37:03.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.219+0000 7f1ad43488c0 1 < completed multipart upload key=9Z2EHQA8T5F4 upload=GPLY5S532I0Y tag=G0N13ARVTFUI type=write size=2489073 2024-09-12T17:37:03.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.223+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~IOQ04AIYYOXF.0 size=1048576 2024-09-12T17:37:03.228 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.227+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~IOQ04AIYYOXF.1 size=243437 2024-09-12T17:37:03.228 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.227+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=IOQ04AIYYOXF tag=BWJ3G9MUD5AQ type=write size=2340589 2024-09-12T17:37:03.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.231+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~OPQ3Z7VDZNJR.0 size=1048576 2024-09-12T17:37:03.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.235+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~OPQ3Z7VDZNJR.1 size=1048576 2024-09-12T17:37:03.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.235+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~OPQ3Z7VDZNJR.2 size=1038539 2024-09-12T17:37:03.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.243+0000 7f1ad43488c0 1 < completed multipart upload key=Y3NQLDWQJ37Z upload=OPQ3Z7VDZNJR tag=SINLBOEBYKC8 type=write size=4184267 2024-09-12T17:37:03.246 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.243+0000 7f1ad43488c0 1 > prepared operation key=PKC1RR4FZWE0 tag=JSHNDR82A0W5 type=write size=190201 2024-09-12T17:37:03.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.247+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~U2Z9ECWH4CQ9.0 size=1048576 2024-09-12T17:37:03.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.247+0000 7f1ad43488c0 1 < canceled part key=_multipart_C7QSOK3D3IWJ.2~U2Z9ECWH4CQ9.1 size=428510 2024-09-12T17:37:03.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.255+0000 7f1ad43488c0 1 < canceled multipart upload key=C7QSOK3D3IWJ upload=U2Z9ECWH4CQ9 tag=BXCN8W74Y3G1 type=write size=2525662 2024-09-12T17:37:03.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.255+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=CPKDUZEP6BA5 type=del size=2662588 2024-09-12T17:37:03.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.259+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~B14BLILBU82U.0 size=1048576 2024-09-12T17:37:03.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.263+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~B14BLILBU82U.1 size=516037 2024-09-12T17:37:03.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.267+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=B14BLILBU82U tag=53OQVG6IQQ38 type=write size=2613189 2024-09-12T17:37:03.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.275+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~ERKEYKYMCZR1.0 size=834108 2024-09-12T17:37:03.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.275+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=ERKEYKYMCZR1 tag=0EMFDO4UGRAT type=write size=1882684 2024-09-12T17:37:03.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.279+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~LHPY6914IXJQ.0 size=1048576 2024-09-12T17:37:03.282 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.279+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~LHPY6914IXJQ.1 size=1048576 2024-09-12T17:37:03.285 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.283+0000 7f1ad43488c0 1 < completed part key=_multipart_SDJ53NSPOIRC.2~LHPY6914IXJQ.2 size=622026 2024-09-12T17:37:03.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.287+0000 7f1ad43488c0 1 < completed multipart upload key=SDJ53NSPOIRC upload=LHPY6914IXJQ tag=C11EF743O1DB type=write size=3767754 2024-09-12T17:37:03.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.291+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=P55ES7SLIQO7 type=del size=817021 2024-09-12T17:37:03.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.295+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~94A40C1QG79E.0 size=1048576 2024-09-12T17:37:03.301 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.299+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~94A40C1QG79E.1 size=1048576 2024-09-12T17:37:03.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.303+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~94A40C1QG79E.2 size=117854 2024-09-12T17:37:03.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.307+0000 7f1ad43488c0 1 < completed multipart upload key=GZ7LGZQHW4CY upload=94A40C1QG79E tag=MYPT82L5ZI5L type=write size=3263582 2024-09-12T17:37:03.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.315+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=635TVQBL6U00 type=del size=2483909 2024-09-12T17:37:03.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.319+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=H68VR3Z1GSLS type=del 2024-09-12T17:37:03.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.323+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=IQJO0F3UG1PY type=del size=2471794 2024-09-12T17:37:03.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.327+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~EQEB825JPKTQ.0 size=1048576 2024-09-12T17:37:03.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.327+0000 7f1ad43488c0 1 < canceled part key=_multipart_X078SB1ITNII.2~EQEB825JPKTQ.1 size=1048576 2024-09-12T17:37:03.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.327+0000 7f1ad43488c0 1 < completed part key=_multipart_X078SB1ITNII.2~EQEB825JPKTQ.2 size=82735 2024-09-12T17:37:03.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.331+0000 7f1ad43488c0 1 < canceled multipart upload key=X078SB1ITNII upload=EQEB825JPKTQ tag=Z2WV6KEGU6O9 type=write size=3228463 2024-09-12T17:37:03.341 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.339+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~S360VPSOUA8R.0 size=1048576 2024-09-12T17:37:03.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.343+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~S360VPSOUA8R.1 size=1048576 2024-09-12T17:37:03.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.343+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~S360VPSOUA8R.2 size=41814 2024-09-12T17:37:03.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.343+0000 7f1ad43488c0 1 > prepared multipart upload key=SIZ0Z1KWTGUJ upload=S360VPSOUA8R tag=HTWIIYICMC91 type=write size=3187542 2024-09-12T17:37:03.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.347+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~NJA6FV6ATBA3.0 size=818472 2024-09-12T17:37:03.355 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.351+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=NJA6FV6ATBA3 tag=G7124JVTR9WQ type=write size=1867048 2024-09-12T17:37:03.358 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.355+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=8W3LMEYZB43I type=write size=389329 2024-09-12T17:37:03.358 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.355+0000 7f1ad43488c0 1 < canceled part key=_multipart_BCPDXAL027U2.2~2QL5UOH8OT2J.0 size=1048576 2024-09-12T17:37:03.361 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.359+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~2QL5UOH8OT2J.1 size=1048576 2024-09-12T17:37:03.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.363+0000 7f1ad43488c0 1 < completed part key=_multipart_BCPDXAL027U2.2~2QL5UOH8OT2J.2 size=180686 2024-09-12T17:37:03.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.367+0000 7f1ad43488c0 1 < canceled multipart upload key=BCPDXAL027U2 upload=2QL5UOH8OT2J tag=KVKORZ8YYW21 type=write size=3326414 2024-09-12T17:37:03.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.371+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=S9S1FL2TZH3W type=write size=300033 2024-09-12T17:37:03.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.375+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=2XWZMMCFY7OB type=del 2024-09-12T17:37:03.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.375+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=MZ6H1PMONXPS type=del size=3934824 2024-09-12T17:37:03.381 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.379+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~WM2CWJJ9G6KM.0 size=1048576 2024-09-12T17:37:03.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.383+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~WM2CWJJ9G6KM.1 size=1048576 2024-09-12T17:37:03.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.383+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~WM2CWJJ9G6KM.2 size=486044 2024-09-12T17:37:03.390 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.387+0000 7f1ad43488c0 1 < completed multipart upload key=7RSHIZRKK2OY upload=WM2CWJJ9G6KM tag=1MDCYJX139MC type=write size=3631772 2024-09-12T17:37:03.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.395+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~MFRY2AE0DOVX.0 size=1048576 2024-09-12T17:37:03.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.395+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~MFRY2AE0DOVX.1 size=1048576 2024-09-12T17:37:03.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.399+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~MFRY2AE0DOVX.2 size=339870 2024-09-12T17:37:03.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.399+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=MFRY2AE0DOVX tag=8TDNC03KJ21Y type=write size=3485598 2024-09-12T17:37:03.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.403+0000 7f1ad43488c0 1 < completed delete operation key=MB3FVGKV0ZNQ tag=A8WDGAHW1P3V type=del 2024-09-12T17:37:03.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.407+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~BEPY9MX5EFLL.0 size=1048576 2024-09-12T17:37:03.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.411+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~BEPY9MX5EFLL.1 size=1048576 2024-09-12T17:37:03.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.411+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~BEPY9MX5EFLL.2 size=730304 2024-09-12T17:37:03.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.411+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=BEPY9MX5EFLL tag=K39IZ3YWFIQY type=write size=3876032 2024-09-12T17:37:03.417 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.415+0000 7f1ad43488c0 1 < completed delete operation key=WWB6LAHAMIR9 tag=GFRTVZJS51Y5 type=del 2024-09-12T17:37:03.420 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.419+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=F1R3ZKDM6YJK type=del size=2608026 2024-09-12T17:37:03.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.423+0000 7f1ad43488c0 1 < suggested remove operation key=GWJ78NNXOL1R tag=A1Q78EH4VADG type=del 2024-09-12T17:37:03.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.427+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=Y6YM6MFKHCU6 type=del size=3909591 2024-09-12T17:37:03.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.431+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=0SW8BZ9B9ZSW type=del 2024-09-12T17:37:03.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.431+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=OHQZMD2A8JUT type=del size=3016295 2024-09-12T17:37:03.437 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.435+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~IOQ04AIYYOXF.0 size=1048576 2024-09-12T17:37:03.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.439+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~IOQ04AIYYOXF.1 size=243437 2024-09-12T17:37:03.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.443+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=IOQ04AIYYOXF tag=BWJ3G9MUD5AQ type=write size=2340589 2024-09-12T17:37:03.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.447+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~GVSZT2HRGHNX.0 size=1048576 2024-09-12T17:37:03.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.451+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~GVSZT2HRGHNX.1 size=1048576 2024-09-12T17:37:03.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.451+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~GVSZT2HRGHNX.2 size=993908 2024-09-12T17:37:03.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.451+0000 7f1ad43488c0 1 > prepared multipart upload key=Y3NQLDWQJ37Z upload=GVSZT2HRGHNX tag=NRKRGDYPWR0Q type=write size=4139636 2024-09-12T17:37:03.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.455+0000 7f1ad43488c0 1 < completed write operation key=PKC1RR4FZWE0 tag=JSHNDR82A0W5 type=write size=190201 2024-09-12T17:37:03.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.459+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~3MQ7K27JOWZV.0 size=1048576 2024-09-12T17:37:03.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.463+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~3MQ7K27JOWZV.1 size=1048576 2024-09-12T17:37:03.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.463+0000 7f1ad43488c0 1 > prepared part key=_multipart_XOEPYERWY6IT.2~3MQ7K27JOWZV.2 size=321309 2024-09-12T17:37:03.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.463+0000 7f1ad43488c0 1 > prepared multipart upload key=XOEPYERWY6IT upload=3MQ7K27JOWZV tag=PQDEN2KTSO72 type=write size=3467037 2024-09-12T17:37:03.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.467+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=CPKDUZEP6BA5 type=del 2024-09-12T17:37:03.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.471+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=VVNYJK9X5JZ7 type=del size=2342516 2024-09-12T17:37:03.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.471+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~ERKEYKYMCZR1.0 size=834108 2024-09-12T17:37:03.480 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.479+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=ERKEYKYMCZR1 tag=0EMFDO4UGRAT type=write size=1882684 2024-09-12T17:37:03.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.483+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~0G3XG8QKC46U.0 size=1048576 2024-09-12T17:37:03.488 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.487+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~0G3XG8QKC46U.1 size=1048576 2024-09-12T17:37:03.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.487+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~0G3XG8QKC46U.2 size=55080 2024-09-12T17:37:03.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.487+0000 7f1ad43488c0 1 > prepared multipart upload key=NHOG1WG3VT6N upload=0G3XG8QKC46U tag=AGJ0DH1YQR4B type=write size=3200808 2024-09-12T17:37:03.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.491+0000 7f1ad43488c0 1 < completed delete operation key=05PAFB226IFP tag=P55ES7SLIQO7 type=del 2024-09-12T17:37:03.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.499+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~BQX2KZERPTGC.0 size=1048576 2024-09-12T17:37:03.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.499+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~BQX2KZERPTGC.1 size=1048576 2024-09-12T17:37:03.504 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.503+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~BQX2KZERPTGC.2 size=832914 2024-09-12T17:37:03.504 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.503+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=BQX2KZERPTGC tag=LI2J3C7ZYD8R type=write size=3978642 2024-09-12T17:37:03.508 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.507+0000 7f1ad43488c0 -1 < failed to complete operation key=GWJ78NNXOL1R tag=635TVQBL6U00 type=del size=2483909: (22) Invalid argument 2024-09-12T17:37:03.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.511+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~440IBKY99FMT.0 size=1048576 2024-09-12T17:37:03.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.511+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~440IBKY99FMT.1 size=1048576 2024-09-12T17:37:03.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.515+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~440IBKY99FMT.2 size=66294 2024-09-12T17:37:03.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.515+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=440IBKY99FMT tag=W4Z00VEW5UW4 type=write size=3212022 2024-09-12T17:37:03.521 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.519+0000 7f1ad43488c0 1 < completed delete operation key=SDJ53NSPOIRC tag=IQJO0F3UG1PY type=del 2024-09-12T17:37:03.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.523+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=6BG8HDZOHQCW type=del size=3098649 2024-09-12T17:37:03.526 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.523+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~S360VPSOUA8R.0 size=1048576 2024-09-12T17:37:03.529 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.527+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~S360VPSOUA8R.1 size=1048576 2024-09-12T17:37:03.532 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.531+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~S360VPSOUA8R.2 size=41814 2024-09-12T17:37:03.537 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.535+0000 7f1ad43488c0 1 < completed multipart upload key=SIZ0Z1KWTGUJ upload=S360VPSOUA8R tag=HTWIIYICMC91 type=write size=3187542 2024-09-12T17:37:03.540 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.539+0000 7f1ad43488c0 1 > prepared operation key=4QO60GZ9V0GK tag=1OS8Z00RY3JC type=del size=3053873 2024-09-12T17:37:03.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.543+0000 7f1ad43488c0 1 < suggested remove operation key=A49CE02X3L2L tag=8W3LMEYZB43I type=write 2024-09-12T17:37:03.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.547+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=TOC1USL9D4D5 type=write size=974030 2024-09-12T17:37:03.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.551+0000 7f1ad43488c0 -1 < failed to complete operation key=GWJ78NNXOL1R tag=S9S1FL2TZH3W type=write size=300033: (22) Invalid argument 2024-09-12T17:37:03.554 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.551+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=HM9RHBE9NKIZ type=del size=793984 2024-09-12T17:37:03.557 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.555+0000 7f1ad43488c0 1 < completed delete operation key=RXJJOPR32OD5 tag=MZ6H1PMONXPS type=del 2024-09-12T17:37:03.562 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.559+0000 7f1ad43488c0 1 > prepared part key=_multipart_WWB6LAHAMIR9.2~41CCM2014VVV.0 size=572848 2024-09-12T17:37:03.562 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.559+0000 7f1ad43488c0 1 > prepared multipart upload key=WWB6LAHAMIR9 upload=41CCM2014VVV tag=1AR4IEPDEF5L type=write size=1621424 2024-09-12T17:37:03.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.563+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~MFRY2AE0DOVX.0 size=1048576 2024-09-12T17:37:03.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.563+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~MFRY2AE0DOVX.1 size=1048576 2024-09-12T17:37:03.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.567+0000 7f1ad43488c0 1 < completed part key=_multipart_7RSHIZRKK2OY.2~MFRY2AE0DOVX.2 size=339870 2024-09-12T17:37:03.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.571+0000 7f1ad43488c0 1 < completed multipart upload key=7RSHIZRKK2OY upload=MFRY2AE0DOVX tag=8TDNC03KJ21Y type=write size=3485598 2024-09-12T17:37:03.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.575+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=OBSQ8QS079GT type=write size=449797 2024-09-12T17:37:03.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.579+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~BEPY9MX5EFLL.0 size=1048576 2024-09-12T17:37:03.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.579+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~BEPY9MX5EFLL.1 size=1048576 2024-09-12T17:37:03.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.583+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~BEPY9MX5EFLL.2 size=730304 2024-09-12T17:37:03.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.591+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=BEPY9MX5EFLL tag=K39IZ3YWFIQY type=write size=3876032 2024-09-12T17:37:03.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.591+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=Q2KK4Y0IX9X3 type=del size=743120 2024-09-12T17:37:03.597 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.595+0000 7f1ad43488c0 1 < completed delete operation key=XOEPYERWY6IT tag=F1R3ZKDM6YJK type=del 2024-09-12T17:37:03.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.599+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~RV2E04I9OZC1.0 size=1048576 2024-09-12T17:37:03.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.603+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~RV2E04I9OZC1.1 size=1048576 2024-09-12T17:37:03.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.603+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~RV2E04I9OZC1.2 size=461507 2024-09-12T17:37:03.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.603+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=RV2E04I9OZC1 tag=JMOFOUNEO12S type=write size=3607235 2024-09-12T17:37:03.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.607+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=Y6YM6MFKHCU6 type=del 2024-09-12T17:37:03.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.611+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=337NZZY96ZMX type=write size=468385 2024-09-12T17:37:03.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.615+0000 7f1ad43488c0 1 < suggested update operation key=MB3FVGKV0ZNQ tag=OHQZMD2A8JUT type=del size=3016295 2024-09-12T17:37:03.619 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.619+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=B235G95PVRDB type=del size=2037991 2024-09-12T17:37:03.622 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.619+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~GVSZT2HRGHNX.0 size=1048576 2024-09-12T17:37:03.624 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.623+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~GVSZT2HRGHNX.1 size=1048576 2024-09-12T17:37:03.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.623+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~GVSZT2HRGHNX.2 size=993908 2024-09-12T17:37:03.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.627+0000 7f1ad43488c0 1 < completed multipart upload key=Y3NQLDWQJ37Z upload=GVSZT2HRGHNX tag=NRKRGDYPWR0Q type=write size=4139636 2024-09-12T17:37:03.635 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.635+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~LH2M9X38Q2X8.0 size=1048576 2024-09-12T17:37:03.637 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.635+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~LH2M9X38Q2X8.1 size=1048576 2024-09-12T17:37:03.639 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.639+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~LH2M9X38Q2X8.2 size=919154 2024-09-12T17:37:03.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.639+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=LH2M9X38Q2X8 tag=FOGPI6J6F9K4 type=write size=4064882 2024-09-12T17:37:03.642 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.639+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~3MQ7K27JOWZV.0 size=1048576 2024-09-12T17:37:03.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.643+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~3MQ7K27JOWZV.1 size=1048576 2024-09-12T17:37:03.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.643+0000 7f1ad43488c0 1 < completed part key=_multipart_XOEPYERWY6IT.2~3MQ7K27JOWZV.2 size=321309 2024-09-12T17:37:03.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.647+0000 7f1ad43488c0 1 < completed multipart upload key=XOEPYERWY6IT upload=3MQ7K27JOWZV tag=PQDEN2KTSO72 type=write size=3467037 2024-09-12T17:37:03.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.651+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=8CQKL3FC9EJN type=del size=2093266 2024-09-12T17:37:03.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.655+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=VVNYJK9X5JZ7 type=del 2024-09-12T17:37:03.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.655+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=D2KD3RXFGTRH type=del size=2980985 2024-09-12T17:37:03.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.659+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~0G3XG8QKC46U.0 size=1048576 2024-09-12T17:37:03.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.663+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~0G3XG8QKC46U.1 size=1048576 2024-09-12T17:37:03.669 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.663+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~0G3XG8QKC46U.2 size=55080 2024-09-12T17:37:03.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.667+0000 7f1ad43488c0 1 < completed multipart upload key=NHOG1WG3VT6N upload=0G3XG8QKC46U tag=AGJ0DH1YQR4B type=write size=3200808 2024-09-12T17:37:03.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.671+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=EE1SPDHW7NUX type=del size=2161738 2024-09-12T17:37:03.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.675+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~BQX2KZERPTGC.0 size=1048576 2024-09-12T17:37:03.680 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.679+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~BQX2KZERPTGC.1 size=1048576 2024-09-12T17:37:03.680 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.679+0000 7f1ad43488c0 1 < canceled part key=_multipart_GZ7LGZQHW4CY.2~BQX2KZERPTGC.2 size=832914 2024-09-12T17:37:03.686 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.683+0000 7f1ad43488c0 1 < canceled multipart upload key=GZ7LGZQHW4CY upload=BQX2KZERPTGC tag=LI2J3C7ZYD8R type=write size=3978642 2024-09-12T17:37:03.690 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.687+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=TOCEOIEDSCHE type=write size=521081 2024-09-12T17:37:03.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.691+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~440IBKY99FMT.0 size=1048576 2024-09-12T17:37:03.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.691+0000 7f1ad43488c0 1 < canceled part key=_multipart_IY2AM7CJDUZG.2~440IBKY99FMT.1 size=1048576 2024-09-12T17:37:03.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.691+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~440IBKY99FMT.2 size=66294 2024-09-12T17:37:03.698 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.695+0000 7f1ad43488c0 1 < canceled multipart upload key=IY2AM7CJDUZG upload=440IBKY99FMT tag=W4Z00VEW5UW4 type=write size=3212022 2024-09-12T17:37:03.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.699+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=2ARJIDA5I0SQ type=write size=1038427 2024-09-12T17:37:03.703 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.703+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=6BG8HDZOHQCW type=del 2024-09-12T17:37:03.706 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.703+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=DTT4SHEPGDS7 type=del size=3430774 2024-09-12T17:37:03.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.707+0000 7f1ad43488c0 1 < completed delete operation key=4QO60GZ9V0GK tag=1OS8Z00RY3JC type=del 2024-09-12T17:37:03.713 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.711+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~ECZAGUD9P1PB.0 size=1048576 2024-09-12T17:37:03.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.715+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~ECZAGUD9P1PB.1 size=1048576 2024-09-12T17:37:03.717 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.715+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~ECZAGUD9P1PB.2 size=310766 2024-09-12T17:37:03.717 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.715+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=ECZAGUD9P1PB tag=NBMIWIH9WJQG type=write size=3456494 2024-09-12T17:37:03.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.719+0000 7f1ad43488c0 1 < completed write operation key=CHMM14VRIOQH tag=TOC1USL9D4D5 type=write size=974030 2024-09-12T17:37:03.723 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.719+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=DFOE9XC7QKGY type=del size=3076701 2024-09-12T17:37:03.725 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.723+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=HM9RHBE9NKIZ type=del 2024-09-12T17:37:03.728 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.727+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=BTLCQ54H7SUD type=del size=182682 2024-09-12T17:37:03.730 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.727+0000 7f1ad43488c0 1 < completed part key=_multipart_WWB6LAHAMIR9.2~41CCM2014VVV.0 size=572848 2024-09-12T17:37:03.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.731+0000 7f1ad43488c0 1 < completed multipart upload key=WWB6LAHAMIR9 upload=41CCM2014VVV tag=1AR4IEPDEF5L type=write size=1621424 2024-09-12T17:37:03.740 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.739+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~6HAPV0I7HPC0.0 size=1048576 2024-09-12T17:37:03.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.739+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~6HAPV0I7HPC0.1 size=1048576 2024-09-12T17:37:03.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.743+0000 7f1ad43488c0 1 > prepared part key=_multipart_X0HT3K3OREL7.2~6HAPV0I7HPC0.2 size=1012487 2024-09-12T17:37:03.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.743+0000 7f1ad43488c0 1 > prepared multipart upload key=X0HT3K3OREL7 upload=6HAPV0I7HPC0 tag=K3JLYH15XI6U type=write size=4158215 2024-09-12T17:37:03.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.747+0000 7f1ad43488c0 1 < completed write operation key=7RSHIZRKK2OY tag=OBSQ8QS079GT type=write size=449797 2024-09-12T17:37:03.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.747+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=YKU5GO8H9TR3 type=del size=3210610 2024-09-12T17:37:03.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.755+0000 7f1ad43488c0 1 < suggested update operation key=Y3NQLDWQJ37Z tag=Q2KK4Y0IX9X3 type=del size=743120 2024-09-12T17:37:03.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.755+0000 7f1ad43488c0 1 > prepared operation key=RXJJOPR32OD5 tag=D04MQZFFC31K type=del size=4068047 2024-09-12T17:37:03.761 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.759+0000 7f1ad43488c0 1 < completed part key=_multipart_2SDYAQRNWAJK.2~RV2E04I9OZC1.0 size=1048576 2024-09-12T17:37:03.761 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.759+0000 7f1ad43488c0 1 < canceled part key=_multipart_2SDYAQRNWAJK.2~RV2E04I9OZC1.1 size=1048576 2024-09-12T17:37:03.762 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.759+0000 7f1ad43488c0 1 < canceled part key=_multipart_2SDYAQRNWAJK.2~RV2E04I9OZC1.2 size=461507 2024-09-12T17:37:03.767 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.763+0000 7f1ad43488c0 1 < canceled multipart upload key=2SDYAQRNWAJK upload=RV2E04I9OZC1 tag=JMOFOUNEO12S type=write size=3607235 2024-09-12T17:37:03.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.771+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~X3GBRL76DU6B.0 size=1048576 2024-09-12T17:37:03.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.771+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~X3GBRL76DU6B.1 size=1048576 2024-09-12T17:37:03.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.775+0000 7f1ad43488c0 1 > prepared part key=_multipart_A49CE02X3L2L.2~X3GBRL76DU6B.2 size=671627 2024-09-12T17:37:03.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.775+0000 7f1ad43488c0 1 > prepared multipart upload key=A49CE02X3L2L upload=X3GBRL76DU6B tag=3PCVJXNS1JNS type=write size=3817355 2024-09-12T17:37:03.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.779+0000 7f1ad43488c0 1 < completed write operation key=RH4HYE315U5Y tag=337NZZY96ZMX type=write size=468385 2024-09-12T17:37:03.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.779+0000 7f1ad43488c0 1 > prepared operation key=GWJ78NNXOL1R tag=ET5OJ5P2K5CU type=del size=1918946 2024-09-12T17:37:03.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.783+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=B235G95PVRDB type=del 2024-09-12T17:37:03.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.787+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=5WGCHPVVGK6E type=del size=717902 2024-09-12T17:37:03.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.787+0000 7f1ad43488c0 1 < canceled part key=_multipart_X0HT3K3OREL7.2~LH2M9X38Q2X8.0 size=1048576 2024-09-12T17:37:03.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.791+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~LH2M9X38Q2X8.1 size=1048576 2024-09-12T17:37:03.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.795+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~LH2M9X38Q2X8.2 size=919154 2024-09-12T17:37:03.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.799+0000 7f1ad43488c0 1 < canceled multipart upload key=X0HT3K3OREL7 upload=LH2M9X38Q2X8 tag=FOGPI6J6F9K4 type=write size=4064882 2024-09-12T17:37:03.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.803+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=WYCEBLUJJALR type=del size=1536511 2024-09-12T17:37:03.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.807+0000 7f1ad43488c0 1 < completed delete operation key=WWB6LAHAMIR9 tag=8CQKL3FC9EJN type=del 2024-09-12T17:37:03.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.811+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~985IVHNBJNPY.0 size=1048576 2024-09-12T17:37:03.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.815+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~985IVHNBJNPY.1 size=169606 2024-09-12T17:37:03.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.815+0000 7f1ad43488c0 1 > prepared multipart upload key=ZHFRKX9YY8P5 upload=985IVHNBJNPY tag=LD9Z7DF7L9KZ type=write size=2266758 2024-09-12T17:37:03.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.815+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=D2KD3RXFGTRH type=del 2024-09-12T17:37:03.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.823+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~XJT6LXO8XA75.0 size=1048576 2024-09-12T17:37:03.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.823+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~XJT6LXO8XA75.1 size=1048576 2024-09-12T17:37:03.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.827+0000 7f1ad43488c0 1 > prepared part key=_multipart_IY2AM7CJDUZG.2~XJT6LXO8XA75.2 size=1011146 2024-09-12T17:37:03.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.827+0000 7f1ad43488c0 1 > prepared multipart upload key=IY2AM7CJDUZG upload=XJT6LXO8XA75 tag=PAGPJ1GGYJPK type=write size=4156874 2024-09-12T17:37:03.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.827+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=EE1SPDHW7NUX type=del 2024-09-12T17:37:03.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.831+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~J4USY19YIDE2.0 size=1048576 2024-09-12T17:37:03.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.835+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~J4USY19YIDE2.1 size=1048576 2024-09-12T17:37:03.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.835+0000 7f1ad43488c0 1 > prepared part key=_multipart_MB3FVGKV0ZNQ.2~J4USY19YIDE2.2 size=434157 2024-09-12T17:37:03.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.835+0000 7f1ad43488c0 1 > prepared multipart upload key=MB3FVGKV0ZNQ upload=J4USY19YIDE2 tag=K7CJWR9XD6VJ type=write size=3579885 2024-09-12T17:37:03.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.839+0000 7f1ad43488c0 1 < completed write operation key=8U3L46JDJ8VS tag=TOCEOIEDSCHE type=write size=521081 2024-09-12T17:37:03.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.847+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=YHEA7HYVDR1D type=del size=608527 2024-09-12T17:37:03.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.851+0000 7f1ad43488c0 1 < completed write operation key=A49CE02X3L2L tag=2ARJIDA5I0SQ type=write size=1038427 2024-09-12T17:37:03.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.851+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=62MU64X9MFJP type=del size=1818833 2024-09-12T17:37:03.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.855+0000 7f1ad43488c0 1 < canceled operation key=GZ7LGZQHW4CY tag=DTT4SHEPGDS7 type=del size=3430774 2024-09-12T17:37:03.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.859+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~3C5T1S7G221W.0 size=1048576 2024-09-12T17:37:03.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.863+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~3C5T1S7G221W.1 size=1048576 2024-09-12T17:37:03.865 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.863+0000 7f1ad43488c0 1 > prepared part key=_multipart_CHMM14VRIOQH.2~3C5T1S7G221W.2 size=742866 2024-09-12T17:37:03.865 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.863+0000 7f1ad43488c0 1 > prepared multipart upload key=CHMM14VRIOQH upload=3C5T1S7G221W tag=KDK6L7MZD6XB type=write size=3888594 2024-09-12T17:37:03.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.867+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~ECZAGUD9P1PB.0 size=1048576 2024-09-12T17:37:03.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.867+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~ECZAGUD9P1PB.1 size=1048576 2024-09-12T17:37:03.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.871+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~ECZAGUD9P1PB.2 size=310766 2024-09-12T17:37:03.876 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.875+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=ECZAGUD9P1PB tag=NBMIWIH9WJQG type=write size=3456494 2024-09-12T17:37:03.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.879+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~061HYP5CY9EF.0 size=1048576 2024-09-12T17:37:03.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.879+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~061HYP5CY9EF.1 size=506104 2024-09-12T17:37:03.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.879+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=061HYP5CY9EF tag=19G1BL3UKN8Z type=write size=2603256 2024-09-12T17:37:03.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.887+0000 7f1ad43488c0 1 < suggested update operation key=WWB6LAHAMIR9 tag=DFOE9XC7QKGY type=del size=3076701 2024-09-12T17:37:03.890 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.887+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=4NHGZK3K5HJG type=del size=2182712 2024-09-12T17:37:03.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.895+0000 7f1ad43488c0 1 < suggested remove operation key=RXJJOPR32OD5 tag=BTLCQ54H7SUD type=del 2024-09-12T17:37:03.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.895+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=D7PELLWIRK5C type=del size=302329 2024-09-12T17:37:03.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.895+0000 7f1ad43488c0 1 < canceled part key=_multipart_X0HT3K3OREL7.2~6HAPV0I7HPC0.0 size=1048576 2024-09-12T17:37:03.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.899+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~6HAPV0I7HPC0.1 size=1048576 2024-09-12T17:37:03.902 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.899+0000 7f1ad43488c0 1 < completed part key=_multipart_X0HT3K3OREL7.2~6HAPV0I7HPC0.2 size=1012487 2024-09-12T17:37:03.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.903+0000 7f1ad43488c0 1 < canceled multipart upload key=X0HT3K3OREL7 upload=6HAPV0I7HPC0 tag=K3JLYH15XI6U type=write size=4158215 2024-09-12T17:37:03.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.907+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~P3NGCRJHUAHW.0 size=472690 2024-09-12T17:37:03.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.907+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=P3NGCRJHUAHW tag=0HU5UNAH8BEJ type=write size=1521266 2024-09-12T17:37:03.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.911+0000 7f1ad43488c0 1 < completed delete operation key=IY2AM7CJDUZG tag=YKU5GO8H9TR3 type=del 2024-09-12T17:37:03.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.911+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=SU5PLDLQ62I0 type=write size=652327 2024-09-12T17:37:03.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.915+0000 7f1ad43488c0 -1 < failed to complete operation key=RXJJOPR32OD5 tag=D04MQZFFC31K type=del size=4068047: (22) Invalid argument 2024-09-12T17:37:03.919 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.919+0000 7f1ad43488c0 1 > prepared operation key=2SDYAQRNWAJK tag=6K4IMUW5WC5U type=del size=3484018 2024-09-12T17:37:03.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.919+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~X3GBRL76DU6B.0 size=1048576 2024-09-12T17:37:03.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.923+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~X3GBRL76DU6B.1 size=1048576 2024-09-12T17:37:03.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.923+0000 7f1ad43488c0 1 < completed part key=_multipart_A49CE02X3L2L.2~X3GBRL76DU6B.2 size=671627 2024-09-12T17:37:03.930 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.927+0000 7f1ad43488c0 1 < completed multipart upload key=A49CE02X3L2L upload=X3GBRL76DU6B tag=3PCVJXNS1JNS type=write size=3817355 2024-09-12T17:37:03.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.931+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=WC18RG25K27Z type=del size=1917751 2024-09-12T17:37:03.935 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.931+0000 7f1ad43488c0 1 < completed delete operation key=GWJ78NNXOL1R tag=ET5OJ5P2K5CU type=del 2024-09-12T17:37:03.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.935+0000 7f1ad43488c0 1 > prepared operation key=NHOG1WG3VT6N tag=32KJYOHA3TFI type=write size=697528 2024-09-12T17:37:03.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.939+0000 7f1ad43488c0 1 < completed delete operation key=X0HT3K3OREL7 tag=5WGCHPVVGK6E type=del 2024-09-12T17:37:03.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.939+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=5GMT8MZ6ODPG type=del size=3302401 2024-09-12T17:37:03.948 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.947+0000 7f1ad43488c0 1 < suggested remove operation key=IY2AM7CJDUZG tag=WYCEBLUJJALR type=del 2024-09-12T17:37:03.953 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.951+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~H0VJBDJGAKKO.0 size=661040 2024-09-12T17:37:03.953 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.951+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=H0VJBDJGAKKO tag=GNZKF9QHZOG4 type=write size=1709616 2024-09-12T17:37:03.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.955+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~985IVHNBJNPY.0 size=1048576 2024-09-12T17:37:03.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.955+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~985IVHNBJNPY.1 size=169606 2024-09-12T17:37:03.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.963+0000 7f1ad43488c0 1 < completed multipart upload key=ZHFRKX9YY8P5 upload=985IVHNBJNPY tag=LD9Z7DF7L9KZ type=write size=2266758 2024-09-12T17:37:03.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.967+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~42VHXB5F63DL.0 size=1048576 2024-09-12T17:37:03.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.967+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~42VHXB5F63DL.1 size=1048576 2024-09-12T17:37:03.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.971+0000 7f1ad43488c0 1 > prepared part key=_multipart_ECEF8IJGU4Z8.2~42VHXB5F63DL.2 size=316355 2024-09-12T17:37:03.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.971+0000 7f1ad43488c0 1 > prepared multipart upload key=ECEF8IJGU4Z8 upload=42VHXB5F63DL tag=GFRVE13B65KG type=write size=3462083 2024-09-12T17:37:03.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.975+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~XJT6LXO8XA75.0 size=1048576 2024-09-12T17:37:03.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.975+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~XJT6LXO8XA75.1 size=1048576 2024-09-12T17:37:03.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.979+0000 7f1ad43488c0 1 < completed part key=_multipart_IY2AM7CJDUZG.2~XJT6LXO8XA75.2 size=1011146 2024-09-12T17:37:03.987 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.983+0000 7f1ad43488c0 1 < completed multipart upload key=IY2AM7CJDUZG upload=XJT6LXO8XA75 tag=PAGPJ1GGYJPK type=write size=4156874 2024-09-12T17:37:03.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.991+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~EURUO0567W5D.0 size=1048576 2024-09-12T17:37:03.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.991+0000 7f1ad43488c0 1 > prepared part key=_multipart_ZHFRKX9YY8P5.2~EURUO0567W5D.1 size=443085 2024-09-12T17:37:03.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.991+0000 7f1ad43488c0 1 > prepared multipart upload key=ZHFRKX9YY8P5 upload=EURUO0567W5D tag=LVYCJFNT46DG type=write size=2540237 2024-09-12T17:37:03.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.995+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~J4USY19YIDE2.0 size=1048576 2024-09-12T17:37:04.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:03.999+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~J4USY19YIDE2.1 size=1048576 2024-09-12T17:37:04.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.003+0000 7f1ad43488c0 1 < completed part key=_multipart_MB3FVGKV0ZNQ.2~J4USY19YIDE2.2 size=434157 2024-09-12T17:37:04.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.007+0000 7f1ad43488c0 1 < completed multipart upload key=MB3FVGKV0ZNQ upload=J4USY19YIDE2 tag=K7CJWR9XD6VJ type=write size=3579885 2024-09-12T17:37:04.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.015+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~N0EBSJR0VOTT.0 size=1048576 2024-09-12T17:37:04.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.015+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~N0EBSJR0VOTT.1 size=1048576 2024-09-12T17:37:04.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.019+0000 7f1ad43488c0 1 > prepared part key=_multipart_3N1YT9TC0M3O.2~N0EBSJR0VOTT.2 size=842382 2024-09-12T17:37:04.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.019+0000 7f1ad43488c0 1 > prepared multipart upload key=3N1YT9TC0M3O upload=N0EBSJR0VOTT tag=84NK7L52F0J9 type=write size=3988110 2024-09-12T17:37:04.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.023+0000 7f1ad43488c0 1 < completed delete operation key=X0HT3K3OREL7 tag=YHEA7HYVDR1D type=del 2024-09-12T17:37:04.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.027+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=S0GJF530RVYJ type=del size=25435 2024-09-12T17:37:04.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.031+0000 7f1ad43488c0 1 < completed delete operation key=8U3L46JDJ8VS tag=62MU64X9MFJP type=del 2024-09-12T17:37:04.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.035+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~2JN6Q9N3PWRL.0 size=1048576 2024-09-12T17:37:04.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.039+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~2JN6Q9N3PWRL.1 size=1048576 2024-09-12T17:37:04.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.039+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~2JN6Q9N3PWRL.2 size=538978 2024-09-12T17:37:04.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.039+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=2JN6Q9N3PWRL tag=13B58W6HVY71 type=write size=3684706 2024-09-12T17:37:04.046 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.043+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~3C5T1S7G221W.0 size=1048576 2024-09-12T17:37:04.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.047+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~3C5T1S7G221W.1 size=1048576 2024-09-12T17:37:04.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.051+0000 7f1ad43488c0 1 < completed part key=_multipart_CHMM14VRIOQH.2~3C5T1S7G221W.2 size=742866 2024-09-12T17:37:04.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.055+0000 7f1ad43488c0 1 < completed multipart upload key=CHMM14VRIOQH upload=3C5T1S7G221W tag=KDK6L7MZD6XB type=write size=3888594 2024-09-12T17:37:04.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.059+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=9LFI17VMG8LM type=del size=3367746 2024-09-12T17:37:04.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.063+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~061HYP5CY9EF.0 size=1048576 2024-09-12T17:37:04.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.063+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~061HYP5CY9EF.1 size=506104 2024-09-12T17:37:04.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.071+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=061HYP5CY9EF tag=19G1BL3UKN8Z type=write size=2603256 2024-09-12T17:37:04.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.075+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=SULY7R33G90P type=del size=2837841 2024-09-12T17:37:04.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.079+0000 7f1ad43488c0 1 < completed delete operation key=CHMM14VRIOQH tag=4NHGZK3K5HJG type=del 2024-09-12T17:37:04.086 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.083+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~MY3EZXZYTYQB.0 size=66643 2024-09-12T17:37:04.086 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.083+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=MY3EZXZYTYQB tag=6PZ79AKD9P7T type=write size=1115219 2024-09-12T17:37:04.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.087+0000 7f1ad43488c0 1 < canceled operation key=Y3NQLDWQJ37Z tag=D7PELLWIRK5C type=del size=302329 2024-09-12T17:37:04.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.091+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=CACX9CG3N2OC type=del size=517866 2024-09-12T17:37:04.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.091+0000 7f1ad43488c0 1 < canceled part key=_multipart_05PAFB226IFP.2~P3NGCRJHUAHW.0 size=472690 2024-09-12T17:37:04.098 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.095+0000 7f1ad43488c0 1 < canceled multipart upload key=05PAFB226IFP upload=P3NGCRJHUAHW tag=0HU5UNAH8BEJ type=write size=1521266 2024-09-12T17:37:04.102 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.099+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=IUU109PBKWE8 type=del size=3644481 2024-09-12T17:37:04.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.107+0000 7f1ad43488c0 1 < suggested remove operation key=WWB6LAHAMIR9 tag=SU5PLDLQ62I0 type=write 2024-09-12T17:37:04.113 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.111+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=VFLS5KHHUV1F type=del size=1087154 2024-09-12T17:37:04.121 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.119+0000 7f1ad43488c0 1 < completed delete operation key=2SDYAQRNWAJK tag=6K4IMUW5WC5U type=del 2024-09-12T17:37:04.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.127+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~4CN0105PDT2S.0 size=1048576 2024-09-12T17:37:04.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.127+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~4CN0105PDT2S.1 size=625537 2024-09-12T17:37:04.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.131+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=4CN0105PDT2S tag=HC1RZKCROATG type=write size=2722689 2024-09-12T17:37:04.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.131+0000 7f1ad43488c0 1 < completed delete operation key=6Z3F28JHHEQS tag=WC18RG25K27Z type=del 2024-09-12T17:37:04.138 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.135+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=JZJHN8H2UFCY type=del size=1854803 2024-09-12T17:37:04.141 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.139+0000 7f1ad43488c0 1 < completed write operation key=NHOG1WG3VT6N tag=32KJYOHA3TFI type=write size=697528 2024-09-12T17:37:04.146 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.143+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~EF411AT47SX3.0 size=1048576 2024-09-12T17:37:04.149 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.147+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~EF411AT47SX3.1 size=1048576 2024-09-12T17:37:04.151 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.147+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~EF411AT47SX3.2 size=768035 2024-09-12T17:37:04.151 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.147+0000 7f1ad43488c0 1 > prepared multipart upload key=GWJ78NNXOL1R upload=EF411AT47SX3 tag=GERN0Q0K9VT7 type=write size=3913763 2024-09-12T17:37:04.156 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.155+0000 7f1ad43488c0 1 < suggested remove operation key=05PAFB226IFP tag=5GMT8MZ6ODPG type=del 2024-09-12T17:37:04.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.159+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=QK9022E73YZ5 type=del size=3319948 2024-09-12T17:37:04.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.159+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~H0VJBDJGAKKO.0 size=661040 2024-09-12T17:37:04.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.167+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=H0VJBDJGAKKO tag=GNZKF9QHZOG4 type=write size=1709616 2024-09-12T17:37:04.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.167+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=7KP0N9R3RSOO type=del size=3323998 2024-09-12T17:37:04.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.171+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~42VHXB5F63DL.0 size=1048576 2024-09-12T17:37:04.176 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.175+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~42VHXB5F63DL.1 size=1048576 2024-09-12T17:37:04.178 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.175+0000 7f1ad43488c0 1 < completed part key=_multipart_ECEF8IJGU4Z8.2~42VHXB5F63DL.2 size=316355 2024-09-12T17:37:04.184 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.183+0000 7f1ad43488c0 1 < completed multipart upload key=ECEF8IJGU4Z8 upload=42VHXB5F63DL tag=GFRVE13B65KG type=write size=3462083 2024-09-12T17:37:04.190 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.187+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~E4R9V9777AKK.0 size=1048576 2024-09-12T17:37:04.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.191+0000 7f1ad43488c0 1 > prepared part key=_multipart_C7QSOK3D3IWJ.2~E4R9V9777AKK.1 size=1038007 2024-09-12T17:37:04.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.191+0000 7f1ad43488c0 1 > prepared multipart upload key=C7QSOK3D3IWJ upload=E4R9V9777AKK tag=6HSAO0HVP20T type=write size=3135159 2024-09-12T17:37:04.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.195+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~EURUO0567W5D.0 size=1048576 2024-09-12T17:37:04.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.195+0000 7f1ad43488c0 1 < completed part key=_multipart_ZHFRKX9YY8P5.2~EURUO0567W5D.1 size=443085 2024-09-12T17:37:04.203 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.203+0000 7f1ad43488c0 1 < completed multipart upload key=ZHFRKX9YY8P5 upload=EURUO0567W5D tag=LVYCJFNT46DG type=write size=2540237 2024-09-12T17:37:04.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.203+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=3SB4E2G0HO15 type=del size=1197930 2024-09-12T17:37:04.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.207+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~N0EBSJR0VOTT.0 size=1048576 2024-09-12T17:37:04.212 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.211+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~N0EBSJR0VOTT.1 size=1048576 2024-09-12T17:37:04.214 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.211+0000 7f1ad43488c0 1 < completed part key=_multipart_3N1YT9TC0M3O.2~N0EBSJR0VOTT.2 size=842382 2024-09-12T17:37:04.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.219+0000 7f1ad43488c0 1 < completed multipart upload key=3N1YT9TC0M3O upload=N0EBSJR0VOTT tag=84NK7L52F0J9 type=write size=3988110 2024-09-12T17:37:04.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.223+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~LXYEL0XZFCNP.0 size=1048576 2024-09-12T17:37:04.228 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.227+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~LXYEL0XZFCNP.1 size=1048576 2024-09-12T17:37:04.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.227+0000 7f1ad43488c0 1 > prepared part key=_multipart_6Z3F28JHHEQS.2~LXYEL0XZFCNP.2 size=336889 2024-09-12T17:37:04.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.227+0000 7f1ad43488c0 1 > prepared multipart upload key=6Z3F28JHHEQS upload=LXYEL0XZFCNP tag=8NU5LQOD93VG type=write size=3482617 2024-09-12T17:37:04.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.231+0000 7f1ad43488c0 1 < completed delete operation key=WFEJLVRCKIUU tag=S0GJF530RVYJ type=del 2024-09-12T17:37:04.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.235+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=42I96UMPV8GH type=del size=1787700 2024-09-12T17:37:04.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.239+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~2JN6Q9N3PWRL.0 size=1048576 2024-09-12T17:37:04.242 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.239+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~2JN6Q9N3PWRL.1 size=1048576 2024-09-12T17:37:04.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.243+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~2JN6Q9N3PWRL.2 size=538978 2024-09-12T17:37:04.249 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.247+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=2JN6Q9N3PWRL tag=13B58W6HVY71 type=write size=3684706 2024-09-12T17:37:04.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.251+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=50T1D8W8GHGU type=del size=3874174 2024-09-12T17:37:04.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.255+0000 7f1ad43488c0 1 < completed delete operation key=GZ7LGZQHW4CY tag=9LFI17VMG8LM type=del 2024-09-12T17:37:04.258 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.255+0000 7f1ad43488c0 1 > prepared operation key=6Z3F28JHHEQS tag=DKJ4PVZWXYT7 type=write size=940617 2024-09-12T17:37:04.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.259+0000 7f1ad43488c0 1 < completed delete operation key=LU7XIBO5YUOR tag=SULY7R33G90P type=del 2024-09-12T17:37:04.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.263+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=CQ2JI1QLH71G type=del size=2188993 2024-09-12T17:37:04.268 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.267+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~MY3EZXZYTYQB.0 size=66643 2024-09-12T17:37:04.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.271+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=MY3EZXZYTYQB tag=6PZ79AKD9P7T type=write size=1115219 2024-09-12T17:37:04.278 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.275+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=0IF6J79RAXOU type=write size=951604 2024-09-12T17:37:04.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.279+0000 7f1ad43488c0 1 < completed delete operation key=RH4HYE315U5Y tag=CACX9CG3N2OC type=del 2024-09-12T17:37:04.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.283+0000 7f1ad43488c0 1 > prepared operation key=C7QSOK3D3IWJ tag=Z4LYE5CSUYZY type=del size=104910 2024-09-12T17:37:04.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.287+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=IUU109PBKWE8 type=del 2024-09-12T17:37:04.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.287+0000 7f1ad43488c0 1 > prepared operation key=X078SB1ITNII tag=2DQI2R6YDDI5 type=del size=172848 2024-09-12T17:37:04.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.295+0000 7f1ad43488c0 1 < suggested remove operation key=7RSHIZRKK2OY tag=VFLS5KHHUV1F type=del 2024-09-12T17:37:04.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.299+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~V2M95TGO4IRS.0 size=1048576 2024-09-12T17:37:04.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.303+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~V2M95TGO4IRS.1 size=241971 2024-09-12T17:37:04.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.303+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=V2M95TGO4IRS tag=KOKEJK61K3AM type=write size=2339123 2024-09-12T17:37:04.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.307+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~4CN0105PDT2S.0 size=1048576 2024-09-12T17:37:04.312 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.311+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~4CN0105PDT2S.1 size=625537 2024-09-12T17:37:04.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.315+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=4CN0105PDT2S tag=HC1RZKCROATG type=write size=2722689 2024-09-12T17:37:04.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.319+0000 7f1ad43488c0 1 > prepared operation key=05PAFB226IFP tag=KVT51H6I1SEB type=write size=924908 2024-09-12T17:37:04.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.323+0000 7f1ad43488c0 1 < completed delete operation key=X0HT3K3OREL7 tag=JZJHN8H2UFCY type=del 2024-09-12T17:37:04.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.327+0000 7f1ad43488c0 1 > prepared part key=_multipart_LU7XIBO5YUOR.2~Q49HT2RTL4JU.0 size=948256 2024-09-12T17:37:04.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.327+0000 7f1ad43488c0 1 > prepared multipart upload key=LU7XIBO5YUOR upload=Q49HT2RTL4JU tag=UM0KAM4BS40E type=write size=1996832 2024-09-12T17:37:04.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.331+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~EF411AT47SX3.0 size=1048576 2024-09-12T17:37:04.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.335+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~EF411AT47SX3.1 size=1048576 2024-09-12T17:37:04.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.339+0000 7f1ad43488c0 1 < completed part key=_multipart_GWJ78NNXOL1R.2~EF411AT47SX3.2 size=768035 2024-09-12T17:37:04.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.343+0000 7f1ad43488c0 1 < completed multipart upload key=GWJ78NNXOL1R upload=EF411AT47SX3 tag=GERN0Q0K9VT7 type=write size=3913763 2024-09-12T17:37:04.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.347+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=4U6VUWEB43S3 type=write size=44470 2024-09-12T17:37:04.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.351+0000 7f1ad43488c0 1 < completed delete operation key=WWB6LAHAMIR9 tag=QK9022E73YZ5 type=del 2024-09-12T17:37:04.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.355+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=193P51ZTI9AO type=del size=3173558 2024-09-12T17:37:04.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.355+0000 7f1ad43488c0 1 < completed delete operation key=BCPDXAL027U2 tag=7KP0N9R3RSOO type=del 2024-09-12T17:37:04.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.363+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~YW4N0STYJPVD.0 size=1048576 2024-09-12T17:37:04.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.363+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~YW4N0STYJPVD.1 size=125541 2024-09-12T17:37:04.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.363+0000 7f1ad43488c0 1 > prepared multipart upload key=NHOG1WG3VT6N upload=YW4N0STYJPVD tag=5MD61L1AZO1T type=write size=2222693 2024-09-12T17:37:04.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.367+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~E4R9V9777AKK.0 size=1048576 2024-09-12T17:37:04.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.371+0000 7f1ad43488c0 1 < completed part key=_multipart_C7QSOK3D3IWJ.2~E4R9V9777AKK.1 size=1038007 2024-09-12T17:37:04.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.375+0000 7f1ad43488c0 1 < completed multipart upload key=C7QSOK3D3IWJ upload=E4R9V9777AKK tag=6HSAO0HVP20T type=write size=3135159 2024-09-12T17:37:04.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.379+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~2LZD02OPNQC0.0 size=1048576 2024-09-12T17:37:04.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.419+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~2LZD02OPNQC0.1 size=1011181 2024-09-12T17:37:04.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.419+0000 7f1ad43488c0 1 > prepared multipart upload key=SIZ0Z1KWTGUJ upload=2LZD02OPNQC0 tag=USGDSAGUISU6 type=write size=3108333 2024-09-12T17:37:04.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.423+0000 7f1ad43488c0 1 < canceled operation key=C7QSOK3D3IWJ tag=3SB4E2G0HO15 type=del size=1197930 2024-09-12T17:37:04.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.427+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=ZR7S5GDBH589 type=del size=2306005 2024-09-12T17:37:04.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.431+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~LXYEL0XZFCNP.0 size=1048576 2024-09-12T17:37:04.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.435+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~LXYEL0XZFCNP.1 size=1048576 2024-09-12T17:37:04.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.435+0000 7f1ad43488c0 1 < completed part key=_multipart_6Z3F28JHHEQS.2~LXYEL0XZFCNP.2 size=336889 2024-09-12T17:37:04.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.443+0000 7f1ad43488c0 1 < completed multipart upload key=6Z3F28JHHEQS upload=LXYEL0XZFCNP tag=8NU5LQOD93VG type=write size=3482617 2024-09-12T17:37:04.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.447+0000 7f1ad43488c0 1 > prepared operation key=7RSHIZRKK2OY tag=Z16SBJL3TZ0D type=del size=1710587 2024-09-12T17:37:04.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.455+0000 7f1ad43488c0 1 < suggested update operation key=WFEJLVRCKIUU tag=42I96UMPV8GH type=del size=1787700 2024-09-12T17:37:04.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.459+0000 7f1ad43488c0 1 > prepared operation key=3N1YT9TC0M3O tag=3N6CL2LQUQWL type=del size=1560088 2024-09-12T17:37:04.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.467+0000 7f1ad43488c0 1 < suggested remove operation key=SDJ53NSPOIRC tag=50T1D8W8GHGU type=del 2024-09-12T17:37:04.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.471+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~JM8ZO28QXY96.0 size=1048576 2024-09-12T17:37:04.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.475+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~JM8ZO28QXY96.1 size=1048576 2024-09-12T17:37:04.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.479+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~JM8ZO28QXY96.2 size=1016412 2024-09-12T17:37:04.480 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.479+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=JM8ZO28QXY96 tag=NMP3O26OFT3F type=write size=4162140 2024-09-12T17:37:04.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.483+0000 7f1ad43488c0 1 < completed write operation key=6Z3F28JHHEQS tag=DKJ4PVZWXYT7 type=write size=940617 2024-09-12T17:37:04.487 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.487+0000 7f1ad43488c0 1 > prepared operation key=8U3L46JDJ8VS tag=G62WFS26Q144 type=del size=992358 2024-09-12T17:37:04.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.491+0000 7f1ad43488c0 1 < completed delete operation key=C7QSOK3D3IWJ tag=CQ2JI1QLH71G type=del 2024-09-12T17:37:04.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.495+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~9E0XV5MNDBQ2.0 size=1048576 2024-09-12T17:37:04.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.499+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~9E0XV5MNDBQ2.1 size=1048576 2024-09-12T17:37:04.504 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.503+0000 7f1ad43488c0 1 > prepared part key=_multipart_GZ7LGZQHW4CY.2~9E0XV5MNDBQ2.2 size=1022562 2024-09-12T17:37:04.504 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.503+0000 7f1ad43488c0 1 > prepared multipart upload key=GZ7LGZQHW4CY upload=9E0XV5MNDBQ2 tag=9BIOMXL9Y5Y2 type=write size=4168290 2024-09-12T17:37:04.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.511+0000 7f1ad43488c0 1 < suggested update operation key=A49CE02X3L2L tag=0IF6J79RAXOU type=write size=951604 2024-09-12T17:37:04.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.515+0000 7f1ad43488c0 1 > prepared operation key=WWB6LAHAMIR9 tag=XF2BLCZGWB3U type=del size=2516883 2024-09-12T17:37:04.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.519+0000 7f1ad43488c0 1 < completed delete operation key=C7QSOK3D3IWJ tag=Z4LYE5CSUYZY type=del 2024-09-12T17:37:04.527 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.527+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~EYH0HWEEBJ1T.0 size=1048576 2024-09-12T17:37:04.530 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.527+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~EYH0HWEEBJ1T.1 size=596425 2024-09-12T17:37:04.530 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.527+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=EYH0HWEEBJ1T tag=QSI70XMVZJYD type=write size=2693577 2024-09-12T17:37:04.533 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.531+0000 7f1ad43488c0 1 < completed delete operation key=X078SB1ITNII tag=2DQI2R6YDDI5 type=del 2024-09-12T17:37:04.537 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.535+0000 7f1ad43488c0 1 > prepared operation key=RH4HYE315U5Y tag=WTK04SGEFVNY type=del size=3894885 2024-09-12T17:37:04.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.539+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~V2M95TGO4IRS.0 size=1048576 2024-09-12T17:37:04.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.543+0000 7f1ad43488c0 1 < completed part key=_multipart_0MV3GCBTWZD0.2~V2M95TGO4IRS.1 size=241971 2024-09-12T17:37:04.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.547+0000 7f1ad43488c0 1 < completed multipart upload key=0MV3GCBTWZD0 upload=V2M95TGO4IRS tag=KOKEJK61K3AM type=write size=2339123 2024-09-12T17:37:04.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.551+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=8SHE30J82ZZV type=del size=3423292 2024-09-12T17:37:04.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.555+0000 7f1ad43488c0 1 < completed write operation key=05PAFB226IFP tag=KVT51H6I1SEB type=write size=924908 2024-09-12T17:37:04.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.559+0000 7f1ad43488c0 1 > prepared operation key=MB3FVGKV0ZNQ tag=SNP9Z6A2I0NA type=del size=119077 2024-09-12T17:37:04.562 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.559+0000 7f1ad43488c0 1 < completed part key=_multipart_LU7XIBO5YUOR.2~Q49HT2RTL4JU.0 size=948256 2024-09-12T17:37:04.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.567+0000 7f1ad43488c0 1 < completed multipart upload key=LU7XIBO5YUOR upload=Q49HT2RTL4JU tag=UM0KAM4BS40E type=write size=1996832 2024-09-12T17:37:04.572 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.571+0000 7f1ad43488c0 1 > prepared operation key=WFEJLVRCKIUU tag=ZWWRH5VA5LNJ type=write size=801272 2024-09-12T17:37:04.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.571+0000 7f1ad43488c0 1 < completed write operation key=Y3NQLDWQJ37Z tag=4U6VUWEB43S3 type=write size=44470 2024-09-12T17:37:04.578 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.575+0000 7f1ad43488c0 1 > prepared operation key=LU7XIBO5YUOR tag=1TU8SFNWNA28 type=del size=2921837 2024-09-12T17:37:04.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.579+0000 7f1ad43488c0 -1 < no bi entry to suggest for operation key=SDJ53NSPOIRC tag=193P51ZTI9AO type=del size=3173558: (2) No such file or directory 2024-09-12T17:37:04.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.583+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~UH8XGGNCM191.0 size=316227 2024-09-12T17:37:04.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.583+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=UH8XGGNCM191 tag=OIV5Z0HW80KP type=write size=1364803 2024-09-12T17:37:04.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.587+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~YW4N0STYJPVD.0 size=1048576 2024-09-12T17:37:04.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.591+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~YW4N0STYJPVD.1 size=125541 2024-09-12T17:37:04.597 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.595+0000 7f1ad43488c0 1 < completed multipart upload key=NHOG1WG3VT6N upload=YW4N0STYJPVD tag=5MD61L1AZO1T type=write size=2222693 2024-09-12T17:37:04.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.603+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~AW9FXDY8H77B.0 size=1048576 2024-09-12T17:37:04.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.603+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~AW9FXDY8H77B.1 size=1048576 2024-09-12T17:37:04.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.607+0000 7f1ad43488c0 1 > prepared part key=_multipart_RXJJOPR32OD5.2~AW9FXDY8H77B.2 size=943360 2024-09-12T17:37:04.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.607+0000 7f1ad43488c0 1 > prepared multipart upload key=RXJJOPR32OD5 upload=AW9FXDY8H77B tag=36ANZLZZYTFQ type=write size=4089088 2024-09-12T17:37:04.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.611+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~2LZD02OPNQC0.0 size=1048576 2024-09-12T17:37:04.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.615+0000 7f1ad43488c0 1 < completed part key=_multipart_SIZ0Z1KWTGUJ.2~2LZD02OPNQC0.1 size=1011181 2024-09-12T17:37:04.621 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.619+0000 7f1ad43488c0 1 < completed multipart upload key=SIZ0Z1KWTGUJ upload=2LZD02OPNQC0 tag=USGDSAGUISU6 type=write size=3108333 2024-09-12T17:37:04.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.627+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~2T2YLO5V9KHO.0 size=1048576 2024-09-12T17:37:04.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.627+0000 7f1ad43488c0 1 > prepared part key=_multipart_05PAFB226IFP.2~2T2YLO5V9KHO.1 size=471837 2024-09-12T17:37:04.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.627+0000 7f1ad43488c0 1 > prepared multipart upload key=05PAFB226IFP upload=2T2YLO5V9KHO tag=CV93WR1261LB type=write size=2568989 2024-09-12T17:37:04.635 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.631+0000 7f1ad43488c0 1 < canceled operation key=8U3L46JDJ8VS tag=ZR7S5GDBH589 type=del size=2306005 2024-09-12T17:37:04.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.639+0000 7f1ad43488c0 1 > prepared part key=_multipart_PKC1RR4FZWE0.2~EPNP9GOZ8UZH.0 size=93214 2024-09-12T17:37:04.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.639+0000 7f1ad43488c0 1 > prepared multipart upload key=PKC1RR4FZWE0 upload=EPNP9GOZ8UZH tag=5KSMYGY6F327 type=write size=1141790 2024-09-12T17:37:04.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.643+0000 7f1ad43488c0 1 < completed delete operation key=7RSHIZRKK2OY tag=Z16SBJL3TZ0D type=del 2024-09-12T17:37:04.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.643+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=RV9MZGS6R4FE type=del size=3878672 2024-09-12T17:37:04.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.647+0000 7f1ad43488c0 1 < completed delete operation key=3N1YT9TC0M3O tag=3N6CL2LQUQWL type=del 2024-09-12T17:37:04.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.651+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=XSTACGS0XDYH type=del size=4087712 2024-09-12T17:37:04.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.655+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~JM8ZO28QXY96.0 size=1048576 2024-09-12T17:37:04.659 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.659+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~JM8ZO28QXY96.1 size=1048576 2024-09-12T17:37:04.660 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.659+0000 7f1ad43488c0 1 < canceled part key=_multipart_PKC1RR4FZWE0.2~JM8ZO28QXY96.2 size=1016412 2024-09-12T17:37:04.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.663+0000 7f1ad43488c0 1 < canceled multipart upload key=PKC1RR4FZWE0 upload=JM8ZO28QXY96 tag=NMP3O26OFT3F type=write size=4162140 2024-09-12T17:37:04.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.667+0000 7f1ad43488c0 1 > prepared part key=_multipart_NHOG1WG3VT6N.2~54CGWDCT2WSU.0 size=488712 2024-09-12T17:37:04.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.667+0000 7f1ad43488c0 1 > prepared multipart upload key=NHOG1WG3VT6N upload=54CGWDCT2WSU tag=3W3SIWSNATUE type=write size=1537288 2024-09-12T17:37:04.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.671+0000 7f1ad43488c0 1 < canceled operation key=8U3L46JDJ8VS tag=G62WFS26Q144 type=del size=992358 2024-09-12T17:37:04.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.675+0000 7f1ad43488c0 1 > prepared operation key=GZ7LGZQHW4CY tag=MXQ4K609IPBZ type=del size=140279 2024-09-12T17:37:04.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.675+0000 7f1ad43488c0 1 < canceled part key=_multipart_GZ7LGZQHW4CY.2~9E0XV5MNDBQ2.0 size=1048576 2024-09-12T17:37:04.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.679+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~9E0XV5MNDBQ2.1 size=1048576 2024-09-12T17:37:04.683 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.683+0000 7f1ad43488c0 1 < completed part key=_multipart_GZ7LGZQHW4CY.2~9E0XV5MNDBQ2.2 size=1022562 2024-09-12T17:37:04.689 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.687+0000 7f1ad43488c0 1 < canceled multipart upload key=GZ7LGZQHW4CY upload=9E0XV5MNDBQ2 tag=9BIOMXL9Y5Y2 type=write size=4168290 2024-09-12T17:37:04.695 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.695+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~UV9T5CN2RR6O.0 size=1048576 2024-09-12T17:37:04.698 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.695+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~UV9T5CN2RR6O.1 size=1048576 2024-09-12T17:37:04.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.699+0000 7f1ad43488c0 1 > prepared part key=_multipart_4QO60GZ9V0GK.2~UV9T5CN2RR6O.2 size=930036 2024-09-12T17:37:04.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.699+0000 7f1ad43488c0 1 > prepared multipart upload key=4QO60GZ9V0GK upload=UV9T5CN2RR6O tag=ECE7WQMQ9IXU type=write size=4075764 2024-09-12T17:37:04.704 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.703+0000 7f1ad43488c0 1 < canceled operation key=WWB6LAHAMIR9 tag=XF2BLCZGWB3U type=del size=2516883 2024-09-12T17:37:04.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.707+0000 7f1ad43488c0 1 > prepared operation key=CHMM14VRIOQH tag=VDU400C9ERIH type=write size=495014 2024-09-12T17:37:04.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.711+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~EYH0HWEEBJ1T.0 size=1048576 2024-09-12T17:37:04.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.715+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~EYH0HWEEBJ1T.1 size=596425 2024-09-12T17:37:04.721 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.719+0000 7f1ad43488c0 1 < completed multipart upload key=4QO60GZ9V0GK upload=EYH0HWEEBJ1T tag=QSI70XMVZJYD type=write size=2693577 2024-09-12T17:37:04.724 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.723+0000 7f1ad43488c0 1 > prepared operation key=SIZ0Z1KWTGUJ tag=WHO1EO5RQ5Z2 type=write size=999707 2024-09-12T17:37:04.731 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.731+0000 7f1ad43488c0 1 < suggested update operation key=RH4HYE315U5Y tag=WTK04SGEFVNY type=del size=3894885 2024-09-12T17:37:04.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.731+0000 7f1ad43488c0 1 > prepared operation key=Y3NQLDWQJ37Z tag=K0H2JPHB5E75 type=del size=1887696 2024-09-12T17:37:04.739 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.739+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=8SHE30J82ZZV type=del 2024-09-12T17:37:04.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.739+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=KBQ1RXGTZPHL type=write size=965801 2024-09-12T17:37:04.746 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.743+0000 7f1ad43488c0 1 < completed delete operation key=MB3FVGKV0ZNQ tag=SNP9Z6A2I0NA type=del 2024-09-12T17:37:04.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.747+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=SW9XDLXIKM8B type=write size=4651 2024-09-12T17:37:04.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.751+0000 7f1ad43488c0 1 < completed write operation key=WFEJLVRCKIUU tag=ZWWRH5VA5LNJ type=write size=801272 2024-09-12T17:37:04.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.751+0000 7f1ad43488c0 1 > prepared operation key=XOEPYERWY6IT tag=SPO80T3W6N16 type=del size=886946 2024-09-12T17:37:04.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.759+0000 7f1ad43488c0 1 < suggested update operation key=LU7XIBO5YUOR tag=1TU8SFNWNA28 type=del size=2921837 2024-09-12T17:37:04.765 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.763+0000 7f1ad43488c0 1 > prepared part key=_multipart_Y3NQLDWQJ37Z.2~XX20BVMGF5WR.0 size=161431 2024-09-12T17:37:04.765 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.763+0000 7f1ad43488c0 1 > prepared multipart upload key=Y3NQLDWQJ37Z upload=XX20BVMGF5WR tag=JEJYJR8JRLB2 type=write size=1210007 2024-09-12T17:37:04.767 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.767+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~UH8XGGNCM191.0 size=316227 2024-09-12T17:37:04.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.775+0000 7f1ad43488c0 1 < completed multipart upload key=05PAFB226IFP upload=UH8XGGNCM191 tag=OIV5Z0HW80KP type=write size=1364803 2024-09-12T17:37:04.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.779+0000 7f1ad43488c0 1 > prepared part key=_multipart_WFEJLVRCKIUU.2~GLZLM99BIB9M.0 size=271725 2024-09-12T17:37:04.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.779+0000 7f1ad43488c0 1 > prepared multipart upload key=WFEJLVRCKIUU upload=GLZLM99BIB9M tag=ZEPWIL36YGOK type=write size=1320301 2024-09-12T17:37:04.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.783+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~AW9FXDY8H77B.0 size=1048576 2024-09-12T17:37:04.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.783+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~AW9FXDY8H77B.1 size=1048576 2024-09-12T17:37:04.787 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.787+0000 7f1ad43488c0 1 < completed part key=_multipart_RXJJOPR32OD5.2~AW9FXDY8H77B.2 size=943360 2024-09-12T17:37:04.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.791+0000 7f1ad43488c0 1 < completed multipart upload key=RXJJOPR32OD5 upload=AW9FXDY8H77B tag=36ANZLZZYTFQ type=write size=4089088 2024-09-12T17:37:04.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.791+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=TH0S64750FOI type=del size=3654655 2024-09-12T17:37:04.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.795+0000 7f1ad43488c0 1 < completed part key=_multipart_05PAFB226IFP.2~2T2YLO5V9KHO.0 size=1048576 2024-09-12T17:37:04.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.795+0000 7f1ad43488c0 1 < canceled part key=_multipart_05PAFB226IFP.2~2T2YLO5V9KHO.1 size=471837 2024-09-12T17:37:04.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.799+0000 7f1ad43488c0 1 < canceled multipart upload key=05PAFB226IFP upload=2T2YLO5V9KHO tag=CV93WR1261LB type=write size=2568989 2024-09-12T17:37:04.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.799+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=H7FNX6YDIUG0 type=del size=1838131 2024-09-12T17:37:04.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.803+0000 7f1ad43488c0 1 < completed part key=_multipart_PKC1RR4FZWE0.2~EPNP9GOZ8UZH.0 size=93214 2024-09-12T17:37:04.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.807+0000 7f1ad43488c0 1 < completed multipart upload key=PKC1RR4FZWE0 upload=EPNP9GOZ8UZH tag=5KSMYGY6F327 type=write size=1141790 2024-09-12T17:37:04.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.811+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=G90F7S1UXI9M type=del size=718011 2024-09-12T17:37:04.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.811+0000 7f1ad43488c0 1 < completed delete operation key=SIZ0Z1KWTGUJ tag=RV9MZGS6R4FE type=del 2024-09-12T17:37:04.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.815+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~7URIKBW00NAR.0 size=1048576 2024-09-12T17:37:04.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.819+0000 7f1ad43488c0 1 > prepared part key=_multipart_SIZ0Z1KWTGUJ.2~7URIKBW00NAR.1 size=371424 2024-09-12T17:37:04.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.819+0000 7f1ad43488c0 1 > prepared multipart upload key=SIZ0Z1KWTGUJ upload=7URIKBW00NAR tag=ZRK47BBQNJDL type=write size=2468576 2024-09-12T17:37:04.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.823+0000 7f1ad43488c0 1 < completed delete operation key=A49CE02X3L2L tag=XSTACGS0XDYH type=del 2024-09-12T17:37:04.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.827+0000 7f1ad43488c0 1 > prepared part key=_multipart_GWJ78NNXOL1R.2~NXX4ILUPKUME.0 size=722633 2024-09-12T17:37:04.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.827+0000 7f1ad43488c0 1 > prepared multipart upload key=GWJ78NNXOL1R upload=NXX4ILUPKUME tag=FA5CKYJFBE9R type=write size=1771209 2024-09-12T17:37:04.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.827+0000 7f1ad43488c0 1 < completed part key=_multipart_NHOG1WG3VT6N.2~54CGWDCT2WSU.0 size=488712 2024-09-12T17:37:04.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.831+0000 7f1ad43488c0 1 < completed multipart upload key=NHOG1WG3VT6N upload=54CGWDCT2WSU tag=3W3SIWSNATUE type=write size=1537288 2024-09-12T17:37:04.838 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.835+0000 7f1ad43488c0 1 > prepared part key=_multipart_7RSHIZRKK2OY.2~612249IDWFT0.0 size=462215 2024-09-12T17:37:04.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.835+0000 7f1ad43488c0 1 > prepared multipart upload key=7RSHIZRKK2OY upload=612249IDWFT0 tag=MCX1B2A81CH6 type=write size=1510791 2024-09-12T17:37:04.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.839+0000 7f1ad43488c0 1 < canceled operation key=GZ7LGZQHW4CY tag=MXQ4K609IPBZ type=del size=140279 2024-09-12T17:37:04.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.843+0000 7f1ad43488c0 1 > prepared operation key=A49CE02X3L2L tag=1M1QDBB7J0DR type=del size=3285599 2024-09-12T17:37:04.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.843+0000 7f1ad43488c0 1 < canceled part key=_multipart_4QO60GZ9V0GK.2~UV9T5CN2RR6O.0 size=1048576 2024-09-12T17:37:04.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.843+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~UV9T5CN2RR6O.1 size=1048576 2024-09-12T17:37:04.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.847+0000 7f1ad43488c0 1 < completed part key=_multipart_4QO60GZ9V0GK.2~UV9T5CN2RR6O.2 size=930036 2024-09-12T17:37:04.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.851+0000 7f1ad43488c0 1 < canceled multipart upload key=4QO60GZ9V0GK upload=UV9T5CN2RR6O tag=ECE7WQMQ9IXU type=write size=4075764 2024-09-12T17:37:04.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.851+0000 7f1ad43488c0 1 > prepared operation key=BCPDXAL027U2 tag=FYZTZJB8OEJI type=del size=1764168 2024-09-12T17:37:04.856 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.855+0000 7f1ad43488c0 1 < completed write operation key=CHMM14VRIOQH tag=VDU400C9ERIH type=write size=495014 2024-09-12T17:37:04.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.855+0000 7f1ad43488c0 1 > prepared operation key=ZHFRKX9YY8P5 tag=NA7NO92JQDTV type=del size=307317 2024-09-12T17:37:04.860 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.859+0000 7f1ad43488c0 1 < canceled operation key=SIZ0Z1KWTGUJ tag=WHO1EO5RQ5Z2 type=write size=999707 2024-09-12T17:37:04.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.859+0000 7f1ad43488c0 1 > prepared operation key=X0HT3K3OREL7 tag=3MMLXYQDP5TP type=del size=2455378 2024-09-12T17:37:04.865 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.863+0000 7f1ad43488c0 1 < completed delete operation key=Y3NQLDWQJ37Z tag=K0H2JPHB5E75 type=del 2024-09-12T17:37:04.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.867+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~O3LWPPW0HXWX.0 size=1048576 2024-09-12T17:37:04.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.871+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~O3LWPPW0HXWX.1 size=1048576 2024-09-12T17:37:04.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.871+0000 7f1ad43488c0 1 > prepared part key=_multipart_2SDYAQRNWAJK.2~O3LWPPW0HXWX.2 size=418581 2024-09-12T17:37:04.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.871+0000 7f1ad43488c0 1 > prepared multipart upload key=2SDYAQRNWAJK upload=O3LWPPW0HXWX tag=A054S6XKUFWO type=write size=3564309 2024-09-12T17:37:04.876 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.875+0000 7f1ad43488c0 1 < completed write operation key=SDJ53NSPOIRC tag=KBQ1RXGTZPHL type=write size=965801 2024-09-12T17:37:04.878 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.875+0000 7f1ad43488c0 1 > prepared operation key=SDJ53NSPOIRC tag=AAECAVJ26OU8 type=del size=2053566 2024-09-12T17:37:04.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.879+0000 7f1ad43488c0 1 < completed write operation key=SDJ53NSPOIRC tag=SW9XDLXIKM8B type=write size=4651 2024-09-12T17:37:04.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.883+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~1X3YXEQW26HO.0 size=1048576 2024-09-12T17:37:04.888 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.887+0000 7f1ad43488c0 1 > prepared part key=_multipart_0MV3GCBTWZD0.2~1X3YXEQW26HO.1 size=603674 2024-09-12T17:37:04.888 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.887+0000 7f1ad43488c0 1 > prepared multipart upload key=0MV3GCBTWZD0 upload=1X3YXEQW26HO tag=N1531AV4TXRF type=write size=2700826 2024-09-12T17:37:04.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.891+0000 7f1ad43488c0 1 < completed delete operation key=XOEPYERWY6IT tag=SPO80T3W6N16 type=del 2024-09-12T17:37:04.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.895+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~JHKAUSQGMHR2.0 size=1048576 2024-09-12T17:37:04.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.895+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~JHKAUSQGMHR2.1 size=374519 2024-09-12T17:37:04.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.895+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=JHKAUSQGMHR2 tag=G4U5IF3XEYTR type=write size=2471671 2024-09-12T17:37:04.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.899+0000 7f1ad43488c0 1 < completed part key=_multipart_Y3NQLDWQJ37Z.2~XX20BVMGF5WR.0 size=161431 2024-09-12T17:37:04.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.903+0000 7f1ad43488c0 1 < completed multipart upload key=Y3NQLDWQJ37Z upload=XX20BVMGF5WR tag=JEJYJR8JRLB2 type=write size=1210007 2024-09-12T17:37:04.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.911+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~6JHDWKRYCERZ.0 size=1048576 2024-09-12T17:37:04.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.911+0000 7f1ad43488c0 1 > prepared part key=_multipart_X078SB1ITNII.2~6JHDWKRYCERZ.1 size=128234 2024-09-12T17:37:04.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.911+0000 7f1ad43488c0 1 > prepared multipart upload key=X078SB1ITNII upload=6JHDWKRYCERZ tag=GKNQZITN28HS type=write size=2225386 2024-09-12T17:37:04.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.915+0000 7f1ad43488c0 1 < completed part key=_multipart_WFEJLVRCKIUU.2~GLZLM99BIB9M.0 size=271725 2024-09-12T17:37:04.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.919+0000 7f1ad43488c0 1 < completed multipart upload key=WFEJLVRCKIUU upload=GLZLM99BIB9M tag=ZEPWIL36YGOK type=write size=1320301 2024-09-12T17:37:04.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.923+0000 7f1ad43488c0 1 > prepared part key=_multipart_8U3L46JDJ8VS.2~MC1SXSMNKWE1.0 size=89043 2024-09-12T17:37:04.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.923+0000 7f1ad43488c0 1 > prepared multipart upload key=8U3L46JDJ8VS upload=MC1SXSMNKWE1 tag=BXMNKL1L6TY2 type=write size=1137619 2024-09-12T17:37:04.927 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.927+0000 7f1ad43488c0 1 < completed delete operation key=X0HT3K3OREL7 tag=TH0S64750FOI type=del 2024-09-12T17:37:04.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:37:04.927+0000 7f1ad43488c0 1 > prepared operation key=IY2AM7CJDUZG tag=L1DXBKD3HDOH type=write size=826599 2024-09-12T17:37:04.930 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] cls_rgw_stats.simulate (21520 ms) 2024-09-12T17:37:04.930 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 1 test from cls_rgw_stats (21520 ms total) 2024-09-12T17:37:04.930 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:37:04.930 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:37:05.558 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 1 test from 1 test suite ran. (24023 ms total) 2024-09-12T17:37:05.559 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 1 test. 2024-09-12T17:37:05.568 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:37:05.568 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:37:05.623 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T17:37:05.624 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T17:37:05.625 DEBUG:teuthology.orchestra.run.smithi098:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T17:37:05.690 INFO:tasks.workunit.client.0.smithi098.stdout:Running main() from gmock_main.cc 2024-09-12T17:37:05.690 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T17:37:05.691 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:37:07.584 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 31 tests from CmpOmap 2024-09-12T17:37:07.585 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T17:37:07.608 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (24 ms) 2024-09-12T17:37:07.608 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T17:37:07.627 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (19 ms) 2024-09-12T17:37:07.627 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T17:37:07.632 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (5 ms) 2024-09-12T17:37:07.632 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T17:37:07.638 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (6 ms) 2024-09-12T17:37:07.638 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T17:37:07.652 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_vals_str (14 ms) 2024-09-12T17:37:07.652 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T17:37:07.660 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_vals_u64 (8 ms) 2024-09-12T17:37:07.660 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T17:37:07.666 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (6 ms) 2024-09-12T17:37:07.666 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T17:37:07.674 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (8 ms) 2024-09-12T17:37:07.674 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T17:37:07.682 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (8 ms) 2024-09-12T17:37:07.682 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T17:37:07.691 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (9 ms) 2024-09-12T17:37:07.692 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T17:37:07.693 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-12T17:37:07.694 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T17:37:07.695 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (2 ms) 2024-09-12T17:37:07.696 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T17:37:07.711 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (16 ms) 2024-09-12T17:37:07.711 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T17:37:07.732 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (21 ms) 2024-09-12T17:37:07.732 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T17:37:07.749 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (17 ms) 2024-09-12T17:37:07.749 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T17:37:07.765 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (15 ms) 2024-09-12T17:37:07.765 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T17:37:07.786 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_set_vals_str (22 ms) 2024-09-12T17:37:07.786 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T17:37:07.807 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (21 ms) 2024-09-12T17:37:07.807 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T17:37:07.814 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (7 ms) 2024-09-12T17:37:07.814 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T17:37:07.820 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (6 ms) 2024-09-12T17:37:07.820 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T17:37:07.823 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (3 ms) 2024-09-12T17:37:07.823 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T17:37:07.825 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (2 ms) 2024-09-12T17:37:07.825 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T17:37:07.841 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (16 ms) 2024-09-12T17:37:07.841 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T17:37:07.859 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (18 ms) 2024-09-12T17:37:07.859 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T17:37:07.878 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (19 ms) 2024-09-12T17:37:07.878 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T17:37:07.899 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (21 ms) 2024-09-12T17:37:07.899 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T17:37:07.906 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (6 ms) 2024-09-12T17:37:07.906 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T17:37:07.911 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (6 ms) 2024-09-12T17:37:07.912 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T17:37:07.914 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-09-12T17:37:07.914 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T17:37:07.916 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-09-12T17:37:07.916 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T17:37:07.935 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (19 ms) 2024-09-12T17:37:07.935 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 31 tests from CmpOmap (351 ms total) 2024-09-12T17:37:07.936 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:37:07.936 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:37:08.599 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 31 tests from 1 test suite ran. (2909 ms total) 2024-09-12T17:37:08.600 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 31 tests. 2024-09-12T17:37:08.605 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:37:08.605 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:37:08.664 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T17:37:08.665 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T17:37:08.666 DEBUG:teuthology.orchestra.run.smithi098:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T17:37:08.733 INFO:tasks.workunit.client.0.smithi098.stdout:Running main() from gmock_main.cc 2024-09-12T17:37:08.733 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:37:08.733 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:37:08.734 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T17:37:08.734 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T17:37:11.648 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2910 ms) 2024-09-12T17:37:11.648 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T17:37:14.649 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3005 ms) 2024-09-12T17:37:14.649 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T17:37:17.692 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.Reserve (3044 ms) 2024-09-12T17:37:17.692 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T17:37:20.698 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3006 ms) 2024-09-12T17:37:20.698 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T17:37:24.767 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.Commit (4069 ms) 2024-09-12T17:37:24.767 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T17:37:28.827 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.Stats (4060 ms) 2024-09-12T17:37:28.827 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T17:37:32.865 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4038 ms) 2024-09-12T17:37:32.865 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T17:37:35.887 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.Abort (3014 ms) 2024-09-12T17:37:35.887 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T17:37:38.935 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.ReserveError (3050 ms) 2024-09-12T17:37:38.935 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T17:37:41.972 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.CommitError (3043 ms) 2024-09-12T17:37:41.972 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T17:37:44.995 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.AbortError (3020 ms) 2024-09-12T17:37:44.995 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T17:37:48.010 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3018 ms) 2024-09-12T17:37:48.010 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T17:37:51.055 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3041 ms) 2024-09-12T17:37:51.055 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T17:37:54.111 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3054 ms) 2024-09-12T17:37:54.111 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T17:37:57.131 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3020 ms) 2024-09-12T17:37:57.131 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T17:38:00.173 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3048 ms) 2024-09-12T17:38:00.173 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T17:38:03.219 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3043 ms) 2024-09-12T17:38:03.219 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T17:38:06.233 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.Cleanup (3016 ms) 2024-09-12T17:38:06.233 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T17:38:17.274 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.MultiProducer (11041 ms) 2024-09-12T17:38:17.275 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T17:38:22.395 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5121 ms) 2024-09-12T17:38:22.395 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T17:38:36.467 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (14069 ms) 2024-09-12T17:38:36.467 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T17:38:42.559 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (6088 ms) 2024-09-12T17:38:42.559 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T17:38:52.626 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (10073 ms) 2024-09-12T17:38:52.626 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T17:39:02.692 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (10067 ms) 2024-09-12T17:39:02.693 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 24 tests from TestCls2PCQueue (113959 ms total) 2024-09-12T17:39:02.693 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:39:02.693 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:39:02.693 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 24 tests from 1 test suite ran. (113959 ms total) 2024-09-12T17:39:02.693 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 24 tests. 2024-09-12T17:39:02.699 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:39:02.700 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:39:02.756 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T17:39:02.757 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T17:39:02.758 DEBUG:teuthology.orchestra.run.smithi098:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T17:39:02.831 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:02.832 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:02.832 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:39:02.832 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:39:04.729 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 4 tests from ClsAccount 2024-09-12T17:39:04.729 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] ClsAccount.add 2024-09-12T17:39:04.753 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] ClsAccount.add (25 ms) 2024-09-12T17:39:04.754 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] ClsAccount.get 2024-09-12T17:39:04.760 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] ClsAccount.get (6 ms) 2024-09-12T17:39:04.760 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] ClsAccount.rm 2024-09-12T17:39:04.903 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] ClsAccount.rm (143 ms) 2024-09-12T17:39:04.903 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] ClsAccount.list 2024-09-12T17:39:04.954 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] ClsAccount.list (51 ms) 2024-09-12T17:39:04.954 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 4 tests from ClsAccount (225 ms total) 2024-09-12T17:39:04.954 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:39:04.954 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:39:05.748 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 4 tests from 1 test suite ran. (2916 ms total) 2024-09-12T17:39:05.748 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 4 tests. 2024-09-12T17:39:05.752 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:39:05.753 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:39:05.808 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T17:39:05.809 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T17:39:05.809 DEBUG:teuthology.orchestra.run.smithi098:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T17:39:05.884 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:05.884 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:05.884 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T17:39:05.885 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:39:07.753 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T17:39:07.753 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T17:39:07.796 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] rgw_gc_log.init_existing_queue (44 ms) 2024-09-12T17:39:07.796 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T17:39:07.801 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] rgw_gc_log.init_existing_omap (4 ms) 2024-09-12T17:39:07.801 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T17:39:07.808 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (7 ms) 2024-09-12T17:39:07.808 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T17:39:07.810 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (3 ms) 2024-09-12T17:39:07.811 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T17:39:07.815 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] rgw_gc_log.defer1_after_init (4 ms) 2024-09-12T17:39:07.815 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T17:39:07.818 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] rgw_gc_log.defer2_before_init (3 ms) 2024-09-12T17:39:07.818 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 6 tests from rgw_gc_log (65 ms total) 2024-09-12T17:39:07.818 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:39:07.818 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:39:08.775 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 6 tests from 1 test suite ran. (2891 ms total) 2024-09-12T17:39:08.775 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 6 tests. 2024-09-12T17:39:08.780 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:39:08.780 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:39:08.839 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T17:39:08.840 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T17:39:08.840 DEBUG:teuthology.orchestra.run.smithi098:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T17:39:08.918 INFO:tasks.workunit.client.0.smithi098.stdout:Running main() from gmock_main.cc 2024-09-12T17:39:08.918 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T17:39:08.918 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:39:08.918 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T17:39:08.918 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T17:39:08.918 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj 2024-09-12T17:39:08.918 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj 2024-09-12T17:39:08.918 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: _obj ns= i= 2024-09-12T17:39:08.918 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj 2024-09-12T17:39:08.918 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj 2024-09-12T17:39:08.918 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: _obj ns= i= 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: _obj ns= i= 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi098.stdout: "obj1": { 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.919 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_obj", 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi098.stdout: "obj2": { 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.920 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.921 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.921 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.921 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.921 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.921 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.921 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.921 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.921 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.921 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.921 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_obj", 2024-09-12T17:39:08.921 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.921 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.921 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi098.stdout: "obj3": { 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.922 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.923 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.923 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_obj", 2024-09-12T17:39:08.923 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.923 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.923 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.923 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.923 INFO:tasks.workunit.client.0.smithi098.stdout: "obj3-2": { 2024-09-12T17:39:08.923 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.923 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.923 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.923 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.923 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.923 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.924 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.924 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.924 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.924 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.924 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.924 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.924 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_obj", 2024-09-12T17:39:08.924 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.924 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.924 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.924 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.924 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:08.924 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj 2024-09-12T17:39:08.925 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj 2024-09-12T17:39:08.925 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: _obj ns=ns i= 2024-09-12T17:39:08.925 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj 2024-09-12T17:39:08.925 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj 2024-09-12T17:39:08.925 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: _obj ns=ns i= 2024-09-12T17:39:08.925 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj 2024-09-12T17:39:08.925 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj 2024-09-12T17:39:08.925 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: _obj ns=ns i= 2024-09-12T17:39:08.925 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:08.925 INFO:tasks.workunit.client.0.smithi098.stdout: "obj1": { 2024-09-12T17:39:08.925 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.925 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.926 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.928 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.929 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.929 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.929 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.929 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.929 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.930 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.930 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.930 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.930 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_obj", 2024-09-12T17:39:08.930 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.930 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:08.930 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.931 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.931 INFO:tasks.workunit.client.0.smithi098.stdout: "obj2": { 2024-09-12T17:39:08.931 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.931 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.931 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.932 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.932 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.932 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.932 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.932 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.932 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.932 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.932 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.932 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.932 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_obj", 2024-09-12T17:39:08.932 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.933 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:08.933 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.933 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.933 INFO:tasks.workunit.client.0.smithi098.stdout: "obj3": { 2024-09-12T17:39:08.933 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.933 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.933 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.933 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.933 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.933 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.933 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.934 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.934 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.934 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.934 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.934 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.934 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_obj", 2024-09-12T17:39:08.934 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.934 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.934 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.934 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.934 INFO:tasks.workunit.client.0.smithi098.stdout: "obj3-2": { 2024-09-12T17:39:08.934 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.935 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.935 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.935 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.935 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.935 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.935 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.935 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.935 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.935 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.935 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.935 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.936 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_obj", 2024-09-12T17:39:08.936 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.936 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:08.936 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.936 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.936 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:08.936 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj[v1] 2024-09-12T17:39:08.936 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj[v1] 2024-09-12T17:39:08.936 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: _obj ns= i=v1 2024-09-12T17:39:08.936 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj[v1] 2024-09-12T17:39:08.936 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj[v1] 2024-09-12T17:39:08.936 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: _obj ns= i=v1 2024-09-12T17:39:08.937 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj[v1] 2024-09-12T17:39:08.937 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj[v1] 2024-09-12T17:39:08.937 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: _obj ns= i=v1 2024-09-12T17:39:08.937 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:08.937 INFO:tasks.workunit.client.0.smithi098.stdout: "obj1": { 2024-09-12T17:39:08.937 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.937 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.937 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.937 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.937 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.938 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.938 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.938 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.938 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.938 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.938 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.938 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.938 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_obj", 2024-09-12T17:39:08.938 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "v1", 2024-09-12T17:39:08.938 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.938 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.938 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.938 INFO:tasks.workunit.client.0.smithi098.stdout: "obj2": { 2024-09-12T17:39:08.939 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.939 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.939 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.939 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.939 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.939 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.939 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.939 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.939 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.939 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.939 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.939 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.939 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_obj", 2024-09-12T17:39:08.940 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "v1", 2024-09-12T17:39:08.940 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.940 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.940 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.940 INFO:tasks.workunit.client.0.smithi098.stdout: "obj3": { 2024-09-12T17:39:08.940 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.940 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.940 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.941 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.941 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.941 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.941 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.941 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.941 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.941 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.941 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.941 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.941 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_obj", 2024-09-12T17:39:08.942 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.942 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.942 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.942 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.942 INFO:tasks.workunit.client.0.smithi098.stdout: "obj3-2": { 2024-09-12T17:39:08.942 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.942 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.942 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.942 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.942 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.942 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.942 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.943 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.943 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.943 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.943 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.943 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.943 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_obj", 2024-09-12T17:39:08.943 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "v1", 2024-09-12T17:39:08.943 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.943 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.943 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.943 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:08.943 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj[v1] 2024-09-12T17:39:08.943 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj[v1] 2024-09-12T17:39:08.944 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:39:08.944 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj[v1] 2024-09-12T17:39:08.944 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj[v1] 2024-09-12T17:39:08.944 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:39:08.944 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj[v1] 2024-09-12T17:39:08.944 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: _obj[v1] 2024-09-12T17:39:08.944 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: _obj ns=ns i=v1 2024-09-12T17:39:08.944 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:08.944 INFO:tasks.workunit.client.0.smithi098.stdout: "obj1": { 2024-09-12T17:39:08.945 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.945 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.945 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.945 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.945 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.945 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.945 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.945 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.945 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.945 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.945 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.945 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.946 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_obj", 2024-09-12T17:39:08.946 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "v1", 2024-09-12T17:39:08.946 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:08.946 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.946 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.946 INFO:tasks.workunit.client.0.smithi098.stdout: "obj2": { 2024-09-12T17:39:08.946 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.946 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.946 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.946 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.946 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.947 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.947 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.947 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.947 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.947 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.947 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.947 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.947 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_obj", 2024-09-12T17:39:08.947 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "v1", 2024-09-12T17:39:08.947 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:08.947 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.948 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.948 INFO:tasks.workunit.client.0.smithi098.stdout: "obj3": { 2024-09-12T17:39:08.948 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.948 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.948 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.948 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.948 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.948 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.948 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.948 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.948 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.948 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.948 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.949 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.949 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_obj", 2024-09-12T17:39:08.949 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.949 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.949 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.949 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.949 INFO:tasks.workunit.client.0.smithi098.stdout: "obj3-2": { 2024-09-12T17:39:08.949 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.949 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.949 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.949 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.950 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.950 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.950 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.950 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.950 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.950 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.950 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.950 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.950 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_obj", 2024-09-12T17:39:08.951 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "v1", 2024-09-12T17:39:08.951 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:08.951 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.951 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.951 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:08.951 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-12T17:39:08.951 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T17:39:08.951 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj 2024-09-12T17:39:08.951 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj 2024-09-12T17:39:08.951 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: obj ns= i= 2024-09-12T17:39:08.951 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj 2024-09-12T17:39:08.951 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj 2024-09-12T17:39:08.952 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: obj ns= i= 2024-09-12T17:39:08.952 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj 2024-09-12T17:39:08.952 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj 2024-09-12T17:39:08.952 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: obj ns= i= 2024-09-12T17:39:08.952 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:08.952 INFO:tasks.workunit.client.0.smithi098.stdout: "obj1": { 2024-09-12T17:39:08.952 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.952 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.952 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.952 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.952 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.952 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.953 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.953 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.953 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.953 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.953 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.953 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.953 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "obj", 2024-09-12T17:39:08.953 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.953 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.953 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.954 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.954 INFO:tasks.workunit.client.0.smithi098.stdout: "obj2": { 2024-09-12T17:39:08.954 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.954 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.954 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.954 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.954 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.954 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.954 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.955 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.955 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.955 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.955 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.955 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.955 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "obj", 2024-09-12T17:39:08.955 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.955 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.955 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.956 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.956 INFO:tasks.workunit.client.0.smithi098.stdout: "obj3": { 2024-09-12T17:39:08.956 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.956 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.956 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.956 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.956 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.956 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.956 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.956 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.956 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.957 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.957 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.957 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.957 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "obj", 2024-09-12T17:39:08.957 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.957 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.957 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.957 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.957 INFO:tasks.workunit.client.0.smithi098.stdout: "obj3-2": { 2024-09-12T17:39:08.957 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.958 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.958 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.958 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.958 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.958 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.958 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.958 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.958 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.958 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.958 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.958 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.958 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "obj", 2024-09-12T17:39:08.959 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.959 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.959 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.959 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.959 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:08.959 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj 2024-09-12T17:39:08.959 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj 2024-09-12T17:39:08.959 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: obj ns=ns i= 2024-09-12T17:39:08.959 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj 2024-09-12T17:39:08.959 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj 2024-09-12T17:39:08.959 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: obj ns=ns i= 2024-09-12T17:39:08.959 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj 2024-09-12T17:39:08.959 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj 2024-09-12T17:39:08.959 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: obj ns=ns i= 2024-09-12T17:39:08.960 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:08.960 INFO:tasks.workunit.client.0.smithi098.stdout: "obj1": { 2024-09-12T17:39:08.960 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.960 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.960 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.960 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.960 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.960 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.960 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.960 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.961 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.961 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.961 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.961 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.961 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "obj", 2024-09-12T17:39:08.961 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.962 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:08.962 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.962 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.962 INFO:tasks.workunit.client.0.smithi098.stdout: "obj2": { 2024-09-12T17:39:08.962 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.962 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.963 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.963 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.963 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.964 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.964 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.964 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.964 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.964 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.964 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.965 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.965 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "obj", 2024-09-12T17:39:08.965 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.965 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:08.965 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.965 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.966 INFO:tasks.workunit.client.0.smithi098.stdout: "obj3": { 2024-09-12T17:39:08.966 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.966 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.966 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.966 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.966 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.967 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.967 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.967 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.967 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.967 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.967 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.968 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.968 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "obj", 2024-09-12T17:39:08.968 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.968 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.968 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.968 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.969 INFO:tasks.workunit.client.0.smithi098.stdout: "obj3-2": { 2024-09-12T17:39:08.969 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.969 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.969 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.969 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.970 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.970 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.970 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.970 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.970 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.970 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.970 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.971 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.971 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "obj", 2024-09-12T17:39:08.971 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.971 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:08.971 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.971 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.972 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:08.972 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj[v1] 2024-09-12T17:39:08.972 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj[v1] 2024-09-12T17:39:08.972 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: obj ns= i=v1 2024-09-12T17:39:08.972 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj[v1] 2024-09-12T17:39:08.972 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj[v1] 2024-09-12T17:39:08.973 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: obj ns= i=v1 2024-09-12T17:39:08.973 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj[v1] 2024-09-12T17:39:08.973 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj[v1] 2024-09-12T17:39:08.973 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: obj ns= i=v1 2024-09-12T17:39:08.973 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:08.973 INFO:tasks.workunit.client.0.smithi098.stdout: "obj1": { 2024-09-12T17:39:08.974 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.974 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.974 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.974 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.974 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.974 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.974 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.974 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.975 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.975 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.975 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.975 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.975 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "obj", 2024-09-12T17:39:08.975 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "v1", 2024-09-12T17:39:08.975 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.975 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.976 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.976 INFO:tasks.workunit.client.0.smithi098.stdout: "obj2": { 2024-09-12T17:39:08.976 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.976 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.976 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.976 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.976 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.976 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.976 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.977 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.977 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.977 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.977 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.977 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.977 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "obj", 2024-09-12T17:39:08.977 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "v1", 2024-09-12T17:39:08.977 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.977 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.977 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.977 INFO:tasks.workunit.client.0.smithi098.stdout: "obj3": { 2024-09-12T17:39:08.977 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.977 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.978 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.978 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.978 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.978 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.978 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.978 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.978 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.978 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.978 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.979 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.979 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "obj", 2024-09-12T17:39:08.979 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.979 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.979 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.979 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.979 INFO:tasks.workunit.client.0.smithi098.stdout: "obj3-2": { 2024-09-12T17:39:08.979 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.979 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.979 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.979 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.979 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.979 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.980 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.980 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.980 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.980 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.980 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.980 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.980 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "obj", 2024-09-12T17:39:08.980 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "v1", 2024-09-12T17:39:08.980 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.980 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.980 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.980 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:08.981 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj[v1] 2024-09-12T17:39:08.981 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj[v1] 2024-09-12T17:39:08.981 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:39:08.981 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj[v1] 2024-09-12T17:39:08.981 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj[v1] 2024-09-12T17:39:08.981 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:39:08.981 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj[v1] 2024-09-12T17:39:08.981 INFO:tasks.workunit.client.0.smithi098.stdout:parsed: obj[v1] 2024-09-12T17:39:08.981 INFO:tasks.workunit.client.0.smithi098.stdout:stripped: obj ns=ns i=v1 2024-09-12T17:39:08.982 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:08.982 INFO:tasks.workunit.client.0.smithi098.stdout: "obj1": { 2024-09-12T17:39:08.982 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.982 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.982 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.982 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.982 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.982 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.982 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.983 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.983 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.983 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.983 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.983 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.983 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "obj", 2024-09-12T17:39:08.983 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "v1", 2024-09-12T17:39:08.983 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:08.983 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.983 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.983 INFO:tasks.workunit.client.0.smithi098.stdout: "obj2": { 2024-09-12T17:39:08.983 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.984 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.984 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.984 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.984 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.984 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.984 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.984 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.984 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.984 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.984 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.985 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.985 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "obj", 2024-09-12T17:39:08.985 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "v1", 2024-09-12T17:39:08.985 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:08.985 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.985 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.985 INFO:tasks.workunit.client.0.smithi098.stdout: "obj3": { 2024-09-12T17:39:08.986 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.986 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.986 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.986 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.986 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.986 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.986 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.986 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.986 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.986 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.986 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.987 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.987 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "obj", 2024-09-12T17:39:08.987 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.987 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.987 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.987 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.987 INFO:tasks.workunit.client.0.smithi098.stdout: "obj3-2": { 2024-09-12T17:39:08.987 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.987 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.987 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.987 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.987 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.988 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.988 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.988 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.988 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.988 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.988 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.988 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.988 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "obj", 2024-09-12T17:39:08.988 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "v1", 2024-09-12T17:39:08.988 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:08.988 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.988 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.988 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:08.989 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T17:39:08.989 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T17:39:08.989 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:08.989 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.989 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.989 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.989 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.989 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.989 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.989 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.989 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.989 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.990 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.990 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.990 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:08.990 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:08.990 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:08.990 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.990 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.990 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.990 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.990 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.990 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.990 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.990 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.990 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.991 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.991 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.991 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.991 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:08.991 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.991 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.991 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.991 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.991 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:08.991 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:08.991 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:08.991 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": "default-placement.data", 2024-09-12T17:39:08.991 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker_myobj", 2024-09-12T17:39:08.991 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:08.992 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.992 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:08.992 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:08.992 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:08.992 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.992 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.992 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.992 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.992 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.992 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.992 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.992 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.992 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.993 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.993 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.993 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.993 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:08.993 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.993 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.993 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.993 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.993 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:08.993 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:08.993 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.993 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:08.993 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.993 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.994 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.994 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.994 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:08.994 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.994 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:08.994 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.994 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.994 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:08.994 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:08.994 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:08.994 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.994 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:08.994 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.994 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.995 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.995 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.995 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:08.995 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.995 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:08.995 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.995 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.995 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.995 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:08.995 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.995 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.995 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.995 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.995 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:08.996 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:08.996 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:08.996 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:08.996 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker_myobj", 2024-09-12T17:39:08.996 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:08.996 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.996 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:08.996 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:08.996 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:08.996 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.996 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:08.996 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.996 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.997 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.997 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.997 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:08.997 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.997 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:08.997 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.997 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:08.997 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:08.997 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:08.997 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:08.997 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:08.997 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.997 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.998 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:08.998 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:08.998 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.998 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.998 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.998 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.998 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.998 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.998 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.998 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.998 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.998 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.998 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.999 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:08.999 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:08.999 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:08.999 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:08.999 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:08.999 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:08.999 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:08.999 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:08.999 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:08.999 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:08.999 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:08.999 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:08.999 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:08.999 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.000 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.000 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:09.000 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.000 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.000 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.000 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.000 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.000 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.000 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.000 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": "default-placement.data", 2024-09-12T17:39:09.000 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:39:09.000 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.001 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.001 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.001 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.001 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.001 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.001 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.001 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.001 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.001 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.001 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.001 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.001 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.002 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.002 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.002 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.002 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.002 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:09.002 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.002 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.002 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.002 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.003 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.003 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.003 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.003 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.003 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.003 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.003 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.003 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.003 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.003 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.003 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.004 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.004 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.004 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.004 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.004 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.004 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.004 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.004 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.004 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.004 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.005 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.005 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.005 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.005 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.005 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.005 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.005 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.005 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:09.005 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.005 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.006 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.006 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.006 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.006 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.006 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.006 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.006 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:39:09.006 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.006 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.006 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.006 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.007 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.007 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.007 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.007 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.007 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.007 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.007 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.007 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.007 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.007 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.008 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.008 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.008 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.008 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:09.008 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.008 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.008 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.008 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.008 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.008 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.009 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.009 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.009 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.009 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.009 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.009 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.009 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.009 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.009 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.009 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.010 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.010 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.010 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.010 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.010 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.010 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.010 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.010 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.010 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.010 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.010 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.011 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.011 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.011 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.011 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.011 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.011 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:09.011 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.011 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.011 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.012 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.012 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.012 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.012 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.012 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": "default-placement.data", 2024-09-12T17:39:09.012 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:39:09.012 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.012 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.012 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.012 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.012 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.013 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.013 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.013 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.013 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.013 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.013 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.013 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.013 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.013 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.013 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.013 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.013 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.013 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:09.013 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.014 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.014 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.014 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.014 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.014 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.014 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.014 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.014 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.014 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.014 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.014 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.014 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.015 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.015 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.015 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.015 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.015 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.015 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.015 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.015 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.015 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.016 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.016 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.016 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.016 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.016 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.016 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.016 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.016 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.016 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.016 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.017 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:09.017 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.017 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.017 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.017 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.017 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.017 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.017 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.017 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.017 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:39:09.018 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.018 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.018 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.018 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.018 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.018 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.018 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.018 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.018 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.018 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.018 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.018 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.019 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.019 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.019 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.019 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.019 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.019 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:09.019 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.019 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.019 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.019 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.019 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.019 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.020 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.020 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.020 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.020 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.020 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.020 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.020 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.020 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.020 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.020 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.020 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.020 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.020 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.020 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.021 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.021 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.021 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.021 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.021 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.021 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.021 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.021 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.021 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.021 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.022 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.022 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.022 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:09.022 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.022 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.022 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.022 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.022 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.022 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.022 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.022 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": "default-placement.data", 2024-09-12T17:39:09.022 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:39:09.023 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.023 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.023 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.023 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.023 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.023 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.023 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.023 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.023 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.023 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.023 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.023 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.023 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.023 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.024 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.024 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.024 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.024 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:09.024 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.024 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.024 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.024 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.024 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.024 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.024 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.024 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.024 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.025 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.025 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.025 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.025 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.025 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.025 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.025 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.025 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.025 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.025 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.025 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.025 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.025 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.026 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.026 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.026 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.026 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.026 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.026 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.026 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.026 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.026 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.026 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.026 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:09.026 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.026 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.026 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.027 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.027 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.027 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.027 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.027 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.027 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:39:09.027 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.027 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.027 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.027 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.027 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.027 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.027 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.027 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.028 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.028 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.028 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.028 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.028 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.028 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.028 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.028 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.028 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.028 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:09.028 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.028 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.028 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.028 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.029 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.029 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.029 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.029 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.029 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.029 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.029 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.029 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.029 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.030 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.030 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.030 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.030 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.030 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.030 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.030 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.030 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.030 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.030 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.030 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.030 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.030 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.031 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.031 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.031 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.031 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.031 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.031 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.031 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.031 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.031 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.031 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.031 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.031 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.032 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.032 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.032 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": "default-placement.data", 2024-09-12T17:39:09.032 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker___myobj", 2024-09-12T17:39:09.032 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "marker__myobj" 2024-09-12T17:39:09.032 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.032 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.032 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.032 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.032 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.032 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.032 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.033 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.033 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.033 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.033 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.033 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.033 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.033 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.033 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.033 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.033 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.033 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.033 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.034 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.034 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.034 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.034 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.034 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.034 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.034 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.034 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.034 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.034 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.035 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.035 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.035 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.035 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.035 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.035 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.035 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.035 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.035 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.035 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.035 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.035 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.036 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.036 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.036 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.036 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.036 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.036 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.036 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.036 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.036 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.036 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.036 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.037 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.037 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.037 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.037 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.037 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.037 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.037 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker___myobj", 2024-09-12T17:39:09.037 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "marker__myobj" 2024-09-12T17:39:09.037 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.037 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.037 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.038 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.038 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.038 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.038 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.038 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.038 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.038 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.038 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.038 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.038 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.039 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.039 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.039 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.039 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.039 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.039 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.039 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.039 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.039 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.039 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.040 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.040 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.040 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.040 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.040 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.040 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.040 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.040 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.040 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.040 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.041 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.041 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.041 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.041 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.041 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.041 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.041 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.041 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.041 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.041 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.042 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.042 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.042 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.042 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.042 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.042 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.042 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.042 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.042 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.042 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.042 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.043 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.043 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.043 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.043 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": "default-placement.data", 2024-09-12T17:39:09.043 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:39:09.043 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.043 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.043 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.043 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.043 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.044 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.044 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.044 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.044 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.044 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.044 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.044 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.044 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.044 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.044 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.044 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.045 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.045 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.045 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.045 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.045 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.045 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.045 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.045 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.045 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.045 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.045 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.046 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.046 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.046 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.046 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.046 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.046 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.046 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.046 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.046 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.047 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.047 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.047 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.047 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.047 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.047 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.047 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.047 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.047 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.047 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.048 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.048 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.048 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.048 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.048 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.048 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.048 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.048 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.048 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.048 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.049 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.049 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.049 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.049 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:39:09.049 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.049 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.049 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.049 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.049 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.049 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.049 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.050 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.050 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.050 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.050 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.050 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.050 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.050 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.050 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.050 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.050 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.050 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.051 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.051 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.051 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.051 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.051 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.051 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.051 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.051 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.051 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.051 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.051 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.051 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.051 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.052 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.052 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.052 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.052 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.052 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.052 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.052 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.052 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.052 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.052 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.052 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.052 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.052 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.052 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.053 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.053 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.053 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.053 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.053 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.053 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.053 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.053 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.053 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.053 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.053 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.053 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.053 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.054 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": "default-placement.data", 2024-09-12T17:39:09.054 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:39:09.054 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "marker__myobj" 2024-09-12T17:39:09.054 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.054 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.054 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.054 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.054 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.054 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.054 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.054 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.055 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.055 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.055 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.055 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.055 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.055 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.055 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.055 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.055 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.056 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.056 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.056 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.056 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.056 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.056 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.056 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.056 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.056 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.056 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.056 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.056 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.057 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.057 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.057 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.057 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.057 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.057 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.057 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.057 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.057 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.057 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.058 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.058 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.058 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.058 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.058 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.058 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.058 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.058 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.058 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.058 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.058 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.058 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.058 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.059 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.059 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.059 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.059 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.059 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.059 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.059 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:39:09.059 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "marker__myobj" 2024-09-12T17:39:09.059 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.059 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.059 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.059 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.059 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.059 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.060 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.060 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.060 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.060 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.060 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.060 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.060 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.060 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.060 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.060 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.060 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.060 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.060 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.061 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.061 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.061 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.061 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.061 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.061 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.061 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.061 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.061 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.061 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.061 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.061 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.061 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.061 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.062 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.062 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.062 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.062 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.062 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.062 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.062 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.062 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.062 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.062 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.062 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.062 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.062 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.062 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.063 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.063 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.063 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.063 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.063 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.063 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.063 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.063 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.063 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.063 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.063 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": "default-placement.data", 2024-09-12T17:39:09.063 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:39:09.063 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.063 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.064 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.064 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.064 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.064 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.064 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.064 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.064 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.064 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.064 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.064 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.064 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.065 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.065 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.065 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.065 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.065 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.065 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.065 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.065 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.065 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.065 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.065 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.065 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.066 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.066 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.066 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.066 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.066 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.066 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.066 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.066 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.066 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.066 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.066 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.066 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.067 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.067 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.067 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.067 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.067 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.067 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.067 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.067 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.067 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.067 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.067 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.067 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.068 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.068 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.068 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.068 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.068 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.068 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.068 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.068 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.068 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.068 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.068 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:39:09.069 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.069 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.069 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.069 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.069 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.069 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.069 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.069 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.069 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.069 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.069 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.070 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.070 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.070 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.070 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.070 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.070 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.070 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.070 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.070 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.070 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.070 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.070 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.071 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.071 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.071 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.071 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.071 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.071 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.071 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.071 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.071 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.071 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.071 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.071 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.072 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.072 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.072 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.072 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.072 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.072 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.072 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.072 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.072 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.072 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.073 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.073 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.073 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.073 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.073 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.073 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.073 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.073 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.073 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.073 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.074 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.074 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.074 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.074 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": "default-placement.data", 2024-09-12T17:39:09.074 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker___myobj_", 2024-09-12T17:39:09.074 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "marker__myobj_" 2024-09-12T17:39:09.074 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.074 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.074 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.074 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.074 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.075 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.075 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.075 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.075 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.075 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.075 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.075 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.075 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.075 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.075 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.076 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.076 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.076 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.076 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.076 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.076 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.076 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.076 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.076 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.076 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.076 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.076 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.077 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.077 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.077 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.077 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.077 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.077 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.077 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.077 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.077 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.078 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.078 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.078 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.078 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.078 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.078 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.078 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.078 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.078 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.078 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.078 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.079 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.079 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.079 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.079 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.079 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.079 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.079 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.079 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.079 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.079 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.079 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.079 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker___myobj_", 2024-09-12T17:39:09.080 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "marker__myobj_" 2024-09-12T17:39:09.080 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.080 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.080 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.080 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.080 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.080 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.080 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.080 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.080 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.081 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.081 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.081 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.081 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.081 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.081 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.081 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.081 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.081 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.081 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.082 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.082 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.082 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.082 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.082 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.082 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.082 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.082 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.082 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.082 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.082 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.083 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.083 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.083 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.083 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.083 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.083 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.083 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.083 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.083 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.083 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.083 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.083 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.083 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.084 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.084 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.084 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.084 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.084 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.084 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.084 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.084 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.084 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.084 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.084 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.084 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.084 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.085 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.085 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": "default-placement.data", 2024-09-12T17:39:09.085 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:39:09.085 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.085 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.085 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.085 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.085 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.085 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.085 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.085 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.085 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.085 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.085 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.085 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.086 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.086 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.086 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.086 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.086 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.086 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.086 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.086 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.086 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.086 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.087 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.087 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.087 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.087 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.087 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.087 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.087 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.087 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.087 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.087 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.088 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.088 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.088 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.088 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.088 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.088 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.088 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.088 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.088 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.088 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.088 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.088 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.088 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.089 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.089 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.089 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.089 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.089 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.089 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.089 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.089 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.089 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.089 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.089 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.089 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.089 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.089 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.090 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:39:09.090 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.090 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.090 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.090 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.090 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.090 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.090 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.090 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.090 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.090 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.090 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.090 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.090 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.091 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.091 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.091 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.091 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.091 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.091 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.091 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.091 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.091 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.091 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.091 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.091 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.091 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.091 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.092 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.092 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.092 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.092 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.092 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.092 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.092 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.092 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.092 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.092 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.092 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.092 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.092 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.092 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.093 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.093 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.093 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.093 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.093 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.093 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.093 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.093 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.093 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.093 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.093 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.093 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.093 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.093 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.094 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.094 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.094 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.094 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": "default-placement.data", 2024-09-12T17:39:09.094 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:39:09.094 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "marker__myobj_" 2024-09-12T17:39:09.094 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.094 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.094 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.094 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.094 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.094 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.095 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.095 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.095 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.095 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.095 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.095 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.095 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.095 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.095 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.095 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.095 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.095 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.096 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.096 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.096 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.096 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.096 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.096 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.096 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.096 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.096 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.096 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.096 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.096 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.096 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.097 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.097 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.097 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.097 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.097 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.097 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.097 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.097 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.097 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.097 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.097 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.097 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.098 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.098 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.098 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.098 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.098 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.098 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.098 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.098 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.098 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.098 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.098 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.098 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.099 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.099 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.099 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.099 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:39:09.099 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "marker__myobj_" 2024-09-12T17:39:09.099 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.099 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.099 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.099 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.099 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.099 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.099 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.099 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.100 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.100 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.100 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.100 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.100 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.100 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.100 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.100 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.100 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.100 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.101 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.101 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.101 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.101 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.101 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.101 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.101 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.101 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.101 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.101 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.101 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.102 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.102 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.102 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.102 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.102 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.102 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.102 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.102 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.102 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.102 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.102 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.103 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.103 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.103 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.103 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.103 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.103 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.103 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.103 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.103 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.103 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.103 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.103 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.104 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.104 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.104 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.104 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.104 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.104 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": "default-placement.data", 2024-09-12T17:39:09.104 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:39:09.104 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.104 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.104 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.104 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.105 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.105 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.105 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "test", 2024-09-12T17:39:09.105 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.105 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.105 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.105 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.105 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": "", 2024-09-12T17:39:09.105 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.105 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": "" 2024-09-12T17:39:09.105 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.105 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.106 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.106 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.106 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.106 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.106 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.106 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.106 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.106 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.106 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.106 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.106 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.107 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.107 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.107 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.107 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.107 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.107 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.107 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.107 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.107 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.107 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.107 INFO:tasks.workunit.client.0.smithi098.stdout: "obj": { 2024-09-12T17:39:09.108 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.108 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.108 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.108 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.108 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.108 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.108 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.108 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.108 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.108 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.108 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.109 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.109 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.109 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.109 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.109 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.109 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.109 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.109 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.109 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.109 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.109 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:39:09.110 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.110 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.110 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.110 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.110 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.110 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.110 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.110 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.110 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.110 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.110 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.111 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.111 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.111 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.111 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.111 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.111 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.111 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.111 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.111 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.111 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.111 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.112 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.112 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-09-12T17:39:09.112 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T17:39:09.112 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.112 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.112 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.112 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker_myobj", 2024-09-12T17:39:09.112 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.112 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.112 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.112 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.112 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.113 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.113 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.113 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.113 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.113 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.113 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.113 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.113 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.113 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.113 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.113 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.114 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.114 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:09.114 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.114 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.114 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.114 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.114 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.114 INFO:tasks.workunit.client.0.smithi098.stdout:raw=.data-pool:marker_myobj 2024-09-12T17:39:09.114 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.114 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj2": { 2024-09-12T17:39:09.114 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.114 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker_myobj", 2024-09-12T17:39:09.114 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.115 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.115 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.115 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.115 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj2": { 2024-09-12T17:39:09.115 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.115 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.115 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.115 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.115 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.115 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.115 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.116 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.116 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.116 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.116 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.116 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.116 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:09.116 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.116 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.116 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.116 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.116 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.116 INFO:tasks.workunit.client.0.smithi098.stdout:raw2=.data-pool:marker_myobj 2024-09-12T17:39:09.116 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.116 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.117 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.117 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:39:09.117 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.117 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.117 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.117 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.117 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.117 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.117 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.117 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.117 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.118 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.118 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.118 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.118 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.118 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.118 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.118 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.118 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.118 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:09.118 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.118 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.118 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.118 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.118 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.119 INFO:tasks.workunit.client.0.smithi098.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T17:39:09.119 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.119 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj2": { 2024-09-12T17:39:09.119 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.119 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns_myobj", 2024-09-12T17:39:09.119 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.119 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.119 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.119 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.119 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj2": { 2024-09-12T17:39:09.120 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.120 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.120 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.120 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.120 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.120 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.120 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.120 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.120 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.120 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.120 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.121 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.121 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:09.121 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.121 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.121 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.121 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.121 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.121 INFO:tasks.workunit.client.0.smithi098.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T17:39:09.121 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.121 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.122 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.122 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:39:09.122 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.122 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.122 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.122 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.122 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.122 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.122 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.122 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.123 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.123 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.123 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.123 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.123 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.123 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.123 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.123 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.123 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.123 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:09.123 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.123 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.124 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.124 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.124 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.124 INFO:tasks.workunit.client.0.smithi098.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T17:39:09.124 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.124 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj2": { 2024-09-12T17:39:09.124 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.124 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__:inst_myobj", 2024-09-12T17:39:09.124 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.124 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.124 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.124 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.124 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj2": { 2024-09-12T17:39:09.125 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.125 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.125 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.125 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.125 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.125 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.125 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.125 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.125 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.128 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.128 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.128 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.128 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:09.128 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.128 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.129 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.129 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.129 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.129 INFO:tasks.workunit.client.0.smithi098.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T17:39:09.129 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.129 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.129 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.129 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:39:09.129 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.129 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.129 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.129 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.129 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.130 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.130 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.130 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.130 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.130 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.130 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.130 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.130 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.130 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.130 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.130 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.130 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.131 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:09.131 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.131 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.131 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.131 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.131 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.131 INFO:tasks.workunit.client.0.smithi098.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T17:39:09.131 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.131 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj2": { 2024-09-12T17:39:09.131 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.131 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T17:39:09.131 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.131 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.132 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.132 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.132 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj2": { 2024-09-12T17:39:09.132 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.132 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.132 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.132 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.132 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.132 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.132 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.132 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.133 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.133 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.133 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.133 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.133 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "myobj", 2024-09-12T17:39:09.133 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.133 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.133 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.133 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.133 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.133 INFO:tasks.workunit.client.0.smithi098.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T17:39:09.134 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.134 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.134 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.134 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker___myobj", 2024-09-12T17:39:09.134 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "marker__myobj" 2024-09-12T17:39:09.134 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.134 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.134 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.134 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.134 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.134 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.134 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.135 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.135 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.135 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.135 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.135 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.135 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.135 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.135 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.135 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.135 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.135 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.136 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.136 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.136 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.136 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.136 INFO:tasks.workunit.client.0.smithi098.stdout:raw=.data-pool:marker___myobj 2024-09-12T17:39:09.136 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.136 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj2": { 2024-09-12T17:39:09.136 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.136 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker___myobj", 2024-09-12T17:39:09.136 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "marker__myobj" 2024-09-12T17:39:09.136 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.136 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.137 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.137 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj2": { 2024-09-12T17:39:09.137 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.137 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.137 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.137 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.137 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.137 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.137 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.137 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.137 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.138 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.138 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.138 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.138 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.138 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.138 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.138 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.138 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.138 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.138 INFO:tasks.workunit.client.0.smithi098.stdout:raw2=.data-pool:marker___myobj 2024-09-12T17:39:09.138 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.138 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.139 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.139 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:39:09.139 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.139 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.139 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.139 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.139 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.139 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.139 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.139 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.139 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.140 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.140 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.140 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.140 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.140 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.140 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.140 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.140 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.140 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.140 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.140 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.141 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.141 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.141 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.141 INFO:tasks.workunit.client.0.smithi098.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T17:39:09.141 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.141 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj2": { 2024-09-12T17:39:09.141 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.141 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns__myobj", 2024-09-12T17:39:09.141 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.141 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.141 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.141 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.142 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj2": { 2024-09-12T17:39:09.142 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.142 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.142 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.142 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.142 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.142 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.142 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.142 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.142 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.142 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.142 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.143 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.143 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.143 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.143 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.143 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.143 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.143 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.143 INFO:tasks.workunit.client.0.smithi098.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T17:39:09.143 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.143 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.143 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.143 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:39:09.144 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "marker__myobj" 2024-09-12T17:39:09.144 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.144 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.144 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.144 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.144 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.144 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.144 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.144 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.144 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.144 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.145 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.145 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.145 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.145 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.145 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.145 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.145 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.145 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.145 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.145 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.145 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.145 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.146 INFO:tasks.workunit.client.0.smithi098.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T17:39:09.146 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.146 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj2": { 2024-09-12T17:39:09.146 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.146 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__:inst__myobj", 2024-09-12T17:39:09.146 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "marker__myobj" 2024-09-12T17:39:09.146 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.146 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.146 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.146 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj2": { 2024-09-12T17:39:09.146 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.146 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.147 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.147 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.147 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.147 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.147 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.147 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.147 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.147 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.147 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.147 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.147 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.148 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.148 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.148 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.148 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.148 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.148 INFO:tasks.workunit.client.0.smithi098.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T17:39:09.148 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.148 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.148 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.148 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:39:09.148 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.148 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.148 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.149 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.149 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.149 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.149 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.149 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.149 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.149 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.149 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.149 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.149 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.149 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.149 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.149 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.149 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.150 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.150 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.150 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.150 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.150 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.150 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.150 INFO:tasks.workunit.client.0.smithi098.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T17:39:09.150 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.150 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj2": { 2024-09-12T17:39:09.150 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.150 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T17:39:09.151 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.151 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.151 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.151 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.151 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj2": { 2024-09-12T17:39:09.151 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.151 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.151 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.151 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.151 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.151 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.151 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.151 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.151 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.152 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.152 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.152 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.152 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj", 2024-09-12T17:39:09.152 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.152 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.152 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.152 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.152 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.152 INFO:tasks.workunit.client.0.smithi098.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T17:39:09.153 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.153 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.153 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.153 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker___myobj_", 2024-09-12T17:39:09.153 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "marker__myobj_" 2024-09-12T17:39:09.153 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.153 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.153 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.153 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.153 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.153 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.153 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.153 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.153 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.154 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.154 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.154 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.154 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.154 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.154 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.154 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.154 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.154 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.154 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.155 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.155 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.155 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.155 INFO:tasks.workunit.client.0.smithi098.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T17:39:09.155 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.155 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj2": { 2024-09-12T17:39:09.155 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.155 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker___myobj_", 2024-09-12T17:39:09.155 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "marker__myobj_" 2024-09-12T17:39:09.155 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.155 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.155 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.156 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj2": { 2024-09-12T17:39:09.156 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.156 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.156 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.156 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.156 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.156 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.156 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.156 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.156 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.157 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.157 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.157 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.157 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.157 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.157 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.157 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.157 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.157 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.157 INFO:tasks.workunit.client.0.smithi098.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T17:39:09.157 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.157 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.158 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.158 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:39:09.158 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.158 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.158 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.158 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.158 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.158 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.158 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.158 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.159 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.159 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.159 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.159 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.159 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.159 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.159 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.159 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.159 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.160 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.160 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.160 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.160 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.160 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.160 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.160 INFO:tasks.workunit.client.0.smithi098.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T17:39:09.160 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.160 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj2": { 2024-09-12T17:39:09.160 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.160 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns__myobj_", 2024-09-12T17:39:09.161 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.161 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.161 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.161 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.161 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj2": { 2024-09-12T17:39:09.161 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.161 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.161 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.161 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.161 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.161 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.161 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.161 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.162 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.162 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.162 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.162 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.162 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.162 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "", 2024-09-12T17:39:09.162 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.162 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.162 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.162 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.162 INFO:tasks.workunit.client.0.smithi098.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T17:39:09.163 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.163 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.163 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.163 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:39:09.163 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "marker__myobj_" 2024-09-12T17:39:09.163 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.163 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.163 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.163 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.163 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.163 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.163 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.164 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.164 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.164 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.164 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.164 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.164 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.164 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.164 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.164 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.164 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.164 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.165 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.165 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.165 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.165 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.165 INFO:tasks.workunit.client.0.smithi098.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T17:39:09.165 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.165 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj2": { 2024-09-12T17:39:09.165 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.165 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T17:39:09.165 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "marker__myobj_" 2024-09-12T17:39:09.165 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.166 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.166 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.166 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj2": { 2024-09-12T17:39:09.166 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.166 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.166 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.166 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.166 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.166 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.166 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.166 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.167 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.167 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.167 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.167 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.167 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.167 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.167 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "" 2024-09-12T17:39:09.167 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.167 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.167 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.167 INFO:tasks.workunit.client.0.smithi098.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T17:39:09.167 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.168 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj": { 2024-09-12T17:39:09.168 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.168 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:39:09.168 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.168 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.168 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.168 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.168 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj": { 2024-09-12T17:39:09.168 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.168 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.168 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.168 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.169 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.169 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.169 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.169 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.169 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.169 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.169 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.169 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.169 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.169 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.169 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.170 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.170 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.170 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.170 INFO:tasks.workunit.client.0.smithi098.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:39:09.170 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.170 INFO:tasks.workunit.client.0.smithi098.stdout: "raw_obj2": { 2024-09-12T17:39:09.170 INFO:tasks.workunit.client.0.smithi098.stdout: "pool": ".data-pool", 2024-09-12T17:39:09.170 INFO:tasks.workunit.client.0.smithi098.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T17:39:09.170 INFO:tasks.workunit.client.0.smithi098.stdout: "loc": "" 2024-09-12T17:39:09.170 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.170 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.170 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.171 INFO:tasks.workunit.client.0.smithi098.stdout: "new_obj2": { 2024-09-12T17:39:09.171 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket": { 2024-09-12T17:39:09.171 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "ebtest", 2024-09-12T17:39:09.171 INFO:tasks.workunit.client.0.smithi098.stdout: "marker": "marker", 2024-09-12T17:39:09.171 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_id": "bucket-id", 2024-09-12T17:39:09.171 INFO:tasks.workunit.client.0.smithi098.stdout: "tenant": "", 2024-09-12T17:39:09.171 INFO:tasks.workunit.client.0.smithi098.stdout: "explicit_placement": { 2024-09-12T17:39:09.171 INFO:tasks.workunit.client.0.smithi098.stdout: "data_pool": ".data-pool", 2024-09-12T17:39:09.171 INFO:tasks.workunit.client.0.smithi098.stdout: "data_extra_pool": "", 2024-09-12T17:39:09.171 INFO:tasks.workunit.client.0.smithi098.stdout: "index_pool": ".index-pool" 2024-09-12T17:39:09.171 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.171 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.172 INFO:tasks.workunit.client.0.smithi098.stdout: "key": { 2024-09-12T17:39:09.172 INFO:tasks.workunit.client.0.smithi098.stdout: "name": "_myobj_", 2024-09-12T17:39:09.172 INFO:tasks.workunit.client.0.smithi098.stdout: "instance": "inst", 2024-09-12T17:39:09.172 INFO:tasks.workunit.client.0.smithi098.stdout: "ns": "ns" 2024-09-12T17:39:09.172 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.172 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.172 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.172 INFO:tasks.workunit.client.0.smithi098.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T17:39:09.172 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-12T17:39:09.172 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-12T17:39:09.172 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:39:09.173 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:39:09.173 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-12T17:39:09.173 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 4 tests. 2024-09-12T17:39:09.173 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:39:09.173 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:39:09.188 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T17:39:09.190 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T17:39:09.190 DEBUG:teuthology.orchestra.run.smithi098:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T17:39:09.292 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:09.292 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:09.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.334+0000 7faf2e0ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.334+0000 7faf2e0ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.334+0000 7faf2e0ab9c0 20 realm 2024-09-12T17:39:09.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.334+0000 7faf2e0ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.334+0000 7faf2e0ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.334+0000 7faf2e0ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:39:09.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.334+0000 7faf2e0ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.334+0000 7faf2e0ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.334+0000 7faf2e0ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.339 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.338+0000 7faf2e0ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:09.339 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.338+0000 7faf2e0ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.340 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.338+0000 7faf2e0ab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:39:09.340 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.338+0000 7faf2e0ab9c0 20 searching for the correct realm 2024-09-12T17:39:09.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.346+0000 7faf2c3b2640 0 -- 172.21.15.98:0/2537119731 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7faf200922b0 msgr2=0x7faf20092820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:39:09.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.562+0000 7faf2bbb1640 0 -- 172.21.15.98:0/2537119731 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x555f4e5f7f70 msgr2=0x555f4e5fa360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:39:09.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.570+0000 7faf2e0ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:39:09.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.570+0000 7faf2e0ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:39:09.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.570+0000 7faf2e0ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:39:09.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.570+0000 7faf2e0ab9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:39:09.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.570+0000 7faf2e0ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:39:09.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.570+0000 7faf2e0ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:39:09.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.570+0000 7faf2e0ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.574+0000 7faf2e0ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.574+0000 7faf2e0ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.574+0000 7faf2e0ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:39:09.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.574+0000 7faf2e0ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.574+0000 7faf2e0ab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:39:09.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.574+0000 7faf2e0ab9c0 20 zone default found 2024-09-12T17:39:09.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.574+0000 7faf2e0ab9c0 4 Realm: () 2024-09-12T17:39:09.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.574+0000 7faf2e0ab9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:39:09.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.574+0000 7faf2e0ab9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:39:09.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.574+0000 7faf2e0ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:39:09.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.574+0000 7faf2e0ab9c0 20 zonegroup default 2024-09-12T17:39:09.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.574+0000 7faf2e0ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.578 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.574+0000 7faf2e0ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.578 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.574+0000 7faf2e0ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.578 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.574+0000 7faf2e0ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.578 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.574+0000 7faf2e0ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.578+0000 7faf2e0ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.578+0000 7faf2e0ab9c0 20 started sync module instance, tier type = 2024-09-12T17:39:09.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.578+0000 7faf2e0ab9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:39:09.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.602+0000 7faf2e0ab9c0 20 add_watcher() i=0 2024-09-12T17:39:09.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.602+0000 7faf2e0ab9c0 20 add_watcher() i=1 2024-09-12T17:39:09.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.602+0000 7faf2e0ab9c0 20 add_watcher() i=2 2024-09-12T17:39:09.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.602+0000 7faf2e0ab9c0 20 add_watcher() i=3 2024-09-12T17:39:09.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.602+0000 7faf2e0ab9c0 20 add_watcher() i=4 2024-09-12T17:39:09.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.602+0000 7faf2e0ab9c0 20 add_watcher() i=5 2024-09-12T17:39:09.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.602+0000 7faf2e0ab9c0 20 add_watcher() i=6 2024-09-12T17:39:09.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.602+0000 7faf2e0ab9c0 20 add_watcher() i=7 2024-09-12T17:39:09.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.602+0000 7faf2e0ab9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:39:09.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.606+0000 7fade1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:09.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.606+0000 7faf2e0ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:39:09.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.606+0000 7faf2e0ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:39:09.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.606+0000 7faf2e0ab9c0 5 note: GC not initialized 2024-09-12T17:39:09.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.606+0000 7fade0fe1640 20 reqs_thread_entry: start 2024-09-12T17:39:09.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.606+0000 7faf2e0ab9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:39:09.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.610+0000 7faf2e0ab9c0 20 Filter name: none 2024-09-12T17:39:09.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.610+0000 7fad5a7fc640 20 reqs_thread_entry: start 2024-09-12T17:39:09.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.610+0000 7faf2e0ab9c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T17:39:09.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.610+0000 7faf2e0ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.610+0000 7faf2e0ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.610+0000 7faf2e0ab9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T17:39:09.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.610+0000 7faf2e0ab9c0 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:39:09.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.610+0000 7faf2e0ab9c0 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T17:39:09.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.610+0000 7faf2e0ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.610+0000 7faf2e0ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.610+0000 7faf2e0ab9c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T17:39:09.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.610+0000 7faf2e0ab9c0 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:39:09.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.610+0000 7faf2e0ab9c0 10 cache get: name=default.rgw.meta+users.keys+gIvlBdkL2wa4XI+xAh9C3gnYknE= : miss 2024-09-12T17:39:09.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.610+0000 7faf2e0ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:39:09.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.610+0000 7faf2e0ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:39:09.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.610+0000 7faf2e0ab9c0 10 cache put: name=default.rgw.meta+users.keys+gIvlBdkL2wa4XI+xAh9C3gnYknE= info.flags=0x0 2024-09-12T17:39:09.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.610+0000 7faf2e0ab9c0 10 adding default.rgw.meta+users.keys+gIvlBdkL2wa4XI+xAh9C3gnYknE= to cache LRU end 2024-09-12T17:39:09.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.610+0000 7faf2e0ab9c0 10 cache get: name=default.rgw.meta+users.keys+gIvlBdkL2wa4XI+xAh9C3gnYknE= : hit (negative entry) 2024-09-12T17:39:09.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.610+0000 7faf2e0ab9c0 10 cache get: name=default.rgw.meta+users.keys+gIvlBdkL2wa4XI+xAh9C3gnYknE= : hit (negative entry) 2024-09-12T17:39:09.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.614+0000 7faf2e0ab9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:39:09.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.614+0000 7faf2e0ab9c0 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:39:09.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.614+0000 7faf2e0ab9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T17:39:09.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.614+0000 7fae0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725889 cookie 93867825171456 notifier 5279 bl.length()=697 2024-09-12T17:39:09.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.614+0000 7fae0affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T17:39:09.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.614+0000 7fae0affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T17:39:09.622 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.618+0000 7faf2e0ab9c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:39:09.622 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.618+0000 7faf2e0ab9c0 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:39:09.622 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.618+0000 7faf2e0ab9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T17:39:09.623 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.622+0000 7fae0a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725888 cookie 93867825169328 notifier 5279 bl.length()=194 2024-09-12T17:39:09.623 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.622+0000 7fae0a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T17:39:09.623 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.622+0000 7fae0a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T17:39:09.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.626+0000 7faf2e0ab9c0 10 cache put: name=default.rgw.meta+users.keys+gIvlBdkL2wa4XI+xAh9C3gnYknE= info.flags=0x7 2024-09-12T17:39:09.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.626+0000 7faf2e0ab9c0 10 moving default.rgw.meta+users.keys+gIvlBdkL2wa4XI+xAh9C3gnYknE= to cache LRU end 2024-09-12T17:39:09.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.626+0000 7faf2e0ab9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:gIvlBdkL2wa4XI+xAh9C3gnYknE=, ofs0, ns] 2024-09-12T17:39:09.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.626+0000 7fae0a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725893 cookie 93867825172784 notifier 5279 bl.length()=203 2024-09-12T17:39:09.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.626+0000 7fae0a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+gIvlBdkL2wa4XI+xAh9C3gnYknE= info.flags=0x7 2024-09-12T17:39:09.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.626+0000 7fae0a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+gIvlBdkL2wa4XI+xAh9C3gnYknE= to cache LRU end 2024-09-12T17:39:09.631 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:39:09.631 INFO:tasks.workunit.client.0.smithi098.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T17:39:09.632 INFO:tasks.workunit.client.0.smithi098.stdout: "display_name": "librgw test user", 2024-09-12T17:39:09.632 INFO:tasks.workunit.client.0.smithi098.stdout: "email": "librgw@example.com", 2024-09-12T17:39:09.632 INFO:tasks.workunit.client.0.smithi098.stdout: "suspended": 0, 2024-09-12T17:39:09.632 INFO:tasks.workunit.client.0.smithi098.stdout: "max_buckets": 1000, 2024-09-12T17:39:09.632 INFO:tasks.workunit.client.0.smithi098.stdout: "subusers": [], 2024-09-12T17:39:09.632 INFO:tasks.workunit.client.0.smithi098.stdout: "keys": [ 2024-09-12T17:39:09.632 INFO:tasks.workunit.client.0.smithi098.stdout: { 2024-09-12T17:39:09.632 INFO:tasks.workunit.client.0.smithi098.stdout: "user": "ceph-test-librgw-file", 2024-09-12T17:39:09.632 INFO:tasks.workunit.client.0.smithi098.stdout: "access_key": "gIvlBdkL2wa4XI+xAh9C3gnYknE=", 2024-09-12T17:39:09.632 INFO:tasks.workunit.client.0.smithi098.stdout: "secret_key": "SqtwYFVLzRTAeWtdFJL7dt0FaVYNq09F5gp/HRaKtTyPWAhBl9L6KQ==", 2024-09-12T17:39:09.632 INFO:tasks.workunit.client.0.smithi098.stdout: "active": true, 2024-09-12T17:39:09.633 INFO:tasks.workunit.client.0.smithi098.stdout: "create_date": "2024-09-12T17:39:09.614870Z" 2024-09-12T17:39:09.633 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:39:09.633 INFO:tasks.workunit.client.0.smithi098.stdout: ], 2024-09-12T17:39:09.633 INFO:tasks.workunit.client.0.smithi098.stdout: "swift_keys": [], 2024-09-12T17:39:09.633 INFO:tasks.workunit.client.0.smithi098.stdout: "caps": [], 2024-09-12T17:39:09.633 INFO:tasks.workunit.client.0.smithi098.stdout: "op_mask": "read, write, delete", 2024-09-12T17:39:09.633 INFO:tasks.workunit.client.0.smithi098.stdout: "default_placement": "", 2024-09-12T17:39:09.633 INFO:tasks.workunit.client.0.smithi098.stdout: "default_storage_class": "", 2024-09-12T17:39:09.633 INFO:tasks.workunit.client.0.smithi098.stdout: "placement_tags": [], 2024-09-12T17:39:09.633 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_quota": { 2024-09-12T17:39:09.634 INFO:tasks.workunit.client.0.smithi098.stdout: "enabled": false, 2024-09-12T17:39:09.634 INFO:tasks.workunit.client.0.smithi098.stdout: "check_on_raw": false, 2024-09-12T17:39:09.634 INFO:tasks.workunit.client.0.smithi098.stdout: "max_size": -1, 2024-09-12T17:39:09.634 INFO:tasks.workunit.client.0.smithi098.stdout: "max_size_kb": 0, 2024-09-12T17:39:09.634 INFO:tasks.workunit.client.0.smithi098.stdout: "max_objects": -1 2024-09-12T17:39:09.634 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.634 INFO:tasks.workunit.client.0.smithi098.stdout: "user_quota": { 2024-09-12T17:39:09.634 INFO:tasks.workunit.client.0.smithi098.stdout: "enabled": false, 2024-09-12T17:39:09.634 INFO:tasks.workunit.client.0.smithi098.stdout: "check_on_raw": false, 2024-09-12T17:39:09.634 INFO:tasks.workunit.client.0.smithi098.stdout: "max_size": -1, 2024-09-12T17:39:09.634 INFO:tasks.workunit.client.0.smithi098.stdout: "max_size_kb": 0, 2024-09-12T17:39:09.635 INFO:tasks.workunit.client.0.smithi098.stdout: "max_objects": -1 2024-09-12T17:39:09.635 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:39:09.635 INFO:tasks.workunit.client.0.smithi098.stdout: "temp_url_keys": [], 2024-09-12T17:39:09.635 INFO:tasks.workunit.client.0.smithi098.stdout: "type": "rgw", 2024-09-12T17:39:09.635 INFO:tasks.workunit.client.0.smithi098.stdout: "mfa_ids": [], 2024-09-12T17:39:09.635 INFO:tasks.workunit.client.0.smithi098.stdout: "account_id": "", 2024-09-12T17:39:09.635 INFO:tasks.workunit.client.0.smithi098.stdout: "path": "/", 2024-09-12T17:39:09.635 INFO:tasks.workunit.client.0.smithi098.stdout: "create_date": "2024-09-12T17:39:09.614837Z", 2024-09-12T17:39:09.635 INFO:tasks.workunit.client.0.smithi098.stdout: "tags": [], 2024-09-12T17:39:09.635 INFO:tasks.workunit.client.0.smithi098.stdout: "group_ids": [] 2024-09-12T17:39:09.636 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:39:09.636 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:39:09.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.630+0000 7fade1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:39:09.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.634+0000 7faf2e0ab9c0 20 remove_watcher() i=0 2024-09-12T17:39:09.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.634+0000 7faf2e0ab9c0 2 removed watcher, disabling cache 2024-09-12T17:39:09.641 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.638+0000 7faf2e0ab9c0 20 remove_watcher() i=1 2024-09-12T17:39:09.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.642+0000 7faf2e0ab9c0 20 remove_watcher() i=2 2024-09-12T17:39:09.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.642+0000 7faf2e0ab9c0 20 remove_watcher() i=3 2024-09-12T17:39:09.647 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.646+0000 7faf2e0ab9c0 20 remove_watcher() i=4 2024-09-12T17:39:09.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.646+0000 7faf2e0ab9c0 20 remove_watcher() i=5 2024-09-12T17:39:09.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.650+0000 7faf2e0ab9c0 20 remove_watcher() i=6 2024-09-12T17:39:09.652 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:09.650+0000 7faf2e0ab9c0 20 remove_watcher() i=7 2024-09-12T17:39:09.667 INFO:tasks.workunit.client.0.smithi098.stdout:phase 1.1 2024-09-12T17:39:09.688 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:39:09.688 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:39:09.688 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:39:09.688 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:39:09.701 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:09.701 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:10.226 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.INIT (538 ms) 2024-09-12T17:39:10.227 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:39:10.229 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MOUNT_NOROOT (3 ms) 2024-09-12T17:39:10.229 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:39:10.229 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:39:10.229 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:39:10.249 INFO:tasks.workunit.client.0.smithi098.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T17:39:10.257 INFO:tasks.workunit.client.0.smithi098.stdout:creating: nfsroot:foo/f1 2024-09-12T17:39:10.261 INFO:tasks.workunit.client.0.smithi098.stdout:creating: nfsroot:foo/f2 2024-09-12T17:39:10.268 INFO:tasks.workunit.client.0.smithi098.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T17:39:10.273 INFO:tasks.workunit.client.0.smithi098.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T17:39:10.279 INFO:tasks.workunit.client.0.smithi098.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T17:39:10.287 INFO:tasks.workunit.client.0.smithi098.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T17:39:10.292 INFO:tasks.workunit.client.0.smithi098.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T17:39:10.298 INFO:tasks.workunit.client.0.smithi098.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T17:39:10.305 INFO:tasks.workunit.client.0.smithi098.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T17:39:10.311 INFO:tasks.workunit.client.0.smithi098.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T17:39:10.317 INFO:tasks.workunit.client.0.smithi098.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T17:39:10.323 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SETUP_HIER1 (94 ms) 2024-09-12T17:39:10.323 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:39:10.567 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SETUP_DIRS1 (244 ms) 2024-09-12T17:39:10.568 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:39:10.568 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:39:10.568 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:39:10.611 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (44 ms) 2024-09-12T17:39:10.611 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:39:10.718 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (107 ms) 2024-09-12T17:39:10.718 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:39:10.719 INFO:tasks.workunit.client.0.smithi098.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T17:39:10.733 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (15 ms) 2024-09-12T17:39:10.733 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:39:10.734 INFO:tasks.workunit.client.0.smithi098.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T17:39:10.750 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (17 ms) 2024-09-12T17:39:10.750 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:39:10.750 INFO:tasks.workunit.client.0.smithi098.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:39:10.750 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:39:10.750 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:39:10.750 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:39:10.750 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:39:10.750 INFO:tasks.workunit.client.0.smithi098.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:39:10.750 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:39:10.750 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:39:10.750 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:39:10.751 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:39:10.751 INFO:tasks.workunit.client.0.smithi098.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:39:10.751 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:39:10.751 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:39:10.751 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:39:10.751 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:39:10.751 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:39:10.751 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:39:10.751 INFO:tasks.workunit.client.0.smithi098.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:39:10.751 INFO:tasks.workunit.client.0.smithi098.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:39:10.755 INFO:tasks.workunit.client.0.smithi098.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:39:10.755 INFO:tasks.workunit.client.0.smithi098.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:39:10.758 INFO:tasks.workunit.client.0.smithi098.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:39:10.759 INFO:tasks.workunit.client.0.smithi098.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:39:10.759 INFO:tasks.workunit.client.0.smithi098.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:39:10.762 INFO:tasks.workunit.client.0.smithi098.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:39:10.762 INFO:tasks.workunit.client.0.smithi098.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:39:10.766 INFO:tasks.workunit.client.0.smithi098.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:39:10.766 INFO:tasks.workunit.client.0.smithi098.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:39:10.766 INFO:tasks.workunit.client.0.smithi098.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:39:10.769 INFO:tasks.workunit.client.0.smithi098.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:39:10.769 INFO:tasks.workunit.client.0.smithi098.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:39:10.772 INFO:tasks.workunit.client.0.smithi098.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:39:10.772 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.READ_DIRS1 (22 ms) 2024-09-12T17:39:10.772 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:39:10.994 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.READF_SETUP1 (222 ms) 2024-09-12T17:39:10.994 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:39:10.994 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:39:10.994 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:39:10.994 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:39:10.994 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:39:10.994 INFO:tasks.workunit.client.0.smithi098.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:39:10.994 INFO:tasks.workunit.client.0.smithi098.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:39:10.994 INFO:tasks.workunit.client.0.smithi098.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:39:10.994 INFO:tasks.workunit.client.0.smithi098.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:39:10.995 INFO:tasks.workunit.client.0.smithi098.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:39:10.995 INFO:tasks.workunit.client.0.smithi098.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:39:10.995 INFO:tasks.workunit.client.0.smithi098.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:39:10.995 INFO:tasks.workunit.client.0.smithi098.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:39:10.995 INFO:tasks.workunit.client.0.smithi098.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:39:10.995 INFO:tasks.workunit.client.0.smithi098.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:39:10.995 INFO:tasks.workunit.client.0.smithi098.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:39:10.995 INFO:tasks.workunit.client.0.smithi098.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:39:10.995 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:39:10.995 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:39:11.011 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:39:11.011 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:39:11.018 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:39:11.021 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:39:11.027 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:39:11.028 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:39:11.029 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:39:11.030 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:39:11.031 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:39:11.033 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:39:11.034 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:39:11.038 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:39:11.039 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:39:11.039 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:39:11.039 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:39:11.039 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:39:11.039 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.HIER1 (44 ms) 2024-09-12T17:39:11.039 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:39:11.039 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:39:11.039 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:39:11.039 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:39:11.039 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:39:11.039 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:39:11.039 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:39:11.039 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:39:11.040 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:39:11.040 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CLEANUP (1 ms) 2024-09-12T17:39:11.040 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:39:11.040 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:39:11.040 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:39:11.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:11.034+0000 7fd881348a80 -1 shutting down 2024-09-12T17:39:11.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:11.038+0000 7fd75b09a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56776, si_uid : 1000, si_addr0x3e80000ddc8, si_status0 2024-09-12T17:39:40.474 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SHUTDOWN (29435 ms) 2024-09-12T17:39:40.474 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 24 tests from LibRGW (30786 ms total) 2024-09-12T17:39:40.474 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:39:40.474 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:39:40.474 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 24 tests from 1 test suite ran. (30786 ms total) 2024-09-12T17:39:40.474 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 24 tests. 2024-09-12T17:39:40.488 INFO:tasks.workunit.client.0.smithi098.stdout:phase 1.2 2024-09-12T17:39:40.511 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:39:40.511 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:39:40.511 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:39:40.511 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:39:40.521 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:39:40.521 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:39:41.039 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.INIT (528 ms) 2024-09-12T17:39:41.040 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:39:41.041 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T17:39:41.042 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:39:41.042 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:39:41.042 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:39:41.042 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T17:39:41.042 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:39:41.042 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T17:39:41.042 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:39:41.042 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:39:41.042 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:39:41.042 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:39:41.042 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:39:41.043 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:39:41.043 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:39:41.043 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:39:41.043 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:39:41.043 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:39:41.043 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:39:41.043 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:39:41.043 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:39:41.043 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T17:39:41.043 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:39:41.043 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:39:41.043 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:39:41.044 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:39:41.044 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:39:41.044 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:39:41.044 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:39:41.044 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:39:41.044 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:39:41.044 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T17:39:41.044 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:39:41.044 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:39:41.044 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:39:41.044 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:39:41.044 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:39:41.044 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:39:41.045 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:39:41.045 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:39:41.045 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:39:41.045 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:39:41.045 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:39:41.045 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:39:41.045 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:39:41.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:41.038+0000 7f1e7789ca80 -1 shutting down 2024-09-12T17:39:41.046 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:39:41.042+0000 7f1d515ee640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57421, si_uid : 1000, si_addr0x3e80000e04d, si_status0 2024-09-12T17:40:11.372 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SHUTDOWN (30331 ms) 2024-09-12T17:40:11.373 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 24 tests from LibRGW (30861 ms total) 2024-09-12T17:40:11.373 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:40:11.373 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:40:11.373 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 24 tests from 1 test suite ran. (30861 ms total) 2024-09-12T17:40:11.373 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 24 tests. 2024-09-12T17:40:11.387 INFO:tasks.workunit.client.0.smithi098.stdout:phase 1.3 2024-09-12T17:40:11.410 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T17:40:11.410 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:40:11.410 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 24 tests from LibRGW 2024-09-12T17:40:11.411 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:40:11.423 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:11.423 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:12.013 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.INIT (603 ms) 2024-09-12T17:40:12.014 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T17:40:12.015 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T17:40:12.015 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:40:12.015 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T17:40:12.015 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T17:40:12.027 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SETUP_HIER1 (11 ms) 2024-09-12T17:40:12.027 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T17:40:12.155 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SETUP_DIRS1 (128 ms) 2024-09-12T17:40:12.155 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T17:40:12.155 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T17:40:12.155 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T17:40:12.156 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T17:40:12.156 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T17:40:12.156 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T17:40:12.156 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T17:40:12.156 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T17:40:12.156 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T17:40:12.156 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T17:40:12.156 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T17:40:12.156 INFO:tasks.workunit.client.0.smithi098.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T17:40:12.156 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:40:12.156 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:40:12.156 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:40:12.157 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:40:12.157 INFO:tasks.workunit.client.0.smithi098.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T17:40:12.157 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:40:12.157 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:40:12.157 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:40:12.158 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:40:12.158 INFO:tasks.workunit.client.0.smithi098.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T17:40:12.158 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T17:40:12.158 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T17:40:12.158 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T17:40:12.158 INFO:tasks.workunit.client.0.smithi098.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T17:40:12.158 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T17:40:12.158 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T17:40:12.158 INFO:tasks.workunit.client.0.smithi098.stdout:read back objects in /bdirs1/dir_0 2024-09-12T17:40:12.158 INFO:tasks.workunit.client.0.smithi098.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T17:40:12.160 INFO:tasks.workunit.client.0.smithi098.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:40:12.160 INFO:tasks.workunit.client.0.smithi098.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T17:40:12.164 INFO:tasks.workunit.client.0.smithi098.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:40:12.164 INFO:tasks.workunit.client.0.smithi098.stdout:read back objects in /bdirs1/dir_1 2024-09-12T17:40:12.164 INFO:tasks.workunit.client.0.smithi098.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T17:40:12.166 INFO:tasks.workunit.client.0.smithi098.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:40:12.166 INFO:tasks.workunit.client.0.smithi098.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T17:40:12.169 INFO:tasks.workunit.client.0.smithi098.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:40:12.169 INFO:tasks.workunit.client.0.smithi098.stdout:read back objects in /bdirs1/dir_2 2024-09-12T17:40:12.169 INFO:tasks.workunit.client.0.smithi098.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T17:40:12.171 INFO:tasks.workunit.client.0.smithi098.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T17:40:12.171 INFO:tasks.workunit.client.0.smithi098.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T17:40:12.174 INFO:tasks.workunit.client.0.smithi098.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T17:40:12.174 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.READ_DIRS1 (19 ms) 2024-09-12T17:40:12.174 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T17:40:12.174 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T17:40:12.174 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T17:40:12.174 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T17:40:12.174 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T17:40:12.174 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T17:40:12.174 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T17:40:12.174 INFO:tasks.workunit.client.0.smithi098.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:40:12.174 INFO:tasks.workunit.client.0.smithi098.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:40:12.174 INFO:tasks.workunit.client.0.smithi098.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:40:12.175 INFO:tasks.workunit.client.0.smithi098.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:40:12.175 INFO:tasks.workunit.client.0.smithi098.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:40:12.175 INFO:tasks.workunit.client.0.smithi098.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:40:12.175 INFO:tasks.workunit.client.0.smithi098.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:40:12.175 INFO:tasks.workunit.client.0.smithi098.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:40:12.175 INFO:tasks.workunit.client.0.smithi098.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T17:40:12.175 INFO:tasks.workunit.client.0.smithi098.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T17:40:12.175 INFO:tasks.workunit.client.0.smithi098.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T17:40:12.175 INFO:tasks.workunit.client.0.smithi098.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T17:40:12.175 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T17:40:12.176 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T17:40:12.191 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T17:40:12.191 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T17:40:12.198 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T17:40:12.201 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T17:40:12.210 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:40:12.210 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T17:40:12.210 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T17:40:12.210 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T17:40:12.211 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:40:12.211 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T17:40:12.212 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T17:40:12.216 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T17:40:12.216 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T17:40:12.216 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T17:40:12.216 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot/foo (foo): DIR 2024-09-12T17:40:12.216 INFO:tasks.workunit.client.0.smithi098.stdout:/nfsroot (nfsroot): DIR 2024-09-12T17:40:12.216 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.HIER1 (42 ms) 2024-09-12T17:40:12.216 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:40:12.216 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T17:40:12.217 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:40:12.217 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:40:12.217 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:40:12.217 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:40:12.217 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:40:12.217 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:40:12.218 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:40:12.218 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:40:12.218 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:40:12.218 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:40:12.218 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:40:12.218 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:40:12.213+0000 7fd815dbfa80 -1 shutting down 2024-09-12T17:40:12.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:40:12.217+0000 7fd6efb11640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58067, si_uid : 1000, si_addr0x3e80000e2d3, si_status0 2024-09-12T17:40:42.267 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SHUTDOWN (30051 ms) 2024-09-12T17:40:42.267 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 24 tests from LibRGW (30856 ms total) 2024-09-12T17:40:42.267 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:40:42.267 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:40:42.268 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 24 tests from 1 test suite ran. (30856 ms total) 2024-09-12T17:40:42.268 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 24 tests. 2024-09-12T17:40:42.279 INFO:tasks.workunit.client.0.smithi098.stdout:phase 2.1 2024-09-12T17:40:42.302 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:40:42.302 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:40:42.303 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:40:42.303 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:40:42.313 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:40:42.314 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:40:42.851 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.INIT (549 ms) 2024-09-12T17:40:42.851 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:40:42.852 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:40:42.853 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:40:42.872 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CREATE_BUCKET (19 ms) 2024-09-12T17:40:42.872 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:40:42.872 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:40:42.872 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:40:42.891 INFO:tasks.workunit.client.0.smithi098.stdout:created: sorrydave0 2024-09-12T17:40:42.912 INFO:tasks.workunit.client.0.smithi098.stdout:created: sorrydave1 2024-09-12T17:40:42.933 INFO:tasks.workunit.client.0.smithi098.stdout:created: sorrydave2 2024-09-12T17:40:42.953 INFO:tasks.workunit.client.0.smithi098.stdout:created: sorrydave3 2024-09-12T17:40:42.976 INFO:tasks.workunit.client.0.smithi098.stdout:created: sorrydave4 2024-09-12T17:40:42.995 INFO:tasks.workunit.client.0.smithi098.stdout:created: sorrydave5 2024-09-12T17:40:43.017 INFO:tasks.workunit.client.0.smithi098.stdout:created: sorrydave6 2024-09-12T17:40:43.038 INFO:tasks.workunit.client.0.smithi098.stdout:created: sorrydave7 2024-09-12T17:40:43.058 INFO:tasks.workunit.client.0.smithi098.stdout:created: sorrydave8 2024-09-12T17:40:43.080 INFO:tasks.workunit.client.0.smithi098.stdout:created: sorrydave9 2024-09-12T17:40:43.081 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (209 ms) 2024-09-12T17:40:43.081 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:40:43.899 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (819 ms) 2024-09-12T17:40:43.900 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:40:43.900 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:40:43.900 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:40:43.900 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:40:43.900 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:40:43.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:40:43.897+0000 7fa1b8f72a80 -1 shutting down 2024-09-12T17:40:43.902 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:40:43.901+0000 7fa092cc4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58713, si_uid : 1000, si_addr0x3e80000e559, si_status0 2024-09-12T17:41:13.231 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SHUTDOWN (29331 ms) 2024-09-12T17:41:13.231 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 9 tests from LibRGW (30928 ms total) 2024-09-12T17:41:13.231 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:41:13.231 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:41:13.231 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 9 tests from 1 test suite ran. (30928 ms total) 2024-09-12T17:41:13.232 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 9 tests. 2024-09-12T17:41:13.245 INFO:tasks.workunit.client.0.smithi098.stdout:phase 2.2 2024-09-12T17:41:13.268 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T17:41:13.268 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:41:13.268 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 9 tests from LibRGW 2024-09-12T17:41:13.269 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:41:13.279 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:13.279 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:13.862 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.INIT (594 ms) 2024-09-12T17:41:13.862 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:41:13.864 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T17:41:13.864 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:41:13.864 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:41:13.864 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:41:13.931 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.DELETE_BUCKET (68 ms) 2024-09-12T17:41:13.931 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T17:41:13.954 INFO:tasks.workunit.client.0.smithi098.stdout:created: sorrydave0 2024-09-12T17:41:13.981 INFO:tasks.workunit.client.0.smithi098.stdout:created: sorrydave1 2024-09-12T17:41:14.003 INFO:tasks.workunit.client.0.smithi098.stdout:created: sorrydave2 2024-09-12T17:41:14.029 INFO:tasks.workunit.client.0.smithi098.stdout:created: sorrydave3 2024-09-12T17:41:14.055 INFO:tasks.workunit.client.0.smithi098.stdout:created: sorrydave4 2024-09-12T17:41:14.081 INFO:tasks.workunit.client.0.smithi098.stdout:created: sorrydave5 2024-09-12T17:41:14.106 INFO:tasks.workunit.client.0.smithi098.stdout:created: sorrydave6 2024-09-12T17:41:14.130 INFO:tasks.workunit.client.0.smithi098.stdout:created: sorrydave7 2024-09-12T17:41:14.154 INFO:tasks.workunit.client.0.smithi098.stdout:created: sorrydave8 2024-09-12T17:41:14.180 INFO:tasks.workunit.client.0.smithi098.stdout:created: sorrydave9 2024-09-12T17:41:14.180 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (248 ms) 2024-09-12T17:41:14.180 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T17:41:14.992 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (813 ms) 2024-09-12T17:41:14.992 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:41:14.993 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:41:14.993 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:41:14.993 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:41:14.993 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:41:14.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:41:14.989+0000 7f1505e6da80 -1 shutting down 2024-09-12T17:41:14.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:41:14.993+0000 7f13dfbbf640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59358, si_uid : 1000, si_addr0x3e80000e7de, si_status0 2024-09-12T17:41:44.026 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SHUTDOWN (29033 ms) 2024-09-12T17:41:44.027 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 9 tests from LibRGW (30757 ms total) 2024-09-12T17:41:44.027 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:41:44.027 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:41:44.027 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 9 tests from 1 test suite ran. (30757 ms total) 2024-09-12T17:41:44.028 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 9 tests. 2024-09-12T17:41:44.038 INFO:tasks.workunit.client.0.smithi098.stdout:phase 3.1 2024-09-12T17:41:44.378 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:41:44.378 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:41:44.379 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:41:44.379 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:41:44.388 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:41:44.388 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:41:44.912 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.INIT (534 ms) 2024-09-12T17:41:44.913 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:41:44.914 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:41:44.914 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:41:44.933 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CREATE_BUCKET (19 ms) 2024-09-12T17:41:44.933 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:41:44.939 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T17:41:44.940 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:41:44.942 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-12T17:41:44.943 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:41:45.011 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.LARGE1 (69 ms) 2024-09-12T17:41:45.011 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:41:45.096 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.LARGE2 (84 ms) 2024-09-12T17:41:45.096 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:41:45.096 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:41:45.096 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:41:45.096 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:41:45.096 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:41:45.096 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:41:45.097 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:41:45.097 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:41:45.097 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:41:45.097 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:41:45.097 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:41:45.098 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:41:45.093+0000 7fb8e10d2a80 -1 shutting down 2024-09-12T17:41:45.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:41:45.097+0000 7fb7bae24640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60003, si_uid : 1000, si_addr0x3e80000ea63, si_status0 2024-09-12T17:42:14.995 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SHUTDOWN (29899 ms) 2024-09-12T17:42:14.995 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 13 tests from LibRGW (30616 ms total) 2024-09-12T17:42:14.995 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:42:14.995 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:42:14.995 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 13 tests from 1 test suite ran. (30616 ms total) 2024-09-12T17:42:14.995 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 13 tests. 2024-09-12T17:42:15.012 INFO:tasks.workunit.client.0.smithi098.stdout:phase 3.2 2024-09-12T17:42:15.353 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T17:42:15.353 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:42:15.353 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 13 tests from LibRGW 2024-09-12T17:42:15.353 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:42:15.362 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:15.362 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:15.913 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.INIT (560 ms) 2024-09-12T17:42:15.914 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:42:15.915 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:42:15.915 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:42:15.915 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:42:15.915 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:42:15.925 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (10 ms) 2024-09-12T17:42:15.925 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:42:15.930 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (5 ms) 2024-09-12T17:42:15.930 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T17:42:16.453 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.LARGE1 (523 ms) 2024-09-12T17:42:16.453 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T17:42:16.453 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T17:42:16.454 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:42:16.454 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:42:16.454 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:42:16.463 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.DELETE_OBJECT (10 ms) 2024-09-12T17:42:16.463 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:42:16.534 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.DELETE_BUCKET (71 ms) 2024-09-12T17:42:16.534 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:42:16.535 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:42:16.535 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:42:16.535 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:42:16.535 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:42:16.535 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:42:16.532+0000 7f15e202ba80 -1 shutting down 2024-09-12T17:42:16.537 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:42:16.532+0000 7f14bbd7d640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60648, si_uid : 1000, si_addr0x3e80000ece8, si_status0 2024-09-12T17:42:46.109 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SHUTDOWN (29575 ms) 2024-09-12T17:42:46.110 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 13 tests from LibRGW (30756 ms total) 2024-09-12T17:42:46.110 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:42:46.110 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:42:46.110 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 13 tests from 1 test suite ran. (30756 ms total) 2024-09-12T17:42:46.110 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 13 tests. 2024-09-12T17:42:46.127 INFO:tasks.workunit.client.0.smithi098.stdout:phase 4.1 2024-09-12T17:42:46.151 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:42:46.151 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:42:46.151 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:42:46.151 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:42:46.151 INFO:tasks.workunit.client.0.smithi098.stdout:read i1: 64001 2024-09-12T17:42:46.151 INFO:tasks.workunit.client.0.smithi098.stdout:read s1: blunderbuss 2024-09-12T17:42:46.151 INFO:tasks.workunit.client.0.smithi098.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:42:46.151 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:42:46.164 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:42:46.164 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:42:46.727 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.INIT (577 ms) 2024-09-12T17:42:46.727 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:42:46.729 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:42:46.729 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:42:46.763 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (34 ms) 2024-09-12T17:42:46.763 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:42:48.209 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_0 2024-09-12T17:42:48.209 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_1 2024-09-12T17:42:48.209 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_2 2024-09-12T17:42:48.209 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_3 2024-09-12T17:42:48.210 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_4 2024-09-12T17:42:48.210 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_5 2024-09-12T17:42:48.210 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_6 2024-09-12T17:42:48.210 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_7 2024-09-12T17:42:48.210 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_8 2024-09-12T17:42:48.210 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_9 2024-09-12T17:42:48.210 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_10 2024-09-12T17:42:48.210 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_11 2024-09-12T17:42:48.210 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_12 2024-09-12T17:42:48.210 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_13 2024-09-12T17:42:48.210 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_14 2024-09-12T17:42:48.210 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_15 2024-09-12T17:42:48.210 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_16 2024-09-12T17:42:48.211 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_17 2024-09-12T17:42:48.211 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_18 2024-09-12T17:42:48.211 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_19 2024-09-12T17:42:48.211 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_20 2024-09-12T17:42:48.211 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_21 2024-09-12T17:42:48.211 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_22 2024-09-12T17:42:48.211 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_23 2024-09-12T17:42:48.211 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_24 2024-09-12T17:42:48.211 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_25 2024-09-12T17:42:48.211 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_26 2024-09-12T17:42:48.211 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_27 2024-09-12T17:42:48.211 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_28 2024-09-12T17:42:48.211 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_29 2024-09-12T17:42:48.212 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_30 2024-09-12T17:42:48.212 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_31 2024-09-12T17:42:48.212 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_32 2024-09-12T17:42:48.212 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_33 2024-09-12T17:42:48.212 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_34 2024-09-12T17:42:48.212 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_35 2024-09-12T17:42:48.212 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_36 2024-09-12T17:42:48.212 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_37 2024-09-12T17:42:48.212 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_38 2024-09-12T17:42:48.212 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_39 2024-09-12T17:42:48.212 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_40 2024-09-12T17:42:48.212 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_41 2024-09-12T17:42:48.212 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_42 2024-09-12T17:42:48.213 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_43 2024-09-12T17:42:48.213 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_44 2024-09-12T17:42:48.213 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_45 2024-09-12T17:42:48.213 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_46 2024-09-12T17:42:48.213 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_47 2024-09-12T17:42:48.213 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_48 2024-09-12T17:42:48.213 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_49 2024-09-12T17:42:48.213 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_50 2024-09-12T17:42:48.213 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_51 2024-09-12T17:42:48.213 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_52 2024-09-12T17:42:48.213 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_53 2024-09-12T17:42:48.213 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_54 2024-09-12T17:42:48.213 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_55 2024-09-12T17:42:48.213 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_56 2024-09-12T17:42:48.214 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_57 2024-09-12T17:42:48.214 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_58 2024-09-12T17:42:48.214 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_59 2024-09-12T17:42:48.214 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_60 2024-09-12T17:42:48.214 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_61 2024-09-12T17:42:48.214 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_62 2024-09-12T17:42:48.214 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_63 2024-09-12T17:42:48.214 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_64 2024-09-12T17:42:48.214 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_65 2024-09-12T17:42:48.214 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_66 2024-09-12T17:42:48.214 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_67 2024-09-12T17:42:48.214 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_68 2024-09-12T17:42:48.214 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_69 2024-09-12T17:42:48.215 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_70 2024-09-12T17:42:48.215 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_71 2024-09-12T17:42:48.215 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_72 2024-09-12T17:42:48.215 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_73 2024-09-12T17:42:48.215 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_74 2024-09-12T17:42:48.215 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_75 2024-09-12T17:42:48.215 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_76 2024-09-12T17:42:48.215 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_77 2024-09-12T17:42:48.215 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_78 2024-09-12T17:42:48.215 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_79 2024-09-12T17:42:48.215 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_80 2024-09-12T17:42:48.215 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_81 2024-09-12T17:42:48.215 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_82 2024-09-12T17:42:48.216 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_83 2024-09-12T17:42:48.216 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_84 2024-09-12T17:42:48.216 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_85 2024-09-12T17:42:48.216 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_86 2024-09-12T17:42:48.216 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_87 2024-09-12T17:42:48.216 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_88 2024-09-12T17:42:48.216 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_89 2024-09-12T17:42:48.216 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_90 2024-09-12T17:42:48.216 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_91 2024-09-12T17:42:48.216 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_92 2024-09-12T17:42:48.216 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_93 2024-09-12T17:42:48.216 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_94 2024-09-12T17:42:48.216 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_95 2024-09-12T17:42:48.217 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_96 2024-09-12T17:42:48.217 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_97 2024-09-12T17:42:48.217 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_98 2024-09-12T17:42:48.217 INFO:tasks.workunit.client.0.smithi098.stdout:created: dmarker:f_99 2024-09-12T17:42:48.217 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1446 ms) 2024-09-12T17:42:48.217 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:42:48.217 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T17:42:48.218 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T17:42:48.218 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:42:48.218 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:42:48.218 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:42:48.218 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:42:48.218 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:42:48.218 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:42:48.218 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:42:48.218 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:42:48.218 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:42:48.218 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:42:48.218 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:42:48.218 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:42:48.219 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:42:48.219 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:42:48.219 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:42:48.219 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:42:48.219 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:42:48.219 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:42:48.219 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:42:48.219 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:42:48.219 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:42:48.219 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:42:48.219 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:42:48.219 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:42:48.219 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:42:48.220 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:42:48.220 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:42:48.220 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:42:48.220 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:42:48.220 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:42:48.220 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:42:48.220 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:42:48.220 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:42:48.220 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:42:48.220 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:42:48.220 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:42:48.221 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:42:48.221 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:42:48.221 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:42:48.221 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:42:48.221 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:42:48.221 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:42:48.221 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:42:48.221 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:42:48.221 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:42:48.221 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:42:48.221 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:42:48.221 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:42:48.221 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:42:48.222 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:42:48.222 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:42:48.222 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:42:48.222 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:42:48.222 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:42:48.222 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:42:48.222 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:42:48.222 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:42:48.222 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:42:48.222 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:42:48.222 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:42:48.222 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:42:48.222 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:42:48.223 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:42:48.223 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:42:48.223 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:42:48.223 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:42:48.223 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:42:48.223 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:42:48.223 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:42:48.223 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:42:48.223 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:42:48.223 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:42:48.223 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:42:48.223 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:42:48.223 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:42:48.224 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:42:48.224 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:42:48.224 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:42:48.224 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:42:48.224 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:42:48.224 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:42:48.224 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:42:48.224 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:42:48.224 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:42:48.224 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:42:48.224 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:42:48.224 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:42:48.224 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:42:48.225 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:42:48.225 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:42:48.225 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:42:48.225 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:42:48.225 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:42:48.225 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:42:48.225 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:42:48.225 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:42:48.225 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:42:48.225 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:42:48.225 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:42:48.225 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:42:48.225 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER1_READDIR (6 ms) 2024-09-12T17:42:48.225 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:42:48.227 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:42:48.227 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:42:48.227 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:42:48.227 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:42:48.227 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:42:48.227 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:42:48.227 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:42:48.227 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:42:48.227 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:42:48.227 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:42:48.227 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:42:48.227 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:42:48.228 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:42:48.228 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:42:48.228 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:42:48.228 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:42:48.228 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:42:48.228 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:42:48.228 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:42:48.228 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:42:48.228 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:42:48.228 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:42:48.228 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:42:48.228 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:42:48.228 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:42:48.229 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:42:48.229 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:42:48.229 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:42:48.229 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:42:48.229 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:42:48.229 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:42:48.229 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:42:48.229 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:42:48.229 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:42:48.229 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:42:48.229 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:42:48.229 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:42:48.229 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:42:48.230 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:42:48.230 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:42:48.230 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:42:48.230 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:42:48.230 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:42:48.230 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:42:48.230 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:42:48.230 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:42:48.230 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:42:48.230 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:42:48.230 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:42:48.230 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:42:48.230 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:42:48.231 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:42:48.231 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:42:48.231 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:42:48.231 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:42:48.231 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:42:48.231 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:42:48.231 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:42:48.231 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:42:48.231 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:42:48.231 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:42:48.231 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:42:48.231 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:42:48.231 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:42:48.232 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:42:48.232 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:42:48.232 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:42:48.232 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:42:48.232 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:42:48.232 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:42:48.232 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:42:48.232 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:42:48.232 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:42:48.232 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:42:48.232 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:42:48.232 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:42:48.232 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:42:48.232 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:42:48.233 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:42:48.233 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:42:48.233 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:42:48.233 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:42:48.233 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:42:48.233 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:42:48.233 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:42:48.233 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:42:48.233 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:42:48.233 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:42:48.233 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:42:48.233 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:42:48.234 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:42:48.234 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:42:48.234 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:42:48.234 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:42:48.234 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:42:48.234 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:42:48.234 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:42:48.234 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:42:48.234 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:42:48.234 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:42:48.234 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER2_READDIR (5 ms) 2024-09-12T17:42:48.234 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:42:48.235 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:42:48.235 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:42:48.235 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:42:48.235 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:42:48.235 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.UMOUNT (1 ms) 2024-09-12T17:42:48.235 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:42:48.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:42:48.220+0000 7f0eca197a80 -1 shutting down 2024-09-12T17:42:48.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:42:48.224+0000 7f0da3ee9640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61294, si_uid : 1000, si_addr0x3e80000ef6e, si_status0 2024-09-12T17:43:16.988 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SHUTDOWN (28766 ms) 2024-09-12T17:43:16.989 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 11 tests from LibRGW (30837 ms total) 2024-09-12T17:43:16.989 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:43:16.989 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:43:16.989 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 11 tests from 1 test suite ran. (30837 ms total) 2024-09-12T17:43:16.989 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 11 tests. 2024-09-12T17:43:16.998 INFO:tasks.workunit.client.0.smithi098.stdout:phase 4.2 2024-09-12T17:43:17.019 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T17:43:17.020 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:43:17.020 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 11 tests from LibRGW 2024-09-12T17:43:17.020 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T17:43:17.020 INFO:tasks.workunit.client.0.smithi098.stdout:read i1: 64001 2024-09-12T17:43:17.020 INFO:tasks.workunit.client.0.smithi098.stdout:read s1: blunderbuss 2024-09-12T17:43:17.021 INFO:tasks.workunit.client.0.smithi098.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T17:43:17.021 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:43:17.029 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:17.029 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:17.375 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.INIT (356 ms) 2024-09-12T17:43:17.376 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:43:17.377 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:43:17.377 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T17:43:17.397 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (20 ms) 2024-09-12T17:43:17.397 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T17:43:17.398 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T17:43:17.398 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T17:43:17.398 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T17:43:17.398 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T17:43:17.402 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T17:43:17.402 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T17:43:17.402 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T17:43:17.402 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T17:43:17.402 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T17:43:17.402 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T17:43:17.403 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T17:43:17.403 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T17:43:17.403 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T17:43:17.403 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T17:43:17.403 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T17:43:17.403 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T17:43:17.404 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T17:43:17.404 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T17:43:17.404 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T17:43:17.404 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T17:43:17.404 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T17:43:17.405 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T17:43:17.405 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T17:43:17.405 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T17:43:17.405 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T17:43:17.406 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T17:43:17.406 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T17:43:17.406 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T17:43:17.406 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T17:43:17.406 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T17:43:17.407 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T17:43:17.407 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T17:43:17.407 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T17:43:17.407 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T17:43:17.407 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T17:43:17.407 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T17:43:17.407 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T17:43:17.407 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T17:43:17.408 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T17:43:17.408 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T17:43:17.408 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T17:43:17.408 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T17:43:17.408 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T17:43:17.408 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T17:43:17.408 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T17:43:17.408 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T17:43:17.408 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T17:43:17.409 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T17:43:17.409 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T17:43:17.409 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T17:43:17.409 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T17:43:17.409 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T17:43:17.409 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T17:43:17.409 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T17:43:17.409 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T17:43:17.409 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T17:43:17.409 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T17:43:17.409 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T17:43:17.409 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T17:43:17.409 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T17:43:17.409 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T17:43:17.410 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T17:43:17.410 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T17:43:17.410 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T17:43:17.410 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T17:43:17.410 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T17:43:17.410 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T17:43:17.410 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T17:43:17.410 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T17:43:17.410 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T17:43:17.410 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T17:43:17.410 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T17:43:17.410 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T17:43:17.411 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T17:43:17.411 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T17:43:17.411 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T17:43:17.411 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T17:43:17.411 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T17:43:17.411 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T17:43:17.411 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T17:43:17.411 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T17:43:17.411 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T17:43:17.411 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T17:43:17.411 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T17:43:17.411 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T17:43:17.411 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T17:43:17.411 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T17:43:17.412 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T17:43:17.412 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T17:43:17.412 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T17:43:17.412 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T17:43:17.412 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T17:43:17.412 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T17:43:17.412 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T17:43:17.412 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T17:43:17.412 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T17:43:17.412 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T17:43:17.412 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T17:43:17.412 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T17:43:17.412 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T17:43:17.413 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T17:43:17.413 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T17:43:17.413 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T17:43:17.413 INFO:tasks.workunit.client.0.smithi098.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T17:43:17.413 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER2_READDIR (4 ms) 2024-09-12T17:43:17.413 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T17:43:17.413 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T17:43:17.413 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:43:17.413 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:43:17.413 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:43:17.413 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:43:17.413 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:43:17.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:43:17.399+0000 7f3290950a80 -1 shutting down 2024-09-12T17:43:17.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:43:17.403+0000 7f316a6a2640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61939, si_uid : 1000, si_addr0x3e80000f1f3, si_status0 2024-09-12T17:43:47.550 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SHUTDOWN (30148 ms) 2024-09-12T17:43:47.550 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 11 tests from LibRGW (30530 ms total) 2024-09-12T17:43:47.550 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:43:47.550 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:43:47.550 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 11 tests from 1 test suite ran. (30530 ms total) 2024-09-12T17:43:47.550 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 11 tests. 2024-09-12T17:43:47.563 INFO:tasks.workunit.client.0.smithi098.stdout:phase 5.1 2024-09-12T17:43:47.596 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:43:47.597 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:43:47.597 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:43:47.597 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:43:47.608 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:43:47.608 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:43:48.148 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.INIT (552 ms) 2024-09-12T17:43:48.149 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:43:48.150 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:43:48.150 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:43:48.167 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CREATE_BUCKET (17 ms) 2024-09-12T17:43:48.167 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:43:48.172 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T17:43:48.173 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:43:48.173 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:43:48.173 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:43:48.175 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-12T17:43:48.175 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:43:48.176 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:43:48.176 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:43:48.185 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.PUT_OBJECT (9 ms) 2024-09-12T17:43:48.185 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:43:48.189 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.GET_OBJECT (4 ms) 2024-09-12T17:43:48.189 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:43:48.189 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:43:48.190 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:43:48.190 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:43:48.190 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:43:48.190 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:43:48.190 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:43:48.190 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:43:48.190 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:43:48.190 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:43:48.190 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:43:48.190 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T17:43:48.190 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:43:48.190 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T17:43:48.190 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:43:48.190 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:43:48.191 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:43:48.191 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:43:48.191 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:43:48.191 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:43:48.187+0000 7f414fb2da80 -1 shutting down 2024-09-12T17:43:48.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:43:48.191+0000 7f402987f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62584, si_uid : 1000, si_addr0x3e80000f478, si_status0 2024-09-12T17:44:18.491 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SHUTDOWN (30301 ms) 2024-09-12T17:44:18.491 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 19 tests from LibRGW (30894 ms total) 2024-09-12T17:44:18.491 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:44:18.491 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:44:18.491 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 19 tests from 1 test suite ran. (30894 ms total) 2024-09-12T17:44:18.491 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 19 tests. 2024-09-12T17:44:18.501 INFO:tasks.workunit.client.0.smithi098.stdout:phase 5.2 2024-09-12T17:44:18.534 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T17:44:18.534 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:44:18.534 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 19 tests from LibRGW 2024-09-12T17:44:18.534 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:44:18.542 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:18.543 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:18.875 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.INIT (341 ms) 2024-09-12T17:44:18.875 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:44:18.877 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:44:18.877 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T17:44:18.877 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T17:44:18.877 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T17:44:18.886 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (9 ms) 2024-09-12T17:44:18.886 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T17:44:18.886 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T17:44:18.886 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T17:44:18.887 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T17:44:18.887 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T17:44:18.887 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T17:44:18.887 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T17:44:18.887 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T17:44:18.887 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T17:44:18.887 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T17:44:18.887 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T17:44:18.887 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T17:44:18.887 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T17:44:18.887 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T17:44:18.887 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T17:44:18.887 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T17:44:18.887 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.READV 2024-09-12T17:44:18.888 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T17:44:18.888 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T17:44:18.888 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T17:44:18.888 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T17:44:18.896 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.DELETE_OBJECT (10 ms) 2024-09-12T17:44:18.896 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T17:44:18.942 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.DELETE_BUCKET (46 ms) 2024-09-12T17:44:18.943 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:44:18.943 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:44:18.943 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:44:18.943 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:44:18.943 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:44:18.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:44:18.943+0000 7fab1627ea80 -1 shutting down 2024-09-12T17:44:18.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:44:18.943+0000 7fa9effd0640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63229, si_uid : 1000, si_addr0x3e80000f6fd, si_status0 2024-09-12T17:44:48.854 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SHUTDOWN (29911 ms) 2024-09-12T17:44:48.855 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 19 tests from LibRGW (30320 ms total) 2024-09-12T17:44:48.855 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:44:48.855 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:44:48.855 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 19 tests from 1 test suite ran. (30320 ms total) 2024-09-12T17:44:48.855 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 19 tests. 2024-09-12T17:44:48.867 INFO:tasks.workunit.client.0.smithi098.stdout:phase 6.1 2024-09-12T17:44:48.890 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T17:44:48.890 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment set-up. 2024-09-12T17:44:48.891 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 10 tests from LibRGW 2024-09-12T17:44:48.891 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.INIT 2024-09-12T17:44:48.900 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:44:48.900 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:44:49.674 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.INIT (784 ms) 2024-09-12T17:44:49.675 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T17:44:49.676 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T17:44:49.676 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T17:44:49.717 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CREATE_BUCKETS (41 ms) 2024-09-12T17:44:49.717 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T17:44:49.731 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (14 ms) 2024-09-12T17:44:49.731 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T17:44:49.767 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.TOPDIR_RENAME (36 ms) 2024-09-12T17:44:49.768 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T17:44:49.807 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SUBDIR_RENAME (40 ms) 2024-09-12T17:44:49.807 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T17:44:49.861 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (54 ms) 2024-09-12T17:44:49.861 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T17:44:49.861 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T17:44:49.862 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T17:44:49.862 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T17:44:49.862 INFO:tasks.workunit.client.0.smithi098.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T17:44:49.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:44:49.858+0000 7f34a5946a80 -1 shutting down 2024-09-12T17:44:49.864 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:44:49.862+0000 7f337f698640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63874, si_uid : 1000, si_addr0x3e80000f982, si_status0 2024-09-12T17:45:19.993 INFO:tasks.workunit.client.0.smithi098.stdout:[ OK ] LibRGW.SHUTDOWN (30131 ms) 2024-09-12T17:45:19.993 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] 10 tests from LibRGW (31102 ms total) 2024-09-12T17:45:19.993 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:45:19.993 INFO:tasks.workunit.client.0.smithi098.stdout:[----------] Global test environment tear-down 2024-09-12T17:45:19.994 INFO:tasks.workunit.client.0.smithi098.stdout:[==========] 10 tests from 1 test suite ran. (31102 ms total) 2024-09-12T17:45:19.994 INFO:tasks.workunit.client.0.smithi098.stdout:[ PASSED ] 10 tests. 2024-09-12T17:45:20.006 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:45:20.006 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:45:20.021 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T17:45:20.022 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T17:45:20.023 DEBUG:teuthology.orchestra.run.smithi098:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T17:45:20.075 INFO:tasks.workunit.client.0.smithi098.stderr:+ [ -z ] 2024-09-12T17:45:20.076 INFO:tasks.workunit.client.0.smithi098.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:45:20.076 INFO:tasks.workunit.client.0.smithi098.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:45:20.076 INFO:tasks.workunit.client.0.smithi098.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-09-12T17:45:20.117 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:45:20.118 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:45:20.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.162+0000 7f1111e349c0 20 rados->read ofs=0 len=0 2024-09-12T17:45:20.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.162+0000 7f1111e349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:20.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.162+0000 7f1111e349c0 20 realm 2024-09-12T17:45:20.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.162+0000 7f1111e349c0 20 rados->read ofs=0 len=0 2024-09-12T17:45:20.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.162+0000 7f1111e349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:20.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.162+0000 7f1111e349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:45:20.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.162+0000 7f1111e349c0 20 rados->read ofs=0 len=0 2024-09-12T17:45:20.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.162+0000 7f1111e349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:20.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.162+0000 7f1111e349c0 20 rados->read ofs=0 len=0 2024-09-12T17:45:20.168 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.166+0000 7f1111e349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:20.169 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.166+0000 7f1111e349c0 20 rados->read ofs=0 len=0 2024-09-12T17:45:20.169 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.166+0000 7f1111e349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:45:20.169 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.166+0000 7f1111e349c0 20 searching for the correct realm 2024-09-12T17:45:20.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.170+0000 7f110f93a640 0 -- 172.21.15.98:0/851665992 >> [v2:172.21.15.98:6816/1225764258,v1:172.21.15.98:6817/1225764258] conn(0x563969f7ea00 msgr2=0x7f110805b6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:20.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.382+0000 7f111013b640 0 -- 172.21.15.98:0/851665992 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f10f8003100 msgr2=0x7f110406e020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:45:20.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.398+0000 7f1111e349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:45:20.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.398+0000 7f1111e349c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:45:20.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.398+0000 7f1111e349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:45:20.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.398+0000 7f1111e349c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:45:20.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.398+0000 7f1111e349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:45:20.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.398+0000 7f1111e349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:45:20.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.398+0000 7f1111e349c0 20 rados->read ofs=0 len=0 2024-09-12T17:45:20.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.402+0000 7f1111e349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:20.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.402+0000 7f1111e349c0 20 rados->read ofs=0 len=0 2024-09-12T17:45:20.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.402+0000 7f1111e349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:45:20.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.402+0000 7f1111e349c0 20 rados->read ofs=0 len=0 2024-09-12T17:45:20.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.402+0000 7f1111e349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:45:20.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.402+0000 7f1111e349c0 20 zone default found 2024-09-12T17:45:20.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.402+0000 7f1111e349c0 4 Realm: () 2024-09-12T17:45:20.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.402+0000 7f1111e349c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:45:20.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.402+0000 7f1111e349c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:45:20.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.402+0000 7f1111e349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:45:20.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.402+0000 7f1111e349c0 20 zonegroup default 2024-09-12T17:45:20.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.402+0000 7f1111e349c0 20 rados->read ofs=0 len=0 2024-09-12T17:45:20.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.402+0000 7f1111e349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:20.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.402+0000 7f1111e349c0 20 rados->read ofs=0 len=0 2024-09-12T17:45:20.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.402+0000 7f1111e349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:20.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.402+0000 7f1111e349c0 20 rados->read ofs=0 len=0 2024-09-12T17:45:20.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.402+0000 7f1111e349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:20.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.402+0000 7f1111e349c0 20 started sync module instance, tier type = 2024-09-12T17:45:20.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.402+0000 7f1111e349c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:45:20.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.426+0000 7f1111e349c0 20 add_watcher() i=0 2024-09-12T17:45:20.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.426+0000 7f1111e349c0 20 add_watcher() i=1 2024-09-12T17:45:20.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.426+0000 7f1111e349c0 20 add_watcher() i=2 2024-09-12T17:45:20.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.426+0000 7f1111e349c0 20 add_watcher() i=3 2024-09-12T17:45:20.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.426+0000 7f1111e349c0 20 add_watcher() i=4 2024-09-12T17:45:20.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.426+0000 7f1111e349c0 20 add_watcher() i=5 2024-09-12T17:45:20.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.426+0000 7f1111e349c0 20 add_watcher() i=6 2024-09-12T17:45:20.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.430+0000 7f1111e349c0 20 add_watcher() i=7 2024-09-12T17:45:20.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.430+0000 7f1111e349c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:45:20.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.434+0000 7f0fc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:20.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.434+0000 7f1111e349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:45:20.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.434+0000 7f1111e349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:45:20.437 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.434+0000 7f1111e349c0 5 note: GC not initialized 2024-09-12T17:45:20.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.434+0000 7f0fc4fe1640 20 reqs_thread_entry: start 2024-09-12T17:45:20.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.434+0000 7f1111e349c0 20 init_complete bucket index max shards: 11 2024-09-12T17:45:20.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.434+0000 7f1111e349c0 20 Filter name: none 2024-09-12T17:45:20.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.434+0000 7f0f3e7fc640 20 reqs_thread_entry: start 2024-09-12T17:45:20.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.434+0000 7f1111e349c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T17:45:20.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.434+0000 7f1111e349c0 20 rados->read ofs=0 len=0 2024-09-12T17:45:20.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f1111e349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:20.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f1111e349c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T17:45:20.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f1111e349c0 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:45:20.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f1111e349c0 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T17:45:20.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f1111e349c0 20 rados->read ofs=0 len=0 2024-09-12T17:45:20.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f1111e349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:20.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f1111e349c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T17:45:20.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f1111e349c0 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:45:20.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f1111e349c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T17:45:20.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f1111e349c0 20 rados->read ofs=0 len=0 2024-09-12T17:45:20.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f1111e349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:45:20.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f1111e349c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T17:45:20.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f1111e349c0 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:45:20.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f1111e349c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:45:20.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f1111e349c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T17:45:20.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f1111e349c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:45:20.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f1111e349c0 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:45:20.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f1111e349c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T17:45:20.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f0feeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725890 cookie 94804593535792 notifier 5489 bl.length()=677 2024-09-12T17:45:20.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f0feeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T17:45:20.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.438+0000 7f0feeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T17:45:20.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.446+0000 7f1111e349c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:45:20.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.446+0000 7f1111e349c0 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:45:20.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.446+0000 7f1111e349c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T17:45:20.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.446+0000 7f0feeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725899 cookie 94804593520416 notifier 5489 bl.length()=187 2024-09-12T17:45:20.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.446+0000 7f0feeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T17:45:20.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.446+0000 7f0feeffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T17:45:20.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.450+0000 7f1111e349c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:45:20.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.450+0000 7f1111e349c0 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:45:20.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.450+0000 7f1111e349c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T17:45:20.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.450+0000 7f0feeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725900 cookie 94804593520416 notifier 5489 bl.length()=197 2024-09-12T17:45:20.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.450+0000 7f0feeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T17:45:20.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.450+0000 7f0feeffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T17:45:20.455 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:45:20.455 INFO:tasks.workunit.client.0.smithi098.stdout: "user_id": "ceph-test-maven", 2024-09-12T17:45:20.455 INFO:tasks.workunit.client.0.smithi098.stdout: "display_name": "maven test user", 2024-09-12T17:45:20.455 INFO:tasks.workunit.client.0.smithi098.stdout: "email": "sigv4@example.com", 2024-09-12T17:45:20.455 INFO:tasks.workunit.client.0.smithi098.stdout: "suspended": 0, 2024-09-12T17:45:20.455 INFO:tasks.workunit.client.0.smithi098.stdout: "max_buckets": 1000, 2024-09-12T17:45:20.455 INFO:tasks.workunit.client.0.smithi098.stdout: "subusers": [], 2024-09-12T17:45:20.455 INFO:tasks.workunit.client.0.smithi098.stdout: "keys": [ 2024-09-12T17:45:20.455 INFO:tasks.workunit.client.0.smithi098.stdout: { 2024-09-12T17:45:20.456 INFO:tasks.workunit.client.0.smithi098.stdout: "user": "ceph-test-maven", 2024-09-12T17:45:20.456 INFO:tasks.workunit.client.0.smithi098.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T17:45:20.456 INFO:tasks.workunit.client.0.smithi098.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T17:45:20.456 INFO:tasks.workunit.client.0.smithi098.stdout: "active": true, 2024-09-12T17:45:20.456 INFO:tasks.workunit.client.0.smithi098.stdout: "create_date": "2024-09-12T17:45:20.441604Z" 2024-09-12T17:45:20.456 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:45:20.456 INFO:tasks.workunit.client.0.smithi098.stdout: ], 2024-09-12T17:45:20.456 INFO:tasks.workunit.client.0.smithi098.stdout: "swift_keys": [], 2024-09-12T17:45:20.456 INFO:tasks.workunit.client.0.smithi098.stdout: "caps": [], 2024-09-12T17:45:20.456 INFO:tasks.workunit.client.0.smithi098.stdout: "op_mask": "read, write, delete", 2024-09-12T17:45:20.456 INFO:tasks.workunit.client.0.smithi098.stdout: "default_placement": "", 2024-09-12T17:45:20.456 INFO:tasks.workunit.client.0.smithi098.stdout: "default_storage_class": "", 2024-09-12T17:45:20.456 INFO:tasks.workunit.client.0.smithi098.stdout: "placement_tags": [], 2024-09-12T17:45:20.456 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_quota": { 2024-09-12T17:45:20.456 INFO:tasks.workunit.client.0.smithi098.stdout: "enabled": false, 2024-09-12T17:45:20.457 INFO:tasks.workunit.client.0.smithi098.stdout: "check_on_raw": false, 2024-09-12T17:45:20.457 INFO:tasks.workunit.client.0.smithi098.stdout: "max_size": -1, 2024-09-12T17:45:20.457 INFO:tasks.workunit.client.0.smithi098.stdout: "max_size_kb": 0, 2024-09-12T17:45:20.457 INFO:tasks.workunit.client.0.smithi098.stdout: "max_objects": -1 2024-09-12T17:45:20.457 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:45:20.457 INFO:tasks.workunit.client.0.smithi098.stdout: "user_quota": { 2024-09-12T17:45:20.457 INFO:tasks.workunit.client.0.smithi098.stdout: "enabled": false, 2024-09-12T17:45:20.457 INFO:tasks.workunit.client.0.smithi098.stdout: "check_on_raw": false, 2024-09-12T17:45:20.457 INFO:tasks.workunit.client.0.smithi098.stdout: "max_size": -1, 2024-09-12T17:45:20.457 INFO:tasks.workunit.client.0.smithi098.stdout: "max_size_kb": 0, 2024-09-12T17:45:20.457 INFO:tasks.workunit.client.0.smithi098.stdout: "max_objects": -1 2024-09-12T17:45:20.457 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:45:20.457 INFO:tasks.workunit.client.0.smithi098.stdout: "temp_url_keys": [], 2024-09-12T17:45:20.457 INFO:tasks.workunit.client.0.smithi098.stdout: "type": "rgw", 2024-09-12T17:45:20.457 INFO:tasks.workunit.client.0.smithi098.stdout: "mfa_ids": [], 2024-09-12T17:45:20.458 INFO:tasks.workunit.client.0.smithi098.stdout: "account_id": "", 2024-09-12T17:45:20.458 INFO:tasks.workunit.client.0.smithi098.stdout: "path": "/", 2024-09-12T17:45:20.458 INFO:tasks.workunit.client.0.smithi098.stdout: "create_date": "2024-09-12T17:45:20.441579Z", 2024-09-12T17:45:20.458 INFO:tasks.workunit.client.0.smithi098.stdout: "tags": [], 2024-09-12T17:45:20.458 INFO:tasks.workunit.client.0.smithi098.stdout: "group_ids": [] 2024-09-12T17:45:20.458 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:45:20.458 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:45:20.458 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.454+0000 7f0fc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:45:20.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.458+0000 7f1111e349c0 20 remove_watcher() i=0 2024-09-12T17:45:20.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.458+0000 7f1111e349c0 2 removed watcher, disabling cache 2024-09-12T17:45:20.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.462+0000 7f1111e349c0 20 remove_watcher() i=1 2024-09-12T17:45:20.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.466+0000 7f1111e349c0 20 remove_watcher() i=2 2024-09-12T17:45:20.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.466+0000 7f1111e349c0 20 remove_watcher() i=3 2024-09-12T17:45:20.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.470+0000 7f1111e349c0 20 remove_watcher() i=4 2024-09-12T17:45:20.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.470+0000 7f1111e349c0 20 remove_watcher() i=5 2024-09-12T17:45:20.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.470+0000 7f1111e349c0 20 remove_watcher() i=6 2024-09-12T17:45:20.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:45:20.474+0000 7f1111e349c0 20 remove_watcher() i=7 2024-09-12T17:45:20.490 INFO:tasks.workunit.client.0.smithi098.stderr:+ [ -z ] 2024-09-12T17:45:20.490 INFO:tasks.workunit.client.0.smithi098.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-09-12T17:45:20.490 INFO:tasks.workunit.client.0.smithi098.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-09-12T17:45:20.491 INFO:tasks.workunit.client.0.smithi098.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi098.front.sepia.ceph.com:443 2024-09-12T17:45:20.491 INFO:tasks.workunit.client.0.smithi098.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-09-12T17:45:20.491 INFO:tasks.workunit.client.0.smithi098.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T17:45:20.491 INFO:tasks.workunit.client.0.smithi098.stderr:+ ./mvnw clean package 2024-09-12T17:45:20.498 INFO:tasks.workunit.client.0.smithi098.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:45:23.460 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] Scanning for projects... 2024-09-12T17:45:23.587 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T17:45:23.686 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 55 kB/s) 2024-09-12T17:45:23.702 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T17:45:23.741 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.1 MB/s) 2024-09-12T17:45:23.756 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T17:45:23.781 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/77 kB Progress (1): 32/77 kB Progress (1): 49/77 kB Progress (1): 65/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.1 MB/s) 2024-09-12T17:45:23.829 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] 2024-09-12T17:45:23.829 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:45:23.829 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:45:23.829 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] from pom.xml 2024-09-12T17:45:23.829 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:45:23.833 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T17:45:23.850 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 332 kB/s) 2024-09-12T17:45:23.858 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T17:45:23.874 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 619 kB/s) 2024-09-12T17:45:23.878 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T17:45:23.896 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.5 MB/s) 2024-09-12T17:45:23.906 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T17:45:23.924 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.1 MB/s) 2024-09-12T17:45:23.944 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T17:45:23.962 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 1.9 MB/s) 2024-09-12T17:45:23.976 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T17:45:23.993 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 480 kB/s) 2024-09-12T17:45:23.998 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T17:45:24.014 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 476 kB/s) 2024-09-12T17:45:24.018 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T17:45:24.035 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.8 MB/s) 2024-09-12T17:45:24.042 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T17:45:24.059 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.2 MB/s) 2024-09-12T17:45:24.069 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T17:45:24.086 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.8 MB/s) 2024-09-12T17:45:24.096 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T17:45:24.114 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 545 kB/s) 2024-09-12T17:45:24.125 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T17:45:24.143 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.6 MB/s) 2024-09-12T17:45:24.156 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T17:45:24.173 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 280 kB/s) 2024-09-12T17:45:24.179 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T17:45:24.196 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.2 MB/s) 2024-09-12T17:45:24.201 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T17:45:24.219 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.6 MB/s) 2024-09-12T17:45:24.227 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T17:45:24.245 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.3 MB/s) 2024-09-12T17:45:24.255 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T17:45:24.271 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 331 kB/s) 2024-09-12T17:45:24.277 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T17:45:24.296 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.3 MB/s) 2024-09-12T17:45:24.307 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T17:45:24.324 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 398 kB/s) 2024-09-12T17:45:24.327 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T17:45:24.344 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 619 kB/s) 2024-09-12T17:45:24.348 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T17:45:24.366 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.5 MB/s) 2024-09-12T17:45:24.372 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T17:45:24.388 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.3 MB/s) 2024-09-12T17:45:24.397 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T17:45:24.414 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.6 MB/s) 2024-09-12T17:45:24.440 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T17:45:24.457 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 358 kB/s) 2024-09-12T17:45:24.460 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T17:45:24.477 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.3 MB/s) 2024-09-12T17:45:24.485 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T17:45:24.503 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.1 MB/s) 2024-09-12T17:45:24.519 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T17:45:24.536 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 236 kB/s) 2024-09-12T17:45:24.540 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T17:45:24.557 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 91 kB/s) 2024-09-12T17:45:24.560 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T17:45:24.577 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 131 kB/s) 2024-09-12T17:45:24.585 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T17:45:24.602 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 214 kB/s) 2024-09-12T17:45:24.610 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T17:45:24.626 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 201 kB/s) 2024-09-12T17:45:24.634 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T17:45:24.650 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 685 kB/s) 2024-09-12T17:45:24.658 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T17:45:24.675 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 99 kB/s) 2024-09-12T17:45:24.681 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T17:45:24.697 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 225 kB/s) 2024-09-12T17:45:24.704 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T17:45:24.721 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 289 kB/s) 2024-09-12T17:45:24.728 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T17:45:24.743 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 72 kB/s) 2024-09-12T17:45:24.747 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T17:45:24.763 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 240 kB/s) 2024-09-12T17:45:24.767 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T17:45:24.784 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 812 kB/s) 2024-09-12T17:45:24.792 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T17:45:24.809 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 204 kB/s) 2024-09-12T17:45:24.819 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T17:45:24.836 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 136 kB/s) 2024-09-12T17:45:24.845 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T17:45:24.864 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 153 kB/s) 2024-09-12T17:45:24.874 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T17:45:24.892 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 412 kB/s) 2024-09-12T17:45:24.901 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T17:45:24.918 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 321 kB/s) 2024-09-12T17:45:24.927 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T17:45:24.944 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 205 kB/s) 2024-09-12T17:45:24.953 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T17:45:24.971 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 244 kB/s) 2024-09-12T17:45:24.977 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T17:45:24.995 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 127 kB/s) 2024-09-12T17:45:25.004 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T17:45:25.025 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 307 kB/s) 2024-09-12T17:45:25.034 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T17:45:25.052 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 357 kB/s) 2024-09-12T17:45:25.063 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T17:45:25.080 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 165 kB/s) 2024-09-12T17:45:25.091 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T17:45:25.108 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 193 kB/s) 2024-09-12T17:45:25.120 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T17:45:25.137 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 240 kB/s) 2024-09-12T17:45:25.141 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T17:45:25.159 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 99 kB/s) 2024-09-12T17:45:25.169 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T17:45:25.186 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 389 kB/s) 2024-09-12T17:45:25.191 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T17:45:25.208 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 964 kB/s) 2024-09-12T17:45:25.214 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T17:45:25.232 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.9 MB/s) 2024-09-12T17:45:25.240 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T17:45:25.257 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 950 kB/s) 2024-09-12T17:45:25.268 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T17:45:25.284 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 310 kB/s) 2024-09-12T17:45:25.289 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T17:45:25.306 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 775 kB/s) 2024-09-12T17:45:25.315 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T17:45:25.332 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 822 kB/s) 2024-09-12T17:45:25.337 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T17:45:25.357 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.4 MB/s) 2024-09-12T17:45:25.377 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T17:45:25.395 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 870 kB/s) 2024-09-12T17:45:25.406 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T17:45:25.422 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 965 kB/s) 2024-09-12T17:45:25.426 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T17:45:25.444 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.4 MB/s) 2024-09-12T17:45:25.455 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T17:45:25.473 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.0 MB/s) 2024-09-12T17:45:25.480 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T17:45:25.496 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.2 MB/s) 2024-09-12T17:45:25.500 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T17:45:25.517 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.6 MB/s) 2024-09-12T17:45:25.525 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T17:45:25.541 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 240 kB/s) 2024-09-12T17:45:25.544 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T17:45:25.559 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 920 kB/s) 2024-09-12T17:45:25.563 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T17:45:25.578 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 214 kB/s) 2024-09-12T17:45:25.581 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T17:45:25.597 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 212 kB/s) 2024-09-12T17:45:25.600 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T17:45:25.615 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 136 kB/s) 2024-09-12T17:45:25.620 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T17:45:25.633 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 177 kB/s) 2024-09-12T17:45:25.637 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T17:45:25.652 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 102 kB/s) 2024-09-12T17:45:25.656 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T17:45:25.671 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 201 kB/s) 2024-09-12T17:45:25.674 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T17:45:25.689 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 200 kB/s) 2024-09-12T17:45:25.693 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T17:45:25.708 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 214 kB/s) 2024-09-12T17:45:25.712 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T17:45:25.727 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 68 kB/s) 2024-09-12T17:45:25.732 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T17:45:25.748 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 60 kB/s) 2024-09-12T17:45:25.752 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T17:45:25.768 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 180 kB/s) 2024-09-12T17:45:25.774 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T17:45:25.791 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 178 kB/s) 2024-09-12T17:45:25.795 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T17:45:25.812 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 202 kB/s) 2024-09-12T17:45:25.817 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T17:45:25.834 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 191 kB/s) 2024-09-12T17:45:25.839 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T17:45:25.857 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 168 kB/s) 2024-09-12T17:45:25.900 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T17:45:26.030 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 25 MB/s) 2024-09-12T17:45:26.034 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T17:45:26.034 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T17:45:26.034 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T17:45:26.034 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T17:45:26.034 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T17:45:26.068 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 451 kB/s) 2024-09-12T17:45:26.069 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T17:45:26.084 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16 kB Progress (2): 16 kB | 16/71 kB Progress (3): 16 kB | 16/71 kB | 16/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 321 kB/s) 2024-09-12T17:45:26.084 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T17:45:26.101 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 33/71 kB | 16/98 kB Progress (2): 33/71 kB | 33/98 kB Progress (2): 33/71 kB | 49/98 kB Progress (2): 49/71 kB | 49/98 kB Progress (2): 49/71 kB | 66/98 kB Progress (2): 66/71 kB | 66/98 kB Progress (2): 71 kB | 66/98 kB Progress (3): 71 kB | 66/98 kB | 16/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 1.0 MB/s) 2024-09-12T17:45:26.101 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T17:45:26.103 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 66/98 kB | 33/782 kB Progress (2): 82/98 kB | 33/782 kB Progress (2): 82/98 kB | 49/782 kB Progress (2): 82/98 kB | 66/782 kB Progress (2): 98 kB | 66/782 kB Progress (2): 98 kB | 82/782 kB Progress (2): 98 kB | 98/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.3 MB/s) 2024-09-12T17:45:26.103 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T17:45:26.118 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 115/782 kB Progress (1): 131/782 kB Progress (1): 147/782 kB Progress (1): 164/782 kB Progress (1): 180/782 kB Progress (1): 197/782 kB Progress (1): 213/782 kB Progress (1): 229/782 kB Progress (1): 246/782 kB Progress (1): 256/782 kB Progress (1): 272/782 kB Progress (1): 289/782 kB Progress (1): 305/782 kB Progress (1): 321/782 kB Progress (1): 338/782 kB Progress (2): 338/782 kB | 1.4/49 kB Progress (2): 354/782 kB | 1.4/49 kB Progress (2): 354/782 kB | 2.8/49 kB Progress (2): 354/782 kB | 4.1/49 kB Progress (3): 354/782 kB | 4.1/49 kB | 1.4/35 kB Progress (3): 370/782 kB | 4.1/49 kB | 1.4/35 kB Progress (3): 370/782 kB | 5.5/49 kB | 1.4/35 kB Progress (3): 370/782 kB | 5.5/49 kB | 2.8/35 kB Progress (3): 370/782 kB | 6.9/49 kB | 2.8/35 kB Progress (3): 370/782 kB | 6.9/49 kB | 4.1/35 kB Progress (3): 370/782 kB | 8.3/49 kB | 4.1/35 kB Progress (3): 370/782 kB | 8.3/49 kB | 5.5/35 kB Progress (3): 370/782 kB | 9.7/49 kB | 5.5/35 kB Progress (3): 387/782 kB | 9.7/49 kB | 5.5/35 kB Progress (3): 387/782 kB | 9.7/49 kB | 6.9/35 kB Progress (3): 387/782 kB | 11/49 kB | 6.9/35 kB Progress (3): 387/782 kB | 11/49 kB | 8.3/35 kB Progress (3): 387/782 kB | 12/49 kB | 8.3/35 kB Progress (3): 387/782 kB | 12/49 kB | 9.7/35 kB Progress (3): 403/782 kB | 12/49 kB | 9.7/35 kB Progress (3): 403/782 kB | 12/49 kB | 11/35 kB Progress (3): 403/782 kB | 14/49 kB | 11/35 kB Progress (3): 403/782 kB | 14/49 kB | 12/35 kB Progress (3): 403/782 kB | 15/49 kB | 12/35 kB Progress (3): 403/782 kB | 15/49 kB | 14/35 kB Progress (3): 420/782 kB | 15/49 kB | 14/35 kB Progress (3): 420/782 kB | 15/49 kB | 15/35 kB Progress (3): 420/782 kB | 16/49 kB | 15/35 kB Progress (3): 420/782 kB | 16/49 kB | 16/35 kB Progress (3): 420/782 kB | 17/49 kB | 16/35 kB Progress (3): 436/782 kB | 17/49 kB | 16/35 kB Progress (3): 436/782 kB | 19/49 kB | 16/35 kB Progress (3): 436/782 kB | 19/49 kB | 17/35 kB Progress (3): 436/782 kB | 19/49 kB | 19/35 kB Progress (3): 436/782 kB | 19/49 kB | 20/35 kB Progress (3): 436/782 kB | 20/49 kB | 20/35 kB Progress (3): 452/782 kB | 20/49 kB | 20/35 kB Progress (3): 452/782 kB | 20/49 kB | 21/35 kB Progress (3): 452/782 kB | 21/49 kB | 21/35 kB Progress (4): 452/782 kB | 21/49 kB | 21/35 kB | 11 kB Progress (4): 452/782 kB | 23/49 kB | 21/35 kB | 11 kB Progress (4): 452/782 kB | 23/49 kB | 23/35 kB | 11 kB Progress (4): 452/782 kB | 24/49 kB | 23/35 kB | 11 kB Progress (4): 452/782 kB | 24/49 kB | 24/35 kB | 11 kB Progress (4): 469/782 kB | 24/49 kB | 24/35 kB | 11 kB Progress (4): 469/782 kB | 24/49 kB | 25/35 kB | 11 kB Progress (4): 469/782 kB | 25/49 kB | 25/35 kB | 11 kB Progress (4): 469/782 kB | 25/49 kB | 27/35 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 137 kB/s) 2024-09-12T17:45:26.118 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (3): 469/782 kB | 25/49 kB | 28/35 kB Progress (3): 469/782 kB | 27/49 kB | 28/35 kB Progress (3): 485/782 kB | 27/49 kB | 28/35 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T17:45:26.119 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (3): 485/782 kB | 28/49 kB | 28/35 kB Progress (3): 485/782 kB | 28/49 kB | 30/35 kB Progress (3): 485/782 kB | 30/49 kB | 30/35 kB Progress (3): 485/782 kB | 30/49 kB | 31/35 kB Progress (3): 485/782 kB | 31/49 kB | 31/35 kB Progress (3): 502/782 kB | 31/49 kB | 31/35 kB Progress (3): 502/782 kB | 31/49 kB | 32/35 kB Progress (3): 502/782 kB | 32/49 kB | 32/35 kB Progress (3): 502/782 kB | 32/49 kB | 34/35 kB Progress (3): 502/782 kB | 34/49 kB | 34/35 kB Progress (3): 502/782 kB | 34/49 kB | 35/35 kB Progress (3): 502/782 kB | 35/49 kB | 35/35 kB Progress (3): 502/782 kB | 35/49 kB | 35 kB Progress (3): 518/782 kB | 35/49 kB | 35 kB Progress (3): 518/782 kB | 36/49 kB | 35 kB Progress (3): 518/782 kB | 38/49 kB | 35 kB Progress (3): 518/782 kB | 39/49 kB | 35 kB Progress (3): 534/782 kB | 39/49 kB | 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 404 kB/s) 2024-09-12T17:45:26.119 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T17:45:26.124 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (3): 534/782 kB | 39/49 kB | 16/205 kB Progress (3): 551/782 kB | 39/49 kB | 16/205 kB Progress (3): 551/782 kB | 39/49 kB | 33/205 kB Progress (3): 567/782 kB | 39/49 kB | 33/205 kB Progress (3): 567/782 kB | 39/49 kB | 49/205 kB Progress (3): 583/782 kB | 39/49 kB | 49/205 kB Progress (3): 600/782 kB | 39/49 kB | 49/205 kB Progress (3): 616/782 kB | 39/49 kB | 49/205 kB Progress (3): 616/782 kB | 39/49 kB | 66/205 kB Progress (3): 633/782 kB | 39/49 kB | 66/205 kB Progress (3): 633/782 kB | 39/49 kB | 82/205 kB Progress (3): 633/782 kB | 41/49 kB | 82/205 kB Progress (3): 633/782 kB | 42/49 kB | 82/205 kB Progress (3): 633/782 kB | 43/49 kB | 82/205 kB Progress (3): 649/782 kB | 43/49 kB | 82/205 kB Progress (3): 649/782 kB | 45/49 kB | 82/205 kB Progress (3): 649/782 kB | 46/49 kB | 82/205 kB Progress (3): 649/782 kB | 46/49 kB | 98/205 kB Progress (3): 649/782 kB | 48/49 kB | 98/205 kB Progress (3): 665/782 kB | 48/49 kB | 98/205 kB Progress (3): 665/782 kB | 49/49 kB | 98/205 kB Progress (3): 665/782 kB | 49 kB | 98/205 kB Progress (3): 682/782 kB | 49 kB | 98/205 kB Progress (3): 698/782 kB | 49 kB | 98/205 kB Progress (3): 698/782 kB | 49 kB | 115/205 kB Progress (3): 715/782 kB | 49 kB | 115/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 547 kB/s) 2024-09-12T17:45:26.124 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T17:45:26.126 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 731/782 kB | 115/205 kB Progress (2): 747/782 kB | 115/205 kB Progress (2): 747/782 kB | 131/205 kB Progress (2): 764/782 kB | 131/205 kB Progress (2): 780/782 kB | 131/205 kB Progress (2): 782 kB | 131/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 8.5 MB/s) 2024-09-12T17:45:26.126 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T17:45:26.132 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 147/205 kB Progress (2): 147/205 kB | 16/30 kB Progress (2): 164/205 kB | 16/30 kB Progress (2): 164/205 kB | 30 kB Progress (2): 180/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 305 kB/s) 2024-09-12T17:45:26.133 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T17:45:26.135 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 197/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.0 MB/s) 2024-09-12T17:45:26.135 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.4/81 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T17:45:26.141 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 2.8/81 kB Progress (1): 4.1/81 kB Progress (1): 5.5/81 kB Progress (1): 6.9/81 kB Progress (1): 8.3/81 kB Progress (1): 9.7/81 kB Progress (1): 11/81 kB Progress (1): 12/81 kB Progress (1): 14/81 kB Progress (1): 15/81 kB Progress (1): 16/81 kB Progress (1): 32/81 kB Progress (1): 49/81 kB Progress (2): 49/81 kB | 13 kB Progress (3): 49/81 kB | 13 kB | 16/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 125 kB/s) 2024-09-12T17:45:26.141 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T17:45:26.150 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 49/81 kB | 32/798 kB Progress (2): 49/81 kB | 49/798 kB Progress (2): 49/81 kB | 65/798 kB Progress (2): 65/81 kB | 65/798 kB Progress (3): 65/81 kB | 65/798 kB | 16/182 kB Progress (3): 65/81 kB | 65/798 kB | 33/182 kB Progress (3): 81 kB | 65/798 kB | 33/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 707 kB/s) 2024-09-12T17:45:26.150 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 65/798 kB | 49/182 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T17:45:26.157 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (3): 65/798 kB | 49/182 kB | 16/151 kB Progress (3): 65/798 kB | 66/182 kB | 16/151 kB Progress (3): 65/798 kB | 66/182 kB | 32/151 kB Progress (3): 65/798 kB | 82/182 kB | 32/151 kB Progress (3): 65/798 kB | 82/182 kB | 49/151 kB Progress (3): 65/798 kB | 98/182 kB | 49/151 kB Progress (3): 65/798 kB | 98/182 kB | 65/151 kB Progress (3): 81/798 kB | 98/182 kB | 65/151 kB Progress (3): 81/798 kB | 98/182 kB | 81/151 kB Progress (3): 98/798 kB | 98/182 kB | 81/151 kB Progress (3): 98/798 kB | 98/182 kB | 98/151 kB Progress (3): 98/798 kB | 98/182 kB | 114/151 kB Progress (3): 114/798 kB | 98/182 kB | 114/151 kB Progress (3): 114/798 kB | 98/182 kB | 130/151 kB Progress (3): 114/798 kB | 98/182 kB | 147/151 kB Progress (3): 130/798 kB | 98/182 kB | 147/151 kB Progress (3): 130/798 kB | 98/182 kB | 151 kB Progress (4): 130/798 kB | 98/182 kB | 151 kB | 16/27 kB Progress (4): 130/798 kB | 98/182 kB | 151 kB | 27 kB Progress (4): 147/798 kB | 98/182 kB | 151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.2 MB/s) 2024-09-12T17:45:26.157 INFO:tasks.workunit.client.0.smithi098.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 225 kB/s) 2024-09-12T17:45:26.157 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T17:45:26.157 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T17:45:26.163 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 163/798 kB | 98/182 kB Progress (2): 180/798 kB | 98/182 kB Progress (2): 196/798 kB | 98/182 kB Progress (2): 212/798 kB | 98/182 kB Progress (2): 212/798 kB | 115/182 kB Progress (2): 212/798 kB | 131/182 kB Progress (2): 229/798 kB | 131/182 kB Progress (2): 229/798 kB | 147/182 kB Progress (2): 229/798 kB | 164/182 kB Progress (2): 229/798 kB | 180/182 kB Progress (2): 229/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.4 MB/s) 2024-09-12T17:45:26.163 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T17:45:26.167 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 245/798 kB Progress (2): 245/798 kB | 16/30 kB Progress (2): 245/798 kB | 30 kB Progress (2): 262/798 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 229 kB/s) 2024-09-12T17:45:26.167 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T17:45:26.173 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 278/798 kB Progress (1): 294/798 kB Progress (1): 311/798 kB Progress (1): 327/798 kB Progress (1): 343/798 kB Progress (1): 360/798 kB Progress (1): 376/798 kB Progress (1): 393/798 kB Progress (1): 402/798 kB Progress (1): 418/798 kB Progress (1): 435/798 kB Progress (2): 435/798 kB | 13 kB Progress (2): 451/798 kB | 13 kB Progress (2): 468/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 96 kB/s) 2024-09-12T17:45:26.173 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T17:45:26.182 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 484/798 kB Progress (1): 500/798 kB Progress (1): 517/798 kB Progress (2): 517/798 kB | 16/385 kB Progress (2): 533/798 kB | 16/385 kB Progress (2): 533/798 kB | 33/385 kB Progress (2): 533/798 kB | 49/385 kB Progress (2): 533/798 kB | 66/385 kB Progress (2): 533/798 kB | 82/385 kB Progress (2): 533/798 kB | 98/385 kB Progress (2): 549/798 kB | 98/385 kB Progress (2): 566/798 kB | 98/385 kB Progress (2): 566/798 kB | 115/385 kB Progress (2): 582/798 kB | 115/385 kB Progress (2): 582/798 kB | 131/385 kB Progress (2): 599/798 kB | 131/385 kB Progress (3): 599/798 kB | 131/385 kB | 16/75 kB Progress (3): 599/798 kB | 147/385 kB | 16/75 kB Progress (3): 599/798 kB | 147/385 kB | 33/75 kB Progress (3): 615/798 kB | 147/385 kB | 33/75 kB Progress (3): 615/798 kB | 164/385 kB | 33/75 kB Progress (3): 615/798 kB | 164/385 kB | 49/75 kB Progress (3): 631/798 kB | 164/385 kB | 49/75 kB Progress (3): 631/798 kB | 180/385 kB | 49/75 kB Progress (3): 631/798 kB | 180/385 kB | 66/75 kB Progress (3): 648/798 kB | 180/385 kB | 66/75 kB Progress (3): 648/798 kB | 180/385 kB | 75 kB Progress (3): 648/798 kB | 197/385 kB | 75 kB Progress (3): 664/798 kB | 197/385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 514 kB/s) 2024-09-12T17:45:26.182 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 664/798 kB | 213/385 kB Progress (3): 664/798 kB | 213/385 kB | 16/780 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T17:45:26.188 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (3): 681/798 kB | 213/385 kB | 16/780 kB Progress (3): 681/798 kB | 213/385 kB | 33/780 kB Progress (3): 681/798 kB | 229/385 kB | 33/780 kB Progress (3): 697/798 kB | 229/385 kB | 33/780 kB Progress (3): 697/798 kB | 229/385 kB | 49/780 kB Progress (3): 697/798 kB | 246/385 kB | 49/780 kB Progress (3): 713/798 kB | 246/385 kB | 49/780 kB Progress (3): 713/798 kB | 246/385 kB | 63/780 kB Progress (3): 713/798 kB | 262/385 kB | 63/780 kB Progress (3): 730/798 kB | 262/385 kB | 63/780 kB Progress (3): 730/798 kB | 279/385 kB | 63/780 kB Progress (3): 746/798 kB | 279/385 kB | 63/780 kB Progress (3): 746/798 kB | 279/385 kB | 80/780 kB Progress (3): 746/798 kB | 295/385 kB | 80/780 kB Progress (3): 762/798 kB | 295/385 kB | 80/780 kB Progress (3): 762/798 kB | 311/385 kB | 80/780 kB Progress (3): 762/798 kB | 311/385 kB | 96/780 kB Progress (3): 762/798 kB | 328/385 kB | 96/780 kB Progress (3): 779/798 kB | 328/385 kB | 96/780 kB Progress (3): 779/798 kB | 328/385 kB | 113/780 kB Progress (3): 779/798 kB | 344/385 kB | 113/780 kB Progress (3): 795/798 kB | 344/385 kB | 113/780 kB Progress (3): 798 kB | 344/385 kB | 113/780 kB Progress (3): 798 kB | 360/385 kB | 113/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 5.2 MB/s) 2024-09-12T17:45:26.188 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T17:45:26.190 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 377/385 kB | 113/780 kB Progress (2): 385 kB | 113/780 kB Progress (3): 385 kB | 113/780 kB | 16/329 kB Progress (3): 385 kB | 113/780 kB | 33/329 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.5 MB/s) 2024-09-12T17:45:26.190 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 113/780 kB | 49/329 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T17:45:26.199 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 113/780 kB | 66/329 kB Progress (2): 113/780 kB | 82/329 kB Progress (2): 113/780 kB | 98/329 kB Progress (2): 113/780 kB | 115/329 kB Progress (2): 113/780 kB | 131/329 kB Progress (2): 113/780 kB | 147/329 kB Progress (2): 113/780 kB | 164/329 kB Progress (2): 129/780 kB | 164/329 kB Progress (2): 145/780 kB | 164/329 kB Progress (2): 145/780 kB | 180/329 kB Progress (2): 145/780 kB | 197/329 kB Progress (2): 162/780 kB | 197/329 kB Progress (2): 178/780 kB | 197/329 kB Progress (2): 178/780 kB | 213/329 kB Progress (2): 178/780 kB | 229/329 kB Progress (2): 194/780 kB | 229/329 kB Progress (2): 194/780 kB | 246/329 kB Progress (2): 194/780 kB | 256/329 kB Progress (2): 211/780 kB | 256/329 kB Progress (2): 211/780 kB | 272/329 kB Progress (3): 211/780 kB | 272/329 kB | 16/501 kB Progress (3): 227/780 kB | 272/329 kB | 16/501 kB Progress (3): 227/780 kB | 289/329 kB | 16/501 kB Progress (3): 227/780 kB | 289/329 kB | 33/501 kB Progress (3): 244/780 kB | 289/329 kB | 33/501 kB Progress (3): 244/780 kB | 305/329 kB | 33/501 kB Progress (3): 244/780 kB | 305/329 kB | 49/501 kB Progress (3): 260/780 kB | 305/329 kB | 49/501 kB Progress (3): 260/780 kB | 321/329 kB | 49/501 kB Progress (3): 260/780 kB | 321/329 kB | 64/501 kB Progress (3): 260/780 kB | 329 kB | 64/501 kB Progress (3): 276/780 kB | 329 kB | 64/501 kB Progress (3): 276/780 kB | 329 kB | 81/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.0 MB/s) 2024-09-12T17:45:26.199 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 276/780 kB | 97/501 kB Progress (2): 293/780 kB | 97/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T17:45:26.208 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 293/780 kB | 113/501 kB Progress (2): 309/780 kB | 113/501 kB Progress (2): 309/780 kB | 130/501 kB Progress (2): 326/780 kB | 130/501 kB Progress (2): 326/780 kB | 146/501 kB Progress (2): 342/780 kB | 146/501 kB Progress (2): 342/780 kB | 163/501 kB Progress (2): 358/780 kB | 163/501 kB Progress (2): 358/780 kB | 179/501 kB Progress (3): 358/780 kB | 179/501 kB | 16/354 kB Progress (3): 358/780 kB | 195/501 kB | 16/354 kB Progress (3): 375/780 kB | 195/501 kB | 16/354 kB Progress (3): 375/780 kB | 195/501 kB | 33/354 kB Progress (3): 375/780 kB | 212/501 kB | 33/354 kB Progress (3): 375/780 kB | 212/501 kB | 49/354 kB Progress (3): 375/780 kB | 228/501 kB | 49/354 kB Progress (3): 375/780 kB | 228/501 kB | 66/354 kB Progress (3): 375/780 kB | 244/501 kB | 66/354 kB Progress (3): 375/780 kB | 261/501 kB | 66/354 kB Progress (3): 375/780 kB | 261/501 kB | 82/354 kB Progress (3): 375/780 kB | 277/501 kB | 82/354 kB Progress (3): 375/780 kB | 277/501 kB | 98/354 kB Progress (3): 375/780 kB | 294/501 kB | 98/354 kB Progress (3): 375/780 kB | 294/501 kB | 115/354 kB Progress (3): 391/780 kB | 294/501 kB | 115/354 kB Progress (3): 391/780 kB | 294/501 kB | 131/354 kB Progress (3): 407/780 kB | 294/501 kB | 131/354 kB Progress (4): 407/780 kB | 294/501 kB | 131/354 kB | 16/41 kB Progress (4): 407/780 kB | 294/501 kB | 147/354 kB | 16/41 kB Progress (4): 407/780 kB | 294/501 kB | 164/354 kB | 16/41 kB Progress (4): 407/780 kB | 294/501 kB | 164/354 kB | 32/41 kB Progress (4): 424/780 kB | 294/501 kB | 164/354 kB | 32/41 kB Progress (4): 424/780 kB | 294/501 kB | 180/354 kB | 32/41 kB Progress (4): 424/780 kB | 294/501 kB | 180/354 kB | 41 kB Progress (4): 440/780 kB | 294/501 kB | 180/354 kB | 41 kB Progress (4): 440/780 kB | 294/501 kB | 197/354 kB | 41 kB Progress (4): 457/780 kB | 294/501 kB | 197/354 kB | 41 kB Progress (4): 457/780 kB | 294/501 kB | 213/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 240 kB/s) 2024-09-12T17:45:26.208 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (3): 473/780 kB | 294/501 kB | 213/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T17:45:26.237 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (3): 473/780 kB | 294/501 kB | 229/354 kB Progress (3): 489/780 kB | 294/501 kB | 229/354 kB Progress (3): 489/780 kB | 310/501 kB | 229/354 kB Progress (3): 489/780 kB | 310/501 kB | 246/354 kB Progress (3): 506/780 kB | 310/501 kB | 246/354 kB Progress (3): 506/780 kB | 310/501 kB | 256/354 kB Progress (3): 522/780 kB | 310/501 kB | 256/354 kB Progress (3): 522/780 kB | 326/501 kB | 256/354 kB Progress (3): 539/780 kB | 326/501 kB | 256/354 kB Progress (3): 539/780 kB | 343/501 kB | 256/354 kB Progress (3): 539/780 kB | 343/501 kB | 272/354 kB Progress (3): 555/780 kB | 343/501 kB | 272/354 kB Progress (3): 555/780 kB | 359/501 kB | 272/354 kB Progress (3): 555/780 kB | 359/501 kB | 289/354 kB Progress (3): 571/780 kB | 359/501 kB | 289/354 kB Progress (3): 571/780 kB | 376/501 kB | 289/354 kB Progress (3): 588/780 kB | 376/501 kB | 289/354 kB Progress (3): 588/780 kB | 392/501 kB | 289/354 kB Progress (3): 588/780 kB | 392/501 kB | 305/354 kB Progress (3): 604/780 kB | 392/501 kB | 305/354 kB Progress (3): 604/780 kB | 408/501 kB | 305/354 kB Progress (3): 604/780 kB | 408/501 kB | 321/354 kB Progress (3): 604/780 kB | 425/501 kB | 321/354 kB Progress (3): 620/780 kB | 425/501 kB | 321/354 kB Progress (4): 620/780 kB | 425/501 kB | 321/354 kB | 6.4 kB Progress (5): 620/780 kB | 425/501 kB | 321/354 kB | 6.4 kB | 16/586 kB Progress (5): 620/780 kB | 425/501 kB | 338/354 kB | 6.4 kB | 16/586 kB Progress (5): 620/780 kB | 441/501 kB | 338/354 kB | 6.4 kB | 16/586 kB Progress (5): 637/780 kB | 441/501 kB | 338/354 kB | 6.4 kB | 16/586 kB Progress (5): 637/780 kB | 441/501 kB | 338/354 kB | 6.4 kB | 32/586 kB Progress (5): 637/780 kB | 457/501 kB | 338/354 kB | 6.4 kB | 32/586 kB Progress (5): 637/780 kB | 457/501 kB | 354 kB | 6.4 kB | 32/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 32 kB/s) 2024-09-12T17:45:26.237 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (4): 653/780 kB | 457/501 kB | 354 kB | 32/586 kB Progress (4): 653/780 kB | 457/501 kB | 354 kB | 49/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T17:45:26.238 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (4): 653/780 kB | 474/501 kB | 354 kB | 49/586 kB Progress (4): 670/780 kB | 474/501 kB | 354 kB | 49/586 kB Progress (4): 670/780 kB | 474/501 kB | 354 kB | 65/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 1.8 MB/s) 2024-09-12T17:45:26.238 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (3): 670/780 kB | 490/501 kB | 65/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T17:45:26.241 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (3): 670/780 kB | 490/501 kB | 81/586 kB Progress (3): 670/780 kB | 501 kB | 81/586 kB Progress (3): 686/780 kB | 501 kB | 81/586 kB Progress (3): 686/780 kB | 501 kB | 98/586 kB Progress (3): 702/780 kB | 501 kB | 98/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.5 MB/s) 2024-09-12T17:45:26.241 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T17:45:26.244 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 702/780 kB | 114/586 kB Progress (2): 719/780 kB | 114/586 kB Progress (2): 719/780 kB | 130/586 kB Progress (2): 735/780 kB | 130/586 kB Progress (2): 735/780 kB | 147/586 kB Progress (2): 752/780 kB | 147/586 kB Progress (2): 752/780 kB | 163/586 kB Progress (2): 768/780 kB | 163/586 kB Progress (2): 768/780 kB | 180/586 kB Progress (2): 780 kB | 180/586 kB Progress (2): 780 kB | 196/586 kB Progress (2): 780 kB | 212/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 3.8 MB/s) 2024-09-12T17:45:26.244 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 229/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T17:45:26.250 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 245/586 kB Progress (1): 262/586 kB Progress (1): 278/586 kB Progress (1): 294/586 kB Progress (1): 311/586 kB Progress (1): 327/586 kB Progress (1): 343/586 kB Progress (1): 360/586 kB Progress (1): 376/586 kB Progress (1): 393/586 kB Progress (1): 402/586 kB Progress (1): 418/586 kB Progress (1): 435/586 kB Progress (1): 451/586 kB Progress (1): 468/586 kB Progress (1): 484/586 kB Progress (1): 500/586 kB Progress (1): 517/586 kB Progress (1): 533/586 kB Progress (1): 549/586 kB Progress (1): 566/586 kB Progress (1): 582/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.8 MB/s) 2024-09-12T17:45:26.250 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T17:45:26.256 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/211 kB Progress (1): 33/211 kB Progress (1): 49/211 kB Progress (1): 66/211 kB Progress (1): 82/211 kB Progress (1): 98/211 kB Progress (1): 115/211 kB Progress (1): 131/211 kB Progress (1): 147/211 kB Progress (1): 164/211 kB Progress (2): 164/211 kB | 16/106 kB Progress (3): 164/211 kB | 16/106 kB | 14 kB Progress (3): 180/211 kB | 16/106 kB | 14 kB Progress (3): 180/211 kB | 33/106 kB | 14 kB Progress (3): 197/211 kB | 33/106 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 65 kB/s) 2024-09-12T17:45:26.256 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T17:45:26.257 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 197/211 kB | 49/106 kB Progress (2): 211 kB | 49/106 kB Progress (2): 211 kB | 66/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 959 kB/s) 2024-09-12T17:45:26.257 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T17:45:26.258 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 82/106 kB Progress (1): 98/106 kB Progress (1): 106 kB Progress (2): 106 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 481 kB/s) 2024-09-12T17:45:26.258 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T17:45:26.259 INFO:tasks.workunit.client.0.smithi098.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 31 kB/s) 2024-09-12T17:45:26.259 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T17:45:26.271 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 15/245 kB Progress (1): 31/245 kB Progress (1): 48/245 kB Progress (1): 64/245 kB Progress (1): 81/245 kB Progress (1): 96/245 kB Progress (1): 112/245 kB Progress (1): 128/245 kB Progress (1): 145/245 kB Progress (1): 161/245 kB Progress (1): 177/245 kB Progress (1): 194/245 kB Progress (1): 210/245 kB Progress (1): 227/245 kB Progress (1): 243/245 kB Progress (1): 245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.0 MB/s) 2024-09-12T17:45:26.271 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T17:45:26.272 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 65 kB/s) 2024-09-12T17:45:26.272 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T17:45:26.274 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/205 kB Progress (2): 16/205 kB | 16/16 kB Progress (2): 33/205 kB | 16/16 kB Progress (2): 33/205 kB | 16 kB Progress (2): 49/205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 69 kB/s) 2024-09-12T17:45:26.274 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 66/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T17:45:26.275 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 66/205 kB | 6.4 kB Progress (2): 82/205 kB | 6.4 kB Progress (2): 98/205 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 27 kB/s) 2024-09-12T17:45:26.275 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 115/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T17:45:26.277 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 131/205 kB Progress (1): 147/205 kB Progress (1): 164/205 kB Progress (1): 180/205 kB Progress (1): 197/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 853 kB/s) 2024-09-12T17:45:26.287 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 90 kB/s) 2024-09-12T17:45:26.289 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Progress (2): 17 kB | 16/24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 69 kB/s) 2024-09-12T17:45:26.290 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 24 kB Progress (2): 24 kB | 16/184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 96 kB/s) 2024-09-12T17:45:26.294 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 66/184 kB Progress (1): 82/184 kB Progress (1): 98/184 kB Progress (1): 115/184 kB Progress (1): 131/184 kB Progress (1): 147/184 kB Progress (1): 164/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 718 kB/s) 2024-09-12T17:45:26.319 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] 2024-09-12T17:45:26.319 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T17:45:26.326 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T17:45:26.342 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 364 kB/s) 2024-09-12T17:45:26.344 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T17:45:26.359 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 318 kB/s) 2024-09-12T17:45:26.361 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T17:45:26.377 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.7 MB/s) 2024-09-12T17:45:26.382 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T17:45:26.397 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 950 kB/s) 2024-09-12T17:45:26.403 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T17:45:26.421 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 41/153 kB Progress (1): 58/153 kB Progress (1): 74/153 kB Progress (1): 90/153 kB Progress (1): 107/153 kB Progress (1): 123/153 kB Progress (1): 140/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 8.5 MB/s) 2024-09-12T17:45:26.421 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T17:45:26.439 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 63/215 kB Progress (1): 79/215 kB Progress (1): 95/215 kB Progress (1): 112/215 kB Progress (1): 128/215 kB Progress (1): 145/215 kB Progress (1): 161/215 kB Progress (1): 177/215 kB Progress (1): 194/215 kB Progress (1): 210/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 12 MB/s) 2024-09-12T17:45:26.510 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] 2024-09-12T17:45:26.510 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:45:26.514 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T17:45:26.529 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 177 kB/s) 2024-09-12T17:45:26.531 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T17:45:26.546 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.5 MB/s) 2024-09-12T17:45:26.550 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T17:45:26.565 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 585 kB/s) 2024-09-12T17:45:26.568 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T17:45:26.583 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.6 MB/s) 2024-09-12T17:45:26.587 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T17:45:26.602 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 402 kB/s) 2024-09-12T17:45:26.605 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T17:45:26.619 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 215 kB/s) 2024-09-12T17:45:26.624 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T17:45:26.639 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 41 kB/s) 2024-09-12T17:45:26.641 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T17:45:26.656 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 183 kB/s) 2024-09-12T17:45:26.659 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T17:45:26.674 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 940 kB/s) 2024-09-12T17:45:26.677 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T17:45:26.692 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 214 kB/s) 2024-09-12T17:45:26.694 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T17:45:26.709 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 557 kB/s) 2024-09-12T17:45:26.712 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T17:45:26.727 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 523 kB/s) 2024-09-12T17:45:26.730 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T17:45:26.745 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 534 kB/s) 2024-09-12T17:45:26.749 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T17:45:26.765 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.2 MB/s) 2024-09-12T17:45:26.770 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T17:45:26.786 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 340 kB/s) 2024-09-12T17:45:26.789 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T17:45:26.805 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.8 MB/s) 2024-09-12T17:45:26.811 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T17:45:26.826 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 340 kB/s) 2024-09-12T17:45:26.831 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T17:45:26.849 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 4.7 MB/s) 2024-09-12T17:45:26.850 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T17:45:26.850 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T17:45:26.851 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T17:45:26.851 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T17:45:26.851 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T17:45:26.866 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/269 kB Progress (1): 33/269 kB Progress (1): 49/269 kB Progress (2): 49/269 kB | 16/55 kB Progress (3): 49/269 kB | 16/55 kB | 2.5 kB Progress (3): 64/269 kB | 16/55 kB | 2.5 kB Progress (3): 64/269 kB | 33/55 kB | 2.5 kB Progress (3): 80/269 kB | 33/55 kB | 2.5 kB Progress (4): 80/269 kB | 33/55 kB | 2.5 kB | 16/41 kB Progress (4): 80/269 kB | 49/55 kB | 2.5 kB | 16/41 kB Progress (4): 97/269 kB | 49/55 kB | 2.5 kB | 16/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 156 kB/s) 2024-09-12T17:45:26.866 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (3): 97/269 kB | 55 kB | 16/41 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T17:45:26.867 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (4): 97/269 kB | 55 kB | 16/41 kB | 8.5 kB Progress (4): 113/269 kB | 55 kB | 16/41 kB | 8.5 kB Progress (4): 113/269 kB | 55 kB | 33/41 kB | 8.5 kB Progress (4): 129/269 kB | 55 kB | 33/41 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.2 MB/s) 2024-09-12T17:45:26.868 INFO:tasks.workunit.client.0.smithi098.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 530 kB/s) 2024-09-12T17:45:26.868 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T17:45:26.869 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 146/269 kB | 33/41 kB Progress (2): 146/269 kB | 41 kB Progress (2): 162/269 kB | 41 kB Progress (2): 179/269 kB | 41 kB Progress (2): 195/269 kB | 41 kB Progress (2): 211/269 kB | 41 kB Progress (2): 228/269 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.2 MB/s) 2024-09-12T17:45:26.869 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 244/269 kB Progress (1): 260/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 14 MB/s) 2024-09-12T17:45:26.887 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/587 kB Progress (1): 33/587 kB Progress (2): 33/587 kB | 16/327 kB Progress (2): 49/587 kB | 16/327 kB Progress (2): 49/587 kB | 33/327 kB Progress (2): 49/587 kB | 49/327 kB Progress (2): 64/587 kB | 49/327 kB Progress (2): 64/587 kB | 66/327 kB Progress (2): 80/587 kB | 66/327 kB Progress (2): 80/587 kB | 82/327 kB Progress (2): 80/587 kB | 98/327 kB Progress (2): 96/587 kB | 98/327 kB Progress (2): 96/587 kB | 115/327 kB Progress (2): 113/587 kB | 115/327 kB Progress (2): 113/587 kB | 131/327 kB Progress (2): 113/587 kB | 147/327 kB Progress (2): 129/587 kB | 147/327 kB Progress (2): 129/587 kB | 164/327 kB Progress (2): 146/587 kB | 164/327 kB Progress (2): 146/587 kB | 180/327 kB Progress (2): 146/587 kB | 197/327 kB Progress (2): 162/587 kB | 197/327 kB Progress (2): 162/587 kB | 213/327 kB Progress (2): 178/587 kB | 213/327 kB Progress (2): 178/587 kB | 229/327 kB Progress (2): 178/587 kB | 246/327 kB Progress (2): 195/587 kB | 246/327 kB Progress (2): 195/587 kB | 256/327 kB Progress (2): 195/587 kB | 272/327 kB Progress (2): 211/587 kB | 272/327 kB Progress (2): 211/587 kB | 289/327 kB Progress (2): 227/587 kB | 289/327 kB Progress (2): 227/587 kB | 305/327 kB Progress (2): 227/587 kB | 321/327 kB Progress (2): 244/587 kB | 321/327 kB Progress (2): 244/587 kB | 327 kB Progress (2): 260/587 kB | 327 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 9.1 MB/s) 2024-09-12T17:45:26.894 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 277/587 kB Progress (1): 293/587 kB Progress (1): 309/587 kB Progress (1): 326/587 kB Progress (1): 342/587 kB Progress (1): 359/587 kB Progress (1): 375/587 kB Progress (1): 391/587 kB Progress (1): 408/587 kB Progress (1): 424/587 kB Progress (1): 440/587 kB Progress (1): 457/587 kB Progress (1): 473/587 kB Progress (1): 490/587 kB Progress (1): 506/587 kB Progress (1): 522/587 kB Progress (1): 539/587 kB Progress (1): 555/587 kB Progress (1): 572/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 14 MB/s) 2024-09-12T17:45:26.929 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:45:26.930 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] 2024-09-12T17:45:26.930 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:45:26.934 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T17:45:26.949 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-12T17:45:26.951 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T17:45:26.966 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 454 kB/s) 2024-09-12T17:45:26.967 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T17:45:26.982 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-12T17:45:26.984 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T17:45:26.999 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-12T17:45:27.003 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T17:45:27.018 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 51 kB/s) 2024-09-12T17:45:27.021 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T17:45:27.036 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 265 kB/s) 2024-09-12T17:45:27.039 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T17:45:27.054 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-12T17:45:27.057 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T17:45:27.072 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 311 kB/s) 2024-09-12T17:45:27.075 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T17:45:27.090 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-09-12T17:45:27.093 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T17:45:27.108 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-09-12T17:45:27.111 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T17:45:27.126 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 753 kB/s) 2024-09-12T17:45:27.129 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T17:45:27.145 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-12T17:45:27.148 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T17:45:27.163 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 438 kB/s) 2024-09-12T17:45:27.166 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T17:45:27.182 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 66 kB/s) 2024-09-12T17:45:27.185 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T17:45:27.201 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 524 kB/s) 2024-09-12T17:45:27.205 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T17:45:27.221 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 167 kB/s) 2024-09-12T17:45:27.227 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T17:45:27.242 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 352 kB/s) 2024-09-12T17:45:27.248 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T17:45:27.264 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 71 kB/s) 2024-09-12T17:45:27.270 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T17:45:27.286 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 51 kB/s) 2024-09-12T17:45:27.289 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T17:45:27.305 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 402 kB/s) 2024-09-12T17:45:27.308 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T17:45:27.325 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.6 MB/s) 2024-09-12T17:45:27.331 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T17:45:27.347 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 75 kB/s) 2024-09-12T17:45:27.350 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T17:45:27.367 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 78 kB/s) 2024-09-12T17:45:27.380 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T17:45:27.396 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 846 kB/s) 2024-09-12T17:45:27.396 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T17:45:27.397 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T17:45:27.397 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T17:45:27.398 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T17:45:27.398 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T17:45:27.414 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/55 kB Progress (2): 4.2 kB | 33/55 kB Progress (3): 4.2 kB | 33/55 kB | 16/122 kB Progress (3): 4.2 kB | 49/55 kB | 16/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 263 kB/s) 2024-09-12T17:45:27.414 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 49/55 kB | 32/122 kB Progress (3): 49/55 kB | 32/122 kB | 16/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T17:45:27.414 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (3): 55 kB | 32/122 kB | 16/334 kB Progress (4): 55 kB | 32/122 kB | 16/334 kB | 16/27 kB Progress (4): 55 kB | 49/122 kB | 16/334 kB | 16/27 kB Progress (4): 55 kB | 49/122 kB | 33/334 kB | 16/27 kB Progress (4): 55 kB | 49/122 kB | 33/334 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.4 MB/s) 2024-09-12T17:45:27.414 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (3): 65/122 kB | 33/334 kB | 27 kB Progress (3): 65/122 kB | 49/334 kB | 27 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T17:45:27.414 INFO:tasks.workunit.client.0.smithi098.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.7 MB/s) 2024-09-12T17:45:27.414 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T17:45:27.416 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 65/122 kB | 66/334 kB Progress (2): 81/122 kB | 66/334 kB Progress (2): 81/122 kB | 82/334 kB Progress (2): 98/122 kB | 82/334 kB Progress (2): 98/122 kB | 98/334 kB Progress (2): 114/122 kB | 98/334 kB Progress (2): 114/122 kB | 115/334 kB Progress (2): 122 kB | 115/334 kB Progress (2): 122 kB | 131/334 kB Progress (2): 122 kB | 147/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.4 MB/s) 2024-09-12T17:45:27.421 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 164/334 kB Progress (1): 180/334 kB Progress (1): 197/334 kB Progress (1): 213/334 kB Progress (1): 229/334 kB Progress (1): 246/334 kB Progress (1): 256/334 kB Progress (1): 272/334 kB Progress (1): 289/334 kB Progress (1): 305/334 kB Progress (1): 321/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 14 MB/s) 2024-09-12T17:45:27.429 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 4.7 kB Progress (2): 4.7 kB | 16/23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 150 kB/s) 2024-09-12T17:45:27.430 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 23 kB Progress (2): 23 kB | 16/267 kB Progress (2): 23 kB | 32/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 712 kB/s) 2024-09-12T17:45:27.435 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 49/267 kB Progress (1): 65/267 kB Progress (1): 81/267 kB Progress (1): 98/267 kB Progress (1): 114/267 kB Progress (1): 130/267 kB Progress (1): 147/267 kB Progress (1): 163/267 kB Progress (1): 180/267 kB Progress (1): 196/267 kB Progress (1): 212/267 kB Progress (1): 219/267 kB Progress (1): 236/267 kB Progress (1): 252/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 7.2 MB/s) 2024-09-12T17:45:27.574 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T17:45:27.577 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T17:45:28.720 INFO:tasks.workunit.client.0.smithi098.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:45:28.721 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] 2024-09-12T17:45:28.721 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:45:28.724 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:45:28.724 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] 2024-09-12T17:45:28.724 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:45:28.728 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T17:45:28.728 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T17:45:28.894 INFO:tasks.workunit.client.0.smithi098.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T17:45:28.895 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] 2024-09-12T17:45:28.895 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:45:28.900 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T17:45:28.914 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-12T17:45:28.918 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T17:45:28.933 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-09-12T17:45:28.936 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T17:45:28.952 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 217 kB/s) 2024-09-12T17:45:28.955 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T17:45:28.971 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 254 kB/s) 2024-09-12T17:45:28.974 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T17:45:28.989 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 207 kB/s) 2024-09-12T17:45:28.993 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T17:45:29.009 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 278 kB/s) 2024-09-12T17:45:29.013 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T17:45:29.028 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 117 kB/s) 2024-09-12T17:45:29.033 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T17:45:29.047 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 146 kB/s) 2024-09-12T17:45:29.050 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T17:45:29.066 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 1.9 MB/s) 2024-09-12T17:45:29.070 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T17:45:29.085 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-12T17:45:29.089 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T17:45:29.104 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 387 kB/s) 2024-09-12T17:45:29.108 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T17:45:29.123 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 157 kB/s) 2024-09-12T17:45:29.125 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T17:45:29.142 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.3 MB/s) 2024-09-12T17:45:29.145 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T17:45:29.161 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.3 MB/s) 2024-09-12T17:45:29.165 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T17:45:29.181 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 952 kB/s) 2024-09-12T17:45:29.186 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T17:45:29.202 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 541 kB/s) 2024-09-12T17:45:29.206 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T17:45:29.222 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.7 MB/s) 2024-09-12T17:45:29.228 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T17:45:29.243 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 504 kB/s) 2024-09-12T17:45:29.249 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T17:45:29.265 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 136 kB/s) 2024-09-12T17:45:29.270 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T17:45:29.286 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 173 kB/s) 2024-09-12T17:45:29.291 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T17:45:29.309 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 96 kB/s) 2024-09-12T17:45:29.310 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T17:45:29.326 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 204 kB/s) 2024-09-12T17:45:29.329 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T17:45:29.346 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.3 MB/s) 2024-09-12T17:45:29.350 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T17:45:29.365 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 422 kB/s) 2024-09-12T17:45:29.369 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T17:45:29.386 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 848 kB/s) 2024-09-12T17:45:29.391 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T17:45:29.407 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 185 kB/s) 2024-09-12T17:45:29.410 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T17:45:29.426 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 453 kB/s) 2024-09-12T17:45:29.430 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T17:45:29.446 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 525 kB/s) 2024-09-12T17:45:29.451 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T17:45:29.468 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 115 kB/s) 2024-09-12T17:45:29.474 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T17:45:29.491 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 131 kB/s) 2024-09-12T17:45:29.500 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T17:45:29.516 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 189 kB/s) 2024-09-12T17:45:29.524 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T17:45:29.542 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 831 kB/s) 2024-09-12T17:45:29.546 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T17:45:29.562 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 906 kB/s) 2024-09-12T17:45:29.570 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T17:45:29.587 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 840 kB/s) 2024-09-12T17:45:29.590 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T17:45:29.606 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 299 kB/s) 2024-09-12T17:45:29.612 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T17:45:29.628 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 392 kB/s) 2024-09-12T17:45:29.633 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T17:45:29.650 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/32 kB Progress (1): 32/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.9 MB/s) 2024-09-12T17:45:29.659 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T17:45:29.676 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.0 MB/s) 2024-09-12T17:45:29.679 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T17:45:29.696 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 871 kB/s) 2024-09-12T17:45:29.705 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T17:45:29.721 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 47 kB/s) 2024-09-12T17:45:29.724 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T17:45:29.740 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 320 kB/s) 2024-09-12T17:45:29.745 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T17:45:29.762 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 465 kB/s) 2024-09-12T17:45:29.768 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T17:45:29.785 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 176 kB/s) 2024-09-12T17:45:29.791 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T17:45:29.807 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 266 kB/s) 2024-09-12T17:45:29.815 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T17:45:29.831 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 121 kB/s) 2024-09-12T17:45:29.839 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T17:45:29.856 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 183 kB/s) 2024-09-12T17:45:29.864 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T17:45:29.880 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 684 kB/s) 2024-09-12T17:45:29.884 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T17:45:29.901 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 793 kB/s) 2024-09-12T17:45:29.905 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T17:45:29.921 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-12T17:45:29.927 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T17:45:29.943 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 23 kB/s) 2024-09-12T17:45:29.947 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T17:45:29.963 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 381 kB/s) 2024-09-12T17:45:29.966 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T17:45:29.982 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 458 kB/s) 2024-09-12T17:45:29.986 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T17:45:30.003 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 302 kB/s) 2024-09-12T17:45:30.010 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T17:45:30.028 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 406 kB/s) 2024-09-12T17:45:30.035 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T17:45:30.052 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.3 MB/s) 2024-09-12T17:45:30.057 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T17:45:30.076 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.1 MB/s) 2024-09-12T17:45:30.088 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T17:45:30.105 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.4 MB/s) 2024-09-12T17:45:30.114 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T17:45:30.130 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 353 kB/s) 2024-09-12T17:45:30.135 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T17:45:30.151 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 267 kB/s) 2024-09-12T17:45:30.156 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T17:45:30.172 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 200 kB/s) 2024-09-12T17:45:30.175 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T17:45:30.192 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.6 MB/s) 2024-09-12T17:45:30.199 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T17:45:30.215 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 148 kB/s) 2024-09-12T17:45:30.232 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T17:45:30.262 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 115/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 164/308 kB Progress (1): 180/308 kB Progress (1): 197/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 246/308 kB Progress (1): 256/308 kB Progress (1): 272/308 kB Progress (1): 289/308 kB Progress (1): 305/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 10 MB/s) 2024-09-12T17:45:30.263 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T17:45:30.263 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T17:45:30.263 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T17:45:30.264 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T17:45:30.264 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T17:45:30.285 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/171 kB Progress (2): 16/171 kB | 8.2 kB Progress (3): 16/171 kB | 8.2 kB | 14 kB Progress (3): 33/171 kB | 8.2 kB | 14 kB Progress (4): 33/171 kB | 8.2 kB | 14 kB | 16/118 kB Progress (4): 49/171 kB | 8.2 kB | 14 kB | 16/118 kB Progress (5): 49/171 kB | 8.2 kB | 14 kB | 16/118 kB | 16/26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 481 kB/s) 2024-09-12T17:45:30.285 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T17:45:30.285 INFO:tasks.workunit.client.0.smithi098.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 755 kB/s) 2024-09-12T17:45:30.286 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (3): 49/171 kB | 33/118 kB | 16/26 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T17:45:30.286 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (3): 49/171 kB | 33/118 kB | 26 kB Progress (3): 66/171 kB | 33/118 kB | 26 kB Progress (3): 66/171 kB | 49/118 kB | 26 kB Progress (3): 82/171 kB | 49/118 kB | 26 kB Progress (3): 98/171 kB | 49/118 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.4 MB/s) 2024-09-12T17:45:30.286 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 98/171 kB | 66/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T17:45:30.286 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 115/171 kB | 66/118 kB Progress (2): 115/171 kB | 82/118 kB Progress (2): 131/171 kB | 82/118 kB Progress (2): 131/171 kB | 98/118 kB Progress (2): 147/171 kB | 98/118 kB Progress (2): 147/171 kB | 115/118 kB Progress (2): 164/171 kB | 115/118 kB Progress (2): 164/171 kB | 118 kB Progress (2): 171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 5.3 MB/s) 2024-09-12T17:45:30.286 INFO:tasks.workunit.client.0.smithi098.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 7.4 MB/s) 2024-09-12T17:45:30.286 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T17:45:30.286 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T17:45:30.298 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/146 kB Progress (2): 16/146 kB | 16/136 kB Progress (2): 33/146 kB | 16/136 kB Progress (3): 33/146 kB | 16/136 kB | 16/61 kB Progress (3): 33/146 kB | 33/136 kB | 16/61 kB Progress (3): 33/146 kB | 33/136 kB | 33/61 kB Progress (3): 49/146 kB | 33/136 kB | 33/61 kB Progress (3): 49/146 kB | 49/136 kB | 33/61 kB Progress (3): 49/146 kB | 49/136 kB | 49/61 kB Progress (3): 65/146 kB | 49/136 kB | 49/61 kB Progress (3): 65/146 kB | 49/136 kB | 61 kB Progress (3): 65/146 kB | 62/136 kB | 61 kB Progress (3): 81/146 kB | 62/136 kB | 61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.8 MB/s) 2024-09-12T17:45:30.299 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 81/146 kB | 78/136 kB Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T17:45:30.300 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (3): 81/146 kB | 78/136 kB | 16/58 kB Progress (3): 98/146 kB | 78/136 kB | 16/58 kB Progress (3): 98/146 kB | 95/136 kB | 16/58 kB Progress (3): 98/146 kB | 95/136 kB | 33/58 kB Progress (3): 114/146 kB | 95/136 kB | 33/58 kB Progress (3): 114/146 kB | 95/136 kB | 49/58 kB Progress (3): 114/146 kB | 111/136 kB | 49/58 kB Progress (3): 114/146 kB | 111/136 kB | 58 kB Progress (3): 131/146 kB | 111/136 kB | 58 kB Progress (3): 131/146 kB | 128/136 kB | 58 kB Progress (3): 146 kB | 128/136 kB | 58 kB Progress (3): 146 kB | 136 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.6 MB/s) 2024-09-12T17:45:30.300 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T17:45:30.301 INFO:tasks.workunit.client.0.smithi098.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 3.9 MB/s) 2024-09-12T17:45:30.301 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 136 kB | 16/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.7 MB/s) 2024-09-12T17:45:30.311 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 33/501 kB Progress (1): 49/501 kB Progress (1): 66/501 kB Progress (1): 82/501 kB Progress (1): 98/501 kB Progress (1): 115/501 kB Progress (1): 131/501 kB Progress (1): 147/501 kB Progress (1): 164/501 kB Progress (1): 180/501 kB Progress (1): 197/501 kB Progress (1): 213/501 kB Progress (1): 229/501 kB Progress (1): 246/501 kB Progress (1): 256/501 kB Progress (1): 272/501 kB Progress (1): 289/501 kB Progress (1): 305/501 kB Progress (1): 321/501 kB Progress (1): 338/501 kB Progress (1): 354/501 kB Progress (1): 370/501 kB Progress (1): 387/501 kB Progress (1): 403/501 kB Progress (1): 420/501 kB Progress (1): 436/501 kB Progress (1): 452/501 kB Progress (1): 469/501 kB Progress (1): 485/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 11 MB/s) 2024-09-12T17:45:30.314 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.5 MB/s) 2024-09-12T17:45:30.373 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 23 MB/s) 2024-09-12T17:45:30.484 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] 2024-09-12T17:45:30.484 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T17:45:30.487 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T17:45:30.502 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 299 kB/s) 2024-09-12T17:45:30.504 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T17:45:30.518 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-12T17:45:30.519 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T17:45:30.535 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-12T17:45:30.537 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T17:45:30.551 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.5 MB/s) 2024-09-12T17:45:30.554 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T17:45:30.568 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 345 kB/s) 2024-09-12T17:45:30.571 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T17:45:30.585 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 261 kB/s) 2024-09-12T17:45:30.589 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T17:45:30.603 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-12T17:45:30.606 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T17:45:30.620 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 417 kB/s) 2024-09-12T17:45:30.623 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T17:45:30.638 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.3 MB/s) 2024-09-12T17:45:30.641 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T17:45:30.656 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-12T17:45:30.658 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T17:45:30.673 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-12T17:45:30.675 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T17:45:30.691 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 514 kB/s) 2024-09-12T17:45:30.694 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T17:45:30.710 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.6 MB/s) 2024-09-12T17:45:30.719 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T17:45:30.736 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.1 MB/s) 2024-09-12T17:45:30.737 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T17:45:30.737 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T17:45:30.737 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T17:45:30.738 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T17:45:30.738 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T17:45:30.755 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/211 kB Progress (2): 16/211 kB | 16/79 kB Progress (3): 16/211 kB | 16/79 kB | 0/1.0 MB Progress (4): 16/211 kB | 16/79 kB | 0/1.0 MB | 16/26 kB Progress (4): 33/211 kB | 16/79 kB | 0/1.0 MB | 16/26 kB Progress (4): 33/211 kB | 33/79 kB | 0/1.0 MB | 16/26 kB Progress (4): 33/211 kB | 33/79 kB | 0/1.0 MB | 16/26 kB Progress (4): 33/211 kB | 33/79 kB | 0/1.0 MB | 26 kB Progress (4): 49/211 kB | 33/79 kB | 0/1.0 MB | 26 kB Progress (4): 49/211 kB | 49/79 kB | 0/1.0 MB | 26 kB Progress (5): 49/211 kB | 49/79 kB | 0/1.0 MB | 26 kB | 16/58 kB Progress (5): 49/211 kB | 49/79 kB | 0/1.0 MB | 26 kB | 16/58 kB Progress (5): 62/211 kB | 49/79 kB | 0/1.0 MB | 26 kB | 16/58 kB Progress (5): 62/211 kB | 66/79 kB | 0/1.0 MB | 26 kB | 16/58 kB Progress (5): 62/211 kB | 66/79 kB | 0/1.0 MB | 26 kB | 33/58 kB Progress (5): 62/211 kB | 66/79 kB | 0.1/1.0 MB | 26 kB | 33/58 kB Progress (5): 78/211 kB | 66/79 kB | 0.1/1.0 MB | 26 kB | 33/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.5 MB/s) 2024-09-12T17:45:30.756 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (4): 78/211 kB | 79 kB | 0.1/1.0 MB | 33/58 kB Progress (4): 78/211 kB | 79 kB | 0.1/1.0 MB | 49/58 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T17:45:30.756 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (4): 78/211 kB | 79 kB | 0.1/1.0 MB | 49/58 kB Progress (4): 95/211 kB | 79 kB | 0.1/1.0 MB | 49/58 kB Progress (4): 95/211 kB | 79 kB | 0.1/1.0 MB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.4 MB/s) 2024-09-12T17:45:30.756 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (3): 95/211 kB | 0.1/1.0 MB | 58 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T17:45:30.756 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (3): 111/211 kB | 0.1/1.0 MB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.4 MB/s) 2024-09-12T17:45:30.758 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 111/211 kB | 0.1/1.0 MB Progress (2): 128/211 kB | 0.1/1.0 MB Progress (2): 128/211 kB | 0.1/1.0 MB Progress (2): 144/211 kB | 0.1/1.0 MB Progress (2): 144/211 kB | 0.1/1.0 MB Progress (2): 160/211 kB | 0.1/1.0 MB Progress (2): 160/211 kB | 0.2/1.0 MB Progress (2): 177/211 kB | 0.2/1.0 MB Progress (2): 177/211 kB | 0.2/1.0 MB Progress (2): 193/211 kB | 0.2/1.0 MB Progress (2): 193/211 kB | 0.2/1.0 MB Progress (2): 209/211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 10 MB/s) 2024-09-12T17:45:30.773 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (2): 0.8/1.0 MB | 16/116 kB Progress (3): 0.8/1.0 MB | 16/116 kB | 16/267 kB Progress (3): 0.9/1.0 MB | 16/116 kB | 16/267 kB Progress (3): 0.9/1.0 MB | 32/116 kB | 16/267 kB Progress (3): 0.9/1.0 MB | 32/116 kB | 33/267 kB Progress (3): 0.9/1.0 MB | 32/116 kB | 33/267 kB Progress (3): 0.9/1.0 MB | 49/116 kB | 33/267 kB Progress (3): 0.9/1.0 MB | 49/116 kB | 33/267 kB Progress (3): 0.9/1.0 MB | 49/116 kB | 49/267 kB Progress (3): 0.9/1.0 MB | 49/116 kB | 49/267 kB Progress (3): 0.9/1.0 MB | 65/116 kB | 49/267 kB Progress (3): 0.9/1.0 MB | 65/116 kB | 63/267 kB Progress (3): 0.9/1.0 MB | 65/116 kB | 63/267 kB Progress (3): 0.9/1.0 MB | 81/116 kB | 63/267 kB Progress (3): 0.9/1.0 MB | 81/116 kB | 80/267 kB Progress (3): 0.9/1.0 MB | 81/116 kB | 80/267 kB Progress (3): 0.9/1.0 MB | 98/116 kB | 80/267 kB Progress (3): 0.9/1.0 MB | 98/116 kB | 96/267 kB Progress (3): 0.9/1.0 MB | 98/116 kB | 96/267 kB Progress (3): 1.0/1.0 MB | 98/116 kB | 96/267 kB Progress (3): 1.0/1.0 MB | 114/116 kB | 96/267 kB Progress (3): 1.0/1.0 MB | 114/116 kB | 112/267 kB Progress (3): 1.0/1.0 MB | 116 kB | 112/267 kB Progress (3): 1.0/1.0 MB | 116 kB | 112/267 kB Progress (3): 1.0/1.0 MB | 116 kB | 129/267 kB Progress (3): 1.0/1.0 MB | 116 kB | 129/267 kB Progress (3): 1.0/1.0 MB | 116 kB | 145/267 kB Progress (3): 1.0/1.0 MB | 116 kB | 145/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.4 MB/s) 2024-09-12T17:45:30.773 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 1.0 MB | 145/267 kB Progress (2): 1.0 MB | 162/267 kB Progress (2): 1.0 MB | 178/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 28 MB/s) 2024-09-12T17:45:30.774 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 194/267 kB Progress (1): 211/267 kB Progress (1): 227/267 kB Progress (1): 244/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.4 MB/s) 2024-09-12T17:45:30.984 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T17:45:31.016 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:45:31.016 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:45:31.017 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:45:31.017 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] Total time: 7.599 s 2024-09-12T17:45:31.017 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] Finished at: 2024-09-12T17:45:31Z 2024-09-12T17:45:31.017 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:45:31.047 INFO:tasks.workunit.client.0.smithi098.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T17:45:31.053 INFO:tasks.workunit.client.0.smithi098.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T17:45:32.166 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] Scanning for projects... 2024-09-12T17:45:32.245 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] 2024-09-12T17:45:32.245 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T17:45:32.245 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] Building jcksum 1.0 2024-09-12T17:45:32.245 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] from pom.xml 2024-09-12T17:45:32.245 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T17:45:32.515 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] 2024-09-12T17:45:32.515 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T17:45:32.671 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T17:45:32.671 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] 2024-09-12T17:45:32.672 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T17:45:32.786 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:45:32.787 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] 2024-09-12T17:45:32.787 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T17:45:32.788 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T17:45:32.789 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] 2024-09-12T17:45:32.789 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T17:45:32.793 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T17:45:32.793 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] 2024-09-12T17:45:32.793 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T17:45:33.001 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T17:45:33.277 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T17:45:33.474 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 23 kB/s) 2024-09-12T17:45:33.482 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T17:45:33.500 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 137 kB/s) 2024-09-12T17:45:33.507 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T17:45:33.525 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 156 kB/s) 2024-09-12T17:45:33.529 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T17:45:33.546 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 189 kB/s) 2024-09-12T17:45:33.549 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T17:45:33.565 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 188 kB/s) 2024-09-12T17:45:33.567 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T17:45:33.583 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-12T17:45:33.586 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T17:45:33.603 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 157 kB/s) 2024-09-12T17:45:33.608 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T17:45:33.631 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 17/27 kB Progress (1): 19/27 kB Progress (1): 20/27 kB Progress (1): 21/27 kB Progress (1): 23/27 kB Progress (1): 24/27 kB Progress (1): 25/27 kB Progress (1): 27/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.2 MB/s) 2024-09-12T17:45:33.632 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T17:45:33.632 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T17:45:33.634 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T17:45:33.639 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T17:45:33.640 INFO:tasks.workunit.client.0.smithi098.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T17:45:33.680 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 16/169 kB Progress (1): 33/169 kB Progress (1): 49/169 kB Progress (1): 66/169 kB Progress (1): 82/169 kB Progress (1): 98/169 kB Progress (1): 115/169 kB Progress (1): 131/169 kB Progress (1): 147/169 kB Progress (1): 164/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 3.5 MB/s) 2024-09-12T17:45:33.699 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 1.4/189 kB Progress (2): 1.4/189 kB | 1.4/7.7 kB Progress (3): 1.4/189 kB | 1.4/7.7 kB | 1.4/18 kB Progress (3): 2.8/189 kB | 1.4/7.7 kB | 1.4/18 kB Progress (3): 2.8/189 kB | 1.4/7.7 kB | 2.8/18 kB Progress (3): 2.8/189 kB | 2.8/7.7 kB | 2.8/18 kB Progress (4): 2.8/189 kB | 2.8/7.7 kB | 2.8/18 kB | 16/103 kB Progress (4): 2.8/189 kB | 2.8/7.7 kB | 4.1/18 kB | 16/103 kB Progress (4): 4.1/189 kB | 2.8/7.7 kB | 4.1/18 kB | 16/103 kB Progress (4): 4.1/189 kB | 2.8/7.7 kB | 5.5/18 kB | 16/103 kB Progress (4): 4.1/189 kB | 4.1/7.7 kB | 5.5/18 kB | 16/103 kB Progress (4): 4.1/189 kB | 4.1/7.7 kB | 6.9/18 kB | 16/103 kB Progress (4): 4.1/189 kB | 5.5/7.7 kB | 6.9/18 kB | 16/103 kB Progress (4): 5.5/189 kB | 5.5/7.7 kB | 6.9/18 kB | 16/103 kB Progress (4): 5.5/189 kB | 6.9/7.7 kB | 6.9/18 kB | 16/103 kB Progress (4): 6.9/189 kB | 6.9/7.7 kB | 6.9/18 kB | 16/103 kB Progress (4): 6.9/189 kB | 6.9/7.7 kB | 6.9/18 kB | 33/103 kB Progress (4): 6.9/189 kB | 6.9/7.7 kB | 8.3/18 kB | 33/103 kB Progress (4): 8.3/189 kB | 6.9/7.7 kB | 8.3/18 kB | 33/103 kB Progress (4): 8.3/189 kB | 7.7 kB | 8.3/18 kB | 33/103 kB Progress (4): 9.7/189 kB | 7.7 kB | 8.3/18 kB | 33/103 kB Progress (4): 9.7/189 kB | 7.7 kB | 9.7/18 kB | 33/103 kB Progress (4): 11/189 kB | 7.7 kB | 9.7/18 kB | 33/103 kB Progress (4): 11/189 kB | 7.7 kB | 11/18 kB | 33/103 kB Progress (4): 12/189 kB | 7.7 kB | 11/18 kB | 33/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 118 kB/s) 2024-09-12T17:45:33.702 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (3): 14/189 kB | 11/18 kB | 33/103 kB Progress (3): 14/189 kB | 12/18 kB | 33/103 kB Progress (3): 15/189 kB | 12/18 kB | 33/103 kB Progress (3): 15/189 kB | 14/18 kB | 33/103 kB Progress (3): 17/189 kB | 14/18 kB | 33/103 kB Progress (3): 17/189 kB | 15/18 kB | 33/103 kB Progress (3): 18/189 kB | 15/18 kB | 33/103 kB Progress (3): 18/189 kB | 16/18 kB | 33/103 kB Progress (3): 19/189 kB | 16/18 kB | 33/103 kB Progress (3): 19/189 kB | 17/18 kB | 33/103 kB Progress (3): 21/189 kB | 17/18 kB | 33/103 kB Progress (3): 21/189 kB | 18 kB | 33/103 kB Progress (3): 22/189 kB | 18 kB | 33/103 kB Progress (3): 23/189 kB | 18 kB | 33/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 244 kB/s) 2024-09-12T17:45:33.718 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (2): 25/189 kB | 33/103 kB Progress (2): 26/189 kB | 33/103 kB Progress (2): 28/189 kB | 33/103 kB Progress (2): 28/189 kB | 49/103 kB Progress (2): 29/189 kB | 49/103 kB Progress (2): 30/189 kB | 49/103 kB Progress (2): 32/189 kB | 49/103 kB Progress (2): 33/189 kB | 49/103 kB Progress (2): 33/189 kB | 66/103 kB Progress (2): 34/189 kB | 66/103 kB Progress (2): 36/189 kB | 66/103 kB Progress (2): 37/189 kB | 66/103 kB Progress (2): 39/189 kB | 66/103 kB Progress (2): 40/189 kB | 66/103 kB Progress (2): 40/189 kB | 82/103 kB Progress (2): 41/189 kB | 82/103 kB Progress (2): 43/189 kB | 82/103 kB Progress (2): 44/189 kB | 82/103 kB Progress (2): 46/189 kB | 82/103 kB Progress (2): 47/189 kB | 82/103 kB Progress (2): 48/189 kB | 82/103 kB Progress (2): 50/189 kB | 82/103 kB Progress (2): 51/189 kB | 82/103 kB Progress (2): 52/189 kB | 82/103 kB Progress (2): 54/189 kB | 82/103 kB Progress (2): 55/189 kB | 82/103 kB Progress (2): 57/189 kB | 82/103 kB Progress (2): 58/189 kB | 82/103 kB Progress (2): 59/189 kB | 82/103 kB Progress (2): 61/189 kB | 82/103 kB Progress (2): 62/189 kB | 82/103 kB Progress (2): 63/189 kB | 82/103 kB Progress (2): 63/189 kB | 98/103 kB Progress (2): 63/189 kB | 103 kB Progress (2): 80/189 kB | 103 kB Progress (2): 96/189 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.3 MB/s) 2024-09-12T17:45:33.729 INFO:tasks.workunit.client.0.smithi098.stdout:Progress (1): 113/189 kB Progress (1): 129/189 kB Progress (1): 145/189 kB Progress (1): 162/189 kB Progress (1): 178/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.0 MB/s) 2024-09-12T17:45:33.744 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] 2024-09-12T17:45:33.744 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:45:33.744 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] T E S T S 2024-09-12T17:45:33.744 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] ------------------------------------------------------- 2024-09-12T17:45:34.320 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T17:45:34.376 INFO:tasks.workunit.client.0.smithi098.stdout:PutObjects.java: starting test run: 2024-09-12T17:45:34.377 INFO:tasks.workunit.client.0.smithi098.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T17:45:34.377 INFO:tasks.workunit.client.0.smithi098.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T17:45:34.377 INFO:tasks.workunit.client.0.smithi098.stdout: EndpointUrl=https://smithi098.front.sepia.ceph.com:443 2024-09-12T17:45:34.473 INFO:tasks.workunit.client.0.smithi098.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T17:45:34.573 INFO:tasks.workunit.client.0.smithi098.stdout:DEBUG: Environment Variables Read 2024-09-12T17:45:34.875 INFO:tasks.workunit.client.0.smithi098.stdout:DEBUG: S3 Client Initialized 2024-09-12T17:45:34.875 INFO:tasks.workunit.client.0.smithi098.stdout:DEBUG: Generating File 2024-09-12T17:45:34.875 INFO:tasks.workunit.client.0.smithi098.stdout:DEBUG: File Generated 2024-09-12T17:45:34.875 INFO:tasks.workunit.client.0.smithi098.stdout:DEBUG: Generating File 2024-09-12T17:45:34.875 INFO:tasks.workunit.client.0.smithi098.stdout:DEBUG: File Generated 2024-09-12T17:45:34.875 INFO:tasks.workunit.client.0.smithi098.stdout:DEBUG: Generating File 2024-09-12T17:45:34.875 INFO:tasks.workunit.client.0.smithi098.stdout:DEBUG: File Generated 2024-09-12T17:45:34.875 INFO:tasks.workunit.client.0.smithi098.stdout:DEBUG: Generating File 2024-09-12T17:45:34.875 INFO:tasks.workunit.client.0.smithi098.stdout:DEBUG: File Generated 2024-09-12T17:45:34.875 INFO:tasks.workunit.client.0.smithi098.stdout:DEBUG: Generating File 2024-09-12T17:45:34.875 INFO:tasks.workunit.client.0.smithi098.stdout:DEBUG: File Generated 2024-09-12T17:45:34.876 INFO:tasks.workunit.client.0.smithi098.stdout:DEBUG: Generating File 2024-09-12T17:45:34.876 INFO:tasks.workunit.client.0.smithi098.stdout:DEBUG: File Generated 2024-09-12T17:45:34.876 INFO:tasks.workunit.client.0.smithi098.stdout:DEBUG: Generated Big Files 2024-09-12T17:45:35.575 INFO:tasks.workunit.client.0.smithi098.stdout:HeadBucketResponse() 2024-09-12T17:45:35.576 INFO:tasks.workunit.client.0.smithi098.stdout:sheik is ready 2024-09-12T17:45:35.576 INFO:tasks.workunit.client.0.smithi098.stdout:DEBUG: Test Bucket Created 2024-09-12T17:45:35.675 INFO:tasks.workunit.client.0.smithi098.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T17:45:35.976 INFO:tasks.workunit.client.0.smithi098.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T17:45:36.377 INFO:tasks.workunit.client.0.smithi098.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T17:45:36.578 INFO:tasks.workunit.client.0.smithi098.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T17:45:37.079 INFO:tasks.workunit.client.0.smithi098.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T17:45:37.480 INFO:tasks.workunit.client.0.smithi098.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T17:45:37.981 INFO:tasks.workunit.client.0.smithi098.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T17:45:38.482 INFO:tasks.workunit.client.0.smithi098.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T17:45:39.384 INFO:tasks.workunit.client.0.smithi098.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T17:45:40.286 INFO:tasks.workunit.client.0.smithi098.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T17:45:45.798 INFO:tasks.workunit.client.0.smithi098.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T17:45:52.711 INFO:tasks.workunit.client.0.smithi098.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T17:47:14.580 INFO:tasks.workunit.client.0.smithi098.stdout:arg: file-0b 2024-09-12T17:47:14.581 INFO:tasks.workunit.client.0.smithi098.stdout:arg: file-8b 2024-09-12T17:47:14.582 INFO:tasks.workunit.client.0.smithi098.stdout:arg: file-200b 2024-09-12T17:47:14.583 INFO:tasks.workunit.client.0.smithi098.stdout:arg: file-21983b 2024-09-12T17:47:14.584 INFO:tasks.workunit.client.0.smithi098.stdout:arg: file-5519b 2024-09-12T17:47:14.585 INFO:tasks.workunit.client.0.smithi098.stdout:arg: file-204329b 2024-09-12T17:47:14.586 INFO:tasks.workunit.client.0.smithi098.stdout:arg: file-256k 2024-09-12T17:47:14.587 INFO:tasks.workunit.client.0.smithi098.stdout:arg: file-1m 2024-09-12T17:47:14.588 INFO:tasks.workunit.client.0.smithi098.stdout:arg: file-1038757b 2024-09-12T17:47:14.621 INFO:tasks.workunit.client.0.smithi098.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T17:47:14.898 INFO:tasks.workunit.client.0.smithi098.stdout:PutObjectResponse 2024-09-12T17:47:14.921 INFO:tasks.workunit.client.0.smithi098.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T17:47:15.121 INFO:tasks.workunit.client.0.smithi098.stdout:PutObjectResponse 2024-09-12T17:47:15.222 INFO:tasks.workunit.client.0.smithi098.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T17:47:15.322 INFO:tasks.workunit.client.0.smithi098.stdout:PutObjectResponse 2024-09-12T17:47:15.522 INFO:tasks.workunit.client.0.smithi098.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T17:47:15.622 INFO:tasks.workunit.client.0.smithi098.stdout:PutObjectResponse 2024-09-12T17:47:15.823 INFO:tasks.workunit.client.0.smithi098.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T17:47:15.923 INFO:tasks.workunit.client.0.smithi098.stdout:PutObjectResponse 2024-09-12T17:47:16.123 INFO:tasks.workunit.client.0.smithi098.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T17:47:16.423 INFO:tasks.workunit.client.0.smithi098.stdout:PutObjectResponse 2024-09-12T17:47:16.624 INFO:tasks.workunit.client.0.smithi098.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T17:47:16.924 INFO:tasks.workunit.client.0.smithi098.stdout:PutObjectResponse 2024-09-12T17:47:17.125 INFO:tasks.workunit.client.0.smithi098.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T17:47:18.226 INFO:tasks.workunit.client.0.smithi098.stdout:PutObjectResponse 2024-09-12T17:47:18.429 INFO:tasks.workunit.client.0.smithi098.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T17:47:19.327 INFO:tasks.workunit.client.0.smithi098.stdout:PutObjectResponse 2024-09-12T17:47:19.628 INFO:tasks.workunit.client.0.smithi098.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T17:47:24.434 INFO:tasks.workunit.client.0.smithi098.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T17:47:35.447 INFO:tasks.workunit.client.0.smithi098.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T17:49:01.857 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 207.5 s -- in io.ceph.jcksum.PutObjects 2024-09-12T17:49:01.890 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] 2024-09-12T17:49:01.890 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] Results: 2024-09-12T17:49:01.890 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] 2024-09-12T17:49:01.890 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T17:49:01.891 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] 2024-09-12T17:49:01.892 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:49:01.892 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] BUILD SUCCESS 2024-09-12T17:49:01.893 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:49:01.893 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] Total time: 03:29 min 2024-09-12T17:49:01.894 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] Finished at: 2024-09-12T17:49:01Z 2024-09-12T17:49:01.894 INFO:tasks.workunit.client.0.smithi098.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T17:49:01.917 INFO:tasks.workunit.client.0.smithi098.stderr:+ exit 2024-09-12T17:49:01.917 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:49:01.917 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:49:01.967 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T17:49:01.967 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:49:02.341 DEBUG:teuthology.parallel:result is None 2024-09-12T17:49:02.342 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:49:02.354 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:49:02.355 DEBUG:teuthology.orchestra.run.smithi098:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:49:02.402 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:49:02.402 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:49:02.416 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:49:02.417 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:49:02.417 DEBUG:teuthology.orchestra.run.smithi098:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:49:02.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:49:02.451 INFO:teuthology.orchestra.run.smithi098.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:49:02.451 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:49:02.499 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:49:02.499 DEBUG:teuthology.orchestra.run.smithi098:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:49:02.547 INFO:tasks.workunit:timeout=3h 2024-09-12T17:49:02.547 INFO:tasks.workunit:cleanup=True 2024-09-12T17:49:02.547 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:49:02.597 INFO:tasks.workunit.client.0.smithi098.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:49:59.578 INFO:tasks.workunit.client.0.smithi098.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:49:59.578 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:49:59.578 INFO:tasks.workunit.client.0.smithi098.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:49:59.578 INFO:tasks.workunit.client.0.smithi098.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:49:59.578 INFO:tasks.workunit.client.0.smithi098.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:49:59.579 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:49:59.579 INFO:tasks.workunit.client.0.smithi098.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:49:59.579 INFO:tasks.workunit.client.0.smithi098.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:49:59.579 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:49:59.579 INFO:tasks.workunit.client.0.smithi098.stderr: git switch -c 2024-09-12T17:49:59.579 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:49:59.579 INFO:tasks.workunit.client.0.smithi098.stderr:Or undo this operation with: 2024-09-12T17:49:59.579 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:49:59.579 INFO:tasks.workunit.client.0.smithi098.stderr: git switch - 2024-09-12T17:49:59.579 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:49:59.579 INFO:tasks.workunit.client.0.smithi098.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:49:59.579 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:49:59.579 INFO:tasks.workunit.client.0.smithi098.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:49:59.585 DEBUG:teuthology.orchestra.run.smithi098:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:49:59.632 INFO:tasks.workunit.client.0.smithi098.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:49:59.635 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:49:59.635 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:49:59.691 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:49:59.745 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:49:59.786 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:49:59.787 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:49:59.787 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:49:59.831 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:49:59.835 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:49:59.835 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:49:59.883 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T17:49:59.884 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T17:49:59.884 DEBUG:teuthology.orchestra.run.smithi098:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T17:49:59.938 INFO:tasks.workunit.client.0.smithi098.stdout:INFO: fully qualified domain name: smithi098.front.sepia.ceph.com 2024-09-12T17:49:59.939 INFO:tasks.workunit.client.0.smithi098.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T17:49:59.939 INFO:tasks.workunit.client.0.smithi098.stdout:== TESTING NON-VERSIONED BUCKET == 2024-09-12T17:50:03.145 INFO:tasks.workunit.client.0.smithi098.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T17:50:03.359 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting pip 2024-09-12T17:50:03.364 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:50:03.401 INFO:tasks.workunit.client.0.smithi098.stdout:Installing collected packages: pip 2024-09-12T17:50:03.401 INFO:tasks.workunit.client.0.smithi098.stdout: Attempting uninstall: pip 2024-09-12T17:50:03.401 INFO:tasks.workunit.client.0.smithi098.stdout: Found existing installation: pip 22.0.2 2024-09-12T17:50:03.659 INFO:tasks.workunit.client.0.smithi098.stdout: Uninstalling pip-22.0.2: 2024-09-12T17:50:03.665 INFO:tasks.workunit.client.0.smithi098.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T17:50:04.388 INFO:tasks.workunit.client.0.smithi098.stdout:Successfully installed pip-24.2 2024-09-12T17:50:05.367 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting boto3 2024-09-12T17:50:05.368 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:50:05.940 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:50:05.941 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:50:05.988 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:50:05.989 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:50:06.034 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:50:06.036 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:50:06.091 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:50:06.093 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:50:06.199 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:50:06.200 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T17:50:06.442 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:50:06.443 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:50:06.446 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:50:06.448 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:50:06.457 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:50:06.458 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:50:06.459 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:50:06.461 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T17:50:06.462 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:50:06.529 INFO:tasks.workunit.client.0.smithi098.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:50:07.657 INFO:tasks.workunit.client.0.smithi098.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T17:50:08.257 INFO:tasks.workunit.client.0.smithi098.stdout:INFO: creating user 2024-09-12T17:50:08.407 INFO:tasks.workunit.client.0.smithi098.stdout:{ 2024-09-12T17:50:08.407 INFO:tasks.workunit.client.0.smithi098.stdout: "user_id": "testid", 2024-09-12T17:50:08.407 INFO:tasks.workunit.client.0.smithi098.stdout: "display_name": "M. Tester", 2024-09-12T17:50:08.407 INFO:tasks.workunit.client.0.smithi098.stdout: "email": "tester@ceph.com", 2024-09-12T17:50:08.407 INFO:tasks.workunit.client.0.smithi098.stdout: "suspended": 0, 2024-09-12T17:50:08.407 INFO:tasks.workunit.client.0.smithi098.stdout: "max_buckets": 1000, 2024-09-12T17:50:08.407 INFO:tasks.workunit.client.0.smithi098.stdout: "subusers": [], 2024-09-12T17:50:08.407 INFO:tasks.workunit.client.0.smithi098.stdout: "keys": [ 2024-09-12T17:50:08.408 INFO:tasks.workunit.client.0.smithi098.stdout: { 2024-09-12T17:50:08.408 INFO:tasks.workunit.client.0.smithi098.stdout: "user": "testid", 2024-09-12T17:50:08.408 INFO:tasks.workunit.client.0.smithi098.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T17:50:08.408 INFO:tasks.workunit.client.0.smithi098.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T17:50:08.408 INFO:tasks.workunit.client.0.smithi098.stdout: "active": true, 2024-09-12T17:50:08.408 INFO:tasks.workunit.client.0.smithi098.stdout: "create_date": "2024-09-12T17:50:08.394698Z" 2024-09-12T17:50:08.408 INFO:tasks.workunit.client.0.smithi098.stdout: } 2024-09-12T17:50:08.408 INFO:tasks.workunit.client.0.smithi098.stdout: ], 2024-09-12T17:50:08.408 INFO:tasks.workunit.client.0.smithi098.stdout: "swift_keys": [], 2024-09-12T17:50:08.408 INFO:tasks.workunit.client.0.smithi098.stdout: "caps": [], 2024-09-12T17:50:08.408 INFO:tasks.workunit.client.0.smithi098.stdout: "op_mask": "read, write, delete", 2024-09-12T17:50:08.408 INFO:tasks.workunit.client.0.smithi098.stdout: "default_placement": "", 2024-09-12T17:50:08.408 INFO:tasks.workunit.client.0.smithi098.stdout: "default_storage_class": "", 2024-09-12T17:50:08.409 INFO:tasks.workunit.client.0.smithi098.stdout: "placement_tags": [], 2024-09-12T17:50:08.409 INFO:tasks.workunit.client.0.smithi098.stdout: "bucket_quota": { 2024-09-12T17:50:08.409 INFO:tasks.workunit.client.0.smithi098.stdout: "enabled": false, 2024-09-12T17:50:08.409 INFO:tasks.workunit.client.0.smithi098.stdout: "check_on_raw": false, 2024-09-12T17:50:08.409 INFO:tasks.workunit.client.0.smithi098.stdout: "max_size": -1, 2024-09-12T17:50:08.409 INFO:tasks.workunit.client.0.smithi098.stdout: "max_size_kb": 0, 2024-09-12T17:50:08.409 INFO:tasks.workunit.client.0.smithi098.stdout: "max_objects": -1 2024-09-12T17:50:08.409 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:50:08.409 INFO:tasks.workunit.client.0.smithi098.stdout: "user_quota": { 2024-09-12T17:50:08.410 INFO:tasks.workunit.client.0.smithi098.stdout: "enabled": false, 2024-09-12T17:50:08.410 INFO:tasks.workunit.client.0.smithi098.stdout: "check_on_raw": false, 2024-09-12T17:50:08.410 INFO:tasks.workunit.client.0.smithi098.stdout: "max_size": -1, 2024-09-12T17:50:08.410 INFO:tasks.workunit.client.0.smithi098.stdout: "max_size_kb": 0, 2024-09-12T17:50:08.410 INFO:tasks.workunit.client.0.smithi098.stdout: "max_objects": -1 2024-09-12T17:50:08.410 INFO:tasks.workunit.client.0.smithi098.stdout: }, 2024-09-12T17:50:08.411 INFO:tasks.workunit.client.0.smithi098.stdout: "temp_url_keys": [], 2024-09-12T17:50:08.411 INFO:tasks.workunit.client.0.smithi098.stdout: "type": "rgw", 2024-09-12T17:50:08.411 INFO:tasks.workunit.client.0.smithi098.stdout: "mfa_ids": [], 2024-09-12T17:50:08.411 INFO:tasks.workunit.client.0.smithi098.stdout: "account_id": "", 2024-09-12T17:50:08.411 INFO:tasks.workunit.client.0.smithi098.stdout: "path": "/", 2024-09-12T17:50:08.411 INFO:tasks.workunit.client.0.smithi098.stdout: "create_date": "2024-09-12T17:50:08.394684Z", 2024-09-12T17:50:08.411 INFO:tasks.workunit.client.0.smithi098.stdout: "tags": [], 2024-09-12T17:50:08.411 INFO:tasks.workunit.client.0.smithi098.stdout: "group_ids": [] 2024-09-12T17:50:08.411 INFO:tasks.workunit.client.0.smithi098.stdout:} 2024-09-12T17:50:08.411 INFO:tasks.workunit.client.0.smithi098.stdout: 2024-09-12T17:50:11.837 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi098.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:50:11.837 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:50:11.999 INFO:tasks.workunit.client.0.smithi098.stderr:5+0 records in 2024-09-12T17:50:11.999 INFO:tasks.workunit.client.0.smithi098.stderr:5+0 records out 2024-09-12T17:50:11.999 INFO:tasks.workunit.client.0.smithi098.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0204939 s, 256 MB/s 2024-09-12T17:50:12.005 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi098.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:50:12.005 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:50:12.124 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi098.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:50:12.124 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:50:14.212 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi098.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:50:14.212 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:50:16.327 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi098.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:50:16.327 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:50:18.539 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi098.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:50:18.539 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:50:20.649 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi098.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:50:20.649 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:50:22.796 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi098.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:50:22.796 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:50:24.912 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi098.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:50:24.912 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:50:27.064 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi098.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:50:27.065 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:50:29.212 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi098.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:50:29.213 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:50:31.540 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi098.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:50:31.540 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:50:33.949 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi098.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:50:33.949 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:50:36.294 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi098.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:50:36.295 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:50:38.670 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi098.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:50:38.671 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:50:40.993 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi098.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:50:40.994 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:50:41.198 INFO:tasks.workunit.client.0.smithi098.stdout:bucket nams is reupload-bkt-118387 2024-09-12T17:50:41.198 INFO:tasks.workunit.client.0.smithi098.stdout:endpoint is https://smithi098.front.sepia.ceph.com:443 2024-09-12T17:50:41.198 INFO:tasks.workunit.client.0.smithi098.stdout:start UploadId=2~Gmu7weTb5yXTjzPBMod25CyotDbv64x 2024-09-12T17:50:41.198 INFO:tasks.workunit.client.0.smithi098.stdout:phase 1 uploaded part {'ETag': '"fb26e1c0420c1468b739f3c89de98175"', 'PartNumber': 1} 2024-09-12T17:50:41.198 INFO:tasks.workunit.client.0.smithi098.stdout:phase 1 uploaded part {'ETag': '"fb26e1c0420c1468b739f3c89de98175"', 'PartNumber': 2} 2024-09-12T17:50:41.198 INFO:tasks.workunit.client.0.smithi098.stdout:phase 2 uploaded part {'ETag': '"fb26e1c0420c1468b739f3c89de98175"', 'PartNumber': 1} 2024-09-12T17:50:41.198 INFO:tasks.workunit.client.0.smithi098.stdout:phase 2 uploaded part {'ETag': '"fb26e1c0420c1468b739f3c89de98175"', 'PartNumber': 1} 2024-09-12T17:50:41.198 INFO:tasks.workunit.client.0.smithi098.stdout:phase 2 uploaded part {'ETag': '"fb26e1c0420c1468b739f3c89de98175"', 'PartNumber': 1} 2024-09-12T17:50:41.199 INFO:tasks.workunit.client.0.smithi098.stdout:phase 2 uploaded part {'ETag': '"fb26e1c0420c1468b739f3c89de98175"', 'PartNumber': 1} 2024-09-12T17:50:41.199 INFO:tasks.workunit.client.0.smithi098.stdout:phase 2 uploaded part {'ETag': '"fb26e1c0420c1468b739f3c89de98175"', 'PartNumber': 1} 2024-09-12T17:50:41.199 INFO:tasks.workunit.client.0.smithi098.stdout:phase 2 uploaded part {'ETag': '"fb26e1c0420c1468b739f3c89de98175"', 'PartNumber': 1} 2024-09-12T17:50:41.199 INFO:tasks.workunit.client.0.smithi098.stdout:phase 2 uploaded part {'ETag': '"fb26e1c0420c1468b739f3c89de98175"', 'PartNumber': 1} 2024-09-12T17:50:41.199 INFO:tasks.workunit.client.0.smithi098.stdout:phase 2 uploaded part {'ETag': '"fb26e1c0420c1468b739f3c89de98175"', 'PartNumber': 1} 2024-09-12T17:50:41.199 INFO:tasks.workunit.client.0.smithi098.stdout:phase 2 uploaded part {'ETag': '"fb26e1c0420c1468b739f3c89de98175"', 'PartNumber': 1} 2024-09-12T17:50:41.199 INFO:tasks.workunit.client.0.smithi098.stdout:phase 2 uploaded part {'ETag': '"fb26e1c0420c1468b739f3c89de98175"', 'PartNumber': 1} 2024-09-12T17:50:41.199 INFO:tasks.workunit.client.0.smithi098.stdout:phase 2 uploaded part {'ETag': '"fb26e1c0420c1468b739f3c89de98175"', 'PartNumber': 1} 2024-09-12T17:50:41.199 INFO:tasks.workunit.client.0.smithi098.stdout:aborting multipart upload, parts=[{'ETag': '"fb26e1c0420c1468b739f3c89de98175"', 'PartNumber': 1}, {'ETag': '"fb26e1c0420c1468b739f3c89de98175"', 'PartNumber': 2}] 2024-09-12T17:50:42.764 INFO:tasks.workunit.client.0.smithi098.stdout:radosgw-admin bucket radoslist: 2024-09-12T17:50:42.853 INFO:tasks.workunit.client.0.smithi098.stdout:rados ls: 2024-09-12T17:50:42.866 INFO:tasks.workunit.client.0.smithi098.stdout:== PASSED == 2024-09-12T17:50:42.866 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:50:42.867 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:50:42.924 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T17:50:42.925 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:50:43.352 DEBUG:teuthology.parallel:result is None 2024-09-12T17:50:43.352 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:50:43.363 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:50:43.363 DEBUG:teuthology.orchestra.run.smithi098:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:50:43.409 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:50:43.410 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T17:50:43.423 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T17:50:43.423 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T17:50:43.423 INFO:tasks.ragweed:Using branch 'wip-rgw-meta-handlers' for ragweed 2024-09-12T17:50:43.423 DEBUG:teuthology.orchestra.run.smithi098:> git clone -b wip-rgw-meta-handlers https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:50:43.457 INFO:teuthology.orchestra.run.smithi098.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:50:43.512 INFO:teuthology.orchestra.run.smithi098.stderr:fatal: Remote branch wip-rgw-meta-handlers not found in upstream origin 2024-09-12T17:50:43.513 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-12T17:50:43.514 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-12T17:50:43.514 DEBUG:teuthology.orchestra.run.smithi098:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:50:43.562 INFO:teuthology.orchestra.run.smithi098.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T17:50:43.741 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T17:50:43.741 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T17:50:43.741 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key YHRSGAUAVLOOIMVQOFHZ --secret 7wQZn1nYRqliavw+IZUDVJJkrCxBZMxPmPy77yczwUGBWFN8OHLu5Q== --email ragweed.client.0+test@test.test --system false 2024-09-12T17:50:43.828 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:43.829 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:43.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.865+0000 7f6061b679c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:43.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.869+0000 7f6061b679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:43.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.869+0000 7f6061b679c0 20 realm 2024-09-12T17:50:43.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.869+0000 7f6061b679c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:43.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.869+0000 7f6061b679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:43.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.869+0000 7f6061b679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:43.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.869+0000 7f6061b679c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:43.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.869+0000 7f6061b679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:43.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.869+0000 7f6061b679c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:43.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.869+0000 7f6061b679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:43.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.869+0000 7f6061b679c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:43.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.869+0000 7f6061b679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:43.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.869+0000 7f6061b679c0 20 searching for the correct realm 2024-09-12T17:50:43.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.877+0000 7f605ee6c640 0 -- 172.21.15.98:0/3158734099 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55a52bfd2380 msgr2=0x55a52bfd47d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:43.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.881+0000 7f605ee6c640 0 -- 172.21.15.98:0/3158734099 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f6058065040 msgr2=0x7f605807f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:50:43.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.889+0000 7f6061b679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:43.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.889+0000 7f6061b679c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:50:43.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.889+0000 7f6061b679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:43.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.889+0000 7f6061b679c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:50:43.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.889+0000 7f6061b679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:43.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.889+0000 7f6061b679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:43.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.889+0000 7f6061b679c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:43.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.893+0000 7f6061b679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:43.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.893+0000 7f6061b679c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:43.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.893+0000 7f6061b679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:43.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.893+0000 7f6061b679c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:43.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.893+0000 7f6061b679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:43.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.893+0000 7f6061b679c0 20 zone default found 2024-09-12T17:50:43.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.893+0000 7f6061b679c0 4 Realm: () 2024-09-12T17:50:43.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.893+0000 7f6061b679c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:50:43.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.893+0000 7f6061b679c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:50:43.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.893+0000 7f6061b679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:43.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.893+0000 7f6061b679c0 20 zonegroup default 2024-09-12T17:50:43.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.893+0000 7f6061b679c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:43.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.893+0000 7f6061b679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:43.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.893+0000 7f6061b679c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:43.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.893+0000 7f6061b679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:43.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.893+0000 7f6061b679c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:43.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.893+0000 7f6061b679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:43.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.893+0000 7f6061b679c0 20 started sync module instance, tier type = 2024-09-12T17:50:43.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.893+0000 7f6061b679c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:50:43.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.909+0000 7f6061b679c0 20 add_watcher() i=0 2024-09-12T17:50:43.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.909+0000 7f6061b679c0 20 add_watcher() i=1 2024-09-12T17:50:43.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.909+0000 7f6061b679c0 20 add_watcher() i=2 2024-09-12T17:50:43.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.909+0000 7f6061b679c0 20 add_watcher() i=3 2024-09-12T17:50:43.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.909+0000 7f6061b679c0 20 add_watcher() i=4 2024-09-12T17:50:43.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.909+0000 7f6061b679c0 20 add_watcher() i=5 2024-09-12T17:50:43.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.909+0000 7f6061b679c0 20 add_watcher() i=6 2024-09-12T17:50:43.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.909+0000 7f6061b679c0 20 add_watcher() i=7 2024-09-12T17:50:43.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.909+0000 7f6061b679c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:43.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.913+0000 7f5f167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:43.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.913+0000 7f6061b679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:43.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.913+0000 7f6061b679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:43.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.913+0000 7f6061b679c0 5 note: GC not initialized 2024-09-12T17:50:43.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.913+0000 7f5f157e2640 20 reqs_thread_entry: start 2024-09-12T17:50:43.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.913+0000 7f6061b679c0 20 init_complete bucket index max shards: 11 2024-09-12T17:50:43.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.913+0000 7f6061b679c0 20 Filter name: none 2024-09-12T17:50:43.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.913+0000 7f5f0e7fc640 20 reqs_thread_entry: start 2024-09-12T17:50:43.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.913+0000 7f6061b679c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T17:50:43.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.913+0000 7f6061b679c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:43.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.913+0000 7f6061b679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:43.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.913+0000 7f6061b679c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T17:50:43.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.913+0000 7f6061b679c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:50:43.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.913+0000 7f6061b679c0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T17:50:43.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.913+0000 7f6061b679c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:43.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.917+0000 7f6061b679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:43.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.917+0000 7f6061b679c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T17:50:43.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.917+0000 7f6061b679c0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:50:43.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.917+0000 7f6061b679c0 10 cache get: name=default.rgw.meta+users.keys+YHRSGAUAVLOOIMVQOFHZ : miss 2024-09-12T17:50:43.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.917+0000 7f6061b679c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:43.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.917+0000 7f6061b679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:43.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.917+0000 7f6061b679c0 10 cache put: name=default.rgw.meta+users.keys+YHRSGAUAVLOOIMVQOFHZ info.flags=0x0 2024-09-12T17:50:43.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.917+0000 7f6061b679c0 10 adding default.rgw.meta+users.keys+YHRSGAUAVLOOIMVQOFHZ to cache LRU end 2024-09-12T17:50:43.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.917+0000 7f6061b679c0 10 cache get: name=default.rgw.meta+users.keys+YHRSGAUAVLOOIMVQOFHZ : hit (negative entry) 2024-09-12T17:50:43.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.917+0000 7f6061b679c0 10 cache get: name=default.rgw.meta+users.keys+YHRSGAUAVLOOIMVQOFHZ : hit (negative entry) 2024-09-12T17:50:43.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.921+0000 7f6061b679c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:50:43.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.921+0000 7f6061b679c0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:50:43.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.921+0000 7f6061b679c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T17:50:43.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.921+0000 7f5f42ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627798 cookie 94167896038560 notifier 5970 bl.length()=675 2024-09-12T17:50:43.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.921+0000 7f5f42ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T17:50:43.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.921+0000 7f5f42ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:50:43.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.925+0000 7f6061b679c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:50:43.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.925+0000 7f6061b679c0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:50:43.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.925+0000 7f6061b679c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T17:50:43.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.925+0000 7f5f42ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627790 cookie 94167896034304 notifier 5970 bl.length()=202 2024-09-12T17:50:43.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.925+0000 7f5f42ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T17:50:43.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.925+0000 7f5f42ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T17:50:43.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.933+0000 7f6061b679c0 10 cache put: name=default.rgw.meta+users.keys+YHRSGAUAVLOOIMVQOFHZ info.flags=0x7 2024-09-12T17:50:43.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.933+0000 7f6061b679c0 10 moving default.rgw.meta+users.keys+YHRSGAUAVLOOIMVQOFHZ to cache LRU end 2024-09-12T17:50:43.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.933+0000 7f6061b679c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:YHRSGAUAVLOOIMVQOFHZ, ofs0, ns] 2024-09-12T17:50:43.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.933+0000 7f5f42ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627790 cookie 94167896025072 notifier 5970 bl.length()=190 2024-09-12T17:50:43.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.933+0000 7f5f42ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YHRSGAUAVLOOIMVQOFHZ info.flags=0x7 2024-09-12T17:50:43.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.933+0000 7f5f42ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YHRSGAUAVLOOIMVQOFHZ to cache LRU end 2024-09-12T17:50:43.936 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T17:50:43.936 INFO:teuthology.orchestra.run.smithi098.stdout: "user_id": "ragweed.client.0", 2024-09-12T17:50:43.936 INFO:teuthology.orchestra.run.smithi098.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T17:50:43.936 INFO:teuthology.orchestra.run.smithi098.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T17:50:43.936 INFO:teuthology.orchestra.run.smithi098.stdout: "suspended": 0, 2024-09-12T17:50:43.936 INFO:teuthology.orchestra.run.smithi098.stdout: "max_buckets": 1000, 2024-09-12T17:50:43.936 INFO:teuthology.orchestra.run.smithi098.stdout: "subusers": [], 2024-09-12T17:50:43.936 INFO:teuthology.orchestra.run.smithi098.stdout: "keys": [ 2024-09-12T17:50:43.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-12T17:50:43.936 INFO:teuthology.orchestra.run.smithi098.stdout: "user": "ragweed.client.0", 2024-09-12T17:50:43.937 INFO:teuthology.orchestra.run.smithi098.stdout: "access_key": "YHRSGAUAVLOOIMVQOFHZ", 2024-09-12T17:50:43.937 INFO:teuthology.orchestra.run.smithi098.stdout: "secret_key": "7wQZn1nYRqliavw+IZUDVJJkrCxBZMxPmPy77yczwUGBWFN8OHLu5Q==", 2024-09-12T17:50:43.937 INFO:teuthology.orchestra.run.smithi098.stdout: "active": true, 2024-09-12T17:50:43.937 INFO:teuthology.orchestra.run.smithi098.stdout: "create_date": "2024-09-12T17:50:43.921232Z" 2024-09-12T17:50:43.937 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-12T17:50:43.937 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-12T17:50:43.937 INFO:teuthology.orchestra.run.smithi098.stdout: "swift_keys": [], 2024-09-12T17:50:43.937 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": [], 2024-09-12T17:50:43.937 INFO:teuthology.orchestra.run.smithi098.stdout: "op_mask": "read, write, delete", 2024-09-12T17:50:43.937 INFO:teuthology.orchestra.run.smithi098.stdout: "default_placement": "", 2024-09-12T17:50:43.937 INFO:teuthology.orchestra.run.smithi098.stdout: "default_storage_class": "", 2024-09-12T17:50:43.937 INFO:teuthology.orchestra.run.smithi098.stdout: "placement_tags": [], 2024-09-12T17:50:43.937 INFO:teuthology.orchestra.run.smithi098.stdout: "bucket_quota": { 2024-09-12T17:50:43.937 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T17:50:43.938 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T17:50:43.938 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T17:50:43.938 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T17:50:43.938 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T17:50:43.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T17:50:43.938 INFO:teuthology.orchestra.run.smithi098.stdout: "user_quota": { 2024-09-12T17:50:43.938 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T17:50:43.938 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T17:50:43.938 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T17:50:43.938 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T17:50:43.938 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T17:50:43.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T17:50:43.938 INFO:teuthology.orchestra.run.smithi098.stdout: "temp_url_keys": [], 2024-09-12T17:50:43.938 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "rgw", 2024-09-12T17:50:43.938 INFO:teuthology.orchestra.run.smithi098.stdout: "mfa_ids": [], 2024-09-12T17:50:43.939 INFO:teuthology.orchestra.run.smithi098.stdout: "account_id": "", 2024-09-12T17:50:43.939 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/", 2024-09-12T17:50:43.939 INFO:teuthology.orchestra.run.smithi098.stdout: "create_date": "2024-09-12T17:50:43.921217Z", 2024-09-12T17:50:43.939 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-12T17:50:43.939 INFO:teuthology.orchestra.run.smithi098.stdout: "group_ids": [] 2024-09-12T17:50:43.939 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T17:50:43.939 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:50:43.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.933+0000 7f5f167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:43.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.937+0000 7f6061b679c0 20 remove_watcher() i=0 2024-09-12T17:50:43.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.937+0000 7f6061b679c0 2 removed watcher, disabling cache 2024-09-12T17:50:43.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.941+0000 7f6061b679c0 20 remove_watcher() i=1 2024-09-12T17:50:43.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.945+0000 7f6061b679c0 20 remove_watcher() i=2 2024-09-12T17:50:43.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.945+0000 7f6061b679c0 20 remove_watcher() i=3 2024-09-12T17:50:43.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.949+0000 7f6061b679c0 20 remove_watcher() i=4 2024-09-12T17:50:43.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.949+0000 7f6061b679c0 20 remove_watcher() i=5 2024-09-12T17:50:43.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.949+0000 7f6061b679c0 20 remove_watcher() i=6 2024-09-12T17:50:43.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:43.949+0000 7f6061b679c0 20 remove_watcher() i=7 2024-09-12T17:50:43.969 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T17:50:43.969 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key IDWKJKUJGIIKDOAQGWCF --secret tJSC3SuvueEqGNb5lZLA8Ry3J3fukHMdU4YRZCnpefPX9wWN/Yy3nw== --email sysuser.client.0+test@test.test --system true 2024-09-12T17:50:44.011 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:50:44.011 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:50:44.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.049+0000 7fa126e629c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:44.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.049+0000 7fa126e629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:44.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.049+0000 7fa126e629c0 20 realm 2024-09-12T17:50:44.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.049+0000 7fa126e629c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:44.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.049+0000 7fa126e629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:44.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.049+0000 7fa126e629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:50:44.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.049+0000 7fa126e629c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:44.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.049+0000 7fa126e629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:44.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.049+0000 7fa126e629c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:44.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.049+0000 7fa126e629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:44.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.049+0000 7fa126e629c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:44.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.053+0000 7fa126e629c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:50:44.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.053+0000 7fa126e629c0 20 searching for the correct realm 2024-09-12T17:50:44.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.057+0000 7fa125169640 0 -- 172.21.15.98:0/3305950473 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7fa118089130 msgr2=0x7fa118090860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:50:44.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.065+0000 7fa124968640 0 -- 172.21.15.98:0/3305950473 >> [v2:172.21.15.98:6816/1225764258,v1:172.21.15.98:6817/1225764258] conn(0x7fa11c039070 msgr2=0x7fa11c060e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:50:44.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.069+0000 7fa126e629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:50:44.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.069+0000 7fa126e629c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:50:44.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.069+0000 7fa126e629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:50:44.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.069+0000 7fa126e629c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:50:44.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.069+0000 7fa126e629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:50:44.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.069+0000 7fa126e629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:50:44.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.069+0000 7fa126e629c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:44.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.069+0000 7fa126e629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:44.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.069+0000 7fa126e629c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:44.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.069+0000 7fa126e629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:50:44.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.069+0000 7fa126e629c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.073+0000 7fa126e629c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:50:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.073+0000 7fa126e629c0 20 zone default found 2024-09-12T17:50:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.073+0000 7fa126e629c0 4 Realm: () 2024-09-12T17:50:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.073+0000 7fa126e629c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:50:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.073+0000 7fa126e629c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:50:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.073+0000 7fa126e629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:50:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.073+0000 7fa126e629c0 20 zonegroup default 2024-09-12T17:50:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.073+0000 7fa126e629c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.073+0000 7fa126e629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:44.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.073+0000 7fa126e629c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:44.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.073+0000 7fa126e629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:44.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.073+0000 7fa126e629c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:44.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.073+0000 7fa126e629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:44.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.073+0000 7fa126e629c0 20 started sync module instance, tier type = 2024-09-12T17:50:44.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.073+0000 7fa126e629c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:50:44.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.089+0000 7fa126e629c0 20 add_watcher() i=0 2024-09-12T17:50:44.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.089+0000 7fa126e629c0 20 add_watcher() i=1 2024-09-12T17:50:44.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.089+0000 7fa126e629c0 20 add_watcher() i=2 2024-09-12T17:50:44.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.089+0000 7fa126e629c0 20 add_watcher() i=3 2024-09-12T17:50:44.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.089+0000 7fa126e629c0 20 add_watcher() i=4 2024-09-12T17:50:44.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.089+0000 7fa126e629c0 20 add_watcher() i=5 2024-09-12T17:50:44.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.089+0000 7fa126e629c0 20 add_watcher() i=6 2024-09-12T17:50:44.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.089+0000 7fa126e629c0 20 add_watcher() i=7 2024-09-12T17:50:44.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.089+0000 7fa126e629c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:50:44.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7f9fdafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:44.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:50:44.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:50:44.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 5 note: GC not initialized 2024-09-12T17:50:44.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7f9fd9fe3640 20 reqs_thread_entry: start 2024-09-12T17:50:44.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 20 init_complete bucket index max shards: 11 2024-09-12T17:50:44.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 20 Filter name: none 2024-09-12T17:50:44.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7f9f4b7fe640 20 reqs_thread_entry: start 2024-09-12T17:50:44.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T17:50:44.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:44.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:44.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T17:50:44.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:50:44.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T17:50:44.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:44.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:44.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T17:50:44.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:50:44.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 10 cache get: name=default.rgw.meta+users.keys+IDWKJKUJGIIKDOAQGWCF : miss 2024-09-12T17:50:44.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 20 rados->read ofs=0 len=0 2024-09-12T17:50:44.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:50:44.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 10 cache put: name=default.rgw.meta+users.keys+IDWKJKUJGIIKDOAQGWCF info.flags=0x0 2024-09-12T17:50:44.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 10 adding default.rgw.meta+users.keys+IDWKJKUJGIIKDOAQGWCF to cache LRU end 2024-09-12T17:50:44.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 10 cache get: name=default.rgw.meta+users.keys+IDWKJKUJGIIKDOAQGWCF : hit (negative entry) 2024-09-12T17:50:44.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.093+0000 7fa126e629c0 10 cache get: name=default.rgw.meta+users.keys+IDWKJKUJGIIKDOAQGWCF : hit (negative entry) 2024-09-12T17:50:44.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.097+0000 7fa126e629c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:50:44.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.097+0000 7fa126e629c0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:50:44.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.097+0000 7fa126e629c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T17:50:44.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.097+0000 7f9ffbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627791 cookie 94328436113792 notifier 5988 bl.length()=675 2024-09-12T17:50:44.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.097+0000 7f9ffbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T17:50:44.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.097+0000 7f9ffbfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:50:44.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.101+0000 7fa126e629c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:50:44.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.101+0000 7fa126e629c0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:50:44.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.101+0000 7fa126e629c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T17:50:44.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.101+0000 7f9ffbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627799 cookie 94328436102960 notifier 5988 bl.length()=202 2024-09-12T17:50:44.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.101+0000 7f9ffbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T17:50:44.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.101+0000 7f9ffbfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T17:50:44.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.105+0000 7fa126e629c0 10 cache put: name=default.rgw.meta+users.keys+IDWKJKUJGIIKDOAQGWCF info.flags=0x7 2024-09-12T17:50:44.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.105+0000 7fa126e629c0 10 moving default.rgw.meta+users.keys+IDWKJKUJGIIKDOAQGWCF to cache LRU end 2024-09-12T17:50:44.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.105+0000 7fa126e629c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:IDWKJKUJGIIKDOAQGWCF, ofs0, ns] 2024-09-12T17:50:44.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.105+0000 7f9ffb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627788 cookie 94328436121456 notifier 5988 bl.length()=190 2024-09-12T17:50:44.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.105+0000 7f9ffb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+IDWKJKUJGIIKDOAQGWCF info.flags=0x7 2024-09-12T17:50:44.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.105+0000 7f9ffb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+IDWKJKUJGIIKDOAQGWCF to cache LRU end 2024-09-12T17:50:44.111 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T17:50:44.111 INFO:teuthology.orchestra.run.smithi098.stdout: "user_id": "sysuser.client.0", 2024-09-12T17:50:44.111 INFO:teuthology.orchestra.run.smithi098.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T17:50:44.111 INFO:teuthology.orchestra.run.smithi098.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T17:50:44.111 INFO:teuthology.orchestra.run.smithi098.stdout: "suspended": 0, 2024-09-12T17:50:44.111 INFO:teuthology.orchestra.run.smithi098.stdout: "max_buckets": 1000, 2024-09-12T17:50:44.111 INFO:teuthology.orchestra.run.smithi098.stdout: "subusers": [], 2024-09-12T17:50:44.111 INFO:teuthology.orchestra.run.smithi098.stdout: "keys": [ 2024-09-12T17:50:44.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-12T17:50:44.111 INFO:teuthology.orchestra.run.smithi098.stdout: "user": "sysuser.client.0", 2024-09-12T17:50:44.111 INFO:teuthology.orchestra.run.smithi098.stdout: "access_key": "IDWKJKUJGIIKDOAQGWCF", 2024-09-12T17:50:44.111 INFO:teuthology.orchestra.run.smithi098.stdout: "secret_key": "tJSC3SuvueEqGNb5lZLA8Ry3J3fukHMdU4YRZCnpefPX9wWN/Yy3nw==", 2024-09-12T17:50:44.111 INFO:teuthology.orchestra.run.smithi098.stdout: "active": true, 2024-09-12T17:50:44.111 INFO:teuthology.orchestra.run.smithi098.stdout: "create_date": "2024-09-12T17:50:44.098830Z" 2024-09-12T17:50:44.112 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-12T17:50:44.112 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-12T17:50:44.112 INFO:teuthology.orchestra.run.smithi098.stdout: "swift_keys": [], 2024-09-12T17:50:44.112 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": [], 2024-09-12T17:50:44.112 INFO:teuthology.orchestra.run.smithi098.stdout: "op_mask": "read, write, delete", 2024-09-12T17:50:44.112 INFO:teuthology.orchestra.run.smithi098.stdout: "system": true, 2024-09-12T17:50:44.112 INFO:teuthology.orchestra.run.smithi098.stdout: "default_placement": "", 2024-09-12T17:50:44.112 INFO:teuthology.orchestra.run.smithi098.stdout: "default_storage_class": "", 2024-09-12T17:50:44.112 INFO:teuthology.orchestra.run.smithi098.stdout: "placement_tags": [], 2024-09-12T17:50:44.112 INFO:teuthology.orchestra.run.smithi098.stdout: "bucket_quota": { 2024-09-12T17:50:44.112 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T17:50:44.112 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T17:50:44.112 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T17:50:44.112 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T17:50:44.113 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T17:50:44.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T17:50:44.113 INFO:teuthology.orchestra.run.smithi098.stdout: "user_quota": { 2024-09-12T17:50:44.113 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T17:50:44.113 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T17:50:44.113 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T17:50:44.113 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T17:50:44.113 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T17:50:44.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T17:50:44.113 INFO:teuthology.orchestra.run.smithi098.stdout: "temp_url_keys": [], 2024-09-12T17:50:44.113 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "rgw", 2024-09-12T17:50:44.113 INFO:teuthology.orchestra.run.smithi098.stdout: "mfa_ids": [], 2024-09-12T17:50:44.113 INFO:teuthology.orchestra.run.smithi098.stdout: "account_id": "", 2024-09-12T17:50:44.114 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/", 2024-09-12T17:50:44.114 INFO:teuthology.orchestra.run.smithi098.stdout: "create_date": "2024-09-12T17:50:44.098807Z", 2024-09-12T17:50:44.114 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-12T17:50:44.114 INFO:teuthology.orchestra.run.smithi098.stdout: "group_ids": [] 2024-09-12T17:50:44.114 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T17:50:44.114 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:50:44.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.109+0000 7f9fdafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:50:44.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.113+0000 7fa126e629c0 20 remove_watcher() i=0 2024-09-12T17:50:44.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.113+0000 7fa126e629c0 2 removed watcher, disabling cache 2024-09-12T17:50:44.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.117+0000 7fa126e629c0 20 remove_watcher() i=1 2024-09-12T17:50:44.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.117+0000 7fa126e629c0 20 remove_watcher() i=2 2024-09-12T17:50:44.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.121+0000 7fa126e629c0 20 remove_watcher() i=3 2024-09-12T17:50:44.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.121+0000 7fa126e629c0 20 remove_watcher() i=4 2024-09-12T17:50:44.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.121+0000 7fa126e629c0 20 remove_watcher() i=5 2024-09-12T17:50:44.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.125+0000 7fa126e629c0 20 remove_watcher() i=6 2024-09-12T17:50:44.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:50:44.125+0000 7fa126e629c0 20 remove_watcher() i=7 2024-09-12T17:50:44.141 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T17:50:44.142 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:50:44.142 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T17:50:44.192 INFO:tasks.ragweed:Configuring boto... 2024-09-12T17:50:44.192 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:50:44.192 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T17:50:44.238 DEBUG:teuthology.orchestra.run.smithi098:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T17:50:44.431 INFO:teuthology.orchestra.run.smithi098.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T17:50:44.614 INFO:teuthology.orchestra.run.smithi098.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T17:50:45.219 INFO:teuthology.orchestra.run.smithi098.stdout:py installdeps: -rrequirements.txt 2024-09-12T17:50:47.874 INFO:teuthology.orchestra.run.smithi098.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T17:50:52.130 INFO:teuthology.orchestra.run.smithi098.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=931949e67fca897fe0e92408dd1ecced7397026cf4e64242a59f7228e31a16db,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-09-12T17:50:52.131 INFO:teuthology.orchestra.run.smithi098.stdout:py run-test-pre: PYTHONHASHSEED='112532321' 2024-09-12T17:50:52.131 INFO:teuthology.orchestra.run.smithi098.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T17:50:52.296 INFO:teuthology.orchestra.run.smithi098.stdout:============================= test session starts ============================== 2024-09-12T17:50:52.296 INFO:teuthology.orchestra.run.smithi098.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T17:50:52.296 INFO:teuthology.orchestra.run.smithi098.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T17:50:52.296 INFO:teuthology.orchestra.run.smithi098.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-09-12T17:50:52.455 INFO:teuthology.orchestra.run.smithi098.stdout:collecting ... collected 9 items 2024-09-12T17:50:52.455 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:51:03.699 INFO:teuthology.orchestra.run.smithi098.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T17:51:16.387 INFO:teuthology.orchestra.run.smithi098.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T17:51:26.360 INFO:teuthology.orchestra.run.smithi098.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T17:51:39.202 INFO:teuthology.orchestra.run.smithi098.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T17:51:51.268 INFO:teuthology.orchestra.run.smithi098.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T17:52:15.323 INFO:teuthology.orchestra.run.smithi098.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T17:52:38.843 INFO:teuthology.orchestra.run.smithi098.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T17:53:01.502 INFO:teuthology.orchestra.run.smithi098.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T17:53:44.975 INFO:teuthology.orchestra.run.smithi098.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T17:53:44.975 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:53:44.975 INFO:teuthology.orchestra.run.smithi098.stdout:=============================== warnings summary =============================== 2024-09-12T17:53:44.975 INFO:teuthology.orchestra.run.smithi098.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T17:53:44.975 INFO:teuthology.orchestra.run.smithi098.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T17:53:44.975 INFO:teuthology.orchestra.run.smithi098.stdout: import imp 2024-09-12T17:53:44.975 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T17:53:44.976 INFO:teuthology.orchestra.run.smithi098.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-09-12T17:53:44.976 INFO:teuthology.orchestra.run.smithi098.stdout:=================== 9 passed, 1 warning in 172.68s (0:02:52) =================== 2024-09-12T17:53:45.024 INFO:teuthology.orchestra.run.smithi098.stdout:___________________________________ summary ____________________________________ 2024-09-12T17:53:45.025 INFO:teuthology.orchestra.run.smithi098.stdout: py: commands succeeded 2024-09-12T17:53:45.025 INFO:teuthology.orchestra.run.smithi098.stdout: congratulations :) 2024-09-12T17:53:45.045 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T17:53:45.045 DEBUG:teuthology.orchestra.run.smithi098:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T17:53:45.051 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T17:53:45.128 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:45.128 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:45.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.167+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.167+0000 7f311eab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:45.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.167+0000 7f311eab09c0 20 realm 2024-09-12T17:53:45.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.167+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.167+0000 7f311eab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:45.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.167+0000 7f311eab09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:45.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.167+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.167+0000 7f311eab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:45.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.167+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.171+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:45.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.171+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.171+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:45.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.171+0000 7f311eab09c0 20 searching for the correct realm 2024-09-12T17:53:45.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.179+0000 7f311cdb7640 0 -- 172.21.15.98:0/3296046914 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f310404e040 msgr2=0x7f310401c940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:45.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.395+0000 7f311c5b6640 0 -- 172.21.15.98:0/3296046914 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x55cacd416690 msgr2=0x55cacd418b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:53:45.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.403+0000 7f311eab09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:45.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.403+0000 7f311eab09c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:53:45.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.403+0000 7f311eab09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:45.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.403+0000 7f311eab09c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:53:45.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.403+0000 7f311eab09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:45.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.403+0000 7f311eab09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:45.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.403+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.403+0000 7f311eab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:45.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.403+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.403+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:45.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.403+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.407+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:45.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.407+0000 7f311eab09c0 20 zone default found 2024-09-12T17:53:45.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.407+0000 7f311eab09c0 4 Realm: () 2024-09-12T17:53:45.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.407+0000 7f311eab09c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:53:45.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.407+0000 7f311eab09c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:53:45.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.407+0000 7f311eab09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:45.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.407+0000 7f311eab09c0 20 zonegroup default 2024-09-12T17:53:45.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.407+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.407+0000 7f311eab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:45.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.407+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.407+0000 7f311eab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:45.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.407+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.407+0000 7f311eab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:45.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.407+0000 7f311eab09c0 20 started sync module instance, tier type = 2024-09-12T17:53:45.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.407+0000 7f311eab09c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:53:45.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.431+0000 7f311eab09c0 20 add_watcher() i=0 2024-09-12T17:53:45.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.431+0000 7f311eab09c0 20 add_watcher() i=1 2024-09-12T17:53:45.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.431+0000 7f311eab09c0 20 add_watcher() i=2 2024-09-12T17:53:45.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.431+0000 7f311eab09c0 20 add_watcher() i=3 2024-09-12T17:53:45.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.431+0000 7f311eab09c0 20 add_watcher() i=4 2024-09-12T17:53:45.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.431+0000 7f311eab09c0 20 add_watcher() i=5 2024-09-12T17:53:45.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.431+0000 7f311eab09c0 20 add_watcher() i=6 2024-09-12T17:53:45.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.431+0000 7f311eab09c0 20 add_watcher() i=7 2024-09-12T17:53:45.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.431+0000 7f311eab09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:45.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.435+0000 7f2fd2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:45.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.435+0000 7f311eab09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:45.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.435+0000 7f311eab09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:45.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.531+0000 7f2fd1fdb640 20 reqs_thread_entry: start 2024-09-12T17:53:45.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.531+0000 7f311eab09c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:45.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.531+0000 7f311eab09c0 20 Filter name: none 2024-09-12T17:53:45.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.531+0000 7f2f437fe640 20 reqs_thread_entry: start 2024-09-12T17:53:45.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.531+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T17:53:45.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.531+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.535+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:53:45.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.535+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T17:53:45.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.535+0000 7f311eab09c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T17:53:45.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.535+0000 7f311eab09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:45.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.535+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:a01e4849-e968-46ce-97f1-a673c26b3735.4529.4 : miss 2024-09-12T17:53:45.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.535+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.535+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T17:53:45.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.535+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:a01e4849-e968-46ce-97f1-a673c26b3735.4529.4 info.flags=0x17 2024-09-12T17:53:45.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.535+0000 7f311eab09c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:a01e4849-e968-46ce-97f1-a673c26b3735.4529.4 to cache LRU end 2024-09-12T17:53:45.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.535+0000 7f311eab09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:45.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.535+0000 7f311eab09c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:45.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.535+0000 7f311eab09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:a01e4849-e968-46ce-97f1-a673c26b3735.4529.4 2024-09-12T17:53:45.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.539+0000 7f311eab09c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T17:53:45.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.539+0000 7f311eab09c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T17:53:45.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.539+0000 7f311eab09c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T17:53:45.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.539+0000 7f311eab09c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T17:53:45.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.539+0000 7f311eab09c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T17:53:45.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.539+0000 7f311eab09c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T17:53:45.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.539+0000 7f311eab09c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T17:53:45.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.543+0000 7f311eab09c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T17:53:45.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.543+0000 7f311eab09c0 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T17:53:45.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.543+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd242300 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55cacd4cca58 s->prefetch_data=0 2024-09-12T17:53:45.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.547+0000 7f311eab09c0 10 manifest: total_size = 7744 2024-09-12T17:53:45.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.547+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.11833545329352341966 2024-09-12T17:53:45.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.547+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd242300 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55cacd4cca58 s->prefetch_data=0 2024-09-12T17:53:45.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.547+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd4cca58 2024-09-12T17:53:45.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.547+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.4.1 2024-09-12T17:53:45.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.551+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.551+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=7744 stripe_ofs=7744 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.551+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.11833545329352341966 2024-09-12T17:53:45.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.551+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.551+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.4__shadow_.Un_PGwb_6YSl-d1cjUxRslW12c97tcy_0 2024-09-12T17:53:45.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.551+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:45.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.551+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.551+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.11833545329352341966 2024-09-12T17:53:45.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.555+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T17:53:45.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.555+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd242300 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55cacd454c38 s->prefetch_data=0 2024-09-12T17:53:45.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.555+0000 7f311eab09c0 10 manifest: total_size = 4896 2024-09-12T17:53:45.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.555+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.2998966436136903859 2024-09-12T17:53:45.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.555+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd242300 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55cacd454c38 s->prefetch_data=0 2024-09-12T17:53:45.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.555+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd454c38 2024-09-12T17:53:45.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.555+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.4.2 2024-09-12T17:53:45.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.563+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.563+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=4896 stripe_ofs=4896 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.563+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.2998966436136903859 2024-09-12T17:53:45.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.563+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.563+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.4__shadow_.6_HbPiSmOGOm9v1E7oFyhdav6wRS2S7_0 2024-09-12T17:53:45.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.563+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:53:45.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.563+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.563+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.2998966436136903859 2024-09-12T17:53:45.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.563+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T17:53:45.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.567+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd242300 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55cacd454c38 s->prefetch_data=0 2024-09-12T17:53:45.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.567+0000 7f311eab09c0 10 manifest: total_size = 5252 2024-09-12T17:53:45.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.567+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.11415282150812076584 2024-09-12T17:53:45.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.567+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd242300 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55cacd454c38 s->prefetch_data=0 2024-09-12T17:53:45.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.567+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd454c38 2024-09-12T17:53:45.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.567+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.4.2 2024-09-12T17:53:45.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.575+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.575+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=5252 stripe_ofs=5252 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.575+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.11415282150812076584 2024-09-12T17:53:45.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.575+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.575+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.4__shadow_.TLo-TIq3IqzbWehESA2ErrsAEG-Ezlu_0 2024-09-12T17:53:45.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.575+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:45.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.575+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.575+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.11415282150812076584 2024-09-12T17:53:45.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.575+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T17:53:45.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.575+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd4ce3a0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55cacd454c38 s->prefetch_data=0 2024-09-12T17:53:45.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.575+0000 7f311eab09c0 10 manifest: total_size = 5011 2024-09-12T17:53:45.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.575+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.11984111510339937189 2024-09-12T17:53:45.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.575+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd4ce3a0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55cacd454c38 s->prefetch_data=0 2024-09-12T17:53:45.578 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.575+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd454c38 2024-09-12T17:53:45.578 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.575+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.4.3 2024-09-12T17:53:45.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.579+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.579+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=5011 stripe_ofs=5011 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.579+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.11984111510339937189 2024-09-12T17:53:45.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.579+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.579+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.4__shadow_.DvEwQgMOKkpmVXTXzUqpYID00DwPDGG_0 2024-09-12T17:53:45.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.579+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:45.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.579+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.579+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.11984111510339937189 2024-09-12T17:53:45.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.583+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T17:53:45.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.583+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd459660 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55cacd454bc8 s->prefetch_data=0 2024-09-12T17:53:45.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.583+0000 7f311eab09c0 10 manifest: total_size = 7677 2024-09-12T17:53:45.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.583+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.16577060782736365732 2024-09-12T17:53:45.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.583+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd459660 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55cacd454bc8 s->prefetch_data=0 2024-09-12T17:53:45.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.583+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd454bc8 2024-09-12T17:53:45.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.583+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.4.4 2024-09-12T17:53:45.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.587+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.587+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=7677 stripe_ofs=7677 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.587+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16577060782736365732 2024-09-12T17:53:45.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.587+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.587+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.4__shadow_.eME5ZVwXO1X7z0hzKhnXH-kfeiOt7ck_0 2024-09-12T17:53:45.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.587+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:45.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.587+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.587+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16577060782736365732 2024-09-12T17:53:45.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.591+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T17:53:45.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.591+0000 7f311eab09c0 20 get_obj_state: octx=0x7f3104014e00 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55cacd454bc8 s->prefetch_data=0 2024-09-12T17:53:45.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.591+0000 7f311eab09c0 10 manifest: total_size = 7540 2024-09-12T17:53:45.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.591+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.10275951813108638432 2024-09-12T17:53:45.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.591+0000 7f311eab09c0 20 get_obj_state: octx=0x7f3104014e00 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55cacd454bc8 s->prefetch_data=0 2024-09-12T17:53:45.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.591+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd454bc8 2024-09-12T17:53:45.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.591+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.4.4 2024-09-12T17:53:45.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.595+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.595+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=7540 stripe_ofs=7540 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.595+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.10275951813108638432 2024-09-12T17:53:45.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.595+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.595+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.4__shadow_.VlIjrfSGEx5TUjum6i8feWDg9PJ9i4z_0 2024-09-12T17:53:45.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.595+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:45.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.595+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.595+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.10275951813108638432 2024-09-12T17:53:45.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.599+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T17:53:45.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.599+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd4ce360 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55cacd454bc8 s->prefetch_data=0 2024-09-12T17:53:45.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.599+0000 7f311eab09c0 10 manifest: total_size = 4909 2024-09-12T17:53:45.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.599+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.4990251547276362604 2024-09-12T17:53:45.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.599+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd4ce360 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55cacd454bc8 s->prefetch_data=0 2024-09-12T17:53:45.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.599+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd454bc8 2024-09-12T17:53:45.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.599+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.4.5 2024-09-12T17:53:45.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.607+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.607+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=4909 stripe_ofs=4909 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.607+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.4990251547276362604 2024-09-12T17:53:45.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.607+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.607+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.4__shadow_.S1G9eTpfxTM_M_uS11wg5I9ORkuVELi_0 2024-09-12T17:53:45.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.607+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:53:45.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.607+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.607+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.4990251547276362604 2024-09-12T17:53:45.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.611+0000 7f311eab09c0 20 get_obj_state: octx=0x7f3104014e00 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55cacd454bc8 s->prefetch_data=0 2024-09-12T17:53:45.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.611+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T17:53:45.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.611+0000 7f311eab09c0 10 manifest: total_size = 7904 2024-09-12T17:53:45.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.611+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.13262867404422745717 2024-09-12T17:53:45.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.611+0000 7f311eab09c0 20 get_obj_state: octx=0x7f3104014e00 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55cacd454bc8 s->prefetch_data=0 2024-09-12T17:53:45.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.611+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd454bc8 2024-09-12T17:53:45.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.611+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.4.7 2024-09-12T17:53:45.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.615+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.615+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=7904 stripe_ofs=7904 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.615+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.13262867404422745717 2024-09-12T17:53:45.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.615+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.615+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.4__shadow_.TQO8ahdoTL0vmXZeVXB6ie-AZE5ezG3_0 2024-09-12T17:53:45.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.615+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:45.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.615+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.615+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.13262867404422745717 2024-09-12T17:53:45.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.619+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0bddd0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55cacd454bc8 s->prefetch_data=0 2024-09-12T17:53:45.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.619+0000 7f311eab09c0 10 manifest: total_size = 38608 2024-09-12T17:53:45.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.619+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.2779729993939602240 2024-09-12T17:53:45.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.619+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0bddd0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55cacd454bc8 s->prefetch_data=0 2024-09-12T17:53:45.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.619+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd454bc8 2024-09-12T17:53:45.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.619+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.4.8 2024-09-12T17:53:45.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.619+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T17:53:45.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.623+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.623+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=38608 stripe_ofs=38608 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.623+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.2779729993939602240 2024-09-12T17:53:45.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.623+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.623+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.4__shadow_.XAPodn2gUNalOij2wJ4XAd5doc5FVhO_0 2024-09-12T17:53:45.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.623+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:53:45.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.623+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.623+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.2779729993939602240 2024-09-12T17:53:45.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.627+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T17:53:45.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.627+0000 7f311eab09c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:45.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.627+0000 7f311eab09c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:45.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.627+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:45.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.627+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:45.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.627+0000 7f311eab09c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:45.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.627+0000 7f311eab09c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:45.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.627+0000 7f311eab09c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[a01e4849-e968-46ce-97f1-a673c26b3735.4529.4])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:45.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.631+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T17:53:45.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.631+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.631+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T17:53:45.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.631+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T17:53:45.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.631+0000 7f311eab09c0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T17:53:45.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.635+0000 7f311eab09c0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T17:53:45.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.635+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T17:53:45.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.635+0000 7f2ff2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 94329515378448 notifier 5636 bl.length()=162 2024-09-12T17:53:45.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.639+0000 7f311eab09c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:a01e4849-e968-46ce-97f1-a673c26b3735.4529.4 from cache 2024-09-12T17:53:45.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.639+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:a01e4849-e968-46ce-97f1-a673c26b3735.4529.4, ofs0, ns] 2024-09-12T17:53:45.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.639+0000 7f2ff37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366176 cookie 94329515378448 notifier 5636 bl.length()=219 2024-09-12T17:53:45.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.651+0000 7f311eab09c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/a01e4849-e968-46ce-97f1-a673c26b3735.4529.4 : miss 2024-09-12T17:53:45.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.651+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.651+0000 7f311eab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:45.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.651+0000 7f311eab09c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/a01e4849-e968-46ce-97f1-a673c26b3735.4529.4 info.flags=0x0 2024-09-12T17:53:45.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.651+0000 7f311eab09c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/a01e4849-e968-46ce-97f1-a673c26b3735.4529.4 to cache LRU end 2024-09-12T17:53:45.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.651+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.11 : miss 2024-09-12T17:53:45.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.651+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.655+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T17:53:45.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.655+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.11 info.flags=0x17 2024-09-12T17:53:45.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.655+0000 7f311eab09c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.11 to cache LRU end 2024-09-12T17:53:45.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.655+0000 7f311eab09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:45.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.655+0000 7f311eab09c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:45.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.655+0000 7f311eab09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.11 2024-09-12T17:53:45.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.663+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo 2024-09-12T17:53:45.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.663+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd4ce2e0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55cacd458338 s->prefetch_data=0 2024-09-12T17:53:45.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.663+0000 7f311eab09c0 10 manifest: total_size = 18874368 2024-09-12T17:53:45.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.663+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.15393283868674497938 2024-09-12T17:53:45.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.663+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd4ce2e0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55cacd458338 s->prefetch_data=0 2024-09-12T17:53:45.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.663+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd458338 2024-09-12T17:53:45.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.663+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.11.10 2024-09-12T17:53:45.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:45.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:45.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:45.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:45.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:45.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:53:45.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:45.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:53:45.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:53:45.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T17:53:45.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:53:45.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T17:53:45.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.15393283868674497938 2024-09-12T17:53:45.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.11__multipart_foo.2~m4nj-daoW1MiQBx9c0p_yE-7lU0Co0Y.1 2024-09-12T17:53:45.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T17:53:45.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.11__multipart_foo.2~m4nj-daoW1MiQBx9c0p_yE-7lU0Co0Y.2 2024-09-12T17:53:45.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T17:53:45.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.11__multipart_foo.2~m4nj-daoW1MiQBx9c0p_yE-7lU0Co0Y.3 2024-09-12T17:53:45.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T17:53:45.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.11__multipart_foo.2~m4nj-daoW1MiQBx9c0p_yE-7lU0Co0Y.4 2024-09-12T17:53:45.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T17:53:45.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.15393283868674497938 2024-09-12T17:53:45.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:53:45.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:45.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.671+0000 7f311eab09c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:45.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.675+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:45.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.675+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:45.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.675+0000 7f311eab09c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:45.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.675+0000 7f311eab09c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:45.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.675+0000 7f311eab09c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[a01e4849-e968-46ce-97f1-a673c26b3735.4529.11])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:45.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.679+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T17:53:45.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.679+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.679+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T17:53:45.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.679+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T17:53:45.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.679+0000 7f311eab09c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T17:53:45.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.683+0000 7f311eab09c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T17:53:45.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.683+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T17:53:45.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.683+0000 7f2ff37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366242 cookie 94329515375888 notifier 5636 bl.length()=191 2024-09-12T17:53:45.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.687+0000 7f311eab09c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.11 from cache 2024-09-12T17:53:45.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.687+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.11, ofs0, ns] 2024-09-12T17:53:45.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.687+0000 7f2ff2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366165 cookie 94329515406336 notifier 5636 bl.length()=249 2024-09-12T17:53:45.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.695+0000 7f311eab09c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.11 : miss 2024-09-12T17:53:45.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.695+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.699+0000 7f311eab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:45.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.699+0000 7f311eab09c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.11 info.flags=0x0 2024-09-12T17:53:45.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.699+0000 7f311eab09c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.11 to cache LRU end 2024-09-12T17:53:45.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.703+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.12 : miss 2024-09-12T17:53:45.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.703+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.703+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T17:53:45.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.703+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.12 info.flags=0x17 2024-09-12T17:53:45.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.703+0000 7f311eab09c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.12 to cache LRU end 2024-09-12T17:53:45.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.703+0000 7f311eab09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:45.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.703+0000 7f311eab09c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:45.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.703+0000 7f311eab09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.12 2024-09-12T17:53:45.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.711+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo 2024-09-12T17:53:45.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.711+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd452090 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55cacd46bb88 s->prefetch_data=0 2024-09-12T17:53:45.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.715+0000 7f311eab09c0 10 manifest: total_size = 74198 2024-09-12T17:53:45.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.715+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.11772464744916594661 2024-09-12T17:53:45.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.715+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd452090 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55cacd46bb88 s->prefetch_data=0 2024-09-12T17:53:45.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.715+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd46bb88 2024-09-12T17:53:45.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.715+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.12.10 2024-09-12T17:53:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:53:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-12T17:53:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T17:53:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:53:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-12T17:53:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T17:53:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:53:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-09-12T17:53:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T17:53:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T17:53:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-09-12T17:53:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T17:53:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.11772464744916594661 2024-09-12T17:53:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.12__multipart_foo.2~Mk37YGmijScCmC4v-O-SPA6H-do0gvy.1 2024-09-12T17:53:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T17:53:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.12__multipart_foo.2~Mk37YGmijScCmC4v-O-SPA6H-do0gvy.2 2024-09-12T17:53:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T17:53:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.12__multipart_foo.2~Mk37YGmijScCmC4v-O-SPA6H-do0gvy.3 2024-09-12T17:53:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T17:53:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.12__multipart_foo.2~Mk37YGmijScCmC4v-O-SPA6H-do0gvy.4 2024-09-12T17:53:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T17:53:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.719+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.11772464744916594661 2024-09-12T17:53:45.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.723+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:53:45.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.723+0000 7f311eab09c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:45.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.723+0000 7f311eab09c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:45.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.727+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:45.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.727+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:45.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.727+0000 7f311eab09c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:45.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.727+0000 7f311eab09c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:45.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.727+0000 7f311eab09c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[a01e4849-e968-46ce-97f1-a673c26b3735.4529.12])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:45.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.731+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T17:53:45.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.731+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.731+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T17:53:45.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.731+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T17:53:45.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.731+0000 7f311eab09c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T17:53:45.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.735+0000 7f311eab09c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T17:53:45.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.735+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T17:53:45.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.735+0000 7f2ff2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366166 cookie 94329515406336 notifier 5636 bl.length()=198 2024-09-12T17:53:45.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.739+0000 7f311eab09c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.12 from cache 2024-09-12T17:53:45.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.739+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.12, ofs0, ns] 2024-09-12T17:53:45.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.739+0000 7f2ff2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366150 cookie 94329515421888 notifier 5636 bl.length()=256 2024-09-12T17:53:45.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.747+0000 7f311eab09c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.12 : miss 2024-09-12T17:53:45.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.747+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.747+0000 7f311eab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:45.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.747+0000 7f311eab09c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.12 info.flags=0x0 2024-09-12T17:53:45.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.747+0000 7f311eab09c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.12 to cache LRU end 2024-09-12T17:53:45.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.751+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.10 : miss 2024-09-12T17:53:45.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.751+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.751+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T17:53:45.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.751+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.10 info.flags=0x17 2024-09-12T17:53:45.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.751+0000 7f311eab09c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.10 to cache LRU end 2024-09-12T17:53:45.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.751+0000 7f311eab09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:45.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.751+0000 7f311eab09c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:45.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.751+0000 7f311eab09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.10 2024-09-12T17:53:45.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.759+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo[rHi8zv4ESQd0YfN.XnmZ4sKn5ZdBkGh] 2024-09-12T17:53:45.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.759+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.10.10 2024-09-12T17:53:45.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.759+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd456d60 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55cacd44d308 s->prefetch_data=0 2024-09-12T17:53:45.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.763+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to sqkf813xy84e8xkchbfasa8gbg5ausja 2024-09-12T17:53:45.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.763+0000 7f311eab09c0 20 get_obj_state_impl: setting s->olh_tag to mjjzz4v95141xidm12gztmowruwavgg1 2024-09-12T17:53:45.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.763+0000 7f311eab09c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mjjzz4v95141xidm12gztmowruwavgg1 2024-09-12T17:53:45.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.763+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.10.10 2024-09-12T17:53:45.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.767+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.10.10 2024-09-12T17:53:45.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.767+0000 7f311eab09c0 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T17:53:45.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.767+0000 7f311eab09c0 20 olh_log_entry: epoch=3 op=3 key=foo[rHi8zv4ESQd0YfN.XnmZ4sKn5ZdBkGh] 2024-09-12T17:53:45.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.767+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd456d60 obj=test-client.0-r-test-multipart-index-versioning.1:_:rHi8zv4ESQd0YfN.XnmZ4sKn5ZdBkGh_foo state=0x55cacd466308 s->prefetch_data=0 2024-09-12T17:53:45.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.767+0000 7f311eab09c0 10 manifest: total_size = 74198 2024-09-12T17:53:45.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.767+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.7276173074187817833 2024-09-12T17:53:45.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.767+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd456d60 obj=test-client.0-r-test-multipart-index-versioning.1:_:rHi8zv4ESQd0YfN.XnmZ4sKn5ZdBkGh_foo state=0x55cacd466308 s->prefetch_data=0 2024-09-12T17:53:45.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.767+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd466308 2024-09-12T17:53:45.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.767+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.10.10 2024-09-12T17:53:45.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:53:45.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-12T17:53:45.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T17:53:45.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:53:45.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-12T17:53:45.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T17:53:45.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T17:53:45.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-09-12T17:53:45.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T17:53:45.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T17:53:45.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-09-12T17:53:45.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T17:53:45.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.7276173074187817833 2024-09-12T17:53:45.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.10__multipart_foo.2~YZYXZJvquHG64XE6FM_Ztf7lsdh3eHc.1 2024-09-12T17:53:45.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T17:53:45.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.10__multipart_foo.2~YZYXZJvquHG64XE6FM_Ztf7lsdh3eHc.2 2024-09-12T17:53:45.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T17:53:45.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.10__multipart_foo.2~YZYXZJvquHG64XE6FM_Ztf7lsdh3eHc.3 2024-09-12T17:53:45.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T17:53:45.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.10__multipart_foo.2~YZYXZJvquHG64XE6FM_Ztf7lsdh3eHc.4 2024-09-12T17:53:45.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T17:53:45.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.7276173074187817833 2024-09-12T17:53:45.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.775+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=foo[rHi8zv4ESQd0YfN.XnmZ4sKn5ZdBkGh] 2024-09-12T17:53:45.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.779+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd456d60 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55cacd44d308 s->prefetch_data=0 2024-09-12T17:53:45.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.783+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.10.10 2024-09-12T17:53:45.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.787+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.10.10 2024-09-12T17:53:45.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.787+0000 7f311eab09c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:45.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.787+0000 7f311eab09c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:45.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.787+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:45.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.787+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:45.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.787+0000 7f311eab09c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:45.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.787+0000 7f311eab09c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:45.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.787+0000 7f311eab09c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[a01e4849-e968-46ce-97f1-a673c26b3735.4529.10])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:45.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.791+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T17:53:45.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.791+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.791+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T17:53:45.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.791+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T17:53:45.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.791+0000 7f311eab09c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T17:53:45.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.795+0000 7f311eab09c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T17:53:45.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.795+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T17:53:45.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.795+0000 7f2ff37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366167 cookie 94329515406336 notifier 5636 bl.length()=193 2024-09-12T17:53:45.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.799+0000 7f311eab09c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.10 from cache 2024-09-12T17:53:45.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.799+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.10, ofs0, ns] 2024-09-12T17:53:45.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.799+0000 7f2ff37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366162 cookie 94329515412688 notifier 5636 bl.length()=251 2024-09-12T17:53:45.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.807+0000 7f311eab09c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.10 : miss 2024-09-12T17:53:45.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.807+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.811+0000 7f311eab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:45.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.811+0000 7f311eab09c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.10 info.flags=0x0 2024-09-12T17:53:45.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.811+0000 7f311eab09c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.10 to cache LRU end 2024-09-12T17:53:45.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.815+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.9 : miss 2024-09-12T17:53:45.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.815+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.815+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:53:45.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.815+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.9 info.flags=0x17 2024-09-12T17:53:45.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.815+0000 7f311eab09c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.9 to cache LRU end 2024-09-12T17:53:45.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.815+0000 7f311eab09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:45.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.815+0000 7f311eab09c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:45.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.815+0000 7f311eab09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.9 2024-09-12T17:53:45.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.823+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo 2024-09-12T17:53:45.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.823+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd4ce460 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55cacd45cd48 s->prefetch_data=0 2024-09-12T17:53:45.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.823+0000 7f311eab09c0 10 manifest: total_size = 18874368 2024-09-12T17:53:45.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.823+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.6313873860498680439 2024-09-12T17:53:45.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.823+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd4ce460 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55cacd45cd48 s->prefetch_data=0 2024-09-12T17:53:45.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.823+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd45cd48 2024-09-12T17:53:45.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.823+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.9.10 2024-09-12T17:53:45.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:45.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:45.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:45.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:45.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:45.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:53:45.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:45.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-09-12T17:53:45.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:53:45.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T17:53:45.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-09-12T17:53:45.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T17:53:45.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.6313873860498680439 2024-09-12T17:53:45.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.9__multipart_foo.2~onaz8u--QSuIZL3kIqyOPd1voXSDV50.1 2024-09-12T17:53:45.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 344 2024-09-12T17:53:45.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.9__multipart_foo.2~onaz8u--QSuIZL3kIqyOPd1voXSDV50.2 2024-09-12T17:53:45.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 588 2024-09-12T17:53:45.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.9__multipart_foo.2~onaz8u--QSuIZL3kIqyOPd1voXSDV50.3 2024-09-12T17:53:45.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 832 2024-09-12T17:53:45.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.9__multipart_foo.2~onaz8u--QSuIZL3kIqyOPd1voXSDV50.4 2024-09-12T17:53:45.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1076 2024-09-12T17:53:45.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.831+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.6313873860498680439 2024-09-12T17:53:45.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.835+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=foo 2024-09-12T17:53:45.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.835+0000 7f311eab09c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:45.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.835+0000 7f311eab09c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:45.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.835+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:45.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.835+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:45.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.835+0000 7f311eab09c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:45.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.835+0000 7f311eab09c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:45.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.835+0000 7f311eab09c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[a01e4849-e968-46ce-97f1-a673c26b3735.4529.9])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:45.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.839+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T17:53:45.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.839+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.843+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T17:53:45.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.843+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T17:53:45.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.843+0000 7f311eab09c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T17:53:45.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.843+0000 7f311eab09c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T17:53:45.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.843+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T17:53:45.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.843+0000 7f2ff2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366177 cookie 94329515407664 notifier 5636 bl.length()=183 2024-09-12T17:53:45.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.851+0000 7f311eab09c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.9 from cache 2024-09-12T17:53:45.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.851+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.9, ofs0, ns] 2024-09-12T17:53:45.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.851+0000 7f2ff37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366163 cookie 94329515417792 notifier 5636 bl.length()=240 2024-09-12T17:53:45.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.859+0000 7f311eab09c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.9 : miss 2024-09-12T17:53:45.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.859+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.859+0000 7f311eab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:45.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.859+0000 7f311eab09c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.9 info.flags=0x0 2024-09-12T17:53:45.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.859+0000 7f311eab09c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.9 to cache LRU end 2024-09-12T17:53:45.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.863+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.15 : miss 2024-09-12T17:53:45.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.863+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:45.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.867+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:53:45.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.867+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.15 info.flags=0x17 2024-09-12T17:53:45.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.867+0000 7f311eab09c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.15 to cache LRU end 2024-09-12T17:53:45.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.867+0000 7f311eab09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:45.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.867+0000 7f311eab09c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:45.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.867+0000 7f311eab09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.15 2024-09-12T17:53:45.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.867+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T17:53:45.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.867+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T17:53:45.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.867+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:53:45.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.871+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T17:53:45.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.871+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T17:53:45.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.871+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:53:45.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.871+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T17:53:45.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.871+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:53:45.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.871+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T17:53:45.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.871+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T17:53:45.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.871+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T17:53:45.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.871+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T17:53:45.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.875+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd44ea30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.875+0000 7f311eab09c0 10 manifest: total_size = 324647 2024-09-12T17:53:45.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.875+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to _Rv61WR_5rCks8TC2J9K27BJyeP95I9W 2024-09-12T17:53:45.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.875+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd44ea30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.875+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:45.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.875+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.15.0 2024-09-12T17:53:45.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.879+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.879+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.879+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: _Rv61WR_5rCks8TC2J9K27BJyeP95I9W 2024-09-12T17:53:45.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.879+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.879+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.mUQ-9ndo5M7QJgJFZXCp7okPoG5jcq2_0 2024-09-12T17:53:45.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.879+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:53:45.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.879+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.879+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _Rv61WR_5rCks8TC2J9K27BJyeP95I9W 2024-09-12T17:53:45.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.883+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T17:53:45.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.883+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd44ea30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.883+0000 7f311eab09c0 10 manifest: total_size = 5242880 2024-09-12T17:53:45.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.883+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to _kH7BwyBWRCSVJC3QW1902CL0-fR0jZt 2024-09-12T17:53:45.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.883+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd44ea30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.883+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:45.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.883+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.15.2 2024-09-12T17:53:45.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.887+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.887+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.887+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: _kH7BwyBWRCSVJC3QW1902CL0-fR0jZt 2024-09-12T17:53:45.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.887+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.887+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.-e2o6uHm-TtHTQ6lPqEH4MNmtX3RWaX_0 2024-09-12T17:53:45.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.887+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:53:45.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.887+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.887+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _kH7BwyBWRCSVJC3QW1902CL0-fR0jZt 2024-09-12T17:53:45.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.891+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T17:53:45.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.891+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd44ea30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.891+0000 7f311eab09c0 10 manifest: total_size = 5242880 2024-09-12T17:53:45.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.891+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.2931709165800341903 2024-09-12T17:53:45.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.891+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd44ea30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.891+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:45.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.891+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.15.3 2024-09-12T17:53:45.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.899+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.899+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.899+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.2931709165800341903 2024-09-12T17:53:45.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.899+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.899+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.MmXhR-EalpuTrU-3MVchLufQEb3qzXj_0 2024-09-12T17:53:45.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.899+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T17:53:45.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.899+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.899+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.2931709165800341903 2024-09-12T17:53:45.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.903+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:53:45.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.903+0000 7f311eab09c0 20 get_obj_state: octx=0x7f3104062d60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.903+0000 7f311eab09c0 10 manifest: total_size = 5242880 2024-09-12T17:53:45.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.903+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to _PUv19cHqlOc0f85RObEaPz9-OzSnpzL 2024-09-12T17:53:45.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.903+0000 7f311eab09c0 20 get_obj_state: octx=0x7f3104062d60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.903+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:45.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.903+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.15.5 2024-09-12T17:53:45.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.911+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.911+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.911+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: _PUv19cHqlOc0f85RObEaPz9-OzSnpzL 2024-09-12T17:53:45.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.911+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.911+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.RT3pBBv9tU-YCzCu7KyvJ1IactVwrPZ_0 2024-09-12T17:53:45.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.911+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:53:45.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.911+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.911+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _PUv19cHqlOc0f85RObEaPz9-OzSnpzL 2024-09-12T17:53:45.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.911+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T17:53:45.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.915+0000 7f311eab09c0 20 get_obj_state: octx=0x7f31140173f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.915+0000 7f311eab09c0 10 manifest: total_size = 5242880 2024-09-12T17:53:45.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.915+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to _C36e_4s3DS6rRtPqxhMoviyKbAU2VFM 2024-09-12T17:53:45.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.915+0000 7f311eab09c0 20 get_obj_state: octx=0x7f31140173f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.915+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:45.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.915+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.15.5 2024-09-12T17:53:45.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.919+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.919+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.919+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: _C36e_4s3DS6rRtPqxhMoviyKbAU2VFM 2024-09-12T17:53:45.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.919+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.919+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_._Dbg7kcu2jGAmMoW0kFMVIaNPdtX0N2_0 2024-09-12T17:53:45.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.919+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:53:45.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.919+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.919+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _C36e_4s3DS6rRtPqxhMoviyKbAU2VFM 2024-09-12T17:53:45.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.923+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T17:53:45.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.923+0000 7f311eab09c0 20 get_obj_state: octx=0x7f3104062d60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.923+0000 7f311eab09c0 10 manifest: total_size = 324647 2024-09-12T17:53:45.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.923+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.7530054836250421682 2024-09-12T17:53:45.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.923+0000 7f311eab09c0 20 get_obj_state: octx=0x7f3104062d60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.923+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:45.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.923+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.15.5 2024-09-12T17:53:45.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.931+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.931+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.931+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.7530054836250421682 2024-09-12T17:53:45.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.931+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.931+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.GwVpewUfzUPb5YtrfUmhPiEKbsuXFZE_0 2024-09-12T17:53:45.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.931+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T17:53:45.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.931+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.931+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.7530054836250421682 2024-09-12T17:53:45.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.935+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:53:45.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.935+0000 7f311eab09c0 20 get_obj_state: octx=0x7f3104062d60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.935+0000 7f311eab09c0 10 manifest: total_size = 5242880 2024-09-12T17:53:45.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.935+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to _QcoWSbKN_HA3AVYzgepmCvYjN4jkvID 2024-09-12T17:53:45.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.935+0000 7f311eab09c0 20 get_obj_state: octx=0x7f3104062d60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.935+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:45.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.935+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.15.7 2024-09-12T17:53:45.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.939+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.939+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.939+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: _QcoWSbKN_HA3AVYzgepmCvYjN4jkvID 2024-09-12T17:53:45.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.939+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.939+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.kAapTv5N4HHbPaKBObkQIrDcSG0kRvM_0 2024-09-12T17:53:45.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.939+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:53:45.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.939+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.939+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _QcoWSbKN_HA3AVYzgepmCvYjN4jkvID 2024-09-12T17:53:45.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.943+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T17:53:45.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.943+0000 7f311eab09c0 20 get_obj_state: octx=0x7f3114055490 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.943+0000 7f311eab09c0 10 manifest: total_size = 5242880 2024-09-12T17:53:45.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.943+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.3592224321994284688 2024-09-12T17:53:45.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.943+0000 7f311eab09c0 20 get_obj_state: octx=0x7f3114055490 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.943+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:45.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.943+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.15.7 2024-09-12T17:53:45.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.951+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.951+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.951+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.3592224321994284688 2024-09-12T17:53:45.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.951+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.951+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.wxPegvjj9b3j9bxWwpZd6sr5Kd40dcP_0 2024-09-12T17:53:45.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.951+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T17:53:45.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.951+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.951+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.3592224321994284688 2024-09-12T17:53:45.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.955+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:53:45.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.955+0000 7f311eab09c0 20 get_obj_state: octx=0x7f3114055490 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.955+0000 7f311eab09c0 10 manifest: total_size = 324647 2024-09-12T17:53:45.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.955+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.5380348803516012093 2024-09-12T17:53:45.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.955+0000 7f311eab09c0 20 get_obj_state: octx=0x7f3114055490 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.955+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:45.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.955+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.15.7 2024-09-12T17:53:45.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.963+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.963+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.963+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.5380348803516012093 2024-09-12T17:53:45.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.963+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.963+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.GwVpewUfzUPb5YtrfUmhPiEKbsuXFZE_0 2024-09-12T17:53:45.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.963+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T17:53:45.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.963+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.963+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.5380348803516012093 2024-09-12T17:53:45.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.963+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T17:53:45.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.967+0000 7f311eab09c0 20 get_obj_state: octx=0x7f31140173f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.967+0000 7f311eab09c0 10 manifest: total_size = 5242880 2024-09-12T17:53:45.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.967+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.710539255089247395 2024-09-12T17:53:45.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.967+0000 7f311eab09c0 20 get_obj_state: octx=0x7f31140173f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.967+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:45.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.967+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.15.8 2024-09-12T17:53:45.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.971+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.971+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.971+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.710539255089247395 2024-09-12T17:53:45.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.971+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.971+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.wxPegvjj9b3j9bxWwpZd6sr5Kd40dcP_0 2024-09-12T17:53:45.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.971+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T17:53:45.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.971+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.971+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.710539255089247395 2024-09-12T17:53:45.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.975+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T17:53:45.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.975+0000 7f311eab09c0 20 get_obj_state: octx=0x7f31140173f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.975+0000 7f311eab09c0 10 manifest: total_size = 324647 2024-09-12T17:53:45.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.975+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to _PL4L44mXsEh1WOOAJmVkfywbxfls6d7 2024-09-12T17:53:45.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.975+0000 7f311eab09c0 20 get_obj_state: octx=0x7f31140173f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.975+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:45.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.975+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.15.8 2024-09-12T17:53:45.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.983+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.983+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.983+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: _PL4L44mXsEh1WOOAJmVkfywbxfls6d7 2024-09-12T17:53:45.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.983+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.983+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.Fw-O8L3A1Z2hlqzB4erpKMOo4gB74BZ_0 2024-09-12T17:53:45.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.983+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:53:45.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.983+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.983+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _PL4L44mXsEh1WOOAJmVkfywbxfls6d7 2024-09-12T17:53:45.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.987+0000 7f311eab09c0 20 get_obj_state: octx=0x7f3104062d60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.987+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T17:53:45.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.987+0000 7f311eab09c0 10 manifest: total_size = 5242880 2024-09-12T17:53:45.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.987+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.4067176979123772629 2024-09-12T17:53:45.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.987+0000 7f311eab09c0 20 get_obj_state: octx=0x7f3104062d60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:45.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.987+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:45.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.987+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.15.9 2024-09-12T17:53:45.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.991+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:45.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.991+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T17:53:45.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.991+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.4067176979123772629 2024-09-12T17:53:45.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.991+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:45.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.991+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.MmXhR-EalpuTrU-3MVchLufQEb3qzXj_0 2024-09-12T17:53:45.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.991+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T17:53:45.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.991+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:45.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.991+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.4067176979123772629 2024-09-12T17:53:45.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.995+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T17:53:45.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.995+0000 7f311eab09c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:45.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.995+0000 7f311eab09c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:45.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.999+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:45.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.999+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:45.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.999+0000 7f311eab09c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:45.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.999+0000 7f311eab09c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:45.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:45.999+0000 7f311eab09c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[a01e4849-e968-46ce-97f1-a673c26b3735.4529.15])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:46.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.003+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T17:53:46.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.003+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.003+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T17:53:46.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.003+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T17:53:46.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.003+0000 7f311eab09c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T17:53:46.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.007+0000 7f311eab09c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T17:53:46.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.007+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T17:53:46.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.007+0000 7f2ff2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366168 cookie 94329515406336 notifier 5636 bl.length()=189 2024-09-12T17:53:46.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.011+0000 7f311eab09c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.15 from cache 2024-09-12T17:53:46.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.011+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.15, ofs0, ns] 2024-09-12T17:53:46.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.011+0000 7f2ff2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366164 cookie 94329515412688 notifier 5636 bl.length()=247 2024-09-12T17:53:46.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.019+0000 7f311eab09c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.15 : miss 2024-09-12T17:53:46.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.019+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.019+0000 7f311eab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:46.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.019+0000 7f311eab09c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.15 info.flags=0x0 2024-09-12T17:53:46.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.019+0000 7f311eab09c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.15 to cache LRU end 2024-09-12T17:53:46.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.023+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16 : miss 2024-09-12T17:53:46.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.023+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.027+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T17:53:46.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.027+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16 info.flags=0x17 2024-09-12T17:53:46.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.027+0000 7f311eab09c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16 to cache LRU end 2024-09-12T17:53:46.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.027+0000 7f311eab09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:46.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.027+0000 7f311eab09c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:46.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.027+0000 7f311eab09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16 2024-09-12T17:53:46.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.027+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T17:53:46.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.027+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T17:53:46.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.027+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:53:46.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.031+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T17:53:46.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.031+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T17:53:46.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.031+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:53:46.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.031+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T17:53:46.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.031+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:53:46.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.031+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T17:53:46.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.035+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T17:53:46.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.035+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T17:53:46.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.035+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T17:53:46.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.035+0000 7f311eab09c0 20 get_obj_state: octx=0x7f3114055490 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.035+0000 7f311eab09c0 10 manifest: total_size = 16380 2024-09-12T17:53:46.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.035+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to _VMVfURgNJoJBoSZxQeub6oFIDS93W_q 2024-09-12T17:53:46.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.035+0000 7f311eab09c0 20 get_obj_state: octx=0x7f3114055490 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.035+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:46.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.035+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.16.0 2024-09-12T17:53:46.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.043+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.043+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=16380 stripe_ofs=16380 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.043+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: _VMVfURgNJoJBoSZxQeub6oFIDS93W_q 2024-09-12T17:53:46.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.043+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.043+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__shadow_.-O_AMJVfGGekcORSDUO2K4_dLEfAR2t_0 2024-09-12T17:53:46.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.043+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:53:46.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.043+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.043+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _VMVfURgNJoJBoSZxQeub6oFIDS93W_q 2024-09-12T17:53:46.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.043+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T17:53:46.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.047+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0fe2f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.047+0000 7f311eab09c0 10 manifest: total_size = 11534336 2024-09-12T17:53:46.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.047+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to _nz2UFoTNN_pDu0PRO-qVCG_g9BysldH 2024-09-12T17:53:46.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.047+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0fe2f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.047+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:46.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.047+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.16.2 2024-09-12T17:53:46.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.051+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.051+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.051+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.051+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.051+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: _nz2UFoTNN_pDu0PRO-qVCG_g9BysldH 2024-09-12T17:53:46.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.051+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.051+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__shadow_.5qHV4TouE5F93MDxP9LsymmZqMqrfNI_0 2024-09-12T17:53:46.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.051+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:53:46.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.051+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__shadow_.5qHV4TouE5F93MDxP9LsymmZqMqrfNI_1 2024-09-12T17:53:46.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.051+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:53:46.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.051+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.051+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _nz2UFoTNN_pDu0PRO-qVCG_g9BysldH 2024-09-12T17:53:46.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.055+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T17:53:46.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.055+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0fe2f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.055+0000 7f311eab09c0 10 manifest: total_size = 11534336 2024-09-12T17:53:46.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.055+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.12369751013056469465 2024-09-12T17:53:46.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.055+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0fe2f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.055+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:46.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.055+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.16.3 2024-09-12T17:53:46.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:46.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:46.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:46.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:46.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:46.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:46.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:53:46.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:46.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:53:46.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.12369751013056469465 2024-09-12T17:53:46.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-FROZEN.2~8eE3-4ymQewMsqSi4egz_JNJMh3wwAY.1 2024-09-12T17:53:46.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T17:53:46.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-FROZEN.2~8eE3-4ymQewMsqSi4egz_JNJMh3wwAY.2 2024-09-12T17:53:46.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-12T17:53:46.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-FROZEN.2~8eE3-4ymQewMsqSi4egz_JNJMh3wwAY.3 2024-09-12T17:53:46.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-12T17:53:46.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.12369751013056469465 2024-09-12T17:53:46.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0adf00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:53:46.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 10 manifest: total_size = 11534336 2024-09-12T17:53:46.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to _zJGQAWYJE2LVUPjxiZAmzpsQ7BnUAO_ 2024-09-12T17:53:46.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0adf00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:46.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.063+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.16.5 2024-09-12T17:53:46.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.071+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.071+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.071+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.071+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.071+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: _zJGQAWYJE2LVUPjxiZAmzpsQ7BnUAO_ 2024-09-12T17:53:46.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.071+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.071+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__shadow_.h5PtwKe3uXL216I_-svneEzbAIV3_Gn_0 2024-09-12T17:53:46.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.071+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T17:53:46.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.071+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__shadow_.h5PtwKe3uXL216I_-svneEzbAIV3_Gn_1 2024-09-12T17:53:46.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.071+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T17:53:46.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.071+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.071+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: _zJGQAWYJE2LVUPjxiZAmzpsQ7BnUAO_ 2024-09-12T17:53:46.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.075+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0fe2f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.075+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T17:53:46.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.075+0000 7f311eab09c0 10 manifest: total_size = 11534336 2024-09-12T17:53:46.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.075+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to _-5rCVq2Jj9g-50H6z0CBuXq-lrcXJq8 2024-09-12T17:53:46.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.075+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0fe2f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.075+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:46.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.075+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.16.5 2024-09-12T17:53:46.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.083+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.083+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.083+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.083+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.083+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: _-5rCVq2Jj9g-50H6z0CBuXq-lrcXJq8 2024-09-12T17:53:46.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.083+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.083+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__shadow_.GbYYvOwNvfMFUmCdLDEfctAmbQyyV2Q_0 2024-09-12T17:53:46.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.083+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:53:46.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.083+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__shadow_.GbYYvOwNvfMFUmCdLDEfctAmbQyyV2Q_1 2024-09-12T17:53:46.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.083+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T17:53:46.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.083+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.083+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _-5rCVq2Jj9g-50H6z0CBuXq-lrcXJq8 2024-09-12T17:53:46.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.083+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T17:53:46.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.087+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0ccf80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.087+0000 7f311eab09c0 10 manifest: total_size = 16380 2024-09-12T17:53:46.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.087+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.689766352208573506 2024-09-12T17:53:46.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.087+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0ccf80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.087+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:46.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.087+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.16.5 2024-09-12T17:53:46.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.091+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-12T17:53:46.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.091+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7672 2024-09-12T17:53:46.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.091+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7673 2024-09-12T17:53:46.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.091+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=3 2024-09-12T17:53:46.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.091+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6299128 part_ofs=7672 rule->part_size=7673 2024-09-12T17:53:46.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.091+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=15345 stripe_ofs=15345 part_ofs=15345 rule->part_size=1035 2024-09-12T17:53:46.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.091+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-12T17:53:46.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.091+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6306801 part_ofs=15345 rule->part_size=1035 2024-09-12T17:53:46.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.091+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=16380 stripe_ofs=16380 part_ofs=16380 rule->part_size=1035 2024-09-12T17:53:46.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.091+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.689766352208573506 2024-09-12T17:53:46.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.091+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.091+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-STANDARD.2~cp5buN3zOGyebj-cIPtL0Oq7WywKLVH.1 2024-09-12T17:53:46.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.091+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 363 2024-09-12T17:53:46.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.091+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-STANDARD.2~cp5buN3zOGyebj-cIPtL0Oq7WywKLVH.2 2024-09-12T17:53:46.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.091+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 627 2024-09-12T17:53:46.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.091+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-STANDARD.2~cp5buN3zOGyebj-cIPtL0Oq7WywKLVH.3 2024-09-12T17:53:46.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.091+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 891 2024-09-12T17:53:46.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.091+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.091+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.689766352208573506 2024-09-12T17:53:46.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.095+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0fe2f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.095+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:53:46.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.095+0000 7f311eab09c0 10 manifest: total_size = 11534336 2024-09-12T17:53:46.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.095+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to _reuhuzPTmqIVVbJw08R0vNo4Le7tezu 2024-09-12T17:53:46.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.095+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0fe2f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.095+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:46.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.095+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.16.7 2024-09-12T17:53:46.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.103+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.103+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.103+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.103+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.103+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: _reuhuzPTmqIVVbJw08R0vNo4Le7tezu 2024-09-12T17:53:46.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.103+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.103+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__shadow_.Oq3LxxO9at2kWFk6PeFkbKze-0OEAF0_0 2024-09-12T17:53:46.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.103+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T17:53:46.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.103+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__shadow_.Oq3LxxO9at2kWFk6PeFkbKze-0OEAF0_1 2024-09-12T17:53:46.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.103+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T17:53:46.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.103+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.103+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _reuhuzPTmqIVVbJw08R0vNo4Le7tezu 2024-09-12T17:53:46.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.107+0000 7f311eab09c0 20 get_obj_state: octx=0x7f31140173f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.107+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T17:53:46.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.107+0000 7f311eab09c0 10 manifest: total_size = 11534336 2024-09-12T17:53:46.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.107+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.16368420932414978693 2024-09-12T17:53:46.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.107+0000 7f311eab09c0 20 get_obj_state: octx=0x7f31140173f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.107+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:46.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.107+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.16.7 2024-09-12T17:53:46.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.115+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:46.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.115+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:46.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.115+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:46.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.115+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:46.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.115+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:46.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.115+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:46.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.115+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:53:46.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.115+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:46.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.115+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:53:46.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.115+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16368420932414978693 2024-09-12T17:53:46.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.115+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.115+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-LUKEWARM.2~kLWd2_KpDEADPR16U-qahYGe1fQza51.1 2024-09-12T17:53:46.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.115+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T17:53:46.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.115+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-LUKEWARM.2~kLWd2_KpDEADPR16U-qahYGe1fQza51.2 2024-09-12T17:53:46.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.115+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-12T17:53:46.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.115+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-LUKEWARM.2~kLWd2_KpDEADPR16U-qahYGe1fQza51.3 2024-09-12T17:53:46.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.115+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-12T17:53:46.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.115+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.115+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16368420932414978693 2024-09-12T17:53:46.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.119+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:53:46.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.119+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd4536e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.119+0000 7f311eab09c0 10 manifest: total_size = 16380 2024-09-12T17:53:46.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.119+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.8997838973003994388 2024-09-12T17:53:46.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.119+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd4536e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.119+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:46.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.119+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.16.7 2024-09-12T17:53:46.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.123+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-12T17:53:46.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.123+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7672 2024-09-12T17:53:46.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.123+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7673 2024-09-12T17:53:46.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.123+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=3 2024-09-12T17:53:46.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.123+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6299128 part_ofs=7672 rule->part_size=7673 2024-09-12T17:53:46.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.123+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=15345 stripe_ofs=15345 part_ofs=15345 rule->part_size=1035 2024-09-12T17:53:46.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.123+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-12T17:53:46.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.123+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6306801 part_ofs=15345 rule->part_size=1035 2024-09-12T17:53:46.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.123+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=16380 stripe_ofs=16380 part_ofs=16380 rule->part_size=1035 2024-09-12T17:53:46.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.123+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.8997838973003994388 2024-09-12T17:53:46.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.123+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.123+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-STANDARD.2~cp5buN3zOGyebj-cIPtL0Oq7WywKLVH.1 2024-09-12T17:53:46.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.123+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T17:53:46.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.123+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-STANDARD.2~cp5buN3zOGyebj-cIPtL0Oq7WywKLVH.2 2024-09-12T17:53:46.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.123+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T17:53:46.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.123+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-STANDARD.2~cp5buN3zOGyebj-cIPtL0Oq7WywKLVH.3 2024-09-12T17:53:46.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.123+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T17:53:46.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.123+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.123+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.8997838973003994388 2024-09-12T17:53:46.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.127+0000 7f311eab09c0 20 get_obj_state: octx=0x7f31140173f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.127+0000 7f311eab09c0 10 manifest: total_size = 11534336 2024-09-12T17:53:46.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.127+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.8024533845262548384 2024-09-12T17:53:46.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.127+0000 7f311eab09c0 20 get_obj_state: octx=0x7f31140173f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.127+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:46.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.127+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.16.8 2024-09-12T17:53:46.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.127+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T17:53:46.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.135+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:46.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.135+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:46.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.135+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:46.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.135+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:46.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.135+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:46.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.135+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:46.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.135+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:53:46.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.135+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:46.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.135+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:53:46.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.135+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.8024533845262548384 2024-09-12T17:53:46.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.135+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.135+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-LUKEWARM.2~kLWd2_KpDEADPR16U-qahYGe1fQza51.1 2024-09-12T17:53:46.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.135+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T17:53:46.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.135+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-LUKEWARM.2~kLWd2_KpDEADPR16U-qahYGe1fQza51.2 2024-09-12T17:53:46.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.135+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-12T17:53:46.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.135+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-LUKEWARM.2~kLWd2_KpDEADPR16U-qahYGe1fQza51.3 2024-09-12T17:53:46.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.135+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-12T17:53:46.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.135+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.135+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.8024533845262548384 2024-09-12T17:53:46.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.135+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T17:53:46.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.139+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd4cd7d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.139+0000 7f311eab09c0 10 manifest: total_size = 16380 2024-09-12T17:53:46.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.139+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to _4WSRWh1FTSMn_Z0Oh4I8flAf8m6PA_R 2024-09-12T17:53:46.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.139+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd4cd7d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.139+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:46.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.139+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.16.8 2024-09-12T17:53:46.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.143+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.143+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=16380 stripe_ofs=16380 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.143+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: _4WSRWh1FTSMn_Z0Oh4I8flAf8m6PA_R 2024-09-12T17:53:46.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.143+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.143+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__shadow_.QQOK2JUa1VDtEzAUpjCN-RiFMmVL_b5_0 2024-09-12T17:53:46.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.143+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T17:53:46.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.143+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.143+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _4WSRWh1FTSMn_Z0Oh4I8flAf8m6PA_R 2024-09-12T17:53:46.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.147+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T17:53:46.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.147+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd451f20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.151+0000 7f311eab09c0 10 manifest: total_size = 11534336 2024-09-12T17:53:46.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.151+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.4591068624644584780 2024-09-12T17:53:46.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.151+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd451f20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55cacd44d208 s->prefetch_data=0 2024-09-12T17:53:46.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.151+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd44d208 2024-09-12T17:53:46.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.151+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.16.9 2024-09-12T17:53:46.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.155+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:46.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.155+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:46.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.155+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:46.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.155+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:46.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.155+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:46.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.155+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:46.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.155+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:53:46.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.155+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:46.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.155+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:53:46.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.155+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.4591068624644584780 2024-09-12T17:53:46.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.155+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.155+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-FROZEN.2~8eE3-4ymQewMsqSi4egz_JNJMh3wwAY.1 2024-09-12T17:53:46.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.155+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T17:53:46.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.155+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-FROZEN.2~8eE3-4ymQewMsqSi4egz_JNJMh3wwAY.2 2024-09-12T17:53:46.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.155+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-12T17:53:46.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.155+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-FROZEN.2~8eE3-4ymQewMsqSi4egz_JNJMh3wwAY.3 2024-09-12T17:53:46.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.155+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-12T17:53:46.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.155+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.155+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.4591068624644584780 2024-09-12T17:53:46.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.159+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T17:53:46.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.159+0000 7f311eab09c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:46.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.159+0000 7f311eab09c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:46.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.163+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:46.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.163+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:46.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.163+0000 7f311eab09c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:46.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.163+0000 7f311eab09c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:46.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.163+0000 7f311eab09c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[a01e4849-e968-46ce-97f1-a673c26b3735.4529.16])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:46.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.167+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T17:53:46.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.167+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.167+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T17:53:46.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.167+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T17:53:46.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.167+0000 7f311eab09c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T17:53:46.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.171+0000 7f311eab09c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T17:53:46.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.171+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T17:53:46.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.171+0000 7f2ff2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366163 cookie 94329515410384 notifier 5636 bl.length()=199 2024-09-12T17:53:46.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.175+0000 7f311eab09c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16 from cache 2024-09-12T17:53:46.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.175+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16, ofs0, ns] 2024-09-12T17:53:46.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.179+0000 7f2ff2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366178 cookie 94329515378448 notifier 5636 bl.length()=257 2024-09-12T17:53:46.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.187+0000 7f311eab09c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.16 : miss 2024-09-12T17:53:46.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.187+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.187+0000 7f311eab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:46.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.187+0000 7f311eab09c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.16 info.flags=0x0 2024-09-12T17:53:46.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.187+0000 7f311eab09c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.16 to cache LRU end 2024-09-12T17:53:46.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.191+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.14 : miss 2024-09-12T17:53:46.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.191+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.191+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:53:46.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.191+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.14 info.flags=0x17 2024-09-12T17:53:46.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.191+0000 7f311eab09c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.14 to cache LRU end 2024-09-12T17:53:46.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.191+0000 7f311eab09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:46.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.191+0000 7f311eab09c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:46.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.191+0000 7f311eab09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.14 2024-09-12T17:53:46.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.195+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:53:46.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.199+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:53:46.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.199+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:53:46.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.203+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd45a500 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55cacd45cd48 s->prefetch_data=0 2024-09-12T17:53:46.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.203+0000 7f311eab09c0 10 manifest: total_size = 11534336 2024-09-12T17:53:46.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.203+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.9435168276899800202 2024-09-12T17:53:46.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.203+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd45a500 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55cacd45cd48 s->prefetch_data=0 2024-09-12T17:53:46.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.203+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd45cd48 2024-09-12T17:53:46.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.203+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.14.3 2024-09-12T17:53:46.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:46.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:46.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:46.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:46.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:46.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:46.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:53:46.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:46.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:53:46.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.9435168276899800202 2024-09-12T17:53:46.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.14__multipart_foo-FROZEN.2~HCrmfwkurp7xMdkup7m-6IwqmdLr2ru.1 2024-09-12T17:53:46.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T17:53:46.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.14__multipart_foo-FROZEN.2~HCrmfwkurp7xMdkup7m-6IwqmdLr2ru.2 2024-09-12T17:53:46.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-12T17:53:46.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.14__multipart_foo-FROZEN.2~HCrmfwkurp7xMdkup7m-6IwqmdLr2ru.3 2024-09-12T17:53:46.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-12T17:53:46.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.9435168276899800202 2024-09-12T17:53:46.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:53:46.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 get_obj_state: octx=0x7f31140173f0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55cacd45cd48 s->prefetch_data=0 2024-09-12T17:53:46.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 10 manifest: total_size = 1087 2024-09-12T17:53:46.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.3003820382018611848 2024-09-12T17:53:46.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 get_obj_state: octx=0x7f31140173f0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55cacd45cd48 s->prefetch_data=0 2024-09-12T17:53:46.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd45cd48 2024-09-12T17:53:46.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.211+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.14.5 2024-09-12T17:53:46.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.219+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:53:46.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.219+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-12T17:53:46.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.219+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T17:53:46.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.219+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T17:53:46.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.219+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-12T17:53:46.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.219+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-12T17:53:46.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.219+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-12T17:53:46.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.219+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=55 2024-09-12T17:53:46.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.219+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-12T17:53:46.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.219+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.3003820382018611848 2024-09-12T17:53:46.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.219+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.219+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.14__multipart_foo-STANDARD.2~gCgIYF4mq-2lNGbjYIN_3THBa2zg-5F.1 2024-09-12T17:53:46.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.219+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T17:53:46.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.219+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.14__multipart_foo-STANDARD.2~gCgIYF4mq-2lNGbjYIN_3THBa2zg-5F.2 2024-09-12T17:53:46.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.219+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T17:53:46.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.219+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.14__multipart_foo-STANDARD.2~gCgIYF4mq-2lNGbjYIN_3THBa2zg-5F.3 2024-09-12T17:53:46.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.219+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T17:53:46.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.219+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.219+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.3003820382018611848 2024-09-12T17:53:46.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.223+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd45d870 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55cacd45cd48 s->prefetch_data=0 2024-09-12T17:53:46.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.223+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:53:46.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.223+0000 7f311eab09c0 10 manifest: total_size = 11534336 2024-09-12T17:53:46.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.223+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.642563197023511844 2024-09-12T17:53:46.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.223+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd45d870 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55cacd45cd48 s->prefetch_data=0 2024-09-12T17:53:46.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.223+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd45cd48 2024-09-12T17:53:46.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.223+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.14.7 2024-09-12T17:53:46.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.231+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:46.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.231+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T17:53:46.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.231+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:46.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.231+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T17:53:46.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.231+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T17:53:46.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.231+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:46.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.231+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T17:53:46.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.231+0000 7f311eab09c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T17:53:46.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.231+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T17:53:46.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.231+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.642563197023511844 2024-09-12T17:53:46.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.231+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.231+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.14__multipart_foo-LUKEWARM.2~SLbG_8uhKEhaNehbNCFwlYMwNsnJtop.1 2024-09-12T17:53:46.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.231+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 372 2024-09-12T17:53:46.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.231+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.14__multipart_foo-LUKEWARM.2~SLbG_8uhKEhaNehbNCFwlYMwNsnJtop.2 2024-09-12T17:53:46.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.231+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T17:53:46.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.231+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.14__multipart_foo-LUKEWARM.2~SLbG_8uhKEhaNehbNCFwlYMwNsnJtop.3 2024-09-12T17:53:46.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.231+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T17:53:46.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.231+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.231+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.642563197023511844 2024-09-12T17:53:46.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.235+0000 7f311eab09c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:46.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.235+0000 7f311eab09c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:46.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.235+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:53:46.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.239+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:46.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.239+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:46.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.239+0000 7f311eab09c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:46.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.239+0000 7f311eab09c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:46.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.239+0000 7f311eab09c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[a01e4849-e968-46ce-97f1-a673c26b3735.4529.14])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:46.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.239+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T17:53:46.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.239+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.243+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T17:53:46.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.243+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T17:53:46.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.243+0000 7f311eab09c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T17:53:46.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.243+0000 7f311eab09c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T17:53:46.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.243+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T17:53:46.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.243+0000 7f2ff37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366165 cookie 94329515412688 notifier 5636 bl.length()=194 2024-09-12T17:53:46.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.251+0000 7f311eab09c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.14 from cache 2024-09-12T17:53:46.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.251+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.14, ofs0, ns] 2024-09-12T17:53:46.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.251+0000 7f2ff2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366179 cookie 94329515378448 notifier 5636 bl.length()=252 2024-09-12T17:53:46.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.259+0000 7f311eab09c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.14 : miss 2024-09-12T17:53:46.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.259+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.259+0000 7f311eab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:46.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.259+0000 7f311eab09c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.14 info.flags=0x0 2024-09-12T17:53:46.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.259+0000 7f311eab09c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.14 to cache LRU end 2024-09-12T17:53:46.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.267+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.13 : miss 2024-09-12T17:53:46.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.267+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.267+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T17:53:46.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.267+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.13 info.flags=0x17 2024-09-12T17:53:46.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.267+0000 7f311eab09c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.13 to cache LRU end 2024-09-12T17:53:46.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.267+0000 7f311eab09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:46.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.267+0000 7f311eab09c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:46.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.267+0000 7f311eab09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.13 2024-09-12T17:53:46.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.271+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T17:53:46.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.271+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T17:53:46.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.275+0000 7f311eab09c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T17:53:46.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.279+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd41ffd0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55cacd467638 s->prefetch_data=0 2024-09-12T17:53:46.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.279+0000 7f311eab09c0 10 manifest: total_size = 10485760 2024-09-12T17:53:46.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.279+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.12872915347131241723 2024-09-12T17:53:46.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.279+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd41ffd0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55cacd467638 s->prefetch_data=0 2024-09-12T17:53:46.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.279+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd467638 2024-09-12T17:53:46.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.279+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.13.3 2024-09-12T17:53:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.283+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.283+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.283+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.283+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.283+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.12872915347131241723 2024-09-12T17:53:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.283+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.283+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.13__shadow_.gxZH-HJc8vgLuRpA_z4oULcibBgwtqF_0 2024-09-12T17:53:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.283+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T17:53:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.283+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.13__shadow_.gxZH-HJc8vgLuRpA_z4oULcibBgwtqF_1 2024-09-12T17:53:46.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.283+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T17:53:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.283+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.283+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.12872915347131241723 2024-09-12T17:53:46.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.287+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T17:53:46.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.287+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0c8390 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55cacd467638 s->prefetch_data=0 2024-09-12T17:53:46.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.287+0000 7f311eab09c0 10 manifest: total_size = 44258 2024-09-12T17:53:46.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.287+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.5394966377387876416 2024-09-12T17:53:46.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.287+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0c8390 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55cacd467638 s->prefetch_data=0 2024-09-12T17:53:46.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.287+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd467638 2024-09-12T17:53:46.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.287+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.13.5 2024-09-12T17:53:46.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.295+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.295+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=44258 stripe_ofs=44258 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.295+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.5394966377387876416 2024-09-12T17:53:46.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.295+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.295+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.13__shadow_.uDuEwSdSM5jqXrCMbLZhtL4V9H7WK8Q_0 2024-09-12T17:53:46.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.295+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T17:53:46.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.295+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.295+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.5394966377387876416 2024-09-12T17:53:46.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.295+0000 7f311eab09c0 20 get_obj_state: octx=0x7f31140173f0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55cacd467638 s->prefetch_data=0 2024-09-12T17:53:46.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.299+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T17:53:46.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.299+0000 7f311eab09c0 10 manifest: total_size = 10485760 2024-09-12T17:53:46.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.299+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.8895919814836118501 2024-09-12T17:53:46.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.299+0000 7f311eab09c0 20 get_obj_state: octx=0x7f31140173f0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55cacd467638 s->prefetch_data=0 2024-09-12T17:53:46.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.299+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd467638 2024-09-12T17:53:46.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.299+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.13.7 2024-09-12T17:53:46.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.307+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.307+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.307+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.307+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.307+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.8895919814836118501 2024-09-12T17:53:46.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.307+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.307+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.13__shadow_.0pNvgjtOYm0vS-exPBTld7AtKJWLLkG_0 2024-09-12T17:53:46.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.307+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T17:53:46.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.307+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.13__shadow_.0pNvgjtOYm0vS-exPBTld7AtKJWLLkG_1 2024-09-12T17:53:46.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.307+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T17:53:46.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.307+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.307+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.8895919814836118501 2024-09-12T17:53:46.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.311+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T17:53:46.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.311+0000 7f311eab09c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:46.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.311+0000 7f311eab09c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:46.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.311+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:46.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.311+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:46.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.311+0000 7f311eab09c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:46.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.311+0000 7f311eab09c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:46.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.311+0000 7f311eab09c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[a01e4849-e968-46ce-97f1-a673c26b3735.4529.13])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:46.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.315+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T17:53:46.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.315+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.319+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T17:53:46.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.319+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T17:53:46.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.319+0000 7f311eab09c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T17:53:46.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.319+0000 7f311eab09c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T17:53:46.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.319+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T17:53:46.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.319+0000 7f2ff2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366169 cookie 94329515406336 notifier 5636 bl.length()=184 2024-09-12T17:53:46.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.327+0000 7f311eab09c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.13 from cache 2024-09-12T17:53:46.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.327+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.13, ofs0, ns] 2024-09-12T17:53:46.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.327+0000 7f2ff37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366151 cookie 94329515421888 notifier 5636 bl.length()=242 2024-09-12T17:53:46.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.335+0000 7f311eab09c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.13 : miss 2024-09-12T17:53:46.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.335+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.335+0000 7f311eab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:46.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.335+0000 7f311eab09c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.13 info.flags=0x0 2024-09-12T17:53:46.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.335+0000 7f311eab09c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.13 to cache LRU end 2024-09-12T17:53:46.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.339+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.6 : miss 2024-09-12T17:53:46.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.339+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.339+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:53:46.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.339+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.6 info.flags=0x17 2024-09-12T17:53:46.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.339+0000 7f311eab09c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.6 to cache LRU end 2024-09-12T17:53:46.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.339+0000 7f311eab09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:46.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.339+0000 7f311eab09c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:46.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.339+0000 7f311eab09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.6 2024-09-12T17:53:46.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.343+0000 7f311eab09c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:53:46.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.343+0000 7f311eab09c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:53:46.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.347+0000 7f311eab09c0 10 cls_bucket_list_unordered: got __ 2024-09-12T17:53:46.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.351+0000 7f311eab09c0 10 cls_bucket_list_unordered: got obj 2024-09-12T17:53:46.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.351+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd453b80 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55cacd457328 s->prefetch_data=0 2024-09-12T17:53:46.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.351+0000 7f311eab09c0 10 manifest: total_size = 0 2024-09-12T17:53:46.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.351+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.9846789431961091269 2024-09-12T17:53:46.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.351+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd453b80 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55cacd457328 s->prefetch_data=0 2024-09-12T17:53:46.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.351+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd457328 2024-09-12T17:53:46.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.351+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.6.2 2024-09-12T17:53:46.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.359+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd453b80 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55cacd457328 s->prefetch_data=0 2024-09-12T17:53:46.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.359+0000 7f311eab09c0 10 manifest: total_size = 0 2024-09-12T17:53:46.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.359+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.5759592201620444896 2024-09-12T17:53:46.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.359+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd453b80 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55cacd457328 s->prefetch_data=0 2024-09-12T17:53:46.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.359+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd457328 2024-09-12T17:53:46.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.359+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.6.3 2024-09-12T17:53:46.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.359+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:53:46.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.367+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0fe2f0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55cacd457328 s->prefetch_data=0 2024-09-12T17:53:46.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.367+0000 7f311eab09c0 10 manifest: total_size = 0 2024-09-12T17:53:46.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.367+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.9228375736533224553 2024-09-12T17:53:46.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.367+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0fe2f0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55cacd457328 s->prefetch_data=0 2024-09-12T17:53:46.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.367+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd457328 2024-09-12T17:53:46.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.367+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.6.6 2024-09-12T17:53:46.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.371+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:53:46.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.371+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0fe2f0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55cacd457328 s->prefetch_data=0 2024-09-12T17:53:46.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.371+0000 7f311eab09c0 10 manifest: total_size = 0 2024-09-12T17:53:46.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.371+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.11882973956436985600 2024-09-12T17:53:46.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.371+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0fe2f0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55cacd457328 s->prefetch_data=0 2024-09-12T17:53:46.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.371+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd457328 2024-09-12T17:53:46.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.371+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.6.8 2024-09-12T17:53:46.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.375+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:53:46.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.379+0000 7f311eab09c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:46.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.379+0000 7f311eab09c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:46.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.383+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:53:46.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.383+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:46.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.383+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:46.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.383+0000 7f311eab09c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:46.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.383+0000 7f311eab09c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:46.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.383+0000 7f311eab09c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[a01e4849-e968-46ce-97f1-a673c26b3735.4529.6])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:46.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.387+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T17:53:46.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.387+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.387+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:53:46.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.387+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T17:53:46.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.387+0000 7f311eab09c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T17:53:46.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.391+0000 7f311eab09c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T17:53:46.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.391+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T17:53:46.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.391+0000 7f2ff2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366243 cookie 94329515375888 notifier 5636 bl.length()=181 2024-09-12T17:53:46.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.395+0000 7f311eab09c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.6 from cache 2024-09-12T17:53:46.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.395+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:a01e4849-e968-46ce-97f1-a673c26b3735.4529.6, ofs0, ns] 2024-09-12T17:53:46.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.399+0000 7f2ff37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366164 cookie 94329515410384 notifier 5636 bl.length()=238 2024-09-12T17:53:46.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.407+0000 7f311eab09c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.6 : miss 2024-09-12T17:53:46.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.407+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.407+0000 7f311eab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:46.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.407+0000 7f311eab09c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.6 info.flags=0x0 2024-09-12T17:53:46.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.407+0000 7f311eab09c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/a01e4849-e968-46ce-97f1-a673c26b3735.4529.6 to cache LRU end 2024-09-12T17:53:46.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.411+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a01e4849-e968-46ce-97f1-a673c26b3735.4529.7 : miss 2024-09-12T17:53:46.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.411+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.411+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:53:46.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.411+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a01e4849-e968-46ce-97f1-a673c26b3735.4529.7 info.flags=0x17 2024-09-12T17:53:46.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.411+0000 7f311eab09c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a01e4849-e968-46ce-97f1-a673c26b3735.4529.7 to cache LRU end 2024-09-12T17:53:46.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.411+0000 7f311eab09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:46.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.411+0000 7f311eab09c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:46.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.411+0000 7f311eab09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a01e4849-e968-46ce-97f1-a673c26b3735.4529.7 2024-09-12T17:53:46.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.415+0000 7f311eab09c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:53:46.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.415+0000 7f311eab09c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:53:46.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.419+0000 7f311eab09c0 10 cls_bucket_list_unordered: got __ 2024-09-12T17:53:46.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.419+0000 7f311eab09c0 10 cls_bucket_list_unordered: got obj 2024-09-12T17:53:46.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.423+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd4ce160 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55cacd46be58 s->prefetch_data=0 2024-09-12T17:53:46.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.423+0000 7f311eab09c0 10 manifest: total_size = 527 2024-09-12T17:53:46.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.423+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.4410566173522830500 2024-09-12T17:53:46.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.423+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd4ce160 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55cacd46be58 s->prefetch_data=0 2024-09-12T17:53:46.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.423+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd46be58 2024-09-12T17:53:46.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.423+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.7.2 2024-09-12T17:53:46.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.427+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.427+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.427+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.4410566173522830500 2024-09-12T17:53:46.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.427+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.427+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.7__shadow_.uCMRsBvhfse7CEI4DXY4lZ3MsTBT8nH_0 2024-09-12T17:53:46.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.427+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:53:46.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.427+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.427+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.4410566173522830500 2024-09-12T17:53:46.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.431+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:53:46.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.431+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd4ce160 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55cacd46be58 s->prefetch_data=0 2024-09-12T17:53:46.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.435+0000 7f311eab09c0 10 manifest: total_size = 524288 2024-09-12T17:53:46.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.435+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.2618137070292821566 2024-09-12T17:53:46.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.435+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd4ce160 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55cacd46be58 s->prefetch_data=0 2024-09-12T17:53:46.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.435+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd46be58 2024-09-12T17:53:46.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.435+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.7.3 2024-09-12T17:53:46.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.439+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.439+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.439+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.2618137070292821566 2024-09-12T17:53:46.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.439+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.439+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.7__shadow_.YKo78AYUPbhXMOlfMeu_oSSSG9_R0w6_0 2024-09-12T17:53:46.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.439+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:53:46.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.439+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.439+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.2618137070292821566 2024-09-12T17:53:46.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.443+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:53:46.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.443+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd4ce160 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55cacd46be58 s->prefetch_data=0 2024-09-12T17:53:46.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.443+0000 7f311eab09c0 10 manifest: total_size = 2078 2024-09-12T17:53:46.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.443+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.3460684477473836712 2024-09-12T17:53:46.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.443+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd4ce160 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55cacd46be58 s->prefetch_data=0 2024-09-12T17:53:46.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.443+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd46be58 2024-09-12T17:53:46.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.443+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.7.6 2024-09-12T17:53:46.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.447+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.447+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.447+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.3460684477473836712 2024-09-12T17:53:46.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.447+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.447+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.7__shadow_.HH_tip4sZbq4E6bQzJiyP_Tw5qCadX8_0 2024-09-12T17:53:46.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.447+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:53:46.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.447+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.451+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.3460684477473836712 2024-09-12T17:53:46.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.451+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:53:46.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.451+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd4ce160 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55cacd46be58 s->prefetch_data=0 2024-09-12T17:53:46.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.455+0000 7f311eab09c0 10 manifest: total_size = 24595 2024-09-12T17:53:46.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.455+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.15601182951599574927 2024-09-12T17:53:46.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.455+0000 7f311eab09c0 20 get_obj_state: octx=0x55cacd4ce160 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55cacd46be58 s->prefetch_data=0 2024-09-12T17:53:46.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.455+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd46be58 2024-09-12T17:53:46.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.455+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.7.8 2024-09-12T17:53:46.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.459+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.459+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.459+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.15601182951599574927 2024-09-12T17:53:46.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.459+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.459+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.7__shadow_.qPao8U24e0udHsz7PlGtUG8U_vUcBQa_0 2024-09-12T17:53:46.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.459+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:46.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.459+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.459+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.15601182951599574927 2024-09-12T17:53:46.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.463+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:53:46.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.463+0000 7f311eab09c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:46.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.463+0000 7f311eab09c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:46.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.467+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:46.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.467+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:46.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.467+0000 7f311eab09c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:46.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.467+0000 7f311eab09c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:46.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.467+0000 7f311eab09c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[a01e4849-e968-46ce-97f1-a673c26b3735.4529.7])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:46.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.471+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T17:53:46.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.471+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.471+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:53:46.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.471+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T17:53:46.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.471+0000 7f311eab09c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T17:53:46.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.475+0000 7f311eab09c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T17:53:46.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.475+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T17:53:46.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.475+0000 7f2ff37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366244 cookie 94329515375888 notifier 5636 bl.length()=181 2024-09-12T17:53:46.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.483+0000 7f311eab09c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a01e4849-e968-46ce-97f1-a673c26b3735.4529.7 from cache 2024-09-12T17:53:46.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.483+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:a01e4849-e968-46ce-97f1-a673c26b3735.4529.7, ofs0, ns] 2024-09-12T17:53:46.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.483+0000 7f2ff37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366165 cookie 94329515410384 notifier 5636 bl.length()=238 2024-09-12T17:53:46.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.491+0000 7f311eab09c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/a01e4849-e968-46ce-97f1-a673c26b3735.4529.7 : miss 2024-09-12T17:53:46.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.491+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.491+0000 7f311eab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:46.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.491+0000 7f311eab09c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/a01e4849-e968-46ce-97f1-a673c26b3735.4529.7 info.flags=0x0 2024-09-12T17:53:46.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.491+0000 7f311eab09c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/a01e4849-e968-46ce-97f1-a673c26b3735.4529.7 to cache LRU end 2024-09-12T17:53:46.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.499+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a01e4849-e968-46ce-97f1-a673c26b3735.4529.8 : miss 2024-09-12T17:53:46.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.499+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.499+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T17:53:46.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.499+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a01e4849-e968-46ce-97f1-a673c26b3735.4529.8 info.flags=0x17 2024-09-12T17:53:46.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.499+0000 7f311eab09c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a01e4849-e968-46ce-97f1-a673c26b3735.4529.8 to cache LRU end 2024-09-12T17:53:46.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.499+0000 7f311eab09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:46.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.499+0000 7f311eab09c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T17:53:46.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.499+0000 7f311eab09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a01e4849-e968-46ce-97f1-a673c26b3735.4529.8 2024-09-12T17:53:46.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.503+0000 7f311eab09c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T17:53:46.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.503+0000 7f311eab09c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T17:53:46.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.507+0000 7f311eab09c0 10 cls_bucket_list_unordered: got __ 2024-09-12T17:53:46.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.507+0000 7f311eab09c0 10 cls_bucket_list_unordered: got obj 2024-09-12T17:53:46.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.511+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0fdf40 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55cacd4640f8 s->prefetch_data=0 2024-09-12T17:53:46.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.511+0000 7f311eab09c0 10 manifest: total_size = 4134 2024-09-12T17:53:46.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.511+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.15567505903181073114 2024-09-12T17:53:46.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.511+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0fdf40 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55cacd4640f8 s->prefetch_data=0 2024-09-12T17:53:46.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.511+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd4640f8 2024-09-12T17:53:46.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.511+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.8.2 2024-09-12T17:53:46.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.519+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.519+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.519+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.15567505903181073114 2024-09-12T17:53:46.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.519+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.519+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.8__shadow_.uMOZt6oJjpahHRtuacyRC1ixaMPvzBY_0 2024-09-12T17:53:46.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.519+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:46.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.519+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.519+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.15567505903181073114 2024-09-12T17:53:46.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.523+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=___ 2024-09-12T17:53:46.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.523+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0fdf40 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55cacd4640f8 s->prefetch_data=0 2024-09-12T17:53:46.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.523+0000 7f311eab09c0 10 manifest: total_size = 55 2024-09-12T17:53:46.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.523+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.8229521278353248611 2024-09-12T17:53:46.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.523+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0fdf40 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55cacd4640f8 s->prefetch_data=0 2024-09-12T17:53:46.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.523+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd4640f8 2024-09-12T17:53:46.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.523+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.8.3 2024-09-12T17:53:46.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.531+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.531+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.531+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.8229521278353248611 2024-09-12T17:53:46.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.531+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.531+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.8__shadow_.c5nzFKP9F9109Vk_Edu1jXbBezXf_a5_0 2024-09-12T17:53:46.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.531+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T17:53:46.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.531+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.531+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.8229521278353248611 2024-09-12T17:53:46.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.531+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T17:53:46.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.535+0000 7f311eab09c0 20 get_obj_state: octx=0x7f3114050f80 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55cacd4640f8 s->prefetch_data=0 2024-09-12T17:53:46.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.535+0000 7f311eab09c0 10 manifest: total_size = 4134 2024-09-12T17:53:46.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.535+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.15048431275124179164 2024-09-12T17:53:46.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.535+0000 7f311eab09c0 20 get_obj_state: octx=0x7f3114050f80 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55cacd4640f8 s->prefetch_data=0 2024-09-12T17:53:46.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.535+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd4640f8 2024-09-12T17:53:46.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.535+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.8.6 2024-09-12T17:53:46.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.539+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.539+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.539+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.15048431275124179164 2024-09-12T17:53:46.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.539+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.539+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.8__shadow_.jfdh2srSO8cLfefphV4Q9xKEhKa69Zj_0 2024-09-12T17:53:46.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.539+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:46.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.539+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.539+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.15048431275124179164 2024-09-12T17:53:46.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.543+0000 7f2ff2ffd640 20 handle_completion(): completion ok for obj=__ 2024-09-12T17:53:46.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.543+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0fdf40 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55cacd4640f8 s->prefetch_data=0 2024-09-12T17:53:46.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.547+0000 7f311eab09c0 10 manifest: total_size = 55 2024-09-12T17:53:46.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.547+0000 7f311eab09c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.10066916386761290628 2024-09-12T17:53:46.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.547+0000 7f311eab09c0 20 get_obj_state: octx=0x7f310c0fdf40 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55cacd4640f8 s->prefetch_data=0 2024-09-12T17:53:46.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.547+0000 7f311eab09c0 20 prepare_atomic_modification: state is not atomic. state=0x55cacd4640f8 2024-09-12T17:53:46.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.547+0000 7f311eab09c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.8.8 2024-09-12T17:53:46.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.551+0000 7f311eab09c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T17:53:46.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.551+0000 7f311eab09c0 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-12T17:53:46.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.551+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.10066916386761290628 2024-09-12T17:53:46.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.551+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T17:53:46.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.551+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a01e4849-e968-46ce-97f1-a673c26b3735.4529.8__shadow_.bDNq8AdYpJsMTuEOOwzAktKhKrQEx-p_0 2024-09-12T17:53:46.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.551+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T17:53:46.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.551+0000 7f311eab09c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T17:53:46.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.551+0000 7f311eab09c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: a01e4849-e968-46ce-97f1-a673c26b3735.4529.10066916386761290628 2024-09-12T17:53:46.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.555+0000 7f2ff37fe640 20 handle_completion(): completion ok for obj=obj 2024-09-12T17:53:46.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.555+0000 7f311eab09c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:53:46.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.555+0000 7f311eab09c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:53:46.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.559+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:53:46.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.559+0000 7f311eab09c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:53:46.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.559+0000 7f311eab09c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:53:46.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.559+0000 7f311eab09c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:53:46.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.559+0000 7f311eab09c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[a01e4849-e968-46ce-97f1-a673c26b3735.4529.8])"; uploads.size()=0; is_truncated=0 2024-09-12T17:53:46.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.563+0000 7f311eab09c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T17:53:46.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.563+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.563+0000 7f311eab09c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T17:53:46.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.563+0000 7f311eab09c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T17:53:46.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.563+0000 7f311eab09c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T17:53:46.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.567+0000 7f311eab09c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T17:53:46.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.567+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T17:53:46.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.567+0000 7f2ff37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366245 cookie 94329515375888 notifier 5636 bl.length()=181 2024-09-12T17:53:46.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.575+0000 7f311eab09c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a01e4849-e968-46ce-97f1-a673c26b3735.4529.8 from cache 2024-09-12T17:53:46.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.575+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:a01e4849-e968-46ce-97f1-a673c26b3735.4529.8, ofs0, ns] 2024-09-12T17:53:46.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.575+0000 7f2ff37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366166 cookie 94329515410384 notifier 5636 bl.length()=238 2024-09-12T17:53:46.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.583+0000 7f311eab09c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/a01e4849-e968-46ce-97f1-a673c26b3735.4529.8 : miss 2024-09-12T17:53:46.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.583+0000 7f311eab09c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.587+0000 7f311eab09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:46.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.587+0000 7f311eab09c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/a01e4849-e968-46ce-97f1-a673c26b3735.4529.8 info.flags=0x0 2024-09-12T17:53:46.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.587+0000 7f311eab09c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/a01e4849-e968-46ce-97f1-a673c26b3735.4529.8 to cache LRU end 2024-09-12T17:53:46.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.591+0000 7f311eab09c0 10 removing key index: YHRSGAUAVLOOIMVQOFHZ 2024-09-12T17:53:46.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.591+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:YHRSGAUAVLOOIMVQOFHZ, ofs0, ns] 2024-09-12T17:53:46.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.595+0000 7f2ff2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366167 cookie 94329515410384 notifier 5636 bl.length()=170 2024-09-12T17:53:46.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.595+0000 7f311eab09c0 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T17:53:46.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.599+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T17:53:46.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.599+0000 7f2ff2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366170 cookie 94329515406336 notifier 5636 bl.length()=182 2024-09-12T17:53:46.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.603+0000 7f311eab09c0 10 removing user buckets index 2024-09-12T17:53:46.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.607+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T17:53:46.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.607+0000 7f2ff2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366166 cookie 94329515412688 notifier 5636 bl.length()=173 2024-09-12T17:53:46.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.611+0000 7f311eab09c0 10 removing user index: ragweed.client.0 2024-09-12T17:53:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.611+0000 7f311eab09c0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T17:53:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.611+0000 7f311eab09c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T17:53:46.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.615+0000 7f2ff37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366180 cookie 94329515407664 notifier 5636 bl.length()=165 2024-09-12T17:53:46.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.623+0000 7f2fd2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:46.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.627+0000 7f311eab09c0 20 remove_watcher() i=0 2024-09-12T17:53:46.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.627+0000 7f311eab09c0 2 removed watcher, disabling cache 2024-09-12T17:53:46.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.631+0000 7f311eab09c0 20 remove_watcher() i=1 2024-09-12T17:53:46.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.635+0000 7f311eab09c0 20 remove_watcher() i=2 2024-09-12T17:53:46.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.635+0000 7f311eab09c0 20 remove_watcher() i=3 2024-09-12T17:53:46.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.639+0000 7f311eab09c0 20 remove_watcher() i=4 2024-09-12T17:53:46.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.639+0000 7f311eab09c0 20 remove_watcher() i=5 2024-09-12T17:53:46.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.643+0000 7f311eab09c0 20 remove_watcher() i=6 2024-09-12T17:53:46.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.643+0000 7f311eab09c0 20 remove_watcher() i=7 2024-09-12T17:53:46.667 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T17:53:46.747 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:53:46.747 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:53:46.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.787+0000 7fa183ea99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.791+0000 7fa183ea99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:46.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.791+0000 7fa183ea99c0 20 realm 2024-09-12T17:53:46.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.791+0000 7fa183ea99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.791+0000 7fa183ea99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:46.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.791+0000 7fa183ea99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:53:46.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.791+0000 7fa183ea99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.791+0000 7fa183ea99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:46.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.791+0000 7fa183ea99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.791+0000 7fa183ea99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:46.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.791+0000 7fa183ea99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:46.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.791+0000 7fa183ea99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:53:46.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.791+0000 7fa183ea99c0 20 searching for the correct realm 2024-09-12T17:53:46.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:46.799+0000 7fa1811ae640 0 -- 172.21.15.98:0/304656524 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fa174058040 msgr2=0x7fa174058930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:53:47.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.007+0000 7fa1819af640 0 -- 172.21.15.98:0/304656524 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fa16c0899a0 msgr2=0x7fa16c089170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:53:47.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.423+0000 7fa183ea99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:53:47.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.423+0000 7fa183ea99c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:53:47.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.423+0000 7fa183ea99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:53:47.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.423+0000 7fa183ea99c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:53:47.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.423+0000 7fa183ea99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:53:47.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.423+0000 7fa183ea99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:53:47.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.423+0000 7fa183ea99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:47.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.423+0000 7fa183ea99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:47.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.423+0000 7fa183ea99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:47.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.427+0000 7fa183ea99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:53:47.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.427+0000 7fa183ea99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:47.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.427+0000 7fa183ea99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:53:47.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.427+0000 7fa183ea99c0 20 zone default found 2024-09-12T17:53:47.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.427+0000 7fa183ea99c0 4 Realm: () 2024-09-12T17:53:47.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.427+0000 7fa183ea99c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:53:47.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.427+0000 7fa183ea99c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:53:47.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.427+0000 7fa183ea99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:53:47.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.427+0000 7fa183ea99c0 20 zonegroup default 2024-09-12T17:53:47.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.427+0000 7fa183ea99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:47.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.427+0000 7fa183ea99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:47.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.427+0000 7fa183ea99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:47.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.427+0000 7fa183ea99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:47.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.427+0000 7fa183ea99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:47.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.427+0000 7fa183ea99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:53:47.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.427+0000 7fa183ea99c0 20 started sync module instance, tier type = 2024-09-12T17:53:47.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.427+0000 7fa183ea99c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:53:47.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.451+0000 7fa183ea99c0 20 add_watcher() i=0 2024-09-12T17:53:47.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.451+0000 7fa183ea99c0 20 add_watcher() i=1 2024-09-12T17:53:47.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.451+0000 7fa183ea99c0 20 add_watcher() i=2 2024-09-12T17:53:47.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.451+0000 7fa183ea99c0 20 add_watcher() i=3 2024-09-12T17:53:47.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.451+0000 7fa183ea99c0 20 add_watcher() i=4 2024-09-12T17:53:47.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.451+0000 7fa183ea99c0 20 add_watcher() i=5 2024-09-12T17:53:47.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.451+0000 7fa183ea99c0 20 add_watcher() i=6 2024-09-12T17:53:47.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.455+0000 7fa183ea99c0 20 add_watcher() i=7 2024-09-12T17:53:47.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.455+0000 7fa183ea99c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:53:47.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.459+0000 7fa037fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:47.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.459+0000 7fa183ea99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:53:47.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.459+0000 7fa183ea99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:53:47.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.563+0000 7fa036fe5640 20 reqs_thread_entry: start 2024-09-12T17:53:47.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.563+0000 7fa183ea99c0 20 init_complete bucket index max shards: 11 2024-09-12T17:53:47.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.563+0000 7fa183ea99c0 20 Filter name: none 2024-09-12T17:53:47.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.563+0000 7fa034fe1640 20 reqs_thread_entry: start 2024-09-12T17:53:47.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.563+0000 7fa183ea99c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T17:53:47.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.563+0000 7fa183ea99c0 20 rados->read ofs=0 len=0 2024-09-12T17:53:47.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.563+0000 7fa183ea99c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T17:53:47.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.563+0000 7fa183ea99c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T17:53:47.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.563+0000 7fa183ea99c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T17:53:47.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.563+0000 7fa183ea99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:53:47.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.567+0000 7fa183ea99c0 10 removing key index: IDWKJKUJGIIKDOAQGWCF 2024-09-12T17:53:47.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.567+0000 7fa183ea99c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:IDWKJKUJGIIKDOAQGWCF, ofs0, ns] 2024-09-12T17:53:47.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.567+0000 7fa0657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366167 cookie 94583094073680 notifier 6039 bl.length()=170 2024-09-12T17:53:47.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.571+0000 7fa183ea99c0 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T17:53:47.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.575+0000 7fa183ea99c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T17:53:47.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.575+0000 7fa064ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366181 cookie 94583094068224 notifier 6039 bl.length()=182 2024-09-12T17:53:47.578 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.579+0000 7fa183ea99c0 10 removing user buckets index 2024-09-12T17:53:47.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.579+0000 7fa183ea99c0 10 removing user index: sysuser.client.0 2024-09-12T17:53:47.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.583+0000 7fa183ea99c0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T17:53:47.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.583+0000 7fa183ea99c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T17:53:47.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.583+0000 7fa064ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366171 cookie 94583094062032 notifier 6039 bl.length()=165 2024-09-12T17:53:47.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.587+0000 7fa037fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:53:47.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.591+0000 7fa183ea99c0 20 remove_watcher() i=0 2024-09-12T17:53:47.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.591+0000 7fa183ea99c0 2 removed watcher, disabling cache 2024-09-12T17:53:47.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.595+0000 7fa183ea99c0 20 remove_watcher() i=1 2024-09-12T17:53:47.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.599+0000 7fa183ea99c0 20 remove_watcher() i=2 2024-09-12T17:53:47.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.599+0000 7fa183ea99c0 20 remove_watcher() i=3 2024-09-12T17:53:47.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.603+0000 7fa183ea99c0 20 remove_watcher() i=4 2024-09-12T17:53:47.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.603+0000 7fa183ea99c0 20 remove_watcher() i=5 2024-09-12T17:53:47.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.603+0000 7fa183ea99c0 20 remove_watcher() i=6 2024-09-12T17:53:47.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T17:53:47.607+0000 7fa183ea99c0 20 remove_watcher() i=7 2024-09-12T17:53:47.622 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T17:53:47.622 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T17:53:47.721 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:53:47.735 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:53:47.735 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:53:47.735 DEBUG:teuthology.orchestra.run.smithi098:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:53:47.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:53:47.741 INFO:teuthology.orchestra.run.smithi098.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:53:47.742 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:53:47.794 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:53:47.795 DEBUG:teuthology.orchestra.run.smithi098:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:53:47.843 INFO:tasks.workunit:timeout=3h 2024-09-12T17:53:47.843 INFO:tasks.workunit:cleanup=True 2024-09-12T17:53:47.843 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:53:47.893 INFO:tasks.workunit.client.0.smithi098.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:54:45.772 INFO:tasks.workunit.client.0.smithi098.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:54:45.773 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:54:45.773 INFO:tasks.workunit.client.0.smithi098.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:54:45.773 INFO:tasks.workunit.client.0.smithi098.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:54:45.773 INFO:tasks.workunit.client.0.smithi098.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:54:45.773 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:54:45.773 INFO:tasks.workunit.client.0.smithi098.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:54:45.773 INFO:tasks.workunit.client.0.smithi098.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:54:45.773 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:54:45.773 INFO:tasks.workunit.client.0.smithi098.stderr: git switch -c 2024-09-12T17:54:45.773 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:54:45.774 INFO:tasks.workunit.client.0.smithi098.stderr:Or undo this operation with: 2024-09-12T17:54:45.774 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:54:45.774 INFO:tasks.workunit.client.0.smithi098.stderr: git switch - 2024-09-12T17:54:45.774 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:54:45.774 INFO:tasks.workunit.client.0.smithi098.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:54:45.774 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:54:45.774 INFO:tasks.workunit.client.0.smithi098.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:54:45.780 DEBUG:teuthology.orchestra.run.smithi098:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:54:45.827 INFO:tasks.workunit.client.0.smithi098.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:54:45.829 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:54:45.829 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:54:45.888 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:54:45.944 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:54:45.984 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:54:45.985 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:54:45.985 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:54:46.025 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:54:46.029 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T17:54:46.029 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:54:46.074 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T17:54:46.076 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T17:54:46.076 DEBUG:teuthology.orchestra.run.smithi098:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T17:54:46.126 INFO:tasks.workunit.client.0.smithi098.stderr:+ ulimit -c 0 2024-09-12T17:54:46.127 INFO:tasks.workunit.client.0.smithi098.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T17:54:46.128 INFO:tasks.workunit.client.0.smithi098.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:54:46.128 INFO:tasks.workunit.client.0.smithi098.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:54:49.212 INFO:tasks.workunit.client.0.smithi098.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T17:54:49.212 INFO:tasks.workunit.client.0.smithi098.stderr:++ deactivate nondestructive 2024-09-12T17:54:49.212 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -n '' ']' 2024-09-12T17:54:49.212 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -n '' ']' 2024-09-12T17:54:49.212 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:54:49.213 INFO:tasks.workunit.client.0.smithi098.stderr:++ hash -r 2024-09-12T17:54:49.213 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -n '' ']' 2024-09-12T17:54:49.213 INFO:tasks.workunit.client.0.smithi098.stderr:++ unset VIRTUAL_ENV 2024-09-12T17:54:49.213 INFO:tasks.workunit.client.0.smithi098.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T17:54:49.213 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T17:54:49.213 INFO:tasks.workunit.client.0.smithi098.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T17:54:49.213 INFO:tasks.workunit.client.0.smithi098.stderr:++ export VIRTUAL_ENV 2024-09-12T17:54:49.213 INFO:tasks.workunit.client.0.smithi098.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:54:49.213 INFO:tasks.workunit.client.0.smithi098.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T17:54:49.213 INFO:tasks.workunit.client.0.smithi098.stderr:++ export PATH 2024-09-12T17:54:49.213 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -n '' ']' 2024-09-12T17:54:49.213 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -z '' ']' 2024-09-12T17:54:49.213 INFO:tasks.workunit.client.0.smithi098.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T17:54:49.214 INFO:tasks.workunit.client.0.smithi098.stderr:++ PS1='(rgw) ' 2024-09-12T17:54:49.214 INFO:tasks.workunit.client.0.smithi098.stderr:++ export PS1 2024-09-12T17:54:49.214 INFO:tasks.workunit.client.0.smithi098.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T17:54:49.214 INFO:tasks.workunit.client.0.smithi098.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T17:54:49.214 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T17:54:49.214 INFO:tasks.workunit.client.0.smithi098.stderr:++ hash -r 2024-09-12T17:54:49.214 INFO:tasks.workunit.client.0.smithi098.stderr:+ pip install pip --upgrade 2024-09-12T17:54:49.567 INFO:tasks.workunit.client.0.smithi098.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T17:54:49.779 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting pip 2024-09-12T17:54:49.785 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T17:54:49.819 INFO:tasks.workunit.client.0.smithi098.stdout:Installing collected packages: pip 2024-09-12T17:54:49.819 INFO:tasks.workunit.client.0.smithi098.stdout: Attempting uninstall: pip 2024-09-12T17:54:49.820 INFO:tasks.workunit.client.0.smithi098.stdout: Found existing installation: pip 22.0.2 2024-09-12T17:54:50.078 INFO:tasks.workunit.client.0.smithi098.stdout: Uninstalling pip-22.0.2: 2024-09-12T17:54:50.084 INFO:tasks.workunit.client.0.smithi098.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T17:54:50.809 INFO:tasks.workunit.client.0.smithi098.stdout:Successfully installed pip-24.2 2024-09-12T17:54:50.871 INFO:tasks.workunit.client.0.smithi098.stderr:+ pip install boto3 2024-09-12T17:54:51.850 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting boto3 2024-09-12T17:54:51.851 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T17:54:52.361 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T17:54:52.362 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T17:54:52.418 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T17:54:52.419 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T17:54:52.465 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T17:54:52.467 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T17:54:52.516 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:54:52.517 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T17:54:52.618 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:54:52.619 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T17:54:52.805 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T17:54:52.806 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T17:54:52.811 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T17:54:52.812 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T17:54:52.821 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T17:54:52.823 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T17:54:52.823 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T17:54:52.825 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T17:54:52.826 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T17:54:52.894 INFO:tasks.workunit.client.0.smithi098.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T17:54:54.071 INFO:tasks.workunit.client.0.smithi098.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T17:54:54.287 INFO:tasks.workunit.client.0.smithi098.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T17:54:54.433 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T17:54:54.471 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:54:54.471 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:54:54.513 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.511+0000 7fddd2ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.515+0000 7fddd2ed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.515+0000 7fddd2ed09c0 20 realm 2024-09-12T17:54:54.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.515+0000 7fddd2ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.515+0000 7fddd2ed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.515+0000 7fddd2ed09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:54:54.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.515+0000 7fddd2ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.515+0000 7fddd2ed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.515+0000 7fddd2ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.515+0000 7fddd2ed09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:54.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.515+0000 7fddd2ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.515+0000 7fddd2ed09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:54:54.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.515+0000 7fddd2ed09c0 20 searching for the correct realm 2024-09-12T17:54:54.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.523+0000 7fddd11d7640 0 -- 172.21.15.98:0/3375599502 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7fddc00ac990 msgr2=0x7fddc00c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:54.739 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.739+0000 7fddd09d6640 0 -- 172.21.15.98:0/3375599502 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x559debd0e740 msgr2=0x559debd10b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:54:54.746 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.747+0000 7fddd2ed09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:54:54.746 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.747+0000 7fddd2ed09c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:54:54.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.747+0000 7fddd2ed09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:54:54.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.747+0000 7fddd2ed09c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:54:54.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.747+0000 7fddd2ed09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:54:54.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.747+0000 7fddd2ed09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:54:54.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.747+0000 7fddd2ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.747+0000 7fddd2ed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.747+0000 7fddd2ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.747+0000 7fddd2ed09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:54:54.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.747+0000 7fddd2ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.747+0000 7fddd2ed09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:54:54.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.747+0000 7fddd2ed09c0 20 zone default found 2024-09-12T17:54:54.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.747+0000 7fddd2ed09c0 4 Realm: () 2024-09-12T17:54:54.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.747+0000 7fddd2ed09c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:54:54.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.747+0000 7fddd2ed09c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:54:54.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.747+0000 7fddd2ed09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:54:54.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.747+0000 7fddd2ed09c0 20 zonegroup default 2024-09-12T17:54:54.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.747+0000 7fddd2ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.751+0000 7fddd2ed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.751+0000 7fddd2ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.751+0000 7fddd2ed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.751+0000 7fddd2ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.751+0000 7fddd2ed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.751+0000 7fddd2ed09c0 20 started sync module instance, tier type = 2024-09-12T17:54:54.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.751+0000 7fddd2ed09c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:54:54.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.775+0000 7fddd2ed09c0 20 add_watcher() i=0 2024-09-12T17:54:54.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.775+0000 7fddd2ed09c0 20 add_watcher() i=1 2024-09-12T17:54:54.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.775+0000 7fddd2ed09c0 20 add_watcher() i=2 2024-09-12T17:54:54.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.775+0000 7fddd2ed09c0 20 add_watcher() i=3 2024-09-12T17:54:54.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.775+0000 7fddd2ed09c0 20 add_watcher() i=4 2024-09-12T17:54:54.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.775+0000 7fddd2ed09c0 20 add_watcher() i=5 2024-09-12T17:54:54.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.775+0000 7fddd2ed09c0 20 add_watcher() i=6 2024-09-12T17:54:54.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.779+0000 7fddd2ed09c0 20 add_watcher() i=7 2024-09-12T17:54:54.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.779+0000 7fddd2ed09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:54:54.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.783+0000 7fdc86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:54.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.783+0000 7fddd2ed09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:54:54.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.783+0000 7fddd2ed09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:54:54.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.783+0000 7fddd2ed09c0 5 note: GC not initialized 2024-09-12T17:54:54.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.783+0000 7fdc85fe3640 20 reqs_thread_entry: start 2024-09-12T17:54:54.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.783+0000 7fddd2ed09c0 20 init_complete bucket index max shards: 11 2024-09-12T17:54:54.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.783+0000 7fddd2ed09c0 20 Filter name: none 2024-09-12T17:54:54.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.783+0000 7fdbf77fe640 20 reqs_thread_entry: start 2024-09-12T17:54:54.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.783+0000 7fddd2ed09c0 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T17:54:54.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.783+0000 7fddd2ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.787+0000 7fddd2ed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.787+0000 7fddd2ed09c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T17:54:54.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.787+0000 7fddd2ed09c0 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T17:54:54.787 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.787+0000 7fddd2ed09c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T17:54:54.787 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.787+0000 7fddd2ed09c0 20 rados->read ofs=0 len=0 2024-09-12T17:54:54.787 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.787+0000 7fddd2ed09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:54:54.787 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.787+0000 7fddd2ed09c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-12T17:54:54.787 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.787+0000 7fddd2ed09c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:54:54.787 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.787+0000 7fddd2ed09c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T17:54:54.787 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.787+0000 7fddd2ed09c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T17:54:54.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.787+0000 7fddd2ed09c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T17:54:54.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.787+0000 7fddd2ed09c0 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T17:54:54.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.787+0000 7fddd2ed09c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-12T17:54:54.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.791+0000 7fdca7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366168 cookie 94136754612480 notifier 6054 bl.length()=569 2024-09-12T17:54:54.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.791+0000 7fdca7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T17:54:54.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.791+0000 7fdca7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T17:54:54.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.795+0000 7fddd2ed09c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T17:54:54.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.795+0000 7fddd2ed09c0 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:54:54.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.795+0000 7fddd2ed09c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T17:54:54.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.795+0000 7fdca77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366169 cookie 94136754608496 notifier 6054 bl.length()=180 2024-09-12T17:54:54.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.795+0000 7fdca77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T17:54:54.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.795+0000 7fdca77fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:54:54.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.799+0000 7fdc86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:54:54.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.803+0000 7fddd2ed09c0 20 remove_watcher() i=0 2024-09-12T17:54:54.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.803+0000 7fddd2ed09c0 2 removed watcher, disabling cache 2024-09-12T17:54:54.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.803+0000 7fddd2ed09c0 20 remove_watcher() i=1 2024-09-12T17:54:54.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.807+0000 7fddd2ed09c0 20 remove_watcher() i=2 2024-09-12T17:54:54.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.811+0000 7fddd2ed09c0 20 remove_watcher() i=3 2024-09-12T17:54:54.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.811+0000 7fddd2ed09c0 20 remove_watcher() i=4 2024-09-12T17:54:54.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.815+0000 7fddd2ed09c0 20 remove_watcher() i=5 2024-09-12T17:54:54.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.815+0000 7fddd2ed09c0 20 remove_watcher() i=6 2024-09-12T17:54:54.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:54:54.815+0000 7fddd2ed09c0 20 remove_watcher() i=7 2024-09-12T17:55:15.145 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:15.145 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:15.217 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:15.218 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:15.336 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:15.337 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:15.439 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:15.440 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:15.522 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:15.522 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:15.594 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:15.594 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:15.679 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard add 2024-09-12T17:55:15.679 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:15.679 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:55:15.713 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:15.713 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:15.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.754+0000 7ffb23c969c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.758+0000 7ffb23c969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:15.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.758+0000 7ffb23c969c0 20 realm 2024-09-12T17:55:15.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.758+0000 7ffb23c969c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.758+0000 7ffb23c969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:15.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.758+0000 7ffb23c969c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:15.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.758+0000 7ffb23c969c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.758+0000 7ffb23c969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:15.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.758+0000 7ffb23c969c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.758+0000 7ffb23c969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:15.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.758+0000 7ffb23c969c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.761 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.758+0000 7ffb23c969c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:15.761 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.758+0000 7ffb23c969c0 20 searching for the correct realm 2024-09-12T17:55:15.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.766+0000 7ffb20f9b640 0 -- 172.21.15.98:0/1059643900 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x56116658f0e0 msgr2=0x5611665914d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:15.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.770+0000 7ffb2179c640 0 -- 172.21.15.98:0/1059643900 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7ffb1807bad0 msgr2=0x7ffb18003000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:55:15.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.778+0000 7ffb23c969c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:15.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.778+0000 7ffb23c969c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:15.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.778+0000 7ffb23c969c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:15.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.778+0000 7ffb23c969c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:15.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.778+0000 7ffb23c969c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:15.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.778+0000 7ffb23c969c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:15.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.778+0000 7ffb23c969c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.778+0000 7ffb23c969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:15.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.778+0000 7ffb23c969c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.778+0000 7ffb23c969c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:15.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.778+0000 7ffb23c969c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.778+0000 7ffb23c969c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:15.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.778+0000 7ffb23c969c0 20 zone default found 2024-09-12T17:55:15.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.778+0000 7ffb23c969c0 4 Realm: () 2024-09-12T17:55:15.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.778+0000 7ffb23c969c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:15.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.778+0000 7ffb23c969c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:15.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.778+0000 7ffb23c969c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:15.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.778+0000 7ffb23c969c0 20 zonegroup default 2024-09-12T17:55:15.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.778+0000 7ffb23c969c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.782+0000 7ffb23c969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:15.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.782+0000 7ffb23c969c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.782+0000 7ffb23c969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:15.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.782+0000 7ffb23c969c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.782+0000 7ffb23c969c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:15.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.782+0000 7ffb23c969c0 20 started sync module instance, tier type = 2024-09-12T17:55:15.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.782+0000 7ffb23c969c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:15.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.798+0000 7ffb23c969c0 20 add_watcher() i=0 2024-09-12T17:55:15.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.798+0000 7ffb23c969c0 20 add_watcher() i=1 2024-09-12T17:55:15.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.798+0000 7ffb23c969c0 20 add_watcher() i=2 2024-09-12T17:55:15.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.798+0000 7ffb23c969c0 20 add_watcher() i=3 2024-09-12T17:55:15.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.798+0000 7ffb23c969c0 20 add_watcher() i=4 2024-09-12T17:55:15.799 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.798+0000 7ffb23c969c0 20 add_watcher() i=5 2024-09-12T17:55:15.799 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.798+0000 7ffb23c969c0 20 add_watcher() i=6 2024-09-12T17:55:15.799 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.798+0000 7ffb23c969c0 20 add_watcher() i=7 2024-09-12T17:55:15.799 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.798+0000 7ffb23c969c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:15.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.798+0000 7ff9d7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:15.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.802+0000 7ffb23c969c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:15.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.802+0000 7ffb23c969c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:15.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.802+0000 7ffb23c969c0 5 note: GC not initialized 2024-09-12T17:55:15.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.802+0000 7ff9d6fe5640 20 reqs_thread_entry: start 2024-09-12T17:55:15.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.802+0000 7ffb23c969c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:15.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.802+0000 7ffb23c969c0 20 Filter name: none 2024-09-12T17:55:15.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.802+0000 7ff9d4fe1640 20 reqs_thread_entry: start 2024-09-12T17:55:15.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.802+0000 7ffb23c969c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.802+0000 7ffb23c969c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:55:15.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.802+0000 7ffb23c969c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.802+0000 7ffb23c969c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:55:15.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.802+0000 7ffb23c969c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:15.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.802+0000 7ffb23c969c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.806+0000 7ffb23c969c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:55:15.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.806+0000 7ffb23c969c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.806+0000 7ffb23c969c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:55:15.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.806+0000 7ffb23c969c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:15.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.806+0000 7ff9d7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:15.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.814+0000 7ffb23c969c0 20 remove_watcher() i=0 2024-09-12T17:55:15.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.814+0000 7ffb23c969c0 2 removed watcher, disabling cache 2024-09-12T17:55:15.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.814+0000 7ffb23c969c0 20 remove_watcher() i=1 2024-09-12T17:55:15.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.818+0000 7ffb23c969c0 20 remove_watcher() i=2 2024-09-12T17:55:15.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.818+0000 7ffb23c969c0 20 remove_watcher() i=3 2024-09-12T17:55:15.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.822+0000 7ffb23c969c0 20 remove_watcher() i=4 2024-09-12T17:55:15.824 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.822+0000 7ffb23c969c0 20 remove_watcher() i=5 2024-09-12T17:55:15.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.826+0000 7ffb23c969c0 20 remove_watcher() i=6 2024-09-12T17:55:15.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.826+0000 7ffb23c969c0 20 remove_watcher() i=7 2024-09-12T17:55:15.841 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:15.841 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:55:15.841 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: a-bucket id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T17:55:15.841 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:15.842 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-12T17:55:15.869 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:15.869 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:15.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.910+0000 7f9ee8af39c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.914+0000 7f9ee8af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:15.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.914+0000 7f9ee8af39c0 20 realm 2024-09-12T17:55:15.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.914+0000 7f9ee8af39c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.914+0000 7f9ee8af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:15.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.914+0000 7f9ee8af39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:15.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.914+0000 7f9ee8af39c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.914+0000 7f9ee8af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:15.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.914+0000 7f9ee8af39c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.914+0000 7f9ee8af39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:15.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.914+0000 7f9ee8af39c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.914+0000 7f9ee8af39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:15.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.914+0000 7f9ee8af39c0 20 searching for the correct realm 2024-09-12T17:55:15.922 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.922+0000 7f9ee5df8640 0 -- 172.21.15.98:0/2293445990 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x557fbf779e70 msgr2=0x557fbf77c300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:15.928 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.926+0000 7f9ee65f9640 0 -- 172.21.15.98:0/2293445990 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f9ed00e5740 msgr2=0x7f9ed00b7660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:15.935 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:15.935 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:15.935 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:15.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:15.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:15.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:15.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:15.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:15.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:15.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 20 zone default found 2024-09-12T17:55:15.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 4 Realm: () 2024-09-12T17:55:15.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:15.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:15.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:15.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 20 zonegroup default 2024-09-12T17:55:15.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:15.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.934+0000 7f9ee8af39c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.938+0000 7f9ee8af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:15.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.938+0000 7f9ee8af39c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.938+0000 7f9ee8af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:15.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.938+0000 7f9ee8af39c0 20 started sync module instance, tier type = 2024-09-12T17:55:15.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.938+0000 7f9ee8af39c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:15.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.950+0000 7f9ee8af39c0 20 add_watcher() i=0 2024-09-12T17:55:15.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.950+0000 7f9ee8af39c0 20 add_watcher() i=1 2024-09-12T17:55:15.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.950+0000 7f9ee8af39c0 20 add_watcher() i=2 2024-09-12T17:55:15.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.950+0000 7f9ee8af39c0 20 add_watcher() i=3 2024-09-12T17:55:15.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.950+0000 7f9ee8af39c0 20 add_watcher() i=4 2024-09-12T17:55:15.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.950+0000 7f9ee8af39c0 20 add_watcher() i=5 2024-09-12T17:55:15.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.950+0000 7f9ee8af39c0 20 add_watcher() i=6 2024-09-12T17:55:15.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.954+0000 7f9ee8af39c0 20 add_watcher() i=7 2024-09-12T17:55:15.955 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.954+0000 7f9ee8af39c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:15.957 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.954+0000 7f9d9cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:15.958 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.958+0000 7f9ee8af39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:15.958 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.958+0000 7f9ee8af39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:15.958 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.958+0000 7f9ee8af39c0 5 note: GC not initialized 2024-09-12T17:55:15.958 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.958+0000 7f9d177fe640 20 reqs_thread_entry: start 2024-09-12T17:55:15.958 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.958+0000 7f9ee8af39c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:15.958 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.958+0000 7f9ee8af39c0 20 Filter name: none 2024-09-12T17:55:15.958 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.958+0000 7f9d157fa640 20 reqs_thread_entry: start 2024-09-12T17:55:15.958 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.958+0000 7f9ee8af39c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:55:15.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.958+0000 7f9ee8af39c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.958+0000 7f9ee8af39c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:55:15.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.958+0000 7f9ee8af39c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:55:15.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.958+0000 7f9ee8af39c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:55:15.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.958+0000 7f9ee8af39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T17:55:15.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.958+0000 7f9ee8af39c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:15.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.958+0000 7f9ee8af39c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:55:15.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.958+0000 7f9ee8af39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T17:55:15.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.958+0000 7f9ee8af39c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T17:55:15.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.958+0000 7f9ee8af39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:15.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.958+0000 7f9ee8af39c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:55:15.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.958+0000 7f9ee8af39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T17:55:15.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.962+0000 7f9d9cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:15.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.966+0000 7f9ee8af39c0 20 remove_watcher() i=0 2024-09-12T17:55:15.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.966+0000 7f9ee8af39c0 2 removed watcher, disabling cache 2024-09-12T17:55:15.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.970+0000 7f9ee8af39c0 20 remove_watcher() i=1 2024-09-12T17:55:15.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.970+0000 7f9ee8af39c0 20 remove_watcher() i=2 2024-09-12T17:55:15.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.970+0000 7f9ee8af39c0 20 remove_watcher() i=3 2024-09-12T17:55:15.975 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.974+0000 7f9ee8af39c0 20 remove_watcher() i=4 2024-09-12T17:55:15.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.974+0000 7f9ee8af39c0 20 remove_watcher() i=5 2024-09-12T17:55:15.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.978+0000 7f9ee8af39c0 20 remove_watcher() i=6 2024-09-12T17:55:15.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:15.978+0000 7f9ee8af39c0 20 remove_watcher() i=7 2024-09-12T17:55:15.993 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin reshard list 2024-09-12T17:55:16.016 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:16.017 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:16.059 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.058+0000 7fb5d86d99c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.058+0000 7fb5d86d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:16.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.058+0000 7fb5d86d99c0 20 realm 2024-09-12T17:55:16.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.058+0000 7fb5d86d99c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.058+0000 7fb5d86d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:16.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.058+0000 7fb5d86d99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:16.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.058+0000 7fb5d86d99c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.058+0000 7fb5d86d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:16.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.058+0000 7fb5d86d99c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.062+0000 7fb5d86d99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:16.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.062+0000 7fb5d86d99c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.062+0000 7fb5d86d99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:16.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.062+0000 7fb5d86d99c0 20 searching for the correct realm 2024-09-12T17:55:16.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.066+0000 7fb5d59de640 0 -- 172.21.15.98:0/594089033 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fb5d007cc30 msgr2=0x7fb5d007bcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:16.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.074+0000 7fb5d61df640 0 -- 172.21.15.98:0/594089033 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fb5c005e450 msgr2=0x7fb5c005e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:16.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:16.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:16.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:16.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:16.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:16.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:16.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:16.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:16.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:16.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 20 zone default found 2024-09-12T17:55:16.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 4 Realm: () 2024-09-12T17:55:16.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:16.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:16.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:16.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 20 zonegroup default 2024-09-12T17:55:16.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:16.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.294+0000 7fb5d86d99c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.298+0000 7fb5d86d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:16.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.298+0000 7fb5d86d99c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.298+0000 7fb5d86d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:16.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.298+0000 7fb5d86d99c0 20 started sync module instance, tier type = 2024-09-12T17:55:16.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.298+0000 7fb5d86d99c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:16.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.322+0000 7fb5d86d99c0 20 add_watcher() i=0 2024-09-12T17:55:16.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.322+0000 7fb5d86d99c0 20 add_watcher() i=1 2024-09-12T17:55:16.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.322+0000 7fb5d86d99c0 20 add_watcher() i=2 2024-09-12T17:55:16.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.322+0000 7fb5d86d99c0 20 add_watcher() i=3 2024-09-12T17:55:16.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.322+0000 7fb5d86d99c0 20 add_watcher() i=4 2024-09-12T17:55:16.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.322+0000 7fb5d86d99c0 20 add_watcher() i=5 2024-09-12T17:55:16.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.322+0000 7fb5d86d99c0 20 add_watcher() i=6 2024-09-12T17:55:16.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.326+0000 7fb5d86d99c0 20 add_watcher() i=7 2024-09-12T17:55:16.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.326+0000 7fb5d86d99c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:16.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.330+0000 7fb48cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:16.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.330+0000 7fb5d86d99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:16.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.330+0000 7fb5d86d99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:16.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.330+0000 7fb5d86d99c0 5 note: GC not initialized 2024-09-12T17:55:16.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.330+0000 7fb4077fe640 20 reqs_thread_entry: start 2024-09-12T17:55:16.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.330+0000 7fb5d86d99c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:16.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.330+0000 7fb5d86d99c0 20 Filter name: none 2024-09-12T17:55:16.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.330+0000 7fb4057fa640 20 reqs_thread_entry: start 2024-09-12T17:55:16.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.342+0000 7fb48cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:16.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.346+0000 7fb5d86d99c0 20 remove_watcher() i=0 2024-09-12T17:55:16.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.346+0000 7fb5d86d99c0 2 removed watcher, disabling cache 2024-09-12T17:55:16.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.350+0000 7fb5d86d99c0 20 remove_watcher() i=1 2024-09-12T17:55:16.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.350+0000 7fb5d86d99c0 20 remove_watcher() i=2 2024-09-12T17:55:16.355 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.354+0000 7fb5d86d99c0 20 remove_watcher() i=3 2024-09-12T17:55:16.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.358+0000 7fb5d86d99c0 20 remove_watcher() i=4 2024-09-12T17:55:16.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.358+0000 7fb5d86d99c0 20 remove_watcher() i=5 2024-09-12T17:55:16.360 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.358+0000 7fb5d86d99c0 20 remove_watcher() i=6 2024-09-12T17:55:16.361 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.362+0000 7fb5d86d99c0 20 remove_watcher() i=7 2024-09-12T17:55:16.379 INFO:tasks.workunit.client.0.smithi098.stderr:bucket name a-bucket 2024-09-12T17:55:16.379 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard process 2024-09-12T17:55:16.379 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:16.379 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin reshard process 2024-09-12T17:55:16.405 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:16.405 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:16.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.450+0000 7f814bcbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.450+0000 7f814bcbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:16.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.450+0000 7f814bcbf9c0 20 realm 2024-09-12T17:55:16.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.450+0000 7f814bcbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.450+0000 7f814bcbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:16.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.450+0000 7f814bcbf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:16.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.450+0000 7f814bcbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.450+0000 7f814bcbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:16.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.450+0000 7f814bcbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.454+0000 7f814bcbf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:16.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.454+0000 7f814bcbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.454+0000 7f814bcbf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:16.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.454+0000 7f814bcbf9c0 20 searching for the correct realm 2024-09-12T17:55:16.460 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.458+0000 7f8148fc4640 0 -- 172.21.15.98:0/235634387 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x5622e0414d80 msgr2=0x5622e0417240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:16.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.466+0000 7f81497c5640 0 -- 172.21.15.98:0/235634387 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f8134065980 msgr2=0x7f81340860d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:16.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:16.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:16.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:16.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:16.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:16.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:16.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:16.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:16.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:16.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 zone default found 2024-09-12T17:55:16.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 4 Realm: () 2024-09-12T17:55:16.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:16.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:16.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:16.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 zonegroup default 2024-09-12T17:55:16.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:16.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:16.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:16.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 started sync module instance, tier type = 2024-09-12T17:55:16.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.474+0000 7f814bcbf9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:16.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.490+0000 7f814bcbf9c0 20 add_watcher() i=0 2024-09-12T17:55:16.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.490+0000 7f814bcbf9c0 20 add_watcher() i=1 2024-09-12T17:55:16.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.490+0000 7f814bcbf9c0 20 add_watcher() i=2 2024-09-12T17:55:16.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.490+0000 7f814bcbf9c0 20 add_watcher() i=3 2024-09-12T17:55:16.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.490+0000 7f814bcbf9c0 20 add_watcher() i=4 2024-09-12T17:55:16.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.490+0000 7f814bcbf9c0 20 add_watcher() i=5 2024-09-12T17:55:16.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.490+0000 7f814bcbf9c0 20 add_watcher() i=6 2024-09-12T17:55:16.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.494+0000 7f814bcbf9c0 20 add_watcher() i=7 2024-09-12T17:55:16.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.494+0000 7f814bcbf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:16.496 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.494+0000 7f7fff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:16.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.494+0000 7f814bcbf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:16.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.494+0000 7f814bcbf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:16.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.494+0000 7f814bcbf9c0 5 note: GC not initialized 2024-09-12T17:55:16.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.494+0000 7f7ffe7e4640 20 reqs_thread_entry: start 2024-09-12T17:55:16.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.494+0000 7f814bcbf9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:16.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.494+0000 7f814bcbf9c0 20 Filter name: none 2024-09-12T17:55:16.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.494+0000 7f7f6ffff640 20 reqs_thread_entry: start 2024-09-12T17:55:16.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.494+0000 7f814bcbf9c0 20 processing logshard = reshard.0000000000 2024-09-12T17:55:16.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.502+0000 7f814bcbf9c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T17:55:16.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.502+0000 7f814bcbf9c0 20 processing logshard = reshard.0000000001 2024-09-12T17:55:16.507 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.506+0000 7f814bcbf9c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T17:55:16.507 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.506+0000 7f814bcbf9c0 20 processing logshard = reshard.0000000002 2024-09-12T17:55:16.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.510+0000 7f814bcbf9c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T17:55:16.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.510+0000 7f814bcbf9c0 20 processing logshard = reshard.0000000003 2024-09-12T17:55:16.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.514+0000 7f814bcbf9c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T17:55:16.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.514+0000 7f814bcbf9c0 20 processing logshard = reshard.0000000004 2024-09-12T17:55:16.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.522+0000 7f814bcbf9c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T17:55:16.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.522+0000 7f814bcbf9c0 20 processing logshard = reshard.0000000005 2024-09-12T17:55:16.527 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.526+0000 7f814bcbf9c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T17:55:16.527 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.526+0000 7f814bcbf9c0 20 processing logshard = reshard.0000000006 2024-09-12T17:55:16.530 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.530+0000 7f814bcbf9c0 20 process_entry resharding a-bucket 2024-09-12T17:55:16.530 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.530+0000 7f814bcbf9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:55:16.530 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.530+0000 7f814bcbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.531 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.530+0000 7f814bcbf9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:55:16.531 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.530+0000 7f814bcbf9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T17:55:16.531 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.530+0000 7f814bcbf9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:55:16.531 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.530+0000 7f814bcbf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T17:55:16.531 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.530+0000 7f814bcbf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:16.532 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.530+0000 7f814bcbf9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:55:16.532 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.530+0000 7f814bcbf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T17:55:16.532 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.530+0000 7f814bcbf9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T17:55:16.532 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.530+0000 7f814bcbf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:16.532 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.530+0000 7f814bcbf9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:55:16.532 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.530+0000 7f814bcbf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T17:55:16.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.546+0000 7f814bcbf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T17:55:16.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.546+0000 7f814bcbf9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T17:55:16.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.546+0000 7f814bcbf9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:55:16.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.546+0000 7f814bcbf9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T17:55:16.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.546+0000 7f802cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366173 cookie 94707791260096 notifier 6135 bl.length()=827 2024-09-12T17:55:16.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.546+0000 7f802cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T17:55:16.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.546+0000 7f802cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T17:55:16.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.546+0000 7f802cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:55:16.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.546+0000 7f814bcbf9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T17:55:16.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.546+0000 7f814bcbf9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T17:55:16.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.546+0000 7f814bcbf9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T17:55:16.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.546+0000 7f814bcbf9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T17:55:16.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.0 2024-09-12T17:55:16.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.0 2024-09-12T17:55:16.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.1 2024-09-12T17:55:16.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.1 2024-09-12T17:55:16.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.2 2024-09-12T17:55:16.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.2 2024-09-12T17:55:16.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.3 2024-09-12T17:55:16.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.3 2024-09-12T17:55:16.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.4 2024-09-12T17:55:16.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.4 2024-09-12T17:55:16.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.5 2024-09-12T17:55:16.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.5 2024-09-12T17:55:16.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.6 2024-09-12T17:55:16.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.6 2024-09-12T17:55:16.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.7 2024-09-12T17:55:16.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.7 2024-09-12T17:55:16.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.8 2024-09-12T17:55:16.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.8 2024-09-12T17:55:16.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.9 2024-09-12T17:55:16.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.9 2024-09-12T17:55:16.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.10 2024-09-12T17:55:16.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.10 2024-09-12T17:55:16.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.11 2024-09-12T17:55:16.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.11 2024-09-12T17:55:16.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.0 2024-09-12T17:55:16.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1 2024-09-12T17:55:16.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2 2024-09-12T17:55:16.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.558+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3 2024-09-12T17:55:16.562 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.562+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.4 2024-09-12T17:55:16.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.562+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.5 2024-09-12T17:55:16.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.562+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.6 2024-09-12T17:55:16.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.562+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.7 2024-09-12T17:55:16.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.566+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.8 2024-09-12T17:55:16.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.566+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.9 2024-09-12T17:55:16.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.566+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.10 2024-09-12T17:55:16.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.566+0000 7f814bcbf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : hit (requested=0x17, cached=0x17) 2024-09-12T17:55:16.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.566+0000 7f814bcbf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T17:55:16.571 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.570+0000 7f814bcbf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T17:55:16.571 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.570+0000 7f814bcbf9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T17:55:16.572 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.570+0000 7f814bcbf9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:55:16.572 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.570+0000 7f814bcbf9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T17:55:16.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.570+0000 7f801bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366174 cookie 94707791260096 notifier 6135 bl.length()=827 2024-09-12T17:55:16.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.570+0000 7f801bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T17:55:16.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.570+0000 7f801bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T17:55:16.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.570+0000 7f801bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:55:16.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.574+0000 7f814bcbf9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T17:55:16.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.574+0000 7f814bcbf9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T17:55:16.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.574+0000 7f814bcbf9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T17:55:16.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.574+0000 7f814bcbf9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T17:55:16.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.578+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.0 2024-09-12T17:55:16.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.578+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1 2024-09-12T17:55:16.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.578+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2 2024-09-12T17:55:16.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.578+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3 2024-09-12T17:55:16.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.582+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.4 2024-09-12T17:55:16.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.582+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.5 2024-09-12T17:55:16.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.582+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.6 2024-09-12T17:55:16.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.582+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.7 2024-09-12T17:55:16.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.582+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.8 2024-09-12T17:55:16.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.586+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.9 2024-09-12T17:55:16.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.586+0000 7f814bcbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.10 2024-09-12T17:55:16.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.586+0000 7f814bcbf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : hit (requested=0x17, cached=0x17) 2024-09-12T17:55:16.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.586+0000 7f814bcbf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T17:55:16.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.590+0000 7f814bcbf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T17:55:16.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.590+0000 7f814bcbf9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T17:55:16.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.590+0000 7f814bcbf9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:55:16.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.590+0000 7f814bcbf9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T17:55:16.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.590+0000 7f802cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 94707791260096 notifier 6135 bl.length()=795 2024-09-12T17:55:16.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.590+0000 7f802cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T17:55:16.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.590+0000 7f802cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T17:55:16.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.590+0000 7f802cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:55:16.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.594+0000 7f814bcbf9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T17:55:16.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.594+0000 7f814bcbf9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T17:55:16.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.594+0000 7f814bcbf9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T17:55:16.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.594+0000 7f814bcbf9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T17:55:16.598 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.598+0000 7f814bcbf9c0 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-12T17:55:16.600 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.598+0000 7f814bcbf9c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T17:55:16.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.602+0000 7f814bcbf9c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T17:55:16.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.602+0000 7f814bcbf9c0 20 processing logshard = reshard.0000000007 2024-09-12T17:55:16.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.606+0000 7f814bcbf9c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T17:55:16.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.606+0000 7f814bcbf9c0 20 processing logshard = reshard.0000000008 2024-09-12T17:55:16.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.614+0000 7f814bcbf9c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T17:55:16.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.614+0000 7f814bcbf9c0 20 processing logshard = reshard.0000000009 2024-09-12T17:55:16.620 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.618+0000 7f814bcbf9c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T17:55:16.621 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.618+0000 7f814bcbf9c0 20 processing logshard = reshard.0000000010 2024-09-12T17:55:16.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.622+0000 7f814bcbf9c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T17:55:16.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.622+0000 7f814bcbf9c0 20 processing logshard = reshard.0000000011 2024-09-12T17:55:16.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.626+0000 7f814bcbf9c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T17:55:16.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.626+0000 7f814bcbf9c0 20 processing logshard = reshard.0000000012 2024-09-12T17:55:16.635 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.634+0000 7f814bcbf9c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T17:55:16.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.634+0000 7f814bcbf9c0 20 processing logshard = reshard.0000000013 2024-09-12T17:55:16.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.638+0000 7f814bcbf9c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T17:55:16.641 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.638+0000 7f814bcbf9c0 20 processing logshard = reshard.0000000014 2024-09-12T17:55:16.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.642+0000 7f814bcbf9c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T17:55:16.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.642+0000 7f814bcbf9c0 20 processing logshard = reshard.0000000015 2024-09-12T17:55:16.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.646+0000 7f814bcbf9c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T17:55:16.652 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.650+0000 7f7fff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:16.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.654+0000 7f814bcbf9c0 20 remove_watcher() i=0 2024-09-12T17:55:16.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.654+0000 7f814bcbf9c0 2 removed watcher, disabling cache 2024-09-12T17:55:16.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.658+0000 7f814bcbf9c0 20 remove_watcher() i=1 2024-09-12T17:55:16.660 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.658+0000 7f814bcbf9c0 20 remove_watcher() i=2 2024-09-12T17:55:16.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.662+0000 7f814bcbf9c0 20 remove_watcher() i=3 2024-09-12T17:55:16.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.662+0000 7f814bcbf9c0 20 remove_watcher() i=4 2024-09-12T17:55:16.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.666+0000 7f814bcbf9c0 20 remove_watcher() i=5 2024-09-12T17:55:16.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.666+0000 7f814bcbf9c0 20 remove_watcher() i=6 2024-09-12T17:55:16.669 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:16.666+0000 7f814bcbf9c0 20 remove_watcher() i=7 2024-09-12T17:55:21.691 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:55:21.724 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:21.724 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:21.769 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:21.766+0000 7fb9fa0629c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:21.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:21.770+0000 7fb9fa0629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:21.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:21.770+0000 7fb9fa0629c0 20 realm 2024-09-12T17:55:21.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:21.770+0000 7fb9fa0629c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:21.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:21.770+0000 7fb9fa0629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:21.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:21.770+0000 7fb9fa0629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:21.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:21.770+0000 7fb9fa0629c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:21.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:21.770+0000 7fb9fa0629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:21.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:21.770+0000 7fb9fa0629c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:21.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:21.774+0000 7fb9fa0629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:21.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:21.774+0000 7fb9fa0629c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:21.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:21.774+0000 7fb9fa0629c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:21.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:21.774+0000 7fb9fa0629c0 20 searching for the correct realm 2024-09-12T17:55:21.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:21.778+0000 7fb9f8369640 0 -- 172.21.15.98:0/2336027471 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7fb9e0035060 msgr2=0x7fb9e0062fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:21.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:21.786+0000 7fb9f7b68640 0 -- 172.21.15.98:0/2336027471 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fb9e0008040 msgr2=0x7fb9e0097940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:22.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.002+0000 7fb9fa0629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:22.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.002+0000 7fb9fa0629c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:22.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.002+0000 7fb9fa0629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:22.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.002+0000 7fb9fa0629c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:22.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.002+0000 7fb9fa0629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:22.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.002+0000 7fb9fa0629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:22.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.002+0000 7fb9fa0629c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.006+0000 7fb9fa0629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:22.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.006+0000 7fb9fa0629c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.006+0000 7fb9fa0629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:22.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.006+0000 7fb9fa0629c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.006+0000 7fb9fa0629c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:22.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.006+0000 7fb9fa0629c0 20 zone default found 2024-09-12T17:55:22.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.006+0000 7fb9fa0629c0 4 Realm: () 2024-09-12T17:55:22.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.006+0000 7fb9fa0629c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:22.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.006+0000 7fb9fa0629c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:22.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.006+0000 7fb9fa0629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:22.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.006+0000 7fb9fa0629c0 20 zonegroup default 2024-09-12T17:55:22.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.006+0000 7fb9fa0629c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.006+0000 7fb9fa0629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:22.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.006+0000 7fb9fa0629c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.006+0000 7fb9fa0629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:22.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.006+0000 7fb9fa0629c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.011 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.010+0000 7fb9fa0629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:22.011 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.010+0000 7fb9fa0629c0 20 started sync module instance, tier type = 2024-09-12T17:55:22.011 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.010+0000 7fb9fa0629c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:22.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.034+0000 7fb9fa0629c0 20 add_watcher() i=0 2024-09-12T17:55:22.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.034+0000 7fb9fa0629c0 20 add_watcher() i=1 2024-09-12T17:55:22.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.034+0000 7fb9fa0629c0 20 add_watcher() i=2 2024-09-12T17:55:22.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.034+0000 7fb9fa0629c0 20 add_watcher() i=3 2024-09-12T17:55:22.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.034+0000 7fb9fa0629c0 20 add_watcher() i=4 2024-09-12T17:55:22.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.034+0000 7fb9fa0629c0 20 add_watcher() i=5 2024-09-12T17:55:22.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.034+0000 7fb9fa0629c0 20 add_watcher() i=6 2024-09-12T17:55:22.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.034+0000 7fb9fa0629c0 20 add_watcher() i=7 2024-09-12T17:55:22.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.034+0000 7fb9fa0629c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:22.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.038+0000 7fb8adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:22.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.042+0000 7fb9fa0629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:22.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.042+0000 7fb9fa0629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:22.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.042+0000 7fb9fa0629c0 5 note: GC not initialized 2024-09-12T17:55:22.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.042+0000 7fb8acfe1640 20 reqs_thread_entry: start 2024-09-12T17:55:22.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.042+0000 7fb9fa0629c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:22.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.042+0000 7fb9fa0629c0 20 Filter name: none 2024-09-12T17:55:22.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.042+0000 7fb8267fc640 20 reqs_thread_entry: start 2024-09-12T17:55:22.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.042+0000 7fb9fa0629c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.042+0000 7fb9fa0629c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:55:22.046 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.042+0000 7fb9fa0629c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.046+0000 7fb9fa0629c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:55:22.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.046+0000 7fb9fa0629c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:22.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.046+0000 7fb9fa0629c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.046+0000 7fb9fa0629c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:55:22.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.046+0000 7fb9fa0629c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.046+0000 7fb9fa0629c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:55:22.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.046+0000 7fb9fa0629c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:22.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.050+0000 7fb8adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:22.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.054+0000 7fb9fa0629c0 20 remove_watcher() i=0 2024-09-12T17:55:22.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.054+0000 7fb9fa0629c0 2 removed watcher, disabling cache 2024-09-12T17:55:22.059 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.058+0000 7fb9fa0629c0 20 remove_watcher() i=1 2024-09-12T17:55:22.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.058+0000 7fb9fa0629c0 20 remove_watcher() i=2 2024-09-12T17:55:22.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.062+0000 7fb9fa0629c0 20 remove_watcher() i=3 2024-09-12T17:55:22.065 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.066+0000 7fb9fa0629c0 20 remove_watcher() i=4 2024-09-12T17:55:22.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.066+0000 7fb9fa0629c0 20 remove_watcher() i=5 2024-09-12T17:55:22.068 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.066+0000 7fb9fa0629c0 20 remove_watcher() i=6 2024-09-12T17:55:22.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.070+0000 7fb9fa0629c0 20 remove_watcher() i=7 2024-09-12T17:55:22.086 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:22.086 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:55:22.086 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: a-bucket id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T17:55:22.086 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:22.087 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard add non empty bucket 2024-09-12T17:55:22.087 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:22.093 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:22.093 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:22.153 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:22.153 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:22.261 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:22.262 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:22.353 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:22.353 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:22.444 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:22.444 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:22.545 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:22.545 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:22.643 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:22.644 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:22.737 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:22.737 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:22.829 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:55:22.866 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:22.866 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:22.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.910+0000 7fe2d9a939c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.914+0000 7fe2d9a939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:22.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.914+0000 7fe2d9a939c0 20 realm 2024-09-12T17:55:22.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.914+0000 7fe2d9a939c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.914+0000 7fe2d9a939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:22.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.914+0000 7fe2d9a939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:22.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.914+0000 7fe2d9a939c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.914+0000 7fe2d9a939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:22.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.914+0000 7fe2d9a939c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.914+0000 7fe2d9a939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:22.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.914+0000 7fe2d9a939c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.914+0000 7fe2d9a939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:22.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.914+0000 7fe2d9a939c0 20 searching for the correct realm 2024-09-12T17:55:22.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.922+0000 7fe2d7d9a640 0 -- 172.21.15.98:0/2258044663 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55aa0214f200 msgr2=0x55aa02151670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:22.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.926+0000 7fe2d7599640 0 -- 172.21.15.98:0/2258044663 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fe2cc0f23a0 msgr2=0x7fe2cc0f2820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:22.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.934+0000 7fe2d9a939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:22.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.934+0000 7fe2d9a939c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:22.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.934+0000 7fe2d9a939c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:22.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.934+0000 7fe2d9a939c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:22.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.934+0000 7fe2d9a939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:22.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.934+0000 7fe2d9a939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:22.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.934+0000 7fe2d9a939c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.934+0000 7fe2d9a939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:22.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.934+0000 7fe2d9a939c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.934+0000 7fe2d9a939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:22.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.934+0000 7fe2d9a939c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.938+0000 7fe2d9a939c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:22.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.938+0000 7fe2d9a939c0 20 zone default found 2024-09-12T17:55:22.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.938+0000 7fe2d9a939c0 4 Realm: () 2024-09-12T17:55:22.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.938+0000 7fe2d9a939c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:22.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.938+0000 7fe2d9a939c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:22.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.938+0000 7fe2d9a939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:22.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.938+0000 7fe2d9a939c0 20 zonegroup default 2024-09-12T17:55:22.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.938+0000 7fe2d9a939c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.938+0000 7fe2d9a939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:22.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.938+0000 7fe2d9a939c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.938+0000 7fe2d9a939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:22.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.938+0000 7fe2d9a939c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.938+0000 7fe2d9a939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:22.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.938+0000 7fe2d9a939c0 20 started sync module instance, tier type = 2024-09-12T17:55:22.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.938+0000 7fe2d9a939c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:22.955 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.954+0000 7fe2d9a939c0 20 add_watcher() i=0 2024-09-12T17:55:22.955 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.954+0000 7fe2d9a939c0 20 add_watcher() i=1 2024-09-12T17:55:22.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.954+0000 7fe2d9a939c0 20 add_watcher() i=2 2024-09-12T17:55:22.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.954+0000 7fe2d9a939c0 20 add_watcher() i=3 2024-09-12T17:55:22.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.954+0000 7fe2d9a939c0 20 add_watcher() i=4 2024-09-12T17:55:22.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.954+0000 7fe2d9a939c0 20 add_watcher() i=5 2024-09-12T17:55:22.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.954+0000 7fe2d9a939c0 20 add_watcher() i=6 2024-09-12T17:55:22.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.954+0000 7fe2d9a939c0 20 add_watcher() i=7 2024-09-12T17:55:22.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.954+0000 7fe2d9a939c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:22.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.958+0000 7fe18dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:22.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.958+0000 7fe2d9a939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:22.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.958+0000 7fe2d9a939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:22.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.958+0000 7fe2d9a939c0 5 note: GC not initialized 2024-09-12T17:55:22.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.958+0000 7fe18cfe1640 20 reqs_thread_entry: start 2024-09-12T17:55:22.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.958+0000 7fe2d9a939c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:22.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.958+0000 7fe2d9a939c0 20 Filter name: none 2024-09-12T17:55:22.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.958+0000 7fe1067fc640 20 reqs_thread_entry: start 2024-09-12T17:55:22.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.958+0000 7fe2d9a939c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.958+0000 7fe2d9a939c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:55:22.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.958+0000 7fe2d9a939c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.962+0000 7fe2d9a939c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:55:22.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.962+0000 7fe2d9a939c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:22.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.962+0000 7fe2d9a939c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.962+0000 7fe2d9a939c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:55:22.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.962+0000 7fe2d9a939c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:22.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.962+0000 7fe2d9a939c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:55:22.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.962+0000 7fe2d9a939c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:22.967 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.966+0000 7fe18dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:22.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.970+0000 7fe2d9a939c0 20 remove_watcher() i=0 2024-09-12T17:55:22.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.970+0000 7fe2d9a939c0 2 removed watcher, disabling cache 2024-09-12T17:55:22.974 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.974+0000 7fe2d9a939c0 20 remove_watcher() i=1 2024-09-12T17:55:22.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.974+0000 7fe2d9a939c0 20 remove_watcher() i=2 2024-09-12T17:55:22.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.978+0000 7fe2d9a939c0 20 remove_watcher() i=3 2024-09-12T17:55:22.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.978+0000 7fe2d9a939c0 20 remove_watcher() i=4 2024-09-12T17:55:22.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.982+0000 7fe2d9a939c0 20 remove_watcher() i=5 2024-09-12T17:55:22.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.982+0000 7fe2d9a939c0 20 remove_watcher() i=6 2024-09-12T17:55:22.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:22.982+0000 7fe2d9a939c0 20 remove_watcher() i=7 2024-09-12T17:55:22.999 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:22.999 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:55:22.999 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: a-bucket id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-12T17:55:22.999 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:22.999 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-12T17:55:23.027 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:23.027 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:23.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.070+0000 7f411ea8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.070+0000 7f411ea8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.070+0000 7f411ea8a9c0 20 realm 2024-09-12T17:55:23.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.070+0000 7f411ea8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.070+0000 7f411ea8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.070+0000 7f411ea8a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:23.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.070+0000 7f411ea8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.070+0000 7f411ea8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.070+0000 7f411ea8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.074+0000 7f411ea8a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:23.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.074+0000 7f411ea8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.074+0000 7f411ea8a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:23.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.074+0000 7f411ea8a9c0 20 searching for the correct realm 2024-09-12T17:55:23.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.078+0000 7f411bd8f640 0 -- 172.21.15.98:0/1261267787 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f410c0e4040 msgr2=0x7f410c0f7070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:23.086 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.086+0000 7f411bd8f640 0 -- 172.21.15.98:0/1261267787 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f3fe4081180 msgr2=0x7f3fe40835b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:23.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.090+0000 7f411ea8a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:23.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.090+0000 7f411ea8a9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:23.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.090+0000 7f411ea8a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:23.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.090+0000 7f411ea8a9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:23.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.090+0000 7f411ea8a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:23.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.090+0000 7f411ea8a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:23.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.090+0000 7f411ea8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.090+0000 7f411ea8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.090+0000 7f411ea8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.096 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.090+0000 7f411ea8a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:23.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.090+0000 7f411ea8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.094+0000 7f411ea8a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:23.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.094+0000 7f411ea8a9c0 20 zone default found 2024-09-12T17:55:23.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.094+0000 7f411ea8a9c0 4 Realm: () 2024-09-12T17:55:23.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.094+0000 7f411ea8a9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:23.098 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.094+0000 7f411ea8a9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:23.098 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.094+0000 7f411ea8a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:23.098 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.094+0000 7f411ea8a9c0 20 zonegroup default 2024-09-12T17:55:23.098 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.094+0000 7f411ea8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.094+0000 7f411ea8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.094+0000 7f411ea8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.094+0000 7f411ea8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.094+0000 7f411ea8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.100 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.094+0000 7f411ea8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.100 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.094+0000 7f411ea8a9c0 20 started sync module instance, tier type = 2024-09-12T17:55:23.100 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.094+0000 7f411ea8a9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:23.112 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.110+0000 7f411ea8a9c0 20 add_watcher() i=0 2024-09-12T17:55:23.112 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.110+0000 7f411ea8a9c0 20 add_watcher() i=1 2024-09-12T17:55:23.113 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.110+0000 7f411ea8a9c0 20 add_watcher() i=2 2024-09-12T17:55:23.113 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.110+0000 7f411ea8a9c0 20 add_watcher() i=3 2024-09-12T17:55:23.113 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.110+0000 7f411ea8a9c0 20 add_watcher() i=4 2024-09-12T17:55:23.113 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.110+0000 7f411ea8a9c0 20 add_watcher() i=5 2024-09-12T17:55:23.113 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.110+0000 7f411ea8a9c0 20 add_watcher() i=6 2024-09-12T17:55:23.113 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.110+0000 7f411ea8a9c0 20 add_watcher() i=7 2024-09-12T17:55:23.114 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.110+0000 7f411ea8a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:23.114 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f3fd2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:23.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f411ea8a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:23.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f411ea8a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:23.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f411ea8a9c0 5 note: GC not initialized 2024-09-12T17:55:23.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f3fd1fdb640 20 reqs_thread_entry: start 2024-09-12T17:55:23.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f411ea8a9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:23.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f411ea8a9c0 20 Filter name: none 2024-09-12T17:55:23.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f3f437fe640 20 reqs_thread_entry: start 2024-09-12T17:55:23.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f411ea8a9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:55:23.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f411ea8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f411ea8a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:55:23.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f411ea8a9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T17:55:23.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f411ea8a9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:55:23.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f411ea8a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T17:55:23.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f411ea8a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f411ea8a9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:55:23.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f411ea8a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T17:55:23.121 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f411ea8a9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T17:55:23.121 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f411ea8a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:23.121 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f411ea8a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:55:23.121 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.114+0000 7f411ea8a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T17:55:23.122 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.118+0000 7f3fd2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:23.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.122+0000 7f411ea8a9c0 20 remove_watcher() i=0 2024-09-12T17:55:23.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.126+0000 7f411ea8a9c0 2 removed watcher, disabling cache 2024-09-12T17:55:23.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.126+0000 7f411ea8a9c0 20 remove_watcher() i=1 2024-09-12T17:55:23.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.130+0000 7f411ea8a9c0 20 remove_watcher() i=2 2024-09-12T17:55:23.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.130+0000 7f411ea8a9c0 20 remove_watcher() i=3 2024-09-12T17:55:23.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.134+0000 7f411ea8a9c0 20 remove_watcher() i=4 2024-09-12T17:55:23.135 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.134+0000 7f411ea8a9c0 20 remove_watcher() i=5 2024-09-12T17:55:23.136 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.134+0000 7f411ea8a9c0 20 remove_watcher() i=6 2024-09-12T17:55:23.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.134+0000 7f411ea8a9c0 20 remove_watcher() i=7 2024-09-12T17:55:23.151 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin reshard list 2024-09-12T17:55:23.175 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:23.175 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:23.218 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.218+0000 7fce839c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.218+0000 7fce839c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.218+0000 7fce839c59c0 20 realm 2024-09-12T17:55:23.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.218+0000 7fce839c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.218+0000 7fce839c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.218+0000 7fce839c59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:23.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.218+0000 7fce839c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.218+0000 7fce839c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.218+0000 7fce839c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.222+0000 7fce839c59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:23.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.222+0000 7fce839c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.222+0000 7fce839c59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:23.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.222+0000 7fce839c59c0 20 searching for the correct realm 2024-09-12T17:55:23.229 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.226+0000 7fce81ccc640 0 -- 172.21.15.98:0/1431001872 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7fce6c027040 msgr2=0x7fce6c0659d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:23.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.442+0000 7fce814cb640 0 -- 172.21.15.98:0/1431001872 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x5604764af1c0 msgr2=0x5604764b15b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:23.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.446+0000 7fce839c59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:23.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:23.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:23.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:23.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:23.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:23.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.451 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.451 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.451 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:23.451 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:23.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 20 zone default found 2024-09-12T17:55:23.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 4 Realm: () 2024-09-12T17:55:23.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:23.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:23.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:23.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 20 zonegroup default 2024-09-12T17:55:23.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.450+0000 7fce839c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.454+0000 7fce839c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.454+0000 7fce839c59c0 20 started sync module instance, tier type = 2024-09-12T17:55:23.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.454+0000 7fce839c59c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:23.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.478+0000 7fce839c59c0 20 add_watcher() i=0 2024-09-12T17:55:23.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.478+0000 7fce839c59c0 20 add_watcher() i=1 2024-09-12T17:55:23.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.478+0000 7fce839c59c0 20 add_watcher() i=2 2024-09-12T17:55:23.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.478+0000 7fce839c59c0 20 add_watcher() i=3 2024-09-12T17:55:23.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.478+0000 7fce839c59c0 20 add_watcher() i=4 2024-09-12T17:55:23.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.478+0000 7fce839c59c0 20 add_watcher() i=5 2024-09-12T17:55:23.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.478+0000 7fce839c59c0 20 add_watcher() i=6 2024-09-12T17:55:23.480 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.478+0000 7fce839c59c0 20 add_watcher() i=7 2024-09-12T17:55:23.480 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.478+0000 7fce839c59c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:23.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.482+0000 7fcd37fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:23.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.482+0000 7fce839c59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:23.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.482+0000 7fce839c59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:23.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.482+0000 7fce839c59c0 5 note: GC not initialized 2024-09-12T17:55:23.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.486+0000 7fcd36fe5640 20 reqs_thread_entry: start 2024-09-12T17:55:23.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.486+0000 7fce839c59c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:23.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.486+0000 7fce839c59c0 20 Filter name: none 2024-09-12T17:55:23.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.486+0000 7fcd34fe1640 20 reqs_thread_entry: start 2024-09-12T17:55:23.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.498+0000 7fcd37fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:23.505 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.502+0000 7fce839c59c0 20 remove_watcher() i=0 2024-09-12T17:55:23.505 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.502+0000 7fce839c59c0 2 removed watcher, disabling cache 2024-09-12T17:55:23.507 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.506+0000 7fce839c59c0 20 remove_watcher() i=1 2024-09-12T17:55:23.509 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.506+0000 7fce839c59c0 20 remove_watcher() i=2 2024-09-12T17:55:23.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.510+0000 7fce839c59c0 20 remove_watcher() i=3 2024-09-12T17:55:23.513 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.514+0000 7fce839c59c0 20 remove_watcher() i=4 2024-09-12T17:55:23.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.514+0000 7fce839c59c0 20 remove_watcher() i=5 2024-09-12T17:55:23.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.514+0000 7fce839c59c0 20 remove_watcher() i=6 2024-09-12T17:55:23.518 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.518+0000 7fce839c59c0 20 remove_watcher() i=7 2024-09-12T17:55:23.536 INFO:tasks.workunit.client.0.smithi098.stderr:bucket name a-bucket 2024-09-12T17:55:23.536 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard process non empty bucket 2024-09-12T17:55:23.536 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:23.536 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin reshard process 2024-09-12T17:55:23.561 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:23.561 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:23.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.606+0000 7fc420e8b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.606+0000 7fc420e8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.606+0000 7fc420e8b9c0 20 realm 2024-09-12T17:55:23.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.606+0000 7fc420e8b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.606+0000 7fc420e8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.606+0000 7fc420e8b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:23.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.606+0000 7fc420e8b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.606+0000 7fc420e8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.606+0000 7fc420e8b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.610+0000 7fc420e8b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:23.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.610+0000 7fc420e8b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.610+0000 7fc420e8b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:23.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.610+0000 7fc420e8b9c0 20 searching for the correct realm 2024-09-12T17:55:23.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.614+0000 7fc41f192640 0 -- 172.21.15.98:0/3196257356 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7fc414008040 msgr2=0x7fc41407ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:23.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.830+0000 7fc41e991640 0 -- 172.21.15.98:0/3196257356 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x5593dea90830 msgr2=0x5593dea92c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:23.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.838+0000 7fc420e8b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:23.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.838+0000 7fc420e8b9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:23.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.838+0000 7fc420e8b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:23.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.838+0000 7fc420e8b9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:23.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.838+0000 7fc420e8b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:23.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.838+0000 7fc420e8b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:23.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.838+0000 7fc420e8b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.838+0000 7fc420e8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.838+0000 7fc420e8b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.838+0000 7fc420e8b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:23.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.838+0000 7fc420e8b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.842+0000 7fc420e8b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:23.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.842+0000 7fc420e8b9c0 20 zone default found 2024-09-12T17:55:23.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.842+0000 7fc420e8b9c0 4 Realm: () 2024-09-12T17:55:23.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.842+0000 7fc420e8b9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:23.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.842+0000 7fc420e8b9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:23.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.842+0000 7fc420e8b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:23.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.842+0000 7fc420e8b9c0 20 zonegroup default 2024-09-12T17:55:23.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.842+0000 7fc420e8b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.842+0000 7fc420e8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.842+0000 7fc420e8b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.842+0000 7fc420e8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.842+0000 7fc420e8b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.842+0000 7fc420e8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:23.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.842+0000 7fc420e8b9c0 20 started sync module instance, tier type = 2024-09-12T17:55:23.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.842+0000 7fc420e8b9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:23.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.866+0000 7fc420e8b9c0 20 add_watcher() i=0 2024-09-12T17:55:23.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.866+0000 7fc420e8b9c0 20 add_watcher() i=1 2024-09-12T17:55:23.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.866+0000 7fc420e8b9c0 20 add_watcher() i=2 2024-09-12T17:55:23.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.866+0000 7fc420e8b9c0 20 add_watcher() i=3 2024-09-12T17:55:23.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.866+0000 7fc420e8b9c0 20 add_watcher() i=4 2024-09-12T17:55:23.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.866+0000 7fc420e8b9c0 20 add_watcher() i=5 2024-09-12T17:55:23.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.866+0000 7fc420e8b9c0 20 add_watcher() i=6 2024-09-12T17:55:23.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.866+0000 7fc420e8b9c0 20 add_watcher() i=7 2024-09-12T17:55:23.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.866+0000 7fc420e8b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:23.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.870+0000 7fc2d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:23.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.870+0000 7fc420e8b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:23.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.870+0000 7fc420e8b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:23.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.870+0000 7fc420e8b9c0 5 note: GC not initialized 2024-09-12T17:55:23.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.870+0000 7fc2d4fe1640 20 reqs_thread_entry: start 2024-09-12T17:55:23.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.870+0000 7fc420e8b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:23.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.870+0000 7fc420e8b9c0 20 Filter name: none 2024-09-12T17:55:23.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.870+0000 7fc2cdffb640 20 reqs_thread_entry: start 2024-09-12T17:55:23.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.870+0000 7fc420e8b9c0 20 processing logshard = reshard.0000000000 2024-09-12T17:55:23.878 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.878+0000 7fc420e8b9c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T17:55:23.878 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.878+0000 7fc420e8b9c0 20 processing logshard = reshard.0000000001 2024-09-12T17:55:23.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.882+0000 7fc420e8b9c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T17:55:23.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.882+0000 7fc420e8b9c0 20 processing logshard = reshard.0000000002 2024-09-12T17:55:23.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.886+0000 7fc420e8b9c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T17:55:23.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.886+0000 7fc420e8b9c0 20 processing logshard = reshard.0000000003 2024-09-12T17:55:23.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.890+0000 7fc420e8b9c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T17:55:23.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.890+0000 7fc420e8b9c0 20 processing logshard = reshard.0000000004 2024-09-12T17:55:23.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.898+0000 7fc420e8b9c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T17:55:23.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.898+0000 7fc420e8b9c0 20 processing logshard = reshard.0000000005 2024-09-12T17:55:23.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.902+0000 7fc420e8b9c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T17:55:23.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.902+0000 7fc420e8b9c0 20 processing logshard = reshard.0000000006 2024-09-12T17:55:23.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.906+0000 7fc420e8b9c0 20 process_entry resharding a-bucket 2024-09-12T17:55:23.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.906+0000 7fc420e8b9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T17:55:23.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.906+0000 7fc420e8b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.906+0000 7fc420e8b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:55:23.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.906+0000 7fc420e8b9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T17:55:23.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.906+0000 7fc420e8b9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T17:55:23.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.906+0000 7fc420e8b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T17:55:23.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.906+0000 7fc420e8b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:23.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.906+0000 7fc420e8b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:55:23.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.906+0000 7fc420e8b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T17:55:23.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.906+0000 7fc420e8b9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T17:55:23.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.906+0000 7fc420e8b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:23.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.906+0000 7fc420e8b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:55:23.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.906+0000 7fc420e8b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T17:55:23.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.922+0000 7fc420e8b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T17:55:23.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.922+0000 7fc420e8b9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T17:55:23.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.922+0000 7fc420e8b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:55:23.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.922+0000 7fc420e8b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T17:55:23.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.922+0000 7fc301ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366176 cookie 94093584211776 notifier 6222 bl.length()=827 2024-09-12T17:55:23.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.922+0000 7fc301ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T17:55:23.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.922+0000 7fc301ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T17:55:23.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.922+0000 7fc301ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:55:23.928 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.926+0000 7fc420e8b9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T17:55:23.928 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.926+0000 7fc420e8b9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T17:55:23.928 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.926+0000 7fc420e8b9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T17:55:23.928 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.926+0000 7fc420e8b9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T17:55:23.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T17:55:23.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T17:55:23.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T17:55:23.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T17:55:23.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T17:55:23.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T17:55:23.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T17:55:23.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T17:55:23.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T17:55:23.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T17:55:23.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T17:55:23.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T17:55:23.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T17:55:23.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T17:55:23.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T17:55:23.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T17:55:23.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T17:55:23.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T17:55:23.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T17:55:23.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T17:55:23.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T17:55:23.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T17:55:23.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T17:55:23.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T17:55:23.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T17:55:23.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T17:55:23.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.0 2024-09-12T17:55:23.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.0 2024-09-12T17:55:23.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.1 2024-09-12T17:55:23.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.938+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.1 2024-09-12T17:55:23.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.942+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.2 2024-09-12T17:55:23.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.942+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.2 2024-09-12T17:55:23.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.942+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.3 2024-09-12T17:55:23.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.942+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.3 2024-09-12T17:55:23.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.942+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.4 2024-09-12T17:55:23.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.942+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.4 2024-09-12T17:55:23.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.942+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.5 2024-09-12T17:55:23.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.942+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.5 2024-09-12T17:55:23.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.946+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.6 2024-09-12T17:55:23.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.946+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.6 2024-09-12T17:55:23.947 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.946+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.7 2024-09-12T17:55:23.947 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.946+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.7 2024-09-12T17:55:23.948 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.946+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.8 2024-09-12T17:55:23.948 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.946+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.8 2024-09-12T17:55:23.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.946+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.9 2024-09-12T17:55:23.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.946+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.9 2024-09-12T17:55:23.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.950+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.10 2024-09-12T17:55:23.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.950+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.10 2024-09-12T17:55:23.951 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.950+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.11 2024-09-12T17:55:23.951 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.950+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.11 2024-09-12T17:55:23.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.954+0000 7fc420e8b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : hit (requested=0x17, cached=0x17) 2024-09-12T17:55:23.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.954+0000 7fc420e8b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T17:55:23.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.958+0000 7fc420e8b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T17:55:23.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.958+0000 7fc420e8b9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T17:55:23.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.958+0000 7fc420e8b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:55:23.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.958+0000 7fc420e8b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T17:55:23.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.958+0000 7fc3027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366177 cookie 94093584211776 notifier 6222 bl.length()=827 2024-09-12T17:55:23.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.958+0000 7fc3027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T17:55:23.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.958+0000 7fc3027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T17:55:23.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.958+0000 7fc3027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:55:23.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.962+0000 7fc420e8b9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T17:55:23.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.962+0000 7fc420e8b9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T17:55:23.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.962+0000 7fc420e8b9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T17:55:23.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.962+0000 7fc420e8b9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T17:55:23.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.966+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.0 2024-09-12T17:55:23.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.966+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.0 2024-09-12T17:55:23.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.970+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.1 2024-09-12T17:55:23.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.970+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.1 2024-09-12T17:55:23.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.970+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.2 2024-09-12T17:55:23.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.970+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.2 2024-09-12T17:55:23.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.970+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.3 2024-09-12T17:55:23.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.970+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.3 2024-09-12T17:55:23.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.970+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.4 2024-09-12T17:55:23.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.970+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.4 2024-09-12T17:55:23.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.970+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.5 2024-09-12T17:55:23.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.970+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.5 2024-09-12T17:55:23.974 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.974+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.6 2024-09-12T17:55:23.974 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.974+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.6 2024-09-12T17:55:23.975 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.974+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.7 2024-09-12T17:55:23.975 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.974+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.7 2024-09-12T17:55:23.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.974+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.8 2024-09-12T17:55:23.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.974+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.8 2024-09-12T17:55:23.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.974+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.9 2024-09-12T17:55:23.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.974+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.9 2024-09-12T17:55:23.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.978+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.10 2024-09-12T17:55:23.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.978+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.10 2024-09-12T17:55:23.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.978+0000 7fc420e8b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.11 2024-09-12T17:55:23.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.978+0000 7fc420e8b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.1.11 2024-09-12T17:55:23.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.978+0000 7fc420e8b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : hit (requested=0x17, cached=0x17) 2024-09-12T17:55:23.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.978+0000 7fc420e8b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T17:55:23.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.982+0000 7fc420e8b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T17:55:23.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.982+0000 7fc420e8b9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T17:55:23.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.982+0000 7fc420e8b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:55:23.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.982+0000 7fc420e8b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T17:55:23.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.982+0000 7fc301ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366178 cookie 94093584211776 notifier 6222 bl.length()=795 2024-09-12T17:55:23.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.982+0000 7fc301ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T17:55:23.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.982+0000 7fc301ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T17:55:23.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.982+0000 7fc301ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T17:55:23.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.986+0000 7fc420e8b9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T17:55:23.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.986+0000 7fc420e8b9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T17:55:23.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.986+0000 7fc420e8b9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T17:55:23.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.986+0000 7fc420e8b9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T17:55:23.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.990+0000 7fc420e8b9c0 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-12T17:55:23.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.994+0000 7fc420e8b9c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T17:55:24.000 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.998+0000 7fc420e8b9c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T17:55:24.000 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:23.998+0000 7fc420e8b9c0 20 processing logshard = reshard.0000000007 2024-09-12T17:55:24.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.006+0000 7fc420e8b9c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T17:55:24.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.006+0000 7fc420e8b9c0 20 processing logshard = reshard.0000000008 2024-09-12T17:55:24.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.010+0000 7fc420e8b9c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T17:55:24.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.010+0000 7fc420e8b9c0 20 processing logshard = reshard.0000000009 2024-09-12T17:55:24.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.018+0000 7fc420e8b9c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T17:55:24.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.018+0000 7fc420e8b9c0 20 processing logshard = reshard.0000000010 2024-09-12T17:55:24.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.022+0000 7fc420e8b9c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T17:55:24.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.022+0000 7fc420e8b9c0 20 processing logshard = reshard.0000000011 2024-09-12T17:55:24.030 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.030+0000 7fc420e8b9c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T17:55:24.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.030+0000 7fc420e8b9c0 20 processing logshard = reshard.0000000012 2024-09-12T17:55:24.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.038+0000 7fc420e8b9c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T17:55:24.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.038+0000 7fc420e8b9c0 20 processing logshard = reshard.0000000013 2024-09-12T17:55:24.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.042+0000 7fc420e8b9c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T17:55:24.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.042+0000 7fc420e8b9c0 20 processing logshard = reshard.0000000014 2024-09-12T17:55:24.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.046+0000 7fc420e8b9c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T17:55:24.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.046+0000 7fc420e8b9c0 20 processing logshard = reshard.0000000015 2024-09-12T17:55:24.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.054+0000 7fc420e8b9c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T17:55:24.058 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.058+0000 7fc2d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:24.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.062+0000 7fc420e8b9c0 20 remove_watcher() i=0 2024-09-12T17:55:24.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.062+0000 7fc420e8b9c0 2 removed watcher, disabling cache 2024-09-12T17:55:24.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.066+0000 7fc420e8b9c0 20 remove_watcher() i=1 2024-09-12T17:55:24.068 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.066+0000 7fc420e8b9c0 20 remove_watcher() i=2 2024-09-12T17:55:24.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.070+0000 7fc420e8b9c0 20 remove_watcher() i=3 2024-09-12T17:55:24.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.074+0000 7fc420e8b9c0 20 remove_watcher() i=4 2024-09-12T17:55:24.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.074+0000 7fc420e8b9c0 20 remove_watcher() i=5 2024-09-12T17:55:24.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.078+0000 7fc420e8b9c0 20 remove_watcher() i=6 2024-09-12T17:55:24.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.078+0000 7fc420e8b9c0 20 remove_watcher() i=7 2024-09-12T17:55:24.100 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T17:55:24.131 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:24.131 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:24.179 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.178+0000 7efc27bf69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.180 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.178+0000 7efc27bf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.178+0000 7efc27bf69c0 20 realm 2024-09-12T17:55:24.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.178+0000 7efc27bf69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.178+0000 7efc27bf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.178+0000 7efc27bf69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:24.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.178+0000 7efc27bf69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.178+0000 7efc27bf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.178+0000 7efc27bf69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.182 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.182+0000 7efc27bf69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:24.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.182+0000 7efc27bf69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.182+0000 7efc27bf69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:24.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.182+0000 7efc27bf69c0 20 searching for the correct realm 2024-09-12T17:55:24.188 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.186+0000 7efc25efd640 0 -- 172.21.15.98:0/2949658440 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x556e66554e90 msgr2=0x556e66557330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:24.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.194+0000 7efc256fc640 0 -- 172.21.15.98:0/2949658440 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7efc1c0f6b50 msgr2=0x7efc1c0f95a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:24.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.198+0000 7efc27bf69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:24.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.198+0000 7efc27bf69c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:24.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.198+0000 7efc27bf69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:24.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.198+0000 7efc27bf69c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:24.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.198+0000 7efc27bf69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:24.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.198+0000 7efc27bf69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:24.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.198+0000 7efc27bf69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.202+0000 7efc27bf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.202+0000 7efc27bf69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.203 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.202+0000 7efc27bf69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:24.203 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.202+0000 7efc27bf69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.202+0000 7efc27bf69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:24.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.202+0000 7efc27bf69c0 20 zone default found 2024-09-12T17:55:24.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.202+0000 7efc27bf69c0 4 Realm: () 2024-09-12T17:55:24.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.202+0000 7efc27bf69c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:24.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.202+0000 7efc27bf69c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:24.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.202+0000 7efc27bf69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:24.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.202+0000 7efc27bf69c0 20 zonegroup default 2024-09-12T17:55:24.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.202+0000 7efc27bf69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.202+0000 7efc27bf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.202+0000 7efc27bf69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.205 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.202+0000 7efc27bf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.205 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.202+0000 7efc27bf69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.205 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.202+0000 7efc27bf69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:24.205 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.202+0000 7efc27bf69c0 20 started sync module instance, tier type = 2024-09-12T17:55:24.205 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.202+0000 7efc27bf69c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:24.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.218+0000 7efc27bf69c0 20 add_watcher() i=0 2024-09-12T17:55:24.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.218+0000 7efc27bf69c0 20 add_watcher() i=1 2024-09-12T17:55:24.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.218+0000 7efc27bf69c0 20 add_watcher() i=2 2024-09-12T17:55:24.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.218+0000 7efc27bf69c0 20 add_watcher() i=3 2024-09-12T17:55:24.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.218+0000 7efc27bf69c0 20 add_watcher() i=4 2024-09-12T17:55:24.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.218+0000 7efc27bf69c0 20 add_watcher() i=5 2024-09-12T17:55:24.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.218+0000 7efc27bf69c0 20 add_watcher() i=6 2024-09-12T17:55:24.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.218+0000 7efc27bf69c0 20 add_watcher() i=7 2024-09-12T17:55:24.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.218+0000 7efc27bf69c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:24.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.222+0000 7efadb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:24.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.222+0000 7efc27bf69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:24.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.222+0000 7efc27bf69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:24.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.222+0000 7efc27bf69c0 5 note: GC not initialized 2024-09-12T17:55:24.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.222+0000 7efada7e4640 20 reqs_thread_entry: start 2024-09-12T17:55:24.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.222+0000 7efc27bf69c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:24.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.222+0000 7efc27bf69c0 20 Filter name: none 2024-09-12T17:55:24.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.222+0000 7efa4bfff640 20 reqs_thread_entry: start 2024-09-12T17:55:24.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.222+0000 7efc27bf69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.226 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.226+0000 7efc27bf69c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:55:24.226 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.226+0000 7efc27bf69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.227 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.226+0000 7efc27bf69c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:55:24.227 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.226+0000 7efc27bf69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:24.227 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.226+0000 7efc27bf69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.228 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.226+0000 7efc27bf69c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T17:55:24.228 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.226+0000 7efc27bf69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:24.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.226+0000 7efc27bf69c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T17:55:24.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.226+0000 7efc27bf69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:24.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.230+0000 7efadb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:24.236 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.234+0000 7efc27bf69c0 20 remove_watcher() i=0 2024-09-12T17:55:24.236 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.234+0000 7efc27bf69c0 2 removed watcher, disabling cache 2024-09-12T17:55:24.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.238+0000 7efc27bf69c0 20 remove_watcher() i=1 2024-09-12T17:55:24.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.238+0000 7efc27bf69c0 20 remove_watcher() i=2 2024-09-12T17:55:24.242 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.242+0000 7efc27bf69c0 20 remove_watcher() i=3 2024-09-12T17:55:24.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.242+0000 7efc27bf69c0 20 remove_watcher() i=4 2024-09-12T17:55:24.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.246+0000 7efc27bf69c0 20 remove_watcher() i=5 2024-09-12T17:55:24.247 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.246+0000 7efc27bf69c0 20 remove_watcher() i=6 2024-09-12T17:55:24.248 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:24.246+0000 7efc27bf69c0 20 remove_watcher() i=7 2024-09-12T17:55:24.261 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:24.262 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:55:24.262 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: a-bucket id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T17:55:24.262 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:24.262 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T17:55:24.262 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:24.263 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:24.263 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:24.331 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:24.332 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:24.394 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:24.394 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:24.497 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:24.501 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:24.601 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:24.601 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:24.700 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:24.700 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:24.790 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:24.790 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:24.888 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:24.888 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:24.962 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:24.962 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:25.058 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:25.058 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:25.153 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:25.153 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:25.249 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:25.249 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:25.349 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:25.349 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:25.445 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:25.445 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:25.537 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:25.537 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:25.626 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:25.626 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:25.708 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:25.708 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:25.806 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:25.806 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:25.878 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:25.878 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:25.976 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:25.976 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:26.078 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:26.078 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:26.170 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:26.170 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:26.262 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:55:26.295 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:26.295 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:26.341 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.338+0000 7fbf157df9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.342+0000 7fbf157df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:26.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.342+0000 7fbf157df9c0 20 realm 2024-09-12T17:55:26.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.342+0000 7fbf157df9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.342+0000 7fbf157df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:26.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.342+0000 7fbf157df9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:26.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.342+0000 7fbf157df9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.342+0000 7fbf157df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:26.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.342+0000 7fbf157df9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.342+0000 7fbf157df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:26.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.342+0000 7fbf157df9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.346+0000 7fbf157df9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:26.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.346+0000 7fbf157df9c0 20 searching for the correct realm 2024-09-12T17:55:26.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.346+0000 7fbf132e5640 0 -- 172.21.15.98:0/1486159044 >> [v2:172.21.15.98:6816/1225764258,v1:172.21.15.98:6817/1225764258] conn(0x55e527626810 msgr2=0x7fbf0c007aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:26.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.558+0000 7fbf13ae6640 0 -- 172.21.15.98:0/1486159044 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7fbf080be040 msgr2=0x7fbf080fdd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:26.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.574+0000 7fbf157df9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:26.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.574+0000 7fbf157df9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:26.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.574+0000 7fbf157df9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:26.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.574+0000 7fbf157df9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:26.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.574+0000 7fbf157df9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:26.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.574+0000 7fbf157df9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:26.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.574+0000 7fbf157df9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.574+0000 7fbf157df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:26.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.574+0000 7fbf157df9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.578 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.578+0000 7fbf157df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:26.578 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.578+0000 7fbf157df9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.578+0000 7fbf157df9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:26.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.578+0000 7fbf157df9c0 20 zone default found 2024-09-12T17:55:26.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.578+0000 7fbf157df9c0 4 Realm: () 2024-09-12T17:55:26.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.578+0000 7fbf157df9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:26.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.578+0000 7fbf157df9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:26.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.578+0000 7fbf157df9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:26.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.578+0000 7fbf157df9c0 20 zonegroup default 2024-09-12T17:55:26.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.578+0000 7fbf157df9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.578+0000 7fbf157df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:26.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.578+0000 7fbf157df9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.578+0000 7fbf157df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:26.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.578+0000 7fbf157df9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.578+0000 7fbf157df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:26.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.578+0000 7fbf157df9c0 20 started sync module instance, tier type = 2024-09-12T17:55:26.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.578+0000 7fbf157df9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:26.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.602+0000 7fbf157df9c0 20 add_watcher() i=0 2024-09-12T17:55:26.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.602+0000 7fbf157df9c0 20 add_watcher() i=1 2024-09-12T17:55:26.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.602+0000 7fbf157df9c0 20 add_watcher() i=2 2024-09-12T17:55:26.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.602+0000 7fbf157df9c0 20 add_watcher() i=3 2024-09-12T17:55:26.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.602+0000 7fbf157df9c0 20 add_watcher() i=4 2024-09-12T17:55:26.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.602+0000 7fbf157df9c0 20 add_watcher() i=5 2024-09-12T17:55:26.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.606+0000 7fbf157df9c0 20 add_watcher() i=6 2024-09-12T17:55:26.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.606+0000 7fbf157df9c0 20 add_watcher() i=7 2024-09-12T17:55:26.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.606+0000 7fbf157df9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:26.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.610+0000 7fbdc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:26.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.614+0000 7fbf157df9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:26.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.614+0000 7fbf157df9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:26.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.614+0000 7fbf157df9c0 5 note: GC not initialized 2024-09-12T17:55:26.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.614+0000 7fbdc8fe1640 20 reqs_thread_entry: start 2024-09-12T17:55:26.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.614+0000 7fbf157df9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:26.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.614+0000 7fbf157df9c0 20 Filter name: none 2024-09-12T17:55:26.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.614+0000 7fbd427fc640 20 reqs_thread_entry: start 2024-09-12T17:55:26.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.614+0000 7fbf157df9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.614+0000 7fbf157df9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:55:26.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.614+0000 7fbf157df9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.614+0000 7fbf157df9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:55:26.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.614+0000 7fbf157df9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:26.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.614+0000 7fbf157df9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.618+0000 7fbf157df9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:55:26.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.618+0000 7fbf157df9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.619 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.618+0000 7fbf157df9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:55:26.619 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.618+0000 7fbf157df9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:26.622 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.622+0000 7fbdc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:26.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.626+0000 7fbf157df9c0 20 remove_watcher() i=0 2024-09-12T17:55:26.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.626+0000 7fbf157df9c0 2 removed watcher, disabling cache 2024-09-12T17:55:26.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.630+0000 7fbf157df9c0 20 remove_watcher() i=1 2024-09-12T17:55:26.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.630+0000 7fbf157df9c0 20 remove_watcher() i=2 2024-09-12T17:55:26.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.634+0000 7fbf157df9c0 20 remove_watcher() i=3 2024-09-12T17:55:26.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.634+0000 7fbf157df9c0 20 remove_watcher() i=4 2024-09-12T17:55:26.637 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.638+0000 7fbf157df9c0 20 remove_watcher() i=5 2024-09-12T17:55:26.639 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.638+0000 7fbf157df9c0 20 remove_watcher() i=6 2024-09-12T17:55:26.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.638+0000 7fbf157df9c0 20 remove_watcher() i=7 2024-09-12T17:55:26.655 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:26.656 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:55:26.656 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-init-index id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:55:26.656 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:26.656 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T17:55:26.693 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:26.693 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:26.737 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.734+0000 7ff4f83619c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.738 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.738+0000 7ff4f83619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:26.738 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.738+0000 7ff4f83619c0 20 realm 2024-09-12T17:55:26.738 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.738+0000 7ff4f83619c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.739 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.738+0000 7ff4f83619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:26.739 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.738+0000 7ff4f83619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:26.739 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.738+0000 7ff4f83619c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.739 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.738+0000 7ff4f83619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:26.739 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.738+0000 7ff4f83619c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.740 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.738+0000 7ff4f83619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:26.740 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.738+0000 7ff4f83619c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.738+0000 7ff4f83619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:26.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.738+0000 7ff4f83619c0 20 searching for the correct realm 2024-09-12T17:55:26.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.742+0000 7ff4effff640 0 -- 172.21.15.98:0/2106216685 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7ff4e803e040 msgr2=0x7ff4e802f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:26.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.750+0000 7ff4f5e67640 0 -- 172.21.15.98:0/2106216685 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7ff4e004c910 msgr2=0x7ff4e003e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:26.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.966+0000 7ff4f83619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:26.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.966+0000 7ff4f83619c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:26.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.966+0000 7ff4f83619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:26.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.966+0000 7ff4f83619c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:26.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.966+0000 7ff4f83619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:26.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.966+0000 7ff4f83619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:26.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.966+0000 7ff4f83619c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.966+0000 7ff4f83619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:26.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.966+0000 7ff4f83619c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.970+0000 7ff4f83619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:26.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.970+0000 7ff4f83619c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.970+0000 7ff4f83619c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:26.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.970+0000 7ff4f83619c0 20 zone default found 2024-09-12T17:55:26.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.970+0000 7ff4f83619c0 4 Realm: () 2024-09-12T17:55:26.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.970+0000 7ff4f83619c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:26.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.970+0000 7ff4f83619c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:26.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.970+0000 7ff4f83619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:26.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.970+0000 7ff4f83619c0 20 zonegroup default 2024-09-12T17:55:26.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.970+0000 7ff4f83619c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.970+0000 7ff4f83619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:26.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.970+0000 7ff4f83619c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.970+0000 7ff4f83619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:26.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.970+0000 7ff4f83619c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:26.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.970+0000 7ff4f83619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:26.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.970+0000 7ff4f83619c0 20 started sync module instance, tier type = 2024-09-12T17:55:26.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.970+0000 7ff4f83619c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:26.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.994+0000 7ff4f83619c0 20 add_watcher() i=0 2024-09-12T17:55:26.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.994+0000 7ff4f83619c0 20 add_watcher() i=1 2024-09-12T17:55:26.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.994+0000 7ff4f83619c0 20 add_watcher() i=2 2024-09-12T17:55:26.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.994+0000 7ff4f83619c0 20 add_watcher() i=3 2024-09-12T17:55:26.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.994+0000 7ff4f83619c0 20 add_watcher() i=4 2024-09-12T17:55:26.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.994+0000 7ff4f83619c0 20 add_watcher() i=5 2024-09-12T17:55:26.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.994+0000 7ff4f83619c0 20 add_watcher() i=6 2024-09-12T17:55:27.000 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.998+0000 7ff4f83619c0 20 add_watcher() i=7 2024-09-12T17:55:27.000 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:26.998+0000 7ff4f83619c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:27.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.002+0000 7ff3a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:27.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.002+0000 7ff4f83619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:27.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.002+0000 7ff4f83619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:27.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.002+0000 7ff4f83619c0 5 note: GC not initialized 2024-09-12T17:55:27.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.002+0000 7ff3a67fc640 20 reqs_thread_entry: start 2024-09-12T17:55:27.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.002+0000 7ff4f83619c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:27.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.002+0000 7ff4f83619c0 20 Filter name: none 2024-09-12T17:55:27.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.006+0000 7ff317fff640 20 reqs_thread_entry: start 2024-09-12T17:55:27.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.006+0000 7ff4f83619c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:55:27.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.006+0000 7ff4f83619c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.006+0000 7ff4f83619c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:55:27.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.006+0000 7ff4f83619c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:55:27.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.006+0000 7ff4f83619c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:55:27.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.006+0000 7ff4f83619c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 : miss 2024-09-12T17:55:27.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.006+0000 7ff4f83619c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.006+0000 7ff4f83619c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:55:27.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.006+0000 7ff4f83619c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 info.flags=0x17 2024-09-12T17:55:27.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.006+0000 7ff4f83619c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 to cache LRU end 2024-09-12T17:55:27.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.006+0000 7ff4f83619c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:27.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.006+0000 7ff4f83619c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:27.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.006+0000 7ff4f83619c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 2024-09-12T17:55:27.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.010+0000 7ff4f83619c0 -1 Injecting error=-5 at location=init_index 2024-09-12T17:55:27.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.010+0000 7ff4f83619c0 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T17:55:27.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.014+0000 7ff3a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:27.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.018+0000 7ff4f83619c0 20 remove_watcher() i=0 2024-09-12T17:55:27.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.018+0000 7ff4f83619c0 2 removed watcher, disabling cache 2024-09-12T17:55:27.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.022+0000 7ff4f83619c0 20 remove_watcher() i=1 2024-09-12T17:55:27.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.022+0000 7ff4f83619c0 20 remove_watcher() i=2 2024-09-12T17:55:27.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.026+0000 7ff4f83619c0 20 remove_watcher() i=3 2024-09-12T17:55:27.029 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.026+0000 7ff4f83619c0 20 remove_watcher() i=4 2024-09-12T17:55:27.030 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.030+0000 7ff4f83619c0 20 remove_watcher() i=5 2024-09-12T17:55:27.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.030+0000 7ff4f83619c0 20 remove_watcher() i=6 2024-09-12T17:55:27.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.030+0000 7ff4f83619c0 20 remove_watcher() i=7 2024-09-12T17:55:27.047 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:55:27.074 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:27.074 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:27.116 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.114+0000 7f25134169c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.117 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.118+0000 7f25134169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:27.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.118+0000 7f25134169c0 20 realm 2024-09-12T17:55:27.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.118+0000 7f25134169c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.118+0000 7f25134169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:27.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.118+0000 7f25134169c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:27.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.118+0000 7f25134169c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.118+0000 7f25134169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:27.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.118+0000 7f25134169c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.118+0000 7f25134169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:27.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.118+0000 7f25134169c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.118+0000 7f25134169c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:27.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.118+0000 7f25134169c0 20 searching for the correct realm 2024-09-12T17:55:27.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.126+0000 7f251071b640 0 -- 172.21.15.98:0/2875065429 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f25000bf020 msgr2=0x7f25000df1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:55:27.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.130+0000 7f251071b640 0 -- 172.21.15.98:0/2875065429 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f23dc081180 msgr2=0x7f23dc0835b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:27.140 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.138+0000 7f25134169c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:27.140 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.138+0000 7f25134169c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:27.141 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.138+0000 7f25134169c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:27.141 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.138+0000 7f25134169c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:27.141 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.138+0000 7f25134169c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:27.141 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.138+0000 7f25134169c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:27.141 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.138+0000 7f25134169c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.141 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.138+0000 7f25134169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:27.142 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.138+0000 7f25134169c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.144 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.138+0000 7f25134169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:27.144 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.138+0000 7f25134169c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.144 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.138+0000 7f25134169c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:27.144 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.138+0000 7f25134169c0 20 zone default found 2024-09-12T17:55:27.145 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.138+0000 7f25134169c0 4 Realm: () 2024-09-12T17:55:27.145 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.138+0000 7f25134169c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:27.145 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.138+0000 7f25134169c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:27.145 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.138+0000 7f25134169c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:27.145 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.138+0000 7f25134169c0 20 zonegroup default 2024-09-12T17:55:27.146 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.138+0000 7f25134169c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.146 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.142+0000 7f25134169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:27.146 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.142+0000 7f25134169c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.146 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.142+0000 7f25134169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:27.146 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.142+0000 7f25134169c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.146 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.142+0000 7f25134169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:27.147 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.142+0000 7f25134169c0 20 started sync module instance, tier type = 2024-09-12T17:55:27.147 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.142+0000 7f25134169c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:27.157 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.154+0000 7f25134169c0 20 add_watcher() i=0 2024-09-12T17:55:27.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.154+0000 7f25134169c0 20 add_watcher() i=1 2024-09-12T17:55:27.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.154+0000 7f25134169c0 20 add_watcher() i=2 2024-09-12T17:55:27.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.154+0000 7f25134169c0 20 add_watcher() i=3 2024-09-12T17:55:27.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.154+0000 7f25134169c0 20 add_watcher() i=4 2024-09-12T17:55:27.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.154+0000 7f25134169c0 20 add_watcher() i=5 2024-09-12T17:55:27.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.154+0000 7f25134169c0 20 add_watcher() i=6 2024-09-12T17:55:27.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.158+0000 7f25134169c0 20 add_watcher() i=7 2024-09-12T17:55:27.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.158+0000 7f25134169c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:27.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.158+0000 7f23c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:27.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.158+0000 7f25134169c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:27.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.158+0000 7f25134169c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:27.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.158+0000 7f25134169c0 5 note: GC not initialized 2024-09-12T17:55:27.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.158+0000 7f23c67e4640 20 reqs_thread_entry: start 2024-09-12T17:55:27.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.158+0000 7f25134169c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:27.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.158+0000 7f25134169c0 20 Filter name: none 2024-09-12T17:55:27.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.158+0000 7f23bf7fe640 20 reqs_thread_entry: start 2024-09-12T17:55:27.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.158+0000 7f25134169c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.162+0000 7f25134169c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:55:27.165 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.162+0000 7f25134169c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.162+0000 7f25134169c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:55:27.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.162+0000 7f25134169c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:27.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.162+0000 7f25134169c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.162+0000 7f25134169c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:55:27.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.162+0000 7f25134169c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.162+0000 7f25134169c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:55:27.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.162+0000 7f25134169c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:27.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.166+0000 7f23c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:27.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.170+0000 7f25134169c0 20 remove_watcher() i=0 2024-09-12T17:55:27.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.170+0000 7f25134169c0 2 removed watcher, disabling cache 2024-09-12T17:55:27.173 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.170+0000 7f25134169c0 20 remove_watcher() i=1 2024-09-12T17:55:27.175 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.174+0000 7f25134169c0 20 remove_watcher() i=2 2024-09-12T17:55:27.176 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.174+0000 7f25134169c0 20 remove_watcher() i=3 2024-09-12T17:55:27.179 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.178+0000 7f25134169c0 20 remove_watcher() i=4 2024-09-12T17:55:27.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.178+0000 7f25134169c0 20 remove_watcher() i=5 2024-09-12T17:55:27.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.178+0000 7f25134169c0 20 remove_watcher() i=6 2024-09-12T17:55:27.182 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.182+0000 7f25134169c0 20 remove_watcher() i=7 2024-09-12T17:55:27.196 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:27.196 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:55:27.197 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-init-index id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:55:27.197 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:27.197 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:27.197 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:27.242 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:27.243 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:27.299 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:55:27.335 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:27.335 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:27.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.378+0000 7f38ff51b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.378+0000 7f38ff51b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:27.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.378+0000 7f38ff51b9c0 20 realm 2024-09-12T17:55:27.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.378+0000 7f38ff51b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.378+0000 7f38ff51b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:27.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.378+0000 7f38ff51b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:27.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.378+0000 7f38ff51b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.378+0000 7f38ff51b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:27.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.378+0000 7f38ff51b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.382+0000 7f38ff51b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:27.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.382+0000 7f38ff51b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.382+0000 7f38ff51b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:27.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.382+0000 7f38ff51b9c0 20 searching for the correct realm 2024-09-12T17:55:27.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.386+0000 7f38fc820640 0 -- 172.21.15.98:0/187448351 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x559031eb45f0 msgr2=0x559031eb6a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:27.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.394+0000 7f38fc820640 0 -- 172.21.15.98:0/187448351 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f38f0019040 msgr2=0x7f38f003c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:27.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.398+0000 7f38ff51b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:27.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.398+0000 7f38ff51b9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:27.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.398+0000 7f38ff51b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:27.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.398+0000 7f38ff51b9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:27.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.398+0000 7f38ff51b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:27.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.398+0000 7f38ff51b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:27.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.398+0000 7f38ff51b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.398+0000 7f38ff51b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:27.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.398+0000 7f38ff51b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.402+0000 7f38ff51b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:27.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.402+0000 7f38ff51b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.402+0000 7f38ff51b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:27.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.402+0000 7f38ff51b9c0 20 zone default found 2024-09-12T17:55:27.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.402+0000 7f38ff51b9c0 4 Realm: () 2024-09-12T17:55:27.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.402+0000 7f38ff51b9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:27.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.402+0000 7f38ff51b9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:27.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.402+0000 7f38ff51b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:27.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.402+0000 7f38ff51b9c0 20 zonegroup default 2024-09-12T17:55:27.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.402+0000 7f38ff51b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.402+0000 7f38ff51b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:27.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.402+0000 7f38ff51b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.402+0000 7f38ff51b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:27.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.402+0000 7f38ff51b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.402+0000 7f38ff51b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:27.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.402+0000 7f38ff51b9c0 20 started sync module instance, tier type = 2024-09-12T17:55:27.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.402+0000 7f38ff51b9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:27.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.418+0000 7f38ff51b9c0 20 add_watcher() i=0 2024-09-12T17:55:27.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.418+0000 7f38ff51b9c0 20 add_watcher() i=1 2024-09-12T17:55:27.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.418+0000 7f38ff51b9c0 20 add_watcher() i=2 2024-09-12T17:55:27.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.418+0000 7f38ff51b9c0 20 add_watcher() i=3 2024-09-12T17:55:27.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.418+0000 7f38ff51b9c0 20 add_watcher() i=4 2024-09-12T17:55:27.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.418+0000 7f38ff51b9c0 20 add_watcher() i=5 2024-09-12T17:55:27.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.418+0000 7f38ff51b9c0 20 add_watcher() i=6 2024-09-12T17:55:27.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.422+0000 7f38ff51b9c0 20 add_watcher() i=7 2024-09-12T17:55:27.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.422+0000 7f38ff51b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:27.424 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.422+0000 7f37b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:27.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.422+0000 7f38ff51b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:27.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.422+0000 7f38ff51b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:27.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.422+0000 7f38ff51b9c0 5 note: GC not initialized 2024-09-12T17:55:27.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.422+0000 7f37b27e4640 20 reqs_thread_entry: start 2024-09-12T17:55:27.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.422+0000 7f38ff51b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:27.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.422+0000 7f38ff51b9c0 20 Filter name: none 2024-09-12T17:55:27.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.422+0000 7f3723fff640 20 reqs_thread_entry: start 2024-09-12T17:55:27.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.426+0000 7f38ff51b9c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:55:27.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.426+0000 7f38ff51b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.426+0000 7f38ff51b9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:55:27.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.426+0000 7f38ff51b9c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:55:27.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.426+0000 7f38ff51b9c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:55:27.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.426+0000 7f38ff51b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 : miss 2024-09-12T17:55:27.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.426+0000 7f38ff51b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.426+0000 7f38ff51b9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:55:27.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.426+0000 7f38ff51b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 info.flags=0x17 2024-09-12T17:55:27.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.426+0000 7f38ff51b9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 to cache LRU end 2024-09-12T17:55:27.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.426+0000 7f38ff51b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:27.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.426+0000 7f38ff51b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:27.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.426+0000 7f38ff51b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 2024-09-12T17:55:27.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.434+0000 7f38ff51b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 info.flags=0x17 2024-09-12T17:55:27.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.434+0000 7f38ff51b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 to cache LRU end 2024-09-12T17:55:27.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.434+0000 7f38ff51b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:27.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.434+0000 7f38ff51b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19, ofs0, ns] 2024-09-12T17:55:27.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.434+0000 7f37e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366184 cookie 94077801207136 notifier 6315 bl.length()=911 2024-09-12T17:55:27.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.434+0000 7f37e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 info.flags=0x17 2024-09-12T17:55:27.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.434+0000 7f37e0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 to cache LRU end 2024-09-12T17:55:27.437 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.434+0000 7f37e0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:27.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.438+0000 7f38ff51b9c0 20 handle_bi_update(): bucket=:error-at-init-index[a01e4849-e968-46ce-97f1-a673c26b3735.4529.19]): orig_sources= new_sources= 2024-09-12T17:55:27.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.438+0000 7f38ff51b9c0 20 handle_bi_update(): bucket=:error-at-init-index[a01e4849-e968-46ce-97f1-a673c26b3735.4529.19]): potential sources added=[] removed=[] 2024-09-12T17:55:27.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.438+0000 7f38ff51b9c0 20 handle_bi_update(): bucket=:error-at-init-index[a01e4849-e968-46ce-97f1-a673c26b3735.4529.19]): orig_dests= new_dests= 2024-09-12T17:55:27.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.438+0000 7f38ff51b9c0 20 handle_bi_update(): bucket=:error-at-init-index[a01e4849-e968-46ce-97f1-a673c26b3735.4529.19]): potential dests added=[] removed=[] 2024-09-12T17:55:27.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.0 2024-09-12T17:55:27.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.0 2024-09-12T17:55:27.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.1 2024-09-12T17:55:27.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.1 2024-09-12T17:55:27.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.2 2024-09-12T17:55:27.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.2 2024-09-12T17:55:27.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.3 2024-09-12T17:55:27.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.3 2024-09-12T17:55:27.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.4 2024-09-12T17:55:27.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.4 2024-09-12T17:55:27.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.5 2024-09-12T17:55:27.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.5 2024-09-12T17:55:27.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.6 2024-09-12T17:55:27.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.6 2024-09-12T17:55:27.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.7 2024-09-12T17:55:27.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.7 2024-09-12T17:55:27.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.8 2024-09-12T17:55:27.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.8 2024-09-12T17:55:27.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.9 2024-09-12T17:55:27.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.9 2024-09-12T17:55:27.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.10 2024-09-12T17:55:27.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.10 2024-09-12T17:55:27.448 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.11 2024-09-12T17:55:27.448 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1.11 2024-09-12T17:55:27.448 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.0 2024-09-12T17:55:27.448 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1 2024-09-12T17:55:27.448 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.2 2024-09-12T17:55:27.448 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.3 2024-09-12T17:55:27.449 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.4 2024-09-12T17:55:27.449 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.446+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.5 2024-09-12T17:55:27.451 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.450+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.6 2024-09-12T17:55:27.451 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.450+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.7 2024-09-12T17:55:27.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.450+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.8 2024-09-12T17:55:27.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.450+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.9 2024-09-12T17:55:27.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.450+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.10 2024-09-12T17:55:27.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.454+0000 7f38ff51b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:55:27.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.454+0000 7f38ff51b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 2024-09-12T17:55:27.458 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.458+0000 7f38ff51b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 info.flags=0x17 2024-09-12T17:55:27.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.458+0000 7f38ff51b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 to cache LRU end 2024-09-12T17:55:27.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.458+0000 7f38ff51b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:27.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.458+0000 7f38ff51b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19, ofs0, ns] 2024-09-12T17:55:27.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.458+0000 7f37cffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366185 cookie 94077801207136 notifier 6315 bl.length()=911 2024-09-12T17:55:27.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.458+0000 7f37cffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 info.flags=0x17 2024-09-12T17:55:27.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.458+0000 7f37cffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 to cache LRU end 2024-09-12T17:55:27.460 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.458+0000 7f37cffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:27.462 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.462+0000 7f38ff51b9c0 20 handle_bi_update(): bucket=:error-at-init-index[a01e4849-e968-46ce-97f1-a673c26b3735.4529.19]): orig_sources= new_sources= 2024-09-12T17:55:27.462 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.462+0000 7f38ff51b9c0 20 handle_bi_update(): bucket=:error-at-init-index[a01e4849-e968-46ce-97f1-a673c26b3735.4529.19]): potential sources added=[] removed=[] 2024-09-12T17:55:27.462 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.462+0000 7f38ff51b9c0 20 handle_bi_update(): bucket=:error-at-init-index[a01e4849-e968-46ce-97f1-a673c26b3735.4529.19]): orig_dests= new_dests= 2024-09-12T17:55:27.462 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.462+0000 7f38ff51b9c0 20 handle_bi_update(): bucket=:error-at-init-index[a01e4849-e968-46ce-97f1-a673c26b3735.4529.19]): potential dests added=[] removed=[] 2024-09-12T17:55:27.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.462+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.0 2024-09-12T17:55:27.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.466+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.1 2024-09-12T17:55:27.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.466+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.2 2024-09-12T17:55:27.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.466+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.3 2024-09-12T17:55:27.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.466+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.4 2024-09-12T17:55:27.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.466+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.5 2024-09-12T17:55:27.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.466+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.6 2024-09-12T17:55:27.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.466+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.7 2024-09-12T17:55:27.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.466+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.8 2024-09-12T17:55:27.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.470+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.9 2024-09-12T17:55:27.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.470+0000 7f38ff51b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.19.10 2024-09-12T17:55:27.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.470+0000 7f38ff51b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 : hit (requested=0x17, cached=0x17) 2024-09-12T17:55:27.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.470+0000 7f38ff51b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 2024-09-12T17:55:27.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.470+0000 7f38ff51b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 info.flags=0x17 2024-09-12T17:55:27.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.470+0000 7f38ff51b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 to cache LRU end 2024-09-12T17:55:27.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.470+0000 7f38ff51b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:27.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.470+0000 7f38ff51b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19, ofs0, ns] 2024-09-12T17:55:27.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.470+0000 7f37e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366186 cookie 94077801207136 notifier 6315 bl.length()=879 2024-09-12T17:55:27.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.470+0000 7f37e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 info.flags=0x17 2024-09-12T17:55:27.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.470+0000 7f37e0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 to cache LRU end 2024-09-12T17:55:27.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.470+0000 7f37e0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:27.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.474+0000 7f38ff51b9c0 20 handle_bi_update(): bucket=:error-at-init-index[a01e4849-e968-46ce-97f1-a673c26b3735.4529.19]): orig_sources= new_sources= 2024-09-12T17:55:27.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.474+0000 7f38ff51b9c0 20 handle_bi_update(): bucket=:error-at-init-index[a01e4849-e968-46ce-97f1-a673c26b3735.4529.19]): potential sources added=[] removed=[] 2024-09-12T17:55:27.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.474+0000 7f38ff51b9c0 20 handle_bi_update(): bucket=:error-at-init-index[a01e4849-e968-46ce-97f1-a673c26b3735.4529.19]): orig_dests= new_dests= 2024-09-12T17:55:27.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.474+0000 7f38ff51b9c0 20 handle_bi_update(): bucket=:error-at-init-index[a01e4849-e968-46ce-97f1-a673c26b3735.4529.19]): potential dests added=[] removed=[] 2024-09-12T17:55:27.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.478+0000 7f38ff51b9c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T17:55:27.482 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.482+0000 7f37b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:27.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.486+0000 7f38ff51b9c0 20 remove_watcher() i=0 2024-09-12T17:55:27.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.486+0000 7f38ff51b9c0 2 removed watcher, disabling cache 2024-09-12T17:55:27.488 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.486+0000 7f38ff51b9c0 20 remove_watcher() i=1 2024-09-12T17:55:27.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.490+0000 7f38ff51b9c0 20 remove_watcher() i=2 2024-09-12T17:55:27.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.490+0000 7f38ff51b9c0 20 remove_watcher() i=3 2024-09-12T17:55:27.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.494+0000 7f38ff51b9c0 20 remove_watcher() i=4 2024-09-12T17:55:27.496 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.494+0000 7f38ff51b9c0 20 remove_watcher() i=5 2024-09-12T17:55:27.496 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.494+0000 7f38ff51b9c0 20 remove_watcher() i=6 2024-09-12T17:55:27.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.498+0000 7f38ff51b9c0 20 remove_watcher() i=7 2024-09-12T17:55:27.511 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:55:27.537 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:27.537 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:27.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.578+0000 7f89ed1839c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.578+0000 7f89ed1839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:27.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.578+0000 7f89ed1839c0 20 realm 2024-09-12T17:55:27.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.578+0000 7f89ed1839c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.578+0000 7f89ed1839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:27.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.578+0000 7f89ed1839c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:27.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.578+0000 7f89ed1839c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.578+0000 7f89ed1839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:27.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.578+0000 7f89ed1839c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.582+0000 7f89ed1839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:27.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.582+0000 7f89ed1839c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:27.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.582+0000 7f89ed1839c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:27.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.582+0000 7f89ed1839c0 20 searching for the correct realm 2024-09-12T17:55:27.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.586+0000 7f89ea488640 0 -- 172.21.15.98:0/3164575304 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f89dc0d9070 msgr2=0x7f89dc105da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:55:27.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:27.802+0000 7f89eac89640 0 -- 172.21.15.98:0/3164575304 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f89e003a420 msgr2=0x7f89e003a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:28.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.018+0000 7f89ed1839c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:28.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.018+0000 7f89ed1839c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:28.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.018+0000 7f89ed1839c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:28.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.018+0000 7f89ed1839c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:28.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.018+0000 7f89ed1839c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:28.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.018+0000 7f89ed1839c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:28.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.018+0000 7f89ed1839c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:28.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.018+0000 7f89ed1839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:28.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.018+0000 7f89ed1839c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:28.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.022+0000 7f89ed1839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:28.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.022+0000 7f89ed1839c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:28.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.022+0000 7f89ed1839c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:28.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.022+0000 7f89ed1839c0 20 zone default found 2024-09-12T17:55:28.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.022+0000 7f89ed1839c0 4 Realm: () 2024-09-12T17:55:28.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.022+0000 7f89ed1839c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:28.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.022+0000 7f89ed1839c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:28.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.022+0000 7f89ed1839c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:28.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.022+0000 7f89ed1839c0 20 zonegroup default 2024-09-12T17:55:28.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.022+0000 7f89ed1839c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:28.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.022+0000 7f89ed1839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:28.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.022+0000 7f89ed1839c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:28.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.022+0000 7f89ed1839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:28.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.022+0000 7f89ed1839c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:28.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.026+0000 7f89ed1839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:28.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.026+0000 7f89ed1839c0 20 started sync module instance, tier type = 2024-09-12T17:55:28.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.026+0000 7f89ed1839c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:28.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.050+0000 7f89ed1839c0 20 add_watcher() i=0 2024-09-12T17:55:28.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.050+0000 7f89ed1839c0 20 add_watcher() i=1 2024-09-12T17:55:28.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.050+0000 7f89ed1839c0 20 add_watcher() i=2 2024-09-12T17:55:28.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.050+0000 7f89ed1839c0 20 add_watcher() i=3 2024-09-12T17:55:28.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.050+0000 7f89ed1839c0 20 add_watcher() i=4 2024-09-12T17:55:28.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.050+0000 7f89ed1839c0 20 add_watcher() i=5 2024-09-12T17:55:28.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.050+0000 7f89ed1839c0 20 add_watcher() i=6 2024-09-12T17:55:28.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.050+0000 7f89ed1839c0 20 add_watcher() i=7 2024-09-12T17:55:28.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.050+0000 7f89ed1839c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:28.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.054+0000 7f88a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:28.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.054+0000 7f89ed1839c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:28.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.054+0000 7f89ed1839c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:28.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.054+0000 7f89ed1839c0 5 note: GC not initialized 2024-09-12T17:55:28.058 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.058+0000 7f881bfff640 20 reqs_thread_entry: start 2024-09-12T17:55:28.058 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.058+0000 7f89ed1839c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:28.058 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.058+0000 7f89ed1839c0 20 Filter name: none 2024-09-12T17:55:28.059 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.058+0000 7f8819ffb640 20 reqs_thread_entry: start 2024-09-12T17:55:28.059 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.058+0000 7f89ed1839c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:28.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.058+0000 7f89ed1839c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:55:28.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.058+0000 7f89ed1839c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:28.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.058+0000 7f89ed1839c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:55:28.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.058+0000 7f89ed1839c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:28.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.058+0000 7f89ed1839c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:28.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.058+0000 7f89ed1839c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:55:28.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.058+0000 7f89ed1839c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:28.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.062+0000 7f89ed1839c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:55:28.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.062+0000 7f89ed1839c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:28.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.066+0000 7f88a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:28.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.070+0000 7f89ed1839c0 20 remove_watcher() i=0 2024-09-12T17:55:28.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.070+0000 7f89ed1839c0 2 removed watcher, disabling cache 2024-09-12T17:55:28.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.070+0000 7f89ed1839c0 20 remove_watcher() i=1 2024-09-12T17:55:28.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.074+0000 7f89ed1839c0 20 remove_watcher() i=2 2024-09-12T17:55:28.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.074+0000 7f89ed1839c0 20 remove_watcher() i=3 2024-09-12T17:55:28.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.078+0000 7f89ed1839c0 20 remove_watcher() i=4 2024-09-12T17:55:28.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.082+0000 7f89ed1839c0 20 remove_watcher() i=5 2024-09-12T17:55:28.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.082+0000 7f89ed1839c0 20 remove_watcher() i=6 2024-09-12T17:55:28.085 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:28.082+0000 7f89ed1839c0 20 remove_watcher() i=7 2024-09-12T17:55:28.101 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:28.101 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:55:28.101 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-init-index id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:55:28.101 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:28.102 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:28.102 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:28.127 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:28.127 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:28.666 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:28.666 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:29.017 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T17:55:29.018 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:29.020 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:29.020 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:29.138 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:29.138 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:29.225 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:29.225 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:29.318 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:29.319 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:29.414 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:29.414 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:29.510 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:29.510 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:29.607 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:29.607 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:29.704 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:29.704 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:29.797 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:29.797 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:29.891 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:29.891 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:29.985 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:29.985 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:30.082 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:30.082 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:30.176 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:30.176 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:30.274 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:30.274 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:30.346 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:30.346 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:30.444 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:30.444 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:30.549 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:30.549 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:30.647 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:30.647 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:30.723 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:30.723 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:30.825 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:30.825 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:30.923 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:30.924 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:31.015 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:31.015 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:31.104 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:55:31.138 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:31.138 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:31.184 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.182+0000 7f4f9dc8e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.186 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.182+0000 7f4f9dc8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.186 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.182+0000 7f4f9dc8e9c0 20 realm 2024-09-12T17:55:31.186 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.182+0000 7f4f9dc8e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.187 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.186+0000 7f4f9dc8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.187 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.186+0000 7f4f9dc8e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:31.187 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.186+0000 7f4f9dc8e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.187 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.186+0000 7f4f9dc8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.187 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.186+0000 7f4f9dc8e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.188 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.186+0000 7f4f9dc8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:31.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.186+0000 7f4f9dc8e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.186+0000 7f4f9dc8e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:31.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.186+0000 7f4f9dc8e9c0 20 searching for the correct realm 2024-09-12T17:55:31.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.194+0000 7f4f9bf95640 0 -- 172.21.15.98:0/4160993782 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x561a686ed940 msgr2=0x561a686efe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:31.201 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.198+0000 7f4f9af93640 0 -- 172.21.15.98:0/4160993782 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f4f8c018070 msgr2=0x7f4f8c05e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:31.208 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.206+0000 7f4f9dc8e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:31.208 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.206+0000 7f4f9dc8e9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:31.208 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.206+0000 7f4f9dc8e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:31.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.206+0000 7f4f9dc8e9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:31.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.206+0000 7f4f9dc8e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:31.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.206+0000 7f4f9dc8e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:31.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.206+0000 7f4f9dc8e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.206+0000 7f4f9dc8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.206+0000 7f4f9dc8e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.206+0000 7f4f9dc8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:31.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.206+0000 7f4f9dc8e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.210+0000 7f4f9dc8e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:31.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.210+0000 7f4f9dc8e9c0 20 zone default found 2024-09-12T17:55:31.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.210+0000 7f4f9dc8e9c0 4 Realm: () 2024-09-12T17:55:31.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.210+0000 7f4f9dc8e9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:31.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.210+0000 7f4f9dc8e9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:31.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.210+0000 7f4f9dc8e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:31.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.210+0000 7f4f9dc8e9c0 20 zonegroup default 2024-09-12T17:55:31.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.210+0000 7f4f9dc8e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.211 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.210+0000 7f4f9dc8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.211 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.210+0000 7f4f9dc8e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.211 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.210+0000 7f4f9dc8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.212 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.210+0000 7f4f9dc8e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.212 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.210+0000 7f4f9dc8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.212 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.210+0000 7f4f9dc8e9c0 20 started sync module instance, tier type = 2024-09-12T17:55:31.212 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.210+0000 7f4f9dc8e9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:31.229 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.226+0000 7f4f9dc8e9c0 20 add_watcher() i=0 2024-09-12T17:55:31.229 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.226+0000 7f4f9dc8e9c0 20 add_watcher() i=1 2024-09-12T17:55:31.230 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.226+0000 7f4f9dc8e9c0 20 add_watcher() i=2 2024-09-12T17:55:31.230 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.226+0000 7f4f9dc8e9c0 20 add_watcher() i=3 2024-09-12T17:55:31.230 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.226+0000 7f4f9dc8e9c0 20 add_watcher() i=4 2024-09-12T17:55:31.230 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.226+0000 7f4f9dc8e9c0 20 add_watcher() i=5 2024-09-12T17:55:31.230 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.226+0000 7f4f9dc8e9c0 20 add_watcher() i=6 2024-09-12T17:55:31.230 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.230+0000 7f4f9dc8e9c0 20 add_watcher() i=7 2024-09-12T17:55:31.230 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.230+0000 7f4f9dc8e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:31.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.230+0000 7f4e51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:31.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.230+0000 7f4f9dc8e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:31.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.230+0000 7f4f9dc8e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:31.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.230+0000 7f4f9dc8e9c0 5 note: GC not initialized 2024-09-12T17:55:31.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.230+0000 7f4e50fe1640 20 reqs_thread_entry: start 2024-09-12T17:55:31.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.230+0000 7f4f9dc8e9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:31.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.230+0000 7f4f9dc8e9c0 20 Filter name: none 2024-09-12T17:55:31.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.234+0000 7f4dca7fc640 20 reqs_thread_entry: start 2024-09-12T17:55:31.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.234+0000 7f4f9dc8e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.234+0000 7f4f9dc8e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:55:31.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.234+0000 7f4f9dc8e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.236 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.234+0000 7f4f9dc8e9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:55:31.236 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.234+0000 7f4f9dc8e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:31.236 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.234+0000 7f4f9dc8e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.234+0000 7f4f9dc8e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:55:31.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.234+0000 7f4f9dc8e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.238+0000 7f4f9dc8e9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:55:31.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.238+0000 7f4f9dc8e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:31.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.238+0000 7f4e51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:31.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.242+0000 7f4f9dc8e9c0 20 remove_watcher() i=0 2024-09-12T17:55:31.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.242+0000 7f4f9dc8e9c0 2 removed watcher, disabling cache 2024-09-12T17:55:31.247 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.246+0000 7f4f9dc8e9c0 20 remove_watcher() i=1 2024-09-12T17:55:31.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.246+0000 7f4f9dc8e9c0 20 remove_watcher() i=2 2024-09-12T17:55:31.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.250+0000 7f4f9dc8e9c0 20 remove_watcher() i=3 2024-09-12T17:55:31.253 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.254+0000 7f4f9dc8e9c0 20 remove_watcher() i=4 2024-09-12T17:55:31.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.254+0000 7f4f9dc8e9c0 20 remove_watcher() i=5 2024-09-12T17:55:31.256 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.254+0000 7f4f9dc8e9c0 20 remove_watcher() i=6 2024-09-12T17:55:31.257 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.254+0000 7f4f9dc8e9c0 20 remove_watcher() i=7 2024-09-12T17:55:31.273 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:31.273 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:55:31.273 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-init-index id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:55:31.273 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:31.273 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T17:55:31.306 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:31.306 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:31.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.346+0000 7f3d885359c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.350+0000 7f3d885359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.350+0000 7f3d885359c0 20 realm 2024-09-12T17:55:31.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.350+0000 7f3d885359c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.350+0000 7f3d885359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.350+0000 7f3d885359c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:31.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.350+0000 7f3d885359c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.350+0000 7f3d885359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.350+0000 7f3d885359c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.350+0000 7f3d885359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:31.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.350+0000 7f3d885359c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.350+0000 7f3d885359c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:31.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.350+0000 7f3d885359c0 20 searching for the correct realm 2024-09-12T17:55:31.360 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.358+0000 7f3d8683c640 0 -- 172.21.15.98:0/2916945613 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f3d7c0949e0 msgr2=0x7f3d7c046150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:55:31.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.574+0000 7f3d8603b640 0 -- 172.21.15.98:0/2916945613 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x55dabd5a5710 msgr2=0x55dabd5a7b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:31.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.582+0000 7f3d885359c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:31.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.582+0000 7f3d885359c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:31.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.582+0000 7f3d885359c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:31.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.582+0000 7f3d885359c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:31.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.582+0000 7f3d885359c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:31.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.582+0000 7f3d885359c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:31.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.582+0000 7f3d885359c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.582+0000 7f3d885359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.582+0000 7f3d885359c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.582+0000 7f3d885359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:31.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.582+0000 7f3d885359c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.586+0000 7f3d885359c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:31.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.586+0000 7f3d885359c0 20 zone default found 2024-09-12T17:55:31.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.586+0000 7f3d885359c0 4 Realm: () 2024-09-12T17:55:31.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.586+0000 7f3d885359c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:31.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.586+0000 7f3d885359c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:31.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.586+0000 7f3d885359c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:31.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.586+0000 7f3d885359c0 20 zonegroup default 2024-09-12T17:55:31.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.586+0000 7f3d885359c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.586+0000 7f3d885359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.586+0000 7f3d885359c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.586+0000 7f3d885359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.586+0000 7f3d885359c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.586+0000 7f3d885359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.586+0000 7f3d885359c0 20 started sync module instance, tier type = 2024-09-12T17:55:31.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.586+0000 7f3d885359c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:31.619 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.618+0000 7f3d885359c0 20 add_watcher() i=0 2024-09-12T17:55:31.619 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.618+0000 7f3d885359c0 20 add_watcher() i=1 2024-09-12T17:55:31.620 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.618+0000 7f3d885359c0 20 add_watcher() i=2 2024-09-12T17:55:31.620 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.618+0000 7f3d885359c0 20 add_watcher() i=3 2024-09-12T17:55:31.620 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.618+0000 7f3d885359c0 20 add_watcher() i=4 2024-09-12T17:55:31.620 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.618+0000 7f3d885359c0 20 add_watcher() i=5 2024-09-12T17:55:31.620 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.618+0000 7f3d885359c0 20 add_watcher() i=6 2024-09-12T17:55:31.621 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.618+0000 7f3d885359c0 20 add_watcher() i=7 2024-09-12T17:55:31.621 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.618+0000 7f3d885359c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:31.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.626+0000 7f3c3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:31.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.626+0000 7f3d885359c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:31.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.626+0000 7f3d885359c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:31.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.626+0000 7f3d885359c0 5 note: GC not initialized 2024-09-12T17:55:31.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.626+0000 7f3bb77fe640 20 reqs_thread_entry: start 2024-09-12T17:55:31.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.626+0000 7f3d885359c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:31.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.626+0000 7f3d885359c0 20 Filter name: none 2024-09-12T17:55:31.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.626+0000 7f3bb57fa640 20 reqs_thread_entry: start 2024-09-12T17:55:31.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.626+0000 7f3d885359c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T17:55:31.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.626+0000 7f3d885359c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.626+0000 7f3d885359c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:55:31.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.626+0000 7f3d885359c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T17:55:31.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.626+0000 7f3d885359c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T17:55:31.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.626+0000 7f3d885359c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20 : miss 2024-09-12T17:55:31.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.626+0000 7f3d885359c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.630+0000 7f3d885359c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:55:31.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.630+0000 7f3d885359c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20 info.flags=0x17 2024-09-12T17:55:31.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.630+0000 7f3d885359c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20 to cache LRU end 2024-09-12T17:55:31.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.630+0000 7f3d885359c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:31.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.630+0000 7f3d885359c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:31.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.630+0000 7f3d885359c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20 2024-09-12T17:55:31.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.630+0000 7f3d885359c0 -1 Injecting error=-95 at location=init_index 2024-09-12T17:55:31.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.630+0000 7f3d885359c0 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T17:55:31.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.642+0000 7f3d885359c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20 info.flags=0x17 2024-09-12T17:55:31.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.642+0000 7f3d885359c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20 to cache LRU end 2024-09-12T17:55:31.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.642+0000 7f3d885359c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:31.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.642+0000 7f3d885359c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20, ofs0, ns] 2024-09-12T17:55:31.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.642+0000 7f3c69ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366189 cookie 94397968088144 notifier 5960 bl.length()=911 2024-09-12T17:55:31.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.642+0000 7f3c69ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20 info.flags=0x17 2024-09-12T17:55:31.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.642+0000 7f3c69ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20 to cache LRU end 2024-09-12T17:55:31.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.642+0000 7f3c69ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:31.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.646+0000 7f3d885359c0 20 handle_bi_update(): bucket=:error-at-init-index[a01e4849-e968-46ce-97f1-a673c26b3735.4529.20]): orig_sources= new_sources= 2024-09-12T17:55:31.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.646+0000 7f3d885359c0 20 handle_bi_update(): bucket=:error-at-init-index[a01e4849-e968-46ce-97f1-a673c26b3735.4529.20]): potential sources added=[] removed=[] 2024-09-12T17:55:31.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.646+0000 7f3d885359c0 20 handle_bi_update(): bucket=:error-at-init-index[a01e4849-e968-46ce-97f1-a673c26b3735.4529.20]): orig_dests= new_dests= 2024-09-12T17:55:31.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.646+0000 7f3d885359c0 20 handle_bi_update(): bucket=:error-at-init-index[a01e4849-e968-46ce-97f1-a673c26b3735.4529.20]): potential dests added=[] removed=[] 2024-09-12T17:55:31.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.0 2024-09-12T17:55:31.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.0 2024-09-12T17:55:31.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.1 2024-09-12T17:55:31.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.1 2024-09-12T17:55:31.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.2 2024-09-12T17:55:31.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.2 2024-09-12T17:55:31.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.3 2024-09-12T17:55:31.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.3 2024-09-12T17:55:31.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.4 2024-09-12T17:55:31.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.4 2024-09-12T17:55:31.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.5 2024-09-12T17:55:31.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.5 2024-09-12T17:55:31.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.6 2024-09-12T17:55:31.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.6 2024-09-12T17:55:31.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.7 2024-09-12T17:55:31.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.7 2024-09-12T17:55:31.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.8 2024-09-12T17:55:31.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.8 2024-09-12T17:55:31.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.9 2024-09-12T17:55:31.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.9 2024-09-12T17:55:31.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.10 2024-09-12T17:55:31.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.10 2024-09-12T17:55:31.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.11 2024-09-12T17:55:31.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1.11 2024-09-12T17:55:31.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.0 2024-09-12T17:55:31.659 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.654+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.1 2024-09-12T17:55:31.659 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.658+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.2 2024-09-12T17:55:31.659 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.658+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.3 2024-09-12T17:55:31.660 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.658+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.4 2024-09-12T17:55:31.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.658+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.5 2024-09-12T17:55:31.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.662+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.6 2024-09-12T17:55:31.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.662+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.7 2024-09-12T17:55:31.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.662+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.8 2024-09-12T17:55:31.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.662+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.9 2024-09-12T17:55:31.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.666+0000 7f3d885359c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.20.10 2024-09-12T17:55:31.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.670+0000 7f3d885359c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20 : hit (requested=0x17, cached=0x17) 2024-09-12T17:55:31.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.670+0000 7f3d885359c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20 2024-09-12T17:55:31.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.674+0000 7f3d885359c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20 info.flags=0x17 2024-09-12T17:55:31.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.674+0000 7f3d885359c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20 to cache LRU end 2024-09-12T17:55:31.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.674+0000 7f3d885359c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:31.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.674+0000 7f3d885359c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20, ofs0, ns] 2024-09-12T17:55:31.679 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.674+0000 7f3c69ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366190 cookie 94397968088144 notifier 5960 bl.length()=879 2024-09-12T17:55:31.679 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.674+0000 7f3c69ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20 info.flags=0x17 2024-09-12T17:55:31.679 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.674+0000 7f3c69ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20 to cache LRU end 2024-09-12T17:55:31.679 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.674+0000 7f3c69ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:31.679 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.678+0000 7f3d885359c0 20 handle_bi_update(): bucket=:error-at-init-index[a01e4849-e968-46ce-97f1-a673c26b3735.4529.20]): orig_sources= new_sources= 2024-09-12T17:55:31.679 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.678+0000 7f3d885359c0 20 handle_bi_update(): bucket=:error-at-init-index[a01e4849-e968-46ce-97f1-a673c26b3735.4529.20]): potential sources added=[] removed=[] 2024-09-12T17:55:31.679 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.678+0000 7f3d885359c0 20 handle_bi_update(): bucket=:error-at-init-index[a01e4849-e968-46ce-97f1-a673c26b3735.4529.20]): orig_dests= new_dests= 2024-09-12T17:55:31.680 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.678+0000 7f3d885359c0 20 handle_bi_update(): bucket=:error-at-init-index[a01e4849-e968-46ce-97f1-a673c26b3735.4529.20]): potential dests added=[] removed=[] 2024-09-12T17:55:31.685 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.682+0000 7f3d885359c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T17:55:31.688 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.686+0000 7f3c3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:31.693 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.690+0000 7f3d885359c0 20 remove_watcher() i=0 2024-09-12T17:55:31.693 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.690+0000 7f3d885359c0 2 removed watcher, disabling cache 2024-09-12T17:55:31.697 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.694+0000 7f3d885359c0 20 remove_watcher() i=1 2024-09-12T17:55:31.700 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.698+0000 7f3d885359c0 20 remove_watcher() i=2 2024-09-12T17:55:31.705 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.702+0000 7f3d885359c0 20 remove_watcher() i=3 2024-09-12T17:55:31.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.706+0000 7f3d885359c0 20 remove_watcher() i=4 2024-09-12T17:55:31.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.706+0000 7f3d885359c0 20 remove_watcher() i=5 2024-09-12T17:55:31.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.706+0000 7f3d885359c0 20 remove_watcher() i=6 2024-09-12T17:55:31.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.710+0000 7f3d885359c0 20 remove_watcher() i=7 2024-09-12T17:55:31.726 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T17:55:31.756 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:31.756 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:31.799 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.798+0000 7efc7b7869c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.798+0000 7efc7b7869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.798+0000 7efc7b7869c0 20 realm 2024-09-12T17:55:31.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.798+0000 7efc7b7869c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.798+0000 7efc7b7869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.798+0000 7efc7b7869c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:31.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.798+0000 7efc7b7869c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.798+0000 7efc7b7869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:31.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.798+0000 7efc7b7869c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.802+0000 7efc7b7869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:31.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.802+0000 7efc7b7869c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:31.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.802+0000 7efc7b7869c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:31.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.802+0000 7efc7b7869c0 20 searching for the correct realm 2024-09-12T17:55:31.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:31.810+0000 7efc79a8d640 0 -- 172.21.15.98:0/3855310925 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7efc640e7410 msgr2=0x7efc640e7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:32.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.026+0000 7efc7928c640 0 -- 172.21.15.98:0/3855310925 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x55da9c0848c0 msgr2=0x55da9c086cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:32.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.034+0000 7efc7b7869c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:32.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.034+0000 7efc7b7869c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:32.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.034+0000 7efc7b7869c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:32.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.034+0000 7efc7b7869c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:32.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.034+0000 7efc7b7869c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:32.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.034+0000 7efc7b7869c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:32.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.034+0000 7efc7b7869c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:32.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.034+0000 7efc7b7869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:32.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.034+0000 7efc7b7869c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:32.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.034+0000 7efc7b7869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:32.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.034+0000 7efc7b7869c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:32.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.038+0000 7efc7b7869c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:32.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.038+0000 7efc7b7869c0 20 zone default found 2024-09-12T17:55:32.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.038+0000 7efc7b7869c0 4 Realm: () 2024-09-12T17:55:32.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.038+0000 7efc7b7869c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:32.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.038+0000 7efc7b7869c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:32.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.038+0000 7efc7b7869c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:32.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.038+0000 7efc7b7869c0 20 zonegroup default 2024-09-12T17:55:32.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.038+0000 7efc7b7869c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:32.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.038+0000 7efc7b7869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:32.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.038+0000 7efc7b7869c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:32.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.038+0000 7efc7b7869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:32.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.038+0000 7efc7b7869c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:32.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.038+0000 7efc7b7869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:32.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.038+0000 7efc7b7869c0 20 started sync module instance, tier type = 2024-09-12T17:55:32.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.038+0000 7efc7b7869c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:32.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.066+0000 7efc7b7869c0 20 add_watcher() i=0 2024-09-12T17:55:32.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.066+0000 7efc7b7869c0 20 add_watcher() i=1 2024-09-12T17:55:32.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.066+0000 7efc7b7869c0 20 add_watcher() i=2 2024-09-12T17:55:32.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.066+0000 7efc7b7869c0 20 add_watcher() i=3 2024-09-12T17:55:32.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.066+0000 7efc7b7869c0 20 add_watcher() i=4 2024-09-12T17:55:32.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.066+0000 7efc7b7869c0 20 add_watcher() i=5 2024-09-12T17:55:32.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.066+0000 7efc7b7869c0 20 add_watcher() i=6 2024-09-12T17:55:32.069 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.066+0000 7efc7b7869c0 20 add_watcher() i=7 2024-09-12T17:55:32.069 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.066+0000 7efc7b7869c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:32.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.070+0000 7efb2f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:32.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.074+0000 7efc7b7869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:32.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.074+0000 7efc7b7869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:32.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.074+0000 7efc7b7869c0 5 note: GC not initialized 2024-09-12T17:55:32.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.074+0000 7efb2e7e4640 20 reqs_thread_entry: start 2024-09-12T17:55:32.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.074+0000 7efc7b7869c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:32.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.074+0000 7efc7b7869c0 20 Filter name: none 2024-09-12T17:55:32.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.074+0000 7efa9ffff640 20 reqs_thread_entry: start 2024-09-12T17:55:32.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.074+0000 7efc7b7869c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:32.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.074+0000 7efc7b7869c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:55:32.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.074+0000 7efc7b7869c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:32.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.078+0000 7efc7b7869c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:55:32.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.078+0000 7efc7b7869c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:32.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.078+0000 7efc7b7869c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:32.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.078+0000 7efc7b7869c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:55:32.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.078+0000 7efc7b7869c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:32.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.078+0000 7efc7b7869c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:55:32.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.078+0000 7efc7b7869c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:32.084 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.082+0000 7efb2f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:32.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.086+0000 7efc7b7869c0 20 remove_watcher() i=0 2024-09-12T17:55:32.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.086+0000 7efc7b7869c0 2 removed watcher, disabling cache 2024-09-12T17:55:32.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.090+0000 7efc7b7869c0 20 remove_watcher() i=1 2024-09-12T17:55:32.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.090+0000 7efc7b7869c0 20 remove_watcher() i=2 2024-09-12T17:55:32.095 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.094+0000 7efc7b7869c0 20 remove_watcher() i=3 2024-09-12T17:55:32.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.098+0000 7efc7b7869c0 20 remove_watcher() i=4 2024-09-12T17:55:32.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.098+0000 7efc7b7869c0 20 remove_watcher() i=5 2024-09-12T17:55:32.101 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.098+0000 7efc7b7869c0 20 remove_watcher() i=6 2024-09-12T17:55:32.102 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:32.102+0000 7efc7b7869c0 20 remove_watcher() i=7 2024-09-12T17:55:32.125 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:32.125 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:55:32.125 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-init-index id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:55:32.126 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:32.127 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:32.127 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:32.149 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:32.149 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:32.764 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:32.765 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:33.138 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T17:55:33.138 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:33.141 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:33.142 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:33.273 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:33.273 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:33.362 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:33.362 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:33.446 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:33.446 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:33.543 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:33.543 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:33.643 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:33.643 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:33.736 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:33.736 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:33.830 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:33.830 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:33.934 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:33.934 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:34.033 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:34.033 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:34.132 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:34.132 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:34.227 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:34.227 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:34.322 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:34.322 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:34.420 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:34.420 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:34.519 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:34.520 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:34.620 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:34.621 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:34.719 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:34.720 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:34.824 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:34.824 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:34.919 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:34.919 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:35.019 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:35.019 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:35.120 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:35.120 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:35.215 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:35.215 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:35.308 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:55:35.340 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:35.340 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:35.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.382+0000 7f1a230b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.386+0000 7f1a230b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.386+0000 7f1a230b69c0 20 realm 2024-09-12T17:55:35.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.386+0000 7f1a230b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.386+0000 7f1a230b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.386+0000 7f1a230b69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:35.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.386+0000 7f1a230b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.386+0000 7f1a230b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.386+0000 7f1a230b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.390 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.386+0000 7f1a230b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:35.390 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.386+0000 7f1a230b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.390 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.390+0000 7f1a230b69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:35.390 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.390+0000 7f1a230b69c0 20 searching for the correct realm 2024-09-12T17:55:35.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.394+0000 7f1a213bd640 0 -- 172.21.15.98:0/1425305780 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55eae9cf8510 msgr2=0x55eae9cfa990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:35.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.398+0000 7f1a20bbc640 0 -- 172.21.15.98:0/1425305780 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f1a140c98d0 msgr2=0x7f1a140d53a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:35.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.406+0000 7f1a230b69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:35.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.406+0000 7f1a230b69c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:35.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.406+0000 7f1a230b69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:35.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.406+0000 7f1a230b69c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:35.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.406+0000 7f1a230b69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:35.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.406+0000 7f1a230b69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:35.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.406+0000 7f1a230b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.406+0000 7f1a230b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.406+0000 7f1a230b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.406+0000 7f1a230b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:35.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.406+0000 7f1a230b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.410+0000 7f1a230b69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:35.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.410+0000 7f1a230b69c0 20 zone default found 2024-09-12T17:55:35.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.410+0000 7f1a230b69c0 4 Realm: () 2024-09-12T17:55:35.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.410+0000 7f1a230b69c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:35.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.410+0000 7f1a230b69c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:35.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.410+0000 7f1a230b69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:35.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.410+0000 7f1a230b69c0 20 zonegroup default 2024-09-12T17:55:35.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.410+0000 7f1a230b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.410+0000 7f1a230b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.410+0000 7f1a230b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.412 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.410+0000 7f1a230b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.412 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.410+0000 7f1a230b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.412 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.410+0000 7f1a230b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.412 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.410+0000 7f1a230b69c0 20 started sync module instance, tier type = 2024-09-12T17:55:35.412 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.410+0000 7f1a230b69c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:35.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.426+0000 7f1a230b69c0 20 add_watcher() i=0 2024-09-12T17:55:35.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.426+0000 7f1a230b69c0 20 add_watcher() i=1 2024-09-12T17:55:35.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.426+0000 7f1a230b69c0 20 add_watcher() i=2 2024-09-12T17:55:35.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.426+0000 7f1a230b69c0 20 add_watcher() i=3 2024-09-12T17:55:35.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.426+0000 7f1a230b69c0 20 add_watcher() i=4 2024-09-12T17:55:35.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.426+0000 7f1a230b69c0 20 add_watcher() i=5 2024-09-12T17:55:35.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.426+0000 7f1a230b69c0 20 add_watcher() i=6 2024-09-12T17:55:35.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.426+0000 7f1a230b69c0 20 add_watcher() i=7 2024-09-12T17:55:35.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.426+0000 7f1a230b69c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:35.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.430+0000 7f18d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:35.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.430+0000 7f1a230b69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:35.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.430+0000 7f1a230b69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:35.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.430+0000 7f1a230b69c0 5 note: GC not initialized 2024-09-12T17:55:35.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.430+0000 7f18d67e4640 20 reqs_thread_entry: start 2024-09-12T17:55:35.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.430+0000 7f1a230b69c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:35.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.430+0000 7f1a230b69c0 20 Filter name: none 2024-09-12T17:55:35.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.430+0000 7f18cf7fe640 20 reqs_thread_entry: start 2024-09-12T17:55:35.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.430+0000 7f1a230b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.430+0000 7f1a230b69c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:55:35.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.430+0000 7f1a230b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.434+0000 7f1a230b69c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:55:35.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.434+0000 7f1a230b69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:35.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.434+0000 7f1a230b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.434+0000 7f1a230b69c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:55:35.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.434+0000 7f1a230b69c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.434+0000 7f1a230b69c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:55:35.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.434+0000 7f1a230b69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:35.437 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.434+0000 7f18d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:35.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.442+0000 7f1a230b69c0 20 remove_watcher() i=0 2024-09-12T17:55:35.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.442+0000 7f1a230b69c0 2 removed watcher, disabling cache 2024-09-12T17:55:35.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.442+0000 7f1a230b69c0 20 remove_watcher() i=1 2024-09-12T17:55:35.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.442+0000 7f1a230b69c0 20 remove_watcher() i=2 2024-09-12T17:55:35.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.446+0000 7f1a230b69c0 20 remove_watcher() i=3 2024-09-12T17:55:35.449 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.446+0000 7f1a230b69c0 20 remove_watcher() i=4 2024-09-12T17:55:35.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.450+0000 7f1a230b69c0 20 remove_watcher() i=5 2024-09-12T17:55:35.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.450+0000 7f1a230b69c0 20 remove_watcher() i=6 2024-09-12T17:55:35.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.450+0000 7f1a230b69c0 20 remove_watcher() i=7 2024-09-12T17:55:35.467 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.467 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:55:35.467 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-init-indext id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:55:35.467 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.467 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T17:55:35.499 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:35.499 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:35.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.538+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.543 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.543 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 realm 2024-09-12T17:55:35.543 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.543 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.543 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.542+0000 7f361c9d19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:35.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:35.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:35.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 searching for the correct realm 2024-09-12T17:55:35.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.550+0000 7f3619cd6640 0 -- 172.21.15.98:0/1070814696 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f360c0881e0 msgr2=0x7f360c079330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:35.558 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.558+0000 7f361acd8640 0 -- 172.21.15.98:0/1070814696 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f3610071bc0 msgr2=0x7f361009e050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:35.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:35.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:35.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:35.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:35.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:35.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:35.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:35.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:35.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 zone default found 2024-09-12T17:55:35.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.566+0000 7f361c9d19c0 4 Realm: () 2024-09-12T17:55:35.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.566+0000 7f361c9d19c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:35.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.566+0000 7f361c9d19c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:35.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.566+0000 7f361c9d19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:35.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 zonegroup default 2024-09-12T17:55:35.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 started sync module instance, tier type = 2024-09-12T17:55:35.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:35.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=0 2024-09-12T17:55:35.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=1 2024-09-12T17:55:35.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=2 2024-09-12T17:55:35.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=3 2024-09-12T17:55:35.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=4 2024-09-12T17:55:35.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=5 2024-09-12T17:55:35.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=6 2024-09-12T17:55:35.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=7 2024-09-12T17:55:35.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.582+0000 7f361c9d19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:35.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f34d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:35.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:35.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:35.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 note: GC not initialized 2024-09-12T17:55:35.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f344b7fe640 20 reqs_thread_entry: start 2024-09-12T17:55:35.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:35.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 Filter name: none 2024-09-12T17:55:35.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f34497fa640 20 reqs_thread_entry: start 2024-09-12T17:55:35.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:55:35.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:55:35.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:55:35.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:55:35.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 : miss 2024-09-12T17:55:35.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:55:35.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 info.flags=0x17 2024-09-12T17:55:35.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 to cache LRU end 2024-09-12T17:55:35.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:35.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:35.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 2024-09-12T17:55:35.591 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f361c9d19c0 time 2024-09-12T17:55:35.593692+0000 2024-09-12T17:55:35.591 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:55:35.592 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:35.592 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f36202ab2eb] 2024-09-12T17:55:35.592 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f36202ab49f] 2024-09-12T17:55:35.592 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a451c5f0c1] 2024-09-12T17:55:35.593 INFO:tasks.workunit.client.0.smithi098.stderr: 4: radosgw-admin(+0x140f572) [0x55a4526b4572] 2024-09-12T17:55:35.593 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a451c7118d] 2024-09-12T17:55:35.593 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T17:55:35.593 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f361f111d90] 2024-09-12T17:55:35.593 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T17:55:35.593 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T17:55:35.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.590+0000 7f361c9d19c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f361c9d19c0 time 2024-09-12T17:55:35.593692+0000 2024-09-12T17:55:35.593 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:55:35.593 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.593 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:35.593 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f36202ab2eb] 2024-09-12T17:55:35.593 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f36202ab49f] 2024-09-12T17:55:35.594 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a451c5f0c1] 2024-09-12T17:55:35.594 INFO:tasks.workunit.client.0.smithi098.stderr: 4: radosgw-admin(+0x140f572) [0x55a4526b4572] 2024-09-12T17:55:35.594 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a451c7118d] 2024-09-12T17:55:35.594 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T17:55:35.594 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f361f111d90] 2024-09-12T17:55:35.594 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T17:55:35.594 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T17:55:35.594 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.594 INFO:tasks.workunit.client.0.smithi098.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:55:35.594 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f361c9d19c0 thread_name:radosgw-admin 2024-09-12T17:55:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f361f12a520] 2024-09-12T17:55:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:55:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:55:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:55:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f36202ab345] 2024-09-12T17:55:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f36202ab49f] 2024-09-12T17:55:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a451c5f0c1] 2024-09-12T17:55:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: 8: radosgw-admin(+0x140f572) [0x55a4526b4572] 2024-09-12T17:55:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a451c7118d] 2024-09-12T17:55:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T17:55:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f361f111d90] 2024-09-12T17:55:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T17:55:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T17:55:35.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.590+0000 7f361c9d19c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:55:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f361c9d19c0 thread_name:radosgw-admin 2024-09-12T17:55:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f361f12a520] 2024-09-12T17:55:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:55:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:55:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:55:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f36202ab345] 2024-09-12T17:55:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f36202ab49f] 2024-09-12T17:55:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a451c5f0c1] 2024-09-12T17:55:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: 8: radosgw-admin(+0x140f572) [0x55a4526b4572] 2024-09-12T17:55:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a451c7118d] 2024-09-12T17:55:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T17:55:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f361f111d90] 2024-09-12T17:55:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T17:55:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T17:55:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:55:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.616 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T17:55:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T17:55:35.518+0000 7f361c9d19c0 10 monclient(hunting): authenticate will time out at 2532.090413s 2024-09-12T17:55:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T17:55:35.518+0000 7f361a4d7640 10 monclient(hunting): get_auth_request con 0x55a4541693d0 auth_method 0 2024-09-12T17:55:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T17:55:35.518+0000 7f361a4d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T17:55:35.518+0000 7f361a4d7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T17:55:35.518+0000 7f361a4d7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T17:55:35.518+0000 7f3619cd6640 10 monclient(hunting): get_auth_request con 0x55a454169a50 auth_method 0 2024-09-12T17:55:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T17:55:35.518+0000 7f3619cd6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T17:55:35.518+0000 7f3619cd6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T17:55:35.518+0000 7f3619cd6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T17:55:35.518+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T17:55:35.518+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T17:55:35.518+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T17:55:35.518+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T17:55:35.518+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T17:55:35.518+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T17:55:35.518+0000 7f3619cd6640 10 monclient(hunting): handle_auth_done global_id 5999 payload 274 2024-09-12T17:55:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T17:55:35.518+0000 7f3619cd6640 10 monclient: _finish_hunting 0 2024-09-12T17:55:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T17:55:35.518+0000 7f3619cd6640 1 monclient: found mon.noname-c 2024-09-12T17:55:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T17:55:35.518+0000 7f3619cd6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:55:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T17:55:35.518+0000 7f3508608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T17:55:35.518+0000 7f3508608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:55:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T17:55:35.518+0000 7f3508608640 10 monclient: dump: 2024-09-12T17:55:35.618 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:55:35.618 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:55:35.618 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.618 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.618 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:35.619 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.619 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:55:35.619 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:55:35.619 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:55:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T17:55:35.518+0000 7f3508608640 10 monclient: _finish_auth 0 2024-09-12T17:55:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T17:55:35.518+0000 7f3508608640 10 monclient: _check_auth_tickets 2024-09-12T17:55:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T17:55:35.518+0000 7f3508608640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T17:55:35.518+0000 7f3508608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T17:55:35.518+0000 7f3508608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:55:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T17:55:35.518+0000 7f3508608640 10 monclient: dump: 2024-09-12T17:55:35.619 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:55:35.619 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:55:35.619 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.620 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.620 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:35.620 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.620 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:55:35.620 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:55:35.620 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:55:35.620 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.620 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T17:55:35.518+0000 7f361c9d19c0 5 monclient: authenticate success, global_id 5999 2024-09-12T17:55:35.620 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T17:55:35.518+0000 7f361c9d19c0 10 monclient: get_monmap_and_config success 2024-09-12T17:55:35.620 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T17:55:35.518+0000 7f361c9d19c0 4 set_mon_vals no callback set 2024-09-12T17:55:35.620 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient: shutdown 2024-09-12T17:55:35.620 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) unregister_commands rotate-key 2024-09-12T17:55:35.620 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient: build_initial_monmap 2024-09-12T17:55:35.621 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 1 build_initial for_mkfs: 0 2024-09-12T17:55:35.621 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient: monmap: 2024-09-12T17:55:35.621 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:55:35.621 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:35.621 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:55:35.621 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:55:35.621 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:35.621 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.621 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:55:35.621 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:55:35.621 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:55:35.621 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.621 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding auth protocol: cephx 2024-09-12T17:55:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding auth protocol: cephx 2024-09-12T17:55:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding auth protocol: cephx 2024-09-12T17:55:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: secure 2024-09-12T17:55:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: crc 2024-09-12T17:55:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: secure 2024-09-12T17:55:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: crc 2024-09-12T17:55:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: secure 2024-09-12T17:55:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: crc 2024-09-12T17:55:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: crc 2024-09-12T17:55:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: secure 2024-09-12T17:55:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: crc 2024-09-12T17:55:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: secure 2024-09-12T17:55:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: crc 2024-09-12T17:55:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: secure 2024-09-12T17:55:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 1 librados: starting msgr at 2024-09-12T17:55:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 1 librados: starting objecter 2024-09-12T17:55:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command objecter_requests hook 0x55a4542c1670 2024-09-12T17:55:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 1 librados: setting wanted keys 2024-09-12T17:55:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 1 librados: calling monclient init 2024-09-12T17:55:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient: init 2024-09-12T17:55:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding auth protocol: cephx 2024-09-12T17:55:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding auth protocol: cephx 2024-09-12T17:55:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding auth protocol: cephx 2024-09-12T17:55:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: secure 2024-09-12T17:55:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: crc 2024-09-12T17:55:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: secure 2024-09-12T17:55:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: crc 2024-09-12T17:55:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: secure 2024-09-12T17:55:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: crc 2024-09-12T17:55:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: crc 2024-09-12T17:55:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: secure 2024-09-12T17:55:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: crc 2024-09-12T17:55:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: secure 2024-09-12T17:55:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: crc 2024-09-12T17:55:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: secure 2024-09-12T17:55:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command rotate-key hook 0x55a4542b8b88 2024-09-12T17:55:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient: _reopen_session rank -1 2024-09-12T17:55:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:55:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-c con 0x55a4541693d0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:55:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-b con 0x55a454169a50 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:55:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-a con 0x55a454202510 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:55:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient(hunting): _renew_subs 2024-09-12T17:55:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient(hunting): authenticate will time out at 2532.093358s 2024-09-12T17:55:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T17:55:35.522+0000 7f361a4d7640 10 monclient(hunting): get_auth_request con 0x55a4541693d0 auth_method 0 2024-09-12T17:55:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T17:55:35.522+0000 7f361a4d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T17:55:35.522+0000 7f361a4d7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T17:55:35.522+0000 7f361a4d7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T17:55:35.522+0000 7f361acd8640 10 monclient(hunting): get_auth_request con 0x55a454202510 auth_method 0 2024-09-12T17:55:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T17:55:35.522+0000 7f361acd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T17:55:35.522+0000 7f361acd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T17:55:35.522+0000 7f361acd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T17:55:35.522+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T17:55:35.522+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T17:55:35.522+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T17:55:35.522+0000 7f361acd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T17:55:35.522+0000 7f361acd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T17:55:35.522+0000 7f361acd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T17:55:35.522+0000 7f361a4d7640 10 monclient(hunting): handle_auth_done global_id 6002 payload 824 2024-09-12T17:55:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T17:55:35.522+0000 7f361a4d7640 10 monclient: _finish_hunting 0 2024-09-12T17:55:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T17:55:35.522+0000 7f361a4d7640 1 monclient: found mon.noname-c 2024-09-12T17:55:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T17:55:35.522+0000 7f361a4d7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:55:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T17:55:35.522+0000 7f3506e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:35.628 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T17:55:35.522+0000 7f3506e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:55:35.628 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T17:55:35.522+0000 7f3506e05640 10 monclient: dump: 2024-09-12T17:55:35.628 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:55:35.628 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:55:35.628 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.628 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.628 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:35.628 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.628 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:55:35.628 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:55:35.628 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:55:35.628 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.628 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T17:55:35.522+0000 7f3506e05640 10 monclient: _finish_auth 0 2024-09-12T17:55:35.629 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T17:55:35.522+0000 7f3506e05640 10 monclient: _check_auth_tickets 2024-09-12T17:55:35.629 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T17:55:35.522+0000 7f3506e05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:35.629 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T17:55:35.522+0000 7f3506e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:35.629 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T17:55:35.522+0000 7f3506e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:55:35.629 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T17:55:35.522+0000 7f3506e05640 10 monclient: dump: 2024-09-12T17:55:35.629 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:55:35.629 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:55:35.629 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.629 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.629 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:35.629 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.630 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:55:35.630 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:55:35.630 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:55:35.630 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.631 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T17:55:35.522+0000 7f3508608640 4 set_mon_vals no callback set 2024-09-12T17:55:35.631 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 monclient: authenticate success, global_id 6002 2024-09-12T17:55:35.631 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient: _renew_subs 2024-09-12T17:55:35.631 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:55:35.631 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient: _renew_subs 2024-09-12T17:55:35.631 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:55:35.631 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 1 librados: init done 2024-09-12T17:55:35.631 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T17:55:35.526+0000 7f3506e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:55:35.631 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T17:55:35.526+0000 7f3506e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:55:35.631 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T17:55:35.526+0000 7f3506e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:55:35.632 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T17:55:35.526+0000 7f3619cd6640 10 monclient: get_auth_request con 0x7f3500070ae0 auth_method 0 2024-09-12T17:55:35.632 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T17:55:35.526+0000 7f361acd8640 10 monclient: get_auth_request con 0x55a4542e6e00 auth_method 0 2024-09-12T17:55:35.632 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T17:55:35.526+0000 7f361a4d7640 10 monclient: get_auth_request con 0x55a4543070f0 auth_method 0 2024-09-12T17:55:35.632 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T17:55:35.530+0000 7f3619cd6640 10 monclient: get_auth_request con 0x55a45430c180 auth_method 0 2024-09-12T17:55:35.632 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient: build_initial_monmap 2024-09-12T17:55:35.632 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 1 build_initial for_mkfs: 0 2024-09-12T17:55:35.632 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient: monmap: 2024-09-12T17:55:35.632 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:55:35.632 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:35.632 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:55:35.632 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:55:35.632 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:35.632 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.633 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:55:35.633 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:55:35.633 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:55:35.633 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.633 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding auth protocol: cephx 2024-09-12T17:55:35.633 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding auth protocol: cephx 2024-09-12T17:55:35.633 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding auth protocol: cephx 2024-09-12T17:55:35.633 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: secure 2024-09-12T17:55:35.633 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: crc 2024-09-12T17:55:35.633 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: secure 2024-09-12T17:55:35.633 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: crc 2024-09-12T17:55:35.633 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: secure 2024-09-12T17:55:35.633 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: crc 2024-09-12T17:55:35.633 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: crc 2024-09-12T17:55:35.634 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: secure 2024-09-12T17:55:35.634 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: crc 2024-09-12T17:55:35.634 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: secure 2024-09-12T17:55:35.634 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: crc 2024-09-12T17:55:35.634 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: secure 2024-09-12T17:55:35.634 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.634 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a454313be0 EEXIST 2024-09-12T17:55:35.634 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient: init 2024-09-12T17:55:35.634 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding auth protocol: cephx 2024-09-12T17:55:35.634 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding auth protocol: cephx 2024-09-12T17:55:35.635 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding auth protocol: cephx 2024-09-12T17:55:35.635 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: secure 2024-09-12T17:55:35.635 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: crc 2024-09-12T17:55:35.635 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: secure 2024-09-12T17:55:35.635 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: crc 2024-09-12T17:55:35.636 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: secure 2024-09-12T17:55:35.636 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: crc 2024-09-12T17:55:35.636 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: crc 2024-09-12T17:55:35.636 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: secure 2024-09-12T17:55:35.636 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: crc 2024-09-12T17:55:35.636 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: secure 2024-09-12T17:55:35.636 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: crc 2024-09-12T17:55:35.636 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: secure 2024-09-12T17:55:35.636 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.636 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.636 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command rotate-key cmddesc rotate-key hook 0x55a45430f2d0 EEXIST 2024-09-12T17:55:35.636 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient: _reopen_session rank -1 2024-09-12T17:55:35.637 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:55:35.637 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-a con 0x55a454337d90 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:55:35.637 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-c con 0x55a4543376c0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:55:35.637 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-b con 0x55a4543360a0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:55:35.637 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.637 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.637 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.637 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient(hunting): _renew_subs 2024-09-12T17:55:35.637 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient(hunting): authenticate will time out at 2532.102846s 2024-09-12T17:55:35.637 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T17:55:35.530+0000 7f361a4d7640 10 monclient(hunting): get_auth_request con 0x55a454337d90 auth_method 0 2024-09-12T17:55:35.637 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T17:55:35.530+0000 7f361a4d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.637 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T17:55:35.530+0000 7f361a4d7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.637 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T17:55:35.530+0000 7f361a4d7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.638 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T17:55:35.530+0000 7f3619cd6640 10 monclient(hunting): get_auth_request con 0x55a4543376c0 auth_method 0 2024-09-12T17:55:35.638 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T17:55:35.530+0000 7f3619cd6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.638 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T17:55:35.530+0000 7f3619cd6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.638 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T17:55:35.530+0000 7f3619cd6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.638 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T17:55:35.530+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:35.638 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T17:55:35.530+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:35.638 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T17:55:35.530+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:35.638 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T17:55:35.530+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:35.638 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T17:55:35.530+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:35.638 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T17:55:35.530+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:35.639 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T17:55:35.530+0000 7f361a4d7640 10 monclient(hunting): handle_auth_done global_id 6423 payload 824 2024-09-12T17:55:35.639 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T17:55:35.530+0000 7f361a4d7640 10 monclient: _finish_hunting 0 2024-09-12T17:55:35.639 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T17:55:35.530+0000 7f361a4d7640 1 monclient: found mon.noname-a 2024-09-12T17:55:35.639 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T17:55:35.530+0000 7f361a4d7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:55:35.639 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T17:55:35.530+0000 7f34fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:35.639 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T17:55:35.530+0000 7f34fffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:55:35.639 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T17:55:35.530+0000 7f34fffff640 10 monclient: dump: 2024-09-12T17:55:35.639 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:55:35.639 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:55:35.639 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.640 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.640 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:35.640 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.640 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:55:35.640 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:55:35.640 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:55:35.640 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.640 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T17:55:35.530+0000 7f34fffff640 10 monclient: _finish_auth 0 2024-09-12T17:55:35.640 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T17:55:35.530+0000 7f34fffff640 10 monclient: _check_auth_tickets 2024-09-12T17:55:35.640 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T17:55:35.530+0000 7f34fffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:35.640 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T17:55:35.530+0000 7f34fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:35.640 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T17:55:35.530+0000 7f34fffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:55:35.641 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T17:55:35.530+0000 7f34fffff640 10 monclient: dump: 2024-09-12T17:55:35.641 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:55:35.641 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:55:35.641 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.641 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.641 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:35.641 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.641 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:55:35.641 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:55:35.641 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:55:35.641 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.641 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 monclient: authenticate success, global_id 6423 2024-09-12T17:55:35.641 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T17:55:35.530+0000 7f361b4d9640 4 set_mon_vals no callback set 2024-09-12T17:55:35.641 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient: _renew_subs 2024-09-12T17:55:35.642 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:55:35.642 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient: _renew_subs 2024-09-12T17:55:35.642 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:55:35.642 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T17:55:35.534+0000 7f34fffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:55:35.642 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T17:55:35.534+0000 7f34fffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:55:35.642 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T17:55:35.534+0000 7f34fffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:55:35.642 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient: get_monmap_and_config 2024-09-12T17:55:35.642 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient: build_initial_monmap 2024-09-12T17:55:35.642 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 1 build_initial for_mkfs: 0 2024-09-12T17:55:35.642 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient: monmap: 2024-09-12T17:55:35.642 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:55:35.642 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:35.642 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:55:35.642 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:55:35.643 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:35.643 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.643 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:55:35.643 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:55:35.643 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:55:35.643 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.643 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding auth protocol: cephx 2024-09-12T17:55:35.643 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding auth protocol: cephx 2024-09-12T17:55:35.643 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding auth protocol: cephx 2024-09-12T17:55:35.643 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: secure 2024-09-12T17:55:35.643 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: crc 2024-09-12T17:55:35.644 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: secure 2024-09-12T17:55:35.644 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: crc 2024-09-12T17:55:35.644 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: secure 2024-09-12T17:55:35.644 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: crc 2024-09-12T17:55:35.644 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: crc 2024-09-12T17:55:35.644 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: secure 2024-09-12T17:55:35.644 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: crc 2024-09-12T17:55:35.644 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: secure 2024-09-12T17:55:35.644 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: crc 2024-09-12T17:55:35.644 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: secure 2024-09-12T17:55:35.644 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T17:55:35.534+0000 7f3619cd6640 10 monclient: get_auth_request con 0x7f34f4070a20 auth_method 0 2024-09-12T17:55:35.645 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.645 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient: init 2024-09-12T17:55:35.645 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding auth protocol: cephx 2024-09-12T17:55:35.645 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding auth protocol: cephx 2024-09-12T17:55:35.645 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding auth protocol: cephx 2024-09-12T17:55:35.645 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: secure 2024-09-12T17:55:35.645 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: crc 2024-09-12T17:55:35.645 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: secure 2024-09-12T17:55:35.645 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: crc 2024-09-12T17:55:35.645 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: secure 2024-09-12T17:55:35.645 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: crc 2024-09-12T17:55:35.645 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: crc 2024-09-12T17:55:35.645 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: secure 2024-09-12T17:55:35.645 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: crc 2024-09-12T17:55:35.646 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: secure 2024-09-12T17:55:35.646 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: crc 2024-09-12T17:55:35.646 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: secure 2024-09-12T17:55:35.646 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.646 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.646 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd3912c4c8 EEXIST 2024-09-12T17:55:35.646 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient: _reopen_session rank -1 2024-09-12T17:55:35.646 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:55:35.646 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-a con 0x55a45438bca0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:55:35.646 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-c con 0x55a454387140 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:55:35.646 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-b con 0x55a45437d8b0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:55:35.646 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.646 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.647 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.647 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient(hunting): _renew_subs 2024-09-12T17:55:35.647 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient(hunting): authenticate will time out at 2532.106668s 2024-09-12T17:55:35.647 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T17:55:35.534+0000 7f3619cd6640 10 monclient(hunting): get_auth_request con 0x55a454387140 auth_method 0 2024-09-12T17:55:35.647 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T17:55:35.534+0000 7f3619cd6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.647 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T17:55:35.534+0000 7f3619cd6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.647 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T17:55:35.534+0000 7f3619cd6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.647 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T17:55:35.534+0000 7f361a4d7640 10 monclient(hunting): get_auth_request con 0x55a45438bca0 auth_method 0 2024-09-12T17:55:35.647 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T17:55:35.534+0000 7f361a4d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.648 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T17:55:35.534+0000 7f361a4d7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.648 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T17:55:35.534+0000 7f361a4d7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.648 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T17:55:35.534+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:35.648 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T17:55:35.534+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:35.648 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T17:55:35.534+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:35.648 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T17:55:35.534+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:35.648 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T17:55:35.534+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:35.648 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T17:55:35.534+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:35.648 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T17:55:35.534+0000 7f361a4d7640 10 monclient(hunting): handle_auth_done global_id 6426 payload 274 2024-09-12T17:55:35.648 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T17:55:35.534+0000 7f361a4d7640 10 monclient: _finish_hunting 0 2024-09-12T17:55:35.649 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T17:55:35.534+0000 7f361a4d7640 1 monclient: found mon.noname-a 2024-09-12T17:55:35.649 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T17:55:35.534+0000 7f361a4d7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:55:35.649 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T17:55:35.534+0000 7f34fdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:35.649 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T17:55:35.534+0000 7f34fdffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:55:35.649 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T17:55:35.534+0000 7f34fdffb640 10 monclient: dump: 2024-09-12T17:55:35.649 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:55:35.649 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:55:35.649 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.649 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.649 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:35.649 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.650 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:55:35.650 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:55:35.650 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:55:35.650 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.650 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T17:55:35.534+0000 7f34fdffb640 10 monclient: _finish_auth 0 2024-09-12T17:55:35.650 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T17:55:35.534+0000 7f34fdffb640 10 monclient: _check_auth_tickets 2024-09-12T17:55:35.650 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T17:55:35.534+0000 7f34fdffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:35.650 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 monclient: authenticate success, global_id 6426 2024-09-12T17:55:35.650 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient: get_monmap_and_config success 2024-09-12T17:55:35.650 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 4 set_mon_vals no callback set 2024-09-12T17:55:35.650 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T17:55:35.534+0000 7f34fdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:35.650 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T17:55:35.534+0000 7f34fdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:55:35.650 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T17:55:35.534+0000 7f34fdffb640 10 monclient: dump: 2024-09-12T17:55:35.650 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:55:35.651 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:55:35.651 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.651 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.651 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:35.651 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.651 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:55:35.651 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:55:35.651 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:55:35.651 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.651 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient: shutdown 2024-09-12T17:55:35.651 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient: build_initial_monmap 2024-09-12T17:55:35.651 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 1 build_initial for_mkfs: 0 2024-09-12T17:55:35.651 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient: monmap: 2024-09-12T17:55:35.651 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:55:35.652 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:35.652 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:55:35.652 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:55:35.652 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:35.652 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.652 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:55:35.652 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:55:35.652 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:55:35.652 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.652 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding auth protocol: cephx 2024-09-12T17:55:35.652 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding auth protocol: cephx 2024-09-12T17:55:35.652 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding auth protocol: cephx 2024-09-12T17:55:35.652 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: secure 2024-09-12T17:55:35.652 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: crc 2024-09-12T17:55:35.653 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: secure 2024-09-12T17:55:35.653 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: crc 2024-09-12T17:55:35.653 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: secure 2024-09-12T17:55:35.653 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: crc 2024-09-12T17:55:35.653 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: crc 2024-09-12T17:55:35.653 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: secure 2024-09-12T17:55:35.653 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: crc 2024-09-12T17:55:35.653 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: secure 2024-09-12T17:55:35.654 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: crc 2024-09-12T17:55:35.654 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: secure 2024-09-12T17:55:35.654 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.654 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 1 librados: starting msgr at 2024-09-12T17:55:35.654 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 1 librados: starting objecter 2024-09-12T17:55:35.654 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a45435ac90 EEXIST 2024-09-12T17:55:35.654 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 1 librados: setting wanted keys 2024-09-12T17:55:35.654 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 1 librados: calling monclient init 2024-09-12T17:55:35.654 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient: init 2024-09-12T17:55:35.654 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding auth protocol: cephx 2024-09-12T17:55:35.654 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding auth protocol: cephx 2024-09-12T17:55:35.654 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding auth protocol: cephx 2024-09-12T17:55:35.655 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: secure 2024-09-12T17:55:35.655 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: crc 2024-09-12T17:55:35.655 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: secure 2024-09-12T17:55:35.655 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: crc 2024-09-12T17:55:35.655 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: secure 2024-09-12T17:55:35.655 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: crc 2024-09-12T17:55:35.655 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: crc 2024-09-12T17:55:35.655 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: secure 2024-09-12T17:55:35.655 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: crc 2024-09-12T17:55:35.656 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: secure 2024-09-12T17:55:35.656 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: crc 2024-09-12T17:55:35.656 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: secure 2024-09-12T17:55:35.656 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.656 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.656 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command rotate-key cmddesc rotate-key hook 0x55a454339cf8 EEXIST 2024-09-12T17:55:35.656 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient: _reopen_session rank -1 2024-09-12T17:55:35.656 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:55:35.656 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-b con 0x55a45437d8b0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:55:35.656 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-a con 0x55a454387140 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:55:35.656 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-c con 0x55a45438bca0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:55:35.656 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.656 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.656 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.657 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient(hunting): _renew_subs 2024-09-12T17:55:35.657 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient(hunting): authenticate will time out at 2532.109262s 2024-09-12T17:55:35.657 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T17:55:35.538+0000 7f3619cd6640 10 monclient(hunting): get_auth_request con 0x55a454387140 auth_method 0 2024-09-12T17:55:35.657 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T17:55:35.538+0000 7f3619cd6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.657 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T17:55:35.538+0000 7f3619cd6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.657 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T17:55:35.538+0000 7f3619cd6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.657 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T17:55:35.538+0000 7f361acd8640 10 monclient(hunting): get_auth_request con 0x55a45438bca0 auth_method 0 2024-09-12T17:55:35.657 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T17:55:35.538+0000 7f361acd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.657 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T17:55:35.538+0000 7f361acd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.657 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T17:55:35.538+0000 7f361acd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.657 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T17:55:35.538+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:35.657 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T17:55:35.538+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:35.657 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T17:55:35.538+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:35.657 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T17:55:35.538+0000 7f361acd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:35.658 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T17:55:35.538+0000 7f361acd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:35.658 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T17:55:35.538+0000 7f361acd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:35.658 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T17:55:35.538+0000 7f361a4d7640 10 monclient(hunting): get_auth_request con 0x55a45437d8b0 auth_method 0 2024-09-12T17:55:35.658 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T17:55:35.538+0000 7f361a4d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.658 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T17:55:35.538+0000 7f361a4d7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.658 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T17:55:35.538+0000 7f361a4d7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.658 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T17:55:35.538+0000 7f3619cd6640 10 monclient(hunting): handle_auth_done global_id 6429 payload 824 2024-09-12T17:55:35.658 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T17:55:35.538+0000 7f3619cd6640 10 monclient: _finish_hunting 0 2024-09-12T17:55:35.658 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T17:55:35.538+0000 7f3619cd6640 1 monclient: found mon.noname-a 2024-09-12T17:55:35.658 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T17:55:35.538+0000 7f3619cd6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:55:35.659 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T17:55:35.538+0000 7f34ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:35.659 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T17:55:35.538+0000 7f34ebfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:55:35.659 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T17:55:35.538+0000 7f34ebfff640 10 monclient: dump: 2024-09-12T17:55:35.659 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:55:35.659 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:55:35.659 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.659 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.659 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:35.659 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.659 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:55:35.659 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:55:35.660 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:55:35.660 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.660 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T17:55:35.538+0000 7f34ebfff640 10 monclient: _finish_auth 0 2024-09-12T17:55:35.660 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T17:55:35.538+0000 7f34ebfff640 10 monclient: _check_auth_tickets 2024-09-12T17:55:35.660 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 monclient: authenticate success, global_id 6429 2024-09-12T17:55:35.660 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient: _renew_subs 2024-09-12T17:55:35.660 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:55:35.660 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T17:55:35.538+0000 7f34ebfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:35.660 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T17:55:35.538+0000 7f34ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:35.660 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T17:55:35.538+0000 7f34ebfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:55:35.660 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T17:55:35.538+0000 7f34ebfff640 10 monclient: dump: 2024-09-12T17:55:35.660 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:55:35.660 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:55:35.660 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.661 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.661 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:35.661 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.661 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:55:35.661 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:55:35.661 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:55:35.661 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.661 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T17:55:35.538+0000 7f34fdffb640 4 set_mon_vals no callback set 2024-09-12T17:55:35.661 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient: _renew_subs 2024-09-12T17:55:35.661 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:55:35.661 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 1 librados: init done 2024-09-12T17:55:35.661 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command cr dump hook 0x55a454383e28 2024-09-12T17:55:35.661 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.661 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T17:55:35.542+0000 7f34ebfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:55:35.662 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T17:55:35.542+0000 7f34ebfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:55:35.662 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T17:55:35.542+0000 7f34ebfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:55:35.662 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T17:55:35.542+0000 7f361a4d7640 10 monclient: get_auth_request con 0x7f34e4070ae0 auth_method 0 2024-09-12T17:55:35.662 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T17:55:35.542+0000 7f361acd8640 10 monclient: get_auth_request con 0x55a4543a5100 auth_method 0 2024-09-12T17:55:35.662 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.662 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 realm 2024-09-12T17:55:35.662 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.662 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.662 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:35.662 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.662 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.662 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.662 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T17:55:35.542+0000 7f361a4d7640 10 monclient: get_auth_request con 0x55a4543a9390 auth_method 0 2024-09-12T17:55:35.663 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:35.663 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.663 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:35.663 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 searching for the correct realm 2024-09-12T17:55:35.663 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T17:55:35.546+0000 7f3619cd6640 10 monclient: get_auth_request con 0x55a4543ae4d0 auth_method 0 2024-09-12T17:55:35.663 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T17:55:35.546+0000 7f361acd8640 10 monclient: get_auth_request con 0x7f3610043070 auth_method 0 2024-09-12T17:55:35.664 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T17:55:35.546+0000 7f361a4d7640 10 monclient: get_auth_request con 0x7f36140c7040 auth_method 0 2024-09-12T17:55:35.664 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T17:55:35.546+0000 7f3619cd6640 10 monclient: get_auth_request con 0x7f360c0881e0 auth_method 0 2024-09-12T17:55:35.664 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T17:55:35.550+0000 7f3619cd6640 0 -- 172.21.15.98:0/1070814696 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f360c0881e0 msgr2=0x7f360c079330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:35.664 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T17:55:35.550+0000 7f34ebfff640 1 client.6429.objecter ms_handle_reset 0x7f360c0881e0 session 0x7f360c088070 osd.4 2024-09-12T17:55:35.664 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T17:55:35.550+0000 7f34ebfff640 10 monclient: _renew_subs 2024-09-12T17:55:35.664 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T17:55:35.550+0000 7f34ebfff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:55:35.664 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T17:55:35.550+0000 7f3619cd6640 10 monclient: get_auth_request con 0x7f34e4081160 auth_method 0 2024-09-12T17:55:35.665 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T17:55:35.550+0000 7f361acd8640 10 monclient: get_auth_request con 0x7f3610071bc0 auth_method 0 2024-09-12T17:55:35.665 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T17:55:35.554+0000 7f361a4d7640 10 monclient: get_auth_request con 0x7f361007e640 auth_method 0 2024-09-12T17:55:35.665 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T17:55:35.558+0000 7f361acd8640 0 -- 172.21.15.98:0/1070814696 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f3610071bc0 msgr2=0x7f361009e050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:35.665 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T17:55:35.558+0000 7f34ebfff640 1 client.6429.objecter ms_handle_reset 0x7f3610071bc0 session 0x7f3610089c40 osd.6 2024-09-12T17:55:35.665 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T17:55:35.558+0000 7f361acd8640 10 monclient: get_auth_request con 0x7f360c0881e0 auth_method 0 2024-09-12T17:55:35.665 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:35.665 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:35.665 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:35.665 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:35.665 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:35.665 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:35.665 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.665 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.665 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.666 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:35.666 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.666 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:35.666 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 zone default found 2024-09-12T17:55:35.666 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 4 Realm: () 2024-09-12T17:55:35.666 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:35.666 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:35.666 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:35.666 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 zonegroup default 2024-09-12T17:55:35.666 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.666 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.666 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.666 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.666 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.667 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.667 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 started sync module instance, tier type = 2024-09-12T17:55:35.667 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:35.667 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=0 2024-09-12T17:55:35.667 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=1 2024-09-12T17:55:35.667 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=2 2024-09-12T17:55:35.667 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=3 2024-09-12T17:55:35.667 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=4 2024-09-12T17:55:35.667 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=5 2024-09-12T17:55:35.667 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=6 2024-09-12T17:55:35.667 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=7 2024-09-12T17:55:35.667 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T17:55:35.582+0000 7f361c9d19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:35.667 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding auth protocol: cephx 2024-09-12T17:55:35.668 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding auth protocol: cephx 2024-09-12T17:55:35.668 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding auth protocol: cephx 2024-09-12T17:55:35.668 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: secure 2024-09-12T17:55:35.668 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: crc 2024-09-12T17:55:35.668 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: secure 2024-09-12T17:55:35.668 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: crc 2024-09-12T17:55:35.668 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: secure 2024-09-12T17:55:35.668 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T17:55:35.586+0000 7f34d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:35.668 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: crc 2024-09-12T17:55:35.668 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: crc 2024-09-12T17:55:35.668 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: secure 2024-09-12T17:55:35.669 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: crc 2024-09-12T17:55:35.669 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: secure 2024-09-12T17:55:35.669 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: crc 2024-09-12T17:55:35.669 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: secure 2024-09-12T17:55:35.669 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.669 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:35.669 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:35.669 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command cache list hook 0x55a454379b80 2024-09-12T17:55:35.669 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command cache inspect hook 0x55a454379b80 2024-09-12T17:55:35.669 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command cache erase hook 0x55a454379b80 2024-09-12T17:55:35.670 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command cache zap hook 0x55a454379b80 2024-09-12T17:55:35.670 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 note: GC not initialized 2024-09-12T17:55:35.670 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T17:55:35.586+0000 7f344b7fe640 20 reqs_thread_entry: start 2024-09-12T17:55:35.670 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command sync trace show hook 0x7f360c049070 2024-09-12T17:55:35.670 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command sync trace history hook 0x7f360c049070 2024-09-12T17:55:35.670 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command sync trace active hook 0x7f360c049070 2024-09-12T17:55:35.670 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command sync trace active_short hook 0x7f360c049070 2024-09-12T17:55:35.670 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:35.670 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 Filter name: none 2024-09-12T17:55:35.670 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T17:55:35.586+0000 7f34497fa640 20 reqs_thread_entry: start 2024-09-12T17:55:35.670 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:55:35.670 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.670 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:55:35.670 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:55:35.671 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:55:35.671 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 : miss 2024-09-12T17:55:35.671 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.671 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:55:35.671 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 info.flags=0x17 2024-09-12T17:55:35.671 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 to cache LRU end 2024-09-12T17:55:35.671 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:35.671 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:35.671 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 2024-09-12T17:55:35.671 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T17:55:35.590+0000 7f361c9d19c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f361c9d19c0 time 2024-09-12T17:55:35.593692+0000 2024-09-12T17:55:35.671 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:55:35.671 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.671 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:35.672 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f36202ab2eb] 2024-09-12T17:55:35.672 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f36202ab49f] 2024-09-12T17:55:35.672 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a451c5f0c1] 2024-09-12T17:55:35.672 INFO:tasks.workunit.client.0.smithi098.stderr: 4: radosgw-admin(+0x140f572) [0x55a4526b4572] 2024-09-12T17:55:35.672 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a451c7118d] 2024-09-12T17:55:35.672 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T17:55:35.672 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f361f111d90] 2024-09-12T17:55:35.672 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T17:55:35.672 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T17:55:35.672 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.672 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T17:55:35.590+0000 7f361c9d19c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:55:35.672 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f361c9d19c0 thread_name:radosgw-admin 2024-09-12T17:55:35.673 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.673 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:35.673 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f361f12a520] 2024-09-12T17:55:35.673 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:55:35.673 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:55:35.673 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:55:35.673 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f36202ab345] 2024-09-12T17:55:35.673 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f36202ab49f] 2024-09-12T17:55:35.673 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a451c5f0c1] 2024-09-12T17:55:35.673 INFO:tasks.workunit.client.0.smithi098.stderr: 8: radosgw-admin(+0x140f572) [0x55a4526b4572] 2024-09-12T17:55:35.673 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a451c7118d] 2024-09-12T17:55:35.673 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T17:55:35.673 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f361f111d90] 2024-09-12T17:55:35.674 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T17:55:35.674 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T17:55:35.674 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:55:35.674 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.674 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T17:55:35.674 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T17:55:35.674 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T17:55:35.674 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T17:55:35.674 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T17:55:35.674 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T17:55:35.674 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T17:55:35.674 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T17:55:35.674 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T17:55:35.674 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T17:55:35.675 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T17:55:35.675 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T17:55:35.675 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T17:55:35.675 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T17:55:35.675 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T17:55:35.675 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T17:55:35.675 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T17:55:35.675 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T17:55:35.675 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T17:55:35.675 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T17:55:35.675 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T17:55:35.675 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T17:55:35.675 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T17:55:35.675 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T17:55:35.676 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:55:35.676 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T17:55:35.676 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T17:55:35.676 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T17:55:35.676 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T17:55:35.676 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T17:55:35.676 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T17:55:35.676 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T17:55:35.676 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T17:55:35.676 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T17:55:35.676 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T17:55:35.676 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T17:55:35.676 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T17:55:35.677 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T17:55:35.677 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T17:55:35.677 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T17:55:35.677 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T17:55:35.677 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T17:55:35.677 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T17:55:35.677 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T17:55:35.677 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T17:55:35.677 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T17:55:35.677 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:55:35.677 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T17:55:35.677 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:55:35.677 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T17:55:35.677 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T17:55:35.678 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T17:55:35.678 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T17:55:35.678 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T17:55:35.678 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T17:55:35.678 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T17:55:35.678 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T17:55:35.678 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T17:55:35.678 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T17:55:35.678 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T17:55:35.678 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T17:55:35.678 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T17:55:35.678 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T17:55:35.678 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T17:55:35.678 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T17:55:35.679 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T17:55:35.679 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T17:55:35.679 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:55:35.679 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T17:55:35.679 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:55:35.679 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T17:55:35.679 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T17:55:35.679 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T17:55:35.679 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T17:55:35.679 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T17:55:35.679 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T17:55:35.679 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:55:35.679 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T17:55:35.679 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T17:55:35.680 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:55:35.680 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T17:55:35.680 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T17:55:35.680 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T17:55:35.680 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T17:55:35.680 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T17:55:35.680 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T17:55:35.680 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T17:55:35.680 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T17:55:35.680 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T17:55:35.680 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T17:55:35.680 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T17:55:35.680 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T17:55:35.681 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T17:55:35.681 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:55:35.681 INFO:tasks.workunit.client.0.smithi098.stderr: 7f34497fa640 / http_manager 2024-09-12T17:55:35.681 INFO:tasks.workunit.client.0.smithi098.stderr: 7f344b7fe640 / http_manager 2024-09-12T17:55:35.681 INFO:tasks.workunit.client.0.smithi098.stderr: 7f34d0fe1640 / rgw_dt_lg_renew 2024-09-12T17:55:35.681 INFO:tasks.workunit.client.0.smithi098.stderr: 7f34ebfff640 / ms_dispatch 2024-09-12T17:55:35.681 INFO:tasks.workunit.client.0.smithi098.stderr: 7f34fdffb640 / io_context_pool 2024-09-12T17:55:35.681 INFO:tasks.workunit.client.0.smithi098.stderr: 7f34fffff640 / ms_dispatch 2024-09-12T17:55:35.681 INFO:tasks.workunit.client.0.smithi098.stderr: 7f3506e05640 / ms_dispatch 2024-09-12T17:55:35.681 INFO:tasks.workunit.client.0.smithi098.stderr: 7f3508608640 / io_context_pool 2024-09-12T17:55:35.681 INFO:tasks.workunit.client.0.smithi098.stderr: 7f3619cd6640 / msgr-worker-2 2024-09-12T17:55:35.681 INFO:tasks.workunit.client.0.smithi098.stderr: 7f361a4d7640 / msgr-worker-1 2024-09-12T17:55:35.681 INFO:tasks.workunit.client.0.smithi098.stderr: 7f361acd8640 / msgr-worker-0 2024-09-12T17:55:35.681 INFO:tasks.workunit.client.0.smithi098.stderr: 7f361b4d9640 / io_context_pool 2024-09-12T17:55:35.682 INFO:tasks.workunit.client.0.smithi098.stderr: 7f361c9d19c0 / radosgw-admin 2024-09-12T17:55:35.682 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T17:55:35.682 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T17:55:35.682 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/log/ceph/ceph-client.admin.82768.log 2024-09-12T17:55:35.682 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T17:55:35.682 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T17:55:35.682 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T17:55:35.518+0000 7f361c9d19c0 10 monclient(hunting): authenticate will time out at 2532.090413s 2024-09-12T17:55:35.682 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T17:55:35.518+0000 7f361a4d7640 10 monclient(hunting): get_auth_request con 0x55a4541693d0 auth_method 0 2024-09-12T17:55:35.682 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T17:55:35.518+0000 7f361a4d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.682 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T17:55:35.518+0000 7f361a4d7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.682 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T17:55:35.518+0000 7f361a4d7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.682 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T17:55:35.518+0000 7f3619cd6640 10 monclient(hunting): get_auth_request con 0x55a454169a50 auth_method 0 2024-09-12T17:55:35.682 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T17:55:35.518+0000 7f3619cd6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.682 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T17:55:35.518+0000 7f3619cd6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.683 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T17:55:35.518+0000 7f3619cd6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.683 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T17:55:35.518+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:35.683 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T17:55:35.518+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:35.683 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T17:55:35.518+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:35.683 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T17:55:35.518+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:35.683 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T17:55:35.518+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:35.683 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T17:55:35.518+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:35.683 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T17:55:35.518+0000 7f3619cd6640 10 monclient(hunting): handle_auth_done global_id 5999 payload 274 2024-09-12T17:55:35.683 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T17:55:35.518+0000 7f3619cd6640 10 monclient: _finish_hunting 0 2024-09-12T17:55:35.683 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T17:55:35.518+0000 7f3619cd6640 1 monclient: found mon.noname-c 2024-09-12T17:55:35.683 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T17:55:35.518+0000 7f3619cd6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:55:35.683 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T17:55:35.518+0000 7f3508608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:35.683 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T17:55:35.518+0000 7f3508608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:55:35.684 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T17:55:35.518+0000 7f3508608640 10 monclient: dump: 2024-09-12T17:55:35.684 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:55:35.684 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:55:35.684 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.684 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.684 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:35.684 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.684 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:55:35.684 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:55:35.684 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:55:35.684 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.684 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T17:55:35.518+0000 7f3508608640 10 monclient: _finish_auth 0 2024-09-12T17:55:35.684 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T17:55:35.518+0000 7f3508608640 10 monclient: _check_auth_tickets 2024-09-12T17:55:35.685 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T17:55:35.518+0000 7f3508608640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:35.685 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T17:55:35.518+0000 7f3508608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:35.685 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T17:55:35.518+0000 7f3508608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:55:35.685 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T17:55:35.518+0000 7f3508608640 10 monclient: dump: 2024-09-12T17:55:35.685 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:55:35.685 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:55:35.685 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.685 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.685 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:35.685 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.685 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:55:35.685 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:55:35.685 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:55:35.685 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.686 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T17:55:35.518+0000 7f361c9d19c0 5 monclient: authenticate success, global_id 5999 2024-09-12T17:55:35.686 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T17:55:35.518+0000 7f361c9d19c0 10 monclient: get_monmap_and_config success 2024-09-12T17:55:35.686 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T17:55:35.518+0000 7f361c9d19c0 4 set_mon_vals no callback set 2024-09-12T17:55:35.686 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient: shutdown 2024-09-12T17:55:35.686 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) unregister_commands rotate-key 2024-09-12T17:55:35.686 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient: build_initial_monmap 2024-09-12T17:55:35.686 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 1 build_initial for_mkfs: 0 2024-09-12T17:55:35.686 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient: monmap: 2024-09-12T17:55:35.686 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:55:35.686 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:35.686 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:55:35.686 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:55:35.686 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:35.687 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.687 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:55:35.687 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:55:35.687 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:55:35.687 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.687 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding auth protocol: cephx 2024-09-12T17:55:35.687 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding auth protocol: cephx 2024-09-12T17:55:35.687 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding auth protocol: cephx 2024-09-12T17:55:35.687 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: secure 2024-09-12T17:55:35.687 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: crc 2024-09-12T17:55:35.687 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: secure 2024-09-12T17:55:35.687 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: crc 2024-09-12T17:55:35.687 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: secure 2024-09-12T17:55:35.687 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: crc 2024-09-12T17:55:35.688 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: crc 2024-09-12T17:55:35.688 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: secure 2024-09-12T17:55:35.688 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: crc 2024-09-12T17:55:35.688 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: secure 2024-09-12T17:55:35.688 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: crc 2024-09-12T17:55:35.688 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542eaf40) adding con mode: secure 2024-09-12T17:55:35.688 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.688 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 1 librados: starting msgr at 2024-09-12T17:55:35.688 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 1 librados: starting objecter 2024-09-12T17:55:35.688 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command objecter_requests hook 0x55a4542c1670 2024-09-12T17:55:35.688 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 1 librados: setting wanted keys 2024-09-12T17:55:35.688 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 1 librados: calling monclient init 2024-09-12T17:55:35.688 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient: init 2024-09-12T17:55:35.689 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding auth protocol: cephx 2024-09-12T17:55:35.689 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding auth protocol: cephx 2024-09-12T17:55:35.689 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding auth protocol: cephx 2024-09-12T17:55:35.689 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: secure 2024-09-12T17:55:35.689 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: crc 2024-09-12T17:55:35.689 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: secure 2024-09-12T17:55:35.689 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: crc 2024-09-12T17:55:35.689 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: secure 2024-09-12T17:55:35.689 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: crc 2024-09-12T17:55:35.689 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: crc 2024-09-12T17:55:35.689 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: secure 2024-09-12T17:55:35.689 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: crc 2024-09-12T17:55:35.689 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: secure 2024-09-12T17:55:35.690 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: crc 2024-09-12T17:55:35.690 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 AuthRegistry(0x55a4542b8a40) adding con mode: secure 2024-09-12T17:55:35.690 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.690 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.690 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command rotate-key hook 0x55a4542b8b88 2024-09-12T17:55:35.690 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient: _reopen_session rank -1 2024-09-12T17:55:35.690 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:55:35.690 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-c con 0x55a4541693d0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:55:35.690 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-b con 0x55a454169a50 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:55:35.690 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-a con 0x55a454202510 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:55:35.690 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.690 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.690 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.690 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient(hunting): _renew_subs 2024-09-12T17:55:35.691 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient(hunting): authenticate will time out at 2532.093358s 2024-09-12T17:55:35.691 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T17:55:35.522+0000 7f361a4d7640 10 monclient(hunting): get_auth_request con 0x55a4541693d0 auth_method 0 2024-09-12T17:55:35.691 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T17:55:35.522+0000 7f361a4d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.691 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T17:55:35.522+0000 7f361a4d7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.691 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T17:55:35.522+0000 7f361a4d7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.691 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T17:55:35.522+0000 7f361acd8640 10 monclient(hunting): get_auth_request con 0x55a454202510 auth_method 0 2024-09-12T17:55:35.691 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T17:55:35.522+0000 7f361acd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.691 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T17:55:35.522+0000 7f361acd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.691 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T17:55:35.522+0000 7f361acd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.691 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T17:55:35.522+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:35.691 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T17:55:35.522+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:35.691 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T17:55:35.522+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:35.692 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T17:55:35.522+0000 7f361acd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:35.692 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T17:55:35.522+0000 7f361acd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:35.692 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T17:55:35.522+0000 7f361acd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:35.692 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T17:55:35.522+0000 7f361a4d7640 10 monclient(hunting): handle_auth_done global_id 6002 payload 824 2024-09-12T17:55:35.692 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T17:55:35.522+0000 7f361a4d7640 10 monclient: _finish_hunting 0 2024-09-12T17:55:35.692 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T17:55:35.522+0000 7f361a4d7640 1 monclient: found mon.noname-c 2024-09-12T17:55:35.692 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T17:55:35.522+0000 7f361a4d7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:55:35.692 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T17:55:35.522+0000 7f3506e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:35.692 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T17:55:35.522+0000 7f3506e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:55:35.692 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T17:55:35.522+0000 7f3506e05640 10 monclient: dump: 2024-09-12T17:55:35.692 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:55:35.692 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:55:35.692 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.693 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.693 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:35.693 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.693 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:55:35.693 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:55:35.693 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:55:35.693 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.693 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T17:55:35.522+0000 7f3506e05640 10 monclient: _finish_auth 0 2024-09-12T17:55:35.693 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T17:55:35.522+0000 7f3506e05640 10 monclient: _check_auth_tickets 2024-09-12T17:55:35.693 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T17:55:35.522+0000 7f3506e05640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:35.693 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T17:55:35.522+0000 7f3506e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:35.693 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T17:55:35.522+0000 7f3506e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:55:35.693 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T17:55:35.522+0000 7f3506e05640 10 monclient: dump: 2024-09-12T17:55:35.694 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:55:35.694 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:55:35.694 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.694 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.694 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:35.694 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.694 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:55:35.694 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:55:35.694 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:55:35.694 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.694 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T17:55:35.522+0000 7f3508608640 4 set_mon_vals no callback set 2024-09-12T17:55:35.694 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 5 monclient: authenticate success, global_id 6002 2024-09-12T17:55:35.694 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient: _renew_subs 2024-09-12T17:55:35.694 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:55:35.695 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient: _renew_subs 2024-09-12T17:55:35.695 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:55:35.695 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T17:55:35.522+0000 7f361c9d19c0 1 librados: init done 2024-09-12T17:55:35.695 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T17:55:35.526+0000 7f3506e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:55:35.695 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T17:55:35.526+0000 7f3506e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:55:35.695 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T17:55:35.526+0000 7f3506e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:55:35.695 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T17:55:35.526+0000 7f3619cd6640 10 monclient: get_auth_request con 0x7f3500070ae0 auth_method 0 2024-09-12T17:55:35.695 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T17:55:35.526+0000 7f361acd8640 10 monclient: get_auth_request con 0x55a4542e6e00 auth_method 0 2024-09-12T17:55:35.695 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T17:55:35.526+0000 7f361a4d7640 10 monclient: get_auth_request con 0x55a4543070f0 auth_method 0 2024-09-12T17:55:35.695 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T17:55:35.530+0000 7f3619cd6640 10 monclient: get_auth_request con 0x55a45430c180 auth_method 0 2024-09-12T17:55:35.695 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient: build_initial_monmap 2024-09-12T17:55:35.695 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 1 build_initial for_mkfs: 0 2024-09-12T17:55:35.695 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient: monmap: 2024-09-12T17:55:35.695 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:55:35.696 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:35.696 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:55:35.696 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:55:35.696 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:35.696 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.696 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:55:35.696 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:55:35.696 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:55:35.696 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.696 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding auth protocol: cephx 2024-09-12T17:55:35.696 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding auth protocol: cephx 2024-09-12T17:55:35.696 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding auth protocol: cephx 2024-09-12T17:55:35.696 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: secure 2024-09-12T17:55:35.697 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: crc 2024-09-12T17:55:35.697 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: secure 2024-09-12T17:55:35.697 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: crc 2024-09-12T17:55:35.697 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: secure 2024-09-12T17:55:35.697 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: crc 2024-09-12T17:55:35.697 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: crc 2024-09-12T17:55:35.697 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: secure 2024-09-12T17:55:35.697 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: crc 2024-09-12T17:55:35.697 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: secure 2024-09-12T17:55:35.697 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: crc 2024-09-12T17:55:35.697 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a4543101d0) adding con mode: secure 2024-09-12T17:55:35.697 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.697 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a454313be0 EEXIST 2024-09-12T17:55:35.698 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient: init 2024-09-12T17:55:35.698 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding auth protocol: cephx 2024-09-12T17:55:35.698 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding auth protocol: cephx 2024-09-12T17:55:35.698 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding auth protocol: cephx 2024-09-12T17:55:35.698 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: secure 2024-09-12T17:55:35.698 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: crc 2024-09-12T17:55:35.698 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: secure 2024-09-12T17:55:35.698 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: crc 2024-09-12T17:55:35.698 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: secure 2024-09-12T17:55:35.698 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: crc 2024-09-12T17:55:35.698 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: crc 2024-09-12T17:55:35.698 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: secure 2024-09-12T17:55:35.698 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: crc 2024-09-12T17:55:35.699 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: secure 2024-09-12T17:55:35.699 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: crc 2024-09-12T17:55:35.699 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 AuthRegistry(0x55a45430f188) adding con mode: secure 2024-09-12T17:55:35.699 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.699 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.699 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command rotate-key cmddesc rotate-key hook 0x55a45430f2d0 EEXIST 2024-09-12T17:55:35.699 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient: _reopen_session rank -1 2024-09-12T17:55:35.699 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:55:35.699 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-a con 0x55a454337d90 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:55:35.699 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-c con 0x55a4543376c0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:55:35.699 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-b con 0x55a4543360a0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:55:35.699 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.699 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.699 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.700 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient(hunting): _renew_subs 2024-09-12T17:55:35.700 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient(hunting): authenticate will time out at 2532.102846s 2024-09-12T17:55:35.700 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T17:55:35.530+0000 7f361a4d7640 10 monclient(hunting): get_auth_request con 0x55a454337d90 auth_method 0 2024-09-12T17:55:35.700 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T17:55:35.530+0000 7f361a4d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.700 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T17:55:35.530+0000 7f361a4d7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.700 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T17:55:35.530+0000 7f361a4d7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.700 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T17:55:35.530+0000 7f3619cd6640 10 monclient(hunting): get_auth_request con 0x55a4543376c0 auth_method 0 2024-09-12T17:55:35.700 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T17:55:35.530+0000 7f3619cd6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.700 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T17:55:35.530+0000 7f3619cd6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.700 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T17:55:35.530+0000 7f3619cd6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.700 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T17:55:35.530+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:35.700 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T17:55:35.530+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:35.700 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T17:55:35.530+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:35.701 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T17:55:35.530+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:35.701 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T17:55:35.530+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:35.701 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T17:55:35.530+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:35.701 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T17:55:35.530+0000 7f361a4d7640 10 monclient(hunting): handle_auth_done global_id 6423 payload 824 2024-09-12T17:55:35.701 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T17:55:35.530+0000 7f361a4d7640 10 monclient: _finish_hunting 0 2024-09-12T17:55:35.701 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T17:55:35.530+0000 7f361a4d7640 1 monclient: found mon.noname-a 2024-09-12T17:55:35.701 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T17:55:35.530+0000 7f361a4d7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:55:35.701 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T17:55:35.530+0000 7f34fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:35.701 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T17:55:35.530+0000 7f34fffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:55:35.701 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T17:55:35.530+0000 7f34fffff640 10 monclient: dump: 2024-09-12T17:55:35.701 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:55:35.701 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:55:35.701 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.701 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.702 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:35.702 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.702 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:55:35.702 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:55:35.702 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:55:35.702 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.702 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T17:55:35.530+0000 7f34fffff640 10 monclient: _finish_auth 0 2024-09-12T17:55:35.702 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T17:55:35.530+0000 7f34fffff640 10 monclient: _check_auth_tickets 2024-09-12T17:55:35.702 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T17:55:35.530+0000 7f34fffff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:35.702 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T17:55:35.530+0000 7f34fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:35.702 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T17:55:35.530+0000 7f34fffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:55:35.702 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T17:55:35.530+0000 7f34fffff640 10 monclient: dump: 2024-09-12T17:55:35.702 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:55:35.703 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:55:35.703 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.703 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.703 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:35.703 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.703 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:55:35.703 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:55:35.703 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:55:35.703 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.703 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 5 monclient: authenticate success, global_id 6423 2024-09-12T17:55:35.703 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T17:55:35.530+0000 7f361b4d9640 4 set_mon_vals no callback set 2024-09-12T17:55:35.703 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient: _renew_subs 2024-09-12T17:55:35.703 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:55:35.704 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient: _renew_subs 2024-09-12T17:55:35.704 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T17:55:35.530+0000 7f361c9d19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:55:35.704 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T17:55:35.534+0000 7f34fffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:55:35.704 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T17:55:35.534+0000 7f34fffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:55:35.704 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T17:55:35.534+0000 7f34fffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:55:35.704 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient: get_monmap_and_config 2024-09-12T17:55:35.704 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient: build_initial_monmap 2024-09-12T17:55:35.704 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 1 build_initial for_mkfs: 0 2024-09-12T17:55:35.704 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient: monmap: 2024-09-12T17:55:35.704 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:55:35.704 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:35.704 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:55:35.704 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:55:35.705 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:35.705 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.705 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:55:35.705 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:55:35.705 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:55:35.705 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.705 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding auth protocol: cephx 2024-09-12T17:55:35.705 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding auth protocol: cephx 2024-09-12T17:55:35.705 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding auth protocol: cephx 2024-09-12T17:55:35.705 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: secure 2024-09-12T17:55:35.705 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: crc 2024-09-12T17:55:35.705 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: secure 2024-09-12T17:55:35.705 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: crc 2024-09-12T17:55:35.706 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: secure 2024-09-12T17:55:35.706 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: crc 2024-09-12T17:55:35.706 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: crc 2024-09-12T17:55:35.706 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: secure 2024-09-12T17:55:35.706 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: crc 2024-09-12T17:55:35.706 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: secure 2024-09-12T17:55:35.706 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: crc 2024-09-12T17:55:35.706 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x55a454357790) adding con mode: secure 2024-09-12T17:55:35.706 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T17:55:35.534+0000 7f3619cd6640 10 monclient: get_auth_request con 0x7f34f4070a20 auth_method 0 2024-09-12T17:55:35.706 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.706 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient: init 2024-09-12T17:55:35.706 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding auth protocol: cephx 2024-09-12T17:55:35.706 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding auth protocol: cephx 2024-09-12T17:55:35.706 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding auth protocol: cephx 2024-09-12T17:55:35.707 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: secure 2024-09-12T17:55:35.707 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: crc 2024-09-12T17:55:35.707 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: secure 2024-09-12T17:55:35.707 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: crc 2024-09-12T17:55:35.707 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: secure 2024-09-12T17:55:35.707 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: crc 2024-09-12T17:55:35.707 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: crc 2024-09-12T17:55:35.707 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: secure 2024-09-12T17:55:35.707 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: crc 2024-09-12T17:55:35.707 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: secure 2024-09-12T17:55:35.707 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: crc 2024-09-12T17:55:35.707 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c380) adding con mode: secure 2024-09-12T17:55:35.707 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.708 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.708 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd3912c4c8 EEXIST 2024-09-12T17:55:35.708 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient: _reopen_session rank -1 2024-09-12T17:55:35.708 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:55:35.708 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-a con 0x55a45438bca0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:55:35.708 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-c con 0x55a454387140 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:55:35.708 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-b con 0x55a45437d8b0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:55:35.708 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.708 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.708 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.708 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient(hunting): _renew_subs 2024-09-12T17:55:35.708 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient(hunting): authenticate will time out at 2532.106668s 2024-09-12T17:55:35.708 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T17:55:35.534+0000 7f3619cd6640 10 monclient(hunting): get_auth_request con 0x55a454387140 auth_method 0 2024-09-12T17:55:35.708 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T17:55:35.534+0000 7f3619cd6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.709 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T17:55:35.534+0000 7f3619cd6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.709 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T17:55:35.534+0000 7f3619cd6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.709 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T17:55:35.534+0000 7f361a4d7640 10 monclient(hunting): get_auth_request con 0x55a45438bca0 auth_method 0 2024-09-12T17:55:35.709 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T17:55:35.534+0000 7f361a4d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.709 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T17:55:35.534+0000 7f361a4d7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.709 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T17:55:35.534+0000 7f361a4d7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.709 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T17:55:35.534+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:35.709 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T17:55:35.534+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:35.709 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T17:55:35.534+0000 7f361a4d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:35.709 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T17:55:35.534+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:35.709 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T17:55:35.534+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:35.709 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T17:55:35.534+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:35.709 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T17:55:35.534+0000 7f361a4d7640 10 monclient(hunting): handle_auth_done global_id 6426 payload 274 2024-09-12T17:55:35.710 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T17:55:35.534+0000 7f361a4d7640 10 monclient: _finish_hunting 0 2024-09-12T17:55:35.710 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T17:55:35.534+0000 7f361a4d7640 1 monclient: found mon.noname-a 2024-09-12T17:55:35.710 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T17:55:35.534+0000 7f361a4d7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:55:35.710 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T17:55:35.534+0000 7f34fdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:35.710 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T17:55:35.534+0000 7f34fdffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:55:35.710 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T17:55:35.534+0000 7f34fdffb640 10 monclient: dump: 2024-09-12T17:55:35.710 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:55:35.710 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:55:35.710 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.710 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.710 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:35.710 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.710 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:55:35.710 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:55:35.711 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:55:35.711 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.711 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T17:55:35.534+0000 7f34fdffb640 10 monclient: _finish_auth 0 2024-09-12T17:55:35.711 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T17:55:35.534+0000 7f34fdffb640 10 monclient: _check_auth_tickets 2024-09-12T17:55:35.711 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T17:55:35.534+0000 7f34fdffb640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:35.711 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 5 monclient: authenticate success, global_id 6426 2024-09-12T17:55:35.711 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient: get_monmap_and_config success 2024-09-12T17:55:35.711 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 4 set_mon_vals no callback set 2024-09-12T17:55:35.711 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T17:55:35.534+0000 7f34fdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:35.711 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T17:55:35.534+0000 7f34fdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:55:35.711 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T17:55:35.534+0000 7f34fdffb640 10 monclient: dump: 2024-09-12T17:55:35.711 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:55:35.711 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:55:35.712 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.712 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.712 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:35.712 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.712 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:55:35.712 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:55:35.712 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:55:35.712 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.712 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T17:55:35.534+0000 7f361c9d19c0 10 monclient: shutdown 2024-09-12T17:55:35.712 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient: build_initial_monmap 2024-09-12T17:55:35.712 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 1 build_initial for_mkfs: 0 2024-09-12T17:55:35.712 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient: monmap: 2024-09-12T17:55:35.712 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:55:35.712 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:55:35.713 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:55:35.713 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:55:35.713 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:55:35.713 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.713 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:55:35.713 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:55:35.713 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:55:35.713 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.713 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding auth protocol: cephx 2024-09-12T17:55:35.713 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding auth protocol: cephx 2024-09-12T17:55:35.713 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding auth protocol: cephx 2024-09-12T17:55:35.713 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: secure 2024-09-12T17:55:35.713 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: crc 2024-09-12T17:55:35.714 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: secure 2024-09-12T17:55:35.714 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: crc 2024-09-12T17:55:35.714 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: secure 2024-09-12T17:55:35.714 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: crc 2024-09-12T17:55:35.714 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: crc 2024-09-12T17:55:35.714 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: secure 2024-09-12T17:55:35.714 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: crc 2024-09-12T17:55:35.714 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: secure 2024-09-12T17:55:35.714 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: crc 2024-09-12T17:55:35.714 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a45435b780) adding con mode: secure 2024-09-12T17:55:35.714 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.714 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 1 librados: starting msgr at 2024-09-12T17:55:35.714 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 1 librados: starting objecter 2024-09-12T17:55:35.715 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a45435ac90 EEXIST 2024-09-12T17:55:35.715 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 1 librados: setting wanted keys 2024-09-12T17:55:35.715 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 1 librados: calling monclient init 2024-09-12T17:55:35.715 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient: init 2024-09-12T17:55:35.715 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding auth protocol: cephx 2024-09-12T17:55:35.715 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding auth protocol: cephx 2024-09-12T17:55:35.715 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding auth protocol: cephx 2024-09-12T17:55:35.715 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: secure 2024-09-12T17:55:35.715 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: crc 2024-09-12T17:55:35.715 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: secure 2024-09-12T17:55:35.715 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: crc 2024-09-12T17:55:35.715 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: secure 2024-09-12T17:55:35.715 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: crc 2024-09-12T17:55:35.715 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: crc 2024-09-12T17:55:35.716 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: secure 2024-09-12T17:55:35.716 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: crc 2024-09-12T17:55:35.716 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: secure 2024-09-12T17:55:35.716 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: crc 2024-09-12T17:55:35.716 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 AuthRegistry(0x55a454339bb0) adding con mode: secure 2024-09-12T17:55:35.716 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.716 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.716 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command rotate-key cmddesc rotate-key hook 0x55a454339cf8 EEXIST 2024-09-12T17:55:35.716 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient: _reopen_session rank -1 2024-09-12T17:55:35.716 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:55:35.716 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-b con 0x55a45437d8b0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:55:35.716 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-a con 0x55a454387140 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:55:35.716 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient(hunting): picked mon.noname-c con 0x55a45438bca0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:55:35.716 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.717 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.717 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:55:35.717 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient(hunting): _renew_subs 2024-09-12T17:55:35.717 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient(hunting): authenticate will time out at 2532.109262s 2024-09-12T17:55:35.717 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T17:55:35.538+0000 7f3619cd6640 10 monclient(hunting): get_auth_request con 0x55a454387140 auth_method 0 2024-09-12T17:55:35.717 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T17:55:35.538+0000 7f3619cd6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.717 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T17:55:35.538+0000 7f3619cd6640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.717 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T17:55:35.538+0000 7f3619cd6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.717 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T17:55:35.538+0000 7f361acd8640 10 monclient(hunting): get_auth_request con 0x55a45438bca0 auth_method 0 2024-09-12T17:55:35.717 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T17:55:35.538+0000 7f361acd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.717 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T17:55:35.538+0000 7f361acd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.717 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T17:55:35.538+0000 7f361acd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.718 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T17:55:35.538+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:35.718 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T17:55:35.538+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:35.718 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T17:55:35.538+0000 7f3619cd6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:35.718 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T17:55:35.538+0000 7f361acd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:55:35.718 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T17:55:35.538+0000 7f361acd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:55:35.718 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T17:55:35.538+0000 7f361acd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:55:35.718 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T17:55:35.538+0000 7f361a4d7640 10 monclient(hunting): get_auth_request con 0x55a45437d8b0 auth_method 0 2024-09-12T17:55:35.718 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T17:55:35.538+0000 7f361a4d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:55:35.718 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T17:55:35.538+0000 7f361a4d7640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:55:35.718 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T17:55:35.538+0000 7f361a4d7640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:55:35.718 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T17:55:35.538+0000 7f3619cd6640 10 monclient(hunting): handle_auth_done global_id 6429 payload 824 2024-09-12T17:55:35.718 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T17:55:35.538+0000 7f3619cd6640 10 monclient: _finish_hunting 0 2024-09-12T17:55:35.718 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T17:55:35.538+0000 7f3619cd6640 1 monclient: found mon.noname-a 2024-09-12T17:55:35.718 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T17:55:35.538+0000 7f3619cd6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:55:35.719 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T17:55:35.538+0000 7f34ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:35.719 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T17:55:35.538+0000 7f34ebfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:55:35.719 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T17:55:35.538+0000 7f34ebfff640 10 monclient: dump: 2024-09-12T17:55:35.719 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:55:35.719 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:55:35.719 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.719 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.719 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:35.719 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.719 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:55:35.719 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:55:35.719 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:55:35.719 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.720 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T17:55:35.538+0000 7f34ebfff640 10 monclient: _finish_auth 0 2024-09-12T17:55:35.720 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T17:55:35.538+0000 7f34ebfff640 10 monclient: _check_auth_tickets 2024-09-12T17:55:35.720 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 monclient: authenticate success, global_id 6429 2024-09-12T17:55:35.720 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient: _renew_subs 2024-09-12T17:55:35.720 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:55:35.720 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T17:55:35.538+0000 7f34ebfff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:55:35.720 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T17:55:35.538+0000 7f34ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:55:35.720 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T17:55:35.538+0000 7f34ebfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:55:35.720 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T17:55:35.538+0000 7f34ebfff640 10 monclient: dump: 2024-09-12T17:55:35.720 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:55:35.720 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:55:35.720 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.720 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:55:35.721 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:55:35.721 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:55:35.721 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:55:35.721 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:55:35.721 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:55:35.721 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.721 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T17:55:35.538+0000 7f34fdffb640 4 set_mon_vals no callback set 2024-09-12T17:55:35.721 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient: _renew_subs 2024-09-12T17:55:35.721 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:55:35.721 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 1 librados: init done 2024-09-12T17:55:35.721 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command cr dump hook 0x55a454383e28 2024-09-12T17:55:35.721 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T17:55:35.538+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.721 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T17:55:35.542+0000 7f34ebfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:55:35.722 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T17:55:35.542+0000 7f34ebfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:55:35.722 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T17:55:35.542+0000 7f34ebfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:55:35.722 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T17:55:35.542+0000 7f361a4d7640 10 monclient: get_auth_request con 0x7f34e4070ae0 auth_method 0 2024-09-12T17:55:35.722 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T17:55:35.542+0000 7f361acd8640 10 monclient: get_auth_request con 0x55a4543a5100 auth_method 0 2024-09-12T17:55:35.722 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.722 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 realm 2024-09-12T17:55:35.722 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.722 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.722 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:35.722 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.722 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.722 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.722 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T17:55:35.542+0000 7f361a4d7640 10 monclient: get_auth_request con 0x55a4543a9390 auth_method 0 2024-09-12T17:55:35.722 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:35.723 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.723 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:35.723 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T17:55:35.542+0000 7f361c9d19c0 20 searching for the correct realm 2024-09-12T17:55:35.723 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T17:55:35.546+0000 7f3619cd6640 10 monclient: get_auth_request con 0x55a4543ae4d0 auth_method 0 2024-09-12T17:55:35.723 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T17:55:35.546+0000 7f361acd8640 10 monclient: get_auth_request con 0x7f3610043070 auth_method 0 2024-09-12T17:55:35.723 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T17:55:35.546+0000 7f361a4d7640 10 monclient: get_auth_request con 0x7f36140c7040 auth_method 0 2024-09-12T17:55:35.723 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T17:55:35.546+0000 7f3619cd6640 10 monclient: get_auth_request con 0x7f360c0881e0 auth_method 0 2024-09-12T17:55:35.723 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T17:55:35.550+0000 7f3619cd6640 0 -- 172.21.15.98:0/1070814696 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f360c0881e0 msgr2=0x7f360c079330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:35.723 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T17:55:35.550+0000 7f34ebfff640 1 client.6429.objecter ms_handle_reset 0x7f360c0881e0 session 0x7f360c088070 osd.4 2024-09-12T17:55:35.723 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T17:55:35.550+0000 7f34ebfff640 10 monclient: _renew_subs 2024-09-12T17:55:35.723 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T17:55:35.550+0000 7f34ebfff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:55:35.723 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T17:55:35.550+0000 7f3619cd6640 10 monclient: get_auth_request con 0x7f34e4081160 auth_method 0 2024-09-12T17:55:35.723 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T17:55:35.550+0000 7f361acd8640 10 monclient: get_auth_request con 0x7f3610071bc0 auth_method 0 2024-09-12T17:55:35.724 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T17:55:35.554+0000 7f361a4d7640 10 monclient: get_auth_request con 0x7f361007e640 auth_method 0 2024-09-12T17:55:35.724 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T17:55:35.558+0000 7f361acd8640 0 -- 172.21.15.98:0/1070814696 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f3610071bc0 msgr2=0x7f361009e050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:35.724 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T17:55:35.558+0000 7f34ebfff640 1 client.6429.objecter ms_handle_reset 0x7f3610071bc0 session 0x7f3610089c40 osd.6 2024-09-12T17:55:35.724 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T17:55:35.558+0000 7f361acd8640 10 monclient: get_auth_request con 0x7f360c0881e0 auth_method 0 2024-09-12T17:55:35.724 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:35.724 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:35.724 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:35.724 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:35.724 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:35.724 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:35.724 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.725 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.725 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.725 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:35.725 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T17:55:35.562+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.725 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:35.725 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 zone default found 2024-09-12T17:55:35.725 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 4 Realm: () 2024-09-12T17:55:35.725 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:35.725 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:35.725 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:35.725 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 zonegroup default 2024-09-12T17:55:35.725 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.725 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.726 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.726 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.726 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.726 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.726 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 started sync module instance, tier type = 2024-09-12T17:55:35.726 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T17:55:35.566+0000 7f361c9d19c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:35.726 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=0 2024-09-12T17:55:35.726 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=1 2024-09-12T17:55:35.726 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=2 2024-09-12T17:55:35.726 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=3 2024-09-12T17:55:35.726 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=4 2024-09-12T17:55:35.726 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=5 2024-09-12T17:55:35.726 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=6 2024-09-12T17:55:35.726 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T17:55:35.582+0000 7f361c9d19c0 20 add_watcher() i=7 2024-09-12T17:55:35.727 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T17:55:35.582+0000 7f361c9d19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:35.727 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding auth protocol: cephx 2024-09-12T17:55:35.727 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding auth protocol: cephx 2024-09-12T17:55:35.727 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding auth protocol: cephx 2024-09-12T17:55:35.727 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: secure 2024-09-12T17:55:35.727 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: crc 2024-09-12T17:55:35.727 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: secure 2024-09-12T17:55:35.727 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: crc 2024-09-12T17:55:35.727 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: secure 2024-09-12T17:55:35.727 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T17:55:35.586+0000 7f34d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:35.727 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: crc 2024-09-12T17:55:35.727 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: crc 2024-09-12T17:55:35.727 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: secure 2024-09-12T17:55:35.727 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: crc 2024-09-12T17:55:35.728 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: secure 2024-09-12T17:55:35.728 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: crc 2024-09-12T17:55:35.728 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 AuthRegistry(0x7ffd3912c850) adding con mode: secure 2024-09-12T17:55:35.728 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:55:35.728 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:35.728 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:35.728 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command cache list hook 0x55a454379b80 2024-09-12T17:55:35.728 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command cache inspect hook 0x55a454379b80 2024-09-12T17:55:35.728 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command cache erase hook 0x55a454379b80 2024-09-12T17:55:35.728 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command cache zap hook 0x55a454379b80 2024-09-12T17:55:35.728 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 note: GC not initialized 2024-09-12T17:55:35.728 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T17:55:35.586+0000 7f344b7fe640 20 reqs_thread_entry: start 2024-09-12T17:55:35.728 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command sync trace show hook 0x7f360c049070 2024-09-12T17:55:35.729 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command sync trace history hook 0x7f360c049070 2024-09-12T17:55:35.729 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command sync trace active hook 0x7f360c049070 2024-09-12T17:55:35.729 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 5 asok(0x55a4540af2b0) register_command sync trace active_short hook 0x7f360c049070 2024-09-12T17:55:35.729 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:35.729 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 Filter name: none 2024-09-12T17:55:35.729 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T17:55:35.586+0000 7f34497fa640 20 reqs_thread_entry: start 2024-09-12T17:55:35.729 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:55:35.729 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.729 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:55:35.729 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:55:35.729 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:55:35.729 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 : miss 2024-09-12T17:55:35.729 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.730 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:55:35.730 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 info.flags=0x17 2024-09-12T17:55:35.730 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 to cache LRU end 2024-09-12T17:55:35.730 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:35.730 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:35.730 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T17:55:35.586+0000 7f361c9d19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 2024-09-12T17:55:35.730 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T17:55:35.590+0000 7f361c9d19c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f361c9d19c0 time 2024-09-12T17:55:35.593692+0000 2024-09-12T17:55:35.730 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:55:35.730 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.730 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:35.730 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f36202ab2eb] 2024-09-12T17:55:35.730 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f36202ab49f] 2024-09-12T17:55:35.730 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a451c5f0c1] 2024-09-12T17:55:35.731 INFO:tasks.workunit.client.0.smithi098.stderr: 4: radosgw-admin(+0x140f572) [0x55a4526b4572] 2024-09-12T17:55:35.731 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a451c7118d] 2024-09-12T17:55:35.731 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T17:55:35.731 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f361f111d90] 2024-09-12T17:55:35.731 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T17:55:35.731 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T17:55:35.731 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.731 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T17:55:35.590+0000 7f361c9d19c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:55:35.731 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f361c9d19c0 thread_name:radosgw-admin 2024-09-12T17:55:35.731 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.731 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:55:35.731 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f361f12a520] 2024-09-12T17:55:35.732 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:55:35.732 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:55:35.732 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:55:35.732 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f36202ab345] 2024-09-12T17:55:35.732 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f36202ab49f] 2024-09-12T17:55:35.732 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a451c5f0c1] 2024-09-12T17:55:35.732 INFO:tasks.workunit.client.0.smithi098.stderr: 8: radosgw-admin(+0x140f572) [0x55a4526b4572] 2024-09-12T17:55:35.732 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a451c7118d] 2024-09-12T17:55:35.732 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T17:55:35.732 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f361f111d90] 2024-09-12T17:55:35.732 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T17:55:35.732 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T17:55:35.733 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:55:35.733 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.733 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T17:55:35.733 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T17:55:35.733 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T17:55:35.733 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T17:55:35.733 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T17:55:35.733 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T17:55:35.733 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T17:55:35.733 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T17:55:35.733 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T17:55:35.733 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T17:55:35.733 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T17:55:35.733 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T17:55:35.734 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T17:55:35.734 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T17:55:35.734 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T17:55:35.734 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T17:55:35.734 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T17:55:35.734 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T17:55:35.734 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T17:55:35.734 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T17:55:35.734 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T17:55:35.734 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T17:55:35.734 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T17:55:35.734 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T17:55:35.734 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:55:35.734 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T17:55:35.735 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T17:55:35.735 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T17:55:35.735 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T17:55:35.735 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T17:55:35.735 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T17:55:35.735 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T17:55:35.735 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T17:55:35.735 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T17:55:35.735 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T17:55:35.735 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T17:55:35.735 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T17:55:35.735 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T17:55:35.735 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T17:55:35.736 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T17:55:35.736 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T17:55:35.736 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T17:55:35.736 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T17:55:35.736 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T17:55:35.736 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T17:55:35.736 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T17:55:35.736 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:55:35.736 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T17:55:35.736 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:55:35.736 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T17:55:35.736 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T17:55:35.736 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T17:55:35.737 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T17:55:35.737 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T17:55:35.737 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T17:55:35.737 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T17:55:35.737 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T17:55:35.737 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T17:55:35.737 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T17:55:35.737 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T17:55:35.737 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T17:55:35.737 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T17:55:35.737 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T17:55:35.737 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T17:55:35.737 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T17:55:35.738 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T17:55:35.738 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T17:55:35.738 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:55:35.738 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T17:55:35.738 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:55:35.738 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T17:55:35.738 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T17:55:35.738 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T17:55:35.738 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T17:55:35.738 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T17:55:35.738 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T17:55:35.738 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:55:35.738 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T17:55:35.738 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T17:55:35.739 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:55:35.739 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T17:55:35.739 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T17:55:35.739 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T17:55:35.739 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T17:55:35.739 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T17:55:35.739 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T17:55:35.739 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T17:55:35.739 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T17:55:35.739 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T17:55:35.739 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T17:55:35.739 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T17:55:35.739 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T17:55:35.740 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T17:55:35.740 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:55:35.740 INFO:tasks.workunit.client.0.smithi098.stderr: 7f34497fa640 / http_manager 2024-09-12T17:55:35.740 INFO:tasks.workunit.client.0.smithi098.stderr: 7f344b7fe640 / http_manager 2024-09-12T17:55:35.740 INFO:tasks.workunit.client.0.smithi098.stderr: 7f34d0fe1640 / rgw_dt_lg_renew 2024-09-12T17:55:35.740 INFO:tasks.workunit.client.0.smithi098.stderr: 7f34ebfff640 / ms_dispatch 2024-09-12T17:55:35.740 INFO:tasks.workunit.client.0.smithi098.stderr: 7f34fdffb640 / io_context_pool 2024-09-12T17:55:35.740 INFO:tasks.workunit.client.0.smithi098.stderr: 7f34fffff640 / ms_dispatch 2024-09-12T17:55:35.740 INFO:tasks.workunit.client.0.smithi098.stderr: 7f3506e05640 / ms_dispatch 2024-09-12T17:55:35.740 INFO:tasks.workunit.client.0.smithi098.stderr: 7f3508608640 / io_context_pool 2024-09-12T17:55:35.740 INFO:tasks.workunit.client.0.smithi098.stderr: 7f3619cd6640 / msgr-worker-2 2024-09-12T17:55:35.740 INFO:tasks.workunit.client.0.smithi098.stderr: 7f361a4d7640 / msgr-worker-1 2024-09-12T17:55:35.740 INFO:tasks.workunit.client.0.smithi098.stderr: 7f361acd8640 / msgr-worker-0 2024-09-12T17:55:35.740 INFO:tasks.workunit.client.0.smithi098.stderr: 7f361b4d9640 / io_context_pool 2024-09-12T17:55:35.741 INFO:tasks.workunit.client.0.smithi098.stderr: 7f361c9d19c0 / radosgw-admin 2024-09-12T17:55:35.741 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T17:55:35.741 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T17:55:35.741 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:55:35.596148Z_5a6298a3-a7d6-4359-b247-afcadeb30ef8/log 2024-09-12T17:55:35.741 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T17:55:35.741 INFO:tasks.workunit.client.0.smithi098.stderr:Aborted 2024-09-12T17:55:35.741 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:55:35.746 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:35.746 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:35.746 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.670+0000 7f87cea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.746 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.674+0000 7f87cea9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.746 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.674+0000 7f87cea9d9c0 20 realm 2024-09-12T17:55:35.746 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.674+0000 7f87cea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.674+0000 7f87cea9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.674+0000 7f87cea9d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:35.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.674+0000 7f87cea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.674+0000 7f87cea9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.674+0000 7f87cea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.674+0000 7f87cea9d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:35.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.674+0000 7f87cea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.674+0000 7f87cea9d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:35.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.674+0000 7f87cea9d9c0 20 searching for the correct realm 2024-09-12T17:55:35.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.678+0000 7f87cbda2640 0 -- 172.21.15.98:0/2626976449 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x555ee4869a30 msgr2=0x555ee486be20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:35.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.686+0000 7f87cc5a3640 0 -- 172.21.15.98:0/2626976449 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f87c0112240 msgr2=0x7f87c0132040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:35.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:35.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:35.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:35.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:35.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:35.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:35.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:35.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:35.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 20 zone default found 2024-09-12T17:55:35.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 4 Realm: () 2024-09-12T17:55:35.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:35.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:35.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:35.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 20 zonegroup default 2024-09-12T17:55:35.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.694+0000 7f87cea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.698+0000 7f87cea9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.698+0000 7f87cea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.698+0000 7f87cea9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.698+0000 7f87cea9d9c0 20 started sync module instance, tier type = 2024-09-12T17:55:35.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.698+0000 7f87cea9d9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:35.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.710+0000 7f87cea9d9c0 20 add_watcher() i=0 2024-09-12T17:55:35.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.710+0000 7f87cea9d9c0 20 add_watcher() i=1 2024-09-12T17:55:35.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.710+0000 7f87cea9d9c0 20 add_watcher() i=2 2024-09-12T17:55:35.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.710+0000 7f87cea9d9c0 20 add_watcher() i=3 2024-09-12T17:55:35.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.710+0000 7f87cea9d9c0 20 add_watcher() i=4 2024-09-12T17:55:35.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.710+0000 7f87cea9d9c0 20 add_watcher() i=5 2024-09-12T17:55:35.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.710+0000 7f87cea9d9c0 20 add_watcher() i=6 2024-09-12T17:55:35.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.714+0000 7f87cea9d9c0 20 add_watcher() i=7 2024-09-12T17:55:35.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.714+0000 7f87cea9d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:35.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.714+0000 7f8682fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:35.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.714+0000 7f87cea9d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:35.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.714+0000 7f87cea9d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:35.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.714+0000 7f87cea9d9c0 5 note: GC not initialized 2024-09-12T17:55:35.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.714+0000 7f8681fdb640 20 reqs_thread_entry: start 2024-09-12T17:55:35.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.714+0000 7f87cea9d9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:35.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.714+0000 7f87cea9d9c0 20 Filter name: none 2024-09-12T17:55:35.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.714+0000 7f85f37fe640 20 reqs_thread_entry: start 2024-09-12T17:55:35.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.714+0000 7f87cea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.718+0000 7f87cea9d9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:55:35.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.718+0000 7f87cea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.718+0000 7f87cea9d9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:55:35.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.718+0000 7f87cea9d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:35.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.718+0000 7f87cea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.718+0000 7f87cea9d9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:55:35.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.718+0000 7f87cea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.718+0000 7f87cea9d9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:55:35.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.718+0000 7f87cea9d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:55:35.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.718+0000 7f8682fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:35.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.726+0000 7f87cea9d9c0 20 remove_watcher() i=0 2024-09-12T17:55:35.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.726+0000 7f87cea9d9c0 2 removed watcher, disabling cache 2024-09-12T17:55:35.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.726+0000 7f87cea9d9c0 20 remove_watcher() i=1 2024-09-12T17:55:35.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.730+0000 7f87cea9d9c0 20 remove_watcher() i=2 2024-09-12T17:55:35.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.730+0000 7f87cea9d9c0 20 remove_watcher() i=3 2024-09-12T17:55:35.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.734+0000 7f87cea9d9c0 20 remove_watcher() i=4 2024-09-12T17:55:35.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.734+0000 7f87cea9d9c0 20 remove_watcher() i=5 2024-09-12T17:55:35.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.734+0000 7f87cea9d9c0 20 remove_watcher() i=6 2024-09-12T17:55:35.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.734+0000 7f87cea9d9c0 20 remove_watcher() i=7 2024-09-12T17:55:35.753 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.753 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:55:35.753 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-init-indext id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:55:35.753 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:55:35.753 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:35.753 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:35.789 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:55:35.789 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:55:35.847 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:55:35.883 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:55:35.884 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:55:35.927 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.926+0000 7f57e28239c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.928 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.926+0000 7f57e28239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.928 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.926+0000 7f57e28239c0 20 realm 2024-09-12T17:55:35.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.926+0000 7f57e28239c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.926+0000 7f57e28239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.926+0000 7f57e28239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:55:35.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.926+0000 7f57e28239c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.926+0000 7f57e28239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:35.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.926+0000 7f57e28239c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.930+0000 7f57e28239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:35.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.930+0000 7f57e28239c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:35.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.930+0000 7f57e28239c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:55:35.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.930+0000 7f57e28239c0 20 searching for the correct realm 2024-09-12T17:55:35.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:35.934+0000 7f57e0b2a640 0 -- 172.21.15.98:0/4215418260 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f57c8067fc0 msgr2=0x7f57c806f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:36.151 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.150+0000 7f57e0329640 0 -- 172.21.15.98:0/4215418260 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x563dae057ae0 msgr2=0x563dae059ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:55:36.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:55:36.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:55:36.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:55:36.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:55:36.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:55:36.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:55:36.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:55:36.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:55:36.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 20 zone default found 2024-09-12T17:55:36.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 4 Realm: () 2024-09-12T17:55:36.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:55:36.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:55:36.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:55:36.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 20 zonegroup default 2024-09-12T17:55:36.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.158+0000 7f57e28239c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.162+0000 7f57e28239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.162+0000 7f57e28239c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.162+0000 7f57e28239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:55:36.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.162+0000 7f57e28239c0 20 started sync module instance, tier type = 2024-09-12T17:55:36.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.162+0000 7f57e28239c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:55:36.188 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.182+0000 7f57e28239c0 20 add_watcher() i=0 2024-09-12T17:55:36.188 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.182+0000 7f57e28239c0 20 add_watcher() i=1 2024-09-12T17:55:36.188 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.182+0000 7f57e28239c0 20 add_watcher() i=2 2024-09-12T17:55:36.188 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.182+0000 7f57e28239c0 20 add_watcher() i=3 2024-09-12T17:55:36.188 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.182+0000 7f57e28239c0 20 add_watcher() i=4 2024-09-12T17:55:36.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.182+0000 7f57e28239c0 20 add_watcher() i=5 2024-09-12T17:55:36.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.182+0000 7f57e28239c0 20 add_watcher() i=6 2024-09-12T17:55:36.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.186+0000 7f57e28239c0 20 add_watcher() i=7 2024-09-12T17:55:36.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.186+0000 7f57e28239c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:55:36.191 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.190+0000 7f56977de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:36.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.190+0000 7f57e28239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:55:36.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.190+0000 7f57e28239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:55:36.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.190+0000 7f57e28239c0 5 note: GC not initialized 2024-09-12T17:55:36.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.190+0000 7f56967dc640 20 reqs_thread_entry: start 2024-09-12T17:55:36.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.190+0000 7f57e28239c0 20 init_complete bucket index max shards: 11 2024-09-12T17:55:36.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.190+0000 7f57e28239c0 20 Filter name: none 2024-09-12T17:55:36.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.190+0000 7f568f7fe640 20 reqs_thread_entry: start 2024-09-12T17:55:36.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.190+0000 7f57e28239c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:55:36.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.190+0000 7f57e28239c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.190+0000 7f57e28239c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:55:36.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.190+0000 7f57e28239c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:55:36.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.190+0000 7f57e28239c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:55:36.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.194+0000 7f57e28239c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 : miss 2024-09-12T17:55:36.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.194+0000 7f57e28239c0 20 rados->read ofs=0 len=0 2024-09-12T17:55:36.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.194+0000 7f57e28239c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:55:36.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.194+0000 7f57e28239c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 info.flags=0x17 2024-09-12T17:55:36.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.194+0000 7f57e28239c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 to cache LRU end 2024-09-12T17:55:36.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.194+0000 7f57e28239c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:55:36.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.194+0000 7f57e28239c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:55:36.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.194+0000 7f57e28239c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 2024-09-12T17:55:36.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.194+0000 7f57e28239c0 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 to be held by another RGW process; skipping for now 2024-09-12T17:55:36.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.198+0000 7f56977de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:55:36.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.202+0000 7f57e28239c0 20 remove_watcher() i=0 2024-09-12T17:55:36.203 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.202+0000 7f57e28239c0 2 removed watcher, disabling cache 2024-09-12T17:55:36.205 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.202+0000 7f57e28239c0 20 remove_watcher() i=1 2024-09-12T17:55:36.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.206+0000 7f57e28239c0 20 remove_watcher() i=2 2024-09-12T17:55:36.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.206+0000 7f57e28239c0 20 remove_watcher() i=3 2024-09-12T17:55:36.211 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.210+0000 7f57e28239c0 20 remove_watcher() i=4 2024-09-12T17:55:36.212 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.210+0000 7f57e28239c0 20 remove_watcher() i=5 2024-09-12T17:55:36.213 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.210+0000 7f57e28239c0 20 remove_watcher() i=6 2024-09-12T17:55:36.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:55:36.214+0000 7f57e28239c0 20 remove_watcher() i=7 2024-09-12T17:55:36.229 INFO:tasks.workunit.client.0.smithi098.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:56:06.262 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:56:06.298 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:06.298 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:06.342 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.341+0000 7f6d641819c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:06.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.341+0000 7f6d641819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:06.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.341+0000 7f6d641819c0 20 realm 2024-09-12T17:56:06.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.341+0000 7f6d641819c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:06.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.341+0000 7f6d641819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:06.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.341+0000 7f6d641819c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:06.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.341+0000 7f6d641819c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:06.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.341+0000 7f6d641819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:06.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.341+0000 7f6d641819c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:06.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.345+0000 7f6d641819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:06.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.345+0000 7f6d641819c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:06.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.345+0000 7f6d641819c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:06.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.345+0000 7f6d641819c0 20 searching for the correct realm 2024-09-12T17:56:06.354 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.353+0000 7f6d62488640 0 -- 172.21.15.98:0/3278420992 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f6d4c00a040 msgr2=0x7f6d4c07a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:06.572 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.569+0000 7f6d61c87640 0 -- 172.21.15.98:0/3278420992 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x55605cf807f0 msgr2=0x55605cf82c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:06.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.577+0000 7f6d641819c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:06.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.577+0000 7f6d641819c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:06.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.577+0000 7f6d641819c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:06.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.577+0000 7f6d641819c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:06.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.577+0000 7f6d641819c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:06.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.577+0000 7f6d641819c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:06.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.577+0000 7f6d641819c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:06.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.577+0000 7f6d641819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:06.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.577+0000 7f6d641819c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:06.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.577+0000 7f6d641819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:06.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.577+0000 7f6d641819c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:06.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.577+0000 7f6d641819c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:06.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.577+0000 7f6d641819c0 20 zone default found 2024-09-12T17:56:06.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.577+0000 7f6d641819c0 4 Realm: () 2024-09-12T17:56:06.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.577+0000 7f6d641819c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:06.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.577+0000 7f6d641819c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:06.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.577+0000 7f6d641819c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:06.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.577+0000 7f6d641819c0 20 zonegroup default 2024-09-12T17:56:06.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.577+0000 7f6d641819c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:06.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.581+0000 7f6d641819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:06.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.581+0000 7f6d641819c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:06.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.581+0000 7f6d641819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:06.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.581+0000 7f6d641819c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:06.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.581+0000 7f6d641819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:06.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.581+0000 7f6d641819c0 20 started sync module instance, tier type = 2024-09-12T17:56:06.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.581+0000 7f6d641819c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:06.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.605+0000 7f6d641819c0 20 add_watcher() i=0 2024-09-12T17:56:06.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.605+0000 7f6d641819c0 20 add_watcher() i=1 2024-09-12T17:56:06.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.605+0000 7f6d641819c0 20 add_watcher() i=2 2024-09-12T17:56:06.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.605+0000 7f6d641819c0 20 add_watcher() i=3 2024-09-12T17:56:06.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.605+0000 7f6d641819c0 20 add_watcher() i=4 2024-09-12T17:56:06.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.605+0000 7f6d641819c0 20 add_watcher() i=5 2024-09-12T17:56:06.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.605+0000 7f6d641819c0 20 add_watcher() i=6 2024-09-12T17:56:06.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.605+0000 7f6d641819c0 20 add_watcher() i=7 2024-09-12T17:56:06.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.605+0000 7f6d641819c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:06.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.609+0000 7f6c137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:06.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.613+0000 7f6d641819c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:06.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.613+0000 7f6d641819c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:06.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.613+0000 7f6d641819c0 5 note: GC not initialized 2024-09-12T17:56:06.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.613+0000 7f6c127fc640 20 reqs_thread_entry: start 2024-09-12T17:56:06.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.613+0000 7f6d641819c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:06.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.613+0000 7f6d641819c0 20 Filter name: none 2024-09-12T17:56:06.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.613+0000 7f6b83fff640 20 reqs_thread_entry: start 2024-09-12T17:56:06.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.613+0000 7f6d641819c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T17:56:06.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.613+0000 7f6d641819c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:06.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.613+0000 7f6d641819c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:56:06.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.613+0000 7f6d641819c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T17:56:06.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.613+0000 7f6d641819c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T17:56:06.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.613+0000 7f6d641819c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 : miss 2024-09-12T17:56:06.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.613+0000 7f6d641819c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:06.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.613+0000 7f6d641819c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:56:06.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.613+0000 7f6d641819c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 info.flags=0x17 2024-09-12T17:56:06.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.613+0000 7f6d641819c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 to cache LRU end 2024-09-12T17:56:06.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.613+0000 7f6d641819c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:06.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.613+0000 7f6d641819c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:06.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.613+0000 7f6d641819c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 2024-09-12T17:56:06.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.625+0000 7f6d641819c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 info.flags=0x17 2024-09-12T17:56:06.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.625+0000 7f6d641819c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 to cache LRU end 2024-09-12T17:56:06.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.625+0000 7f6d641819c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:06.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.625+0000 7f6d641819c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21, ofs0, ns] 2024-09-12T17:56:06.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.629+0000 7f6c457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366193 cookie 93872365025136 notifier 6489 bl.length()=913 2024-09-12T17:56:06.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.629+0000 7f6c457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 info.flags=0x17 2024-09-12T17:56:06.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.629+0000 7f6c457fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 to cache LRU end 2024-09-12T17:56:06.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.629+0000 7f6c457fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:06.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.629+0000 7f6d641819c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a01e4849-e968-46ce-97f1-a673c26b3735.4529.21]): orig_sources= new_sources= 2024-09-12T17:56:06.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.629+0000 7f6d641819c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a01e4849-e968-46ce-97f1-a673c26b3735.4529.21]): potential sources added=[] removed=[] 2024-09-12T17:56:06.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.629+0000 7f6d641819c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a01e4849-e968-46ce-97f1-a673c26b3735.4529.21]): orig_dests= new_dests= 2024-09-12T17:56:06.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.629+0000 7f6d641819c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a01e4849-e968-46ce-97f1-a673c26b3735.4529.21]): potential dests added=[] removed=[] 2024-09-12T17:56:06.642 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.637+0000 7f6d641819c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.0 2024-09-12T17:56:06.642 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.637+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.0 2024-09-12T17:56:06.642 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.637+0000 7f6d641819c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.1 2024-09-12T17:56:06.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.637+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.1 2024-09-12T17:56:06.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.637+0000 7f6d641819c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.2 2024-09-12T17:56:06.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.637+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.2 2024-09-12T17:56:06.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.637+0000 7f6d641819c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.3 2024-09-12T17:56:06.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.637+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.3 2024-09-12T17:56:06.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.637+0000 7f6d641819c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.4 2024-09-12T17:56:06.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.637+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.4 2024-09-12T17:56:06.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.5 2024-09-12T17:56:06.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.5 2024-09-12T17:56:06.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.6 2024-09-12T17:56:06.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.6 2024-09-12T17:56:06.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.7 2024-09-12T17:56:06.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.7 2024-09-12T17:56:06.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.8 2024-09-12T17:56:06.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.8 2024-09-12T17:56:06.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.9 2024-09-12T17:56:06.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.9 2024-09-12T17:56:06.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.10 2024-09-12T17:56:06.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.10 2024-09-12T17:56:06.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.11 2024-09-12T17:56:06.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1.11 2024-09-12T17:56:06.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.0 2024-09-12T17:56:06.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1 2024-09-12T17:56:06.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.2 2024-09-12T17:56:06.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.3 2024-09-12T17:56:06.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.4 2024-09-12T17:56:06.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.5 2024-09-12T17:56:06.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.641+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.6 2024-09-12T17:56:06.647 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.645+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.7 2024-09-12T17:56:06.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.645+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.8 2024-09-12T17:56:06.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.645+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.9 2024-09-12T17:56:06.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.649+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.10 2024-09-12T17:56:06.660 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.657+0000 7f6d641819c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:06.660 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.657+0000 7f6d641819c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 2024-09-12T17:56:06.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.661+0000 7f6d641819c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 info.flags=0x17 2024-09-12T17:56:06.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.661+0000 7f6d641819c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 to cache LRU end 2024-09-12T17:56:06.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.661+0000 7f6d641819c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:06.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.661+0000 7f6d641819c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21, ofs0, ns] 2024-09-12T17:56:06.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.661+0000 7f6c457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366194 cookie 93872365025136 notifier 6489 bl.length()=913 2024-09-12T17:56:06.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.661+0000 7f6c457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 info.flags=0x17 2024-09-12T17:56:06.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.661+0000 7f6c457fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 to cache LRU end 2024-09-12T17:56:06.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.661+0000 7f6c457fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:06.669 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.665+0000 7f6d641819c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a01e4849-e968-46ce-97f1-a673c26b3735.4529.21]): orig_sources= new_sources= 2024-09-12T17:56:06.669 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.665+0000 7f6d641819c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a01e4849-e968-46ce-97f1-a673c26b3735.4529.21]): potential sources added=[] removed=[] 2024-09-12T17:56:06.669 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.665+0000 7f6d641819c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a01e4849-e968-46ce-97f1-a673c26b3735.4529.21]): orig_dests= new_dests= 2024-09-12T17:56:06.669 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.665+0000 7f6d641819c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a01e4849-e968-46ce-97f1-a673c26b3735.4529.21]): potential dests added=[] removed=[] 2024-09-12T17:56:06.671 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.669+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.0 2024-09-12T17:56:06.671 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.669+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.1 2024-09-12T17:56:06.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.669+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.2 2024-09-12T17:56:06.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.669+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.3 2024-09-12T17:56:06.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.669+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.4 2024-09-12T17:56:06.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.669+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.5 2024-09-12T17:56:06.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.673+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.6 2024-09-12T17:56:06.675 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.673+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.7 2024-09-12T17:56:06.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.673+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.8 2024-09-12T17:56:06.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.673+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.9 2024-09-12T17:56:06.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.673+0000 7f6d641819c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.21.10 2024-09-12T17:56:06.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.677+0000 7f6d641819c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:06.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.677+0000 7f6d641819c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 2024-09-12T17:56:06.680 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.677+0000 7f6d641819c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 info.flags=0x17 2024-09-12T17:56:06.680 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.677+0000 7f6d641819c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 to cache LRU end 2024-09-12T17:56:06.680 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.677+0000 7f6d641819c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:06.680 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.677+0000 7f6d641819c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21, ofs0, ns] 2024-09-12T17:56:06.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.677+0000 7f6c44ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366195 cookie 93872365025136 notifier 6489 bl.length()=881 2024-09-12T17:56:06.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.677+0000 7f6c44ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 info.flags=0x17 2024-09-12T17:56:06.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.677+0000 7f6c44ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 to cache LRU end 2024-09-12T17:56:06.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.677+0000 7f6c44ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:06.683 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.681+0000 7f6d641819c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a01e4849-e968-46ce-97f1-a673c26b3735.4529.21]): orig_sources= new_sources= 2024-09-12T17:56:06.683 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.681+0000 7f6d641819c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a01e4849-e968-46ce-97f1-a673c26b3735.4529.21]): potential sources added=[] removed=[] 2024-09-12T17:56:06.684 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.681+0000 7f6d641819c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a01e4849-e968-46ce-97f1-a673c26b3735.4529.21]): orig_dests= new_dests= 2024-09-12T17:56:06.684 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.681+0000 7f6d641819c0 20 handle_bi_update(): bucket=:abort-at-init-indext[a01e4849-e968-46ce-97f1-a673c26b3735.4529.21]): potential dests added=[] removed=[] 2024-09-12T17:56:06.688 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.685+0000 7f6d641819c0 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-12T17:56:06.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.689+0000 7f6c137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:06.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.693+0000 7f6d641819c0 20 remove_watcher() i=0 2024-09-12T17:56:06.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.693+0000 7f6d641819c0 2 removed watcher, disabling cache 2024-09-12T17:56:06.698 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.697+0000 7f6d641819c0 20 remove_watcher() i=1 2024-09-12T17:56:06.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.697+0000 7f6d641819c0 20 remove_watcher() i=2 2024-09-12T17:56:06.703 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.701+0000 7f6d641819c0 20 remove_watcher() i=3 2024-09-12T17:56:06.705 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.701+0000 7f6d641819c0 20 remove_watcher() i=4 2024-09-12T17:56:06.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.705+0000 7f6d641819c0 20 remove_watcher() i=5 2024-09-12T17:56:06.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.705+0000 7f6d641819c0 20 remove_watcher() i=6 2024-09-12T17:56:06.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.709+0000 7f6d641819c0 20 remove_watcher() i=7 2024-09-12T17:56:06.729 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T17:56:06.760 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:06.760 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:06.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.801+0000 7fc1710999c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:06.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.805+0000 7fc1710999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:06.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.805+0000 7fc1710999c0 20 realm 2024-09-12T17:56:06.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.805+0000 7fc1710999c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:06.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.805+0000 7fc1710999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:06.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.805+0000 7fc1710999c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:06.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.805+0000 7fc1710999c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:06.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.805+0000 7fc1710999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:06.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.805+0000 7fc1710999c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:06.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.805+0000 7fc1710999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:06.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.805+0000 7fc1710999c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:06.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.805+0000 7fc1710999c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:06.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.805+0000 7fc1710999c0 20 searching for the correct realm 2024-09-12T17:56:06.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:06.813+0000 7fc16e39e640 0 -- 172.21.15.98:0/3806496966 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x5589458f2330 msgr2=0x5589458f4780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:07.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.025+0000 7fc16e39e640 0 -- 172.21.15.98:0/3806496966 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fc160064170 msgr2=0x7fc160062be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:07.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.037+0000 7fc1710999c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:07.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.037+0000 7fc1710999c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:07.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.037+0000 7fc1710999c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:07.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.037+0000 7fc1710999c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:07.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.037+0000 7fc1710999c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:07.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.037+0000 7fc1710999c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:07.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.037+0000 7fc1710999c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:07.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.037+0000 7fc1710999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:07.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.037+0000 7fc1710999c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:07.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.037+0000 7fc1710999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:07.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.037+0000 7fc1710999c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:07.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.037+0000 7fc1710999c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:07.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.041+0000 7fc1710999c0 20 zone default found 2024-09-12T17:56:07.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.041+0000 7fc1710999c0 4 Realm: () 2024-09-12T17:56:07.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.041+0000 7fc1710999c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:07.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.041+0000 7fc1710999c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:07.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.041+0000 7fc1710999c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:07.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.041+0000 7fc1710999c0 20 zonegroup default 2024-09-12T17:56:07.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.041+0000 7fc1710999c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:07.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.041+0000 7fc1710999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:07.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.041+0000 7fc1710999c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:07.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.041+0000 7fc1710999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:07.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.041+0000 7fc1710999c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:07.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.041+0000 7fc1710999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:07.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.041+0000 7fc1710999c0 20 started sync module instance, tier type = 2024-09-12T17:56:07.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.041+0000 7fc1710999c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:07.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.065+0000 7fc1710999c0 20 add_watcher() i=0 2024-09-12T17:56:07.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.065+0000 7fc1710999c0 20 add_watcher() i=1 2024-09-12T17:56:07.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.065+0000 7fc1710999c0 20 add_watcher() i=2 2024-09-12T17:56:07.068 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.065+0000 7fc1710999c0 20 add_watcher() i=3 2024-09-12T17:56:07.068 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.065+0000 7fc1710999c0 20 add_watcher() i=4 2024-09-12T17:56:07.068 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.065+0000 7fc1710999c0 20 add_watcher() i=5 2024-09-12T17:56:07.068 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.065+0000 7fc1710999c0 20 add_watcher() i=6 2024-09-12T17:56:07.069 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.065+0000 7fc1710999c0 20 add_watcher() i=7 2024-09-12T17:56:07.069 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.065+0000 7fc1710999c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:07.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.069+0000 7fc0257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:07.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.073+0000 7fc1710999c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:07.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.073+0000 7fc1710999c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:07.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.073+0000 7fc1710999c0 5 note: GC not initialized 2024-09-12T17:56:07.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.073+0000 7fbf9ffff640 20 reqs_thread_entry: start 2024-09-12T17:56:07.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.073+0000 7fc1710999c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:07.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.073+0000 7fc1710999c0 20 Filter name: none 2024-09-12T17:56:07.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.073+0000 7fbf9dffb640 20 reqs_thread_entry: start 2024-09-12T17:56:07.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.073+0000 7fc1710999c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:07.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.073+0000 7fc1710999c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:56:07.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.073+0000 7fc1710999c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:07.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.077+0000 7fc1710999c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:56:07.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.077+0000 7fc1710999c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:07.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.077+0000 7fc1710999c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:07.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.077+0000 7fc1710999c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T17:56:07.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.077+0000 7fc1710999c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:07.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.077+0000 7fc1710999c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T17:56:07.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.077+0000 7fc1710999c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:07.082 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.081+0000 7fc0257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:07.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.085+0000 7fc1710999c0 20 remove_watcher() i=0 2024-09-12T17:56:07.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.085+0000 7fc1710999c0 2 removed watcher, disabling cache 2024-09-12T17:56:07.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.085+0000 7fc1710999c0 20 remove_watcher() i=1 2024-09-12T17:56:07.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.089+0000 7fc1710999c0 20 remove_watcher() i=2 2024-09-12T17:56:07.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.093+0000 7fc1710999c0 20 remove_watcher() i=3 2024-09-12T17:56:07.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.093+0000 7fc1710999c0 20 remove_watcher() i=4 2024-09-12T17:56:07.098 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.097+0000 7fc1710999c0 20 remove_watcher() i=5 2024-09-12T17:56:07.100 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.097+0000 7fc1710999c0 20 remove_watcher() i=6 2024-09-12T17:56:07.101 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:07.097+0000 7fc1710999c0 20 remove_watcher() i=7 2024-09-12T17:56:07.117 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:07.118 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:56:07.118 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-init-indext id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:56:07.118 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:07.119 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:07.119 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:07.146 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:07.146 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:07.676 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:07.677 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:08.054 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T17:56:08.054 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:08.057 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:08.057 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:08.189 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:08.189 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:08.274 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:08.275 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:08.376 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:08.376 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:08.470 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:08.471 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:08.561 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:08.561 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:08.663 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:08.663 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:08.757 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:08.757 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:08.856 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:08.856 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:08.952 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:08.952 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:09.031 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:09.031 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:09.132 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:09.132 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:09.232 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:09.232 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:09.325 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:09.326 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:09.408 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:09.408 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:09.504 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:09.504 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:09.600 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:09.601 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:09.700 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:09.701 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:09.794 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:09.794 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:09.893 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:09.893 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:09.994 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:09.995 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:10.076 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:10.076 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:10.171 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:56:10.204 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:10.204 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:10.248 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.245+0000 7f3ffe9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.249+0000 7f3ffe9dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.249+0000 7f3ffe9dd9c0 20 realm 2024-09-12T17:56:10.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.249+0000 7f3ffe9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.249+0000 7f3ffe9dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.249+0000 7f3ffe9dd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:10.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.249+0000 7f3ffe9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.249+0000 7f3ffe9dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.249+0000 7f3ffe9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.249+0000 7f3ffe9dd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:10.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.249+0000 7f3ffe9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.249+0000 7f3ffe9dd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:10.253 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.249+0000 7f3ffe9dd9c0 20 searching for the correct realm 2024-09-12T17:56:10.259 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.257+0000 7f3ffbce2640 0 -- 172.21.15.98:0/3136907782 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f3fe40e4990 msgr2=0x7f3fe40e2430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:10.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.261+0000 7f3ffbce2640 0 -- 172.21.15.98:0/3136907782 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f3ec40811b0 msgr2=0x7f3ec40835e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:10.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.269+0000 7f3ffe9dd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:10.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.269+0000 7f3ffe9dd9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:10.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.269+0000 7f3ffe9dd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:10.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.269+0000 7f3ffe9dd9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:10.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.269+0000 7f3ffe9dd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:10.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.269+0000 7f3ffe9dd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:10.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.269+0000 7f3ffe9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.269+0000 7f3ffe9dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.269+0000 7f3ffe9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.273+0000 7f3ffe9dd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:10.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.273+0000 7f3ffe9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.273+0000 7f3ffe9dd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:10.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.273+0000 7f3ffe9dd9c0 20 zone default found 2024-09-12T17:56:10.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.273+0000 7f3ffe9dd9c0 4 Realm: () 2024-09-12T17:56:10.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.273+0000 7f3ffe9dd9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:10.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.273+0000 7f3ffe9dd9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:10.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.273+0000 7f3ffe9dd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:10.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.273+0000 7f3ffe9dd9c0 20 zonegroup default 2024-09-12T17:56:10.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.273+0000 7f3ffe9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.273+0000 7f3ffe9dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.273+0000 7f3ffe9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.273+0000 7f3ffe9dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.273+0000 7f3ffe9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.273+0000 7f3ffe9dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.273+0000 7f3ffe9dd9c0 20 started sync module instance, tier type = 2024-09-12T17:56:10.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.273+0000 7f3ffe9dd9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:10.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.289+0000 7f3ffe9dd9c0 20 add_watcher() i=0 2024-09-12T17:56:10.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.289+0000 7f3ffe9dd9c0 20 add_watcher() i=1 2024-09-12T17:56:10.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.289+0000 7f3ffe9dd9c0 20 add_watcher() i=2 2024-09-12T17:56:10.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.289+0000 7f3ffe9dd9c0 20 add_watcher() i=3 2024-09-12T17:56:10.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.289+0000 7f3ffe9dd9c0 20 add_watcher() i=4 2024-09-12T17:56:10.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.289+0000 7f3ffe9dd9c0 20 add_watcher() i=5 2024-09-12T17:56:10.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.289+0000 7f3ffe9dd9c0 20 add_watcher() i=6 2024-09-12T17:56:10.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.289+0000 7f3ffe9dd9c0 20 add_watcher() i=7 2024-09-12T17:56:10.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.289+0000 7f3ffe9dd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:10.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.293+0000 7f3eb2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:10.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.293+0000 7f3ffe9dd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:10.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.293+0000 7f3ffe9dd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:10.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.293+0000 7f3ffe9dd9c0 5 note: GC not initialized 2024-09-12T17:56:10.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.293+0000 7f3eb1fdb640 20 reqs_thread_entry: start 2024-09-12T17:56:10.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.293+0000 7f3ffe9dd9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:10.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.293+0000 7f3ffe9dd9c0 20 Filter name: none 2024-09-12T17:56:10.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.293+0000 7f3e237fe640 20 reqs_thread_entry: start 2024-09-12T17:56:10.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.293+0000 7f3ffe9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.297+0000 7f3ffe9dd9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:10.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.297+0000 7f3ffe9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.297+0000 7f3ffe9dd9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:10.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.297+0000 7f3ffe9dd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:10.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.297+0000 7f3ffe9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.297+0000 7f3ffe9dd9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:10.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.297+0000 7f3ffe9dd9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.297+0000 7f3ffe9dd9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:10.301 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.297+0000 7f3ffe9dd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:10.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.301+0000 7f3eb2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:10.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.305+0000 7f3ffe9dd9c0 20 remove_watcher() i=0 2024-09-12T17:56:10.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.305+0000 7f3ffe9dd9c0 2 removed watcher, disabling cache 2024-09-12T17:56:10.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.305+0000 7f3ffe9dd9c0 20 remove_watcher() i=1 2024-09-12T17:56:10.312 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.309+0000 7f3ffe9dd9c0 20 remove_watcher() i=2 2024-09-12T17:56:10.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.313+0000 7f3ffe9dd9c0 20 remove_watcher() i=3 2024-09-12T17:56:10.316 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.313+0000 7f3ffe9dd9c0 20 remove_watcher() i=4 2024-09-12T17:56:10.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.313+0000 7f3ffe9dd9c0 20 remove_watcher() i=5 2024-09-12T17:56:10.318 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.317+0000 7f3ffe9dd9c0 20 remove_watcher() i=6 2024-09-12T17:56:10.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.317+0000 7f3ffe9dd9c0 20 remove_watcher() i=7 2024-09-12T17:56:10.333 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:10.333 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:56:10.333 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-set-target-layout id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:56:10.333 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:10.334 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T17:56:10.366 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:10.366 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:10.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.405+0000 7f216c45e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.409+0000 7f216c45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.409+0000 7f216c45e9c0 20 realm 2024-09-12T17:56:10.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.409+0000 7f216c45e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.409+0000 7f216c45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.409+0000 7f216c45e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:10.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.409+0000 7f216c45e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.409+0000 7f216c45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.409+0000 7f216c45e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.409+0000 7f216c45e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:10.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.409+0000 7f216c45e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.409+0000 7f216c45e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:10.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.409+0000 7f216c45e9c0 20 searching for the correct realm 2024-09-12T17:56:10.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.417+0000 7f2169763640 0 -- 172.21.15.98:0/1027950213 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55a6d80537a0 msgr2=0x55a6d8055c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:10.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.421+0000 7f2169f64640 0 -- 172.21.15.98:0/1027950213 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f2160016800 msgr2=0x7f21600440c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:10.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.429+0000 7f216c45e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:10.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.429+0000 7f216c45e9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:10.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.429+0000 7f216c45e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:10.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.429+0000 7f216c45e9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:10.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.429+0000 7f216c45e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:10.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.429+0000 7f216c45e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:10.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.429+0000 7f216c45e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.429+0000 7f216c45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.429+0000 7f216c45e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.429+0000 7f216c45e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:10.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.429+0000 7f216c45e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.429+0000 7f216c45e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:10.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.429+0000 7f216c45e9c0 20 zone default found 2024-09-12T17:56:10.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.429+0000 7f216c45e9c0 4 Realm: () 2024-09-12T17:56:10.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.429+0000 7f216c45e9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:10.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.429+0000 7f216c45e9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:10.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.429+0000 7f216c45e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:10.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.429+0000 7f216c45e9c0 20 zonegroup default 2024-09-12T17:56:10.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.429+0000 7f216c45e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.433+0000 7f216c45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.433+0000 7f216c45e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.433+0000 7f216c45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.433+0000 7f216c45e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.433+0000 7f216c45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.433+0000 7f216c45e9c0 20 started sync module instance, tier type = 2024-09-12T17:56:10.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.433+0000 7f216c45e9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:10.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.449+0000 7f216c45e9c0 20 add_watcher() i=0 2024-09-12T17:56:10.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.449+0000 7f216c45e9c0 20 add_watcher() i=1 2024-09-12T17:56:10.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.449+0000 7f216c45e9c0 20 add_watcher() i=2 2024-09-12T17:56:10.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.449+0000 7f216c45e9c0 20 add_watcher() i=3 2024-09-12T17:56:10.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.449+0000 7f216c45e9c0 20 add_watcher() i=4 2024-09-12T17:56:10.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.449+0000 7f216c45e9c0 20 add_watcher() i=5 2024-09-12T17:56:10.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.449+0000 7f216c45e9c0 20 add_watcher() i=6 2024-09-12T17:56:10.451 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.449+0000 7f216c45e9c0 20 add_watcher() i=7 2024-09-12T17:56:10.451 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.449+0000 7f216c45e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:10.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.449+0000 7f201b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:10.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.449+0000 7f216c45e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:10.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.449+0000 7f216c45e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:10.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.453+0000 7f216c45e9c0 5 note: GC not initialized 2024-09-12T17:56:10.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.453+0000 7f201a7fc640 20 reqs_thread_entry: start 2024-09-12T17:56:10.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.453+0000 7f216c45e9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:10.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.453+0000 7f216c45e9c0 20 Filter name: none 2024-09-12T17:56:10.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.453+0000 7f1f8bfff640 20 reqs_thread_entry: start 2024-09-12T17:56:10.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.453+0000 7f216c45e9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:56:10.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.453+0000 7f216c45e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.453+0000 7f216c45e9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:10.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.453+0000 7f216c45e9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:56:10.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.453+0000 7f216c45e9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:56:10.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.453+0000 7f216c45e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 : miss 2024-09-12T17:56:10.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.453+0000 7f216c45e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.453+0000 7f216c45e9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:10.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.453+0000 7f216c45e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 info.flags=0x17 2024-09-12T17:56:10.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.453+0000 7f216c45e9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 to cache LRU end 2024-09-12T17:56:10.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.453+0000 7f216c45e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:10.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.453+0000 7f216c45e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:10.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.453+0000 7f216c45e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 2024-09-12T17:56:10.462 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.461+0000 7f216c45e9c0 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T17:56:10.462 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.461+0000 7f216c45e9c0 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T17:56:10.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.465+0000 7f201b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:10.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.469+0000 7f216c45e9c0 20 remove_watcher() i=0 2024-09-12T17:56:10.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.469+0000 7f216c45e9c0 2 removed watcher, disabling cache 2024-09-12T17:56:10.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.473+0000 7f216c45e9c0 20 remove_watcher() i=1 2024-09-12T17:56:10.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.473+0000 7f216c45e9c0 20 remove_watcher() i=2 2024-09-12T17:56:10.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.477+0000 7f216c45e9c0 20 remove_watcher() i=3 2024-09-12T17:56:10.481 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.477+0000 7f216c45e9c0 20 remove_watcher() i=4 2024-09-12T17:56:10.482 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.481+0000 7f216c45e9c0 20 remove_watcher() i=5 2024-09-12T17:56:10.483 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.481+0000 7f216c45e9c0 20 remove_watcher() i=6 2024-09-12T17:56:10.484 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.481+0000 7f216c45e9c0 20 remove_watcher() i=7 2024-09-12T17:56:10.497 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:56:10.524 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:10.524 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:10.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.565+0000 7f7d3c2399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.565+0000 7f7d3c2399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.565+0000 7f7d3c2399c0 20 realm 2024-09-12T17:56:10.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.565+0000 7f7d3c2399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.565+0000 7f7d3c2399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.565+0000 7f7d3c2399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:10.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.565+0000 7f7d3c2399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.565+0000 7f7d3c2399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.565+0000 7f7d3c2399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.569+0000 7f7d3c2399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:10.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.569+0000 7f7d3c2399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.571 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.569+0000 7f7d3c2399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:10.571 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.569+0000 7f7d3c2399c0 20 searching for the correct realm 2024-09-12T17:56:10.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.573+0000 7f7d3953e640 0 -- 172.21.15.98:0/2236563904 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55c1303c11f0 msgr2=0x55c1303c3630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:10.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.581+0000 7f7d3953e640 0 -- 172.21.15.98:0/2236563904 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f7d2c0cd9d0 msgr2=0x7f7d2c12b1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:10.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.585+0000 7f7d3c2399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:10.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.585+0000 7f7d3c2399c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:10.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.585+0000 7f7d3c2399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:10.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.585+0000 7f7d3c2399c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:10.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.585+0000 7f7d3c2399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:10.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.585+0000 7f7d3c2399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:10.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.585+0000 7f7d3c2399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.585+0000 7f7d3c2399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.585+0000 7f7d3c2399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.589+0000 7f7d3c2399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:10.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.589+0000 7f7d3c2399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.589+0000 7f7d3c2399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:10.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.589+0000 7f7d3c2399c0 20 zone default found 2024-09-12T17:56:10.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.589+0000 7f7d3c2399c0 4 Realm: () 2024-09-12T17:56:10.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.589+0000 7f7d3c2399c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:10.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.589+0000 7f7d3c2399c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:10.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.589+0000 7f7d3c2399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:10.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.589+0000 7f7d3c2399c0 20 zonegroup default 2024-09-12T17:56:10.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.589+0000 7f7d3c2399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.589+0000 7f7d3c2399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.589+0000 7f7d3c2399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.589+0000 7f7d3c2399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.589+0000 7f7d3c2399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.589+0000 7f7d3c2399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.589+0000 7f7d3c2399c0 20 started sync module instance, tier type = 2024-09-12T17:56:10.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.589+0000 7f7d3c2399c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:10.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.605+0000 7f7d3c2399c0 20 add_watcher() i=0 2024-09-12T17:56:10.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.605+0000 7f7d3c2399c0 20 add_watcher() i=1 2024-09-12T17:56:10.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.605+0000 7f7d3c2399c0 20 add_watcher() i=2 2024-09-12T17:56:10.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.605+0000 7f7d3c2399c0 20 add_watcher() i=3 2024-09-12T17:56:10.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.605+0000 7f7d3c2399c0 20 add_watcher() i=4 2024-09-12T17:56:10.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.605+0000 7f7d3c2399c0 20 add_watcher() i=5 2024-09-12T17:56:10.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.605+0000 7f7d3c2399c0 20 add_watcher() i=6 2024-09-12T17:56:10.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.605+0000 7f7d3c2399c0 20 add_watcher() i=7 2024-09-12T17:56:10.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.605+0000 7f7d3c2399c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:10.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.609+0000 7f7beb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:10.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.609+0000 7f7d3c2399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:10.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.609+0000 7f7d3c2399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:10.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.609+0000 7f7d3c2399c0 5 note: GC not initialized 2024-09-12T17:56:10.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.609+0000 7f7bea7fc640 20 reqs_thread_entry: start 2024-09-12T17:56:10.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.609+0000 7f7d3c2399c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:10.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.609+0000 7f7d3c2399c0 20 Filter name: none 2024-09-12T17:56:10.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.609+0000 7f7b5bfff640 20 reqs_thread_entry: start 2024-09-12T17:56:10.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.609+0000 7f7d3c2399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.609+0000 7f7d3c2399c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:10.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.609+0000 7f7d3c2399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.613+0000 7f7d3c2399c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:10.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.613+0000 7f7d3c2399c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:10.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.613+0000 7f7d3c2399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.613+0000 7f7d3c2399c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:10.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.613+0000 7f7d3c2399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.613+0000 7f7d3c2399c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:10.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.613+0000 7f7d3c2399c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:10.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.617+0000 7f7beb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:10.623 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.621+0000 7f7d3c2399c0 20 remove_watcher() i=0 2024-09-12T17:56:10.623 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.621+0000 7f7d3c2399c0 2 removed watcher, disabling cache 2024-09-12T17:56:10.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.621+0000 7f7d3c2399c0 20 remove_watcher() i=1 2024-09-12T17:56:10.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.625+0000 7f7d3c2399c0 20 remove_watcher() i=2 2024-09-12T17:56:10.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.625+0000 7f7d3c2399c0 20 remove_watcher() i=3 2024-09-12T17:56:10.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.629+0000 7f7d3c2399c0 20 remove_watcher() i=4 2024-09-12T17:56:10.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.629+0000 7f7d3c2399c0 20 remove_watcher() i=5 2024-09-12T17:56:10.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.629+0000 7f7d3c2399c0 20 remove_watcher() i=6 2024-09-12T17:56:10.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.633+0000 7f7d3c2399c0 20 remove_watcher() i=7 2024-09-12T17:56:10.648 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:10.648 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:56:10.648 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-set-target-layout id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:56:10.648 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:10.649 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:10.649 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:10.688 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:10.688 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:10.748 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:56:10.783 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:10.783 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:10.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.825+0000 7ff99eaed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.825+0000 7ff99eaed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.825+0000 7ff99eaed9c0 20 realm 2024-09-12T17:56:10.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.825+0000 7ff99eaed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.825+0000 7ff99eaed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.825+0000 7ff99eaed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:10.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.829+0000 7ff99eaed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.829+0000 7ff99eaed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:10.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.829+0000 7ff99eaed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.829+0000 7ff99eaed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:10.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.829+0000 7ff99eaed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:10.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.829+0000 7ff99eaed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:10.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.829+0000 7ff99eaed9c0 20 searching for the correct realm 2024-09-12T17:56:10.835 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:10.833+0000 7ff99bdf2640 0 -- 172.21.15.98:0/4117265423 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7ff98c0f7040 msgr2=0x7ff98c0f7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:11.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.049+0000 7ff99c5f3640 0 -- 172.21.15.98:0/4117265423 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7ff984003100 msgr2=0x7ff990028950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:11.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.265+0000 7ff99eaed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:11.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.265+0000 7ff99eaed9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:11.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.265+0000 7ff99eaed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:11.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.265+0000 7ff99eaed9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:11.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.265+0000 7ff99eaed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:11.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.265+0000 7ff99eaed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:11.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.265+0000 7ff99eaed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.265+0000 7ff99eaed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:11.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.265+0000 7ff99eaed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.269+0000 7ff99eaed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:11.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.269+0000 7ff99eaed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.269+0000 7ff99eaed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:11.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.269+0000 7ff99eaed9c0 20 zone default found 2024-09-12T17:56:11.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.269+0000 7ff99eaed9c0 4 Realm: () 2024-09-12T17:56:11.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.269+0000 7ff99eaed9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:11.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.269+0000 7ff99eaed9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:11.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.269+0000 7ff99eaed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:11.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.269+0000 7ff99eaed9c0 20 zonegroup default 2024-09-12T17:56:11.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.269+0000 7ff99eaed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.269+0000 7ff99eaed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:11.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.269+0000 7ff99eaed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.269+0000 7ff99eaed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:11.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.269+0000 7ff99eaed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.273+0000 7ff99eaed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:11.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.273+0000 7ff99eaed9c0 20 started sync module instance, tier type = 2024-09-12T17:56:11.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.273+0000 7ff99eaed9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:11.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.297+0000 7ff99eaed9c0 20 add_watcher() i=0 2024-09-12T17:56:11.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.297+0000 7ff99eaed9c0 20 add_watcher() i=1 2024-09-12T17:56:11.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.297+0000 7ff99eaed9c0 20 add_watcher() i=2 2024-09-12T17:56:11.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.297+0000 7ff99eaed9c0 20 add_watcher() i=3 2024-09-12T17:56:11.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.297+0000 7ff99eaed9c0 20 add_watcher() i=4 2024-09-12T17:56:11.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.297+0000 7ff99eaed9c0 20 add_watcher() i=5 2024-09-12T17:56:11.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.297+0000 7ff99eaed9c0 20 add_watcher() i=6 2024-09-12T17:56:11.301 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.297+0000 7ff99eaed9c0 20 add_watcher() i=7 2024-09-12T17:56:11.301 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.297+0000 7ff99eaed9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:11.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.301+0000 7ff852fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:11.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.305+0000 7ff99eaed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:11.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.305+0000 7ff99eaed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:11.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.305+0000 7ff99eaed9c0 5 note: GC not initialized 2024-09-12T17:56:11.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.305+0000 7ff851fdb640 20 reqs_thread_entry: start 2024-09-12T17:56:11.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.305+0000 7ff99eaed9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:11.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.305+0000 7ff99eaed9c0 20 Filter name: none 2024-09-12T17:56:11.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.305+0000 7ff7c37fe640 20 reqs_thread_entry: start 2024-09-12T17:56:11.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.305+0000 7ff99eaed9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:56:11.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.305+0000 7ff99eaed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.305+0000 7ff99eaed9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:11.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.305+0000 7ff99eaed9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:56:11.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.305+0000 7ff99eaed9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:56:11.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.305+0000 7ff99eaed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 : miss 2024-09-12T17:56:11.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.305+0000 7ff99eaed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.305+0000 7ff99eaed9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:11.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.305+0000 7ff99eaed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 info.flags=0x17 2024-09-12T17:56:11.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.305+0000 7ff99eaed9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 to cache LRU end 2024-09-12T17:56:11.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.305+0000 7ff99eaed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:11.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.305+0000 7ff99eaed9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:11.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.305+0000 7ff99eaed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 2024-09-12T17:56:11.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.317+0000 7ff99eaed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 info.flags=0x17 2024-09-12T17:56:11.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.317+0000 7ff99eaed9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 to cache LRU end 2024-09-12T17:56:11.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.317+0000 7ff99eaed9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:11.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.317+0000 7ff99eaed9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22, ofs0, ns] 2024-09-12T17:56:11.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.317+0000 7ff8737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366180 cookie 94875669202704 notifier 6140 bl.length()=925 2024-09-12T17:56:11.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.317+0000 7ff8737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 info.flags=0x17 2024-09-12T17:56:11.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.317+0000 7ff8737fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 to cache LRU end 2024-09-12T17:56:11.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.317+0000 7ff8737fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:11.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.321+0000 7ff99eaed9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.22]): orig_sources= new_sources= 2024-09-12T17:56:11.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.321+0000 7ff99eaed9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.22]): potential sources added=[] removed=[] 2024-09-12T17:56:11.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.321+0000 7ff99eaed9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.22]): orig_dests= new_dests= 2024-09-12T17:56:11.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.321+0000 7ff99eaed9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.22]): potential dests added=[] removed=[] 2024-09-12T17:56:11.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.0 2024-09-12T17:56:11.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.0 2024-09-12T17:56:11.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.1 2024-09-12T17:56:11.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.1 2024-09-12T17:56:11.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.2 2024-09-12T17:56:11.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.2 2024-09-12T17:56:11.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.3 2024-09-12T17:56:11.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.3 2024-09-12T17:56:11.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.4 2024-09-12T17:56:11.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.4 2024-09-12T17:56:11.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.5 2024-09-12T17:56:11.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.5 2024-09-12T17:56:11.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.6 2024-09-12T17:56:11.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.6 2024-09-12T17:56:11.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.7 2024-09-12T17:56:11.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.7 2024-09-12T17:56:11.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.8 2024-09-12T17:56:11.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.8 2024-09-12T17:56:11.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.9 2024-09-12T17:56:11.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.9 2024-09-12T17:56:11.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.10 2024-09-12T17:56:11.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.10 2024-09-12T17:56:11.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.11 2024-09-12T17:56:11.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1.11 2024-09-12T17:56:11.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.0 2024-09-12T17:56:11.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.329+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1 2024-09-12T17:56:11.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.333+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.2 2024-09-12T17:56:11.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.333+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.3 2024-09-12T17:56:11.337 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.333+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.4 2024-09-12T17:56:11.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.337+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.5 2024-09-12T17:56:11.339 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.337+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.6 2024-09-12T17:56:11.340 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.337+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.7 2024-09-12T17:56:11.341 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.337+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.8 2024-09-12T17:56:11.343 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.337+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.9 2024-09-12T17:56:11.343 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.341+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.10 2024-09-12T17:56:11.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.345+0000 7ff99eaed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:11.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.345+0000 7ff99eaed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 2024-09-12T17:56:11.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.349+0000 7ff99eaed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 info.flags=0x17 2024-09-12T17:56:11.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.349+0000 7ff99eaed9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 to cache LRU end 2024-09-12T17:56:11.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.349+0000 7ff99eaed9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:11.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.349+0000 7ff99eaed9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22, ofs0, ns] 2024-09-12T17:56:11.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.349+0000 7ff872ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366181 cookie 94875669202704 notifier 6140 bl.length()=925 2024-09-12T17:56:11.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.349+0000 7ff872ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 info.flags=0x17 2024-09-12T17:56:11.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.349+0000 7ff872ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 to cache LRU end 2024-09-12T17:56:11.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.349+0000 7ff872ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:11.355 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.353+0000 7ff99eaed9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.22]): orig_sources= new_sources= 2024-09-12T17:56:11.355 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.353+0000 7ff99eaed9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.22]): potential sources added=[] removed=[] 2024-09-12T17:56:11.355 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.353+0000 7ff99eaed9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.22]): orig_dests= new_dests= 2024-09-12T17:56:11.355 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.353+0000 7ff99eaed9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.22]): potential dests added=[] removed=[] 2024-09-12T17:56:11.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.357+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.0 2024-09-12T17:56:11.360 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.357+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.1 2024-09-12T17:56:11.361 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.357+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.2 2024-09-12T17:56:11.361 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.357+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.3 2024-09-12T17:56:11.362 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.361+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.4 2024-09-12T17:56:11.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.361+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.5 2024-09-12T17:56:11.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.361+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.6 2024-09-12T17:56:11.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.361+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.7 2024-09-12T17:56:11.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.361+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.8 2024-09-12T17:56:11.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.365+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.9 2024-09-12T17:56:11.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.365+0000 7ff99eaed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.22.10 2024-09-12T17:56:11.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.365+0000 7ff99eaed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:11.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.365+0000 7ff99eaed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 2024-09-12T17:56:11.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.369+0000 7ff99eaed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 info.flags=0x17 2024-09-12T17:56:11.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.369+0000 7ff99eaed9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 to cache LRU end 2024-09-12T17:56:11.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.369+0000 7ff99eaed9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:11.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.369+0000 7ff99eaed9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22, ofs0, ns] 2024-09-12T17:56:11.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.369+0000 7ff872ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366182 cookie 94875669202704 notifier 6140 bl.length()=893 2024-09-12T17:56:11.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.369+0000 7ff872ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 info.flags=0x17 2024-09-12T17:56:11.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.369+0000 7ff872ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 to cache LRU end 2024-09-12T17:56:11.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.369+0000 7ff872ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:11.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.373+0000 7ff99eaed9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.22]): orig_sources= new_sources= 2024-09-12T17:56:11.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.373+0000 7ff99eaed9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.22]): potential sources added=[] removed=[] 2024-09-12T17:56:11.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.373+0000 7ff99eaed9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.22]): orig_dests= new_dests= 2024-09-12T17:56:11.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.373+0000 7ff99eaed9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.22]): potential dests added=[] removed=[] 2024-09-12T17:56:11.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.377+0000 7ff99eaed9c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:56:11.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.381+0000 7ff852fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:11.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.385+0000 7ff99eaed9c0 20 remove_watcher() i=0 2024-09-12T17:56:11.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.385+0000 7ff99eaed9c0 2 removed watcher, disabling cache 2024-09-12T17:56:11.390 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.385+0000 7ff99eaed9c0 20 remove_watcher() i=1 2024-09-12T17:56:11.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.389+0000 7ff99eaed9c0 20 remove_watcher() i=2 2024-09-12T17:56:11.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.389+0000 7ff99eaed9c0 20 remove_watcher() i=3 2024-09-12T17:56:11.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.393+0000 7ff99eaed9c0 20 remove_watcher() i=4 2024-09-12T17:56:11.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.397+0000 7ff99eaed9c0 20 remove_watcher() i=5 2024-09-12T17:56:11.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.397+0000 7ff99eaed9c0 20 remove_watcher() i=6 2024-09-12T17:56:11.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.397+0000 7ff99eaed9c0 20 remove_watcher() i=7 2024-09-12T17:56:11.416 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:56:11.446 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:11.446 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:11.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.485+0000 7fedaefcf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.489+0000 7fedaefcf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:11.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.489+0000 7fedaefcf9c0 20 realm 2024-09-12T17:56:11.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.489+0000 7fedaefcf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.489+0000 7fedaefcf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:11.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.489+0000 7fedaefcf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:11.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.489+0000 7fedaefcf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.489+0000 7fedaefcf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:11.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.489+0000 7fedaefcf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.489+0000 7fedaefcf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:11.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.489+0000 7fedaefcf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.489+0000 7fedaefcf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:11.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.489+0000 7fedaefcf9c0 20 searching for the correct realm 2024-09-12T17:56:11.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.497+0000 7feda7fff640 0 -- 172.21.15.98:0/3298782674 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7feda0048040 msgr2=0x7feda004ab90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:11.507 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.505+0000 7feda7fff640 0 -- 172.21.15.98:0/3298782674 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fec74081180 msgr2=0x7fec740835b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:11.513 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.509+0000 7fedaefcf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:11.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.509+0000 7fedaefcf9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:11.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.509+0000 7fedaefcf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:11.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.509+0000 7fedaefcf9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:11.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.509+0000 7fedaefcf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:11.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.509+0000 7fedaefcf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:11.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.509+0000 7fedaefcf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.509+0000 7fedaefcf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:11.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.509+0000 7fedaefcf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.513+0000 7fedaefcf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:11.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.513+0000 7fedaefcf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.513+0000 7fedaefcf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:11.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.513+0000 7fedaefcf9c0 20 zone default found 2024-09-12T17:56:11.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.513+0000 7fedaefcf9c0 4 Realm: () 2024-09-12T17:56:11.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.513+0000 7fedaefcf9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:11.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.513+0000 7fedaefcf9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:11.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.513+0000 7fedaefcf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:11.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.513+0000 7fedaefcf9c0 20 zonegroup default 2024-09-12T17:56:11.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.513+0000 7fedaefcf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.513+0000 7fedaefcf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:11.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.513+0000 7fedaefcf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.513+0000 7fedaefcf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:11.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.513+0000 7fedaefcf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.513+0000 7fedaefcf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:11.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.513+0000 7fedaefcf9c0 20 started sync module instance, tier type = 2024-09-12T17:56:11.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.513+0000 7fedaefcf9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:11.532 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.529+0000 7fedaefcf9c0 20 add_watcher() i=0 2024-09-12T17:56:11.532 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.529+0000 7fedaefcf9c0 20 add_watcher() i=1 2024-09-12T17:56:11.533 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.529+0000 7fedaefcf9c0 20 add_watcher() i=2 2024-09-12T17:56:11.533 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.529+0000 7fedaefcf9c0 20 add_watcher() i=3 2024-09-12T17:56:11.533 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.529+0000 7fedaefcf9c0 20 add_watcher() i=4 2024-09-12T17:56:11.533 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.529+0000 7fedaefcf9c0 20 add_watcher() i=5 2024-09-12T17:56:11.533 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.529+0000 7fedaefcf9c0 20 add_watcher() i=6 2024-09-12T17:56:11.533 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.529+0000 7fedaefcf9c0 20 add_watcher() i=7 2024-09-12T17:56:11.533 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.529+0000 7fedaefcf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:11.536 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.533+0000 7fec61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:11.537 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.533+0000 7fedaefcf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:11.537 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.533+0000 7fedaefcf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:11.537 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.533+0000 7fedaefcf9c0 5 note: GC not initialized 2024-09-12T17:56:11.537 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.533+0000 7fec60fe1640 20 reqs_thread_entry: start 2024-09-12T17:56:11.537 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.533+0000 7fedaefcf9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:11.537 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.533+0000 7fedaefcf9c0 20 Filter name: none 2024-09-12T17:56:11.537 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.533+0000 7febda7fc640 20 reqs_thread_entry: start 2024-09-12T17:56:11.537 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.533+0000 7fedaefcf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.538 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.533+0000 7fedaefcf9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:11.538 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.533+0000 7fedaefcf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.538 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.537+0000 7fedaefcf9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:11.538 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.537+0000 7fedaefcf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:11.538 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.537+0000 7fedaefcf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.539 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.537+0000 7fedaefcf9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:11.539 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.537+0000 7fedaefcf9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:11.539 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.537+0000 7fedaefcf9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:11.540 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.537+0000 7fedaefcf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:11.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.541+0000 7fec61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:11.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.545+0000 7fedaefcf9c0 20 remove_watcher() i=0 2024-09-12T17:56:11.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.545+0000 7fedaefcf9c0 2 removed watcher, disabling cache 2024-09-12T17:56:11.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.545+0000 7fedaefcf9c0 20 remove_watcher() i=1 2024-09-12T17:56:11.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.549+0000 7fedaefcf9c0 20 remove_watcher() i=2 2024-09-12T17:56:11.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.549+0000 7fedaefcf9c0 20 remove_watcher() i=3 2024-09-12T17:56:11.554 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.553+0000 7fedaefcf9c0 20 remove_watcher() i=4 2024-09-12T17:56:11.555 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.553+0000 7fedaefcf9c0 20 remove_watcher() i=5 2024-09-12T17:56:11.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.553+0000 7fedaefcf9c0 20 remove_watcher() i=6 2024-09-12T17:56:11.558 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:11.557+0000 7fedaefcf9c0 20 remove_watcher() i=7 2024-09-12T17:56:11.571 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:11.572 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:56:11.572 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-set-target-layout id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:56:11.572 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:11.572 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:11.572 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:11.591 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:11.591 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:12.172 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:12.172 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:12.568 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T17:56:12.568 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:12.570 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:12.570 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:12.706 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:12.706 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:12.793 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:12.793 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:12.891 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:12.891 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:12.991 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:12.991 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:13.088 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:13.088 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:13.181 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:13.182 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:13.278 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:13.278 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:13.377 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:13.377 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:13.477 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:13.477 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:13.569 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:13.569 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:13.665 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:13.666 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:13.768 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:13.768 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:13.863 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:13.864 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:13.958 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:13.959 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:14.053 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:14.053 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:14.156 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:14.157 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:14.250 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:14.250 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:14.348 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:14.348 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:14.448 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:14.448 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:14.543 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:14.543 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:14.645 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:14.646 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:14.741 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:56:14.774 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:14.774 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:14.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.817+0000 7fa52c4a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.817+0000 7fa52c4a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:14.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.817+0000 7fa52c4a89c0 20 realm 2024-09-12T17:56:14.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.817+0000 7fa52c4a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.817+0000 7fa52c4a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:14.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.817+0000 7fa52c4a89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:14.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.817+0000 7fa52c4a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.817+0000 7fa52c4a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:14.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.817+0000 7fa52c4a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.822 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.821+0000 7fa52c4a89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:14.822 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.821+0000 7fa52c4a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.821+0000 7fa52c4a89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:14.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.821+0000 7fa52c4a89c0 20 searching for the correct realm 2024-09-12T17:56:14.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.825+0000 7fa5297ad640 0 -- 172.21.15.98:0/2993420964 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x55575b736c40 msgr2=0x55575b739030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:14.835 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.833+0000 7fa529fae640 0 -- 172.21.15.98:0/2993420964 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fa52006b050 msgr2=0x7fa520065860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:14.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:14.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:14.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:14.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:14.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:14.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:14.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:14.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:14.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:14.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 20 zone default found 2024-09-12T17:56:14.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 4 Realm: () 2024-09-12T17:56:14.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:14.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:14.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:14.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 20 zonegroup default 2024-09-12T17:56:14.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:14.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.841+0000 7fa52c4a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.845+0000 7fa52c4a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:14.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.845+0000 7fa52c4a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.845+0000 7fa52c4a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:14.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.845+0000 7fa52c4a89c0 20 started sync module instance, tier type = 2024-09-12T17:56:14.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.845+0000 7fa52c4a89c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:14.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.857+0000 7fa52c4a89c0 20 add_watcher() i=0 2024-09-12T17:56:14.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.857+0000 7fa52c4a89c0 20 add_watcher() i=1 2024-09-12T17:56:14.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.857+0000 7fa52c4a89c0 20 add_watcher() i=2 2024-09-12T17:56:14.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.857+0000 7fa52c4a89c0 20 add_watcher() i=3 2024-09-12T17:56:14.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.857+0000 7fa52c4a89c0 20 add_watcher() i=4 2024-09-12T17:56:14.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.857+0000 7fa52c4a89c0 20 add_watcher() i=5 2024-09-12T17:56:14.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.857+0000 7fa52c4a89c0 20 add_watcher() i=6 2024-09-12T17:56:14.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.861+0000 7fa52c4a89c0 20 add_watcher() i=7 2024-09-12T17:56:14.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.861+0000 7fa52c4a89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:14.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.861+0000 7fa3db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:14.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.861+0000 7fa52c4a89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:14.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.861+0000 7fa52c4a89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:14.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.861+0000 7fa52c4a89c0 5 note: GC not initialized 2024-09-12T17:56:14.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.861+0000 7fa3da7fc640 20 reqs_thread_entry: start 2024-09-12T17:56:14.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.865+0000 7fa52c4a89c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:14.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.865+0000 7fa52c4a89c0 20 Filter name: none 2024-09-12T17:56:14.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.865+0000 7fa34bfff640 20 reqs_thread_entry: start 2024-09-12T17:56:14.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.865+0000 7fa52c4a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.865+0000 7fa52c4a89c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:14.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.865+0000 7fa52c4a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.865+0000 7fa52c4a89c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:14.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.865+0000 7fa52c4a89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:14.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.865+0000 7fa52c4a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.865+0000 7fa52c4a89c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:14.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.865+0000 7fa52c4a89c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.865+0000 7fa52c4a89c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:14.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.865+0000 7fa52c4a89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:14.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.869+0000 7fa3db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:14.876 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.873+0000 7fa52c4a89c0 20 remove_watcher() i=0 2024-09-12T17:56:14.876 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.873+0000 7fa52c4a89c0 2 removed watcher, disabling cache 2024-09-12T17:56:14.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.873+0000 7fa52c4a89c0 20 remove_watcher() i=1 2024-09-12T17:56:14.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.877+0000 7fa52c4a89c0 20 remove_watcher() i=2 2024-09-12T17:56:14.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.881+0000 7fa52c4a89c0 20 remove_watcher() i=3 2024-09-12T17:56:14.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.881+0000 7fa52c4a89c0 20 remove_watcher() i=4 2024-09-12T17:56:14.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.881+0000 7fa52c4a89c0 20 remove_watcher() i=5 2024-09-12T17:56:14.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.885+0000 7fa52c4a89c0 20 remove_watcher() i=6 2024-09-12T17:56:14.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.885+0000 7fa52c4a89c0 20 remove_watcher() i=7 2024-09-12T17:56:14.901 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:14.901 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:56:14.901 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-set-target-layout id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:56:14.901 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:14.902 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T17:56:14.939 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:14.939 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:14.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.981+0000 7f2f1fd399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.981+0000 7f2f1fd399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:14.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.981+0000 7f2f1fd399c0 20 realm 2024-09-12T17:56:14.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.981+0000 7f2f1fd399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.981+0000 7f2f1fd399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:14.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.981+0000 7f2f1fd399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:14.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.981+0000 7f2f1fd399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.981+0000 7f2f1fd399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:14.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.981+0000 7f2f1fd399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.987 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.985+0000 7f2f1fd399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:14.987 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.985+0000 7f2f1fd399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:14.987 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.985+0000 7f2f1fd399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:14.987 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.985+0000 7f2f1fd399c0 20 searching for the correct realm 2024-09-12T17:56:14.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:14.989+0000 7f2f1e040640 0 -- 172.21.15.98:0/3947693197 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f2f140ec930 msgr2=0x7f2f140e4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:15.213 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.209+0000 7f2f1d83f640 0 -- 172.21.15.98:0/3947693197 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x563a2166beb0 msgr2=0x563a2166e2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:15.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.217+0000 7f2f1fd399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:15.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.217+0000 7f2f1fd399c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:15.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.217+0000 7f2f1fd399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:15.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.217+0000 7f2f1fd399c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:15.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.217+0000 7f2f1fd399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:15.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.217+0000 7f2f1fd399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:15.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.217+0000 7f2f1fd399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.217+0000 7f2f1fd399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.217+0000 7f2f1fd399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.221+0000 7f2f1fd399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:15.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.221+0000 7f2f1fd399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.221+0000 7f2f1fd399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:15.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.221+0000 7f2f1fd399c0 20 zone default found 2024-09-12T17:56:15.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.221+0000 7f2f1fd399c0 4 Realm: () 2024-09-12T17:56:15.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.221+0000 7f2f1fd399c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:15.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.221+0000 7f2f1fd399c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:15.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.221+0000 7f2f1fd399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:15.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.221+0000 7f2f1fd399c0 20 zonegroup default 2024-09-12T17:56:15.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.221+0000 7f2f1fd399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.221+0000 7f2f1fd399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.221+0000 7f2f1fd399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.221+0000 7f2f1fd399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.221+0000 7f2f1fd399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.221+0000 7f2f1fd399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.221+0000 7f2f1fd399c0 20 started sync module instance, tier type = 2024-09-12T17:56:15.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.221+0000 7f2f1fd399c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:15.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.249+0000 7f2f1fd399c0 20 add_watcher() i=0 2024-09-12T17:56:15.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.249+0000 7f2f1fd399c0 20 add_watcher() i=1 2024-09-12T17:56:15.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.249+0000 7f2f1fd399c0 20 add_watcher() i=2 2024-09-12T17:56:15.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.249+0000 7f2f1fd399c0 20 add_watcher() i=3 2024-09-12T17:56:15.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.249+0000 7f2f1fd399c0 20 add_watcher() i=4 2024-09-12T17:56:15.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.249+0000 7f2f1fd399c0 20 add_watcher() i=5 2024-09-12T17:56:15.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.249+0000 7f2f1fd399c0 20 add_watcher() i=6 2024-09-12T17:56:15.253 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.249+0000 7f2f1fd399c0 20 add_watcher() i=7 2024-09-12T17:56:15.253 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.249+0000 7f2f1fd399c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:15.257 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.253+0000 7f2dcf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:15.258 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.257+0000 7f2f1fd399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:15.258 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.257+0000 7f2f1fd399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:15.258 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.257+0000 7f2f1fd399c0 5 note: GC not initialized 2024-09-12T17:56:15.259 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.257+0000 7f2dce7fc640 20 reqs_thread_entry: start 2024-09-12T17:56:15.259 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.257+0000 7f2f1fd399c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:15.259 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.257+0000 7f2f1fd399c0 20 Filter name: none 2024-09-12T17:56:15.259 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.257+0000 7f2d3ffff640 20 reqs_thread_entry: start 2024-09-12T17:56:15.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.257+0000 7f2f1fd399c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T17:56:15.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.257+0000 7f2f1fd399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.257+0000 7f2f1fd399c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:15.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.257+0000 7f2f1fd399c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T17:56:15.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.257+0000 7f2f1fd399c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T17:56:15.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.257+0000 7f2f1fd399c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 : miss 2024-09-12T17:56:15.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.257+0000 7f2f1fd399c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.257+0000 7f2f1fd399c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:15.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.257+0000 7f2f1fd399c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 info.flags=0x17 2024-09-12T17:56:15.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.257+0000 7f2f1fd399c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 to cache LRU end 2024-09-12T17:56:15.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.257+0000 7f2f1fd399c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:15.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.257+0000 7f2f1fd399c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:15.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.257+0000 7f2f1fd399c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 2024-09-12T17:56:15.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.265+0000 7f2f1fd399c0 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T17:56:15.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.269+0000 7f2f1fd399c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 info.flags=0x17 2024-09-12T17:56:15.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.269+0000 7f2f1fd399c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 to cache LRU end 2024-09-12T17:56:15.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.269+0000 7f2f1fd399c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:15.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.269+0000 7f2f1fd399c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23, ofs0, ns] 2024-09-12T17:56:15.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.269+0000 7f2e017fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366185 cookie 94807668510976 notifier 6191 bl.length()=925 2024-09-12T17:56:15.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.269+0000 7f2e017fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 info.flags=0x17 2024-09-12T17:56:15.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.269+0000 7f2e017fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 to cache LRU end 2024-09-12T17:56:15.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.269+0000 7f2e017fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:15.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.273+0000 7f2f1fd399c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.23]): orig_sources= new_sources= 2024-09-12T17:56:15.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.273+0000 7f2f1fd399c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.23]): potential sources added=[] removed=[] 2024-09-12T17:56:15.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.273+0000 7f2f1fd399c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.23]): orig_dests= new_dests= 2024-09-12T17:56:15.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.273+0000 7f2f1fd399c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.23]): potential dests added=[] removed=[] 2024-09-12T17:56:15.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.0 2024-09-12T17:56:15.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.0 2024-09-12T17:56:15.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.1 2024-09-12T17:56:15.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.1 2024-09-12T17:56:15.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.2 2024-09-12T17:56:15.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.2 2024-09-12T17:56:15.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.3 2024-09-12T17:56:15.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.3 2024-09-12T17:56:15.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.4 2024-09-12T17:56:15.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.4 2024-09-12T17:56:15.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.5 2024-09-12T17:56:15.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.5 2024-09-12T17:56:15.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.6 2024-09-12T17:56:15.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.6 2024-09-12T17:56:15.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.7 2024-09-12T17:56:15.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.7 2024-09-12T17:56:15.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.8 2024-09-12T17:56:15.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.8 2024-09-12T17:56:15.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.9 2024-09-12T17:56:15.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.9 2024-09-12T17:56:15.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.10 2024-09-12T17:56:15.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.10 2024-09-12T17:56:15.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.11 2024-09-12T17:56:15.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1.11 2024-09-12T17:56:15.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.0 2024-09-12T17:56:15.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1 2024-09-12T17:56:15.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.285+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.2 2024-09-12T17:56:15.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.289+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.3 2024-09-12T17:56:15.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.289+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.4 2024-09-12T17:56:15.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.289+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.5 2024-09-12T17:56:15.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.293+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.6 2024-09-12T17:56:15.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.293+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.7 2024-09-12T17:56:15.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.293+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.8 2024-09-12T17:56:15.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.293+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.9 2024-09-12T17:56:15.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.293+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.10 2024-09-12T17:56:15.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.301+0000 7f2f1fd399c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:15.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.301+0000 7f2f1fd399c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 2024-09-12T17:56:15.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.305+0000 7f2f1fd399c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 info.flags=0x17 2024-09-12T17:56:15.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.305+0000 7f2f1fd399c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 to cache LRU end 2024-09-12T17:56:15.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.305+0000 7f2f1fd399c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:15.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.305+0000 7f2f1fd399c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23, ofs0, ns] 2024-09-12T17:56:15.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.305+0000 7f2e017fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366186 cookie 94807668510976 notifier 6191 bl.length()=925 2024-09-12T17:56:15.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.305+0000 7f2e017fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 info.flags=0x17 2024-09-12T17:56:15.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.305+0000 7f2e017fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 to cache LRU end 2024-09-12T17:56:15.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.305+0000 7f2e017fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:15.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.309+0000 7f2f1fd399c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.23]): orig_sources= new_sources= 2024-09-12T17:56:15.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.309+0000 7f2f1fd399c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.23]): potential sources added=[] removed=[] 2024-09-12T17:56:15.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.309+0000 7f2f1fd399c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.23]): orig_dests= new_dests= 2024-09-12T17:56:15.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.309+0000 7f2f1fd399c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.23]): potential dests added=[] removed=[] 2024-09-12T17:56:15.316 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.313+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.0 2024-09-12T17:56:15.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.313+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.1 2024-09-12T17:56:15.318 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.317+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.2 2024-09-12T17:56:15.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.317+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.3 2024-09-12T17:56:15.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.317+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.4 2024-09-12T17:56:15.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.317+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.5 2024-09-12T17:56:15.322 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.321+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.6 2024-09-12T17:56:15.322 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.321+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.7 2024-09-12T17:56:15.323 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.321+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.8 2024-09-12T17:56:15.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.321+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.9 2024-09-12T17:56:15.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.321+0000 7f2f1fd399c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.23.10 2024-09-12T17:56:15.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.325+0000 7f2f1fd399c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:15.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.325+0000 7f2f1fd399c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 2024-09-12T17:56:15.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.325+0000 7f2f1fd399c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 info.flags=0x17 2024-09-12T17:56:15.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.325+0000 7f2f1fd399c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 to cache LRU end 2024-09-12T17:56:15.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.325+0000 7f2f1fd399c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:15.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.325+0000 7f2f1fd399c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23, ofs0, ns] 2024-09-12T17:56:15.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.329+0000 7f2e00ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366187 cookie 94807668510976 notifier 6191 bl.length()=893 2024-09-12T17:56:15.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.329+0000 7f2e00ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 info.flags=0x17 2024-09-12T17:56:15.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.329+0000 7f2e00ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 to cache LRU end 2024-09-12T17:56:15.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.329+0000 7f2e00ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:15.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.329+0000 7f2f1fd399c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.23]): orig_sources= new_sources= 2024-09-12T17:56:15.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.329+0000 7f2f1fd399c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.23]): potential sources added=[] removed=[] 2024-09-12T17:56:15.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.329+0000 7f2f1fd399c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.23]): orig_dests= new_dests= 2024-09-12T17:56:15.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.329+0000 7f2f1fd399c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.23]): potential dests added=[] removed=[] 2024-09-12T17:56:15.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.337+0000 7f2f1fd399c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:56:15.341 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.337+0000 7f2dcf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:15.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.345+0000 7f2f1fd399c0 20 remove_watcher() i=0 2024-09-12T17:56:15.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.345+0000 7f2f1fd399c0 2 removed watcher, disabling cache 2024-09-12T17:56:15.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.345+0000 7f2f1fd399c0 20 remove_watcher() i=1 2024-09-12T17:56:15.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.349+0000 7f2f1fd399c0 20 remove_watcher() i=2 2024-09-12T17:56:15.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.349+0000 7f2f1fd399c0 20 remove_watcher() i=3 2024-09-12T17:56:15.355 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.353+0000 7f2f1fd399c0 20 remove_watcher() i=4 2024-09-12T17:56:15.356 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.353+0000 7f2f1fd399c0 20 remove_watcher() i=5 2024-09-12T17:56:15.358 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.357+0000 7f2f1fd399c0 20 remove_watcher() i=6 2024-09-12T17:56:15.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.357+0000 7f2f1fd399c0 20 remove_watcher() i=7 2024-09-12T17:56:15.376 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T17:56:15.407 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:15.407 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:15.451 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.449+0000 7f77ad6d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.449+0000 7f77ad6d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.449+0000 7f77ad6d09c0 20 realm 2024-09-12T17:56:15.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.449+0000 7f77ad6d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.449+0000 7f77ad6d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.449+0000 7f77ad6d09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:15.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.449+0000 7f77ad6d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.449+0000 7f77ad6d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.449+0000 7f77ad6d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.453+0000 7f77ad6d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:15.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.453+0000 7f77ad6d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.453+0000 7f77ad6d09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:15.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.453+0000 7f77ad6d09c0 20 searching for the correct realm 2024-09-12T17:56:15.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.457+0000 7f77ab9d7640 0 -- 172.21.15.98:0/1790094241 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x562bcf0b3b40 msgr2=0x562bcf0b6000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:15.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.465+0000 7f77aa9d5640 0 -- 172.21.15.98:0/1790094241 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f779c0c0070 msgr2=0x7f779c0fa430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:15.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:15.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:15.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:15.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:15.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:15.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:15.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:15.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:15.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 zone default found 2024-09-12T17:56:15.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 4 Realm: () 2024-09-12T17:56:15.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:15.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:15.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:15.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 zonegroup default 2024-09-12T17:56:15.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:15.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 started sync module instance, tier type = 2024-09-12T17:56:15.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.473+0000 7f77ad6d09c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:15.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.489+0000 7f77ad6d09c0 20 add_watcher() i=0 2024-09-12T17:56:15.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.489+0000 7f77ad6d09c0 20 add_watcher() i=1 2024-09-12T17:56:15.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.489+0000 7f77ad6d09c0 20 add_watcher() i=2 2024-09-12T17:56:15.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.489+0000 7f77ad6d09c0 20 add_watcher() i=3 2024-09-12T17:56:15.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.489+0000 7f77ad6d09c0 20 add_watcher() i=4 2024-09-12T17:56:15.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.489+0000 7f77ad6d09c0 20 add_watcher() i=5 2024-09-12T17:56:15.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.489+0000 7f77ad6d09c0 20 add_watcher() i=6 2024-09-12T17:56:15.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.493+0000 7f77ad6d09c0 20 add_watcher() i=7 2024-09-12T17:56:15.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.493+0000 7f77ad6d09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:15.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.493+0000 7f7661fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:15.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.493+0000 7f77ad6d09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:15.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.493+0000 7f77ad6d09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:15.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.493+0000 7f77ad6d09c0 5 note: GC not initialized 2024-09-12T17:56:15.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.493+0000 7f7660fe1640 20 reqs_thread_entry: start 2024-09-12T17:56:15.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.493+0000 7f77ad6d09c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:15.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.493+0000 7f77ad6d09c0 20 Filter name: none 2024-09-12T17:56:15.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.493+0000 7f75da7fc640 20 reqs_thread_entry: start 2024-09-12T17:56:15.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.497+0000 7f77ad6d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.497+0000 7f77ad6d09c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:15.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.497+0000 7f77ad6d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.497+0000 7f77ad6d09c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:15.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.497+0000 7f77ad6d09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:15.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.497+0000 7f77ad6d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.497+0000 7f77ad6d09c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:15.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.497+0000 7f77ad6d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:15.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.497+0000 7f77ad6d09c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:15.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.497+0000 7f77ad6d09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:15.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.501+0000 7f7661fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:15.507 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.505+0000 7f77ad6d09c0 20 remove_watcher() i=0 2024-09-12T17:56:15.507 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.505+0000 7f77ad6d09c0 2 removed watcher, disabling cache 2024-09-12T17:56:15.509 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.505+0000 7f77ad6d09c0 20 remove_watcher() i=1 2024-09-12T17:56:15.511 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.509+0000 7f77ad6d09c0 20 remove_watcher() i=2 2024-09-12T17:56:15.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.509+0000 7f77ad6d09c0 20 remove_watcher() i=3 2024-09-12T17:56:15.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.513+0000 7f77ad6d09c0 20 remove_watcher() i=4 2024-09-12T17:56:15.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.513+0000 7f77ad6d09c0 20 remove_watcher() i=5 2024-09-12T17:56:15.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.513+0000 7f77ad6d09c0 20 remove_watcher() i=6 2024-09-12T17:56:15.518 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:15.517+0000 7f77ad6d09c0 20 remove_watcher() i=7 2024-09-12T17:56:15.532 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:15.532 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:56:15.532 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-set-target-layout id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.23 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:56:15.532 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:15.533 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:15.533 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:15.552 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:15.552 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:16.100 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:16.100 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:16.477 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T17:56:16.477 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:16.480 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:16.480 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:16.612 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:16.612 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:16.702 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:16.703 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:16.813 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:16.813 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:16.920 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:16.920 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:17.017 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:17.018 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:17.116 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:17.116 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:17.216 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:17.216 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:17.317 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:17.317 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:17.436 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:17.436 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:17.531 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:17.532 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:17.626 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:17.627 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:17.723 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:17.723 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:17.812 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:17.812 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:17.903 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:17.903 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:18.005 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:18.006 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:18.101 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:18.101 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:18.192 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:18.192 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:18.292 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:18.292 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:18.387 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:18.387 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:18.483 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:18.483 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:18.578 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:18.579 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:18.676 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:56:18.708 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:18.708 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:18.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.753+0000 7f39b31249c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.753+0000 7f39b31249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:18.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.753+0000 7f39b31249c0 20 realm 2024-09-12T17:56:18.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.753+0000 7f39b31249c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.753+0000 7f39b31249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:18.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.753+0000 7f39b31249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:18.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.753+0000 7f39b31249c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.753+0000 7f39b31249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:18.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.753+0000 7f39b31249c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.757+0000 7f39b31249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:18.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.757+0000 7f39b31249c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.757+0000 7f39b31249c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:18.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.757+0000 7f39b31249c0 20 searching for the correct realm 2024-09-12T17:56:18.765 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.761+0000 7f39b142b640 0 -- 172.21.15.98:0/711914296 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55c55732e4d0 msgr2=0x55c5573308e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:18.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.769+0000 7f39b0429640 0 -- 172.21.15.98:0/711914296 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f39a8069b50 msgr2=0x7f39a803b710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:18.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:18.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:18.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:18.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:18.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:18.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:18.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:18.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:18.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:18.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 20 zone default found 2024-09-12T17:56:18.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 4 Realm: () 2024-09-12T17:56:18.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:18.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:18.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:18.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 20 zonegroup default 2024-09-12T17:56:18.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:18.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.777+0000 7f39b31249c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.781+0000 7f39b31249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:18.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.781+0000 7f39b31249c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.781+0000 7f39b31249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:18.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.781+0000 7f39b31249c0 20 started sync module instance, tier type = 2024-09-12T17:56:18.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.781+0000 7f39b31249c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:18.799 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.797+0000 7f39b31249c0 20 add_watcher() i=0 2024-09-12T17:56:18.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.797+0000 7f39b31249c0 20 add_watcher() i=1 2024-09-12T17:56:18.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.797+0000 7f39b31249c0 20 add_watcher() i=2 2024-09-12T17:56:18.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.797+0000 7f39b31249c0 20 add_watcher() i=3 2024-09-12T17:56:18.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.797+0000 7f39b31249c0 20 add_watcher() i=4 2024-09-12T17:56:18.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.797+0000 7f39b31249c0 20 add_watcher() i=5 2024-09-12T17:56:18.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.797+0000 7f39b31249c0 20 add_watcher() i=6 2024-09-12T17:56:18.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.797+0000 7f39b31249c0 20 add_watcher() i=7 2024-09-12T17:56:18.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.797+0000 7f39b31249c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:18.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.801+0000 7f3866fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:18.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.801+0000 7f39b31249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:18.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.801+0000 7f39b31249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:18.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.801+0000 7f39b31249c0 5 note: GC not initialized 2024-09-12T17:56:18.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.801+0000 7f3865fe3640 20 reqs_thread_entry: start 2024-09-12T17:56:18.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.801+0000 7f39b31249c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:18.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.801+0000 7f39b31249c0 20 Filter name: none 2024-09-12T17:56:18.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.801+0000 7f37d77fe640 20 reqs_thread_entry: start 2024-09-12T17:56:18.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.801+0000 7f39b31249c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.801+0000 7f39b31249c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:18.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.801+0000 7f39b31249c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.805+0000 7f39b31249c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:18.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.805+0000 7f39b31249c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:18.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.805+0000 7f39b31249c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.805+0000 7f39b31249c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:18.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.805+0000 7f39b31249c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.805+0000 7f39b31249c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:18.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.805+0000 7f39b31249c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:18.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.809+0000 7f3866fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:18.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.813+0000 7f39b31249c0 20 remove_watcher() i=0 2024-09-12T17:56:18.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.813+0000 7f39b31249c0 2 removed watcher, disabling cache 2024-09-12T17:56:18.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.813+0000 7f39b31249c0 20 remove_watcher() i=1 2024-09-12T17:56:18.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.817+0000 7f39b31249c0 20 remove_watcher() i=2 2024-09-12T17:56:18.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.817+0000 7f39b31249c0 20 remove_watcher() i=3 2024-09-12T17:56:18.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.821+0000 7f39b31249c0 20 remove_watcher() i=4 2024-09-12T17:56:18.824 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.821+0000 7f39b31249c0 20 remove_watcher() i=5 2024-09-12T17:56:18.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.821+0000 7f39b31249c0 20 remove_watcher() i=6 2024-09-12T17:56:18.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.825+0000 7f39b31249c0 20 remove_watcher() i=7 2024-09-12T17:56:18.839 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:18.839 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:56:18.839 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-set-target-layout id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:56:18.839 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:18.840 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T17:56:18.871 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:18.872 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:18.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:18.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.913+0000 7f67d78989c0 20 realm 2024-09-12T17:56:18.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:18.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.913+0000 7f67d78989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:18.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:18.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.917+0000 7f67d78989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:18.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.917+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.917+0000 7f67d78989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:18.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.917+0000 7f67d78989c0 20 searching for the correct realm 2024-09-12T17:56:18.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.921+0000 7f67d4b9d640 0 -- 172.21.15.98:0/1125680 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55f5a47d50c0 msgr2=0x55f5a47d7560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:18.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.929+0000 7f67d4b9d640 0 -- 172.21.15.98:0/1125680 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f67c80e0020 msgr2=0x7f67c80f4440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:18.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.933+0000 7f67d78989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:18.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.933+0000 7f67d78989c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:18.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.933+0000 7f67d78989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:18.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.933+0000 7f67d78989c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:18.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.933+0000 7f67d78989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:18.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.933+0000 7f67d78989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:18.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.933+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.933+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:18.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:18.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:18.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.937+0000 7f67d78989c0 20 zone default found 2024-09-12T17:56:18.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.937+0000 7f67d78989c0 4 Realm: () 2024-09-12T17:56:18.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.937+0000 7f67d78989c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:18.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.937+0000 7f67d78989c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:18.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.937+0000 7f67d78989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:18.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.937+0000 7f67d78989c0 20 zonegroup default 2024-09-12T17:56:18.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:18.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:18.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:18.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.937+0000 7f67d78989c0 20 started sync module instance, tier type = 2024-09-12T17:56:18.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.937+0000 7f67d78989c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:18.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=0 2024-09-12T17:56:18.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=1 2024-09-12T17:56:18.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=2 2024-09-12T17:56:18.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=3 2024-09-12T17:56:18.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=4 2024-09-12T17:56:18.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=5 2024-09-12T17:56:18.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=6 2024-09-12T17:56:18.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=7 2024-09-12T17:56:18.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.957+0000 7f67d78989c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:18.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.961+0000 7f668b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:18.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.961+0000 7f67d78989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:18.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.961+0000 7f67d78989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:18.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.961+0000 7f67d78989c0 5 note: GC not initialized 2024-09-12T17:56:18.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.961+0000 7f668a7e4640 20 reqs_thread_entry: start 2024-09-12T17:56:18.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.961+0000 7f67d78989c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:18.967 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.961+0000 7f67d78989c0 20 Filter name: none 2024-09-12T17:56:18.967 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.961+0000 7f65fbfff640 20 reqs_thread_entry: start 2024-09-12T17:56:18.967 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.961+0000 7f67d78989c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:56:18.967 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.961+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.965+0000 7f67d78989c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:18.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.965+0000 7f67d78989c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:56:18.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.965+0000 7f67d78989c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:56:18.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.965+0000 7f67d78989c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 : miss 2024-09-12T17:56:18.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.965+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:18.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.965+0000 7f67d78989c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:18.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.965+0000 7f67d78989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 info.flags=0x17 2024-09-12T17:56:18.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.965+0000 7f67d78989c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 to cache LRU end 2024-09-12T17:56:18.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.965+0000 7f67d78989c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:18.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.965+0000 7f67d78989c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:18.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.965+0000 7f67d78989c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 2024-09-12T17:56:18.975 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f67d78989c0 time 2024-09-12T17:56:18.977813+0000 2024-09-12T17:56:18.976 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:56:18.976 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:18.977 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f67db1722eb] 2024-09-12T17:56:18.977 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f67db17249f] 2024-09-12T17:56:18.977 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f5a29e50c1] 2024-09-12T17:56:18.977 INFO:tasks.workunit.client.0.smithi098.stderr: 4: radosgw-admin(+0x140f6b8) [0x55f5a343a6b8] 2024-09-12T17:56:18.977 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f5a29f718d] 2024-09-12T17:56:18.977 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T17:56:18.977 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f67d9fd8d90] 2024-09-12T17:56:18.977 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T17:56:18.977 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T17:56:18.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.973+0000 7f67d78989c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f67d78989c0 time 2024-09-12T17:56:18.977813+0000 2024-09-12T17:56:18.978 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:56:18.978 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:18.978 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:18.978 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f67db1722eb] 2024-09-12T17:56:18.978 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f67db17249f] 2024-09-12T17:56:18.978 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f5a29e50c1] 2024-09-12T17:56:18.978 INFO:tasks.workunit.client.0.smithi098.stderr: 4: radosgw-admin(+0x140f6b8) [0x55f5a343a6b8] 2024-09-12T17:56:18.978 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f5a29f718d] 2024-09-12T17:56:18.978 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T17:56:18.978 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f67d9fd8d90] 2024-09-12T17:56:18.978 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T17:56:18.978 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T17:56:18.978 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:18.979 INFO:tasks.workunit.client.0.smithi098.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:56:18.979 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f67d78989c0 thread_name:radosgw-admin 2024-09-12T17:56:19.001 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:19.001 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f67d9ff1520] 2024-09-12T17:56:19.001 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:56:19.002 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:56:19.002 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:56:19.002 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f67db172345] 2024-09-12T17:56:19.002 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f67db17249f] 2024-09-12T17:56:19.002 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f5a29e50c1] 2024-09-12T17:56:19.002 INFO:tasks.workunit.client.0.smithi098.stderr: 8: radosgw-admin(+0x140f6b8) [0x55f5a343a6b8] 2024-09-12T17:56:19.002 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f5a29f718d] 2024-09-12T17:56:19.002 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T17:56:19.002 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f67d9fd8d90] 2024-09-12T17:56:19.002 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T17:56:19.002 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T17:56:19.002 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:18.973+0000 7f67d78989c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:56:19.002 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f67d78989c0 thread_name:radosgw-admin 2024-09-12T17:56:19.003 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.003 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:19.003 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f67d9ff1520] 2024-09-12T17:56:19.003 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:56:19.003 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:56:19.003 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:56:19.003 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f67db172345] 2024-09-12T17:56:19.003 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f67db17249f] 2024-09-12T17:56:19.003 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f5a29e50c1] 2024-09-12T17:56:19.003 INFO:tasks.workunit.client.0.smithi098.stderr: 8: radosgw-admin(+0x140f6b8) [0x55f5a343a6b8] 2024-09-12T17:56:19.003 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f5a29f718d] 2024-09-12T17:56:19.003 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T17:56:19.004 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f67d9fd8d90] 2024-09-12T17:56:19.004 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T17:56:19.004 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T17:56:19.004 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:56:19.004 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.004 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T17:56:19.004 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T17:56:18.889+0000 7f67d539e640 10 monclient(hunting): get_auth_request con 0x55f5a45abaa0 auth_method 0 2024-09-12T17:56:19.004 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T17:56:18.889+0000 7f67d539e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.004 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T17:56:18.889+0000 7f67d539e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.004 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T17:56:18.889+0000 7f67d539e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.004 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T17:56:18.889+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:19.004 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T17:56:18.889+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:19.004 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T17:56:18.889+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:19.005 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T17:56:18.889+0000 7f67d539e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:19.005 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T17:56:18.889+0000 7f67d539e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:19.005 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T17:56:18.889+0000 7f67d539e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:19.005 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T17:56:18.889+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_done global_id 6690 payload 274 2024-09-12T17:56:19.005 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T17:56:18.889+0000 7f67d4b9d640 10 monclient: _finish_hunting 0 2024-09-12T17:56:19.005 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T17:56:18.889+0000 7f67d4b9d640 1 monclient: found mon.noname-a 2024-09-12T17:56:19.005 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T17:56:18.889+0000 7f67d4b9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:56:19.005 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T17:56:18.889+0000 7f66c3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:19.005 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T17:56:18.889+0000 7f66c3606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:56:19.005 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T17:56:18.889+0000 7f66c3606640 10 monclient: dump: 2024-09-12T17:56:19.005 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:56:19.005 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:56:19.005 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.005 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.006 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:19.006 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.006 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:56:19.006 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:56:19.006 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:56:19.006 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.006 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T17:56:18.889+0000 7f66c3606640 10 monclient: _finish_auth 0 2024-09-12T17:56:19.006 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T17:56:18.889+0000 7f66c3606640 10 monclient: _check_auth_tickets 2024-09-12T17:56:19.006 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T17:56:18.889+0000 7f66c3606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:19.006 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 monclient: authenticate success, global_id 6690 2024-09-12T17:56:19.006 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T17:56:18.889+0000 7f67d78989c0 10 monclient: get_monmap_and_config success 2024-09-12T17:56:19.006 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T17:56:18.889+0000 7f67d78989c0 4 set_mon_vals no callback set 2024-09-12T17:56:19.006 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T17:56:18.889+0000 7f66c3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:19.006 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T17:56:18.889+0000 7f66c3606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:56:19.007 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T17:56:18.889+0000 7f66c3606640 10 monclient: dump: 2024-09-12T17:56:19.007 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:56:19.007 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:56:19.007 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.007 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.007 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:19.007 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.007 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:56:19.007 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:56:19.007 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:56:19.007 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.007 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T17:56:18.889+0000 7f67d78989c0 10 monclient: shutdown 2024-09-12T17:56:19.007 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) unregister_commands rotate-key 2024-09-12T17:56:19.007 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T17:56:18.889+0000 7f67d78989c0 10 monclient: build_initial_monmap 2024-09-12T17:56:19.008 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T17:56:18.889+0000 7f67d78989c0 1 build_initial for_mkfs: 0 2024-09-12T17:56:19.008 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T17:56:18.889+0000 7f67d78989c0 10 monclient: monmap: 2024-09-12T17:56:19.008 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:56:19.008 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:19.008 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:56:19.008 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:56:19.008 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:19.008 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.008 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:56:19.008 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:56:19.008 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:56:19.008 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.008 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding auth protocol: cephx 2024-09-12T17:56:19.008 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding auth protocol: cephx 2024-09-12T17:56:19.009 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding auth protocol: cephx 2024-09-12T17:56:19.009 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: secure 2024-09-12T17:56:19.009 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: crc 2024-09-12T17:56:19.009 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: secure 2024-09-12T17:56:19.009 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: crc 2024-09-12T17:56:19.009 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: secure 2024-09-12T17:56:19.009 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: crc 2024-09-12T17:56:19.009 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: crc 2024-09-12T17:56:19.009 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: secure 2024-09-12T17:56:19.009 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: crc 2024-09-12T17:56:19.009 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: secure 2024-09-12T17:56:19.009 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: crc 2024-09-12T17:56:19.009 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: secure 2024-09-12T17:56:19.010 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T17:56:18.893+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.010 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T17:56:18.893+0000 7f67d78989c0 1 librados: starting msgr at 2024-09-12T17:56:19.010 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T17:56:18.893+0000 7f67d78989c0 1 librados: starting objecter 2024-09-12T17:56:19.010 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command objecter_requests hook 0x55f5a46f2060 2024-09-12T17:56:19.010 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T17:56:18.893+0000 7f67d78989c0 1 librados: setting wanted keys 2024-09-12T17:56:19.010 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T17:56:18.893+0000 7f67d78989c0 1 librados: calling monclient init 2024-09-12T17:56:19.010 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient: init 2024-09-12T17:56:19.010 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding auth protocol: cephx 2024-09-12T17:56:19.010 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding auth protocol: cephx 2024-09-12T17:56:19.010 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding auth protocol: cephx 2024-09-12T17:56:19.010 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: secure 2024-09-12T17:56:19.010 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: crc 2024-09-12T17:56:19.010 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: secure 2024-09-12T17:56:19.010 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: crc 2024-09-12T17:56:19.011 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: secure 2024-09-12T17:56:19.011 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: crc 2024-09-12T17:56:19.011 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: crc 2024-09-12T17:56:19.011 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: secure 2024-09-12T17:56:19.011 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: crc 2024-09-12T17:56:19.011 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: secure 2024-09-12T17:56:19.011 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: crc 2024-09-12T17:56:19.011 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: secure 2024-09-12T17:56:19.011 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T17:56:18.893+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.011 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T17:56:18.893+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.011 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command rotate-key hook 0x55f5a46ebd08 2024-09-12T17:56:19.011 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient: _reopen_session rank -1 2024-09-12T17:56:19.011 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:56:19.011 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-b con 0x55f5a45abaa0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:56:19.012 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-a con 0x55f5a4631880 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:56:19.012 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-c con 0x55f5a4634bf0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:56:19.012 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.012 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.012 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.012 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient(hunting): _renew_subs 2024-09-12T17:56:19.012 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient(hunting): authenticate will time out at 2575.465045s 2024-09-12T17:56:19.012 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 10 monclient(hunting): get_auth_request con 0x55f5a4634bf0 auth_method 0 2024-09-12T17:56:19.012 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.012 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.012 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.012 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T17:56:18.893+0000 7f67d4b9d640 10 monclient(hunting): get_auth_request con 0x55f5a4631880 auth_method 0 2024-09-12T17:56:19.012 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T17:56:18.893+0000 7f67d4b9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.012 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T17:56:18.893+0000 7f67d4b9d640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.013 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T17:56:18.893+0000 7f67d4b9d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.013 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:19.013 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:19.013 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:19.013 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T17:56:18.893+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:19.013 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T17:56:18.893+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:19.013 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T17:56:18.893+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:19.013 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_done global_id 6230 payload 824 2024-09-12T17:56:19.013 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 10 monclient: _finish_hunting 0 2024-09-12T17:56:19.013 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 1 monclient: found mon.noname-c 2024-09-12T17:56:19.013 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:56:19.013 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T17:56:18.893+0000 7f67d539e640 10 monclient: get_auth_request con 0x55f5a45abaa0 auth_method 0 2024-09-12T17:56:19.013 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T17:56:18.893+0000 7f66c1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:19.013 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T17:56:18.893+0000 7f66c1e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:56:19.014 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T17:56:18.893+0000 7f66c1e03640 10 monclient: dump: 2024-09-12T17:56:19.014 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:56:19.014 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:56:19.014 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.014 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.014 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:19.014 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.014 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:56:19.014 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:56:19.014 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:56:19.014 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.014 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T17:56:18.893+0000 7f66c1e03640 10 monclient: _finish_auth 0 2024-09-12T17:56:19.014 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T17:56:18.893+0000 7f66c1e03640 10 monclient: _check_auth_tickets 2024-09-12T17:56:19.014 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T17:56:18.893+0000 7f66c1e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:19.015 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T17:56:18.893+0000 7f66c1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:19.015 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T17:56:18.893+0000 7f66c1e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:56:19.015 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T17:56:18.893+0000 7f66c1e03640 10 monclient: dump: 2024-09-12T17:56:19.015 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:56:19.015 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:56:19.015 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.015 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.015 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:19.015 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.015 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:56:19.015 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:56:19.015 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:56:19.015 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.015 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 monclient: authenticate success, global_id 6230 2024-09-12T17:56:19.016 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T17:56:18.893+0000 7f66c3606640 4 set_mon_vals no callback set 2024-09-12T17:56:19.016 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient: _renew_subs 2024-09-12T17:56:19.016 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:56:19.016 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient: _renew_subs 2024-09-12T17:56:19.016 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:56:19.016 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T17:56:18.893+0000 7f67d78989c0 1 librados: init done 2024-09-12T17:56:19.016 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T17:56:18.893+0000 7f66c1e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:56:19.016 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T17:56:18.893+0000 7f66c1e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:56:19.016 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T17:56:18.893+0000 7f66c1e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:56:19.016 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T17:56:18.897+0000 7f67d539e640 10 monclient: get_auth_request con 0x7f66bc070b10 auth_method 0 2024-09-12T17:56:19.016 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T17:56:18.897+0000 7f67d4b9d640 10 monclient: get_auth_request con 0x55f5a4713980 auth_method 0 2024-09-12T17:56:19.016 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T17:56:18.897+0000 7f67d539e640 10 monclient: get_auth_request con 0x55f5a47369a0 auth_method 0 2024-09-12T17:56:19.016 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient: get_auth_request con 0x55f5a473a250 auth_method 0 2024-09-12T17:56:19.017 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient: build_initial_monmap 2024-09-12T17:56:19.017 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T17:56:18.901+0000 7f67d78989c0 1 build_initial for_mkfs: 0 2024-09-12T17:56:19.017 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient: monmap: 2024-09-12T17:56:19.017 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:56:19.017 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:19.017 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:56:19.017 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:56:19.017 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:19.017 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.017 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:56:19.017 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:56:19.017 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:56:19.017 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.017 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding auth protocol: cephx 2024-09-12T17:56:19.017 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding auth protocol: cephx 2024-09-12T17:56:19.018 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding auth protocol: cephx 2024-09-12T17:56:19.018 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: secure 2024-09-12T17:56:19.018 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: crc 2024-09-12T17:56:19.018 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: secure 2024-09-12T17:56:19.018 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: crc 2024-09-12T17:56:19.018 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: secure 2024-09-12T17:56:19.018 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: crc 2024-09-12T17:56:19.018 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: crc 2024-09-12T17:56:19.018 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: secure 2024-09-12T17:56:19.018 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: crc 2024-09-12T17:56:19.018 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: secure 2024-09-12T17:56:19.018 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: crc 2024-09-12T17:56:19.018 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: secure 2024-09-12T17:56:19.018 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T17:56:18.901+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.019 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f5a47435f0 EEXIST 2024-09-12T17:56:19.019 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient: init 2024-09-12T17:56:19.019 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding auth protocol: cephx 2024-09-12T17:56:19.019 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding auth protocol: cephx 2024-09-12T17:56:19.019 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding auth protocol: cephx 2024-09-12T17:56:19.019 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: secure 2024-09-12T17:56:19.019 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: crc 2024-09-12T17:56:19.019 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: secure 2024-09-12T17:56:19.019 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: crc 2024-09-12T17:56:19.019 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: secure 2024-09-12T17:56:19.019 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: crc 2024-09-12T17:56:19.019 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: crc 2024-09-12T17:56:19.019 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: secure 2024-09-12T17:56:19.019 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: crc 2024-09-12T17:56:19.020 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: secure 2024-09-12T17:56:19.020 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: crc 2024-09-12T17:56:19.020 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: secure 2024-09-12T17:56:19.020 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T17:56:18.901+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.020 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T17:56:18.901+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.020 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command rotate-key cmddesc rotate-key hook 0x55f5a473ed60 EEXIST 2024-09-12T17:56:19.020 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient: _reopen_session rank -1 2024-09-12T17:56:19.020 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:56:19.020 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-b con 0x55f5a47677a0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:56:19.020 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-c con 0x55f5a47670d0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:56:19.020 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-a con 0x55f5a4765ab0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:56:19.020 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.020 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.020 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.021 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient(hunting): _renew_subs 2024-09-12T17:56:19.021 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient(hunting): authenticate will time out at 2575.475370s 2024-09-12T17:56:19.021 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient(hunting): get_auth_request con 0x55f5a47670d0 auth_method 0 2024-09-12T17:56:19.021 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.021 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.021 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.021 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T17:56:18.901+0000 7f67d5b9f640 10 monclient(hunting): get_auth_request con 0x55f5a4765ab0 auth_method 0 2024-09-12T17:56:19.021 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T17:56:18.901+0000 7f67d5b9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.021 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T17:56:18.901+0000 7f67d5b9f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.021 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T17:56:18.901+0000 7f67d5b9f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.021 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:19.021 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:19.021 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:19.022 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T17:56:18.901+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:19.022 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T17:56:18.901+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:19.022 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T17:56:18.901+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:19.022 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T17:56:18.901+0000 7f67d539e640 10 monclient(hunting): get_auth_request con 0x55f5a47677a0 auth_method 0 2024-09-12T17:56:19.022 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T17:56:18.901+0000 7f67d539e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.022 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T17:56:18.901+0000 7f67d539e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.022 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T17:56:18.901+0000 7f67d539e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.022 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_done global_id 6233 payload 824 2024-09-12T17:56:19.022 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient: _finish_hunting 0 2024-09-12T17:56:19.022 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 1 monclient: found mon.noname-c 2024-09-12T17:56:19.022 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:56:19.022 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T17:56:18.905+0000 7f66baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:19.022 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T17:56:18.905+0000 7f66baffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:56:19.022 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T17:56:18.905+0000 7f66baffd640 10 monclient: dump: 2024-09-12T17:56:19.023 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:56:19.023 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:56:19.023 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.023 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.023 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:19.023 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.023 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:56:19.023 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:56:19.023 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:56:19.023 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.023 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T17:56:18.905+0000 7f66baffd640 10 monclient: _finish_auth 0 2024-09-12T17:56:19.023 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T17:56:18.905+0000 7f66baffd640 10 monclient: _check_auth_tickets 2024-09-12T17:56:19.023 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T17:56:18.905+0000 7f66baffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:19.024 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T17:56:18.905+0000 7f66baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:19.024 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T17:56:18.905+0000 7f66baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:56:19.024 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T17:56:18.905+0000 7f66baffd640 10 monclient: dump: 2024-09-12T17:56:19.024 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:56:19.024 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:56:19.024 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.024 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.024 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:19.024 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.024 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:56:19.024 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:56:19.024 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:56:19.024 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.024 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 monclient: authenticate success, global_id 6233 2024-09-12T17:56:19.025 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient: _renew_subs 2024-09-12T17:56:19.025 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T17:56:18.905+0000 7f67d63a0640 4 set_mon_vals no callback set 2024-09-12T17:56:19.025 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:56:19.025 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient: _renew_subs 2024-09-12T17:56:19.025 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:56:19.025 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T17:56:18.905+0000 7f66baffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:56:19.025 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T17:56:18.905+0000 7f66baffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:56:19.025 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T17:56:18.905+0000 7f66baffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:56:19.025 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient: get_monmap_and_config 2024-09-12T17:56:19.025 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient: build_initial_monmap 2024-09-12T17:56:19.025 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T17:56:18.905+0000 7f67d78989c0 1 build_initial for_mkfs: 0 2024-09-12T17:56:19.025 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient: monmap: 2024-09-12T17:56:19.025 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:56:19.026 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:19.026 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:56:19.026 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:56:19.026 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:19.026 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.026 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:56:19.026 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:56:19.026 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:56:19.026 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.026 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding auth protocol: cephx 2024-09-12T17:56:19.026 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding auth protocol: cephx 2024-09-12T17:56:19.026 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding auth protocol: cephx 2024-09-12T17:56:19.026 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: secure 2024-09-12T17:56:19.026 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: crc 2024-09-12T17:56:19.026 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: secure 2024-09-12T17:56:19.027 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: crc 2024-09-12T17:56:19.027 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: secure 2024-09-12T17:56:19.027 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: crc 2024-09-12T17:56:19.027 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: crc 2024-09-12T17:56:19.027 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: secure 2024-09-12T17:56:19.027 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: crc 2024-09-12T17:56:19.027 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: secure 2024-09-12T17:56:19.027 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: crc 2024-09-12T17:56:19.027 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: secure 2024-09-12T17:56:19.027 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient: get_auth_request con 0x7f66b0070a20 auth_method 0 2024-09-12T17:56:19.027 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T17:56:18.905+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.027 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient: init 2024-09-12T17:56:19.027 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding auth protocol: cephx 2024-09-12T17:56:19.027 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding auth protocol: cephx 2024-09-12T17:56:19.028 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding auth protocol: cephx 2024-09-12T17:56:19.028 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: secure 2024-09-12T17:56:19.028 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: crc 2024-09-12T17:56:19.028 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: secure 2024-09-12T17:56:19.028 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: crc 2024-09-12T17:56:19.028 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: secure 2024-09-12T17:56:19.028 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: crc 2024-09-12T17:56:19.028 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: crc 2024-09-12T17:56:19.028 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: secure 2024-09-12T17:56:19.028 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: crc 2024-09-12T17:56:19.028 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: secure 2024-09-12T17:56:19.028 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: crc 2024-09-12T17:56:19.028 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: secure 2024-09-12T17:56:19.028 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T17:56:18.905+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.029 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T17:56:18.905+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.029 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command rotate-key cmddesc rotate-key hook 0x7ffeebd3e928 EEXIST 2024-09-12T17:56:19.029 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient: _reopen_session rank -1 2024-09-12T17:56:19.029 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:56:19.029 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-a con 0x55f5a47bb5f0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:56:19.029 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-b con 0x55f5a478c6d0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:56:19.029 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-c con 0x55f5a47b6f00 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:56:19.029 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.029 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.029 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.029 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient(hunting): _renew_subs 2024-09-12T17:56:19.029 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient(hunting): authenticate will time out at 2575.479408s 2024-09-12T17:56:19.029 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient(hunting): get_auth_request con 0x55f5a47bb5f0 auth_method 0 2024-09-12T17:56:19.030 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.030 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.030 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.030 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T17:56:18.905+0000 7f67d5b9f640 10 monclient(hunting): get_auth_request con 0x55f5a47b6f00 auth_method 0 2024-09-12T17:56:19.030 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T17:56:18.905+0000 7f67d5b9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.030 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T17:56:18.905+0000 7f67d5b9f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.030 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T17:56:18.905+0000 7f67d5b9f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.030 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:19.030 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:19.030 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:19.030 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T17:56:18.905+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:19.030 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T17:56:18.905+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:19.030 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T17:56:18.905+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:19.030 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T17:56:18.905+0000 7f67d4b9d640 10 monclient(hunting): get_auth_request con 0x55f5a478c6d0 auth_method 0 2024-09-12T17:56:19.031 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T17:56:18.905+0000 7f67d4b9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.031 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T17:56:18.905+0000 7f67d4b9d640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.031 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T17:56:18.905+0000 7f67d4b9d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.031 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient(hunting): handle_auth_done global_id 6699 payload 274 2024-09-12T17:56:19.031 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient: _finish_hunting 0 2024-09-12T17:56:19.031 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T17:56:18.905+0000 7f67d539e640 1 monclient: found mon.noname-a 2024-09-12T17:56:19.031 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:56:19.031 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T17:56:18.909+0000 7f66b8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:19.031 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T17:56:18.909+0000 7f66b8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:56:19.032 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T17:56:18.909+0000 7f66b8ff9640 10 monclient: dump: 2024-09-12T17:56:19.032 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:56:19.032 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:56:19.032 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.032 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.032 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:19.032 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.032 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:56:19.032 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:56:19.032 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:56:19.032 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.032 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T17:56:18.909+0000 7f66b8ff9640 10 monclient: _finish_auth 0 2024-09-12T17:56:19.032 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T17:56:18.909+0000 7f66b8ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:56:19.032 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T17:56:18.909+0000 7f66b8ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:19.033 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 monclient: authenticate success, global_id 6699 2024-09-12T17:56:19.033 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: get_monmap_and_config success 2024-09-12T17:56:19.033 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T17:56:18.909+0000 7f67d78989c0 4 set_mon_vals no callback set 2024-09-12T17:56:19.033 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T17:56:18.909+0000 7f66b8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:19.033 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T17:56:18.909+0000 7f66b8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:56:19.033 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T17:56:18.909+0000 7f66b8ff9640 10 monclient: dump: 2024-09-12T17:56:19.033 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:56:19.033 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:56:19.033 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.033 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.033 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:19.033 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.033 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:56:19.033 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:56:19.034 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:56:19.034 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.034 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: shutdown 2024-09-12T17:56:19.034 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: build_initial_monmap 2024-09-12T17:56:19.034 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T17:56:18.909+0000 7f67d78989c0 1 build_initial for_mkfs: 0 2024-09-12T17:56:19.034 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: monmap: 2024-09-12T17:56:19.034 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:56:19.034 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:19.034 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:56:19.034 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:56:19.034 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:19.034 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.034 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:56:19.034 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:56:19.035 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:56:19.035 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.035 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding auth protocol: cephx 2024-09-12T17:56:19.035 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding auth protocol: cephx 2024-09-12T17:56:19.035 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding auth protocol: cephx 2024-09-12T17:56:19.035 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: secure 2024-09-12T17:56:19.035 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: crc 2024-09-12T17:56:19.035 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: secure 2024-09-12T17:56:19.035 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: crc 2024-09-12T17:56:19.035 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: secure 2024-09-12T17:56:19.035 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: crc 2024-09-12T17:56:19.035 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: crc 2024-09-12T17:56:19.035 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: secure 2024-09-12T17:56:19.035 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: crc 2024-09-12T17:56:19.036 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: secure 2024-09-12T17:56:19.036 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: crc 2024-09-12T17:56:19.036 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: secure 2024-09-12T17:56:19.036 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T17:56:18.909+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.036 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T17:56:18.909+0000 7f67d78989c0 1 librados: starting msgr at 2024-09-12T17:56:19.036 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T17:56:18.909+0000 7f67d78989c0 1 librados: starting objecter 2024-09-12T17:56:19.036 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f5a478d5c0 EEXIST 2024-09-12T17:56:19.036 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T17:56:18.909+0000 7f67d78989c0 1 librados: setting wanted keys 2024-09-12T17:56:19.036 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T17:56:18.909+0000 7f67d78989c0 1 librados: calling monclient init 2024-09-12T17:56:19.036 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: init 2024-09-12T17:56:19.036 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding auth protocol: cephx 2024-09-12T17:56:19.036 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding auth protocol: cephx 2024-09-12T17:56:19.036 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding auth protocol: cephx 2024-09-12T17:56:19.037 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: secure 2024-09-12T17:56:19.037 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: crc 2024-09-12T17:56:19.037 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: secure 2024-09-12T17:56:19.037 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: crc 2024-09-12T17:56:19.037 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: secure 2024-09-12T17:56:19.037 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: crc 2024-09-12T17:56:19.037 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: crc 2024-09-12T17:56:19.037 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: secure 2024-09-12T17:56:19.037 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: crc 2024-09-12T17:56:19.037 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: secure 2024-09-12T17:56:19.037 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: crc 2024-09-12T17:56:19.037 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: secure 2024-09-12T17:56:19.037 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T17:56:18.909+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.038 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T17:56:18.909+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.038 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command rotate-key cmddesc rotate-key hook 0x55f5a4769708 EEXIST 2024-09-12T17:56:19.038 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: _reopen_session rank -1 2024-09-12T17:56:19.038 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:56:19.038 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-c con 0x55f5a478c6d0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:56:19.038 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-b con 0x55f5a47b6f00 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:56:19.038 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-a con 0x55f5a47bb5f0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:56:19.038 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.038 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.038 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.038 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient(hunting): _renew_subs 2024-09-12T17:56:19.038 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient(hunting): authenticate will time out at 2575.482143s 2024-09-12T17:56:19.038 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 10 monclient(hunting): get_auth_request con 0x55f5a47bb5f0 auth_method 0 2024-09-12T17:56:19.039 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.039 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.039 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.039 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T17:56:18.909+0000 7f67d539e640 10 monclient(hunting): get_auth_request con 0x55f5a478c6d0 auth_method 0 2024-09-12T17:56:19.039 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T17:56:18.909+0000 7f67d539e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.039 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T17:56:18.909+0000 7f67d539e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.039 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T17:56:18.909+0000 7f67d539e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.039 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:19.039 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:19.039 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:19.039 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T17:56:18.909+0000 7f67d539e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:19.039 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T17:56:18.909+0000 7f67d539e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:19.039 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T17:56:18.909+0000 7f67d539e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:19.040 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_done global_id 6702 payload 824 2024-09-12T17:56:19.040 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 10 monclient: _finish_hunting 0 2024-09-12T17:56:19.040 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 1 monclient: found mon.noname-a 2024-09-12T17:56:19.040 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:56:19.040 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T17:56:18.909+0000 7f66a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:19.040 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T17:56:18.909+0000 7f66a6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:56:19.040 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T17:56:18.909+0000 7f66a6ffd640 10 monclient: dump: 2024-09-12T17:56:19.040 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:56:19.040 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:56:19.040 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.040 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.040 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:19.040 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.041 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:56:19.041 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:56:19.041 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:56:19.041 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.041 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T17:56:18.909+0000 7f66a6ffd640 10 monclient: _finish_auth 0 2024-09-12T17:56:19.041 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T17:56:18.909+0000 7f66a6ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:56:19.041 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T17:56:18.909+0000 7f66a6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:19.041 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T17:56:18.909+0000 7f66a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:19.041 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T17:56:18.909+0000 7f66a6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:56:19.041 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T17:56:18.909+0000 7f66a6ffd640 10 monclient: dump: 2024-09-12T17:56:19.041 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:56:19.041 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:56:19.041 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.041 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.042 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:19.042 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.042 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:56:19.042 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:56:19.042 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:56:19.042 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.042 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 monclient: authenticate success, global_id 6702 2024-09-12T17:56:19.042 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T17:56:18.909+0000 7f66b8ff9640 4 set_mon_vals no callback set 2024-09-12T17:56:19.042 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: _renew_subs 2024-09-12T17:56:19.042 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:56:19.042 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: _renew_subs 2024-09-12T17:56:19.042 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:56:19.042 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T17:56:18.909+0000 7f67d78989c0 1 librados: init done 2024-09-12T17:56:19.042 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command cr dump hook 0x55f5a47b37b8 2024-09-12T17:56:19.043 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.043 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T17:56:18.913+0000 7f66a6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:56:19.043 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T17:56:18.913+0000 7f66a6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:56:19.043 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T17:56:18.913+0000 7f66a6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:56:19.043 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T17:56:18.913+0000 7f67d539e640 10 monclient: get_auth_request con 0x7f66a0070ae0 auth_method 0 2024-09-12T17:56:19.043 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T17:56:18.913+0000 7f67d4b9d640 10 monclient: get_auth_request con 0x55f5a47d50c0 auth_method 0 2024-09-12T17:56:19.043 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.043 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T17:56:18.913+0000 7f67d78989c0 20 realm 2024-09-12T17:56:19.043 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.043 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.043 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T17:56:18.913+0000 7f67d78989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:19.043 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.043 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.043 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.044 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T17:56:18.913+0000 7f67d539e640 10 monclient: get_auth_request con 0x55f5a47d9450 auth_method 0 2024-09-12T17:56:19.044 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T17:56:18.917+0000 7f67d78989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:19.044 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T17:56:18.917+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.044 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T17:56:18.917+0000 7f67d78989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:19.044 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T17:56:18.917+0000 7f67d78989c0 20 searching for the correct realm 2024-09-12T17:56:19.044 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T17:56:18.917+0000 7f67d4b9d640 10 monclient: get_auth_request con 0x55f5a47de5b0 auth_method 0 2024-09-12T17:56:19.044 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T17:56:18.917+0000 7f67d5b9f640 10 monclient: get_auth_request con 0x7f67cc064b20 auth_method 0 2024-09-12T17:56:19.044 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T17:56:18.917+0000 7f67d539e640 10 monclient: get_auth_request con 0x7f67d00791b0 auth_method 0 2024-09-12T17:56:19.044 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T17:56:18.921+0000 7f67d4b9d640 10 monclient: get_auth_request con 0x7f67c80e0020 auth_method 0 2024-09-12T17:56:19.044 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T17:56:18.921+0000 7f67d4b9d640 0 -- 172.21.15.98:0/1125680 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55f5a47d50c0 msgr2=0x55f5a47d7560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:19.044 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T17:56:18.921+0000 7f66a6ffd640 1 client.6702.objecter ms_handle_reset 0x55f5a47d50c0 session 0x55f5a47d4a40 osd.1 2024-09-12T17:56:19.044 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T17:56:18.921+0000 7f66a6ffd640 10 monclient: _renew_subs 2024-09-12T17:56:19.044 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T17:56:18.921+0000 7f66a6ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:56:19.045 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T17:56:18.921+0000 7f67d4b9d640 10 monclient: get_auth_request con 0x7f66a0081180 auth_method 0 2024-09-12T17:56:19.045 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T17:56:18.921+0000 7f67d5b9f640 10 monclient: get_auth_request con 0x7f67cc06d6c0 auth_method 0 2024-09-12T17:56:19.045 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T17:56:18.925+0000 7f67d539e640 10 monclient: get_auth_request con 0x7f67cc06b330 auth_method 0 2024-09-12T17:56:19.045 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T17:56:18.929+0000 7f67d4b9d640 0 -- 172.21.15.98:0/1125680 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f67c80e0020 msgr2=0x7f67c80f4440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:19.045 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T17:56:18.929+0000 7f66a6ffd640 1 client.6702.objecter ms_handle_reset 0x7f67c80e0020 session 0x7f67c80a6070 osd.4 2024-09-12T17:56:19.045 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T17:56:18.929+0000 7f67d4b9d640 10 monclient: get_auth_request con 0x55f5a47d50c0 auth_method 0 2024-09-12T17:56:19.045 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T17:56:18.933+0000 7f67d78989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:19.045 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T17:56:18.933+0000 7f67d78989c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:19.045 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T17:56:18.933+0000 7f67d78989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:19.045 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T17:56:18.933+0000 7f67d78989c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:19.045 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T17:56:18.933+0000 7f67d78989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:19.045 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T17:56:18.933+0000 7f67d78989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:19.045 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T17:56:18.933+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.045 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T17:56:18.933+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.046 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.046 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:19.046 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.046 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:19.046 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 zone default found 2024-09-12T17:56:19.046 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T17:56:18.937+0000 7f67d78989c0 4 Realm: () 2024-09-12T17:56:19.046 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T17:56:18.937+0000 7f67d78989c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:19.046 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T17:56:18.937+0000 7f67d78989c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:19.046 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T17:56:18.937+0000 7f67d78989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:19.046 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 zonegroup default 2024-09-12T17:56:19.046 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.046 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.046 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.047 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.047 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.047 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.047 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 started sync module instance, tier type = 2024-09-12T17:56:19.047 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:19.047 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=0 2024-09-12T17:56:19.047 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=1 2024-09-12T17:56:19.047 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=2 2024-09-12T17:56:19.047 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=3 2024-09-12T17:56:19.047 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=4 2024-09-12T17:56:19.047 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=5 2024-09-12T17:56:19.047 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=6 2024-09-12T17:56:19.047 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=7 2024-09-12T17:56:19.047 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T17:56:18.957+0000 7f67d78989c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:19.048 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding auth protocol: cephx 2024-09-12T17:56:19.048 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding auth protocol: cephx 2024-09-12T17:56:19.048 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding auth protocol: cephx 2024-09-12T17:56:19.048 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: secure 2024-09-12T17:56:19.048 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: crc 2024-09-12T17:56:19.048 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: secure 2024-09-12T17:56:19.048 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: crc 2024-09-12T17:56:19.048 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: secure 2024-09-12T17:56:19.048 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: crc 2024-09-12T17:56:19.048 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: crc 2024-09-12T17:56:19.048 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: secure 2024-09-12T17:56:19.048 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: crc 2024-09-12T17:56:19.048 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T17:56:18.961+0000 7f668b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:19.049 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: secure 2024-09-12T17:56:19.049 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: crc 2024-09-12T17:56:19.049 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: secure 2024-09-12T17:56:19.049 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T17:56:18.961+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.049 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T17:56:18.961+0000 7f67d78989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:19.049 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T17:56:18.961+0000 7f67d78989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:19.049 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command cache list hook 0x55f5a47b0890 2024-09-12T17:56:19.049 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command cache inspect hook 0x55f5a47b0890 2024-09-12T17:56:19.049 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command cache erase hook 0x55f5a47b0890 2024-09-12T17:56:19.049 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command cache zap hook 0x55f5a47b0890 2024-09-12T17:56:19.049 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 note: GC not initialized 2024-09-12T17:56:19.049 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T17:56:18.961+0000 7f668a7e4640 20 reqs_thread_entry: start 2024-09-12T17:56:19.049 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command sync trace show hook 0x7f67c80b94b0 2024-09-12T17:56:19.049 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command sync trace history hook 0x7f67c80b94b0 2024-09-12T17:56:19.050 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command sync trace active hook 0x7f67c80b94b0 2024-09-12T17:56:19.050 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command sync trace active_short hook 0x7f67c80b94b0 2024-09-12T17:56:19.050 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T17:56:18.961+0000 7f67d78989c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:19.050 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T17:56:18.961+0000 7f67d78989c0 20 Filter name: none 2024-09-12T17:56:19.050 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T17:56:18.961+0000 7f65fbfff640 20 reqs_thread_entry: start 2024-09-12T17:56:19.050 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T17:56:18.961+0000 7f67d78989c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:56:19.050 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T17:56:18.961+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.050 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T17:56:18.965+0000 7f67d78989c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:19.050 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T17:56:18.965+0000 7f67d78989c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:56:19.050 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T17:56:18.965+0000 7f67d78989c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:56:19.050 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T17:56:18.965+0000 7f67d78989c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 : miss 2024-09-12T17:56:19.050 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T17:56:18.965+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.050 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T17:56:18.965+0000 7f67d78989c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:19.050 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T17:56:18.965+0000 7f67d78989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 info.flags=0x17 2024-09-12T17:56:19.051 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T17:56:18.965+0000 7f67d78989c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 to cache LRU end 2024-09-12T17:56:19.051 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T17:56:18.965+0000 7f67d78989c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:19.051 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T17:56:18.965+0000 7f67d78989c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:19.051 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T17:56:18.965+0000 7f67d78989c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 2024-09-12T17:56:19.051 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T17:56:18.973+0000 7f67d78989c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f67d78989c0 time 2024-09-12T17:56:18.977813+0000 2024-09-12T17:56:19.051 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:56:19.051 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.051 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:19.051 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f67db1722eb] 2024-09-12T17:56:19.051 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f67db17249f] 2024-09-12T17:56:19.051 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f5a29e50c1] 2024-09-12T17:56:19.051 INFO:tasks.workunit.client.0.smithi098.stderr: 4: radosgw-admin(+0x140f6b8) [0x55f5a343a6b8] 2024-09-12T17:56:19.051 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f5a29f718d] 2024-09-12T17:56:19.051 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T17:56:19.052 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f67d9fd8d90] 2024-09-12T17:56:19.052 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T17:56:19.052 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T17:56:19.052 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.052 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T17:56:18.973+0000 7f67d78989c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:56:19.052 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f67d78989c0 thread_name:radosgw-admin 2024-09-12T17:56:19.052 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.052 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:19.052 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f67d9ff1520] 2024-09-12T17:56:19.052 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:56:19.052 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:56:19.052 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:56:19.052 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f67db172345] 2024-09-12T17:56:19.052 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f67db17249f] 2024-09-12T17:56:19.053 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f5a29e50c1] 2024-09-12T17:56:19.053 INFO:tasks.workunit.client.0.smithi098.stderr: 8: radosgw-admin(+0x140f6b8) [0x55f5a343a6b8] 2024-09-12T17:56:19.053 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f5a29f718d] 2024-09-12T17:56:19.053 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T17:56:19.053 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f67d9fd8d90] 2024-09-12T17:56:19.053 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T17:56:19.053 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T17:56:19.053 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:56:19.053 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.053 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T17:56:19.053 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T17:56:19.053 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T17:56:19.053 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T17:56:19.053 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T17:56:19.054 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T17:56:19.054 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T17:56:19.054 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T17:56:19.054 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T17:56:19.054 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T17:56:19.054 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T17:56:19.054 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T17:56:19.054 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T17:56:19.054 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T17:56:19.054 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T17:56:19.054 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T17:56:19.054 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T17:56:19.054 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T17:56:19.054 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T17:56:19.055 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T17:56:19.055 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T17:56:19.055 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T17:56:19.055 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T17:56:19.055 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T17:56:19.055 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:56:19.055 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T17:56:19.055 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T17:56:19.055 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T17:56:19.055 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T17:56:19.055 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T17:56:19.055 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T17:56:19.055 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T17:56:19.055 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T17:56:19.056 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T17:56:19.056 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T17:56:19.056 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T17:56:19.056 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T17:56:19.056 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T17:56:19.056 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T17:56:19.056 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T17:56:19.056 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T17:56:19.056 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T17:56:19.056 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T17:56:19.056 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T17:56:19.056 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T17:56:19.056 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T17:56:19.056 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:56:19.057 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T17:56:19.057 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:56:19.057 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T17:56:19.057 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T17:56:19.057 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T17:56:19.057 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T17:56:19.057 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T17:56:19.057 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T17:56:19.057 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T17:56:19.057 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T17:56:19.057 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T17:56:19.057 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T17:56:19.057 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T17:56:19.057 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T17:56:19.058 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T17:56:19.058 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T17:56:19.058 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T17:56:19.058 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T17:56:19.058 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T17:56:19.058 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T17:56:19.058 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:56:19.058 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T17:56:19.058 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:56:19.058 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T17:56:19.058 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T17:56:19.058 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T17:56:19.058 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T17:56:19.058 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T17:56:19.058 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T17:56:19.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:56:19.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T17:56:19.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T17:56:19.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:56:19.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T17:56:19.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T17:56:19.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T17:56:19.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T17:56:19.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T17:56:19.059 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T17:56:19.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T17:56:19.059 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T17:56:19.059 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T17:56:19.060 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T17:56:19.060 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T17:56:19.060 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T17:56:19.060 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T17:56:19.060 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:56:19.060 INFO:tasks.workunit.client.0.smithi098.stderr: 7f65fbfff640 / http_manager 2024-09-12T17:56:19.060 INFO:tasks.workunit.client.0.smithi098.stderr: 7f668a7e4640 / http_manager 2024-09-12T17:56:19.060 INFO:tasks.workunit.client.0.smithi098.stderr: 7f668b7e6640 / rgw_dt_lg_renew 2024-09-12T17:56:19.060 INFO:tasks.workunit.client.0.smithi098.stderr: 7f66a6ffd640 / ms_dispatch 2024-09-12T17:56:19.060 INFO:tasks.workunit.client.0.smithi098.stderr: 7f66b8ff9640 / io_context_pool 2024-09-12T17:56:19.060 INFO:tasks.workunit.client.0.smithi098.stderr: 7f66baffd640 / ms_dispatch 2024-09-12T17:56:19.060 INFO:tasks.workunit.client.0.smithi098.stderr: 7f66c1e03640 / ms_dispatch 2024-09-12T17:56:19.060 INFO:tasks.workunit.client.0.smithi098.stderr: 7f66c3606640 / io_context_pool 2024-09-12T17:56:19.061 INFO:tasks.workunit.client.0.smithi098.stderr: 7f67d4b9d640 / msgr-worker-2 2024-09-12T17:56:19.061 INFO:tasks.workunit.client.0.smithi098.stderr: 7f67d539e640 / msgr-worker-1 2024-09-12T17:56:19.061 INFO:tasks.workunit.client.0.smithi098.stderr: 7f67d5b9f640 / msgr-worker-0 2024-09-12T17:56:19.061 INFO:tasks.workunit.client.0.smithi098.stderr: 7f67d63a0640 / io_context_pool 2024-09-12T17:56:19.061 INFO:tasks.workunit.client.0.smithi098.stderr: 7f67d78989c0 / radosgw-admin 2024-09-12T17:56:19.061 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T17:56:19.061 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T17:56:19.061 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/log/ceph/ceph-client.admin.91030.log 2024-09-12T17:56:19.061 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T17:56:19.061 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T17:56:19.061 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T17:56:18.889+0000 7f67d539e640 10 monclient(hunting): get_auth_request con 0x55f5a45abaa0 auth_method 0 2024-09-12T17:56:19.061 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T17:56:18.889+0000 7f67d539e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.061 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T17:56:18.889+0000 7f67d539e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.061 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T17:56:18.889+0000 7f67d539e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.062 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T17:56:18.889+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:19.062 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T17:56:18.889+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:19.062 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T17:56:18.889+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:19.062 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T17:56:18.889+0000 7f67d539e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:19.062 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T17:56:18.889+0000 7f67d539e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:19.062 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T17:56:18.889+0000 7f67d539e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:19.062 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T17:56:18.889+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_done global_id 6690 payload 274 2024-09-12T17:56:19.062 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T17:56:18.889+0000 7f67d4b9d640 10 monclient: _finish_hunting 0 2024-09-12T17:56:19.062 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T17:56:18.889+0000 7f67d4b9d640 1 monclient: found mon.noname-a 2024-09-12T17:56:19.062 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T17:56:18.889+0000 7f67d4b9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:56:19.062 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T17:56:18.889+0000 7f66c3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:19.062 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T17:56:18.889+0000 7f66c3606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:56:19.062 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T17:56:18.889+0000 7f66c3606640 10 monclient: dump: 2024-09-12T17:56:19.062 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:56:19.063 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:56:19.063 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.063 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.063 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:19.063 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.063 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:56:19.063 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:56:19.063 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:56:19.063 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.063 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T17:56:18.889+0000 7f66c3606640 10 monclient: _finish_auth 0 2024-09-12T17:56:19.063 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T17:56:18.889+0000 7f66c3606640 10 monclient: _check_auth_tickets 2024-09-12T17:56:19.063 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T17:56:18.889+0000 7f66c3606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:19.063 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 monclient: authenticate success, global_id 6690 2024-09-12T17:56:19.064 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T17:56:18.889+0000 7f67d78989c0 10 monclient: get_monmap_and_config success 2024-09-12T17:56:19.064 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T17:56:18.889+0000 7f67d78989c0 4 set_mon_vals no callback set 2024-09-12T17:56:19.064 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T17:56:18.889+0000 7f66c3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:19.064 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T17:56:18.889+0000 7f66c3606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:56:19.064 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T17:56:18.889+0000 7f66c3606640 10 monclient: dump: 2024-09-12T17:56:19.064 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:56:19.064 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:56:19.064 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.064 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.064 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:19.064 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.064 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:56:19.064 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:56:19.064 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:56:19.065 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.065 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T17:56:18.889+0000 7f67d78989c0 10 monclient: shutdown 2024-09-12T17:56:19.065 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) unregister_commands rotate-key 2024-09-12T17:56:19.065 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T17:56:18.889+0000 7f67d78989c0 10 monclient: build_initial_monmap 2024-09-12T17:56:19.065 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T17:56:18.889+0000 7f67d78989c0 1 build_initial for_mkfs: 0 2024-09-12T17:56:19.065 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T17:56:18.889+0000 7f67d78989c0 10 monclient: monmap: 2024-09-12T17:56:19.065 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:56:19.065 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:19.065 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:56:19.065 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:56:19.065 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:19.065 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.065 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:56:19.065 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:56:19.066 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:56:19.066 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.066 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding auth protocol: cephx 2024-09-12T17:56:19.066 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding auth protocol: cephx 2024-09-12T17:56:19.066 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding auth protocol: cephx 2024-09-12T17:56:19.066 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: secure 2024-09-12T17:56:19.066 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: crc 2024-09-12T17:56:19.066 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: secure 2024-09-12T17:56:19.066 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: crc 2024-09-12T17:56:19.066 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: secure 2024-09-12T17:56:19.066 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: crc 2024-09-12T17:56:19.066 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: crc 2024-09-12T17:56:19.066 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: secure 2024-09-12T17:56:19.066 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: crc 2024-09-12T17:56:19.067 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T17:56:18.889+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: secure 2024-09-12T17:56:19.067 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: crc 2024-09-12T17:56:19.067 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46f1340) adding con mode: secure 2024-09-12T17:56:19.067 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T17:56:18.893+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.067 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T17:56:18.893+0000 7f67d78989c0 1 librados: starting msgr at 2024-09-12T17:56:19.067 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T17:56:18.893+0000 7f67d78989c0 1 librados: starting objecter 2024-09-12T17:56:19.067 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command objecter_requests hook 0x55f5a46f2060 2024-09-12T17:56:19.067 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T17:56:18.893+0000 7f67d78989c0 1 librados: setting wanted keys 2024-09-12T17:56:19.067 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T17:56:18.893+0000 7f67d78989c0 1 librados: calling monclient init 2024-09-12T17:56:19.067 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient: init 2024-09-12T17:56:19.067 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding auth protocol: cephx 2024-09-12T17:56:19.067 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding auth protocol: cephx 2024-09-12T17:56:19.067 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding auth protocol: cephx 2024-09-12T17:56:19.067 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: secure 2024-09-12T17:56:19.067 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: crc 2024-09-12T17:56:19.068 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: secure 2024-09-12T17:56:19.068 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: crc 2024-09-12T17:56:19.068 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: secure 2024-09-12T17:56:19.068 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: crc 2024-09-12T17:56:19.068 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: crc 2024-09-12T17:56:19.068 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: secure 2024-09-12T17:56:19.068 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: crc 2024-09-12T17:56:19.068 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: secure 2024-09-12T17:56:19.068 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: crc 2024-09-12T17:56:19.068 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 AuthRegistry(0x55f5a46ebbc0) adding con mode: secure 2024-09-12T17:56:19.068 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T17:56:18.893+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.068 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T17:56:18.893+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.068 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command rotate-key hook 0x55f5a46ebd08 2024-09-12T17:56:19.069 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient: _reopen_session rank -1 2024-09-12T17:56:19.069 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:56:19.069 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-b con 0x55f5a45abaa0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:56:19.069 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-a con 0x55f5a4631880 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:56:19.069 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-c con 0x55f5a4634bf0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:56:19.069 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.069 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.069 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.069 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient(hunting): _renew_subs 2024-09-12T17:56:19.069 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient(hunting): authenticate will time out at 2575.465045s 2024-09-12T17:56:19.069 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 10 monclient(hunting): get_auth_request con 0x55f5a4634bf0 auth_method 0 2024-09-12T17:56:19.069 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.069 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.069 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.070 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T17:56:18.893+0000 7f67d4b9d640 10 monclient(hunting): get_auth_request con 0x55f5a4631880 auth_method 0 2024-09-12T17:56:19.070 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T17:56:18.893+0000 7f67d4b9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.070 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T17:56:18.893+0000 7f67d4b9d640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.070 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T17:56:18.893+0000 7f67d4b9d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.070 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:19.070 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:19.070 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:19.070 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T17:56:18.893+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:19.070 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T17:56:18.893+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:19.070 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T17:56:18.893+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:19.070 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_done global_id 6230 payload 824 2024-09-12T17:56:19.070 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 10 monclient: _finish_hunting 0 2024-09-12T17:56:19.070 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 1 monclient: found mon.noname-c 2024-09-12T17:56:19.070 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T17:56:18.893+0000 7f67d5b9f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:56:19.071 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T17:56:18.893+0000 7f67d539e640 10 monclient: get_auth_request con 0x55f5a45abaa0 auth_method 0 2024-09-12T17:56:19.071 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T17:56:18.893+0000 7f66c1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:19.071 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T17:56:18.893+0000 7f66c1e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:56:19.071 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T17:56:18.893+0000 7f66c1e03640 10 monclient: dump: 2024-09-12T17:56:19.071 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:56:19.071 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:56:19.071 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.071 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.071 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:19.071 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.071 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:56:19.071 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:56:19.071 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:56:19.072 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.072 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T17:56:18.893+0000 7f66c1e03640 10 monclient: _finish_auth 0 2024-09-12T17:56:19.072 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T17:56:18.893+0000 7f66c1e03640 10 monclient: _check_auth_tickets 2024-09-12T17:56:19.072 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T17:56:18.893+0000 7f66c1e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:19.072 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T17:56:18.893+0000 7f66c1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:19.072 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T17:56:18.893+0000 7f66c1e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:56:19.072 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T17:56:18.893+0000 7f66c1e03640 10 monclient: dump: 2024-09-12T17:56:19.072 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:56:19.072 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:56:19.072 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.072 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.072 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:19.072 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.073 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:56:19.073 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:56:19.073 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:56:19.073 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.073 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T17:56:18.893+0000 7f67d78989c0 5 monclient: authenticate success, global_id 6230 2024-09-12T17:56:19.073 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T17:56:18.893+0000 7f66c3606640 4 set_mon_vals no callback set 2024-09-12T17:56:19.073 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient: _renew_subs 2024-09-12T17:56:19.073 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:56:19.073 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient: _renew_subs 2024-09-12T17:56:19.073 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T17:56:18.893+0000 7f67d78989c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:56:19.073 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T17:56:18.893+0000 7f67d78989c0 1 librados: init done 2024-09-12T17:56:19.073 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T17:56:18.893+0000 7f66c1e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:56:19.073 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T17:56:18.893+0000 7f66c1e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:56:19.074 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T17:56:18.893+0000 7f66c1e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:56:19.074 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T17:56:18.897+0000 7f67d539e640 10 monclient: get_auth_request con 0x7f66bc070b10 auth_method 0 2024-09-12T17:56:19.074 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T17:56:18.897+0000 7f67d4b9d640 10 monclient: get_auth_request con 0x55f5a4713980 auth_method 0 2024-09-12T17:56:19.074 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T17:56:18.897+0000 7f67d539e640 10 monclient: get_auth_request con 0x55f5a47369a0 auth_method 0 2024-09-12T17:56:19.074 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient: get_auth_request con 0x55f5a473a250 auth_method 0 2024-09-12T17:56:19.074 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient: build_initial_monmap 2024-09-12T17:56:19.074 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T17:56:18.901+0000 7f67d78989c0 1 build_initial for_mkfs: 0 2024-09-12T17:56:19.074 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient: monmap: 2024-09-12T17:56:19.074 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:56:19.074 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:19.074 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:56:19.074 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:56:19.074 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:19.074 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.075 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:56:19.075 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:56:19.075 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:56:19.075 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.075 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding auth protocol: cephx 2024-09-12T17:56:19.075 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding auth protocol: cephx 2024-09-12T17:56:19.075 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding auth protocol: cephx 2024-09-12T17:56:19.075 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: secure 2024-09-12T17:56:19.075 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: crc 2024-09-12T17:56:19.075 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: secure 2024-09-12T17:56:19.076 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: crc 2024-09-12T17:56:19.076 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: secure 2024-09-12T17:56:19.076 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: crc 2024-09-12T17:56:19.076 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: crc 2024-09-12T17:56:19.076 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: secure 2024-09-12T17:56:19.076 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: crc 2024-09-12T17:56:19.076 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: secure 2024-09-12T17:56:19.076 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: crc 2024-09-12T17:56:19.076 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473fbc0) adding con mode: secure 2024-09-12T17:56:19.076 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T17:56:18.901+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.076 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f5a47435f0 EEXIST 2024-09-12T17:56:19.076 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient: init 2024-09-12T17:56:19.076 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding auth protocol: cephx 2024-09-12T17:56:19.077 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding auth protocol: cephx 2024-09-12T17:56:19.077 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding auth protocol: cephx 2024-09-12T17:56:19.077 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: secure 2024-09-12T17:56:19.077 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: crc 2024-09-12T17:56:19.077 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: secure 2024-09-12T17:56:19.077 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: crc 2024-09-12T17:56:19.077 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: secure 2024-09-12T17:56:19.077 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: crc 2024-09-12T17:56:19.077 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: crc 2024-09-12T17:56:19.077 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: secure 2024-09-12T17:56:19.077 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: crc 2024-09-12T17:56:19.077 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: secure 2024-09-12T17:56:19.077 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: crc 2024-09-12T17:56:19.077 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 AuthRegistry(0x55f5a473ec18) adding con mode: secure 2024-09-12T17:56:19.078 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T17:56:18.901+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.078 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T17:56:18.901+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.078 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T17:56:18.901+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command rotate-key cmddesc rotate-key hook 0x55f5a473ed60 EEXIST 2024-09-12T17:56:19.078 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient: _reopen_session rank -1 2024-09-12T17:56:19.078 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:56:19.078 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-b con 0x55f5a47677a0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:56:19.078 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-c con 0x55f5a47670d0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:56:19.078 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-a con 0x55f5a4765ab0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:56:19.078 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.078 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.078 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.078 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient(hunting): _renew_subs 2024-09-12T17:56:19.079 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T17:56:18.901+0000 7f67d78989c0 10 monclient(hunting): authenticate will time out at 2575.475370s 2024-09-12T17:56:19.079 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient(hunting): get_auth_request con 0x55f5a47670d0 auth_method 0 2024-09-12T17:56:19.079 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.079 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.079 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.079 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T17:56:18.901+0000 7f67d5b9f640 10 monclient(hunting): get_auth_request con 0x55f5a4765ab0 auth_method 0 2024-09-12T17:56:19.079 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T17:56:18.901+0000 7f67d5b9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.079 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T17:56:18.901+0000 7f67d5b9f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.079 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T17:56:18.901+0000 7f67d5b9f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.079 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:19.079 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:19.079 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:19.079 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T17:56:18.901+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:19.079 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T17:56:18.901+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:19.080 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T17:56:18.901+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:19.080 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T17:56:18.901+0000 7f67d539e640 10 monclient(hunting): get_auth_request con 0x55f5a47677a0 auth_method 0 2024-09-12T17:56:19.080 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T17:56:18.901+0000 7f67d539e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.080 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T17:56:18.901+0000 7f67d539e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.080 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T17:56:18.901+0000 7f67d539e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.080 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient(hunting): handle_auth_done global_id 6233 payload 824 2024-09-12T17:56:19.080 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient: _finish_hunting 0 2024-09-12T17:56:19.080 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 1 monclient: found mon.noname-c 2024-09-12T17:56:19.080 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T17:56:18.901+0000 7f67d4b9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:56:19.080 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T17:56:18.905+0000 7f66baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:19.080 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T17:56:18.905+0000 7f66baffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:56:19.080 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T17:56:18.905+0000 7f66baffd640 10 monclient: dump: 2024-09-12T17:56:19.080 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:56:19.080 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:56:19.080 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.081 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.081 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:19.081 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.081 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:56:19.081 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:56:19.081 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:56:19.081 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.081 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T17:56:18.905+0000 7f66baffd640 10 monclient: _finish_auth 0 2024-09-12T17:56:19.081 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T17:56:18.905+0000 7f66baffd640 10 monclient: _check_auth_tickets 2024-09-12T17:56:19.081 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T17:56:18.905+0000 7f66baffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:19.081 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T17:56:18.905+0000 7f66baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:19.081 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T17:56:18.905+0000 7f66baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:56:19.081 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T17:56:18.905+0000 7f66baffd640 10 monclient: dump: 2024-09-12T17:56:19.082 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:56:19.082 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:56:19.082 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.082 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.082 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:19.082 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.082 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:56:19.082 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:56:19.082 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:56:19.082 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.082 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 monclient: authenticate success, global_id 6233 2024-09-12T17:56:19.082 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient: _renew_subs 2024-09-12T17:56:19.082 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T17:56:18.905+0000 7f67d63a0640 4 set_mon_vals no callback set 2024-09-12T17:56:19.082 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:56:19.083 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient: _renew_subs 2024-09-12T17:56:19.083 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:56:19.083 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T17:56:18.905+0000 7f66baffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:56:19.083 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T17:56:18.905+0000 7f66baffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:56:19.083 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T17:56:18.905+0000 7f66baffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:56:19.083 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient: get_monmap_and_config 2024-09-12T17:56:19.083 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient: build_initial_monmap 2024-09-12T17:56:19.083 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T17:56:18.905+0000 7f67d78989c0 1 build_initial for_mkfs: 0 2024-09-12T17:56:19.083 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient: monmap: 2024-09-12T17:56:19.083 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:56:19.083 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:19.083 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:56:19.083 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:56:19.084 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:19.084 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.084 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:56:19.084 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:56:19.084 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:56:19.084 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.084 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding auth protocol: cephx 2024-09-12T17:56:19.084 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding auth protocol: cephx 2024-09-12T17:56:19.084 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding auth protocol: cephx 2024-09-12T17:56:19.084 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: secure 2024-09-12T17:56:19.084 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: crc 2024-09-12T17:56:19.084 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: secure 2024-09-12T17:56:19.084 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: crc 2024-09-12T17:56:19.084 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: secure 2024-09-12T17:56:19.085 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: crc 2024-09-12T17:56:19.085 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: crc 2024-09-12T17:56:19.085 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: secure 2024-09-12T17:56:19.085 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: crc 2024-09-12T17:56:19.085 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: secure 2024-09-12T17:56:19.085 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: crc 2024-09-12T17:56:19.085 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47870d0) adding con mode: secure 2024-09-12T17:56:19.085 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient: get_auth_request con 0x7f66b0070a20 auth_method 0 2024-09-12T17:56:19.085 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T17:56:18.905+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.085 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient: init 2024-09-12T17:56:19.085 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding auth protocol: cephx 2024-09-12T17:56:19.085 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding auth protocol: cephx 2024-09-12T17:56:19.085 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding auth protocol: cephx 2024-09-12T17:56:19.085 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: secure 2024-09-12T17:56:19.086 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: crc 2024-09-12T17:56:19.086 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: secure 2024-09-12T17:56:19.086 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: crc 2024-09-12T17:56:19.086 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: secure 2024-09-12T17:56:19.086 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: crc 2024-09-12T17:56:19.086 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: crc 2024-09-12T17:56:19.086 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: secure 2024-09-12T17:56:19.086 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: crc 2024-09-12T17:56:19.086 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: secure 2024-09-12T17:56:19.086 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: crc 2024-09-12T17:56:19.086 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3e7e0) adding con mode: secure 2024-09-12T17:56:19.086 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T17:56:18.905+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.086 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T17:56:18.905+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.087 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T17:56:18.905+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command rotate-key cmddesc rotate-key hook 0x7ffeebd3e928 EEXIST 2024-09-12T17:56:19.087 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient: _reopen_session rank -1 2024-09-12T17:56:19.087 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:56:19.087 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-a con 0x55f5a47bb5f0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:56:19.087 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-b con 0x55f5a478c6d0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:56:19.087 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-c con 0x55f5a47b6f00 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:56:19.087 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.087 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.087 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.087 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient(hunting): _renew_subs 2024-09-12T17:56:19.087 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T17:56:18.905+0000 7f67d78989c0 10 monclient(hunting): authenticate will time out at 2575.479408s 2024-09-12T17:56:19.087 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient(hunting): get_auth_request con 0x55f5a47bb5f0 auth_method 0 2024-09-12T17:56:19.087 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.087 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.088 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.088 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T17:56:18.905+0000 7f67d5b9f640 10 monclient(hunting): get_auth_request con 0x55f5a47b6f00 auth_method 0 2024-09-12T17:56:19.088 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T17:56:18.905+0000 7f67d5b9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.088 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T17:56:18.905+0000 7f67d5b9f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.088 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T17:56:18.905+0000 7f67d5b9f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.088 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:19.088 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:19.088 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:19.088 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T17:56:18.905+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:19.088 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T17:56:18.905+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:19.088 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T17:56:18.905+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:19.088 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T17:56:18.905+0000 7f67d4b9d640 10 monclient(hunting): get_auth_request con 0x55f5a478c6d0 auth_method 0 2024-09-12T17:56:19.088 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T17:56:18.905+0000 7f67d4b9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.088 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T17:56:18.905+0000 7f67d4b9d640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.089 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T17:56:18.905+0000 7f67d4b9d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.089 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient(hunting): handle_auth_done global_id 6699 payload 274 2024-09-12T17:56:19.089 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient: _finish_hunting 0 2024-09-12T17:56:19.089 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T17:56:18.905+0000 7f67d539e640 1 monclient: found mon.noname-a 2024-09-12T17:56:19.089 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T17:56:18.905+0000 7f67d539e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:56:19.089 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T17:56:18.909+0000 7f66b8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:19.089 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T17:56:18.909+0000 7f66b8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:56:19.089 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T17:56:18.909+0000 7f66b8ff9640 10 monclient: dump: 2024-09-12T17:56:19.089 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:56:19.089 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:56:19.089 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.089 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.090 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:19.090 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.090 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:56:19.090 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:56:19.090 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:56:19.090 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.090 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T17:56:18.909+0000 7f66b8ff9640 10 monclient: _finish_auth 0 2024-09-12T17:56:19.090 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T17:56:18.909+0000 7f66b8ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:56:19.090 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T17:56:18.909+0000 7f66b8ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:19.090 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 monclient: authenticate success, global_id 6699 2024-09-12T17:56:19.090 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: get_monmap_and_config success 2024-09-12T17:56:19.090 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T17:56:18.909+0000 7f67d78989c0 4 set_mon_vals no callback set 2024-09-12T17:56:19.090 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T17:56:18.909+0000 7f66b8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:19.090 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T17:56:18.909+0000 7f66b8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:56:19.090 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T17:56:18.909+0000 7f66b8ff9640 10 monclient: dump: 2024-09-12T17:56:19.091 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:56:19.091 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:56:19.091 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.091 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.091 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:19.091 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.091 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:56:19.091 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:56:19.091 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:56:19.091 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.091 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: shutdown 2024-09-12T17:56:19.091 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: build_initial_monmap 2024-09-12T17:56:19.091 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T17:56:18.909+0000 7f67d78989c0 1 build_initial for_mkfs: 0 2024-09-12T17:56:19.091 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: monmap: 2024-09-12T17:56:19.092 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:56:19.092 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:56:19.092 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:56:19.092 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:56:19.092 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:56:19.092 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.092 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:56:19.092 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:56:19.092 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:56:19.092 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.092 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding auth protocol: cephx 2024-09-12T17:56:19.092 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding auth protocol: cephx 2024-09-12T17:56:19.092 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding auth protocol: cephx 2024-09-12T17:56:19.092 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: secure 2024-09-12T17:56:19.093 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: crc 2024-09-12T17:56:19.093 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: secure 2024-09-12T17:56:19.093 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: crc 2024-09-12T17:56:19.093 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: secure 2024-09-12T17:56:19.093 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: crc 2024-09-12T17:56:19.093 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: crc 2024-09-12T17:56:19.093 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: secure 2024-09-12T17:56:19.093 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: crc 2024-09-12T17:56:19.093 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: secure 2024-09-12T17:56:19.093 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: crc 2024-09-12T17:56:19.093 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47abdf0) adding con mode: secure 2024-09-12T17:56:19.093 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T17:56:18.909+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.093 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T17:56:18.909+0000 7f67d78989c0 1 librados: starting msgr at 2024-09-12T17:56:19.093 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T17:56:18.909+0000 7f67d78989c0 1 librados: starting objecter 2024-09-12T17:56:19.094 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f5a478d5c0 EEXIST 2024-09-12T17:56:19.094 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T17:56:18.909+0000 7f67d78989c0 1 librados: setting wanted keys 2024-09-12T17:56:19.094 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T17:56:18.909+0000 7f67d78989c0 1 librados: calling monclient init 2024-09-12T17:56:19.094 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: init 2024-09-12T17:56:19.094 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding auth protocol: cephx 2024-09-12T17:56:19.094 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding auth protocol: cephx 2024-09-12T17:56:19.094 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding auth protocol: cephx 2024-09-12T17:56:19.094 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: secure 2024-09-12T17:56:19.094 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: crc 2024-09-12T17:56:19.094 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: secure 2024-09-12T17:56:19.094 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: crc 2024-09-12T17:56:19.094 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: secure 2024-09-12T17:56:19.094 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: crc 2024-09-12T17:56:19.094 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: crc 2024-09-12T17:56:19.094 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: secure 2024-09-12T17:56:19.095 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: crc 2024-09-12T17:56:19.095 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: secure 2024-09-12T17:56:19.095 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: crc 2024-09-12T17:56:19.095 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 AuthRegistry(0x55f5a47695c0) adding con mode: secure 2024-09-12T17:56:19.095 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T17:56:18.909+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.095 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T17:56:18.909+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.095 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command rotate-key cmddesc rotate-key hook 0x55f5a4769708 EEXIST 2024-09-12T17:56:19.095 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: _reopen_session rank -1 2024-09-12T17:56:19.095 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:56:19.095 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-c con 0x55f5a478c6d0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:56:19.095 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-b con 0x55f5a47b6f00 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:56:19.095 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient(hunting): picked mon.noname-a con 0x55f5a47bb5f0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:56:19.095 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.096 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.096 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:56:19.096 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient(hunting): _renew_subs 2024-09-12T17:56:19.096 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient(hunting): authenticate will time out at 2575.482143s 2024-09-12T17:56:19.096 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 10 monclient(hunting): get_auth_request con 0x55f5a47bb5f0 auth_method 0 2024-09-12T17:56:19.096 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.096 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.096 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.096 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T17:56:18.909+0000 7f67d539e640 10 monclient(hunting): get_auth_request con 0x55f5a478c6d0 auth_method 0 2024-09-12T17:56:19.096 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T17:56:18.909+0000 7f67d539e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:56:19.096 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T17:56:18.909+0000 7f67d539e640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:56:19.096 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T17:56:18.909+0000 7f67d539e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:56:19.096 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:19.096 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:19.097 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:19.097 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T17:56:18.909+0000 7f67d539e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:56:19.097 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T17:56:18.909+0000 7f67d539e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:56:19.097 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T17:56:18.909+0000 7f67d539e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:56:19.097 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 10 monclient(hunting): handle_auth_done global_id 6702 payload 824 2024-09-12T17:56:19.097 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 10 monclient: _finish_hunting 0 2024-09-12T17:56:19.097 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 1 monclient: found mon.noname-a 2024-09-12T17:56:19.097 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T17:56:18.909+0000 7f67d5b9f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:56:19.097 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T17:56:18.909+0000 7f66a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:19.097 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T17:56:18.909+0000 7f66a6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:56:19.097 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T17:56:18.909+0000 7f66a6ffd640 10 monclient: dump: 2024-09-12T17:56:19.097 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:56:19.097 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:56:19.098 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.098 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.098 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:19.098 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.098 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:56:19.098 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:56:19.098 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:56:19.098 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.098 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T17:56:18.909+0000 7f66a6ffd640 10 monclient: _finish_auth 0 2024-09-12T17:56:19.098 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T17:56:18.909+0000 7f66a6ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:56:19.098 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T17:56:18.909+0000 7f66a6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:56:19.098 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T17:56:18.909+0000 7f66a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:56:19.098 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T17:56:18.909+0000 7f66a6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:56:19.098 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T17:56:18.909+0000 7f66a6ffd640 10 monclient: dump: 2024-09-12T17:56:19.098 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:56:19.099 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:56:19.099 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.099 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:56:19.099 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:56:19.099 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:56:19.099 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:56:19.099 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:56:19.099 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:56:19.099 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.099 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 monclient: authenticate success, global_id 6702 2024-09-12T17:56:19.099 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T17:56:18.909+0000 7f66b8ff9640 4 set_mon_vals no callback set 2024-09-12T17:56:19.099 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: _renew_subs 2024-09-12T17:56:19.099 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:56:19.099 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: _renew_subs 2024-09-12T17:56:19.100 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T17:56:18.909+0000 7f67d78989c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:56:19.100 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T17:56:18.909+0000 7f67d78989c0 1 librados: init done 2024-09-12T17:56:19.100 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T17:56:18.909+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command cr dump hook 0x55f5a47b37b8 2024-09-12T17:56:19.100 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.100 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T17:56:18.913+0000 7f66a6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:56:19.100 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T17:56:18.913+0000 7f66a6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:56:19.100 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T17:56:18.913+0000 7f66a6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:56:19.100 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T17:56:18.913+0000 7f67d539e640 10 monclient: get_auth_request con 0x7f66a0070ae0 auth_method 0 2024-09-12T17:56:19.100 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T17:56:18.913+0000 7f67d4b9d640 10 monclient: get_auth_request con 0x55f5a47d50c0 auth_method 0 2024-09-12T17:56:19.100 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.100 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T17:56:18.913+0000 7f67d78989c0 20 realm 2024-09-12T17:56:19.100 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.100 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.100 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T17:56:18.913+0000 7f67d78989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:19.101 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.101 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.101 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T17:56:18.913+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.101 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T17:56:18.913+0000 7f67d539e640 10 monclient: get_auth_request con 0x55f5a47d9450 auth_method 0 2024-09-12T17:56:19.101 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T17:56:18.917+0000 7f67d78989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:19.101 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T17:56:18.917+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.101 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T17:56:18.917+0000 7f67d78989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:19.101 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T17:56:18.917+0000 7f67d78989c0 20 searching for the correct realm 2024-09-12T17:56:19.101 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T17:56:18.917+0000 7f67d4b9d640 10 monclient: get_auth_request con 0x55f5a47de5b0 auth_method 0 2024-09-12T17:56:19.101 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T17:56:18.917+0000 7f67d5b9f640 10 monclient: get_auth_request con 0x7f67cc064b20 auth_method 0 2024-09-12T17:56:19.101 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T17:56:18.917+0000 7f67d539e640 10 monclient: get_auth_request con 0x7f67d00791b0 auth_method 0 2024-09-12T17:56:19.101 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T17:56:18.921+0000 7f67d4b9d640 10 monclient: get_auth_request con 0x7f67c80e0020 auth_method 0 2024-09-12T17:56:19.101 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T17:56:18.921+0000 7f67d4b9d640 0 -- 172.21.15.98:0/1125680 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55f5a47d50c0 msgr2=0x55f5a47d7560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:19.101 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T17:56:18.921+0000 7f66a6ffd640 1 client.6702.objecter ms_handle_reset 0x55f5a47d50c0 session 0x55f5a47d4a40 osd.1 2024-09-12T17:56:19.102 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T17:56:18.921+0000 7f66a6ffd640 10 monclient: _renew_subs 2024-09-12T17:56:19.102 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T17:56:18.921+0000 7f66a6ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:56:19.102 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T17:56:18.921+0000 7f67d4b9d640 10 monclient: get_auth_request con 0x7f66a0081180 auth_method 0 2024-09-12T17:56:19.102 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T17:56:18.921+0000 7f67d5b9f640 10 monclient: get_auth_request con 0x7f67cc06d6c0 auth_method 0 2024-09-12T17:56:19.102 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T17:56:18.925+0000 7f67d539e640 10 monclient: get_auth_request con 0x7f67cc06b330 auth_method 0 2024-09-12T17:56:19.102 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T17:56:18.929+0000 7f67d4b9d640 0 -- 172.21.15.98:0/1125680 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f67c80e0020 msgr2=0x7f67c80f4440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:19.102 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T17:56:18.929+0000 7f66a6ffd640 1 client.6702.objecter ms_handle_reset 0x7f67c80e0020 session 0x7f67c80a6070 osd.4 2024-09-12T17:56:19.102 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T17:56:18.929+0000 7f67d4b9d640 10 monclient: get_auth_request con 0x55f5a47d50c0 auth_method 0 2024-09-12T17:56:19.102 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T17:56:18.933+0000 7f67d78989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:19.102 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T17:56:18.933+0000 7f67d78989c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:19.102 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T17:56:18.933+0000 7f67d78989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:19.102 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T17:56:18.933+0000 7f67d78989c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:19.102 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T17:56:18.933+0000 7f67d78989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:19.103 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T17:56:18.933+0000 7f67d78989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:19.103 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T17:56:18.933+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.103 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T17:56:18.933+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.103 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.103 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:19.103 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.103 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:19.103 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 zone default found 2024-09-12T17:56:19.103 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T17:56:18.937+0000 7f67d78989c0 4 Realm: () 2024-09-12T17:56:19.103 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T17:56:18.937+0000 7f67d78989c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:19.103 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T17:56:18.937+0000 7f67d78989c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:19.103 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T17:56:18.937+0000 7f67d78989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:19.103 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 zonegroup default 2024-09-12T17:56:19.103 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.103 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.104 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.104 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.104 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.104 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.104 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 started sync module instance, tier type = 2024-09-12T17:56:19.104 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T17:56:18.937+0000 7f67d78989c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:19.104 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=0 2024-09-12T17:56:19.104 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=1 2024-09-12T17:56:19.104 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=2 2024-09-12T17:56:19.104 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=3 2024-09-12T17:56:19.104 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=4 2024-09-12T17:56:19.104 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=5 2024-09-12T17:56:19.104 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=6 2024-09-12T17:56:19.105 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T17:56:18.957+0000 7f67d78989c0 20 add_watcher() i=7 2024-09-12T17:56:19.105 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T17:56:18.957+0000 7f67d78989c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:19.105 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding auth protocol: cephx 2024-09-12T17:56:19.105 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding auth protocol: cephx 2024-09-12T17:56:19.105 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding auth protocol: cephx 2024-09-12T17:56:19.105 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: secure 2024-09-12T17:56:19.105 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: crc 2024-09-12T17:56:19.105 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: secure 2024-09-12T17:56:19.105 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: crc 2024-09-12T17:56:19.105 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: secure 2024-09-12T17:56:19.105 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: crc 2024-09-12T17:56:19.105 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: crc 2024-09-12T17:56:19.105 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: secure 2024-09-12T17:56:19.106 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: crc 2024-09-12T17:56:19.106 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T17:56:18.961+0000 7f668b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:19.106 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: secure 2024-09-12T17:56:19.106 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: crc 2024-09-12T17:56:19.106 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 AuthRegistry(0x7ffeebd3ecb0) adding con mode: secure 2024-09-12T17:56:19.106 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T17:56:18.961+0000 7f67d78989c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:56:19.106 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T17:56:18.961+0000 7f67d78989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:19.106 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T17:56:18.961+0000 7f67d78989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:19.106 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command cache list hook 0x55f5a47b0890 2024-09-12T17:56:19.106 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command cache inspect hook 0x55f5a47b0890 2024-09-12T17:56:19.106 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command cache erase hook 0x55f5a47b0890 2024-09-12T17:56:19.106 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command cache zap hook 0x55f5a47b0890 2024-09-12T17:56:19.106 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 note: GC not initialized 2024-09-12T17:56:19.106 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T17:56:18.961+0000 7f668a7e4640 20 reqs_thread_entry: start 2024-09-12T17:56:19.107 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command sync trace show hook 0x7f67c80b94b0 2024-09-12T17:56:19.107 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command sync trace history hook 0x7f67c80b94b0 2024-09-12T17:56:19.107 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command sync trace active hook 0x7f67c80b94b0 2024-09-12T17:56:19.107 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T17:56:18.961+0000 7f67d78989c0 5 asok(0x55f5a44e12b0) register_command sync trace active_short hook 0x7f67c80b94b0 2024-09-12T17:56:19.107 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T17:56:18.961+0000 7f67d78989c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:19.107 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T17:56:18.961+0000 7f67d78989c0 20 Filter name: none 2024-09-12T17:56:19.107 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T17:56:18.961+0000 7f65fbfff640 20 reqs_thread_entry: start 2024-09-12T17:56:19.107 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T17:56:18.961+0000 7f67d78989c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:56:19.107 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T17:56:18.961+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.107 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T17:56:18.965+0000 7f67d78989c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:19.107 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T17:56:18.965+0000 7f67d78989c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:56:19.107 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T17:56:18.965+0000 7f67d78989c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:56:19.107 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T17:56:18.965+0000 7f67d78989c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 : miss 2024-09-12T17:56:19.108 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T17:56:18.965+0000 7f67d78989c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.108 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T17:56:18.965+0000 7f67d78989c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:19.108 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T17:56:18.965+0000 7f67d78989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 info.flags=0x17 2024-09-12T17:56:19.108 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T17:56:18.965+0000 7f67d78989c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 to cache LRU end 2024-09-12T17:56:19.108 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T17:56:18.965+0000 7f67d78989c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:19.108 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T17:56:18.965+0000 7f67d78989c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:19.108 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T17:56:18.965+0000 7f67d78989c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 2024-09-12T17:56:19.108 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T17:56:18.973+0000 7f67d78989c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f67d78989c0 time 2024-09-12T17:56:18.977813+0000 2024-09-12T17:56:19.108 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:56:19.108 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.108 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:19.108 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f67db1722eb] 2024-09-12T17:56:19.108 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f67db17249f] 2024-09-12T17:56:19.109 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f5a29e50c1] 2024-09-12T17:56:19.109 INFO:tasks.workunit.client.0.smithi098.stderr: 4: radosgw-admin(+0x140f6b8) [0x55f5a343a6b8] 2024-09-12T17:56:19.109 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f5a29f718d] 2024-09-12T17:56:19.109 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T17:56:19.109 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f67d9fd8d90] 2024-09-12T17:56:19.109 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T17:56:19.109 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T17:56:19.109 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.109 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T17:56:18.973+0000 7f67d78989c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:56:19.109 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f67d78989c0 thread_name:radosgw-admin 2024-09-12T17:56:19.109 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.109 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:56:19.109 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f67d9ff1520] 2024-09-12T17:56:19.110 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:56:19.110 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:56:19.110 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:56:19.110 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f67db172345] 2024-09-12T17:56:19.110 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f67db17249f] 2024-09-12T17:56:19.110 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f5a29e50c1] 2024-09-12T17:56:19.110 INFO:tasks.workunit.client.0.smithi098.stderr: 8: radosgw-admin(+0x140f6b8) [0x55f5a343a6b8] 2024-09-12T17:56:19.110 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f5a29f718d] 2024-09-12T17:56:19.110 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T17:56:19.110 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f67d9fd8d90] 2024-09-12T17:56:19.110 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T17:56:19.110 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T17:56:19.110 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:56:19.110 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.111 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T17:56:19.111 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T17:56:19.111 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T17:56:19.111 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T17:56:19.111 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T17:56:19.111 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T17:56:19.111 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T17:56:19.111 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T17:56:19.111 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T17:56:19.111 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T17:56:19.111 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T17:56:19.111 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T17:56:19.111 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T17:56:19.111 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T17:56:19.112 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T17:56:19.112 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T17:56:19.112 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T17:56:19.112 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T17:56:19.112 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T17:56:19.112 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T17:56:19.112 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T17:56:19.112 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T17:56:19.112 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T17:56:19.112 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T17:56:19.112 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:56:19.112 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T17:56:19.112 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T17:56:19.112 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T17:56:19.112 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T17:56:19.113 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T17:56:19.113 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T17:56:19.113 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T17:56:19.113 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T17:56:19.113 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T17:56:19.113 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T17:56:19.113 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T17:56:19.113 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T17:56:19.113 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T17:56:19.113 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T17:56:19.113 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T17:56:19.113 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T17:56:19.113 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T17:56:19.113 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T17:56:19.114 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T17:56:19.114 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T17:56:19.114 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T17:56:19.114 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:56:19.114 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T17:56:19.114 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:56:19.114 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T17:56:19.114 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T17:56:19.114 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T17:56:19.114 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T17:56:19.114 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T17:56:19.114 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T17:56:19.114 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T17:56:19.114 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T17:56:19.115 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T17:56:19.115 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T17:56:19.115 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T17:56:19.115 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T17:56:19.115 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T17:56:19.115 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T17:56:19.115 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T17:56:19.115 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T17:56:19.115 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T17:56:19.115 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T17:56:19.115 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:56:19.115 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T17:56:19.115 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:56:19.115 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T17:56:19.116 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T17:56:19.116 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T17:56:19.116 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T17:56:19.116 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T17:56:19.116 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T17:56:19.116 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:56:19.116 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T17:56:19.116 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T17:56:19.116 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:56:19.116 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T17:56:19.116 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T17:56:19.116 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T17:56:19.116 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T17:56:19.116 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T17:56:19.117 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T17:56:19.117 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T17:56:19.117 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T17:56:19.117 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T17:56:19.117 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T17:56:19.117 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T17:56:19.117 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T17:56:19.117 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T17:56:19.117 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:56:19.117 INFO:tasks.workunit.client.0.smithi098.stderr: 7f65fbfff640 / http_manager 2024-09-12T17:56:19.117 INFO:tasks.workunit.client.0.smithi098.stderr: 7f668a7e4640 / http_manager 2024-09-12T17:56:19.117 INFO:tasks.workunit.client.0.smithi098.stderr: 7f668b7e6640 / rgw_dt_lg_renew 2024-09-12T17:56:19.117 INFO:tasks.workunit.client.0.smithi098.stderr: 7f66a6ffd640 / ms_dispatch 2024-09-12T17:56:19.117 INFO:tasks.workunit.client.0.smithi098.stderr: 7f66b8ff9640 / io_context_pool 2024-09-12T17:56:19.118 INFO:tasks.workunit.client.0.smithi098.stderr: 7f66baffd640 / ms_dispatch 2024-09-12T17:56:19.118 INFO:tasks.workunit.client.0.smithi098.stderr: 7f66c1e03640 / ms_dispatch 2024-09-12T17:56:19.118 INFO:tasks.workunit.client.0.smithi098.stderr: 7f66c3606640 / io_context_pool 2024-09-12T17:56:19.118 INFO:tasks.workunit.client.0.smithi098.stderr: 7f67d4b9d640 / msgr-worker-2 2024-09-12T17:56:19.118 INFO:tasks.workunit.client.0.smithi098.stderr: 7f67d539e640 / msgr-worker-1 2024-09-12T17:56:19.118 INFO:tasks.workunit.client.0.smithi098.stderr: 7f67d5b9f640 / msgr-worker-0 2024-09-12T17:56:19.118 INFO:tasks.workunit.client.0.smithi098.stderr: 7f67d63a0640 / io_context_pool 2024-09-12T17:56:19.118 INFO:tasks.workunit.client.0.smithi098.stderr: 7f67d78989c0 / radosgw-admin 2024-09-12T17:56:19.118 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T17:56:19.118 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T17:56:19.118 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:56:18.980262Z_560bcfd1-80e8-4af5-97f7-beb4385f0e80/log 2024-09-12T17:56:19.118 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T17:56:19.118 INFO:tasks.workunit.client.0.smithi098.stderr:Aborted 2024-09-12T17:56:19.118 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:56:19.123 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:19.123 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:19.124 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.053+0000 7f6ed95d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.124 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.057+0000 7f6ed95d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.124 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.057+0000 7f6ed95d79c0 20 realm 2024-09-12T17:56:19.124 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.057+0000 7f6ed95d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.124 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.057+0000 7f6ed95d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.124 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.057+0000 7f6ed95d79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:19.124 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.057+0000 7f6ed95d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.124 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.057+0000 7f6ed95d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.124 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.057+0000 7f6ed95d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.124 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.057+0000 7f6ed95d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:19.124 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.057+0000 7f6ed95d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.124 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.057+0000 7f6ed95d79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:19.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.057+0000 7f6ed95d79c0 20 searching for the correct realm 2024-09-12T17:56:19.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.065+0000 7f6ed78de640 0 -- 172.21.15.98:0/3259158733 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x560c438f32d0 msgr2=0x560c438f56c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:19.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.069+0000 7f6ed70dd640 0 -- 172.21.15.98:0/3259158733 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f6ecc008040 msgr2=0x7f6ecc052400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:19.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.077+0000 7f6ed95d79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:19.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.077+0000 7f6ed95d79c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:19.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.077+0000 7f6ed95d79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:19.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.077+0000 7f6ed95d79c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:19.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.077+0000 7f6ed95d79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:19.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.077+0000 7f6ed95d79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:19.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.077+0000 7f6ed95d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.077+0000 7f6ed95d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.077+0000 7f6ed95d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.077+0000 7f6ed95d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:19.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.077+0000 7f6ed95d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.081+0000 7f6ed95d79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:19.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.081+0000 7f6ed95d79c0 20 zone default found 2024-09-12T17:56:19.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.081+0000 7f6ed95d79c0 4 Realm: () 2024-09-12T17:56:19.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.081+0000 7f6ed95d79c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:19.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.081+0000 7f6ed95d79c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:19.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.081+0000 7f6ed95d79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:19.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.081+0000 7f6ed95d79c0 20 zonegroup default 2024-09-12T17:56:19.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.081+0000 7f6ed95d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.081+0000 7f6ed95d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.081+0000 7f6ed95d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.081+0000 7f6ed95d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.081+0000 7f6ed95d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.081+0000 7f6ed95d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.081+0000 7f6ed95d79c0 20 started sync module instance, tier type = 2024-09-12T17:56:19.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.081+0000 7f6ed95d79c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:19.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.097+0000 7f6ed95d79c0 20 add_watcher() i=0 2024-09-12T17:56:19.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.097+0000 7f6ed95d79c0 20 add_watcher() i=1 2024-09-12T17:56:19.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.097+0000 7f6ed95d79c0 20 add_watcher() i=2 2024-09-12T17:56:19.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.097+0000 7f6ed95d79c0 20 add_watcher() i=3 2024-09-12T17:56:19.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.097+0000 7f6ed95d79c0 20 add_watcher() i=4 2024-09-12T17:56:19.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.097+0000 7f6ed95d79c0 20 add_watcher() i=5 2024-09-12T17:56:19.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.097+0000 7f6ed95d79c0 20 add_watcher() i=6 2024-09-12T17:56:19.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.097+0000 7f6ed95d79c0 20 add_watcher() i=7 2024-09-12T17:56:19.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.097+0000 7f6ed95d79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:19.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.097+0000 7f6d8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:19.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.101+0000 7f6ed95d79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:19.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.101+0000 7f6ed95d79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:19.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.101+0000 7f6ed95d79c0 5 note: GC not initialized 2024-09-12T17:56:19.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.101+0000 7f6d8cfe1640 20 reqs_thread_entry: start 2024-09-12T17:56:19.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.101+0000 7f6ed95d79c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:19.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.101+0000 7f6ed95d79c0 20 Filter name: none 2024-09-12T17:56:19.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.101+0000 7f6d067fc640 20 reqs_thread_entry: start 2024-09-12T17:56:19.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.101+0000 7f6ed95d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.101+0000 7f6ed95d79c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:19.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.101+0000 7f6ed95d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.101+0000 7f6ed95d79c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:19.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.101+0000 7f6ed95d79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:19.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.101+0000 7f6ed95d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.101+0000 7f6ed95d79c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:19.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.101+0000 7f6ed95d79c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.101+0000 7f6ed95d79c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:19.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.101+0000 7f6ed95d79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:19.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.105+0000 7f6d8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:19.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.109+0000 7f6ed95d79c0 20 remove_watcher() i=0 2024-09-12T17:56:19.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.109+0000 7f6ed95d79c0 2 removed watcher, disabling cache 2024-09-12T17:56:19.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.113+0000 7f6ed95d79c0 20 remove_watcher() i=1 2024-09-12T17:56:19.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.113+0000 7f6ed95d79c0 20 remove_watcher() i=2 2024-09-12T17:56:19.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.117+0000 7f6ed95d79c0 20 remove_watcher() i=3 2024-09-12T17:56:19.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.117+0000 7f6ed95d79c0 20 remove_watcher() i=4 2024-09-12T17:56:19.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.121+0000 7f6ed95d79c0 20 remove_watcher() i=5 2024-09-12T17:56:19.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.121+0000 7f6ed95d79c0 20 remove_watcher() i=6 2024-09-12T17:56:19.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.121+0000 7f6ed95d79c0 20 remove_watcher() i=7 2024-09-12T17:56:19.137 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.137 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:56:19.137 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-set-target-layout id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:56:19.137 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:19.138 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:19.138 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:19.178 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:19.178 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:19.236 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:56:19.270 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:19.270 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:19.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.309+0000 7f80963079c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.313+0000 7f80963079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.313+0000 7f80963079c0 20 realm 2024-09-12T17:56:19.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.313+0000 7f80963079c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.313+0000 7f80963079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.316 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.313+0000 7f80963079c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:19.316 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.313+0000 7f80963079c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.316 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.313+0000 7f80963079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.316 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.313+0000 7f80963079c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.313+0000 7f80963079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:19.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.313+0000 7f80963079c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.313+0000 7f80963079c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:19.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.313+0000 7f80963079c0 20 searching for the correct realm 2024-09-12T17:56:19.323 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.321+0000 7f809460e640 0 -- 172.21.15.98:0/31170269 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f8088008040 msgr2=0x7f8088035970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:19.540 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.537+0000 7f8093e0d640 0 -- 172.21.15.98:0/31170269 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x55be9233fe20 msgr2=0x55be92342210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:19.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.545+0000 7f80963079c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:19.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.545+0000 7f80963079c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:19.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.545+0000 7f80963079c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:19.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.545+0000 7f80963079c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:19.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.545+0000 7f80963079c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:19.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.545+0000 7f80963079c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:19.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.545+0000 7f80963079c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.545+0000 7f80963079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.545+0000 7f80963079c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.545+0000 7f80963079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:19.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.545+0000 7f80963079c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.549+0000 7f80963079c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:19.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.549+0000 7f80963079c0 20 zone default found 2024-09-12T17:56:19.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.549+0000 7f80963079c0 4 Realm: () 2024-09-12T17:56:19.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.549+0000 7f80963079c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:19.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.549+0000 7f80963079c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:19.551 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.549+0000 7f80963079c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:19.551 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.549+0000 7f80963079c0 20 zonegroup default 2024-09-12T17:56:19.551 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.549+0000 7f80963079c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.551 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.549+0000 7f80963079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.551 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.549+0000 7f80963079c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.549+0000 7f80963079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.549+0000 7f80963079c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.549+0000 7f80963079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:19.553 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.549+0000 7f80963079c0 20 started sync module instance, tier type = 2024-09-12T17:56:19.553 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.549+0000 7f80963079c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:19.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.573+0000 7f80963079c0 20 add_watcher() i=0 2024-09-12T17:56:19.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.573+0000 7f80963079c0 20 add_watcher() i=1 2024-09-12T17:56:19.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.573+0000 7f80963079c0 20 add_watcher() i=2 2024-09-12T17:56:19.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.573+0000 7f80963079c0 20 add_watcher() i=3 2024-09-12T17:56:19.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.573+0000 7f80963079c0 20 add_watcher() i=4 2024-09-12T17:56:19.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.573+0000 7f80963079c0 20 add_watcher() i=5 2024-09-12T17:56:19.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.573+0000 7f80963079c0 20 add_watcher() i=6 2024-09-12T17:56:19.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.573+0000 7f80963079c0 20 add_watcher() i=7 2024-09-12T17:56:19.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.573+0000 7f80963079c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:19.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.577+0000 7f7f49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:19.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.577+0000 7f80963079c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:19.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.577+0000 7f80963079c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:19.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.577+0000 7f80963079c0 5 note: GC not initialized 2024-09-12T17:56:19.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.577+0000 7f7f48fe1640 20 reqs_thread_entry: start 2024-09-12T17:56:19.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.577+0000 7f80963079c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:19.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.577+0000 7f80963079c0 20 Filter name: none 2024-09-12T17:56:19.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.577+0000 7f7ec27fc640 20 reqs_thread_entry: start 2024-09-12T17:56:19.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.577+0000 7f80963079c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:56:19.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.577+0000 7f80963079c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.581+0000 7f80963079c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:19.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.581+0000 7f80963079c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:56:19.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.581+0000 7f80963079c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:56:19.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.581+0000 7f80963079c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 : miss 2024-09-12T17:56:19.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.581+0000 7f80963079c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:19.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.581+0000 7f80963079c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:19.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.581+0000 7f80963079c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 info.flags=0x17 2024-09-12T17:56:19.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.581+0000 7f80963079c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 to cache LRU end 2024-09-12T17:56:19.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.581+0000 7f80963079c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:19.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.581+0000 7f80963079c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:19.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.581+0000 7f80963079c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 2024-09-12T17:56:19.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.581+0000 7f80963079c0 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 to be held by another RGW process; skipping for now 2024-09-12T17:56:19.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.585+0000 7f7f49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:19.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.589+0000 7f80963079c0 20 remove_watcher() i=0 2024-09-12T17:56:19.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.589+0000 7f80963079c0 2 removed watcher, disabling cache 2024-09-12T17:56:19.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.589+0000 7f80963079c0 20 remove_watcher() i=1 2024-09-12T17:56:19.595 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.593+0000 7f80963079c0 20 remove_watcher() i=2 2024-09-12T17:56:19.598 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.597+0000 7f80963079c0 20 remove_watcher() i=3 2024-09-12T17:56:19.600 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.597+0000 7f80963079c0 20 remove_watcher() i=4 2024-09-12T17:56:19.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.597+0000 7f80963079c0 20 remove_watcher() i=5 2024-09-12T17:56:19.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.601+0000 7f80963079c0 20 remove_watcher() i=6 2024-09-12T17:56:19.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:19.601+0000 7f80963079c0 20 remove_watcher() i=7 2024-09-12T17:56:19.620 INFO:tasks.workunit.client.0.smithi098.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:56:49.649 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:56:49.686 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:49.686 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:49.730 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.728+0000 7efcaa9169c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.732 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.728+0000 7efcaa9169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.733 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.728+0000 7efcaa9169c0 20 realm 2024-09-12T17:56:49.733 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.728+0000 7efcaa9169c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.733 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.728+0000 7efcaa9169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.733 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.728+0000 7efcaa9169c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:49.733 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.728+0000 7efcaa9169c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.733 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.728+0000 7efcaa9169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.733 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.728+0000 7efcaa9169c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.732+0000 7efcaa9169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:49.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.732+0000 7efcaa9169c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.732+0000 7efcaa9169c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:49.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.732+0000 7efcaa9169c0 20 searching for the correct realm 2024-09-12T17:56:49.740 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.736+0000 7efca8c1d640 0 -- 172.21.15.98:0/4268779323 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55e271510580 msgr2=0x55e271512a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:49.746 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.744+0000 7efca841c640 0 -- 172.21.15.98:0/4268779323 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7efc900eb3a0 msgr2=0x7efc900eb820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:49.754 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:49.754 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:49.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:49.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:49.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:49.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:49.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:49.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:49.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 zone default found 2024-09-12T17:56:49.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 4 Realm: () 2024-09-12T17:56:49.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:49.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:49.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:49.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 zonegroup default 2024-09-12T17:56:49.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 started sync module instance, tier type = 2024-09-12T17:56:49.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.752+0000 7efcaa9169c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:49.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.768+0000 7efcaa9169c0 20 add_watcher() i=0 2024-09-12T17:56:49.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.768+0000 7efcaa9169c0 20 add_watcher() i=1 2024-09-12T17:56:49.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.768+0000 7efcaa9169c0 20 add_watcher() i=2 2024-09-12T17:56:49.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.768+0000 7efcaa9169c0 20 add_watcher() i=3 2024-09-12T17:56:49.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.768+0000 7efcaa9169c0 20 add_watcher() i=4 2024-09-12T17:56:49.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.768+0000 7efcaa9169c0 20 add_watcher() i=5 2024-09-12T17:56:49.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.768+0000 7efcaa9169c0 20 add_watcher() i=6 2024-09-12T17:56:49.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.772+0000 7efcaa9169c0 20 add_watcher() i=7 2024-09-12T17:56:49.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.772+0000 7efcaa9169c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:49.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.772+0000 7efb5efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:49.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.772+0000 7efcaa9169c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:49.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.772+0000 7efcaa9169c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:49.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.772+0000 7efcaa9169c0 5 note: GC not initialized 2024-09-12T17:56:49.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.772+0000 7efb5dfe3640 20 reqs_thread_entry: start 2024-09-12T17:56:49.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.772+0000 7efcaa9169c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:49.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.776+0000 7efcaa9169c0 20 Filter name: none 2024-09-12T17:56:49.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.776+0000 7efb56ffd640 20 reqs_thread_entry: start 2024-09-12T17:56:49.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.776+0000 7efcaa9169c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T17:56:49.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.776+0000 7efcaa9169c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.776+0000 7efcaa9169c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:49.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.776+0000 7efcaa9169c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T17:56:49.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.776+0000 7efcaa9169c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T17:56:49.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.776+0000 7efcaa9169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 : miss 2024-09-12T17:56:49.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.776+0000 7efcaa9169c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.776+0000 7efcaa9169c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:49.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.776+0000 7efcaa9169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 info.flags=0x17 2024-09-12T17:56:49.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.776+0000 7efcaa9169c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 to cache LRU end 2024-09-12T17:56:49.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.776+0000 7efcaa9169c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:49.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.776+0000 7efcaa9169c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:49.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.776+0000 7efcaa9169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 2024-09-12T17:56:49.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.784+0000 7efcaa9169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 info.flags=0x17 2024-09-12T17:56:49.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.784+0000 7efcaa9169c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 to cache LRU end 2024-09-12T17:56:49.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.784+0000 7efcaa9169c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:49.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.784+0000 7efcaa9169c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24, ofs0, ns] 2024-09-12T17:56:49.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.784+0000 7efb86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366157 cookie 94431052176528 notifier 6753 bl.length()=925 2024-09-12T17:56:49.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.784+0000 7efb86ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 info.flags=0x17 2024-09-12T17:56:49.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.784+0000 7efb86ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 to cache LRU end 2024-09-12T17:56:49.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.784+0000 7efb86ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:49.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.788+0000 7efcaa9169c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.24]): orig_sources= new_sources= 2024-09-12T17:56:49.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.788+0000 7efcaa9169c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.24]): potential sources added=[] removed=[] 2024-09-12T17:56:49.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.788+0000 7efcaa9169c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.24]): orig_dests= new_dests= 2024-09-12T17:56:49.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.788+0000 7efcaa9169c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.24]): potential dests added=[] removed=[] 2024-09-12T17:56:49.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.0 2024-09-12T17:56:49.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.0 2024-09-12T17:56:49.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.1 2024-09-12T17:56:49.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.1 2024-09-12T17:56:49.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.2 2024-09-12T17:56:49.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.2 2024-09-12T17:56:49.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.3 2024-09-12T17:56:49.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.3 2024-09-12T17:56:49.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.4 2024-09-12T17:56:49.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.4 2024-09-12T17:56:49.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.5 2024-09-12T17:56:49.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.5 2024-09-12T17:56:49.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.6 2024-09-12T17:56:49.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.6 2024-09-12T17:56:49.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.7 2024-09-12T17:56:49.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.7 2024-09-12T17:56:49.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.8 2024-09-12T17:56:49.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.8 2024-09-12T17:56:49.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.9 2024-09-12T17:56:49.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.9 2024-09-12T17:56:49.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.10 2024-09-12T17:56:49.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.10 2024-09-12T17:56:49.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.11 2024-09-12T17:56:49.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1.11 2024-09-12T17:56:49.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.796+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.0 2024-09-12T17:56:49.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.800+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1 2024-09-12T17:56:49.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.800+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.2 2024-09-12T17:56:49.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.800+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.3 2024-09-12T17:56:49.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.804+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.4 2024-09-12T17:56:49.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.804+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.5 2024-09-12T17:56:49.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.804+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.6 2024-09-12T17:56:49.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.804+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.7 2024-09-12T17:56:49.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.808+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.8 2024-09-12T17:56:49.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.808+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.9 2024-09-12T17:56:49.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.808+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.10 2024-09-12T17:56:49.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.816+0000 7efcaa9169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:49.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.816+0000 7efcaa9169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 2024-09-12T17:56:49.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.816+0000 7efcaa9169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 info.flags=0x17 2024-09-12T17:56:49.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.816+0000 7efcaa9169c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 to cache LRU end 2024-09-12T17:56:49.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.816+0000 7efcaa9169c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:49.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.816+0000 7efcaa9169c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24, ofs0, ns] 2024-09-12T17:56:49.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.816+0000 7efb877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366158 cookie 94431052176528 notifier 6753 bl.length()=925 2024-09-12T17:56:49.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.816+0000 7efb877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 info.flags=0x17 2024-09-12T17:56:49.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.816+0000 7efb877fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 to cache LRU end 2024-09-12T17:56:49.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.816+0000 7efb877fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:49.822 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.820+0000 7efcaa9169c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.24]): orig_sources= new_sources= 2024-09-12T17:56:49.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.820+0000 7efcaa9169c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.24]): potential sources added=[] removed=[] 2024-09-12T17:56:49.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.820+0000 7efcaa9169c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.24]): orig_dests= new_dests= 2024-09-12T17:56:49.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.820+0000 7efcaa9169c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.24]): potential dests added=[] removed=[] 2024-09-12T17:56:49.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.824+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.0 2024-09-12T17:56:49.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.824+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.1 2024-09-12T17:56:49.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.828+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.2 2024-09-12T17:56:49.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.828+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.3 2024-09-12T17:56:49.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.828+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.4 2024-09-12T17:56:49.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.828+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.5 2024-09-12T17:56:49.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.828+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.6 2024-09-12T17:56:49.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.832+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.7 2024-09-12T17:56:49.835 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.832+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.8 2024-09-12T17:56:49.835 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.832+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.9 2024-09-12T17:56:49.836 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.832+0000 7efcaa9169c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.24.10 2024-09-12T17:56:49.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.832+0000 7efcaa9169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:49.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.832+0000 7efcaa9169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 2024-09-12T17:56:49.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.836+0000 7efcaa9169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 info.flags=0x17 2024-09-12T17:56:49.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.836+0000 7efcaa9169c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 to cache LRU end 2024-09-12T17:56:49.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.836+0000 7efcaa9169c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:49.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.836+0000 7efcaa9169c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24, ofs0, ns] 2024-09-12T17:56:49.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.836+0000 7efb86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366159 cookie 94431052176528 notifier 6753 bl.length()=893 2024-09-12T17:56:49.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.836+0000 7efb86ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 info.flags=0x17 2024-09-12T17:56:49.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.836+0000 7efb86ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 to cache LRU end 2024-09-12T17:56:49.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.836+0000 7efb86ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:49.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.836+0000 7efcaa9169c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.24]): orig_sources= new_sources= 2024-09-12T17:56:49.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.836+0000 7efcaa9169c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.24]): potential sources added=[] removed=[] 2024-09-12T17:56:49.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.836+0000 7efcaa9169c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.24]): orig_dests= new_dests= 2024-09-12T17:56:49.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.836+0000 7efcaa9169c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.24]): potential dests added=[] removed=[] 2024-09-12T17:56:49.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.844+0000 7efcaa9169c0 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:56:49.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.848+0000 7efb5efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:49.865 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.852+0000 7efcaa9169c0 20 remove_watcher() i=0 2024-09-12T17:56:49.865 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.852+0000 7efcaa9169c0 2 removed watcher, disabling cache 2024-09-12T17:56:49.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.856+0000 7efcaa9169c0 20 remove_watcher() i=1 2024-09-12T17:56:49.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.856+0000 7efcaa9169c0 20 remove_watcher() i=2 2024-09-12T17:56:49.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.860+0000 7efcaa9169c0 20 remove_watcher() i=3 2024-09-12T17:56:49.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.860+0000 7efcaa9169c0 20 remove_watcher() i=4 2024-09-12T17:56:49.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.864+0000 7efcaa9169c0 20 remove_watcher() i=5 2024-09-12T17:56:49.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.864+0000 7efcaa9169c0 20 remove_watcher() i=6 2024-09-12T17:56:49.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.864+0000 7efcaa9169c0 20 remove_watcher() i=7 2024-09-12T17:56:49.885 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T17:56:49.912 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:49.913 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:49.957 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.952+0000 7f59a30959c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.956+0000 7f59a30959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.956+0000 7f59a30959c0 20 realm 2024-09-12T17:56:49.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.956+0000 7f59a30959c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.956+0000 7f59a30959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.956+0000 7f59a30959c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:49.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.956+0000 7f59a30959c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.956+0000 7f59a30959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.956+0000 7f59a30959c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.956+0000 7f59a30959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:49.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.956+0000 7f59a30959c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.956+0000 7f59a30959c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:49.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.956+0000 7f59a30959c0 20 searching for the correct realm 2024-09-12T17:56:49.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.964+0000 7f59a039a640 0 -- 172.21.15.98:0/1016112420 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x561a6448d150 msgr2=0x561a6448f540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:49.975 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.972+0000 7f59a0b9b640 0 -- 172.21.15.98:0/1016112420 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f599412c1b0 msgr2=0x7f599412c630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:49.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.976+0000 7f59a30959c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:49.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.976+0000 7f59a30959c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:49.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.976+0000 7f59a30959c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:49.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.976+0000 7f59a30959c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:49.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.976+0000 7f59a30959c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:49.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.976+0000 7f59a30959c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:49.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.976+0000 7f59a30959c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.976+0000 7f59a30959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.976+0000 7f59a30959c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.980+0000 7f59a30959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:49.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.980+0000 7f59a30959c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.980+0000 7f59a30959c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:49.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.980+0000 7f59a30959c0 20 zone default found 2024-09-12T17:56:49.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.980+0000 7f59a30959c0 4 Realm: () 2024-09-12T17:56:49.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.980+0000 7f59a30959c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:49.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.980+0000 7f59a30959c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:49.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.980+0000 7f59a30959c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:49.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.980+0000 7f59a30959c0 20 zonegroup default 2024-09-12T17:56:49.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.980+0000 7f59a30959c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.980+0000 7f59a30959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.980+0000 7f59a30959c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.980+0000 7f59a30959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.980+0000 7f59a30959c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:49.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.980+0000 7f59a30959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:49.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.980+0000 7f59a30959c0 20 started sync module instance, tier type = 2024-09-12T17:56:49.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.980+0000 7f59a30959c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:50.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.996+0000 7f59a30959c0 20 add_watcher() i=0 2024-09-12T17:56:50.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.996+0000 7f59a30959c0 20 add_watcher() i=1 2024-09-12T17:56:50.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.996+0000 7f59a30959c0 20 add_watcher() i=2 2024-09-12T17:56:50.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.996+0000 7f59a30959c0 20 add_watcher() i=3 2024-09-12T17:56:50.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.996+0000 7f59a30959c0 20 add_watcher() i=4 2024-09-12T17:56:50.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.996+0000 7f59a30959c0 20 add_watcher() i=5 2024-09-12T17:56:50.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:49.996+0000 7f59a30959c0 20 add_watcher() i=6 2024-09-12T17:56:50.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.000+0000 7f59a30959c0 20 add_watcher() i=7 2024-09-12T17:56:50.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.000+0000 7f59a30959c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:50.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.000+0000 7f58577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:50.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.000+0000 7f59a30959c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:50.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.000+0000 7f59a30959c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:50.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.000+0000 7f59a30959c0 5 note: GC not initialized 2024-09-12T17:56:50.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.000+0000 7f58567e4640 20 reqs_thread_entry: start 2024-09-12T17:56:50.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.000+0000 7f59a30959c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:50.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.000+0000 7f59a30959c0 20 Filter name: none 2024-09-12T17:56:50.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.000+0000 7f584f7fe640 20 reqs_thread_entry: start 2024-09-12T17:56:50.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.000+0000 7f59a30959c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.004+0000 7f59a30959c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:50.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.004+0000 7f59a30959c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.004+0000 7f59a30959c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:50.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.004+0000 7f59a30959c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:50.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.004+0000 7f59a30959c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.004+0000 7f59a30959c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T17:56:50.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.004+0000 7f59a30959c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:50.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.004+0000 7f59a30959c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T17:56:50.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.004+0000 7f59a30959c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:50.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.008+0000 7f58577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:50.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.012+0000 7f59a30959c0 20 remove_watcher() i=0 2024-09-12T17:56:50.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.012+0000 7f59a30959c0 2 removed watcher, disabling cache 2024-09-12T17:56:50.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.016+0000 7f59a30959c0 20 remove_watcher() i=1 2024-09-12T17:56:50.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.016+0000 7f59a30959c0 20 remove_watcher() i=2 2024-09-12T17:56:50.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.020+0000 7f59a30959c0 20 remove_watcher() i=3 2024-09-12T17:56:50.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.020+0000 7f59a30959c0 20 remove_watcher() i=4 2024-09-12T17:56:50.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.020+0000 7f59a30959c0 20 remove_watcher() i=5 2024-09-12T17:56:50.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.024+0000 7f59a30959c0 20 remove_watcher() i=6 2024-09-12T17:56:50.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:50.024+0000 7f59a30959c0 20 remove_watcher() i=7 2024-09-12T17:56:50.041 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:50.042 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:56:50.042 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-set-target-layout id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:56:50.042 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:50.042 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:50.042 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:50.061 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:50.061 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:50.559 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:50.559 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:50.946 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T17:56:50.947 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:50.950 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:50.950 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:51.084 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:51.084 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:51.171 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:51.171 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:51.273 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:51.273 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:51.371 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:51.371 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:51.463 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:51.464 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:51.558 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:51.558 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:51.661 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:51.661 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:51.761 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:51.761 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:51.860 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:51.860 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:51.959 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:51.959 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:52.058 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:52.058 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:52.157 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:52.157 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:52.306 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:52.306 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:52.412 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:52.412 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:52.520 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:52.520 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:52.621 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:52.621 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:52.719 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:52.719 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:52.816 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:52.816 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:52.915 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:52.915 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:53.013 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:53.013 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:53.102 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:53.103 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:53.200 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:56:53.232 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:53.232 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:53.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.272+0000 7f54640859c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.276+0000 7f54640859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.276+0000 7f54640859c0 20 realm 2024-09-12T17:56:53.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.276+0000 7f54640859c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.276+0000 7f54640859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.276+0000 7f54640859c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:53.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.276+0000 7f54640859c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.276+0000 7f54640859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.276+0000 7f54640859c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.276+0000 7f54640859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:53.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.276+0000 7f54640859c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.276+0000 7f54640859c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:53.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.276+0000 7f54640859c0 20 searching for the correct realm 2024-09-12T17:56:53.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.284+0000 7f546138a640 0 -- 172.21.15.98:0/3694219386 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x5633f864bc20 msgr2=0x5633f864e070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:53.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.288+0000 7f546138a640 0 -- 172.21.15.98:0/3694219386 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f545403f040 msgr2=0x7f5454008460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:53.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:53.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:53.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:53.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:53.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:53.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:53.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:53.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:53.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 zone default found 2024-09-12T17:56:53.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 4 Realm: () 2024-09-12T17:56:53.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:53.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:53.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:53.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 zonegroup default 2024-09-12T17:56:53.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 started sync module instance, tier type = 2024-09-12T17:56:53.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.300+0000 7f54640859c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:53.322 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.316+0000 7f54640859c0 20 add_watcher() i=0 2024-09-12T17:56:53.322 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.316+0000 7f54640859c0 20 add_watcher() i=1 2024-09-12T17:56:53.322 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.316+0000 7f54640859c0 20 add_watcher() i=2 2024-09-12T17:56:53.322 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.316+0000 7f54640859c0 20 add_watcher() i=3 2024-09-12T17:56:53.322 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.316+0000 7f54640859c0 20 add_watcher() i=4 2024-09-12T17:56:53.322 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.316+0000 7f54640859c0 20 add_watcher() i=5 2024-09-12T17:56:53.322 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.316+0000 7f54640859c0 20 add_watcher() i=6 2024-09-12T17:56:53.323 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.320+0000 7f54640859c0 20 add_watcher() i=7 2024-09-12T17:56:53.323 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.320+0000 7f54640859c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:53.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.320+0000 7f5317fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:53.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.320+0000 7f54640859c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:53.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.320+0000 7f54640859c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:53.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.320+0000 7f54640859c0 5 note: GC not initialized 2024-09-12T17:56:53.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.324+0000 7f5316fe5640 20 reqs_thread_entry: start 2024-09-12T17:56:53.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.324+0000 7f54640859c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:53.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.324+0000 7f54640859c0 20 Filter name: none 2024-09-12T17:56:53.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.324+0000 7f5314fe1640 20 reqs_thread_entry: start 2024-09-12T17:56:53.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.324+0000 7f54640859c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.324+0000 7f54640859c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:53.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.324+0000 7f54640859c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.324+0000 7f54640859c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:53.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.324+0000 7f54640859c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:53.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.324+0000 7f54640859c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.324+0000 7f54640859c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:53.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.324+0000 7f54640859c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.328+0000 7f54640859c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:53.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.328+0000 7f54640859c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:53.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.328+0000 7f5317fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:53.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.336+0000 7f54640859c0 20 remove_watcher() i=0 2024-09-12T17:56:53.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.336+0000 7f54640859c0 2 removed watcher, disabling cache 2024-09-12T17:56:53.340 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.336+0000 7f54640859c0 20 remove_watcher() i=1 2024-09-12T17:56:53.342 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.340+0000 7f54640859c0 20 remove_watcher() i=2 2024-09-12T17:56:53.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.340+0000 7f54640859c0 20 remove_watcher() i=3 2024-09-12T17:56:53.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.344+0000 7f54640859c0 20 remove_watcher() i=4 2024-09-12T17:56:53.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.344+0000 7f54640859c0 20 remove_watcher() i=5 2024-09-12T17:56:53.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.344+0000 7f54640859c0 20 remove_watcher() i=6 2024-09-12T17:56:53.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.348+0000 7f54640859c0 20 remove_watcher() i=7 2024-09-12T17:56:53.364 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:53.364 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:56:53.365 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-trim-reshard-log-entries id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:56:53.365 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:53.365 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T17:56:53.397 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:53.397 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:53.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.440+0000 7f65c0bfa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.440+0000 7f65c0bfa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.440+0000 7f65c0bfa9c0 20 realm 2024-09-12T17:56:53.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.440+0000 7f65c0bfa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.440+0000 7f65c0bfa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.440+0000 7f65c0bfa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:53.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.440+0000 7f65c0bfa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.440+0000 7f65c0bfa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.440+0000 7f65c0bfa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.444+0000 7f65c0bfa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:53.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.444+0000 7f65c0bfa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.444+0000 7f65c0bfa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:53.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.444+0000 7f65c0bfa9c0 20 searching for the correct realm 2024-09-12T17:56:53.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.448+0000 7f65bef01640 0 -- 172.21.15.98:0/3990365308 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55ea9c471500 msgr2=0x55ea9c473960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:53.458 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.456+0000 7f65be700640 0 -- 172.21.15.98:0/3990365308 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f65a8008070 msgr2=0x7f65a8055910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:53.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:53.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:53.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:53.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:53.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:53.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:53.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:53.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:53.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 zone default found 2024-09-12T17:56:53.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 4 Realm: () 2024-09-12T17:56:53.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:53.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:53.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:53.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 zonegroup default 2024-09-12T17:56:53.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 started sync module instance, tier type = 2024-09-12T17:56:53.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.464+0000 7f65c0bfa9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:53.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.480+0000 7f65c0bfa9c0 20 add_watcher() i=0 2024-09-12T17:56:53.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.480+0000 7f65c0bfa9c0 20 add_watcher() i=1 2024-09-12T17:56:53.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.480+0000 7f65c0bfa9c0 20 add_watcher() i=2 2024-09-12T17:56:53.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.480+0000 7f65c0bfa9c0 20 add_watcher() i=3 2024-09-12T17:56:53.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.480+0000 7f65c0bfa9c0 20 add_watcher() i=4 2024-09-12T17:56:53.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.480+0000 7f65c0bfa9c0 20 add_watcher() i=5 2024-09-12T17:56:53.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.480+0000 7f65c0bfa9c0 20 add_watcher() i=6 2024-09-12T17:56:53.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.480+0000 7f65c0bfa9c0 20 add_watcher() i=7 2024-09-12T17:56:53.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.480+0000 7f65c0bfa9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:53.488 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.484+0000 7f6474fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:53.489 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.484+0000 7f65c0bfa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:53.489 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.484+0000 7f65c0bfa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:53.489 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.484+0000 7f65c0bfa9c0 5 note: GC not initialized 2024-09-12T17:56:53.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.484+0000 7f63ef7fe640 20 reqs_thread_entry: start 2024-09-12T17:56:53.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.484+0000 7f65c0bfa9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:53.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.484+0000 7f65c0bfa9c0 20 Filter name: none 2024-09-12T17:56:53.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.484+0000 7f63ed7fa640 20 reqs_thread_entry: start 2024-09-12T17:56:53.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.484+0000 7f65c0bfa9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:56:53.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.484+0000 7f65c0bfa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.488+0000 7f65c0bfa9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:53.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.488+0000 7f65c0bfa9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:56:53.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.488+0000 7f65c0bfa9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:56:53.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.488+0000 7f65c0bfa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 : miss 2024-09-12T17:56:53.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.488+0000 7f65c0bfa9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.488+0000 7f65c0bfa9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:53.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.488+0000 7f65c0bfa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 info.flags=0x17 2024-09-12T17:56:53.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.488+0000 7f65c0bfa9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 to cache LRU end 2024-09-12T17:56:53.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.488+0000 7f65c0bfa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:53.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.488+0000 7f65c0bfa9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:53.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.488+0000 7f65c0bfa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 2024-09-12T17:56:53.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.496+0000 7f65c0bfa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 info.flags=0x17 2024-09-12T17:56:53.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.496+0000 7f65c0bfa9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 to cache LRU end 2024-09-12T17:56:53.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.496+0000 7f65c0bfa9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:53.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.496+0000 7f65c0bfa9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25, ofs0, ns] 2024-09-12T17:56:53.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.496+0000 7f64a17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366198 cookie 94466132620704 notifier 6347 bl.length()=939 2024-09-12T17:56:53.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.496+0000 7f64a17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 info.flags=0x17 2024-09-12T17:56:53.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.496+0000 7f64a17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 to cache LRU end 2024-09-12T17:56:53.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.496+0000 7f64a17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:53.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.500+0000 7f65c0bfa9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.25]): orig_sources= new_sources= 2024-09-12T17:56:53.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.500+0000 7f65c0bfa9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.25]): potential sources added=[] removed=[] 2024-09-12T17:56:53.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.500+0000 7f65c0bfa9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.25]): orig_dests= new_dests= 2024-09-12T17:56:53.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.500+0000 7f65c0bfa9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.25]): potential dests added=[] removed=[] 2024-09-12T17:56:53.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.500+0000 7f65c0bfa9c0 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T17:56:53.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.500+0000 7f65c0bfa9c0 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T17:56:53.507 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.504+0000 7f6474fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:53.511 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.508+0000 7f65c0bfa9c0 20 remove_watcher() i=0 2024-09-12T17:56:53.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.508+0000 7f65c0bfa9c0 2 removed watcher, disabling cache 2024-09-12T17:56:53.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.512+0000 7f65c0bfa9c0 20 remove_watcher() i=1 2024-09-12T17:56:53.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.512+0000 7f65c0bfa9c0 20 remove_watcher() i=2 2024-09-12T17:56:53.518 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.516+0000 7f65c0bfa9c0 20 remove_watcher() i=3 2024-09-12T17:56:53.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.516+0000 7f65c0bfa9c0 20 remove_watcher() i=4 2024-09-12T17:56:53.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.516+0000 7f65c0bfa9c0 20 remove_watcher() i=5 2024-09-12T17:56:53.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.520+0000 7f65c0bfa9c0 20 remove_watcher() i=6 2024-09-12T17:56:53.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.520+0000 7f65c0bfa9c0 20 remove_watcher() i=7 2024-09-12T17:56:53.538 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:56:53.564 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:53.564 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:53.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.604+0000 7f1972b159c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.608+0000 7f1972b159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.608+0000 7f1972b159c0 20 realm 2024-09-12T17:56:53.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.608+0000 7f1972b159c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.608+0000 7f1972b159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.608+0000 7f1972b159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:53.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.608+0000 7f1972b159c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.608+0000 7f1972b159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.608+0000 7f1972b159c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.608+0000 7f1972b159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:53.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.608+0000 7f1972b159c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.608+0000 7f1972b159c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:53.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.608+0000 7f1972b159c0 20 searching for the correct realm 2024-09-12T17:56:53.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.612+0000 7f197061b640 0 -- 172.21.15.98:0/1219501693 >> [v2:172.21.15.98:6816/1225764258,v1:172.21.15.98:6817/1225764258] conn(0x7f196802e020 msgr2=0x7f19680606d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:53.623 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.620+0000 7f1970e1c640 0 -- 172.21.15.98:0/1219501693 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f1964065420 msgr2=0x7f1964063e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:53.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.628+0000 7f1972b159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:53.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.628+0000 7f1972b159c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:53.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.628+0000 7f1972b159c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:53.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.628+0000 7f1972b159c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:53.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.628+0000 7f1972b159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:53.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.628+0000 7f1972b159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:53.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.628+0000 7f1972b159c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.628+0000 7f1972b159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.628+0000 7f1972b159c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.635 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.632+0000 7f1972b159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:53.635 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.632+0000 7f1972b159c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.632+0000 7f1972b159c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:53.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.632+0000 7f1972b159c0 20 zone default found 2024-09-12T17:56:53.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.632+0000 7f1972b159c0 4 Realm: () 2024-09-12T17:56:53.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.632+0000 7f1972b159c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:53.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.632+0000 7f1972b159c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:53.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.632+0000 7f1972b159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:53.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.632+0000 7f1972b159c0 20 zonegroup default 2024-09-12T17:56:53.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.632+0000 7f1972b159c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.632+0000 7f1972b159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.632+0000 7f1972b159c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.637 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.632+0000 7f1972b159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.637 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.632+0000 7f1972b159c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.637 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.632+0000 7f1972b159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:53.637 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.632+0000 7f1972b159c0 20 started sync module instance, tier type = 2024-09-12T17:56:53.637 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.632+0000 7f1972b159c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:53.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.648+0000 7f1972b159c0 20 add_watcher() i=0 2024-09-12T17:56:53.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.648+0000 7f1972b159c0 20 add_watcher() i=1 2024-09-12T17:56:53.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.648+0000 7f1972b159c0 20 add_watcher() i=2 2024-09-12T17:56:53.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.648+0000 7f1972b159c0 20 add_watcher() i=3 2024-09-12T17:56:53.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.648+0000 7f1972b159c0 20 add_watcher() i=4 2024-09-12T17:56:53.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.648+0000 7f1972b159c0 20 add_watcher() i=5 2024-09-12T17:56:53.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.648+0000 7f1972b159c0 20 add_watcher() i=6 2024-09-12T17:56:53.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.652+0000 7f1972b159c0 20 add_watcher() i=7 2024-09-12T17:56:53.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.652+0000 7f1972b159c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:53.659 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.656+0000 7f1826fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:53.660 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.656+0000 7f1972b159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:53.660 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.656+0000 7f1972b159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:53.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.656+0000 7f1972b159c0 5 note: GC not initialized 2024-09-12T17:56:53.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.656+0000 7f1825fdb640 20 reqs_thread_entry: start 2024-09-12T17:56:53.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.656+0000 7f1972b159c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:53.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.656+0000 7f1972b159c0 20 Filter name: none 2024-09-12T17:56:53.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.656+0000 7f17977fe640 20 reqs_thread_entry: start 2024-09-12T17:56:53.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.656+0000 7f1972b159c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.656+0000 7f1972b159c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:53.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.656+0000 7f1972b159c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.660+0000 7f1972b159c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:56:53.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.660+0000 7f1972b159c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:53.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.660+0000 7f1972b159c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.660+0000 7f1972b159c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:53.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.660+0000 7f1972b159c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:53.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.660+0000 7f1972b159c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:56:53.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.660+0000 7f1972b159c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:53.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.664+0000 7f1826fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:53.671 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.668+0000 7f1972b159c0 20 remove_watcher() i=0 2024-09-12T17:56:53.671 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.668+0000 7f1972b159c0 2 removed watcher, disabling cache 2024-09-12T17:56:53.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.668+0000 7f1972b159c0 20 remove_watcher() i=1 2024-09-12T17:56:53.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.672+0000 7f1972b159c0 20 remove_watcher() i=2 2024-09-12T17:56:53.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.676+0000 7f1972b159c0 20 remove_watcher() i=3 2024-09-12T17:56:53.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.676+0000 7f1972b159c0 20 remove_watcher() i=4 2024-09-12T17:56:53.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.676+0000 7f1972b159c0 20 remove_watcher() i=5 2024-09-12T17:56:53.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.680+0000 7f1972b159c0 20 remove_watcher() i=6 2024-09-12T17:56:53.684 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:53.680+0000 7f1972b159c0 20 remove_watcher() i=7 2024-09-12T17:56:53.697 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:53.697 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:56:53.697 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-trim-reshard-log-entries id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:56:53.697 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:53.698 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:53.698 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:53.746 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:53.746 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:53.808 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:56:53.843 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:53.844 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:54.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.088+0000 7fd9ff9589c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.092+0000 7fd9ff9589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:54.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.092+0000 7fd9ff9589c0 20 realm 2024-09-12T17:56:54.095 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.092+0000 7fd9ff9589c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.095 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.092+0000 7fd9ff9589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:54.095 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.092+0000 7fd9ff9589c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:54.095 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.092+0000 7fd9ff9589c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.095 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.092+0000 7fd9ff9589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:54.095 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.092+0000 7fd9ff9589c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.096 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.092+0000 7fd9ff9589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:54.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.092+0000 7fd9ff9589c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.092+0000 7fd9ff9589c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:54.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.092+0000 7fd9ff9589c0 20 searching for the correct realm 2024-09-12T17:56:54.101 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.096+0000 7fd9fcc5d640 0 -- 172.21.15.98:0/657155937 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fd9f0027040 msgr2=0x7fd9f0036a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:54.112 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.108+0000 7fd9fd45e640 0 -- 172.21.15.98:0/657155937 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fd9f40760c0 msgr2=0x7fd9f405b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:54.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.324+0000 7fd9ff9589c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:54.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.324+0000 7fd9ff9589c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:54.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.324+0000 7fd9ff9589c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:54.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.324+0000 7fd9ff9589c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:54.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.324+0000 7fd9ff9589c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:54.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.324+0000 7fd9ff9589c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:54.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.324+0000 7fd9ff9589c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.324+0000 7fd9ff9589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:54.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.328+0000 7fd9ff9589c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.328+0000 7fd9ff9589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:54.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.328+0000 7fd9ff9589c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.328+0000 7fd9ff9589c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:54.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.328+0000 7fd9ff9589c0 20 zone default found 2024-09-12T17:56:54.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.328+0000 7fd9ff9589c0 4 Realm: () 2024-09-12T17:56:54.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.328+0000 7fd9ff9589c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:54.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.328+0000 7fd9ff9589c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:54.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.328+0000 7fd9ff9589c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:54.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.328+0000 7fd9ff9589c0 20 zonegroup default 2024-09-12T17:56:54.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.328+0000 7fd9ff9589c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.328+0000 7fd9ff9589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:54.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.328+0000 7fd9ff9589c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.328+0000 7fd9ff9589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:54.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.328+0000 7fd9ff9589c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.332+0000 7fd9ff9589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:54.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.332+0000 7fd9ff9589c0 20 started sync module instance, tier type = 2024-09-12T17:56:54.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.332+0000 7fd9ff9589c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:54.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.356+0000 7fd9ff9589c0 20 add_watcher() i=0 2024-09-12T17:56:54.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.356+0000 7fd9ff9589c0 20 add_watcher() i=1 2024-09-12T17:56:54.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.356+0000 7fd9ff9589c0 20 add_watcher() i=2 2024-09-12T17:56:54.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.356+0000 7fd9ff9589c0 20 add_watcher() i=3 2024-09-12T17:56:54.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.356+0000 7fd9ff9589c0 20 add_watcher() i=4 2024-09-12T17:56:54.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.356+0000 7fd9ff9589c0 20 add_watcher() i=5 2024-09-12T17:56:54.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.356+0000 7fd9ff9589c0 20 add_watcher() i=6 2024-09-12T17:56:54.361 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.356+0000 7fd9ff9589c0 20 add_watcher() i=7 2024-09-12T17:56:54.361 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.356+0000 7fd9ff9589c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:54.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.360+0000 7fd8b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:54.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.364+0000 7fd9ff9589c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:54.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.364+0000 7fd9ff9589c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:54.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.364+0000 7fd9ff9589c0 5 note: GC not initialized 2024-09-12T17:56:54.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.364+0000 7fd8b27e4640 20 reqs_thread_entry: start 2024-09-12T17:56:54.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.364+0000 7fd9ff9589c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:54.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.364+0000 7fd9ff9589c0 20 Filter name: none 2024-09-12T17:56:54.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.364+0000 7fd823fff640 20 reqs_thread_entry: start 2024-09-12T17:56:54.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.364+0000 7fd9ff9589c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:56:54.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.364+0000 7fd9ff9589c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.369 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.364+0000 7fd9ff9589c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:54.369 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.364+0000 7fd9ff9589c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:56:54.369 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.364+0000 7fd9ff9589c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:56:54.369 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.364+0000 7fd9ff9589c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 : miss 2024-09-12T17:56:54.369 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.364+0000 7fd9ff9589c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.364+0000 7fd9ff9589c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:56:54.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.364+0000 7fd9ff9589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 info.flags=0x17 2024-09-12T17:56:54.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.364+0000 7fd9ff9589c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 to cache LRU end 2024-09-12T17:56:54.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.364+0000 7fd9ff9589c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:54.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.364+0000 7fd9ff9589c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:54.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.364+0000 7fd9ff9589c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 2024-09-12T17:56:54.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.368+0000 7fd9ff9589c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:56:54.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.380+0000 7fd9ff9589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 info.flags=0x17 2024-09-12T17:56:54.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.380+0000 7fd9ff9589c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 to cache LRU end 2024-09-12T17:56:54.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.380+0000 7fd9ff9589c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:54.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.380+0000 7fd9ff9589c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25, ofs0, ns] 2024-09-12T17:56:54.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.380+0000 7fd8e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366199 cookie 93965737067408 notifier 6846 bl.length()=939 2024-09-12T17:56:54.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.380+0000 7fd8e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 info.flags=0x17 2024-09-12T17:56:54.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.380+0000 7fd8e0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 to cache LRU end 2024-09-12T17:56:54.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.380+0000 7fd8e0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:54.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.384+0000 7fd9ff9589c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.25]): orig_sources= new_sources= 2024-09-12T17:56:54.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.384+0000 7fd9ff9589c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.25]): potential sources added=[] removed=[] 2024-09-12T17:56:54.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.384+0000 7fd9ff9589c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.25]): orig_dests= new_dests= 2024-09-12T17:56:54.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.384+0000 7fd9ff9589c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.25]): potential dests added=[] removed=[] 2024-09-12T17:56:54.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.0 2024-09-12T17:56:54.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.0 2024-09-12T17:56:54.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.1 2024-09-12T17:56:54.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.1 2024-09-12T17:56:54.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.2 2024-09-12T17:56:54.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.2 2024-09-12T17:56:54.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.3 2024-09-12T17:56:54.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.3 2024-09-12T17:56:54.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.4 2024-09-12T17:56:54.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.4 2024-09-12T17:56:54.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.5 2024-09-12T17:56:54.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.5 2024-09-12T17:56:54.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.6 2024-09-12T17:56:54.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.6 2024-09-12T17:56:54.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.7 2024-09-12T17:56:54.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.7 2024-09-12T17:56:54.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.8 2024-09-12T17:56:54.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.8 2024-09-12T17:56:54.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.9 2024-09-12T17:56:54.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.9 2024-09-12T17:56:54.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.10 2024-09-12T17:56:54.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.10 2024-09-12T17:56:54.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.11 2024-09-12T17:56:54.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2.11 2024-09-12T17:56:54.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.0 2024-09-12T17:56:54.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.1 2024-09-12T17:56:54.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.396+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2 2024-09-12T17:56:54.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.400+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.3 2024-09-12T17:56:54.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.400+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.4 2024-09-12T17:56:54.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.400+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.5 2024-09-12T17:56:54.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.400+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.6 2024-09-12T17:56:54.407 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.404+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.7 2024-09-12T17:56:54.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.404+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.8 2024-09-12T17:56:54.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.404+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.9 2024-09-12T17:56:54.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.408+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.10 2024-09-12T17:56:54.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.412+0000 7fd9ff9589c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:54.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.412+0000 7fd9ff9589c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 2024-09-12T17:56:54.420 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.416+0000 7fd9ff9589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 info.flags=0x17 2024-09-12T17:56:54.420 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.416+0000 7fd9ff9589c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 to cache LRU end 2024-09-12T17:56:54.420 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.416+0000 7fd9ff9589c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:54.420 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.416+0000 7fd9ff9589c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25, ofs0, ns] 2024-09-12T17:56:54.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.416+0000 7fd8cffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366200 cookie 93965737067408 notifier 6846 bl.length()=939 2024-09-12T17:56:54.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.416+0000 7fd8cffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 info.flags=0x17 2024-09-12T17:56:54.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.416+0000 7fd8cffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 to cache LRU end 2024-09-12T17:56:54.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.416+0000 7fd8cffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:54.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.420+0000 7fd9ff9589c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.25]): orig_sources= new_sources= 2024-09-12T17:56:54.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.420+0000 7fd9ff9589c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.25]): potential sources added=[] removed=[] 2024-09-12T17:56:54.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.420+0000 7fd9ff9589c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.25]): orig_dests= new_dests= 2024-09-12T17:56:54.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.420+0000 7fd9ff9589c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.25]): potential dests added=[] removed=[] 2024-09-12T17:56:54.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.424+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.0 2024-09-12T17:56:54.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.424+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.1 2024-09-12T17:56:54.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.428+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.2 2024-09-12T17:56:54.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.428+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.3 2024-09-12T17:56:54.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.428+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.4 2024-09-12T17:56:54.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.428+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.5 2024-09-12T17:56:54.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.432+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.6 2024-09-12T17:56:54.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.432+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.7 2024-09-12T17:56:54.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.432+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.8 2024-09-12T17:56:54.437 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.432+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.9 2024-09-12T17:56:54.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.432+0000 7fd9ff9589c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.25.10 2024-09-12T17:56:54.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.436+0000 7fd9ff9589c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:54.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.436+0000 7fd9ff9589c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 2024-09-12T17:56:54.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.436+0000 7fd9ff9589c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 info.flags=0x17 2024-09-12T17:56:54.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.436+0000 7fd9ff9589c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 to cache LRU end 2024-09-12T17:56:54.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.436+0000 7fd9ff9589c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:54.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.436+0000 7fd9ff9589c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25, ofs0, ns] 2024-09-12T17:56:54.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.436+0000 7fd8cffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366201 cookie 93965737067408 notifier 6846 bl.length()=907 2024-09-12T17:56:54.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.436+0000 7fd8cffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 info.flags=0x17 2024-09-12T17:56:54.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.436+0000 7fd8cffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 to cache LRU end 2024-09-12T17:56:54.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.436+0000 7fd8cffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:54.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.440+0000 7fd9ff9589c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.25]): orig_sources= new_sources= 2024-09-12T17:56:54.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.440+0000 7fd9ff9589c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.25]): potential sources added=[] removed=[] 2024-09-12T17:56:54.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.440+0000 7fd9ff9589c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.25]): orig_dests= new_dests= 2024-09-12T17:56:54.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.440+0000 7fd9ff9589c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.25]): potential dests added=[] removed=[] 2024-09-12T17:56:54.449 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.444+0000 7fd9ff9589c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T17:56:54.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.448+0000 7fd8b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:54.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.452+0000 7fd9ff9589c0 20 remove_watcher() i=0 2024-09-12T17:56:54.458 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.452+0000 7fd9ff9589c0 2 removed watcher, disabling cache 2024-09-12T17:56:54.460 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.456+0000 7fd9ff9589c0 20 remove_watcher() i=1 2024-09-12T17:56:54.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.456+0000 7fd9ff9589c0 20 remove_watcher() i=2 2024-09-12T17:56:54.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.460+0000 7fd9ff9589c0 20 remove_watcher() i=3 2024-09-12T17:56:54.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.460+0000 7fd9ff9589c0 20 remove_watcher() i=4 2024-09-12T17:56:54.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.464+0000 7fd9ff9589c0 20 remove_watcher() i=5 2024-09-12T17:56:54.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.464+0000 7fd9ff9589c0 20 remove_watcher() i=6 2024-09-12T17:56:54.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.468+0000 7fd9ff9589c0 20 remove_watcher() i=7 2024-09-12T17:56:54.488 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:56:54.521 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:54.521 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:54.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.560+0000 7f3e195189c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.564+0000 7f3e195189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:54.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.564+0000 7f3e195189c0 20 realm 2024-09-12T17:56:54.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.564+0000 7f3e195189c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.564+0000 7f3e195189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:54.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.564+0000 7f3e195189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:54.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.564+0000 7f3e195189c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.564+0000 7f3e195189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:54.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.564+0000 7f3e195189c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.564+0000 7f3e195189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:54.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.564+0000 7f3e195189c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.564+0000 7f3e195189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:54.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.564+0000 7f3e195189c0 20 searching for the correct realm 2024-09-12T17:56:54.575 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.572+0000 7f3e1781f640 0 -- 172.21.15.98:0/1213796732 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55b94962a4a0 msgr2=0x55b94962c890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:54.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.576+0000 7f3e1681d640 0 -- 172.21.15.98:0/1213796732 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f3e0810b530 msgr2=0x7f3e080dea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:54.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:54.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:54.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:54.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:54.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:54.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:54.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:54.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:54.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:54.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 zone default found 2024-09-12T17:56:54.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 4 Realm: () 2024-09-12T17:56:54.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:54.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:54.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:54.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 zonegroup default 2024-09-12T17:56:54.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:54.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:54.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:54.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 started sync module instance, tier type = 2024-09-12T17:56:54.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.588+0000 7f3e195189c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:54.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.604+0000 7f3e195189c0 20 add_watcher() i=0 2024-09-12T17:56:54.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.604+0000 7f3e195189c0 20 add_watcher() i=1 2024-09-12T17:56:54.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.604+0000 7f3e195189c0 20 add_watcher() i=2 2024-09-12T17:56:54.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.604+0000 7f3e195189c0 20 add_watcher() i=3 2024-09-12T17:56:54.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.604+0000 7f3e195189c0 20 add_watcher() i=4 2024-09-12T17:56:54.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.604+0000 7f3e195189c0 20 add_watcher() i=5 2024-09-12T17:56:54.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.604+0000 7f3e195189c0 20 add_watcher() i=6 2024-09-12T17:56:54.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.608+0000 7f3e195189c0 20 add_watcher() i=7 2024-09-12T17:56:54.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.608+0000 7f3e195189c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:54.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.608+0000 7f3ccdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:54.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.608+0000 7f3e195189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:54.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.608+0000 7f3e195189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:54.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.608+0000 7f3e195189c0 5 note: GC not initialized 2024-09-12T17:56:54.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.608+0000 7f3cccfe1640 20 reqs_thread_entry: start 2024-09-12T17:56:54.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.608+0000 7f3e195189c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:54.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.612+0000 7f3e195189c0 20 Filter name: none 2024-09-12T17:56:54.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.612+0000 7f3c467fc640 20 reqs_thread_entry: start 2024-09-12T17:56:54.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.612+0000 7f3e195189c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.612+0000 7f3e195189c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:54.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.612+0000 7f3e195189c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.612+0000 7f3e195189c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:54.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.612+0000 7f3e195189c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:54.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.612+0000 7f3e195189c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.612+0000 7f3e195189c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:54.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.612+0000 7f3e195189c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:54.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.612+0000 7f3e195189c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:54.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.612+0000 7f3e195189c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:54.619 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.616+0000 7f3ccdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:54.624 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.620+0000 7f3e195189c0 20 remove_watcher() i=0 2024-09-12T17:56:54.624 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.620+0000 7f3e195189c0 2 removed watcher, disabling cache 2024-09-12T17:56:54.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.624+0000 7f3e195189c0 20 remove_watcher() i=1 2024-09-12T17:56:54.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.624+0000 7f3e195189c0 20 remove_watcher() i=2 2024-09-12T17:56:54.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.624+0000 7f3e195189c0 20 remove_watcher() i=3 2024-09-12T17:56:54.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.628+0000 7f3e195189c0 20 remove_watcher() i=4 2024-09-12T17:56:54.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.628+0000 7f3e195189c0 20 remove_watcher() i=5 2024-09-12T17:56:54.635 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.632+0000 7f3e195189c0 20 remove_watcher() i=6 2024-09-12T17:56:54.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:54.632+0000 7f3e195189c0 20 remove_watcher() i=7 2024-09-12T17:56:54.649 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:54.649 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:56:54.649 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-trim-reshard-log-entries id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:56:54.649 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:54.650 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:54.651 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:54.672 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:54.672 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:55.235 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:55.235 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:55.602 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T17:56:55.602 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:55.604 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:55.604 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:55.730 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:55.730 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:55.817 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:55.817 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:55.913 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:55.913 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:56.012 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:56.013 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:56.105 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:56.106 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:56.202 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:56.203 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:56.302 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:56.302 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:56.401 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:56.401 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:56.501 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:56.501 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:56.602 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:56.602 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:56.705 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:56.705 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:56.804 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:56.804 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:56.907 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:56.907 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:57.005 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:57.006 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:57.101 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:57.101 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:57.197 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:57.197 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:57.294 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:57.294 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:57.403 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:57.404 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:57.511 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:57.511 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:57.611 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:57.611 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:57.712 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:57.712 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:57.814 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:56:57.848 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:57.848 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:57.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:57.888+0000 7f38d0d599c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:57.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:57.888+0000 7f38d0d599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:57.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:57.888+0000 7f38d0d599c0 20 realm 2024-09-12T17:56:57.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:57.888+0000 7f38d0d599c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:57.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:57.892+0000 7f38d0d599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:57.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:57.892+0000 7f38d0d599c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:57.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:57.892+0000 7f38d0d599c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:57.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:57.892+0000 7f38d0d599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:57.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:57.892+0000 7f38d0d599c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:57.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:57.892+0000 7f38d0d599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:57.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:57.892+0000 7f38d0d599c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:57.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:57.892+0000 7f38d0d599c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:57.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:57.892+0000 7f38d0d599c0 20 searching for the correct realm 2024-09-12T17:56:57.903 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:57.900+0000 7f38cf060640 0 -- 172.21.15.98:0/3480490990 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f38c41090b0 msgr2=0x7f38c41240e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:58.121 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.116+0000 7f38ce85f640 0 -- 172.21.15.98:0/3480490990 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x561b09a891e0 msgr2=0x561b09a8b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:58.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.124+0000 7f38d0d599c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:58.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.124+0000 7f38d0d599c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:58.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.124+0000 7f38d0d599c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:58.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.124+0000 7f38d0d599c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:58.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.124+0000 7f38d0d599c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:58.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.124+0000 7f38d0d599c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:58.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.124+0000 7f38d0d599c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.124+0000 7f38d0d599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.124+0000 7f38d0d599c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.124+0000 7f38d0d599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:58.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.124+0000 7f38d0d599c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.128+0000 7f38d0d599c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:58.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.128+0000 7f38d0d599c0 20 zone default found 2024-09-12T17:56:58.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.128+0000 7f38d0d599c0 4 Realm: () 2024-09-12T17:56:58.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.128+0000 7f38d0d599c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:58.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.128+0000 7f38d0d599c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:58.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.128+0000 7f38d0d599c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:58.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.128+0000 7f38d0d599c0 20 zonegroup default 2024-09-12T17:56:58.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.128+0000 7f38d0d599c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.128+0000 7f38d0d599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.128+0000 7f38d0d599c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.128+0000 7f38d0d599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.128+0000 7f38d0d599c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.128+0000 7f38d0d599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.128+0000 7f38d0d599c0 20 started sync module instance, tier type = 2024-09-12T17:56:58.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.128+0000 7f38d0d599c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:58.156 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.152+0000 7f38d0d599c0 20 add_watcher() i=0 2024-09-12T17:56:58.156 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.152+0000 7f38d0d599c0 20 add_watcher() i=1 2024-09-12T17:56:58.156 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.152+0000 7f38d0d599c0 20 add_watcher() i=2 2024-09-12T17:56:58.157 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.152+0000 7f38d0d599c0 20 add_watcher() i=3 2024-09-12T17:56:58.157 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.152+0000 7f38d0d599c0 20 add_watcher() i=4 2024-09-12T17:56:58.157 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.152+0000 7f38d0d599c0 20 add_watcher() i=5 2024-09-12T17:56:58.157 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.152+0000 7f38d0d599c0 20 add_watcher() i=6 2024-09-12T17:56:58.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.156+0000 7f38d0d599c0 20 add_watcher() i=7 2024-09-12T17:56:58.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.156+0000 7f38d0d599c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:58.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.160+0000 7f37857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:58.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.160+0000 7f38d0d599c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:58.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.160+0000 7f38d0d599c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:58.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.160+0000 7f38d0d599c0 5 note: GC not initialized 2024-09-12T17:56:58.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.160+0000 7f36fffff640 20 reqs_thread_entry: start 2024-09-12T17:56:58.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.160+0000 7f38d0d599c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:58.165 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.160+0000 7f38d0d599c0 20 Filter name: none 2024-09-12T17:56:58.165 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.160+0000 7f36fdffb640 20 reqs_thread_entry: start 2024-09-12T17:56:58.165 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.160+0000 7f38d0d599c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.164+0000 7f38d0d599c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:58.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.164+0000 7f38d0d599c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.164+0000 7f38d0d599c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:58.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.164+0000 7f38d0d599c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:58.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.164+0000 7f38d0d599c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.168 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.164+0000 7f38d0d599c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:58.168 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.164+0000 7f38d0d599c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.169 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.164+0000 7f38d0d599c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:58.169 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.164+0000 7f38d0d599c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:58.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.168+0000 7f37857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:58.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.172+0000 7f38d0d599c0 20 remove_watcher() i=0 2024-09-12T17:56:58.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.172+0000 7f38d0d599c0 2 removed watcher, disabling cache 2024-09-12T17:56:58.179 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.176+0000 7f38d0d599c0 20 remove_watcher() i=1 2024-09-12T17:56:58.182 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.176+0000 7f38d0d599c0 20 remove_watcher() i=2 2024-09-12T17:56:58.184 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.180+0000 7f38d0d599c0 20 remove_watcher() i=3 2024-09-12T17:56:58.186 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.184+0000 7f38d0d599c0 20 remove_watcher() i=4 2024-09-12T17:56:58.188 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.184+0000 7f38d0d599c0 20 remove_watcher() i=5 2024-09-12T17:56:58.190 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.188+0000 7f38d0d599c0 20 remove_watcher() i=6 2024-09-12T17:56:58.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.188+0000 7f38d0d599c0 20 remove_watcher() i=7 2024-09-12T17:56:58.208 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:58.208 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:56:58.208 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-trim-reshard-log-entries id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:56:58.208 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:58.208 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T17:56:58.243 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:58.243 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:58.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.284+0000 7f90706da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.284+0000 7f90706da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.284+0000 7f90706da9c0 20 realm 2024-09-12T17:56:58.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.284+0000 7f90706da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.284+0000 7f90706da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.284+0000 7f90706da9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:58.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.284+0000 7f90706da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.284+0000 7f90706da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.284+0000 7f90706da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.284+0000 7f90706da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:58.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.284+0000 7f90706da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.288+0000 7f90706da9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:58.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.288+0000 7f90706da9c0 20 searching for the correct realm 2024-09-12T17:56:58.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.292+0000 7f906e9e1640 0 -- 172.21.15.98:0/2240747486 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f905801b040 msgr2=0x7f9058025930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:56:58.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.508+0000 7f906e1e0640 0 -- 172.21.15.98:0/2240747486 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x561b879bfb40 msgr2=0x561b879c2000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:58.519 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.516+0000 7f90706da9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:58.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.516+0000 7f90706da9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:58.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.516+0000 7f90706da9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:58.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.516+0000 7f90706da9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:58.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.516+0000 7f90706da9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:58.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.516+0000 7f90706da9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:58.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.516+0000 7f90706da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.516+0000 7f90706da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.516+0000 7f90706da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.521 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.516+0000 7f90706da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:58.521 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.516+0000 7f90706da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.516+0000 7f90706da9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:58.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.516+0000 7f90706da9c0 20 zone default found 2024-09-12T17:56:58.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.516+0000 7f90706da9c0 4 Realm: () 2024-09-12T17:56:58.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.516+0000 7f90706da9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:58.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.516+0000 7f90706da9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:58.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.516+0000 7f90706da9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:58.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.516+0000 7f90706da9c0 20 zonegroup default 2024-09-12T17:56:58.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.516+0000 7f90706da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.520+0000 7f90706da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.520+0000 7f90706da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.520+0000 7f90706da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.520+0000 7f90706da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.520+0000 7f90706da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.520+0000 7f90706da9c0 20 started sync module instance, tier type = 2024-09-12T17:56:58.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.520+0000 7f90706da9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:58.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.544+0000 7f90706da9c0 20 add_watcher() i=0 2024-09-12T17:56:58.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.544+0000 7f90706da9c0 20 add_watcher() i=1 2024-09-12T17:56:58.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.544+0000 7f90706da9c0 20 add_watcher() i=2 2024-09-12T17:56:58.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.544+0000 7f90706da9c0 20 add_watcher() i=3 2024-09-12T17:56:58.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.544+0000 7f90706da9c0 20 add_watcher() i=4 2024-09-12T17:56:58.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.544+0000 7f90706da9c0 20 add_watcher() i=5 2024-09-12T17:56:58.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.544+0000 7f90706da9c0 20 add_watcher() i=6 2024-09-12T17:56:58.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.548+0000 7f90706da9c0 20 add_watcher() i=7 2024-09-12T17:56:58.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.548+0000 7f90706da9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:58.554 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.552+0000 7f8f24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:58.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.552+0000 7f90706da9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:58.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.552+0000 7f90706da9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:58.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.552+0000 7f90706da9c0 5 note: GC not initialized 2024-09-12T17:56:58.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.552+0000 7f8e9f7fe640 20 reqs_thread_entry: start 2024-09-12T17:56:58.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.552+0000 7f90706da9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:58.557 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.552+0000 7f90706da9c0 20 Filter name: none 2024-09-12T17:56:58.557 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.552+0000 7f8e9d7fa640 20 reqs_thread_entry: start 2024-09-12T17:56:58.557 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.552+0000 7f90706da9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T17:56:58.557 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.552+0000 7f90706da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.556+0000 7f90706da9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:58.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.556+0000 7f90706da9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:56:58.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.556+0000 7f90706da9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:56:58.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.556+0000 7f90706da9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26 : miss 2024-09-12T17:56:58.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.556+0000 7f90706da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.556+0000 7f90706da9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:58.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.556+0000 7f90706da9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26 info.flags=0x17 2024-09-12T17:56:58.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.556+0000 7f90706da9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26 to cache LRU end 2024-09-12T17:56:58.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.556+0000 7f90706da9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:56:58.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.556+0000 7f90706da9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:58.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.556+0000 7f90706da9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26 2024-09-12T17:56:58.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.564+0000 7f90706da9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26 info.flags=0x17 2024-09-12T17:56:58.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.564+0000 7f90706da9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26 to cache LRU end 2024-09-12T17:56:58.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.564+0000 7f90706da9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:58.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.564+0000 7f90706da9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26, ofs0, ns] 2024-09-12T17:56:58.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.568+0000 7f8f517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366204 cookie 94676239260576 notifier 6428 bl.length()=939 2024-09-12T17:56:58.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.568+0000 7f8f517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26 info.flags=0x17 2024-09-12T17:56:58.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.568+0000 7f8f517fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26 to cache LRU end 2024-09-12T17:56:58.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.568+0000 7f8f517fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:58.572 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.568+0000 7f90706da9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.26]): orig_sources= new_sources= 2024-09-12T17:56:58.573 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.568+0000 7f90706da9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.26]): potential sources added=[] removed=[] 2024-09-12T17:56:58.573 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.568+0000 7f90706da9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.26]): orig_dests= new_dests= 2024-09-12T17:56:58.573 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.568+0000 7f90706da9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.26]): potential dests added=[] removed=[] 2024-09-12T17:56:58.573 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.568+0000 7f90706da9c0 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T17:56:58.573 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.568+0000 7f90706da9c0 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T17:56:58.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.0 2024-09-12T17:56:58.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.0 2024-09-12T17:56:58.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.1 2024-09-12T17:56:58.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.1 2024-09-12T17:56:58.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.2 2024-09-12T17:56:58.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.2 2024-09-12T17:56:58.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.3 2024-09-12T17:56:58.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.3 2024-09-12T17:56:58.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.4 2024-09-12T17:56:58.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.4 2024-09-12T17:56:58.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.5 2024-09-12T17:56:58.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.5 2024-09-12T17:56:58.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.6 2024-09-12T17:56:58.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.6 2024-09-12T17:56:58.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.7 2024-09-12T17:56:58.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.7 2024-09-12T17:56:58.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.8 2024-09-12T17:56:58.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.8 2024-09-12T17:56:58.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.9 2024-09-12T17:56:58.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.9 2024-09-12T17:56:58.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.10 2024-09-12T17:56:58.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.10 2024-09-12T17:56:58.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.11 2024-09-12T17:56:58.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1.11 2024-09-12T17:56:58.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.0 2024-09-12T17:56:58.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.576+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.1 2024-09-12T17:56:58.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.580+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.2 2024-09-12T17:56:58.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.580+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.3 2024-09-12T17:56:58.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.580+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.4 2024-09-12T17:56:58.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.580+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.5 2024-09-12T17:56:58.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.584+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.6 2024-09-12T17:56:58.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.584+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.7 2024-09-12T17:56:58.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.584+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.8 2024-09-12T17:56:58.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.588+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.9 2024-09-12T17:56:58.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.588+0000 7f90706da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.26.10 2024-09-12T17:56:58.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.592+0000 7f90706da9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26 : hit (requested=0x17, cached=0x17) 2024-09-12T17:56:58.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.592+0000 7f90706da9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26 2024-09-12T17:56:58.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.596+0000 7f90706da9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26 info.flags=0x17 2024-09-12T17:56:58.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.596+0000 7f90706da9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26 to cache LRU end 2024-09-12T17:56:58.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.596+0000 7f90706da9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:58.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.596+0000 7f90706da9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26, ofs0, ns] 2024-09-12T17:56:58.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.596+0000 7f8f51ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366205 cookie 94676239260576 notifier 6428 bl.length()=907 2024-09-12T17:56:58.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.596+0000 7f8f51ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26 info.flags=0x17 2024-09-12T17:56:58.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.596+0000 7f8f51ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26 to cache LRU end 2024-09-12T17:56:58.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.596+0000 7f8f51ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:56:58.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.600+0000 7f90706da9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.26]): orig_sources= new_sources= 2024-09-12T17:56:58.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.600+0000 7f90706da9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.26]): potential sources added=[] removed=[] 2024-09-12T17:56:58.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.600+0000 7f90706da9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.26]): orig_dests= new_dests= 2024-09-12T17:56:58.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.600+0000 7f90706da9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.26]): potential dests added=[] removed=[] 2024-09-12T17:56:58.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.604+0000 7f90706da9c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T17:56:58.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.608+0000 7f8f24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:58.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.616+0000 7f90706da9c0 20 remove_watcher() i=0 2024-09-12T17:56:58.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.616+0000 7f90706da9c0 2 removed watcher, disabling cache 2024-09-12T17:56:58.620 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.616+0000 7f90706da9c0 20 remove_watcher() i=1 2024-09-12T17:56:58.622 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.620+0000 7f90706da9c0 20 remove_watcher() i=2 2024-09-12T17:56:58.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.620+0000 7f90706da9c0 20 remove_watcher() i=3 2024-09-12T17:56:58.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.624+0000 7f90706da9c0 20 remove_watcher() i=4 2024-09-12T17:56:58.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.624+0000 7f90706da9c0 20 remove_watcher() i=5 2024-09-12T17:56:58.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.628+0000 7f90706da9c0 20 remove_watcher() i=6 2024-09-12T17:56:58.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.628+0000 7f90706da9c0 20 remove_watcher() i=7 2024-09-12T17:56:58.646 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T17:56:58.673 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:56:58.673 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:56:58.716 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.712+0000 7fed22ac49c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.712+0000 7fed22ac49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.712+0000 7fed22ac49c0 20 realm 2024-09-12T17:56:58.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.712+0000 7fed22ac49c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.712+0000 7fed22ac49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.712+0000 7fed22ac49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:56:58.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.712+0000 7fed22ac49c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.716+0000 7fed22ac49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.719 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.716+0000 7fed22ac49c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.716+0000 7fed22ac49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:58.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.716+0000 7fed22ac49c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.716+0000 7fed22ac49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:56:58.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.716+0000 7fed22ac49c0 20 searching for the correct realm 2024-09-12T17:56:58.726 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.724+0000 7fed20dcb640 0 -- 172.21.15.98:0/3214378743 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55cbd9496500 msgr2=0x55cbd9498930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:58.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.728+0000 7fed1fdc9640 0 -- 172.21.15.98:0/3214378743 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fed10008070 msgr2=0x7fed10026440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:56:58.740 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.736+0000 7fed22ac49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:56:58.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.736+0000 7fed22ac49c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:56:58.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.736+0000 7fed22ac49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:56:58.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.736+0000 7fed22ac49c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:56:58.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.736+0000 7fed22ac49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:56:58.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.736+0000 7fed22ac49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:56:58.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.736+0000 7fed22ac49c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.736+0000 7fed22ac49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.736+0000 7fed22ac49c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.736+0000 7fed22ac49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:56:58.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.736+0000 7fed22ac49c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.740+0000 7fed22ac49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:56:58.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.740+0000 7fed22ac49c0 20 zone default found 2024-09-12T17:56:58.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.740+0000 7fed22ac49c0 4 Realm: () 2024-09-12T17:56:58.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.740+0000 7fed22ac49c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:56:58.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.740+0000 7fed22ac49c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:56:58.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.740+0000 7fed22ac49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:56:58.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.740+0000 7fed22ac49c0 20 zonegroup default 2024-09-12T17:56:58.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.740+0000 7fed22ac49c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.740+0000 7fed22ac49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.740+0000 7fed22ac49c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.740+0000 7fed22ac49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.740+0000 7fed22ac49c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.740+0000 7fed22ac49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:56:58.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.740+0000 7fed22ac49c0 20 started sync module instance, tier type = 2024-09-12T17:56:58.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.740+0000 7fed22ac49c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:56:58.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.756+0000 7fed22ac49c0 20 add_watcher() i=0 2024-09-12T17:56:58.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.756+0000 7fed22ac49c0 20 add_watcher() i=1 2024-09-12T17:56:58.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.756+0000 7fed22ac49c0 20 add_watcher() i=2 2024-09-12T17:56:58.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.756+0000 7fed22ac49c0 20 add_watcher() i=3 2024-09-12T17:56:58.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.756+0000 7fed22ac49c0 20 add_watcher() i=4 2024-09-12T17:56:58.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.756+0000 7fed22ac49c0 20 add_watcher() i=5 2024-09-12T17:56:58.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.756+0000 7fed22ac49c0 20 add_watcher() i=6 2024-09-12T17:56:58.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.756+0000 7fed22ac49c0 20 add_watcher() i=7 2024-09-12T17:56:58.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.756+0000 7fed22ac49c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:56:58.763 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.760+0000 7febd67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:58.764 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.760+0000 7fed22ac49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:56:58.764 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.760+0000 7fed22ac49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:56:58.764 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.760+0000 7fed22ac49c0 5 note: GC not initialized 2024-09-12T17:56:58.764 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.760+0000 7febd57e2640 20 reqs_thread_entry: start 2024-09-12T17:56:58.764 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.760+0000 7fed22ac49c0 20 init_complete bucket index max shards: 11 2024-09-12T17:56:58.764 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.760+0000 7fed22ac49c0 20 Filter name: none 2024-09-12T17:56:58.764 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.760+0000 7feb46ffd640 20 reqs_thread_entry: start 2024-09-12T17:56:58.764 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.760+0000 7fed22ac49c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.765 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.760+0000 7fed22ac49c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:58.765 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.760+0000 7fed22ac49c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.760+0000 7fed22ac49c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:58.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.760+0000 7fed22ac49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:58.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.760+0000 7fed22ac49c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.768 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.764+0000 7fed22ac49c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:56:58.768 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.764+0000 7fed22ac49c0 20 rados->read ofs=0 len=0 2024-09-12T17:56:58.768 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.764+0000 7fed22ac49c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:56:58.768 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.764+0000 7fed22ac49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:56:58.769 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.764+0000 7febd67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:56:58.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.772+0000 7fed22ac49c0 20 remove_watcher() i=0 2024-09-12T17:56:58.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.772+0000 7fed22ac49c0 2 removed watcher, disabling cache 2024-09-12T17:56:58.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.772+0000 7fed22ac49c0 20 remove_watcher() i=1 2024-09-12T17:56:58.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.776+0000 7fed22ac49c0 20 remove_watcher() i=2 2024-09-12T17:56:58.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.776+0000 7fed22ac49c0 20 remove_watcher() i=3 2024-09-12T17:56:58.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.780+0000 7fed22ac49c0 20 remove_watcher() i=4 2024-09-12T17:56:58.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.780+0000 7fed22ac49c0 20 remove_watcher() i=5 2024-09-12T17:56:58.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.784+0000 7fed22ac49c0 20 remove_watcher() i=6 2024-09-12T17:56:58.787 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:56:58.784+0000 7fed22ac49c0 20 remove_watcher() i=7 2024-09-12T17:56:58.800 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:58.801 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:56:58.801 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-trim-reshard-log-entries id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.26 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:56:58.801 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:58.805 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:58.805 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:58.821 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:58.821 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:59.324 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:59.325 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:59.687 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T17:56:59.687 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:56:59.690 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:59.690 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:59.821 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:59.821 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:56:59.910 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:56:59.910 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:00.012 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:00.012 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:00.108 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:00.108 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:00.206 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:00.206 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:00.295 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:00.295 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:00.387 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:00.387 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:00.487 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:00.487 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:00.586 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:00.586 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:00.689 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:00.689 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:00.787 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:00.788 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:00.884 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:00.885 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:00.983 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:00.984 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:01.083 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:01.083 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:01.180 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:01.180 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:01.277 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:01.278 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:01.377 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:01.377 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:01.475 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:01.475 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:01.575 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:01.575 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:01.679 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:01.679 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:01.778 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:01.779 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:01.874 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:57:01.908 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:01.908 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:01.952 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.948+0000 7f1bb65799c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.948+0000 7f1bb65799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:01.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.948+0000 7f1bb65799c0 20 realm 2024-09-12T17:57:01.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.948+0000 7f1bb65799c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.952+0000 7f1bb65799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:01.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.952+0000 7f1bb65799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:01.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.952+0000 7f1bb65799c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.955 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.952+0000 7f1bb65799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:01.955 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.952+0000 7f1bb65799c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.957 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.952+0000 7f1bb65799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:01.957 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.952+0000 7f1bb65799c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.957 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.952+0000 7f1bb65799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:01.957 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.952+0000 7f1bb65799c0 20 searching for the correct realm 2024-09-12T17:57:01.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.960+0000 7f1bb4880640 0 -- 172.21.15.98:0/3594635887 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55df50f56490 msgr2=0x55df50f588e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:01.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.964+0000 7f1bb387e640 0 -- 172.21.15.98:0/3594635887 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f1ba400ec20 msgr2=0x7f1ba405b2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:01.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:01.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:57:01.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:01.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:57:01.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:01.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:01.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:01.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:01.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:01.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 20 zone default found 2024-09-12T17:57:01.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 4 Realm: () 2024-09-12T17:57:01.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:57:01.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:57:01.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:01.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 20 zonegroup default 2024-09-12T17:57:01.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:01.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:01.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.972+0000 7f1bb65799c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:01.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.976+0000 7f1bb65799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:01.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.976+0000 7f1bb65799c0 20 started sync module instance, tier type = 2024-09-12T17:57:01.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.976+0000 7f1bb65799c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:57:01.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.992+0000 7f1bb65799c0 20 add_watcher() i=0 2024-09-12T17:57:01.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.992+0000 7f1bb65799c0 20 add_watcher() i=1 2024-09-12T17:57:01.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.992+0000 7f1bb65799c0 20 add_watcher() i=2 2024-09-12T17:57:01.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.992+0000 7f1bb65799c0 20 add_watcher() i=3 2024-09-12T17:57:01.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.992+0000 7f1bb65799c0 20 add_watcher() i=4 2024-09-12T17:57:01.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.992+0000 7f1bb65799c0 20 add_watcher() i=5 2024-09-12T17:57:01.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.992+0000 7f1bb65799c0 20 add_watcher() i=6 2024-09-12T17:57:01.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.992+0000 7f1bb65799c0 20 add_watcher() i=7 2024-09-12T17:57:01.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.992+0000 7f1bb65799c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:01.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.992+0000 7f1a6a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:01.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.996+0000 7f1bb65799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:01.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.996+0000 7f1bb65799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:01.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.996+0000 7f1bb65799c0 5 note: GC not initialized 2024-09-12T17:57:01.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.996+0000 7f1a697e2640 20 reqs_thread_entry: start 2024-09-12T17:57:01.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.996+0000 7f1bb65799c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:01.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.996+0000 7f1bb65799c0 20 Filter name: none 2024-09-12T17:57:01.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.996+0000 7f19daffd640 20 reqs_thread_entry: start 2024-09-12T17:57:01.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.996+0000 7f1bb65799c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.000 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.996+0000 7f1bb65799c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:57:02.000 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.996+0000 7f1bb65799c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.000 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.996+0000 7f1bb65799c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:57:02.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.996+0000 7f1bb65799c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:02.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.996+0000 7f1bb65799c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.996+0000 7f1bb65799c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:57:02.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.996+0000 7f1bb65799c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.996+0000 7f1bb65799c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:57:02.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:01.996+0000 7f1bb65799c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:02.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.000+0000 7f1a6a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:02.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.004+0000 7f1bb65799c0 20 remove_watcher() i=0 2024-09-12T17:57:02.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.004+0000 7f1bb65799c0 2 removed watcher, disabling cache 2024-09-12T17:57:02.011 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.008+0000 7f1bb65799c0 20 remove_watcher() i=1 2024-09-12T17:57:02.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.008+0000 7f1bb65799c0 20 remove_watcher() i=2 2024-09-12T17:57:02.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.012+0000 7f1bb65799c0 20 remove_watcher() i=3 2024-09-12T17:57:02.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.012+0000 7f1bb65799c0 20 remove_watcher() i=4 2024-09-12T17:57:02.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.016+0000 7f1bb65799c0 20 remove_watcher() i=5 2024-09-12T17:57:02.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.016+0000 7f1bb65799c0 20 remove_watcher() i=6 2024-09-12T17:57:02.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.016+0000 7f1bb65799c0 20 remove_watcher() i=7 2024-09-12T17:57:02.033 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.033 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:57:02.034 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-trim-reshard-log-entries id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:57:02.034 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.034 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T17:57:02.066 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:02.066 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:02.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.300+0000 7face9985640 0 --2- 172.21.15.98:0/4062313168 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55714bbc1300 0x55714bbd55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:57:02.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.312+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 realm 2024-09-12T17:57:02.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.316+0000 7facebe7f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:02.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:02.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:02.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 searching for the correct realm 2024-09-12T17:57:02.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.320+0000 7face9184640 0 -- 172.21.15.98:0/265200285 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7facdc0c0070 msgr2=0x7facdc0fe840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:02.539 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.536+0000 7face9985640 0 -- 172.21.15.98:0/265200285 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7face004e900 msgr2=0x7face000e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:02.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:02.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:57:02.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:02.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:57:02.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:02.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:02.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:02.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.761 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:02.761 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 zone default found 2024-09-12T17:57:02.761 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.756+0000 7facebe7f9c0 4 Realm: () 2024-09-12T17:57:02.762 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.756+0000 7facebe7f9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:57:02.762 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.756+0000 7facebe7f9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:57:02.762 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.756+0000 7facebe7f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:02.762 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 zonegroup default 2024-09-12T17:57:02.762 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.762 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.762 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.763 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.763 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.764 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.764 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 started sync module instance, tier type = 2024-09-12T17:57:02.764 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:57:02.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=0 2024-09-12T17:57:02.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=1 2024-09-12T17:57:02.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=2 2024-09-12T17:57:02.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=3 2024-09-12T17:57:02.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=4 2024-09-12T17:57:02.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=5 2024-09-12T17:57:02.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=6 2024-09-12T17:57:02.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=7 2024-09-12T17:57:02.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.784+0000 7facebe7f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:02.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.788+0000 7fab9ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:02.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:02.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:02.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.792+0000 7facebe7f9c0 5 note: GC not initialized 2024-09-12T17:57:02.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.792+0000 7fab9efe5640 20 reqs_thread_entry: start 2024-09-12T17:57:02.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:02.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 Filter name: none 2024-09-12T17:57:02.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.792+0000 7fab9cfe1640 20 reqs_thread_entry: start 2024-09-12T17:57:02.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:57:02.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:57:02.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:57:02.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:57:02.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 : miss 2024-09-12T17:57:02.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:57:02.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 info.flags=0x17 2024-09-12T17:57:02.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 to cache LRU end 2024-09-12T17:57:02.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:02.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:02.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 2024-09-12T17:57:02.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.808+0000 7facebe7f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 info.flags=0x17 2024-09-12T17:57:02.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.808+0000 7facebe7f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 to cache LRU end 2024-09-12T17:57:02.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.808+0000 7facebe7f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:02.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.808+0000 7facebe7f9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27, ofs0, ns] 2024-09-12T17:57:02.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.808+0000 7fabccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366162 cookie 93945090778432 notifier 6966 bl.length()=939 2024-09-12T17:57:02.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.808+0000 7fabccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 info.flags=0x17 2024-09-12T17:57:02.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.808+0000 7fabccff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 to cache LRU end 2024-09-12T17:57:02.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.808+0000 7fabccff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:02.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.812+0000 7facebe7f9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): orig_sources= new_sources= 2024-09-12T17:57:02.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.812+0000 7facebe7f9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): potential sources added=[] removed=[] 2024-09-12T17:57:02.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.812+0000 7facebe7f9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): orig_dests= new_dests= 2024-09-12T17:57:02.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.812+0000 7facebe7f9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): potential dests added=[] removed=[] 2024-09-12T17:57:02.816 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7facebe7f9c0 time 2024-09-12T17:57:02.817271+0000 2024-09-12T17:57:02.816 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:57:02.817 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:02.818 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7facef7592eb] 2024-09-12T17:57:02.818 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7facef75949f] 2024-09-12T17:57:02.818 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571494490c1] 2024-09-12T17:57:02.818 INFO:tasks.workunit.client.0.smithi098.stderr: 4: radosgw-admin(+0x141007e) [0x557149e9f07e] 2024-09-12T17:57:02.818 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55714945b18d] 2024-09-12T17:57:02.818 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T17:57:02.820 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7facee5bfd90] 2024-09-12T17:57:02.820 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T17:57:02.820 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T17:57:02.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.812+0000 7facebe7f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7facebe7f9c0 time 2024-09-12T17:57:02.817271+0000 2024-09-12T17:57:02.820 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:57:02.820 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.821 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:02.821 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7facef7592eb] 2024-09-12T17:57:02.821 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7facef75949f] 2024-09-12T17:57:02.821 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571494490c1] 2024-09-12T17:57:02.821 INFO:tasks.workunit.client.0.smithi098.stderr: 4: radosgw-admin(+0x141007e) [0x557149e9f07e] 2024-09-12T17:57:02.822 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55714945b18d] 2024-09-12T17:57:02.822 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T17:57:02.822 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7facee5bfd90] 2024-09-12T17:57:02.822 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T17:57:02.822 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T17:57:02.822 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.823 INFO:tasks.workunit.client.0.smithi098.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:57:02.823 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7facebe7f9c0 thread_name:radosgw-admin 2024-09-12T17:57:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7facee5d8520] 2024-09-12T17:57:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:57:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:57:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:57:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7facef759345] 2024-09-12T17:57:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7facef75949f] 2024-09-12T17:57:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571494490c1] 2024-09-12T17:57:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: 8: radosgw-admin(+0x141007e) [0x557149e9f07e] 2024-09-12T17:57:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55714945b18d] 2024-09-12T17:57:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T17:57:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7facee5bfd90] 2024-09-12T17:57:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T17:57:02.851 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T17:57:02.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.812+0000 7facebe7f9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:57:02.851 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7facebe7f9c0 thread_name:radosgw-admin 2024-09-12T17:57:02.851 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.851 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:02.851 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7facee5d8520] 2024-09-12T17:57:02.851 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:57:02.851 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:57:02.851 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:57:02.851 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7facef759345] 2024-09-12T17:57:02.851 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7facef75949f] 2024-09-12T17:57:02.851 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571494490c1] 2024-09-12T17:57:02.851 INFO:tasks.workunit.client.0.smithi098.stderr: 8: radosgw-admin(+0x141007e) [0x557149e9f07e] 2024-09-12T17:57:02.851 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55714945b18d] 2024-09-12T17:57:02.852 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T17:57:02.852 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7facee5bfd90] 2024-09-12T17:57:02.852 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T17:57:02.852 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T17:57:02.852 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:57:02.852 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.852 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T17:57:02.852 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb48360) adding con mode: secure 2024-09-12T17:57:02.852 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb48360) adding con mode: crc 2024-09-12T17:57:02.852 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb48360) adding con mode: crc 2024-09-12T17:57:02.852 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb48360) adding con mode: secure 2024-09-12T17:57:02.852 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb48360) adding con mode: crc 2024-09-12T17:57:02.853 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb48360) adding con mode: secure 2024-09-12T17:57:02.853 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb48360) adding con mode: crc 2024-09-12T17:57:02.853 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb48360) adding con mode: secure 2024-09-12T17:57:02.853 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.853 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 1 librados: starting msgr at 2024-09-12T17:57:02.853 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 1 librados: starting objecter 2024-09-12T17:57:02.853 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command objecter_requests hook 0x55714bb4c5e0 2024-09-12T17:57:02.853 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 1 librados: setting wanted keys 2024-09-12T17:57:02.853 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 1 librados: calling monclient init 2024-09-12T17:57:02.853 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient: init 2024-09-12T17:57:02.853 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding auth protocol: cephx 2024-09-12T17:57:02.853 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding auth protocol: cephx 2024-09-12T17:57:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding auth protocol: cephx 2024-09-12T17:57:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: secure 2024-09-12T17:57:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: crc 2024-09-12T17:57:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: secure 2024-09-12T17:57:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: crc 2024-09-12T17:57:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: secure 2024-09-12T17:57:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: crc 2024-09-12T17:57:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: crc 2024-09-12T17:57:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: secure 2024-09-12T17:57:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: crc 2024-09-12T17:57:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: secure 2024-09-12T17:57:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: crc 2024-09-12T17:57:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: secure 2024-09-12T17:57:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command rotate-key hook 0x55714bb45348 2024-09-12T17:57:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:57:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:57:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-a con 0x55714b9d2840 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:57:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-c con 0x55714ba8b2b0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:57:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-b con 0x55714bb6eea0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:57:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:57:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient(hunting): authenticate will time out at 2618.659692s 2024-09-12T17:57:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T17:57:02.084+0000 7face9985640 10 monclient(hunting): get_auth_request con 0x55714b9d2840 auth_method 0 2024-09-12T17:57:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T17:57:02.084+0000 7face9985640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T17:57:02.084+0000 7face9985640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T17:57:02.084+0000 7face9985640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T17:57:02.084+0000 7face9184640 10 monclient(hunting): get_auth_request con 0x55714ba8b2b0 auth_method 0 2024-09-12T17:57:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T17:57:02.084+0000 7face9184640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T17:57:02.084+0000 7face9184640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T17:57:02.084+0000 7face9184640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T17:57:02.084+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T17:57:02.084+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T17:57:02.084+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T17:57:02.084+0000 7face9184640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T17:57:02.084+0000 7face9184640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T17:57:02.084+0000 7face9184640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T17:57:02.088+0000 7face9985640 10 monclient(hunting): handle_auth_done global_id 6957 payload 824 2024-09-12T17:57:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T17:57:02.088+0000 7face9985640 10 monclient: _finish_hunting 0 2024-09-12T17:57:02.857 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T17:57:02.088+0000 7face9985640 1 monclient: found mon.noname-a 2024-09-12T17:57:02.857 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T17:57:02.088+0000 7face9985640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:57:02.857 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T17:57:02.088+0000 7fabd6604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:02.857 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T17:57:02.088+0000 7fabd6604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:57:02.857 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T17:57:02.088+0000 7fabd6604640 10 monclient: dump: 2024-09-12T17:57:02.857 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:02.857 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:02.857 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.857 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.857 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:02.857 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.857 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:02.857 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:02.857 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T17:57:02.088+0000 7fabd6604640 10 monclient: _finish_auth 0 2024-09-12T17:57:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T17:57:02.088+0000 7fabd6604640 10 monclient: _check_auth_tickets 2024-09-12T17:57:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T17:57:02.088+0000 7fabd6604640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T17:57:02.088+0000 7fabd6604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T17:57:02.088+0000 7fabd6604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:57:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T17:57:02.088+0000 7fabd6604640 10 monclient: dump: 2024-09-12T17:57:02.858 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:02.858 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:02.858 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.858 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.858 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:02.858 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.858 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:02.858 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:02.859 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T17:57:02.088+0000 7facebe7f9c0 5 monclient: authenticate success, global_id 6957 2024-09-12T17:57:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T17:57:02.088+0000 7facebe7f9c0 10 monclient: _renew_subs 2024-09-12T17:57:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T17:57:02.088+0000 7fabd7e07640 4 set_mon_vals no callback set 2024-09-12T17:57:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T17:57:02.088+0000 7facebe7f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:57:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T17:57:02.088+0000 7facebe7f9c0 10 monclient: _renew_subs 2024-09-12T17:57:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T17:57:02.088+0000 7facebe7f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:57:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T17:57:02.088+0000 7facebe7f9c0 1 librados: init done 2024-09-12T17:57:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T17:57:02.088+0000 7fabd6604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:57:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T17:57:02.088+0000 7fabd6604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T17:57:02.088+0000 7fabd6604640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T17:57:02.088+0000 7face9184640 10 monclient: get_auth_request con 0x7fabd0070ae0 auth_method 0 2024-09-12T17:57:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T17:57:02.088+0000 7facea186640 10 monclient: get_auth_request con 0x55714bb6db20 auth_method 0 2024-09-12T17:57:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T17:57:02.088+0000 7face9985640 10 monclient: get_auth_request con 0x55714bb90470 auth_method 0 2024-09-12T17:57:02.860 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T17:57:02.092+0000 7face9184640 10 monclient: get_auth_request con 0x55714bb95a40 auth_method 0 2024-09-12T17:57:02.860 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient: build_initial_monmap 2024-09-12T17:57:02.860 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 1 build_initial for_mkfs: 0 2024-09-12T17:57:02.860 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient: monmap: 2024-09-12T17:57:02.860 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:57:02.860 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:57:02.860 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:57:02.860 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:57:02.860 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:57:02.861 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.861 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:57:02.861 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:57:02.861 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:57:02.861 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.861 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding auth protocol: cephx 2024-09-12T17:57:02.861 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding auth protocol: cephx 2024-09-12T17:57:02.861 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding auth protocol: cephx 2024-09-12T17:57:02.861 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: secure 2024-09-12T17:57:02.861 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: crc 2024-09-12T17:57:02.861 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: secure 2024-09-12T17:57:02.861 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: crc 2024-09-12T17:57:02.862 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: secure 2024-09-12T17:57:02.862 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: crc 2024-09-12T17:57:02.862 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: crc 2024-09-12T17:57:02.862 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: secure 2024-09-12T17:57:02.862 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: crc 2024-09-12T17:57:02.862 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: secure 2024-09-12T17:57:02.862 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: crc 2024-09-12T17:57:02.862 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: secure 2024-09-12T17:57:02.862 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.862 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55714bb9d150 EEXIST 2024-09-12T17:57:02.862 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient: init 2024-09-12T17:57:02.862 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding auth protocol: cephx 2024-09-12T17:57:02.862 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding auth protocol: cephx 2024-09-12T17:57:02.862 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding auth protocol: cephx 2024-09-12T17:57:02.863 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: secure 2024-09-12T17:57:02.863 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: crc 2024-09-12T17:57:02.863 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: secure 2024-09-12T17:57:02.863 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: crc 2024-09-12T17:57:02.863 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: secure 2024-09-12T17:57:02.863 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: crc 2024-09-12T17:57:02.863 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: crc 2024-09-12T17:57:02.863 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: secure 2024-09-12T17:57:02.863 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: crc 2024-09-12T17:57:02.863 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: secure 2024-09-12T17:57:02.863 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: crc 2024-09-12T17:57:02.863 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: secure 2024-09-12T17:57:02.863 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command rotate-key cmddesc rotate-key hook 0x55714bb988d0 EEXIST 2024-09-12T17:57:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:57:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:57:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-c con 0x55714bbc1300 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:57:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-a con 0x55714bbc0c30 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:57:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-b con 0x55714bbbf610 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:57:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:57:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient(hunting): authenticate will time out at 2618.669702s 2024-09-12T17:57:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T17:57:02.096+0000 7face9985640 10 monclient(hunting): get_auth_request con 0x55714bbc1300 auth_method 0 2024-09-12T17:57:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T17:57:02.096+0000 7face9985640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T17:57:02.096+0000 7face9985640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T17:57:02.096+0000 7face9985640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T17:57:02.096+0000 7face9184640 10 monclient(hunting): get_auth_request con 0x55714bbc0c30 auth_method 0 2024-09-12T17:57:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T17:57:02.096+0000 7face9184640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T17:57:02.096+0000 7face9184640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T17:57:02.096+0000 7face9184640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T17:57:02.096+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T17:57:02.096+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T17:57:02.096+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T17:57:02.096+0000 7face9184640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T17:57:02.096+0000 7face9184640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T17:57:02.096+0000 7face9184640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T17:57:02.096+0000 7face9985640 10 monclient(hunting): handle_auth_done global_id 6467 payload 824 2024-09-12T17:57:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T17:57:02.096+0000 7face9985640 10 monclient: _finish_hunting 0 2024-09-12T17:57:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T17:57:02.096+0000 7face9985640 1 monclient: found mon.noname-c 2024-09-12T17:57:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T17:57:02.096+0000 7face9985640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:57:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient: get_auth_request con 0x55714bbc1300 auth_method 0 2024-09-12T17:57:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T17:57:02.300+0000 7face9985640 0 --2- 172.21.15.98:0/4062313168 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55714bbc1300 0x55714bbd55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:57:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: ms_handle_reset current mon [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:57:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: _reopen_session rank -1 2024-09-12T17:57:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:57:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient(hunting): picked mon.noname-c con 0x7fabc4001dd0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:57:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient(hunting): picked mon.noname-b con 0x55714bbbf610 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:57:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient(hunting): picked mon.noname-a con 0x7fabc4007840 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:57:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient(hunting): _renew_subs 2024-09-12T17:57:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient(hunting): get_auth_request con 0x7fabc4001dd0 auth_method 0 2024-09-12T17:57:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:57:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T17:57:02.300+0000 7facea186640 10 monclient(hunting): get_auth_request con 0x7fabc4007840 auth_method 0 2024-09-12T17:57:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T17:57:02.300+0000 7facea186640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T17:57:02.300+0000 7facea186640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T17:57:02.300+0000 7facea186640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:57:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:57:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T17:57:02.300+0000 7facea186640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T17:57:02.300+0000 7facea186640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T17:57:02.300+0000 7facea186640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:57:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T17:57:02.300+0000 7face9184640 10 monclient(hunting): get_auth_request con 0x55714bbbf610 auth_method 0 2024-09-12T17:57:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T17:57:02.300+0000 7face9184640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T17:57:02.300+0000 7face9184640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T17:57:02.300+0000 7face9184640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:57:02.868 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient(hunting): handle_auth_done global_id 6467 payload 293 2024-09-12T17:57:02.868 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient: _finish_hunting 0 2024-09-12T17:57:02.868 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T17:57:02.300+0000 7face9985640 1 monclient: found mon.noname-c 2024-09-12T17:57:02.868 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:57:02.868 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:02.868 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:57:02.868 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: dump: 2024-09-12T17:57:02.868 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:02.868 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:02.868 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.868 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.868 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:02.868 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.869 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:02.869 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:02.869 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: _finish_auth 0 2024-09-12T17:57:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:57:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T17:57:02.300+0000 7facebe7f9c0 5 monclient: authenticate success, global_id 6467 2024-09-12T17:57:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T17:57:02.300+0000 7facebe7f9c0 10 monclient: _renew_subs 2024-09-12T17:57:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T17:57:02.300+0000 7facebe7f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:57:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:57:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: dump: 2024-09-12T17:57:02.869 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:02.870 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:02.870 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.870 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.870 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:02.870 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.870 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:02.870 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:02.870 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:02.870 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.870 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T17:57:02.300+0000 7facea987640 4 set_mon_vals no callback set 2024-09-12T17:57:02.870 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T17:57:02.300+0000 7facebe7f9c0 10 monclient: _renew_subs 2024-09-12T17:57:02.870 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T17:57:02.300+0000 7facebe7f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:57:02.870 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T17:57:02.304+0000 7fabcf7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:57:02.870 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T17:57:02.304+0000 7fabcf7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:02.871 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T17:57:02.304+0000 7fabcf7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:02.871 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 10 monclient: get_monmap_and_config 2024-09-12T17:57:02.871 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 10 monclient: build_initial_monmap 2024-09-12T17:57:02.871 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 1 build_initial for_mkfs: 0 2024-09-12T17:57:02.871 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 10 monclient: monmap: 2024-09-12T17:57:02.871 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:57:02.871 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:57:02.871 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:57:02.871 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:57:02.871 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:57:02.871 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.871 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:57:02.871 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:57:02.871 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:57:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T17:57:02.304+0000 7face9184640 10 monclient: get_auth_request con 0x55714bbc1300 auth_method 0 2024-09-12T17:57:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding auth protocol: cephx 2024-09-12T17:57:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding auth protocol: cephx 2024-09-12T17:57:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding auth protocol: cephx 2024-09-12T17:57:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: secure 2024-09-12T17:57:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: crc 2024-09-12T17:57:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: secure 2024-09-12T17:57:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: crc 2024-09-12T17:57:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: secure 2024-09-12T17:57:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: crc 2024-09-12T17:57:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: crc 2024-09-12T17:57:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: secure 2024-09-12T17:57:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: crc 2024-09-12T17:57:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: secure 2024-09-12T17:57:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: crc 2024-09-12T17:57:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: secure 2024-09-12T17:57:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 10 monclient: init 2024-09-12T17:57:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding auth protocol: cephx 2024-09-12T17:57:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding auth protocol: cephx 2024-09-12T17:57:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding auth protocol: cephx 2024-09-12T17:57:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: secure 2024-09-12T17:57:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: crc 2024-09-12T17:57:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: secure 2024-09-12T17:57:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: crc 2024-09-12T17:57:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: secure 2024-09-12T17:57:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: crc 2024-09-12T17:57:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: crc 2024-09-12T17:57:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: secure 2024-09-12T17:57:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: crc 2024-09-12T17:57:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: secure 2024-09-12T17:57:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: crc 2024-09-12T17:57:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: secure 2024-09-12T17:57:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff676dd4b8 EEXIST 2024-09-12T17:57:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:57:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:57:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-b con 0x55714bc0db80 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:57:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-c con 0x55714bc08f70 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:57:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-a con 0x55714bc098f0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:57:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:57:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): authenticate will time out at 2618.880082s 2024-09-12T17:57:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): get_auth_request con 0x55714bc098f0 auth_method 0 2024-09-12T17:57:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T17:57:02.308+0000 7face9184640 10 monclient(hunting): get_auth_request con 0x55714bc08f70 auth_method 0 2024-09-12T17:57:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T17:57:02.308+0000 7face9184640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T17:57:02.308+0000 7face9184640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T17:57:02.308+0000 7face9184640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): get_auth_request con 0x55714bc0db80 auth_method 0 2024-09-12T17:57:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): handle_auth_done global_id 6963 payload 274 2024-09-12T17:57:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient: _finish_hunting 0 2024-09-12T17:57:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T17:57:02.308+0000 7facea186640 1 monclient: found mon.noname-a 2024-09-12T17:57:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:57:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T17:57:02.308+0000 7fabcd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:02.877 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T17:57:02.308+0000 7fabcd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:57:02.877 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T17:57:02.308+0000 7fabcd7fa640 10 monclient: dump: 2024-09-12T17:57:02.877 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:02.877 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:02.877 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.877 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.877 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:02.877 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.877 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:02.877 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:02.877 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:02.877 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.877 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T17:57:02.308+0000 7fabcd7fa640 10 monclient: _finish_auth 0 2024-09-12T17:57:02.877 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T17:57:02.308+0000 7fabcd7fa640 10 monclient: _check_auth_tickets 2024-09-12T17:57:02.878 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T17:57:02.308+0000 7fabcd7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:02.878 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T17:57:02.308+0000 7fabcd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:02.878 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T17:57:02.308+0000 7fabcd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:57:02.878 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T17:57:02.308+0000 7fabcd7fa640 10 monclient: dump: 2024-09-12T17:57:02.878 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:02.878 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:02.878 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.878 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.878 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:02.878 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.878 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:02.878 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:02.878 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:02.878 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 monclient: authenticate success, global_id 6963 2024-09-12T17:57:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:57:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 4 set_mon_vals no callback set 2024-09-12T17:57:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient: shutdown 2024-09-12T17:57:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient: build_initial_monmap 2024-09-12T17:57:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 1 build_initial for_mkfs: 0 2024-09-12T17:57:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient: monmap: 2024-09-12T17:57:02.879 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:57:02.879 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:57:02.879 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:57:02.879 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:57:02.879 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:57:02.879 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.879 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:57:02.880 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:57:02.880 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:57:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding auth protocol: cephx 2024-09-12T17:57:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding auth protocol: cephx 2024-09-12T17:57:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding auth protocol: cephx 2024-09-12T17:57:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: secure 2024-09-12T17:57:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: crc 2024-09-12T17:57:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: secure 2024-09-12T17:57:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: crc 2024-09-12T17:57:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: secure 2024-09-12T17:57:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: crc 2024-09-12T17:57:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: crc 2024-09-12T17:57:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: secure 2024-09-12T17:57:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: crc 2024-09-12T17:57:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: secure 2024-09-12T17:57:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: crc 2024-09-12T17:57:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: secure 2024-09-12T17:57:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 1 librados: starting msgr at 2024-09-12T17:57:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 1 librados: starting objecter 2024-09-12T17:57:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55714bbc1070 EEXIST 2024-09-12T17:57:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 1 librados: setting wanted keys 2024-09-12T17:57:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 1 librados: calling monclient init 2024-09-12T17:57:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient: init 2024-09-12T17:57:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding auth protocol: cephx 2024-09-12T17:57:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding auth protocol: cephx 2024-09-12T17:57:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding auth protocol: cephx 2024-09-12T17:57:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: secure 2024-09-12T17:57:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: crc 2024-09-12T17:57:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: secure 2024-09-12T17:57:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: crc 2024-09-12T17:57:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: secure 2024-09-12T17:57:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: crc 2024-09-12T17:57:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: crc 2024-09-12T17:57:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: secure 2024-09-12T17:57:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: crc 2024-09-12T17:57:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: secure 2024-09-12T17:57:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: crc 2024-09-12T17:57:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: secure 2024-09-12T17:57:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command rotate-key cmddesc rotate-key hook 0x55714bbc3268 EEXIST 2024-09-12T17:57:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:57:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:57:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-c con 0x55714bc08f70 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:57:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-b con 0x55714bc098f0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:57:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-a con 0x55714bc0db80 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:57:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:57:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): authenticate will time out at 2618.883456s 2024-09-12T17:57:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): get_auth_request con 0x55714bc0db80 auth_method 0 2024-09-12T17:57:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): get_auth_request con 0x55714bc08f70 auth_method 0 2024-09-12T17:57:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T17:57:02.308+0000 7face9184640 10 monclient(hunting): get_auth_request con 0x55714bc098f0 auth_method 0 2024-09-12T17:57:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T17:57:02.308+0000 7face9184640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T17:57:02.308+0000 7face9184640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T17:57:02.308+0000 7face9184640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): handle_auth_done global_id 6966 payload 824 2024-09-12T17:57:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient: _finish_hunting 0 2024-09-12T17:57:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T17:57:02.308+0000 7facea186640 1 monclient: found mon.noname-a 2024-09-12T17:57:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:57:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:57:02.886 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 10 monclient: dump: 2024-09-12T17:57:02.886 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:02.886 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:02.886 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.886 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.886 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:02.886 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.886 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:02.886 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:02.886 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:02.886 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.886 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 10 monclient: _finish_auth 0 2024-09-12T17:57:02.886 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:57:02.887 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T17:57:02.312+0000 7facebe7f9c0 5 monclient: authenticate success, global_id 6966 2024-09-12T17:57:02.887 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T17:57:02.312+0000 7facebe7f9c0 10 monclient: _renew_subs 2024-09-12T17:57:02.887 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T17:57:02.312+0000 7facebe7f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:57:02.887 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:02.887 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:02.887 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:57:02.887 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 10 monclient: dump: 2024-09-12T17:57:02.887 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:02.887 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:02.887 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.887 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.887 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:02.887 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.887 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:02.888 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:02.888 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T17:57:02.312+0000 7fabcd7fa640 4 set_mon_vals no callback set 2024-09-12T17:57:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T17:57:02.312+0000 7facebe7f9c0 10 monclient: _renew_subs 2024-09-12T17:57:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T17:57:02.312+0000 7facebe7f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:57:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T17:57:02.312+0000 7facebe7f9c0 1 librados: init done 2024-09-12T17:57:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T17:57:02.312+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command cr dump hook 0x55714bc05f18 2024-09-12T17:57:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T17:57:02.312+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:57:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T17:57:02.312+0000 7face9985640 10 monclient: get_auth_request con 0x7fabb4070ae0 auth_method 0 2024-09-12T17:57:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T17:57:02.312+0000 7face9184640 10 monclient: get_auth_request con 0x55714bc26e60 auth_method 0 2024-09-12T17:57:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 realm 2024-09-12T17:57:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T17:57:02.316+0000 7face9985640 10 monclient: get_auth_request con 0x55714bc2b180 auth_method 0 2024-09-12T17:57:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 searching for the correct realm 2024-09-12T17:57:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T17:57:02.316+0000 7face9184640 10 monclient: get_auth_request con 0x55714bc30290 auth_method 0 2024-09-12T17:57:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T17:57:02.320+0000 7facea186640 10 monclient: get_auth_request con 0x7face002cb20 auth_method 0 2024-09-12T17:57:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T17:57:02.320+0000 7face9985640 10 monclient: get_auth_request con 0x7face4040070 auth_method 0 2024-09-12T17:57:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T17:57:02.320+0000 7face9184640 10 monclient: get_auth_request con 0x7facdc0c0070 auth_method 0 2024-09-12T17:57:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T17:57:02.320+0000 7face9184640 0 -- 172.21.15.98:0/265200285 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7facdc0c0070 msgr2=0x7facdc0fe840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T17:57:02.524+0000 7face9184640 10 monclient: get_auth_request con 0x7facdc0c0070 auth_method 0 2024-09-12T17:57:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T17:57:02.528+0000 7facea186640 10 monclient: get_auth_request con 0x7face001cb20 auth_method 0 2024-09-12T17:57:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T17:57:02.536+0000 7face9985640 10 monclient: get_auth_request con 0x7face004e900 auth_method 0 2024-09-12T17:57:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T17:57:02.536+0000 7face9985640 0 -- 172.21.15.98:0/265200285 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7face004e900 msgr2=0x7face000e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T17:57:02.740+0000 7face9985640 10 monclient: get_auth_request con 0x7face004e900 auth_method 0 2024-09-12T17:57:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:57:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:57:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 zone default found 2024-09-12T17:57:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 4 Realm: () 2024-09-12T17:57:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:57:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:57:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 zonegroup default 2024-09-12T17:57:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 started sync module instance, tier type = 2024-09-12T17:57:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:57:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=0 2024-09-12T17:57:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=1 2024-09-12T17:57:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=2 2024-09-12T17:57:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=3 2024-09-12T17:57:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=4 2024-09-12T17:57:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=5 2024-09-12T17:57:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=6 2024-09-12T17:57:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=7 2024-09-12T17:57:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T17:57:02.784+0000 7facebe7f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding auth protocol: cephx 2024-09-12T17:57:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding auth protocol: cephx 2024-09-12T17:57:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding auth protocol: cephx 2024-09-12T17:57:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: secure 2024-09-12T17:57:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: crc 2024-09-12T17:57:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: secure 2024-09-12T17:57:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: crc 2024-09-12T17:57:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: secure 2024-09-12T17:57:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: crc 2024-09-12T17:57:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: crc 2024-09-12T17:57:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: secure 2024-09-12T17:57:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: crc 2024-09-12T17:57:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T17:57:02.788+0000 7fab9ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: secure 2024-09-12T17:57:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: crc 2024-09-12T17:57:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: secure 2024-09-12T17:57:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command cache list hook 0x55714bbfe510 2024-09-12T17:57:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command cache inspect hook 0x55714bbfe510 2024-09-12T17:57:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command cache erase hook 0x55714bbfe510 2024-09-12T17:57:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command cache zap hook 0x55714bbfe510 2024-09-12T17:57:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 5 note: GC not initialized 2024-09-12T17:57:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T17:57:02.792+0000 7fab9efe5640 20 reqs_thread_entry: start 2024-09-12T17:57:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command sync trace show hook 0x7facdc004300 2024-09-12T17:57:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command sync trace history hook 0x7facdc004300 2024-09-12T17:57:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command sync trace active hook 0x7facdc004300 2024-09-12T17:57:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command sync trace active_short hook 0x7facdc004300 2024-09-12T17:57:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 Filter name: none 2024-09-12T17:57:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T17:57:02.792+0000 7fab9cfe1640 20 reqs_thread_entry: start 2024-09-12T17:57:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:57:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:57:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:57:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:57:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 : miss 2024-09-12T17:57:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:57:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 info.flags=0x17 2024-09-12T17:57:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 to cache LRU end 2024-09-12T17:57:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 2024-09-12T17:57:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T17:57:02.808+0000 7facebe7f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 info.flags=0x17 2024-09-12T17:57:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T17:57:02.808+0000 7facebe7f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 to cache LRU end 2024-09-12T17:57:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T17:57:02.808+0000 7facebe7f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T17:57:02.808+0000 7facebe7f9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27, ofs0, ns] 2024-09-12T17:57:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T17:57:02.808+0000 7fabccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366162 cookie 93945090778432 notifier 6966 bl.length()=939 2024-09-12T17:57:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T17:57:02.808+0000 7fabccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 info.flags=0x17 2024-09-12T17:57:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T17:57:02.808+0000 7fabccff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 to cache LRU end 2024-09-12T17:57:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T17:57:02.808+0000 7fabccff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T17:57:02.812+0000 7facebe7f9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): orig_sources= new_sources= 2024-09-12T17:57:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T17:57:02.812+0000 7facebe7f9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): potential sources added=[] removed=[] 2024-09-12T17:57:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T17:57:02.812+0000 7facebe7f9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): orig_dests= new_dests= 2024-09-12T17:57:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T17:57:02.812+0000 7facebe7f9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): potential dests added=[] removed=[] 2024-09-12T17:57:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T17:57:02.812+0000 7facebe7f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7facebe7f9c0 time 2024-09-12T17:57:02.817271+0000 2024-09-12T17:57:02.898 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:57:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7facef7592eb] 2024-09-12T17:57:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7facef75949f] 2024-09-12T17:57:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571494490c1] 2024-09-12T17:57:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: 4: radosgw-admin(+0x141007e) [0x557149e9f07e] 2024-09-12T17:57:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55714945b18d] 2024-09-12T17:57:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T17:57:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7facee5bfd90] 2024-09-12T17:57:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T17:57:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T17:57:02.899 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.899 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T17:57:02.812+0000 7facebe7f9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:57:02.899 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7facebe7f9c0 thread_name:radosgw-admin 2024-09-12T17:57:02.899 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.899 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:02.899 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7facee5d8520] 2024-09-12T17:57:02.899 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:57:02.899 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:57:02.899 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:57:02.899 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7facef759345] 2024-09-12T17:57:02.899 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7facef75949f] 2024-09-12T17:57:02.899 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571494490c1] 2024-09-12T17:57:02.900 INFO:tasks.workunit.client.0.smithi098.stderr: 8: radosgw-admin(+0x141007e) [0x557149e9f07e] 2024-09-12T17:57:02.900 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55714945b18d] 2024-09-12T17:57:02.900 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T17:57:02.900 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7facee5bfd90] 2024-09-12T17:57:02.900 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T17:57:02.900 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T17:57:02.900 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:57:02.900 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.900 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T17:57:02.900 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T17:57:02.900 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T17:57:02.900 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T17:57:02.900 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T17:57:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T17:57:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T17:57:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T17:57:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T17:57:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T17:57:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T17:57:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T17:57:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T17:57:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T17:57:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T17:57:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T17:57:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T17:57:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T17:57:02.902 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T17:57:02.902 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T17:57:02.902 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T17:57:02.902 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T17:57:02.902 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T17:57:02.902 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T17:57:02.902 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:57:02.902 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T17:57:02.902 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T17:57:02.902 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T17:57:02.902 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T17:57:02.902 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T17:57:02.902 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T17:57:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T17:57:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T17:57:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T17:57:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T17:57:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T17:57:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T17:57:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T17:57:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T17:57:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T17:57:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T17:57:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T17:57:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T17:57:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T17:57:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T17:57:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T17:57:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:57:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T17:57:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:57:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T17:57:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T17:57:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T17:57:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T17:57:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T17:57:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T17:57:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T17:57:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T17:57:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T17:57:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T17:57:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T17:57:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T17:57:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T17:57:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T17:57:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T17:57:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T17:57:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T17:57:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T17:57:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:57:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T17:57:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:57:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T17:57:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T17:57:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T17:57:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T17:57:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T17:57:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T17:57:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:57:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T17:57:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T17:57:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:57:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T17:57:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T17:57:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T17:57:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T17:57:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T17:57:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T17:57:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T17:57:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T17:57:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T17:57:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T17:57:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T17:57:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T17:57:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T17:57:02.907 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:57:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: 7fab9cfe1640 / http_manager 2024-09-12T17:57:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: 7fab9efe5640 / http_manager 2024-09-12T17:57:02.909 INFO:tasks.workunit.client.0.smithi098.stderr: 7fab9ffe7640 / rgw_dt_lg_renew 2024-09-12T17:57:02.909 INFO:tasks.workunit.client.0.smithi098.stderr: 7fabbb7fe640 / ms_dispatch 2024-09-12T17:57:02.909 INFO:tasks.workunit.client.0.smithi098.stderr: 7fabccff9640 / io_context_pool 2024-09-12T17:57:02.909 INFO:tasks.workunit.client.0.smithi098.stderr: 7fabcd7fa640 / io_context_pool 2024-09-12T17:57:02.909 INFO:tasks.workunit.client.0.smithi098.stderr: 7fabcf7fe640 / ms_dispatch 2024-09-12T17:57:02.910 INFO:tasks.workunit.client.0.smithi098.stderr: 7fabd6604640 / ms_dispatch 2024-09-12T17:57:02.910 INFO:tasks.workunit.client.0.smithi098.stderr: 7fabd7e07640 / io_context_pool 2024-09-12T17:57:02.910 INFO:tasks.workunit.client.0.smithi098.stderr: 7face9184640 / msgr-worker-2 2024-09-12T17:57:02.910 INFO:tasks.workunit.client.0.smithi098.stderr: 7face9985640 / msgr-worker-1 2024-09-12T17:57:02.910 INFO:tasks.workunit.client.0.smithi098.stderr: 7facea186640 / msgr-worker-0 2024-09-12T17:57:02.910 INFO:tasks.workunit.client.0.smithi098.stderr: 7facea987640 / io_context_pool 2024-09-12T17:57:02.911 INFO:tasks.workunit.client.0.smithi098.stderr: 7facebe7f9c0 / radosgw-admin 2024-09-12T17:57:02.911 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T17:57:02.911 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T17:57:02.911 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/log/ceph/ceph-client.admin.99291.log 2024-09-12T17:57:02.911 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T17:57:02.911 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T17:57:02.912 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb48360) adding con mode: secure 2024-09-12T17:57:02.912 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb48360) adding con mode: crc 2024-09-12T17:57:02.912 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb48360) adding con mode: crc 2024-09-12T17:57:02.912 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb48360) adding con mode: secure 2024-09-12T17:57:02.912 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb48360) adding con mode: crc 2024-09-12T17:57:02.912 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb48360) adding con mode: secure 2024-09-12T17:57:02.913 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb48360) adding con mode: crc 2024-09-12T17:57:02.913 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb48360) adding con mode: secure 2024-09-12T17:57:02.913 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.913 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 1 librados: starting msgr at 2024-09-12T17:57:02.913 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 1 librados: starting objecter 2024-09-12T17:57:02.913 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command objecter_requests hook 0x55714bb4c5e0 2024-09-12T17:57:02.914 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 1 librados: setting wanted keys 2024-09-12T17:57:02.914 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 1 librados: calling monclient init 2024-09-12T17:57:02.914 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient: init 2024-09-12T17:57:02.914 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding auth protocol: cephx 2024-09-12T17:57:02.914 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding auth protocol: cephx 2024-09-12T17:57:02.915 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding auth protocol: cephx 2024-09-12T17:57:02.915 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: secure 2024-09-12T17:57:02.915 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: crc 2024-09-12T17:57:02.915 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: secure 2024-09-12T17:57:02.915 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: crc 2024-09-12T17:57:02.915 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: secure 2024-09-12T17:57:02.916 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: crc 2024-09-12T17:57:02.916 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: crc 2024-09-12T17:57:02.916 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: secure 2024-09-12T17:57:02.916 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: crc 2024-09-12T17:57:02.916 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: secure 2024-09-12T17:57:02.917 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: crc 2024-09-12T17:57:02.917 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb45200) adding con mode: secure 2024-09-12T17:57:02.917 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.917 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.917 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command rotate-key hook 0x55714bb45348 2024-09-12T17:57:02.917 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:57:02.918 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:57:02.918 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-a con 0x55714b9d2840 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:57:02.918 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-c con 0x55714ba8b2b0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:57:02.918 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-b con 0x55714bb6eea0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:57:02.918 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.918 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.918 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.919 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:57:02.919 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T17:57:02.084+0000 7facebe7f9c0 10 monclient(hunting): authenticate will time out at 2618.659692s 2024-09-12T17:57:02.919 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T17:57:02.084+0000 7face9985640 10 monclient(hunting): get_auth_request con 0x55714b9d2840 auth_method 0 2024-09-12T17:57:02.919 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T17:57:02.084+0000 7face9985640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.919 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T17:57:02.084+0000 7face9985640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.920 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T17:57:02.084+0000 7face9985640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:02.920 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T17:57:02.084+0000 7face9184640 10 monclient(hunting): get_auth_request con 0x55714ba8b2b0 auth_method 0 2024-09-12T17:57:02.920 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T17:57:02.084+0000 7face9184640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.920 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T17:57:02.084+0000 7face9184640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.920 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T17:57:02.084+0000 7face9184640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:02.920 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T17:57:02.084+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:02.921 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T17:57:02.084+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:02.921 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T17:57:02.084+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:02.921 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T17:57:02.084+0000 7face9184640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:02.921 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T17:57:02.084+0000 7face9184640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:02.921 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T17:57:02.084+0000 7face9184640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:02.922 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T17:57:02.088+0000 7face9985640 10 monclient(hunting): handle_auth_done global_id 6957 payload 824 2024-09-12T17:57:02.922 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T17:57:02.088+0000 7face9985640 10 monclient: _finish_hunting 0 2024-09-12T17:57:02.922 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T17:57:02.088+0000 7face9985640 1 monclient: found mon.noname-a 2024-09-12T17:57:02.922 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T17:57:02.088+0000 7face9985640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:57:02.922 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T17:57:02.088+0000 7fabd6604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:02.922 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T17:57:02.088+0000 7fabd6604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:57:02.923 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T17:57:02.088+0000 7fabd6604640 10 monclient: dump: 2024-09-12T17:57:02.923 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:02.923 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:02.923 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.923 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.923 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:02.924 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.924 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:02.924 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:02.924 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:02.924 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.924 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T17:57:02.088+0000 7fabd6604640 10 monclient: _finish_auth 0 2024-09-12T17:57:02.925 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T17:57:02.088+0000 7fabd6604640 10 monclient: _check_auth_tickets 2024-09-12T17:57:02.925 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T17:57:02.088+0000 7fabd6604640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:02.925 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T17:57:02.088+0000 7fabd6604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:02.925 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T17:57:02.088+0000 7fabd6604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:57:02.925 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T17:57:02.088+0000 7fabd6604640 10 monclient: dump: 2024-09-12T17:57:02.926 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:02.926 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:02.926 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.926 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.926 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:02.926 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.927 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:02.927 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:02.927 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:02.927 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.927 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T17:57:02.088+0000 7facebe7f9c0 5 monclient: authenticate success, global_id 6957 2024-09-12T17:57:02.927 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T17:57:02.088+0000 7facebe7f9c0 10 monclient: _renew_subs 2024-09-12T17:57:02.928 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T17:57:02.088+0000 7fabd7e07640 4 set_mon_vals no callback set 2024-09-12T17:57:02.928 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T17:57:02.088+0000 7facebe7f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:57:02.928 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T17:57:02.088+0000 7facebe7f9c0 10 monclient: _renew_subs 2024-09-12T17:57:02.928 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T17:57:02.088+0000 7facebe7f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:57:02.928 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T17:57:02.088+0000 7facebe7f9c0 1 librados: init done 2024-09-12T17:57:02.929 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T17:57:02.088+0000 7fabd6604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:57:02.929 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T17:57:02.088+0000 7fabd6604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:02.929 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T17:57:02.088+0000 7fabd6604640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:02.929 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T17:57:02.088+0000 7face9184640 10 monclient: get_auth_request con 0x7fabd0070ae0 auth_method 0 2024-09-12T17:57:02.929 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T17:57:02.088+0000 7facea186640 10 monclient: get_auth_request con 0x55714bb6db20 auth_method 0 2024-09-12T17:57:02.929 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T17:57:02.088+0000 7face9985640 10 monclient: get_auth_request con 0x55714bb90470 auth_method 0 2024-09-12T17:57:02.930 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T17:57:02.092+0000 7face9184640 10 monclient: get_auth_request con 0x55714bb95a40 auth_method 0 2024-09-12T17:57:02.930 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient: build_initial_monmap 2024-09-12T17:57:02.930 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 1 build_initial for_mkfs: 0 2024-09-12T17:57:02.930 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient: monmap: 2024-09-12T17:57:02.930 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:57:02.930 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:57:02.930 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:57:02.931 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:57:02.931 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:57:02.931 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.931 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:57:02.931 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:57:02.931 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:57:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding auth protocol: cephx 2024-09-12T17:57:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding auth protocol: cephx 2024-09-12T17:57:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding auth protocol: cephx 2024-09-12T17:57:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: secure 2024-09-12T17:57:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: crc 2024-09-12T17:57:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: secure 2024-09-12T17:57:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: crc 2024-09-12T17:57:02.933 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: secure 2024-09-12T17:57:02.933 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: crc 2024-09-12T17:57:02.933 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: crc 2024-09-12T17:57:02.933 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: secure 2024-09-12T17:57:02.933 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: crc 2024-09-12T17:57:02.933 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: secure 2024-09-12T17:57:02.933 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: crc 2024-09-12T17:57:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb996e0) adding con mode: secure 2024-09-12T17:57:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55714bb9d150 EEXIST 2024-09-12T17:57:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient: init 2024-09-12T17:57:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding auth protocol: cephx 2024-09-12T17:57:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding auth protocol: cephx 2024-09-12T17:57:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding auth protocol: cephx 2024-09-12T17:57:02.935 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: secure 2024-09-12T17:57:02.935 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: crc 2024-09-12T17:57:02.935 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: secure 2024-09-12T17:57:02.935 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: crc 2024-09-12T17:57:02.935 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: secure 2024-09-12T17:57:02.935 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: crc 2024-09-12T17:57:02.936 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: crc 2024-09-12T17:57:02.936 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: secure 2024-09-12T17:57:02.936 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: crc 2024-09-12T17:57:02.936 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: secure 2024-09-12T17:57:02.936 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: crc 2024-09-12T17:57:02.936 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 AuthRegistry(0x55714bb98788) adding con mode: secure 2024-09-12T17:57:02.937 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.937 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.937 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command rotate-key cmddesc rotate-key hook 0x55714bb988d0 EEXIST 2024-09-12T17:57:02.937 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:57:02.937 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:57:02.937 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-c con 0x55714bbc1300 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:57:02.938 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-a con 0x55714bbc0c30 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:57:02.938 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-b con 0x55714bbbf610 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:57:02.938 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.938 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.938 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.938 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:57:02.939 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T17:57:02.096+0000 7facebe7f9c0 10 monclient(hunting): authenticate will time out at 2618.669702s 2024-09-12T17:57:02.939 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T17:57:02.096+0000 7face9985640 10 monclient(hunting): get_auth_request con 0x55714bbc1300 auth_method 0 2024-09-12T17:57:02.939 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T17:57:02.096+0000 7face9985640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.939 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T17:57:02.096+0000 7face9985640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.939 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T17:57:02.096+0000 7face9985640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:02.940 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T17:57:02.096+0000 7face9184640 10 monclient(hunting): get_auth_request con 0x55714bbc0c30 auth_method 0 2024-09-12T17:57:02.940 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T17:57:02.096+0000 7face9184640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.940 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T17:57:02.096+0000 7face9184640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.940 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T17:57:02.096+0000 7face9184640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:02.940 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T17:57:02.096+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:02.940 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T17:57:02.096+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:02.941 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T17:57:02.096+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:02.941 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T17:57:02.096+0000 7face9184640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:02.941 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T17:57:02.096+0000 7face9184640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:02.941 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T17:57:02.096+0000 7face9184640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:02.941 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T17:57:02.096+0000 7face9985640 10 monclient(hunting): handle_auth_done global_id 6467 payload 824 2024-09-12T17:57:02.941 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T17:57:02.096+0000 7face9985640 10 monclient: _finish_hunting 0 2024-09-12T17:57:02.942 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T17:57:02.096+0000 7face9985640 1 monclient: found mon.noname-c 2024-09-12T17:57:02.942 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T17:57:02.096+0000 7face9985640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:57:02.942 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient: get_auth_request con 0x55714bbc1300 auth_method 0 2024-09-12T17:57:02.942 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T17:57:02.300+0000 7face9985640 0 --2- 172.21.15.98:0/4062313168 >> [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] conn(0x55714bbc1300 0x55714bbd55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T17:57:02.942 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: ms_handle_reset current mon [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:57:02.942 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: _reopen_session rank -1 2024-09-12T17:57:02.943 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:57:02.943 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient(hunting): picked mon.noname-c con 0x7fabc4001dd0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:57:02.943 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient(hunting): picked mon.noname-b con 0x55714bbbf610 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:57:02.943 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient(hunting): picked mon.noname-a con 0x7fabc4007840 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:57:02.943 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.943 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.944 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.944 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient(hunting): _renew_subs 2024-09-12T17:57:02.944 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient(hunting): get_auth_request con 0x7fabc4001dd0 auth_method 0 2024-09-12T17:57:02.944 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.944 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.944 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:57:02.945 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T17:57:02.300+0000 7facea186640 10 monclient(hunting): get_auth_request con 0x7fabc4007840 auth_method 0 2024-09-12T17:57:02.945 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T17:57:02.300+0000 7facea186640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.945 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T17:57:02.300+0000 7facea186640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.945 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T17:57:02.300+0000 7facea186640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:57:02.945 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:02.945 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:02.946 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:57:02.946 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T17:57:02.300+0000 7facea186640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:02.946 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T17:57:02.300+0000 7facea186640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:02.946 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T17:57:02.300+0000 7facea186640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T17:57:02.946 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T17:57:02.300+0000 7face9184640 10 monclient(hunting): get_auth_request con 0x55714bbbf610 auth_method 0 2024-09-12T17:57:02.946 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T17:57:02.300+0000 7face9184640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.947 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T17:57:02.300+0000 7face9184640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.947 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T17:57:02.300+0000 7face9184640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T17:57:02.947 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient(hunting): handle_auth_done global_id 6467 payload 293 2024-09-12T17:57:02.947 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient: _finish_hunting 0 2024-09-12T17:57:02.947 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T17:57:02.300+0000 7face9985640 1 monclient: found mon.noname-c 2024-09-12T17:57:02.947 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T17:57:02.300+0000 7face9985640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:57:02.948 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:02.948 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:57:02.948 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: dump: 2024-09-12T17:57:02.948 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:02.948 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:02.948 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.949 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.949 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:02.949 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.949 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:02.949 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:02.949 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: _finish_auth 0 2024-09-12T17:57:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:57:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T17:57:02.300+0000 7facebe7f9c0 5 monclient: authenticate success, global_id 6467 2024-09-12T17:57:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T17:57:02.300+0000 7facebe7f9c0 10 monclient: _renew_subs 2024-09-12T17:57:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T17:57:02.300+0000 7facebe7f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:57:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:57:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T17:57:02.300+0000 7fabcf7fe640 10 monclient: dump: 2024-09-12T17:57:02.950 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:02.950 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:02.950 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.950 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.951 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:02.951 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.951 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:02.951 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:02.951 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T17:57:02.300+0000 7facea987640 4 set_mon_vals no callback set 2024-09-12T17:57:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T17:57:02.300+0000 7facebe7f9c0 10 monclient: _renew_subs 2024-09-12T17:57:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T17:57:02.300+0000 7facebe7f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:57:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T17:57:02.304+0000 7fabcf7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:57:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T17:57:02.304+0000 7fabcf7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T17:57:02.304+0000 7fabcf7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 10 monclient: get_monmap_and_config 2024-09-12T17:57:02.952 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 10 monclient: build_initial_monmap 2024-09-12T17:57:02.952 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 1 build_initial for_mkfs: 0 2024-09-12T17:57:02.952 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 10 monclient: monmap: 2024-09-12T17:57:02.952 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:57:02.952 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:57:02.952 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:57:02.952 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:57:02.952 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:57:02.952 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.952 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:57:02.952 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:57:02.952 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:57:02.952 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T17:57:02.304+0000 7face9184640 10 monclient: get_auth_request con 0x55714bbc1300 auth_method 0 2024-09-12T17:57:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding auth protocol: cephx 2024-09-12T17:57:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding auth protocol: cephx 2024-09-12T17:57:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding auth protocol: cephx 2024-09-12T17:57:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: secure 2024-09-12T17:57:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: crc 2024-09-12T17:57:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: secure 2024-09-12T17:57:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: crc 2024-09-12T17:57:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: secure 2024-09-12T17:57:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: crc 2024-09-12T17:57:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: crc 2024-09-12T17:57:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: secure 2024-09-12T17:57:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: crc 2024-09-12T17:57:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: secure 2024-09-12T17:57:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: crc 2024-09-12T17:57:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd58c0) adding con mode: secure 2024-09-12T17:57:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 10 monclient: init 2024-09-12T17:57:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding auth protocol: cephx 2024-09-12T17:57:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding auth protocol: cephx 2024-09-12T17:57:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding auth protocol: cephx 2024-09-12T17:57:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: secure 2024-09-12T17:57:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: crc 2024-09-12T17:57:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: secure 2024-09-12T17:57:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: crc 2024-09-12T17:57:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: secure 2024-09-12T17:57:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: crc 2024-09-12T17:57:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: crc 2024-09-12T17:57:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: secure 2024-09-12T17:57:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: crc 2024-09-12T17:57:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: secure 2024-09-12T17:57:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: crc 2024-09-12T17:57:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd370) adding con mode: secure 2024-09-12T17:57:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff676dd4b8 EEXIST 2024-09-12T17:57:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T17:57:02.304+0000 7facebe7f9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:57:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:57:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-b con 0x55714bc0db80 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:57:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-c con 0x55714bc08f70 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:57:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-a con 0x55714bc098f0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:57:02.956 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.956 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.956 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.956 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:57:02.956 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): authenticate will time out at 2618.880082s 2024-09-12T17:57:02.956 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): get_auth_request con 0x55714bc098f0 auth_method 0 2024-09-12T17:57:02.956 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.956 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.956 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:02.956 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:02.956 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:02.956 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:02.956 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T17:57:02.308+0000 7face9184640 10 monclient(hunting): get_auth_request con 0x55714bc08f70 auth_method 0 2024-09-12T17:57:02.956 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T17:57:02.308+0000 7face9184640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.957 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T17:57:02.308+0000 7face9184640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.957 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T17:57:02.308+0000 7face9184640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:02.957 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): get_auth_request con 0x55714bc0db80 auth_method 0 2024-09-12T17:57:02.957 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.957 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.957 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:02.957 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): handle_auth_done global_id 6963 payload 274 2024-09-12T17:57:02.957 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient: _finish_hunting 0 2024-09-12T17:57:02.957 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T17:57:02.308+0000 7facea186640 1 monclient: found mon.noname-a 2024-09-12T17:57:02.957 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:57:02.957 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T17:57:02.308+0000 7fabcd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:02.957 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T17:57:02.308+0000 7fabcd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:57:02.957 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T17:57:02.308+0000 7fabcd7fa640 10 monclient: dump: 2024-09-12T17:57:02.957 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:02.958 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:02.958 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.958 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.958 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:02.958 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.958 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:02.958 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:02.958 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:02.958 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.958 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T17:57:02.308+0000 7fabcd7fa640 10 monclient: _finish_auth 0 2024-09-12T17:57:02.958 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T17:57:02.308+0000 7fabcd7fa640 10 monclient: _check_auth_tickets 2024-09-12T17:57:02.958 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T17:57:02.308+0000 7fabcd7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:02.958 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T17:57:02.308+0000 7fabcd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:02.958 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T17:57:02.308+0000 7fabcd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:57:02.959 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T17:57:02.308+0000 7fabcd7fa640 10 monclient: dump: 2024-09-12T17:57:02.959 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:02.959 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:02.959 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.959 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.959 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:02.959 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.959 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:02.959 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:02.959 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:02.959 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.959 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 monclient: authenticate success, global_id 6963 2024-09-12T17:57:02.959 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:57:02.960 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 4 set_mon_vals no callback set 2024-09-12T17:57:02.960 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient: shutdown 2024-09-12T17:57:02.960 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient: build_initial_monmap 2024-09-12T17:57:02.960 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 1 build_initial for_mkfs: 0 2024-09-12T17:57:02.960 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient: monmap: 2024-09-12T17:57:02.960 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:57:02.960 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:57:02.960 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:57:02.960 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:57:02.960 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:57:02.960 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.960 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:57:02.960 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:57:02.960 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:57:02.961 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.961 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding auth protocol: cephx 2024-09-12T17:57:02.961 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding auth protocol: cephx 2024-09-12T17:57:02.961 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding auth protocol: cephx 2024-09-12T17:57:02.961 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: secure 2024-09-12T17:57:02.961 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: crc 2024-09-12T17:57:02.961 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: secure 2024-09-12T17:57:02.961 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: crc 2024-09-12T17:57:02.961 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: secure 2024-09-12T17:57:02.961 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: crc 2024-09-12T17:57:02.961 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: crc 2024-09-12T17:57:02.961 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: secure 2024-09-12T17:57:02.961 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: crc 2024-09-12T17:57:02.961 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: secure 2024-09-12T17:57:02.962 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: crc 2024-09-12T17:57:02.962 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbd5870) adding con mode: secure 2024-09-12T17:57:02.962 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.962 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 1 librados: starting msgr at 2024-09-12T17:57:02.962 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 1 librados: starting objecter 2024-09-12T17:57:02.962 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55714bbc1070 EEXIST 2024-09-12T17:57:02.962 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 1 librados: setting wanted keys 2024-09-12T17:57:02.962 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 1 librados: calling monclient init 2024-09-12T17:57:02.962 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient: init 2024-09-12T17:57:02.962 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding auth protocol: cephx 2024-09-12T17:57:02.962 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding auth protocol: cephx 2024-09-12T17:57:02.962 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding auth protocol: cephx 2024-09-12T17:57:02.962 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: secure 2024-09-12T17:57:02.962 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: crc 2024-09-12T17:57:02.963 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: secure 2024-09-12T17:57:02.963 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: crc 2024-09-12T17:57:02.963 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: secure 2024-09-12T17:57:02.963 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: crc 2024-09-12T17:57:02.963 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: crc 2024-09-12T17:57:02.963 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: secure 2024-09-12T17:57:02.963 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: crc 2024-09-12T17:57:02.963 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: secure 2024-09-12T17:57:02.963 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: crc 2024-09-12T17:57:02.963 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 AuthRegistry(0x55714bbc3120) adding con mode: secure 2024-09-12T17:57:02.963 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.963 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.963 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command rotate-key cmddesc rotate-key hook 0x55714bbc3268 EEXIST 2024-09-12T17:57:02.963 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:57:02.964 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:57:02.964 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-c con 0x55714bc08f70 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:57:02.964 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-b con 0x55714bc098f0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:57:02.964 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): picked mon.noname-a con 0x55714bc0db80 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:57:02.964 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.964 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.964 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:02.964 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:57:02.964 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T17:57:02.308+0000 7facebe7f9c0 10 monclient(hunting): authenticate will time out at 2618.883456s 2024-09-12T17:57:02.964 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): get_auth_request con 0x55714bc0db80 auth_method 0 2024-09-12T17:57:02.964 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.964 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.964 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:02.965 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): get_auth_request con 0x55714bc08f70 auth_method 0 2024-09-12T17:57:02.965 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.965 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.965 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:02.965 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:02.965 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:02.965 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:02.965 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:02.965 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:02.965 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T17:57:02.308+0000 7face9985640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:02.965 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T17:57:02.308+0000 7face9184640 10 monclient(hunting): get_auth_request con 0x55714bc098f0 auth_method 0 2024-09-12T17:57:02.965 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T17:57:02.308+0000 7face9184640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:02.965 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T17:57:02.308+0000 7face9184640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:02.965 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T17:57:02.308+0000 7face9184640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:02.966 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient(hunting): handle_auth_done global_id 6966 payload 824 2024-09-12T17:57:02.966 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient: _finish_hunting 0 2024-09-12T17:57:02.966 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T17:57:02.308+0000 7facea186640 1 monclient: found mon.noname-a 2024-09-12T17:57:02.966 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T17:57:02.308+0000 7facea186640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:57:02.966 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:02.966 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:57:02.966 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 10 monclient: dump: 2024-09-12T17:57:02.966 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:02.966 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:02.966 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.966 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.966 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:02.966 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.966 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:02.967 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:02.967 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:02.967 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.967 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 10 monclient: _finish_auth 0 2024-09-12T17:57:02.967 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 10 monclient: _check_auth_tickets 2024-09-12T17:57:02.967 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T17:57:02.312+0000 7facebe7f9c0 5 monclient: authenticate success, global_id 6966 2024-09-12T17:57:02.967 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T17:57:02.312+0000 7facebe7f9c0 10 monclient: _renew_subs 2024-09-12T17:57:02.967 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T17:57:02.312+0000 7facebe7f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:57:02.967 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:02.967 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:02.967 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:57:02.967 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 10 monclient: dump: 2024-09-12T17:57:02.967 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:02.967 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:02.968 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.968 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:02.968 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:02.968 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:02.968 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:02.968 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:02.968 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:02.968 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.968 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T17:57:02.312+0000 7fabcd7fa640 4 set_mon_vals no callback set 2024-09-12T17:57:02.968 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T17:57:02.312+0000 7facebe7f9c0 10 monclient: _renew_subs 2024-09-12T17:57:02.968 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T17:57:02.312+0000 7facebe7f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:57:02.968 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T17:57:02.312+0000 7facebe7f9c0 1 librados: init done 2024-09-12T17:57:02.968 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T17:57:02.312+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command cr dump hook 0x55714bc05f18 2024-09-12T17:57:02.968 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T17:57:02.312+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.969 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:57:02.969 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:02.969 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T17:57:02.312+0000 7fabbb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:02.969 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T17:57:02.312+0000 7face9985640 10 monclient: get_auth_request con 0x7fabb4070ae0 auth_method 0 2024-09-12T17:57:02.969 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T17:57:02.312+0000 7face9184640 10 monclient: get_auth_request con 0x55714bc26e60 auth_method 0 2024-09-12T17:57:02.969 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.969 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 realm 2024-09-12T17:57:02.969 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.969 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.969 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:02.969 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.969 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.969 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.969 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T17:57:02.316+0000 7face9985640 10 monclient: get_auth_request con 0x55714bc2b180 auth_method 0 2024-09-12T17:57:02.970 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:02.970 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.970 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:02.970 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T17:57:02.316+0000 7facebe7f9c0 20 searching for the correct realm 2024-09-12T17:57:02.970 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T17:57:02.316+0000 7face9184640 10 monclient: get_auth_request con 0x55714bc30290 auth_method 0 2024-09-12T17:57:02.970 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T17:57:02.320+0000 7facea186640 10 monclient: get_auth_request con 0x7face002cb20 auth_method 0 2024-09-12T17:57:02.970 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T17:57:02.320+0000 7face9985640 10 monclient: get_auth_request con 0x7face4040070 auth_method 0 2024-09-12T17:57:02.970 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T17:57:02.320+0000 7face9184640 10 monclient: get_auth_request con 0x7facdc0c0070 auth_method 0 2024-09-12T17:57:02.970 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T17:57:02.320+0000 7face9184640 0 -- 172.21.15.98:0/265200285 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7facdc0c0070 msgr2=0x7facdc0fe840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:02.970 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T17:57:02.524+0000 7face9184640 10 monclient: get_auth_request con 0x7facdc0c0070 auth_method 0 2024-09-12T17:57:02.970 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T17:57:02.528+0000 7facea186640 10 monclient: get_auth_request con 0x7face001cb20 auth_method 0 2024-09-12T17:57:02.970 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T17:57:02.536+0000 7face9985640 10 monclient: get_auth_request con 0x7face004e900 auth_method 0 2024-09-12T17:57:02.970 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T17:57:02.536+0000 7face9985640 0 -- 172.21.15.98:0/265200285 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7face004e900 msgr2=0x7face000e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:02.970 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T17:57:02.740+0000 7face9985640 10 monclient: get_auth_request con 0x7face004e900 auth_method 0 2024-09-12T17:57:02.971 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:02.971 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:57:02.971 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:02.971 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:57:02.971 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:02.971 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:02.971 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.971 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.971 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.971 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:02.971 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.971 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:02.971 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 zone default found 2024-09-12T17:57:02.971 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 4 Realm: () 2024-09-12T17:57:02.972 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:57:02.972 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:57:02.972 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:02.972 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 zonegroup default 2024-09-12T17:57:02.972 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T17:57:02.756+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.972 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.972 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.972 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.972 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.972 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.972 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 started sync module instance, tier type = 2024-09-12T17:57:02.972 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T17:57:02.760+0000 7facebe7f9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:57:02.972 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=0 2024-09-12T17:57:02.973 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=1 2024-09-12T17:57:02.973 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=2 2024-09-12T17:57:02.973 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=3 2024-09-12T17:57:02.973 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=4 2024-09-12T17:57:02.973 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=5 2024-09-12T17:57:02.973 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=6 2024-09-12T17:57:02.973 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T17:57:02.784+0000 7facebe7f9c0 20 add_watcher() i=7 2024-09-12T17:57:02.973 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T17:57:02.784+0000 7facebe7f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:02.973 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding auth protocol: cephx 2024-09-12T17:57:02.973 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding auth protocol: cephx 2024-09-12T17:57:02.973 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding auth protocol: cephx 2024-09-12T17:57:02.973 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: secure 2024-09-12T17:57:02.973 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: crc 2024-09-12T17:57:02.973 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: secure 2024-09-12T17:57:02.974 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: crc 2024-09-12T17:57:02.974 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: secure 2024-09-12T17:57:02.974 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: crc 2024-09-12T17:57:02.974 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: crc 2024-09-12T17:57:02.974 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: secure 2024-09-12T17:57:02.974 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: crc 2024-09-12T17:57:02.974 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T17:57:02.788+0000 7fab9ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:02.974 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: secure 2024-09-12T17:57:02.974 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: crc 2024-09-12T17:57:02.974 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T17:57:02.788+0000 7facebe7f9c0 5 AuthRegistry(0x7fff676dd840) adding con mode: secure 2024-09-12T17:57:02.974 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:02.974 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:02.974 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:02.974 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command cache list hook 0x55714bbfe510 2024-09-12T17:57:02.975 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command cache inspect hook 0x55714bbfe510 2024-09-12T17:57:02.975 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command cache erase hook 0x55714bbfe510 2024-09-12T17:57:02.975 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command cache zap hook 0x55714bbfe510 2024-09-12T17:57:02.975 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 5 note: GC not initialized 2024-09-12T17:57:02.975 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T17:57:02.792+0000 7fab9efe5640 20 reqs_thread_entry: start 2024-09-12T17:57:02.975 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command sync trace show hook 0x7facdc004300 2024-09-12T17:57:02.975 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command sync trace history hook 0x7facdc004300 2024-09-12T17:57:02.975 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command sync trace active hook 0x7facdc004300 2024-09-12T17:57:02.975 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 5 asok(0x55714b93a2b0) register_command sync trace active_short hook 0x7facdc004300 2024-09-12T17:57:02.975 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:02.975 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 Filter name: none 2024-09-12T17:57:02.975 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T17:57:02.792+0000 7fab9cfe1640 20 reqs_thread_entry: start 2024-09-12T17:57:02.975 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:57:02.975 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.976 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:57:02.976 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:57:02.976 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:57:02.976 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 : miss 2024-09-12T17:57:02.976 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.976 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:57:02.976 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 info.flags=0x17 2024-09-12T17:57:02.976 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 to cache LRU end 2024-09-12T17:57:02.976 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:02.976 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:02.976 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T17:57:02.792+0000 7facebe7f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 2024-09-12T17:57:02.976 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T17:57:02.808+0000 7facebe7f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 info.flags=0x17 2024-09-12T17:57:02.976 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T17:57:02.808+0000 7facebe7f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 to cache LRU end 2024-09-12T17:57:02.977 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T17:57:02.808+0000 7facebe7f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:02.977 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T17:57:02.808+0000 7facebe7f9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27, ofs0, ns] 2024-09-12T17:57:02.977 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T17:57:02.808+0000 7fabccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366162 cookie 93945090778432 notifier 6966 bl.length()=939 2024-09-12T17:57:02.977 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T17:57:02.808+0000 7fabccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 info.flags=0x17 2024-09-12T17:57:02.977 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T17:57:02.808+0000 7fabccff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 to cache LRU end 2024-09-12T17:57:02.977 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T17:57:02.808+0000 7fabccff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:02.977 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T17:57:02.812+0000 7facebe7f9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): orig_sources= new_sources= 2024-09-12T17:57:02.977 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T17:57:02.812+0000 7facebe7f9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): potential sources added=[] removed=[] 2024-09-12T17:57:02.977 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T17:57:02.812+0000 7facebe7f9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): orig_dests= new_dests= 2024-09-12T17:57:02.977 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T17:57:02.812+0000 7facebe7f9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): potential dests added=[] removed=[] 2024-09-12T17:57:02.977 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T17:57:02.812+0000 7facebe7f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7facebe7f9c0 time 2024-09-12T17:57:02.817271+0000 2024-09-12T17:57:02.977 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:57:02.977 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.977 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:02.978 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7facef7592eb] 2024-09-12T17:57:02.978 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7facef75949f] 2024-09-12T17:57:02.978 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571494490c1] 2024-09-12T17:57:02.978 INFO:tasks.workunit.client.0.smithi098.stderr: 4: radosgw-admin(+0x141007e) [0x557149e9f07e] 2024-09-12T17:57:02.978 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55714945b18d] 2024-09-12T17:57:02.978 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T17:57:02.978 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7facee5bfd90] 2024-09-12T17:57:02.978 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T17:57:02.978 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T17:57:02.978 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.978 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T17:57:02.812+0000 7facebe7f9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:57:02.978 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7facebe7f9c0 thread_name:radosgw-admin 2024-09-12T17:57:02.978 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.978 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:02.979 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7facee5d8520] 2024-09-12T17:57:02.979 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:57:02.979 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:57:02.979 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:57:02.979 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7facef759345] 2024-09-12T17:57:02.979 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7facef75949f] 2024-09-12T17:57:02.979 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5571494490c1] 2024-09-12T17:57:02.979 INFO:tasks.workunit.client.0.smithi098.stderr: 8: radosgw-admin(+0x141007e) [0x557149e9f07e] 2024-09-12T17:57:02.979 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55714945b18d] 2024-09-12T17:57:02.979 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T17:57:02.979 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7facee5bfd90] 2024-09-12T17:57:02.979 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T17:57:02.979 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T17:57:02.979 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:57:02.980 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.980 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T17:57:02.980 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T17:57:02.980 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T17:57:02.980 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T17:57:02.980 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T17:57:02.980 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T17:57:02.980 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T17:57:02.980 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T17:57:02.980 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T17:57:02.980 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T17:57:02.980 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T17:57:02.980 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T17:57:02.980 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T17:57:02.981 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T17:57:02.981 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T17:57:02.981 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T17:57:02.981 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T17:57:02.981 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T17:57:02.981 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T17:57:02.981 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T17:57:02.981 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T17:57:02.981 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T17:57:02.981 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T17:57:02.981 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T17:57:02.981 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:57:02.981 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T17:57:02.981 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T17:57:02.982 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T17:57:02.982 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T17:57:02.982 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T17:57:02.982 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T17:57:02.982 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T17:57:02.982 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T17:57:02.982 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T17:57:02.982 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T17:57:02.982 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T17:57:02.982 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T17:57:02.982 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T17:57:02.982 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T17:57:02.982 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T17:57:02.982 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T17:57:02.983 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T17:57:02.983 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T17:57:02.983 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T17:57:02.983 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T17:57:02.983 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T17:57:02.983 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:57:02.983 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T17:57:02.983 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:57:02.983 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T17:57:02.983 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T17:57:02.983 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T17:57:02.983 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T17:57:02.983 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T17:57:02.983 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T17:57:02.983 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T17:57:02.984 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T17:57:02.984 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T17:57:02.984 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T17:57:02.984 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T17:57:02.984 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T17:57:02.984 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T17:57:02.984 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T17:57:02.984 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T17:57:02.984 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T17:57:02.984 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T17:57:02.984 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T17:57:02.984 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:57:02.984 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T17:57:02.984 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:57:02.985 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T17:57:02.985 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T17:57:02.985 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T17:57:02.985 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T17:57:02.985 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T17:57:02.985 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T17:57:02.985 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:57:02.985 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T17:57:02.985 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T17:57:02.985 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:57:02.985 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T17:57:02.985 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T17:57:02.985 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T17:57:02.985 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T17:57:02.986 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T17:57:02.986 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T17:57:02.986 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T17:57:02.986 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T17:57:02.986 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T17:57:02.986 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T17:57:02.986 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T17:57:02.986 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T17:57:02.986 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T17:57:02.986 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:57:02.986 INFO:tasks.workunit.client.0.smithi098.stderr: 7fab9cfe1640 / http_manager 2024-09-12T17:57:02.986 INFO:tasks.workunit.client.0.smithi098.stderr: 7fab9efe5640 / http_manager 2024-09-12T17:57:02.986 INFO:tasks.workunit.client.0.smithi098.stderr: 7fab9ffe7640 / rgw_dt_lg_renew 2024-09-12T17:57:02.986 INFO:tasks.workunit.client.0.smithi098.stderr: 7fabbb7fe640 / ms_dispatch 2024-09-12T17:57:02.987 INFO:tasks.workunit.client.0.smithi098.stderr: 7fabccff9640 / io_context_pool 2024-09-12T17:57:02.987 INFO:tasks.workunit.client.0.smithi098.stderr: 7fabcd7fa640 / io_context_pool 2024-09-12T17:57:02.987 INFO:tasks.workunit.client.0.smithi098.stderr: 7fabcf7fe640 / ms_dispatch 2024-09-12T17:57:02.987 INFO:tasks.workunit.client.0.smithi098.stderr: 7fabd6604640 / ms_dispatch 2024-09-12T17:57:02.987 INFO:tasks.workunit.client.0.smithi098.stderr: 7fabd7e07640 / io_context_pool 2024-09-12T17:57:02.987 INFO:tasks.workunit.client.0.smithi098.stderr: 7face9184640 / msgr-worker-2 2024-09-12T17:57:02.987 INFO:tasks.workunit.client.0.smithi098.stderr: 7face9985640 / msgr-worker-1 2024-09-12T17:57:02.987 INFO:tasks.workunit.client.0.smithi098.stderr: 7facea186640 / msgr-worker-0 2024-09-12T17:57:02.987 INFO:tasks.workunit.client.0.smithi098.stderr: 7facea987640 / io_context_pool 2024-09-12T17:57:02.987 INFO:tasks.workunit.client.0.smithi098.stderr: 7facebe7f9c0 / radosgw-admin 2024-09-12T17:57:02.987 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T17:57:02.987 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T17:57:02.987 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:57:02.819818Z_0d14c177-fba2-4e58-863b-f80f1e9fc32c/log 2024-09-12T17:57:02.987 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T17:57:02.988 INFO:tasks.workunit.client.0.smithi098.stderr:Aborted 2024-09-12T17:57:02.988 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:57:02.993 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:02.993 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:02.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.896+0000 7f4117bb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.900+0000 7f4117bb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.900+0000 7f4117bb79c0 20 realm 2024-09-12T17:57:02.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.900+0000 7f4117bb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.900+0000 7f4117bb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.900+0000 7f4117bb79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:02.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.900+0000 7f4117bb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.900+0000 7f4117bb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.900+0000 7f4117bb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.900+0000 7f4117bb79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:02.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.900+0000 7f4117bb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.900+0000 7f4117bb79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:02.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.900+0000 7f4117bb79c0 20 searching for the correct realm 2024-09-12T17:57:02.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.908+0000 7f410ffff640 0 -- 172.21.15.98:0/1459515716 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f4108038040 msgr2=0x7f4108019410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:02.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.916+0000 7f4115ebe640 0 -- 172.21.15.98:0/1459515716 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f410004b940 msgr2=0x7f41000083e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:02.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.920+0000 7f4117bb79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:02.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.920+0000 7f4117bb79c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:57:02.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.920+0000 7f4117bb79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:02.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.920+0000 7f4117bb79c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:57:02.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.920+0000 7f4117bb79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:02.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.920+0000 7f4117bb79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:02.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.920+0000 7f4117bb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.920+0000 7f4117bb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.920+0000 7f4117bb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.924+0000 7f4117bb79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:02.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.924+0000 7f4117bb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.924+0000 7f4117bb79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:02.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.924+0000 7f4117bb79c0 20 zone default found 2024-09-12T17:57:02.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.924+0000 7f4117bb79c0 4 Realm: () 2024-09-12T17:57:02.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.924+0000 7f4117bb79c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:57:02.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.924+0000 7f4117bb79c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:57:02.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.924+0000 7f4117bb79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:02.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.924+0000 7f4117bb79c0 20 zonegroup default 2024-09-12T17:57:02.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.924+0000 7f4117bb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.924+0000 7f4117bb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.924+0000 7f4117bb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.924+0000 7f4117bb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.924+0000 7f4117bb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.924+0000 7f4117bb79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:02.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.924+0000 7f4117bb79c0 20 started sync module instance, tier type = 2024-09-12T17:57:02.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.924+0000 7f4117bb79c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:57:02.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.940+0000 7f4117bb79c0 20 add_watcher() i=0 2024-09-12T17:57:02.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.940+0000 7f4117bb79c0 20 add_watcher() i=1 2024-09-12T17:57:02.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.940+0000 7f4117bb79c0 20 add_watcher() i=2 2024-09-12T17:57:02.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.940+0000 7f4117bb79c0 20 add_watcher() i=3 2024-09-12T17:57:02.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.940+0000 7f4117bb79c0 20 add_watcher() i=4 2024-09-12T17:57:02.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.940+0000 7f4117bb79c0 20 add_watcher() i=5 2024-09-12T17:57:02.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.940+0000 7f4117bb79c0 20 add_watcher() i=6 2024-09-12T17:57:02.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.944+0000 7f4117bb79c0 20 add_watcher() i=7 2024-09-12T17:57:02.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.944+0000 7f4117bb79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:02.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.944+0000 7f3fcb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:02.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.944+0000 7f4117bb79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:02.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.944+0000 7f4117bb79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:02.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.944+0000 7f4117bb79c0 5 note: GC not initialized 2024-09-12T17:57:02.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.944+0000 7f3fca7e4640 20 reqs_thread_entry: start 2024-09-12T17:57:02.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.944+0000 7f4117bb79c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:02.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.944+0000 7f4117bb79c0 20 Filter name: none 2024-09-12T17:57:02.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.944+0000 7f3f3bfff640 20 reqs_thread_entry: start 2024-09-12T17:57:02.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.944+0000 7f4117bb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.948+0000 7f4117bb79c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:57:02.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.948+0000 7f4117bb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.948+0000 7f4117bb79c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:57:02.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.948+0000 7f4117bb79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:02.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.948+0000 7f4117bb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.948+0000 7f4117bb79c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:57:02.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.948+0000 7f4117bb79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:02.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.948+0000 7f4117bb79c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:57:02.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.948+0000 7f4117bb79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:02.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.952+0000 7f3fcb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:02.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.956+0000 7f4117bb79c0 20 remove_watcher() i=0 2024-09-12T17:57:02.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.956+0000 7f4117bb79c0 2 removed watcher, disabling cache 2024-09-12T17:57:02.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.960+0000 7f4117bb79c0 20 remove_watcher() i=1 2024-09-12T17:57:02.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.960+0000 7f4117bb79c0 20 remove_watcher() i=2 2024-09-12T17:57:02.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.964+0000 7f4117bb79c0 20 remove_watcher() i=3 2024-09-12T17:57:02.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.964+0000 7f4117bb79c0 20 remove_watcher() i=4 2024-09-12T17:57:02.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.968+0000 7f4117bb79c0 20 remove_watcher() i=5 2024-09-12T17:57:02.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.968+0000 7f4117bb79c0 20 remove_watcher() i=6 2024-09-12T17:57:02.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:02.968+0000 7f4117bb79c0 20 remove_watcher() i=7 2024-09-12T17:57:02.998 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.999 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:57:02.999 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-trim-reshard-log-entries id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:57:02.999 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:02.999 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:02.999 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:03.029 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:03.029 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:03.092 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:57:03.127 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:03.127 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:03.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.168+0000 7f737b81a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.168+0000 7f737b81a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.168+0000 7f737b81a9c0 20 realm 2024-09-12T17:57:03.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.168+0000 7f737b81a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.168+0000 7f737b81a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.168+0000 7f737b81a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:03.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.168+0000 7f737b81a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.173 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.168+0000 7f737b81a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.173 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.168+0000 7f737b81a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.168+0000 7f737b81a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:03.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.168+0000 7f737b81a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.172+0000 7f737b81a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:03.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.172+0000 7f737b81a9c0 20 searching for the correct realm 2024-09-12T17:57:03.180 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.176+0000 7f7378b1f640 0 -- 172.21.15.98:0/3725138961 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f736c0c9070 msgr2=0x7f736c002780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:03.187 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.184+0000 7f7379b21640 0 -- 172.21.15.98:0/3725138961 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f736406daf0 msgr2=0x7f736407e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:03.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.188+0000 7f737b81a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:03.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.188+0000 7f737b81a9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:57:03.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.188+0000 7f737b81a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:03.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.188+0000 7f737b81a9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:57:03.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.188+0000 7f737b81a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:03.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.188+0000 7f737b81a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:03.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.188+0000 7f737b81a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.188+0000 7f737b81a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.188+0000 7f737b81a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.192+0000 7f737b81a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:03.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.192+0000 7f737b81a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.192+0000 7f737b81a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:03.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.192+0000 7f737b81a9c0 20 zone default found 2024-09-12T17:57:03.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.192+0000 7f737b81a9c0 4 Realm: () 2024-09-12T17:57:03.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.192+0000 7f737b81a9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:57:03.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.192+0000 7f737b81a9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:57:03.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.192+0000 7f737b81a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:03.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.192+0000 7f737b81a9c0 20 zonegroup default 2024-09-12T17:57:03.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.192+0000 7f737b81a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.192+0000 7f737b81a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.192+0000 7f737b81a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.192+0000 7f737b81a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.192+0000 7f737b81a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.192+0000 7f737b81a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:03.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.192+0000 7f737b81a9c0 20 started sync module instance, tier type = 2024-09-12T17:57:03.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.192+0000 7f737b81a9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:57:03.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.212+0000 7f737b81a9c0 20 add_watcher() i=0 2024-09-12T17:57:03.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.212+0000 7f737b81a9c0 20 add_watcher() i=1 2024-09-12T17:57:03.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.212+0000 7f737b81a9c0 20 add_watcher() i=2 2024-09-12T17:57:03.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.212+0000 7f737b81a9c0 20 add_watcher() i=3 2024-09-12T17:57:03.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.212+0000 7f737b81a9c0 20 add_watcher() i=4 2024-09-12T17:57:03.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.212+0000 7f737b81a9c0 20 add_watcher() i=5 2024-09-12T17:57:03.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.212+0000 7f737b81a9c0 20 add_watcher() i=6 2024-09-12T17:57:03.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.212+0000 7f737b81a9c0 20 add_watcher() i=7 2024-09-12T17:57:03.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.212+0000 7f737b81a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:03.218 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f722ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:03.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f737b81a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:03.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f737b81a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:03.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f737b81a9c0 5 note: GC not initialized 2024-09-12T17:57:03.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f722efe5640 20 reqs_thread_entry: start 2024-09-12T17:57:03.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f737b81a9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:03.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f737b81a9c0 20 Filter name: none 2024-09-12T17:57:03.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f722cfe1640 20 reqs_thread_entry: start 2024-09-12T17:57:03.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f737b81a9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:57:03.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f737b81a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f737b81a9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:57:03.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f737b81a9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:57:03.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f737b81a9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:57:03.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f737b81a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 : miss 2024-09-12T17:57:03.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f737b81a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:03.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f737b81a9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:57:03.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f737b81a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 info.flags=0x17 2024-09-12T17:57:03.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f737b81a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 to cache LRU end 2024-09-12T17:57:03.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f737b81a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:03.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f737b81a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:03.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.216+0000 7f737b81a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 2024-09-12T17:57:03.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.220+0000 7f737b81a9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 to be held by another RGW process; skipping for now 2024-09-12T17:57:03.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.220+0000 7f722ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:03.229 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.224+0000 7f737b81a9c0 20 remove_watcher() i=0 2024-09-12T17:57:03.229 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.224+0000 7f737b81a9c0 2 removed watcher, disabling cache 2024-09-12T17:57:03.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.228+0000 7f737b81a9c0 20 remove_watcher() i=1 2024-09-12T17:57:03.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.228+0000 7f737b81a9c0 20 remove_watcher() i=2 2024-09-12T17:57:03.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.232+0000 7f737b81a9c0 20 remove_watcher() i=3 2024-09-12T17:57:03.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.232+0000 7f737b81a9c0 20 remove_watcher() i=4 2024-09-12T17:57:03.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.236+0000 7f737b81a9c0 20 remove_watcher() i=5 2024-09-12T17:57:03.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.236+0000 7f737b81a9c0 20 remove_watcher() i=6 2024-09-12T17:57:03.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:03.236+0000 7f737b81a9c0 20 remove_watcher() i=7 2024-09-12T17:57:03.254 INFO:tasks.workunit.client.0.smithi098.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:57:33.281 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:57:33.318 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:33.318 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:33.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.364+0000 7f89a03319c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.364+0000 7f89a03319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:33.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.364+0000 7f89a03319c0 20 realm 2024-09-12T17:57:33.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.364+0000 7f89a03319c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.364+0000 7f89a03319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:33.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.364+0000 7f89a03319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:33.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.364+0000 7f89a03319c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.364+0000 7f89a03319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:33.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.364+0000 7f89a03319c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.368+0000 7f89a03319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:33.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.368+0000 7f89a03319c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.368+0000 7f89a03319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:33.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.368+0000 7f89a03319c0 20 searching for the correct realm 2024-09-12T17:57:33.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.372+0000 7f899d636640 0 -- 172.21.15.98:0/3178720629 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f8990020040 msgr2=0x7f8990020420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:33.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.380+0000 7f899d636640 0 -- 172.21.15.98:0/3178720629 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f8868081180 msgr2=0x7f88680835b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:33.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:33.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:57:33.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:33.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:57:33.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:33.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:33.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:33.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.391 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:33.391 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.391 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:33.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 20 zone default found 2024-09-12T17:57:33.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 4 Realm: () 2024-09-12T17:57:33.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:57:33.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:57:33.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:33.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 20 zonegroup default 2024-09-12T17:57:33.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:33.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.388+0000 7f89a03319c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.392+0000 7f89a03319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:33.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.392+0000 7f89a03319c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.392+0000 7f89a03319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:33.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.392+0000 7f89a03319c0 20 started sync module instance, tier type = 2024-09-12T17:57:33.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.392+0000 7f89a03319c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:57:33.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.416+0000 7f89a03319c0 20 add_watcher() i=0 2024-09-12T17:57:33.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.416+0000 7f89a03319c0 20 add_watcher() i=1 2024-09-12T17:57:33.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.416+0000 7f89a03319c0 20 add_watcher() i=2 2024-09-12T17:57:33.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.416+0000 7f89a03319c0 20 add_watcher() i=3 2024-09-12T17:57:33.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.416+0000 7f89a03319c0 20 add_watcher() i=4 2024-09-12T17:57:33.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.416+0000 7f89a03319c0 20 add_watcher() i=5 2024-09-12T17:57:33.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.416+0000 7f89a03319c0 20 add_watcher() i=6 2024-09-12T17:57:33.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.420+0000 7f89a03319c0 20 add_watcher() i=7 2024-09-12T17:57:33.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.420+0000 7f89a03319c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:33.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.420+0000 7f884f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:33.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.420+0000 7f89a03319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:33.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.420+0000 7f89a03319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:33.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.420+0000 7f89a03319c0 5 note: GC not initialized 2024-09-12T17:57:33.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.420+0000 7f884e7fc640 20 reqs_thread_entry: start 2024-09-12T17:57:33.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.424+0000 7f89a03319c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:33.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.424+0000 7f89a03319c0 20 Filter name: none 2024-09-12T17:57:33.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.424+0000 7f87bffff640 20 reqs_thread_entry: start 2024-09-12T17:57:33.424 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.424+0000 7f89a03319c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T17:57:33.424 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.424+0000 7f89a03319c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.424+0000 7f89a03319c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:57:33.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.424+0000 7f89a03319c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T17:57:33.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.424+0000 7f89a03319c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T17:57:33.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.424+0000 7f89a03319c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 : miss 2024-09-12T17:57:33.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.424+0000 7f89a03319c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.424+0000 7f89a03319c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T17:57:33.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.424+0000 7f89a03319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 info.flags=0x17 2024-09-12T17:57:33.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.424+0000 7f89a03319c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 to cache LRU end 2024-09-12T17:57:33.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.424+0000 7f89a03319c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:33.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.424+0000 7f89a03319c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:33.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.424+0000 7f89a03319c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 2024-09-12T17:57:33.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.428+0000 7f89a03319c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:57:33.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.440+0000 7f89a03319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 info.flags=0x17 2024-09-12T17:57:33.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.440+0000 7f89a03319c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 to cache LRU end 2024-09-12T17:57:33.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.440+0000 7f89a03319c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:33.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.440+0000 7f89a03319c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27, ofs0, ns] 2024-09-12T17:57:33.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.440+0000 7f8880ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366163 cookie 94001320127328 notifier 7026 bl.length()=939 2024-09-12T17:57:33.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.440+0000 7f8880ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 info.flags=0x17 2024-09-12T17:57:33.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.440+0000 7f8880ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 to cache LRU end 2024-09-12T17:57:33.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.440+0000 7f8880ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:33.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.444+0000 7f89a03319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): orig_sources= new_sources= 2024-09-12T17:57:33.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.444+0000 7f89a03319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): potential sources added=[] removed=[] 2024-09-12T17:57:33.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.444+0000 7f89a03319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): orig_dests= new_dests= 2024-09-12T17:57:33.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.444+0000 7f89a03319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): potential dests added=[] removed=[] 2024-09-12T17:57:33.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.0 2024-09-12T17:57:33.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.0 2024-09-12T17:57:33.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.1 2024-09-12T17:57:33.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.1 2024-09-12T17:57:33.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.2 2024-09-12T17:57:33.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.2 2024-09-12T17:57:33.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.3 2024-09-12T17:57:33.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.3 2024-09-12T17:57:33.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.4 2024-09-12T17:57:33.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.4 2024-09-12T17:57:33.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.5 2024-09-12T17:57:33.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.5 2024-09-12T17:57:33.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.6 2024-09-12T17:57:33.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.6 2024-09-12T17:57:33.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.7 2024-09-12T17:57:33.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.7 2024-09-12T17:57:33.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.8 2024-09-12T17:57:33.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.8 2024-09-12T17:57:33.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.9 2024-09-12T17:57:33.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.9 2024-09-12T17:57:33.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.10 2024-09-12T17:57:33.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.10 2024-09-12T17:57:33.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.11 2024-09-12T17:57:33.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2.11 2024-09-12T17:57:33.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.0 2024-09-12T17:57:33.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.1 2024-09-12T17:57:33.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2 2024-09-12T17:57:33.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.452+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.3 2024-09-12T17:57:33.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.456+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.4 2024-09-12T17:57:33.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.456+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.5 2024-09-12T17:57:33.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.456+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.6 2024-09-12T17:57:33.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.456+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.7 2024-09-12T17:57:33.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.456+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.8 2024-09-12T17:57:33.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.456+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.9 2024-09-12T17:57:33.458 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.456+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.10 2024-09-12T17:57:33.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.464+0000 7f89a03319c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:33.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.464+0000 7f89a03319c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 2024-09-12T17:57:33.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.468+0000 7f89a03319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 info.flags=0x17 2024-09-12T17:57:33.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.468+0000 7f89a03319c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 to cache LRU end 2024-09-12T17:57:33.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.468+0000 7f89a03319c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:33.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.468+0000 7f89a03319c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27, ofs0, ns] 2024-09-12T17:57:33.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.468+0000 7f88817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366164 cookie 94001320127328 notifier 7026 bl.length()=939 2024-09-12T17:57:33.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.468+0000 7f88817fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 info.flags=0x17 2024-09-12T17:57:33.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.468+0000 7f88817fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 to cache LRU end 2024-09-12T17:57:33.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.468+0000 7f88817fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:33.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.472+0000 7f89a03319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): orig_sources= new_sources= 2024-09-12T17:57:33.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.472+0000 7f89a03319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): potential sources added=[] removed=[] 2024-09-12T17:57:33.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.472+0000 7f89a03319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): orig_dests= new_dests= 2024-09-12T17:57:33.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.472+0000 7f89a03319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): potential dests added=[] removed=[] 2024-09-12T17:57:33.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.476+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.0 2024-09-12T17:57:33.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.476+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.1 2024-09-12T17:57:33.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.476+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.2 2024-09-12T17:57:33.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.476+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.3 2024-09-12T17:57:33.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.480+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.4 2024-09-12T17:57:33.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.480+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.5 2024-09-12T17:57:33.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.480+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.6 2024-09-12T17:57:33.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.480+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.7 2024-09-12T17:57:33.480 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.480+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.8 2024-09-12T17:57:33.481 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.480+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.9 2024-09-12T17:57:33.481 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.480+0000 7f89a03319c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.27.10 2024-09-12T17:57:33.483 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.484+0000 7f89a03319c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:33.483 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.484+0000 7f89a03319c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 2024-09-12T17:57:33.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.484+0000 7f89a03319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 info.flags=0x17 2024-09-12T17:57:33.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.484+0000 7f89a03319c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 to cache LRU end 2024-09-12T17:57:33.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.484+0000 7f89a03319c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:33.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.484+0000 7f89a03319c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27, ofs0, ns] 2024-09-12T17:57:33.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.488+0000 7f88817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366165 cookie 94001320127328 notifier 7026 bl.length()=907 2024-09-12T17:57:33.487 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.488+0000 7f88817fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 info.flags=0x17 2024-09-12T17:57:33.487 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.488+0000 7f88817fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 to cache LRU end 2024-09-12T17:57:33.487 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.488+0000 7f88817fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:33.488 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.488+0000 7f89a03319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): orig_sources= new_sources= 2024-09-12T17:57:33.488 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.488+0000 7f89a03319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): potential sources added=[] removed=[] 2024-09-12T17:57:33.488 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.488+0000 7f89a03319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): orig_dests= new_dests= 2024-09-12T17:57:33.488 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.488+0000 7f89a03319c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a01e4849-e968-46ce-97f1-a673c26b3735.4529.27]): potential dests added=[] removed=[] 2024-09-12T17:57:33.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.492+0000 7f89a03319c0 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T17:57:33.496 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.496+0000 7f884f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:33.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.500+0000 7f89a03319c0 20 remove_watcher() i=0 2024-09-12T17:57:33.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.500+0000 7f89a03319c0 2 removed watcher, disabling cache 2024-09-12T17:57:33.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.504+0000 7f89a03319c0 20 remove_watcher() i=1 2024-09-12T17:57:33.505 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.504+0000 7f89a03319c0 20 remove_watcher() i=2 2024-09-12T17:57:33.507 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.508+0000 7f89a03319c0 20 remove_watcher() i=3 2024-09-12T17:57:33.508 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.508+0000 7f89a03319c0 20 remove_watcher() i=4 2024-09-12T17:57:33.510 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.508+0000 7f89a03319c0 20 remove_watcher() i=5 2024-09-12T17:57:33.511 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.512+0000 7f89a03319c0 20 remove_watcher() i=6 2024-09-12T17:57:33.513 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.512+0000 7f89a03319c0 20 remove_watcher() i=7 2024-09-12T17:57:33.530 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T17:57:33.558 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:33.558 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:33.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.600+0000 7f3388cf79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.604+0000 7f3388cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:33.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.604+0000 7f3388cf79c0 20 realm 2024-09-12T17:57:33.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.604+0000 7f3388cf79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.604+0000 7f3388cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:33.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.604+0000 7f3388cf79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:33.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.604+0000 7f3388cf79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.604+0000 7f3388cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:33.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.604+0000 7f3388cf79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.604+0000 7f3388cf79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:33.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.604+0000 7f3388cf79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.604+0000 7f3388cf79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:33.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.604+0000 7f3388cf79c0 20 searching for the correct realm 2024-09-12T17:57:33.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.612+0000 7f3385ffc640 0 -- 172.21.15.98:0/21765562 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f337805b4b0 msgr2=0x7f3378007aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:33.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.616+0000 7f3385ffc640 0 -- 172.21.15.98:0/21765562 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f32500811b0 msgr2=0x7f32500835e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:33.624 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.624+0000 7f3388cf79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:33.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.624+0000 7f3388cf79c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:57:33.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.624+0000 7f3388cf79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:33.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.624+0000 7f3388cf79c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:57:33.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.624+0000 7f3388cf79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:33.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.624+0000 7f3388cf79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:33.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.624+0000 7f3388cf79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.624+0000 7f3388cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:33.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.624+0000 7f3388cf79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.624+0000 7f3388cf79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:33.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.624+0000 7f3388cf79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.624+0000 7f3388cf79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:33.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.624+0000 7f3388cf79c0 20 zone default found 2024-09-12T17:57:33.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.624+0000 7f3388cf79c0 4 Realm: () 2024-09-12T17:57:33.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.624+0000 7f3388cf79c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:57:33.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.624+0000 7f3388cf79c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:57:33.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.624+0000 7f3388cf79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:33.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.624+0000 7f3388cf79c0 20 zonegroup default 2024-09-12T17:57:33.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.624+0000 7f3388cf79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.628+0000 7f3388cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:33.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.628+0000 7f3388cf79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.628+0000 7f3388cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:33.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.628+0000 7f3388cf79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.628+0000 7f3388cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:33.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.628+0000 7f3388cf79c0 20 started sync module instance, tier type = 2024-09-12T17:57:33.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.628+0000 7f3388cf79c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:57:33.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.644+0000 7f3388cf79c0 20 add_watcher() i=0 2024-09-12T17:57:33.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.644+0000 7f3388cf79c0 20 add_watcher() i=1 2024-09-12T17:57:33.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.644+0000 7f3388cf79c0 20 add_watcher() i=2 2024-09-12T17:57:33.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.644+0000 7f3388cf79c0 20 add_watcher() i=3 2024-09-12T17:57:33.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.644+0000 7f3388cf79c0 20 add_watcher() i=4 2024-09-12T17:57:33.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.644+0000 7f3388cf79c0 20 add_watcher() i=5 2024-09-12T17:57:33.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.644+0000 7f3388cf79c0 20 add_watcher() i=6 2024-09-12T17:57:33.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.644+0000 7f3388cf79c0 20 add_watcher() i=7 2024-09-12T17:57:33.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.644+0000 7f3388cf79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:33.647 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.648+0000 7f323cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:33.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.648+0000 7f3388cf79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:33.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.648+0000 7f3388cf79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:33.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.648+0000 7f3388cf79c0 5 note: GC not initialized 2024-09-12T17:57:33.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.648+0000 7f31b77fe640 20 reqs_thread_entry: start 2024-09-12T17:57:33.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.648+0000 7f3388cf79c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:33.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.648+0000 7f3388cf79c0 20 Filter name: none 2024-09-12T17:57:33.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.648+0000 7f31b57fa640 20 reqs_thread_entry: start 2024-09-12T17:57:33.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.648+0000 7f3388cf79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.648+0000 7f3388cf79c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:57:33.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.648+0000 7f3388cf79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.648+0000 7f3388cf79c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:57:33.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.648+0000 7f3388cf79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:33.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.648+0000 7f3388cf79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.652+0000 7f3388cf79c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T17:57:33.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.652+0000 7f3388cf79c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:33.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.652+0000 7f3388cf79c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T17:57:33.652 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.652+0000 7f3388cf79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:33.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.656+0000 7f323cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:33.659 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.660+0000 7f3388cf79c0 20 remove_watcher() i=0 2024-09-12T17:57:33.659 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.660+0000 7f3388cf79c0 2 removed watcher, disabling cache 2024-09-12T17:57:33.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.660+0000 7f3388cf79c0 20 remove_watcher() i=1 2024-09-12T17:57:33.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.664+0000 7f3388cf79c0 20 remove_watcher() i=2 2024-09-12T17:57:33.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.664+0000 7f3388cf79c0 20 remove_watcher() i=3 2024-09-12T17:57:33.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.668+0000 7f3388cf79c0 20 remove_watcher() i=4 2024-09-12T17:57:33.668 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.668+0000 7f3388cf79c0 20 remove_watcher() i=5 2024-09-12T17:57:33.669 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.668+0000 7f3388cf79c0 20 remove_watcher() i=6 2024-09-12T17:57:33.671 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:33.672+0000 7f3388cf79c0 20 remove_watcher() i=7 2024-09-12T17:57:33.684 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:33.684 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:57:33.684 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-trim-reshard-log-entries id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:57:33.684 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:33.685 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:33.686 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:33.708 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:33.708 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:34.255 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:34.255 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:34.621 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T17:57:34.621 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:34.624 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:34.624 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:34.763 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:34.763 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:34.851 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:34.851 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:34.952 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:34.952 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:35.050 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:35.050 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:35.151 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:35.151 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:35.249 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:35.250 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:35.351 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:35.351 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:35.440 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:35.441 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:35.536 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:35.536 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:35.636 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:35.636 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:35.731 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:35.731 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:35.830 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:35.830 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:35.923 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:35.924 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:36.024 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:36.024 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:36.127 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:36.127 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:36.226 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:36.226 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:36.326 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:36.326 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:36.426 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:36.426 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:36.526 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:36.527 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:36.617 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:36.617 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:36.713 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:36.713 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:36.823 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:57:36.856 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:36.856 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:36.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:36.900+0000 7fb302b1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:36.903 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:36.904+0000 7fb302b1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:36.903 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:36.904+0000 7fb302b1a9c0 20 realm 2024-09-12T17:57:36.903 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:36.904+0000 7fb302b1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:36.903 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:36.904+0000 7fb302b1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:36.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:36.904+0000 7fb302b1a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:36.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:36.904+0000 7fb302b1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:36.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:36.904+0000 7fb302b1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:36.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:36.904+0000 7fb302b1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:36.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:36.904+0000 7fb302b1a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:36.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:36.904+0000 7fb302b1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:36.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:36.904+0000 7fb302b1a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:36.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:36.904+0000 7fb302b1a9c0 20 searching for the correct realm 2024-09-12T17:57:36.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:36.912+0000 7fb300e21640 0 -- 172.21.15.98:0/3802182533 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7fb2f401a040 msgr2=0x7fb2f400fab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:36.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:36.916+0000 7fb300620640 0 -- 172.21.15.98:0/3802182533 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fb2f401a420 msgr2=0x7fb2f401a880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:57:37.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.132+0000 7fb302b1a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:37.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.132+0000 7fb302b1a9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:57:37.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.132+0000 7fb302b1a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:37.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.132+0000 7fb302b1a9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:57:37.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.132+0000 7fb302b1a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:37.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.132+0000 7fb302b1a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:37.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.132+0000 7fb302b1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.135 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.132+0000 7fb302b1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.135 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.132+0000 7fb302b1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.135 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.136+0000 7fb302b1a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:37.135 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.136+0000 7fb302b1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.136+0000 7fb302b1a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:37.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.136+0000 7fb302b1a9c0 20 zone default found 2024-09-12T17:57:37.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.136+0000 7fb302b1a9c0 4 Realm: () 2024-09-12T17:57:37.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.136+0000 7fb302b1a9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:57:37.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.136+0000 7fb302b1a9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:57:37.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.136+0000 7fb302b1a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:37.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.136+0000 7fb302b1a9c0 20 zonegroup default 2024-09-12T17:57:37.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.136+0000 7fb302b1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.138 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.136+0000 7fb302b1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.138 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.136+0000 7fb302b1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.138 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.136+0000 7fb302b1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.138 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.136+0000 7fb302b1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.139 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.140+0000 7fb302b1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.139 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.140+0000 7fb302b1a9c0 20 started sync module instance, tier type = 2024-09-12T17:57:37.139 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.140+0000 7fb302b1a9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:57:37.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.160+0000 7fb302b1a9c0 20 add_watcher() i=0 2024-09-12T17:57:37.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.160+0000 7fb302b1a9c0 20 add_watcher() i=1 2024-09-12T17:57:37.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.160+0000 7fb302b1a9c0 20 add_watcher() i=2 2024-09-12T17:57:37.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.160+0000 7fb302b1a9c0 20 add_watcher() i=3 2024-09-12T17:57:37.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.160+0000 7fb302b1a9c0 20 add_watcher() i=4 2024-09-12T17:57:37.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.160+0000 7fb302b1a9c0 20 add_watcher() i=5 2024-09-12T17:57:37.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.164+0000 7fb302b1a9c0 20 add_watcher() i=6 2024-09-12T17:57:37.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.164+0000 7fb302b1a9c0 20 add_watcher() i=7 2024-09-12T17:57:37.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.164+0000 7fb302b1a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:37.168 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.168+0000 7fb1b6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:37.169 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.168+0000 7fb302b1a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:37.169 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.168+0000 7fb302b1a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:37.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.168+0000 7fb302b1a9c0 5 note: GC not initialized 2024-09-12T17:57:37.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.168+0000 7fb1b5fdb640 20 reqs_thread_entry: start 2024-09-12T17:57:37.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.168+0000 7fb302b1a9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:37.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.172+0000 7fb302b1a9c0 20 Filter name: none 2024-09-12T17:57:37.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.172+0000 7fb1277fe640 20 reqs_thread_entry: start 2024-09-12T17:57:37.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.172+0000 7fb302b1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.172+0000 7fb302b1a9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:57:37.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.172+0000 7fb302b1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.173 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.172+0000 7fb302b1a9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:57:37.173 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.172+0000 7fb302b1a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:37.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.172+0000 7fb302b1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.176+0000 7fb302b1a9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:57:37.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.176+0000 7fb302b1a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.175 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.176+0000 7fb302b1a9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:57:37.176 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.176+0000 7fb302b1a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:37.178 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.180+0000 7fb1b6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:37.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.184+0000 7fb302b1a9c0 20 remove_watcher() i=0 2024-09-12T17:57:37.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.184+0000 7fb302b1a9c0 2 removed watcher, disabling cache 2024-09-12T17:57:37.186 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.184+0000 7fb302b1a9c0 20 remove_watcher() i=1 2024-09-12T17:57:37.188 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.188+0000 7fb302b1a9c0 20 remove_watcher() i=2 2024-09-12T17:57:37.191 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.192+0000 7fb302b1a9c0 20 remove_watcher() i=3 2024-09-12T17:57:37.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.192+0000 7fb302b1a9c0 20 remove_watcher() i=4 2024-09-12T17:57:37.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.196+0000 7fb302b1a9c0 20 remove_watcher() i=5 2024-09-12T17:57:37.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.196+0000 7fb302b1a9c0 20 remove_watcher() i=6 2024-09-12T17:57:37.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.196+0000 7fb302b1a9c0 20 remove_watcher() i=7 2024-09-12T17:57:37.213 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:37.213 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:57:37.213 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-block-writes id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:57:37.213 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:37.214 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T17:57:37.246 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:37.246 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:37.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.288+0000 7f7fb354e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.288+0000 7f7fb354e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.288+0000 7f7fb354e9c0 20 realm 2024-09-12T17:57:37.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.288+0000 7f7fb354e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.288+0000 7f7fb354e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.288+0000 7f7fb354e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:37.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.288+0000 7f7fb354e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.288+0000 7f7fb354e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.288+0000 7f7fb354e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.292+0000 7f7fb354e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:37.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.292+0000 7f7fb354e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.292+0000 7f7fb354e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:37.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.292+0000 7f7fb354e9c0 20 searching for the correct realm 2024-09-12T17:57:37.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.296+0000 7f7fb0853640 0 -- 172.21.15.98:0/3105605816 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x561c3b0c9d10 msgr2=0x561c3b0cc1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:57:37.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.304+0000 7f7fb1054640 0 -- 172.21.15.98:0/3105605816 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f7fa800a040 msgr2=0x7f7fa802b940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:37.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.312+0000 7f7fb354e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:37.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.312+0000 7f7fb354e9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:57:37.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.312+0000 7f7fb354e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:37.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.312+0000 7f7fb354e9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:57:37.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.312+0000 7f7fb354e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:37.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.312+0000 7f7fb354e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:37.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.312+0000 7f7fb354e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.312+0000 7f7fb354e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.312+0000 7f7fb354e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.312+0000 7f7fb354e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:37.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.312+0000 7f7fb354e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.316+0000 7f7fb354e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:37.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.316+0000 7f7fb354e9c0 20 zone default found 2024-09-12T17:57:37.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.316+0000 7f7fb354e9c0 4 Realm: () 2024-09-12T17:57:37.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.316+0000 7f7fb354e9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:57:37.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.316+0000 7f7fb354e9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:57:37.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.316+0000 7f7fb354e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:37.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.316+0000 7f7fb354e9c0 20 zonegroup default 2024-09-12T17:57:37.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.316+0000 7f7fb354e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.316 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.316+0000 7f7fb354e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.316 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.316+0000 7f7fb354e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.316 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.316+0000 7f7fb354e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.316 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.316+0000 7f7fb354e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.316+0000 7f7fb354e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.316+0000 7f7fb354e9c0 20 started sync module instance, tier type = 2024-09-12T17:57:37.317 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.316+0000 7f7fb354e9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:57:37.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.332+0000 7f7fb354e9c0 20 add_watcher() i=0 2024-09-12T17:57:37.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.332+0000 7f7fb354e9c0 20 add_watcher() i=1 2024-09-12T17:57:37.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.332+0000 7f7fb354e9c0 20 add_watcher() i=2 2024-09-12T17:57:37.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.332+0000 7f7fb354e9c0 20 add_watcher() i=3 2024-09-12T17:57:37.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.332+0000 7f7fb354e9c0 20 add_watcher() i=4 2024-09-12T17:57:37.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.332+0000 7f7fb354e9c0 20 add_watcher() i=5 2024-09-12T17:57:37.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.332+0000 7f7fb354e9c0 20 add_watcher() i=6 2024-09-12T17:57:37.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.332+0000 7f7fb354e9c0 20 add_watcher() i=7 2024-09-12T17:57:37.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.332+0000 7f7fb354e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:37.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.336+0000 7f7e677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:37.337 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.336+0000 7f7fb354e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:37.337 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.336+0000 7f7fb354e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:37.337 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.336+0000 7f7fb354e9c0 5 note: GC not initialized 2024-09-12T17:57:37.337 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.336+0000 7f7e667e4640 20 reqs_thread_entry: start 2024-09-12T17:57:37.337 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.336+0000 7f7fb354e9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:37.337 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.336+0000 7f7fb354e9c0 20 Filter name: none 2024-09-12T17:57:37.337 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.336+0000 7f7dd7fff640 20 reqs_thread_entry: start 2024-09-12T17:57:37.337 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.336+0000 7f7fb354e9c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T17:57:37.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.336+0000 7f7fb354e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.336+0000 7f7fb354e9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:57:37.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.336+0000 7f7fb354e9c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T17:57:37.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.336+0000 7f7fb354e9c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T17:57:37.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.336+0000 7f7fb354e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 : miss 2024-09-12T17:57:37.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.336+0000 7f7fb354e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.340 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.340+0000 7f7fb354e9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:57:37.340 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.340+0000 7f7fb354e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 info.flags=0x17 2024-09-12T17:57:37.340 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.340+0000 7f7fb354e9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 to cache LRU end 2024-09-12T17:57:37.340 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.340+0000 7f7fb354e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:37.340 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.340+0000 7f7fb354e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:37.340 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.340+0000 7f7fb354e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 2024-09-12T17:57:37.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.352+0000 7f7fb354e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 info.flags=0x17 2024-09-12T17:57:37.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.352+0000 7f7fb354e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 to cache LRU end 2024-09-12T17:57:37.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.352+0000 7f7fb354e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:37.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.352+0000 7f7fb354e9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28, ofs0, ns] 2024-09-12T17:57:37.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.352+0000 7f7e94ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366210 cookie 94679249761216 notifier 6575 bl.length()=915 2024-09-12T17:57:37.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.352+0000 7f7e94ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 info.flags=0x17 2024-09-12T17:57:37.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.352+0000 7f7e94ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 to cache LRU end 2024-09-12T17:57:37.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.352+0000 7f7e94ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:37.354 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.352+0000 7f7fb354e9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): orig_sources= new_sources= 2024-09-12T17:57:37.354 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.352+0000 7f7fb354e9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): potential sources added=[] removed=[] 2024-09-12T17:57:37.354 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.352+0000 7f7fb354e9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): orig_dests= new_dests= 2024-09-12T17:57:37.354 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.352+0000 7f7fb354e9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): potential dests added=[] removed=[] 2024-09-12T17:57:37.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.0 2024-09-12T17:57:37.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.0 2024-09-12T17:57:37.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.1 2024-09-12T17:57:37.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.1 2024-09-12T17:57:37.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.2 2024-09-12T17:57:37.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.2 2024-09-12T17:57:37.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.3 2024-09-12T17:57:37.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.3 2024-09-12T17:57:37.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.4 2024-09-12T17:57:37.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.4 2024-09-12T17:57:37.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.5 2024-09-12T17:57:37.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.5 2024-09-12T17:57:37.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.6 2024-09-12T17:57:37.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.6 2024-09-12T17:57:37.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.7 2024-09-12T17:57:37.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.7 2024-09-12T17:57:37.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.8 2024-09-12T17:57:37.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.8 2024-09-12T17:57:37.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.9 2024-09-12T17:57:37.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.9 2024-09-12T17:57:37.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.10 2024-09-12T17:57:37.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.10 2024-09-12T17:57:37.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.11 2024-09-12T17:57:37.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.11 2024-09-12T17:57:37.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.364+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.0 2024-09-12T17:57:37.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.368+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1 2024-09-12T17:57:37.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.368+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.2 2024-09-12T17:57:37.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.368+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.3 2024-09-12T17:57:37.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.368+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.4 2024-09-12T17:57:37.369 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.368+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.5 2024-09-12T17:57:37.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.372+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.6 2024-09-12T17:57:37.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.372+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.7 2024-09-12T17:57:37.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.372+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.8 2024-09-12T17:57:37.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.372+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.9 2024-09-12T17:57:37.374 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.376+0000 7f7fb354e9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.10 2024-09-12T17:57:37.381 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.380+0000 7f7fb354e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:37.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.380+0000 7f7fb354e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 2024-09-12T17:57:37.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.384+0000 7f7fb354e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 info.flags=0x17 2024-09-12T17:57:37.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.384+0000 7f7fb354e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 to cache LRU end 2024-09-12T17:57:37.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.384+0000 7f7fb354e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:37.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.384+0000 7f7fb354e9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28, ofs0, ns] 2024-09-12T17:57:37.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.384+0000 7f7e94ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366211 cookie 94679249761216 notifier 6575 bl.length()=915 2024-09-12T17:57:37.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.384+0000 7f7e94ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 info.flags=0x17 2024-09-12T17:57:37.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.384+0000 7f7e94ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 to cache LRU end 2024-09-12T17:57:37.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.384+0000 7f7e94ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:37.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.392+0000 7f7fb354e9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): orig_sources= new_sources= 2024-09-12T17:57:37.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.392+0000 7f7fb354e9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): potential sources added=[] removed=[] 2024-09-12T17:57:37.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.392+0000 7f7fb354e9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): orig_dests= new_dests= 2024-09-12T17:57:37.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.392+0000 7f7fb354e9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): potential dests added=[] removed=[] 2024-09-12T17:57:37.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.392+0000 7f7fb354e9c0 -1 Injecting error=-5 at location=block_writes 2024-09-12T17:57:37.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.392+0000 7f7fb354e9c0 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T17:57:37.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.400+0000 7f7fb354e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:37.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.400+0000 7f7fb354e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 2024-09-12T17:57:37.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.404+0000 7f7fb354e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 info.flags=0x17 2024-09-12T17:57:37.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.404+0000 7f7fb354e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 to cache LRU end 2024-09-12T17:57:37.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.404+0000 7f7fb354e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:37.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.404+0000 7f7fb354e9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28, ofs0, ns] 2024-09-12T17:57:37.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.404+0000 7f7e94ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366212 cookie 94679249761216 notifier 6575 bl.length()=883 2024-09-12T17:57:37.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.404+0000 7f7e94ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 info.flags=0x17 2024-09-12T17:57:37.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.404+0000 7f7e94ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 to cache LRU end 2024-09-12T17:57:37.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.404+0000 7f7e94ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:37.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.408+0000 7f7fb354e9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): orig_sources= new_sources= 2024-09-12T17:57:37.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.408+0000 7f7fb354e9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): potential sources added=[] removed=[] 2024-09-12T17:57:37.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.408+0000 7f7fb354e9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): orig_dests= new_dests= 2024-09-12T17:57:37.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.408+0000 7f7fb354e9c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): potential dests added=[] removed=[] 2024-09-12T17:57:37.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.416+0000 7f7fb354e9c0 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T17:57:37.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.416+0000 7f7e677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:37.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.424+0000 7f7fb354e9c0 20 remove_watcher() i=0 2024-09-12T17:57:37.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.424+0000 7f7fb354e9c0 2 removed watcher, disabling cache 2024-09-12T17:57:37.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.424+0000 7f7fb354e9c0 20 remove_watcher() i=1 2024-09-12T17:57:37.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.428+0000 7f7fb354e9c0 20 remove_watcher() i=2 2024-09-12T17:57:37.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.428+0000 7f7fb354e9c0 20 remove_watcher() i=3 2024-09-12T17:57:37.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.432+0000 7f7fb354e9c0 20 remove_watcher() i=4 2024-09-12T17:57:37.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.432+0000 7f7fb354e9c0 20 remove_watcher() i=5 2024-09-12T17:57:37.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.432+0000 7f7fb354e9c0 20 remove_watcher() i=6 2024-09-12T17:57:37.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.436+0000 7f7fb354e9c0 20 remove_watcher() i=7 2024-09-12T17:57:37.449 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:57:37.475 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:37.476 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:37.519 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.520+0000 7fe49b2889c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.521 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.520+0000 7fe49b2889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.521 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.520+0000 7fe49b2889c0 20 realm 2024-09-12T17:57:37.521 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.520+0000 7fe49b2889c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.521 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.520+0000 7fe49b2889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.521 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.520+0000 7fe49b2889c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:37.521 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.520+0000 7fe49b2889c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.520+0000 7fe49b2889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.520+0000 7fe49b2889c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.524+0000 7fe49b2889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:37.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.524+0000 7fe49b2889c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.524+0000 7fe49b2889c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:37.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.524+0000 7fe49b2889c0 20 searching for the correct realm 2024-09-12T17:57:37.529 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.528+0000 7fe49958f640 0 -- 172.21.15.98:0/298338490 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x564a8cbf9390 msgr2=0x564a8cbfb800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:37.535 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.536+0000 7fe493fff640 0 -- 172.21.15.98:0/298338490 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fe48c0ef080 msgr2=0x7fe48c0d2040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:37.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.540+0000 7fe49b2889c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:37.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.540+0000 7fe49b2889c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:57:37.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.540+0000 7fe49b2889c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:37.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.540+0000 7fe49b2889c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:57:37.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.540+0000 7fe49b2889c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:37.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.540+0000 7fe49b2889c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:37.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.540+0000 7fe49b2889c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.543 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.540+0000 7fe49b2889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.543 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.540+0000 7fe49b2889c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.543 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.544+0000 7fe49b2889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:37.543 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.544+0000 7fe49b2889c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.544+0000 7fe49b2889c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:37.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.544+0000 7fe49b2889c0 20 zone default found 2024-09-12T17:57:37.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.544+0000 7fe49b2889c0 4 Realm: () 2024-09-12T17:57:37.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.544+0000 7fe49b2889c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:57:37.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.544+0000 7fe49b2889c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:57:37.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.544+0000 7fe49b2889c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:37.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.544+0000 7fe49b2889c0 20 zonegroup default 2024-09-12T17:57:37.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.544+0000 7fe49b2889c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.544+0000 7fe49b2889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.544+0000 7fe49b2889c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.544+0000 7fe49b2889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.544+0000 7fe49b2889c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.544+0000 7fe49b2889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.544+0000 7fe49b2889c0 20 started sync module instance, tier type = 2024-09-12T17:57:37.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.544+0000 7fe49b2889c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:57:37.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.560+0000 7fe49b2889c0 20 add_watcher() i=0 2024-09-12T17:57:37.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.560+0000 7fe49b2889c0 20 add_watcher() i=1 2024-09-12T17:57:37.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.560+0000 7fe49b2889c0 20 add_watcher() i=2 2024-09-12T17:57:37.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.560+0000 7fe49b2889c0 20 add_watcher() i=3 2024-09-12T17:57:37.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.560+0000 7fe49b2889c0 20 add_watcher() i=4 2024-09-12T17:57:37.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.560+0000 7fe49b2889c0 20 add_watcher() i=5 2024-09-12T17:57:37.562 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.560+0000 7fe49b2889c0 20 add_watcher() i=6 2024-09-12T17:57:37.562 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.560+0000 7fe49b2889c0 20 add_watcher() i=7 2024-09-12T17:57:37.562 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.560+0000 7fe49b2889c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:37.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.564+0000 7fe34efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:37.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.564+0000 7fe49b2889c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:37.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.564+0000 7fe49b2889c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:37.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.564+0000 7fe49b2889c0 5 note: GC not initialized 2024-09-12T17:57:37.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.564+0000 7fe34dfe3640 20 reqs_thread_entry: start 2024-09-12T17:57:37.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.564+0000 7fe49b2889c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:37.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.564+0000 7fe49b2889c0 20 Filter name: none 2024-09-12T17:57:37.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.564+0000 7fe2bf7fe640 20 reqs_thread_entry: start 2024-09-12T17:57:37.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.564+0000 7fe49b2889c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.568+0000 7fe49b2889c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:57:37.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.568+0000 7fe49b2889c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.568+0000 7fe49b2889c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:57:37.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.568+0000 7fe49b2889c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:37.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.568+0000 7fe49b2889c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.568+0000 7fe49b2889c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:57:37.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.568+0000 7fe49b2889c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.568+0000 7fe49b2889c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:57:37.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.568+0000 7fe49b2889c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:37.572 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.572+0000 7fe34efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:37.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.576+0000 7fe49b2889c0 20 remove_watcher() i=0 2024-09-12T17:57:37.578 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.576+0000 7fe49b2889c0 2 removed watcher, disabling cache 2024-09-12T17:57:37.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.580+0000 7fe49b2889c0 20 remove_watcher() i=1 2024-09-12T17:57:37.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.580+0000 7fe49b2889c0 20 remove_watcher() i=2 2024-09-12T17:57:37.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.584+0000 7fe49b2889c0 20 remove_watcher() i=3 2024-09-12T17:57:37.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.584+0000 7fe49b2889c0 20 remove_watcher() i=4 2024-09-12T17:57:37.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.588+0000 7fe49b2889c0 20 remove_watcher() i=5 2024-09-12T17:57:37.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.588+0000 7fe49b2889c0 20 remove_watcher() i=6 2024-09-12T17:57:37.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.588+0000 7fe49b2889c0 20 remove_watcher() i=7 2024-09-12T17:57:37.601 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:37.601 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:57:37.601 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-block-writes id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:57:37.602 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:37.602 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:37.602 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:37.641 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:37.641 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:37.700 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:57:37.733 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:37.733 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:37.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.776+0000 7f0af7e209c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.776+0000 7f0af7e209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.776+0000 7f0af7e209c0 20 realm 2024-09-12T17:57:37.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.776+0000 7f0af7e209c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.776+0000 7f0af7e209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.776+0000 7f0af7e209c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:37.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.776+0000 7f0af7e209c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.780+0000 7f0af7e209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.780+0000 7f0af7e209c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.780+0000 7f0af7e209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:37.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.780+0000 7f0af7e209c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.780+0000 7f0af7e209c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:37.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.780+0000 7f0af7e209c0 20 searching for the correct realm 2024-09-12T17:57:37.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.784+0000 7f0af5125640 0 -- 172.21.15.98:0/2777209342 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f0ae8116020 msgr2=0x7f0ae80b63d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:57:37.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.792+0000 7f0af5125640 0 -- 172.21.15.98:0/2777209342 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f09c0081180 msgr2=0x7f09c00835b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:37.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.800+0000 7f0af7e209c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:37.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.800+0000 7f0af7e209c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:57:37.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.800+0000 7f0af7e209c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:37.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.800+0000 7f0af7e209c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:57:37.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.800+0000 7f0af7e209c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:37.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.800+0000 7f0af7e209c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:37.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.800+0000 7f0af7e209c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.800+0000 7f0af7e209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.800+0000 7f0af7e209c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.800+0000 7f0af7e209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:37.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.800+0000 7f0af7e209c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.804+0000 7f0af7e209c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:37.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.804+0000 7f0af7e209c0 20 zone default found 2024-09-12T17:57:37.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.804+0000 7f0af7e209c0 4 Realm: () 2024-09-12T17:57:37.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.804+0000 7f0af7e209c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:57:37.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.804+0000 7f0af7e209c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:57:37.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.804+0000 7f0af7e209c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:37.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.804+0000 7f0af7e209c0 20 zonegroup default 2024-09-12T17:57:37.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.804+0000 7f0af7e209c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.804+0000 7f0af7e209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.804+0000 7f0af7e209c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.804+0000 7f0af7e209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.804+0000 7f0af7e209c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.804+0000 7f0af7e209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:37.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.804+0000 7f0af7e209c0 20 started sync module instance, tier type = 2024-09-12T17:57:37.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.804+0000 7f0af7e209c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:57:37.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.820+0000 7f0af7e209c0 20 add_watcher() i=0 2024-09-12T17:57:37.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.820+0000 7f0af7e209c0 20 add_watcher() i=1 2024-09-12T17:57:37.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.820+0000 7f0af7e209c0 20 add_watcher() i=2 2024-09-12T17:57:37.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.820+0000 7f0af7e209c0 20 add_watcher() i=3 2024-09-12T17:57:37.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.820+0000 7f0af7e209c0 20 add_watcher() i=4 2024-09-12T17:57:37.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.820+0000 7f0af7e209c0 20 add_watcher() i=5 2024-09-12T17:57:37.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.820+0000 7f0af7e209c0 20 add_watcher() i=6 2024-09-12T17:57:37.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.820+0000 7f0af7e209c0 20 add_watcher() i=7 2024-09-12T17:57:37.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.820+0000 7f0af7e209c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:37.822 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f09a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:37.824 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f0af7e209c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:37.824 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f0af7e209c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:37.824 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f0af7e209c0 5 note: GC not initialized 2024-09-12T17:57:37.824 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f09a67fc640 20 reqs_thread_entry: start 2024-09-12T17:57:37.824 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f0af7e209c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:37.824 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f0af7e209c0 20 Filter name: none 2024-09-12T17:57:37.824 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f0917fff640 20 reqs_thread_entry: start 2024-09-12T17:57:37.824 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f0af7e209c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T17:57:37.824 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f0af7e209c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f0af7e209c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:57:37.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f0af7e209c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T17:57:37.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f0af7e209c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T17:57:37.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f0af7e209c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 : miss 2024-09-12T17:57:37.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f0af7e209c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:37.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f0af7e209c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:57:37.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f0af7e209c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 info.flags=0x17 2024-09-12T17:57:37.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f0af7e209c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 to cache LRU end 2024-09-12T17:57:37.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f0af7e209c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:37.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f0af7e209c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:37.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.824+0000 7f0af7e209c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 2024-09-12T17:57:37.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.836+0000 7f0af7e209c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 info.flags=0x17 2024-09-12T17:57:37.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.836+0000 7f0af7e209c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 to cache LRU end 2024-09-12T17:57:37.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.836+0000 7f0af7e209c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:37.838 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.836+0000 7f0af7e209c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28, ofs0, ns] 2024-09-12T17:57:37.838 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.836+0000 7f09d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366213 cookie 93856418461824 notifier 7119 bl.length()=915 2024-09-12T17:57:37.838 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.836+0000 7f09d8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 info.flags=0x17 2024-09-12T17:57:37.838 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.836+0000 7f09d8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 to cache LRU end 2024-09-12T17:57:37.838 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.836+0000 7f09d8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:37.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.840+0000 7f0af7e209c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): orig_sources= new_sources= 2024-09-12T17:57:37.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.840+0000 7f0af7e209c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): potential sources added=[] removed=[] 2024-09-12T17:57:37.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.840+0000 7f0af7e209c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): orig_dests= new_dests= 2024-09-12T17:57:37.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.840+0000 7f0af7e209c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): potential dests added=[] removed=[] 2024-09-12T17:57:37.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.0 2024-09-12T17:57:37.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.0 2024-09-12T17:57:37.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.1 2024-09-12T17:57:37.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.1 2024-09-12T17:57:37.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.2 2024-09-12T17:57:37.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.2 2024-09-12T17:57:37.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.3 2024-09-12T17:57:37.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.3 2024-09-12T17:57:37.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.4 2024-09-12T17:57:37.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.4 2024-09-12T17:57:37.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.5 2024-09-12T17:57:37.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.5 2024-09-12T17:57:37.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.6 2024-09-12T17:57:37.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.6 2024-09-12T17:57:37.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.7 2024-09-12T17:57:37.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.7 2024-09-12T17:57:37.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.8 2024-09-12T17:57:37.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.8 2024-09-12T17:57:37.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.9 2024-09-12T17:57:37.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.9 2024-09-12T17:57:37.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.10 2024-09-12T17:57:37.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.10 2024-09-12T17:57:37.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.11 2024-09-12T17:57:37.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1.11 2024-09-12T17:57:37.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.0 2024-09-12T17:57:37.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1 2024-09-12T17:57:37.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.2 2024-09-12T17:57:37.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.3 2024-09-12T17:57:37.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.852+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.4 2024-09-12T17:57:37.855 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.856+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.5 2024-09-12T17:57:37.856 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.856+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.6 2024-09-12T17:57:37.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.856+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.7 2024-09-12T17:57:37.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.860+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.8 2024-09-12T17:57:37.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.860+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.9 2024-09-12T17:57:37.860 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.860+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.10 2024-09-12T17:57:37.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.868+0000 7f0af7e209c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:37.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.868+0000 7f0af7e209c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 2024-09-12T17:57:37.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.872+0000 7f0af7e209c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 info.flags=0x17 2024-09-12T17:57:37.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.872+0000 7f0af7e209c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 to cache LRU end 2024-09-12T17:57:37.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.872+0000 7f0af7e209c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:37.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.872+0000 7f0af7e209c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28, ofs0, ns] 2024-09-12T17:57:37.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.872+0000 7f09d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366214 cookie 93856418461824 notifier 7119 bl.length()=915 2024-09-12T17:57:37.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.872+0000 7f09d8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 info.flags=0x17 2024-09-12T17:57:37.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.872+0000 7f09d8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 to cache LRU end 2024-09-12T17:57:37.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.872+0000 7f09d8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:37.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.872+0000 7f0af7e209c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): orig_sources= new_sources= 2024-09-12T17:57:37.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.872+0000 7f0af7e209c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): potential sources added=[] removed=[] 2024-09-12T17:57:37.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.872+0000 7f0af7e209c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): orig_dests= new_dests= 2024-09-12T17:57:37.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.872+0000 7f0af7e209c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): potential dests added=[] removed=[] 2024-09-12T17:57:37.878 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.880+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.0 2024-09-12T17:57:37.879 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.880+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.1 2024-09-12T17:57:37.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.880+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.2 2024-09-12T17:57:37.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.880+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.3 2024-09-12T17:57:37.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.880+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.4 2024-09-12T17:57:37.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.880+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.5 2024-09-12T17:57:37.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.880+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.6 2024-09-12T17:57:37.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.884+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.7 2024-09-12T17:57:37.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.884+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.8 2024-09-12T17:57:37.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.884+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.9 2024-09-12T17:57:37.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.884+0000 7f0af7e209c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.28.10 2024-09-12T17:57:37.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.884+0000 7f0af7e209c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:37.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.884+0000 7f0af7e209c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 2024-09-12T17:57:37.888 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.888+0000 7f0af7e209c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 info.flags=0x17 2024-09-12T17:57:37.888 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.888+0000 7f0af7e209c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 to cache LRU end 2024-09-12T17:57:37.888 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.888+0000 7f0af7e209c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:37.888 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.888+0000 7f0af7e209c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28, ofs0, ns] 2024-09-12T17:57:37.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.888+0000 7f09d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366215 cookie 93856418461824 notifier 7119 bl.length()=883 2024-09-12T17:57:37.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.888+0000 7f09d8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 info.flags=0x17 2024-09-12T17:57:37.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.888+0000 7f09d8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 to cache LRU end 2024-09-12T17:57:37.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.888+0000 7f09d8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:37.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.892+0000 7f0af7e209c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): orig_sources= new_sources= 2024-09-12T17:57:37.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.892+0000 7f0af7e209c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): potential sources added=[] removed=[] 2024-09-12T17:57:37.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.892+0000 7f0af7e209c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): orig_dests= new_dests= 2024-09-12T17:57:37.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.892+0000 7f0af7e209c0 20 handle_bi_update(): bucket=:error-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.28]): potential dests added=[] removed=[] 2024-09-12T17:57:37.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.896+0000 7f0af7e209c0 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:57:37.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.900+0000 7f09a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:37.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.904+0000 7f0af7e209c0 20 remove_watcher() i=0 2024-09-12T17:57:37.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.904+0000 7f0af7e209c0 2 removed watcher, disabling cache 2024-09-12T17:57:37.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.904+0000 7f0af7e209c0 20 remove_watcher() i=1 2024-09-12T17:57:37.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.908+0000 7f0af7e209c0 20 remove_watcher() i=2 2024-09-12T17:57:37.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.908+0000 7f0af7e209c0 20 remove_watcher() i=3 2024-09-12T17:57:37.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.912+0000 7f0af7e209c0 20 remove_watcher() i=4 2024-09-12T17:57:37.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.912+0000 7f0af7e209c0 20 remove_watcher() i=5 2024-09-12T17:57:37.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.916+0000 7f0af7e209c0 20 remove_watcher() i=6 2024-09-12T17:57:37.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:37.916+0000 7f0af7e209c0 20 remove_watcher() i=7 2024-09-12T17:57:37.931 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T17:57:37.958 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:37.958 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:38.002 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.000+0000 7f31870989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:38.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.004+0000 7f31870989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:38.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.004+0000 7f31870989c0 20 realm 2024-09-12T17:57:38.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.004+0000 7f31870989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:38.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.004+0000 7f31870989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:38.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.004+0000 7f31870989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:38.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.004+0000 7f31870989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:38.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.004+0000 7f31870989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:38.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.004+0000 7f31870989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:38.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.004+0000 7f31870989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:38.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.004+0000 7f31870989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:38.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.008+0000 7f31870989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:38.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.008+0000 7f31870989c0 20 searching for the correct realm 2024-09-12T17:57:38.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.012+0000 7f318539f640 0 -- 172.21.15.98:0/2968742310 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55a996fb65c0 msgr2=0x55a996fb8a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:38.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.016+0000 7f3184b9e640 0 -- 172.21.15.98:0/2968742310 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f317806cdf0 msgr2=0x7f3178097700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:38.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.024+0000 7f31870989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:38.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.024+0000 7f31870989c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:57:38.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.024+0000 7f31870989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:38.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.024+0000 7f31870989c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:57:38.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.024+0000 7f31870989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:38.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.024+0000 7f31870989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:38.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.024+0000 7f31870989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:38.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.024+0000 7f31870989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:38.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.024+0000 7f31870989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:38.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.024+0000 7f31870989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:38.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.024+0000 7f31870989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:38.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.028+0000 7f31870989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:38.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.028+0000 7f31870989c0 20 zone default found 2024-09-12T17:57:38.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.028+0000 7f31870989c0 4 Realm: () 2024-09-12T17:57:38.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.028+0000 7f31870989c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:57:38.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.028+0000 7f31870989c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:57:38.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.028+0000 7f31870989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:38.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.028+0000 7f31870989c0 20 zonegroup default 2024-09-12T17:57:38.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.028+0000 7f31870989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:38.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.028+0000 7f31870989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:38.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.028+0000 7f31870989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:38.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.028+0000 7f31870989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:38.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.028+0000 7f31870989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:38.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.028+0000 7f31870989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:38.029 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.028+0000 7f31870989c0 20 started sync module instance, tier type = 2024-09-12T17:57:38.029 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.028+0000 7f31870989c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:57:38.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.044+0000 7f31870989c0 20 add_watcher() i=0 2024-09-12T17:57:38.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.044+0000 7f31870989c0 20 add_watcher() i=1 2024-09-12T17:57:38.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.044+0000 7f31870989c0 20 add_watcher() i=2 2024-09-12T17:57:38.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.044+0000 7f31870989c0 20 add_watcher() i=3 2024-09-12T17:57:38.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.044+0000 7f31870989c0 20 add_watcher() i=4 2024-09-12T17:57:38.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.044+0000 7f31870989c0 20 add_watcher() i=5 2024-09-12T17:57:38.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.044+0000 7f31870989c0 20 add_watcher() i=6 2024-09-12T17:57:38.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.044+0000 7f31870989c0 20 add_watcher() i=7 2024-09-12T17:57:38.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.044+0000 7f31870989c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:38.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.048+0000 7f303afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:38.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.048+0000 7f31870989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:38.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.048+0000 7f31870989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:38.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.048+0000 7f31870989c0 5 note: GC not initialized 2024-09-12T17:57:38.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.048+0000 7f3039fe3640 20 reqs_thread_entry: start 2024-09-12T17:57:38.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.048+0000 7f31870989c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:38.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.048+0000 7f31870989c0 20 Filter name: none 2024-09-12T17:57:38.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.048+0000 7f2fab7fe640 20 reqs_thread_entry: start 2024-09-12T17:57:38.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.048+0000 7f31870989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:38.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.048+0000 7f31870989c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:57:38.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.048+0000 7f31870989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:38.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.052+0000 7f31870989c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:57:38.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.052+0000 7f31870989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:38.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.052+0000 7f31870989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:38.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.052+0000 7f31870989c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:57:38.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.052+0000 7f31870989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:38.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.052+0000 7f31870989c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:57:38.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.052+0000 7f31870989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:38.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.056+0000 7f303afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:38.059 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.060+0000 7f31870989c0 20 remove_watcher() i=0 2024-09-12T17:57:38.059 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.060+0000 7f31870989c0 2 removed watcher, disabling cache 2024-09-12T17:57:38.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.060+0000 7f31870989c0 20 remove_watcher() i=1 2024-09-12T17:57:38.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.064+0000 7f31870989c0 20 remove_watcher() i=2 2024-09-12T17:57:38.068 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.068+0000 7f31870989c0 20 remove_watcher() i=3 2024-09-12T17:57:38.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.068+0000 7f31870989c0 20 remove_watcher() i=4 2024-09-12T17:57:38.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.072+0000 7f31870989c0 20 remove_watcher() i=5 2024-09-12T17:57:38.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.072+0000 7f31870989c0 20 remove_watcher() i=6 2024-09-12T17:57:38.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:38.072+0000 7f31870989c0 20 remove_watcher() i=7 2024-09-12T17:57:38.087 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:38.087 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:57:38.087 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-block-writes id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:57:38.087 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:38.089 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:38.089 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:38.110 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:38.111 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:38.600 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:38.600 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:38.984 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T17:57:38.984 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:38.989 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:38.989 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:39.128 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:39.128 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:39.215 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:39.215 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:39.316 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:39.316 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:39.414 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:39.414 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:39.511 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:39.511 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:39.604 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:39.604 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:39.705 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:39.705 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:39.803 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:39.803 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:39.898 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:39.898 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:39.991 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:39.991 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:40.089 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:40.090 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:40.187 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:40.187 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:40.287 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:40.287 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:40.382 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:40.383 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:40.475 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:40.475 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:40.568 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:40.568 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:40.669 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:40.669 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:40.768 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:40.768 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:40.868 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:40.868 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:40.965 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:40.965 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:41.061 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:41.061 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:41.153 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:57:41.186 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:41.186 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:41.230 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.227+0000 7f27172859c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.231+0000 7f27172859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.231+0000 7f27172859c0 20 realm 2024-09-12T17:57:41.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.231+0000 7f27172859c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.231+0000 7f27172859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.231+0000 7f27172859c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:41.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.231+0000 7f27172859c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.231+0000 7f27172859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.231+0000 7f27172859c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.231+0000 7f27172859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:41.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.231+0000 7f27172859c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.235+0000 7f27172859c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:41.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.235+0000 7f27172859c0 20 searching for the correct realm 2024-09-12T17:57:41.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.239+0000 7f271558c640 0 -- 172.21.15.98:0/3265150354 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f2708120040 msgr2=0x7f2708124050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:41.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.455+0000 7f2714d8b640 0 -- 172.21.15.98:0/3265150354 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x564ffbb43ec0 msgr2=0x564ffbb462b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:41.463 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.463+0000 7f27172859c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:41.463 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.463+0000 7f27172859c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:57:41.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.463+0000 7f27172859c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:41.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.463+0000 7f27172859c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:57:41.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.463+0000 7f27172859c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:41.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.463+0000 7f27172859c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:41.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.463+0000 7f27172859c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.463+0000 7f27172859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.463+0000 7f27172859c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.463+0000 7f27172859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:41.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.463+0000 7f27172859c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.463+0000 7f27172859c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:41.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.463+0000 7f27172859c0 20 zone default found 2024-09-12T17:57:41.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.463+0000 7f27172859c0 4 Realm: () 2024-09-12T17:57:41.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.463+0000 7f27172859c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:57:41.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.463+0000 7f27172859c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:57:41.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.463+0000 7f27172859c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:41.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.463+0000 7f27172859c0 20 zonegroup default 2024-09-12T17:57:41.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.463+0000 7f27172859c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.467+0000 7f27172859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.467+0000 7f27172859c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.467+0000 7f27172859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.467+0000 7f27172859c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.467+0000 7f27172859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.467+0000 7f27172859c0 20 started sync module instance, tier type = 2024-09-12T17:57:41.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.467+0000 7f27172859c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:57:41.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.491+0000 7f27172859c0 20 add_watcher() i=0 2024-09-12T17:57:41.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.491+0000 7f27172859c0 20 add_watcher() i=1 2024-09-12T17:57:41.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.491+0000 7f27172859c0 20 add_watcher() i=2 2024-09-12T17:57:41.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.491+0000 7f27172859c0 20 add_watcher() i=3 2024-09-12T17:57:41.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.491+0000 7f27172859c0 20 add_watcher() i=4 2024-09-12T17:57:41.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.491+0000 7f27172859c0 20 add_watcher() i=5 2024-09-12T17:57:41.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.491+0000 7f27172859c0 20 add_watcher() i=6 2024-09-12T17:57:41.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.495+0000 7f27172859c0 20 add_watcher() i=7 2024-09-12T17:57:41.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.495+0000 7f27172859c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:41.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.499+0000 7f25cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:41.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.499+0000 7f27172859c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:41.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.499+0000 7f27172859c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:41.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.499+0000 7f27172859c0 5 note: GC not initialized 2024-09-12T17:57:41.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.499+0000 7f25ca7e4640 20 reqs_thread_entry: start 2024-09-12T17:57:41.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.499+0000 7f27172859c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:41.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.499+0000 7f27172859c0 20 Filter name: none 2024-09-12T17:57:41.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.499+0000 7f25c37fe640 20 reqs_thread_entry: start 2024-09-12T17:57:41.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.499+0000 7f27172859c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.499+0000 7f27172859c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:57:41.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.499+0000 7f27172859c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.503+0000 7f27172859c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:57:41.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.503+0000 7f27172859c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:41.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.503+0000 7f27172859c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.504 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.503+0000 7f27172859c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:57:41.504 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.503+0000 7f27172859c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.505 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.503+0000 7f27172859c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:57:41.505 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.503+0000 7f27172859c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:41.508 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.507+0000 7f25cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:41.513 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.511+0000 7f27172859c0 20 remove_watcher() i=0 2024-09-12T17:57:41.513 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.511+0000 7f27172859c0 2 removed watcher, disabling cache 2024-09-12T17:57:41.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.515+0000 7f27172859c0 20 remove_watcher() i=1 2024-09-12T17:57:41.518 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.515+0000 7f27172859c0 20 remove_watcher() i=2 2024-09-12T17:57:41.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.519+0000 7f27172859c0 20 remove_watcher() i=3 2024-09-12T17:57:41.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.519+0000 7f27172859c0 20 remove_watcher() i=4 2024-09-12T17:57:41.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.523+0000 7f27172859c0 20 remove_watcher() i=5 2024-09-12T17:57:41.525 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.523+0000 7f27172859c0 20 remove_watcher() i=6 2024-09-12T17:57:41.526 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.527+0000 7f27172859c0 20 remove_watcher() i=7 2024-09-12T17:57:41.542 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.542 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:57:41.542 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-block-writes id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:57:41.543 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.543 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T17:57:41.580 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:41.580 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:41.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.623+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.623+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.623+0000 7f253f8fb9c0 20 realm 2024-09-12T17:57:41.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.623+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.627+0000 7f253f8fb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:41.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:41.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:41.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 searching for the correct realm 2024-09-12T17:57:41.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.635+0000 7f253cc00640 0 -- 172.21.15.98:0/2373793126 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x55c515a8c480 msgr2=0x55c515a8e940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:41.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.639+0000 7f253d401640 0 -- 172.21.15.98:0/2373793126 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f253402a920 msgr2=0x7f2534055400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:57:41.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:41.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:57:41.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:41.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:57:41.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:41.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:41.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:41.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:41.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 zone default found 2024-09-12T17:57:41.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 4 Realm: () 2024-09-12T17:57:41.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:57:41.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:57:41.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:41.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 zonegroup default 2024-09-12T17:57:41.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.651+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.651+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.651+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.651+0000 7f253f8fb9c0 20 started sync module instance, tier type = 2024-09-12T17:57:41.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.651+0000 7f253f8fb9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:57:41.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=0 2024-09-12T17:57:41.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=1 2024-09-12T17:57:41.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=2 2024-09-12T17:57:41.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=3 2024-09-12T17:57:41.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=4 2024-09-12T17:57:41.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=5 2024-09-12T17:57:41.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=6 2024-09-12T17:57:41.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.667+0000 7f253f8fb9c0 20 add_watcher() i=7 2024-09-12T17:57:41.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.667+0000 7f253f8fb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:41.669 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.667+0000 7f23f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:41.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.667+0000 7f253f8fb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:41.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.667+0000 7f253f8fb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:41.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 note: GC not initialized 2024-09-12T17:57:41.671 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.667+0000 7f23f27e4640 20 reqs_thread_entry: start 2024-09-12T17:57:41.671 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.667+0000 7f253f8fb9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:41.671 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.671+0000 7f253f8fb9c0 20 Filter name: none 2024-09-12T17:57:41.671 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.671+0000 7f2363fff640 20 reqs_thread_entry: start 2024-09-12T17:57:41.671 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:57:41.671 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.671+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.671+0000 7f253f8fb9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:57:41.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:57:41.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:57:41.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 : miss 2024-09-12T17:57:41.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.671+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.671+0000 7f253f8fb9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:57:41.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:57:41.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:57:41.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:41.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:41.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 2024-09-12T17:57:41.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.679+0000 7f253f8fb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:57:41.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.679+0000 7f253f8fb9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:57:41.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.679+0000 7f253f8fb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:41.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.679+0000 7f253f8fb9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29, ofs0, ns] 2024-09-12T17:57:41.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.683+0000 7f2420ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366168 cookie 94304960329344 notifier 6662 bl.length()=915 2024-09-12T17:57:41.683 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.683+0000 7f2420ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:57:41.683 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.683+0000 7f2420ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:57:41.683 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.683+0000 7f2420ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:41.684 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.683+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): orig_sources= new_sources= 2024-09-12T17:57:41.684 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.683+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): potential sources added=[] removed=[] 2024-09-12T17:57:41.684 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.683+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): orig_dests= new_dests= 2024-09-12T17:57:41.684 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.683+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): potential dests added=[] removed=[] 2024-09-12T17:57:41.695 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.0 2024-09-12T17:57:41.695 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.0 2024-09-12T17:57:41.695 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.1 2024-09-12T17:57:41.695 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.1 2024-09-12T17:57:41.695 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.2 2024-09-12T17:57:41.695 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.2 2024-09-12T17:57:41.695 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.3 2024-09-12T17:57:41.695 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.3 2024-09-12T17:57:41.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.4 2024-09-12T17:57:41.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.4 2024-09-12T17:57:41.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.5 2024-09-12T17:57:41.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.5 2024-09-12T17:57:41.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.6 2024-09-12T17:57:41.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.6 2024-09-12T17:57:41.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.7 2024-09-12T17:57:41.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.7 2024-09-12T17:57:41.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.8 2024-09-12T17:57:41.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.8 2024-09-12T17:57:41.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.9 2024-09-12T17:57:41.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.9 2024-09-12T17:57:41.697 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.10 2024-09-12T17:57:41.697 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.10 2024-09-12T17:57:41.697 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.11 2024-09-12T17:57:41.697 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.11 2024-09-12T17:57:41.697 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.0 2024-09-12T17:57:41.697 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1 2024-09-12T17:57:41.697 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2 2024-09-12T17:57:41.698 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.3 2024-09-12T17:57:41.698 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.4 2024-09-12T17:57:41.698 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.699+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.5 2024-09-12T17:57:41.699 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.699+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.6 2024-09-12T17:57:41.700 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.699+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.7 2024-09-12T17:57:41.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.699+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.8 2024-09-12T17:57:41.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.703+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.9 2024-09-12T17:57:41.704 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.703+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.10 2024-09-12T17:57:41.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.711+0000 7f253f8fb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:41.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.711+0000 7f253f8fb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 2024-09-12T17:57:41.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.711+0000 7f253f8fb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:57:41.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.711+0000 7f253f8fb9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:57:41.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.711+0000 7f253f8fb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:41.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.711+0000 7f253f8fb9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29, ofs0, ns] 2024-09-12T17:57:41.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.715+0000 7f2420ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366169 cookie 94304960329344 notifier 6662 bl.length()=915 2024-09-12T17:57:41.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.715+0000 7f2420ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:57:41.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.715+0000 7f2420ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:57:41.715 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.715+0000 7f2420ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:41.716 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.715+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): orig_sources= new_sources= 2024-09-12T17:57:41.716 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.715+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): potential sources added=[] removed=[] 2024-09-12T17:57:41.716 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.715+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): orig_dests= new_dests= 2024-09-12T17:57:41.717 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.715+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): potential dests added=[] removed=[] 2024-09-12T17:57:41.717 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f253f8fb9c0 time 2024-09-12T17:57:41.718360+0000 2024-09-12T17:57:41.717 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:57:41.718 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:41.718 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f25431d52eb] 2024-09-12T17:57:41.718 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f25431d549f] 2024-09-12T17:57:41.718 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5132370c1] 2024-09-12T17:57:41.718 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55c51324855b] 2024-09-12T17:57:41.718 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c513249b44] 2024-09-12T17:57:41.718 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T17:57:41.718 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f254203bd90] 2024-09-12T17:57:41.718 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T17:57:41.718 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T17:57:41.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.715+0000 7f253f8fb9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f253f8fb9c0 time 2024-09-12T17:57:41.718360+0000 2024-09-12T17:57:41.719 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:57:41.719 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.719 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:41.719 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f25431d52eb] 2024-09-12T17:57:41.719 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f25431d549f] 2024-09-12T17:57:41.719 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5132370c1] 2024-09-12T17:57:41.719 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55c51324855b] 2024-09-12T17:57:41.719 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c513249b44] 2024-09-12T17:57:41.719 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T17:57:41.719 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f254203bd90] 2024-09-12T17:57:41.719 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T17:57:41.719 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T17:57:41.719 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.720 INFO:tasks.workunit.client.0.smithi098.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:57:41.720 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f253f8fb9c0 thread_name:radosgw-admin 2024-09-12T17:57:41.741 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:41.741 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2542054520] 2024-09-12T17:57:41.741 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:57:41.741 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:57:41.741 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:57:41.744 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f25431d5345] 2024-09-12T17:57:41.744 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f25431d549f] 2024-09-12T17:57:41.744 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5132370c1] 2024-09-12T17:57:41.744 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55c51324855b] 2024-09-12T17:57:41.744 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c513249b44] 2024-09-12T17:57:41.744 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T17:57:41.744 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f254203bd90] 2024-09-12T17:57:41.744 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T17:57:41.745 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T17:57:41.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.719+0000 7f253f8fb9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:57:41.745 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f253f8fb9c0 thread_name:radosgw-admin 2024-09-12T17:57:41.745 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.745 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:41.745 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2542054520] 2024-09-12T17:57:41.745 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:57:41.745 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:57:41.745 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:57:41.745 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f25431d5345] 2024-09-12T17:57:41.745 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f25431d549f] 2024-09-12T17:57:41.745 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5132370c1] 2024-09-12T17:57:41.745 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55c51324855b] 2024-09-12T17:57:41.746 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c513249b44] 2024-09-12T17:57:41.746 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T17:57:41.746 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f254203bd90] 2024-09-12T17:57:41.746 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T17:57:41.746 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T17:57:41.746 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:57:41.746 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.746 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T17:57:41.746 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: crc 2024-09-12T17:57:41.746 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: secure 2024-09-12T17:57:41.746 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: crc 2024-09-12T17:57:41.746 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: secure 2024-09-12T17:57:41.747 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: crc 2024-09-12T17:57:41.747 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: crc 2024-09-12T17:57:41.747 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: secure 2024-09-12T17:57:41.747 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: crc 2024-09-12T17:57:41.747 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: secure 2024-09-12T17:57:41.747 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: crc 2024-09-12T17:57:41.747 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: secure 2024-09-12T17:57:41.747 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.747 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.747 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command rotate-key hook 0x55c51599a4e8 2024-09-12T17:57:41.747 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:57:41.747 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:57:41.747 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-a con 0x55c515827840 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:57:41.748 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-c con 0x55c5158e29c0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:57:41.748 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-b con 0x55c51599d6a0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:57:41.748 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.748 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.748 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.748 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:57:41.748 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 10 monclient(hunting): authenticate will time out at 2658.174779s 2024-09-12T17:57:41.748 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T17:57:41.603+0000 7f253d401640 10 monclient(hunting): get_auth_request con 0x55c515827840 auth_method 0 2024-09-12T17:57:41.748 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T17:57:41.603+0000 7f253d401640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:41.748 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T17:57:41.603+0000 7f253d401640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:41.748 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T17:57:41.603+0000 7f253d401640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:41.748 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T17:57:41.603+0000 7f253cc00640 10 monclient(hunting): get_auth_request con 0x55c5158e29c0 auth_method 0 2024-09-12T17:57:41.748 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T17:57:41.603+0000 7f253cc00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:41.749 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T17:57:41.603+0000 7f253cc00640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:41.749 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T17:57:41.603+0000 7f253cc00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:41.749 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T17:57:41.603+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:41.749 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T17:57:41.603+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:41.749 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T17:57:41.603+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:41.749 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T17:57:41.603+0000 7f253cc00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:41.749 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T17:57:41.603+0000 7f253cc00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:41.749 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T17:57:41.603+0000 7f253cc00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:41.749 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T17:57:41.603+0000 7f253d401640 10 monclient(hunting): handle_auth_done global_id 7167 payload 824 2024-09-12T17:57:41.749 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T17:57:41.603+0000 7f253d401640 10 monclient: _finish_hunting 0 2024-09-12T17:57:41.749 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T17:57:41.603+0000 7f253d401640 1 monclient: found mon.noname-a 2024-09-12T17:57:41.749 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T17:57:41.603+0000 7f253d401640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:57:41.749 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T17:57:41.603+0000 7f2429e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:41.750 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T17:57:41.603+0000 7f2429e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:57:41.750 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T17:57:41.603+0000 7f2429e03640 10 monclient: dump: 2024-09-12T17:57:41.750 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:41.750 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:41.750 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.750 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.750 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:41.750 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.750 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:41.750 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:41.750 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:41.750 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.750 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T17:57:41.603+0000 7f2429e03640 10 monclient: _finish_auth 0 2024-09-12T17:57:41.751 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T17:57:41.603+0000 7f2429e03640 10 monclient: _check_auth_tickets 2024-09-12T17:57:41.751 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T17:57:41.603+0000 7f2429e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:41.751 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T17:57:41.603+0000 7f2429e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:41.751 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T17:57:41.603+0000 7f2429e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:57:41.751 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T17:57:41.603+0000 7f2429e03640 10 monclient: dump: 2024-09-12T17:57:41.751 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:41.751 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:41.751 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.751 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.751 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:41.751 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.751 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:41.751 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:41.752 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:41.752 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.752 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T17:57:41.603+0000 7f242b606640 4 set_mon_vals no callback set 2024-09-12T17:57:41.752 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T17:57:41.607+0000 7f253f8fb9c0 5 monclient: authenticate success, global_id 7167 2024-09-12T17:57:41.752 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T17:57:41.607+0000 7f253f8fb9c0 10 monclient: _renew_subs 2024-09-12T17:57:41.752 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T17:57:41.607+0000 7f253f8fb9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:57:41.752 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T17:57:41.607+0000 7f253f8fb9c0 10 monclient: _renew_subs 2024-09-12T17:57:41.752 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T17:57:41.607+0000 7f253f8fb9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:57:41.752 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T17:57:41.607+0000 7f253f8fb9c0 1 librados: init done 2024-09-12T17:57:41.752 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T17:57:41.607+0000 7f2429e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:57:41.752 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T17:57:41.607+0000 7f2429e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:41.752 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T17:57:41.607+0000 7f2429e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:41.752 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T17:57:41.607+0000 7f253dc02640 10 monclient: get_auth_request con 0x55c5159c2440 auth_method 0 2024-09-12T17:57:41.753 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T17:57:41.607+0000 7f253cc00640 10 monclient: get_auth_request con 0x7f2424070b10 auth_method 0 2024-09-12T17:57:41.753 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T17:57:41.607+0000 7f253d401640 10 monclient: get_auth_request con 0x55c5159e5210 auth_method 0 2024-09-12T17:57:41.753 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T17:57:41.611+0000 7f253cc00640 10 monclient: get_auth_request con 0x55c5159ea440 auth_method 0 2024-09-12T17:57:41.753 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient: build_initial_monmap 2024-09-12T17:57:41.753 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 1 build_initial for_mkfs: 0 2024-09-12T17:57:41.753 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient: monmap: 2024-09-12T17:57:41.753 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:57:41.753 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:57:41.753 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:57:41.753 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:57:41.753 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:57:41.753 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.754 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:57:41.754 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:57:41.754 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:57:41.754 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.754 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding auth protocol: cephx 2024-09-12T17:57:41.754 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding auth protocol: cephx 2024-09-12T17:57:41.754 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding auth protocol: cephx 2024-09-12T17:57:41.754 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: secure 2024-09-12T17:57:41.754 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: crc 2024-09-12T17:57:41.754 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: secure 2024-09-12T17:57:41.754 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: crc 2024-09-12T17:57:41.754 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: secure 2024-09-12T17:57:41.754 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: crc 2024-09-12T17:57:41.755 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: crc 2024-09-12T17:57:41.755 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: secure 2024-09-12T17:57:41.755 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: crc 2024-09-12T17:57:41.755 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: secure 2024-09-12T17:57:41.755 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: crc 2024-09-12T17:57:41.755 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: secure 2024-09-12T17:57:41.755 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.755 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c5159f1e60 EEXIST 2024-09-12T17:57:41.755 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient: init 2024-09-12T17:57:41.755 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding auth protocol: cephx 2024-09-12T17:57:41.755 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding auth protocol: cephx 2024-09-12T17:57:41.755 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding auth protocol: cephx 2024-09-12T17:57:41.755 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: secure 2024-09-12T17:57:41.756 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: crc 2024-09-12T17:57:41.756 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: secure 2024-09-12T17:57:41.756 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: crc 2024-09-12T17:57:41.756 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: secure 2024-09-12T17:57:41.756 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: crc 2024-09-12T17:57:41.756 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: crc 2024-09-12T17:57:41.756 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: secure 2024-09-12T17:57:41.756 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: crc 2024-09-12T17:57:41.756 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: secure 2024-09-12T17:57:41.756 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: crc 2024-09-12T17:57:41.756 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: secure 2024-09-12T17:57:41.756 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.757 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.757 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command rotate-key cmddesc rotate-key hook 0x55c5159ed5b0 EEXIST 2024-09-12T17:57:41.757 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:57:41.757 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:57:41.757 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-a con 0x55c515a16010 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:57:41.757 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-c con 0x55c515a15940 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:57:41.757 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-b con 0x55c515a14320 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:57:41.757 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.757 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.757 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.757 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:57:41.757 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient(hunting): authenticate will time out at 2658.185331s 2024-09-12T17:57:41.757 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T17:57:41.615+0000 7f253cc00640 10 monclient(hunting): get_auth_request con 0x55c515a15940 auth_method 0 2024-09-12T17:57:41.758 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T17:57:41.615+0000 7f253cc00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:41.758 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T17:57:41.615+0000 7f253cc00640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:41.758 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T17:57:41.615+0000 7f253cc00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:41.758 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T17:57:41.615+0000 7f253d401640 10 monclient(hunting): get_auth_request con 0x55c515a16010 auth_method 0 2024-09-12T17:57:41.758 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T17:57:41.615+0000 7f253d401640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:41.758 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T17:57:41.615+0000 7f253d401640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:41.758 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T17:57:41.615+0000 7f253d401640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:41.758 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T17:57:41.615+0000 7f253cc00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:41.758 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T17:57:41.615+0000 7f253cc00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:41.758 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T17:57:41.615+0000 7f253cc00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:41.758 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T17:57:41.615+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:41.758 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T17:57:41.615+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:41.758 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T17:57:41.615+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:41.758 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T17:57:41.615+0000 7f253d401640 10 monclient(hunting): handle_auth_done global_id 7170 payload 824 2024-09-12T17:57:41.759 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T17:57:41.615+0000 7f253d401640 10 monclient: _finish_hunting 0 2024-09-12T17:57:41.759 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T17:57:41.615+0000 7f253d401640 1 monclient: found mon.noname-a 2024-09-12T17:57:41.759 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T17:57:41.615+0000 7f253d401640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:57:41.759 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T17:57:41.615+0000 7f253dc02640 10 monclient: get_auth_request con 0x55c515a14320 auth_method 0 2024-09-12T17:57:41.759 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T17:57:41.615+0000 7f2422ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:41.759 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T17:57:41.615+0000 7f2422ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:57:41.759 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T17:57:41.615+0000 7f2422ffd640 10 monclient: dump: 2024-09-12T17:57:41.759 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:41.759 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:41.759 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.759 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.759 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:41.759 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.760 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:41.760 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:41.760 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:41.760 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.760 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T17:57:41.615+0000 7f2422ffd640 10 monclient: _finish_auth 0 2024-09-12T17:57:41.760 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T17:57:41.615+0000 7f2422ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:57:41.760 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T17:57:41.615+0000 7f2422ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:41.760 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T17:57:41.615+0000 7f2422ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:41.760 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T17:57:41.615+0000 7f2422ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:57:41.760 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T17:57:41.615+0000 7f2422ffd640 10 monclient: dump: 2024-09-12T17:57:41.760 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:41.760 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:41.761 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.761 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.761 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:41.761 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.761 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:41.761 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:41.761 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:41.761 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.761 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 monclient: authenticate success, global_id 7170 2024-09-12T17:57:41.761 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T17:57:41.615+0000 7f253e403640 4 set_mon_vals no callback set 2024-09-12T17:57:41.761 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient: _renew_subs 2024-09-12T17:57:41.761 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:57:41.762 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient: _renew_subs 2024-09-12T17:57:41.762 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:57:41.762 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T17:57:41.615+0000 7f2422ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:57:41.762 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T17:57:41.615+0000 7f2422ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:41.762 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T17:57:41.615+0000 7f2422ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:41.762 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: get_monmap_and_config 2024-09-12T17:57:41.762 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: build_initial_monmap 2024-09-12T17:57:41.762 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 1 build_initial for_mkfs: 0 2024-09-12T17:57:41.762 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: monmap: 2024-09-12T17:57:41.762 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:57:41.762 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:57:41.762 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:57:41.762 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:57:41.763 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:57:41.763 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.763 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:57:41.763 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:57:41.763 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:57:41.763 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.763 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding auth protocol: cephx 2024-09-12T17:57:41.763 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding auth protocol: cephx 2024-09-12T17:57:41.763 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding auth protocol: cephx 2024-09-12T17:57:41.763 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: secure 2024-09-12T17:57:41.763 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: crc 2024-09-12T17:57:41.763 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: secure 2024-09-12T17:57:41.763 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: crc 2024-09-12T17:57:41.763 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: secure 2024-09-12T17:57:41.764 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: crc 2024-09-12T17:57:41.764 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: crc 2024-09-12T17:57:41.764 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: secure 2024-09-12T17:57:41.764 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: crc 2024-09-12T17:57:41.764 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: secure 2024-09-12T17:57:41.764 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: crc 2024-09-12T17:57:41.764 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: secure 2024-09-12T17:57:41.764 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient: get_auth_request con 0x7f2418070a20 auth_method 0 2024-09-12T17:57:41.764 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.764 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: init 2024-09-12T17:57:41.764 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding auth protocol: cephx 2024-09-12T17:57:41.764 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding auth protocol: cephx 2024-09-12T17:57:41.764 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding auth protocol: cephx 2024-09-12T17:57:41.765 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: secure 2024-09-12T17:57:41.765 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: crc 2024-09-12T17:57:41.765 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: secure 2024-09-12T17:57:41.765 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: crc 2024-09-12T17:57:41.765 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: secure 2024-09-12T17:57:41.765 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: crc 2024-09-12T17:57:41.765 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: crc 2024-09-12T17:57:41.765 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: secure 2024-09-12T17:57:41.765 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: crc 2024-09-12T17:57:41.765 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: secure 2024-09-12T17:57:41.765 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: crc 2024-09-12T17:57:41.765 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: secure 2024-09-12T17:57:41.765 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.766 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.766 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe0e9356c8 EEXIST 2024-09-12T17:57:41.766 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:57:41.766 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:57:41.766 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-c con 0x55c515a69b50 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:57:41.766 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-a con 0x55c515a64f90 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:57:41.766 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-b con 0x55c515a5b660 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:57:41.766 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.766 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.766 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.766 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:57:41.766 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): authenticate will time out at 2658.189291s 2024-09-12T17:57:41.766 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient(hunting): get_auth_request con 0x55c515a64f90 auth_method 0 2024-09-12T17:57:41.766 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:41.767 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:41.767 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:41.767 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T17:57:41.619+0000 7f253d401640 10 monclient(hunting): get_auth_request con 0x55c515a69b50 auth_method 0 2024-09-12T17:57:41.767 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T17:57:41.619+0000 7f253d401640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:41.767 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T17:57:41.619+0000 7f253d401640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:41.767 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T17:57:41.619+0000 7f253d401640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:41.767 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:41.767 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:41.767 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:41.767 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T17:57:41.619+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:41.767 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T17:57:41.619+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:41.767 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T17:57:41.619+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:41.767 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient(hunting): handle_auth_done global_id 7173 payload 274 2024-09-12T17:57:41.767 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient: _finish_hunting 0 2024-09-12T17:57:41.768 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T17:57:41.619+0000 7f253cc00640 1 monclient: found mon.noname-a 2024-09-12T17:57:41.768 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:57:41.768 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T17:57:41.619+0000 7f2420ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:41.768 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T17:57:41.619+0000 7f2420ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:57:41.768 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T17:57:41.619+0000 7f2420ff9640 10 monclient: dump: 2024-09-12T17:57:41.768 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:41.768 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:41.768 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.768 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.768 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:41.768 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.768 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:41.768 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:41.768 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:41.769 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.769 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T17:57:41.619+0000 7f2420ff9640 10 monclient: _finish_auth 0 2024-09-12T17:57:41.769 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T17:57:41.619+0000 7f2420ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:57:41.769 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T17:57:41.619+0000 7f2420ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:41.769 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T17:57:41.619+0000 7f2420ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:41.769 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T17:57:41.619+0000 7f2420ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:57:41.769 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T17:57:41.619+0000 7f2420ff9640 10 monclient: dump: 2024-09-12T17:57:41.769 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:41.769 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:41.769 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.769 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.769 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:41.769 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.769 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:41.770 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:41.770 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:41.770 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.770 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 monclient: authenticate success, global_id 7173 2024-09-12T17:57:41.770 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:57:41.770 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 4 set_mon_vals no callback set 2024-09-12T17:57:41.770 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: shutdown 2024-09-12T17:57:41.770 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: build_initial_monmap 2024-09-12T17:57:41.770 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 1 build_initial for_mkfs: 0 2024-09-12T17:57:41.770 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: monmap: 2024-09-12T17:57:41.770 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:57:41.770 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:57:41.770 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:57:41.771 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:57:41.771 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:57:41.771 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.771 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:57:41.771 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:57:41.771 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:57:41.771 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.771 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding auth protocol: cephx 2024-09-12T17:57:41.771 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding auth protocol: cephx 2024-09-12T17:57:41.771 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding auth protocol: cephx 2024-09-12T17:57:41.771 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: secure 2024-09-12T17:57:41.771 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: crc 2024-09-12T17:57:41.772 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: secure 2024-09-12T17:57:41.772 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: crc 2024-09-12T17:57:41.772 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: secure 2024-09-12T17:57:41.772 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: crc 2024-09-12T17:57:41.772 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: crc 2024-09-12T17:57:41.772 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: secure 2024-09-12T17:57:41.772 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: crc 2024-09-12T17:57:41.772 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: secure 2024-09-12T17:57:41.772 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: crc 2024-09-12T17:57:41.772 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: secure 2024-09-12T17:57:41.772 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.772 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 1 librados: starting msgr at 2024-09-12T17:57:41.772 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 1 librados: starting objecter 2024-09-12T17:57:41.773 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c515a14d30 EEXIST 2024-09-12T17:57:41.773 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 1 librados: setting wanted keys 2024-09-12T17:57:41.773 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 1 librados: calling monclient init 2024-09-12T17:57:41.773 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: init 2024-09-12T17:57:41.773 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding auth protocol: cephx 2024-09-12T17:57:41.773 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding auth protocol: cephx 2024-09-12T17:57:41.773 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding auth protocol: cephx 2024-09-12T17:57:41.773 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: secure 2024-09-12T17:57:41.773 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: crc 2024-09-12T17:57:41.773 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: secure 2024-09-12T17:57:41.773 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: crc 2024-09-12T17:57:41.773 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: secure 2024-09-12T17:57:41.773 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: crc 2024-09-12T17:57:41.774 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: crc 2024-09-12T17:57:41.774 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: secure 2024-09-12T17:57:41.774 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: crc 2024-09-12T17:57:41.774 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: secure 2024-09-12T17:57:41.774 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: crc 2024-09-12T17:57:41.774 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: secure 2024-09-12T17:57:41.774 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.774 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.774 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command rotate-key cmddesc rotate-key hook 0x55c515a17f78 EEXIST 2024-09-12T17:57:41.774 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:57:41.774 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:57:41.774 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-c con 0x55c515a5b660 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:57:41.774 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-b con 0x55c515a64f90 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:57:41.774 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-a con 0x55c515a69b50 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:57:41.775 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.775 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.775 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.775 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:57:41.775 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): authenticate will time out at 2658.191890s 2024-09-12T17:57:41.775 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T17:57:41.619+0000 7f253d401640 10 monclient(hunting): get_auth_request con 0x55c515a5b660 auth_method 0 2024-09-12T17:57:41.775 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T17:57:41.623+0000 7f253d401640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:41.775 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T17:57:41.623+0000 7f253d401640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:41.775 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T17:57:41.623+0000 7f253d401640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:41.775 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T17:57:41.623+0000 7f253dc02640 10 monclient(hunting): get_auth_request con 0x55c515a69b50 auth_method 0 2024-09-12T17:57:41.775 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T17:57:41.623+0000 7f253dc02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:41.775 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T17:57:41.623+0000 7f253dc02640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:41.775 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T17:57:41.623+0000 7f253dc02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:41.776 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T17:57:41.623+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:41.776 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T17:57:41.623+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:41.776 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T17:57:41.623+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:41.776 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T17:57:41.623+0000 7f253dc02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:41.776 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T17:57:41.623+0000 7f253dc02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:41.776 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T17:57:41.623+0000 7f253dc02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:41.776 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T17:57:41.623+0000 7f253cc00640 10 monclient(hunting): get_auth_request con 0x55c515a64f90 auth_method 0 2024-09-12T17:57:41.776 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T17:57:41.623+0000 7f253cc00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:41.776 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T17:57:41.623+0000 7f253cc00640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:41.776 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T17:57:41.623+0000 7f253cc00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:41.776 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T17:57:41.623+0000 7f253d401640 10 monclient(hunting): handle_auth_done global_id 6662 payload 824 2024-09-12T17:57:41.776 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T17:57:41.623+0000 7f253d401640 10 monclient: _finish_hunting 0 2024-09-12T17:57:41.776 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T17:57:41.623+0000 7f253d401640 1 monclient: found mon.noname-c 2024-09-12T17:57:41.777 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T17:57:41.623+0000 7f253d401640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:57:41.777 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T17:57:41.623+0000 7f240effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:41.777 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T17:57:41.623+0000 7f240effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:57:41.777 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T17:57:41.623+0000 7f240effd640 10 monclient: dump: 2024-09-12T17:57:41.777 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:41.777 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:41.777 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.777 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.777 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:41.777 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.777 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:41.777 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:41.777 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:41.777 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.778 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T17:57:41.623+0000 7f240effd640 10 monclient: _finish_auth 0 2024-09-12T17:57:41.778 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T17:57:41.623+0000 7f240effd640 10 monclient: _check_auth_tickets 2024-09-12T17:57:41.778 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T17:57:41.623+0000 7f240effd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:41.778 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T17:57:41.623+0000 7f240effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:41.778 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T17:57:41.623+0000 7f240effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:57:41.778 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T17:57:41.623+0000 7f240effd640 10 monclient: dump: 2024-09-12T17:57:41.778 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:41.778 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:41.778 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.778 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.778 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:41.778 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.778 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:41.778 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:41.779 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:41.779 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.779 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 5 monclient: authenticate success, global_id 6662 2024-09-12T17:57:41.779 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 10 monclient: _renew_subs 2024-09-12T17:57:41.779 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:57:41.779 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T17:57:41.623+0000 7f2420ff9640 4 set_mon_vals no callback set 2024-09-12T17:57:41.779 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 10 monclient: _renew_subs 2024-09-12T17:57:41.779 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:57:41.779 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 1 librados: init done 2024-09-12T17:57:41.779 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command cr dump hook 0x55c515a39ce8 2024-09-12T17:57:41.779 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.779 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T17:57:41.623+0000 7f240effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:57:41.779 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T17:57:41.623+0000 7f240effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:41.779 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T17:57:41.623+0000 7f240effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:41.780 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T17:57:41.623+0000 7f253cc00640 10 monclient: get_auth_request con 0x7f2408070b10 auth_method 0 2024-09-12T17:57:41.780 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T17:57:41.623+0000 7f253dc02640 10 monclient: get_auth_request con 0x55c515a82fa0 auth_method 0 2024-09-12T17:57:41.780 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.780 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 20 realm 2024-09-12T17:57:41.780 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.780 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.780 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T17:57:41.627+0000 7f253f8fb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:41.780 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.780 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.780 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.780 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T17:57:41.627+0000 7f253d401640 10 monclient: get_auth_request con 0x55c515a871d0 auth_method 0 2024-09-12T17:57:41.780 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:41.780 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.781 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:41.781 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 searching for the correct realm 2024-09-12T17:57:41.781 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T17:57:41.627+0000 7f253cc00640 10 monclient: get_auth_request con 0x55c515a8c480 auth_method 0 2024-09-12T17:57:41.781 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T17:57:41.627+0000 7f253dc02640 10 monclient: get_auth_request con 0x7f2534038070 auth_method 0 2024-09-12T17:57:41.781 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T17:57:41.631+0000 7f253d401640 10 monclient: get_auth_request con 0x7f25380c6400 auth_method 0 2024-09-12T17:57:41.781 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T17:57:41.631+0000 7f253cc00640 10 monclient: get_auth_request con 0x7f2530070070 auth_method 0 2024-09-12T17:57:41.781 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T17:57:41.635+0000 7f253cc00640 0 -- 172.21.15.98:0/2373793126 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x55c515a8c480 msgr2=0x55c515a8e940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:41.781 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T17:57:41.635+0000 7f240effd640 1 client.6662.objecter ms_handle_reset 0x55c515a8c480 session 0x55c515a8be00 osd.3 2024-09-12T17:57:41.781 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T17:57:41.635+0000 7f240effd640 10 monclient: _renew_subs 2024-09-12T17:57:41.781 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T17:57:41.635+0000 7f240effd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:57:41.781 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T17:57:41.635+0000 7f253cc00640 10 monclient: get_auth_request con 0x7f24080811b0 auth_method 0 2024-09-12T17:57:41.781 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T17:57:41.635+0000 7f253dc02640 10 monclient: get_auth_request con 0x7f2534045b70 auth_method 0 2024-09-12T17:57:41.781 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T17:57:41.639+0000 7f253d401640 10 monclient: get_auth_request con 0x7f253402a920 auth_method 0 2024-09-12T17:57:41.781 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T17:57:41.639+0000 7f253d401640 0 -- 172.21.15.98:0/2373793126 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f253402a920 msgr2=0x7f2534055400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:57:41.782 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T17:57:41.639+0000 7f240effd640 1 client.6662.objecter ms_handle_reset 0x7f253402a920 session 0x7f2534038ea0 osd.0 2024-09-12T17:57:41.782 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T17:57:41.639+0000 7f253d401640 10 monclient: get_auth_request con 0x55c515a8c480 auth_method 0 2024-09-12T17:57:41.782 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:41.782 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:57:41.782 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:41.782 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:57:41.782 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:41.782 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:41.782 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.782 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.782 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.782 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:41.782 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.782 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:41.783 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 zone default found 2024-09-12T17:57:41.783 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 4 Realm: () 2024-09-12T17:57:41.783 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:57:41.783 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:57:41.783 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:41.783 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 zonegroup default 2024-09-12T17:57:41.783 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.783 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.783 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.783 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T17:57:41.651+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.783 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T17:57:41.651+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.783 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T17:57:41.651+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.783 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T17:57:41.651+0000 7f253f8fb9c0 20 started sync module instance, tier type = 2024-09-12T17:57:41.784 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T17:57:41.651+0000 7f253f8fb9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:57:41.784 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=0 2024-09-12T17:57:41.784 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=1 2024-09-12T17:57:41.784 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=2 2024-09-12T17:57:41.784 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=3 2024-09-12T17:57:41.784 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=4 2024-09-12T17:57:41.784 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=5 2024-09-12T17:57:41.784 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=6 2024-09-12T17:57:41.784 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 20 add_watcher() i=7 2024-09-12T17:57:41.784 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:41.784 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding auth protocol: cephx 2024-09-12T17:57:41.784 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding auth protocol: cephx 2024-09-12T17:57:41.784 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding auth protocol: cephx 2024-09-12T17:57:41.784 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: secure 2024-09-12T17:57:41.785 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: crc 2024-09-12T17:57:41.785 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: secure 2024-09-12T17:57:41.785 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: crc 2024-09-12T17:57:41.785 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: secure 2024-09-12T17:57:41.785 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: crc 2024-09-12T17:57:41.785 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: crc 2024-09-12T17:57:41.785 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: secure 2024-09-12T17:57:41.785 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T17:57:41.667+0000 7f23f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:41.785 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: crc 2024-09-12T17:57:41.785 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: secure 2024-09-12T17:57:41.785 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: crc 2024-09-12T17:57:41.786 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: secure 2024-09-12T17:57:41.786 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.786 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:41.786 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:41.786 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command cache list hook 0x55c515a5a1e0 2024-09-12T17:57:41.786 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command cache inspect hook 0x55c515a5a1e0 2024-09-12T17:57:41.786 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command cache erase hook 0x55c515a5a1e0 2024-09-12T17:57:41.786 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command cache zap hook 0x55c515a5a1e0 2024-09-12T17:57:41.786 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 note: GC not initialized 2024-09-12T17:57:41.786 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T17:57:41.667+0000 7f23f27e4640 20 reqs_thread_entry: start 2024-09-12T17:57:41.786 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command sync trace show hook 0x7f2534015750 2024-09-12T17:57:41.786 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command sync trace history hook 0x7f2534015750 2024-09-12T17:57:41.786 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command sync trace active hook 0x7f2534015750 2024-09-12T17:57:41.787 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command sync trace active_short hook 0x7f2534015750 2024-09-12T17:57:41.787 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:41.787 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 20 Filter name: none 2024-09-12T17:57:41.787 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T17:57:41.671+0000 7f2363fff640 20 reqs_thread_entry: start 2024-09-12T17:57:41.787 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:57:41.787 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.787 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:57:41.787 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:57:41.787 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:57:41.787 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 : miss 2024-09-12T17:57:41.787 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.787 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:57:41.787 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:57:41.787 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:57:41.788 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:41.788 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:41.788 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 2024-09-12T17:57:41.788 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T17:57:41.679+0000 7f253f8fb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:57:41.788 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T17:57:41.679+0000 7f253f8fb9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:57:41.788 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T17:57:41.679+0000 7f253f8fb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:41.788 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T17:57:41.679+0000 7f253f8fb9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29, ofs0, ns] 2024-09-12T17:57:41.788 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T17:57:41.683+0000 7f2420ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366168 cookie 94304960329344 notifier 6662 bl.length()=915 2024-09-12T17:57:41.788 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T17:57:41.683+0000 7f2420ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:57:41.788 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T17:57:41.683+0000 7f2420ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:57:41.788 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T17:57:41.683+0000 7f2420ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:41.788 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T17:57:41.683+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): orig_sources= new_sources= 2024-09-12T17:57:41.788 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T17:57:41.683+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): potential sources added=[] removed=[] 2024-09-12T17:57:41.789 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T17:57:41.683+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): orig_dests= new_dests= 2024-09-12T17:57:41.789 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T17:57:41.683+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): potential dests added=[] removed=[] 2024-09-12T17:57:41.789 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.0 2024-09-12T17:57:41.789 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.0 2024-09-12T17:57:41.789 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.1 2024-09-12T17:57:41.789 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.1 2024-09-12T17:57:41.789 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.2 2024-09-12T17:57:41.789 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.2 2024-09-12T17:57:41.789 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.3 2024-09-12T17:57:41.789 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.3 2024-09-12T17:57:41.789 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.4 2024-09-12T17:57:41.789 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.4 2024-09-12T17:57:41.789 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.5 2024-09-12T17:57:41.790 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.5 2024-09-12T17:57:41.790 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.6 2024-09-12T17:57:41.790 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.6 2024-09-12T17:57:41.790 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.7 2024-09-12T17:57:41.790 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.7 2024-09-12T17:57:41.790 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.8 2024-09-12T17:57:41.790 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.8 2024-09-12T17:57:41.790 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.9 2024-09-12T17:57:41.790 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.9 2024-09-12T17:57:41.790 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.10 2024-09-12T17:57:41.790 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.10 2024-09-12T17:57:41.790 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.11 2024-09-12T17:57:41.790 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.11 2024-09-12T17:57:41.790 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.0 2024-09-12T17:57:41.791 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1 2024-09-12T17:57:41.791 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2 2024-09-12T17:57:41.791 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.3 2024-09-12T17:57:41.791 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.4 2024-09-12T17:57:41.791 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T17:57:41.699+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.5 2024-09-12T17:57:41.791 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T17:57:41.699+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.6 2024-09-12T17:57:41.791 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T17:57:41.699+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.7 2024-09-12T17:57:41.791 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T17:57:41.699+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.8 2024-09-12T17:57:41.791 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T17:57:41.703+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.9 2024-09-12T17:57:41.791 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T17:57:41.703+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.10 2024-09-12T17:57:41.791 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T17:57:41.711+0000 7f253f8fb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:41.791 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T17:57:41.711+0000 7f253f8fb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 2024-09-12T17:57:41.791 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T17:57:41.711+0000 7f253f8fb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:57:41.791 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T17:57:41.711+0000 7f253f8fb9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:57:41.792 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T17:57:41.711+0000 7f253f8fb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:41.792 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T17:57:41.711+0000 7f253f8fb9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29, ofs0, ns] 2024-09-12T17:57:41.792 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T17:57:41.715+0000 7f2420ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366169 cookie 94304960329344 notifier 6662 bl.length()=915 2024-09-12T17:57:41.792 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T17:57:41.715+0000 7f2420ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:57:41.792 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T17:57:41.715+0000 7f2420ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:57:41.792 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T17:57:41.715+0000 7f2420ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:41.792 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T17:57:41.715+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): orig_sources= new_sources= 2024-09-12T17:57:41.792 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T17:57:41.715+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): potential sources added=[] removed=[] 2024-09-12T17:57:41.792 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T17:57:41.715+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): orig_dests= new_dests= 2024-09-12T17:57:41.792 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T17:57:41.715+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): potential dests added=[] removed=[] 2024-09-12T17:57:41.792 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T17:57:41.715+0000 7f253f8fb9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f253f8fb9c0 time 2024-09-12T17:57:41.718360+0000 2024-09-12T17:57:41.792 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:57:41.792 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.793 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:41.793 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f25431d52eb] 2024-09-12T17:57:41.793 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f25431d549f] 2024-09-12T17:57:41.793 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5132370c1] 2024-09-12T17:57:41.793 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55c51324855b] 2024-09-12T17:57:41.793 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c513249b44] 2024-09-12T17:57:41.793 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T17:57:41.793 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f254203bd90] 2024-09-12T17:57:41.793 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T17:57:41.793 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T17:57:41.793 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.793 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T17:57:41.719+0000 7f253f8fb9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:57:41.793 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f253f8fb9c0 thread_name:radosgw-admin 2024-09-12T17:57:41.793 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.794 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:41.794 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2542054520] 2024-09-12T17:57:41.794 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:57:41.794 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:57:41.794 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:57:41.794 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f25431d5345] 2024-09-12T17:57:41.794 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f25431d549f] 2024-09-12T17:57:41.794 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5132370c1] 2024-09-12T17:57:41.794 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55c51324855b] 2024-09-12T17:57:41.794 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c513249b44] 2024-09-12T17:57:41.794 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T17:57:41.794 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f254203bd90] 2024-09-12T17:57:41.795 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T17:57:41.795 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T17:57:41.795 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:57:41.795 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.795 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T17:57:41.795 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T17:57:41.795 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T17:57:41.795 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T17:57:41.795 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T17:57:41.795 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T17:57:41.795 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T17:57:41.795 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T17:57:41.795 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T17:57:41.795 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T17:57:41.796 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T17:57:41.796 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T17:57:41.796 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T17:57:41.796 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T17:57:41.796 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T17:57:41.796 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T17:57:41.796 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T17:57:41.796 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T17:57:41.796 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T17:57:41.796 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T17:57:41.796 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T17:57:41.796 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T17:57:41.796 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T17:57:41.797 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T17:57:41.797 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:57:41.797 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T17:57:41.797 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T17:57:41.797 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T17:57:41.797 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T17:57:41.797 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T17:57:41.797 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T17:57:41.797 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T17:57:41.797 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T17:57:41.797 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T17:57:41.797 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T17:57:41.797 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T17:57:41.797 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T17:57:41.798 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T17:57:41.798 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T17:57:41.798 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T17:57:41.798 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T17:57:41.798 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T17:57:41.798 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T17:57:41.798 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T17:57:41.798 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T17:57:41.798 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T17:57:41.798 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:57:41.798 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T17:57:41.798 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:57:41.798 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T17:57:41.798 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T17:57:41.799 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T17:57:41.799 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T17:57:41.799 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T17:57:41.799 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T17:57:41.799 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T17:57:41.799 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T17:57:41.799 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T17:57:41.799 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T17:57:41.799 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T17:57:41.799 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T17:57:41.799 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T17:57:41.799 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T17:57:41.799 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T17:57:41.799 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T17:57:41.800 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T17:57:41.800 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T17:57:41.800 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:57:41.800 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T17:57:41.800 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:57:41.800 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T17:57:41.800 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T17:57:41.800 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T17:57:41.800 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T17:57:41.800 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T17:57:41.800 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T17:57:41.800 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:57:41.800 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T17:57:41.800 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T17:57:41.801 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:57:41.801 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T17:57:41.801 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T17:57:41.801 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T17:57:41.801 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T17:57:41.801 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T17:57:41.801 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T17:57:41.801 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T17:57:41.801 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T17:57:41.801 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T17:57:41.801 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T17:57:41.801 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T17:57:41.801 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T17:57:41.802 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T17:57:41.802 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:57:41.802 INFO:tasks.workunit.client.0.smithi098.stderr: 7f2363fff640 / http_manager 2024-09-12T17:57:41.802 INFO:tasks.workunit.client.0.smithi098.stderr: 7f23f27e4640 / http_manager 2024-09-12T17:57:41.802 INFO:tasks.workunit.client.0.smithi098.stderr: 7f23f37e6640 / rgw_dt_lg_renew 2024-09-12T17:57:41.802 INFO:tasks.workunit.client.0.smithi098.stderr: 7f240effd640 / ms_dispatch 2024-09-12T17:57:41.802 INFO:tasks.workunit.client.0.smithi098.stderr: 7f2420ff9640 / io_context_pool 2024-09-12T17:57:41.802 INFO:tasks.workunit.client.0.smithi098.stderr: 7f2422ffd640 / ms_dispatch 2024-09-12T17:57:41.802 INFO:tasks.workunit.client.0.smithi098.stderr: 7f2429e03640 / ms_dispatch 2024-09-12T17:57:41.802 INFO:tasks.workunit.client.0.smithi098.stderr: 7f242b606640 / io_context_pool 2024-09-12T17:57:41.802 INFO:tasks.workunit.client.0.smithi098.stderr: 7f253cc00640 / msgr-worker-2 2024-09-12T17:57:41.802 INFO:tasks.workunit.client.0.smithi098.stderr: 7f253d401640 / msgr-worker-1 2024-09-12T17:57:41.802 INFO:tasks.workunit.client.0.smithi098.stderr: 7f253dc02640 / msgr-worker-0 2024-09-12T17:57:41.802 INFO:tasks.workunit.client.0.smithi098.stderr: 7f253e403640 / io_context_pool 2024-09-12T17:57:41.803 INFO:tasks.workunit.client.0.smithi098.stderr: 7f253f8fb9c0 / radosgw-admin 2024-09-12T17:57:41.803 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T17:57:41.803 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T17:57:41.803 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/log/ceph/ceph-client.admin.105781.log 2024-09-12T17:57:41.803 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T17:57:41.803 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T17:57:41.803 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: crc 2024-09-12T17:57:41.803 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: secure 2024-09-12T17:57:41.803 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: crc 2024-09-12T17:57:41.803 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: secure 2024-09-12T17:57:41.803 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: crc 2024-09-12T17:57:41.803 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: crc 2024-09-12T17:57:41.804 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: secure 2024-09-12T17:57:41.804 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: crc 2024-09-12T17:57:41.804 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: secure 2024-09-12T17:57:41.804 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: crc 2024-09-12T17:57:41.804 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 AuthRegistry(0x55c51599a3a0) adding con mode: secure 2024-09-12T17:57:41.804 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.804 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.804 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command rotate-key hook 0x55c51599a4e8 2024-09-12T17:57:41.804 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:57:41.804 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:57:41.804 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-a con 0x55c515827840 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:57:41.804 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-c con 0x55c5158e29c0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:57:41.804 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-b con 0x55c51599d6a0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:57:41.804 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.805 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.805 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.805 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:57:41.805 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T17:57:41.603+0000 7f253f8fb9c0 10 monclient(hunting): authenticate will time out at 2658.174779s 2024-09-12T17:57:41.805 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T17:57:41.603+0000 7f253d401640 10 monclient(hunting): get_auth_request con 0x55c515827840 auth_method 0 2024-09-12T17:57:41.805 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T17:57:41.603+0000 7f253d401640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:41.805 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T17:57:41.603+0000 7f253d401640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:41.805 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T17:57:41.603+0000 7f253d401640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:41.805 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T17:57:41.603+0000 7f253cc00640 10 monclient(hunting): get_auth_request con 0x55c5158e29c0 auth_method 0 2024-09-12T17:57:41.805 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T17:57:41.603+0000 7f253cc00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:41.805 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T17:57:41.603+0000 7f253cc00640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:41.805 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T17:57:41.603+0000 7f253cc00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:41.805 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T17:57:41.603+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:41.806 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T17:57:41.603+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:41.806 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T17:57:41.603+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:41.806 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T17:57:41.603+0000 7f253cc00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:41.806 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T17:57:41.603+0000 7f253cc00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:41.806 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T17:57:41.603+0000 7f253cc00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:41.806 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T17:57:41.603+0000 7f253d401640 10 monclient(hunting): handle_auth_done global_id 7167 payload 824 2024-09-12T17:57:41.806 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T17:57:41.603+0000 7f253d401640 10 monclient: _finish_hunting 0 2024-09-12T17:57:41.806 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T17:57:41.603+0000 7f253d401640 1 monclient: found mon.noname-a 2024-09-12T17:57:41.806 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T17:57:41.603+0000 7f253d401640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:57:41.806 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T17:57:41.603+0000 7f2429e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:41.806 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T17:57:41.603+0000 7f2429e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:57:41.806 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T17:57:41.603+0000 7f2429e03640 10 monclient: dump: 2024-09-12T17:57:41.806 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:41.807 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:41.807 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.807 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.807 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:41.807 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.807 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:41.807 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:41.807 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:41.807 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.807 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T17:57:41.603+0000 7f2429e03640 10 monclient: _finish_auth 0 2024-09-12T17:57:41.807 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T17:57:41.603+0000 7f2429e03640 10 monclient: _check_auth_tickets 2024-09-12T17:57:41.807 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T17:57:41.603+0000 7f2429e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:41.807 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T17:57:41.603+0000 7f2429e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:41.808 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T17:57:41.603+0000 7f2429e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:57:41.808 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T17:57:41.603+0000 7f2429e03640 10 monclient: dump: 2024-09-12T17:57:41.808 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:41.808 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:41.808 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.808 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.808 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:41.808 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.808 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:41.808 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:41.808 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:41.808 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.808 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T17:57:41.603+0000 7f242b606640 4 set_mon_vals no callback set 2024-09-12T17:57:41.808 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T17:57:41.607+0000 7f253f8fb9c0 5 monclient: authenticate success, global_id 7167 2024-09-12T17:57:41.809 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T17:57:41.607+0000 7f253f8fb9c0 10 monclient: _renew_subs 2024-09-12T17:57:41.809 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T17:57:41.607+0000 7f253f8fb9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:57:41.809 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T17:57:41.607+0000 7f253f8fb9c0 10 monclient: _renew_subs 2024-09-12T17:57:41.809 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T17:57:41.607+0000 7f253f8fb9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:57:41.809 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T17:57:41.607+0000 7f253f8fb9c0 1 librados: init done 2024-09-12T17:57:41.809 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T17:57:41.607+0000 7f2429e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:57:41.809 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T17:57:41.607+0000 7f2429e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:41.809 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T17:57:41.607+0000 7f2429e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:41.809 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T17:57:41.607+0000 7f253dc02640 10 monclient: get_auth_request con 0x55c5159c2440 auth_method 0 2024-09-12T17:57:41.809 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T17:57:41.607+0000 7f253cc00640 10 monclient: get_auth_request con 0x7f2424070b10 auth_method 0 2024-09-12T17:57:41.809 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T17:57:41.607+0000 7f253d401640 10 monclient: get_auth_request con 0x55c5159e5210 auth_method 0 2024-09-12T17:57:41.809 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T17:57:41.611+0000 7f253cc00640 10 monclient: get_auth_request con 0x55c5159ea440 auth_method 0 2024-09-12T17:57:41.810 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient: build_initial_monmap 2024-09-12T17:57:41.810 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 1 build_initial for_mkfs: 0 2024-09-12T17:57:41.810 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient: monmap: 2024-09-12T17:57:41.810 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:57:41.810 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:57:41.810 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:57:41.810 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:57:41.810 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:57:41.810 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.810 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:57:41.810 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:57:41.810 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:57:41.810 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.811 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding auth protocol: cephx 2024-09-12T17:57:41.811 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding auth protocol: cephx 2024-09-12T17:57:41.811 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding auth protocol: cephx 2024-09-12T17:57:41.811 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: secure 2024-09-12T17:57:41.811 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: crc 2024-09-12T17:57:41.811 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: secure 2024-09-12T17:57:41.811 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: crc 2024-09-12T17:57:41.811 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: secure 2024-09-12T17:57:41.811 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: crc 2024-09-12T17:57:41.811 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: crc 2024-09-12T17:57:41.811 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: secure 2024-09-12T17:57:41.812 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: crc 2024-09-12T17:57:41.812 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: secure 2024-09-12T17:57:41.812 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: crc 2024-09-12T17:57:41.812 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ee4b0) adding con mode: secure 2024-09-12T17:57:41.812 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.812 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c5159f1e60 EEXIST 2024-09-12T17:57:41.812 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient: init 2024-09-12T17:57:41.812 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding auth protocol: cephx 2024-09-12T17:57:41.812 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding auth protocol: cephx 2024-09-12T17:57:41.812 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding auth protocol: cephx 2024-09-12T17:57:41.812 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: secure 2024-09-12T17:57:41.812 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: crc 2024-09-12T17:57:41.812 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: secure 2024-09-12T17:57:41.813 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: crc 2024-09-12T17:57:41.813 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: secure 2024-09-12T17:57:41.813 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: crc 2024-09-12T17:57:41.813 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: crc 2024-09-12T17:57:41.813 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: secure 2024-09-12T17:57:41.813 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: crc 2024-09-12T17:57:41.813 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: secure 2024-09-12T17:57:41.813 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: crc 2024-09-12T17:57:41.813 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 AuthRegistry(0x55c5159ed468) adding con mode: secure 2024-09-12T17:57:41.813 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.813 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.813 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command rotate-key cmddesc rotate-key hook 0x55c5159ed5b0 EEXIST 2024-09-12T17:57:41.813 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:57:41.814 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:57:41.814 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-a con 0x55c515a16010 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:57:41.814 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-c con 0x55c515a15940 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:57:41.814 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-b con 0x55c515a14320 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:57:41.814 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.814 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.814 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.814 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:57:41.814 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient(hunting): authenticate will time out at 2658.185331s 2024-09-12T17:57:41.814 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T17:57:41.615+0000 7f253cc00640 10 monclient(hunting): get_auth_request con 0x55c515a15940 auth_method 0 2024-09-12T17:57:41.814 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T17:57:41.615+0000 7f253cc00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:41.814 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T17:57:41.615+0000 7f253cc00640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:41.814 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T17:57:41.615+0000 7f253cc00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:41.815 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T17:57:41.615+0000 7f253d401640 10 monclient(hunting): get_auth_request con 0x55c515a16010 auth_method 0 2024-09-12T17:57:41.815 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T17:57:41.615+0000 7f253d401640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:41.815 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T17:57:41.615+0000 7f253d401640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:41.815 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T17:57:41.615+0000 7f253d401640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:41.815 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T17:57:41.615+0000 7f253cc00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:41.815 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T17:57:41.615+0000 7f253cc00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:41.815 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T17:57:41.615+0000 7f253cc00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:41.815 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T17:57:41.615+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:41.815 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T17:57:41.615+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:41.815 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T17:57:41.615+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:41.815 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T17:57:41.615+0000 7f253d401640 10 monclient(hunting): handle_auth_done global_id 7170 payload 824 2024-09-12T17:57:41.816 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T17:57:41.615+0000 7f253d401640 10 monclient: _finish_hunting 0 2024-09-12T17:57:41.816 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T17:57:41.615+0000 7f253d401640 1 monclient: found mon.noname-a 2024-09-12T17:57:41.816 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T17:57:41.615+0000 7f253d401640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:57:41.816 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T17:57:41.615+0000 7f253dc02640 10 monclient: get_auth_request con 0x55c515a14320 auth_method 0 2024-09-12T17:57:41.816 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T17:57:41.615+0000 7f2422ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:41.816 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T17:57:41.615+0000 7f2422ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:57:41.816 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T17:57:41.615+0000 7f2422ffd640 10 monclient: dump: 2024-09-12T17:57:41.816 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:41.816 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:41.816 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.816 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.816 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:41.816 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.816 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:41.817 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:41.817 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:41.817 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.817 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T17:57:41.615+0000 7f2422ffd640 10 monclient: _finish_auth 0 2024-09-12T17:57:41.817 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T17:57:41.615+0000 7f2422ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:57:41.817 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T17:57:41.615+0000 7f2422ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:41.817 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T17:57:41.615+0000 7f2422ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:41.817 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T17:57:41.615+0000 7f2422ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:57:41.817 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T17:57:41.615+0000 7f2422ffd640 10 monclient: dump: 2024-09-12T17:57:41.817 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:41.817 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:41.817 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.817 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.818 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:41.818 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.818 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:41.818 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:41.818 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:41.818 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.818 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 5 monclient: authenticate success, global_id 7170 2024-09-12T17:57:41.818 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T17:57:41.615+0000 7f253e403640 4 set_mon_vals no callback set 2024-09-12T17:57:41.818 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient: _renew_subs 2024-09-12T17:57:41.818 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:57:41.818 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient: _renew_subs 2024-09-12T17:57:41.818 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T17:57:41.615+0000 7f253f8fb9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:57:41.819 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T17:57:41.615+0000 7f2422ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:57:41.819 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T17:57:41.615+0000 7f2422ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:41.819 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T17:57:41.615+0000 7f2422ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:41.819 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: get_monmap_and_config 2024-09-12T17:57:41.819 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: build_initial_monmap 2024-09-12T17:57:41.819 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 1 build_initial for_mkfs: 0 2024-09-12T17:57:41.819 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: monmap: 2024-09-12T17:57:41.819 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:57:41.819 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:57:41.819 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:57:41.819 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:57:41.819 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:57:41.819 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.819 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:57:41.820 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:57:41.820 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:57:41.820 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.820 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding auth protocol: cephx 2024-09-12T17:57:41.820 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding auth protocol: cephx 2024-09-12T17:57:41.820 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding auth protocol: cephx 2024-09-12T17:57:41.820 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: secure 2024-09-12T17:57:41.820 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: crc 2024-09-12T17:57:41.820 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: secure 2024-09-12T17:57:41.820 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: crc 2024-09-12T17:57:41.820 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: secure 2024-09-12T17:57:41.820 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: crc 2024-09-12T17:57:41.820 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: crc 2024-09-12T17:57:41.821 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: secure 2024-09-12T17:57:41.821 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: crc 2024-09-12T17:57:41.821 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: secure 2024-09-12T17:57:41.821 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: crc 2024-09-12T17:57:41.821 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a35630) adding con mode: secure 2024-09-12T17:57:41.821 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient: get_auth_request con 0x7f2418070a20 auth_method 0 2024-09-12T17:57:41.821 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.821 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: init 2024-09-12T17:57:41.821 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding auth protocol: cephx 2024-09-12T17:57:41.821 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding auth protocol: cephx 2024-09-12T17:57:41.821 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding auth protocol: cephx 2024-09-12T17:57:41.821 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: secure 2024-09-12T17:57:41.821 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: crc 2024-09-12T17:57:41.822 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: secure 2024-09-12T17:57:41.822 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: crc 2024-09-12T17:57:41.822 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: secure 2024-09-12T17:57:41.822 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: crc 2024-09-12T17:57:41.822 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: crc 2024-09-12T17:57:41.822 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: secure 2024-09-12T17:57:41.822 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: crc 2024-09-12T17:57:41.822 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: secure 2024-09-12T17:57:41.822 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: crc 2024-09-12T17:57:41.822 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935580) adding con mode: secure 2024-09-12T17:57:41.822 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.822 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.823 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe0e9356c8 EEXIST 2024-09-12T17:57:41.823 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:57:41.823 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:57:41.823 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-c con 0x55c515a69b50 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:57:41.823 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-a con 0x55c515a64f90 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:57:41.823 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-b con 0x55c515a5b660 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:57:41.823 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.823 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.823 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.823 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:57:41.823 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): authenticate will time out at 2658.189291s 2024-09-12T17:57:41.823 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient(hunting): get_auth_request con 0x55c515a64f90 auth_method 0 2024-09-12T17:57:41.823 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:41.823 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:41.824 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:41.824 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T17:57:41.619+0000 7f253d401640 10 monclient(hunting): get_auth_request con 0x55c515a69b50 auth_method 0 2024-09-12T17:57:41.824 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T17:57:41.619+0000 7f253d401640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:41.824 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T17:57:41.619+0000 7f253d401640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:41.824 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T17:57:41.619+0000 7f253d401640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:41.824 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:41.824 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:41.824 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:41.824 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T17:57:41.619+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:41.824 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T17:57:41.619+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:41.824 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T17:57:41.619+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:41.824 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient(hunting): handle_auth_done global_id 7173 payload 274 2024-09-12T17:57:41.825 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient: _finish_hunting 0 2024-09-12T17:57:41.825 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T17:57:41.619+0000 7f253cc00640 1 monclient: found mon.noname-a 2024-09-12T17:57:41.825 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T17:57:41.619+0000 7f253cc00640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:57:41.825 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T17:57:41.619+0000 7f2420ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:41.825 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T17:57:41.619+0000 7f2420ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:57:41.825 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T17:57:41.619+0000 7f2420ff9640 10 monclient: dump: 2024-09-12T17:57:41.825 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:41.825 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:41.825 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.825 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.825 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:41.825 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.825 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:41.826 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:41.826 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:41.826 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.826 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T17:57:41.619+0000 7f2420ff9640 10 monclient: _finish_auth 0 2024-09-12T17:57:41.826 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T17:57:41.619+0000 7f2420ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:57:41.826 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T17:57:41.619+0000 7f2420ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:41.826 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T17:57:41.619+0000 7f2420ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:41.826 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T17:57:41.619+0000 7f2420ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:57:41.826 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T17:57:41.619+0000 7f2420ff9640 10 monclient: dump: 2024-09-12T17:57:41.826 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:41.826 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:41.826 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.826 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.827 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:41.827 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.827 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:41.827 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:41.827 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:41.827 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.827 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 monclient: authenticate success, global_id 7173 2024-09-12T17:57:41.827 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:57:41.827 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 4 set_mon_vals no callback set 2024-09-12T17:57:41.827 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: shutdown 2024-09-12T17:57:41.827 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: build_initial_monmap 2024-09-12T17:57:41.827 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 1 build_initial for_mkfs: 0 2024-09-12T17:57:41.827 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: monmap: 2024-09-12T17:57:41.827 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:57:41.828 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:57:41.828 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:57:41.828 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:57:41.828 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:57:41.828 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.828 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:57:41.828 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:57:41.828 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:57:41.828 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.828 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding auth protocol: cephx 2024-09-12T17:57:41.828 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding auth protocol: cephx 2024-09-12T17:57:41.828 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding auth protocol: cephx 2024-09-12T17:57:41.828 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: secure 2024-09-12T17:57:41.829 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: crc 2024-09-12T17:57:41.829 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: secure 2024-09-12T17:57:41.829 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: crc 2024-09-12T17:57:41.829 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: secure 2024-09-12T17:57:41.829 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: crc 2024-09-12T17:57:41.829 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: crc 2024-09-12T17:57:41.829 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: secure 2024-09-12T17:57:41.829 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: crc 2024-09-12T17:57:41.829 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: secure 2024-09-12T17:57:41.829 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: crc 2024-09-12T17:57:41.829 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a5c120) adding con mode: secure 2024-09-12T17:57:41.829 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.829 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 1 librados: starting msgr at 2024-09-12T17:57:41.830 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 1 librados: starting objecter 2024-09-12T17:57:41.830 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c515a14d30 EEXIST 2024-09-12T17:57:41.830 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 1 librados: setting wanted keys 2024-09-12T17:57:41.830 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 1 librados: calling monclient init 2024-09-12T17:57:41.830 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: init 2024-09-12T17:57:41.830 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding auth protocol: cephx 2024-09-12T17:57:41.830 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding auth protocol: cephx 2024-09-12T17:57:41.830 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding auth protocol: cephx 2024-09-12T17:57:41.830 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: secure 2024-09-12T17:57:41.830 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: crc 2024-09-12T17:57:41.830 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: secure 2024-09-12T17:57:41.830 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: crc 2024-09-12T17:57:41.830 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: secure 2024-09-12T17:57:41.831 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: crc 2024-09-12T17:57:41.831 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: crc 2024-09-12T17:57:41.831 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: secure 2024-09-12T17:57:41.831 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: crc 2024-09-12T17:57:41.831 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: secure 2024-09-12T17:57:41.831 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: crc 2024-09-12T17:57:41.831 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 AuthRegistry(0x55c515a17e30) adding con mode: secure 2024-09-12T17:57:41.831 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.831 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.831 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command rotate-key cmddesc rotate-key hook 0x55c515a17f78 EEXIST 2024-09-12T17:57:41.831 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:57:41.831 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:57:41.831 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-c con 0x55c515a5b660 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:57:41.831 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-b con 0x55c515a64f90 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:57:41.832 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): picked mon.noname-a con 0x55c515a69b50 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:57:41.832 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.832 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.832 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:57:41.832 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:57:41.832 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T17:57:41.619+0000 7f253f8fb9c0 10 monclient(hunting): authenticate will time out at 2658.191890s 2024-09-12T17:57:41.832 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T17:57:41.619+0000 7f253d401640 10 monclient(hunting): get_auth_request con 0x55c515a5b660 auth_method 0 2024-09-12T17:57:41.832 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T17:57:41.623+0000 7f253d401640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:41.832 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T17:57:41.623+0000 7f253d401640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:41.832 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T17:57:41.623+0000 7f253d401640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:41.832 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T17:57:41.623+0000 7f253dc02640 10 monclient(hunting): get_auth_request con 0x55c515a69b50 auth_method 0 2024-09-12T17:57:41.832 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T17:57:41.623+0000 7f253dc02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:41.833 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T17:57:41.623+0000 7f253dc02640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:41.833 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T17:57:41.623+0000 7f253dc02640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:41.833 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T17:57:41.623+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:41.833 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T17:57:41.623+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:41.833 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T17:57:41.623+0000 7f253d401640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:41.833 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T17:57:41.623+0000 7f253dc02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:57:41.833 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T17:57:41.623+0000 7f253dc02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:57:41.833 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T17:57:41.623+0000 7f253dc02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:57:41.833 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T17:57:41.623+0000 7f253cc00640 10 monclient(hunting): get_auth_request con 0x55c515a64f90 auth_method 0 2024-09-12T17:57:41.833 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T17:57:41.623+0000 7f253cc00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:57:41.833 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T17:57:41.623+0000 7f253cc00640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:57:41.833 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T17:57:41.623+0000 7f253cc00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:57:41.833 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T17:57:41.623+0000 7f253d401640 10 monclient(hunting): handle_auth_done global_id 6662 payload 824 2024-09-12T17:57:41.834 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T17:57:41.623+0000 7f253d401640 10 monclient: _finish_hunting 0 2024-09-12T17:57:41.834 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T17:57:41.623+0000 7f253d401640 1 monclient: found mon.noname-c 2024-09-12T17:57:41.834 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T17:57:41.623+0000 7f253d401640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:57:41.834 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T17:57:41.623+0000 7f240effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:41.834 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T17:57:41.623+0000 7f240effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:57:41.834 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T17:57:41.623+0000 7f240effd640 10 monclient: dump: 2024-09-12T17:57:41.834 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:41.834 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:41.834 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.834 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.834 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:41.834 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.834 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:41.835 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:41.835 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:41.835 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.835 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T17:57:41.623+0000 7f240effd640 10 monclient: _finish_auth 0 2024-09-12T17:57:41.835 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T17:57:41.623+0000 7f240effd640 10 monclient: _check_auth_tickets 2024-09-12T17:57:41.835 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T17:57:41.623+0000 7f240effd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:57:41.835 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T17:57:41.623+0000 7f240effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:57:41.835 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T17:57:41.623+0000 7f240effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:57:41.835 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T17:57:41.623+0000 7f240effd640 10 monclient: dump: 2024-09-12T17:57:41.835 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:57:41.835 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:57:41.835 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.835 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:57:41.835 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:57:41.836 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:57:41.836 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:57:41.836 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:57:41.836 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:57:41.836 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.836 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 5 monclient: authenticate success, global_id 6662 2024-09-12T17:57:41.836 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 10 monclient: _renew_subs 2024-09-12T17:57:41.836 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:57:41.836 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T17:57:41.623+0000 7f2420ff9640 4 set_mon_vals no callback set 2024-09-12T17:57:41.836 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 10 monclient: _renew_subs 2024-09-12T17:57:41.836 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:57:41.836 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 1 librados: init done 2024-09-12T17:57:41.836 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command cr dump hook 0x55c515a39ce8 2024-09-12T17:57:41.837 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.837 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T17:57:41.623+0000 7f240effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:57:41.837 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T17:57:41.623+0000 7f240effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:41.837 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T17:57:41.623+0000 7f240effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:57:41.837 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T17:57:41.623+0000 7f253cc00640 10 monclient: get_auth_request con 0x7f2408070b10 auth_method 0 2024-09-12T17:57:41.837 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T17:57:41.623+0000 7f253dc02640 10 monclient: get_auth_request con 0x55c515a82fa0 auth_method 0 2024-09-12T17:57:41.837 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.837 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 20 realm 2024-09-12T17:57:41.837 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T17:57:41.623+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.837 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.837 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T17:57:41.627+0000 7f253f8fb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:41.837 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.838 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.838 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.838 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T17:57:41.627+0000 7f253d401640 10 monclient: get_auth_request con 0x55c515a871d0 auth_method 0 2024-09-12T17:57:41.838 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:41.838 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.838 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:41.838 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T17:57:41.627+0000 7f253f8fb9c0 20 searching for the correct realm 2024-09-12T17:57:41.839 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T17:57:41.627+0000 7f253cc00640 10 monclient: get_auth_request con 0x55c515a8c480 auth_method 0 2024-09-12T17:57:41.839 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T17:57:41.627+0000 7f253dc02640 10 monclient: get_auth_request con 0x7f2534038070 auth_method 0 2024-09-12T17:57:41.839 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T17:57:41.631+0000 7f253d401640 10 monclient: get_auth_request con 0x7f25380c6400 auth_method 0 2024-09-12T17:57:41.839 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T17:57:41.631+0000 7f253cc00640 10 monclient: get_auth_request con 0x7f2530070070 auth_method 0 2024-09-12T17:57:41.839 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T17:57:41.635+0000 7f253cc00640 0 -- 172.21.15.98:0/2373793126 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x55c515a8c480 msgr2=0x55c515a8e940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:41.839 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T17:57:41.635+0000 7f240effd640 1 client.6662.objecter ms_handle_reset 0x55c515a8c480 session 0x55c515a8be00 osd.3 2024-09-12T17:57:41.839 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T17:57:41.635+0000 7f240effd640 10 monclient: _renew_subs 2024-09-12T17:57:41.839 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T17:57:41.635+0000 7f240effd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:57:41.839 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T17:57:41.635+0000 7f253cc00640 10 monclient: get_auth_request con 0x7f24080811b0 auth_method 0 2024-09-12T17:57:41.839 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T17:57:41.635+0000 7f253dc02640 10 monclient: get_auth_request con 0x7f2534045b70 auth_method 0 2024-09-12T17:57:41.839 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T17:57:41.639+0000 7f253d401640 10 monclient: get_auth_request con 0x7f253402a920 auth_method 0 2024-09-12T17:57:41.839 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T17:57:41.639+0000 7f253d401640 0 -- 172.21.15.98:0/2373793126 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f253402a920 msgr2=0x7f2534055400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:57:41.839 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T17:57:41.639+0000 7f240effd640 1 client.6662.objecter ms_handle_reset 0x7f253402a920 session 0x7f2534038ea0 osd.0 2024-09-12T17:57:41.839 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T17:57:41.639+0000 7f253d401640 10 monclient: get_auth_request con 0x55c515a8c480 auth_method 0 2024-09-12T17:57:41.840 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:41.840 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:57:41.840 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:41.840 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:57:41.840 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:41.840 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:41.840 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.840 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.840 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.840 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:41.840 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.840 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:41.840 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 zone default found 2024-09-12T17:57:41.841 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 4 Realm: () 2024-09-12T17:57:41.841 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:57:41.841 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:57:41.841 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:41.841 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 zonegroup default 2024-09-12T17:57:41.841 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.841 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.841 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T17:57:41.647+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.841 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T17:57:41.651+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.841 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T17:57:41.651+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.841 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T17:57:41.651+0000 7f253f8fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.841 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T17:57:41.651+0000 7f253f8fb9c0 20 started sync module instance, tier type = 2024-09-12T17:57:41.841 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T17:57:41.651+0000 7f253f8fb9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:57:41.842 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=0 2024-09-12T17:57:41.842 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=1 2024-09-12T17:57:41.842 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=2 2024-09-12T17:57:41.842 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=3 2024-09-12T17:57:41.842 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=4 2024-09-12T17:57:41.842 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=5 2024-09-12T17:57:41.842 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T17:57:41.663+0000 7f253f8fb9c0 20 add_watcher() i=6 2024-09-12T17:57:41.842 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 20 add_watcher() i=7 2024-09-12T17:57:41.842 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:41.842 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding auth protocol: cephx 2024-09-12T17:57:41.842 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding auth protocol: cephx 2024-09-12T17:57:41.842 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding auth protocol: cephx 2024-09-12T17:57:41.842 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: secure 2024-09-12T17:57:41.842 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: crc 2024-09-12T17:57:41.843 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: secure 2024-09-12T17:57:41.843 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: crc 2024-09-12T17:57:41.843 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: secure 2024-09-12T17:57:41.843 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: crc 2024-09-12T17:57:41.843 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: crc 2024-09-12T17:57:41.843 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: secure 2024-09-12T17:57:41.843 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T17:57:41.667+0000 7f23f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:41.843 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: crc 2024-09-12T17:57:41.843 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: secure 2024-09-12T17:57:41.843 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: crc 2024-09-12T17:57:41.843 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 AuthRegistry(0x7ffe0e935a50) adding con mode: secure 2024-09-12T17:57:41.843 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:57:41.843 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:41.844 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:41.844 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command cache list hook 0x55c515a5a1e0 2024-09-12T17:57:41.844 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command cache inspect hook 0x55c515a5a1e0 2024-09-12T17:57:41.844 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command cache erase hook 0x55c515a5a1e0 2024-09-12T17:57:41.844 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command cache zap hook 0x55c515a5a1e0 2024-09-12T17:57:41.844 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 note: GC not initialized 2024-09-12T17:57:41.844 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T17:57:41.667+0000 7f23f27e4640 20 reqs_thread_entry: start 2024-09-12T17:57:41.844 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command sync trace show hook 0x7f2534015750 2024-09-12T17:57:41.844 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command sync trace history hook 0x7f2534015750 2024-09-12T17:57:41.844 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command sync trace active hook 0x7f2534015750 2024-09-12T17:57:41.844 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 5 asok(0x55c51578f2b0) register_command sync trace active_short hook 0x7f2534015750 2024-09-12T17:57:41.844 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T17:57:41.667+0000 7f253f8fb9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:41.844 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 20 Filter name: none 2024-09-12T17:57:41.845 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T17:57:41.671+0000 7f2363fff640 20 reqs_thread_entry: start 2024-09-12T17:57:41.845 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:57:41.845 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.845 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:57:41.845 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:57:41.845 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:57:41.845 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 : miss 2024-09-12T17:57:41.845 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.845 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:57:41.845 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:57:41.845 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:57:41.845 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:41.845 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:41.846 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T17:57:41.671+0000 7f253f8fb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 2024-09-12T17:57:41.846 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T17:57:41.679+0000 7f253f8fb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:57:41.846 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T17:57:41.679+0000 7f253f8fb9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:57:41.846 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T17:57:41.679+0000 7f253f8fb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:41.846 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T17:57:41.679+0000 7f253f8fb9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29, ofs0, ns] 2024-09-12T17:57:41.846 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T17:57:41.683+0000 7f2420ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366168 cookie 94304960329344 notifier 6662 bl.length()=915 2024-09-12T17:57:41.846 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T17:57:41.683+0000 7f2420ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:57:41.846 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T17:57:41.683+0000 7f2420ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:57:41.846 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T17:57:41.683+0000 7f2420ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:41.846 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T17:57:41.683+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): orig_sources= new_sources= 2024-09-12T17:57:41.846 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T17:57:41.683+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): potential sources added=[] removed=[] 2024-09-12T17:57:41.846 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T17:57:41.683+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): orig_dests= new_dests= 2024-09-12T17:57:41.846 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T17:57:41.683+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): potential dests added=[] removed=[] 2024-09-12T17:57:41.847 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.0 2024-09-12T17:57:41.847 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.0 2024-09-12T17:57:41.847 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.1 2024-09-12T17:57:41.847 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.1 2024-09-12T17:57:41.847 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.2 2024-09-12T17:57:41.847 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.2 2024-09-12T17:57:41.847 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.3 2024-09-12T17:57:41.847 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.3 2024-09-12T17:57:41.847 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.4 2024-09-12T17:57:41.847 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.4 2024-09-12T17:57:41.847 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.5 2024-09-12T17:57:41.847 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.5 2024-09-12T17:57:41.847 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.6 2024-09-12T17:57:41.848 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.6 2024-09-12T17:57:41.848 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.7 2024-09-12T17:57:41.848 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.7 2024-09-12T17:57:41.848 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.8 2024-09-12T17:57:41.848 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.8 2024-09-12T17:57:41.848 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.9 2024-09-12T17:57:41.848 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.9 2024-09-12T17:57:41.848 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.10 2024-09-12T17:57:41.848 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.10 2024-09-12T17:57:41.848 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.11 2024-09-12T17:57:41.848 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1.11 2024-09-12T17:57:41.848 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.0 2024-09-12T17:57:41.848 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1 2024-09-12T17:57:41.849 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2 2024-09-12T17:57:41.849 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.3 2024-09-12T17:57:41.849 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T17:57:41.695+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.4 2024-09-12T17:57:41.849 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T17:57:41.699+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.5 2024-09-12T17:57:41.849 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T17:57:41.699+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.6 2024-09-12T17:57:41.849 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T17:57:41.699+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.7 2024-09-12T17:57:41.849 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T17:57:41.699+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.8 2024-09-12T17:57:41.849 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T17:57:41.703+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.9 2024-09-12T17:57:41.849 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T17:57:41.703+0000 7f253f8fb9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.10 2024-09-12T17:57:41.849 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T17:57:41.711+0000 7f253f8fb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:57:41.849 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T17:57:41.711+0000 7f253f8fb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 2024-09-12T17:57:41.849 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T17:57:41.711+0000 7f253f8fb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:57:41.849 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T17:57:41.711+0000 7f253f8fb9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:57:41.849 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T17:57:41.711+0000 7f253f8fb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:41.850 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T17:57:41.711+0000 7f253f8fb9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29, ofs0, ns] 2024-09-12T17:57:41.850 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T17:57:41.715+0000 7f2420ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366169 cookie 94304960329344 notifier 6662 bl.length()=915 2024-09-12T17:57:41.850 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T17:57:41.715+0000 7f2420ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:57:41.850 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T17:57:41.715+0000 7f2420ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:57:41.850 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T17:57:41.715+0000 7f2420ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:41.850 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T17:57:41.715+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): orig_sources= new_sources= 2024-09-12T17:57:41.850 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T17:57:41.715+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): potential sources added=[] removed=[] 2024-09-12T17:57:41.850 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T17:57:41.715+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): orig_dests= new_dests= 2024-09-12T17:57:41.850 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T17:57:41.715+0000 7f253f8fb9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): potential dests added=[] removed=[] 2024-09-12T17:57:41.850 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T17:57:41.715+0000 7f253f8fb9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f253f8fb9c0 time 2024-09-12T17:57:41.718360+0000 2024-09-12T17:57:41.850 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:57:41.850 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.850 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:41.851 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f25431d52eb] 2024-09-12T17:57:41.851 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f25431d549f] 2024-09-12T17:57:41.851 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5132370c1] 2024-09-12T17:57:41.851 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55c51324855b] 2024-09-12T17:57:41.851 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c513249b44] 2024-09-12T17:57:41.851 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T17:57:41.851 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f254203bd90] 2024-09-12T17:57:41.851 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T17:57:41.851 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T17:57:41.851 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.851 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T17:57:41.719+0000 7f253f8fb9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:57:41.851 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f253f8fb9c0 thread_name:radosgw-admin 2024-09-12T17:57:41.851 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.851 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:57:41.852 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2542054520] 2024-09-12T17:57:41.852 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:57:41.852 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:57:41.852 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:57:41.852 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f25431d5345] 2024-09-12T17:57:41.852 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f25431d549f] 2024-09-12T17:57:41.852 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c5132370c1] 2024-09-12T17:57:41.852 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x55c51324855b] 2024-09-12T17:57:41.852 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55c513249b44] 2024-09-12T17:57:41.852 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T17:57:41.852 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f254203bd90] 2024-09-12T17:57:41.852 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T17:57:41.852 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T17:57:41.853 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:57:41.853 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:41.853 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T17:57:41.853 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T17:57:41.853 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T17:57:41.853 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T17:57:41.853 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T17:57:41.853 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T17:57:41.853 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T17:57:41.853 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T17:57:41.853 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T17:57:41.853 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T17:57:41.853 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T17:57:41.854 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T17:57:41.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T17:57:41.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T17:57:41.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T17:57:41.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T17:57:41.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T17:57:41.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T17:57:41.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T17:57:41.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T17:57:41.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T17:57:41.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T17:57:41.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T17:57:41.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T17:57:41.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:57:41.855 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T17:57:41.855 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T17:57:41.855 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T17:57:41.855 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T17:57:41.855 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T17:57:41.855 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T17:57:41.855 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T17:57:41.855 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T17:57:41.855 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T17:57:41.855 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T17:57:41.855 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T17:57:41.855 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T17:57:41.855 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T17:57:41.855 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T17:57:41.856 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T17:57:41.856 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T17:57:41.856 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T17:57:41.856 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T17:57:41.856 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T17:57:41.856 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T17:57:41.856 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T17:57:41.856 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:57:41.856 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T17:57:41.856 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:57:41.856 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T17:57:41.856 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T17:57:41.856 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T17:57:41.856 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T17:57:41.857 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T17:57:41.857 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T17:57:41.857 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T17:57:41.857 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T17:57:41.857 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T17:57:41.857 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T17:57:41.857 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T17:57:41.857 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T17:57:41.857 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T17:57:41.857 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T17:57:41.857 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T17:57:41.857 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T17:57:41.857 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T17:57:41.857 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T17:57:41.858 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:57:41.858 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T17:57:41.858 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:57:41.858 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T17:57:41.858 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T17:57:41.858 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T17:57:41.858 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T17:57:41.858 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T17:57:41.858 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T17:57:41.858 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:57:41.858 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T17:57:41.858 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T17:57:41.858 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:57:41.858 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T17:57:41.858 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T17:57:41.858 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T17:57:41.859 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T17:57:41.859 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T17:57:41.859 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T17:57:41.859 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T17:57:41.859 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T17:57:41.859 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T17:57:41.859 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T17:57:41.859 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T17:57:41.859 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T17:57:41.859 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T17:57:41.859 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:57:41.859 INFO:tasks.workunit.client.0.smithi098.stderr: 7f2363fff640 / http_manager 2024-09-12T17:57:41.859 INFO:tasks.workunit.client.0.smithi098.stderr: 7f23f27e4640 / http_manager 2024-09-12T17:57:41.859 INFO:tasks.workunit.client.0.smithi098.stderr: 7f23f37e6640 / rgw_dt_lg_renew 2024-09-12T17:57:41.859 INFO:tasks.workunit.client.0.smithi098.stderr: 7f240effd640 / ms_dispatch 2024-09-12T17:57:41.860 INFO:tasks.workunit.client.0.smithi098.stderr: 7f2420ff9640 / io_context_pool 2024-09-12T17:57:41.860 INFO:tasks.workunit.client.0.smithi098.stderr: 7f2422ffd640 / ms_dispatch 2024-09-12T17:57:41.860 INFO:tasks.workunit.client.0.smithi098.stderr: 7f2429e03640 / ms_dispatch 2024-09-12T17:57:41.860 INFO:tasks.workunit.client.0.smithi098.stderr: 7f242b606640 / io_context_pool 2024-09-12T17:57:41.860 INFO:tasks.workunit.client.0.smithi098.stderr: 7f253cc00640 / msgr-worker-2 2024-09-12T17:57:41.860 INFO:tasks.workunit.client.0.smithi098.stderr: 7f253d401640 / msgr-worker-1 2024-09-12T17:57:41.860 INFO:tasks.workunit.client.0.smithi098.stderr: 7f253dc02640 / msgr-worker-0 2024-09-12T17:57:41.860 INFO:tasks.workunit.client.0.smithi098.stderr: 7f253e403640 / io_context_pool 2024-09-12T17:57:41.860 INFO:tasks.workunit.client.0.smithi098.stderr: 7f253f8fb9c0 / radosgw-admin 2024-09-12T17:57:41.860 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T17:57:41.860 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T17:57:41.860 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:57:41.721121Z_04e1ebbb-e1a6-4c39-80c1-4840b66183f3/log 2024-09-12T17:57:41.860 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T17:57:41.861 INFO:tasks.workunit.client.0.smithi098.stderr:Aborted 2024-09-12T17:57:41.861 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:57:41.862 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:41.862 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:41.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.795+0000 7fac33e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.799+0000 7fac33e989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.799+0000 7fac33e989c0 20 realm 2024-09-12T17:57:41.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.799+0000 7fac33e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.799+0000 7fac33e989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.799+0000 7fac33e989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:41.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.799+0000 7fac33e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.799+0000 7fac33e989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:41.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.799+0000 7fac33e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.799+0000 7fac33e989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:41.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.799+0000 7fac33e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:41.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.803+0000 7fac33e989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:41.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.803+0000 7fac33e989c0 20 searching for the correct realm 2024-09-12T17:57:41.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:41.807+0000 7fac3219f640 0 -- 172.21.15.98:0/3459687342 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7fac28049920 msgr2=0x7fac28071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:42.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.023+0000 7fac3199e640 0 -- 172.21.15.98:0/3459687342 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x556674bf7330 msgr2=0x556674bf97c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:42.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:42.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:57:42.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:42.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:57:42.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:42.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:42.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:42.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:42.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:42.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 20 zone default found 2024-09-12T17:57:42.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 4 Realm: () 2024-09-12T17:57:42.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:57:42.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:57:42.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:42.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 20 zonegroup default 2024-09-12T17:57:42.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:42.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.031+0000 7fac33e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.035+0000 7fac33e989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:42.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.035+0000 7fac33e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.035+0000 7fac33e989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:42.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.035+0000 7fac33e989c0 20 started sync module instance, tier type = 2024-09-12T17:57:42.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.035+0000 7fac33e989c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:57:42.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.059+0000 7fac33e989c0 20 add_watcher() i=0 2024-09-12T17:57:42.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.059+0000 7fac33e989c0 20 add_watcher() i=1 2024-09-12T17:57:42.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.059+0000 7fac33e989c0 20 add_watcher() i=2 2024-09-12T17:57:42.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.059+0000 7fac33e989c0 20 add_watcher() i=3 2024-09-12T17:57:42.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.059+0000 7fac33e989c0 20 add_watcher() i=4 2024-09-12T17:57:42.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.059+0000 7fac33e989c0 20 add_watcher() i=5 2024-09-12T17:57:42.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.059+0000 7fac33e989c0 20 add_watcher() i=6 2024-09-12T17:57:42.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.063+0000 7fac33e989c0 20 add_watcher() i=7 2024-09-12T17:57:42.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.063+0000 7fac33e989c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:42.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.067+0000 7faae37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:42.068 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.067+0000 7fac33e989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:42.069 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.067+0000 7fac33e989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:42.069 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.067+0000 7fac33e989c0 5 note: GC not initialized 2024-09-12T17:57:42.069 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.067+0000 7faae27fc640 20 reqs_thread_entry: start 2024-09-12T17:57:42.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.067+0000 7fac33e989c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:42.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.067+0000 7fac33e989c0 20 Filter name: none 2024-09-12T17:57:42.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.067+0000 7faa53fff640 20 reqs_thread_entry: start 2024-09-12T17:57:42.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.067+0000 7fac33e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.067+0000 7fac33e989c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:57:42.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.067+0000 7fac33e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.071+0000 7fac33e989c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:57:42.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.071+0000 7fac33e989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:42.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.071+0000 7fac33e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.071+0000 7fac33e989c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:57:42.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.071+0000 7fac33e989c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.071+0000 7fac33e989c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:57:42.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.071+0000 7fac33e989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:57:42.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.075+0000 7faae37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:42.082 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.079+0000 7fac33e989c0 20 remove_watcher() i=0 2024-09-12T17:57:42.082 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.079+0000 7fac33e989c0 2 removed watcher, disabling cache 2024-09-12T17:57:42.084 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.083+0000 7fac33e989c0 20 remove_watcher() i=1 2024-09-12T17:57:42.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.087+0000 7fac33e989c0 20 remove_watcher() i=2 2024-09-12T17:57:42.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.087+0000 7fac33e989c0 20 remove_watcher() i=3 2024-09-12T17:57:42.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.091+0000 7fac33e989c0 20 remove_watcher() i=4 2024-09-12T17:57:42.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.091+0000 7fac33e989c0 20 remove_watcher() i=5 2024-09-12T17:57:42.095 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.095+0000 7fac33e989c0 20 remove_watcher() i=6 2024-09-12T17:57:42.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.095+0000 7fac33e989c0 20 remove_watcher() i=7 2024-09-12T17:57:42.121 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:42.121 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:57:42.121 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-block-writes id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:57:42.121 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:57:42.123 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:42.124 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:42.176 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:57:42.176 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:57:42.240 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:57:42.276 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:57:42.276 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:57:42.322 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.319+0000 7f6dcecd39c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.323 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.323+0000 7f6dcecd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:42.323 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.323+0000 7f6dcecd39c0 20 realm 2024-09-12T17:57:42.323 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.323+0000 7f6dcecd39c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.323 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.323+0000 7f6dcecd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:42.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.323+0000 7f6dcecd39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:57:42.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.323+0000 7f6dcecd39c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.323+0000 7f6dcecd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:42.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.323+0000 7f6dcecd39c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.323+0000 7f6dcecd39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:42.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.323+0000 7f6dcecd39c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.323+0000 7f6dcecd39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:57:42.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.323+0000 7f6dcecd39c0 20 searching for the correct realm 2024-09-12T17:57:42.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.331+0000 7f6dccfda640 0 -- 172.21.15.98:0/2937773274 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f6db40c32e0 msgr2=0x7f6db40c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:57:42.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.547+0000 7f6dcc7d9640 0 -- 172.21.15.98:0/2937773274 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x55f2db051d50 msgr2=0x55f2db054140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:57:42.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.555+0000 7f6dcecd39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:57:42.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.555+0000 7f6dcecd39c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:57:42.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.555+0000 7f6dcecd39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:57:42.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.555+0000 7f6dcecd39c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:57:42.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.555+0000 7f6dcecd39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:57:42.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.555+0000 7f6dcecd39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:57:42.556 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.555+0000 7f6dcecd39c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.557 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.555+0000 7f6dcecd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:42.557 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.555+0000 7f6dcecd39c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.557 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.555+0000 7f6dcecd39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:57:42.557 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.555+0000 7f6dcecd39c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.558 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.559+0000 7f6dcecd39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:57:42.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.559+0000 7f6dcecd39c0 20 zone default found 2024-09-12T17:57:42.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.559+0000 7f6dcecd39c0 4 Realm: () 2024-09-12T17:57:42.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.559+0000 7f6dcecd39c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:57:42.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.559+0000 7f6dcecd39c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:57:42.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.559+0000 7f6dcecd39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:57:42.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.559+0000 7f6dcecd39c0 20 zonegroup default 2024-09-12T17:57:42.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.559+0000 7f6dcecd39c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.559+0000 7f6dcecd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:42.559 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.559+0000 7f6dcecd39c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.559+0000 7f6dcecd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:42.560 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.559+0000 7f6dcecd39c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.559+0000 7f6dcecd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:57:42.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.559+0000 7f6dcecd39c0 20 started sync module instance, tier type = 2024-09-12T17:57:42.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.559+0000 7f6dcecd39c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:57:42.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.583+0000 7f6dcecd39c0 20 add_watcher() i=0 2024-09-12T17:57:42.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.583+0000 7f6dcecd39c0 20 add_watcher() i=1 2024-09-12T17:57:42.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.583+0000 7f6dcecd39c0 20 add_watcher() i=2 2024-09-12T17:57:42.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.583+0000 7f6dcecd39c0 20 add_watcher() i=3 2024-09-12T17:57:42.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.583+0000 7f6dcecd39c0 20 add_watcher() i=4 2024-09-12T17:57:42.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.583+0000 7f6dcecd39c0 20 add_watcher() i=5 2024-09-12T17:57:42.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.583+0000 7f6dcecd39c0 20 add_watcher() i=6 2024-09-12T17:57:42.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.587+0000 7f6dcecd39c0 20 add_watcher() i=7 2024-09-12T17:57:42.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.587+0000 7f6dcecd39c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:57:42.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.591+0000 7f6c82fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:42.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.591+0000 7f6dcecd39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:57:42.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.591+0000 7f6dcecd39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:57:42.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.591+0000 7f6dcecd39c0 5 note: GC not initialized 2024-09-12T17:57:42.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.591+0000 7f6c81fdb640 20 reqs_thread_entry: start 2024-09-12T17:57:42.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.591+0000 7f6dcecd39c0 20 init_complete bucket index max shards: 11 2024-09-12T17:57:42.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.591+0000 7f6dcecd39c0 20 Filter name: none 2024-09-12T17:57:42.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.591+0000 7f6bf37fe640 20 reqs_thread_entry: start 2024-09-12T17:57:42.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.591+0000 7f6dcecd39c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:57:42.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.591+0000 7f6dcecd39c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.591+0000 7f6dcecd39c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:57:42.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.591+0000 7f6dcecd39c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:57:42.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.591+0000 7f6dcecd39c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:57:42.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.591+0000 7f6dcecd39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 : miss 2024-09-12T17:57:42.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.591+0000 7f6dcecd39c0 20 rados->read ofs=0 len=0 2024-09-12T17:57:42.595 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.595+0000 7f6dcecd39c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:57:42.595 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.595+0000 7f6dcecd39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:57:42.595 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.595+0000 7f6dcecd39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:57:42.596 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.595+0000 7f6dcecd39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:57:42.596 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.595+0000 7f6dcecd39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:57:42.596 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.595+0000 7f6dcecd39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 2024-09-12T17:57:42.598 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.595+0000 7f6dcecd39c0 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to be held by another RGW process; skipping for now 2024-09-12T17:57:42.600 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.599+0000 7f6c82fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:57:42.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.603+0000 7f6dcecd39c0 20 remove_watcher() i=0 2024-09-12T17:57:42.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.603+0000 7f6dcecd39c0 2 removed watcher, disabling cache 2024-09-12T17:57:42.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.607+0000 7f6dcecd39c0 20 remove_watcher() i=1 2024-09-12T17:57:42.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.607+0000 7f6dcecd39c0 20 remove_watcher() i=2 2024-09-12T17:57:42.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.611+0000 7f6dcecd39c0 20 remove_watcher() i=3 2024-09-12T17:57:42.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.611+0000 7f6dcecd39c0 20 remove_watcher() i=4 2024-09-12T17:57:42.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.615+0000 7f6dcecd39c0 20 remove_watcher() i=5 2024-09-12T17:57:42.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.615+0000 7f6dcecd39c0 20 remove_watcher() i=6 2024-09-12T17:57:42.619 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:57:42.619+0000 7f6dcecd39c0 20 remove_watcher() i=7 2024-09-12T17:57:42.634 INFO:tasks.workunit.client.0.smithi098.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:58:12.666 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:58:12.701 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:12.701 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:12.746 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.743+0000 7fbfa84639c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:12.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.747+0000 7fbfa84639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:12.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.747+0000 7fbfa84639c0 20 realm 2024-09-12T17:58:12.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.747+0000 7fbfa84639c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:12.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.747+0000 7fbfa84639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:12.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.747+0000 7fbfa84639c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:12.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.747+0000 7fbfa84639c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:12.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.747+0000 7fbfa84639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:12.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.747+0000 7fbfa84639c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:12.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.747+0000 7fbfa84639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:12.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.747+0000 7fbfa84639c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:12.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.751+0000 7fbfa84639c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:12.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.751+0000 7fbfa84639c0 20 searching for the correct realm 2024-09-12T17:58:12.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.755+0000 7fbfa5768640 0 -- 172.21.15.98:0/3998089001 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fbf980fdd70 msgr2=0x7fbf980fc7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:12.763 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.763+0000 7fbfa676a640 0 -- 172.21.15.98:0/3998089001 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7fbf9c017070 msgr2=0x7fbf9c08a8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:58:12.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:12.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:58:12.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:12.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:58:12.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:12.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:12.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:12.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:12.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:12.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:12.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:12.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:12.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 zone default found 2024-09-12T17:58:12.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 4 Realm: () 2024-09-12T17:58:12.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:58:12.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:58:12.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:12.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 zonegroup default 2024-09-12T17:58:12.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:12.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:12.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:12.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:12.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:12.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:12.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 started sync module instance, tier type = 2024-09-12T17:58:12.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.771+0000 7fbfa84639c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:58:12.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.787+0000 7fbfa84639c0 20 add_watcher() i=0 2024-09-12T17:58:12.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.787+0000 7fbfa84639c0 20 add_watcher() i=1 2024-09-12T17:58:12.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.787+0000 7fbfa84639c0 20 add_watcher() i=2 2024-09-12T17:58:12.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.787+0000 7fbfa84639c0 20 add_watcher() i=3 2024-09-12T17:58:12.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.787+0000 7fbfa84639c0 20 add_watcher() i=4 2024-09-12T17:58:12.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.787+0000 7fbfa84639c0 20 add_watcher() i=5 2024-09-12T17:58:12.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.787+0000 7fbfa84639c0 20 add_watcher() i=6 2024-09-12T17:58:12.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.791+0000 7fbfa84639c0 20 add_watcher() i=7 2024-09-12T17:58:12.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.791+0000 7fbfa84639c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:12.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.791+0000 7fbe577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:12.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.791+0000 7fbfa84639c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:12.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.791+0000 7fbfa84639c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:12.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.791+0000 7fbfa84639c0 5 note: GC not initialized 2024-09-12T17:58:12.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.795+0000 7fbe567fc640 20 reqs_thread_entry: start 2024-09-12T17:58:12.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.795+0000 7fbfa84639c0 20 init_complete bucket index max shards: 11 2024-09-12T17:58:12.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.795+0000 7fbfa84639c0 20 Filter name: none 2024-09-12T17:58:12.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.795+0000 7fbdc7fff640 20 reqs_thread_entry: start 2024-09-12T17:58:12.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.795+0000 7fbfa84639c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T17:58:12.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.795+0000 7fbfa84639c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:12.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.795+0000 7fbfa84639c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:58:12.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.795+0000 7fbfa84639c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T17:58:12.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.795+0000 7fbfa84639c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T17:58:12.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.795+0000 7fbfa84639c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 : miss 2024-09-12T17:58:12.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.795+0000 7fbfa84639c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:12.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.795+0000 7fbfa84639c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T17:58:12.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.795+0000 7fbfa84639c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:58:12.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.795+0000 7fbfa84639c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:58:12.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.795+0000 7fbfa84639c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:12.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.795+0000 7fbfa84639c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:12.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.795+0000 7fbfa84639c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 2024-09-12T17:58:12.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.795+0000 7fbfa84639c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:58:12.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.811+0000 7fbfa84639c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:58:12.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.811+0000 7fbfa84639c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:58:12.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.811+0000 7fbfa84639c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:12.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.811+0000 7fbfa84639c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29, ofs0, ns] 2024-09-12T17:58:12.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.811+0000 7fbe88ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366170 cookie 93855495722672 notifier 7236 bl.length()=915 2024-09-12T17:58:12.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.811+0000 7fbe88ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:58:12.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.811+0000 7fbe88ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:58:12.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.811+0000 7fbe88ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:12.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.815+0000 7fbfa84639c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): orig_sources= new_sources= 2024-09-12T17:58:12.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.815+0000 7fbfa84639c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): potential sources added=[] removed=[] 2024-09-12T17:58:12.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.815+0000 7fbfa84639c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): orig_dests= new_dests= 2024-09-12T17:58:12.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.815+0000 7fbfa84639c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): potential dests added=[] removed=[] 2024-09-12T17:58:12.824 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.0 2024-09-12T17:58:12.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.0 2024-09-12T17:58:12.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.1 2024-09-12T17:58:12.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.1 2024-09-12T17:58:12.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.2 2024-09-12T17:58:12.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.2 2024-09-12T17:58:12.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.3 2024-09-12T17:58:12.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.3 2024-09-12T17:58:12.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.4 2024-09-12T17:58:12.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.4 2024-09-12T17:58:12.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.5 2024-09-12T17:58:12.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.5 2024-09-12T17:58:12.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.6 2024-09-12T17:58:12.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.6 2024-09-12T17:58:12.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.7 2024-09-12T17:58:12.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.7 2024-09-12T17:58:12.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.8 2024-09-12T17:58:12.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.8 2024-09-12T17:58:12.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.9 2024-09-12T17:58:12.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.9 2024-09-12T17:58:12.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.10 2024-09-12T17:58:12.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.10 2024-09-12T17:58:12.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.11 2024-09-12T17:58:12.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2.11 2024-09-12T17:58:12.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.0 2024-09-12T17:58:12.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1 2024-09-12T17:58:12.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.823+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2 2024-09-12T17:58:12.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.827+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.3 2024-09-12T17:58:12.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.827+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.4 2024-09-12T17:58:12.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.827+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.5 2024-09-12T17:58:12.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.827+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.6 2024-09-12T17:58:12.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.831+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.7 2024-09-12T17:58:12.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.831+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.8 2024-09-12T17:58:12.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.831+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.9 2024-09-12T17:58:12.835 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.835+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.10 2024-09-12T17:58:12.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.843+0000 7fbfa84639c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:58:12.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.843+0000 7fbfa84639c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 2024-09-12T17:58:12.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.843+0000 7fbfa84639c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:58:12.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.843+0000 7fbfa84639c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:58:12.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.843+0000 7fbfa84639c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:12.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.843+0000 7fbfa84639c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29, ofs0, ns] 2024-09-12T17:58:12.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.847+0000 7fbe897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366171 cookie 93855495722672 notifier 7236 bl.length()=915 2024-09-12T17:58:12.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.847+0000 7fbe897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:58:12.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.847+0000 7fbe897fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:58:12.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.847+0000 7fbe897fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:12.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.847+0000 7fbfa84639c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): orig_sources= new_sources= 2024-09-12T17:58:12.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.847+0000 7fbfa84639c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): potential sources added=[] removed=[] 2024-09-12T17:58:12.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.847+0000 7fbfa84639c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): orig_dests= new_dests= 2024-09-12T17:58:12.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.847+0000 7fbfa84639c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): potential dests added=[] removed=[] 2024-09-12T17:58:12.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.851+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.0 2024-09-12T17:58:12.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.855+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.1 2024-09-12T17:58:12.855 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.855+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.2 2024-09-12T17:58:12.855 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.855+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.3 2024-09-12T17:58:12.856 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.855+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.4 2024-09-12T17:58:12.856 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.855+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.5 2024-09-12T17:58:12.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.855+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.6 2024-09-12T17:58:12.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.855+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.7 2024-09-12T17:58:12.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.859+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.8 2024-09-12T17:58:12.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.859+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.9 2024-09-12T17:58:12.860 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.859+0000 7fbfa84639c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.29.10 2024-09-12T17:58:12.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.859+0000 7fbfa84639c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 : hit (requested=0x17, cached=0x17) 2024-09-12T17:58:12.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.859+0000 7fbfa84639c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 2024-09-12T17:58:12.865 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.863+0000 7fbfa84639c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:58:12.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.863+0000 7fbfa84639c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:58:12.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.863+0000 7fbfa84639c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:12.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.863+0000 7fbfa84639c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29, ofs0, ns] 2024-09-12T17:58:12.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.863+0000 7fbe897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366172 cookie 93855495722672 notifier 7236 bl.length()=883 2024-09-12T17:58:12.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.863+0000 7fbe897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 info.flags=0x17 2024-09-12T17:58:12.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.863+0000 7fbe897fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 to cache LRU end 2024-09-12T17:58:12.866 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.863+0000 7fbe897fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:12.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.867+0000 7fbfa84639c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): orig_sources= new_sources= 2024-09-12T17:58:12.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.867+0000 7fbfa84639c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): potential sources added=[] removed=[] 2024-09-12T17:58:12.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.867+0000 7fbfa84639c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): orig_dests= new_dests= 2024-09-12T17:58:12.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.867+0000 7fbfa84639c0 20 handle_bi_update(): bucket=:abort-at-block-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.29]): potential dests added=[] removed=[] 2024-09-12T17:58:12.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.871+0000 7fbfa84639c0 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:58:12.876 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.875+0000 7fbe577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:12.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.879+0000 7fbfa84639c0 20 remove_watcher() i=0 2024-09-12T17:58:12.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.879+0000 7fbfa84639c0 2 removed watcher, disabling cache 2024-09-12T17:58:12.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.883+0000 7fbfa84639c0 20 remove_watcher() i=1 2024-09-12T17:58:12.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.883+0000 7fbfa84639c0 20 remove_watcher() i=2 2024-09-12T17:58:12.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.887+0000 7fbfa84639c0 20 remove_watcher() i=3 2024-09-12T17:58:12.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.887+0000 7fbfa84639c0 20 remove_watcher() i=4 2024-09-12T17:58:12.890 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.891+0000 7fbfa84639c0 20 remove_watcher() i=5 2024-09-12T17:58:12.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.891+0000 7fbfa84639c0 20 remove_watcher() i=6 2024-09-12T17:58:12.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.891+0000 7fbfa84639c0 20 remove_watcher() i=7 2024-09-12T17:58:12.909 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T17:58:12.938 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:12.938 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:12.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.979+0000 7f6039a919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:12.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.983+0000 7f6039a919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:12.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.983+0000 7f6039a919c0 20 realm 2024-09-12T17:58:12.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.983+0000 7f6039a919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:12.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.983+0000 7f6039a919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:12.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.983+0000 7f6039a919c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:12.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.983+0000 7f6039a919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:12.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.983+0000 7f6039a919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:12.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.983+0000 7f6039a919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:12.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.983+0000 7f6039a919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:12.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.983+0000 7f6039a919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:12.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.983+0000 7f6039a919c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:12.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.983+0000 7f6039a919c0 20 searching for the correct realm 2024-09-12T17:58:12.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.991+0000 7f6036d96640 0 -- 172.21.15.98:0/391061774 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f60280de050 msgr2=0x7f60280ed410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:12.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:12.999+0000 7f6037d98640 0 -- 172.21.15.98:0/391061774 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f602c08ab30 msgr2=0x7f602c072a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:13.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:13.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:58:13.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:13.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:58:13.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:13.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:13.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:13.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:13.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:13.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:13.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:13.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:13.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 20 zone default found 2024-09-12T17:58:13.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 4 Realm: () 2024-09-12T17:58:13.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:58:13.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:58:13.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:13.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 20 zonegroup default 2024-09-12T17:58:13.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:13.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:13.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.003+0000 7f6039a919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:13.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.007+0000 7f6039a919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:13.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.007+0000 7f6039a919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:13.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.007+0000 7f6039a919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:13.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.007+0000 7f6039a919c0 20 started sync module instance, tier type = 2024-09-12T17:58:13.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.007+0000 7f6039a919c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:58:13.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.023+0000 7f6039a919c0 20 add_watcher() i=0 2024-09-12T17:58:13.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.023+0000 7f6039a919c0 20 add_watcher() i=1 2024-09-12T17:58:13.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.023+0000 7f6039a919c0 20 add_watcher() i=2 2024-09-12T17:58:13.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.023+0000 7f6039a919c0 20 add_watcher() i=3 2024-09-12T17:58:13.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.023+0000 7f6039a919c0 20 add_watcher() i=4 2024-09-12T17:58:13.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.023+0000 7f6039a919c0 20 add_watcher() i=5 2024-09-12T17:58:13.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.023+0000 7f6039a919c0 20 add_watcher() i=6 2024-09-12T17:58:13.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.023+0000 7f6039a919c0 20 add_watcher() i=7 2024-09-12T17:58:13.024 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.023+0000 7f6039a919c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:13.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.027+0000 7f5eedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:13.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.027+0000 7f6039a919c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:13.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.027+0000 7f6039a919c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:13.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.027+0000 7f6039a919c0 5 note: GC not initialized 2024-09-12T17:58:13.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.027+0000 7f5eecfe1640 20 reqs_thread_entry: start 2024-09-12T17:58:13.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.027+0000 7f6039a919c0 20 init_complete bucket index max shards: 11 2024-09-12T17:58:13.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.027+0000 7f6039a919c0 20 Filter name: none 2024-09-12T17:58:13.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.027+0000 7f5e667fc640 20 reqs_thread_entry: start 2024-09-12T17:58:13.029 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.027+0000 7f6039a919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:13.029 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.027+0000 7f6039a919c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:58:13.029 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.027+0000 7f6039a919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:13.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.031+0000 7f6039a919c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:58:13.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.031+0000 7f6039a919c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:13.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.031+0000 7f6039a919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:13.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.031+0000 7f6039a919c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T17:58:13.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.031+0000 7f6039a919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:13.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.031+0000 7f6039a919c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T17:58:13.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.031+0000 7f6039a919c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:13.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.035+0000 7f5eedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:13.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.039+0000 7f6039a919c0 20 remove_watcher() i=0 2024-09-12T17:58:13.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.039+0000 7f6039a919c0 2 removed watcher, disabling cache 2024-09-12T17:58:13.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.043+0000 7f6039a919c0 20 remove_watcher() i=1 2024-09-12T17:58:13.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.043+0000 7f6039a919c0 20 remove_watcher() i=2 2024-09-12T17:58:13.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.047+0000 7f6039a919c0 20 remove_watcher() i=3 2024-09-12T17:58:13.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.047+0000 7f6039a919c0 20 remove_watcher() i=4 2024-09-12T17:58:13.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.051+0000 7f6039a919c0 20 remove_watcher() i=5 2024-09-12T17:58:13.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.051+0000 7f6039a919c0 20 remove_watcher() i=6 2024-09-12T17:58:13.053 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:13.051+0000 7f6039a919c0 20 remove_watcher() i=7 2024-09-12T17:58:13.066 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:13.067 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:58:13.067 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-block-writes id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:58:13.067 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:13.068 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:13.068 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:13.090 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:13.090 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:13.593 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:13.593 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:14.199 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T17:58:14.200 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:14.203 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:14.203 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:14.335 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:14.335 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:14.423 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:14.424 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:14.528 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:14.528 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:14.621 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:14.622 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:14.720 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:14.721 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:14.828 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:14.829 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:14.928 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:14.928 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:15.030 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:15.030 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:15.123 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:15.123 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:15.219 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:15.219 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:15.317 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:15.317 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:15.416 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:15.417 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:15.513 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:15.513 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:15.610 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:15.611 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:15.705 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:15.706 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:15.805 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:15.805 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:15.903 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:15.903 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:15.999 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:15.999 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:16.093 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:16.094 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:16.192 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:16.193 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:16.279 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:16.279 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:16.375 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:58:16.408 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:16.408 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:16.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.451+0000 7f59391239c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.451+0000 7f59391239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.451+0000 7f59391239c0 20 realm 2024-09-12T17:58:16.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.451+0000 7f59391239c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.451+0000 7f59391239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.451+0000 7f59391239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:16.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.451+0000 7f59391239c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.455+0000 7f59391239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.455+0000 7f59391239c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.455+0000 7f59391239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:16.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.455+0000 7f59391239c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.455+0000 7f59391239c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:16.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.455+0000 7f59391239c0 20 searching for the correct realm 2024-09-12T17:58:16.463 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.463+0000 7f593742a640 0 -- 172.21.15.98:0/1403849326 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x5652f4b88160 msgr2=0x5652f4b8a550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:16.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.467+0000 7f5936428640 0 -- 172.21.15.98:0/1403849326 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f592804e040 msgr2=0x7f592804e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:16.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:16.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:58:16.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:16.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:58:16.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:16.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:16.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:16.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:16.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 20 zone default found 2024-09-12T17:58:16.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 4 Realm: () 2024-09-12T17:58:16.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:58:16.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:58:16.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:16.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 20 zonegroup default 2024-09-12T17:58:16.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.475+0000 7f59391239c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.479+0000 7f59391239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.479+0000 7f59391239c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.479+0000 7f59391239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.479+0000 7f59391239c0 20 started sync module instance, tier type = 2024-09-12T17:58:16.480 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.479+0000 7f59391239c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:58:16.495 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.495+0000 7f59391239c0 20 add_watcher() i=0 2024-09-12T17:58:16.495 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.495+0000 7f59391239c0 20 add_watcher() i=1 2024-09-12T17:58:16.495 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.495+0000 7f59391239c0 20 add_watcher() i=2 2024-09-12T17:58:16.495 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.495+0000 7f59391239c0 20 add_watcher() i=3 2024-09-12T17:58:16.495 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.495+0000 7f59391239c0 20 add_watcher() i=4 2024-09-12T17:58:16.496 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.495+0000 7f59391239c0 20 add_watcher() i=5 2024-09-12T17:58:16.496 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.495+0000 7f59391239c0 20 add_watcher() i=6 2024-09-12T17:58:16.496 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.495+0000 7f59391239c0 20 add_watcher() i=7 2024-09-12T17:58:16.496 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.495+0000 7f59391239c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:16.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.499+0000 7f57ed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:16.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.499+0000 7f59391239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:16.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.499+0000 7f59391239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:16.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.499+0000 7f59391239c0 5 note: GC not initialized 2024-09-12T17:58:16.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.499+0000 7f5767fff640 20 reqs_thread_entry: start 2024-09-12T17:58:16.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.499+0000 7f59391239c0 20 init_complete bucket index max shards: 11 2024-09-12T17:58:16.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.499+0000 7f59391239c0 20 Filter name: none 2024-09-12T17:58:16.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.499+0000 7f5765ffb640 20 reqs_thread_entry: start 2024-09-12T17:58:16.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.499+0000 7f59391239c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.499+0000 7f59391239c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:16.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.499+0000 7f59391239c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.499+0000 7f59391239c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:58:16.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.499+0000 7f59391239c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:16.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.499+0000 7f59391239c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.503+0000 7f59391239c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:16.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.503+0000 7f59391239c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.504 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.503+0000 7f59391239c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:58:16.504 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.503+0000 7f59391239c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:16.506 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.503+0000 7f57ed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:16.511 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.511+0000 7f59391239c0 20 remove_watcher() i=0 2024-09-12T17:58:16.511 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.511+0000 7f59391239c0 2 removed watcher, disabling cache 2024-09-12T17:58:16.513 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.511+0000 7f59391239c0 20 remove_watcher() i=1 2024-09-12T17:58:16.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.515+0000 7f59391239c0 20 remove_watcher() i=2 2024-09-12T17:58:16.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.515+0000 7f59391239c0 20 remove_watcher() i=3 2024-09-12T17:58:16.519 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.519+0000 7f59391239c0 20 remove_watcher() i=4 2024-09-12T17:58:16.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.519+0000 7f59391239c0 20 remove_watcher() i=5 2024-09-12T17:58:16.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.519+0000 7f59391239c0 20 remove_watcher() i=6 2024-09-12T17:58:16.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.523+0000 7f59391239c0 20 remove_watcher() i=7 2024-09-12T17:58:16.537 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:16.537 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:58:16.537 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-commit-target-layout id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:58:16.537 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:16.537 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T17:58:16.570 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:16.570 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:16.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.611+0000 7facdb9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.615+0000 7facdb9ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.615+0000 7facdb9ed9c0 20 realm 2024-09-12T17:58:16.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.615+0000 7facdb9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.615+0000 7facdb9ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.615+0000 7facdb9ed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:16.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.615+0000 7facdb9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.615+0000 7facdb9ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.615+0000 7facdb9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.615+0000 7facdb9ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:16.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.615+0000 7facdb9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.615+0000 7facdb9ed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:16.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.615+0000 7facdb9ed9c0 20 searching for the correct realm 2024-09-12T17:58:16.623 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.623+0000 7facd9cf4640 0 -- 172.21.15.98:0/2724769195 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55d249871ee0 msgr2=0x55d2498743a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:58:16.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.627+0000 7facd94f3640 0 -- 172.21.15.98:0/2724769195 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7facd012f920 msgr2=0x7facd0102990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:16.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.635+0000 7facdb9ed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:16.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.635+0000 7facdb9ed9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:58:16.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.635+0000 7facdb9ed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:16.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.635+0000 7facdb9ed9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:58:16.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.635+0000 7facdb9ed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:16.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.635+0000 7facdb9ed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:16.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.635+0000 7facdb9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.635+0000 7facdb9ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.635+0000 7facdb9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.639 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.639+0000 7facdb9ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:16.639 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.639+0000 7facdb9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.639+0000 7facdb9ed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:16.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.639+0000 7facdb9ed9c0 20 zone default found 2024-09-12T17:58:16.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.639+0000 7facdb9ed9c0 4 Realm: () 2024-09-12T17:58:16.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.639+0000 7facdb9ed9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:58:16.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.639+0000 7facdb9ed9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:58:16.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.639+0000 7facdb9ed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:16.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.639+0000 7facdb9ed9c0 20 zonegroup default 2024-09-12T17:58:16.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.639+0000 7facdb9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.639+0000 7facdb9ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.639+0000 7facdb9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.641 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.639+0000 7facdb9ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.641 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.639+0000 7facdb9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.641 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.639+0000 7facdb9ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.642 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.639+0000 7facdb9ed9c0 20 started sync module instance, tier type = 2024-09-12T17:58:16.642 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.639+0000 7facdb9ed9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:58:16.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.655+0000 7facdb9ed9c0 20 add_watcher() i=0 2024-09-12T17:58:16.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.655+0000 7facdb9ed9c0 20 add_watcher() i=1 2024-09-12T17:58:16.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.655+0000 7facdb9ed9c0 20 add_watcher() i=2 2024-09-12T17:58:16.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.655+0000 7facdb9ed9c0 20 add_watcher() i=3 2024-09-12T17:58:16.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.655+0000 7facdb9ed9c0 20 add_watcher() i=4 2024-09-12T17:58:16.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.655+0000 7facdb9ed9c0 20 add_watcher() i=5 2024-09-12T17:58:16.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.655+0000 7facdb9ed9c0 20 add_watcher() i=6 2024-09-12T17:58:16.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.655+0000 7facdb9ed9c0 20 add_watcher() i=7 2024-09-12T17:58:16.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.655+0000 7facdb9ed9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:16.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.659+0000 7fab8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:16.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.659+0000 7facdb9ed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:16.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.659+0000 7facdb9ed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:16.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.659+0000 7facdb9ed9c0 5 note: GC not initialized 2024-09-12T17:58:16.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.659+0000 7fab8e7e4640 20 reqs_thread_entry: start 2024-09-12T17:58:16.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.659+0000 7facdb9ed9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:58:16.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.659+0000 7facdb9ed9c0 20 Filter name: none 2024-09-12T17:58:16.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.659+0000 7faafffff640 20 reqs_thread_entry: start 2024-09-12T17:58:16.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.659+0000 7facdb9ed9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:58:16.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.659+0000 7facdb9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.659+0000 7facdb9ed9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:16.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.659+0000 7facdb9ed9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:58:16.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.659+0000 7facdb9ed9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:58:16.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.659+0000 7facdb9ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 : miss 2024-09-12T17:58:16.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.659+0000 7facdb9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.663+0000 7facdb9ed9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:58:16.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.663+0000 7facdb9ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 info.flags=0x17 2024-09-12T17:58:16.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.663+0000 7facdb9ed9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 to cache LRU end 2024-09-12T17:58:16.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.663+0000 7facdb9ed9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:16.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.663+0000 7facdb9ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:16.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.663+0000 7facdb9ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 2024-09-12T17:58:16.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.671+0000 7facdb9ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 info.flags=0x17 2024-09-12T17:58:16.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.671+0000 7facdb9ed9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 to cache LRU end 2024-09-12T17:58:16.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.671+0000 7facdb9ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:16.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.671+0000 7facdb9ed9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30, ofs0, ns] 2024-09-12T17:58:16.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.671+0000 7fababfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366182 cookie 94361665135456 notifier 7293 bl.length()=931 2024-09-12T17:58:16.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.671+0000 7fababfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 info.flags=0x17 2024-09-12T17:58:16.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.671+0000 7fababfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 to cache LRU end 2024-09-12T17:58:16.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.671+0000 7fababfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:16.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.675+0000 7facdb9ed9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.30]): orig_sources= new_sources= 2024-09-12T17:58:16.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.675+0000 7facdb9ed9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.30]): potential sources added=[] removed=[] 2024-09-12T17:58:16.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.675+0000 7facdb9ed9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.30]): orig_dests= new_dests= 2024-09-12T17:58:16.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.675+0000 7facdb9ed9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.30]): potential dests added=[] removed=[] 2024-09-12T17:58:16.690 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.0 2024-09-12T17:58:16.690 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.0 2024-09-12T17:58:16.690 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.1 2024-09-12T17:58:16.690 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.1 2024-09-12T17:58:16.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.2 2024-09-12T17:58:16.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.2 2024-09-12T17:58:16.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.3 2024-09-12T17:58:16.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.3 2024-09-12T17:58:16.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.4 2024-09-12T17:58:16.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.4 2024-09-12T17:58:16.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.5 2024-09-12T17:58:16.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.5 2024-09-12T17:58:16.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.6 2024-09-12T17:58:16.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.6 2024-09-12T17:58:16.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.7 2024-09-12T17:58:16.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.7 2024-09-12T17:58:16.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.8 2024-09-12T17:58:16.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.8 2024-09-12T17:58:16.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.9 2024-09-12T17:58:16.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.9 2024-09-12T17:58:16.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.10 2024-09-12T17:58:16.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.10 2024-09-12T17:58:16.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.11 2024-09-12T17:58:16.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1.11 2024-09-12T17:58:16.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.687+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.0 2024-09-12T17:58:16.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.691+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1 2024-09-12T17:58:16.693 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.691+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2 2024-09-12T17:58:16.693 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.691+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.3 2024-09-12T17:58:16.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.691+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.4 2024-09-12T17:58:16.695 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.695+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.5 2024-09-12T17:58:16.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.695+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.6 2024-09-12T17:58:16.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.695+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.7 2024-09-12T17:58:16.698 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.695+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.8 2024-09-12T17:58:16.698 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.695+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.9 2024-09-12T17:58:16.699 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.699+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.10 2024-09-12T17:58:16.705 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.703+0000 7facdb9ed9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:58:16.705 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.703+0000 7facdb9ed9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 2024-09-12T17:58:16.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.707+0000 7facdb9ed9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 info.flags=0x17 2024-09-12T17:58:16.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.707+0000 7facdb9ed9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 to cache LRU end 2024-09-12T17:58:16.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.707+0000 7facdb9ed9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:16.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.707+0000 7facdb9ed9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30, ofs0, ns] 2024-09-12T17:58:16.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.707+0000 7fababfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366183 cookie 94361665135456 notifier 7293 bl.length()=931 2024-09-12T17:58:16.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.707+0000 7fababfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 info.flags=0x17 2024-09-12T17:58:16.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.707+0000 7fababfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 to cache LRU end 2024-09-12T17:58:16.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.707+0000 7fababfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:16.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.711+0000 7facdb9ed9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.30]): orig_sources= new_sources= 2024-09-12T17:58:16.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.711+0000 7facdb9ed9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.30]): potential sources added=[] removed=[] 2024-09-12T17:58:16.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.711+0000 7facdb9ed9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.30]): orig_dests= new_dests= 2024-09-12T17:58:16.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.711+0000 7facdb9ed9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.30]): potential dests added=[] removed=[] 2024-09-12T17:58:16.716 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.715+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.0 2024-09-12T17:58:16.717 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.715+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1 2024-09-12T17:58:16.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.715+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2 2024-09-12T17:58:16.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.719+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.3 2024-09-12T17:58:16.719 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.719+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.4 2024-09-12T17:58:16.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.719+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.5 2024-09-12T17:58:16.721 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.719+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.6 2024-09-12T17:58:16.721 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.719+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.7 2024-09-12T17:58:16.722 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.719+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.8 2024-09-12T17:58:16.722 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.719+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.9 2024-09-12T17:58:16.723 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.723+0000 7facdb9ed9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.10 2024-09-12T17:58:16.724 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.723+0000 7facdb9ed9c0 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T17:58:16.724 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.723+0000 7facdb9ed9c0 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T17:58:16.731 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.731+0000 7fab8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:16.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.735+0000 7facdb9ed9c0 20 remove_watcher() i=0 2024-09-12T17:58:16.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.735+0000 7facdb9ed9c0 2 removed watcher, disabling cache 2024-09-12T17:58:16.738 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.735+0000 7facdb9ed9c0 20 remove_watcher() i=1 2024-09-12T17:58:16.740 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.739+0000 7facdb9ed9c0 20 remove_watcher() i=2 2024-09-12T17:58:16.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.743+0000 7facdb9ed9c0 20 remove_watcher() i=3 2024-09-12T17:58:16.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.743+0000 7facdb9ed9c0 20 remove_watcher() i=4 2024-09-12T17:58:16.746 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.743+0000 7facdb9ed9c0 20 remove_watcher() i=5 2024-09-12T17:58:16.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.747+0000 7facdb9ed9c0 20 remove_watcher() i=6 2024-09-12T17:58:16.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.747+0000 7facdb9ed9c0 20 remove_watcher() i=7 2024-09-12T17:58:16.762 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:58:16.790 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:16.791 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:16.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.831+0000 7f4baa10c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.835 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.835+0000 7f4baa10c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.835 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.835+0000 7f4baa10c9c0 20 realm 2024-09-12T17:58:16.835 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.835+0000 7f4baa10c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.836 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.835+0000 7f4baa10c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.836 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.835+0000 7f4baa10c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:16.836 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.835+0000 7f4baa10c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.836 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.835+0000 7f4baa10c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.836 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.835+0000 7f4baa10c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.835+0000 7f4baa10c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:16.838 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.835+0000 7f4baa10c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.838 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.835+0000 7f4baa10c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:16.838 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.835+0000 7f4baa10c9c0 20 searching for the correct realm 2024-09-12T17:58:16.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.843+0000 7f4ba7411640 0 -- 172.21.15.98:0/4246653291 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f4b980e9040 msgr2=0x7f4b980e9420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:16.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.847+0000 7f4ba8413640 0 -- 172.21.15.98:0/4246653291 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f4b9c095040 msgr2=0x7f4b9c09a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:58:16.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:16.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:58:16.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:16.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:58:16.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:16.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:16.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:16.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:16.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 20 zone default found 2024-09-12T17:58:16.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 4 Realm: () 2024-09-12T17:58:16.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:58:16.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:58:16.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:16.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 20 zonegroup default 2024-09-12T17:58:16.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.855+0000 7f4baa10c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.860 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.859+0000 7f4baa10c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.860 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.859+0000 7f4baa10c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.860 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.859+0000 7f4baa10c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:16.860 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.859+0000 7f4baa10c9c0 20 started sync module instance, tier type = 2024-09-12T17:58:16.860 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.859+0000 7f4baa10c9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:58:16.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.875+0000 7f4baa10c9c0 20 add_watcher() i=0 2024-09-12T17:58:16.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.875+0000 7f4baa10c9c0 20 add_watcher() i=1 2024-09-12T17:58:16.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.875+0000 7f4baa10c9c0 20 add_watcher() i=2 2024-09-12T17:58:16.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.875+0000 7f4baa10c9c0 20 add_watcher() i=3 2024-09-12T17:58:16.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.875+0000 7f4baa10c9c0 20 add_watcher() i=4 2024-09-12T17:58:16.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.875+0000 7f4baa10c9c0 20 add_watcher() i=5 2024-09-12T17:58:16.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.875+0000 7f4baa10c9c0 20 add_watcher() i=6 2024-09-12T17:58:16.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.875+0000 7f4baa10c9c0 20 add_watcher() i=7 2024-09-12T17:58:16.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.875+0000 7f4baa10c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:16.879 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.879+0000 7f4a5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:16.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.879+0000 7f4baa10c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:16.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.879+0000 7f4baa10c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:16.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.879+0000 7f4baa10c9c0 5 note: GC not initialized 2024-09-12T17:58:16.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.879+0000 7f4a5cfe1640 20 reqs_thread_entry: start 2024-09-12T17:58:16.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.879+0000 7f4baa10c9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:58:16.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.879+0000 7f4baa10c9c0 20 Filter name: none 2024-09-12T17:58:16.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.879+0000 7f49d67fc640 20 reqs_thread_entry: start 2024-09-12T17:58:16.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.879+0000 7f4baa10c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.879+0000 7f4baa10c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:16.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.879+0000 7f4baa10c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.879+0000 7f4baa10c9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:58:16.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.879+0000 7f4baa10c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:16.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.879+0000 7f4baa10c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.883+0000 7f4baa10c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:16.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.883+0000 7f4baa10c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:16.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.883+0000 7f4baa10c9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:58:16.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.883+0000 7f4baa10c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:16.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.887+0000 7f4a5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:16.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.891+0000 7f4baa10c9c0 20 remove_watcher() i=0 2024-09-12T17:58:16.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.891+0000 7f4baa10c9c0 2 removed watcher, disabling cache 2024-09-12T17:58:16.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.891+0000 7f4baa10c9c0 20 remove_watcher() i=1 2024-09-12T17:58:16.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.895+0000 7f4baa10c9c0 20 remove_watcher() i=2 2024-09-12T17:58:16.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.895+0000 7f4baa10c9c0 20 remove_watcher() i=3 2024-09-12T17:58:16.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.899+0000 7f4baa10c9c0 20 remove_watcher() i=4 2024-09-12T17:58:16.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.899+0000 7f4baa10c9c0 20 remove_watcher() i=5 2024-09-12T17:58:16.902 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.903+0000 7f4baa10c9c0 20 remove_watcher() i=6 2024-09-12T17:58:16.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:16.903+0000 7f4baa10c9c0 20 remove_watcher() i=7 2024-09-12T17:58:16.917 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:16.917 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:58:16.917 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-commit-target-layout id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:58:16.918 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:16.919 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:16.919 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:16.956 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:16.956 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:17.016 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:58:17.051 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:17.051 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:17.095 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.095+0000 7f1ba2e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.095+0000 7f1ba2e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:17.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.095+0000 7f1ba2e179c0 20 realm 2024-09-12T17:58:17.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.095+0000 7f1ba2e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.095+0000 7f1ba2e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:17.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.095+0000 7f1ba2e179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:17.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.095+0000 7f1ba2e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.095+0000 7f1ba2e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:17.098 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.095+0000 7f1ba2e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.099+0000 7f1ba2e179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:17.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.099+0000 7f1ba2e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.099+0000 7f1ba2e179c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:17.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.099+0000 7f1ba2e179c0 20 searching for the correct realm 2024-09-12T17:58:17.105 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.103+0000 7f1ba011c640 0 -- 172.21.15.98:0/1454502403 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f1b90027020 msgr2=0x7f1b9008b000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:17.111 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.111+0000 7f1ba091d640 0 -- 172.21.15.98:0/1454502403 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f1b90027020 msgr2=0x7f1a6c085f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:17.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.327+0000 7f1ba2e179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:17.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.327+0000 7f1ba2e179c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:58:17.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.327+0000 7f1ba2e179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:17.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.327+0000 7f1ba2e179c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:58:17.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.327+0000 7f1ba2e179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:17.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.327+0000 7f1ba2e179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:17.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.327+0000 7f1ba2e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.327+0000 7f1ba2e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:17.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.327+0000 7f1ba2e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.331+0000 7f1ba2e179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:17.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.331+0000 7f1ba2e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.331+0000 7f1ba2e179c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:17.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.331+0000 7f1ba2e179c0 20 zone default found 2024-09-12T17:58:17.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.331+0000 7f1ba2e179c0 4 Realm: () 2024-09-12T17:58:17.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.331+0000 7f1ba2e179c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:58:17.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.331+0000 7f1ba2e179c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:58:17.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.331+0000 7f1ba2e179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:17.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.331+0000 7f1ba2e179c0 20 zonegroup default 2024-09-12T17:58:17.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.331+0000 7f1ba2e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.331+0000 7f1ba2e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:17.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.331+0000 7f1ba2e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.331+0000 7f1ba2e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:17.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.331+0000 7f1ba2e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.331+0000 7f1ba2e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:17.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.331+0000 7f1ba2e179c0 20 started sync module instance, tier type = 2024-09-12T17:58:17.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.331+0000 7f1ba2e179c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:58:17.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.355+0000 7f1ba2e179c0 20 add_watcher() i=0 2024-09-12T17:58:17.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.355+0000 7f1ba2e179c0 20 add_watcher() i=1 2024-09-12T17:58:17.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.355+0000 7f1ba2e179c0 20 add_watcher() i=2 2024-09-12T17:58:17.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.355+0000 7f1ba2e179c0 20 add_watcher() i=3 2024-09-12T17:58:17.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.355+0000 7f1ba2e179c0 20 add_watcher() i=4 2024-09-12T17:58:17.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.355+0000 7f1ba2e179c0 20 add_watcher() i=5 2024-09-12T17:58:17.358 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.355+0000 7f1ba2e179c0 20 add_watcher() i=6 2024-09-12T17:58:17.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.359+0000 7f1ba2e179c0 20 add_watcher() i=7 2024-09-12T17:58:17.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.359+0000 7f1ba2e179c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:17.362 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.359+0000 7f1a577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:17.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.363+0000 7f1ba2e179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:17.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.363+0000 7f1ba2e179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:17.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.363+0000 7f1ba2e179c0 5 note: GC not initialized 2024-09-12T17:58:17.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.363+0000 7f1a567e4640 20 reqs_thread_entry: start 2024-09-12T17:58:17.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.363+0000 7f1ba2e179c0 20 init_complete bucket index max shards: 11 2024-09-12T17:58:17.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.363+0000 7f1ba2e179c0 20 Filter name: none 2024-09-12T17:58:17.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.363+0000 7f1a4ffff640 20 reqs_thread_entry: start 2024-09-12T17:58:17.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.363+0000 7f1ba2e179c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:58:17.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.363+0000 7f1ba2e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.363+0000 7f1ba2e179c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:17.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.363+0000 7f1ba2e179c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:58:17.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.363+0000 7f1ba2e179c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:58:17.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.363+0000 7f1ba2e179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 : miss 2024-09-12T17:58:17.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.363+0000 7f1ba2e179c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.363+0000 7f1ba2e179c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:58:17.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.363+0000 7f1ba2e179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 info.flags=0x17 2024-09-12T17:58:17.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.363+0000 7f1ba2e179c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 to cache LRU end 2024-09-12T17:58:17.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.363+0000 7f1ba2e179c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:17.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.363+0000 7f1ba2e179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:17.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.363+0000 7f1ba2e179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 2024-09-12T17:58:17.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.367+0000 7f1ba2e179c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:58:17.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.379+0000 7f1ba2e179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 info.flags=0x17 2024-09-12T17:58:17.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.379+0000 7f1ba2e179c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 to cache LRU end 2024-09-12T17:58:17.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.379+0000 7f1ba2e179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:17.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.379+0000 7f1ba2e179c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30, ofs0, ns] 2024-09-12T17:58:17.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.383+0000 7f1a77fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366184 cookie 94196708332960 notifier 7329 bl.length()=931 2024-09-12T17:58:17.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.383+0000 7f1a77fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 info.flags=0x17 2024-09-12T17:58:17.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.383+0000 7f1a77fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 to cache LRU end 2024-09-12T17:58:17.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.383+0000 7f1a77fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:17.384 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.383+0000 7f1ba2e179c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.30]): orig_sources= new_sources= 2024-09-12T17:58:17.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.383+0000 7f1ba2e179c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.30]): potential sources added=[] removed=[] 2024-09-12T17:58:17.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.383+0000 7f1ba2e179c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.30]): orig_dests= new_dests= 2024-09-12T17:58:17.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.383+0000 7f1ba2e179c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.30]): potential dests added=[] removed=[] 2024-09-12T17:58:17.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.0 2024-09-12T17:58:17.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.0 2024-09-12T17:58:17.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.1 2024-09-12T17:58:17.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.1 2024-09-12T17:58:17.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.2 2024-09-12T17:58:17.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.2 2024-09-12T17:58:17.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.3 2024-09-12T17:58:17.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.3 2024-09-12T17:58:17.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.4 2024-09-12T17:58:17.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.4 2024-09-12T17:58:17.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.5 2024-09-12T17:58:17.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.5 2024-09-12T17:58:17.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.6 2024-09-12T17:58:17.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.6 2024-09-12T17:58:17.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.7 2024-09-12T17:58:17.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.7 2024-09-12T17:58:17.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.8 2024-09-12T17:58:17.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.8 2024-09-12T17:58:17.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.9 2024-09-12T17:58:17.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.9 2024-09-12T17:58:17.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.10 2024-09-12T17:58:17.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.10 2024-09-12T17:58:17.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.11 2024-09-12T17:58:17.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2.11 2024-09-12T17:58:17.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.395+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.0 2024-09-12T17:58:17.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.399+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1 2024-09-12T17:58:17.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.399+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2 2024-09-12T17:58:17.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.399+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.3 2024-09-12T17:58:17.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.399+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.4 2024-09-12T17:58:17.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.403+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.5 2024-09-12T17:58:17.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.403+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.6 2024-09-12T17:58:17.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.403+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.7 2024-09-12T17:58:17.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.403+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.8 2024-09-12T17:58:17.407 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.407+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.9 2024-09-12T17:58:17.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.407+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.10 2024-09-12T17:58:17.415 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.415+0000 7f1ba2e179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:58:17.415 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.415+0000 7f1ba2e179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 2024-09-12T17:58:17.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.419+0000 7f1ba2e179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 info.flags=0x17 2024-09-12T17:58:17.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.419+0000 7f1ba2e179c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 to cache LRU end 2024-09-12T17:58:17.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.419+0000 7f1ba2e179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:17.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.419+0000 7f1ba2e179c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30, ofs0, ns] 2024-09-12T17:58:17.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.419+0000 7f1a777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366185 cookie 94196708332960 notifier 7329 bl.length()=931 2024-09-12T17:58:17.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.419+0000 7f1a777fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 info.flags=0x17 2024-09-12T17:58:17.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.419+0000 7f1a777fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 to cache LRU end 2024-09-12T17:58:17.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.419+0000 7f1a777fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:17.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.419+0000 7f1ba2e179c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.30]): orig_sources= new_sources= 2024-09-12T17:58:17.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.419+0000 7f1ba2e179c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.30]): potential sources added=[] removed=[] 2024-09-12T17:58:17.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.419+0000 7f1ba2e179c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.30]): orig_dests= new_dests= 2024-09-12T17:58:17.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.419+0000 7f1ba2e179c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.30]): potential dests added=[] removed=[] 2024-09-12T17:58:17.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.427+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.0 2024-09-12T17:58:17.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.427+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.1 2024-09-12T17:58:17.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.427+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.2 2024-09-12T17:58:17.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.427+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.3 2024-09-12T17:58:17.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.427+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.4 2024-09-12T17:58:17.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.431+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.5 2024-09-12T17:58:17.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.431+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.6 2024-09-12T17:58:17.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.431+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.7 2024-09-12T17:58:17.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.431+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.8 2024-09-12T17:58:17.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.431+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.9 2024-09-12T17:58:17.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.431+0000 7f1ba2e179c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.30.10 2024-09-12T17:58:17.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.435+0000 7f1ba2e179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 : hit (requested=0x17, cached=0x17) 2024-09-12T17:58:17.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.435+0000 7f1ba2e179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 2024-09-12T17:58:17.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.435+0000 7f1ba2e179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 info.flags=0x17 2024-09-12T17:58:17.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.435+0000 7f1ba2e179c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 to cache LRU end 2024-09-12T17:58:17.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.435+0000 7f1ba2e179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:17.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.435+0000 7f1ba2e179c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30, ofs0, ns] 2024-09-12T17:58:17.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.439+0000 7f1a77fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366186 cookie 94196708332960 notifier 7329 bl.length()=899 2024-09-12T17:58:17.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.439+0000 7f1a77fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 info.flags=0x17 2024-09-12T17:58:17.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.439+0000 7f1a77fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 to cache LRU end 2024-09-12T17:58:17.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.439+0000 7f1a77fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:17.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.439+0000 7f1ba2e179c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.30]): orig_sources= new_sources= 2024-09-12T17:58:17.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.439+0000 7f1ba2e179c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.30]): potential sources added=[] removed=[] 2024-09-12T17:58:17.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.439+0000 7f1ba2e179c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.30]): orig_dests= new_dests= 2024-09-12T17:58:17.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.439+0000 7f1ba2e179c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.30]): potential dests added=[] removed=[] 2024-09-12T17:58:17.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.447+0000 7f1ba2e179c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:58:17.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.447+0000 7f1a577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:17.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.451+0000 7f1ba2e179c0 20 remove_watcher() i=0 2024-09-12T17:58:17.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.451+0000 7f1ba2e179c0 2 removed watcher, disabling cache 2024-09-12T17:58:17.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.455+0000 7f1ba2e179c0 20 remove_watcher() i=1 2024-09-12T17:58:17.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.459+0000 7f1ba2e179c0 20 remove_watcher() i=2 2024-09-12T17:58:17.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.459+0000 7f1ba2e179c0 20 remove_watcher() i=3 2024-09-12T17:58:17.463 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.463+0000 7f1ba2e179c0 20 remove_watcher() i=4 2024-09-12T17:58:17.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.463+0000 7f1ba2e179c0 20 remove_watcher() i=5 2024-09-12T17:58:17.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.463+0000 7f1ba2e179c0 20 remove_watcher() i=6 2024-09-12T17:58:17.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.467+0000 7f1ba2e179c0 20 remove_watcher() i=7 2024-09-12T17:58:17.483 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:58:17.514 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:17.514 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:17.558 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.555+0000 7fbcd2a739c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.559+0000 7fbcd2a739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:17.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.559+0000 7fbcd2a739c0 20 realm 2024-09-12T17:58:17.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.559+0000 7fbcd2a739c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.559+0000 7fbcd2a739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:17.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.559+0000 7fbcd2a739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:17.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.559+0000 7fbcd2a739c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.559+0000 7fbcd2a739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:17.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.559+0000 7fbcd2a739c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.562 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.563+0000 7fbcd2a739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:17.562 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.563+0000 7fbcd2a739c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.563+0000 7fbcd2a739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:17.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.563+0000 7fbcd2a739c0 20 searching for the correct realm 2024-09-12T17:58:17.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.567+0000 7fbcd0d7a640 0 -- 172.21.15.98:0/966267088 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7fbcb80fdc80 msgr2=0x7fbcb8106040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:17.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.571+0000 7fbcd0579640 0 -- 172.21.15.98:0/966267088 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x55f134cc5b40 msgr2=0x55f134cc8000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:17.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:17.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:58:17.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:17.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:58:17.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:17.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:17.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:17.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:17.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:17.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 20 zone default found 2024-09-12T17:58:17.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 4 Realm: () 2024-09-12T17:58:17.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:58:17.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:58:17.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:17.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 20 zonegroup default 2024-09-12T17:58:17.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:17.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:17.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.583+0000 7fbcd2a739c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.587+0000 7fbcd2a739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:17.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.587+0000 7fbcd2a739c0 20 started sync module instance, tier type = 2024-09-12T17:58:17.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.587+0000 7fbcd2a739c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:58:17.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.599+0000 7fbcd2a739c0 20 add_watcher() i=0 2024-09-12T17:58:17.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.599+0000 7fbcd2a739c0 20 add_watcher() i=1 2024-09-12T17:58:17.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.599+0000 7fbcd2a739c0 20 add_watcher() i=2 2024-09-12T17:58:17.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.599+0000 7fbcd2a739c0 20 add_watcher() i=3 2024-09-12T17:58:17.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.599+0000 7fbcd2a739c0 20 add_watcher() i=4 2024-09-12T17:58:17.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.599+0000 7fbcd2a739c0 20 add_watcher() i=5 2024-09-12T17:58:17.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.599+0000 7fbcd2a739c0 20 add_watcher() i=6 2024-09-12T17:58:17.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.603+0000 7fbcd2a739c0 20 add_watcher() i=7 2024-09-12T17:58:17.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.603+0000 7fbcd2a739c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:17.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.603+0000 7fbb86fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:17.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.603+0000 7fbcd2a739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:17.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.603+0000 7fbcd2a739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:17.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.603+0000 7fbcd2a739c0 5 note: GC not initialized 2024-09-12T17:58:17.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.603+0000 7fbb85fdb640 20 reqs_thread_entry: start 2024-09-12T17:58:17.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.603+0000 7fbcd2a739c0 20 init_complete bucket index max shards: 11 2024-09-12T17:58:17.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.603+0000 7fbcd2a739c0 20 Filter name: none 2024-09-12T17:58:17.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.603+0000 7fbaf77fe640 20 reqs_thread_entry: start 2024-09-12T17:58:17.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.603+0000 7fbcd2a739c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.607+0000 7fbcd2a739c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:17.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.607+0000 7fbcd2a739c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.607+0000 7fbcd2a739c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:58:17.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.607+0000 7fbcd2a739c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:17.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.607+0000 7fbcd2a739c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.607+0000 7fbcd2a739c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:17.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.607+0000 7fbcd2a739c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:17.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.607+0000 7fbcd2a739c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:58:17.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.607+0000 7fbcd2a739c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:17.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.611+0000 7fbb86fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:17.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.615+0000 7fbcd2a739c0 20 remove_watcher() i=0 2024-09-12T17:58:17.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.615+0000 7fbcd2a739c0 2 removed watcher, disabling cache 2024-09-12T17:58:17.619 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.619+0000 7fbcd2a739c0 20 remove_watcher() i=1 2024-09-12T17:58:17.621 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.619+0000 7fbcd2a739c0 20 remove_watcher() i=2 2024-09-12T17:58:17.623 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.623+0000 7fbcd2a739c0 20 remove_watcher() i=3 2024-09-12T17:58:17.624 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.623+0000 7fbcd2a739c0 20 remove_watcher() i=4 2024-09-12T17:58:17.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.623+0000 7fbcd2a739c0 20 remove_watcher() i=5 2024-09-12T17:58:17.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.627+0000 7fbcd2a739c0 20 remove_watcher() i=6 2024-09-12T17:58:17.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:17.627+0000 7fbcd2a739c0 20 remove_watcher() i=7 2024-09-12T17:58:17.641 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:17.641 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:58:17.641 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-commit-target-layout id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:58:17.641 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:17.643 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:17.643 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:17.664 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:17.664 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:18.171 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:18.171 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:18.544 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T17:58:18.544 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:18.546 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:18.546 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:18.685 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:18.686 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:18.770 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:18.770 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:18.866 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:18.866 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:18.962 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:18.962 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:19.057 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:19.057 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:19.160 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:19.160 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:19.254 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:19.254 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:19.350 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:19.350 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:19.449 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:19.449 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:19.549 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:19.550 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:19.646 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:19.646 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:19.744 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:19.745 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:19.835 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:19.835 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:19.928 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:19.928 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:20.022 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:20.022 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:20.113 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:20.113 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:20.213 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:20.213 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:20.314 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:20.314 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:20.410 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:20.410 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:20.502 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:20.503 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:20.603 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:20.603 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:20.695 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:58:20.728 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:20.728 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:20.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:20.771+0000 7feb1e8889c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:20.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:20.775+0000 7feb1e8889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:20.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:20.775+0000 7feb1e8889c0 20 realm 2024-09-12T17:58:20.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:20.775+0000 7feb1e8889c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:20.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:20.775+0000 7feb1e8889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:20.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:20.775+0000 7feb1e8889c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:20.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:20.775+0000 7feb1e8889c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:20.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:20.775+0000 7feb1e8889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:20.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:20.775+0000 7feb1e8889c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:20.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:20.775+0000 7feb1e8889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:20.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:20.775+0000 7feb1e8889c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:20.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:20.775+0000 7feb1e8889c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:20.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:20.775+0000 7feb1e8889c0 20 searching for the correct realm 2024-09-12T17:58:20.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:20.783+0000 7feb1cb8f640 0 -- 172.21.15.98:0/3137445624 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7feb040d0040 msgr2=0x7feb040c5410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:20.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:20.787+0000 7feb1c38e640 0 -- 172.21.15.98:0/3137445624 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7feb040c5410 msgr2=0x7feb040c5850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:21.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.003+0000 7feb1e8889c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:21.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.003+0000 7feb1e8889c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:58:21.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.003+0000 7feb1e8889c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:21.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.003+0000 7feb1e8889c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:58:21.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.003+0000 7feb1e8889c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:21.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.003+0000 7feb1e8889c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:21.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.003+0000 7feb1e8889c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.003+0000 7feb1e8889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:21.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.003+0000 7feb1e8889c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.007+0000 7feb1e8889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:21.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.007+0000 7feb1e8889c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.007+0000 7feb1e8889c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:21.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.007+0000 7feb1e8889c0 20 zone default found 2024-09-12T17:58:21.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.007+0000 7feb1e8889c0 4 Realm: () 2024-09-12T17:58:21.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.007+0000 7feb1e8889c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:58:21.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.007+0000 7feb1e8889c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:58:21.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.007+0000 7feb1e8889c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:21.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.007+0000 7feb1e8889c0 20 zonegroup default 2024-09-12T17:58:21.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.007+0000 7feb1e8889c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.007+0000 7feb1e8889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:21.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.007+0000 7feb1e8889c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.007+0000 7feb1e8889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:21.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.007+0000 7feb1e8889c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.007+0000 7feb1e8889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:21.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.007+0000 7feb1e8889c0 20 started sync module instance, tier type = 2024-09-12T17:58:21.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.007+0000 7feb1e8889c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:58:21.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.031+0000 7feb1e8889c0 20 add_watcher() i=0 2024-09-12T17:58:21.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.031+0000 7feb1e8889c0 20 add_watcher() i=1 2024-09-12T17:58:21.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.031+0000 7feb1e8889c0 20 add_watcher() i=2 2024-09-12T17:58:21.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.031+0000 7feb1e8889c0 20 add_watcher() i=3 2024-09-12T17:58:21.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.031+0000 7feb1e8889c0 20 add_watcher() i=4 2024-09-12T17:58:21.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.031+0000 7feb1e8889c0 20 add_watcher() i=5 2024-09-12T17:58:21.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.031+0000 7feb1e8889c0 20 add_watcher() i=6 2024-09-12T17:58:21.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.035+0000 7feb1e8889c0 20 add_watcher() i=7 2024-09-12T17:58:21.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.035+0000 7feb1e8889c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:21.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.039+0000 7fe9d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:21.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.039+0000 7feb1e8889c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:21.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.039+0000 7feb1e8889c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:21.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.039+0000 7feb1e8889c0 5 note: GC not initialized 2024-09-12T17:58:21.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.039+0000 7fe9d1fdb640 20 reqs_thread_entry: start 2024-09-12T17:58:21.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.039+0000 7feb1e8889c0 20 init_complete bucket index max shards: 11 2024-09-12T17:58:21.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.039+0000 7feb1e8889c0 20 Filter name: none 2024-09-12T17:58:21.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.039+0000 7fe9437fe640 20 reqs_thread_entry: start 2024-09-12T17:58:21.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.043+0000 7feb1e8889c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.043+0000 7feb1e8889c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:21.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.043+0000 7feb1e8889c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.043+0000 7feb1e8889c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:58:21.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.043+0000 7feb1e8889c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:21.046 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.043+0000 7feb1e8889c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.046 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.043+0000 7feb1e8889c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:21.046 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.043+0000 7feb1e8889c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.047+0000 7feb1e8889c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:58:21.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.047+0000 7feb1e8889c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:21.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.047+0000 7fe9d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:21.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.055+0000 7feb1e8889c0 20 remove_watcher() i=0 2024-09-12T17:58:21.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.055+0000 7feb1e8889c0 2 removed watcher, disabling cache 2024-09-12T17:58:21.058 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.055+0000 7feb1e8889c0 20 remove_watcher() i=1 2024-09-12T17:58:21.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.059+0000 7feb1e8889c0 20 remove_watcher() i=2 2024-09-12T17:58:21.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.059+0000 7feb1e8889c0 20 remove_watcher() i=3 2024-09-12T17:58:21.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.063+0000 7feb1e8889c0 20 remove_watcher() i=4 2024-09-12T17:58:21.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.063+0000 7feb1e8889c0 20 remove_watcher() i=5 2024-09-12T17:58:21.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.067+0000 7feb1e8889c0 20 remove_watcher() i=6 2024-09-12T17:58:21.069 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.067+0000 7feb1e8889c0 20 remove_watcher() i=7 2024-09-12T17:58:21.085 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:21.085 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:58:21.085 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-commit-target-layout id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:58:21.085 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:21.086 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T17:58:21.124 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:21.124 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:21.168 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.167+0000 7f809f3da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.167+0000 7f809f3da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:21.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.167+0000 7f809f3da9c0 20 realm 2024-09-12T17:58:21.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.167+0000 7f809f3da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.167+0000 7f809f3da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:21.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.167+0000 7f809f3da9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:21.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.167+0000 7f809f3da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.167+0000 7f809f3da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:21.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.167+0000 7f809f3da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.173 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.171+0000 7f809f3da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:21.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.171+0000 7f809f3da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.171+0000 7f809f3da9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:21.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.171+0000 7f809f3da9c0 20 searching for the correct realm 2024-09-12T17:58:21.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.175+0000 7f809d6e1640 0 -- 172.21.15.98:0/1415111405 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f8090027040 msgr2=0x7f809006c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:21.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.183+0000 7f809cee0640 0 -- 172.21.15.98:0/1415111405 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f80900038c0 msgr2=0x7f8090098210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:21.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.399+0000 7f809f3da9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:21.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.399+0000 7f809f3da9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:58:21.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.399+0000 7f809f3da9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:21.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.399+0000 7f809f3da9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:58:21.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.399+0000 7f809f3da9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:21.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.399+0000 7f809f3da9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:21.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.399+0000 7f809f3da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.399+0000 7f809f3da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:21.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.399+0000 7f809f3da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.403+0000 7f809f3da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:21.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.403+0000 7f809f3da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.403+0000 7f809f3da9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:21.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.403+0000 7f809f3da9c0 20 zone default found 2024-09-12T17:58:21.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.403+0000 7f809f3da9c0 4 Realm: () 2024-09-12T17:58:21.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.403+0000 7f809f3da9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:58:21.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.403+0000 7f809f3da9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:58:21.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.403+0000 7f809f3da9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:21.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.403+0000 7f809f3da9c0 20 zonegroup default 2024-09-12T17:58:21.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.403+0000 7f809f3da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.403+0000 7f809f3da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:21.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.403+0000 7f809f3da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.403+0000 7f809f3da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:21.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.403+0000 7f809f3da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.403+0000 7f809f3da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:21.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.403+0000 7f809f3da9c0 20 started sync module instance, tier type = 2024-09-12T17:58:21.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.403+0000 7f809f3da9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:58:21.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.427+0000 7f809f3da9c0 20 add_watcher() i=0 2024-09-12T17:58:21.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.427+0000 7f809f3da9c0 20 add_watcher() i=1 2024-09-12T17:58:21.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.427+0000 7f809f3da9c0 20 add_watcher() i=2 2024-09-12T17:58:21.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.427+0000 7f809f3da9c0 20 add_watcher() i=3 2024-09-12T17:58:21.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.427+0000 7f809f3da9c0 20 add_watcher() i=4 2024-09-12T17:58:21.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.427+0000 7f809f3da9c0 20 add_watcher() i=5 2024-09-12T17:58:21.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.427+0000 7f809f3da9c0 20 add_watcher() i=6 2024-09-12T17:58:21.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.431+0000 7f809f3da9c0 20 add_watcher() i=7 2024-09-12T17:58:21.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.431+0000 7f809f3da9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:21.437 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.435+0000 7f7f52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:21.437 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.435+0000 7f809f3da9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:21.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.435+0000 7f809f3da9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:21.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.435+0000 7f809f3da9c0 5 note: GC not initialized 2024-09-12T17:58:21.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.435+0000 7f7f51fe3640 20 reqs_thread_entry: start 2024-09-12T17:58:21.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.435+0000 7f809f3da9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:58:21.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.435+0000 7f809f3da9c0 20 Filter name: none 2024-09-12T17:58:21.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.439+0000 7f7ec37fe640 20 reqs_thread_entry: start 2024-09-12T17:58:21.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.439+0000 7f809f3da9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T17:58:21.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.439+0000 7f809f3da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.439+0000 7f809f3da9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:21.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.439+0000 7f809f3da9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T17:58:21.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.439+0000 7f809f3da9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T17:58:21.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.439+0000 7f809f3da9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 : miss 2024-09-12T17:58:21.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.439+0000 7f809f3da9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.439+0000 7f809f3da9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:58:21.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.439+0000 7f809f3da9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 info.flags=0x17 2024-09-12T17:58:21.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.439+0000 7f809f3da9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 to cache LRU end 2024-09-12T17:58:21.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.439+0000 7f809f3da9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:21.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.439+0000 7f809f3da9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:21.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.439+0000 7f809f3da9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 2024-09-12T17:58:21.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.451+0000 7f809f3da9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 info.flags=0x17 2024-09-12T17:58:21.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.451+0000 7f809f3da9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 to cache LRU end 2024-09-12T17:58:21.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.451+0000 7f809f3da9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:21.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.451+0000 7f809f3da9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31, ofs0, ns] 2024-09-12T17:58:21.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.451+0000 7f7f73fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366189 cookie 93914412168192 notifier 6842 bl.length()=931 2024-09-12T17:58:21.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.451+0000 7f7f73fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 info.flags=0x17 2024-09-12T17:58:21.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.451+0000 7f7f73fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 to cache LRU end 2024-09-12T17:58:21.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.451+0000 7f7f73fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:21.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.455+0000 7f809f3da9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.31]): orig_sources= new_sources= 2024-09-12T17:58:21.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.455+0000 7f809f3da9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.31]): potential sources added=[] removed=[] 2024-09-12T17:58:21.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.455+0000 7f809f3da9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.31]): orig_dests= new_dests= 2024-09-12T17:58:21.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.455+0000 7f809f3da9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.31]): potential dests added=[] removed=[] 2024-09-12T17:58:21.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.0 2024-09-12T17:58:21.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.0 2024-09-12T17:58:21.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.1 2024-09-12T17:58:21.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.1 2024-09-12T17:58:21.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.2 2024-09-12T17:58:21.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.2 2024-09-12T17:58:21.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.3 2024-09-12T17:58:21.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.3 2024-09-12T17:58:21.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.4 2024-09-12T17:58:21.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.4 2024-09-12T17:58:21.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.5 2024-09-12T17:58:21.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.5 2024-09-12T17:58:21.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.6 2024-09-12T17:58:21.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.6 2024-09-12T17:58:21.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.7 2024-09-12T17:58:21.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.7 2024-09-12T17:58:21.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.8 2024-09-12T17:58:21.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.8 2024-09-12T17:58:21.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.9 2024-09-12T17:58:21.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.9 2024-09-12T17:58:21.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.10 2024-09-12T17:58:21.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.10 2024-09-12T17:58:21.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.11 2024-09-12T17:58:21.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1.11 2024-09-12T17:58:21.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.0 2024-09-12T17:58:21.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1 2024-09-12T17:58:21.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.467+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.2 2024-09-12T17:58:21.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.471+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.3 2024-09-12T17:58:21.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.471+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.4 2024-09-12T17:58:21.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.471+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.5 2024-09-12T17:58:21.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.471+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.6 2024-09-12T17:58:21.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.475+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.7 2024-09-12T17:58:21.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.475+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.8 2024-09-12T17:58:21.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.475+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.9 2024-09-12T17:58:21.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.475+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.10 2024-09-12T17:58:21.483 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.483+0000 7f809f3da9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:58:21.483 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.483+0000 7f809f3da9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 2024-09-12T17:58:21.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.483+0000 7f809f3da9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 info.flags=0x17 2024-09-12T17:58:21.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.483+0000 7f809f3da9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 to cache LRU end 2024-09-12T17:58:21.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.483+0000 7f809f3da9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:21.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.483+0000 7f809f3da9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31, ofs0, ns] 2024-09-12T17:58:21.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.483+0000 7f7f737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366190 cookie 93914412168192 notifier 6842 bl.length()=931 2024-09-12T17:58:21.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.483+0000 7f7f737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 info.flags=0x17 2024-09-12T17:58:21.486 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.483+0000 7f7f737fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 to cache LRU end 2024-09-12T17:58:21.487 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.483+0000 7f7f737fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:21.488 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.487+0000 7f809f3da9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.31]): orig_sources= new_sources= 2024-09-12T17:58:21.488 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.487+0000 7f809f3da9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.31]): potential sources added=[] removed=[] 2024-09-12T17:58:21.489 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.487+0000 7f809f3da9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.31]): orig_dests= new_dests= 2024-09-12T17:58:21.489 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.487+0000 7f809f3da9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.31]): potential dests added=[] removed=[] 2024-09-12T17:58:21.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.491+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.0 2024-09-12T17:58:21.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.491+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.1 2024-09-12T17:58:21.495 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.495+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.2 2024-09-12T17:58:21.495 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.495+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.3 2024-09-12T17:58:21.496 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.495+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.4 2024-09-12T17:58:21.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.495+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.5 2024-09-12T17:58:21.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.495+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.6 2024-09-12T17:58:21.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.495+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.7 2024-09-12T17:58:21.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.499+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.8 2024-09-12T17:58:21.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.499+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.9 2024-09-12T17:58:21.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.499+0000 7f809f3da9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.31.10 2024-09-12T17:58:21.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.499+0000 7f809f3da9c0 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T17:58:21.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.499+0000 7f809f3da9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 : hit (requested=0x17, cached=0x17) 2024-09-12T17:58:21.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.499+0000 7f809f3da9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 2024-09-12T17:58:21.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.503+0000 7f809f3da9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 info.flags=0x17 2024-09-12T17:58:21.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.503+0000 7f809f3da9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 to cache LRU end 2024-09-12T17:58:21.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.503+0000 7f809f3da9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:21.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.503+0000 7f809f3da9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31, ofs0, ns] 2024-09-12T17:58:21.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.503+0000 7f7f73fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366191 cookie 93914412168192 notifier 6842 bl.length()=899 2024-09-12T17:58:21.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.503+0000 7f7f73fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 info.flags=0x17 2024-09-12T17:58:21.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.503+0000 7f7f73fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 to cache LRU end 2024-09-12T17:58:21.504 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.503+0000 7f7f73fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:21.506 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.503+0000 7f809f3da9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.31]): orig_sources= new_sources= 2024-09-12T17:58:21.506 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.503+0000 7f809f3da9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.31]): potential sources added=[] removed=[] 2024-09-12T17:58:21.506 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.503+0000 7f809f3da9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.31]): orig_dests= new_dests= 2024-09-12T17:58:21.506 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.503+0000 7f809f3da9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.31]): potential dests added=[] removed=[] 2024-09-12T17:58:21.511 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.511+0000 7f809f3da9c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:58:21.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.515+0000 7f7f52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:21.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.519+0000 7f809f3da9c0 20 remove_watcher() i=0 2024-09-12T17:58:21.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.519+0000 7f809f3da9c0 2 removed watcher, disabling cache 2024-09-12T17:58:21.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.523+0000 7f809f3da9c0 20 remove_watcher() i=1 2024-09-12T17:58:21.526 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.523+0000 7f809f3da9c0 20 remove_watcher() i=2 2024-09-12T17:58:21.528 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.527+0000 7f809f3da9c0 20 remove_watcher() i=3 2024-09-12T17:58:21.530 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.527+0000 7f809f3da9c0 20 remove_watcher() i=4 2024-09-12T17:58:21.531 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.531+0000 7f809f3da9c0 20 remove_watcher() i=5 2024-09-12T17:58:21.533 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.531+0000 7f809f3da9c0 20 remove_watcher() i=6 2024-09-12T17:58:21.534 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.535+0000 7f809f3da9c0 20 remove_watcher() i=7 2024-09-12T17:58:21.551 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T17:58:21.581 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:21.581 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:21.624 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.623+0000 7fbc620919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.623+0000 7fbc620919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:21.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.623+0000 7fbc620919c0 20 realm 2024-09-12T17:58:21.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.623+0000 7fbc620919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.623+0000 7fbc620919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:21.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.623+0000 7fbc620919c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:21.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.623+0000 7fbc620919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.623+0000 7fbc620919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:21.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.623+0000 7fbc620919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.627+0000 7fbc620919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:21.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.627+0000 7fbc620919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.627+0000 7fbc620919c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:21.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.627+0000 7fbc620919c0 20 searching for the correct realm 2024-09-12T17:58:21.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.631+0000 7fbc5f396640 0 -- 172.21.15.98:0/4163117253 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fbc5001d040 msgr2=0x7fbc50069b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:21.639 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.639+0000 7fbc5fb97640 0 -- 172.21.15.98:0/4163117253 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fbc540fc800 msgr2=0x7fbc540fedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:21.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.855+0000 7fbc620919c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:21.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.855+0000 7fbc620919c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:58:21.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.855+0000 7fbc620919c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:21.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.855+0000 7fbc620919c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:58:21.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.855+0000 7fbc620919c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:21.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.855+0000 7fbc620919c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:21.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.855+0000 7fbc620919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.859+0000 7fbc620919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:21.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.859+0000 7fbc620919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.859+0000 7fbc620919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:21.860 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.859+0000 7fbc620919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.859+0000 7fbc620919c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:21.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.859+0000 7fbc620919c0 20 zone default found 2024-09-12T17:58:21.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.859+0000 7fbc620919c0 4 Realm: () 2024-09-12T17:58:21.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.859+0000 7fbc620919c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:58:21.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.859+0000 7fbc620919c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:58:21.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.859+0000 7fbc620919c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:21.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.859+0000 7fbc620919c0 20 zonegroup default 2024-09-12T17:58:21.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.859+0000 7fbc620919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.859+0000 7fbc620919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:21.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.859+0000 7fbc620919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.859+0000 7fbc620919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:21.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.859+0000 7fbc620919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.863+0000 7fbc620919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:21.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.863+0000 7fbc620919c0 20 started sync module instance, tier type = 2024-09-12T17:58:21.863 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.863+0000 7fbc620919c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:58:21.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.883+0000 7fbc620919c0 20 add_watcher() i=0 2024-09-12T17:58:21.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.883+0000 7fbc620919c0 20 add_watcher() i=1 2024-09-12T17:58:21.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.883+0000 7fbc620919c0 20 add_watcher() i=2 2024-09-12T17:58:21.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.883+0000 7fbc620919c0 20 add_watcher() i=3 2024-09-12T17:58:21.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.883+0000 7fbc620919c0 20 add_watcher() i=4 2024-09-12T17:58:21.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.883+0000 7fbc620919c0 20 add_watcher() i=5 2024-09-12T17:58:21.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.883+0000 7fbc620919c0 20 add_watcher() i=6 2024-09-12T17:58:21.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.887+0000 7fbc620919c0 20 add_watcher() i=7 2024-09-12T17:58:21.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.887+0000 7fbc620919c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:21.890 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.887+0000 7fbb15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:21.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.891+0000 7fbc620919c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:21.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.891+0000 7fbc620919c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:21.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.891+0000 7fbc620919c0 5 note: GC not initialized 2024-09-12T17:58:21.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.891+0000 7fbb14fe1640 20 reqs_thread_entry: start 2024-09-12T17:58:21.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.891+0000 7fbc620919c0 20 init_complete bucket index max shards: 11 2024-09-12T17:58:21.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.891+0000 7fbc620919c0 20 Filter name: none 2024-09-12T17:58:21.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.891+0000 7fba8e7fc640 20 reqs_thread_entry: start 2024-09-12T17:58:21.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.891+0000 7fbc620919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.891+0000 7fbc620919c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:21.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.891+0000 7fbc620919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.895+0000 7fbc620919c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:58:21.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.895+0000 7fbc620919c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:21.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.895+0000 7fbc620919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.895+0000 7fbc620919c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:21.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.895+0000 7fbc620919c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:21.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.895+0000 7fbc620919c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:58:21.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.895+0000 7fbc620919c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:21.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.899+0000 7fbb15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:21.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.907+0000 7fbc620919c0 20 remove_watcher() i=0 2024-09-12T17:58:21.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.907+0000 7fbc620919c0 2 removed watcher, disabling cache 2024-09-12T17:58:21.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.907+0000 7fbc620919c0 20 remove_watcher() i=1 2024-09-12T17:58:21.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.911+0000 7fbc620919c0 20 remove_watcher() i=2 2024-09-12T17:58:21.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.911+0000 7fbc620919c0 20 remove_watcher() i=3 2024-09-12T17:58:21.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.915+0000 7fbc620919c0 20 remove_watcher() i=4 2024-09-12T17:58:21.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.915+0000 7fbc620919c0 20 remove_watcher() i=5 2024-09-12T17:58:21.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.915+0000 7fbc620919c0 20 remove_watcher() i=6 2024-09-12T17:58:21.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:21.919+0000 7fbc620919c0 20 remove_watcher() i=7 2024-09-12T17:58:21.937 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:21.937 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:58:21.937 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-commit-target-layout id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.31 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T17:58:21.937 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:21.939 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:21.939 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:21.967 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:21.967 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:22.552 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:22.552 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:22.939 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T17:58:22.939 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:22.941 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:22.941 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:23.059 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:23.059 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:23.147 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:23.147 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:23.250 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:23.250 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:23.350 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:23.350 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:23.444 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:23.444 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:23.543 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:23.543 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:23.633 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:23.633 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:23.732 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:23.732 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:23.833 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:23.833 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:23.917 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:23.917 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:24.018 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:24.018 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:24.119 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:24.119 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:24.204 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:24.204 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:24.305 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:24.305 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:24.401 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:24.401 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:24.500 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:24.500 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:24.596 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:24.597 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:24.697 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:24.697 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:24.805 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:24.806 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:24.903 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:24.904 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:24.999 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:24.999 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:25.087 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:58:25.120 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:25.120 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:25.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.163+0000 7fc7a46019c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.163+0000 7fc7a46019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.163+0000 7fc7a46019c0 20 realm 2024-09-12T17:58:25.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.163+0000 7fc7a46019c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.167+0000 7fc7a46019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.167+0000 7fc7a46019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:25.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.167+0000 7fc7a46019c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.167+0000 7fc7a46019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.167+0000 7fc7a46019c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.168 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.167+0000 7fc7a46019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:25.168 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.167+0000 7fc7a46019c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.169 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.167+0000 7fc7a46019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:25.169 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.167+0000 7fc7a46019c0 20 searching for the correct realm 2024-09-12T17:58:25.175 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.175+0000 7fc7a2908640 0 -- 172.21.15.98:0/3548311860 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x563793da1210 msgr2=0x563793da3600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:25.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.179+0000 7fc7a2107640 0 -- 172.21.15.98:0/3548311860 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fc78c0990d0 msgr2=0x7fc78c000ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:25.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.187+0000 7fc7a46019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:25.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.187+0000 7fc7a46019c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:58:25.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.187+0000 7fc7a46019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:25.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.187+0000 7fc7a46019c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:58:25.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.187+0000 7fc7a46019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:25.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.187+0000 7fc7a46019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:25.190 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.187+0000 7fc7a46019c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.190 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.187+0000 7fc7a46019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.190 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.187+0000 7fc7a46019c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.190 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.187+0000 7fc7a46019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:25.190 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.187+0000 7fc7a46019c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.191 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.191+0000 7fc7a46019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:25.191 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.191+0000 7fc7a46019c0 20 zone default found 2024-09-12T17:58:25.191 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.191+0000 7fc7a46019c0 4 Realm: () 2024-09-12T17:58:25.191 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.191+0000 7fc7a46019c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:58:25.191 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.191+0000 7fc7a46019c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:58:25.191 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.191+0000 7fc7a46019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:25.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.191+0000 7fc7a46019c0 20 zonegroup default 2024-09-12T17:58:25.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.191+0000 7fc7a46019c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.191+0000 7fc7a46019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.191+0000 7fc7a46019c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.191+0000 7fc7a46019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.191+0000 7fc7a46019c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.191+0000 7fc7a46019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.191+0000 7fc7a46019c0 20 started sync module instance, tier type = 2024-09-12T17:58:25.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.191+0000 7fc7a46019c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:58:25.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.207+0000 7fc7a46019c0 20 add_watcher() i=0 2024-09-12T17:58:25.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.207+0000 7fc7a46019c0 20 add_watcher() i=1 2024-09-12T17:58:25.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.207+0000 7fc7a46019c0 20 add_watcher() i=2 2024-09-12T17:58:25.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.207+0000 7fc7a46019c0 20 add_watcher() i=3 2024-09-12T17:58:25.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.207+0000 7fc7a46019c0 20 add_watcher() i=4 2024-09-12T17:58:25.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.207+0000 7fc7a46019c0 20 add_watcher() i=5 2024-09-12T17:58:25.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.207+0000 7fc7a46019c0 20 add_watcher() i=6 2024-09-12T17:58:25.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.207+0000 7fc7a46019c0 20 add_watcher() i=7 2024-09-12T17:58:25.211 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.207+0000 7fc7a46019c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:25.213 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.211+0000 7fc658fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:25.214 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.211+0000 7fc7a46019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:25.214 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.211+0000 7fc7a46019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:25.214 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.211+0000 7fc7a46019c0 5 note: GC not initialized 2024-09-12T17:58:25.214 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.211+0000 7fc5d37fe640 20 reqs_thread_entry: start 2024-09-12T17:58:25.214 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.211+0000 7fc7a46019c0 20 init_complete bucket index max shards: 11 2024-09-12T17:58:25.214 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.211+0000 7fc7a46019c0 20 Filter name: none 2024-09-12T17:58:25.214 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.211+0000 7fc5d17fa640 20 reqs_thread_entry: start 2024-09-12T17:58:25.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.211+0000 7fc7a46019c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.211+0000 7fc7a46019c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:25.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.211+0000 7fc7a46019c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.215+0000 7fc7a46019c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:58:25.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.215+0000 7fc7a46019c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:25.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.215+0000 7fc7a46019c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.215+0000 7fc7a46019c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:25.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.215+0000 7fc7a46019c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.215+0000 7fc7a46019c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:58:25.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.215+0000 7fc7a46019c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:25.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.219+0000 7fc658fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:25.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.223+0000 7fc7a46019c0 20 remove_watcher() i=0 2024-09-12T17:58:25.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.223+0000 7fc7a46019c0 2 removed watcher, disabling cache 2024-09-12T17:58:25.226 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.223+0000 7fc7a46019c0 20 remove_watcher() i=1 2024-09-12T17:58:25.228 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.227+0000 7fc7a46019c0 20 remove_watcher() i=2 2024-09-12T17:58:25.230 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.227+0000 7fc7a46019c0 20 remove_watcher() i=3 2024-09-12T17:58:25.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.231+0000 7fc7a46019c0 20 remove_watcher() i=4 2024-09-12T17:58:25.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.231+0000 7fc7a46019c0 20 remove_watcher() i=5 2024-09-12T17:58:25.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.235+0000 7fc7a46019c0 20 remove_watcher() i=6 2024-09-12T17:58:25.236 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.235+0000 7fc7a46019c0 20 remove_watcher() i=7 2024-09-12T17:58:25.249 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.253 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:58:25.253 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-commit-target-layout id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:58:25.253 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.253 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T17:58:25.281 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:25.281 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:25.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 realm 2024-09-12T17:58:25.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.323+0000 7f6e377c89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:25.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.327+0000 7f6e377c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:25.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.327+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.328 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.327+0000 7f6e377c89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:25.328 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.327+0000 7f6e377c89c0 20 searching for the correct realm 2024-09-12T17:58:25.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.331+0000 7f6e34acd640 0 -- 172.21.15.98:0/3966641589 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f6e280c5040 msgr2=0x7f6e28104f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:25.339 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.339+0000 7f6e34acd640 0 -- 172.21.15.98:0/3966641589 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f6d000811b0 msgr2=0x7f6d000835e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:25.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:25.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:58:25.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:25.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:58:25.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:25.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:25.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:25.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:25.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 zone default found 2024-09-12T17:58:25.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.347+0000 7f6e377c89c0 4 Realm: () 2024-09-12T17:58:25.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.347+0000 7f6e377c89c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:58:25.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.347+0000 7f6e377c89c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:58:25.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.347+0000 7f6e377c89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:25.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 zonegroup default 2024-09-12T17:58:25.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 started sync module instance, tier type = 2024-09-12T17:58:25.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:58:25.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=0 2024-09-12T17:58:25.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=1 2024-09-12T17:58:25.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=2 2024-09-12T17:58:25.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=3 2024-09-12T17:58:25.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=4 2024-09-12T17:58:25.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=5 2024-09-12T17:58:25.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=6 2024-09-12T17:58:25.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=7 2024-09-12T17:58:25.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.363+0000 7f6e377c89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:25.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.367+0000 7f6ceb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:25.369 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:25.369 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:25.369 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 note: GC not initialized 2024-09-12T17:58:25.369 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.367+0000 7f6cea7e4640 20 reqs_thread_entry: start 2024-09-12T17:58:25.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 init_complete bucket index max shards: 11 2024-09-12T17:58:25.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 Filter name: none 2024-09-12T17:58:25.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.367+0000 7f6c5bfff640 20 reqs_thread_entry: start 2024-09-12T17:58:25.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.367+0000 7f6e377c89c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:58:25.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:25.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.367+0000 7f6e377c89c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:58:25.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.367+0000 7f6e377c89c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:58:25.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.367+0000 7f6e377c89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 : miss 2024-09-12T17:58:25.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.371+0000 7f6e377c89c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:58:25.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.371+0000 7f6e377c89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:25.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.371+0000 7f6e377c89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:25.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.371+0000 7f6e377c89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:25.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.371+0000 7f6e377c89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:25.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.371+0000 7f6e377c89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 2024-09-12T17:58:25.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.383+0000 7f6e377c89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:25.384 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.383+0000 7f6e377c89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:25.384 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.383+0000 7f6e377c89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:25.384 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.383+0000 7f6e377c89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32, ofs0, ns] 2024-09-12T17:58:25.384 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.383+0000 7f6d18ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366192 cookie 94604470130368 notifier 7443 bl.length()=931 2024-09-12T17:58:25.384 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.383+0000 7f6d18ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:25.384 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.383+0000 7f6d18ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:25.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.383+0000 7f6d18ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:25.387 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.383+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): orig_sources= new_sources= 2024-09-12T17:58:25.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.383+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): potential sources added=[] removed=[] 2024-09-12T17:58:25.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.383+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): orig_dests= new_dests= 2024-09-12T17:58:25.389 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.383+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): potential dests added=[] removed=[] 2024-09-12T17:58:25.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.0 2024-09-12T17:58:25.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.0 2024-09-12T17:58:25.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.1 2024-09-12T17:58:25.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.1 2024-09-12T17:58:25.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.2 2024-09-12T17:58:25.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.2 2024-09-12T17:58:25.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.3 2024-09-12T17:58:25.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.3 2024-09-12T17:58:25.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.4 2024-09-12T17:58:25.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.4 2024-09-12T17:58:25.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.5 2024-09-12T17:58:25.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.5 2024-09-12T17:58:25.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.6 2024-09-12T17:58:25.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.6 2024-09-12T17:58:25.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.7 2024-09-12T17:58:25.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.7 2024-09-12T17:58:25.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.8 2024-09-12T17:58:25.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.8 2024-09-12T17:58:25.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.9 2024-09-12T17:58:25.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.9 2024-09-12T17:58:25.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.10 2024-09-12T17:58:25.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.10 2024-09-12T17:58:25.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.11 2024-09-12T17:58:25.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.11 2024-09-12T17:58:25.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.0 2024-09-12T17:58:25.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1 2024-09-12T17:58:25.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.2 2024-09-12T17:58:25.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.399+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.3 2024-09-12T17:58:25.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.399+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.4 2024-09-12T17:58:25.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.399+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.5 2024-09-12T17:58:25.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.399+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.6 2024-09-12T17:58:25.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.399+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.7 2024-09-12T17:58:25.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.399+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.8 2024-09-12T17:58:25.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.403+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.9 2024-09-12T17:58:25.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.403+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.10 2024-09-12T17:58:25.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.407+0000 7f6e377c89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:58:25.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.407+0000 7f6e377c89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 2024-09-12T17:58:25.412 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.411+0000 7f6e377c89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:25.412 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.411+0000 7f6e377c89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:25.412 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.411+0000 7f6e377c89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:25.412 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.411+0000 7f6e377c89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32, ofs0, ns] 2024-09-12T17:58:25.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.411+0000 7f6d18ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366193 cookie 94604470130368 notifier 7443 bl.length()=931 2024-09-12T17:58:25.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.411+0000 7f6d18ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:25.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.411+0000 7f6d18ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:25.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.411+0000 7f6d18ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:25.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.415+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): orig_sources= new_sources= 2024-09-12T17:58:25.415 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.415+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): potential sources added=[] removed=[] 2024-09-12T17:58:25.415 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.415+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): orig_dests= new_dests= 2024-09-12T17:58:25.415 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.415+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): potential dests added=[] removed=[] 2024-09-12T17:58:25.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.0 2024-09-12T17:58:25.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1 2024-09-12T17:58:25.420 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.2 2024-09-12T17:58:25.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.3 2024-09-12T17:58:25.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.4 2024-09-12T17:58:25.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.5 2024-09-12T17:58:25.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.6 2024-09-12T17:58:25.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.423+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.7 2024-09-12T17:58:25.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.423+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.8 2024-09-12T17:58:25.424 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.423+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.9 2024-09-12T17:58:25.424 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.423+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.10 2024-09-12T17:58:25.425 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6e377c89c0 time 2024-09-12T17:58:25.426814+0000 2024-09-12T17:58:25.425 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:58:25.426 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:25.426 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f6e3b0a22eb] 2024-09-12T17:58:25.426 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f6e3b0a249f] 2024-09-12T17:58:25.426 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560aceeb60c1] 2024-09-12T17:58:25.427 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x560aceec8467] 2024-09-12T17:58:25.427 INFO:tasks.workunit.client.0.smithi098.stderr: 5: main() 2024-09-12T17:58:25.427 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f6e39f08d90] 2024-09-12T17:58:25.427 INFO:tasks.workunit.client.0.smithi098.stderr: 7: __libc_start_main() 2024-09-12T17:58:25.427 INFO:tasks.workunit.client.0.smithi098.stderr: 8: _start() 2024-09-12T17:58:25.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.423+0000 7f6e377c89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6e377c89c0 time 2024-09-12T17:58:25.426814+0000 2024-09-12T17:58:25.427 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:58:25.427 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.427 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:25.427 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f6e3b0a22eb] 2024-09-12T17:58:25.427 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f6e3b0a249f] 2024-09-12T17:58:25.428 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560aceeb60c1] 2024-09-12T17:58:25.428 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x560aceec8467] 2024-09-12T17:58:25.428 INFO:tasks.workunit.client.0.smithi098.stderr: 5: main() 2024-09-12T17:58:25.428 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f6e39f08d90] 2024-09-12T17:58:25.428 INFO:tasks.workunit.client.0.smithi098.stderr: 7: __libc_start_main() 2024-09-12T17:58:25.428 INFO:tasks.workunit.client.0.smithi098.stderr: 8: _start() 2024-09-12T17:58:25.428 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.428 INFO:tasks.workunit.client.0.smithi098.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:58:25.428 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f6e377c89c0 thread_name:radosgw-admin 2024-09-12T17:58:25.457 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:25.457 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f6e39f21520] 2024-09-12T17:58:25.457 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:58:25.458 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:58:25.458 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:58:25.458 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f6e3b0a2345] 2024-09-12T17:58:25.458 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f6e3b0a249f] 2024-09-12T17:58:25.458 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560aceeb60c1] 2024-09-12T17:58:25.458 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x560aceec8467] 2024-09-12T17:58:25.458 INFO:tasks.workunit.client.0.smithi098.stderr: 9: main() 2024-09-12T17:58:25.458 INFO:tasks.workunit.client.0.smithi098.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f6e39f08d90] 2024-09-12T17:58:25.458 INFO:tasks.workunit.client.0.smithi098.stderr: 11: __libc_start_main() 2024-09-12T17:58:25.458 INFO:tasks.workunit.client.0.smithi098.stderr: 12: _start() 2024-09-12T17:58:25.458 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.427+0000 7f6e377c89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:58:25.458 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f6e377c89c0 thread_name:radosgw-admin 2024-09-12T17:58:25.458 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.459 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:25.459 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f6e39f21520] 2024-09-12T17:58:25.459 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:58:25.459 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:58:25.459 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:58:25.459 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f6e3b0a2345] 2024-09-12T17:58:25.459 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f6e3b0a249f] 2024-09-12T17:58:25.459 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560aceeb60c1] 2024-09-12T17:58:25.459 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x560aceec8467] 2024-09-12T17:58:25.459 INFO:tasks.workunit.client.0.smithi098.stderr: 9: main() 2024-09-12T17:58:25.459 INFO:tasks.workunit.client.0.smithi098.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f6e39f08d90] 2024-09-12T17:58:25.459 INFO:tasks.workunit.client.0.smithi098.stderr: 11: __libc_start_main() 2024-09-12T17:58:25.459 INFO:tasks.workunit.client.0.smithi098.stderr: 12: _start() 2024-09-12T17:58:25.460 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:58:25.460 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.460 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T17:58:25.460 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.460 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.460 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command rotate-key hook 0x560ad1c68ff8 2024-09-12T17:58:25.460 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient: _reopen_session rank -1 2024-09-12T17:58:25.460 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:58:25.460 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-c con 0x560ad1b18d00 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:58:25.460 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-b con 0x560ad1b190e0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:58:25.460 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-a con 0x560ad1b194f0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:58:25.460 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.460 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.461 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.461 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient(hunting): _renew_subs 2024-09-12T17:58:25.461 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient(hunting): authenticate will time out at 2701.874182s 2024-09-12T17:58:25.461 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T17:58:25.303+0000 7f6e35acf640 10 monclient(hunting): get_auth_request con 0x560ad1b194f0 auth_method 0 2024-09-12T17:58:25.461 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T17:58:25.303+0000 7f6e35acf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:25.461 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T17:58:25.303+0000 7f6e35acf640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:25.461 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T17:58:25.303+0000 7f6e35acf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:25.461 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T17:58:25.303+0000 7f6e352ce640 10 monclient(hunting): get_auth_request con 0x560ad1b18d00 auth_method 0 2024-09-12T17:58:25.461 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T17:58:25.303+0000 7f6e352ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:25.461 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T17:58:25.303+0000 7f6e352ce640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:25.461 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T17:58:25.303+0000 7f6e352ce640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:25.461 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T17:58:25.303+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:25.461 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T17:58:25.303+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:25.461 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T17:58:25.303+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:25.462 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T17:58:25.303+0000 7f6e352ce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:25.462 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T17:58:25.303+0000 7f6e352ce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:25.462 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T17:58:25.303+0000 7f6e352ce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:25.462 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T17:58:25.303+0000 7f6e35acf640 10 monclient(hunting): handle_auth_done global_id 7434 payload 824 2024-09-12T17:58:25.462 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T17:58:25.303+0000 7f6e35acf640 10 monclient: _finish_hunting 0 2024-09-12T17:58:25.462 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T17:58:25.303+0000 7f6e35acf640 1 monclient: found mon.noname-a 2024-09-12T17:58:25.462 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T17:58:25.303+0000 7f6e35acf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.462 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T17:58:25.303+0000 7f6d21e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:25.462 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T17:58:25.303+0000 7f6d21e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:25.462 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T17:58:25.303+0000 7f6d21e03640 10 monclient: dump: 2024-09-12T17:58:25.462 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:58:25.462 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:58:25.462 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.462 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.463 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:25.463 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.463 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:58:25.463 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:58:25.463 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:58:25.463 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.463 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T17:58:25.303+0000 7f6d21e03640 10 monclient: _finish_auth 0 2024-09-12T17:58:25.463 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T17:58:25.303+0000 7f6d21e03640 10 monclient: _check_auth_tickets 2024-09-12T17:58:25.463 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T17:58:25.303+0000 7f6d21e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:25.463 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T17:58:25.303+0000 7f6d21e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:25.463 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T17:58:25.303+0000 7f6d21e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:25.463 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T17:58:25.303+0000 7f6d21e03640 10 monclient: dump: 2024-09-12T17:58:25.463 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:58:25.463 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:58:25.464 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.464 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.464 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:25.464 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.464 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:58:25.464 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:58:25.464 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:58:25.464 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.464 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 5 monclient: authenticate success, global_id 7434 2024-09-12T17:58:25.465 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T17:58:25.303+0000 7f6d23606640 4 set_mon_vals no callback set 2024-09-12T17:58:25.465 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient: _renew_subs 2024-09-12T17:58:25.465 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.465 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient: _renew_subs 2024-09-12T17:58:25.465 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.465 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 1 librados: init done 2024-09-12T17:58:25.465 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T17:58:25.307+0000 7f6d21e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:58:25.465 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T17:58:25.307+0000 7f6d21e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:58:25.465 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T17:58:25.307+0000 7f6d21e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:58:25.465 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T17:58:25.307+0000 7f6e352ce640 10 monclient: get_auth_request con 0x7f6d1c070b10 auth_method 0 2024-09-12T17:58:25.465 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T17:58:25.307+0000 7f6e34acd640 10 monclient: get_auth_request con 0x560ad1ca8230 auth_method 0 2024-09-12T17:58:25.465 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T17:58:25.307+0000 7f6e352ce640 10 monclient: get_auth_request con 0x560ad1cb4930 auth_method 0 2024-09-12T17:58:25.465 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T17:58:25.311+0000 7f6e34acd640 10 monclient: get_auth_request con 0x560ad1cb81e0 auth_method 0 2024-09-12T17:58:25.466 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 10 monclient: build_initial_monmap 2024-09-12T17:58:25.466 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 1 build_initial for_mkfs: 0 2024-09-12T17:58:25.466 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 10 monclient: monmap: 2024-09-12T17:58:25.466 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:58:25.466 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:25.466 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:58:25.466 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:58:25.466 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:25.466 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.466 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:58:25.466 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:58:25.466 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:58:25.466 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.467 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding auth protocol: cephx 2024-09-12T17:58:25.467 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding auth protocol: cephx 2024-09-12T17:58:25.467 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding auth protocol: cephx 2024-09-12T17:58:25.467 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: secure 2024-09-12T17:58:25.467 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: crc 2024-09-12T17:58:25.467 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: secure 2024-09-12T17:58:25.467 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: crc 2024-09-12T17:58:25.467 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: secure 2024-09-12T17:58:25.467 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: crc 2024-09-12T17:58:25.467 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: crc 2024-09-12T17:58:25.467 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: secure 2024-09-12T17:58:25.467 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: crc 2024-09-12T17:58:25.467 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: secure 2024-09-12T17:58:25.467 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: crc 2024-09-12T17:58:25.468 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: secure 2024-09-12T17:58:25.468 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.468 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x560ad1cc1540 EEXIST 2024-09-12T17:58:25.468 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 10 monclient: init 2024-09-12T17:58:25.468 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding auth protocol: cephx 2024-09-12T17:58:25.468 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding auth protocol: cephx 2024-09-12T17:58:25.468 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding auth protocol: cephx 2024-09-12T17:58:25.468 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: secure 2024-09-12T17:58:25.468 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: crc 2024-09-12T17:58:25.468 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: secure 2024-09-12T17:58:25.468 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: crc 2024-09-12T17:58:25.468 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: secure 2024-09-12T17:58:25.468 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: crc 2024-09-12T17:58:25.469 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: crc 2024-09-12T17:58:25.469 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: secure 2024-09-12T17:58:25.469 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: crc 2024-09-12T17:58:25.469 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: secure 2024-09-12T17:58:25.469 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: crc 2024-09-12T17:58:25.469 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: secure 2024-09-12T17:58:25.469 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.469 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.469 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command rotate-key cmddesc rotate-key hook 0x560ad1cbccf0 EEXIST 2024-09-12T17:58:25.469 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 10 monclient: _reopen_session rank -1 2024-09-12T17:58:25.469 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:58:25.469 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-a con 0x560ad1ce56f0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:58:25.469 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-b con 0x560ad1ce5020 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:58:25.469 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-c con 0x560ad1ce3a00 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:58:25.470 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.470 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.470 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.470 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): _renew_subs 2024-09-12T17:58:25.470 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): authenticate will time out at 2701.884054s 2024-09-12T17:58:25.470 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T17:58:25.315+0000 7f6e352ce640 10 monclient(hunting): get_auth_request con 0x560ad1ce56f0 auth_method 0 2024-09-12T17:58:25.470 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T17:58:25.315+0000 7f6e352ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:25.470 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T17:58:25.315+0000 7f6e352ce640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:25.470 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T17:58:25.315+0000 7f6e352ce640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:25.470 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T17:58:25.315+0000 7f6e35acf640 10 monclient(hunting): get_auth_request con 0x560ad1ce3a00 auth_method 0 2024-09-12T17:58:25.470 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T17:58:25.315+0000 7f6e35acf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:25.470 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T17:58:25.315+0000 7f6e35acf640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:25.470 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T17:58:25.315+0000 7f6e35acf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:25.470 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T17:58:25.315+0000 7f6e352ce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:25.471 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T17:58:25.315+0000 7f6e352ce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:25.471 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T17:58:25.315+0000 7f6e352ce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:25.471 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T17:58:25.315+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:25.471 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T17:58:25.315+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:25.471 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T17:58:25.315+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:25.471 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T17:58:25.315+0000 7f6e34acd640 10 monclient(hunting): get_auth_request con 0x560ad1ce5020 auth_method 0 2024-09-12T17:58:25.471 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T17:58:25.315+0000 7f6e34acd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:25.471 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T17:58:25.315+0000 7f6e34acd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:25.471 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T17:58:25.315+0000 7f6e34acd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:25.471 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T17:58:25.315+0000 7f6e352ce640 10 monclient(hunting): handle_auth_done global_id 7437 payload 824 2024-09-12T17:58:25.471 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T17:58:25.315+0000 7f6e352ce640 10 monclient: _finish_hunting 0 2024-09-12T17:58:25.471 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T17:58:25.315+0000 7f6e352ce640 1 monclient: found mon.noname-a 2024-09-12T17:58:25.471 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T17:58:25.315+0000 7f6e352ce640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.472 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T17:58:25.315+0000 7f6d1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:25.472 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T17:58:25.315+0000 7f6d1affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:25.472 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T17:58:25.315+0000 7f6d1affd640 10 monclient: dump: 2024-09-12T17:58:25.472 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:58:25.472 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:58:25.472 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.472 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.472 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:25.472 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.472 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:58:25.472 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:58:25.472 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:58:25.472 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.473 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T17:58:25.315+0000 7f6d1affd640 10 monclient: _finish_auth 0 2024-09-12T17:58:25.473 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T17:58:25.315+0000 7f6d1affd640 10 monclient: _check_auth_tickets 2024-09-12T17:58:25.473 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T17:58:25.315+0000 7f6d1affd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:25.473 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T17:58:25.315+0000 7f6d1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:25.473 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T17:58:25.315+0000 7f6d1affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:25.473 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T17:58:25.315+0000 7f6d1affd640 10 monclient: dump: 2024-09-12T17:58:25.473 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:58:25.473 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:58:25.473 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.473 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.473 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:25.473 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.473 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:58:25.474 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:58:25.474 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:58:25.474 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.474 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 monclient: authenticate success, global_id 7437 2024-09-12T17:58:25.474 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient: _renew_subs 2024-09-12T17:58:25.474 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T17:58:25.315+0000 7f6e362d0640 4 set_mon_vals no callback set 2024-09-12T17:58:25.474 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.474 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient: _renew_subs 2024-09-12T17:58:25.474 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.474 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T17:58:25.315+0000 7f6d1affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:58:25.474 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T17:58:25.315+0000 7f6d1affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:58:25.474 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T17:58:25.315+0000 7f6d1affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:58:25.474 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient: get_monmap_and_config 2024-09-12T17:58:25.474 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient: build_initial_monmap 2024-09-12T17:58:25.475 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 1 build_initial for_mkfs: 0 2024-09-12T17:58:25.475 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient: monmap: 2024-09-12T17:58:25.475 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:58:25.475 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:25.475 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:58:25.475 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:58:25.475 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:25.475 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.475 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:58:25.475 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:58:25.475 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:58:25.475 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.475 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding auth protocol: cephx 2024-09-12T17:58:25.476 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding auth protocol: cephx 2024-09-12T17:58:25.476 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding auth protocol: cephx 2024-09-12T17:58:25.476 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: secure 2024-09-12T17:58:25.476 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: crc 2024-09-12T17:58:25.476 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: secure 2024-09-12T17:58:25.476 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: crc 2024-09-12T17:58:25.476 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: secure 2024-09-12T17:58:25.476 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: crc 2024-09-12T17:58:25.476 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: crc 2024-09-12T17:58:25.476 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: secure 2024-09-12T17:58:25.476 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: crc 2024-09-12T17:58:25.476 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: secure 2024-09-12T17:58:25.476 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: crc 2024-09-12T17:58:25.477 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: secure 2024-09-12T17:58:25.477 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T17:58:25.315+0000 7f6e34acd640 10 monclient: get_auth_request con 0x7f6d10070a20 auth_method 0 2024-09-12T17:58:25.477 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.477 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient: init 2024-09-12T17:58:25.477 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding auth protocol: cephx 2024-09-12T17:58:25.477 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding auth protocol: cephx 2024-09-12T17:58:25.477 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding auth protocol: cephx 2024-09-12T17:58:25.477 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: secure 2024-09-12T17:58:25.477 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: crc 2024-09-12T17:58:25.477 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: secure 2024-09-12T17:58:25.477 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: crc 2024-09-12T17:58:25.477 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: secure 2024-09-12T17:58:25.477 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: crc 2024-09-12T17:58:25.477 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: crc 2024-09-12T17:58:25.478 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: secure 2024-09-12T17:58:25.478 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: crc 2024-09-12T17:58:25.478 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: secure 2024-09-12T17:58:25.478 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: crc 2024-09-12T17:58:25.478 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: secure 2024-09-12T17:58:25.478 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.478 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.478 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command rotate-key cmddesc rotate-key hook 0x7fffa1aa4988 EEXIST 2024-09-12T17:58:25.478 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient: _reopen_session rank -1 2024-09-12T17:58:25.479 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:58:25.479 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-b con 0x560ad1d39680 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:58:25.479 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-a con 0x560ad1d34ac0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:58:25.479 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-c con 0x560ad1d2b190 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:58:25.479 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.479 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.479 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.479 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): _renew_subs 2024-09-12T17:58:25.479 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): authenticate will time out at 2701.887960s 2024-09-12T17:58:25.479 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): get_auth_request con 0x560ad1d34ac0 auth_method 0 2024-09-12T17:58:25.479 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:25.479 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:25.479 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:25.479 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): get_auth_request con 0x560ad1d2b190 auth_method 0 2024-09-12T17:58:25.480 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:25.480 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:25.480 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:25.480 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:25.480 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:25.480 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:25.480 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:25.480 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:25.480 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:25.480 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): handle_auth_done global_id 7440 payload 274 2024-09-12T17:58:25.480 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient: _finish_hunting 0 2024-09-12T17:58:25.480 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T17:58:25.319+0000 7f6e34acd640 1 monclient: found mon.noname-a 2024-09-12T17:58:25.481 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.481 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T17:58:25.319+0000 7f6e352ce640 10 monclient: get_auth_request con 0x560ad1d39680 auth_method 0 2024-09-12T17:58:25.481 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T17:58:25.319+0000 7f6d18ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:25.481 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T17:58:25.319+0000 7f6d18ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:25.481 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T17:58:25.319+0000 7f6d18ff9640 10 monclient: dump: 2024-09-12T17:58:25.481 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:58:25.481 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:58:25.481 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.481 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.481 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:25.481 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.481 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:58:25.481 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:58:25.481 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:58:25.482 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.482 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T17:58:25.319+0000 7f6d18ff9640 10 monclient: _finish_auth 0 2024-09-12T17:58:25.482 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T17:58:25.319+0000 7f6d18ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:58:25.482 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T17:58:25.319+0000 7f6d18ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:25.482 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T17:58:25.319+0000 7f6d18ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:25.482 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T17:58:25.319+0000 7f6d18ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:25.482 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T17:58:25.319+0000 7f6d18ff9640 10 monclient: dump: 2024-09-12T17:58:25.482 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:58:25.482 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:58:25.482 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.482 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.482 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:25.482 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.483 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:58:25.483 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:58:25.483 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:58:25.483 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.483 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 monclient: authenticate success, global_id 7440 2024-09-12T17:58:25.483 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: get_monmap_and_config success 2024-09-12T17:58:25.483 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 4 set_mon_vals no callback set 2024-09-12T17:58:25.483 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: shutdown 2024-09-12T17:58:25.483 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: build_initial_monmap 2024-09-12T17:58:25.483 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 1 build_initial for_mkfs: 0 2024-09-12T17:58:25.483 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: monmap: 2024-09-12T17:58:25.483 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:58:25.483 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:25.483 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:58:25.484 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:58:25.484 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:25.484 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.484 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:58:25.484 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:58:25.484 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:58:25.484 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.484 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding auth protocol: cephx 2024-09-12T17:58:25.484 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding auth protocol: cephx 2024-09-12T17:58:25.484 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding auth protocol: cephx 2024-09-12T17:58:25.484 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: secure 2024-09-12T17:58:25.484 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: crc 2024-09-12T17:58:25.484 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: secure 2024-09-12T17:58:25.484 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: crc 2024-09-12T17:58:25.485 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: secure 2024-09-12T17:58:25.485 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: crc 2024-09-12T17:58:25.485 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: crc 2024-09-12T17:58:25.485 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: secure 2024-09-12T17:58:25.485 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: crc 2024-09-12T17:58:25.485 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: secure 2024-09-12T17:58:25.485 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: crc 2024-09-12T17:58:25.485 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: secure 2024-09-12T17:58:25.485 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.486 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 1 librados: starting msgr at 2024-09-12T17:58:25.486 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 1 librados: starting objecter 2024-09-12T17:58:25.486 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x560ad1d0b610 EEXIST 2024-09-12T17:58:25.486 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 1 librados: setting wanted keys 2024-09-12T17:58:25.486 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 1 librados: calling monclient init 2024-09-12T17:58:25.486 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: init 2024-09-12T17:58:25.486 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding auth protocol: cephx 2024-09-12T17:58:25.486 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding auth protocol: cephx 2024-09-12T17:58:25.486 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding auth protocol: cephx 2024-09-12T17:58:25.486 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: secure 2024-09-12T17:58:25.486 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: crc 2024-09-12T17:58:25.486 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: secure 2024-09-12T17:58:25.486 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: crc 2024-09-12T17:58:25.487 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: secure 2024-09-12T17:58:25.487 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: crc 2024-09-12T17:58:25.487 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: crc 2024-09-12T17:58:25.487 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: secure 2024-09-12T17:58:25.487 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: crc 2024-09-12T17:58:25.487 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: secure 2024-09-12T17:58:25.487 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: crc 2024-09-12T17:58:25.487 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: secure 2024-09-12T17:58:25.487 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.487 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.487 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command rotate-key cmddesc rotate-key hook 0x560ad1ce7658 EEXIST 2024-09-12T17:58:25.487 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: _reopen_session rank -1 2024-09-12T17:58:25.487 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:58:25.487 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-b con 0x560ad1d2b190 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:58:25.488 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-a con 0x560ad1d34ac0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:58:25.488 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-c con 0x560ad1d39680 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:58:25.488 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.488 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.488 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.488 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient(hunting): _renew_subs 2024-09-12T17:58:25.488 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient(hunting): authenticate will time out at 2701.890564s 2024-09-12T17:58:25.488 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): get_auth_request con 0x560ad1d34ac0 auth_method 0 2024-09-12T17:58:25.488 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:25.488 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:25.488 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:25.488 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): get_auth_request con 0x560ad1d39680 auth_method 0 2024-09-12T17:58:25.488 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:25.489 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:25.489 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:25.489 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:25.489 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:25.489 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:25.489 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:25.489 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:25.489 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:25.490 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): handle_auth_done global_id 7443 payload 824 2024-09-12T17:58:25.490 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient: _finish_hunting 0 2024-09-12T17:58:25.490 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T17:58:25.319+0000 7f6e34acd640 1 monclient: found mon.noname-a 2024-09-12T17:58:25.491 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.491 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T17:58:25.319+0000 7f6d06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:25.491 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T17:58:25.319+0000 7f6d06ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:25.491 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T17:58:25.319+0000 7f6d06ffd640 10 monclient: dump: 2024-09-12T17:58:25.491 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:58:25.491 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:58:25.491 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.491 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.491 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:25.491 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.491 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:58:25.491 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:58:25.491 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:58:25.491 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.492 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T17:58:25.319+0000 7f6d06ffd640 10 monclient: _finish_auth 0 2024-09-12T17:58:25.492 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T17:58:25.319+0000 7f6d06ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:58:25.492 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T17:58:25.319+0000 7f6d06ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:25.492 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T17:58:25.319+0000 7f6d06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:25.492 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T17:58:25.319+0000 7f6d06ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:25.492 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T17:58:25.319+0000 7f6d06ffd640 10 monclient: dump: 2024-09-12T17:58:25.492 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:58:25.492 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:58:25.492 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.492 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.492 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:25.492 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.492 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:58:25.493 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:58:25.493 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:58:25.493 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.493 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 monclient: authenticate success, global_id 7443 2024-09-12T17:58:25.493 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T17:58:25.319+0000 7f6d18ff9640 4 set_mon_vals no callback set 2024-09-12T17:58:25.493 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: _renew_subs 2024-09-12T17:58:25.493 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.493 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: _renew_subs 2024-09-12T17:58:25.493 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.493 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 1 librados: init done 2024-09-12T17:58:25.493 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command cr dump hook 0x560ad1d2d4c8 2024-09-12T17:58:25.493 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.493 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T17:58:25.323+0000 7f6d06ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:58:25.493 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T17:58:25.323+0000 7f6d06ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:58:25.494 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T17:58:25.323+0000 7f6d06ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:58:25.494 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T17:58:25.323+0000 7f6e35acf640 10 monclient: get_auth_request con 0x560ad1d52fe0 auth_method 0 2024-09-12T17:58:25.494 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T17:58:25.323+0000 7f6e352ce640 10 monclient: get_auth_request con 0x7f6d00070b10 auth_method 0 2024-09-12T17:58:25.494 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.494 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 realm 2024-09-12T17:58:25.494 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.494 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.494 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T17:58:25.323+0000 7f6e377c89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:25.494 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.494 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.494 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.494 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T17:58:25.323+0000 7f6e352ce640 10 monclient: get_auth_request con 0x560ad1d57210 auth_method 0 2024-09-12T17:58:25.494 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T17:58:25.327+0000 7f6e377c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:25.495 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T17:58:25.327+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.495 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T17:58:25.327+0000 7f6e377c89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:25.495 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T17:58:25.327+0000 7f6e377c89c0 20 searching for the correct realm 2024-09-12T17:58:25.495 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T17:58:25.327+0000 7f6e34acd640 10 monclient: get_auth_request con 0x560ad1d5c480 auth_method 0 2024-09-12T17:58:25.495 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T17:58:25.327+0000 7f6e35acf640 10 monclient: get_auth_request con 0x7f6e2c01d040 auth_method 0 2024-09-12T17:58:25.495 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T17:58:25.327+0000 7f6e352ce640 10 monclient: get_auth_request con 0x7f6e30028070 auth_method 0 2024-09-12T17:58:25.495 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T17:58:25.331+0000 7f6e34acd640 10 monclient: get_auth_request con 0x7f6e280c5040 auth_method 0 2024-09-12T17:58:25.495 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T17:58:25.331+0000 7f6e34acd640 0 -- 172.21.15.98:0/3966641589 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f6e280c5040 msgr2=0x7f6e28104f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:25.495 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T17:58:25.331+0000 7f6d06ffd640 1 client.7443.objecter ms_handle_reset 0x7f6e280c5040 session 0x7f6e280a6070 osd.4 2024-09-12T17:58:25.495 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T17:58:25.331+0000 7f6d06ffd640 10 monclient: _renew_subs 2024-09-12T17:58:25.495 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T17:58:25.331+0000 7f6d06ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.495 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T17:58:25.331+0000 7f6e35acf640 10 monclient: get_auth_request con 0x7f6e2c06d2d0 auth_method 0 2024-09-12T17:58:25.495 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T17:58:25.331+0000 7f6e34acd640 10 monclient: get_auth_request con 0x7f6d000811b0 auth_method 0 2024-09-12T17:58:25.496 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T17:58:25.335+0000 7f6e352ce640 10 monclient: get_auth_request con 0x7f6e2c069110 auth_method 0 2024-09-12T17:58:25.496 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T17:58:25.339+0000 7f6e34acd640 0 -- 172.21.15.98:0/3966641589 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f6d000811b0 msgr2=0x7f6d000835e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:25.496 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T17:58:25.339+0000 7f6d06ffd640 1 client.7443.objecter ms_handle_reset 0x7f6d000811b0 session 0x7f6e280a6070 osd.4 2024-09-12T17:58:25.496 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T17:58:25.339+0000 7f6e34acd640 10 monclient: get_auth_request con 0x7f6e280c5040 auth_method 0 2024-09-12T17:58:25.496 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:25.496 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:58:25.496 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:25.496 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:58:25.497 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:25.497 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:25.497 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.497 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.497 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.497 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:25.497 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.497 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:25.497 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 zone default found 2024-09-12T17:58:25.497 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 4 Realm: () 2024-09-12T17:58:25.497 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:58:25.497 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:58:25.497 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:25.498 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 zonegroup default 2024-09-12T17:58:25.498 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.498 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.498 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.498 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.498 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.498 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.498 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 started sync module instance, tier type = 2024-09-12T17:58:25.498 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:58:25.498 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=0 2024-09-12T17:58:25.498 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=1 2024-09-12T17:58:25.498 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=2 2024-09-12T17:58:25.499 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=3 2024-09-12T17:58:25.499 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=4 2024-09-12T17:58:25.499 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=5 2024-09-12T17:58:25.499 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=6 2024-09-12T17:58:25.499 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=7 2024-09-12T17:58:25.499 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T17:58:25.363+0000 7f6e377c89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:25.499 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding auth protocol: cephx 2024-09-12T17:58:25.499 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding auth protocol: cephx 2024-09-12T17:58:25.499 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding auth protocol: cephx 2024-09-12T17:58:25.499 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: secure 2024-09-12T17:58:25.499 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: crc 2024-09-12T17:58:25.499 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: secure 2024-09-12T17:58:25.499 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: crc 2024-09-12T17:58:25.500 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: secure 2024-09-12T17:58:25.500 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: crc 2024-09-12T17:58:25.500 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: crc 2024-09-12T17:58:25.500 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: secure 2024-09-12T17:58:25.500 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: crc 2024-09-12T17:58:25.500 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: secure 2024-09-12T17:58:25.500 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T17:58:25.367+0000 7f6ceb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:25.500 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: crc 2024-09-12T17:58:25.502 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: secure 2024-09-12T17:58:25.502 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.502 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:25.502 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:25.503 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command cache list hook 0x560ad1d2f010 2024-09-12T17:58:25.503 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command cache inspect hook 0x560ad1d2f010 2024-09-12T17:58:25.503 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command cache erase hook 0x560ad1d2f010 2024-09-12T17:58:25.503 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command cache zap hook 0x560ad1d2f010 2024-09-12T17:58:25.503 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 note: GC not initialized 2024-09-12T17:58:25.503 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T17:58:25.367+0000 7f6cea7e4640 20 reqs_thread_entry: start 2024-09-12T17:58:25.503 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command sync trace show hook 0x7f6e2c0026b0 2024-09-12T17:58:25.503 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command sync trace history hook 0x7f6e2c0026b0 2024-09-12T17:58:25.503 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command sync trace active hook 0x7f6e2c0026b0 2024-09-12T17:58:25.503 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command sync trace active_short hook 0x7f6e2c0026b0 2024-09-12T17:58:25.503 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 init_complete bucket index max shards: 11 2024-09-12T17:58:25.503 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 Filter name: none 2024-09-12T17:58:25.504 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T17:58:25.367+0000 7f6c5bfff640 20 reqs_thread_entry: start 2024-09-12T17:58:25.504 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:58:25.504 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.504 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:25.504 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:58:25.504 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:58:25.504 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 : miss 2024-09-12T17:58:25.504 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.504 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T17:58:25.371+0000 7f6e377c89c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:58:25.504 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T17:58:25.371+0000 7f6e377c89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:25.504 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T17:58:25.371+0000 7f6e377c89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:25.504 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T17:58:25.371+0000 7f6e377c89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:25.504 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T17:58:25.371+0000 7f6e377c89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:25.505 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T17:58:25.371+0000 7f6e377c89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 2024-09-12T17:58:25.505 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T17:58:25.383+0000 7f6e377c89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:25.505 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T17:58:25.383+0000 7f6e377c89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:25.505 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T17:58:25.383+0000 7f6e377c89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:25.505 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T17:58:25.383+0000 7f6e377c89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32, ofs0, ns] 2024-09-12T17:58:25.505 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T17:58:25.383+0000 7f6d18ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366192 cookie 94604470130368 notifier 7443 bl.length()=931 2024-09-12T17:58:25.505 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T17:58:25.383+0000 7f6d18ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:25.505 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T17:58:25.383+0000 7f6d18ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:25.505 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T17:58:25.383+0000 7f6d18ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:25.505 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T17:58:25.383+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): orig_sources= new_sources= 2024-09-12T17:58:25.505 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T17:58:25.383+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): potential sources added=[] removed=[] 2024-09-12T17:58:25.505 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T17:58:25.383+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): orig_dests= new_dests= 2024-09-12T17:58:25.505 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T17:58:25.383+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): potential dests added=[] removed=[] 2024-09-12T17:58:25.506 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.0 2024-09-12T17:58:25.506 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.0 2024-09-12T17:58:25.506 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.1 2024-09-12T17:58:25.506 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.1 2024-09-12T17:58:25.506 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.2 2024-09-12T17:58:25.506 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.2 2024-09-12T17:58:25.506 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.3 2024-09-12T17:58:25.506 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.3 2024-09-12T17:58:25.506 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.4 2024-09-12T17:58:25.506 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.4 2024-09-12T17:58:25.507 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.5 2024-09-12T17:58:25.507 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.5 2024-09-12T17:58:25.507 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.6 2024-09-12T17:58:25.507 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.6 2024-09-12T17:58:25.507 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.7 2024-09-12T17:58:25.507 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.7 2024-09-12T17:58:25.507 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.8 2024-09-12T17:58:25.507 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.8 2024-09-12T17:58:25.507 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.9 2024-09-12T17:58:25.507 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.9 2024-09-12T17:58:25.507 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.10 2024-09-12T17:58:25.508 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.10 2024-09-12T17:58:25.508 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.11 2024-09-12T17:58:25.508 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.11 2024-09-12T17:58:25.508 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.0 2024-09-12T17:58:25.508 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1 2024-09-12T17:58:25.508 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.2 2024-09-12T17:58:25.508 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T17:58:25.399+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.3 2024-09-12T17:58:25.508 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T17:58:25.399+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.4 2024-09-12T17:58:25.508 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T17:58:25.399+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.5 2024-09-12T17:58:25.509 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T17:58:25.399+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.6 2024-09-12T17:58:25.509 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T17:58:25.399+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.7 2024-09-12T17:58:25.509 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T17:58:25.399+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.8 2024-09-12T17:58:25.509 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T17:58:25.403+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.9 2024-09-12T17:58:25.509 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T17:58:25.403+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.10 2024-09-12T17:58:25.509 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T17:58:25.407+0000 7f6e377c89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:58:25.509 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T17:58:25.407+0000 7f6e377c89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 2024-09-12T17:58:25.509 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T17:58:25.411+0000 7f6e377c89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:25.509 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T17:58:25.411+0000 7f6e377c89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:25.509 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T17:58:25.411+0000 7f6e377c89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:25.509 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T17:58:25.411+0000 7f6e377c89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32, ofs0, ns] 2024-09-12T17:58:25.509 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T17:58:25.411+0000 7f6d18ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366193 cookie 94604470130368 notifier 7443 bl.length()=931 2024-09-12T17:58:25.510 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T17:58:25.411+0000 7f6d18ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:25.510 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T17:58:25.411+0000 7f6d18ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:25.510 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T17:58:25.411+0000 7f6d18ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:25.510 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T17:58:25.415+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): orig_sources= new_sources= 2024-09-12T17:58:25.510 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T17:58:25.415+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): potential sources added=[] removed=[] 2024-09-12T17:58:25.510 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T17:58:25.415+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): orig_dests= new_dests= 2024-09-12T17:58:25.510 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T17:58:25.415+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): potential dests added=[] removed=[] 2024-09-12T17:58:25.510 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.0 2024-09-12T17:58:25.511 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1 2024-09-12T17:58:25.511 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.2 2024-09-12T17:58:25.511 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.3 2024-09-12T17:58:25.511 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.4 2024-09-12T17:58:25.511 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.5 2024-09-12T17:58:25.511 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.6 2024-09-12T17:58:25.511 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T17:58:25.423+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.7 2024-09-12T17:58:25.511 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T17:58:25.423+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.8 2024-09-12T17:58:25.511 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T17:58:25.423+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.9 2024-09-12T17:58:25.511 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T17:58:25.423+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.10 2024-09-12T17:58:25.511 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T17:58:25.423+0000 7f6e377c89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6e377c89c0 time 2024-09-12T17:58:25.426814+0000 2024-09-12T17:58:25.511 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:58:25.511 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.512 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:25.512 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f6e3b0a22eb] 2024-09-12T17:58:25.512 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f6e3b0a249f] 2024-09-12T17:58:25.512 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560aceeb60c1] 2024-09-12T17:58:25.512 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x560aceec8467] 2024-09-12T17:58:25.512 INFO:tasks.workunit.client.0.smithi098.stderr: 5: main() 2024-09-12T17:58:25.512 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f6e39f08d90] 2024-09-12T17:58:25.512 INFO:tasks.workunit.client.0.smithi098.stderr: 7: __libc_start_main() 2024-09-12T17:58:25.512 INFO:tasks.workunit.client.0.smithi098.stderr: 8: _start() 2024-09-12T17:58:25.512 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.512 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T17:58:25.427+0000 7f6e377c89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:58:25.512 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f6e377c89c0 thread_name:radosgw-admin 2024-09-12T17:58:25.512 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.513 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:25.513 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f6e39f21520] 2024-09-12T17:58:25.513 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:58:25.513 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:58:25.513 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:58:25.513 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f6e3b0a2345] 2024-09-12T17:58:25.513 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f6e3b0a249f] 2024-09-12T17:58:25.513 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560aceeb60c1] 2024-09-12T17:58:25.513 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x560aceec8467] 2024-09-12T17:58:25.513 INFO:tasks.workunit.client.0.smithi098.stderr: 9: main() 2024-09-12T17:58:25.513 INFO:tasks.workunit.client.0.smithi098.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f6e39f08d90] 2024-09-12T17:58:25.513 INFO:tasks.workunit.client.0.smithi098.stderr: 11: __libc_start_main() 2024-09-12T17:58:25.513 INFO:tasks.workunit.client.0.smithi098.stderr: 12: _start() 2024-09-12T17:58:25.514 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:58:25.514 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.514 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T17:58:25.514 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T17:58:25.514 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T17:58:25.514 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T17:58:25.514 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T17:58:25.514 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T17:58:25.514 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T17:58:25.514 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T17:58:25.514 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T17:58:25.514 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T17:58:25.514 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T17:58:25.514 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T17:58:25.515 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T17:58:25.515 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T17:58:25.515 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T17:58:25.515 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T17:58:25.515 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T17:58:25.515 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T17:58:25.515 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T17:58:25.515 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T17:58:25.515 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T17:58:25.515 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T17:58:25.515 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T17:58:25.515 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T17:58:25.515 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:58:25.515 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T17:58:25.516 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T17:58:25.516 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T17:58:25.516 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T17:58:25.516 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T17:58:25.516 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T17:58:25.516 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T17:58:25.516 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T17:58:25.516 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T17:58:25.516 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T17:58:25.516 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T17:58:25.516 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T17:58:25.516 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T17:58:25.516 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T17:58:25.517 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T17:58:25.517 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T17:58:25.517 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T17:58:25.517 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T17:58:25.517 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T17:58:25.517 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T17:58:25.517 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T17:58:25.517 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:58:25.517 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T17:58:25.517 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:58:25.517 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T17:58:25.517 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T17:58:25.517 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T17:58:25.517 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T17:58:25.518 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T17:58:25.518 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T17:58:25.518 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T17:58:25.518 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T17:58:25.519 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T17:58:25.519 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T17:58:25.519 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T17:58:25.519 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T17:58:25.519 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T17:58:25.519 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T17:58:25.519 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T17:58:25.519 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T17:58:25.520 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T17:58:25.520 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T17:58:25.520 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:58:25.520 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T17:58:25.521 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:58:25.521 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T17:58:25.521 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T17:58:25.521 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T17:58:25.521 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T17:58:25.521 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T17:58:25.521 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T17:58:25.521 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:58:25.521 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T17:58:25.521 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T17:58:25.521 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:58:25.522 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T17:58:25.522 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T17:58:25.522 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T17:58:25.522 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T17:58:25.522 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T17:58:25.522 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T17:58:25.522 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T17:58:25.522 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T17:58:25.522 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T17:58:25.522 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T17:58:25.523 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T17:58:25.523 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T17:58:25.523 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T17:58:25.523 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:58:25.523 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6c5bfff640 / http_manager 2024-09-12T17:58:25.523 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6cea7e4640 / http_manager 2024-09-12T17:58:25.523 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6ceb7e6640 / rgw_dt_lg_renew 2024-09-12T17:58:25.523 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6d06ffd640 / ms_dispatch 2024-09-12T17:58:25.523 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6d18ff9640 / io_context_pool 2024-09-12T17:58:25.523 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6d1affd640 / ms_dispatch 2024-09-12T17:58:25.523 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6d21e03640 / ms_dispatch 2024-09-12T17:58:25.523 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6d23606640 / io_context_pool 2024-09-12T17:58:25.524 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6e34acd640 / msgr-worker-2 2024-09-12T17:58:25.524 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6e352ce640 / msgr-worker-1 2024-09-12T17:58:25.524 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6e35acf640 / msgr-worker-0 2024-09-12T17:58:25.524 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6e362d0640 / io_context_pool 2024-09-12T17:58:25.524 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6e377c89c0 / radosgw-admin 2024-09-12T17:58:25.524 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T17:58:25.524 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T17:58:25.524 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/log/ceph/ceph-client.admin.114042.log 2024-09-12T17:58:25.524 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T17:58:25.524 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T17:58:25.524 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.524 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.524 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command rotate-key hook 0x560ad1c68ff8 2024-09-12T17:58:25.525 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient: _reopen_session rank -1 2024-09-12T17:58:25.525 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:58:25.525 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-c con 0x560ad1b18d00 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:58:25.525 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-b con 0x560ad1b190e0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:58:25.525 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-a con 0x560ad1b194f0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:58:25.525 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.525 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.525 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.525 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient(hunting): _renew_subs 2024-09-12T17:58:25.525 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient(hunting): authenticate will time out at 2701.874182s 2024-09-12T17:58:25.525 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T17:58:25.303+0000 7f6e35acf640 10 monclient(hunting): get_auth_request con 0x560ad1b194f0 auth_method 0 2024-09-12T17:58:25.525 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T17:58:25.303+0000 7f6e35acf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:25.526 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T17:58:25.303+0000 7f6e35acf640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:25.526 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T17:58:25.303+0000 7f6e35acf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:25.526 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T17:58:25.303+0000 7f6e352ce640 10 monclient(hunting): get_auth_request con 0x560ad1b18d00 auth_method 0 2024-09-12T17:58:25.526 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T17:58:25.303+0000 7f6e352ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:25.526 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T17:58:25.303+0000 7f6e352ce640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:25.526 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T17:58:25.303+0000 7f6e352ce640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:25.526 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T17:58:25.303+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:25.527 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T17:58:25.303+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:25.527 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T17:58:25.303+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:25.527 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T17:58:25.303+0000 7f6e352ce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:25.527 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T17:58:25.303+0000 7f6e352ce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:25.527 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T17:58:25.303+0000 7f6e352ce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:25.527 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T17:58:25.303+0000 7f6e35acf640 10 monclient(hunting): handle_auth_done global_id 7434 payload 824 2024-09-12T17:58:25.527 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T17:58:25.303+0000 7f6e35acf640 10 monclient: _finish_hunting 0 2024-09-12T17:58:25.527 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T17:58:25.303+0000 7f6e35acf640 1 monclient: found mon.noname-a 2024-09-12T17:58:25.527 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T17:58:25.303+0000 7f6e35acf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.527 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T17:58:25.303+0000 7f6d21e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:25.527 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T17:58:25.303+0000 7f6d21e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:25.527 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T17:58:25.303+0000 7f6d21e03640 10 monclient: dump: 2024-09-12T17:58:25.527 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:58:25.527 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:58:25.528 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.528 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.528 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:25.528 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.528 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:58:25.528 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:58:25.528 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:58:25.528 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.528 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T17:58:25.303+0000 7f6d21e03640 10 monclient: _finish_auth 0 2024-09-12T17:58:25.528 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T17:58:25.303+0000 7f6d21e03640 10 monclient: _check_auth_tickets 2024-09-12T17:58:25.528 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T17:58:25.303+0000 7f6d21e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:25.528 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T17:58:25.303+0000 7f6d21e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:25.528 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T17:58:25.303+0000 7f6d21e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:25.529 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T17:58:25.303+0000 7f6d21e03640 10 monclient: dump: 2024-09-12T17:58:25.529 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:58:25.529 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:58:25.529 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.529 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.529 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:25.529 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.529 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:58:25.529 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:58:25.529 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:58:25.529 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.529 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 5 monclient: authenticate success, global_id 7434 2024-09-12T17:58:25.529 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T17:58:25.303+0000 7f6d23606640 4 set_mon_vals no callback set 2024-09-12T17:58:25.529 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient: _renew_subs 2024-09-12T17:58:25.530 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.530 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient: _renew_subs 2024-09-12T17:58:25.530 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.530 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T17:58:25.303+0000 7f6e377c89c0 1 librados: init done 2024-09-12T17:58:25.530 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T17:58:25.307+0000 7f6d21e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:58:25.530 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T17:58:25.307+0000 7f6d21e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:58:25.530 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T17:58:25.307+0000 7f6d21e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:58:25.530 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T17:58:25.307+0000 7f6e352ce640 10 monclient: get_auth_request con 0x7f6d1c070b10 auth_method 0 2024-09-12T17:58:25.531 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T17:58:25.307+0000 7f6e34acd640 10 monclient: get_auth_request con 0x560ad1ca8230 auth_method 0 2024-09-12T17:58:25.531 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T17:58:25.307+0000 7f6e352ce640 10 monclient: get_auth_request con 0x560ad1cb4930 auth_method 0 2024-09-12T17:58:25.531 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T17:58:25.311+0000 7f6e34acd640 10 monclient: get_auth_request con 0x560ad1cb81e0 auth_method 0 2024-09-12T17:58:25.531 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 10 monclient: build_initial_monmap 2024-09-12T17:58:25.531 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 1 build_initial for_mkfs: 0 2024-09-12T17:58:25.531 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 10 monclient: monmap: 2024-09-12T17:58:25.531 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:58:25.531 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:25.531 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:58:25.531 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:58:25.531 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:25.531 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.531 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:58:25.531 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:58:25.532 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:58:25.532 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.532 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding auth protocol: cephx 2024-09-12T17:58:25.532 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding auth protocol: cephx 2024-09-12T17:58:25.532 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding auth protocol: cephx 2024-09-12T17:58:25.532 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: secure 2024-09-12T17:58:25.532 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: crc 2024-09-12T17:58:25.532 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: secure 2024-09-12T17:58:25.532 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: crc 2024-09-12T17:58:25.532 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: secure 2024-09-12T17:58:25.532 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: crc 2024-09-12T17:58:25.532 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: crc 2024-09-12T17:58:25.532 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: secure 2024-09-12T17:58:25.533 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: crc 2024-09-12T17:58:25.533 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: secure 2024-09-12T17:58:25.533 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: crc 2024-09-12T17:58:25.533 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbdbf0) adding con mode: secure 2024-09-12T17:58:25.533 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.533 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x560ad1cc1540 EEXIST 2024-09-12T17:58:25.533 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 10 monclient: init 2024-09-12T17:58:25.533 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding auth protocol: cephx 2024-09-12T17:58:25.533 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding auth protocol: cephx 2024-09-12T17:58:25.533 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding auth protocol: cephx 2024-09-12T17:58:25.533 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: secure 2024-09-12T17:58:25.533 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: crc 2024-09-12T17:58:25.533 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: secure 2024-09-12T17:58:25.533 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: crc 2024-09-12T17:58:25.534 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: secure 2024-09-12T17:58:25.534 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: crc 2024-09-12T17:58:25.534 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: crc 2024-09-12T17:58:25.534 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: secure 2024-09-12T17:58:25.534 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: crc 2024-09-12T17:58:25.534 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: secure 2024-09-12T17:58:25.534 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: crc 2024-09-12T17:58:25.534 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1cbcba8) adding con mode: secure 2024-09-12T17:58:25.534 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.534 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.534 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command rotate-key cmddesc rotate-key hook 0x560ad1cbccf0 EEXIST 2024-09-12T17:58:25.534 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 10 monclient: _reopen_session rank -1 2024-09-12T17:58:25.534 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T17:58:25.311+0000 7f6e377c89c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:58:25.534 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-a con 0x560ad1ce56f0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:58:25.535 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-b con 0x560ad1ce5020 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:58:25.535 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-c con 0x560ad1ce3a00 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:58:25.535 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.535 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.535 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.535 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): _renew_subs 2024-09-12T17:58:25.535 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): authenticate will time out at 2701.884054s 2024-09-12T17:58:25.535 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T17:58:25.315+0000 7f6e352ce640 10 monclient(hunting): get_auth_request con 0x560ad1ce56f0 auth_method 0 2024-09-12T17:58:25.535 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T17:58:25.315+0000 7f6e352ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:25.535 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T17:58:25.315+0000 7f6e352ce640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:25.535 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T17:58:25.315+0000 7f6e352ce640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:25.535 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T17:58:25.315+0000 7f6e35acf640 10 monclient(hunting): get_auth_request con 0x560ad1ce3a00 auth_method 0 2024-09-12T17:58:25.535 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T17:58:25.315+0000 7f6e35acf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:25.535 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T17:58:25.315+0000 7f6e35acf640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:25.536 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T17:58:25.315+0000 7f6e35acf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:25.536 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T17:58:25.315+0000 7f6e352ce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:25.536 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T17:58:25.315+0000 7f6e352ce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:25.536 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T17:58:25.315+0000 7f6e352ce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:25.536 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T17:58:25.315+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:25.536 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T17:58:25.315+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:25.536 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T17:58:25.315+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:25.536 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T17:58:25.315+0000 7f6e34acd640 10 monclient(hunting): get_auth_request con 0x560ad1ce5020 auth_method 0 2024-09-12T17:58:25.536 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T17:58:25.315+0000 7f6e34acd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:25.536 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T17:58:25.315+0000 7f6e34acd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:25.536 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T17:58:25.315+0000 7f6e34acd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:25.536 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T17:58:25.315+0000 7f6e352ce640 10 monclient(hunting): handle_auth_done global_id 7437 payload 824 2024-09-12T17:58:25.536 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T17:58:25.315+0000 7f6e352ce640 10 monclient: _finish_hunting 0 2024-09-12T17:58:25.537 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T17:58:25.315+0000 7f6e352ce640 1 monclient: found mon.noname-a 2024-09-12T17:58:25.537 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T17:58:25.315+0000 7f6e352ce640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.537 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T17:58:25.315+0000 7f6d1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:25.537 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T17:58:25.315+0000 7f6d1affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:25.537 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T17:58:25.315+0000 7f6d1affd640 10 monclient: dump: 2024-09-12T17:58:25.537 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:58:25.537 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:58:25.537 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.537 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.537 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:25.537 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.537 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:58:25.537 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:58:25.537 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:58:25.538 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.538 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T17:58:25.315+0000 7f6d1affd640 10 monclient: _finish_auth 0 2024-09-12T17:58:25.538 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T17:58:25.315+0000 7f6d1affd640 10 monclient: _check_auth_tickets 2024-09-12T17:58:25.538 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T17:58:25.315+0000 7f6d1affd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:25.538 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T17:58:25.315+0000 7f6d1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:25.538 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T17:58:25.315+0000 7f6d1affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:25.538 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T17:58:25.315+0000 7f6d1affd640 10 monclient: dump: 2024-09-12T17:58:25.538 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:58:25.538 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:58:25.538 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.538 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.538 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:25.538 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.539 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:58:25.539 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:58:25.539 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:58:25.539 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.539 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 monclient: authenticate success, global_id 7437 2024-09-12T17:58:25.539 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient: _renew_subs 2024-09-12T17:58:25.539 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T17:58:25.315+0000 7f6e362d0640 4 set_mon_vals no callback set 2024-09-12T17:58:25.539 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.539 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient: _renew_subs 2024-09-12T17:58:25.539 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.539 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T17:58:25.315+0000 7f6d1affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:58:25.539 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T17:58:25.315+0000 7f6d1affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:58:25.539 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T17:58:25.315+0000 7f6d1affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:58:25.540 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient: get_monmap_and_config 2024-09-12T17:58:25.540 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient: build_initial_monmap 2024-09-12T17:58:25.540 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 1 build_initial for_mkfs: 0 2024-09-12T17:58:25.540 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient: monmap: 2024-09-12T17:58:25.540 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:58:25.540 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:25.540 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:58:25.540 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:58:25.540 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:25.540 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.540 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:58:25.540 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:58:25.541 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:58:25.541 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.541 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding auth protocol: cephx 2024-09-12T17:58:25.541 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding auth protocol: cephx 2024-09-12T17:58:25.541 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding auth protocol: cephx 2024-09-12T17:58:25.541 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: secure 2024-09-12T17:58:25.541 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: crc 2024-09-12T17:58:25.541 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: secure 2024-09-12T17:58:25.541 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: crc 2024-09-12T17:58:25.541 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: secure 2024-09-12T17:58:25.541 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: crc 2024-09-12T17:58:25.541 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: crc 2024-09-12T17:58:25.541 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: secure 2024-09-12T17:58:25.541 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: crc 2024-09-12T17:58:25.542 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: secure 2024-09-12T17:58:25.542 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: crc 2024-09-12T17:58:25.542 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d05120) adding con mode: secure 2024-09-12T17:58:25.542 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T17:58:25.315+0000 7f6e34acd640 10 monclient: get_auth_request con 0x7f6d10070a20 auth_method 0 2024-09-12T17:58:25.542 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.542 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient: init 2024-09-12T17:58:25.542 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding auth protocol: cephx 2024-09-12T17:58:25.542 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding auth protocol: cephx 2024-09-12T17:58:25.542 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding auth protocol: cephx 2024-09-12T17:58:25.542 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: secure 2024-09-12T17:58:25.542 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: crc 2024-09-12T17:58:25.542 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: secure 2024-09-12T17:58:25.542 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: crc 2024-09-12T17:58:25.542 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: secure 2024-09-12T17:58:25.543 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: crc 2024-09-12T17:58:25.543 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: crc 2024-09-12T17:58:25.543 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: secure 2024-09-12T17:58:25.543 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: crc 2024-09-12T17:58:25.543 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: secure 2024-09-12T17:58:25.543 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: crc 2024-09-12T17:58:25.543 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4840) adding con mode: secure 2024-09-12T17:58:25.543 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.543 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.543 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command rotate-key cmddesc rotate-key hook 0x7fffa1aa4988 EEXIST 2024-09-12T17:58:25.543 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient: _reopen_session rank -1 2024-09-12T17:58:25.543 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:58:25.543 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-b con 0x560ad1d39680 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:58:25.544 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-a con 0x560ad1d34ac0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:58:25.544 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-c con 0x560ad1d2b190 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:58:25.544 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.545 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.545 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.545 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): _renew_subs 2024-09-12T17:58:25.545 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T17:58:25.315+0000 7f6e377c89c0 10 monclient(hunting): authenticate will time out at 2701.887960s 2024-09-12T17:58:25.545 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): get_auth_request con 0x560ad1d34ac0 auth_method 0 2024-09-12T17:58:25.545 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:25.545 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:25.545 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:25.546 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): get_auth_request con 0x560ad1d2b190 auth_method 0 2024-09-12T17:58:25.546 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:25.546 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:25.546 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:25.546 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:25.546 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:25.546 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:25.546 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:25.546 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:25.546 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:25.547 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): handle_auth_done global_id 7440 payload 274 2024-09-12T17:58:25.547 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient: _finish_hunting 0 2024-09-12T17:58:25.547 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T17:58:25.319+0000 7f6e34acd640 1 monclient: found mon.noname-a 2024-09-12T17:58:25.547 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.547 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T17:58:25.319+0000 7f6e352ce640 10 monclient: get_auth_request con 0x560ad1d39680 auth_method 0 2024-09-12T17:58:25.548 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T17:58:25.319+0000 7f6d18ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:25.548 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T17:58:25.319+0000 7f6d18ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:25.548 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T17:58:25.319+0000 7f6d18ff9640 10 monclient: dump: 2024-09-12T17:58:25.548 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:58:25.548 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:58:25.548 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.548 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.548 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:25.548 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.548 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:58:25.548 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:58:25.549 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:58:25.549 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.549 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T17:58:25.319+0000 7f6d18ff9640 10 monclient: _finish_auth 0 2024-09-12T17:58:25.549 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T17:58:25.319+0000 7f6d18ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:58:25.549 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T17:58:25.319+0000 7f6d18ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:25.549 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T17:58:25.319+0000 7f6d18ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:25.549 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T17:58:25.319+0000 7f6d18ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:25.549 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T17:58:25.319+0000 7f6d18ff9640 10 monclient: dump: 2024-09-12T17:58:25.549 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:58:25.550 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:58:25.550 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.550 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.550 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:25.550 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.550 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:58:25.550 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:58:25.551 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:58:25.551 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.551 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 monclient: authenticate success, global_id 7440 2024-09-12T17:58:25.551 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: get_monmap_and_config success 2024-09-12T17:58:25.551 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 4 set_mon_vals no callback set 2024-09-12T17:58:25.551 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: shutdown 2024-09-12T17:58:25.552 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: build_initial_monmap 2024-09-12T17:58:25.552 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 1 build_initial for_mkfs: 0 2024-09-12T17:58:25.552 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: monmap: 2024-09-12T17:58:25.552 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:58:25.552 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:58:25.552 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:58:25.552 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:58:25.552 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:58:25.552 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.552 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:58:25.552 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:58:25.552 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:58:25.552 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.553 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding auth protocol: cephx 2024-09-12T17:58:25.553 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding auth protocol: cephx 2024-09-12T17:58:25.553 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding auth protocol: cephx 2024-09-12T17:58:25.553 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: secure 2024-09-12T17:58:25.553 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: crc 2024-09-12T17:58:25.553 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: secure 2024-09-12T17:58:25.553 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: crc 2024-09-12T17:58:25.553 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: secure 2024-09-12T17:58:25.553 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: crc 2024-09-12T17:58:25.553 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: crc 2024-09-12T17:58:25.553 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: secure 2024-09-12T17:58:25.553 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: crc 2024-09-12T17:58:25.553 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: secure 2024-09-12T17:58:25.553 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: crc 2024-09-12T17:58:25.554 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1d2bc50) adding con mode: secure 2024-09-12T17:58:25.554 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.554 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 1 librados: starting msgr at 2024-09-12T17:58:25.554 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 1 librados: starting objecter 2024-09-12T17:58:25.554 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x560ad1d0b610 EEXIST 2024-09-12T17:58:25.554 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 1 librados: setting wanted keys 2024-09-12T17:58:25.554 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 1 librados: calling monclient init 2024-09-12T17:58:25.554 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: init 2024-09-12T17:58:25.554 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding auth protocol: cephx 2024-09-12T17:58:25.554 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding auth protocol: cephx 2024-09-12T17:58:25.554 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding auth protocol: cephx 2024-09-12T17:58:25.554 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: secure 2024-09-12T17:58:25.554 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: crc 2024-09-12T17:58:25.555 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: secure 2024-09-12T17:58:25.555 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: crc 2024-09-12T17:58:25.555 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: secure 2024-09-12T17:58:25.555 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: crc 2024-09-12T17:58:25.555 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: crc 2024-09-12T17:58:25.555 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: secure 2024-09-12T17:58:25.555 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: crc 2024-09-12T17:58:25.555 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: secure 2024-09-12T17:58:25.555 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: crc 2024-09-12T17:58:25.555 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 AuthRegistry(0x560ad1ce7510) adding con mode: secure 2024-09-12T17:58:25.555 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.555 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.555 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command rotate-key cmddesc rotate-key hook 0x560ad1ce7658 EEXIST 2024-09-12T17:58:25.556 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: _reopen_session rank -1 2024-09-12T17:58:25.556 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:58:25.556 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-b con 0x560ad1d2b190 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:58:25.556 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-a con 0x560ad1d34ac0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:58:25.556 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient(hunting): picked mon.noname-c con 0x560ad1d39680 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:58:25.556 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.556 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.556 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:58:25.556 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient(hunting): _renew_subs 2024-09-12T17:58:25.556 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient(hunting): authenticate will time out at 2701.890564s 2024-09-12T17:58:25.556 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): get_auth_request con 0x560ad1d34ac0 auth_method 0 2024-09-12T17:58:25.556 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:25.556 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:25.557 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:25.557 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): get_auth_request con 0x560ad1d39680 auth_method 0 2024-09-12T17:58:25.557 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:58:25.557 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:58:25.557 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:58:25.557 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:25.557 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:25.557 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:25.557 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:58:25.557 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:58:25.557 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T17:58:25.319+0000 7f6e35acf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:58:25.557 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient(hunting): handle_auth_done global_id 7443 payload 824 2024-09-12T17:58:25.557 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient: _finish_hunting 0 2024-09-12T17:58:25.558 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T17:58:25.319+0000 7f6e34acd640 1 monclient: found mon.noname-a 2024-09-12T17:58:25.558 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T17:58:25.319+0000 7f6e34acd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.558 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T17:58:25.319+0000 7f6d06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:25.558 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T17:58:25.319+0000 7f6d06ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:58:25.558 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T17:58:25.319+0000 7f6d06ffd640 10 monclient: dump: 2024-09-12T17:58:25.558 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:58:25.558 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:58:25.558 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.558 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.558 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:25.558 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.558 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:58:25.558 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:58:25.559 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:58:25.559 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.559 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T17:58:25.319+0000 7f6d06ffd640 10 monclient: _finish_auth 0 2024-09-12T17:58:25.559 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T17:58:25.319+0000 7f6d06ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:58:25.559 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T17:58:25.319+0000 7f6d06ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:58:25.559 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T17:58:25.319+0000 7f6d06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:58:25.559 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T17:58:25.319+0000 7f6d06ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:58:25.559 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T17:58:25.319+0000 7f6d06ffd640 10 monclient: dump: 2024-09-12T17:58:25.559 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:58:25.559 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:58:25.559 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.559 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:58:25.559 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:58:25.560 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:58:25.560 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:58:25.560 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:58:25.560 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:58:25.560 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.560 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 monclient: authenticate success, global_id 7443 2024-09-12T17:58:25.560 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T17:58:25.319+0000 7f6d18ff9640 4 set_mon_vals no callback set 2024-09-12T17:58:25.560 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: _renew_subs 2024-09-12T17:58:25.560 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.560 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: _renew_subs 2024-09-12T17:58:25.560 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.560 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 1 librados: init done 2024-09-12T17:58:25.560 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T17:58:25.319+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command cr dump hook 0x560ad1d2d4c8 2024-09-12T17:58:25.560 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.561 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T17:58:25.323+0000 7f6d06ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:58:25.561 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T17:58:25.323+0000 7f6d06ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:58:25.561 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T17:58:25.323+0000 7f6d06ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:58:25.561 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T17:58:25.323+0000 7f6e35acf640 10 monclient: get_auth_request con 0x560ad1d52fe0 auth_method 0 2024-09-12T17:58:25.561 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T17:58:25.323+0000 7f6e352ce640 10 monclient: get_auth_request con 0x7f6d00070b10 auth_method 0 2024-09-12T17:58:25.561 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.561 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 realm 2024-09-12T17:58:25.561 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.561 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.561 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T17:58:25.323+0000 7f6e377c89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:25.561 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.562 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.562 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T17:58:25.323+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.562 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T17:58:25.323+0000 7f6e352ce640 10 monclient: get_auth_request con 0x560ad1d57210 auth_method 0 2024-09-12T17:58:25.562 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T17:58:25.327+0000 7f6e377c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:25.562 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T17:58:25.327+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.562 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T17:58:25.327+0000 7f6e377c89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:25.562 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T17:58:25.327+0000 7f6e377c89c0 20 searching for the correct realm 2024-09-12T17:58:25.562 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T17:58:25.327+0000 7f6e34acd640 10 monclient: get_auth_request con 0x560ad1d5c480 auth_method 0 2024-09-12T17:58:25.562 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T17:58:25.327+0000 7f6e35acf640 10 monclient: get_auth_request con 0x7f6e2c01d040 auth_method 0 2024-09-12T17:58:25.562 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T17:58:25.327+0000 7f6e352ce640 10 monclient: get_auth_request con 0x7f6e30028070 auth_method 0 2024-09-12T17:58:25.562 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T17:58:25.331+0000 7f6e34acd640 10 monclient: get_auth_request con 0x7f6e280c5040 auth_method 0 2024-09-12T17:58:25.562 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T17:58:25.331+0000 7f6e34acd640 0 -- 172.21.15.98:0/3966641589 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f6e280c5040 msgr2=0x7f6e28104f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:25.563 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T17:58:25.331+0000 7f6d06ffd640 1 client.7443.objecter ms_handle_reset 0x7f6e280c5040 session 0x7f6e280a6070 osd.4 2024-09-12T17:58:25.563 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T17:58:25.331+0000 7f6d06ffd640 10 monclient: _renew_subs 2024-09-12T17:58:25.563 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T17:58:25.331+0000 7f6d06ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:58:25.563 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T17:58:25.331+0000 7f6e35acf640 10 monclient: get_auth_request con 0x7f6e2c06d2d0 auth_method 0 2024-09-12T17:58:25.563 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T17:58:25.331+0000 7f6e34acd640 10 monclient: get_auth_request con 0x7f6d000811b0 auth_method 0 2024-09-12T17:58:25.563 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T17:58:25.335+0000 7f6e352ce640 10 monclient: get_auth_request con 0x7f6e2c069110 auth_method 0 2024-09-12T17:58:25.563 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T17:58:25.339+0000 7f6e34acd640 0 -- 172.21.15.98:0/3966641589 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f6d000811b0 msgr2=0x7f6d000835e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:25.563 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T17:58:25.339+0000 7f6d06ffd640 1 client.7443.objecter ms_handle_reset 0x7f6d000811b0 session 0x7f6e280a6070 osd.4 2024-09-12T17:58:25.563 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T17:58:25.339+0000 7f6e34acd640 10 monclient: get_auth_request con 0x7f6e280c5040 auth_method 0 2024-09-12T17:58:25.563 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:25.563 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:58:25.564 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:25.564 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:58:25.564 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:25.564 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:25.564 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.564 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.564 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T17:58:25.343+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.564 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:25.564 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.564 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:25.564 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 zone default found 2024-09-12T17:58:25.565 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 4 Realm: () 2024-09-12T17:58:25.565 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:58:25.565 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:58:25.565 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:25.565 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 zonegroup default 2024-09-12T17:58:25.565 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.565 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.565 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.565 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.565 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.565 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.565 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 started sync module instance, tier type = 2024-09-12T17:58:25.566 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T17:58:25.347+0000 7f6e377c89c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:58:25.566 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=0 2024-09-12T17:58:25.566 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=1 2024-09-12T17:58:25.566 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=2 2024-09-12T17:58:25.566 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=3 2024-09-12T17:58:25.566 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=4 2024-09-12T17:58:25.566 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=5 2024-09-12T17:58:25.566 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=6 2024-09-12T17:58:25.566 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T17:58:25.363+0000 7f6e377c89c0 20 add_watcher() i=7 2024-09-12T17:58:25.566 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T17:58:25.363+0000 7f6e377c89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:25.566 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding auth protocol: cephx 2024-09-12T17:58:25.566 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding auth protocol: cephx 2024-09-12T17:58:25.567 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding auth protocol: cephx 2024-09-12T17:58:25.567 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: secure 2024-09-12T17:58:25.567 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: crc 2024-09-12T17:58:25.567 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: secure 2024-09-12T17:58:25.567 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: crc 2024-09-12T17:58:25.567 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: secure 2024-09-12T17:58:25.567 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: crc 2024-09-12T17:58:25.567 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: crc 2024-09-12T17:58:25.567 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: secure 2024-09-12T17:58:25.567 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: crc 2024-09-12T17:58:25.568 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: secure 2024-09-12T17:58:25.568 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T17:58:25.367+0000 7f6ceb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:25.568 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: crc 2024-09-12T17:58:25.568 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 AuthRegistry(0x7fffa1aa4d10) adding con mode: secure 2024-09-12T17:58:25.568 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:58:25.568 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:25.568 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:25.568 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command cache list hook 0x560ad1d2f010 2024-09-12T17:58:25.568 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command cache inspect hook 0x560ad1d2f010 2024-09-12T17:58:25.568 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command cache erase hook 0x560ad1d2f010 2024-09-12T17:58:25.568 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command cache zap hook 0x560ad1d2f010 2024-09-12T17:58:25.569 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 note: GC not initialized 2024-09-12T17:58:25.569 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T17:58:25.367+0000 7f6cea7e4640 20 reqs_thread_entry: start 2024-09-12T17:58:25.569 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command sync trace show hook 0x7f6e2c0026b0 2024-09-12T17:58:25.569 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command sync trace history hook 0x7f6e2c0026b0 2024-09-12T17:58:25.569 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command sync trace active hook 0x7f6e2c0026b0 2024-09-12T17:58:25.569 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 5 asok(0x560ad1a5f2b0) register_command sync trace active_short hook 0x7f6e2c0026b0 2024-09-12T17:58:25.569 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 init_complete bucket index max shards: 11 2024-09-12T17:58:25.569 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 Filter name: none 2024-09-12T17:58:25.569 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T17:58:25.367+0000 7f6c5bfff640 20 reqs_thread_entry: start 2024-09-12T17:58:25.569 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:58:25.569 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.570 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:25.570 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:58:25.570 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:58:25.570 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 : miss 2024-09-12T17:58:25.570 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T17:58:25.367+0000 7f6e377c89c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.570 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T17:58:25.371+0000 7f6e377c89c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:58:25.570 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T17:58:25.371+0000 7f6e377c89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:25.570 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T17:58:25.371+0000 7f6e377c89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:25.570 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T17:58:25.371+0000 7f6e377c89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:25.570 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T17:58:25.371+0000 7f6e377c89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:25.570 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T17:58:25.371+0000 7f6e377c89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 2024-09-12T17:58:25.571 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T17:58:25.383+0000 7f6e377c89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:25.571 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T17:58:25.383+0000 7f6e377c89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:25.571 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T17:58:25.383+0000 7f6e377c89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:25.571 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T17:58:25.383+0000 7f6e377c89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32, ofs0, ns] 2024-09-12T17:58:25.571 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T17:58:25.383+0000 7f6d18ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366192 cookie 94604470130368 notifier 7443 bl.length()=931 2024-09-12T17:58:25.571 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T17:58:25.383+0000 7f6d18ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:25.571 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T17:58:25.383+0000 7f6d18ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:25.571 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T17:58:25.383+0000 7f6d18ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:25.571 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T17:58:25.383+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): orig_sources= new_sources= 2024-09-12T17:58:25.571 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T17:58:25.383+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): potential sources added=[] removed=[] 2024-09-12T17:58:25.571 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T17:58:25.383+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): orig_dests= new_dests= 2024-09-12T17:58:25.572 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T17:58:25.383+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): potential dests added=[] removed=[] 2024-09-12T17:58:25.572 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.0 2024-09-12T17:58:25.572 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.0 2024-09-12T17:58:25.572 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.1 2024-09-12T17:58:25.572 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.1 2024-09-12T17:58:25.572 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.2 2024-09-12T17:58:25.572 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.2 2024-09-12T17:58:25.572 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.3 2024-09-12T17:58:25.572 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.3 2024-09-12T17:58:25.572 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.4 2024-09-12T17:58:25.572 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.4 2024-09-12T17:58:25.572 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.5 2024-09-12T17:58:25.572 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.5 2024-09-12T17:58:25.573 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.6 2024-09-12T17:58:25.573 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.6 2024-09-12T17:58:25.573 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.7 2024-09-12T17:58:25.573 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.7 2024-09-12T17:58:25.573 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.8 2024-09-12T17:58:25.573 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.8 2024-09-12T17:58:25.573 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.9 2024-09-12T17:58:25.573 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.9 2024-09-12T17:58:25.573 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.10 2024-09-12T17:58:25.573 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.10 2024-09-12T17:58:25.573 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.11 2024-09-12T17:58:25.573 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.11 2024-09-12T17:58:25.574 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.0 2024-09-12T17:58:25.574 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1 2024-09-12T17:58:25.574 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T17:58:25.395+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.2 2024-09-12T17:58:25.574 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T17:58:25.399+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.3 2024-09-12T17:58:25.574 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T17:58:25.399+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.4 2024-09-12T17:58:25.574 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T17:58:25.399+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.5 2024-09-12T17:58:25.574 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T17:58:25.399+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.6 2024-09-12T17:58:25.574 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T17:58:25.399+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.7 2024-09-12T17:58:25.574 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T17:58:25.399+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.8 2024-09-12T17:58:25.575 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T17:58:25.403+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.9 2024-09-12T17:58:25.575 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T17:58:25.403+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.10 2024-09-12T17:58:25.575 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T17:58:25.407+0000 7f6e377c89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:58:25.575 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T17:58:25.407+0000 7f6e377c89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 2024-09-12T17:58:25.576 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T17:58:25.411+0000 7f6e377c89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:25.576 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T17:58:25.411+0000 7f6e377c89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:25.576 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T17:58:25.411+0000 7f6e377c89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:25.576 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T17:58:25.411+0000 7f6e377c89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32, ofs0, ns] 2024-09-12T17:58:25.576 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T17:58:25.411+0000 7f6d18ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366193 cookie 94604470130368 notifier 7443 bl.length()=931 2024-09-12T17:58:25.576 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T17:58:25.411+0000 7f6d18ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:25.576 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T17:58:25.411+0000 7f6d18ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:25.576 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T17:58:25.411+0000 7f6d18ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:25.576 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T17:58:25.415+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): orig_sources= new_sources= 2024-09-12T17:58:25.576 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T17:58:25.415+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): potential sources added=[] removed=[] 2024-09-12T17:58:25.577 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T17:58:25.415+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): orig_dests= new_dests= 2024-09-12T17:58:25.577 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T17:58:25.415+0000 7f6e377c89c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): potential dests added=[] removed=[] 2024-09-12T17:58:25.577 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.0 2024-09-12T17:58:25.577 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1 2024-09-12T17:58:25.577 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.2 2024-09-12T17:58:25.577 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.3 2024-09-12T17:58:25.577 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.4 2024-09-12T17:58:25.577 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.5 2024-09-12T17:58:25.578 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T17:58:25.419+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.6 2024-09-12T17:58:25.578 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T17:58:25.423+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.7 2024-09-12T17:58:25.578 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T17:58:25.423+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.8 2024-09-12T17:58:25.578 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T17:58:25.423+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.9 2024-09-12T17:58:25.578 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T17:58:25.423+0000 7f6e377c89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.10 2024-09-12T17:58:25.578 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T17:58:25.423+0000 7f6e377c89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6e377c89c0 time 2024-09-12T17:58:25.426814+0000 2024-09-12T17:58:25.578 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:58:25.578 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.579 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:25.579 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f6e3b0a22eb] 2024-09-12T17:58:25.579 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f6e3b0a249f] 2024-09-12T17:58:25.579 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560aceeb60c1] 2024-09-12T17:58:25.579 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x560aceec8467] 2024-09-12T17:58:25.579 INFO:tasks.workunit.client.0.smithi098.stderr: 5: main() 2024-09-12T17:58:25.579 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f6e39f08d90] 2024-09-12T17:58:25.579 INFO:tasks.workunit.client.0.smithi098.stderr: 7: __libc_start_main() 2024-09-12T17:58:25.580 INFO:tasks.workunit.client.0.smithi098.stderr: 8: _start() 2024-09-12T17:58:25.580 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.580 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T17:58:25.427+0000 7f6e377c89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:58:25.580 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f6e377c89c0 thread_name:radosgw-admin 2024-09-12T17:58:25.580 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.580 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:58:25.580 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f6e39f21520] 2024-09-12T17:58:25.580 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:58:25.581 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:58:25.581 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:58:25.581 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f6e3b0a2345] 2024-09-12T17:58:25.581 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f6e3b0a249f] 2024-09-12T17:58:25.581 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560aceeb60c1] 2024-09-12T17:58:25.581 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x560aceec8467] 2024-09-12T17:58:25.581 INFO:tasks.workunit.client.0.smithi098.stderr: 9: main() 2024-09-12T17:58:25.582 INFO:tasks.workunit.client.0.smithi098.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f6e39f08d90] 2024-09-12T17:58:25.582 INFO:tasks.workunit.client.0.smithi098.stderr: 11: __libc_start_main() 2024-09-12T17:58:25.582 INFO:tasks.workunit.client.0.smithi098.stderr: 12: _start() 2024-09-12T17:58:25.582 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:58:25.582 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.582 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T17:58:25.582 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T17:58:25.582 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T17:58:25.582 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T17:58:25.582 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T17:58:25.582 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T17:58:25.582 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T17:58:25.583 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T17:58:25.583 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T17:58:25.583 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T17:58:25.583 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T17:58:25.583 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T17:58:25.584 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T17:58:25.584 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T17:58:25.584 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T17:58:25.584 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T17:58:25.584 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T17:58:25.584 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T17:58:25.584 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T17:58:25.584 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T17:58:25.585 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T17:58:25.585 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T17:58:25.585 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T17:58:25.585 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T17:58:25.585 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:58:25.585 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T17:58:25.585 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T17:58:25.585 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T17:58:25.585 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T17:58:25.585 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T17:58:25.585 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T17:58:25.585 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T17:58:25.585 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T17:58:25.586 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T17:58:25.586 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T17:58:25.586 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T17:58:25.586 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T17:58:25.586 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T17:58:25.586 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T17:58:25.586 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T17:58:25.586 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T17:58:25.586 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T17:58:25.586 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T17:58:25.586 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T17:58:25.586 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T17:58:25.586 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T17:58:25.586 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:58:25.587 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T17:58:25.587 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:58:25.587 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T17:58:25.587 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T17:58:25.587 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T17:58:25.587 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T17:58:25.587 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T17:58:25.587 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T17:58:25.587 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T17:58:25.587 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T17:58:25.587 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T17:58:25.587 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T17:58:25.587 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T17:58:25.587 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T17:58:25.588 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T17:58:25.588 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T17:58:25.588 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T17:58:25.588 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T17:58:25.588 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T17:58:25.588 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T17:58:25.588 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:58:25.588 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T17:58:25.588 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:58:25.588 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T17:58:25.588 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T17:58:25.588 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T17:58:25.589 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T17:58:25.589 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T17:58:25.589 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T17:58:25.589 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:58:25.589 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T17:58:25.589 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T17:58:25.589 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:58:25.589 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T17:58:25.589 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T17:58:25.589 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T17:58:25.589 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T17:58:25.589 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T17:58:25.589 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T17:58:25.589 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T17:58:25.590 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T17:58:25.590 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T17:58:25.590 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T17:58:25.590 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T17:58:25.590 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T17:58:25.590 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T17:58:25.590 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:58:25.590 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6c5bfff640 / http_manager 2024-09-12T17:58:25.590 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6cea7e4640 / http_manager 2024-09-12T17:58:25.590 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6ceb7e6640 / rgw_dt_lg_renew 2024-09-12T17:58:25.590 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6d06ffd640 / ms_dispatch 2024-09-12T17:58:25.590 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6d18ff9640 / io_context_pool 2024-09-12T17:58:25.591 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6d1affd640 / ms_dispatch 2024-09-12T17:58:25.591 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6d21e03640 / ms_dispatch 2024-09-12T17:58:25.591 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6d23606640 / io_context_pool 2024-09-12T17:58:25.591 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6e34acd640 / msgr-worker-2 2024-09-12T17:58:25.591 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6e352ce640 / msgr-worker-1 2024-09-12T17:58:25.591 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6e35acf640 / msgr-worker-0 2024-09-12T17:58:25.591 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6e362d0640 / io_context_pool 2024-09-12T17:58:25.591 INFO:tasks.workunit.client.0.smithi098.stderr: 7f6e377c89c0 / radosgw-admin 2024-09-12T17:58:25.591 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T17:58:25.591 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T17:58:25.591 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:58:25.428881Z_684e06c9-2c83-4eb3-9b4c-8e8acee97b4b/log 2024-09-12T17:58:25.591 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T17:58:25.591 INFO:tasks.workunit.client.0.smithi098.stderr:Aborted 2024-09-12T17:58:25.592 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:58:25.593 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:25.593 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:25.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.503+0000 7f7610e979c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.507+0000 7f7610e979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.507+0000 7f7610e979c0 20 realm 2024-09-12T17:58:25.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.507+0000 7f7610e979c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.507+0000 7f7610e979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.507+0000 7f7610e979c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:25.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.507+0000 7f7610e979c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.507+0000 7f7610e979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.507+0000 7f7610e979c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.511+0000 7f7610e979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:25.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.511+0000 7f7610e979c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.511+0000 7f7610e979c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:25.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.511+0000 7f7610e979c0 20 searching for the correct realm 2024-09-12T17:58:25.595 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.515+0000 7f760f19e640 0 -- 172.21.15.98:0/656462171 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f7604107290 msgr2=0x7f76041023f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:25.733 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.731+0000 7f760e99d640 0 -- 172.21.15.98:0/656462171 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x557d5c17f180 msgr2=0x557d5c181620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:25.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.739+0000 7f7610e979c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:25.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.739+0000 7f7610e979c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:58:25.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.739+0000 7f7610e979c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:25.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.739+0000 7f7610e979c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:58:25.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.739+0000 7f7610e979c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:25.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.739+0000 7f7610e979c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:25.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.739+0000 7f7610e979c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.739+0000 7f7610e979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.739+0000 7f7610e979c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.739+0000 7f7610e979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:25.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.739+0000 7f7610e979c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.739+0000 7f7610e979c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:25.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.743+0000 7f7610e979c0 20 zone default found 2024-09-12T17:58:25.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.743+0000 7f7610e979c0 4 Realm: () 2024-09-12T17:58:25.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.743+0000 7f7610e979c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:58:25.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.743+0000 7f7610e979c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:58:25.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.743+0000 7f7610e979c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:25.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.743+0000 7f7610e979c0 20 zonegroup default 2024-09-12T17:58:25.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.743+0000 7f7610e979c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.743+0000 7f7610e979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.743+0000 7f7610e979c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.743+0000 7f7610e979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.743+0000 7f7610e979c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.743+0000 7f7610e979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:25.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.743+0000 7f7610e979c0 20 started sync module instance, tier type = 2024-09-12T17:58:25.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.743+0000 7f7610e979c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:58:25.769 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.767+0000 7f7610e979c0 20 add_watcher() i=0 2024-09-12T17:58:25.769 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.767+0000 7f7610e979c0 20 add_watcher() i=1 2024-09-12T17:58:25.769 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.767+0000 7f7610e979c0 20 add_watcher() i=2 2024-09-12T17:58:25.769 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.767+0000 7f7610e979c0 20 add_watcher() i=3 2024-09-12T17:58:25.770 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.767+0000 7f7610e979c0 20 add_watcher() i=4 2024-09-12T17:58:25.770 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.767+0000 7f7610e979c0 20 add_watcher() i=5 2024-09-12T17:58:25.770 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.767+0000 7f7610e979c0 20 add_watcher() i=6 2024-09-12T17:58:25.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.771+0000 7f7610e979c0 20 add_watcher() i=7 2024-09-12T17:58:25.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.771+0000 7f7610e979c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:25.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.775+0000 7f74c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:25.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.775+0000 7f7610e979c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:25.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.775+0000 7f7610e979c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:25.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.775+0000 7f7610e979c0 5 note: GC not initialized 2024-09-12T17:58:25.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.775+0000 7f743ffff640 20 reqs_thread_entry: start 2024-09-12T17:58:25.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.775+0000 7f7610e979c0 20 init_complete bucket index max shards: 11 2024-09-12T17:58:25.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.775+0000 7f7610e979c0 20 Filter name: none 2024-09-12T17:58:25.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.775+0000 7f743dffb640 20 reqs_thread_entry: start 2024-09-12T17:58:25.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.775+0000 7f7610e979c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.775+0000 7f7610e979c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:25.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.775+0000 7f7610e979c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.779+0000 7f7610e979c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:58:25.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.779+0000 7f7610e979c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:25.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.779+0000 7f7610e979c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.779+0000 7f7610e979c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:25.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.779+0000 7f7610e979c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:25.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.779+0000 7f7610e979c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T17:58:25.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.779+0000 7f7610e979c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:25.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.783+0000 7f74c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:25.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.787+0000 7f7610e979c0 20 remove_watcher() i=0 2024-09-12T17:58:25.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.787+0000 7f7610e979c0 2 removed watcher, disabling cache 2024-09-12T17:58:25.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.787+0000 7f7610e979c0 20 remove_watcher() i=1 2024-09-12T17:58:25.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.791+0000 7f7610e979c0 20 remove_watcher() i=2 2024-09-12T17:58:25.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.795+0000 7f7610e979c0 20 remove_watcher() i=3 2024-09-12T17:58:25.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.795+0000 7f7610e979c0 20 remove_watcher() i=4 2024-09-12T17:58:25.799 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.799+0000 7f7610e979c0 20 remove_watcher() i=5 2024-09-12T17:58:25.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.799+0000 7f7610e979c0 20 remove_watcher() i=6 2024-09-12T17:58:25.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:25.799+0000 7f7610e979c0 20 remove_watcher() i=7 2024-09-12T17:58:25.816 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.817 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:58:25.817 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-commit-target-layout id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:58:25.817 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:25.817 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:25.817 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:56.133 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:56.134 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:56.220 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:58:56.257 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:56.257 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:56.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.302+0000 7f96000e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.302+0000 7f96000e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:56.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.302+0000 7f96000e19c0 20 realm 2024-09-12T17:58:56.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.302+0000 7f96000e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.302+0000 7f96000e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:56.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.302+0000 7f96000e19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:56.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.302+0000 7f96000e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.302+0000 7f96000e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:56.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.302+0000 7f96000e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.306+0000 7f96000e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:56.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.306+0000 7f96000e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.306+0000 7f96000e19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:56.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.306+0000 7f96000e19c0 20 searching for the correct realm 2024-09-12T17:58:56.316 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.310+0000 7f95fd3e6640 0 -- 172.21.15.98:0/1202814201 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f95f001a040 msgr2=0x7f95f00780b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:56.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.318+0000 7f95fd3e6640 0 -- 172.21.15.98:0/1202814201 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f94c8081180 msgr2=0x7f94c80835b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:56.328 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:56.328 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:58:56.328 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:56.328 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:58:56.328 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:56.328 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:56.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:56.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:56.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:56.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 20 zone default found 2024-09-12T17:58:56.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 4 Realm: () 2024-09-12T17:58:56.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:58:56.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:58:56.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:56.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 20 zonegroup default 2024-09-12T17:58:56.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:56.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:56.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.326+0000 7f96000e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.330+0000 7f96000e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:56.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.330+0000 7f96000e19c0 20 started sync module instance, tier type = 2024-09-12T17:58:56.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.330+0000 7f96000e19c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:58:56.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.342+0000 7f96000e19c0 20 add_watcher() i=0 2024-09-12T17:58:56.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.342+0000 7f96000e19c0 20 add_watcher() i=1 2024-09-12T17:58:56.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.342+0000 7f96000e19c0 20 add_watcher() i=2 2024-09-12T17:58:56.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.342+0000 7f96000e19c0 20 add_watcher() i=3 2024-09-12T17:58:56.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.342+0000 7f96000e19c0 20 add_watcher() i=4 2024-09-12T17:58:56.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.342+0000 7f96000e19c0 20 add_watcher() i=5 2024-09-12T17:58:56.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.342+0000 7f96000e19c0 20 add_watcher() i=6 2024-09-12T17:58:56.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.346+0000 7f96000e19c0 20 add_watcher() i=7 2024-09-12T17:58:56.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.346+0000 7f96000e19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:56.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.346+0000 7f94b3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:56.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.350+0000 7f96000e19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:56.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.350+0000 7f96000e19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:56.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.350+0000 7f96000e19c0 5 note: GC not initialized 2024-09-12T17:58:56.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.350+0000 7f94b2fe5640 20 reqs_thread_entry: start 2024-09-12T17:58:56.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.350+0000 7f96000e19c0 20 init_complete bucket index max shards: 11 2024-09-12T17:58:56.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.350+0000 7f96000e19c0 20 Filter name: none 2024-09-12T17:58:56.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.350+0000 7f94b0fe1640 20 reqs_thread_entry: start 2024-09-12T17:58:56.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.350+0000 7f96000e19c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T17:58:56.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.350+0000 7f96000e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.350+0000 7f96000e19c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:56.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.350+0000 7f96000e19c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T17:58:56.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.350+0000 7f96000e19c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T17:58:56.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.350+0000 7f96000e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 : miss 2024-09-12T17:58:56.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.350+0000 7f96000e19c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.350+0000 7f96000e19c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:58:56.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.350+0000 7f96000e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:56.354 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.350+0000 7f96000e19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:56.354 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.350+0000 7f96000e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:58:56.354 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.350+0000 7f96000e19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:56.354 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.350+0000 7f96000e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 2024-09-12T17:58:56.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.362+0000 7f96000e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:56.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.362+0000 7f96000e19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:56.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.362+0000 7f96000e19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:56.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.362+0000 7f96000e19c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32, ofs0, ns] 2024-09-12T17:58:56.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.362+0000 7f94e17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366195 cookie 94754432920544 notifier 6920 bl.length()=931 2024-09-12T17:58:56.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.362+0000 7f94e17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:56.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.362+0000 7f94e17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:56.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.362+0000 7f94e17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:56.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.366+0000 7f96000e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): orig_sources= new_sources= 2024-09-12T17:58:56.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.366+0000 7f96000e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): potential sources added=[] removed=[] 2024-09-12T17:58:56.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.366+0000 7f96000e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): orig_dests= new_dests= 2024-09-12T17:58:56.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.366+0000 7f96000e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): potential dests added=[] removed=[] 2024-09-12T17:58:56.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.0 2024-09-12T17:58:56.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.0 2024-09-12T17:58:56.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.1 2024-09-12T17:58:56.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.1 2024-09-12T17:58:56.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.2 2024-09-12T17:58:56.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.2 2024-09-12T17:58:56.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.3 2024-09-12T17:58:56.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.3 2024-09-12T17:58:56.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.4 2024-09-12T17:58:56.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.4 2024-09-12T17:58:56.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.5 2024-09-12T17:58:56.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.5 2024-09-12T17:58:56.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.6 2024-09-12T17:58:56.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.6 2024-09-12T17:58:56.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.7 2024-09-12T17:58:56.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.7 2024-09-12T17:58:56.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.8 2024-09-12T17:58:56.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.8 2024-09-12T17:58:56.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.9 2024-09-12T17:58:56.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.9 2024-09-12T17:58:56.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.10 2024-09-12T17:58:56.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.10 2024-09-12T17:58:56.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.11 2024-09-12T17:58:56.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1.11 2024-09-12T17:58:56.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.0 2024-09-12T17:58:56.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.374+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1 2024-09-12T17:58:56.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.378+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.2 2024-09-12T17:58:56.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.378+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.3 2024-09-12T17:58:56.381 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.378+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.4 2024-09-12T17:58:56.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.378+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.5 2024-09-12T17:58:56.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.378+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.6 2024-09-12T17:58:56.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.382+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.7 2024-09-12T17:58:56.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.382+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.8 2024-09-12T17:58:56.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.382+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.9 2024-09-12T17:58:56.387 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.386+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.10 2024-09-12T17:58:56.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.390+0000 7f96000e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:58:56.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.390+0000 7f96000e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 2024-09-12T17:58:56.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.390+0000 7f96000e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:56.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.390+0000 7f96000e19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:56.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.390+0000 7f96000e19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:56.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.390+0000 7f96000e19c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32, ofs0, ns] 2024-09-12T17:58:56.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.394+0000 7f94e17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366196 cookie 94754432920544 notifier 6920 bl.length()=931 2024-09-12T17:58:56.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.394+0000 7f94e17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:56.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.394+0000 7f94e17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:56.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.394+0000 7f94e17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:56.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.394+0000 7f96000e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): orig_sources= new_sources= 2024-09-12T17:58:56.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.394+0000 7f96000e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): potential sources added=[] removed=[] 2024-09-12T17:58:56.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.394+0000 7f96000e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): orig_dests= new_dests= 2024-09-12T17:58:56.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.394+0000 7f96000e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): potential dests added=[] removed=[] 2024-09-12T17:58:56.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.398+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.0 2024-09-12T17:58:56.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.402+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.1 2024-09-12T17:58:56.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.402+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.2 2024-09-12T17:58:56.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.402+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.3 2024-09-12T17:58:56.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.402+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.4 2024-09-12T17:58:56.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.402+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.5 2024-09-12T17:58:56.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.402+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.6 2024-09-12T17:58:56.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.402+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.7 2024-09-12T17:58:56.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.402+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.8 2024-09-12T17:58:56.407 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.406+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.9 2024-09-12T17:58:56.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.406+0000 7f96000e19c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.32.10 2024-09-12T17:58:56.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.406+0000 7f96000e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 : hit (requested=0x17, cached=0x17) 2024-09-12T17:58:56.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.406+0000 7f96000e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 2024-09-12T17:58:56.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.410+0000 7f96000e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:56.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.410+0000 7f96000e19c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:56.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.410+0000 7f96000e19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:56.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.410+0000 7f96000e19c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32, ofs0, ns] 2024-09-12T17:58:56.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.410+0000 7f94e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366197 cookie 94754432920544 notifier 6920 bl.length()=899 2024-09-12T17:58:56.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.410+0000 7f94e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 info.flags=0x17 2024-09-12T17:58:56.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.410+0000 7f94e0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 to cache LRU end 2024-09-12T17:58:56.412 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.410+0000 7f94e0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:58:56.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.410+0000 7f96000e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): orig_sources= new_sources= 2024-09-12T17:58:56.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.410+0000 7f96000e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): potential sources added=[] removed=[] 2024-09-12T17:58:56.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.410+0000 7f96000e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): orig_dests= new_dests= 2024-09-12T17:58:56.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.410+0000 7f96000e19c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a01e4849-e968-46ce-97f1-a673c26b3735.4529.32]): potential dests added=[] removed=[] 2024-09-12T17:58:56.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.414+0000 7f96000e19c0 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T17:58:56.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.418+0000 7f94b3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:56.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.422+0000 7f96000e19c0 20 remove_watcher() i=0 2024-09-12T17:58:56.426 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.422+0000 7f96000e19c0 2 removed watcher, disabling cache 2024-09-12T17:58:56.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.426+0000 7f96000e19c0 20 remove_watcher() i=1 2024-09-12T17:58:56.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.430+0000 7f96000e19c0 20 remove_watcher() i=2 2024-09-12T17:58:56.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.430+0000 7f96000e19c0 20 remove_watcher() i=3 2024-09-12T17:58:56.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.434+0000 7f96000e19c0 20 remove_watcher() i=4 2024-09-12T17:58:56.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.434+0000 7f96000e19c0 20 remove_watcher() i=5 2024-09-12T17:58:56.438 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.434+0000 7f96000e19c0 20 remove_watcher() i=6 2024-09-12T17:58:56.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.438+0000 7f96000e19c0 20 remove_watcher() i=7 2024-09-12T17:58:56.453 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T17:58:56.481 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:56.481 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:56.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.522+0000 7f27eb7c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.526 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.522+0000 7f27eb7c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:56.527 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.522+0000 7f27eb7c29c0 20 realm 2024-09-12T17:58:56.527 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.522+0000 7f27eb7c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.527 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.522+0000 7f27eb7c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:56.527 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.522+0000 7f27eb7c29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:56.527 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.522+0000 7f27eb7c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.528 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.522+0000 7f27eb7c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:56.528 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.522+0000 7f27eb7c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.529 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.526+0000 7f27eb7c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:56.529 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.526+0000 7f27eb7c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.530 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.526+0000 7f27eb7c29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:56.530 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.526+0000 7f27eb7c29c0 20 searching for the correct realm 2024-09-12T17:58:56.534 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.530+0000 7f27e9ac9640 0 -- 172.21.15.98:0/652795575 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x56220d42b890 msgr2=0x56220d42dd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:56.539 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.538+0000 7f27e92c8640 0 -- 172.21.15.98:0/652795575 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f27e008e6a0 msgr2=0x7f27e0085670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:56.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:56.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:58:56.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:56.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:58:56.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:56.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:56.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:56.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:56.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:56.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 zone default found 2024-09-12T17:58:56.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 4 Realm: () 2024-09-12T17:58:56.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:58:56.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:58:56.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:56.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 zonegroup default 2024-09-12T17:58:56.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:56.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:56.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.551 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:56.551 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 started sync module instance, tier type = 2024-09-12T17:58:56.551 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.546+0000 7f27eb7c29c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:58:56.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.562+0000 7f27eb7c29c0 20 add_watcher() i=0 2024-09-12T17:58:56.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.562+0000 7f27eb7c29c0 20 add_watcher() i=1 2024-09-12T17:58:56.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.562+0000 7f27eb7c29c0 20 add_watcher() i=2 2024-09-12T17:58:56.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.562+0000 7f27eb7c29c0 20 add_watcher() i=3 2024-09-12T17:58:56.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.562+0000 7f27eb7c29c0 20 add_watcher() i=4 2024-09-12T17:58:56.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.562+0000 7f27eb7c29c0 20 add_watcher() i=5 2024-09-12T17:58:56.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.562+0000 7f27eb7c29c0 20 add_watcher() i=6 2024-09-12T17:58:56.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.562+0000 7f27eb7c29c0 20 add_watcher() i=7 2024-09-12T17:58:56.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.562+0000 7f27eb7c29c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:56.569 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.566+0000 7f269ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:56.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.566+0000 7f27eb7c29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:56.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.566+0000 7f27eb7c29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:56.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.566+0000 7f27eb7c29c0 5 note: GC not initialized 2024-09-12T17:58:56.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.566+0000 7f269efe5640 20 reqs_thread_entry: start 2024-09-12T17:58:56.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.566+0000 7f27eb7c29c0 20 init_complete bucket index max shards: 11 2024-09-12T17:58:56.571 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.566+0000 7f27eb7c29c0 20 Filter name: none 2024-09-12T17:58:56.571 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.566+0000 7f269cfe1640 20 reqs_thread_entry: start 2024-09-12T17:58:56.571 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.566+0000 7f27eb7c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.571 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.570+0000 7f27eb7c29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:56.571 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.570+0000 7f27eb7c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.572 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.570+0000 7f27eb7c29c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:58:56.572 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.570+0000 7f27eb7c29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:56.572 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.570+0000 7f27eb7c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.573 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.570+0000 7f27eb7c29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T17:58:56.573 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.570+0000 7f27eb7c29c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:56.573 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.570+0000 7f27eb7c29c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:58:56.574 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.570+0000 7f27eb7c29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:56.576 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.574+0000 7f269ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:56.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.578+0000 7f27eb7c29c0 20 remove_watcher() i=0 2024-09-12T17:58:56.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.578+0000 7f27eb7c29c0 2 removed watcher, disabling cache 2024-09-12T17:58:56.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.578+0000 7f27eb7c29c0 20 remove_watcher() i=1 2024-09-12T17:58:56.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.582+0000 7f27eb7c29c0 20 remove_watcher() i=2 2024-09-12T17:58:56.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.582+0000 7f27eb7c29c0 20 remove_watcher() i=3 2024-09-12T17:58:56.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.586+0000 7f27eb7c29c0 20 remove_watcher() i=4 2024-09-12T17:58:56.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.586+0000 7f27eb7c29c0 20 remove_watcher() i=5 2024-09-12T17:58:56.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.590+0000 7f27eb7c29c0 20 remove_watcher() i=6 2024-09-12T17:58:56.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:56.590+0000 7f27eb7c29c0 20 remove_watcher() i=7 2024-09-12T17:58:56.605 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:56.605 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:58:56.606 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-commit-target-layout id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.32 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:58:56.606 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:56.607 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:56.608 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:56.629 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:56.629 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:57.153 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:57.153 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:57.553 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T17:58:57.553 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:57.556 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:57.556 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:57.696 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:57.697 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:57.783 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:57.783 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:57.890 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:57.890 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:57.991 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:57.991 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:58.085 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:58.086 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:58.242 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:58.242 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:58.318 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:58.318 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:58.411 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:58.411 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:58.514 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:58.515 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:58.614 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:58.614 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:58.711 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:58.711 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:58.812 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:58.812 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:58.905 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:58.905 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:59.005 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:59.005 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:59.114 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:59.114 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:59.208 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:59.208 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:59.304 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:59.304 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:59.402 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:59.403 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:59.500 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:59.500 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:59.598 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:59.598 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:59.696 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:58:59.696 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:58:59.791 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:58:59.824 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:59.825 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:58:59.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.870+0000 7f786d9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:59.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.870+0000 7f786d9ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:59.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.870+0000 7f786d9ed9c0 20 realm 2024-09-12T17:58:59.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.870+0000 7f786d9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:59.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.870+0000 7f786d9ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:59.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.870+0000 7f786d9ed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:58:59.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.870+0000 7f786d9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:59.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.874+0000 7f786d9ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:59.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.874+0000 7f786d9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:59.876 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.874+0000 7f786d9ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:59.876 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.874+0000 7f786d9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:59.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.874+0000 7f786d9ed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:58:59.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.874+0000 7f786d9ed9c0 20 searching for the correct realm 2024-09-12T17:58:59.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.882+0000 7f786bcf4640 0 -- 172.21.15.98:0/2723492800 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55599e84a530 msgr2=0x55599e84c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:59.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.886+0000 7f786b4f3640 0 -- 172.21.15.98:0/2723492800 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f7860102160 msgr2=0x7f786012a2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:58:59.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.894+0000 7f786d9ed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:58:59.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.894+0000 7f786d9ed9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:58:59.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.894+0000 7f786d9ed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:58:59.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.894+0000 7f786d9ed9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:58:59.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.894+0000 7f786d9ed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:58:59.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.894+0000 7f786d9ed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:58:59.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.894+0000 7f786d9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:59.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.894+0000 7f786d9ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:59.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.894+0000 7f786d9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:59.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.894+0000 7f786d9ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:58:59.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.894+0000 7f786d9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:59.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.894+0000 7f786d9ed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:58:59.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.894+0000 7f786d9ed9c0 20 zone default found 2024-09-12T17:58:59.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.894+0000 7f786d9ed9c0 4 Realm: () 2024-09-12T17:58:59.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.894+0000 7f786d9ed9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:58:59.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.894+0000 7f786d9ed9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:58:59.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.894+0000 7f786d9ed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:58:59.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.894+0000 7f786d9ed9c0 20 zonegroup default 2024-09-12T17:58:59.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.894+0000 7f786d9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:59.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.898+0000 7f786d9ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:59.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.898+0000 7f786d9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:59.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.898+0000 7f786d9ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:59.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.898+0000 7f786d9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:59.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.898+0000 7f786d9ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:58:59.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.898+0000 7f786d9ed9c0 20 started sync module instance, tier type = 2024-09-12T17:58:59.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.898+0000 7f786d9ed9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:58:59.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.914+0000 7f786d9ed9c0 20 add_watcher() i=0 2024-09-12T17:58:59.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.914+0000 7f786d9ed9c0 20 add_watcher() i=1 2024-09-12T17:58:59.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.914+0000 7f786d9ed9c0 20 add_watcher() i=2 2024-09-12T17:58:59.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.914+0000 7f786d9ed9c0 20 add_watcher() i=3 2024-09-12T17:58:59.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.914+0000 7f786d9ed9c0 20 add_watcher() i=4 2024-09-12T17:58:59.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.914+0000 7f786d9ed9c0 20 add_watcher() i=5 2024-09-12T17:58:59.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.914+0000 7f786d9ed9c0 20 add_watcher() i=6 2024-09-12T17:58:59.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.914+0000 7f786d9ed9c0 20 add_watcher() i=7 2024-09-12T17:58:59.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.914+0000 7f786d9ed9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:58:59.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.918+0000 7f7721fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:59.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.918+0000 7f786d9ed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:58:59.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.918+0000 7f786d9ed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:58:59.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.918+0000 7f786d9ed9c0 5 note: GC not initialized 2024-09-12T17:58:59.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.918+0000 7f7720fe1640 20 reqs_thread_entry: start 2024-09-12T17:58:59.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.918+0000 7f786d9ed9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:58:59.922 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.918+0000 7f786d9ed9c0 20 Filter name: none 2024-09-12T17:58:59.922 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.918+0000 7f769a7fc640 20 reqs_thread_entry: start 2024-09-12T17:58:59.922 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.918+0000 7f786d9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:59.922 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.918+0000 7f786d9ed9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:59.922 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.918+0000 7f786d9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:59.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.922+0000 7f786d9ed9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:58:59.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.922+0000 7f786d9ed9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:59.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.922+0000 7f786d9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:59.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.922+0000 7f786d9ed9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:58:59.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.922+0000 7f786d9ed9c0 20 rados->read ofs=0 len=0 2024-09-12T17:58:59.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.922+0000 7f786d9ed9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:58:59.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.922+0000 7f786d9ed9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:58:59.927 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.926+0000 7f7721fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:58:59.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.930+0000 7f786d9ed9c0 20 remove_watcher() i=0 2024-09-12T17:58:59.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.930+0000 7f786d9ed9c0 2 removed watcher, disabling cache 2024-09-12T17:58:59.933 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.930+0000 7f786d9ed9c0 20 remove_watcher() i=1 2024-09-12T17:58:59.935 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.934+0000 7f786d9ed9c0 20 remove_watcher() i=2 2024-09-12T17:58:59.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.934+0000 7f786d9ed9c0 20 remove_watcher() i=3 2024-09-12T17:58:59.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.938+0000 7f786d9ed9c0 20 remove_watcher() i=4 2024-09-12T17:58:59.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.938+0000 7f786d9ed9c0 20 remove_watcher() i=5 2024-09-12T17:58:59.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.938+0000 7f786d9ed9c0 20 remove_watcher() i=6 2024-09-12T17:58:59.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:58:59.942+0000 7f786d9ed9c0 20 remove_watcher() i=7 2024-09-12T17:58:59.957 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:59.957 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:58:59.957 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-do-reshard id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:58:59.957 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:58:59.957 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T17:58:59.989 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:58:59.989 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:00.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.030+0000 7f4a8c7259c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.030+0000 7f4a8c7259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.030+0000 7f4a8c7259c0 20 realm 2024-09-12T17:59:00.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.030+0000 7f4a8c7259c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.030+0000 7f4a8c7259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.030+0000 7f4a8c7259c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:00.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.030+0000 7f4a8c7259c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.030+0000 7f4a8c7259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.030+0000 7f4a8c7259c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.034+0000 7f4a8c7259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:00.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.034+0000 7f4a8c7259c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.034+0000 7f4a8c7259c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:00.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.034+0000 7f4a8c7259c0 20 searching for the correct realm 2024-09-12T17:59:00.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.038+0000 7f4a8aa2c640 0 -- 172.21.15.98:0/403003045 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55c71d74c730 msgr2=0x55c71d74eb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:00.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.046+0000 7f4a8a22b640 0 -- 172.21.15.98:0/403003045 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f4a800ec800 msgr2=0x7f4a8011d0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:00.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.050+0000 7f4a8c7259c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:00.054 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.050+0000 7f4a8c7259c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:00.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.050+0000 7f4a8c7259c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:00.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.050+0000 7f4a8c7259c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:00.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.050+0000 7f4a8c7259c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:00.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.050+0000 7f4a8c7259c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:00.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.050+0000 7f4a8c7259c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.050+0000 7f4a8c7259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.050+0000 7f4a8c7259c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.054+0000 7f4a8c7259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:00.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.054+0000 7f4a8c7259c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.054+0000 7f4a8c7259c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:00.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.054+0000 7f4a8c7259c0 20 zone default found 2024-09-12T17:59:00.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.054+0000 7f4a8c7259c0 4 Realm: () 2024-09-12T17:59:00.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.054+0000 7f4a8c7259c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:00.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.054+0000 7f4a8c7259c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:00.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.054+0000 7f4a8c7259c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:00.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.054+0000 7f4a8c7259c0 20 zonegroup default 2024-09-12T17:59:00.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.054+0000 7f4a8c7259c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.054+0000 7f4a8c7259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.054+0000 7f4a8c7259c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.054+0000 7f4a8c7259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.058 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.054+0000 7f4a8c7259c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.058 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.054+0000 7f4a8c7259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.058 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.054+0000 7f4a8c7259c0 20 started sync module instance, tier type = 2024-09-12T17:59:00.058 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.054+0000 7f4a8c7259c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:00.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.070+0000 7f4a8c7259c0 20 add_watcher() i=0 2024-09-12T17:59:00.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.070+0000 7f4a8c7259c0 20 add_watcher() i=1 2024-09-12T17:59:00.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.070+0000 7f4a8c7259c0 20 add_watcher() i=2 2024-09-12T17:59:00.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.070+0000 7f4a8c7259c0 20 add_watcher() i=3 2024-09-12T17:59:00.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.070+0000 7f4a8c7259c0 20 add_watcher() i=4 2024-09-12T17:59:00.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.070+0000 7f4a8c7259c0 20 add_watcher() i=5 2024-09-12T17:59:00.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.070+0000 7f4a8c7259c0 20 add_watcher() i=6 2024-09-12T17:59:00.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.070+0000 7f4a8c7259c0 20 add_watcher() i=7 2024-09-12T17:59:00.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.070+0000 7f4a8c7259c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:00.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f4940fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:00.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f4a8c7259c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:00.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f4a8c7259c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:00.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f4a8c7259c0 5 note: GC not initialized 2024-09-12T17:59:00.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f48bb7fe640 20 reqs_thread_entry: start 2024-09-12T17:59:00.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f4a8c7259c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:00.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f4a8c7259c0 20 Filter name: none 2024-09-12T17:59:00.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f48b97fa640 20 reqs_thread_entry: start 2024-09-12T17:59:00.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f4a8c7259c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T17:59:00.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f4a8c7259c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f4a8c7259c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:59:00.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f4a8c7259c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T17:59:00.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f4a8c7259c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T17:59:00.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f4a8c7259c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 : miss 2024-09-12T17:59:00.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f4a8c7259c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f4a8c7259c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:59:00.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f4a8c7259c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 info.flags=0x17 2024-09-12T17:59:00.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f4a8c7259c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 to cache LRU end 2024-09-12T17:59:00.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f4a8c7259c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:00.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f4a8c7259c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:00.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.074+0000 7f4a8c7259c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 2024-09-12T17:59:00.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.086+0000 7f4a8c7259c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 info.flags=0x17 2024-09-12T17:59:00.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.086+0000 7f4a8c7259c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 to cache LRU end 2024-09-12T17:59:00.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.086+0000 7f4a8c7259c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:00.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.086+0000 7f4a8c7259c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33, ofs0, ns] 2024-09-12T17:59:00.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.090+0000 7f496d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 94313681111696 notifier 6968 bl.length()=911 2024-09-12T17:59:00.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.090+0000 7f496d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 info.flags=0x17 2024-09-12T17:59:00.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.090+0000 7f496d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 to cache LRU end 2024-09-12T17:59:00.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.090+0000 7f496d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:00.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.090+0000 7f4a8c7259c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.33]): orig_sources= new_sources= 2024-09-12T17:59:00.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.090+0000 7f4a8c7259c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.33]): potential sources added=[] removed=[] 2024-09-12T17:59:00.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.090+0000 7f4a8c7259c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.33]): orig_dests= new_dests= 2024-09-12T17:59:00.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.090+0000 7f4a8c7259c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.33]): potential dests added=[] removed=[] 2024-09-12T17:59:00.101 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.098+0000 7f4a8c7259c0 -1 Injecting error=-5 at location=do_reshard 2024-09-12T17:59:00.117 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.114+0000 7f4a8c7259c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:59:00.117 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.114+0000 7f4a8c7259c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 2024-09-12T17:59:00.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.118+0000 7f4a8c7259c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 info.flags=0x17 2024-09-12T17:59:00.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.118+0000 7f4a8c7259c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 to cache LRU end 2024-09-12T17:59:00.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.118+0000 7f4a8c7259c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:00.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.118+0000 7f4a8c7259c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33, ofs0, ns] 2024-09-12T17:59:00.121 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.118+0000 7f496d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366176 cookie 94313681111696 notifier 6968 bl.length()=879 2024-09-12T17:59:00.121 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.118+0000 7f496d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 info.flags=0x17 2024-09-12T17:59:00.121 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.118+0000 7f496d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 to cache LRU end 2024-09-12T17:59:00.121 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.118+0000 7f496d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:00.122 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.118+0000 7f4a8c7259c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.33]): orig_sources= new_sources= 2024-09-12T17:59:00.122 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.118+0000 7f4a8c7259c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.33]): potential sources added=[] removed=[] 2024-09-12T17:59:00.123 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.118+0000 7f4a8c7259c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.33]): orig_dests= new_dests= 2024-09-12T17:59:00.123 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.118+0000 7f4a8c7259c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.33]): potential dests added=[] removed=[] 2024-09-12T17:59:00.123 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.118+0000 7f4a8c7259c0 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T17:59:00.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.122+0000 7f4940fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:00.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.130+0000 7f4a8c7259c0 20 remove_watcher() i=0 2024-09-12T17:59:00.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.130+0000 7f4a8c7259c0 2 removed watcher, disabling cache 2024-09-12T17:59:00.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.130+0000 7f4a8c7259c0 20 remove_watcher() i=1 2024-09-12T17:59:00.135 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.134+0000 7f4a8c7259c0 20 remove_watcher() i=2 2024-09-12T17:59:00.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.134+0000 7f4a8c7259c0 20 remove_watcher() i=3 2024-09-12T17:59:00.139 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.138+0000 7f4a8c7259c0 20 remove_watcher() i=4 2024-09-12T17:59:00.140 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.138+0000 7f4a8c7259c0 20 remove_watcher() i=5 2024-09-12T17:59:00.142 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.138+0000 7f4a8c7259c0 20 remove_watcher() i=6 2024-09-12T17:59:00.144 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.142+0000 7f4a8c7259c0 20 remove_watcher() i=7 2024-09-12T17:59:00.157 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:59:00.185 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:00.185 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:00.227 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.226+0000 7f325c7149c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.230 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.226+0000 7f325c7149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.230 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.226+0000 7f325c7149c0 20 realm 2024-09-12T17:59:00.230 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.226+0000 7f325c7149c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.226+0000 7f325c7149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.226+0000 7f325c7149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:00.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.226+0000 7f325c7149c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.226+0000 7f325c7149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.226+0000 7f325c7149c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.230+0000 7f325c7149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:00.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.230+0000 7f325c7149c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.230+0000 7f325c7149c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:00.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.230+0000 7f325c7149c0 20 searching for the correct realm 2024-09-12T17:59:00.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.234+0000 7f325aa1b640 0 -- 172.21.15.98:0/1261033171 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f325000f430 msgr2=0x7f325000f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:59:00.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.454+0000 7f325a21a640 0 -- 172.21.15.98:0/1261033171 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x555ffee15840 msgr2=0x555ffee17c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:00.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.462+0000 7f325c7149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:00.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.462+0000 7f325c7149c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:00.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.462+0000 7f325c7149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:00.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.462+0000 7f325c7149c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:00.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.462+0000 7f325c7149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:00.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.462+0000 7f325c7149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:00.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.462+0000 7f325c7149c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.462+0000 7f325c7149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.462+0000 7f325c7149c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.462+0000 7f325c7149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:00.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.462+0000 7f325c7149c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.466+0000 7f325c7149c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:00.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.466+0000 7f325c7149c0 20 zone default found 2024-09-12T17:59:00.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.466+0000 7f325c7149c0 4 Realm: () 2024-09-12T17:59:00.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.466+0000 7f325c7149c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:00.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.466+0000 7f325c7149c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:00.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.466+0000 7f325c7149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:00.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.466+0000 7f325c7149c0 20 zonegroup default 2024-09-12T17:59:00.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.466+0000 7f325c7149c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.466+0000 7f325c7149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.466+0000 7f325c7149c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.466+0000 7f325c7149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.466+0000 7f325c7149c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.466+0000 7f325c7149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.466+0000 7f325c7149c0 20 started sync module instance, tier type = 2024-09-12T17:59:00.469 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.466+0000 7f325c7149c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:00.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.486+0000 7f325c7149c0 20 add_watcher() i=0 2024-09-12T17:59:00.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.486+0000 7f325c7149c0 20 add_watcher() i=1 2024-09-12T17:59:00.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.486+0000 7f325c7149c0 20 add_watcher() i=2 2024-09-12T17:59:00.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.486+0000 7f325c7149c0 20 add_watcher() i=3 2024-09-12T17:59:00.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.486+0000 7f325c7149c0 20 add_watcher() i=4 2024-09-12T17:59:00.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.486+0000 7f325c7149c0 20 add_watcher() i=5 2024-09-12T17:59:00.491 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.486+0000 7f325c7149c0 20 add_watcher() i=6 2024-09-12T17:59:00.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.490+0000 7f325c7149c0 20 add_watcher() i=7 2024-09-12T17:59:00.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.490+0000 7f325c7149c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:00.496 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.494+0000 7f3110fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:00.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.494+0000 7f325c7149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:00.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.494+0000 7f325c7149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:00.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.494+0000 7f325c7149c0 5 note: GC not initialized 2024-09-12T17:59:00.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.494+0000 7f308b7fe640 20 reqs_thread_entry: start 2024-09-12T17:59:00.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.494+0000 7f325c7149c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:00.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.494+0000 7f325c7149c0 20 Filter name: none 2024-09-12T17:59:00.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.494+0000 7f30897fa640 20 reqs_thread_entry: start 2024-09-12T17:59:00.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.494+0000 7f325c7149c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.498+0000 7f325c7149c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:59:00.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.498+0000 7f325c7149c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.498+0000 7f325c7149c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:59:00.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.498+0000 7f325c7149c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:00.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.498+0000 7f325c7149c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.498+0000 7f325c7149c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:59:00.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.498+0000 7f325c7149c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.498+0000 7f325c7149c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:59:00.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.498+0000 7f325c7149c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:00.505 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.502+0000 7f3110fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:00.510 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.506+0000 7f325c7149c0 20 remove_watcher() i=0 2024-09-12T17:59:00.510 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.506+0000 7f325c7149c0 2 removed watcher, disabling cache 2024-09-12T17:59:00.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.510+0000 7f325c7149c0 20 remove_watcher() i=1 2024-09-12T17:59:00.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.514+0000 7f325c7149c0 20 remove_watcher() i=2 2024-09-12T17:59:00.518 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.514+0000 7f325c7149c0 20 remove_watcher() i=3 2024-09-12T17:59:00.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.518+0000 7f325c7149c0 20 remove_watcher() i=4 2024-09-12T17:59:00.521 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.518+0000 7f325c7149c0 20 remove_watcher() i=5 2024-09-12T17:59:00.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.522+0000 7f325c7149c0 20 remove_watcher() i=6 2024-09-12T17:59:00.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.522+0000 7f325c7149c0 20 remove_watcher() i=7 2024-09-12T17:59:00.539 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:00.539 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:59:00.539 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-do-reshard id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:59:00.539 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:00.540 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:00.540 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:00.581 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:00.582 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:00.648 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:59:00.686 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:00.686 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:00.732 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.730+0000 7f588d93a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.730+0000 7f588d93a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.730+0000 7f588d93a9c0 20 realm 2024-09-12T17:59:00.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.730+0000 7f588d93a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.730+0000 7f588d93a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.730+0000 7f588d93a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:00.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.730+0000 7f588d93a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.730+0000 7f588d93a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.730+0000 7f588d93a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.734+0000 7f588d93a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:00.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.734+0000 7f588d93a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.734+0000 7f588d93a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:00.736 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.734+0000 7f588d93a9c0 20 searching for the correct realm 2024-09-12T17:59:00.742 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.738+0000 7f588bc41640 0 -- 172.21.15.98:0/739919191 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x56184dcec9e0 msgr2=0x56184dceee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:00.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.746+0000 7f5882c3f640 0 -- 172.21.15.98:0/739919191 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f587c07f040 msgr2=0x7f587c08aa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:00.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:00.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:00.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:00.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:00.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:00.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:00.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:00.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:00.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 zone default found 2024-09-12T17:59:00.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 4 Realm: () 2024-09-12T17:59:00.758 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:00.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:00.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:00.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 zonegroup default 2024-09-12T17:59:00.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 started sync module instance, tier type = 2024-09-12T17:59:00.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.754+0000 7f588d93a9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:00.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.770+0000 7f588d93a9c0 20 add_watcher() i=0 2024-09-12T17:59:00.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.770+0000 7f588d93a9c0 20 add_watcher() i=1 2024-09-12T17:59:00.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.770+0000 7f588d93a9c0 20 add_watcher() i=2 2024-09-12T17:59:00.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.770+0000 7f588d93a9c0 20 add_watcher() i=3 2024-09-12T17:59:00.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.770+0000 7f588d93a9c0 20 add_watcher() i=4 2024-09-12T17:59:00.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.770+0000 7f588d93a9c0 20 add_watcher() i=5 2024-09-12T17:59:00.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.770+0000 7f588d93a9c0 20 add_watcher() i=6 2024-09-12T17:59:00.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.774+0000 7f588d93a9c0 20 add_watcher() i=7 2024-09-12T17:59:00.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.774+0000 7f588d93a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:00.778 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.774+0000 7f5741fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:00.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.774+0000 7f588d93a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:00.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.774+0000 7f588d93a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:00.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.774+0000 7f588d93a9c0 5 note: GC not initialized 2024-09-12T17:59:00.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.774+0000 7f5740fe1640 20 reqs_thread_entry: start 2024-09-12T17:59:00.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.778+0000 7f588d93a9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:00.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.778+0000 7f588d93a9c0 20 Filter name: none 2024-09-12T17:59:00.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.778+0000 7f56ba7fc640 20 reqs_thread_entry: start 2024-09-12T17:59:00.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.778+0000 7f588d93a9c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T17:59:00.779 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.778+0000 7f588d93a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.778+0000 7f588d93a9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:59:00.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.778+0000 7f588d93a9c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T17:59:00.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.778+0000 7f588d93a9c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T17:59:00.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.778+0000 7f588d93a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 : miss 2024-09-12T17:59:00.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.778+0000 7f588d93a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.778+0000 7f588d93a9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:59:00.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.778+0000 7f588d93a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 info.flags=0x17 2024-09-12T17:59:00.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.778+0000 7f588d93a9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 to cache LRU end 2024-09-12T17:59:00.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.778+0000 7f588d93a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:00.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.778+0000 7f588d93a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:00.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.778+0000 7f588d93a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 2024-09-12T17:59:00.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.794+0000 7f588d93a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 info.flags=0x17 2024-09-12T17:59:00.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.794+0000 7f588d93a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 to cache LRU end 2024-09-12T17:59:00.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.794+0000 7f588d93a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:00.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.794+0000 7f588d93a9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33, ofs0, ns] 2024-09-12T17:59:00.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.794+0000 7f576e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366177 cookie 94662384667584 notifier 6998 bl.length()=911 2024-09-12T17:59:00.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.794+0000 7f576e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 info.flags=0x17 2024-09-12T17:59:00.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.794+0000 7f576e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 to cache LRU end 2024-09-12T17:59:00.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.794+0000 7f576e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:00.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.794+0000 7f588d93a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.33]): orig_sources= new_sources= 2024-09-12T17:59:00.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.794+0000 7f588d93a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.33]): potential sources added=[] removed=[] 2024-09-12T17:59:00.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.794+0000 7f588d93a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.33]): orig_dests= new_dests= 2024-09-12T17:59:00.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.794+0000 7f588d93a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.33]): potential dests added=[] removed=[] 2024-09-12T17:59:00.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.0 2024-09-12T17:59:00.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.0 2024-09-12T17:59:00.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.1 2024-09-12T17:59:00.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.1 2024-09-12T17:59:00.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.2 2024-09-12T17:59:00.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.2 2024-09-12T17:59:00.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.3 2024-09-12T17:59:00.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.3 2024-09-12T17:59:00.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.4 2024-09-12T17:59:00.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.4 2024-09-12T17:59:00.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.5 2024-09-12T17:59:00.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.5 2024-09-12T17:59:00.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.6 2024-09-12T17:59:00.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.6 2024-09-12T17:59:00.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.7 2024-09-12T17:59:00.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.7 2024-09-12T17:59:00.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.8 2024-09-12T17:59:00.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.8 2024-09-12T17:59:00.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.9 2024-09-12T17:59:00.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.9 2024-09-12T17:59:00.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.10 2024-09-12T17:59:00.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.10 2024-09-12T17:59:00.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.11 2024-09-12T17:59:00.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1.11 2024-09-12T17:59:00.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.0 2024-09-12T17:59:00.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1 2024-09-12T17:59:00.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.2 2024-09-12T17:59:00.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.3 2024-09-12T17:59:00.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.4 2024-09-12T17:59:00.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.806+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.5 2024-09-12T17:59:00.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.810+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.6 2024-09-12T17:59:00.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.810+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.7 2024-09-12T17:59:00.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.810+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.8 2024-09-12T17:59:00.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.810+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.9 2024-09-12T17:59:00.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.810+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.10 2024-09-12T17:59:00.822 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.818+0000 7f588d93a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:59:00.822 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.818+0000 7f588d93a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 2024-09-12T17:59:00.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.822+0000 7f588d93a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 info.flags=0x17 2024-09-12T17:59:00.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.822+0000 7f588d93a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 to cache LRU end 2024-09-12T17:59:00.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.822+0000 7f588d93a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:00.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.822+0000 7f588d93a9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33, ofs0, ns] 2024-09-12T17:59:00.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.822+0000 7f576effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366178 cookie 94662384667584 notifier 6998 bl.length()=911 2024-09-12T17:59:00.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.822+0000 7f576effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 info.flags=0x17 2024-09-12T17:59:00.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.822+0000 7f576effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 to cache LRU end 2024-09-12T17:59:00.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.822+0000 7f576effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:00.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.826+0000 7f588d93a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.33]): orig_sources= new_sources= 2024-09-12T17:59:00.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.826+0000 7f588d93a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.33]): potential sources added=[] removed=[] 2024-09-12T17:59:00.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.826+0000 7f588d93a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.33]): orig_dests= new_dests= 2024-09-12T17:59:00.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.826+0000 7f588d93a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.33]): potential dests added=[] removed=[] 2024-09-12T17:59:00.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.830+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.0 2024-09-12T17:59:00.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.830+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.1 2024-09-12T17:59:00.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.830+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.2 2024-09-12T17:59:00.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.830+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.3 2024-09-12T17:59:00.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.830+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.4 2024-09-12T17:59:00.836 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.830+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.5 2024-09-12T17:59:00.836 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.834+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.6 2024-09-12T17:59:00.836 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.834+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.7 2024-09-12T17:59:00.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.834+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.8 2024-09-12T17:59:00.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.834+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.9 2024-09-12T17:59:00.838 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.834+0000 7f588d93a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.33.10 2024-09-12T17:59:00.838 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.834+0000 7f588d93a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 : hit (requested=0x17, cached=0x17) 2024-09-12T17:59:00.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.834+0000 7f588d93a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 2024-09-12T17:59:00.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.838+0000 7f588d93a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 info.flags=0x17 2024-09-12T17:59:00.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.838+0000 7f588d93a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 to cache LRU end 2024-09-12T17:59:00.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.838+0000 7f588d93a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:00.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.838+0000 7f588d93a9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33, ofs0, ns] 2024-09-12T17:59:00.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.838+0000 7f576effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366179 cookie 94662384667584 notifier 6998 bl.length()=879 2024-09-12T17:59:00.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.838+0000 7f576effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 info.flags=0x17 2024-09-12T17:59:00.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.838+0000 7f576effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 to cache LRU end 2024-09-12T17:59:00.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.838+0000 7f576effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:00.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.842+0000 7f588d93a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.33]): orig_sources= new_sources= 2024-09-12T17:59:00.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.842+0000 7f588d93a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.33]): potential sources added=[] removed=[] 2024-09-12T17:59:00.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.842+0000 7f588d93a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.33]): orig_dests= new_dests= 2024-09-12T17:59:00.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.842+0000 7f588d93a9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.33]): potential dests added=[] removed=[] 2024-09-12T17:59:00.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.846+0000 7f588d93a9c0 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T17:59:00.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.850+0000 7f5741fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:00.856 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.854+0000 7f588d93a9c0 20 remove_watcher() i=0 2024-09-12T17:59:00.856 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.854+0000 7f588d93a9c0 2 removed watcher, disabling cache 2024-09-12T17:59:00.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.854+0000 7f588d93a9c0 20 remove_watcher() i=1 2024-09-12T17:59:00.860 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.858+0000 7f588d93a9c0 20 remove_watcher() i=2 2024-09-12T17:59:00.862 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.858+0000 7f588d93a9c0 20 remove_watcher() i=3 2024-09-12T17:59:00.864 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.862+0000 7f588d93a9c0 20 remove_watcher() i=4 2024-09-12T17:59:00.865 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.862+0000 7f588d93a9c0 20 remove_watcher() i=5 2024-09-12T17:59:00.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.862+0000 7f588d93a9c0 20 remove_watcher() i=6 2024-09-12T17:59:00.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.866+0000 7f588d93a9c0 20 remove_watcher() i=7 2024-09-12T17:59:00.885 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T17:59:00.919 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:00.919 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:00.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.958+0000 7f168b9389c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.962+0000 7f168b9389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.962+0000 7f168b9389c0 20 realm 2024-09-12T17:59:00.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.962+0000 7f168b9389c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.962+0000 7f168b9389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.962+0000 7f168b9389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:00.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.962+0000 7f168b9389c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.962+0000 7f168b9389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:00.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.962+0000 7f168b9389c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.962+0000 7f168b9389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:00.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.962+0000 7f168b9389c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:00.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.962+0000 7f168b9389c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:00.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.962+0000 7f168b9389c0 20 searching for the correct realm 2024-09-12T17:59:00.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:00.970+0000 7f1689c3f640 0 -- 172.21.15.98:0/381238287 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f1680017070 msgr2=0x7f1680088950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:01.188 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.186+0000 7f168943e640 0 -- 172.21.15.98:0/381238287 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x557345321140 msgr2=0x557345323600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:01.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:01.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:01.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:01.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:01.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:01.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:01.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:01.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:01.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:01.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:01.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:01.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:01.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 20 zone default found 2024-09-12T17:59:01.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 4 Realm: () 2024-09-12T17:59:01.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:01.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:01.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:01.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 20 zonegroup default 2024-09-12T17:59:01.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:01.200 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:01.200 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.194+0000 7f168b9389c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:01.200 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.198+0000 7f168b9389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:01.200 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.198+0000 7f168b9389c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:01.200 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.198+0000 7f168b9389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:01.200 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.198+0000 7f168b9389c0 20 started sync module instance, tier type = 2024-09-12T17:59:01.200 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.198+0000 7f168b9389c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:01.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.222+0000 7f168b9389c0 20 add_watcher() i=0 2024-09-12T17:59:01.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.222+0000 7f168b9389c0 20 add_watcher() i=1 2024-09-12T17:59:01.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.222+0000 7f168b9389c0 20 add_watcher() i=2 2024-09-12T17:59:01.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.222+0000 7f168b9389c0 20 add_watcher() i=3 2024-09-12T17:59:01.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.222+0000 7f168b9389c0 20 add_watcher() i=4 2024-09-12T17:59:01.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.222+0000 7f168b9389c0 20 add_watcher() i=5 2024-09-12T17:59:01.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.222+0000 7f168b9389c0 20 add_watcher() i=6 2024-09-12T17:59:01.227 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.226+0000 7f168b9389c0 20 add_watcher() i=7 2024-09-12T17:59:01.228 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.226+0000 7f168b9389c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:01.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.230+0000 7f153ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:01.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.230+0000 7f168b9389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:01.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.230+0000 7f168b9389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:01.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.230+0000 7f168b9389c0 5 note: GC not initialized 2024-09-12T17:59:01.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.230+0000 7f153efe5640 20 reqs_thread_entry: start 2024-09-12T17:59:01.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.230+0000 7f168b9389c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:01.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.230+0000 7f168b9389c0 20 Filter name: none 2024-09-12T17:59:01.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.230+0000 7f153cfe1640 20 reqs_thread_entry: start 2024-09-12T17:59:01.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.230+0000 7f168b9389c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:01.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.230+0000 7f168b9389c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:59:01.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.230+0000 7f168b9389c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:01.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.234+0000 7f168b9389c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:59:01.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.234+0000 7f168b9389c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:01.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.234+0000 7f168b9389c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:01.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.234+0000 7f168b9389c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:59:01.236 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.234+0000 7f168b9389c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:01.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.234+0000 7f168b9389c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:59:01.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.234+0000 7f168b9389c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:01.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.238+0000 7f153ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:01.246 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.242+0000 7f168b9389c0 20 remove_watcher() i=0 2024-09-12T17:59:01.246 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.242+0000 7f168b9389c0 2 removed watcher, disabling cache 2024-09-12T17:59:01.248 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.246+0000 7f168b9389c0 20 remove_watcher() i=1 2024-09-12T17:59:01.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.246+0000 7f168b9389c0 20 remove_watcher() i=2 2024-09-12T17:59:01.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.250+0000 7f168b9389c0 20 remove_watcher() i=3 2024-09-12T17:59:01.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.254+0000 7f168b9389c0 20 remove_watcher() i=4 2024-09-12T17:59:01.258 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.254+0000 7f168b9389c0 20 remove_watcher() i=5 2024-09-12T17:59:01.258 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.254+0000 7f168b9389c0 20 remove_watcher() i=6 2024-09-12T17:59:01.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:01.258+0000 7f168b9389c0 20 remove_watcher() i=7 2024-09-12T17:59:01.275 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:01.275 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:59:01.275 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-do-reshard id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:59:01.275 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:01.276 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:01.276 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:01.295 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:01.295 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:01.807 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:01.807 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:02.174 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T17:59:02.175 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:02.177 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:02.178 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:02.302 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:02.302 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:02.391 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:02.391 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:02.510 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:02.510 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:02.599 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:02.600 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:02.698 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:02.698 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:02.796 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:02.797 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:02.895 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:02.996 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:02.996 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:03.091 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:03.091 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:03.189 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:03.189 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:03.282 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:03.282 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:03.381 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:03.381 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:03.478 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:03.478 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:03.571 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:03.572 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:03.662 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:03.662 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:03.762 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:03.762 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:03.856 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:03.856 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:03.957 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:03.957 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:04.056 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:04.057 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:04.154 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:04.155 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:04.251 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:04.251 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:04.350 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:59:04.382 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:04.382 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:04.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.426+0000 7f1c32fef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.426+0000 7f1c32fef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.426+0000 7f1c32fef9c0 20 realm 2024-09-12T17:59:04.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.426+0000 7f1c32fef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.430+0000 7f1c32fef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.430+0000 7f1c32fef9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:04.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.430+0000 7f1c32fef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.430+0000 7f1c32fef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.430+0000 7f1c32fef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.430+0000 7f1c32fef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:04.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.430+0000 7f1c32fef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.430+0000 7f1c32fef9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:04.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.430+0000 7f1c32fef9c0 20 searching for the correct realm 2024-09-12T17:59:04.440 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.438+0000 7f1c312f6640 0 -- 172.21.15.98:0/1211205552 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f1c24001260 msgr2=0x7f1c240c1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:04.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.654+0000 7f1c30af5640 0 -- 172.21.15.98:0/1211205552 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x56308e7cd810 msgr2=0x56308e7cfc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:04.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.662+0000 7f1c32fef9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:04.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.662+0000 7f1c32fef9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:04.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.662+0000 7f1c32fef9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:04.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.662+0000 7f1c32fef9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:04.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.662+0000 7f1c32fef9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:04.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.662+0000 7f1c32fef9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:04.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.662+0000 7f1c32fef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.662+0000 7f1c32fef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.662+0000 7f1c32fef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.668 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.666+0000 7f1c32fef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:04.668 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.666+0000 7f1c32fef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.668 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.666+0000 7f1c32fef9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:04.668 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.666+0000 7f1c32fef9c0 20 zone default found 2024-09-12T17:59:04.668 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.666+0000 7f1c32fef9c0 4 Realm: () 2024-09-12T17:59:04.668 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.666+0000 7f1c32fef9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:04.669 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.666+0000 7f1c32fef9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:04.669 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.666+0000 7f1c32fef9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:04.669 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.666+0000 7f1c32fef9c0 20 zonegroup default 2024-09-12T17:59:04.669 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.666+0000 7f1c32fef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.669 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.666+0000 7f1c32fef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.666+0000 7f1c32fef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.666+0000 7f1c32fef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.666+0000 7f1c32fef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.666+0000 7f1c32fef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.666+0000 7f1c32fef9c0 20 started sync module instance, tier type = 2024-09-12T17:59:04.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.666+0000 7f1c32fef9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:04.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.690+0000 7f1c32fef9c0 20 add_watcher() i=0 2024-09-12T17:59:04.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.690+0000 7f1c32fef9c0 20 add_watcher() i=1 2024-09-12T17:59:04.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.690+0000 7f1c32fef9c0 20 add_watcher() i=2 2024-09-12T17:59:04.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.690+0000 7f1c32fef9c0 20 add_watcher() i=3 2024-09-12T17:59:04.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.690+0000 7f1c32fef9c0 20 add_watcher() i=4 2024-09-12T17:59:04.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.690+0000 7f1c32fef9c0 20 add_watcher() i=5 2024-09-12T17:59:04.697 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.690+0000 7f1c32fef9c0 20 add_watcher() i=6 2024-09-12T17:59:04.697 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.694+0000 7f1c32fef9c0 20 add_watcher() i=7 2024-09-12T17:59:04.697 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.694+0000 7f1c32fef9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:04.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.698+0000 7f1ae77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:04.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.698+0000 7f1c32fef9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:04.702 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.698+0000 7f1c32fef9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:04.703 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.698+0000 7f1c32fef9c0 5 note: GC not initialized 2024-09-12T17:59:04.704 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.702+0000 7f1ae67e4640 20 reqs_thread_entry: start 2024-09-12T17:59:04.704 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.702+0000 7f1c32fef9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:04.704 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.702+0000 7f1c32fef9c0 20 Filter name: none 2024-09-12T17:59:04.704 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.702+0000 7f1adf7fe640 20 reqs_thread_entry: start 2024-09-12T17:59:04.704 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.702+0000 7f1c32fef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.705 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.702+0000 7f1c32fef9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:59:04.705 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.702+0000 7f1c32fef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.702+0000 7f1c32fef9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:59:04.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.706+0000 7f1c32fef9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:04.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.706+0000 7f1c32fef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.706+0000 7f1c32fef9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:59:04.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.706+0000 7f1c32fef9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.706+0000 7f1c32fef9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:59:04.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.706+0000 7f1c32fef9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:04.713 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.710+0000 7f1ae77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:04.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.714+0000 7f1c32fef9c0 20 remove_watcher() i=0 2024-09-12T17:59:04.718 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.714+0000 7f1c32fef9c0 2 removed watcher, disabling cache 2024-09-12T17:59:04.720 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.718+0000 7f1c32fef9c0 20 remove_watcher() i=1 2024-09-12T17:59:04.722 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.718+0000 7f1c32fef9c0 20 remove_watcher() i=2 2024-09-12T17:59:04.724 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.722+0000 7f1c32fef9c0 20 remove_watcher() i=3 2024-09-12T17:59:04.726 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.722+0000 7f1c32fef9c0 20 remove_watcher() i=4 2024-09-12T17:59:04.728 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.726+0000 7f1c32fef9c0 20 remove_watcher() i=5 2024-09-12T17:59:04.730 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.726+0000 7f1c32fef9c0 20 remove_watcher() i=6 2024-09-12T17:59:04.732 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.730+0000 7f1c32fef9c0 20 remove_watcher() i=7 2024-09-12T17:59:04.747 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.747 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:59:04.747 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-do-reshard id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:59:04.747 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.748 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T17:59:04.780 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:04.780 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:04.824 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 realm 2024-09-12T17:59:04.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.822+0000 7fcd7f9739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:04.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.826+0000 7fcd7f9739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:04.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.826+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.826+0000 7fcd7f9739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:04.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.826+0000 7fcd7f9739c0 20 searching for the correct realm 2024-09-12T17:59:04.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.830+0000 7fcd7dc7a640 0 -- 172.21.15.98:0/3325347558 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55acf684dbf0 msgr2=0x55acf6850080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:04.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.838+0000 7fcd7cc78640 0 -- 172.21.15.98:0/3325347558 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fcd700e6030 msgr2=0x7fcd7011c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:04.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:04.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:04.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:04.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:04.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:04.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:04.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:04.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:04.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 zone default found 2024-09-12T17:59:04.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 4 Realm: () 2024-09-12T17:59:04.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:04.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:04.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:04.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 zonegroup default 2024-09-12T17:59:04.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 started sync module instance, tier type = 2024-09-12T17:59:04.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:04.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=0 2024-09-12T17:59:04.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=1 2024-09-12T17:59:04.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=2 2024-09-12T17:59:04.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=3 2024-09-12T17:59:04.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=4 2024-09-12T17:59:04.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=5 2024-09-12T17:59:04.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=6 2024-09-12T17:59:04.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=7 2024-09-12T17:59:04.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.866+0000 7fcd7f9739c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:04.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcc337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:04.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:04.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:04.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 note: GC not initialized 2024-09-12T17:59:04.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcc327e4640 20 reqs_thread_entry: start 2024-09-12T17:59:04.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:04.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 Filter name: none 2024-09-12T17:59:04.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcba3fff640 20 reqs_thread_entry: start 2024-09-12T17:59:04.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:59:04.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:59:04.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:59:04.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:59:04.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 : miss 2024-09-12T17:59:04.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:59:04.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 info.flags=0x17 2024-09-12T17:59:04.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 to cache LRU end 2024-09-12T17:59:04.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:04.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:04.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 2024-09-12T17:59:04.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.882+0000 7fcd7f9739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 info.flags=0x17 2024-09-12T17:59:04.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.882+0000 7fcd7f9739c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 to cache LRU end 2024-09-12T17:59:04.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.882+0000 7fcd7f9739c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:04.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.882+0000 7fcd7f9739c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34, ofs0, ns] 2024-09-12T17:59:04.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.886+0000 7fcc4ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366172 cookie 94201358700384 notifier 7049 bl.length()=911 2024-09-12T17:59:04.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.886+0000 7fcc4ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 info.flags=0x17 2024-09-12T17:59:04.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.886+0000 7fcc4ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 to cache LRU end 2024-09-12T17:59:04.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.886+0000 7fcc4ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:04.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.886+0000 7fcd7f9739c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): orig_sources= new_sources= 2024-09-12T17:59:04.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.886+0000 7fcd7f9739c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): potential sources added=[] removed=[] 2024-09-12T17:59:04.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.886+0000 7fcd7f9739c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): orig_dests= new_dests= 2024-09-12T17:59:04.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.886+0000 7fcd7f9739c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): potential dests added=[] removed=[] 2024-09-12T17:59:04.906 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcd7f9739c0 time 2024-09-12T17:59:04.907804+0000 2024-09-12T17:59:04.906 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:59:04.907 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:04.907 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fcd8324d2eb] 2024-09-12T17:59:04.908 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fcd8324d49f] 2024-09-12T17:59:04.908 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acf37110c1] 2024-09-12T17:59:04.908 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55acf37231fa] 2024-09-12T17:59:04.908 INFO:tasks.workunit.client.0.smithi098.stderr: 5: main() 2024-09-12T17:59:04.908 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fcd820b3d90] 2024-09-12T17:59:04.909 INFO:tasks.workunit.client.0.smithi098.stderr: 7: __libc_start_main() 2024-09-12T17:59:04.909 INFO:tasks.workunit.client.0.smithi098.stderr: 8: _start() 2024-09-12T17:59:04.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.906+0000 7fcd7f9739c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcd7f9739c0 time 2024-09-12T17:59:04.907804+0000 2024-09-12T17:59:04.909 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:59:04.909 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.909 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:04.910 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fcd8324d2eb] 2024-09-12T17:59:04.910 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fcd8324d49f] 2024-09-12T17:59:04.910 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acf37110c1] 2024-09-12T17:59:04.910 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55acf37231fa] 2024-09-12T17:59:04.910 INFO:tasks.workunit.client.0.smithi098.stderr: 5: main() 2024-09-12T17:59:04.910 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fcd820b3d90] 2024-09-12T17:59:04.911 INFO:tasks.workunit.client.0.smithi098.stderr: 7: __libc_start_main() 2024-09-12T17:59:04.911 INFO:tasks.workunit.client.0.smithi098.stderr: 8: _start() 2024-09-12T17:59:04.911 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.911 INFO:tasks.workunit.client.0.smithi098.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:59:04.911 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7fcd7f9739c0 thread_name:radosgw-admin 2024-09-12T17:59:04.935 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:04.936 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fcd820cc520] 2024-09-12T17:59:04.936 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:59:04.936 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:59:04.936 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:59:04.936 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fcd8324d345] 2024-09-12T17:59:04.936 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fcd8324d49f] 2024-09-12T17:59:04.936 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acf37110c1] 2024-09-12T17:59:04.936 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55acf37231fa] 2024-09-12T17:59:04.936 INFO:tasks.workunit.client.0.smithi098.stderr: 9: main() 2024-09-12T17:59:04.936 INFO:tasks.workunit.client.0.smithi098.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fcd820b3d90] 2024-09-12T17:59:04.936 INFO:tasks.workunit.client.0.smithi098.stderr: 11: __libc_start_main() 2024-09-12T17:59:04.936 INFO:tasks.workunit.client.0.smithi098.stderr: 12: _start() 2024-09-12T17:59:04.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.906+0000 7fcd7f9739c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:59:04.937 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7fcd7f9739c0 thread_name:radosgw-admin 2024-09-12T17:59:04.937 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.937 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:04.937 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fcd820cc520] 2024-09-12T17:59:04.937 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:59:04.937 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:59:04.937 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:59:04.937 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fcd8324d345] 2024-09-12T17:59:04.937 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fcd8324d49f] 2024-09-12T17:59:04.937 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acf37110c1] 2024-09-12T17:59:04.937 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55acf37231fa] 2024-09-12T17:59:04.937 INFO:tasks.workunit.client.0.smithi098.stderr: 9: main() 2024-09-12T17:59:04.938 INFO:tasks.workunit.client.0.smithi098.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fcd820b3d90] 2024-09-12T17:59:04.938 INFO:tasks.workunit.client.0.smithi098.stderr: 11: __libc_start_main() 2024-09-12T17:59:04.938 INFO:tasks.workunit.client.0.smithi098.stderr: 12: _start() 2024-09-12T17:59:04.938 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:59:04.938 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.938 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T17:59:04.938 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T17:59:04.798+0000 7fcd7cc78640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:59:04.938 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T17:59:04.798+0000 7fcd7dc7a640 10 monclient: get_auth_request con 0x55acf678be30 auth_method 0 2024-09-12T17:59:04.938 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T17:59:04.798+0000 7fcc6b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:04.938 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T17:59:04.798+0000 7fcc6b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:59:04.938 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T17:59:04.798+0000 7fcc6b606640 10 monclient: dump: 2024-09-12T17:59:04.938 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:04.939 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:04.939 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:04.939 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:04.939 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:04.939 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:04.939 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:04.939 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:04.939 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:04.939 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.939 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T17:59:04.798+0000 7fcc6b606640 10 monclient: _finish_auth 0 2024-09-12T17:59:04.939 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T17:59:04.798+0000 7fcc6b606640 10 monclient: _check_auth_tickets 2024-09-12T17:59:04.939 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T17:59:04.798+0000 7fcc6b606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:04.939 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T17:59:04.798+0000 7fcc6b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:04.939 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T17:59:04.798+0000 7fcc6b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:59:04.940 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T17:59:04.798+0000 7fcc6b606640 10 monclient: dump: 2024-09-12T17:59:04.940 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:04.940 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:04.940 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:04.940 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:04.940 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:04.940 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:04.940 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:04.940 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:04.940 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:04.940 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.941 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T17:59:04.798+0000 7fcd7f9739c0 5 monclient: authenticate success, global_id 7617 2024-09-12T17:59:04.941 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T17:59:04.798+0000 7fcd7f9739c0 10 monclient: get_monmap_and_config success 2024-09-12T17:59:04.941 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T17:59:04.798+0000 7fcd7f9739c0 4 set_mon_vals no callback set 2024-09-12T17:59:04.941 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T17:59:04.798+0000 7fcd7f9739c0 10 monclient: shutdown 2024-09-12T17:59:04.941 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T17:59:04.798+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) unregister_commands rotate-key 2024-09-12T17:59:04.941 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient: build_initial_monmap 2024-09-12T17:59:04.941 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 1 build_initial for_mkfs: 0 2024-09-12T17:59:04.941 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient: monmap: 2024-09-12T17:59:04.941 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:59:04.941 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:04.941 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:59:04.941 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:59:04.942 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:04.942 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:04.942 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:59:04.942 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:59:04.942 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:59:04.942 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.942 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding auth protocol: cephx 2024-09-12T17:59:04.942 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding auth protocol: cephx 2024-09-12T17:59:04.942 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding auth protocol: cephx 2024-09-12T17:59:04.942 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: secure 2024-09-12T17:59:04.942 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: crc 2024-09-12T17:59:04.942 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: secure 2024-09-12T17:59:04.942 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: crc 2024-09-12T17:59:04.943 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: secure 2024-09-12T17:59:04.943 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: crc 2024-09-12T17:59:04.943 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: crc 2024-09-12T17:59:04.943 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: secure 2024-09-12T17:59:04.943 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: crc 2024-09-12T17:59:04.943 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: secure 2024-09-12T17:59:04.943 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: crc 2024-09-12T17:59:04.943 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: secure 2024-09-12T17:59:04.943 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:04.943 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 1 librados: starting msgr at 2024-09-12T17:59:04.943 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 1 librados: starting objecter 2024-09-12T17:59:04.943 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command objecter_requests hook 0x55acf6793880 2024-09-12T17:59:04.943 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 1 librados: setting wanted keys 2024-09-12T17:59:04.944 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 1 librados: calling monclient init 2024-09-12T17:59:04.944 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient: init 2024-09-12T17:59:04.944 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding auth protocol: cephx 2024-09-12T17:59:04.944 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding auth protocol: cephx 2024-09-12T17:59:04.944 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding auth protocol: cephx 2024-09-12T17:59:04.944 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: secure 2024-09-12T17:59:04.944 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: crc 2024-09-12T17:59:04.944 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: secure 2024-09-12T17:59:04.944 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: crc 2024-09-12T17:59:04.944 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: secure 2024-09-12T17:59:04.944 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: crc 2024-09-12T17:59:04.944 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: crc 2024-09-12T17:59:04.945 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: secure 2024-09-12T17:59:04.945 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: crc 2024-09-12T17:59:04.945 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: secure 2024-09-12T17:59:04.945 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: crc 2024-09-12T17:59:04.945 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: secure 2024-09-12T17:59:04.945 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:04.945 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:04.945 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command rotate-key hook 0x55acf67622f8 2024-09-12T17:59:04.945 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient: _reopen_session rank -1 2024-09-12T17:59:04.946 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:59:04.946 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-b con 0x55acf65ef840 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:59:04.946 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-c con 0x55acf66a82b0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:59:04.946 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-a con 0x55acf678be30 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:59:04.946 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:04.946 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:04.946 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:04.946 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient(hunting): _renew_subs 2024-09-12T17:59:04.946 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient(hunting): authenticate will time out at 2741.373334s 2024-09-12T17:59:04.946 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 10 monclient(hunting): get_auth_request con 0x55acf66a82b0 auth_method 0 2024-09-12T17:59:04.946 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:04.946 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:04.946 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:04.946 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T17:59:04.802+0000 7fcd7dc7a640 10 monclient(hunting): get_auth_request con 0x55acf678be30 auth_method 0 2024-09-12T17:59:04.947 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T17:59:04.802+0000 7fcd7dc7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:04.947 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T17:59:04.802+0000 7fcd7dc7a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:04.947 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T17:59:04.802+0000 7fcd7dc7a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:04.947 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:04.947 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:04.947 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:04.947 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T17:59:04.802+0000 7fcd7dc7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:04.947 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T17:59:04.802+0000 7fcd7dc7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:04.947 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T17:59:04.802+0000 7fcd7dc7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:04.947 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_done global_id 7040 payload 824 2024-09-12T17:59:04.947 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 10 monclient: _finish_hunting 0 2024-09-12T17:59:04.947 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 1 monclient: found mon.noname-c 2024-09-12T17:59:04.947 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:59:04.948 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T17:59:04.802+0000 7fcc69e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:04.948 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T17:59:04.802+0000 7fcc69e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:59:04.948 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T17:59:04.802+0000 7fcc69e03640 10 monclient: dump: 2024-09-12T17:59:04.948 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:04.948 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:04.948 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:04.948 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:04.948 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:04.948 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:04.948 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:04.948 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:04.948 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:04.948 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.948 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T17:59:04.802+0000 7fcc69e03640 10 monclient: _finish_auth 0 2024-09-12T17:59:04.949 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T17:59:04.802+0000 7fcc69e03640 10 monclient: _check_auth_tickets 2024-09-12T17:59:04.949 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T17:59:04.802+0000 7fcc69e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:04.949 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T17:59:04.802+0000 7fcc69e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:04.949 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T17:59:04.802+0000 7fcc69e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:59:04.949 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T17:59:04.802+0000 7fcc69e03640 10 monclient: dump: 2024-09-12T17:59:04.949 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:04.949 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:04.949 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:04.949 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:04.949 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:04.949 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:04.949 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:04.950 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:04.950 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:04.950 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.950 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 monclient: authenticate success, global_id 7040 2024-09-12T17:59:04.950 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T17:59:04.802+0000 7fcc6b606640 4 set_mon_vals no callback set 2024-09-12T17:59:04.950 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient: _renew_subs 2024-09-12T17:59:04.950 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:04.950 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient: _renew_subs 2024-09-12T17:59:04.951 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:04.951 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 1 librados: init done 2024-09-12T17:59:04.951 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T17:59:04.806+0000 7fcc69e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:04.951 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T17:59:04.806+0000 7fcc69e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:04.951 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T17:59:04.806+0000 7fcc69e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:04.951 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T17:59:04.806+0000 7fcd7d479640 10 monclient: get_auth_request con 0x7fcc64070ae0 auth_method 0 2024-09-12T17:59:04.951 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T17:59:04.806+0000 7fcd7dc7a640 10 monclient: get_auth_request con 0x55acf67aa7f0 auth_method 0 2024-09-12T17:59:04.951 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T17:59:04.806+0000 7fcd7d479640 10 monclient: get_auth_request con 0x55acf67ad9d0 auth_method 0 2024-09-12T17:59:04.951 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient: get_auth_request con 0x55acf67b2a60 auth_method 0 2024-09-12T17:59:04.952 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient: build_initial_monmap 2024-09-12T17:59:04.952 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 1 build_initial for_mkfs: 0 2024-09-12T17:59:04.952 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient: monmap: 2024-09-12T17:59:04.952 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:59:04.952 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:04.952 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:59:04.952 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:59:04.953 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:04.953 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:04.953 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:59:04.953 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:59:04.953 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:59:04.953 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.953 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding auth protocol: cephx 2024-09-12T17:59:04.954 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding auth protocol: cephx 2024-09-12T17:59:04.954 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding auth protocol: cephx 2024-09-12T17:59:04.954 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: secure 2024-09-12T17:59:04.954 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: crc 2024-09-12T17:59:04.954 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: secure 2024-09-12T17:59:04.954 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: crc 2024-09-12T17:59:04.954 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: secure 2024-09-12T17:59:04.954 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: crc 2024-09-12T17:59:04.955 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: crc 2024-09-12T17:59:04.955 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: secure 2024-09-12T17:59:04.955 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: crc 2024-09-12T17:59:04.955 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: secure 2024-09-12T17:59:04.955 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: crc 2024-09-12T17:59:04.955 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: secure 2024-09-12T17:59:04.955 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:04.955 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command objecter_requests cmddesc objecter_requests hook 0x55acf67bbe20 EEXIST 2024-09-12T17:59:04.956 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient: init 2024-09-12T17:59:04.956 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding auth protocol: cephx 2024-09-12T17:59:04.956 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding auth protocol: cephx 2024-09-12T17:59:04.956 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding auth protocol: cephx 2024-09-12T17:59:04.956 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: secure 2024-09-12T17:59:04.956 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: crc 2024-09-12T17:59:04.956 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: secure 2024-09-12T17:59:04.956 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: crc 2024-09-12T17:59:04.957 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: secure 2024-09-12T17:59:04.957 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: crc 2024-09-12T17:59:04.957 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: crc 2024-09-12T17:59:04.957 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: secure 2024-09-12T17:59:04.957 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: crc 2024-09-12T17:59:04.957 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: secure 2024-09-12T17:59:04.957 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: crc 2024-09-12T17:59:04.957 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: secure 2024-09-12T17:59:04.958 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:04.958 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:04.958 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command rotate-key cmddesc rotate-key hook 0x55acf67b5960 EEXIST 2024-09-12T17:59:04.958 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient: _reopen_session rank -1 2024-09-12T17:59:04.958 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:59:04.958 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-b con 0x55acf67e0110 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:59:04.958 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-a con 0x55acf67f48b0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:59:04.958 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-c con 0x55acf67de470 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:59:04.959 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:04.959 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:04.959 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:04.959 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient(hunting): _renew_subs 2024-09-12T17:59:04.959 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient(hunting): authenticate will time out at 2741.383343s 2024-09-12T17:59:04.959 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient(hunting): get_auth_request con 0x55acf67f48b0 auth_method 0 2024-09-12T17:59:04.959 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:04.959 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:04.960 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:04.960 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T17:59:04.810+0000 7fcd7dc7a640 10 monclient(hunting): get_auth_request con 0x55acf67de470 auth_method 0 2024-09-12T17:59:04.960 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T17:59:04.810+0000 7fcd7dc7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:04.960 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T17:59:04.810+0000 7fcd7dc7a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:04.960 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T17:59:04.810+0000 7fcd7dc7a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:04.960 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:04.960 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:04.960 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:04.961 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T17:59:04.810+0000 7fcd7dc7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:04.961 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T17:59:04.810+0000 7fcd7dc7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:04.961 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T17:59:04.810+0000 7fcd7dc7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:04.961 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T17:59:04.810+0000 7fcd7d479640 10 monclient(hunting): get_auth_request con 0x55acf67e0110 auth_method 0 2024-09-12T17:59:04.961 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T17:59:04.810+0000 7fcd7d479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:04.961 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T17:59:04.810+0000 7fcd7d479640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:04.961 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T17:59:04.810+0000 7fcd7d479640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:04.961 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_done global_id 7623 payload 824 2024-09-12T17:59:04.962 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient: _finish_hunting 0 2024-09-12T17:59:04.962 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 1 monclient: found mon.noname-a 2024-09-12T17:59:04.962 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:59:04.962 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:04.962 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:59:04.962 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 10 monclient: dump: 2024-09-12T17:59:04.962 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:04.962 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:04.963 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:04.963 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:04.963 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:04.963 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:04.963 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:04.963 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:04.963 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:04.963 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.964 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 10 monclient: _finish_auth 0 2024-09-12T17:59:04.964 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:59:04.964 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 monclient: authenticate success, global_id 7623 2024-09-12T17:59:04.964 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient: _renew_subs 2024-09-12T17:59:04.964 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:59:04.964 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:04.964 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:04.964 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:59:04.964 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 10 monclient: dump: 2024-09-12T17:59:04.964 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:04.964 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:04.965 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:04.965 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:04.965 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:04.965 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:04.965 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:04.965 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:04.965 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:04.965 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.965 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T17:59:04.814+0000 7fcd7e47b640 4 set_mon_vals no callback set 2024-09-12T17:59:04.965 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient: _renew_subs 2024-09-12T17:59:04.965 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:59:04.965 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:04.965 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:04.966 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:04.966 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient: get_monmap_and_config 2024-09-12T17:59:04.966 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient: build_initial_monmap 2024-09-12T17:59:04.966 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 1 build_initial for_mkfs: 0 2024-09-12T17:59:04.966 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient: monmap: 2024-09-12T17:59:04.966 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:59:04.966 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:04.966 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:59:04.966 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:59:04.966 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:04.966 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:04.966 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:59:04.966 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:59:04.967 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:59:04.967 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.967 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding auth protocol: cephx 2024-09-12T17:59:04.967 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding auth protocol: cephx 2024-09-12T17:59:04.967 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding auth protocol: cephx 2024-09-12T17:59:04.967 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:04.967 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:04.967 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:04.967 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:04.967 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:04.967 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:04.967 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:04.967 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:04.967 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:04.968 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:04.968 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:04.968 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:04.968 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T17:59:04.814+0000 7fcd7d479640 10 monclient: get_auth_request con 0x7fcc580709f0 auth_method 0 2024-09-12T17:59:04.968 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:04.968 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient: init 2024-09-12T17:59:04.968 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding auth protocol: cephx 2024-09-12T17:59:04.968 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding auth protocol: cephx 2024-09-12T17:59:04.968 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding auth protocol: cephx 2024-09-12T17:59:04.968 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: secure 2024-09-12T17:59:04.968 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: crc 2024-09-12T17:59:04.968 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: secure 2024-09-12T17:59:04.968 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: crc 2024-09-12T17:59:04.969 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: secure 2024-09-12T17:59:04.969 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: crc 2024-09-12T17:59:04.969 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: crc 2024-09-12T17:59:04.969 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: secure 2024-09-12T17:59:04.969 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: crc 2024-09-12T17:59:04.969 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: secure 2024-09-12T17:59:04.969 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: crc 2024-09-12T17:59:04.969 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: secure 2024-09-12T17:59:04.969 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:04.969 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:04.969 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe7103ae98 EEXIST 2024-09-12T17:59:04.969 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient: _reopen_session rank -1 2024-09-12T17:59:04.969 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:59:04.970 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-c con 0x55acf682e180 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:59:04.970 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-a con 0x55acf682e560 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:59:04.970 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-b con 0x55acf682fa20 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:59:04.970 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:04.970 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:04.970 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:04.970 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient(hunting): _renew_subs 2024-09-12T17:59:04.970 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient(hunting): authenticate will time out at 2741.387601s 2024-09-12T17:59:04.970 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T17:59:04.814+0000 7fcd7d479640 10 monclient(hunting): get_auth_request con 0x55acf682e180 auth_method 0 2024-09-12T17:59:04.970 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T17:59:04.814+0000 7fcd7d479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:04.970 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T17:59:04.814+0000 7fcd7d479640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:04.970 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T17:59:04.814+0000 7fcd7d479640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:04.970 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T17:59:04.814+0000 7fcd7cc78640 10 monclient(hunting): get_auth_request con 0x55acf682e560 auth_method 0 2024-09-12T17:59:04.971 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T17:59:04.814+0000 7fcd7cc78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:04.971 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T17:59:04.814+0000 7fcd7cc78640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:04.971 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T17:59:04.814+0000 7fcd7cc78640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:04.971 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T17:59:04.814+0000 7fcd7d479640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:04.971 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T17:59:04.814+0000 7fcd7d479640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:04.971 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T17:59:04.814+0000 7fcd7d479640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:04.971 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T17:59:04.814+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:04.971 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T17:59:04.814+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:04.971 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T17:59:04.814+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:04.971 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): get_auth_request con 0x55acf682fa20 auth_method 0 2024-09-12T17:59:04.971 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:04.971 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:04.971 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:04.971 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T17:59:04.818+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_done global_id 7626 payload 274 2024-09-12T17:59:04.972 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T17:59:04.818+0000 7fcd7cc78640 10 monclient: _finish_hunting 0 2024-09-12T17:59:04.972 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T17:59:04.818+0000 7fcd7cc78640 1 monclient: found mon.noname-a 2024-09-12T17:59:04.972 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T17:59:04.818+0000 7fcd7cc78640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:59:04.972 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T17:59:04.818+0000 7fcc60ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:04.972 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T17:59:04.818+0000 7fcc60ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:59:04.972 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T17:59:04.818+0000 7fcc60ff9640 10 monclient: dump: 2024-09-12T17:59:04.972 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:04.972 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:04.972 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:04.972 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:04.973 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:04.973 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:04.973 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:04.973 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:04.973 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:04.973 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.973 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T17:59:04.818+0000 7fcc60ff9640 10 monclient: _finish_auth 0 2024-09-12T17:59:04.973 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T17:59:04.818+0000 7fcc60ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:59:04.973 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T17:59:04.818+0000 7fcc60ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:04.973 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 monclient: authenticate success, global_id 7626 2024-09-12T17:59:04.973 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: get_monmap_and_config success 2024-09-12T17:59:04.973 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T17:59:04.818+0000 7fcc60ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:04.973 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 4 set_mon_vals no callback set 2024-09-12T17:59:04.974 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T17:59:04.818+0000 7fcc60ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:59:04.974 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T17:59:04.818+0000 7fcc60ff9640 10 monclient: dump: 2024-09-12T17:59:04.974 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:04.974 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:04.974 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:04.974 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:04.974 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:04.974 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:04.974 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:04.974 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:04.974 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:04.974 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.974 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: shutdown 2024-09-12T17:59:04.974 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: build_initial_monmap 2024-09-12T17:59:04.975 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 1 build_initial for_mkfs: 0 2024-09-12T17:59:04.975 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: monmap: 2024-09-12T17:59:04.975 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:59:04.975 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:04.975 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:59:04.975 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:59:04.975 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:04.975 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:04.975 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:59:04.975 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:59:04.976 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:59:04.976 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.976 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding auth protocol: cephx 2024-09-12T17:59:04.976 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding auth protocol: cephx 2024-09-12T17:59:04.976 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding auth protocol: cephx 2024-09-12T17:59:04.976 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:04.976 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:04.976 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:04.976 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:04.976 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:04.976 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:04.976 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:04.976 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:04.977 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:04.977 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:04.977 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:04.977 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:04.977 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:04.977 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 1 librados: starting msgr at 2024-09-12T17:59:04.977 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 1 librados: starting objecter 2024-09-12T17:59:04.977 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command objecter_requests cmddesc objecter_requests hook 0x55acf67e5090 EEXIST 2024-09-12T17:59:04.977 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 1 librados: setting wanted keys 2024-09-12T17:59:04.977 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 1 librados: calling monclient init 2024-09-12T17:59:04.977 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: init 2024-09-12T17:59:04.977 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding auth protocol: cephx 2024-09-12T17:59:04.977 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding auth protocol: cephx 2024-09-12T17:59:04.978 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding auth protocol: cephx 2024-09-12T17:59:04.978 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: secure 2024-09-12T17:59:04.978 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: crc 2024-09-12T17:59:04.978 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: secure 2024-09-12T17:59:04.978 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: crc 2024-09-12T17:59:04.978 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: secure 2024-09-12T17:59:04.978 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: crc 2024-09-12T17:59:04.978 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: crc 2024-09-12T17:59:04.978 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: secure 2024-09-12T17:59:04.978 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: crc 2024-09-12T17:59:04.978 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: secure 2024-09-12T17:59:04.978 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: crc 2024-09-12T17:59:04.979 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: secure 2024-09-12T17:59:04.979 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:04.979 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:04.979 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command rotate-key cmddesc rotate-key hook 0x55acf67e2588 EEXIST 2024-09-12T17:59:04.979 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: _reopen_session rank -1 2024-09-12T17:59:04.979 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:59:04.979 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-c con 0x55acf682e180 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:59:04.979 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-b con 0x55acf682fa20 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:59:04.979 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-a con 0x55acf68248d0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:59:04.979 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:04.979 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:04.979 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:04.979 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient(hunting): _renew_subs 2024-09-12T17:59:04.979 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient(hunting): authenticate will time out at 2741.390688s 2024-09-12T17:59:04.980 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T17:59:04.818+0000 7fcd7d479640 10 monclient(hunting): get_auth_request con 0x55acf682e180 auth_method 0 2024-09-12T17:59:04.980 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T17:59:04.818+0000 7fcd7d479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:04.980 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T17:59:04.818+0000 7fcd7d479640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:04.980 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T17:59:04.818+0000 7fcd7d479640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:04.980 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): get_auth_request con 0x55acf68248d0 auth_method 0 2024-09-12T17:59:04.980 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:04.980 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:04.980 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:04.980 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T17:59:04.818+0000 7fcd7d479640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:04.980 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T17:59:04.818+0000 7fcd7d479640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:04.980 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T17:59:04.818+0000 7fcd7d479640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:04.980 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:04.980 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:04.981 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:04.981 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T17:59:04.818+0000 7fcd7d479640 10 monclient(hunting): handle_auth_done global_id 7049 payload 824 2024-09-12T17:59:04.981 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T17:59:04.818+0000 7fcd7d479640 10 monclient: _finish_hunting 0 2024-09-12T17:59:04.981 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T17:59:04.818+0000 7fcd7d479640 1 monclient: found mon.noname-c 2024-09-12T17:59:04.981 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T17:59:04.818+0000 7fcd7d479640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:59:04.981 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T17:59:04.818+0000 7fcd7cc78640 10 monclient: get_auth_request con 0x55acf682fa20 auth_method 0 2024-09-12T17:59:04.981 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T17:59:04.818+0000 7fcc4effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:04.981 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T17:59:04.818+0000 7fcc4effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:59:04.981 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T17:59:04.818+0000 7fcc4effd640 10 monclient: dump: 2024-09-12T17:59:04.981 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:04.981 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:04.981 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:04.981 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:04.982 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:04.982 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:04.982 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:04.982 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:04.982 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:04.982 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.982 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T17:59:04.818+0000 7fcc4effd640 10 monclient: _finish_auth 0 2024-09-12T17:59:04.982 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T17:59:04.818+0000 7fcc4effd640 10 monclient: _check_auth_tickets 2024-09-12T17:59:04.982 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T17:59:04.818+0000 7fcc4effd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:04.982 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T17:59:04.818+0000 7fcc4effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:04.982 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T17:59:04.818+0000 7fcc4effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:59:04.982 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T17:59:04.818+0000 7fcc4effd640 10 monclient: dump: 2024-09-12T17:59:04.982 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:04.983 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:04.983 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:04.983 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:04.983 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:04.983 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:04.983 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:04.983 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:04.983 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:04.983 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.983 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 monclient: authenticate success, global_id 7049 2024-09-12T17:59:04.983 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T17:59:04.818+0000 7fcc60ff9640 4 set_mon_vals no callback set 2024-09-12T17:59:04.983 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: _renew_subs 2024-09-12T17:59:04.983 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:04.983 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: _renew_subs 2024-09-12T17:59:04.984 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:04.984 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 1 librados: init done 2024-09-12T17:59:04.984 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command cr dump hook 0x7fcd7405d3d8 2024-09-12T17:59:04.984 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.984 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T17:59:04.822+0000 7fcc4effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:04.984 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T17:59:04.822+0000 7fcc4effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:04.984 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T17:59:04.822+0000 7fcc4effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:04.984 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T17:59:04.822+0000 7fcd7cc78640 10 monclient: get_auth_request con 0x7fcc48070b10 auth_method 0 2024-09-12T17:59:04.984 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T17:59:04.822+0000 7fcd7dc7a640 10 monclient: get_auth_request con 0x55acf684dbf0 auth_method 0 2024-09-12T17:59:04.984 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.984 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 realm 2024-09-12T17:59:04.985 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.985 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.985 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T17:59:04.822+0000 7fcd7f9739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:04.985 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.985 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.985 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.985 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T17:59:04.822+0000 7fcd7d479640 10 monclient: get_auth_request con 0x55acf6851e70 auth_method 0 2024-09-12T17:59:04.985 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T17:59:04.826+0000 7fcd7f9739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:04.985 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T17:59:04.826+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.985 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T17:59:04.826+0000 7fcd7f9739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:04.985 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T17:59:04.826+0000 7fcd7f9739c0 20 searching for the correct realm 2024-09-12T17:59:04.985 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T17:59:04.826+0000 7fcd7cc78640 10 monclient: get_auth_request con 0x55acf6857100 auth_method 0 2024-09-12T17:59:04.985 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T17:59:04.826+0000 7fcd7dc7a640 10 monclient: get_auth_request con 0x7fcd7404db60 auth_method 0 2024-09-12T17:59:04.986 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T17:59:04.830+0000 7fcd7d479640 10 monclient: get_auth_request con 0x7fcd78016040 auth_method 0 2024-09-12T17:59:04.986 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T17:59:04.830+0000 7fcd7cc78640 10 monclient: get_auth_request con 0x7fcd700e6030 auth_method 0 2024-09-12T17:59:04.986 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T17:59:04.830+0000 7fcd7dc7a640 0 -- 172.21.15.98:0/3325347558 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55acf684dbf0 msgr2=0x55acf6850080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:04.986 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T17:59:04.830+0000 7fcc4effd640 1 client.7049.objecter ms_handle_reset 0x55acf684dbf0 session 0x55acf684d570 osd.1 2024-09-12T17:59:04.986 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T17:59:04.830+0000 7fcc4effd640 10 monclient: _renew_subs 2024-09-12T17:59:04.986 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T17:59:04.830+0000 7fcc4effd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:04.986 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T17:59:04.830+0000 7fcd7dc7a640 10 monclient: get_auth_request con 0x7fcc480811b0 auth_method 0 2024-09-12T17:59:04.986 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T17:59:04.834+0000 7fcd7dc7a640 10 monclient: get_auth_request con 0x7fcd74058040 auth_method 0 2024-09-12T17:59:04.986 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T17:59:04.838+0000 7fcd7d479640 10 monclient: get_auth_request con 0x7fcd74083300 auth_method 0 2024-09-12T17:59:04.986 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T17:59:04.838+0000 7fcd7cc78640 0 -- 172.21.15.98:0/3325347558 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fcd700e6030 msgr2=0x7fcd7011c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:04.986 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T17:59:04.838+0000 7fcc4effd640 1 client.7049.objecter ms_handle_reset 0x7fcd700e6030 session 0x7fcd700c9050 osd.4 2024-09-12T17:59:04.986 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T17:59:04.838+0000 7fcd7cc78640 10 monclient: get_auth_request con 0x55acf684dbf0 auth_method 0 2024-09-12T17:59:04.986 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:04.986 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:04.987 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:04.987 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:04.987 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:04.987 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:04.987 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.987 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.987 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.987 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:04.987 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.987 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:04.987 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 zone default found 2024-09-12T17:59:04.987 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 4 Realm: () 2024-09-12T17:59:04.987 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:04.988 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:04.988 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:04.988 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 zonegroup default 2024-09-12T17:59:04.988 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.988 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.988 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.988 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.988 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.988 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:04.988 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 started sync module instance, tier type = 2024-09-12T17:59:04.988 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:04.988 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=0 2024-09-12T17:59:04.988 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=1 2024-09-12T17:59:04.988 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=2 2024-09-12T17:59:04.989 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=3 2024-09-12T17:59:04.989 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=4 2024-09-12T17:59:04.989 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=5 2024-09-12T17:59:04.989 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=6 2024-09-12T17:59:04.989 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=7 2024-09-12T17:59:04.989 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T17:59:04.866+0000 7fcd7f9739c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:04.989 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding auth protocol: cephx 2024-09-12T17:59:04.989 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding auth protocol: cephx 2024-09-12T17:59:04.989 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding auth protocol: cephx 2024-09-12T17:59:04.989 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: secure 2024-09-12T17:59:04.989 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: crc 2024-09-12T17:59:04.989 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: secure 2024-09-12T17:59:04.989 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T17:59:04.870+0000 7fcc337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:04.990 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: crc 2024-09-12T17:59:04.990 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: secure 2024-09-12T17:59:04.990 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: crc 2024-09-12T17:59:04.990 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: crc 2024-09-12T17:59:04.990 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: secure 2024-09-12T17:59:04.990 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: crc 2024-09-12T17:59:04.990 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: secure 2024-09-12T17:59:04.990 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: crc 2024-09-12T17:59:04.990 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: secure 2024-09-12T17:59:04.990 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:04.990 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:04.990 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:04.990 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command cache list hook 0x55acf682a820 2024-09-12T17:59:04.990 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command cache inspect hook 0x55acf682a820 2024-09-12T17:59:04.991 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command cache erase hook 0x55acf682a820 2024-09-12T17:59:04.991 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command cache zap hook 0x55acf682a820 2024-09-12T17:59:04.991 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 note: GC not initialized 2024-09-12T17:59:04.991 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T17:59:04.870+0000 7fcc327e4640 20 reqs_thread_entry: start 2024-09-12T17:59:04.991 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command sync trace show hook 0x7fcd74082070 2024-09-12T17:59:04.991 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command sync trace history hook 0x7fcd74082070 2024-09-12T17:59:04.991 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command sync trace active hook 0x7fcd74082070 2024-09-12T17:59:04.991 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command sync trace active_short hook 0x7fcd74082070 2024-09-12T17:59:04.991 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:04.991 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 Filter name: none 2024-09-12T17:59:04.991 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T17:59:04.870+0000 7fcba3fff640 20 reqs_thread_entry: start 2024-09-12T17:59:04.991 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:59:04.991 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.991 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:59:04.992 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:59:04.992 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:59:04.992 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 : miss 2024-09-12T17:59:04.992 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:04.992 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:59:04.992 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 info.flags=0x17 2024-09-12T17:59:04.992 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 to cache LRU end 2024-09-12T17:59:04.992 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:04.992 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:04.992 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 2024-09-12T17:59:04.992 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T17:59:04.882+0000 7fcd7f9739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 info.flags=0x17 2024-09-12T17:59:04.992 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T17:59:04.882+0000 7fcd7f9739c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 to cache LRU end 2024-09-12T17:59:04.992 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T17:59:04.882+0000 7fcd7f9739c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:04.993 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T17:59:04.882+0000 7fcd7f9739c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34, ofs0, ns] 2024-09-12T17:59:04.993 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T17:59:04.886+0000 7fcc4ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366172 cookie 94201358700384 notifier 7049 bl.length()=911 2024-09-12T17:59:04.993 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T17:59:04.886+0000 7fcc4ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 info.flags=0x17 2024-09-12T17:59:04.993 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T17:59:04.886+0000 7fcc4ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 to cache LRU end 2024-09-12T17:59:04.993 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T17:59:04.886+0000 7fcc4ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:04.993 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T17:59:04.886+0000 7fcd7f9739c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): orig_sources= new_sources= 2024-09-12T17:59:04.993 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T17:59:04.886+0000 7fcd7f9739c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): potential sources added=[] removed=[] 2024-09-12T17:59:04.993 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T17:59:04.886+0000 7fcd7f9739c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): orig_dests= new_dests= 2024-09-12T17:59:04.993 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T17:59:04.886+0000 7fcd7f9739c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): potential dests added=[] removed=[] 2024-09-12T17:59:04.993 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T17:59:04.906+0000 7fcd7f9739c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcd7f9739c0 time 2024-09-12T17:59:04.907804+0000 2024-09-12T17:59:04.993 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:59:04.993 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.993 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:04.994 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fcd8324d2eb] 2024-09-12T17:59:04.994 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fcd8324d49f] 2024-09-12T17:59:04.994 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acf37110c1] 2024-09-12T17:59:04.994 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55acf37231fa] 2024-09-12T17:59:04.994 INFO:tasks.workunit.client.0.smithi098.stderr: 5: main() 2024-09-12T17:59:04.994 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fcd820b3d90] 2024-09-12T17:59:04.994 INFO:tasks.workunit.client.0.smithi098.stderr: 7: __libc_start_main() 2024-09-12T17:59:04.994 INFO:tasks.workunit.client.0.smithi098.stderr: 8: _start() 2024-09-12T17:59:04.994 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.994 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T17:59:04.906+0000 7fcd7f9739c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:59:04.994 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7fcd7f9739c0 thread_name:radosgw-admin 2024-09-12T17:59:04.994 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.994 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:04.994 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fcd820cc520] 2024-09-12T17:59:04.995 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:59:04.995 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:59:04.995 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:59:04.995 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fcd8324d345] 2024-09-12T17:59:04.995 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fcd8324d49f] 2024-09-12T17:59:04.995 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acf37110c1] 2024-09-12T17:59:04.995 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55acf37231fa] 2024-09-12T17:59:04.995 INFO:tasks.workunit.client.0.smithi098.stderr: 9: main() 2024-09-12T17:59:04.995 INFO:tasks.workunit.client.0.smithi098.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fcd820b3d90] 2024-09-12T17:59:04.995 INFO:tasks.workunit.client.0.smithi098.stderr: 11: __libc_start_main() 2024-09-12T17:59:04.995 INFO:tasks.workunit.client.0.smithi098.stderr: 12: _start() 2024-09-12T17:59:04.995 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:59:04.995 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:04.996 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T17:59:04.996 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T17:59:04.996 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T17:59:04.996 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T17:59:04.996 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T17:59:04.996 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T17:59:04.996 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T17:59:04.996 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T17:59:04.996 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T17:59:04.996 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T17:59:04.996 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T17:59:04.996 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T17:59:04.996 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T17:59:04.997 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T17:59:04.997 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T17:59:04.997 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T17:59:04.997 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T17:59:04.997 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T17:59:04.997 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T17:59:04.997 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T17:59:04.997 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T17:59:04.997 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T17:59:04.997 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T17:59:04.997 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T17:59:04.997 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:59:04.997 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T17:59:04.997 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T17:59:04.998 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T17:59:04.998 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T17:59:04.998 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T17:59:04.998 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T17:59:04.998 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T17:59:04.998 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T17:59:04.998 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T17:59:04.998 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T17:59:04.998 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T17:59:04.998 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T17:59:04.998 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T17:59:04.998 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T17:59:04.998 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T17:59:04.999 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T17:59:04.999 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T17:59:04.999 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T17:59:04.999 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T17:59:04.999 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T17:59:04.999 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T17:59:04.999 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:59:04.999 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T17:59:04.999 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:59:04.999 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T17:59:04.999 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T17:59:04.999 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T17:59:04.999 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T17:59:05.000 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T17:59:05.000 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T17:59:05.000 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T17:59:05.000 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T17:59:05.000 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T17:59:05.000 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T17:59:05.000 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T17:59:05.000 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T17:59:05.000 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T17:59:05.000 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T17:59:05.000 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T17:59:05.000 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T17:59:05.001 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T17:59:05.001 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T17:59:05.001 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:59:05.001 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T17:59:05.001 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:59:05.001 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T17:59:05.001 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T17:59:05.001 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T17:59:05.001 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T17:59:05.001 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T17:59:05.001 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T17:59:05.001 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:59:05.001 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T17:59:05.001 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T17:59:05.002 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:59:05.002 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T17:59:05.002 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T17:59:05.002 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T17:59:05.002 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T17:59:05.002 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T17:59:05.002 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T17:59:05.002 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T17:59:05.002 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T17:59:05.002 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T17:59:05.002 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T17:59:05.002 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T17:59:05.002 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T17:59:05.002 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T17:59:05.003 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:59:05.003 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcba3fff640 / http_manager 2024-09-12T17:59:05.003 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcc327e4640 / http_manager 2024-09-12T17:59:05.003 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcc337e6640 / rgw_dt_lg_renew 2024-09-12T17:59:05.003 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcc4effd640 / ms_dispatch 2024-09-12T17:59:05.003 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcc4ffff640 / io_context_pool 2024-09-12T17:59:05.003 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcc60ff9640 / io_context_pool 2024-09-12T17:59:05.003 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcc62ffd640 / ms_dispatch 2024-09-12T17:59:05.003 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcc69e03640 / ms_dispatch 2024-09-12T17:59:05.003 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcc6b606640 / io_context_pool 2024-09-12T17:59:05.003 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcd7cc78640 / msgr-worker-2 2024-09-12T17:59:05.003 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcd7d479640 / msgr-worker-1 2024-09-12T17:59:05.003 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcd7dc7a640 / msgr-worker-0 2024-09-12T17:59:05.003 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcd7e47b640 / io_context_pool 2024-09-12T17:59:05.004 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcd7f9739c0 / radosgw-admin 2024-09-12T17:59:05.004 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T17:59:05.004 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T17:59:05.004 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/log/ceph/ceph-client.admin.119943.log 2024-09-12T17:59:05.004 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T17:59:05.004 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T17:59:05.004 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T17:59:04.798+0000 7fcd7cc78640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:59:05.004 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T17:59:04.798+0000 7fcd7dc7a640 10 monclient: get_auth_request con 0x55acf678be30 auth_method 0 2024-09-12T17:59:05.004 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T17:59:04.798+0000 7fcc6b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:05.004 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T17:59:04.798+0000 7fcc6b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:59:05.004 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T17:59:04.798+0000 7fcc6b606640 10 monclient: dump: 2024-09-12T17:59:05.004 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:05.004 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:05.005 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:05.005 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:05.005 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:05.005 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:05.005 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:05.005 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:05.005 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:05.005 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:05.005 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T17:59:04.798+0000 7fcc6b606640 10 monclient: _finish_auth 0 2024-09-12T17:59:05.005 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T17:59:04.798+0000 7fcc6b606640 10 monclient: _check_auth_tickets 2024-09-12T17:59:05.005 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T17:59:04.798+0000 7fcc6b606640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:05.005 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T17:59:04.798+0000 7fcc6b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:05.005 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T17:59:04.798+0000 7fcc6b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:59:05.006 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T17:59:04.798+0000 7fcc6b606640 10 monclient: dump: 2024-09-12T17:59:05.006 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:05.006 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:05.006 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:05.006 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:05.006 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:05.006 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:05.006 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:05.006 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:05.006 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:05.006 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:05.006 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T17:59:04.798+0000 7fcd7f9739c0 5 monclient: authenticate success, global_id 7617 2024-09-12T17:59:05.006 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T17:59:04.798+0000 7fcd7f9739c0 10 monclient: get_monmap_and_config success 2024-09-12T17:59:05.006 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T17:59:04.798+0000 7fcd7f9739c0 4 set_mon_vals no callback set 2024-09-12T17:59:05.007 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T17:59:04.798+0000 7fcd7f9739c0 10 monclient: shutdown 2024-09-12T17:59:05.007 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T17:59:04.798+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) unregister_commands rotate-key 2024-09-12T17:59:05.007 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient: build_initial_monmap 2024-09-12T17:59:05.007 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 1 build_initial for_mkfs: 0 2024-09-12T17:59:05.007 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient: monmap: 2024-09-12T17:59:05.007 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:59:05.007 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:05.007 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:59:05.007 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:59:05.007 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:05.007 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:05.007 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:59:05.007 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:59:05.008 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:59:05.008 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:05.008 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding auth protocol: cephx 2024-09-12T17:59:05.008 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding auth protocol: cephx 2024-09-12T17:59:05.008 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding auth protocol: cephx 2024-09-12T17:59:05.008 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: secure 2024-09-12T17:59:05.008 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: crc 2024-09-12T17:59:05.008 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: secure 2024-09-12T17:59:05.008 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: crc 2024-09-12T17:59:05.008 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: secure 2024-09-12T17:59:05.008 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: crc 2024-09-12T17:59:05.008 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: crc 2024-09-12T17:59:05.008 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: secure 2024-09-12T17:59:05.008 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: crc 2024-09-12T17:59:05.009 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: secure 2024-09-12T17:59:05.009 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: crc 2024-09-12T17:59:05.009 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf6767590) adding con mode: secure 2024-09-12T17:59:05.009 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:05.009 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 1 librados: starting msgr at 2024-09-12T17:59:05.009 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 1 librados: starting objecter 2024-09-12T17:59:05.009 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command objecter_requests hook 0x55acf6793880 2024-09-12T17:59:05.009 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 1 librados: setting wanted keys 2024-09-12T17:59:05.009 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 1 librados: calling monclient init 2024-09-12T17:59:05.009 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient: init 2024-09-12T17:59:05.009 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding auth protocol: cephx 2024-09-12T17:59:05.009 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding auth protocol: cephx 2024-09-12T17:59:05.009 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding auth protocol: cephx 2024-09-12T17:59:05.009 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: secure 2024-09-12T17:59:05.010 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: crc 2024-09-12T17:59:05.010 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: secure 2024-09-12T17:59:05.010 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: crc 2024-09-12T17:59:05.010 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: secure 2024-09-12T17:59:05.010 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: crc 2024-09-12T17:59:05.010 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: crc 2024-09-12T17:59:05.010 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: secure 2024-09-12T17:59:05.010 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: crc 2024-09-12T17:59:05.010 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: secure 2024-09-12T17:59:05.010 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: crc 2024-09-12T17:59:05.010 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67621b0) adding con mode: secure 2024-09-12T17:59:05.010 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:05.010 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:05.011 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command rotate-key hook 0x55acf67622f8 2024-09-12T17:59:05.011 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient: _reopen_session rank -1 2024-09-12T17:59:05.011 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:59:05.011 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-b con 0x55acf65ef840 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:59:05.011 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-c con 0x55acf66a82b0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:59:05.011 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-a con 0x55acf678be30 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:59:05.011 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:05.011 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:05.011 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:05.011 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient(hunting): _renew_subs 2024-09-12T17:59:05.011 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient(hunting): authenticate will time out at 2741.373334s 2024-09-12T17:59:05.011 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 10 monclient(hunting): get_auth_request con 0x55acf66a82b0 auth_method 0 2024-09-12T17:59:05.011 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:05.011 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:05.012 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:05.012 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T17:59:04.802+0000 7fcd7dc7a640 10 monclient(hunting): get_auth_request con 0x55acf678be30 auth_method 0 2024-09-12T17:59:05.012 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T17:59:04.802+0000 7fcd7dc7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:05.012 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T17:59:04.802+0000 7fcd7dc7a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:05.012 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T17:59:04.802+0000 7fcd7dc7a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:05.012 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:05.012 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:05.012 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:05.012 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T17:59:04.802+0000 7fcd7dc7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:05.012 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T17:59:04.802+0000 7fcd7dc7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:05.012 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T17:59:04.802+0000 7fcd7dc7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:05.012 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_done global_id 7040 payload 824 2024-09-12T17:59:05.012 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 10 monclient: _finish_hunting 0 2024-09-12T17:59:05.013 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 1 monclient: found mon.noname-c 2024-09-12T17:59:05.013 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T17:59:04.802+0000 7fcd7cc78640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:59:05.013 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T17:59:04.802+0000 7fcc69e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:05.013 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T17:59:04.802+0000 7fcc69e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:59:05.013 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T17:59:04.802+0000 7fcc69e03640 10 monclient: dump: 2024-09-12T17:59:05.013 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:05.013 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:05.013 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:05.013 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:05.013 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:05.013 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:05.013 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:05.013 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:05.014 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:05.014 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:05.014 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T17:59:04.802+0000 7fcc69e03640 10 monclient: _finish_auth 0 2024-09-12T17:59:05.014 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T17:59:04.802+0000 7fcc69e03640 10 monclient: _check_auth_tickets 2024-09-12T17:59:05.014 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T17:59:04.802+0000 7fcc69e03640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:05.014 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T17:59:04.802+0000 7fcc69e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:05.014 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T17:59:04.802+0000 7fcc69e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:59:05.014 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T17:59:04.802+0000 7fcc69e03640 10 monclient: dump: 2024-09-12T17:59:05.014 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:05.014 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:05.015 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:05.015 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:05.015 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:05.015 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:05.015 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:05.015 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:05.015 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:05.015 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:05.015 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 5 monclient: authenticate success, global_id 7040 2024-09-12T17:59:05.015 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T17:59:04.802+0000 7fcc6b606640 4 set_mon_vals no callback set 2024-09-12T17:59:05.015 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient: _renew_subs 2024-09-12T17:59:05.015 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:05.015 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient: _renew_subs 2024-09-12T17:59:05.015 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:05.016 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T17:59:04.802+0000 7fcd7f9739c0 1 librados: init done 2024-09-12T17:59:05.016 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T17:59:04.806+0000 7fcc69e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:05.016 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T17:59:04.806+0000 7fcc69e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:05.016 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T17:59:04.806+0000 7fcc69e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:05.016 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T17:59:04.806+0000 7fcd7d479640 10 monclient: get_auth_request con 0x7fcc64070ae0 auth_method 0 2024-09-12T17:59:05.016 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T17:59:04.806+0000 7fcd7dc7a640 10 monclient: get_auth_request con 0x55acf67aa7f0 auth_method 0 2024-09-12T17:59:05.016 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T17:59:04.806+0000 7fcd7d479640 10 monclient: get_auth_request con 0x55acf67ad9d0 auth_method 0 2024-09-12T17:59:05.016 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient: get_auth_request con 0x55acf67b2a60 auth_method 0 2024-09-12T17:59:05.016 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient: build_initial_monmap 2024-09-12T17:59:05.016 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 1 build_initial for_mkfs: 0 2024-09-12T17:59:05.016 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient: monmap: 2024-09-12T17:59:05.016 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:59:05.016 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:05.017 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:59:05.017 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:59:05.017 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:05.017 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:05.017 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:59:05.017 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:59:05.017 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:59:05.017 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:05.017 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding auth protocol: cephx 2024-09-12T17:59:05.017 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding auth protocol: cephx 2024-09-12T17:59:05.017 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding auth protocol: cephx 2024-09-12T17:59:05.017 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: secure 2024-09-12T17:59:05.017 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: crc 2024-09-12T17:59:05.017 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: secure 2024-09-12T17:59:05.018 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: crc 2024-09-12T17:59:05.018 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: secure 2024-09-12T17:59:05.018 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: crc 2024-09-12T17:59:05.018 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: crc 2024-09-12T17:59:05.018 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: secure 2024-09-12T17:59:05.018 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: crc 2024-09-12T17:59:05.018 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: secure 2024-09-12T17:59:05.018 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: crc 2024-09-12T17:59:05.018 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b6860) adding con mode: secure 2024-09-12T17:59:05.018 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:05.018 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command objecter_requests cmddesc objecter_requests hook 0x55acf67bbe20 EEXIST 2024-09-12T17:59:05.018 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient: init 2024-09-12T17:59:05.018 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding auth protocol: cephx 2024-09-12T17:59:05.019 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding auth protocol: cephx 2024-09-12T17:59:05.019 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding auth protocol: cephx 2024-09-12T17:59:05.019 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: secure 2024-09-12T17:59:05.019 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: crc 2024-09-12T17:59:05.019 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: secure 2024-09-12T17:59:05.019 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: crc 2024-09-12T17:59:05.019 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: secure 2024-09-12T17:59:05.019 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: crc 2024-09-12T17:59:05.019 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: crc 2024-09-12T17:59:05.019 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: secure 2024-09-12T17:59:05.019 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: crc 2024-09-12T17:59:05.019 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: secure 2024-09-12T17:59:05.020 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: crc 2024-09-12T17:59:05.020 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67b5818) adding con mode: secure 2024-09-12T17:59:05.020 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:05.020 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:05.020 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command rotate-key cmddesc rotate-key hook 0x55acf67b5960 EEXIST 2024-09-12T17:59:05.020 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient: _reopen_session rank -1 2024-09-12T17:59:05.020 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T17:59:05.020 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-b con 0x55acf67e0110 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:59:05.020 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-a con 0x55acf67f48b0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:59:05.020 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-c con 0x55acf67de470 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:59:05.020 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:05.020 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:05.020 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:05.020 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient(hunting): _renew_subs 2024-09-12T17:59:05.021 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T17:59:04.810+0000 7fcd7f9739c0 10 monclient(hunting): authenticate will time out at 2741.383343s 2024-09-12T17:59:05.021 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient(hunting): get_auth_request con 0x55acf67f48b0 auth_method 0 2024-09-12T17:59:05.021 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:05.021 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:05.021 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:05.021 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T17:59:04.810+0000 7fcd7dc7a640 10 monclient(hunting): get_auth_request con 0x55acf67de470 auth_method 0 2024-09-12T17:59:05.021 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T17:59:04.810+0000 7fcd7dc7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:05.021 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T17:59:04.810+0000 7fcd7dc7a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:05.021 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T17:59:04.810+0000 7fcd7dc7a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:05.021 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:05.021 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:05.021 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:05.021 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T17:59:04.810+0000 7fcd7dc7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:05.022 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T17:59:04.810+0000 7fcd7dc7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:05.022 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T17:59:04.810+0000 7fcd7dc7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:05.022 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T17:59:04.810+0000 7fcd7d479640 10 monclient(hunting): get_auth_request con 0x55acf67e0110 auth_method 0 2024-09-12T17:59:05.022 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T17:59:04.810+0000 7fcd7d479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:05.022 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T17:59:04.810+0000 7fcd7d479640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:05.022 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T17:59:04.810+0000 7fcd7d479640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:05.022 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_done global_id 7623 payload 824 2024-09-12T17:59:05.022 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient: _finish_hunting 0 2024-09-12T17:59:05.022 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 1 monclient: found mon.noname-a 2024-09-12T17:59:05.022 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T17:59:04.810+0000 7fcd7cc78640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:59:05.022 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:05.022 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:59:05.022 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 10 monclient: dump: 2024-09-12T17:59:05.022 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:05.023 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:05.023 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:05.023 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:05.023 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:05.023 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:05.023 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:05.023 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:05.023 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:05.023 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:05.023 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 10 monclient: _finish_auth 0 2024-09-12T17:59:05.023 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 10 monclient: _check_auth_tickets 2024-09-12T17:59:05.023 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 monclient: authenticate success, global_id 7623 2024-09-12T17:59:05.023 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient: _renew_subs 2024-09-12T17:59:05.023 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:59:05.024 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:05.024 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:05.024 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:59:05.024 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 10 monclient: dump: 2024-09-12T17:59:05.024 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:05.024 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:05.024 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:05.024 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:05.024 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:05.024 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:05.024 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:05.024 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:05.024 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:05.024 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:05.025 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T17:59:04.814+0000 7fcd7e47b640 4 set_mon_vals no callback set 2024-09-12T17:59:05.025 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient: _renew_subs 2024-09-12T17:59:05.025 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T17:59:05.025 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:05.025 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:05.025 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T17:59:04.814+0000 7fcc62ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:05.025 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient: get_monmap_and_config 2024-09-12T17:59:05.025 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient: build_initial_monmap 2024-09-12T17:59:05.025 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 1 build_initial for_mkfs: 0 2024-09-12T17:59:05.025 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient: monmap: 2024-09-12T17:59:05.025 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:59:05.025 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:05.025 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:59:05.026 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:59:05.026 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:05.026 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:05.026 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:59:05.026 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:59:05.026 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:59:05.026 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:05.026 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding auth protocol: cephx 2024-09-12T17:59:05.026 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding auth protocol: cephx 2024-09-12T17:59:05.026 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding auth protocol: cephx 2024-09-12T17:59:05.026 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:05.026 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:05.026 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:05.026 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:05.027 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:05.027 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:05.027 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:05.027 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:05.027 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:05.027 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:05.027 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:05.027 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:05.027 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T17:59:04.814+0000 7fcd7d479640 10 monclient: get_auth_request con 0x7fcc580709f0 auth_method 0 2024-09-12T17:59:05.027 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:05.027 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient: init 2024-09-12T17:59:05.027 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding auth protocol: cephx 2024-09-12T17:59:05.027 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding auth protocol: cephx 2024-09-12T17:59:05.027 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding auth protocol: cephx 2024-09-12T17:59:05.028 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: secure 2024-09-12T17:59:05.028 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: crc 2024-09-12T17:59:05.028 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: secure 2024-09-12T17:59:05.028 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: crc 2024-09-12T17:59:05.028 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: secure 2024-09-12T17:59:05.028 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: crc 2024-09-12T17:59:05.028 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: crc 2024-09-12T17:59:05.028 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: secure 2024-09-12T17:59:05.028 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: crc 2024-09-12T17:59:05.028 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: secure 2024-09-12T17:59:05.028 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: crc 2024-09-12T17:59:05.029 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103ad50) adding con mode: secure 2024-09-12T17:59:05.029 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:05.029 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:05.029 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe7103ae98 EEXIST 2024-09-12T17:59:05.029 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient: _reopen_session rank -1 2024-09-12T17:59:05.029 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:59:05.029 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-c con 0x55acf682e180 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:59:05.029 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-a con 0x55acf682e560 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:59:05.029 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-b con 0x55acf682fa20 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:59:05.030 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:05.030 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:05.030 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:05.030 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient(hunting): _renew_subs 2024-09-12T17:59:05.030 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T17:59:04.814+0000 7fcd7f9739c0 10 monclient(hunting): authenticate will time out at 2741.387601s 2024-09-12T17:59:05.030 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T17:59:04.814+0000 7fcd7d479640 10 monclient(hunting): get_auth_request con 0x55acf682e180 auth_method 0 2024-09-12T17:59:05.030 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T17:59:04.814+0000 7fcd7d479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:05.030 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T17:59:04.814+0000 7fcd7d479640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:05.030 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T17:59:04.814+0000 7fcd7d479640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:05.030 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T17:59:04.814+0000 7fcd7cc78640 10 monclient(hunting): get_auth_request con 0x55acf682e560 auth_method 0 2024-09-12T17:59:05.030 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T17:59:04.814+0000 7fcd7cc78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:05.030 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T17:59:04.814+0000 7fcd7cc78640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:05.030 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T17:59:04.814+0000 7fcd7cc78640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:05.030 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T17:59:04.814+0000 7fcd7d479640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:05.031 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T17:59:04.814+0000 7fcd7d479640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:05.031 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T17:59:04.814+0000 7fcd7d479640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:05.031 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T17:59:04.814+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:05.031 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T17:59:04.814+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:05.031 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T17:59:04.814+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:05.031 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): get_auth_request con 0x55acf682fa20 auth_method 0 2024-09-12T17:59:05.031 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:05.031 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:05.031 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:05.031 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T17:59:04.818+0000 7fcd7cc78640 10 monclient(hunting): handle_auth_done global_id 7626 payload 274 2024-09-12T17:59:05.031 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T17:59:04.818+0000 7fcd7cc78640 10 monclient: _finish_hunting 0 2024-09-12T17:59:05.031 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T17:59:04.818+0000 7fcd7cc78640 1 monclient: found mon.noname-a 2024-09-12T17:59:05.031 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T17:59:04.818+0000 7fcd7cc78640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:59:05.032 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T17:59:04.818+0000 7fcc60ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:05.032 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T17:59:04.818+0000 7fcc60ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:59:05.032 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T17:59:04.818+0000 7fcc60ff9640 10 monclient: dump: 2024-09-12T17:59:05.032 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:05.032 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:05.032 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:05.032 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:05.032 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:05.032 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:05.032 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:05.032 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:05.032 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:05.032 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:05.033 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T17:59:04.818+0000 7fcc60ff9640 10 monclient: _finish_auth 0 2024-09-12T17:59:05.033 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T17:59:04.818+0000 7fcc60ff9640 10 monclient: _check_auth_tickets 2024-09-12T17:59:05.033 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T17:59:04.818+0000 7fcc60ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:05.033 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 monclient: authenticate success, global_id 7626 2024-09-12T17:59:05.033 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: get_monmap_and_config success 2024-09-12T17:59:05.033 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T17:59:04.818+0000 7fcc60ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:05.034 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 4 set_mon_vals no callback set 2024-09-12T17:59:05.034 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T17:59:04.818+0000 7fcc60ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:59:05.034 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T17:59:04.818+0000 7fcc60ff9640 10 monclient: dump: 2024-09-12T17:59:05.034 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:05.034 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:05.034 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:05.034 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:05.034 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:05.034 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:05.034 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:05.034 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:05.034 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:05.034 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:05.034 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: shutdown 2024-09-12T17:59:05.035 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: build_initial_monmap 2024-09-12T17:59:05.035 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 1 build_initial for_mkfs: 0 2024-09-12T17:59:05.035 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: monmap: 2024-09-12T17:59:05.035 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:59:05.035 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:05.035 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:59:05.035 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:59:05.035 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:05.035 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:05.035 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:59:05.035 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:59:05.035 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:59:05.035 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:05.035 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding auth protocol: cephx 2024-09-12T17:59:05.036 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding auth protocol: cephx 2024-09-12T17:59:05.036 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding auth protocol: cephx 2024-09-12T17:59:05.036 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:05.036 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:05.036 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:05.036 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:05.036 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:05.036 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:05.036 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:05.036 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:05.036 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:05.036 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:05.036 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: crc 2024-09-12T17:59:05.037 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67ffc20) adding con mode: secure 2024-09-12T17:59:05.037 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:05.037 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 1 librados: starting msgr at 2024-09-12T17:59:05.037 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 1 librados: starting objecter 2024-09-12T17:59:05.037 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command objecter_requests cmddesc objecter_requests hook 0x55acf67e5090 EEXIST 2024-09-12T17:59:05.037 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 1 librados: setting wanted keys 2024-09-12T17:59:05.037 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 1 librados: calling monclient init 2024-09-12T17:59:05.037 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: init 2024-09-12T17:59:05.037 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding auth protocol: cephx 2024-09-12T17:59:05.037 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding auth protocol: cephx 2024-09-12T17:59:05.037 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding auth protocol: cephx 2024-09-12T17:59:05.037 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: secure 2024-09-12T17:59:05.037 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: crc 2024-09-12T17:59:05.037 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: secure 2024-09-12T17:59:05.037 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: crc 2024-09-12T17:59:05.038 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: secure 2024-09-12T17:59:05.038 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: crc 2024-09-12T17:59:05.038 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: crc 2024-09-12T17:59:05.038 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: secure 2024-09-12T17:59:05.038 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: crc 2024-09-12T17:59:05.038 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: secure 2024-09-12T17:59:05.038 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: crc 2024-09-12T17:59:05.038 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 AuthRegistry(0x55acf67e2440) adding con mode: secure 2024-09-12T17:59:05.038 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:05.038 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:05.038 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command rotate-key cmddesc rotate-key hook 0x55acf67e2588 EEXIST 2024-09-12T17:59:05.038 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: _reopen_session rank -1 2024-09-12T17:59:05.038 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T17:59:05.039 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-c con 0x55acf682e180 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:59:05.039 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-b con 0x55acf682fa20 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:59:05.039 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient(hunting): picked mon.noname-a con 0x55acf68248d0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:59:05.039 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:05.039 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:05.039 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:05.039 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient(hunting): _renew_subs 2024-09-12T17:59:05.039 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient(hunting): authenticate will time out at 2741.390688s 2024-09-12T17:59:05.039 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T17:59:04.818+0000 7fcd7d479640 10 monclient(hunting): get_auth_request con 0x55acf682e180 auth_method 0 2024-09-12T17:59:05.039 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T17:59:04.818+0000 7fcd7d479640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:05.039 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T17:59:04.818+0000 7fcd7d479640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:05.039 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T17:59:04.818+0000 7fcd7d479640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:05.039 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): get_auth_request con 0x55acf68248d0 auth_method 0 2024-09-12T17:59:05.040 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:05.040 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:05.040 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:05.040 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T17:59:04.818+0000 7fcd7d479640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:05.040 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T17:59:04.818+0000 7fcd7d479640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:05.040 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T17:59:04.818+0000 7fcd7d479640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:05.040 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:05.040 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:05.040 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T17:59:04.818+0000 7fcd7dc7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:05.040 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T17:59:04.818+0000 7fcd7d479640 10 monclient(hunting): handle_auth_done global_id 7049 payload 824 2024-09-12T17:59:05.040 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T17:59:04.818+0000 7fcd7d479640 10 monclient: _finish_hunting 0 2024-09-12T17:59:05.040 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T17:59:04.818+0000 7fcd7d479640 1 monclient: found mon.noname-c 2024-09-12T17:59:05.040 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T17:59:04.818+0000 7fcd7d479640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:59:05.040 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T17:59:04.818+0000 7fcd7cc78640 10 monclient: get_auth_request con 0x55acf682fa20 auth_method 0 2024-09-12T17:59:05.041 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T17:59:04.818+0000 7fcc4effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:05.041 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T17:59:04.818+0000 7fcc4effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:59:05.041 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T17:59:04.818+0000 7fcc4effd640 10 monclient: dump: 2024-09-12T17:59:05.041 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:05.041 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:05.041 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:05.041 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:05.041 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:05.041 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:05.041 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:05.041 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:05.042 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:05.042 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:05.042 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T17:59:04.818+0000 7fcc4effd640 10 monclient: _finish_auth 0 2024-09-12T17:59:05.042 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T17:59:04.818+0000 7fcc4effd640 10 monclient: _check_auth_tickets 2024-09-12T17:59:05.042 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T17:59:04.818+0000 7fcc4effd640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:05.042 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T17:59:04.818+0000 7fcc4effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:05.042 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T17:59:04.818+0000 7fcc4effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:59:05.042 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T17:59:04.818+0000 7fcc4effd640 10 monclient: dump: 2024-09-12T17:59:05.042 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:05.042 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:05.042 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:05.042 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:05.042 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:05.043 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:05.043 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:05.043 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:05.043 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:05.043 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:05.043 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 monclient: authenticate success, global_id 7049 2024-09-12T17:59:05.043 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T17:59:04.818+0000 7fcc60ff9640 4 set_mon_vals no callback set 2024-09-12T17:59:05.043 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: _renew_subs 2024-09-12T17:59:05.043 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:05.043 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: _renew_subs 2024-09-12T17:59:05.043 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:05.043 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 1 librados: init done 2024-09-12T17:59:05.043 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T17:59:04.818+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command cr dump hook 0x7fcd7405d3d8 2024-09-12T17:59:05.043 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.044 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T17:59:04.822+0000 7fcc4effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:05.044 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T17:59:04.822+0000 7fcc4effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:05.044 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T17:59:04.822+0000 7fcc4effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:05.044 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T17:59:04.822+0000 7fcd7cc78640 10 monclient: get_auth_request con 0x7fcc48070b10 auth_method 0 2024-09-12T17:59:05.044 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T17:59:04.822+0000 7fcd7dc7a640 10 monclient: get_auth_request con 0x55acf684dbf0 auth_method 0 2024-09-12T17:59:05.044 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.044 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 realm 2024-09-12T17:59:05.044 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.045 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.045 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T17:59:04.822+0000 7fcd7f9739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:05.045 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.045 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.045 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T17:59:04.822+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.045 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T17:59:04.822+0000 7fcd7d479640 10 monclient: get_auth_request con 0x55acf6851e70 auth_method 0 2024-09-12T17:59:05.045 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T17:59:04.826+0000 7fcd7f9739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:05.045 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T17:59:04.826+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.046 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T17:59:04.826+0000 7fcd7f9739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:05.046 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T17:59:04.826+0000 7fcd7f9739c0 20 searching for the correct realm 2024-09-12T17:59:05.046 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T17:59:04.826+0000 7fcd7cc78640 10 monclient: get_auth_request con 0x55acf6857100 auth_method 0 2024-09-12T17:59:05.046 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T17:59:04.826+0000 7fcd7dc7a640 10 monclient: get_auth_request con 0x7fcd7404db60 auth_method 0 2024-09-12T17:59:05.046 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T17:59:04.830+0000 7fcd7d479640 10 monclient: get_auth_request con 0x7fcd78016040 auth_method 0 2024-09-12T17:59:05.046 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T17:59:04.830+0000 7fcd7cc78640 10 monclient: get_auth_request con 0x7fcd700e6030 auth_method 0 2024-09-12T17:59:05.046 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T17:59:04.830+0000 7fcd7dc7a640 0 -- 172.21.15.98:0/3325347558 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55acf684dbf0 msgr2=0x55acf6850080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:05.046 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T17:59:04.830+0000 7fcc4effd640 1 client.7049.objecter ms_handle_reset 0x55acf684dbf0 session 0x55acf684d570 osd.1 2024-09-12T17:59:05.046 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T17:59:04.830+0000 7fcc4effd640 10 monclient: _renew_subs 2024-09-12T17:59:05.046 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T17:59:04.830+0000 7fcc4effd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:05.046 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T17:59:04.830+0000 7fcd7dc7a640 10 monclient: get_auth_request con 0x7fcc480811b0 auth_method 0 2024-09-12T17:59:05.046 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T17:59:04.834+0000 7fcd7dc7a640 10 monclient: get_auth_request con 0x7fcd74058040 auth_method 0 2024-09-12T17:59:05.046 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T17:59:04.838+0000 7fcd7d479640 10 monclient: get_auth_request con 0x7fcd74083300 auth_method 0 2024-09-12T17:59:05.046 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T17:59:04.838+0000 7fcd7cc78640 0 -- 172.21.15.98:0/3325347558 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fcd700e6030 msgr2=0x7fcd7011c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:05.047 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T17:59:04.838+0000 7fcc4effd640 1 client.7049.objecter ms_handle_reset 0x7fcd700e6030 session 0x7fcd700c9050 osd.4 2024-09-12T17:59:05.047 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T17:59:04.838+0000 7fcd7cc78640 10 monclient: get_auth_request con 0x55acf684dbf0 auth_method 0 2024-09-12T17:59:05.047 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:05.047 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:05.047 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:05.047 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:05.047 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:05.047 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:05.047 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.047 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.047 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.047 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:05.047 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.048 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:05.048 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 zone default found 2024-09-12T17:59:05.048 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 4 Realm: () 2024-09-12T17:59:05.048 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:05.048 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:05.048 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:05.048 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 zonegroup default 2024-09-12T17:59:05.048 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.048 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.048 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.048 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.048 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.048 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.049 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 started sync module instance, tier type = 2024-09-12T17:59:05.049 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T17:59:04.846+0000 7fcd7f9739c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:05.049 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=0 2024-09-12T17:59:05.049 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=1 2024-09-12T17:59:05.049 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=2 2024-09-12T17:59:05.049 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=3 2024-09-12T17:59:05.049 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=4 2024-09-12T17:59:05.049 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=5 2024-09-12T17:59:05.049 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=6 2024-09-12T17:59:05.049 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T17:59:04.866+0000 7fcd7f9739c0 20 add_watcher() i=7 2024-09-12T17:59:05.049 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T17:59:04.866+0000 7fcd7f9739c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:05.049 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding auth protocol: cephx 2024-09-12T17:59:05.049 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding auth protocol: cephx 2024-09-12T17:59:05.049 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding auth protocol: cephx 2024-09-12T17:59:05.050 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: secure 2024-09-12T17:59:05.050 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: crc 2024-09-12T17:59:05.050 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: secure 2024-09-12T17:59:05.050 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T17:59:04.870+0000 7fcc337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:05.050 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: crc 2024-09-12T17:59:05.050 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: secure 2024-09-12T17:59:05.050 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: crc 2024-09-12T17:59:05.050 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: crc 2024-09-12T17:59:05.050 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: secure 2024-09-12T17:59:05.050 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: crc 2024-09-12T17:59:05.050 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: secure 2024-09-12T17:59:05.050 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: crc 2024-09-12T17:59:05.050 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 AuthRegistry(0x7ffe7103b220) adding con mode: secure 2024-09-12T17:59:05.051 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:05.051 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:05.051 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:05.051 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command cache list hook 0x55acf682a820 2024-09-12T17:59:05.051 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command cache inspect hook 0x55acf682a820 2024-09-12T17:59:05.051 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command cache erase hook 0x55acf682a820 2024-09-12T17:59:05.051 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command cache zap hook 0x55acf682a820 2024-09-12T17:59:05.051 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 note: GC not initialized 2024-09-12T17:59:05.051 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T17:59:04.870+0000 7fcc327e4640 20 reqs_thread_entry: start 2024-09-12T17:59:05.051 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command sync trace show hook 0x7fcd74082070 2024-09-12T17:59:05.051 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command sync trace history hook 0x7fcd74082070 2024-09-12T17:59:05.051 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command sync trace active hook 0x7fcd74082070 2024-09-12T17:59:05.051 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 5 asok(0x55acf65572b0) register_command sync trace active_short hook 0x7fcd74082070 2024-09-12T17:59:05.051 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:05.052 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 Filter name: none 2024-09-12T17:59:05.052 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T17:59:04.870+0000 7fcba3fff640 20 reqs_thread_entry: start 2024-09-12T17:59:05.052 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:59:05.052 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.052 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:59:05.052 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:59:05.052 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:59:05.052 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 : miss 2024-09-12T17:59:05.052 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.052 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:59:05.052 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 info.flags=0x17 2024-09-12T17:59:05.052 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 to cache LRU end 2024-09-12T17:59:05.052 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:05.052 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:05.053 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T17:59:04.870+0000 7fcd7f9739c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 2024-09-12T17:59:05.053 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T17:59:04.882+0000 7fcd7f9739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 info.flags=0x17 2024-09-12T17:59:05.053 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T17:59:04.882+0000 7fcd7f9739c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 to cache LRU end 2024-09-12T17:59:05.053 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T17:59:04.882+0000 7fcd7f9739c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:05.053 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T17:59:04.882+0000 7fcd7f9739c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34, ofs0, ns] 2024-09-12T17:59:05.053 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T17:59:04.886+0000 7fcc4ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366172 cookie 94201358700384 notifier 7049 bl.length()=911 2024-09-12T17:59:05.053 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T17:59:04.886+0000 7fcc4ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 info.flags=0x17 2024-09-12T17:59:05.053 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T17:59:04.886+0000 7fcc4ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 to cache LRU end 2024-09-12T17:59:05.053 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T17:59:04.886+0000 7fcc4ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:05.053 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T17:59:04.886+0000 7fcd7f9739c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): orig_sources= new_sources= 2024-09-12T17:59:05.054 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T17:59:04.886+0000 7fcd7f9739c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): potential sources added=[] removed=[] 2024-09-12T17:59:05.054 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T17:59:04.886+0000 7fcd7f9739c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): orig_dests= new_dests= 2024-09-12T17:59:05.054 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T17:59:04.886+0000 7fcd7f9739c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): potential dests added=[] removed=[] 2024-09-12T17:59:05.054 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T17:59:04.906+0000 7fcd7f9739c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcd7f9739c0 time 2024-09-12T17:59:04.907804+0000 2024-09-12T17:59:05.054 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:59:05.054 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:05.054 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:05.054 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fcd8324d2eb] 2024-09-12T17:59:05.054 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fcd8324d49f] 2024-09-12T17:59:05.054 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acf37110c1] 2024-09-12T17:59:05.055 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55acf37231fa] 2024-09-12T17:59:05.055 INFO:tasks.workunit.client.0.smithi098.stderr: 5: main() 2024-09-12T17:59:05.055 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fcd820b3d90] 2024-09-12T17:59:05.055 INFO:tasks.workunit.client.0.smithi098.stderr: 7: __libc_start_main() 2024-09-12T17:59:05.055 INFO:tasks.workunit.client.0.smithi098.stderr: 8: _start() 2024-09-12T17:59:05.055 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:05.055 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T17:59:04.906+0000 7fcd7f9739c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:59:05.055 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7fcd7f9739c0 thread_name:radosgw-admin 2024-09-12T17:59:05.055 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:05.055 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:05.056 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fcd820cc520] 2024-09-12T17:59:05.056 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:59:05.056 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:59:05.056 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:59:05.056 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fcd8324d345] 2024-09-12T17:59:05.056 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fcd8324d49f] 2024-09-12T17:59:05.056 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acf37110c1] 2024-09-12T17:59:05.057 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55acf37231fa] 2024-09-12T17:59:05.057 INFO:tasks.workunit.client.0.smithi098.stderr: 9: main() 2024-09-12T17:59:05.057 INFO:tasks.workunit.client.0.smithi098.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fcd820b3d90] 2024-09-12T17:59:05.057 INFO:tasks.workunit.client.0.smithi098.stderr: 11: __libc_start_main() 2024-09-12T17:59:05.057 INFO:tasks.workunit.client.0.smithi098.stderr: 12: _start() 2024-09-12T17:59:05.057 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:59:05.057 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:05.057 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T17:59:05.058 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T17:59:05.058 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T17:59:05.058 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T17:59:05.058 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T17:59:05.058 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T17:59:05.058 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T17:59:05.058 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T17:59:05.058 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T17:59:05.058 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T17:59:05.058 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T17:59:05.058 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T17:59:05.058 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T17:59:05.058 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T17:59:05.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T17:59:05.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T17:59:05.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T17:59:05.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T17:59:05.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T17:59:05.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T17:59:05.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T17:59:05.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T17:59:05.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T17:59:05.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T17:59:05.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:59:05.059 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T17:59:05.059 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T17:59:05.060 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T17:59:05.060 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T17:59:05.060 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T17:59:05.060 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T17:59:05.060 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T17:59:05.060 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T17:59:05.060 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T17:59:05.060 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T17:59:05.060 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T17:59:05.060 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T17:59:05.060 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T17:59:05.060 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T17:59:05.060 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T17:59:05.061 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T17:59:05.061 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T17:59:05.061 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T17:59:05.061 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T17:59:05.061 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T17:59:05.061 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T17:59:05.061 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:59:05.061 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T17:59:05.061 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:59:05.061 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T17:59:05.061 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T17:59:05.061 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T17:59:05.061 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T17:59:05.062 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T17:59:05.062 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T17:59:05.062 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T17:59:05.062 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T17:59:05.062 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T17:59:05.062 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T17:59:05.062 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T17:59:05.062 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T17:59:05.062 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T17:59:05.062 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T17:59:05.062 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T17:59:05.062 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T17:59:05.063 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T17:59:05.063 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T17:59:05.063 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:59:05.063 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T17:59:05.063 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:59:05.063 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T17:59:05.063 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T17:59:05.063 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T17:59:05.063 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T17:59:05.063 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T17:59:05.063 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T17:59:05.063 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:59:05.063 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T17:59:05.063 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T17:59:05.064 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:59:05.064 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T17:59:05.064 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T17:59:05.064 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T17:59:05.064 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T17:59:05.064 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T17:59:05.064 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T17:59:05.064 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T17:59:05.064 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T17:59:05.064 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T17:59:05.064 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T17:59:05.064 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T17:59:05.064 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T17:59:05.065 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T17:59:05.065 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:59:05.065 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcba3fff640 / http_manager 2024-09-12T17:59:05.065 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcc327e4640 / http_manager 2024-09-12T17:59:05.065 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcc337e6640 / rgw_dt_lg_renew 2024-09-12T17:59:05.065 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcc4effd640 / ms_dispatch 2024-09-12T17:59:05.065 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcc4ffff640 / io_context_pool 2024-09-12T17:59:05.065 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcc60ff9640 / io_context_pool 2024-09-12T17:59:05.066 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcc62ffd640 / ms_dispatch 2024-09-12T17:59:05.066 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcc69e03640 / ms_dispatch 2024-09-12T17:59:05.066 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcc6b606640 / io_context_pool 2024-09-12T17:59:05.066 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcd7cc78640 / msgr-worker-2 2024-09-12T17:59:05.066 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcd7d479640 / msgr-worker-1 2024-09-12T17:59:05.066 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcd7dc7a640 / msgr-worker-0 2024-09-12T17:59:05.066 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcd7e47b640 / io_context_pool 2024-09-12T17:59:05.066 INFO:tasks.workunit.client.0.smithi098.stderr: 7fcd7f9739c0 / radosgw-admin 2024-09-12T17:59:05.066 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T17:59:05.066 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T17:59:05.066 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:59:04.909848Z_90eac289-9a9b-484e-820c-0ca6a366739b/log 2024-09-12T17:59:05.066 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T17:59:05.066 INFO:tasks.workunit.client.0.smithi098.stderr:Aborted 2024-09-12T17:59:05.066 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:59:05.071 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:05.071 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:05.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.986+0000 7fb5c6e509c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.990+0000 7fb5c6e509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.990+0000 7fb5c6e509c0 20 realm 2024-09-12T17:59:05.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.990+0000 7fb5c6e509c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.990+0000 7fb5c6e509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.990+0000 7fb5c6e509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:05.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.990+0000 7fb5c6e509c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.990+0000 7fb5c6e509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.990+0000 7fb5c6e509c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.990+0000 7fb5c6e509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:05.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.990+0000 7fb5c6e509c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.990+0000 7fb5c6e509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:05.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.990+0000 7fb5c6e509c0 20 searching for the correct realm 2024-09-12T17:59:05.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:04.998+0000 7fb5bffff640 0 -- 172.21.15.98:0/3374063779 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fb5b80adb50 msgr2=0x7fb5b80f7240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:59:05.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.006+0000 7fb5bffff640 0 -- 172.21.15.98:0/3374063779 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fb490081180 msgr2=0x7fb4900835b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:05.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.010+0000 7fb5c6e509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:05.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.010+0000 7fb5c6e509c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:05.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.010+0000 7fb5c6e509c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:05.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.010+0000 7fb5c6e509c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:05.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.010+0000 7fb5c6e509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:05.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.010+0000 7fb5c6e509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:05.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.010+0000 7fb5c6e509c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.014+0000 7fb5c6e509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.014+0000 7fb5c6e509c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.014+0000 7fb5c6e509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:05.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.014+0000 7fb5c6e509c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.014+0000 7fb5c6e509c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:05.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.014+0000 7fb5c6e509c0 20 zone default found 2024-09-12T17:59:05.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.014+0000 7fb5c6e509c0 4 Realm: () 2024-09-12T17:59:05.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.014+0000 7fb5c6e509c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:05.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.014+0000 7fb5c6e509c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:05.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.014+0000 7fb5c6e509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:05.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.014+0000 7fb5c6e509c0 20 zonegroup default 2024-09-12T17:59:05.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.014+0000 7fb5c6e509c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.014+0000 7fb5c6e509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.014+0000 7fb5c6e509c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.014+0000 7fb5c6e509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.014+0000 7fb5c6e509c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.014+0000 7fb5c6e509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.014+0000 7fb5c6e509c0 20 started sync module instance, tier type = 2024-09-12T17:59:05.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.014+0000 7fb5c6e509c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:05.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.030+0000 7fb5c6e509c0 20 add_watcher() i=0 2024-09-12T17:59:05.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.030+0000 7fb5c6e509c0 20 add_watcher() i=1 2024-09-12T17:59:05.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.030+0000 7fb5c6e509c0 20 add_watcher() i=2 2024-09-12T17:59:05.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.030+0000 7fb5c6e509c0 20 add_watcher() i=3 2024-09-12T17:59:05.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.030+0000 7fb5c6e509c0 20 add_watcher() i=4 2024-09-12T17:59:05.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.030+0000 7fb5c6e509c0 20 add_watcher() i=5 2024-09-12T17:59:05.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.030+0000 7fb5c6e509c0 20 add_watcher() i=6 2024-09-12T17:59:05.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.030+0000 7fb5c6e509c0 20 add_watcher() i=7 2024-09-12T17:59:05.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.030+0000 7fb5c6e509c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:05.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.034+0000 7fb47afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:05.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.034+0000 7fb5c6e509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:05.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.034+0000 7fb5c6e509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:05.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.034+0000 7fb5c6e509c0 5 note: GC not initialized 2024-09-12T17:59:05.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.034+0000 7fb479fe3640 20 reqs_thread_entry: start 2024-09-12T17:59:05.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.034+0000 7fb5c6e509c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:05.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.034+0000 7fb5c6e509c0 20 Filter name: none 2024-09-12T17:59:05.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.034+0000 7fb3eb7fe640 20 reqs_thread_entry: start 2024-09-12T17:59:05.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.034+0000 7fb5c6e509c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.034+0000 7fb5c6e509c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:59:05.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.034+0000 7fb5c6e509c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.038+0000 7fb5c6e509c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T17:59:05.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.038+0000 7fb5c6e509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:05.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.038+0000 7fb5c6e509c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.038+0000 7fb5c6e509c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:59:05.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.038+0000 7fb5c6e509c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.038+0000 7fb5c6e509c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T17:59:05.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.038+0000 7fb5c6e509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:05.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.042+0000 7fb47afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:05.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.046+0000 7fb5c6e509c0 20 remove_watcher() i=0 2024-09-12T17:59:05.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.046+0000 7fb5c6e509c0 2 removed watcher, disabling cache 2024-09-12T17:59:05.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.050+0000 7fb5c6e509c0 20 remove_watcher() i=1 2024-09-12T17:59:05.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.054+0000 7fb5c6e509c0 20 remove_watcher() i=2 2024-09-12T17:59:05.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.058+0000 7fb5c6e509c0 20 remove_watcher() i=3 2024-09-12T17:59:05.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.062+0000 7fb5c6e509c0 20 remove_watcher() i=4 2024-09-12T17:59:05.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.062+0000 7fb5c6e509c0 20 remove_watcher() i=5 2024-09-12T17:59:05.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.066+0000 7fb5c6e509c0 20 remove_watcher() i=6 2024-09-12T17:59:05.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.066+0000 7fb5c6e509c0 20 remove_watcher() i=7 2024-09-12T17:59:05.082 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:05.082 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:59:05.082 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-do-reshard id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:59:05.082 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:05.083 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:05.083 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:05.123 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:05.123 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:05.180 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:59:05.215 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:05.215 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:05.258 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.254+0000 7efe019ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.258+0000 7efe019ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.258+0000 7efe019ec9c0 20 realm 2024-09-12T17:59:05.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.258+0000 7efe019ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.258+0000 7efe019ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.258+0000 7efe019ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:05.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.258+0000 7efe019ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.258+0000 7efe019ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.258+0000 7efe019ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.258+0000 7efe019ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:05.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.258+0000 7efe019ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.258+0000 7efe019ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:05.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.258+0000 7efe019ec9c0 20 searching for the correct realm 2024-09-12T17:59:05.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.266+0000 7efdffcf3640 0 -- 172.21.15.98:0/2226272470 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55ec6fe55c60 msgr2=0x55ec6fe58120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:05.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.274+0000 7efdff4f2640 0 -- 172.21.15.98:0/2226272470 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7efdf405f120 msgr2=0x7efdf40620c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:05.283 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:05.283 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:05.283 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:05.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:05.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:05.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:05.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:05.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.285 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:05.285 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 zone default found 2024-09-12T17:59:05.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 4 Realm: () 2024-09-12T17:59:05.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:05.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:05.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:05.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 zonegroup default 2024-09-12T17:59:05.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:05.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 started sync module instance, tier type = 2024-09-12T17:59:05.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.282+0000 7efe019ec9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:05.301 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.298+0000 7efe019ec9c0 20 add_watcher() i=0 2024-09-12T17:59:05.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.298+0000 7efe019ec9c0 20 add_watcher() i=1 2024-09-12T17:59:05.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.298+0000 7efe019ec9c0 20 add_watcher() i=2 2024-09-12T17:59:05.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.298+0000 7efe019ec9c0 20 add_watcher() i=3 2024-09-12T17:59:05.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.298+0000 7efe019ec9c0 20 add_watcher() i=4 2024-09-12T17:59:05.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.298+0000 7efe019ec9c0 20 add_watcher() i=5 2024-09-12T17:59:05.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.298+0000 7efe019ec9c0 20 add_watcher() i=6 2024-09-12T17:59:05.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.298+0000 7efe019ec9c0 20 add_watcher() i=7 2024-09-12T17:59:05.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.302+0000 7efe019ec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:05.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.302+0000 7efcb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:05.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.302+0000 7efe019ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:05.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.302+0000 7efe019ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:05.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.302+0000 7efe019ec9c0 5 note: GC not initialized 2024-09-12T17:59:05.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.302+0000 7efcb4fe1640 20 reqs_thread_entry: start 2024-09-12T17:59:05.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.302+0000 7efe019ec9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:05.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.302+0000 7efe019ec9c0 20 Filter name: none 2024-09-12T17:59:05.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.302+0000 7efc2e7fc640 20 reqs_thread_entry: start 2024-09-12T17:59:05.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.302+0000 7efe019ec9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:59:05.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.302+0000 7efe019ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.306+0000 7efe019ec9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:59:05.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.306+0000 7efe019ec9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:59:05.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.306+0000 7efe019ec9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:59:05.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.306+0000 7efe019ec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 : miss 2024-09-12T17:59:05.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.306+0000 7efe019ec9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:05.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.306+0000 7efe019ec9c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T17:59:05.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.306+0000 7efe019ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 info.flags=0x17 2024-09-12T17:59:05.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.306+0000 7efe019ec9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 to cache LRU end 2024-09-12T17:59:05.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.306+0000 7efe019ec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:05.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.306+0000 7efe019ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:05.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.306+0000 7efe019ec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 2024-09-12T17:59:05.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.306+0000 7efe019ec9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 to be held by another RGW process; skipping for now 2024-09-12T17:59:05.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.310+0000 7efcb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:05.316 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.314+0000 7efe019ec9c0 20 remove_watcher() i=0 2024-09-12T17:59:05.316 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.314+0000 7efe019ec9c0 2 removed watcher, disabling cache 2024-09-12T17:59:05.318 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.314+0000 7efe019ec9c0 20 remove_watcher() i=1 2024-09-12T17:59:05.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.318+0000 7efe019ec9c0 20 remove_watcher() i=2 2024-09-12T17:59:05.322 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.318+0000 7efe019ec9c0 20 remove_watcher() i=3 2024-09-12T17:59:05.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.322+0000 7efe019ec9c0 20 remove_watcher() i=4 2024-09-12T17:59:05.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.322+0000 7efe019ec9c0 20 remove_watcher() i=5 2024-09-12T17:59:05.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.322+0000 7efe019ec9c0 20 remove_watcher() i=6 2024-09-12T17:59:05.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:05.326+0000 7efe019ec9c0 20 remove_watcher() i=7 2024-09-12T17:59:05.340 INFO:tasks.workunit.client.0.smithi098.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T17:59:35.369 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:59:35.405 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:35.405 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:35.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.445+0000 7f5f62f409c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:35.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.449+0000 7f5f62f409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:35.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.449+0000 7f5f62f409c0 20 realm 2024-09-12T17:59:35.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.449+0000 7f5f62f409c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:35.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.449+0000 7f5f62f409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:35.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.449+0000 7f5f62f409c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:35.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.449+0000 7f5f62f409c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:35.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.449+0000 7f5f62f409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:35.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.449+0000 7f5f62f409c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:35.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.449+0000 7f5f62f409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:35.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.449+0000 7f5f62f409c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:35.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.449+0000 7f5f62f409c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:35.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.449+0000 7f5f62f409c0 20 searching for the correct realm 2024-09-12T17:59:35.458 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.453+0000 7f5f60245640 0 -- 172.21.15.98:0/3301119990 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f5f50053600 msgr2=0x7f5f50053a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:35.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.669+0000 7f5f60a46640 0 -- 172.21.15.98:0/3301119990 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f5f5407ebe0 msgr2=0x7f5f5406b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:59:35.890 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.885+0000 7f5f62f409c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:35.890 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.885+0000 7f5f62f409c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:35.890 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.885+0000 7f5f62f409c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:35.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.885+0000 7f5f62f409c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:35.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.885+0000 7f5f62f409c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:35.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.885+0000 7f5f62f409c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:35.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.885+0000 7f5f62f409c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:35.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.885+0000 7f5f62f409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:35.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.885+0000 7f5f62f409c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:35.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.889+0000 7f5f62f409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:35.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.889+0000 7f5f62f409c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:35.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.889+0000 7f5f62f409c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:35.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.889+0000 7f5f62f409c0 20 zone default found 2024-09-12T17:59:35.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.889+0000 7f5f62f409c0 4 Realm: () 2024-09-12T17:59:35.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.889+0000 7f5f62f409c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:35.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.889+0000 7f5f62f409c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:35.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.889+0000 7f5f62f409c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:35.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.889+0000 7f5f62f409c0 20 zonegroup default 2024-09-12T17:59:35.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.889+0000 7f5f62f409c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:35.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.889+0000 7f5f62f409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:35.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.889+0000 7f5f62f409c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:35.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.889+0000 7f5f62f409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:35.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.889+0000 7f5f62f409c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:35.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.889+0000 7f5f62f409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:35.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.889+0000 7f5f62f409c0 20 started sync module instance, tier type = 2024-09-12T17:59:35.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.889+0000 7f5f62f409c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:35.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.913+0000 7f5f62f409c0 20 add_watcher() i=0 2024-09-12T17:59:35.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.913+0000 7f5f62f409c0 20 add_watcher() i=1 2024-09-12T17:59:35.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.913+0000 7f5f62f409c0 20 add_watcher() i=2 2024-09-12T17:59:35.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.913+0000 7f5f62f409c0 20 add_watcher() i=3 2024-09-12T17:59:35.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.913+0000 7f5f62f409c0 20 add_watcher() i=4 2024-09-12T17:59:35.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.913+0000 7f5f62f409c0 20 add_watcher() i=5 2024-09-12T17:59:35.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.913+0000 7f5f62f409c0 20 add_watcher() i=6 2024-09-12T17:59:35.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.913+0000 7f5f62f409c0 20 add_watcher() i=7 2024-09-12T17:59:35.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.913+0000 7f5f62f409c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:35.922 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.917+0000 7f5e16fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:35.922 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.917+0000 7f5f62f409c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:35.922 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.917+0000 7f5f62f409c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:35.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.917+0000 7f5f62f409c0 5 note: GC not initialized 2024-09-12T17:59:35.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.921+0000 7f5e15fe3640 20 reqs_thread_entry: start 2024-09-12T17:59:35.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.921+0000 7f5f62f409c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:35.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.921+0000 7f5f62f409c0 20 Filter name: none 2024-09-12T17:59:35.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.921+0000 7f5d877fe640 20 reqs_thread_entry: start 2024-09-12T17:59:35.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.921+0000 7f5f62f409c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T17:59:35.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.921+0000 7f5f62f409c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:35.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.921+0000 7f5f62f409c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:59:35.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.921+0000 7f5f62f409c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T17:59:35.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.921+0000 7f5f62f409c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T17:59:35.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.921+0000 7f5f62f409c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 : miss 2024-09-12T17:59:35.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.921+0000 7f5f62f409c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:35.926 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.921+0000 7f5f62f409c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T17:59:35.926 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.921+0000 7f5f62f409c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 info.flags=0x17 2024-09-12T17:59:35.926 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.921+0000 7f5f62f409c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 to cache LRU end 2024-09-12T17:59:35.926 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.921+0000 7f5f62f409c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:35.926 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.921+0000 7f5f62f409c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:35.926 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.921+0000 7f5f62f409c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 2024-09-12T17:59:35.928 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.925+0000 7f5f62f409c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T17:59:35.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.937+0000 7f5f62f409c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 info.flags=0x17 2024-09-12T17:59:35.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.937+0000 7f5f62f409c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 to cache LRU end 2024-09-12T17:59:35.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.937+0000 7f5f62f409c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:35.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.937+0000 7f5f62f409c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34, ofs0, ns] 2024-09-12T17:59:35.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.941+0000 7f5e37fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366173 cookie 94466377998800 notifier 7689 bl.length()=911 2024-09-12T17:59:35.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.941+0000 7f5e37fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 info.flags=0x17 2024-09-12T17:59:35.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.941+0000 7f5e37fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 to cache LRU end 2024-09-12T17:59:35.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.941+0000 7f5e37fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:35.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.941+0000 7f5f62f409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): orig_sources= new_sources= 2024-09-12T17:59:35.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.941+0000 7f5f62f409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): potential sources added=[] removed=[] 2024-09-12T17:59:35.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.941+0000 7f5f62f409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): orig_dests= new_dests= 2024-09-12T17:59:35.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.941+0000 7f5f62f409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): potential dests added=[] removed=[] 2024-09-12T17:59:35.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.0 2024-09-12T17:59:35.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.0 2024-09-12T17:59:35.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.1 2024-09-12T17:59:35.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.1 2024-09-12T17:59:35.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.2 2024-09-12T17:59:35.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.2 2024-09-12T17:59:35.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.3 2024-09-12T17:59:35.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.3 2024-09-12T17:59:35.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.4 2024-09-12T17:59:35.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.4 2024-09-12T17:59:35.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.5 2024-09-12T17:59:35.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.5 2024-09-12T17:59:35.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.6 2024-09-12T17:59:35.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.6 2024-09-12T17:59:35.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.7 2024-09-12T17:59:35.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.7 2024-09-12T17:59:35.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.8 2024-09-12T17:59:35.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.8 2024-09-12T17:59:35.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.9 2024-09-12T17:59:35.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.9 2024-09-12T17:59:35.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.10 2024-09-12T17:59:35.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.10 2024-09-12T17:59:35.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.11 2024-09-12T17:59:35.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2.11 2024-09-12T17:59:35.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.0 2024-09-12T17:59:35.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.1 2024-09-12T17:59:35.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2 2024-09-12T17:59:35.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.957+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.3 2024-09-12T17:59:35.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.961+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.4 2024-09-12T17:59:35.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.961+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.5 2024-09-12T17:59:35.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.961+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.6 2024-09-12T17:59:35.967 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.961+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.7 2024-09-12T17:59:35.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.965+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.8 2024-09-12T17:59:35.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.965+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.9 2024-09-12T17:59:35.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.969+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.10 2024-09-12T17:59:35.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.973+0000 7f5f62f409c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:59:35.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.973+0000 7f5f62f409c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 2024-09-12T17:59:35.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.977+0000 7f5f62f409c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 info.flags=0x17 2024-09-12T17:59:35.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.977+0000 7f5f62f409c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 to cache LRU end 2024-09-12T17:59:35.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.977+0000 7f5f62f409c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:35.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.977+0000 7f5f62f409c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34, ofs0, ns] 2024-09-12T17:59:35.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.977+0000 7f5e377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366174 cookie 94466377998800 notifier 7689 bl.length()=911 2024-09-12T17:59:35.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.977+0000 7f5e377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 info.flags=0x17 2024-09-12T17:59:35.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.977+0000 7f5e377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 to cache LRU end 2024-09-12T17:59:35.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.977+0000 7f5e377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:35.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.981+0000 7f5f62f409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): orig_sources= new_sources= 2024-09-12T17:59:35.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.981+0000 7f5f62f409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): potential sources added=[] removed=[] 2024-09-12T17:59:35.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.981+0000 7f5f62f409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): orig_dests= new_dests= 2024-09-12T17:59:35.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.981+0000 7f5f62f409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): potential dests added=[] removed=[] 2024-09-12T17:59:35.990 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.985+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.0 2024-09-12T17:59:35.991 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.989+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.1 2024-09-12T17:59:35.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.989+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.2 2024-09-12T17:59:35.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.989+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.3 2024-09-12T17:59:35.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.989+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.4 2024-09-12T17:59:35.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.989+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.5 2024-09-12T17:59:35.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.989+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.6 2024-09-12T17:59:35.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.993+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.7 2024-09-12T17:59:35.996 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.993+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.8 2024-09-12T17:59:35.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.993+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.9 2024-09-12T17:59:35.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.993+0000 7f5f62f409c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.34.10 2024-09-12T17:59:35.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.993+0000 7f5f62f409c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 : hit (requested=0x17, cached=0x17) 2024-09-12T17:59:35.999 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.993+0000 7f5f62f409c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 2024-09-12T17:59:36.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.997+0000 7f5f62f409c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 info.flags=0x17 2024-09-12T17:59:36.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.997+0000 7f5f62f409c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 to cache LRU end 2024-09-12T17:59:36.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.997+0000 7f5f62f409c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:36.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:35.997+0000 7f5f62f409c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34, ofs0, ns] 2024-09-12T17:59:36.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.001+0000 7f5e377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 94466377998800 notifier 7689 bl.length()=879 2024-09-12T17:59:36.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.001+0000 7f5e377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 info.flags=0x17 2024-09-12T17:59:36.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.001+0000 7f5e377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 to cache LRU end 2024-09-12T17:59:36.004 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.001+0000 7f5e377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:36.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.001+0000 7f5f62f409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): orig_sources= new_sources= 2024-09-12T17:59:36.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.001+0000 7f5f62f409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): potential sources added=[] removed=[] 2024-09-12T17:59:36.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.001+0000 7f5f62f409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): orig_dests= new_dests= 2024-09-12T17:59:36.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.001+0000 7f5f62f409c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[a01e4849-e968-46ce-97f1-a673c26b3735.4529.34]): potential dests added=[] removed=[] 2024-09-12T17:59:36.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.009+0000 7f5f62f409c0 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T17:59:36.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.013+0000 7f5e16fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:36.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.017+0000 7f5f62f409c0 20 remove_watcher() i=0 2024-09-12T17:59:36.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.017+0000 7f5f62f409c0 2 removed watcher, disabling cache 2024-09-12T17:59:36.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.021+0000 7f5f62f409c0 20 remove_watcher() i=1 2024-09-12T17:59:36.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.021+0000 7f5f62f409c0 20 remove_watcher() i=2 2024-09-12T17:59:36.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.025+0000 7f5f62f409c0 20 remove_watcher() i=3 2024-09-12T17:59:36.030 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.025+0000 7f5f62f409c0 20 remove_watcher() i=4 2024-09-12T17:59:36.031 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.029+0000 7f5f62f409c0 20 remove_watcher() i=5 2024-09-12T17:59:36.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.029+0000 7f5f62f409c0 20 remove_watcher() i=6 2024-09-12T17:59:36.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.029+0000 7f5f62f409c0 20 remove_watcher() i=7 2024-09-12T17:59:36.049 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T17:59:36.079 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:36.079 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:36.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.341+0000 7fc3e13909c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:36.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.345+0000 7fc3e13909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:36.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.345+0000 7fc3e13909c0 20 realm 2024-09-12T17:59:36.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.345+0000 7fc3e13909c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:36.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.345+0000 7fc3e13909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:36.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.345+0000 7fc3e13909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:36.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.345+0000 7fc3e13909c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:36.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.345+0000 7fc3e13909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:36.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.345+0000 7fc3e13909c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:36.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.345+0000 7fc3e13909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:36.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.345+0000 7fc3e13909c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:36.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.349+0000 7fc3e13909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:36.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.349+0000 7fc3e13909c0 20 searching for the correct realm 2024-09-12T17:59:36.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.349+0000 7fc3df697640 0 -- 172.21.15.98:0/3861030484 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7fc3c80a7040 msgr2=0x7fc3c80cc410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:36.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.557+0000 7fc3df697640 0 -- 172.21.15.98:0/3861030484 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7fc3c80dd940 msgr2=0x7fc3c80e63c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:36.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.781+0000 7fc3e13909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:36.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.781+0000 7fc3e13909c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:36.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.781+0000 7fc3e13909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:36.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.781+0000 7fc3e13909c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:36.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.781+0000 7fc3e13909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:36.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.781+0000 7fc3e13909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:36.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.781+0000 7fc3e13909c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:36.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.781+0000 7fc3e13909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:36.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.781+0000 7fc3e13909c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:36.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.781+0000 7fc3e13909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:36.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.781+0000 7fc3e13909c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:36.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.785+0000 7fc3e13909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:36.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.785+0000 7fc3e13909c0 20 zone default found 2024-09-12T17:59:36.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.785+0000 7fc3e13909c0 4 Realm: () 2024-09-12T17:59:36.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.785+0000 7fc3e13909c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:36.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.785+0000 7fc3e13909c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:36.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.785+0000 7fc3e13909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:36.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.785+0000 7fc3e13909c0 20 zonegroup default 2024-09-12T17:59:36.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.785+0000 7fc3e13909c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:36.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.785+0000 7fc3e13909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:36.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.785+0000 7fc3e13909c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:36.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.785+0000 7fc3e13909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:36.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.785+0000 7fc3e13909c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:36.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.785+0000 7fc3e13909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:36.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.785+0000 7fc3e13909c0 20 started sync module instance, tier type = 2024-09-12T17:59:36.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.785+0000 7fc3e13909c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:36.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.809+0000 7fc3e13909c0 20 add_watcher() i=0 2024-09-12T17:59:36.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.809+0000 7fc3e13909c0 20 add_watcher() i=1 2024-09-12T17:59:36.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.809+0000 7fc3e13909c0 20 add_watcher() i=2 2024-09-12T17:59:36.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.809+0000 7fc3e13909c0 20 add_watcher() i=3 2024-09-12T17:59:36.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.809+0000 7fc3e13909c0 20 add_watcher() i=4 2024-09-12T17:59:36.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.809+0000 7fc3e13909c0 20 add_watcher() i=5 2024-09-12T17:59:36.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.809+0000 7fc3e13909c0 20 add_watcher() i=6 2024-09-12T17:59:36.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.809+0000 7fc3e13909c0 20 add_watcher() i=7 2024-09-12T17:59:36.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.809+0000 7fc3e13909c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:36.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.813+0000 7fc2957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:36.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.817+0000 7fc3e13909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:36.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.817+0000 7fc3e13909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:36.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.817+0000 7fc3e13909c0 5 note: GC not initialized 2024-09-12T17:59:36.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.817+0000 7fc20ffff640 20 reqs_thread_entry: start 2024-09-12T17:59:36.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.817+0000 7fc3e13909c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:36.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.817+0000 7fc3e13909c0 20 Filter name: none 2024-09-12T17:59:36.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.817+0000 7fc20dffb640 20 reqs_thread_entry: start 2024-09-12T17:59:36.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.817+0000 7fc3e13909c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:36.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.817+0000 7fc3e13909c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:59:36.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.817+0000 7fc3e13909c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:36.822 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.817+0000 7fc3e13909c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:59:36.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.817+0000 7fc3e13909c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:36.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.817+0000 7fc3e13909c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:36.823 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.821+0000 7fc3e13909c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:59:36.824 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.821+0000 7fc3e13909c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:36.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.821+0000 7fc3e13909c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T17:59:36.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.821+0000 7fc3e13909c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:36.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.825+0000 7fc2957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:36.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.829+0000 7fc3e13909c0 20 remove_watcher() i=0 2024-09-12T17:59:36.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.829+0000 7fc3e13909c0 2 removed watcher, disabling cache 2024-09-12T17:59:36.835 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.833+0000 7fc3e13909c0 20 remove_watcher() i=1 2024-09-12T17:59:36.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.833+0000 7fc3e13909c0 20 remove_watcher() i=2 2024-09-12T17:59:36.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.837+0000 7fc3e13909c0 20 remove_watcher() i=3 2024-09-12T17:59:36.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.837+0000 7fc3e13909c0 20 remove_watcher() i=4 2024-09-12T17:59:36.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.837+0000 7fc3e13909c0 20 remove_watcher() i=5 2024-09-12T17:59:36.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.841+0000 7fc3e13909c0 20 remove_watcher() i=6 2024-09-12T17:59:36.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:36.841+0000 7fc3e13909c0 20 remove_watcher() i=7 2024-09-12T17:59:36.860 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:36.860 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:59:36.860 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-do-reshard id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:59:36.860 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:36.861 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:36.861 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:36.886 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:36.886 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:37.398 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:37.399 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:37.800 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T17:59:37.800 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:37.803 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:37.803 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:37.932 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:37.932 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:38.019 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:38.020 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:38.124 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:38.124 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:38.215 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:38.216 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:38.312 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:38.312 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:38.416 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:38.416 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:38.504 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:38.504 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:38.601 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:38.601 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:38.701 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:38.701 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:38.801 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:38.801 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:38.895 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:38.895 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:38.992 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:38.992 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:39.091 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:39.091 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:39.187 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:39.187 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:39.287 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:39.287 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:39.379 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:39.379 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:39.473 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:39.473 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:39.571 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:39.571 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:39.670 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:39.670 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:39.768 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:39.768 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:39.871 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:39.871 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:39.960 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:59:39.992 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:39.992 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:40.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.033+0000 7f7060b049c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.033+0000 7f7060b049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.033+0000 7f7060b049c0 20 realm 2024-09-12T17:59:40.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.033+0000 7f7060b049c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.033+0000 7f7060b049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.033+0000 7f7060b049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:40.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.033+0000 7f7060b049c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.033+0000 7f7060b049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.033+0000 7f7060b049c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.037+0000 7f7060b049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:40.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.037+0000 7f7060b049c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.037+0000 7f7060b049c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:40.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.037+0000 7f7060b049c0 20 searching for the correct realm 2024-09-12T17:59:40.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.045+0000 7f705ee0b640 0 -- 172.21.15.98:0/2046711276 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f70500fc190 msgr2=0x7f70500ff8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:40.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.261+0000 7f705e60a640 0 -- 172.21.15.98:0/2046711276 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x562aff173dc0 msgr2=0x562aff176250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:40.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.269+0000 7f7060b049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:40.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.269+0000 7f7060b049c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:40.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.269+0000 7f7060b049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:40.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.269+0000 7f7060b049c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:40.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.269+0000 7f7060b049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:40.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.269+0000 7f7060b049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:40.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.269+0000 7f7060b049c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.269+0000 7f7060b049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.269+0000 7f7060b049c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.273+0000 7f7060b049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:40.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.273+0000 7f7060b049c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.273+0000 7f7060b049c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:40.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.273+0000 7f7060b049c0 20 zone default found 2024-09-12T17:59:40.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.273+0000 7f7060b049c0 4 Realm: () 2024-09-12T17:59:40.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.273+0000 7f7060b049c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:40.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.273+0000 7f7060b049c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:40.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.273+0000 7f7060b049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:40.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.273+0000 7f7060b049c0 20 zonegroup default 2024-09-12T17:59:40.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.273+0000 7f7060b049c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.278 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.273+0000 7f7060b049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.278 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.273+0000 7f7060b049c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.278 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.273+0000 7f7060b049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.278 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.273+0000 7f7060b049c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.277+0000 7f7060b049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.277+0000 7f7060b049c0 20 started sync module instance, tier type = 2024-09-12T17:59:40.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.277+0000 7f7060b049c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:40.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.297+0000 7f7060b049c0 20 add_watcher() i=0 2024-09-12T17:59:40.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.297+0000 7f7060b049c0 20 add_watcher() i=1 2024-09-12T17:59:40.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.297+0000 7f7060b049c0 20 add_watcher() i=2 2024-09-12T17:59:40.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.297+0000 7f7060b049c0 20 add_watcher() i=3 2024-09-12T17:59:40.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.297+0000 7f7060b049c0 20 add_watcher() i=4 2024-09-12T17:59:40.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.297+0000 7f7060b049c0 20 add_watcher() i=5 2024-09-12T17:59:40.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.297+0000 7f7060b049c0 20 add_watcher() i=6 2024-09-12T17:59:40.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.301+0000 7f7060b049c0 20 add_watcher() i=7 2024-09-12T17:59:40.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.301+0000 7f7060b049c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:40.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.305+0000 7f6f14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:40.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.305+0000 7f7060b049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:40.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.305+0000 7f7060b049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:40.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.305+0000 7f7060b049c0 5 note: GC not initialized 2024-09-12T17:59:40.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.305+0000 7f6e8f7fe640 20 reqs_thread_entry: start 2024-09-12T17:59:40.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.305+0000 7f7060b049c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:40.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.309+0000 7f7060b049c0 20 Filter name: none 2024-09-12T17:59:40.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.309+0000 7f6e8d7fa640 20 reqs_thread_entry: start 2024-09-12T17:59:40.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.309+0000 7f7060b049c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.312 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.309+0000 7f7060b049c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:59:40.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.309+0000 7f7060b049c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.309+0000 7f7060b049c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:59:40.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.309+0000 7f7060b049c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:40.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.309+0000 7f7060b049c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.313+0000 7f7060b049c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:59:40.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.313+0000 7f7060b049c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.316 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.313+0000 7f7060b049c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:59:40.316 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.313+0000 7f7060b049c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:40.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.317+0000 7f6f14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:40.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.321+0000 7f7060b049c0 20 remove_watcher() i=0 2024-09-12T17:59:40.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.321+0000 7f7060b049c0 2 removed watcher, disabling cache 2024-09-12T17:59:40.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.325+0000 7f7060b049c0 20 remove_watcher() i=1 2024-09-12T17:59:40.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.325+0000 7f7060b049c0 20 remove_watcher() i=2 2024-09-12T17:59:40.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.329+0000 7f7060b049c0 20 remove_watcher() i=3 2024-09-12T17:59:40.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.329+0000 7f7060b049c0 20 remove_watcher() i=4 2024-09-12T17:59:40.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.333+0000 7f7060b049c0 20 remove_watcher() i=5 2024-09-12T17:59:40.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.333+0000 7f7060b049c0 20 remove_watcher() i=6 2024-09-12T17:59:40.339 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.337+0000 7f7060b049c0 20 remove_watcher() i=7 2024-09-12T17:59:40.356 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:40.356 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:59:40.356 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-logrecord-writes id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:59:40.356 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:40.357 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T17:59:40.393 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:40.393 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:40.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.433+0000 7fd3e930e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.437+0000 7fd3e930e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.437+0000 7fd3e930e9c0 20 realm 2024-09-12T17:59:40.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.437+0000 7fd3e930e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.437+0000 7fd3e930e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.437+0000 7fd3e930e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:40.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.437+0000 7fd3e930e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.437+0000 7fd3e930e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.437+0000 7fd3e930e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.437+0000 7fd3e930e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:40.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.437+0000 7fd3e930e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.437+0000 7fd3e930e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:40.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.437+0000 7fd3e930e9c0 20 searching for the correct realm 2024-09-12T17:59:40.448 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.445+0000 7fd3e7615640 0 -- 172.21.15.98:0/2506567574 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7fd3d000a040 msgr2=0x7fd3d00987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:59:40.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.661+0000 7fd3e6e14640 0 -- 172.21.15.98:0/2506567574 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x5592bbef0690 msgr2=0x5592bbef2b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:40.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.669+0000 7fd3e930e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:40.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.669+0000 7fd3e930e9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:40.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.669+0000 7fd3e930e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:40.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.669+0000 7fd3e930e9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:40.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.669+0000 7fd3e930e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:40.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.669+0000 7fd3e930e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:40.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.669+0000 7fd3e930e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.669+0000 7fd3e930e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.669+0000 7fd3e930e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.669+0000 7fd3e930e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:40.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.669+0000 7fd3e930e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.669+0000 7fd3e930e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:40.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.669+0000 7fd3e930e9c0 20 zone default found 2024-09-12T17:59:40.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.669+0000 7fd3e930e9c0 4 Realm: () 2024-09-12T17:59:40.675 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.669+0000 7fd3e930e9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:40.675 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.669+0000 7fd3e930e9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:40.675 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.669+0000 7fd3e930e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:40.675 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.669+0000 7fd3e930e9c0 20 zonegroup default 2024-09-12T17:59:40.675 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.669+0000 7fd3e930e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.675 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.673+0000 7fd3e930e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.675 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.673+0000 7fd3e930e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.673+0000 7fd3e930e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.673+0000 7fd3e930e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.673+0000 7fd3e930e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.673+0000 7fd3e930e9c0 20 started sync module instance, tier type = 2024-09-12T17:59:40.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.673+0000 7fd3e930e9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:40.700 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.697+0000 7fd3e930e9c0 20 add_watcher() i=0 2024-09-12T17:59:40.700 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.697+0000 7fd3e930e9c0 20 add_watcher() i=1 2024-09-12T17:59:40.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.697+0000 7fd3e930e9c0 20 add_watcher() i=2 2024-09-12T17:59:40.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.697+0000 7fd3e930e9c0 20 add_watcher() i=3 2024-09-12T17:59:40.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.697+0000 7fd3e930e9c0 20 add_watcher() i=4 2024-09-12T17:59:40.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.697+0000 7fd3e930e9c0 20 add_watcher() i=5 2024-09-12T17:59:40.701 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.697+0000 7fd3e930e9c0 20 add_watcher() i=6 2024-09-12T17:59:40.703 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.701+0000 7fd3e930e9c0 20 add_watcher() i=7 2024-09-12T17:59:40.703 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.701+0000 7fd3e930e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:40.707 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.705+0000 7fd29d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:40.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.705+0000 7fd3e930e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:40.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.705+0000 7fd3e930e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:40.708 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.705+0000 7fd3e930e9c0 5 note: GC not initialized 2024-09-12T17:59:40.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.705+0000 7fd217fff640 20 reqs_thread_entry: start 2024-09-12T17:59:40.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.705+0000 7fd3e930e9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:40.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.705+0000 7fd3e930e9c0 20 Filter name: none 2024-09-12T17:59:40.709 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.705+0000 7fd215ffb640 20 reqs_thread_entry: start 2024-09-12T17:59:40.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.705+0000 7fd3e930e9c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T17:59:40.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.705+0000 7fd3e930e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.705+0000 7fd3e930e9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:59:40.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.705+0000 7fd3e930e9c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T17:59:40.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.705+0000 7fd3e930e9c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T17:59:40.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.705+0000 7fd3e930e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 : miss 2024-09-12T17:59:40.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.705+0000 7fd3e930e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.709+0000 7fd3e930e9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:59:40.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.709+0000 7fd3e930e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 info.flags=0x17 2024-09-12T17:59:40.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.709+0000 7fd3e930e9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 to cache LRU end 2024-09-12T17:59:40.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.709+0000 7fd3e930e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:40.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.709+0000 7fd3e930e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:40.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.709+0000 7fd3e930e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 2024-09-12T17:59:40.724 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.721+0000 7fd3e930e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 info.flags=0x17 2024-09-12T17:59:40.724 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.721+0000 7fd3e930e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 to cache LRU end 2024-09-12T17:59:40.724 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.721+0000 7fd3e930e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:40.724 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.721+0000 7fd3e930e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35, ofs0, ns] 2024-09-12T17:59:40.725 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.721+0000 7fd2ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366200 cookie 94088706629312 notifier 7145 bl.length()=923 2024-09-12T17:59:40.725 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.721+0000 7fd2ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 info.flags=0x17 2024-09-12T17:59:40.725 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.721+0000 7fd2ca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 to cache LRU end 2024-09-12T17:59:40.725 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.721+0000 7fd2ca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:40.727 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.725+0000 7fd3e930e9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.35]): orig_sources= new_sources= 2024-09-12T17:59:40.728 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.725+0000 7fd3e930e9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.35]): potential sources added=[] removed=[] 2024-09-12T17:59:40.728 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.725+0000 7fd3e930e9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.35]): orig_dests= new_dests= 2024-09-12T17:59:40.728 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.725+0000 7fd3e930e9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.35]): potential dests added=[] removed=[] 2024-09-12T17:59:40.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.729+0000 7fd3e930e9c0 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T17:59:40.734 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.729+0000 7fd3e930e9c0 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T17:59:40.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.745+0000 7fd3e930e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:59:40.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.745+0000 7fd3e930e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 2024-09-12T17:59:40.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.745+0000 7fd3e930e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 info.flags=0x17 2024-09-12T17:59:40.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.745+0000 7fd3e930e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 to cache LRU end 2024-09-12T17:59:40.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.745+0000 7fd3e930e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:40.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.745+0000 7fd3e930e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35, ofs0, ns] 2024-09-12T17:59:40.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.745+0000 7fd2ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366201 cookie 94088706629312 notifier 7145 bl.length()=891 2024-09-12T17:59:40.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.745+0000 7fd2ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 info.flags=0x17 2024-09-12T17:59:40.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.745+0000 7fd2ca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 to cache LRU end 2024-09-12T17:59:40.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.745+0000 7fd2ca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:40.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.749+0000 7fd3e930e9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.35]): orig_sources= new_sources= 2024-09-12T17:59:40.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.749+0000 7fd3e930e9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.35]): potential sources added=[] removed=[] 2024-09-12T17:59:40.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.749+0000 7fd3e930e9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.35]): orig_dests= new_dests= 2024-09-12T17:59:40.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.749+0000 7fd3e930e9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.35]): potential dests added=[] removed=[] 2024-09-12T17:59:40.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.753+0000 7fd29d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:40.761 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.757+0000 7fd3e930e9c0 20 remove_watcher() i=0 2024-09-12T17:59:40.761 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.757+0000 7fd3e930e9c0 2 removed watcher, disabling cache 2024-09-12T17:59:40.763 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.761+0000 7fd3e930e9c0 20 remove_watcher() i=1 2024-09-12T17:59:40.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.761+0000 7fd3e930e9c0 20 remove_watcher() i=2 2024-09-12T17:59:40.768 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.765+0000 7fd3e930e9c0 20 remove_watcher() i=3 2024-09-12T17:59:40.770 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.765+0000 7fd3e930e9c0 20 remove_watcher() i=4 2024-09-12T17:59:40.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.769+0000 7fd3e930e9c0 20 remove_watcher() i=5 2024-09-12T17:59:40.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.769+0000 7fd3e930e9c0 20 remove_watcher() i=6 2024-09-12T17:59:40.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.773+0000 7fd3e930e9c0 20 remove_watcher() i=7 2024-09-12T17:59:40.793 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:59:40.825 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:40.825 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:40.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.865+0000 7fc47f0d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.869+0000 7fc47f0d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.869+0000 7fc47f0d19c0 20 realm 2024-09-12T17:59:40.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.869+0000 7fc47f0d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.869+0000 7fc47f0d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.869+0000 7fc47f0d19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:40.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.869+0000 7fc47f0d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.869+0000 7fc47f0d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.869+0000 7fc47f0d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.869+0000 7fc47f0d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:40.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.869+0000 7fc47f0d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.869+0000 7fc47f0d19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:40.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.869+0000 7fc47f0d19c0 20 searching for the correct realm 2024-09-12T17:59:40.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.877+0000 7fc47c3d6640 0 -- 172.21.15.98:0/2413041191 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55fd5eb43fe0 msgr2=0x55fd5eb46470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:59:40.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.881+0000 7fc47cbd7640 0 -- 172.21.15.98:0/2413041191 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fc4700e5b40 msgr2=0x7fc4700b8900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:40.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.889+0000 7fc47f0d19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:40.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.889+0000 7fc47f0d19c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:40.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.889+0000 7fc47f0d19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:40.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.889+0000 7fc47f0d19c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:40.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.889+0000 7fc47f0d19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:40.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.889+0000 7fc47f0d19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:40.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.889+0000 7fc47f0d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.889+0000 7fc47f0d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.889+0000 7fc47f0d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.893+0000 7fc47f0d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:40.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.893+0000 7fc47f0d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.893+0000 7fc47f0d19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:40.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.893+0000 7fc47f0d19c0 20 zone default found 2024-09-12T17:59:40.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.893+0000 7fc47f0d19c0 4 Realm: () 2024-09-12T17:59:40.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.893+0000 7fc47f0d19c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:40.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.893+0000 7fc47f0d19c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:40.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.893+0000 7fc47f0d19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:40.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.893+0000 7fc47f0d19c0 20 zonegroup default 2024-09-12T17:59:40.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.893+0000 7fc47f0d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.893+0000 7fc47f0d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.893+0000 7fc47f0d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.893+0000 7fc47f0d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.893+0000 7fc47f0d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.893+0000 7fc47f0d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:40.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.893+0000 7fc47f0d19c0 20 started sync module instance, tier type = 2024-09-12T17:59:40.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.893+0000 7fc47f0d19c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:40.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.909+0000 7fc47f0d19c0 20 add_watcher() i=0 2024-09-12T17:59:40.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.909+0000 7fc47f0d19c0 20 add_watcher() i=1 2024-09-12T17:59:40.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.909+0000 7fc47f0d19c0 20 add_watcher() i=2 2024-09-12T17:59:40.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.909+0000 7fc47f0d19c0 20 add_watcher() i=3 2024-09-12T17:59:40.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.909+0000 7fc47f0d19c0 20 add_watcher() i=4 2024-09-12T17:59:40.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.909+0000 7fc47f0d19c0 20 add_watcher() i=5 2024-09-12T17:59:40.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.909+0000 7fc47f0d19c0 20 add_watcher() i=6 2024-09-12T17:59:40.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.909+0000 7fc47f0d19c0 20 add_watcher() i=7 2024-09-12T17:59:40.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.909+0000 7fc47f0d19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:40.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.913+0000 7fc332fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:40.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.913+0000 7fc47f0d19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:40.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.913+0000 7fc47f0d19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:40.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.913+0000 7fc47f0d19c0 5 note: GC not initialized 2024-09-12T17:59:40.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.913+0000 7fc331fe3640 20 reqs_thread_entry: start 2024-09-12T17:59:40.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.913+0000 7fc47f0d19c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:40.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.913+0000 7fc47f0d19c0 20 Filter name: none 2024-09-12T17:59:40.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.913+0000 7fc2a37fe640 20 reqs_thread_entry: start 2024-09-12T17:59:40.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.913+0000 7fc47f0d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.919 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.913+0000 7fc47f0d19c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:59:40.919 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.917+0000 7fc47f0d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.917+0000 7fc47f0d19c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:59:40.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.917+0000 7fc47f0d19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:40.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.917+0000 7fc47f0d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.917+0000 7fc47f0d19c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:59:40.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.917+0000 7fc47f0d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:40.922 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.917+0000 7fc47f0d19c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:59:40.922 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.917+0000 7fc47f0d19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:40.925 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.921+0000 7fc332fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:40.930 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.925+0000 7fc47f0d19c0 20 remove_watcher() i=0 2024-09-12T17:59:40.930 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.925+0000 7fc47f0d19c0 2 removed watcher, disabling cache 2024-09-12T17:59:40.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.929+0000 7fc47f0d19c0 20 remove_watcher() i=1 2024-09-12T17:59:40.934 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.929+0000 7fc47f0d19c0 20 remove_watcher() i=2 2024-09-12T17:59:40.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.933+0000 7fc47f0d19c0 20 remove_watcher() i=3 2024-09-12T17:59:40.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.933+0000 7fc47f0d19c0 20 remove_watcher() i=4 2024-09-12T17:59:40.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.937+0000 7fc47f0d19c0 20 remove_watcher() i=5 2024-09-12T17:59:40.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.937+0000 7fc47f0d19c0 20 remove_watcher() i=6 2024-09-12T17:59:40.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:40.937+0000 7fc47f0d19c0 20 remove_watcher() i=7 2024-09-12T17:59:40.956 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:40.956 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:59:40.956 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-logrecord-writes id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:59:40.956 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:40.957 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:40.957 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:40.997 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:40.997 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:41.057 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:59:41.091 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:41.091 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:41.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.129+0000 7f97cde3f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.136 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.133+0000 7f97cde3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:41.136 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.133+0000 7f97cde3f9c0 20 realm 2024-09-12T17:59:41.136 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.133+0000 7f97cde3f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.133+0000 7f97cde3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:41.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.133+0000 7f97cde3f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:41.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.133+0000 7f97cde3f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.133+0000 7f97cde3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:41.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.133+0000 7f97cde3f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.138 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.133+0000 7f97cde3f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:41.138 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.133+0000 7f97cde3f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.139 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.133+0000 7f97cde3f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:41.139 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.133+0000 7f97cde3f9c0 20 searching for the correct realm 2024-09-12T17:59:41.144 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.141+0000 7f97cc146640 0 -- 172.21.15.98:0/1384480907 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x558f11d01eb0 msgr2=0x558f11d04350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:41.150 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.145+0000 7f97cb144640 0 -- 172.21.15.98:0/1384480907 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f97bc0c1020 msgr2=0x7f97bc0b5350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:59:41.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.153+0000 7f97cde3f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:41.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.153+0000 7f97cde3f9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:41.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.153+0000 7f97cde3f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:41.158 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.153+0000 7f97cde3f9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:41.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.153+0000 7f97cde3f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:41.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.153+0000 7f97cde3f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:41.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.153+0000 7f97cde3f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.153+0000 7f97cde3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:41.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.153+0000 7f97cde3f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.157+0000 7f97cde3f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:41.159 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.157+0000 7f97cde3f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.157+0000 7f97cde3f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:41.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.157+0000 7f97cde3f9c0 20 zone default found 2024-09-12T17:59:41.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.157+0000 7f97cde3f9c0 4 Realm: () 2024-09-12T17:59:41.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.157+0000 7f97cde3f9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:41.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.157+0000 7f97cde3f9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:41.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.157+0000 7f97cde3f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:41.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.157+0000 7f97cde3f9c0 20 zonegroup default 2024-09-12T17:59:41.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.157+0000 7f97cde3f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.157+0000 7f97cde3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:41.161 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.157+0000 7f97cde3f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.157+0000 7f97cde3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:41.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.157+0000 7f97cde3f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.157+0000 7f97cde3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:41.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.157+0000 7f97cde3f9c0 20 started sync module instance, tier type = 2024-09-12T17:59:41.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.157+0000 7f97cde3f9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:41.176 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.173+0000 7f97cde3f9c0 20 add_watcher() i=0 2024-09-12T17:59:41.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.173+0000 7f97cde3f9c0 20 add_watcher() i=1 2024-09-12T17:59:41.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.173+0000 7f97cde3f9c0 20 add_watcher() i=2 2024-09-12T17:59:41.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.173+0000 7f97cde3f9c0 20 add_watcher() i=3 2024-09-12T17:59:41.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.173+0000 7f97cde3f9c0 20 add_watcher() i=4 2024-09-12T17:59:41.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.173+0000 7f97cde3f9c0 20 add_watcher() i=5 2024-09-12T17:59:41.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.173+0000 7f97cde3f9c0 20 add_watcher() i=6 2024-09-12T17:59:41.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.173+0000 7f97cde3f9c0 20 add_watcher() i=7 2024-09-12T17:59:41.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.173+0000 7f97cde3f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:41.180 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.177+0000 7f9681fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:41.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.177+0000 7f97cde3f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:41.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.177+0000 7f97cde3f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:41.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.177+0000 7f97cde3f9c0 5 note: GC not initialized 2024-09-12T17:59:41.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.177+0000 7f9680fe1640 20 reqs_thread_entry: start 2024-09-12T17:59:41.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.177+0000 7f97cde3f9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:41.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.177+0000 7f97cde3f9c0 20 Filter name: none 2024-09-12T17:59:41.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.177+0000 7f95fa7fc640 20 reqs_thread_entry: start 2024-09-12T17:59:41.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.177+0000 7f97cde3f9c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T17:59:41.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.177+0000 7f97cde3f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.182 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.177+0000 7f97cde3f9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:59:41.182 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.177+0000 7f97cde3f9c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T17:59:41.182 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.177+0000 7f97cde3f9c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T17:59:41.182 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.177+0000 7f97cde3f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 : miss 2024-09-12T17:59:41.182 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.177+0000 7f97cde3f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.181+0000 7f97cde3f9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:59:41.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.181+0000 7f97cde3f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 info.flags=0x17 2024-09-12T17:59:41.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.181+0000 7f97cde3f9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 to cache LRU end 2024-09-12T17:59:41.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.181+0000 7f97cde3f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:41.184 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.181+0000 7f97cde3f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:41.184 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.181+0000 7f97cde3f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 2024-09-12T17:59:41.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.193+0000 7f97cde3f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 info.flags=0x17 2024-09-12T17:59:41.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.193+0000 7f97cde3f9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 to cache LRU end 2024-09-12T17:59:41.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.193+0000 7f97cde3f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:41.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.193+0000 7f97cde3f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35, ofs0, ns] 2024-09-12T17:59:41.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.193+0000 7f96aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366202 cookie 94072967542240 notifier 7779 bl.length()=923 2024-09-12T17:59:41.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.193+0000 7f96aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 info.flags=0x17 2024-09-12T17:59:41.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.193+0000 7f96aa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 to cache LRU end 2024-09-12T17:59:41.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.193+0000 7f96aa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:41.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.197+0000 7f97cde3f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.35]): orig_sources= new_sources= 2024-09-12T17:59:41.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.197+0000 7f97cde3f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.35]): potential sources added=[] removed=[] 2024-09-12T17:59:41.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.197+0000 7f97cde3f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.35]): orig_dests= new_dests= 2024-09-12T17:59:41.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.197+0000 7f97cde3f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.35]): potential dests added=[] removed=[] 2024-09-12T17:59:41.214 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.0 2024-09-12T17:59:41.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.0 2024-09-12T17:59:41.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.1 2024-09-12T17:59:41.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.1 2024-09-12T17:59:41.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.2 2024-09-12T17:59:41.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.2 2024-09-12T17:59:41.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.3 2024-09-12T17:59:41.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.3 2024-09-12T17:59:41.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.4 2024-09-12T17:59:41.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.4 2024-09-12T17:59:41.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.5 2024-09-12T17:59:41.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.5 2024-09-12T17:59:41.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.6 2024-09-12T17:59:41.215 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.6 2024-09-12T17:59:41.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.7 2024-09-12T17:59:41.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.7 2024-09-12T17:59:41.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.8 2024-09-12T17:59:41.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.8 2024-09-12T17:59:41.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.9 2024-09-12T17:59:41.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.9 2024-09-12T17:59:41.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.10 2024-09-12T17:59:41.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.10 2024-09-12T17:59:41.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.11 2024-09-12T17:59:41.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1.11 2024-09-12T17:59:41.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.209+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.0 2024-09-12T17:59:41.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.213+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1 2024-09-12T17:59:41.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.213+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.2 2024-09-12T17:59:41.218 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.213+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.3 2024-09-12T17:59:41.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.217+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.4 2024-09-12T17:59:41.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.217+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.5 2024-09-12T17:59:41.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.217+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.6 2024-09-12T17:59:41.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.217+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.7 2024-09-12T17:59:41.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.221+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.8 2024-09-12T17:59:41.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.221+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.9 2024-09-12T17:59:41.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.221+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.10 2024-09-12T17:59:41.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.229+0000 7f97cde3f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:59:41.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.229+0000 7f97cde3f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 2024-09-12T17:59:41.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.229+0000 7f97cde3f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 info.flags=0x17 2024-09-12T17:59:41.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.229+0000 7f97cde3f9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 to cache LRU end 2024-09-12T17:59:41.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.229+0000 7f97cde3f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:41.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.229+0000 7f97cde3f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35, ofs0, ns] 2024-09-12T17:59:41.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.233+0000 7f96aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366203 cookie 94072967542240 notifier 7779 bl.length()=923 2024-09-12T17:59:41.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.233+0000 7f96aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 info.flags=0x17 2024-09-12T17:59:41.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.233+0000 7f96aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 to cache LRU end 2024-09-12T17:59:41.236 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.233+0000 7f96aaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:41.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.233+0000 7f97cde3f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.35]): orig_sources= new_sources= 2024-09-12T17:59:41.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.233+0000 7f97cde3f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.35]): potential sources added=[] removed=[] 2024-09-12T17:59:41.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.233+0000 7f97cde3f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.35]): orig_dests= new_dests= 2024-09-12T17:59:41.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.233+0000 7f97cde3f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.35]): potential dests added=[] removed=[] 2024-09-12T17:59:41.249 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.245+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.0 2024-09-12T17:59:41.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.245+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.1 2024-09-12T17:59:41.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.249+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.2 2024-09-12T17:59:41.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.249+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.3 2024-09-12T17:59:41.253 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.249+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.4 2024-09-12T17:59:41.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.249+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.5 2024-09-12T17:59:41.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.253+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.6 2024-09-12T17:59:41.256 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.253+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.7 2024-09-12T17:59:41.256 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.253+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.8 2024-09-12T17:59:41.257 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.253+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.9 2024-09-12T17:59:41.258 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.253+0000 7f97cde3f9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.35.10 2024-09-12T17:59:41.258 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.253+0000 7f97cde3f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 : hit (requested=0x17, cached=0x17) 2024-09-12T17:59:41.259 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.253+0000 7f97cde3f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 2024-09-12T17:59:41.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.257+0000 7f97cde3f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 info.flags=0x17 2024-09-12T17:59:41.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.257+0000 7f97cde3f9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 to cache LRU end 2024-09-12T17:59:41.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.257+0000 7f97cde3f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:41.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.257+0000 7f97cde3f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35, ofs0, ns] 2024-09-12T17:59:41.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.257+0000 7f96aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366204 cookie 94072967542240 notifier 7779 bl.length()=891 2024-09-12T17:59:41.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.257+0000 7f96aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 info.flags=0x17 2024-09-12T17:59:41.263 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.257+0000 7f96aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 to cache LRU end 2024-09-12T17:59:41.263 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.257+0000 7f96aaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:41.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.261+0000 7f97cde3f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.35]): orig_sources= new_sources= 2024-09-12T17:59:41.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.261+0000 7f97cde3f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.35]): potential sources added=[] removed=[] 2024-09-12T17:59:41.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.261+0000 7f97cde3f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.35]): orig_dests= new_dests= 2024-09-12T17:59:41.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.261+0000 7f97cde3f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.35]): potential dests added=[] removed=[] 2024-09-12T17:59:41.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.269+0000 7f97cde3f9c0 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T17:59:41.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.273+0000 7f9681fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:41.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.277+0000 7f97cde3f9c0 20 remove_watcher() i=0 2024-09-12T17:59:41.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.277+0000 7f97cde3f9c0 2 removed watcher, disabling cache 2024-09-12T17:59:41.283 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.281+0000 7f97cde3f9c0 20 remove_watcher() i=1 2024-09-12T17:59:41.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.281+0000 7f97cde3f9c0 20 remove_watcher() i=2 2024-09-12T17:59:41.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.285+0000 7f97cde3f9c0 20 remove_watcher() i=3 2024-09-12T17:59:41.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.285+0000 7f97cde3f9c0 20 remove_watcher() i=4 2024-09-12T17:59:41.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.289+0000 7f97cde3f9c0 20 remove_watcher() i=5 2024-09-12T17:59:41.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.289+0000 7f97cde3f9c0 20 remove_watcher() i=6 2024-09-12T17:59:41.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.293+0000 7f97cde3f9c0 20 remove_watcher() i=7 2024-09-12T17:59:41.316 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T17:59:41.348 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:41.348 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:41.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.389+0000 7f28c5aac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.389+0000 7f28c5aac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:41.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.389+0000 7f28c5aac9c0 20 realm 2024-09-12T17:59:41.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.389+0000 7f28c5aac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.389+0000 7f28c5aac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:41.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.389+0000 7f28c5aac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:41.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.389+0000 7f28c5aac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.389+0000 7f28c5aac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:41.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.389+0000 7f28c5aac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.393+0000 7f28c5aac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:41.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.393+0000 7f28c5aac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.393+0000 7f28c5aac9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:41.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.393+0000 7f28c5aac9c0 20 searching for the correct realm 2024-09-12T17:59:41.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.401+0000 7f28c3db3640 0 -- 172.21.15.98:0/1669520579 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f28b806d690 msgr2=0x7f28b806d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:41.621 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.617+0000 7f28c35b2640 0 -- 172.21.15.98:0/1669520579 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x56235b7071b0 msgr2=0x56235b709670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:41.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.625+0000 7f28c5aac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:41.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.625+0000 7f28c5aac9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:41.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.625+0000 7f28c5aac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:41.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.625+0000 7f28c5aac9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:41.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.625+0000 7f28c5aac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:41.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.625+0000 7f28c5aac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:41.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.625+0000 7f28c5aac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.625+0000 7f28c5aac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:41.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.625+0000 7f28c5aac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.625+0000 7f28c5aac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:41.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.625+0000 7f28c5aac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.629+0000 7f28c5aac9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:41.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.629+0000 7f28c5aac9c0 20 zone default found 2024-09-12T17:59:41.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.629+0000 7f28c5aac9c0 4 Realm: () 2024-09-12T17:59:41.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.629+0000 7f28c5aac9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:41.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.629+0000 7f28c5aac9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:41.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.629+0000 7f28c5aac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:41.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.629+0000 7f28c5aac9c0 20 zonegroup default 2024-09-12T17:59:41.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.629+0000 7f28c5aac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.629+0000 7f28c5aac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:41.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.629+0000 7f28c5aac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.629+0000 7f28c5aac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:41.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.629+0000 7f28c5aac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.629+0000 7f28c5aac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:41.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.629+0000 7f28c5aac9c0 20 started sync module instance, tier type = 2024-09-12T17:59:41.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.629+0000 7f28c5aac9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:41.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.653+0000 7f28c5aac9c0 20 add_watcher() i=0 2024-09-12T17:59:41.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.653+0000 7f28c5aac9c0 20 add_watcher() i=1 2024-09-12T17:59:41.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.653+0000 7f28c5aac9c0 20 add_watcher() i=2 2024-09-12T17:59:41.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.653+0000 7f28c5aac9c0 20 add_watcher() i=3 2024-09-12T17:59:41.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.653+0000 7f28c5aac9c0 20 add_watcher() i=4 2024-09-12T17:59:41.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.653+0000 7f28c5aac9c0 20 add_watcher() i=5 2024-09-12T17:59:41.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.653+0000 7f28c5aac9c0 20 add_watcher() i=6 2024-09-12T17:59:41.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.653+0000 7f28c5aac9c0 20 add_watcher() i=7 2024-09-12T17:59:41.659 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.653+0000 7f28c5aac9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:41.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.661+0000 7f2779fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:41.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.661+0000 7f28c5aac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:41.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.661+0000 7f28c5aac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:41.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.661+0000 7f28c5aac9c0 5 note: GC not initialized 2024-09-12T17:59:41.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.661+0000 7f2778fe1640 20 reqs_thread_entry: start 2024-09-12T17:59:41.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.661+0000 7f28c5aac9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:41.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.661+0000 7f28c5aac9c0 20 Filter name: none 2024-09-12T17:59:41.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.661+0000 7f26f27fc640 20 reqs_thread_entry: start 2024-09-12T17:59:41.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.661+0000 7f28c5aac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.661+0000 7f28c5aac9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:59:41.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.661+0000 7f28c5aac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.668 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.665+0000 7f28c5aac9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:59:41.668 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.665+0000 7f28c5aac9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:41.668 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.665+0000 7f28c5aac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.669 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.665+0000 7f28c5aac9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:59:41.669 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.665+0000 7f28c5aac9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:41.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.665+0000 7f28c5aac9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:59:41.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.665+0000 7f28c5aac9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:41.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.669+0000 7f2779fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:41.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.673+0000 7f28c5aac9c0 20 remove_watcher() i=0 2024-09-12T17:59:41.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.673+0000 7f28c5aac9c0 2 removed watcher, disabling cache 2024-09-12T17:59:41.680 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.677+0000 7f28c5aac9c0 20 remove_watcher() i=1 2024-09-12T17:59:41.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.677+0000 7f28c5aac9c0 20 remove_watcher() i=2 2024-09-12T17:59:41.684 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.681+0000 7f28c5aac9c0 20 remove_watcher() i=3 2024-09-12T17:59:41.686 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.681+0000 7f28c5aac9c0 20 remove_watcher() i=4 2024-09-12T17:59:41.687 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.685+0000 7f28c5aac9c0 20 remove_watcher() i=5 2024-09-12T17:59:41.689 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.685+0000 7f28c5aac9c0 20 remove_watcher() i=6 2024-09-12T17:59:41.690 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:41.685+0000 7f28c5aac9c0 20 remove_watcher() i=7 2024-09-12T17:59:41.705 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:41.705 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:59:41.705 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-logrecord-writes id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T17:59:41.705 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:41.706 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:41.707 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:41.734 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:41.734 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:42.304 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:42.304 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:42.703 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T17:59:42.703 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:42.706 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:42.706 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:42.823 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:42.823 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:42.911 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:42.912 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:43.016 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:43.016 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:43.114 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:43.114 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:43.208 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:43.209 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:43.294 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:43.294 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:43.384 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:43.384 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:43.469 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:43.469 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:43.563 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:43.563 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:43.659 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:43.659 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:43.748 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:43.749 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:43.844 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:43.844 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:43.941 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:43.941 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:44.055 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:44.055 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:44.151 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:44.151 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:44.250 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:44.250 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:44.348 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:44.348 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:44.442 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:44.442 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:44.535 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:44.535 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:44.635 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:44.635 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:44.728 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:44.728 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:44.825 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:59:44.857 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:44.857 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:44.902 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:44.897+0000 7f7a4e0019c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:44.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:44.901+0000 7f7a4e0019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:44.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:44.901+0000 7f7a4e0019c0 20 realm 2024-09-12T17:59:44.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:44.901+0000 7f7a4e0019c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:44.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:44.901+0000 7f7a4e0019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:44.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:44.901+0000 7f7a4e0019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:44.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:44.901+0000 7f7a4e0019c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:44.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:44.901+0000 7f7a4e0019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:44.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:44.901+0000 7f7a4e0019c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:44.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:44.901+0000 7f7a4e0019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:44.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:44.901+0000 7f7a4e0019c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:44.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:44.901+0000 7f7a4e0019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:44.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:44.901+0000 7f7a4e0019c0 20 searching for the correct realm 2024-09-12T17:59:44.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:44.909+0000 7f7a4b306640 0 -- 172.21.15.98:0/686038713 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f7a3c0ca070 msgr2=0x7f7a3c1330e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:59:45.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.125+0000 7f7a4bb07640 0 -- 172.21.15.98:0/686038713 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f7a40067ea0 msgr2=0x7f7a400817b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T17:59:45.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.341+0000 7f7a4e0019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:45.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.341+0000 7f7a4e0019c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:45.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.341+0000 7f7a4e0019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:45.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.341+0000 7f7a4e0019c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:45.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.341+0000 7f7a4e0019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:45.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.341+0000 7f7a4e0019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:45.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.341+0000 7f7a4e0019c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.341+0000 7f7a4e0019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.341+0000 7f7a4e0019c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.345+0000 7f7a4e0019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:45.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.345+0000 7f7a4e0019c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.345+0000 7f7a4e0019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:45.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.345+0000 7f7a4e0019c0 20 zone default found 2024-09-12T17:59:45.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.345+0000 7f7a4e0019c0 4 Realm: () 2024-09-12T17:59:45.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.345+0000 7f7a4e0019c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:45.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.345+0000 7f7a4e0019c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:45.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.345+0000 7f7a4e0019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:45.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.345+0000 7f7a4e0019c0 20 zonegroup default 2024-09-12T17:59:45.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.345+0000 7f7a4e0019c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.345+0000 7f7a4e0019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.345+0000 7f7a4e0019c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.345+0000 7f7a4e0019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.345+0000 7f7a4e0019c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.345+0000 7f7a4e0019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.345+0000 7f7a4e0019c0 20 started sync module instance, tier type = 2024-09-12T17:59:45.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.345+0000 7f7a4e0019c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:45.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.365+0000 7f7a4e0019c0 20 add_watcher() i=0 2024-09-12T17:59:45.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.365+0000 7f7a4e0019c0 20 add_watcher() i=1 2024-09-12T17:59:45.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.365+0000 7f7a4e0019c0 20 add_watcher() i=2 2024-09-12T17:59:45.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.365+0000 7f7a4e0019c0 20 add_watcher() i=3 2024-09-12T17:59:45.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.365+0000 7f7a4e0019c0 20 add_watcher() i=4 2024-09-12T17:59:45.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.365+0000 7f7a4e0019c0 20 add_watcher() i=5 2024-09-12T17:59:45.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.365+0000 7f7a4e0019c0 20 add_watcher() i=6 2024-09-12T17:59:45.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.369+0000 7f7a4e0019c0 20 add_watcher() i=7 2024-09-12T17:59:45.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.369+0000 7f7a4e0019c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:45.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.373+0000 7f7901fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:45.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.373+0000 7f7a4e0019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:45.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.373+0000 7f7a4e0019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:45.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.373+0000 7f7a4e0019c0 5 note: GC not initialized 2024-09-12T17:59:45.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.373+0000 7f7900fe1640 20 reqs_thread_entry: start 2024-09-12T17:59:45.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.373+0000 7f7a4e0019c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:45.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.373+0000 7f7a4e0019c0 20 Filter name: none 2024-09-12T17:59:45.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.373+0000 7f787a7fc640 20 reqs_thread_entry: start 2024-09-12T17:59:45.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.373+0000 7f7a4e0019c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.377+0000 7f7a4e0019c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:59:45.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.377+0000 7f7a4e0019c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.377+0000 7f7a4e0019c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:59:45.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.377+0000 7f7a4e0019c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:45.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.377+0000 7f7a4e0019c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.377+0000 7f7a4e0019c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:59:45.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.377+0000 7f7a4e0019c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.384 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.381+0000 7f7a4e0019c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:59:45.384 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.381+0000 7f7a4e0019c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:45.387 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.385+0000 7f7901fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:45.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.389+0000 7f7a4e0019c0 20 remove_watcher() i=0 2024-09-12T17:59:45.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.389+0000 7f7a4e0019c0 2 removed watcher, disabling cache 2024-09-12T17:59:45.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.389+0000 7f7a4e0019c0 20 remove_watcher() i=1 2024-09-12T17:59:45.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.393+0000 7f7a4e0019c0 20 remove_watcher() i=2 2024-09-12T17:59:45.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.393+0000 7f7a4e0019c0 20 remove_watcher() i=3 2024-09-12T17:59:45.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.397+0000 7f7a4e0019c0 20 remove_watcher() i=4 2024-09-12T17:59:45.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.397+0000 7f7a4e0019c0 20 remove_watcher() i=5 2024-09-12T17:59:45.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.401+0000 7f7a4e0019c0 20 remove_watcher() i=6 2024-09-12T17:59:45.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.401+0000 7f7a4e0019c0 20 remove_watcher() i=7 2024-09-12T17:59:45.421 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.422 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:59:45.422 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-logrecord-writes id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:59:45.422 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.422 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T17:59:45.455 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:45.456 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:45.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 realm 2024-09-12T17:59:45.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:45.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:45.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.501+0000 7fa36ee2e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:45.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.501+0000 7fa36ee2e9c0 20 searching for the correct realm 2024-09-12T17:59:45.509 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.505+0000 7fa36d135640 0 -- 172.21.15.98:0/3828057187 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55780567abd0 msgr2=0x55780567d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:45.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.513+0000 7fa36c133640 0 -- 172.21.15.98:0/3828057187 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fa35c019040 msgr2=0x7fa35c072040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:45.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:45.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:45.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:45.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:45.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:45.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:45.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:45.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:45.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 zone default found 2024-09-12T17:59:45.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 4 Realm: () 2024-09-12T17:59:45.524 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:45.525 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:45.525 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:45.525 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 zonegroup default 2024-09-12T17:59:45.525 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.525 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.525 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.526 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.526 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.526 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.526 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 started sync module instance, tier type = 2024-09-12T17:59:45.526 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:45.540 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=0 2024-09-12T17:59:45.540 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=1 2024-09-12T17:59:45.540 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=2 2024-09-12T17:59:45.540 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=3 2024-09-12T17:59:45.540 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=4 2024-09-12T17:59:45.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=5 2024-09-12T17:59:45.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=6 2024-09-12T17:59:45.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=7 2024-09-12T17:59:45.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:45.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.541+0000 7fa222fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:45.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:45.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:45.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 note: GC not initialized 2024-09-12T17:59:45.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.541+0000 7fa221fe3640 20 reqs_thread_entry: start 2024-09-12T17:59:45.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:45.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 Filter name: none 2024-09-12T17:59:45.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.541+0000 7fa1937fe640 20 reqs_thread_entry: start 2024-09-12T17:59:45.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:59:45.545 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:59:45.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:59:45.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:59:45.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 : miss 2024-09-12T17:59:45.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.545+0000 7fa36ee2e9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:59:45.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.545+0000 7fa36ee2e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 info.flags=0x17 2024-09-12T17:59:45.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.545+0000 7fa36ee2e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 to cache LRU end 2024-09-12T17:59:45.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.545+0000 7fa36ee2e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:45.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.545+0000 7fa36ee2e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:45.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.545+0000 7fa36ee2e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 2024-09-12T17:59:45.557 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.553+0000 7fa36ee2e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 info.flags=0x17 2024-09-12T17:59:45.557 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.553+0000 7fa36ee2e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 to cache LRU end 2024-09-12T17:59:45.557 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.553+0000 7fa36ee2e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:45.557 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.553+0000 7fa36ee2e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36, ofs0, ns] 2024-09-12T17:59:45.558 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.553+0000 7fa243fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366253 cookie 93973975167824 notifier 7229 bl.length()=923 2024-09-12T17:59:45.558 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.553+0000 7fa243fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 info.flags=0x17 2024-09-12T17:59:45.558 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.553+0000 7fa243fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 to cache LRU end 2024-09-12T17:59:45.558 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.553+0000 7fa243fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:45.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.557+0000 7fa36ee2e9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): orig_sources= new_sources= 2024-09-12T17:59:45.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.557+0000 7fa36ee2e9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): potential sources added=[] removed=[] 2024-09-12T17:59:45.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.557+0000 7fa36ee2e9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): orig_dests= new_dests= 2024-09-12T17:59:45.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.557+0000 7fa36ee2e9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): potential dests added=[] removed=[] 2024-09-12T17:59:45.565 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa36ee2e9c0 time 2024-09-12T17:59:45.567011+0000 2024-09-12T17:59:45.565 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:59:45.567 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:45.567 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa3727082eb] 2024-09-12T17:59:45.567 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa37270849f] 2024-09-12T17:59:45.567 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55780350e0c1] 2024-09-12T17:59:45.567 INFO:tasks.workunit.client.0.smithi098.stderr: 4: radosgw-admin(+0x14100ec) [0x557803f640ec] 2024-09-12T17:59:45.567 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55780352018d] 2024-09-12T17:59:45.567 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T17:59:45.567 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa37156ed90] 2024-09-12T17:59:45.568 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T17:59:45.568 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T17:59:45.568 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.561+0000 7fa36ee2e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa36ee2e9c0 time 2024-09-12T17:59:45.567011+0000 2024-09-12T17:59:45.568 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:59:45.568 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.568 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:45.568 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa3727082eb] 2024-09-12T17:59:45.568 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa37270849f] 2024-09-12T17:59:45.568 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55780350e0c1] 2024-09-12T17:59:45.568 INFO:tasks.workunit.client.0.smithi098.stderr: 4: radosgw-admin(+0x14100ec) [0x557803f640ec] 2024-09-12T17:59:45.568 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55780352018d] 2024-09-12T17:59:45.568 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T17:59:45.569 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa37156ed90] 2024-09-12T17:59:45.569 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T17:59:45.569 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T17:59:45.569 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.569 INFO:tasks.workunit.client.0.smithi098.stderr:*** Caught signal (Aborted) ** 2024-09-12T17:59:45.569 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7fa36ee2e9c0 thread_name:radosgw-admin 2024-09-12T17:59:45.589 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:45.589 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa371587520] 2024-09-12T17:59:45.590 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:59:45.590 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:59:45.590 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:59:45.590 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa372708345] 2024-09-12T17:59:45.590 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa37270849f] 2024-09-12T17:59:45.590 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55780350e0c1] 2024-09-12T17:59:45.590 INFO:tasks.workunit.client.0.smithi098.stderr: 8: radosgw-admin(+0x14100ec) [0x557803f640ec] 2024-09-12T17:59:45.590 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55780352018d] 2024-09-12T17:59:45.590 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T17:59:45.590 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa37156ed90] 2024-09-12T17:59:45.590 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T17:59:45.590 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T17:59:45.591 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.565+0000 7fa36ee2e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:59:45.591 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7fa36ee2e9c0 thread_name:radosgw-admin 2024-09-12T17:59:45.591 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.591 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:45.591 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa371587520] 2024-09-12T17:59:45.591 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:59:45.591 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:59:45.591 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:59:45.591 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa372708345] 2024-09-12T17:59:45.591 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa37270849f] 2024-09-12T17:59:45.591 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55780350e0c1] 2024-09-12T17:59:45.591 INFO:tasks.workunit.client.0.smithi098.stderr: 8: radosgw-admin(+0x14100ec) [0x557803f640ec] 2024-09-12T17:59:45.591 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55780352018d] 2024-09-12T17:59:45.592 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T17:59:45.592 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa37156ed90] 2024-09-12T17:59:45.592 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T17:59:45.592 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T17:59:45.592 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:59:45.592 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.592 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T17:59:45.592 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T17:59:45.473+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:45.592 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T17:59:45.473+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:45.592 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T17:59:45.473+0000 7fa36c934640 10 monclient(hunting): handle_auth_done global_id 7824 payload 274 2024-09-12T17:59:45.592 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T17:59:45.473+0000 7fa36c934640 10 monclient: _finish_hunting 0 2024-09-12T17:59:45.592 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T17:59:45.473+0000 7fa36c934640 1 monclient: found mon.noname-a 2024-09-12T17:59:45.593 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T17:59:45.473+0000 7fa36c934640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:59:45.593 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T17:59:45.473+0000 7fa25ae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:45.593 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T17:59:45.473+0000 7fa25ae0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:59:45.593 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T17:59:45.473+0000 7fa25ae0d640 10 monclient: dump: 2024-09-12T17:59:45.593 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:45.593 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:45.593 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.593 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.593 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:45.593 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.593 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:45.593 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:45.593 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:45.594 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.594 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T17:59:45.473+0000 7fa25ae0d640 10 monclient: _finish_auth 0 2024-09-12T17:59:45.594 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T17:59:45.473+0000 7fa25ae0d640 10 monclient: _check_auth_tickets 2024-09-12T17:59:45.594 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T17:59:45.473+0000 7fa25ae0d640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:45.594 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T17:59:45.473+0000 7fa36ee2e9c0 5 monclient: authenticate success, global_id 7824 2024-09-12T17:59:45.594 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T17:59:45.473+0000 7fa36ee2e9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:59:45.594 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T17:59:45.473+0000 7fa36ee2e9c0 4 set_mon_vals no callback set 2024-09-12T17:59:45.594 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T17:59:45.473+0000 7fa25ae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:45.594 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T17:59:45.473+0000 7fa25ae0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:59:45.594 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T17:59:45.473+0000 7fa25ae0d640 10 monclient: dump: 2024-09-12T17:59:45.594 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:45.594 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:45.594 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.594 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.595 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:45.595 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.595 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:45.595 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:45.595 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:45.595 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.595 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T17:59:45.473+0000 7fa36ee2e9c0 10 monclient: shutdown 2024-09-12T17:59:45.595 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T17:59:45.473+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) unregister_commands rotate-key 2024-09-12T17:59:45.595 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient: build_initial_monmap 2024-09-12T17:59:45.595 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 1 build_initial for_mkfs: 0 2024-09-12T17:59:45.595 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient: monmap: 2024-09-12T17:59:45.595 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:59:45.595 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:45.595 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:59:45.596 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:59:45.596 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:45.596 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.596 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:59:45.596 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:59:45.596 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:59:45.596 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.596 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding auth protocol: cephx 2024-09-12T17:59:45.596 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding auth protocol: cephx 2024-09-12T17:59:45.596 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding auth protocol: cephx 2024-09-12T17:59:45.596 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: secure 2024-09-12T17:59:45.596 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: crc 2024-09-12T17:59:45.597 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: secure 2024-09-12T17:59:45.597 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: crc 2024-09-12T17:59:45.597 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: secure 2024-09-12T17:59:45.597 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: crc 2024-09-12T17:59:45.597 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: crc 2024-09-12T17:59:45.597 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: secure 2024-09-12T17:59:45.597 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: crc 2024-09-12T17:59:45.597 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: secure 2024-09-12T17:59:45.597 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: crc 2024-09-12T17:59:45.597 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: secure 2024-09-12T17:59:45.597 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.597 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 1 librados: starting msgr at 2024-09-12T17:59:45.597 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 1 librados: starting objecter 2024-09-12T17:59:45.597 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command objecter_requests hook 0x5578055c2b70 2024-09-12T17:59:45.598 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 1 librados: setting wanted keys 2024-09-12T17:59:45.598 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 1 librados: calling monclient init 2024-09-12T17:59:45.598 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient: init 2024-09-12T17:59:45.598 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding auth protocol: cephx 2024-09-12T17:59:45.598 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding auth protocol: cephx 2024-09-12T17:59:45.598 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding auth protocol: cephx 2024-09-12T17:59:45.598 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: secure 2024-09-12T17:59:45.598 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: crc 2024-09-12T17:59:45.598 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: secure 2024-09-12T17:59:45.598 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: crc 2024-09-12T17:59:45.598 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: secure 2024-09-12T17:59:45.598 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: crc 2024-09-12T17:59:45.598 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: crc 2024-09-12T17:59:45.598 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: secure 2024-09-12T17:59:45.599 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: crc 2024-09-12T17:59:45.599 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: secure 2024-09-12T17:59:45.599 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: crc 2024-09-12T17:59:45.599 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: secure 2024-09-12T17:59:45.599 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.599 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.599 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command rotate-key hook 0x5578055916e8 2024-09-12T17:59:45.599 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:59:45.599 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:59:45.599 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-b con 0x55780541e840 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:59:45.599 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-c con 0x5578054d99c0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:59:45.599 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-a con 0x5578055948a0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:59:45.599 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.600 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.600 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.600 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:59:45.600 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient(hunting): authenticate will time out at 2782.049156s 2024-09-12T17:59:45.600 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T17:59:45.477+0000 7fa36c133640 10 monclient(hunting): get_auth_request con 0x5578054d99c0 auth_method 0 2024-09-12T17:59:45.600 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T17:59:45.477+0000 7fa36c133640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:45.600 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T17:59:45.477+0000 7fa36c133640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:45.600 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T17:59:45.477+0000 7fa36c133640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:45.600 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T17:59:45.477+0000 7fa36d135640 10 monclient(hunting): get_auth_request con 0x5578055948a0 auth_method 0 2024-09-12T17:59:45.600 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T17:59:45.477+0000 7fa36d135640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:45.600 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T17:59:45.477+0000 7fa36d135640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:45.600 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T17:59:45.477+0000 7fa36d135640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:45.600 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T17:59:45.477+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:45.601 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T17:59:45.477+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:45.601 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T17:59:45.477+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:45.601 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T17:59:45.477+0000 7fa36d135640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:45.601 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T17:59:45.477+0000 7fa36d135640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:45.601 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T17:59:45.477+0000 7fa36d135640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:45.601 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T17:59:45.477+0000 7fa36c133640 10 monclient(hunting): handle_auth_done global_id 7220 payload 824 2024-09-12T17:59:45.601 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T17:59:45.477+0000 7fa36c133640 10 monclient: _finish_hunting 0 2024-09-12T17:59:45.601 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T17:59:45.477+0000 7fa36c133640 1 monclient: found mon.noname-c 2024-09-12T17:59:45.601 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T17:59:45.477+0000 7fa36c133640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:59:45.601 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T17:59:45.477+0000 7fa36c934640 10 monclient: get_auth_request con 0x55780541e840 auth_method 0 2024-09-12T17:59:45.601 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T17:59:45.477+0000 7fa25960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:45.601 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T17:59:45.477+0000 7fa25960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:59:45.601 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T17:59:45.477+0000 7fa25960a640 10 monclient: dump: 2024-09-12T17:59:45.602 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:45.602 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:45.602 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.602 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.602 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:45.602 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.602 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:45.602 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:45.602 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:45.602 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.602 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T17:59:45.477+0000 7fa25960a640 10 monclient: _finish_auth 0 2024-09-12T17:59:45.602 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T17:59:45.477+0000 7fa25960a640 10 monclient: _check_auth_tickets 2024-09-12T17:59:45.602 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T17:59:45.477+0000 7fa25960a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:45.602 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T17:59:45.477+0000 7fa25960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:45.603 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T17:59:45.477+0000 7fa25960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:59:45.603 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T17:59:45.477+0000 7fa25960a640 10 monclient: dump: 2024-09-12T17:59:45.603 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:45.603 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:45.603 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.603 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.603 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:45.603 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.603 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:45.603 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:45.603 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:45.603 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.603 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 monclient: authenticate success, global_id 7220 2024-09-12T17:59:45.603 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient: _renew_subs 2024-09-12T17:59:45.604 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:45.604 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T17:59:45.477+0000 7fa25ae0d640 4 set_mon_vals no callback set 2024-09-12T17:59:45.604 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient: _renew_subs 2024-09-12T17:59:45.604 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:45.604 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 1 librados: init done 2024-09-12T17:59:45.604 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T17:59:45.477+0000 7fa25960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:45.604 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T17:59:45.481+0000 7fa25960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:45.604 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T17:59:45.481+0000 7fa25960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:45.604 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T17:59:45.481+0000 7fa36c934640 10 monclient: get_auth_request con 0x7fa254070ae0 auth_method 0 2024-09-12T17:59:45.604 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T17:59:45.481+0000 7fa36d135640 10 monclient: get_auth_request con 0x5578055d0f20 auth_method 0 2024-09-12T17:59:45.604 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T17:59:45.481+0000 7fa36c934640 10 monclient: get_auth_request con 0x5578055dca10 auth_method 0 2024-09-12T17:59:45.604 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient: get_auth_request con 0x5578055e0300 auth_method 0 2024-09-12T17:59:45.604 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient: build_initial_monmap 2024-09-12T17:59:45.605 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 1 build_initial for_mkfs: 0 2024-09-12T17:59:45.605 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient: monmap: 2024-09-12T17:59:45.605 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:59:45.605 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:45.605 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:59:45.605 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:59:45.605 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:45.605 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.605 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:59:45.605 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:59:45.605 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:59:45.606 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.606 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding auth protocol: cephx 2024-09-12T17:59:45.606 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding auth protocol: cephx 2024-09-12T17:59:45.606 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding auth protocol: cephx 2024-09-12T17:59:45.606 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: secure 2024-09-12T17:59:45.606 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: crc 2024-09-12T17:59:45.606 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: secure 2024-09-12T17:59:45.606 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: crc 2024-09-12T17:59:45.606 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: secure 2024-09-12T17:59:45.606 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: crc 2024-09-12T17:59:45.606 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: crc 2024-09-12T17:59:45.606 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: secure 2024-09-12T17:59:45.607 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: crc 2024-09-12T17:59:45.607 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: secure 2024-09-12T17:59:45.607 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: crc 2024-09-12T17:59:45.607 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: secure 2024-09-12T17:59:45.607 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.607 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command objecter_requests cmddesc objecter_requests hook 0x5578055e95c0 EEXIST 2024-09-12T17:59:45.607 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient: init 2024-09-12T17:59:45.607 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding auth protocol: cephx 2024-09-12T17:59:45.607 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding auth protocol: cephx 2024-09-12T17:59:45.607 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding auth protocol: cephx 2024-09-12T17:59:45.607 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: secure 2024-09-12T17:59:45.607 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: crc 2024-09-12T17:59:45.607 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: secure 2024-09-12T17:59:45.607 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: crc 2024-09-12T17:59:45.608 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: secure 2024-09-12T17:59:45.608 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: crc 2024-09-12T17:59:45.608 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: crc 2024-09-12T17:59:45.608 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: secure 2024-09-12T17:59:45.608 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: crc 2024-09-12T17:59:45.608 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: secure 2024-09-12T17:59:45.608 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: crc 2024-09-12T17:59:45.608 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: secure 2024-09-12T17:59:45.608 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.608 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.608 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command rotate-key cmddesc rotate-key hook 0x5578055e4cf0 EEXIST 2024-09-12T17:59:45.608 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:59:45.609 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:59:45.609 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-a con 0x55780560d770 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:59:45.609 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-c con 0x55780560d0a0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:59:45.609 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-b con 0x55780560ba80 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:59:45.609 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.609 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.609 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.609 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:59:45.609 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient(hunting): authenticate will time out at 2782.058982s 2024-09-12T17:59:45.609 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T17:59:45.485+0000 7fa36c934640 10 monclient(hunting): get_auth_request con 0x55780560d770 auth_method 0 2024-09-12T17:59:45.609 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T17:59:45.485+0000 7fa36c934640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:45.609 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T17:59:45.485+0000 7fa36c934640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:45.609 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T17:59:45.485+0000 7fa36c934640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:45.610 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient(hunting): get_auth_request con 0x55780560d0a0 auth_method 0 2024-09-12T17:59:45.610 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:45.610 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:45.610 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:45.610 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T17:59:45.485+0000 7fa36c934640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:45.610 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T17:59:45.485+0000 7fa36c934640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:45.610 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T17:59:45.485+0000 7fa36c934640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:45.610 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:45.610 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:45.610 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:45.610 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T17:59:45.485+0000 7fa36d135640 10 monclient(hunting): get_auth_request con 0x55780560ba80 auth_method 0 2024-09-12T17:59:45.610 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T17:59:45.485+0000 7fa36d135640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:45.610 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T17:59:45.485+0000 7fa36d135640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:45.611 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T17:59:45.485+0000 7fa36d135640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:45.611 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient(hunting): handle_auth_done global_id 7223 payload 824 2024-09-12T17:59:45.611 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient: _finish_hunting 0 2024-09-12T17:59:45.611 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T17:59:45.485+0000 7fa36c133640 1 monclient: found mon.noname-c 2024-09-12T17:59:45.611 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:59:45.611 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T17:59:45.485+0000 7fa2527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:45.611 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T17:59:45.485+0000 7fa2527fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:59:45.611 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T17:59:45.485+0000 7fa2527fc640 10 monclient: dump: 2024-09-12T17:59:45.611 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:45.611 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:45.611 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.611 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.611 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:45.612 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.612 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:45.612 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:45.612 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:45.612 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.612 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T17:59:45.485+0000 7fa2527fc640 10 monclient: _finish_auth 0 2024-09-12T17:59:45.612 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T17:59:45.485+0000 7fa2527fc640 10 monclient: _check_auth_tickets 2024-09-12T17:59:45.612 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T17:59:45.485+0000 7fa2527fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:45.612 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T17:59:45.485+0000 7fa2527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:45.612 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T17:59:45.485+0000 7fa2527fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:59:45.612 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T17:59:45.485+0000 7fa2527fc640 10 monclient: dump: 2024-09-12T17:59:45.612 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:45.612 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:45.613 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.613 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.613 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:45.613 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.613 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:45.613 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:45.613 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:45.613 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.613 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T17:59:45.485+0000 7fa36d936640 4 set_mon_vals no callback set 2024-09-12T17:59:45.613 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 monclient: authenticate success, global_id 7223 2024-09-12T17:59:45.613 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: _renew_subs 2024-09-12T17:59:45.613 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:45.614 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: _renew_subs 2024-09-12T17:59:45.614 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:45.614 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T17:59:45.489+0000 7fa2527fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:45.614 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T17:59:45.489+0000 7fa2527fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:45.614 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T17:59:45.489+0000 7fa2527fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:45.614 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: get_monmap_and_config 2024-09-12T17:59:45.614 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: build_initial_monmap 2024-09-12T17:59:45.614 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 1 build_initial for_mkfs: 0 2024-09-12T17:59:45.614 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: monmap: 2024-09-12T17:59:45.614 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:59:45.614 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:45.614 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:59:45.614 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:59:45.615 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:45.615 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.615 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:59:45.615 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:59:45.615 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:59:45.615 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.615 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding auth protocol: cephx 2024-09-12T17:59:45.615 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding auth protocol: cephx 2024-09-12T17:59:45.615 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding auth protocol: cephx 2024-09-12T17:59:45.615 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: secure 2024-09-12T17:59:45.615 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: crc 2024-09-12T17:59:45.615 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: secure 2024-09-12T17:59:45.616 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: crc 2024-09-12T17:59:45.616 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: secure 2024-09-12T17:59:45.616 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: crc 2024-09-12T17:59:45.616 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: crc 2024-09-12T17:59:45.616 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: secure 2024-09-12T17:59:45.616 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: crc 2024-09-12T17:59:45.616 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: secure 2024-09-12T17:59:45.616 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: crc 2024-09-12T17:59:45.616 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: secure 2024-09-12T17:59:45.616 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient: get_auth_request con 0x7fa244070a20 auth_method 0 2024-09-12T17:59:45.616 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.616 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: init 2024-09-12T17:59:45.616 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding auth protocol: cephx 2024-09-12T17:59:45.617 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding auth protocol: cephx 2024-09-12T17:59:45.617 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding auth protocol: cephx 2024-09-12T17:59:45.617 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: secure 2024-09-12T17:59:45.617 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: crc 2024-09-12T17:59:45.617 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: secure 2024-09-12T17:59:45.617 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: crc 2024-09-12T17:59:45.617 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: secure 2024-09-12T17:59:45.617 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: crc 2024-09-12T17:59:45.617 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: crc 2024-09-12T17:59:45.617 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: secure 2024-09-12T17:59:45.617 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: crc 2024-09-12T17:59:45.617 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: secure 2024-09-12T17:59:45.617 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: crc 2024-09-12T17:59:45.617 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: secure 2024-09-12T17:59:45.618 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.618 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.618 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd87617bb8 EEXIST 2024-09-12T17:59:45.618 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:59:45.618 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:59:45.618 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-a con 0x5578056612b0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:59:45.618 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-b con 0x55780565c6f0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:59:45.618 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-c con 0x557805652ef0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:59:45.618 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.618 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.618 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.618 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:59:45.619 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient(hunting): authenticate will time out at 2782.063111s 2024-09-12T17:59:45.619 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient(hunting): get_auth_request con 0x5578056612b0 auth_method 0 2024-09-12T17:59:45.619 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:45.619 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:45.619 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:45.619 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T17:59:45.489+0000 7fa36d135640 10 monclient(hunting): get_auth_request con 0x557805652ef0 auth_method 0 2024-09-12T17:59:45.619 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T17:59:45.489+0000 7fa36d135640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:45.619 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T17:59:45.489+0000 7fa36d135640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:45.619 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T17:59:45.489+0000 7fa36d135640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:45.619 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:45.619 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:45.619 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:45.619 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T17:59:45.489+0000 7fa36d135640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:45.619 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T17:59:45.489+0000 7fa36d135640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:45.620 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T17:59:45.489+0000 7fa36d135640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:45.620 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient(hunting): handle_auth_done global_id 7833 payload 274 2024-09-12T17:59:45.620 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient: _finish_hunting 0 2024-09-12T17:59:45.620 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T17:59:45.489+0000 7fa36c934640 1 monclient: found mon.noname-a 2024-09-12T17:59:45.620 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:59:45.620 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T17:59:45.489+0000 7fa243fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:45.620 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T17:59:45.489+0000 7fa243fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:59:45.620 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T17:59:45.489+0000 7fa243fff640 10 monclient: dump: 2024-09-12T17:59:45.620 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:45.620 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:45.620 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.620 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.620 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:45.620 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.621 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:45.621 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:45.621 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:45.621 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.621 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T17:59:45.489+0000 7fa243fff640 10 monclient: _finish_auth 0 2024-09-12T17:59:45.621 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T17:59:45.489+0000 7fa243fff640 10 monclient: _check_auth_tickets 2024-09-12T17:59:45.621 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T17:59:45.489+0000 7fa243fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:45.621 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 monclient: authenticate success, global_id 7833 2024-09-12T17:59:45.621 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:59:45.621 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 4 set_mon_vals no callback set 2024-09-12T17:59:45.621 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T17:59:45.489+0000 7fa243fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:45.621 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T17:59:45.489+0000 7fa243fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:59:45.621 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T17:59:45.489+0000 7fa243fff640 10 monclient: dump: 2024-09-12T17:59:45.622 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:45.622 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:45.622 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.622 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.622 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:45.622 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.622 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:45.622 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:45.622 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:45.622 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.622 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient: shutdown 2024-09-12T17:59:45.622 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient: build_initial_monmap 2024-09-12T17:59:45.622 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 1 build_initial for_mkfs: 0 2024-09-12T17:59:45.623 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient: monmap: 2024-09-12T17:59:45.623 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:59:45.623 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:45.623 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:59:45.623 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:59:45.623 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:45.623 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.623 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:59:45.623 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:59:45.623 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:59:45.623 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.623 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding auth protocol: cephx 2024-09-12T17:59:45.623 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding auth protocol: cephx 2024-09-12T17:59:45.624 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding auth protocol: cephx 2024-09-12T17:59:45.624 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: secure 2024-09-12T17:59:45.624 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: crc 2024-09-12T17:59:45.624 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: secure 2024-09-12T17:59:45.624 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: crc 2024-09-12T17:59:45.624 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: secure 2024-09-12T17:59:45.624 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: crc 2024-09-12T17:59:45.624 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: crc 2024-09-12T17:59:45.624 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: secure 2024-09-12T17:59:45.624 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: crc 2024-09-12T17:59:45.624 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: secure 2024-09-12T17:59:45.624 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: crc 2024-09-12T17:59:45.624 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: secure 2024-09-12T17:59:45.625 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.625 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 1 librados: starting msgr at 2024-09-12T17:59:45.625 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 1 librados: starting objecter 2024-09-12T17:59:45.625 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command objecter_requests cmddesc objecter_requests hook 0x557805633160 EEXIST 2024-09-12T17:59:45.625 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 1 librados: setting wanted keys 2024-09-12T17:59:45.625 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 1 librados: calling monclient init 2024-09-12T17:59:45.625 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient: init 2024-09-12T17:59:45.625 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding auth protocol: cephx 2024-09-12T17:59:45.625 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding auth protocol: cephx 2024-09-12T17:59:45.625 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding auth protocol: cephx 2024-09-12T17:59:45.625 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: secure 2024-09-12T17:59:45.625 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: crc 2024-09-12T17:59:45.625 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: secure 2024-09-12T17:59:45.625 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: crc 2024-09-12T17:59:45.626 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: secure 2024-09-12T17:59:45.626 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: crc 2024-09-12T17:59:45.626 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: crc 2024-09-12T17:59:45.626 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: secure 2024-09-12T17:59:45.626 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: crc 2024-09-12T17:59:45.626 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: secure 2024-09-12T17:59:45.626 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: crc 2024-09-12T17:59:45.626 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: secure 2024-09-12T17:59:45.626 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.626 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.626 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command rotate-key cmddesc rotate-key hook 0x55780560f6d8 EEXIST 2024-09-12T17:59:45.626 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:59:45.627 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:59:45.627 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-c con 0x557805652ef0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:59:45.627 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-a con 0x55780565c6f0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:59:45.627 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-b con 0x5578056612b0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:59:45.627 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.627 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.627 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.627 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:59:45.627 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient(hunting): authenticate will time out at 2782.065714s 2024-09-12T17:59:45.627 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T17:59:45.493+0000 7fa36c934640 10 monclient(hunting): get_auth_request con 0x557805652ef0 auth_method 0 2024-09-12T17:59:45.627 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T17:59:45.493+0000 7fa36c934640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:45.627 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T17:59:45.493+0000 7fa36c934640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:45.628 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T17:59:45.493+0000 7fa36c934640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:45.628 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T17:59:45.493+0000 7fa36c133640 10 monclient(hunting): get_auth_request con 0x55780565c6f0 auth_method 0 2024-09-12T17:59:45.628 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T17:59:45.493+0000 7fa36c133640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:45.628 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T17:59:45.493+0000 7fa36c133640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:45.628 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T17:59:45.493+0000 7fa36c133640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:45.628 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T17:59:45.493+0000 7fa36c934640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:45.628 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T17:59:45.493+0000 7fa36c934640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:45.628 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T17:59:45.493+0000 7fa36c934640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:45.628 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T17:59:45.493+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:45.628 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T17:59:45.493+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:45.628 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T17:59:45.493+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:45.628 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T17:59:45.493+0000 7fa36c934640 10 monclient(hunting): handle_auth_done global_id 7229 payload 824 2024-09-12T17:59:45.629 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T17:59:45.493+0000 7fa36c934640 10 monclient: _finish_hunting 0 2024-09-12T17:59:45.629 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T17:59:45.493+0000 7fa36c934640 1 monclient: found mon.noname-c 2024-09-12T17:59:45.629 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T17:59:45.493+0000 7fa36c934640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:59:45.629 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T17:59:45.493+0000 7fa2427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:45.629 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T17:59:45.493+0000 7fa2427fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:59:45.629 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T17:59:45.493+0000 7fa2427fc640 10 monclient: dump: 2024-09-12T17:59:45.629 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:45.629 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:45.629 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.629 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.629 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:45.629 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.629 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:45.629 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:45.630 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:45.630 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.630 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T17:59:45.493+0000 7fa2427fc640 10 monclient: _finish_auth 0 2024-09-12T17:59:45.630 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T17:59:45.493+0000 7fa2427fc640 10 monclient: _check_auth_tickets 2024-09-12T17:59:45.630 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T17:59:45.493+0000 7fa2427fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:45.630 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T17:59:45.493+0000 7fa2427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:45.630 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T17:59:45.493+0000 7fa2427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:59:45.630 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T17:59:45.493+0000 7fa2427fc640 10 monclient: dump: 2024-09-12T17:59:45.630 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:45.630 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:45.630 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.630 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.630 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:45.631 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.631 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:45.631 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:45.631 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:45.631 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.631 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 monclient: authenticate success, global_id 7229 2024-09-12T17:59:45.631 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient: _renew_subs 2024-09-12T17:59:45.631 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T17:59:45.493+0000 7fa243fff640 4 set_mon_vals no callback set 2024-09-12T17:59:45.631 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:45.631 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient: _renew_subs 2024-09-12T17:59:45.631 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:45.631 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 1 librados: init done 2024-09-12T17:59:45.631 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command cr dump hook 0x557805656a68 2024-09-12T17:59:45.631 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.632 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T17:59:45.497+0000 7fa2427fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:45.632 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T17:59:45.497+0000 7fa2427fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:45.632 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T17:59:45.497+0000 7fa2427fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:45.632 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T17:59:45.497+0000 7fa36c133640 10 monclient: get_auth_request con 0x7fa238070ae0 auth_method 0 2024-09-12T17:59:45.632 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T17:59:45.497+0000 7fa36d135640 10 monclient: get_auth_request con 0x55780567abd0 auth_method 0 2024-09-12T17:59:45.632 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.632 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 realm 2024-09-12T17:59:45.632 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.632 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.632 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:45.632 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.632 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.632 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.632 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T17:59:45.497+0000 7fa36c934640 10 monclient: get_auth_request con 0x55780567eee0 auth_method 0 2024-09-12T17:59:45.633 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:45.633 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.633 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T17:59:45.501+0000 7fa36ee2e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:45.633 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T17:59:45.501+0000 7fa36ee2e9c0 20 searching for the correct realm 2024-09-12T17:59:45.633 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T17:59:45.501+0000 7fa36c133640 10 monclient: get_auth_request con 0x557805684030 auth_method 0 2024-09-12T17:59:45.633 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T17:59:45.501+0000 7fa36d135640 10 monclient: get_auth_request con 0x7fa36010c040 auth_method 0 2024-09-12T17:59:45.633 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T17:59:45.501+0000 7fa36c934640 10 monclient: get_auth_request con 0x7fa364023bb0 auth_method 0 2024-09-12T17:59:45.633 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T17:59:45.501+0000 7fa36c133640 10 monclient: get_auth_request con 0x7fa35c019040 auth_method 0 2024-09-12T17:59:45.633 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T17:59:45.505+0000 7fa36d135640 0 -- 172.21.15.98:0/3828057187 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55780567abd0 msgr2=0x55780567d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:45.633 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T17:59:45.505+0000 7fa2427fc640 1 client.7229.objecter ms_handle_reset 0x55780567abd0 session 0x55780567a500 osd.1 2024-09-12T17:59:45.633 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T17:59:45.505+0000 7fa2427fc640 10 monclient: _renew_subs 2024-09-12T17:59:45.633 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T17:59:45.505+0000 7fa2427fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:45.633 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T17:59:45.505+0000 7fa36d135640 10 monclient: get_auth_request con 0x7fa238081100 auth_method 0 2024-09-12T17:59:45.634 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T17:59:45.505+0000 7fa36d135640 10 monclient: get_auth_request con 0x7fa3600c0020 auth_method 0 2024-09-12T17:59:45.634 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T17:59:45.509+0000 7fa36c934640 10 monclient: get_auth_request con 0x7fa3600e9370 auth_method 0 2024-09-12T17:59:45.634 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T17:59:45.513+0000 7fa36c133640 0 -- 172.21.15.98:0/3828057187 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fa35c019040 msgr2=0x7fa35c072040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:45.634 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T17:59:45.513+0000 7fa2427fc640 1 client.7229.objecter ms_handle_reset 0x7fa35c019040 session 0x7fa35c03d270 osd.4 2024-09-12T17:59:45.634 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T17:59:45.513+0000 7fa36c133640 10 monclient: get_auth_request con 0x55780567abd0 auth_method 0 2024-09-12T17:59:45.634 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:45.634 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:45.634 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:45.634 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:45.634 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:45.634 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:45.634 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.634 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.635 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.635 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:45.635 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.635 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:45.635 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 zone default found 2024-09-12T17:59:45.635 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 4 Realm: () 2024-09-12T17:59:45.635 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:45.635 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:45.635 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:45.635 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 zonegroup default 2024-09-12T17:59:45.635 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.635 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.635 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.635 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.636 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.636 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.636 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 started sync module instance, tier type = 2024-09-12T17:59:45.636 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:45.636 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=0 2024-09-12T17:59:45.636 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=1 2024-09-12T17:59:45.636 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=2 2024-09-12T17:59:45.636 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=3 2024-09-12T17:59:45.636 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=4 2024-09-12T17:59:45.636 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=5 2024-09-12T17:59:45.636 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=6 2024-09-12T17:59:45.636 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=7 2024-09-12T17:59:45.637 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:45.637 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding auth protocol: cephx 2024-09-12T17:59:45.637 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding auth protocol: cephx 2024-09-12T17:59:45.637 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding auth protocol: cephx 2024-09-12T17:59:45.637 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: secure 2024-09-12T17:59:45.637 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: crc 2024-09-12T17:59:45.637 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: secure 2024-09-12T17:59:45.637 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: crc 2024-09-12T17:59:45.637 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: secure 2024-09-12T17:59:45.637 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: crc 2024-09-12T17:59:45.637 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: crc 2024-09-12T17:59:45.637 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: secure 2024-09-12T17:59:45.637 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: crc 2024-09-12T17:59:45.637 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: secure 2024-09-12T17:59:45.638 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T17:59:45.541+0000 7fa222fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:45.638 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: crc 2024-09-12T17:59:45.638 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: secure 2024-09-12T17:59:45.638 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.638 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:45.638 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:45.638 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command cache list hook 0x5578056548b0 2024-09-12T17:59:45.638 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command cache inspect hook 0x5578056548b0 2024-09-12T17:59:45.638 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command cache erase hook 0x5578056548b0 2024-09-12T17:59:45.638 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command cache zap hook 0x5578056548b0 2024-09-12T17:59:45.638 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 note: GC not initialized 2024-09-12T17:59:45.638 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T17:59:45.541+0000 7fa221fe3640 20 reqs_thread_entry: start 2024-09-12T17:59:45.638 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command sync trace show hook 0x7fa35c01d070 2024-09-12T17:59:45.638 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command sync trace history hook 0x7fa35c01d070 2024-09-12T17:59:45.639 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command sync trace active hook 0x7fa35c01d070 2024-09-12T17:59:45.639 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command sync trace active_short hook 0x7fa35c01d070 2024-09-12T17:59:45.639 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:45.639 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 Filter name: none 2024-09-12T17:59:45.639 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T17:59:45.541+0000 7fa1937fe640 20 reqs_thread_entry: start 2024-09-12T17:59:45.639 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:59:45.639 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.639 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:59:45.639 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:59:45.639 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:59:45.639 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 : miss 2024-09-12T17:59:45.639 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.639 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T17:59:45.545+0000 7fa36ee2e9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:59:45.640 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T17:59:45.545+0000 7fa36ee2e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 info.flags=0x17 2024-09-12T17:59:45.640 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T17:59:45.545+0000 7fa36ee2e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 to cache LRU end 2024-09-12T17:59:45.640 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T17:59:45.545+0000 7fa36ee2e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:45.640 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T17:59:45.545+0000 7fa36ee2e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:45.640 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T17:59:45.545+0000 7fa36ee2e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 2024-09-12T17:59:45.640 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T17:59:45.553+0000 7fa36ee2e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 info.flags=0x17 2024-09-12T17:59:45.640 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T17:59:45.553+0000 7fa36ee2e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 to cache LRU end 2024-09-12T17:59:45.640 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T17:59:45.553+0000 7fa36ee2e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:45.640 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T17:59:45.553+0000 7fa36ee2e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36, ofs0, ns] 2024-09-12T17:59:45.640 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T17:59:45.553+0000 7fa243fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366253 cookie 93973975167824 notifier 7229 bl.length()=923 2024-09-12T17:59:45.640 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T17:59:45.553+0000 7fa243fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 info.flags=0x17 2024-09-12T17:59:45.640 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T17:59:45.553+0000 7fa243fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 to cache LRU end 2024-09-12T17:59:45.640 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T17:59:45.553+0000 7fa243fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:45.641 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T17:59:45.557+0000 7fa36ee2e9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): orig_sources= new_sources= 2024-09-12T17:59:45.641 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T17:59:45.557+0000 7fa36ee2e9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): potential sources added=[] removed=[] 2024-09-12T17:59:45.641 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T17:59:45.557+0000 7fa36ee2e9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): orig_dests= new_dests= 2024-09-12T17:59:45.641 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T17:59:45.557+0000 7fa36ee2e9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): potential dests added=[] removed=[] 2024-09-12T17:59:45.641 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T17:59:45.561+0000 7fa36ee2e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa36ee2e9c0 time 2024-09-12T17:59:45.567011+0000 2024-09-12T17:59:45.641 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:59:45.641 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.641 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:45.641 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa3727082eb] 2024-09-12T17:59:45.641 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa37270849f] 2024-09-12T17:59:45.641 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55780350e0c1] 2024-09-12T17:59:45.641 INFO:tasks.workunit.client.0.smithi098.stderr: 4: radosgw-admin(+0x14100ec) [0x557803f640ec] 2024-09-12T17:59:45.641 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55780352018d] 2024-09-12T17:59:45.642 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T17:59:45.642 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa37156ed90] 2024-09-12T17:59:45.642 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T17:59:45.642 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T17:59:45.642 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.642 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T17:59:45.565+0000 7fa36ee2e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:59:45.642 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7fa36ee2e9c0 thread_name:radosgw-admin 2024-09-12T17:59:45.642 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.642 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:45.642 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa371587520] 2024-09-12T17:59:45.642 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:59:45.642 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:59:45.642 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:59:45.642 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa372708345] 2024-09-12T17:59:45.643 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa37270849f] 2024-09-12T17:59:45.643 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55780350e0c1] 2024-09-12T17:59:45.643 INFO:tasks.workunit.client.0.smithi098.stderr: 8: radosgw-admin(+0x14100ec) [0x557803f640ec] 2024-09-12T17:59:45.643 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55780352018d] 2024-09-12T17:59:45.643 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T17:59:45.643 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa37156ed90] 2024-09-12T17:59:45.643 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T17:59:45.643 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T17:59:45.643 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:59:45.643 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.643 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T17:59:45.643 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T17:59:45.643 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T17:59:45.643 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T17:59:45.644 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T17:59:45.644 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T17:59:45.644 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T17:59:45.644 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T17:59:45.644 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T17:59:45.644 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T17:59:45.644 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T17:59:45.644 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T17:59:45.644 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T17:59:45.644 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T17:59:45.644 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T17:59:45.644 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T17:59:45.644 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T17:59:45.645 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T17:59:45.645 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T17:59:45.645 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T17:59:45.645 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T17:59:45.645 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T17:59:45.645 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T17:59:45.645 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T17:59:45.645 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:59:45.645 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T17:59:45.645 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T17:59:45.645 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T17:59:45.645 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T17:59:45.645 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T17:59:45.645 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T17:59:45.646 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T17:59:45.646 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T17:59:45.646 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T17:59:45.646 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T17:59:45.646 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T17:59:45.646 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T17:59:45.646 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T17:59:45.646 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T17:59:45.646 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T17:59:45.646 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T17:59:45.646 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T17:59:45.646 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T17:59:45.646 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T17:59:45.646 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T17:59:45.647 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T17:59:45.647 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:59:45.647 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T17:59:45.647 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:59:45.647 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T17:59:45.647 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T17:59:45.647 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T17:59:45.647 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T17:59:45.647 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T17:59:45.647 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T17:59:45.647 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T17:59:45.647 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T17:59:45.647 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T17:59:45.647 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T17:59:45.648 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T17:59:45.648 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T17:59:45.648 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T17:59:45.648 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T17:59:45.648 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T17:59:45.648 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T17:59:45.648 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T17:59:45.648 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T17:59:45.648 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:59:45.648 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T17:59:45.648 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:59:45.648 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T17:59:45.648 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T17:59:45.649 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T17:59:45.649 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T17:59:45.649 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T17:59:45.649 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T17:59:45.649 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:59:45.649 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T17:59:45.649 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T17:59:45.649 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:59:45.649 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T17:59:45.649 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T17:59:45.649 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T17:59:45.649 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T17:59:45.649 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T17:59:45.649 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T17:59:45.650 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T17:59:45.650 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T17:59:45.650 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T17:59:45.650 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T17:59:45.650 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T17:59:45.650 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T17:59:45.650 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T17:59:45.650 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:59:45.650 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa1937fe640 / http_manager 2024-09-12T17:59:45.650 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa221fe3640 / http_manager 2024-09-12T17:59:45.650 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa222fe5640 / rgw_dt_lg_renew 2024-09-12T17:59:45.650 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa2427fc640 / ms_dispatch 2024-09-12T17:59:45.650 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa243fff640 / io_context_pool 2024-09-12T17:59:45.651 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa2527fc640 / ms_dispatch 2024-09-12T17:59:45.651 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa25960a640 / ms_dispatch 2024-09-12T17:59:45.651 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa25ae0d640 / io_context_pool 2024-09-12T17:59:45.651 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa36c133640 / msgr-worker-2 2024-09-12T17:59:45.651 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa36c934640 / msgr-worker-1 2024-09-12T17:59:45.651 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa36d135640 / msgr-worker-0 2024-09-12T17:59:45.651 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa36d936640 / io_context_pool 2024-09-12T17:59:45.651 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa36ee2e9c0 / radosgw-admin 2024-09-12T17:59:45.651 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T17:59:45.651 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T17:59:45.651 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/log/ceph/ceph-client.admin.126433.log 2024-09-12T17:59:45.651 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T17:59:45.651 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T17:59:45.651 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T17:59:45.473+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:45.652 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T17:59:45.473+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:45.652 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T17:59:45.473+0000 7fa36c934640 10 monclient(hunting): handle_auth_done global_id 7824 payload 274 2024-09-12T17:59:45.652 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T17:59:45.473+0000 7fa36c934640 10 monclient: _finish_hunting 0 2024-09-12T17:59:45.652 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T17:59:45.473+0000 7fa36c934640 1 monclient: found mon.noname-a 2024-09-12T17:59:45.652 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T17:59:45.473+0000 7fa36c934640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:59:45.652 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T17:59:45.473+0000 7fa25ae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:45.652 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T17:59:45.473+0000 7fa25ae0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:59:45.652 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T17:59:45.473+0000 7fa25ae0d640 10 monclient: dump: 2024-09-12T17:59:45.652 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:45.652 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:45.652 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.652 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.652 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:45.652 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.653 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:45.653 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:45.653 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:45.653 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.653 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T17:59:45.473+0000 7fa25ae0d640 10 monclient: _finish_auth 0 2024-09-12T17:59:45.653 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T17:59:45.473+0000 7fa25ae0d640 10 monclient: _check_auth_tickets 2024-09-12T17:59:45.653 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T17:59:45.473+0000 7fa25ae0d640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:45.653 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T17:59:45.473+0000 7fa36ee2e9c0 5 monclient: authenticate success, global_id 7824 2024-09-12T17:59:45.653 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T17:59:45.473+0000 7fa36ee2e9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:59:45.653 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T17:59:45.473+0000 7fa36ee2e9c0 4 set_mon_vals no callback set 2024-09-12T17:59:45.653 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T17:59:45.473+0000 7fa25ae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:45.653 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T17:59:45.473+0000 7fa25ae0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:59:45.653 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T17:59:45.473+0000 7fa25ae0d640 10 monclient: dump: 2024-09-12T17:59:45.654 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:45.654 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:45.654 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.654 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.654 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:45.654 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.654 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:45.654 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:45.654 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:45.654 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.654 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T17:59:45.473+0000 7fa36ee2e9c0 10 monclient: shutdown 2024-09-12T17:59:45.654 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T17:59:45.473+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) unregister_commands rotate-key 2024-09-12T17:59:45.654 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient: build_initial_monmap 2024-09-12T17:59:45.654 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 1 build_initial for_mkfs: 0 2024-09-12T17:59:45.654 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient: monmap: 2024-09-12T17:59:45.655 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:59:45.655 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:45.655 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:59:45.655 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:59:45.655 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:45.655 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.655 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:59:45.655 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:59:45.655 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:59:45.655 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.655 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding auth protocol: cephx 2024-09-12T17:59:45.655 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding auth protocol: cephx 2024-09-12T17:59:45.655 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding auth protocol: cephx 2024-09-12T17:59:45.656 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: secure 2024-09-12T17:59:45.656 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: crc 2024-09-12T17:59:45.656 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: secure 2024-09-12T17:59:45.656 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: crc 2024-09-12T17:59:45.656 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: secure 2024-09-12T17:59:45.656 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: crc 2024-09-12T17:59:45.656 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: crc 2024-09-12T17:59:45.656 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: secure 2024-09-12T17:59:45.656 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: crc 2024-09-12T17:59:45.656 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: secure 2024-09-12T17:59:45.656 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: crc 2024-09-12T17:59:45.656 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805596b30) adding con mode: secure 2024-09-12T17:59:45.656 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.657 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 1 librados: starting msgr at 2024-09-12T17:59:45.657 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 1 librados: starting objecter 2024-09-12T17:59:45.657 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command objecter_requests hook 0x5578055c2b70 2024-09-12T17:59:45.657 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 1 librados: setting wanted keys 2024-09-12T17:59:45.657 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 1 librados: calling monclient init 2024-09-12T17:59:45.657 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient: init 2024-09-12T17:59:45.657 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding auth protocol: cephx 2024-09-12T17:59:45.657 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding auth protocol: cephx 2024-09-12T17:59:45.657 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding auth protocol: cephx 2024-09-12T17:59:45.657 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: secure 2024-09-12T17:59:45.657 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: crc 2024-09-12T17:59:45.658 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: secure 2024-09-12T17:59:45.658 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: crc 2024-09-12T17:59:45.658 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: secure 2024-09-12T17:59:45.658 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: crc 2024-09-12T17:59:45.658 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: crc 2024-09-12T17:59:45.658 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: secure 2024-09-12T17:59:45.658 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: crc 2024-09-12T17:59:45.658 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: secure 2024-09-12T17:59:45.658 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: crc 2024-09-12T17:59:45.658 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055915a0) adding con mode: secure 2024-09-12T17:59:45.658 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.658 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.658 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command rotate-key hook 0x5578055916e8 2024-09-12T17:59:45.658 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:59:45.659 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T17:59:45.659 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-b con 0x55780541e840 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:59:45.659 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-c con 0x5578054d99c0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:59:45.659 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-a con 0x5578055948a0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:59:45.659 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.659 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.659 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.659 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:59:45.659 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient(hunting): authenticate will time out at 2782.049156s 2024-09-12T17:59:45.659 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T17:59:45.477+0000 7fa36c133640 10 monclient(hunting): get_auth_request con 0x5578054d99c0 auth_method 0 2024-09-12T17:59:45.659 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T17:59:45.477+0000 7fa36c133640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:45.659 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T17:59:45.477+0000 7fa36c133640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:45.659 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T17:59:45.477+0000 7fa36c133640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:45.660 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T17:59:45.477+0000 7fa36d135640 10 monclient(hunting): get_auth_request con 0x5578055948a0 auth_method 0 2024-09-12T17:59:45.660 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T17:59:45.477+0000 7fa36d135640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:45.660 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T17:59:45.477+0000 7fa36d135640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:45.660 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T17:59:45.477+0000 7fa36d135640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:45.660 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T17:59:45.477+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:45.660 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T17:59:45.477+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:45.660 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T17:59:45.477+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:45.660 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T17:59:45.477+0000 7fa36d135640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:45.660 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T17:59:45.477+0000 7fa36d135640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:45.660 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T17:59:45.477+0000 7fa36d135640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:45.660 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T17:59:45.477+0000 7fa36c133640 10 monclient(hunting): handle_auth_done global_id 7220 payload 824 2024-09-12T17:59:45.660 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T17:59:45.477+0000 7fa36c133640 10 monclient: _finish_hunting 0 2024-09-12T17:59:45.660 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T17:59:45.477+0000 7fa36c133640 1 monclient: found mon.noname-c 2024-09-12T17:59:45.661 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T17:59:45.477+0000 7fa36c133640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:59:45.661 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T17:59:45.477+0000 7fa36c934640 10 monclient: get_auth_request con 0x55780541e840 auth_method 0 2024-09-12T17:59:45.661 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T17:59:45.477+0000 7fa25960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:45.661 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T17:59:45.477+0000 7fa25960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:59:45.661 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T17:59:45.477+0000 7fa25960a640 10 monclient: dump: 2024-09-12T17:59:45.661 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:45.661 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:45.661 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.661 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.661 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:45.661 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.661 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:45.661 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:45.661 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:45.662 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.662 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T17:59:45.477+0000 7fa25960a640 10 monclient: _finish_auth 0 2024-09-12T17:59:45.662 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T17:59:45.477+0000 7fa25960a640 10 monclient: _check_auth_tickets 2024-09-12T17:59:45.662 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T17:59:45.477+0000 7fa25960a640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:45.662 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T17:59:45.477+0000 7fa25960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:45.662 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T17:59:45.477+0000 7fa25960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:59:45.662 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T17:59:45.477+0000 7fa25960a640 10 monclient: dump: 2024-09-12T17:59:45.662 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:45.662 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:45.662 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.662 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.662 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:45.662 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.662 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:45.663 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:45.663 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:45.663 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.663 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 5 monclient: authenticate success, global_id 7220 2024-09-12T17:59:45.663 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient: _renew_subs 2024-09-12T17:59:45.663 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:45.663 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T17:59:45.477+0000 7fa25ae0d640 4 set_mon_vals no callback set 2024-09-12T17:59:45.663 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient: _renew_subs 2024-09-12T17:59:45.663 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:45.663 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T17:59:45.477+0000 7fa36ee2e9c0 1 librados: init done 2024-09-12T17:59:45.663 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T17:59:45.477+0000 7fa25960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:45.663 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T17:59:45.481+0000 7fa25960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:45.663 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T17:59:45.481+0000 7fa25960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:45.663 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T17:59:45.481+0000 7fa36c934640 10 monclient: get_auth_request con 0x7fa254070ae0 auth_method 0 2024-09-12T17:59:45.664 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T17:59:45.481+0000 7fa36d135640 10 monclient: get_auth_request con 0x5578055d0f20 auth_method 0 2024-09-12T17:59:45.664 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T17:59:45.481+0000 7fa36c934640 10 monclient: get_auth_request con 0x5578055dca10 auth_method 0 2024-09-12T17:59:45.664 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient: get_auth_request con 0x5578055e0300 auth_method 0 2024-09-12T17:59:45.664 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient: build_initial_monmap 2024-09-12T17:59:45.664 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 1 build_initial for_mkfs: 0 2024-09-12T17:59:45.664 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient: monmap: 2024-09-12T17:59:45.664 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:59:45.664 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:45.664 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:59:45.664 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:59:45.664 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:45.664 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.664 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:59:45.665 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:59:45.665 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:59:45.665 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.665 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding auth protocol: cephx 2024-09-12T17:59:45.665 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding auth protocol: cephx 2024-09-12T17:59:45.665 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding auth protocol: cephx 2024-09-12T17:59:45.665 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: secure 2024-09-12T17:59:45.665 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: crc 2024-09-12T17:59:45.665 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: secure 2024-09-12T17:59:45.665 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: crc 2024-09-12T17:59:45.665 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: secure 2024-09-12T17:59:45.665 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: crc 2024-09-12T17:59:45.665 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: crc 2024-09-12T17:59:45.665 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: secure 2024-09-12T17:59:45.666 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: crc 2024-09-12T17:59:45.666 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: secure 2024-09-12T17:59:45.666 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: crc 2024-09-12T17:59:45.666 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e5b50) adding con mode: secure 2024-09-12T17:59:45.666 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.666 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command objecter_requests cmddesc objecter_requests hook 0x5578055e95c0 EEXIST 2024-09-12T17:59:45.666 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient: init 2024-09-12T17:59:45.666 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding auth protocol: cephx 2024-09-12T17:59:45.666 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding auth protocol: cephx 2024-09-12T17:59:45.666 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding auth protocol: cephx 2024-09-12T17:59:45.666 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: secure 2024-09-12T17:59:45.666 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: crc 2024-09-12T17:59:45.666 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: secure 2024-09-12T17:59:45.667 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: crc 2024-09-12T17:59:45.667 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: secure 2024-09-12T17:59:45.667 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: crc 2024-09-12T17:59:45.667 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: crc 2024-09-12T17:59:45.667 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: secure 2024-09-12T17:59:45.667 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: crc 2024-09-12T17:59:45.667 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: secure 2024-09-12T17:59:45.667 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: crc 2024-09-12T17:59:45.667 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 AuthRegistry(0x5578055e4ba8) adding con mode: secure 2024-09-12T17:59:45.667 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.667 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.667 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command rotate-key cmddesc rotate-key hook 0x5578055e4cf0 EEXIST 2024-09-12T17:59:45.667 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:59:45.667 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T17:59:45.668 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-a con 0x55780560d770 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:59:45.668 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-c con 0x55780560d0a0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:59:45.668 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-b con 0x55780560ba80 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:59:45.668 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.668 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.668 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.668 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:59:45.668 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T17:59:45.485+0000 7fa36ee2e9c0 10 monclient(hunting): authenticate will time out at 2782.058982s 2024-09-12T17:59:45.668 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T17:59:45.485+0000 7fa36c934640 10 monclient(hunting): get_auth_request con 0x55780560d770 auth_method 0 2024-09-12T17:59:45.668 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T17:59:45.485+0000 7fa36c934640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:45.668 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T17:59:45.485+0000 7fa36c934640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:45.668 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T17:59:45.485+0000 7fa36c934640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:45.668 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient(hunting): get_auth_request con 0x55780560d0a0 auth_method 0 2024-09-12T17:59:45.669 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:45.669 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:45.669 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:45.669 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T17:59:45.485+0000 7fa36c934640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:45.669 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T17:59:45.485+0000 7fa36c934640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:45.669 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T17:59:45.485+0000 7fa36c934640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:45.669 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:45.669 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:45.669 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:45.669 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T17:59:45.485+0000 7fa36d135640 10 monclient(hunting): get_auth_request con 0x55780560ba80 auth_method 0 2024-09-12T17:59:45.670 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T17:59:45.485+0000 7fa36d135640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:45.670 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T17:59:45.485+0000 7fa36d135640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:45.670 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T17:59:45.485+0000 7fa36d135640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:45.670 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient(hunting): handle_auth_done global_id 7223 payload 824 2024-09-12T17:59:45.670 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient: _finish_hunting 0 2024-09-12T17:59:45.670 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T17:59:45.485+0000 7fa36c133640 1 monclient: found mon.noname-c 2024-09-12T17:59:45.670 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T17:59:45.485+0000 7fa36c133640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:59:45.670 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T17:59:45.485+0000 7fa2527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:45.670 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T17:59:45.485+0000 7fa2527fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:59:45.670 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T17:59:45.485+0000 7fa2527fc640 10 monclient: dump: 2024-09-12T17:59:45.670 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:45.670 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:45.670 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.671 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.671 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:45.671 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.671 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:45.671 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:45.671 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:45.671 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.671 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T17:59:45.485+0000 7fa2527fc640 10 monclient: _finish_auth 0 2024-09-12T17:59:45.671 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T17:59:45.485+0000 7fa2527fc640 10 monclient: _check_auth_tickets 2024-09-12T17:59:45.671 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T17:59:45.485+0000 7fa2527fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:45.671 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T17:59:45.485+0000 7fa2527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:45.671 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T17:59:45.485+0000 7fa2527fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:59:45.671 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T17:59:45.485+0000 7fa2527fc640 10 monclient: dump: 2024-09-12T17:59:45.671 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:45.672 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:45.672 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.672 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.672 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:45.672 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.672 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:45.672 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:45.672 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:45.672 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.672 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T17:59:45.485+0000 7fa36d936640 4 set_mon_vals no callback set 2024-09-12T17:59:45.672 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 monclient: authenticate success, global_id 7223 2024-09-12T17:59:45.672 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: _renew_subs 2024-09-12T17:59:45.672 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:45.673 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: _renew_subs 2024-09-12T17:59:45.673 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:45.673 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T17:59:45.489+0000 7fa2527fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:45.673 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T17:59:45.489+0000 7fa2527fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:45.673 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T17:59:45.489+0000 7fa2527fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:45.673 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: get_monmap_and_config 2024-09-12T17:59:45.673 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: build_initial_monmap 2024-09-12T17:59:45.673 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 1 build_initial for_mkfs: 0 2024-09-12T17:59:45.673 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: monmap: 2024-09-12T17:59:45.673 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:59:45.673 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:45.673 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:59:45.673 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:59:45.673 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:45.674 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.674 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:59:45.674 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:59:45.674 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:59:45.674 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.674 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding auth protocol: cephx 2024-09-12T17:59:45.674 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding auth protocol: cephx 2024-09-12T17:59:45.674 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding auth protocol: cephx 2024-09-12T17:59:45.674 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: secure 2024-09-12T17:59:45.674 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: crc 2024-09-12T17:59:45.674 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: secure 2024-09-12T17:59:45.674 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: crc 2024-09-12T17:59:45.674 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: secure 2024-09-12T17:59:45.674 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: crc 2024-09-12T17:59:45.675 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: crc 2024-09-12T17:59:45.675 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: secure 2024-09-12T17:59:45.675 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: crc 2024-09-12T17:59:45.675 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: secure 2024-09-12T17:59:45.675 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: crc 2024-09-12T17:59:45.675 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780562ce50) adding con mode: secure 2024-09-12T17:59:45.675 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient: get_auth_request con 0x7fa244070a20 auth_method 0 2024-09-12T17:59:45.675 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.675 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: init 2024-09-12T17:59:45.675 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding auth protocol: cephx 2024-09-12T17:59:45.675 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding auth protocol: cephx 2024-09-12T17:59:45.675 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding auth protocol: cephx 2024-09-12T17:59:45.675 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: secure 2024-09-12T17:59:45.676 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: crc 2024-09-12T17:59:45.676 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: secure 2024-09-12T17:59:45.676 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: crc 2024-09-12T17:59:45.676 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: secure 2024-09-12T17:59:45.676 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: crc 2024-09-12T17:59:45.676 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: crc 2024-09-12T17:59:45.676 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: secure 2024-09-12T17:59:45.676 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: crc 2024-09-12T17:59:45.676 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: secure 2024-09-12T17:59:45.676 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: crc 2024-09-12T17:59:45.676 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617a70) adding con mode: secure 2024-09-12T17:59:45.676 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.676 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.677 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd87617bb8 EEXIST 2024-09-12T17:59:45.677 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:59:45.677 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T17:59:45.677 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-a con 0x5578056612b0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:59:45.677 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-b con 0x55780565c6f0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:59:45.677 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-c con 0x557805652ef0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:59:45.677 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.677 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.677 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.677 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:59:45.677 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient(hunting): authenticate will time out at 2782.063111s 2024-09-12T17:59:45.677 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient(hunting): get_auth_request con 0x5578056612b0 auth_method 0 2024-09-12T17:59:45.677 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:45.677 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:45.678 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:45.678 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T17:59:45.489+0000 7fa36d135640 10 monclient(hunting): get_auth_request con 0x557805652ef0 auth_method 0 2024-09-12T17:59:45.678 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T17:59:45.489+0000 7fa36d135640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:45.678 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T17:59:45.489+0000 7fa36d135640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:45.678 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T17:59:45.489+0000 7fa36d135640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:45.678 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:45.678 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:45.678 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:45.678 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T17:59:45.489+0000 7fa36d135640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:45.678 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T17:59:45.489+0000 7fa36d135640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:45.678 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T17:59:45.489+0000 7fa36d135640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:45.678 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient(hunting): handle_auth_done global_id 7833 payload 274 2024-09-12T17:59:45.678 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient: _finish_hunting 0 2024-09-12T17:59:45.678 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T17:59:45.489+0000 7fa36c934640 1 monclient: found mon.noname-a 2024-09-12T17:59:45.679 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T17:59:45.489+0000 7fa36c934640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T17:59:45.679 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T17:59:45.489+0000 7fa243fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:45.679 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T17:59:45.489+0000 7fa243fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T17:59:45.679 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T17:59:45.489+0000 7fa243fff640 10 monclient: dump: 2024-09-12T17:59:45.679 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:45.679 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:45.679 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.679 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.679 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:45.679 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.679 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:45.679 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:45.679 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:45.679 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.680 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T17:59:45.489+0000 7fa243fff640 10 monclient: _finish_auth 0 2024-09-12T17:59:45.680 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T17:59:45.489+0000 7fa243fff640 10 monclient: _check_auth_tickets 2024-09-12T17:59:45.680 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T17:59:45.489+0000 7fa243fff640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:45.680 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 5 monclient: authenticate success, global_id 7833 2024-09-12T17:59:45.680 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 10 monclient: get_monmap_and_config success 2024-09-12T17:59:45.680 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T17:59:45.489+0000 7fa36ee2e9c0 4 set_mon_vals no callback set 2024-09-12T17:59:45.680 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T17:59:45.489+0000 7fa243fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:45.680 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T17:59:45.489+0000 7fa243fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T17:59:45.680 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T17:59:45.489+0000 7fa243fff640 10 monclient: dump: 2024-09-12T17:59:45.680 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:45.680 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:45.680 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.680 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.681 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:45.681 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.681 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:45.681 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:45.681 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:45.681 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.681 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient: shutdown 2024-09-12T17:59:45.681 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient: build_initial_monmap 2024-09-12T17:59:45.681 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 1 build_initial for_mkfs: 0 2024-09-12T17:59:45.681 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient: monmap: 2024-09-12T17:59:45.681 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T17:59:45.681 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T17:59:45.681 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T17:59:45.681 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T17:59:45.682 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T17:59:45.682 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.682 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T17:59:45.682 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T17:59:45.682 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T17:59:45.682 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.682 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding auth protocol: cephx 2024-09-12T17:59:45.682 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding auth protocol: cephx 2024-09-12T17:59:45.682 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding auth protocol: cephx 2024-09-12T17:59:45.682 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: secure 2024-09-12T17:59:45.682 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: crc 2024-09-12T17:59:45.682 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: secure 2024-09-12T17:59:45.683 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: crc 2024-09-12T17:59:45.683 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: secure 2024-09-12T17:59:45.683 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: crc 2024-09-12T17:59:45.683 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: crc 2024-09-12T17:59:45.683 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: secure 2024-09-12T17:59:45.683 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: crc 2024-09-12T17:59:45.683 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: secure 2024-09-12T17:59:45.683 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: crc 2024-09-12T17:59:45.683 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x557805653470) adding con mode: secure 2024-09-12T17:59:45.683 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.683 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 1 librados: starting msgr at 2024-09-12T17:59:45.683 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 1 librados: starting objecter 2024-09-12T17:59:45.683 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command objecter_requests cmddesc objecter_requests hook 0x557805633160 EEXIST 2024-09-12T17:59:45.683 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 1 librados: setting wanted keys 2024-09-12T17:59:45.684 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 1 librados: calling monclient init 2024-09-12T17:59:45.684 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient: init 2024-09-12T17:59:45.684 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding auth protocol: cephx 2024-09-12T17:59:45.684 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding auth protocol: cephx 2024-09-12T17:59:45.684 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding auth protocol: cephx 2024-09-12T17:59:45.684 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: secure 2024-09-12T17:59:45.684 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: crc 2024-09-12T17:59:45.684 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: secure 2024-09-12T17:59:45.684 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: crc 2024-09-12T17:59:45.684 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: secure 2024-09-12T17:59:45.684 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: crc 2024-09-12T17:59:45.684 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: crc 2024-09-12T17:59:45.684 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: secure 2024-09-12T17:59:45.684 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: crc 2024-09-12T17:59:45.685 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: secure 2024-09-12T17:59:45.685 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: crc 2024-09-12T17:59:45.685 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 AuthRegistry(0x55780560f590) adding con mode: secure 2024-09-12T17:59:45.685 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.685 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.685 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command rotate-key cmddesc rotate-key hook 0x55780560f6d8 EEXIST 2024-09-12T17:59:45.685 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient: _reopen_session rank -1 2024-09-12T17:59:45.685 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T17:59:45.685 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-c con 0x557805652ef0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T17:59:45.685 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-a con 0x55780565c6f0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T17:59:45.685 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient(hunting): picked mon.noname-b con 0x5578056612b0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T17:59:45.685 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.685 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.686 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T17:59:45.686 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient(hunting): _renew_subs 2024-09-12T17:59:45.686 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient(hunting): authenticate will time out at 2782.065714s 2024-09-12T17:59:45.686 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T17:59:45.493+0000 7fa36c934640 10 monclient(hunting): get_auth_request con 0x557805652ef0 auth_method 0 2024-09-12T17:59:45.686 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T17:59:45.493+0000 7fa36c934640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:45.686 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T17:59:45.493+0000 7fa36c934640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:45.686 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T17:59:45.493+0000 7fa36c934640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:45.686 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T17:59:45.493+0000 7fa36c133640 10 monclient(hunting): get_auth_request con 0x55780565c6f0 auth_method 0 2024-09-12T17:59:45.686 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T17:59:45.493+0000 7fa36c133640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T17:59:45.686 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T17:59:45.493+0000 7fa36c133640 10 monclient(hunting): _init_auth method 2 2024-09-12T17:59:45.686 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T17:59:45.493+0000 7fa36c133640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T17:59:45.686 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T17:59:45.493+0000 7fa36c934640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:45.686 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T17:59:45.493+0000 7fa36c934640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:45.687 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T17:59:45.493+0000 7fa36c934640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:45.687 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T17:59:45.493+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T17:59:45.687 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T17:59:45.493+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T17:59:45.687 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T17:59:45.493+0000 7fa36c133640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T17:59:45.687 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T17:59:45.493+0000 7fa36c934640 10 monclient(hunting): handle_auth_done global_id 7229 payload 824 2024-09-12T17:59:45.687 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T17:59:45.493+0000 7fa36c934640 10 monclient: _finish_hunting 0 2024-09-12T17:59:45.687 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T17:59:45.493+0000 7fa36c934640 1 monclient: found mon.noname-c 2024-09-12T17:59:45.687 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T17:59:45.493+0000 7fa36c934640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T17:59:45.687 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T17:59:45.493+0000 7fa2427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:45.687 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T17:59:45.493+0000 7fa2427fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T17:59:45.687 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T17:59:45.493+0000 7fa2427fc640 10 monclient: dump: 2024-09-12T17:59:45.687 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:45.687 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:45.687 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.688 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.688 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:45.688 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.688 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:45.688 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:45.688 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:45.688 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.688 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T17:59:45.493+0000 7fa2427fc640 10 monclient: _finish_auth 0 2024-09-12T17:59:45.688 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T17:59:45.493+0000 7fa2427fc640 10 monclient: _check_auth_tickets 2024-09-12T17:59:45.688 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T17:59:45.493+0000 7fa2427fc640 10 monclient: handle_config config(0 keys) 2024-09-12T17:59:45.688 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T17:59:45.493+0000 7fa2427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T17:59:45.688 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T17:59:45.493+0000 7fa2427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T17:59:45.688 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T17:59:45.493+0000 7fa2427fc640 10 monclient: dump: 2024-09-12T17:59:45.689 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T17:59:45.689 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T17:59:45.689 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.689 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T17:59:45.689 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T17:59:45.689 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T17:59:45.689 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T17:59:45.689 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T17:59:45.689 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T17:59:45.689 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.689 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 monclient: authenticate success, global_id 7229 2024-09-12T17:59:45.689 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient: _renew_subs 2024-09-12T17:59:45.689 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T17:59:45.493+0000 7fa243fff640 4 set_mon_vals no callback set 2024-09-12T17:59:45.689 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:45.690 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient: _renew_subs 2024-09-12T17:59:45.690 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:45.690 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 1 librados: init done 2024-09-12T17:59:45.690 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T17:59:45.493+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command cr dump hook 0x557805656a68 2024-09-12T17:59:45.690 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.690 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T17:59:45.497+0000 7fa2427fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T17:59:45.690 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T17:59:45.497+0000 7fa2427fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:45.690 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T17:59:45.497+0000 7fa2427fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T17:59:45.690 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T17:59:45.497+0000 7fa36c133640 10 monclient: get_auth_request con 0x7fa238070ae0 auth_method 0 2024-09-12T17:59:45.690 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T17:59:45.497+0000 7fa36d135640 10 monclient: get_auth_request con 0x55780567abd0 auth_method 0 2024-09-12T17:59:45.690 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.690 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 realm 2024-09-12T17:59:45.690 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.691 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.691 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:45.691 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.691 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.691 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.691 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T17:59:45.497+0000 7fa36c934640 10 monclient: get_auth_request con 0x55780567eee0 auth_method 0 2024-09-12T17:59:45.691 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:45.691 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T17:59:45.497+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.691 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T17:59:45.501+0000 7fa36ee2e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:45.691 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T17:59:45.501+0000 7fa36ee2e9c0 20 searching for the correct realm 2024-09-12T17:59:45.691 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T17:59:45.501+0000 7fa36c133640 10 monclient: get_auth_request con 0x557805684030 auth_method 0 2024-09-12T17:59:45.691 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T17:59:45.501+0000 7fa36d135640 10 monclient: get_auth_request con 0x7fa36010c040 auth_method 0 2024-09-12T17:59:45.691 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T17:59:45.501+0000 7fa36c934640 10 monclient: get_auth_request con 0x7fa364023bb0 auth_method 0 2024-09-12T17:59:45.691 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T17:59:45.501+0000 7fa36c133640 10 monclient: get_auth_request con 0x7fa35c019040 auth_method 0 2024-09-12T17:59:45.692 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T17:59:45.505+0000 7fa36d135640 0 -- 172.21.15.98:0/3828057187 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55780567abd0 msgr2=0x55780567d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:45.692 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T17:59:45.505+0000 7fa2427fc640 1 client.7229.objecter ms_handle_reset 0x55780567abd0 session 0x55780567a500 osd.1 2024-09-12T17:59:45.692 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T17:59:45.505+0000 7fa2427fc640 10 monclient: _renew_subs 2024-09-12T17:59:45.692 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T17:59:45.505+0000 7fa2427fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T17:59:45.692 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T17:59:45.505+0000 7fa36d135640 10 monclient: get_auth_request con 0x7fa238081100 auth_method 0 2024-09-12T17:59:45.692 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T17:59:45.505+0000 7fa36d135640 10 monclient: get_auth_request con 0x7fa3600c0020 auth_method 0 2024-09-12T17:59:45.692 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T17:59:45.509+0000 7fa36c934640 10 monclient: get_auth_request con 0x7fa3600e9370 auth_method 0 2024-09-12T17:59:45.692 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T17:59:45.513+0000 7fa36c133640 0 -- 172.21.15.98:0/3828057187 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fa35c019040 msgr2=0x7fa35c072040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:45.692 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T17:59:45.513+0000 7fa2427fc640 1 client.7229.objecter ms_handle_reset 0x7fa35c019040 session 0x7fa35c03d270 osd.4 2024-09-12T17:59:45.692 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T17:59:45.513+0000 7fa36c133640 10 monclient: get_auth_request con 0x55780567abd0 auth_method 0 2024-09-12T17:59:45.692 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:45.692 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:45.692 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:45.693 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:45.693 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:45.693 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:45.693 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.693 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.693 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T17:59:45.517+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.693 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:45.693 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.693 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:45.693 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 zone default found 2024-09-12T17:59:45.693 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 4 Realm: () 2024-09-12T17:59:45.693 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:45.693 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:45.694 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:45.694 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 zonegroup default 2024-09-12T17:59:45.694 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.694 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.694 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.694 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.694 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.694 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.694 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 started sync module instance, tier type = 2024-09-12T17:59:45.694 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T17:59:45.521+0000 7fa36ee2e9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:45.694 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=0 2024-09-12T17:59:45.694 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=1 2024-09-12T17:59:45.694 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=2 2024-09-12T17:59:45.694 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=3 2024-09-12T17:59:45.695 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=4 2024-09-12T17:59:45.695 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=5 2024-09-12T17:59:45.695 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=6 2024-09-12T17:59:45.695 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 20 add_watcher() i=7 2024-09-12T17:59:45.695 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T17:59:45.537+0000 7fa36ee2e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:45.695 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding auth protocol: cephx 2024-09-12T17:59:45.695 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding auth protocol: cephx 2024-09-12T17:59:45.695 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding auth protocol: cephx 2024-09-12T17:59:45.695 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: secure 2024-09-12T17:59:45.695 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: crc 2024-09-12T17:59:45.695 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: secure 2024-09-12T17:59:45.695 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: crc 2024-09-12T17:59:45.695 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: secure 2024-09-12T17:59:45.695 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: crc 2024-09-12T17:59:45.696 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: crc 2024-09-12T17:59:45.696 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: secure 2024-09-12T17:59:45.696 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: crc 2024-09-12T17:59:45.696 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: secure 2024-09-12T17:59:45.696 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T17:59:45.541+0000 7fa222fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:45.696 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: crc 2024-09-12T17:59:45.696 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 AuthRegistry(0x7ffd87617f40) adding con mode: secure 2024-09-12T17:59:45.696 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T17:59:45.696 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:45.696 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:45.696 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command cache list hook 0x5578056548b0 2024-09-12T17:59:45.696 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command cache inspect hook 0x5578056548b0 2024-09-12T17:59:45.696 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command cache erase hook 0x5578056548b0 2024-09-12T17:59:45.697 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command cache zap hook 0x5578056548b0 2024-09-12T17:59:45.697 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 note: GC not initialized 2024-09-12T17:59:45.697 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T17:59:45.541+0000 7fa221fe3640 20 reqs_thread_entry: start 2024-09-12T17:59:45.697 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command sync trace show hook 0x7fa35c01d070 2024-09-12T17:59:45.697 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command sync trace history hook 0x7fa35c01d070 2024-09-12T17:59:45.697 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command sync trace active hook 0x7fa35c01d070 2024-09-12T17:59:45.697 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 5 asok(0x5578053862b0) register_command sync trace active_short hook 0x7fa35c01d070 2024-09-12T17:59:45.697 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:45.697 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 Filter name: none 2024-09-12T17:59:45.697 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T17:59:45.541+0000 7fa1937fe640 20 reqs_thread_entry: start 2024-09-12T17:59:45.697 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:59:45.697 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.697 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:59:45.697 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:59:45.698 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:59:45.698 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 : miss 2024-09-12T17:59:45.698 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T17:59:45.541+0000 7fa36ee2e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.698 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T17:59:45.545+0000 7fa36ee2e9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T17:59:45.698 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T17:59:45.545+0000 7fa36ee2e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 info.flags=0x17 2024-09-12T17:59:45.698 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T17:59:45.545+0000 7fa36ee2e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 to cache LRU end 2024-09-12T17:59:45.698 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T17:59:45.545+0000 7fa36ee2e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:45.698 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T17:59:45.545+0000 7fa36ee2e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:45.698 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T17:59:45.545+0000 7fa36ee2e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 2024-09-12T17:59:45.698 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T17:59:45.553+0000 7fa36ee2e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 info.flags=0x17 2024-09-12T17:59:45.698 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T17:59:45.553+0000 7fa36ee2e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 to cache LRU end 2024-09-12T17:59:45.698 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T17:59:45.553+0000 7fa36ee2e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:45.698 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T17:59:45.553+0000 7fa36ee2e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36, ofs0, ns] 2024-09-12T17:59:45.699 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T17:59:45.553+0000 7fa243fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366253 cookie 93973975167824 notifier 7229 bl.length()=923 2024-09-12T17:59:45.699 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T17:59:45.553+0000 7fa243fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 info.flags=0x17 2024-09-12T17:59:45.699 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T17:59:45.553+0000 7fa243fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 to cache LRU end 2024-09-12T17:59:45.699 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T17:59:45.553+0000 7fa243fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:45.699 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T17:59:45.557+0000 7fa36ee2e9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): orig_sources= new_sources= 2024-09-12T17:59:45.699 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T17:59:45.557+0000 7fa36ee2e9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): potential sources added=[] removed=[] 2024-09-12T17:59:45.699 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T17:59:45.557+0000 7fa36ee2e9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): orig_dests= new_dests= 2024-09-12T17:59:45.699 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T17:59:45.557+0000 7fa36ee2e9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): potential dests added=[] removed=[] 2024-09-12T17:59:45.699 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T17:59:45.561+0000 7fa36ee2e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa36ee2e9c0 time 2024-09-12T17:59:45.567011+0000 2024-09-12T17:59:45.699 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T17:59:45.699 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.699 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:45.699 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa3727082eb] 2024-09-12T17:59:45.699 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa37270849f] 2024-09-12T17:59:45.700 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55780350e0c1] 2024-09-12T17:59:45.700 INFO:tasks.workunit.client.0.smithi098.stderr: 4: radosgw-admin(+0x14100ec) [0x557803f640ec] 2024-09-12T17:59:45.700 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55780352018d] 2024-09-12T17:59:45.700 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T17:59:45.700 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa37156ed90] 2024-09-12T17:59:45.700 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T17:59:45.700 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T17:59:45.700 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.700 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T17:59:45.565+0000 7fa36ee2e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T17:59:45.700 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7fa36ee2e9c0 thread_name:radosgw-admin 2024-09-12T17:59:45.700 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.700 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T17:59:45.700 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa371587520] 2024-09-12T17:59:45.701 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T17:59:45.701 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T17:59:45.701 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T17:59:45.701 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa372708345] 2024-09-12T17:59:45.701 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa37270849f] 2024-09-12T17:59:45.701 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55780350e0c1] 2024-09-12T17:59:45.701 INFO:tasks.workunit.client.0.smithi098.stderr: 8: radosgw-admin(+0x14100ec) [0x557803f640ec] 2024-09-12T17:59:45.701 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55780352018d] 2024-09-12T17:59:45.701 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T17:59:45.701 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa37156ed90] 2024-09-12T17:59:45.701 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T17:59:45.701 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T17:59:45.701 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T17:59:45.701 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.702 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T17:59:45.702 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T17:59:45.702 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T17:59:45.702 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T17:59:45.702 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T17:59:45.702 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T17:59:45.702 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T17:59:45.702 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T17:59:45.702 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T17:59:45.702 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T17:59:45.702 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T17:59:45.702 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T17:59:45.702 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T17:59:45.702 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T17:59:45.703 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T17:59:45.703 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T17:59:45.703 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T17:59:45.703 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T17:59:45.703 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T17:59:45.703 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T17:59:45.703 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T17:59:45.703 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T17:59:45.703 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T17:59:45.703 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T17:59:45.703 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T17:59:45.703 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T17:59:45.703 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T17:59:45.703 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T17:59:45.703 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T17:59:45.704 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T17:59:45.704 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T17:59:45.704 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T17:59:45.704 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T17:59:45.704 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T17:59:45.704 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T17:59:45.704 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T17:59:45.704 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T17:59:45.704 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T17:59:45.704 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T17:59:45.704 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T17:59:45.704 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T17:59:45.704 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T17:59:45.704 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T17:59:45.705 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T17:59:45.705 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T17:59:45.705 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T17:59:45.705 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T17:59:45.705 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T17:59:45.705 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T17:59:45.705 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T17:59:45.705 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T17:59:45.705 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T17:59:45.705 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T17:59:45.705 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T17:59:45.705 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T17:59:45.705 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T17:59:45.705 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T17:59:45.706 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T17:59:45.706 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T17:59:45.706 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T17:59:45.706 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T17:59:45.706 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T17:59:45.706 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T17:59:45.706 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T17:59:45.706 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T17:59:45.706 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T17:59:45.707 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T17:59:45.707 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T17:59:45.707 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T17:59:45.707 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T17:59:45.707 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T17:59:45.707 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T17:59:45.707 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T17:59:45.707 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T17:59:45.707 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T17:59:45.707 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T17:59:45.707 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T17:59:45.707 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T17:59:45.707 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T17:59:45.707 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T17:59:45.708 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T17:59:45.708 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T17:59:45.708 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T17:59:45.708 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T17:59:45.708 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T17:59:45.708 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T17:59:45.708 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T17:59:45.708 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T17:59:45.708 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T17:59:45.708 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T17:59:45.708 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T17:59:45.708 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T17:59:45.708 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T17:59:45.708 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T17:59:45.709 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa1937fe640 / http_manager 2024-09-12T17:59:45.709 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa221fe3640 / http_manager 2024-09-12T17:59:45.709 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa222fe5640 / rgw_dt_lg_renew 2024-09-12T17:59:45.709 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa2427fc640 / ms_dispatch 2024-09-12T17:59:45.709 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa243fff640 / io_context_pool 2024-09-12T17:59:45.709 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa2527fc640 / ms_dispatch 2024-09-12T17:59:45.709 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa25960a640 / ms_dispatch 2024-09-12T17:59:45.709 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa25ae0d640 / io_context_pool 2024-09-12T17:59:45.709 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa36c133640 / msgr-worker-2 2024-09-12T17:59:45.709 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa36c934640 / msgr-worker-1 2024-09-12T17:59:45.709 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa36d135640 / msgr-worker-0 2024-09-12T17:59:45.709 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa36d936640 / io_context_pool 2024-09-12T17:59:45.709 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa36ee2e9c0 / radosgw-admin 2024-09-12T17:59:45.709 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T17:59:45.710 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T17:59:45.710 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/lib/ceph/crash/2024-09-12T17:59:45.569498Z_62422658-7f6e-4f3e-8ce6-69ec34d9a56e/log 2024-09-12T17:59:45.710 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T17:59:45.710 INFO:tasks.workunit.client.0.smithi098.stderr:Aborted 2024-09-12T17:59:45.710 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T17:59:45.711 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:45.711 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:45.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.645+0000 7f94e9a669c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.645+0000 7f94e9a669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.645+0000 7f94e9a669c0 20 realm 2024-09-12T17:59:45.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.645+0000 7f94e9a669c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.645+0000 7f94e9a669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.645+0000 7f94e9a669c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:45.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.645+0000 7f94e9a669c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.645+0000 7f94e9a669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.645+0000 7f94e9a669c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.649+0000 7f94e9a669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:45.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.649+0000 7f94e9a669c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.649+0000 7f94e9a669c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:45.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.649+0000 7f94e9a669c0 20 searching for the correct realm 2024-09-12T17:59:45.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.653+0000 7f94e7d6d640 0 -- 172.21.15.98:0/309200620 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f94dc008030 msgr2=0x7f94dc076820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:45.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.869+0000 7f94e756c640 0 -- 172.21.15.98:0/309200620 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x559765dffc40 msgr2=0x559765e02100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:45.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.877+0000 7f94e9a669c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:45.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.877+0000 7f94e9a669c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:45.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.877+0000 7f94e9a669c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:45.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.877+0000 7f94e9a669c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:45.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.877+0000 7f94e9a669c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:45.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.877+0000 7f94e9a669c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:45.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.877+0000 7f94e9a669c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.877+0000 7f94e9a669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.877+0000 7f94e9a669c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.881+0000 7f94e9a669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:45.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.881+0000 7f94e9a669c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.881+0000 7f94e9a669c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:45.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.881+0000 7f94e9a669c0 20 zone default found 2024-09-12T17:59:45.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.881+0000 7f94e9a669c0 4 Realm: () 2024-09-12T17:59:45.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.881+0000 7f94e9a669c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:45.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.881+0000 7f94e9a669c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:45.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.881+0000 7f94e9a669c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:45.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.881+0000 7f94e9a669c0 20 zonegroup default 2024-09-12T17:59:45.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.881+0000 7f94e9a669c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.881+0000 7f94e9a669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.881+0000 7f94e9a669c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.881+0000 7f94e9a669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.881+0000 7f94e9a669c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.881+0000 7f94e9a669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:45.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.881+0000 7f94e9a669c0 20 started sync module instance, tier type = 2024-09-12T17:59:45.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.881+0000 7f94e9a669c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:45.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.905+0000 7f94e9a669c0 20 add_watcher() i=0 2024-09-12T17:59:45.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.905+0000 7f94e9a669c0 20 add_watcher() i=1 2024-09-12T17:59:45.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.905+0000 7f94e9a669c0 20 add_watcher() i=2 2024-09-12T17:59:45.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.905+0000 7f94e9a669c0 20 add_watcher() i=3 2024-09-12T17:59:45.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.905+0000 7f94e9a669c0 20 add_watcher() i=4 2024-09-12T17:59:45.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.905+0000 7f94e9a669c0 20 add_watcher() i=5 2024-09-12T17:59:45.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.905+0000 7f94e9a669c0 20 add_watcher() i=6 2024-09-12T17:59:45.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.909+0000 7f94e9a669c0 20 add_watcher() i=7 2024-09-12T17:59:45.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.909+0000 7f94e9a669c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:45.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.913+0000 7f939dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:45.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.913+0000 7f94e9a669c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:45.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.913+0000 7f94e9a669c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:45.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.913+0000 7f94e9a669c0 5 note: GC not initialized 2024-09-12T17:59:45.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.913+0000 7f939cfe1640 20 reqs_thread_entry: start 2024-09-12T17:59:45.919 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.917+0000 7f94e9a669c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:45.919 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.917+0000 7f94e9a669c0 20 Filter name: none 2024-09-12T17:59:45.919 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.917+0000 7f93167fc640 20 reqs_thread_entry: start 2024-09-12T17:59:45.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.917+0000 7f94e9a669c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.917+0000 7f94e9a669c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:59:45.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.917+0000 7f94e9a669c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.922 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.917+0000 7f94e9a669c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:59:45.922 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.917+0000 7f94e9a669c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:45.922 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.917+0000 7f94e9a669c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.921+0000 7f94e9a669c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:59:45.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.921+0000 7f94e9a669c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:45.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.921+0000 7f94e9a669c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:59:45.924 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.921+0000 7f94e9a669c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:59:45.927 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.925+0000 7f939dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:45.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.929+0000 7f94e9a669c0 20 remove_watcher() i=0 2024-09-12T17:59:45.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.929+0000 7f94e9a669c0 2 removed watcher, disabling cache 2024-09-12T17:59:45.934 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.929+0000 7f94e9a669c0 20 remove_watcher() i=1 2024-09-12T17:59:45.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.933+0000 7f94e9a669c0 20 remove_watcher() i=2 2024-09-12T17:59:45.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.937+0000 7f94e9a669c0 20 remove_watcher() i=3 2024-09-12T17:59:45.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.937+0000 7f94e9a669c0 20 remove_watcher() i=4 2024-09-12T17:59:45.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.941+0000 7f94e9a669c0 20 remove_watcher() i=5 2024-09-12T17:59:45.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.941+0000 7f94e9a669c0 20 remove_watcher() i=6 2024-09-12T17:59:45.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:45.941+0000 7f94e9a669c0 20 remove_watcher() i=7 2024-09-12T17:59:45.962 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.962 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T17:59:45.962 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-logrecord-writes id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T17:59:45.962 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T17:59:45.963 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:45.963 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:46.015 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T17:59:46.016 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T17:59:46.077 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T17:59:46.113 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:59:46.113 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:59:46.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.153+0000 7fcaab3a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:46.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.157+0000 7fcaab3a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:46.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.157+0000 7fcaab3a19c0 20 realm 2024-09-12T17:59:46.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.157+0000 7fcaab3a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:46.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.157+0000 7fcaab3a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:46.163 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.157+0000 7fcaab3a19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:59:46.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.157+0000 7fcaab3a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:46.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.157+0000 7fcaab3a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:46.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.157+0000 7fcaab3a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:46.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.157+0000 7fcaab3a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:46.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.157+0000 7fcaab3a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:46.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.157+0000 7fcaab3a19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T17:59:46.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.157+0000 7fcaab3a19c0 20 searching for the correct realm 2024-09-12T17:59:46.169 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.165+0000 7fcaa96a8640 0 -- 172.21.15.98:0/2557400896 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7fca90017400 msgr2=0x7fca90017880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:46.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.381+0000 7fcaa8ea7640 0 -- 172.21.15.98:0/2557400896 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x55dd86979800 msgr2=0x55dd8697bc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T17:59:46.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.389+0000 7fcaab3a19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:59:46.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.389+0000 7fcaab3a19c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T17:59:46.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.389+0000 7fcaab3a19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:59:46.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.389+0000 7fcaab3a19c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T17:59:46.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.389+0000 7fcaab3a19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:59:46.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.389+0000 7fcaab3a19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:59:46.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.389+0000 7fcaab3a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:46.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.389+0000 7fcaab3a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:46.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.389+0000 7fcaab3a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:46.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.389+0000 7fcaab3a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:59:46.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.389+0000 7fcaab3a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:46.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.393+0000 7fcaab3a19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T17:59:46.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.393+0000 7fcaab3a19c0 20 zone default found 2024-09-12T17:59:46.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.393+0000 7fcaab3a19c0 4 Realm: () 2024-09-12T17:59:46.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.393+0000 7fcaab3a19c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T17:59:46.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.393+0000 7fcaab3a19c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T17:59:46.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.393+0000 7fcaab3a19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:59:46.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.393+0000 7fcaab3a19c0 20 zonegroup default 2024-09-12T17:59:46.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.393+0000 7fcaab3a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:46.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.393+0000 7fcaab3a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:46.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.393+0000 7fcaab3a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:46.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.393+0000 7fcaab3a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:46.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.393+0000 7fcaab3a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:46.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.393+0000 7fcaab3a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:59:46.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.393+0000 7fcaab3a19c0 20 started sync module instance, tier type = 2024-09-12T17:59:46.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.393+0000 7fcaab3a19c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T17:59:46.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.417+0000 7fcaab3a19c0 20 add_watcher() i=0 2024-09-12T17:59:46.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.417+0000 7fcaab3a19c0 20 add_watcher() i=1 2024-09-12T17:59:46.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.417+0000 7fcaab3a19c0 20 add_watcher() i=2 2024-09-12T17:59:46.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.417+0000 7fcaab3a19c0 20 add_watcher() i=3 2024-09-12T17:59:46.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.417+0000 7fcaab3a19c0 20 add_watcher() i=4 2024-09-12T17:59:46.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.417+0000 7fcaab3a19c0 20 add_watcher() i=5 2024-09-12T17:59:46.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.417+0000 7fcaab3a19c0 20 add_watcher() i=6 2024-09-12T17:59:46.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.421+0000 7fcaab3a19c0 20 add_watcher() i=7 2024-09-12T17:59:46.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.421+0000 7fcaab3a19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:59:46.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.425+0000 7fc95efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:46.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.425+0000 7fcaab3a19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:59:46.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.425+0000 7fcaab3a19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:59:46.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.425+0000 7fcaab3a19c0 5 note: GC not initialized 2024-09-12T17:59:46.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.425+0000 7fc95dfe3640 20 reqs_thread_entry: start 2024-09-12T17:59:46.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.425+0000 7fcaab3a19c0 20 init_complete bucket index max shards: 11 2024-09-12T17:59:46.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.425+0000 7fcaab3a19c0 20 Filter name: none 2024-09-12T17:59:46.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.425+0000 7fc8cf7fe640 20 reqs_thread_entry: start 2024-09-12T17:59:46.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.425+0000 7fcaab3a19c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T17:59:46.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.425+0000 7fcaab3a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:46.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.425+0000 7fcaab3a19c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:59:46.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.425+0000 7fcaab3a19c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T17:59:46.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.425+0000 7fcaab3a19c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T17:59:46.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.425+0000 7fcaab3a19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 : miss 2024-09-12T17:59:46.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.425+0000 7fcaab3a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:59:46.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.429+0000 7fcaab3a19c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T17:59:46.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.429+0000 7fcaab3a19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 info.flags=0x17 2024-09-12T17:59:46.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.429+0000 7fcaab3a19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 to cache LRU end 2024-09-12T17:59:46.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.429+0000 7fcaab3a19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:59:46.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.429+0000 7fcaab3a19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T17:59:46.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.429+0000 7fcaab3a19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 2024-09-12T17:59:46.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.429+0000 7fcaab3a19c0 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 to be held by another RGW process; skipping for now 2024-09-12T17:59:46.437 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.433+0000 7fc95efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:59:46.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.437+0000 7fcaab3a19c0 20 remove_watcher() i=0 2024-09-12T17:59:46.442 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.437+0000 7fcaab3a19c0 2 removed watcher, disabling cache 2024-09-12T17:59:46.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.441+0000 7fcaab3a19c0 20 remove_watcher() i=1 2024-09-12T17:59:46.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.441+0000 7fcaab3a19c0 20 remove_watcher() i=2 2024-09-12T17:59:46.448 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.445+0000 7fcaab3a19c0 20 remove_watcher() i=3 2024-09-12T17:59:46.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.445+0000 7fcaab3a19c0 20 remove_watcher() i=4 2024-09-12T17:59:46.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.449+0000 7fcaab3a19c0 20 remove_watcher() i=5 2024-09-12T17:59:46.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.449+0000 7fcaab3a19c0 20 remove_watcher() i=6 2024-09-12T17:59:46.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T17:59:46.453+0000 7fcaab3a19c0 20 remove_watcher() i=7 2024-09-12T17:59:46.471 INFO:tasks.workunit.client.0.smithi098.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:00:16.494 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:00:16.532 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:16.532 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:16.578 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.573+0000 7f48b727b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:16.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.577+0000 7f48b727b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:16.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.577+0000 7f48b727b9c0 20 realm 2024-09-12T18:00:16.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.577+0000 7f48b727b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:16.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.577+0000 7f48b727b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:16.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.577+0000 7f48b727b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:16.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.577+0000 7f48b727b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:16.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.577+0000 7f48b727b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:16.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.577+0000 7f48b727b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:16.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.577+0000 7f48b727b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:16.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.577+0000 7f48b727b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:16.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.577+0000 7f48b727b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:16.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.577+0000 7f48b727b9c0 20 searching for the correct realm 2024-09-12T18:00:16.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.585+0000 7f48b5582640 0 -- 172.21.15.98:0/1186348595 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f48a8038410 msgr2=0x7f48a8038830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:00:16.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.589+0000 7f48b4d81640 0 -- 172.21.15.98:0/1186348595 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f48a8049920 msgr2=0x7f48a80483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:16.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:16.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:00:16.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:16.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:00:16.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:16.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:16.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:16.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:16.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:16.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:16.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:16.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:16.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 20 zone default found 2024-09-12T18:00:16.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 4 Realm: () 2024-09-12T18:00:16.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:00:16.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:00:16.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:16.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 20 zonegroup default 2024-09-12T18:00:16.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:16.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:16.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.809+0000 7f48b727b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:16.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.813+0000 7f48b727b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:16.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.813+0000 7f48b727b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:16.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.813+0000 7f48b727b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:16.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.813+0000 7f48b727b9c0 20 started sync module instance, tier type = 2024-09-12T18:00:16.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.813+0000 7f48b727b9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:00:16.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.833+0000 7f48b727b9c0 20 add_watcher() i=0 2024-09-12T18:00:16.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.833+0000 7f48b727b9c0 20 add_watcher() i=1 2024-09-12T18:00:16.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.833+0000 7f48b727b9c0 20 add_watcher() i=2 2024-09-12T18:00:16.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.833+0000 7f48b727b9c0 20 add_watcher() i=3 2024-09-12T18:00:16.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.833+0000 7f48b727b9c0 20 add_watcher() i=4 2024-09-12T18:00:16.839 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.833+0000 7f48b727b9c0 20 add_watcher() i=5 2024-09-12T18:00:16.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.833+0000 7f48b727b9c0 20 add_watcher() i=6 2024-09-12T18:00:16.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.837+0000 7f48b727b9c0 20 add_watcher() i=7 2024-09-12T18:00:16.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.837+0000 7f48b727b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:16.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.841+0000 7f476afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:16.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.841+0000 7f48b727b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:16.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.841+0000 7f48b727b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:16.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.841+0000 7f48b727b9c0 5 note: GC not initialized 2024-09-12T18:00:16.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.841+0000 7f4769fe3640 20 reqs_thread_entry: start 2024-09-12T18:00:16.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.845+0000 7f48b727b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:00:16.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.845+0000 7f48b727b9c0 20 Filter name: none 2024-09-12T18:00:16.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.845+0000 7f46db7fe640 20 reqs_thread_entry: start 2024-09-12T18:00:16.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.845+0000 7f48b727b9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T18:00:16.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.845+0000 7f48b727b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:16.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.845+0000 7f48b727b9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:00:16.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.845+0000 7f48b727b9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T18:00:16.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.845+0000 7f48b727b9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T18:00:16.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.845+0000 7f48b727b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 : miss 2024-09-12T18:00:16.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.845+0000 7f48b727b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:16.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.845+0000 7f48b727b9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T18:00:16.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.845+0000 7f48b727b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 info.flags=0x17 2024-09-12T18:00:16.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.845+0000 7f48b727b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 to cache LRU end 2024-09-12T18:00:16.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.845+0000 7f48b727b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:16.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.845+0000 7f48b727b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:16.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.845+0000 7f48b727b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 2024-09-12T18:00:16.856 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.849+0000 7f48b727b9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:00:16.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.861+0000 7f48b727b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 info.flags=0x17 2024-09-12T18:00:16.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.861+0000 7f48b727b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 to cache LRU end 2024-09-12T18:00:16.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.861+0000 7f48b727b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:16.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.861+0000 7f48b727b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36, ofs0, ns] 2024-09-12T18:00:16.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.865+0000 7f478b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366254 cookie 93980930908080 notifier 7280 bl.length()=923 2024-09-12T18:00:16.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.865+0000 7f478b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 info.flags=0x17 2024-09-12T18:00:16.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.865+0000 7f478b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 to cache LRU end 2024-09-12T18:00:16.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.865+0000 7f478b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:16.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.865+0000 7f48b727b9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): orig_sources= new_sources= 2024-09-12T18:00:16.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.865+0000 7f48b727b9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): potential sources added=[] removed=[] 2024-09-12T18:00:16.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.865+0000 7f48b727b9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): orig_dests= new_dests= 2024-09-12T18:00:16.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.865+0000 7f48b727b9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): potential dests added=[] removed=[] 2024-09-12T18:00:16.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.0 2024-09-12T18:00:16.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.0 2024-09-12T18:00:16.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.1 2024-09-12T18:00:16.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.1 2024-09-12T18:00:16.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.2 2024-09-12T18:00:16.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.2 2024-09-12T18:00:16.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.3 2024-09-12T18:00:16.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.3 2024-09-12T18:00:16.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.4 2024-09-12T18:00:16.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.4 2024-09-12T18:00:16.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.5 2024-09-12T18:00:16.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.5 2024-09-12T18:00:16.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.6 2024-09-12T18:00:16.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.6 2024-09-12T18:00:16.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.7 2024-09-12T18:00:16.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.7 2024-09-12T18:00:16.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.8 2024-09-12T18:00:16.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.8 2024-09-12T18:00:16.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.9 2024-09-12T18:00:16.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.9 2024-09-12T18:00:16.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.10 2024-09-12T18:00:16.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.10 2024-09-12T18:00:16.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.11 2024-09-12T18:00:16.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2.11 2024-09-12T18:00:16.882 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.0 2024-09-12T18:00:16.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.1 2024-09-12T18:00:16.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.877+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2 2024-09-12T18:00:16.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.881+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.3 2024-09-12T18:00:16.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.881+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.4 2024-09-12T18:00:16.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.881+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.5 2024-09-12T18:00:16.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.881+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.6 2024-09-12T18:00:16.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.885+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.7 2024-09-12T18:00:16.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.885+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.8 2024-09-12T18:00:16.890 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.885+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.9 2024-09-12T18:00:16.890 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.885+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.10 2024-09-12T18:00:16.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.893+0000 7f48b727b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 : hit (requested=0x17, cached=0x17) 2024-09-12T18:00:16.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.893+0000 7f48b727b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 2024-09-12T18:00:16.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.893+0000 7f48b727b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 info.flags=0x17 2024-09-12T18:00:16.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.893+0000 7f48b727b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 to cache LRU end 2024-09-12T18:00:16.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.893+0000 7f48b727b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:16.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.893+0000 7f48b727b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36, ofs0, ns] 2024-09-12T18:00:16.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.897+0000 7f478b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366255 cookie 93980930908080 notifier 7280 bl.length()=923 2024-09-12T18:00:16.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.897+0000 7f478b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 info.flags=0x17 2024-09-12T18:00:16.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.897+0000 7f478b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 to cache LRU end 2024-09-12T18:00:16.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.897+0000 7f478b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:16.903 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.897+0000 7f48b727b9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): orig_sources= new_sources= 2024-09-12T18:00:16.903 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.897+0000 7f48b727b9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): potential sources added=[] removed=[] 2024-09-12T18:00:16.903 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.897+0000 7f48b727b9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): orig_dests= new_dests= 2024-09-12T18:00:16.903 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.897+0000 7f48b727b9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): potential dests added=[] removed=[] 2024-09-12T18:00:16.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.905+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.0 2024-09-12T18:00:16.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.905+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.1 2024-09-12T18:00:16.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.905+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.2 2024-09-12T18:00:16.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.905+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.3 2024-09-12T18:00:16.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.905+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.4 2024-09-12T18:00:16.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.905+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.5 2024-09-12T18:00:16.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.909+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.6 2024-09-12T18:00:16.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.909+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.7 2024-09-12T18:00:16.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.909+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.8 2024-09-12T18:00:16.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.909+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.9 2024-09-12T18:00:16.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.909+0000 7f48b727b9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.36.10 2024-09-12T18:00:16.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.909+0000 7f48b727b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 : hit (requested=0x17, cached=0x17) 2024-09-12T18:00:16.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.909+0000 7f48b727b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 2024-09-12T18:00:16.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.913+0000 7f48b727b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 info.flags=0x17 2024-09-12T18:00:16.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.913+0000 7f48b727b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 to cache LRU end 2024-09-12T18:00:16.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.913+0000 7f48b727b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:16.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.913+0000 7f48b727b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36, ofs0, ns] 2024-09-12T18:00:16.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.913+0000 7f478bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366256 cookie 93980930908080 notifier 7280 bl.length()=891 2024-09-12T18:00:16.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.913+0000 7f478bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 info.flags=0x17 2024-09-12T18:00:16.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.913+0000 7f478bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 to cache LRU end 2024-09-12T18:00:16.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.913+0000 7f478bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:16.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.917+0000 7f48b727b9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): orig_sources= new_sources= 2024-09-12T18:00:16.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.917+0000 7f48b727b9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): potential sources added=[] removed=[] 2024-09-12T18:00:16.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.917+0000 7f48b727b9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): orig_dests= new_dests= 2024-09-12T18:00:16.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.917+0000 7f48b727b9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a01e4849-e968-46ce-97f1-a673c26b3735.4529.36]): potential dests added=[] removed=[] 2024-09-12T18:00:16.926 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.921+0000 7f48b727b9c0 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T18:00:16.930 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.925+0000 7f476afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:16.935 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.929+0000 7f48b727b9c0 20 remove_watcher() i=0 2024-09-12T18:00:16.935 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.929+0000 7f48b727b9c0 2 removed watcher, disabling cache 2024-09-12T18:00:16.937 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.933+0000 7f48b727b9c0 20 remove_watcher() i=1 2024-09-12T18:00:16.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.937+0000 7f48b727b9c0 20 remove_watcher() i=2 2024-09-12T18:00:16.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.937+0000 7f48b727b9c0 20 remove_watcher() i=3 2024-09-12T18:00:16.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.941+0000 7f48b727b9c0 20 remove_watcher() i=4 2024-09-12T18:00:16.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.941+0000 7f48b727b9c0 20 remove_watcher() i=5 2024-09-12T18:00:16.947 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.941+0000 7f48b727b9c0 20 remove_watcher() i=6 2024-09-12T18:00:16.948 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:16.945+0000 7f48b727b9c0 20 remove_watcher() i=7 2024-09-12T18:00:16.963 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T18:00:16.994 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:16.994 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:17.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.033+0000 7fe51291b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:17.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.037+0000 7fe51291b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:17.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.037+0000 7fe51291b9c0 20 realm 2024-09-12T18:00:17.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.037+0000 7fe51291b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:17.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.037+0000 7fe51291b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:17.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.037+0000 7fe51291b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:17.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.037+0000 7fe51291b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:17.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.037+0000 7fe51291b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:17.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.037+0000 7fe51291b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:17.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.041+0000 7fe51291b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:17.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.041+0000 7fe51291b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:17.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.041+0000 7fe51291b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:17.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.041+0000 7fe51291b9c0 20 searching for the correct realm 2024-09-12T18:00:17.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.045+0000 7fe50fc20640 0 -- 172.21.15.98:0/1061699736 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fe500029070 msgr2=0x7fe5000753c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:17.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.049+0000 7fe510421640 0 -- 172.21.15.98:0/1061699736 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fe4f80303f0 msgr2=0x7fe4f8030870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:17.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.265+0000 7fe51291b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:17.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.265+0000 7fe51291b9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:00:17.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.265+0000 7fe51291b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:17.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.265+0000 7fe51291b9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:00:17.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.265+0000 7fe51291b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:17.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.265+0000 7fe51291b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:17.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.265+0000 7fe51291b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:17.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.265+0000 7fe51291b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:17.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.265+0000 7fe51291b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:17.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.265+0000 7fe51291b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:17.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.265+0000 7fe51291b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:17.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.269+0000 7fe51291b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:17.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.269+0000 7fe51291b9c0 20 zone default found 2024-09-12T18:00:17.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.269+0000 7fe51291b9c0 4 Realm: () 2024-09-12T18:00:17.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.269+0000 7fe51291b9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:00:17.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.269+0000 7fe51291b9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:00:17.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.269+0000 7fe51291b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:17.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.269+0000 7fe51291b9c0 20 zonegroup default 2024-09-12T18:00:17.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.269+0000 7fe51291b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:17.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.269+0000 7fe51291b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:17.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.269+0000 7fe51291b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:17.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.269+0000 7fe51291b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:17.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.269+0000 7fe51291b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:17.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.269+0000 7fe51291b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:17.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.269+0000 7fe51291b9c0 20 started sync module instance, tier type = 2024-09-12T18:00:17.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.269+0000 7fe51291b9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:00:17.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.293+0000 7fe51291b9c0 20 add_watcher() i=0 2024-09-12T18:00:17.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.293+0000 7fe51291b9c0 20 add_watcher() i=1 2024-09-12T18:00:17.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.293+0000 7fe51291b9c0 20 add_watcher() i=2 2024-09-12T18:00:17.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.293+0000 7fe51291b9c0 20 add_watcher() i=3 2024-09-12T18:00:17.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.293+0000 7fe51291b9c0 20 add_watcher() i=4 2024-09-12T18:00:17.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.293+0000 7fe51291b9c0 20 add_watcher() i=5 2024-09-12T18:00:17.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.293+0000 7fe51291b9c0 20 add_watcher() i=6 2024-09-12T18:00:17.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.297+0000 7fe51291b9c0 20 add_watcher() i=7 2024-09-12T18:00:17.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.297+0000 7fe51291b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:17.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.301+0000 7fe3c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:17.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.301+0000 7fe51291b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:17.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.301+0000 7fe51291b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:17.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.301+0000 7fe51291b9c0 5 note: GC not initialized 2024-09-12T18:00:17.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.301+0000 7fe3c5fdb640 20 reqs_thread_entry: start 2024-09-12T18:00:17.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.301+0000 7fe51291b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:00:17.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.301+0000 7fe51291b9c0 20 Filter name: none 2024-09-12T18:00:17.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.301+0000 7fe3377fe640 20 reqs_thread_entry: start 2024-09-12T18:00:17.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.301+0000 7fe51291b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:17.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.305+0000 7fe51291b9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:00:17.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.305+0000 7fe51291b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:17.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.305+0000 7fe51291b9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:00:17.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.305+0000 7fe51291b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:17.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.305+0000 7fe51291b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:17.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.305+0000 7fe51291b9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:00:17.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.305+0000 7fe51291b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:17.312 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.309+0000 7fe51291b9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:00:17.312 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.309+0000 7fe51291b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:17.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.313+0000 7fe3c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:17.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.317+0000 7fe51291b9c0 20 remove_watcher() i=0 2024-09-12T18:00:17.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.317+0000 7fe51291b9c0 2 removed watcher, disabling cache 2024-09-12T18:00:17.323 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.317+0000 7fe51291b9c0 20 remove_watcher() i=1 2024-09-12T18:00:17.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.321+0000 7fe51291b9c0 20 remove_watcher() i=2 2024-09-12T18:00:17.328 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.325+0000 7fe51291b9c0 20 remove_watcher() i=3 2024-09-12T18:00:17.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.325+0000 7fe51291b9c0 20 remove_watcher() i=4 2024-09-12T18:00:17.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.329+0000 7fe51291b9c0 20 remove_watcher() i=5 2024-09-12T18:00:17.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.329+0000 7fe51291b9c0 20 remove_watcher() i=6 2024-09-12T18:00:17.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:17.329+0000 7fe51291b9c0 20 remove_watcher() i=7 2024-09-12T18:00:17.349 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:17.349 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T18:00:17.349 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-logrecord-writes id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:00:17.349 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:17.351 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:17.351 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:17.382 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:17.382 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:17.953 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:17.953 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:18.335 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T18:00:18.335 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:18.338 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:18.338 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:18.471 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:18.471 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:18.560 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:18.560 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:18.659 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:18.659 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:18.762 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:18.762 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:18.857 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:18.857 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:18.960 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:18.960 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:19.063 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:19.063 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:19.162 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:19.163 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:19.265 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:19.265 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:19.364 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:19.364 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:19.461 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:19.462 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:19.555 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:19.556 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:19.659 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:19.659 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:19.755 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:19.755 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:19.858 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:19.858 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:19.956 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:19.956 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:20.046 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:20.046 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:20.146 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:20.146 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:20.240 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:20.241 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:20.340 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:20.340 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:20.440 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:20.440 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:20.536 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T18:00:20.570 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:20.570 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:20.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.608+0000 7f2f7faa19c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:20.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.612+0000 7f2f7faa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:20.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.612+0000 7f2f7faa19c0 20 realm 2024-09-12T18:00:20.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.612+0000 7f2f7faa19c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:20.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.612+0000 7f2f7faa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:20.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.612+0000 7f2f7faa19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:20.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.612+0000 7f2f7faa19c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:20.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.612+0000 7f2f7faa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:20.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.612+0000 7f2f7faa19c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:20.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.612+0000 7f2f7faa19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:20.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.612+0000 7f2f7faa19c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:20.619 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.612+0000 7f2f7faa19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:20.619 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.612+0000 7f2f7faa19c0 20 searching for the correct realm 2024-09-12T18:00:20.624 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.620+0000 7f2f7dda8640 0 -- 172.21.15.98:0/945405583 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f2f6801e060 msgr2=0x7f2f6805b0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:20.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.624+0000 7f2f7d5a7640 0 -- 172.21.15.98:0/945405583 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f2f6805d690 msgr2=0x7f2f6807e5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:20.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.840+0000 7f2f7faa19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:20.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.840+0000 7f2f7faa19c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:00:20.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.840+0000 7f2f7faa19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:20.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.840+0000 7f2f7faa19c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:00:20.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.840+0000 7f2f7faa19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:20.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.840+0000 7f2f7faa19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:20.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.840+0000 7f2f7faa19c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:20.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.844+0000 7f2f7faa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:20.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.844+0000 7f2f7faa19c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:20.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.844+0000 7f2f7faa19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:20.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.844+0000 7f2f7faa19c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:20.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.844+0000 7f2f7faa19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:20.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.844+0000 7f2f7faa19c0 20 zone default found 2024-09-12T18:00:20.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.844+0000 7f2f7faa19c0 4 Realm: () 2024-09-12T18:00:20.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.844+0000 7f2f7faa19c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:00:20.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.844+0000 7f2f7faa19c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:00:20.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.844+0000 7f2f7faa19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:20.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.844+0000 7f2f7faa19c0 20 zonegroup default 2024-09-12T18:00:20.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.844+0000 7f2f7faa19c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:20.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.844+0000 7f2f7faa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:20.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.844+0000 7f2f7faa19c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:20.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.848+0000 7f2f7faa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:20.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.848+0000 7f2f7faa19c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:20.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.848+0000 7f2f7faa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:20.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.848+0000 7f2f7faa19c0 20 started sync module instance, tier type = 2024-09-12T18:00:20.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.848+0000 7f2f7faa19c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:00:20.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.872+0000 7f2f7faa19c0 20 add_watcher() i=0 2024-09-12T18:00:20.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.872+0000 7f2f7faa19c0 20 add_watcher() i=1 2024-09-12T18:00:20.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.872+0000 7f2f7faa19c0 20 add_watcher() i=2 2024-09-12T18:00:20.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.872+0000 7f2f7faa19c0 20 add_watcher() i=3 2024-09-12T18:00:20.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.872+0000 7f2f7faa19c0 20 add_watcher() i=4 2024-09-12T18:00:20.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.872+0000 7f2f7faa19c0 20 add_watcher() i=5 2024-09-12T18:00:20.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.872+0000 7f2f7faa19c0 20 add_watcher() i=6 2024-09-12T18:00:20.879 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.876+0000 7f2f7faa19c0 20 add_watcher() i=7 2024-09-12T18:00:20.879 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.876+0000 7f2f7faa19c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:20.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.880+0000 7f2e33fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:20.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.880+0000 7f2f7faa19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:20.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.880+0000 7f2f7faa19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:20.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.880+0000 7f2f7faa19c0 5 note: GC not initialized 2024-09-12T18:00:20.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.880+0000 7f2e32fe5640 20 reqs_thread_entry: start 2024-09-12T18:00:20.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.880+0000 7f2f7faa19c0 20 init_complete bucket index max shards: 11 2024-09-12T18:00:20.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.880+0000 7f2f7faa19c0 20 Filter name: none 2024-09-12T18:00:20.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.880+0000 7f2e30fe1640 20 reqs_thread_entry: start 2024-09-12T18:00:20.886 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.880+0000 7f2f7faa19c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:20.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.884+0000 7f2f7faa19c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:20.888 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.884+0000 7f2f7faa19c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:20.888 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.884+0000 7f2f7faa19c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:00:20.888 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.884+0000 7f2f7faa19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:20.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.884+0000 7f2f7faa19c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:20.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.884+0000 7f2f7faa19c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:20.889 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.884+0000 7f2f7faa19c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:20.890 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.884+0000 7f2f7faa19c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:00:20.890 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.884+0000 7f2f7faa19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:20.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.888+0000 7f2e33fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:20.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.892+0000 7f2f7faa19c0 20 remove_watcher() i=0 2024-09-12T18:00:20.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.892+0000 7f2f7faa19c0 2 removed watcher, disabling cache 2024-09-12T18:00:20.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.896+0000 7f2f7faa19c0 20 remove_watcher() i=1 2024-09-12T18:00:20.903 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.896+0000 7f2f7faa19c0 20 remove_watcher() i=2 2024-09-12T18:00:20.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.900+0000 7f2f7faa19c0 20 remove_watcher() i=3 2024-09-12T18:00:20.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.904+0000 7f2f7faa19c0 20 remove_watcher() i=4 2024-09-12T18:00:20.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.904+0000 7f2f7faa19c0 20 remove_watcher() i=5 2024-09-12T18:00:20.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.904+0000 7f2f7faa19c0 20 remove_watcher() i=6 2024-09-12T18:00:20.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:20.908+0000 7f2f7faa19c0 20 remove_watcher() i=7 2024-09-12T18:00:20.932 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:20.932 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T18:00:20.932 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-change-reshard-state id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:00:20.932 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:20.933 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T18:00:20.967 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:20.968 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:21.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.008+0000 7f4345d109c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.008+0000 7f4345d109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.008+0000 7f4345d109c0 20 realm 2024-09-12T18:00:21.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.008+0000 7f4345d109c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.008+0000 7f4345d109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.008+0000 7f4345d109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:21.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.008+0000 7f4345d109c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.008+0000 7f4345d109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.008+0000 7f4345d109c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.016 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.012+0000 7f4345d109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:21.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.012+0000 7f4345d109c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.012+0000 7f4345d109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:21.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.012+0000 7f4345d109c0 20 searching for the correct realm 2024-09-12T18:00:21.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.020+0000 7f4343015640 0 -- 172.21.15.98:0/2532844187 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f43340ca030 msgr2=0x7f4334118300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:21.029 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.024+0000 7f4344017640 0 -- 172.21.15.98:0/2532844187 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f433800fc00 msgr2=0x7f43380287d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:00:21.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:21.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:00:21.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:21.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:00:21.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:21.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:21.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:21.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:21.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 20 zone default found 2024-09-12T18:00:21.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 4 Realm: () 2024-09-12T18:00:21.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:00:21.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:00:21.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:21.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 20 zonegroup default 2024-09-12T18:00:21.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.032+0000 7f4345d109c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.036+0000 7f4345d109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.036+0000 7f4345d109c0 20 started sync module instance, tier type = 2024-09-12T18:00:21.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.036+0000 7f4345d109c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:00:21.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.048+0000 7f4345d109c0 20 add_watcher() i=0 2024-09-12T18:00:21.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.048+0000 7f4345d109c0 20 add_watcher() i=1 2024-09-12T18:00:21.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.048+0000 7f4345d109c0 20 add_watcher() i=2 2024-09-12T18:00:21.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.048+0000 7f4345d109c0 20 add_watcher() i=3 2024-09-12T18:00:21.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.048+0000 7f4345d109c0 20 add_watcher() i=4 2024-09-12T18:00:21.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.048+0000 7f4345d109c0 20 add_watcher() i=5 2024-09-12T18:00:21.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.048+0000 7f4345d109c0 20 add_watcher() i=6 2024-09-12T18:00:21.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.052+0000 7f4345d109c0 20 add_watcher() i=7 2024-09-12T18:00:21.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.052+0000 7f4345d109c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:21.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.052+0000 7f41f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:21.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.052+0000 7f4345d109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:21.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.052+0000 7f4345d109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:21.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.052+0000 7f4345d109c0 5 note: GC not initialized 2024-09-12T18:00:21.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.056+0000 7f41f8fe1640 20 reqs_thread_entry: start 2024-09-12T18:00:21.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.056+0000 7f4345d109c0 20 init_complete bucket index max shards: 11 2024-09-12T18:00:21.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.056+0000 7f4345d109c0 20 Filter name: none 2024-09-12T18:00:21.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.056+0000 7f41727fc640 20 reqs_thread_entry: start 2024-09-12T18:00:21.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.056+0000 7f4345d109c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T18:00:21.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.056+0000 7f4345d109c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.056+0000 7f4345d109c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:21.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.056+0000 7f4345d109c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T18:00:21.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.056+0000 7f4345d109c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T18:00:21.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.056+0000 7f4345d109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 : miss 2024-09-12T18:00:21.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.056+0000 7f4345d109c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.056+0000 7f4345d109c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:00:21.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.056+0000 7f4345d109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 info.flags=0x17 2024-09-12T18:00:21.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.056+0000 7f4345d109c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 to cache LRU end 2024-09-12T18:00:21.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.056+0000 7f4345d109c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:21.065 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.056+0000 7f4345d109c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:21.065 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.056+0000 7f4345d109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 2024-09-12T18:00:21.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.068+0000 7f4345d109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 info.flags=0x17 2024-09-12T18:00:21.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.068+0000 7f4345d109c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 to cache LRU end 2024-09-12T18:00:21.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.068+0000 7f4345d109c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:21.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.068+0000 7f4345d109c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37, ofs0, ns] 2024-09-12T18:00:21.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.068+0000 7f4222ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366207 cookie 94794563138944 notifier 7947 bl.length()=931 2024-09-12T18:00:21.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.068+0000 7f4222ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 info.flags=0x17 2024-09-12T18:00:21.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.068+0000 7f4222ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 to cache LRU end 2024-09-12T18:00:21.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.068+0000 7f4222ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:21.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.072+0000 7f4345d109c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.37]): orig_sources= new_sources= 2024-09-12T18:00:21.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.072+0000 7f4345d109c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.37]): potential sources added=[] removed=[] 2024-09-12T18:00:21.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.072+0000 7f4345d109c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.37]): orig_dests= new_dests= 2024-09-12T18:00:21.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.072+0000 7f4345d109c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.37]): potential dests added=[] removed=[] 2024-09-12T18:00:21.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.0 2024-09-12T18:00:21.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.0 2024-09-12T18:00:21.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.1 2024-09-12T18:00:21.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.1 2024-09-12T18:00:21.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.2 2024-09-12T18:00:21.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.2 2024-09-12T18:00:21.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.3 2024-09-12T18:00:21.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.3 2024-09-12T18:00:21.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.4 2024-09-12T18:00:21.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.4 2024-09-12T18:00:21.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.5 2024-09-12T18:00:21.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.5 2024-09-12T18:00:21.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.6 2024-09-12T18:00:21.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.6 2024-09-12T18:00:21.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.7 2024-09-12T18:00:21.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.7 2024-09-12T18:00:21.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.8 2024-09-12T18:00:21.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.8 2024-09-12T18:00:21.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.9 2024-09-12T18:00:21.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.9 2024-09-12T18:00:21.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.10 2024-09-12T18:00:21.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.10 2024-09-12T18:00:21.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.11 2024-09-12T18:00:21.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.11 2024-09-12T18:00:21.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.080+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.0 2024-09-12T18:00:21.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.084+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1 2024-09-12T18:00:21.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.084+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.2 2024-09-12T18:00:21.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.084+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.3 2024-09-12T18:00:21.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.084+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.4 2024-09-12T18:00:21.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.084+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.5 2024-09-12T18:00:21.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.088+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.6 2024-09-12T18:00:21.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.088+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.7 2024-09-12T18:00:21.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.088+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.8 2024-09-12T18:00:21.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.088+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.9 2024-09-12T18:00:21.096 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.092+0000 7f4345d109c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.10 2024-09-12T18:00:21.102 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.096+0000 7f4345d109c0 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T18:00:21.103 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.096+0000 7f4345d109c0 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T18:00:21.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.120+0000 7f4345d109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 : hit (requested=0x17, cached=0x17) 2024-09-12T18:00:21.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.120+0000 7f4345d109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 2024-09-12T18:00:21.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.124+0000 7f4345d109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 info.flags=0x17 2024-09-12T18:00:21.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.124+0000 7f4345d109c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 to cache LRU end 2024-09-12T18:00:21.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.124+0000 7f4345d109c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:21.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.124+0000 7f4345d109c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37, ofs0, ns] 2024-09-12T18:00:21.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.124+0000 7f4222ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366208 cookie 94794563138944 notifier 7947 bl.length()=899 2024-09-12T18:00:21.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.124+0000 7f4222ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 info.flags=0x17 2024-09-12T18:00:21.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.124+0000 7f4222ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 to cache LRU end 2024-09-12T18:00:21.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.124+0000 7f4222ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:21.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.128+0000 7f4345d109c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.37]): orig_sources= new_sources= 2024-09-12T18:00:21.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.128+0000 7f4345d109c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.37]): potential sources added=[] removed=[] 2024-09-12T18:00:21.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.128+0000 7f4345d109c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.37]): orig_dests= new_dests= 2024-09-12T18:00:21.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.128+0000 7f4345d109c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.37]): potential dests added=[] removed=[] 2024-09-12T18:00:21.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.128+0000 7f4345d109c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T18:00:21.136 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.132+0000 7f41f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:21.140 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.136+0000 7f4345d109c0 20 remove_watcher() i=0 2024-09-12T18:00:21.140 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.136+0000 7f4345d109c0 2 removed watcher, disabling cache 2024-09-12T18:00:21.142 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.136+0000 7f4345d109c0 20 remove_watcher() i=1 2024-09-12T18:00:21.145 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.140+0000 7f4345d109c0 20 remove_watcher() i=2 2024-09-12T18:00:21.147 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.140+0000 7f4345d109c0 20 remove_watcher() i=3 2024-09-12T18:00:21.149 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.144+0000 7f4345d109c0 20 remove_watcher() i=4 2024-09-12T18:00:21.150 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.144+0000 7f4345d109c0 20 remove_watcher() i=5 2024-09-12T18:00:21.151 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.148+0000 7f4345d109c0 20 remove_watcher() i=6 2024-09-12T18:00:21.152 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.148+0000 7f4345d109c0 20 remove_watcher() i=7 2024-09-12T18:00:21.167 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T18:00:21.194 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:21.194 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:21.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.232+0000 7fd746c9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.236+0000 7fd746c9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.236+0000 7fd746c9a9c0 20 realm 2024-09-12T18:00:21.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.236+0000 7fd746c9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.236+0000 7fd746c9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.236+0000 7fd746c9a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:21.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.236+0000 7fd746c9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.236+0000 7fd746c9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.236+0000 7fd746c9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.236+0000 7fd746c9a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:21.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.236+0000 7fd746c9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.236+0000 7fd746c9a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:21.242 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.236+0000 7fd746c9a9c0 20 searching for the correct realm 2024-09-12T18:00:21.247 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.244+0000 7fd743f9f640 0 -- 172.21.15.98:0/4124156207 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fd7340dc060 msgr2=0x7fd73412b250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:21.253 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.248+0000 7fd743f9f640 0 -- 172.21.15.98:0/4124156207 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fd7340dc060 msgr2=0x7fd60c085f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:21.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.464+0000 7fd746c9a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:21.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.464+0000 7fd746c9a9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:00:21.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.464+0000 7fd746c9a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:21.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.464+0000 7fd746c9a9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:00:21.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.464+0000 7fd746c9a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:21.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.464+0000 7fd746c9a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:21.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.464+0000 7fd746c9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.464+0000 7fd746c9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.464+0000 7fd746c9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.468+0000 7fd746c9a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:21.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.468+0000 7fd746c9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.468+0000 7fd746c9a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:21.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.468+0000 7fd746c9a9c0 20 zone default found 2024-09-12T18:00:21.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.468+0000 7fd746c9a9c0 4 Realm: () 2024-09-12T18:00:21.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.468+0000 7fd746c9a9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:00:21.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.468+0000 7fd746c9a9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:00:21.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.468+0000 7fd746c9a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:21.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.468+0000 7fd746c9a9c0 20 zonegroup default 2024-09-12T18:00:21.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.468+0000 7fd746c9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.468+0000 7fd746c9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.468+0000 7fd746c9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.468+0000 7fd746c9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.468+0000 7fd746c9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.468+0000 7fd746c9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.468+0000 7fd746c9a9c0 20 started sync module instance, tier type = 2024-09-12T18:00:21.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.468+0000 7fd746c9a9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:00:21.495 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.488+0000 7fd746c9a9c0 20 add_watcher() i=0 2024-09-12T18:00:21.495 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.488+0000 7fd746c9a9c0 20 add_watcher() i=1 2024-09-12T18:00:21.495 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.488+0000 7fd746c9a9c0 20 add_watcher() i=2 2024-09-12T18:00:21.495 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.488+0000 7fd746c9a9c0 20 add_watcher() i=3 2024-09-12T18:00:21.495 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.488+0000 7fd746c9a9c0 20 add_watcher() i=4 2024-09-12T18:00:21.495 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.488+0000 7fd746c9a9c0 20 add_watcher() i=5 2024-09-12T18:00:21.495 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.488+0000 7fd746c9a9c0 20 add_watcher() i=6 2024-09-12T18:00:21.496 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.492+0000 7fd746c9a9c0 20 add_watcher() i=7 2024-09-12T18:00:21.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.492+0000 7fd746c9a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:21.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.496+0000 7fd5fb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:21.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.496+0000 7fd746c9a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:21.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.496+0000 7fd746c9a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:21.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.496+0000 7fd746c9a9c0 5 note: GC not initialized 2024-09-12T18:00:21.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.496+0000 7fd5fa7dc640 20 reqs_thread_entry: start 2024-09-12T18:00:21.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.496+0000 7fd746c9a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:00:21.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.496+0000 7fd746c9a9c0 20 Filter name: none 2024-09-12T18:00:21.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.496+0000 7fd5f37fe640 20 reqs_thread_entry: start 2024-09-12T18:00:21.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.496+0000 7fd746c9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.496+0000 7fd746c9a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:21.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.496+0000 7fd746c9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.496+0000 7fd746c9a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:00:21.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.496+0000 7fd746c9a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:21.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.496+0000 7fd746c9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.500+0000 7fd746c9a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:21.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.500+0000 7fd746c9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.504 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.500+0000 7fd746c9a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:00:21.504 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.500+0000 7fd746c9a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:21.507 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.504+0000 7fd5fb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:21.511 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.508+0000 7fd746c9a9c0 20 remove_watcher() i=0 2024-09-12T18:00:21.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.508+0000 7fd746c9a9c0 2 removed watcher, disabling cache 2024-09-12T18:00:21.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.508+0000 7fd746c9a9c0 20 remove_watcher() i=1 2024-09-12T18:00:21.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.512+0000 7fd746c9a9c0 20 remove_watcher() i=2 2024-09-12T18:00:21.518 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.512+0000 7fd746c9a9c0 20 remove_watcher() i=3 2024-09-12T18:00:21.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.516+0000 7fd746c9a9c0 20 remove_watcher() i=4 2024-09-12T18:00:21.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.516+0000 7fd746c9a9c0 20 remove_watcher() i=5 2024-09-12T18:00:21.523 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.520+0000 7fd746c9a9c0 20 remove_watcher() i=6 2024-09-12T18:00:21.525 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.520+0000 7fd746c9a9c0 20 remove_watcher() i=7 2024-09-12T18:00:21.539 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:21.539 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T18:00:21.539 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-change-reshard-state id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:00:21.539 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:21.540 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:21.540 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:21.593 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:21.593 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:21.657 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:00:21.693 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:21.693 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:21.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.736+0000 7f2ff83b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.736+0000 7f2ff83b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.736+0000 7f2ff83b79c0 20 realm 2024-09-12T18:00:21.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.736+0000 7f2ff83b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.736+0000 7f2ff83b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.736+0000 7f2ff83b79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:21.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.736+0000 7f2ff83b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.743 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.740+0000 7f2ff83b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.744 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.740+0000 7f2ff83b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.740+0000 7f2ff83b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:21.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.740+0000 7f2ff83b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.740+0000 7f2ff83b79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:21.746 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.740+0000 7f2ff83b79c0 20 searching for the correct realm 2024-09-12T18:00:21.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.744+0000 7f2ff56bc640 0 -- 172.21.15.98:0/3336811320 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55739b6fa9e0 msgr2=0x55739b6fce80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:00:21.760 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.752+0000 7f2ff5ebd640 0 -- 172.21.15.98:0/3336811320 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f2fec114bc0 msgr2=0x7f2fec0d2610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:21.765 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.760+0000 7f2ff83b79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:21.765 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.760+0000 7f2ff83b79c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:00:21.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.760+0000 7f2ff83b79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:21.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.760+0000 7f2ff83b79c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:00:21.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.760+0000 7f2ff83b79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:21.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.760+0000 7f2ff83b79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:21.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.760+0000 7f2ff83b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.760+0000 7f2ff83b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.760+0000 7f2ff83b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.760+0000 7f2ff83b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:21.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.760+0000 7f2ff83b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.767 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.760+0000 7f2ff83b79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:21.767 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.760+0000 7f2ff83b79c0 20 zone default found 2024-09-12T18:00:21.768 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.760+0000 7f2ff83b79c0 4 Realm: () 2024-09-12T18:00:21.768 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.760+0000 7f2ff83b79c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:00:21.768 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.760+0000 7f2ff83b79c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:00:21.768 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.760+0000 7f2ff83b79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:21.768 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.760+0000 7f2ff83b79c0 20 zonegroup default 2024-09-12T18:00:21.768 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.764+0000 7f2ff83b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.768 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.764+0000 7f2ff83b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.768 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.764+0000 7f2ff83b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.769 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.764+0000 7f2ff83b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.769 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.764+0000 7f2ff83b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.769 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.764+0000 7f2ff83b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.769 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.764+0000 7f2ff83b79c0 20 started sync module instance, tier type = 2024-09-12T18:00:21.769 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.764+0000 7f2ff83b79c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:00:21.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.780+0000 7f2ff83b79c0 20 add_watcher() i=0 2024-09-12T18:00:21.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.780+0000 7f2ff83b79c0 20 add_watcher() i=1 2024-09-12T18:00:21.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.780+0000 7f2ff83b79c0 20 add_watcher() i=2 2024-09-12T18:00:21.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.780+0000 7f2ff83b79c0 20 add_watcher() i=3 2024-09-12T18:00:21.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.780+0000 7f2ff83b79c0 20 add_watcher() i=4 2024-09-12T18:00:21.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.780+0000 7f2ff83b79c0 20 add_watcher() i=5 2024-09-12T18:00:21.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.780+0000 7f2ff83b79c0 20 add_watcher() i=6 2024-09-12T18:00:21.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.780+0000 7f2ff83b79c0 20 add_watcher() i=7 2024-09-12T18:00:21.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.780+0000 7f2ff83b79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:21.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2ea77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:21.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2ff83b79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:21.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2ff83b79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:21.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2ff83b79c0 5 note: GC not initialized 2024-09-12T18:00:21.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2ea67fc640 20 reqs_thread_entry: start 2024-09-12T18:00:21.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2ff83b79c0 20 init_complete bucket index max shards: 11 2024-09-12T18:00:21.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2ff83b79c0 20 Filter name: none 2024-09-12T18:00:21.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2ff83b79c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T18:00:21.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2e17fff640 20 reqs_thread_entry: start 2024-09-12T18:00:21.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2ff83b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2ff83b79c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:21.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2ff83b79c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T18:00:21.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2ff83b79c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T18:00:21.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2ff83b79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 : miss 2024-09-12T18:00:21.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2ff83b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2ff83b79c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:00:21.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2ff83b79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 info.flags=0x17 2024-09-12T18:00:21.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2ff83b79c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 to cache LRU end 2024-09-12T18:00:21.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2ff83b79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:21.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2ff83b79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:21.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.784+0000 7f2ff83b79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 2024-09-12T18:00:21.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.796+0000 7f2ff83b79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 info.flags=0x17 2024-09-12T18:00:21.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.796+0000 7f2ff83b79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 to cache LRU end 2024-09-12T18:00:21.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.796+0000 7f2ff83b79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:21.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.796+0000 7f2ff83b79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37, ofs0, ns] 2024-09-12T18:00:21.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.796+0000 7f2ed97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366209 cookie 93955017441632 notifier 7986 bl.length()=931 2024-09-12T18:00:21.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.796+0000 7f2ed97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 info.flags=0x17 2024-09-12T18:00:21.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.796+0000 7f2ed97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 to cache LRU end 2024-09-12T18:00:21.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.796+0000 7f2ed97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:21.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.800+0000 7f2ff83b79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.37]): orig_sources= new_sources= 2024-09-12T18:00:21.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.800+0000 7f2ff83b79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.37]): potential sources added=[] removed=[] 2024-09-12T18:00:21.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.800+0000 7f2ff83b79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.37]): orig_dests= new_dests= 2024-09-12T18:00:21.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.800+0000 7f2ff83b79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.37]): potential dests added=[] removed=[] 2024-09-12T18:00:21.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.0 2024-09-12T18:00:21.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.0 2024-09-12T18:00:21.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.1 2024-09-12T18:00:21.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.1 2024-09-12T18:00:21.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.2 2024-09-12T18:00:21.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.2 2024-09-12T18:00:21.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.3 2024-09-12T18:00:21.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.3 2024-09-12T18:00:21.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.4 2024-09-12T18:00:21.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.4 2024-09-12T18:00:21.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.5 2024-09-12T18:00:21.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.5 2024-09-12T18:00:21.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.6 2024-09-12T18:00:21.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.6 2024-09-12T18:00:21.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.7 2024-09-12T18:00:21.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.7 2024-09-12T18:00:21.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.8 2024-09-12T18:00:21.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.8 2024-09-12T18:00:21.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.9 2024-09-12T18:00:21.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.9 2024-09-12T18:00:21.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.10 2024-09-12T18:00:21.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.10 2024-09-12T18:00:21.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.11 2024-09-12T18:00:21.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1.11 2024-09-12T18:00:21.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.0 2024-09-12T18:00:21.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1 2024-09-12T18:00:21.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.2 2024-09-12T18:00:21.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.3 2024-09-12T18:00:21.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.812+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.4 2024-09-12T18:00:21.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.816+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.5 2024-09-12T18:00:21.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.816+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.6 2024-09-12T18:00:21.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.816+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.7 2024-09-12T18:00:21.822 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.816+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.8 2024-09-12T18:00:21.822 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.816+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.9 2024-09-12T18:00:21.824 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.820+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.10 2024-09-12T18:00:21.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.824+0000 7f2ff83b79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 : hit (requested=0x17, cached=0x17) 2024-09-12T18:00:21.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.824+0000 7f2ff83b79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 2024-09-12T18:00:21.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.828+0000 7f2ff83b79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 info.flags=0x17 2024-09-12T18:00:21.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.828+0000 7f2ff83b79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 to cache LRU end 2024-09-12T18:00:21.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.828+0000 7f2ff83b79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:21.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.828+0000 7f2ff83b79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37, ofs0, ns] 2024-09-12T18:00:21.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.828+0000 7f2ed8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366210 cookie 93955017441632 notifier 7986 bl.length()=931 2024-09-12T18:00:21.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.828+0000 7f2ed8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 info.flags=0x17 2024-09-12T18:00:21.834 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.828+0000 7f2ed8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 to cache LRU end 2024-09-12T18:00:21.835 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.828+0000 7f2ed8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:21.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.832+0000 7f2ff83b79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.37]): orig_sources= new_sources= 2024-09-12T18:00:21.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.832+0000 7f2ff83b79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.37]): potential sources added=[] removed=[] 2024-09-12T18:00:21.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.832+0000 7f2ff83b79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.37]): orig_dests= new_dests= 2024-09-12T18:00:21.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.832+0000 7f2ff83b79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.37]): potential dests added=[] removed=[] 2024-09-12T18:00:21.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.836+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.0 2024-09-12T18:00:21.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.836+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.1 2024-09-12T18:00:21.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.836+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.2 2024-09-12T18:00:21.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.840+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.3 2024-09-12T18:00:21.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.840+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.4 2024-09-12T18:00:21.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.840+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.5 2024-09-12T18:00:21.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.840+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.6 2024-09-12T18:00:21.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.840+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.7 2024-09-12T18:00:21.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.840+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.8 2024-09-12T18:00:21.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.840+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.9 2024-09-12T18:00:21.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.840+0000 7f2ff83b79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.37.10 2024-09-12T18:00:21.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.844+0000 7f2ff83b79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 : hit (requested=0x17, cached=0x17) 2024-09-12T18:00:21.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.844+0000 7f2ff83b79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 2024-09-12T18:00:21.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.844+0000 7f2ff83b79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 info.flags=0x17 2024-09-12T18:00:21.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.844+0000 7f2ff83b79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 to cache LRU end 2024-09-12T18:00:21.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.844+0000 7f2ff83b79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:21.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.844+0000 7f2ff83b79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37, ofs0, ns] 2024-09-12T18:00:21.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.848+0000 7f2ed97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366211 cookie 93955017441632 notifier 7986 bl.length()=899 2024-09-12T18:00:21.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.848+0000 7f2ed97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 info.flags=0x17 2024-09-12T18:00:21.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.848+0000 7f2ed97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 to cache LRU end 2024-09-12T18:00:21.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.848+0000 7f2ed97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:21.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.848+0000 7f2ff83b79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.37]): orig_sources= new_sources= 2024-09-12T18:00:21.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.848+0000 7f2ff83b79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.37]): potential sources added=[] removed=[] 2024-09-12T18:00:21.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.848+0000 7f2ff83b79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.37]): orig_dests= new_dests= 2024-09-12T18:00:21.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.848+0000 7f2ff83b79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.37]): potential dests added=[] removed=[] 2024-09-12T18:00:21.860 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.856+0000 7f2ff83b79c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T18:00:21.864 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.860+0000 7f2ea77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:21.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.864+0000 7f2ff83b79c0 20 remove_watcher() i=0 2024-09-12T18:00:21.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.864+0000 7f2ff83b79c0 2 removed watcher, disabling cache 2024-09-12T18:00:21.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.864+0000 7f2ff83b79c0 20 remove_watcher() i=1 2024-09-12T18:00:21.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.868+0000 7f2ff83b79c0 20 remove_watcher() i=2 2024-09-12T18:00:21.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.872+0000 7f2ff83b79c0 20 remove_watcher() i=3 2024-09-12T18:00:21.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.872+0000 7f2ff83b79c0 20 remove_watcher() i=4 2024-09-12T18:00:21.878 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.872+0000 7f2ff83b79c0 20 remove_watcher() i=5 2024-09-12T18:00:21.879 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.876+0000 7f2ff83b79c0 20 remove_watcher() i=6 2024-09-12T18:00:21.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.876+0000 7f2ff83b79c0 20 remove_watcher() i=7 2024-09-12T18:00:21.895 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T18:00:21.921 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:21.921 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:21.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.956+0000 7f8f8c87d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.960+0000 7f8f8c87d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.960+0000 7f8f8c87d9c0 20 realm 2024-09-12T18:00:21.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.960+0000 7f8f8c87d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.960+0000 7f8f8c87d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.960+0000 7f8f8c87d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:21.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.960+0000 7f8f8c87d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.960+0000 7f8f8c87d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:21.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.960+0000 7f8f8c87d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.960+0000 7f8f8c87d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:21.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.960+0000 7f8f8c87d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:21.967 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.960+0000 7f8f8c87d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:21.967 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.960+0000 7f8f8c87d9c0 20 searching for the correct realm 2024-09-12T18:00:21.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.968+0000 7f8f8ab84640 0 -- 172.21.15.98:0/1808141582 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f8f74008040 msgr2=0x7f8f74008930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:21.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:21.972+0000 7f8f8a383640 0 -- 172.21.15.98:0/1808141582 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f8f7402c3f0 msgr2=0x7f8f7402c850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:22.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:22.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:00:22.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:22.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:00:22.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:22.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:22.196 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:22.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:22.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:22.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:22.197 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:22.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:22.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 20 zone default found 2024-09-12T18:00:22.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 4 Realm: () 2024-09-12T18:00:22.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:00:22.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:00:22.198 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:22.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 20 zonegroup default 2024-09-12T18:00:22.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:22.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:22.199 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.192+0000 7f8f8c87d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:22.200 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.196+0000 7f8f8c87d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:22.200 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.196+0000 7f8f8c87d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:22.200 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.196+0000 7f8f8c87d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:22.200 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.196+0000 7f8f8c87d9c0 20 started sync module instance, tier type = 2024-09-12T18:00:22.200 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.196+0000 7f8f8c87d9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:00:22.226 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.220+0000 7f8f8c87d9c0 20 add_watcher() i=0 2024-09-12T18:00:22.226 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.220+0000 7f8f8c87d9c0 20 add_watcher() i=1 2024-09-12T18:00:22.226 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.220+0000 7f8f8c87d9c0 20 add_watcher() i=2 2024-09-12T18:00:22.226 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.220+0000 7f8f8c87d9c0 20 add_watcher() i=3 2024-09-12T18:00:22.226 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.220+0000 7f8f8c87d9c0 20 add_watcher() i=4 2024-09-12T18:00:22.226 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.220+0000 7f8f8c87d9c0 20 add_watcher() i=5 2024-09-12T18:00:22.226 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.220+0000 7f8f8c87d9c0 20 add_watcher() i=6 2024-09-12T18:00:22.228 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.224+0000 7f8f8c87d9c0 20 add_watcher() i=7 2024-09-12T18:00:22.228 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.224+0000 7f8f8c87d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:22.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.228+0000 7f8e40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:22.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.228+0000 7f8f8c87d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:22.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.228+0000 7f8f8c87d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:22.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.228+0000 7f8f8c87d9c0 5 note: GC not initialized 2024-09-12T18:00:22.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.228+0000 7f8dbb7fe640 20 reqs_thread_entry: start 2024-09-12T18:00:22.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.228+0000 7f8f8c87d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:00:22.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.228+0000 7f8f8c87d9c0 20 Filter name: none 2024-09-12T18:00:22.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.228+0000 7f8db97fa640 20 reqs_thread_entry: start 2024-09-12T18:00:22.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.228+0000 7f8f8c87d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:22.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.232+0000 7f8f8c87d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:22.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.232+0000 7f8f8c87d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:22.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.232+0000 7f8f8c87d9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:00:22.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.232+0000 7f8f8c87d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:22.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.232+0000 7f8f8c87d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:22.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.232+0000 7f8f8c87d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:22.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.232+0000 7f8f8c87d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:22.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.232+0000 7f8f8c87d9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:00:22.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.232+0000 7f8f8c87d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:22.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.236+0000 7f8e40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:22.246 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.240+0000 7f8f8c87d9c0 20 remove_watcher() i=0 2024-09-12T18:00:22.246 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.240+0000 7f8f8c87d9c0 2 removed watcher, disabling cache 2024-09-12T18:00:22.248 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.244+0000 7f8f8c87d9c0 20 remove_watcher() i=1 2024-09-12T18:00:22.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.244+0000 7f8f8c87d9c0 20 remove_watcher() i=2 2024-09-12T18:00:22.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.248+0000 7f8f8c87d9c0 20 remove_watcher() i=3 2024-09-12T18:00:22.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.248+0000 7f8f8c87d9c0 20 remove_watcher() i=4 2024-09-12T18:00:22.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.252+0000 7f8f8c87d9c0 20 remove_watcher() i=5 2024-09-12T18:00:22.256 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.252+0000 7f8f8c87d9c0 20 remove_watcher() i=6 2024-09-12T18:00:22.258 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:22.252+0000 7f8f8c87d9c0 20 remove_watcher() i=7 2024-09-12T18:00:22.274 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:22.274 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T18:00:22.275 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-change-reshard-state id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:00:22.275 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:22.276 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:22.276 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:22.300 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:22.300 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:22.848 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:22.848 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:23.219 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T18:00:23.219 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:23.222 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:23.222 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:23.357 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:23.357 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:23.443 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:23.443 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:23.536 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:23.536 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:23.633 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:23.633 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:23.736 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:23.736 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:23.830 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:23.830 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:23.922 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:23.922 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:24.025 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:24.025 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:24.124 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:24.124 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:24.221 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:24.221 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:24.313 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:24.313 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:24.412 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:24.412 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:24.506 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:24.506 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:24.601 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:24.601 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:24.699 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:24.699 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:24.789 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:24.789 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:24.894 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:24.894 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:24.998 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:24.998 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:25.097 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:25.097 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:25.196 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:25.196 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:25.295 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:25.295 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:25.390 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T18:00:25.422 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:25.422 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:25.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.464+0000 7f75673c59c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.464+0000 7f75673c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.464+0000 7f75673c59c0 20 realm 2024-09-12T18:00:25.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.464+0000 7f75673c59c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.464+0000 7f75673c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.464+0000 7f75673c59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:25.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.464+0000 7f75673c59c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.464+0000 7f75673c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.464+0000 7f75673c59c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.468+0000 7f75673c59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:25.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.468+0000 7f75673c59c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.468+0000 7f75673c59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:25.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.468+0000 7f75673c59c0 20 searching for the correct realm 2024-09-12T18:00:25.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.472+0000 7f75646ca640 0 -- 172.21.15.98:0/1473777924 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f7550002300 msgr2=0x7f7554097220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:25.693 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.688+0000 7f7564ecb640 0 -- 172.21.15.98:0/1473777924 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f754c106be0 msgr2=0x7f754c1249b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:25.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.904+0000 7f75673c59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:25.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.904+0000 7f75673c59c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:00:25.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.904+0000 7f75673c59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:25.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.904+0000 7f75673c59c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:00:25.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.904+0000 7f75673c59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:25.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.904+0000 7f75673c59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:25.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.904+0000 7f75673c59c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.904+0000 7f75673c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.904+0000 7f75673c59c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.908+0000 7f75673c59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:25.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.908+0000 7f75673c59c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.908+0000 7f75673c59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:25.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.908+0000 7f75673c59c0 20 zone default found 2024-09-12T18:00:25.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.908+0000 7f75673c59c0 4 Realm: () 2024-09-12T18:00:25.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.908+0000 7f75673c59c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:00:25.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.908+0000 7f75673c59c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:00:25.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.908+0000 7f75673c59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:25.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.908+0000 7f75673c59c0 20 zonegroup default 2024-09-12T18:00:25.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.908+0000 7f75673c59c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.908+0000 7f75673c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.908+0000 7f75673c59c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.908+0000 7f75673c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.908+0000 7f75673c59c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.908+0000 7f75673c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:25.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.908+0000 7f75673c59c0 20 started sync module instance, tier type = 2024-09-12T18:00:25.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.908+0000 7f75673c59c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:00:25.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.932+0000 7f75673c59c0 20 add_watcher() i=0 2024-09-12T18:00:25.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.932+0000 7f75673c59c0 20 add_watcher() i=1 2024-09-12T18:00:25.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.932+0000 7f75673c59c0 20 add_watcher() i=2 2024-09-12T18:00:25.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.932+0000 7f75673c59c0 20 add_watcher() i=3 2024-09-12T18:00:25.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.932+0000 7f75673c59c0 20 add_watcher() i=4 2024-09-12T18:00:25.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.932+0000 7f75673c59c0 20 add_watcher() i=5 2024-09-12T18:00:25.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.932+0000 7f75673c59c0 20 add_watcher() i=6 2024-09-12T18:00:25.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.936+0000 7f75673c59c0 20 add_watcher() i=7 2024-09-12T18:00:25.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.936+0000 7f75673c59c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:25.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.940+0000 7f741afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:25.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.940+0000 7f75673c59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:25.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.940+0000 7f75673c59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:25.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.940+0000 7f75673c59c0 5 note: GC not initialized 2024-09-12T18:00:25.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.940+0000 7f7419fe3640 20 reqs_thread_entry: start 2024-09-12T18:00:25.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.940+0000 7f75673c59c0 20 init_complete bucket index max shards: 11 2024-09-12T18:00:25.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.940+0000 7f75673c59c0 20 Filter name: none 2024-09-12T18:00:25.947 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.940+0000 7f738b7fe640 20 reqs_thread_entry: start 2024-09-12T18:00:25.947 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.940+0000 7f75673c59c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.948 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.944+0000 7f75673c59c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:25.948 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.944+0000 7f75673c59c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.944+0000 7f75673c59c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:00:25.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.944+0000 7f75673c59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:25.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.944+0000 7f75673c59c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.944+0000 7f75673c59c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:25.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.944+0000 7f75673c59c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:25.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.944+0000 7f75673c59c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:00:25.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.944+0000 7f75673c59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:25.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.948+0000 7f741afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:25.958 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.952+0000 7f75673c59c0 20 remove_watcher() i=0 2024-09-12T18:00:25.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.952+0000 7f75673c59c0 2 removed watcher, disabling cache 2024-09-12T18:00:25.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.956+0000 7f75673c59c0 20 remove_watcher() i=1 2024-09-12T18:00:25.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.960+0000 7f75673c59c0 20 remove_watcher() i=2 2024-09-12T18:00:25.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.960+0000 7f75673c59c0 20 remove_watcher() i=3 2024-09-12T18:00:25.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.964+0000 7f75673c59c0 20 remove_watcher() i=4 2024-09-12T18:00:25.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.964+0000 7f75673c59c0 20 remove_watcher() i=5 2024-09-12T18:00:25.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.964+0000 7f75673c59c0 20 remove_watcher() i=6 2024-09-12T18:00:25.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:25.968+0000 7f75673c59c0 20 remove_watcher() i=7 2024-09-12T18:00:25.990 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:25.990 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T18:00:25.991 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-change-reshard-state id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:00:25.991 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:25.991 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T18:00:26.031 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:26.031 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:26.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.072+0000 7ff17cec79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.072+0000 7ff17cec79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:26.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.072+0000 7ff17cec79c0 20 realm 2024-09-12T18:00:26.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.072+0000 7ff17cec79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.076+0000 7ff17cec79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:26.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.076+0000 7ff17cec79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:26.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.076+0000 7ff17cec79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.076+0000 7ff17cec79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:26.080 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.076+0000 7ff17cec79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.076+0000 7ff17cec79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:26.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.076+0000 7ff17cec79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.082 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.076+0000 7ff17cec79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:26.082 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.076+0000 7ff17cec79c0 20 searching for the correct realm 2024-09-12T18:00:26.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.080+0000 7ff17b1ce640 0 -- 172.21.15.98:0/327026295 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7ff17001f030 msgr2=0x7ff170039400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:26.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.088+0000 7ff17a9cd640 0 -- 172.21.15.98:0/327026295 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7ff170039910 msgr2=0x7ff17002b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:26.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.304+0000 7ff17cec79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:26.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.304+0000 7ff17cec79c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:00:26.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.304+0000 7ff17cec79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:26.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.304+0000 7ff17cec79c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:00:26.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.304+0000 7ff17cec79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:26.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.304+0000 7ff17cec79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:26.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.304+0000 7ff17cec79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.304+0000 7ff17cec79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:26.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.304+0000 7ff17cec79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.312 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.308+0000 7ff17cec79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:26.312 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.308+0000 7ff17cec79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.308+0000 7ff17cec79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:26.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.308+0000 7ff17cec79c0 20 zone default found 2024-09-12T18:00:26.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.308+0000 7ff17cec79c0 4 Realm: () 2024-09-12T18:00:26.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.308+0000 7ff17cec79c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:00:26.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.308+0000 7ff17cec79c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:00:26.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.308+0000 7ff17cec79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:26.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.308+0000 7ff17cec79c0 20 zonegroup default 2024-09-12T18:00:26.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.308+0000 7ff17cec79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.308+0000 7ff17cec79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:26.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.308+0000 7ff17cec79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.308+0000 7ff17cec79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:26.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.308+0000 7ff17cec79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.312+0000 7ff17cec79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:26.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.312+0000 7ff17cec79c0 20 started sync module instance, tier type = 2024-09-12T18:00:26.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.312+0000 7ff17cec79c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:00:26.339 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.332+0000 7ff17cec79c0 20 add_watcher() i=0 2024-09-12T18:00:26.339 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.332+0000 7ff17cec79c0 20 add_watcher() i=1 2024-09-12T18:00:26.339 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.332+0000 7ff17cec79c0 20 add_watcher() i=2 2024-09-12T18:00:26.339 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.332+0000 7ff17cec79c0 20 add_watcher() i=3 2024-09-12T18:00:26.339 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.332+0000 7ff17cec79c0 20 add_watcher() i=4 2024-09-12T18:00:26.339 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.332+0000 7ff17cec79c0 20 add_watcher() i=5 2024-09-12T18:00:26.339 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.332+0000 7ff17cec79c0 20 add_watcher() i=6 2024-09-12T18:00:26.341 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.336+0000 7ff17cec79c0 20 add_watcher() i=7 2024-09-12T18:00:26.341 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.336+0000 7ff17cec79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:26.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.340+0000 7ff0317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:26.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.340+0000 7ff17cec79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:26.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.340+0000 7ff17cec79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:26.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.340+0000 7ff17cec79c0 5 note: GC not initialized 2024-09-12T18:00:26.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.340+0000 7fefabfff640 20 reqs_thread_entry: start 2024-09-12T18:00:26.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.340+0000 7ff17cec79c0 20 init_complete bucket index max shards: 11 2024-09-12T18:00:26.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.340+0000 7ff17cec79c0 20 Filter name: none 2024-09-12T18:00:26.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.344+0000 7fefa9ffb640 20 reqs_thread_entry: start 2024-09-12T18:00:26.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.344+0000 7ff17cec79c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T18:00:26.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.344+0000 7ff17cec79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.344+0000 7ff17cec79c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:26.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.344+0000 7ff17cec79c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T18:00:26.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.344+0000 7ff17cec79c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T18:00:26.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.344+0000 7ff17cec79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 : miss 2024-09-12T18:00:26.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.344+0000 7ff17cec79c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.344+0000 7ff17cec79c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:00:26.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.344+0000 7ff17cec79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 info.flags=0x17 2024-09-12T18:00:26.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.344+0000 7ff17cec79c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 to cache LRU end 2024-09-12T18:00:26.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.344+0000 7ff17cec79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:26.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.344+0000 7ff17cec79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:26.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.344+0000 7ff17cec79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 2024-09-12T18:00:26.360 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.356+0000 7ff17cec79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 info.flags=0x17 2024-09-12T18:00:26.360 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.356+0000 7ff17cec79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 to cache LRU end 2024-09-12T18:00:26.360 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.356+0000 7ff17cec79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:26.360 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.356+0000 7ff17cec79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38, ofs0, ns] 2024-09-12T18:00:26.361 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.356+0000 7ff05e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366214 cookie 94720267452112 notifier 8046 bl.length()=931 2024-09-12T18:00:26.361 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.356+0000 7ff05e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 info.flags=0x17 2024-09-12T18:00:26.361 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.356+0000 7ff05e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 to cache LRU end 2024-09-12T18:00:26.361 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.356+0000 7ff05e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:26.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.360+0000 7ff17cec79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.38]): orig_sources= new_sources= 2024-09-12T18:00:26.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.360+0000 7ff17cec79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.38]): potential sources added=[] removed=[] 2024-09-12T18:00:26.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.360+0000 7ff17cec79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.38]): orig_dests= new_dests= 2024-09-12T18:00:26.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.360+0000 7ff17cec79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.38]): potential dests added=[] removed=[] 2024-09-12T18:00:26.374 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.0 2024-09-12T18:00:26.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.0 2024-09-12T18:00:26.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.1 2024-09-12T18:00:26.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.1 2024-09-12T18:00:26.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.2 2024-09-12T18:00:26.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.2 2024-09-12T18:00:26.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.3 2024-09-12T18:00:26.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.3 2024-09-12T18:00:26.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.4 2024-09-12T18:00:26.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.4 2024-09-12T18:00:26.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.5 2024-09-12T18:00:26.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.5 2024-09-12T18:00:26.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.6 2024-09-12T18:00:26.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.6 2024-09-12T18:00:26.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.7 2024-09-12T18:00:26.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.7 2024-09-12T18:00:26.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.8 2024-09-12T18:00:26.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.8 2024-09-12T18:00:26.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.9 2024-09-12T18:00:26.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.9 2024-09-12T18:00:26.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.10 2024-09-12T18:00:26.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.10 2024-09-12T18:00:26.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.11 2024-09-12T18:00:26.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1.11 2024-09-12T18:00:26.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.368+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.0 2024-09-12T18:00:26.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.372+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1 2024-09-12T18:00:26.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.372+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.2 2024-09-12T18:00:26.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.372+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.3 2024-09-12T18:00:26.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.372+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.4 2024-09-12T18:00:26.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.376+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.5 2024-09-12T18:00:26.381 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.376+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.6 2024-09-12T18:00:26.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.376+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.7 2024-09-12T18:00:26.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.380+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.8 2024-09-12T18:00:26.384 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.380+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.9 2024-09-12T18:00:26.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.380+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.10 2024-09-12T18:00:26.391 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.388+0000 7ff17cec79c0 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T18:00:26.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.388+0000 7ff17cec79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 : hit (requested=0x17, cached=0x17) 2024-09-12T18:00:26.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.388+0000 7ff17cec79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 2024-09-12T18:00:26.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.388+0000 7ff17cec79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 info.flags=0x17 2024-09-12T18:00:26.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.388+0000 7ff17cec79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 to cache LRU end 2024-09-12T18:00:26.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.388+0000 7ff17cec79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:26.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.388+0000 7ff17cec79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38, ofs0, ns] 2024-09-12T18:00:26.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.392+0000 7ff05e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366215 cookie 94720267452112 notifier 8046 bl.length()=931 2024-09-12T18:00:26.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.392+0000 7ff05e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 info.flags=0x17 2024-09-12T18:00:26.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.392+0000 7ff05e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 to cache LRU end 2024-09-12T18:00:26.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.392+0000 7ff05e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:26.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.392+0000 7ff17cec79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.38]): orig_sources= new_sources= 2024-09-12T18:00:26.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.392+0000 7ff17cec79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.38]): potential sources added=[] removed=[] 2024-09-12T18:00:26.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.392+0000 7ff17cec79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.38]): orig_dests= new_dests= 2024-09-12T18:00:26.398 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.392+0000 7ff17cec79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.38]): potential dests added=[] removed=[] 2024-09-12T18:00:26.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.400+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.0 2024-09-12T18:00:26.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.400+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.1 2024-09-12T18:00:26.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.400+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.2 2024-09-12T18:00:26.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.400+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.3 2024-09-12T18:00:26.407 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.400+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.4 2024-09-12T18:00:26.407 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.404+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.5 2024-09-12T18:00:26.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.404+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.6 2024-09-12T18:00:26.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.404+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.7 2024-09-12T18:00:26.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.404+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.8 2024-09-12T18:00:26.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.404+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.9 2024-09-12T18:00:26.412 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.408+0000 7ff17cec79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.38.10 2024-09-12T18:00:26.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.408+0000 7ff17cec79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 : hit (requested=0x17, cached=0x17) 2024-09-12T18:00:26.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.408+0000 7ff17cec79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 2024-09-12T18:00:26.415 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.412+0000 7ff17cec79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 info.flags=0x17 2024-09-12T18:00:26.415 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.412+0000 7ff17cec79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 to cache LRU end 2024-09-12T18:00:26.416 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.412+0000 7ff17cec79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:26.416 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.412+0000 7ff17cec79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38, ofs0, ns] 2024-09-12T18:00:26.416 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.412+0000 7ff05dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366216 cookie 94720267452112 notifier 8046 bl.length()=899 2024-09-12T18:00:26.416 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.412+0000 7ff05dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 info.flags=0x17 2024-09-12T18:00:26.416 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.412+0000 7ff05dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 to cache LRU end 2024-09-12T18:00:26.416 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.412+0000 7ff05dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:26.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.412+0000 7ff17cec79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.38]): orig_sources= new_sources= 2024-09-12T18:00:26.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.412+0000 7ff17cec79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.38]): potential sources added=[] removed=[] 2024-09-12T18:00:26.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.412+0000 7ff17cec79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.38]): orig_dests= new_dests= 2024-09-12T18:00:26.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.412+0000 7ff17cec79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.38]): potential dests added=[] removed=[] 2024-09-12T18:00:26.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.420+0000 7ff17cec79c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T18:00:26.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.424+0000 7ff0317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:26.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.428+0000 7ff17cec79c0 20 remove_watcher() i=0 2024-09-12T18:00:26.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.428+0000 7ff17cec79c0 2 removed watcher, disabling cache 2024-09-12T18:00:26.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.428+0000 7ff17cec79c0 20 remove_watcher() i=1 2024-09-12T18:00:26.437 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.432+0000 7ff17cec79c0 20 remove_watcher() i=2 2024-09-12T18:00:26.439 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.436+0000 7ff17cec79c0 20 remove_watcher() i=3 2024-09-12T18:00:26.441 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.436+0000 7ff17cec79c0 20 remove_watcher() i=4 2024-09-12T18:00:26.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.436+0000 7ff17cec79c0 20 remove_watcher() i=5 2024-09-12T18:00:26.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.440+0000 7ff17cec79c0 20 remove_watcher() i=6 2024-09-12T18:00:26.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.440+0000 7ff17cec79c0 20 remove_watcher() i=7 2024-09-12T18:00:26.461 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T18:00:26.491 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:26.492 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:26.536 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.532+0000 7f4aa9bba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.538 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.532+0000 7f4aa9bba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:26.538 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.532+0000 7f4aa9bba9c0 20 realm 2024-09-12T18:00:26.539 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.532+0000 7f4aa9bba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.539 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.532+0000 7f4aa9bba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:26.539 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.532+0000 7f4aa9bba9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:26.539 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.532+0000 7f4aa9bba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.539 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.532+0000 7f4aa9bba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:26.539 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.532+0000 7f4aa9bba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.540 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.536+0000 7f4aa9bba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:26.540 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.536+0000 7f4aa9bba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.536+0000 7f4aa9bba9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:26.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.536+0000 7f4aa9bba9c0 20 searching for the correct realm 2024-09-12T18:00:26.546 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.540+0000 7f4aa6ebf640 0 -- 172.21.15.98:0/3298073426 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55ad2995b0d0 msgr2=0x55ad2995d4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:00:26.553 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.548+0000 7f4aa76c0640 0 -- 172.21.15.98:0/3298073426 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f4a9c106410 msgr2=0x7f4a9c106890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:26.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:26.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:00:26.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:26.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:00:26.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:26.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:26.562 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.562 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:26.562 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.562 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:26.562 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:26.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 20 zone default found 2024-09-12T18:00:26.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 4 Realm: () 2024-09-12T18:00:26.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:00:26.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:00:26.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:26.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 20 zonegroup default 2024-09-12T18:00:26.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:26.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.556+0000 7f4aa9bba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.560+0000 7f4aa9bba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:26.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.560+0000 7f4aa9bba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.560+0000 7f4aa9bba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:26.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.560+0000 7f4aa9bba9c0 20 started sync module instance, tier type = 2024-09-12T18:00:26.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.560+0000 7f4aa9bba9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:00:26.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.572+0000 7f4aa9bba9c0 20 add_watcher() i=0 2024-09-12T18:00:26.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.572+0000 7f4aa9bba9c0 20 add_watcher() i=1 2024-09-12T18:00:26.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.572+0000 7f4aa9bba9c0 20 add_watcher() i=2 2024-09-12T18:00:26.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.572+0000 7f4aa9bba9c0 20 add_watcher() i=3 2024-09-12T18:00:26.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.572+0000 7f4aa9bba9c0 20 add_watcher() i=4 2024-09-12T18:00:26.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.572+0000 7f4aa9bba9c0 20 add_watcher() i=5 2024-09-12T18:00:26.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.572+0000 7f4aa9bba9c0 20 add_watcher() i=6 2024-09-12T18:00:26.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.576+0000 7f4aa9bba9c0 20 add_watcher() i=7 2024-09-12T18:00:26.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.576+0000 7f4aa9bba9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:26.582 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.576+0000 7f495dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:26.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.576+0000 7f4aa9bba9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:26.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.576+0000 7f4aa9bba9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:26.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.576+0000 7f4aa9bba9c0 5 note: GC not initialized 2024-09-12T18:00:26.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.580+0000 7f495cfe1640 20 reqs_thread_entry: start 2024-09-12T18:00:26.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.580+0000 7f4aa9bba9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:00:26.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.580+0000 7f4aa9bba9c0 20 Filter name: none 2024-09-12T18:00:26.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.580+0000 7f48d67fc640 20 reqs_thread_entry: start 2024-09-12T18:00:26.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.580+0000 7f4aa9bba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.580+0000 7f4aa9bba9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:26.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.580+0000 7f4aa9bba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.580+0000 7f4aa9bba9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:00:26.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.580+0000 7f4aa9bba9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:26.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.580+0000 7f4aa9bba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.580+0000 7f4aa9bba9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:26.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.580+0000 7f4aa9bba9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:26.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.580+0000 7f4aa9bba9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:00:26.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.580+0000 7f4aa9bba9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:26.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.584+0000 7f495dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:26.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.588+0000 7f4aa9bba9c0 20 remove_watcher() i=0 2024-09-12T18:00:26.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.588+0000 7f4aa9bba9c0 2 removed watcher, disabling cache 2024-09-12T18:00:26.596 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.592+0000 7f4aa9bba9c0 20 remove_watcher() i=1 2024-09-12T18:00:26.598 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.592+0000 7f4aa9bba9c0 20 remove_watcher() i=2 2024-09-12T18:00:26.600 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.596+0000 7f4aa9bba9c0 20 remove_watcher() i=3 2024-09-12T18:00:26.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.596+0000 7f4aa9bba9c0 20 remove_watcher() i=4 2024-09-12T18:00:26.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.600+0000 7f4aa9bba9c0 20 remove_watcher() i=5 2024-09-12T18:00:26.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.600+0000 7f4aa9bba9c0 20 remove_watcher() i=6 2024-09-12T18:00:26.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:26.600+0000 7f4aa9bba9c0 20 remove_watcher() i=7 2024-09-12T18:00:26.620 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:26.620 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T18:00:26.620 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: error-at-change-reshard-state id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.38 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T18:00:26.620 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:26.621 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:26.621 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:26.643 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:26.643 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:27.190 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:27.190 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:27.561 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T18:00:27.561 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:27.564 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:27.564 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:27.715 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:27.716 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:27.804 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:27.804 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:27.953 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:27.954 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:28.052 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:28.053 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:28.152 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:28.153 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:28.249 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:28.250 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:28.348 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:28.348 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:28.444 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:28.444 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:28.540 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:28.541 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:28.628 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:28.628 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:28.725 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:28.725 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:28.829 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:28.829 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:28.927 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:28.927 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:29.032 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:29.033 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:29.134 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:29.134 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:29.234 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:29.234 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:29.328 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:29.328 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:29.431 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:29.431 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:29.528 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:29.528 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:29.627 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:29.627 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:29.726 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:29.726 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:29.827 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T18:00:29.861 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:29.861 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:29.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.900+0000 7fdb1682a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:29.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.904+0000 7fdb1682a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:29.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.904+0000 7fdb1682a9c0 20 realm 2024-09-12T18:00:29.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.904+0000 7fdb1682a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:29.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.904+0000 7fdb1682a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:29.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.904+0000 7fdb1682a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:29.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.904+0000 7fdb1682a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:29.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.904+0000 7fdb1682a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:29.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.904+0000 7fdb1682a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:29.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.904+0000 7fdb1682a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:29.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.904+0000 7fdb1682a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:29.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.904+0000 7fdb1682a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:29.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.908+0000 7fdb1682a9c0 20 searching for the correct realm 2024-09-12T18:00:29.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.912+0000 7fdb13b2f640 0 -- 172.21.15.98:0/2722255309 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fdb0404e040 msgr2=0x7fdb0404e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:29.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.920+0000 7fdb14b31640 0 -- 172.21.15.98:0/2722255309 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7fdb0800a040 msgr2=0x7fdb0801c970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:00:29.930 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.924+0000 7fdb1682a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:29.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.924+0000 7fdb1682a9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:00:29.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.924+0000 7fdb1682a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:29.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.924+0000 7fdb1682a9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:00:29.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.924+0000 7fdb1682a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:29.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.924+0000 7fdb1682a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:29.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.924+0000 7fdb1682a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:29.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.924+0000 7fdb1682a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:29.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.924+0000 7fdb1682a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:29.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.928+0000 7fdb1682a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:29.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.928+0000 7fdb1682a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:29.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.928+0000 7fdb1682a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:29.933 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.928+0000 7fdb1682a9c0 20 zone default found 2024-09-12T18:00:29.933 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.928+0000 7fdb1682a9c0 4 Realm: () 2024-09-12T18:00:29.933 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.928+0000 7fdb1682a9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:00:29.933 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.928+0000 7fdb1682a9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:00:29.933 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.928+0000 7fdb1682a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:29.933 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.928+0000 7fdb1682a9c0 20 zonegroup default 2024-09-12T18:00:29.933 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.928+0000 7fdb1682a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:29.933 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.928+0000 7fdb1682a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:29.933 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.928+0000 7fdb1682a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:29.934 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.928+0000 7fdb1682a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:29.934 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.928+0000 7fdb1682a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:29.934 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.928+0000 7fdb1682a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:29.934 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.928+0000 7fdb1682a9c0 20 started sync module instance, tier type = 2024-09-12T18:00:29.934 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.928+0000 7fdb1682a9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:00:29.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.944+0000 7fdb1682a9c0 20 add_watcher() i=0 2024-09-12T18:00:29.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.944+0000 7fdb1682a9c0 20 add_watcher() i=1 2024-09-12T18:00:29.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.944+0000 7fdb1682a9c0 20 add_watcher() i=2 2024-09-12T18:00:29.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.944+0000 7fdb1682a9c0 20 add_watcher() i=3 2024-09-12T18:00:29.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.944+0000 7fdb1682a9c0 20 add_watcher() i=4 2024-09-12T18:00:29.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.944+0000 7fdb1682a9c0 20 add_watcher() i=5 2024-09-12T18:00:29.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.944+0000 7fdb1682a9c0 20 add_watcher() i=6 2024-09-12T18:00:29.951 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.944+0000 7fdb1682a9c0 20 add_watcher() i=7 2024-09-12T18:00:29.951 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.944+0000 7fdb1682a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:29.953 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.948+0000 7fd9cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:29.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.948+0000 7fdb1682a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:29.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.948+0000 7fdb1682a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:29.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.948+0000 7fdb1682a9c0 5 note: GC not initialized 2024-09-12T18:00:29.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.948+0000 7fd9c9fdb640 20 reqs_thread_entry: start 2024-09-12T18:00:29.955 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.948+0000 7fdb1682a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:00:29.955 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.948+0000 7fdb1682a9c0 20 Filter name: none 2024-09-12T18:00:29.955 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.948+0000 7fd93b7fe640 20 reqs_thread_entry: start 2024-09-12T18:00:29.955 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.948+0000 7fdb1682a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:29.955 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.948+0000 7fdb1682a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:29.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.948+0000 7fdb1682a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:29.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.952+0000 7fdb1682a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:00:29.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.952+0000 7fdb1682a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:29.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.952+0000 7fdb1682a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:29.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.952+0000 7fdb1682a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:29.957 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.952+0000 7fdb1682a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:29.957 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.952+0000 7fdb1682a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:00:29.957 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.952+0000 7fdb1682a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:29.959 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.952+0000 7fd9cafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:29.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.956+0000 7fdb1682a9c0 20 remove_watcher() i=0 2024-09-12T18:00:29.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.956+0000 7fdb1682a9c0 2 removed watcher, disabling cache 2024-09-12T18:00:29.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.960+0000 7fdb1682a9c0 20 remove_watcher() i=1 2024-09-12T18:00:29.967 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.960+0000 7fdb1682a9c0 20 remove_watcher() i=2 2024-09-12T18:00:29.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.964+0000 7fdb1682a9c0 20 remove_watcher() i=3 2024-09-12T18:00:29.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.964+0000 7fdb1682a9c0 20 remove_watcher() i=4 2024-09-12T18:00:29.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.968+0000 7fdb1682a9c0 20 remove_watcher() i=5 2024-09-12T18:00:29.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.968+0000 7fdb1682a9c0 20 remove_watcher() i=6 2024-09-12T18:00:29.974 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:29.968+0000 7fdb1682a9c0 20 remove_watcher() i=7 2024-09-12T18:00:29.987 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:29.988 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T18:00:29.988 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-change-reshard-state id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:00:29.988 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:29.988 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T18:00:30.020 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:30.020 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:30.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 realm 2024-09-12T18:00:30.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:30.065 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.065 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.065 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:30.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:30.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 searching for the correct realm 2024-09-12T18:00:30.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.068+0000 7ffa384dd640 0 -- 172.21.15.98:0/3835894165 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x56179a682420 msgr2=0x56179a6848e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:30.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.072+0000 7ffa38cde640 0 -- 172.21.15.98:0/3835894165 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7ffa2c08abf0 msgr2=0x7ffa2c061ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:30.085 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:30.085 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:00:30.085 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:30.086 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:00:30.086 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:30.086 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:30.086 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.086 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.086 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:30.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:30.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 zone default found 2024-09-12T18:00:30.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 4 Realm: () 2024-09-12T18:00:30.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:00:30.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:00:30.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:30.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 zonegroup default 2024-09-12T18:00:30.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.084+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.084+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.084+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.084+0000 7ffa3b1d89c0 20 started sync module instance, tier type = 2024-09-12T18:00:30.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.084+0000 7ffa3b1d89c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:00:30.103 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=0 2024-09-12T18:00:30.103 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=1 2024-09-12T18:00:30.103 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=2 2024-09-12T18:00:30.104 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=3 2024-09-12T18:00:30.104 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=4 2024-09-12T18:00:30.104 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=5 2024-09-12T18:00:30.104 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=6 2024-09-12T18:00:30.105 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=7 2024-09-12T18:00:30.105 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:30.107 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.100+0000 7ff8ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:30.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:30.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:30.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 note: GC not initialized 2024-09-12T18:00:30.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.104+0000 7ff8ee7e4640 20 reqs_thread_entry: start 2024-09-12T18:00:30.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 20 init_complete bucket index max shards: 11 2024-09-12T18:00:30.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 20 Filter name: none 2024-09-12T18:00:30.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.104+0000 7ff8e77fe640 20 reqs_thread_entry: start 2024-09-12T18:00:30.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T18:00:30.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:30.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T18:00:30.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T18:00:30.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 : miss 2024-09-12T18:00:30.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:00:30.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 info.flags=0x17 2024-09-12T18:00:30.110 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 to cache LRU end 2024-09-12T18:00:30.110 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:30.110 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:30.110 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 2024-09-12T18:00:30.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.112+0000 7ffa3b1d89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 info.flags=0x17 2024-09-12T18:00:30.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.112+0000 7ffa3b1d89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 to cache LRU end 2024-09-12T18:00:30.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.112+0000 7ffa3b1d89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:30.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.112+0000 7ffa3b1d89c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39, ofs0, ns] 2024-09-12T18:00:30.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.116+0000 7ff90f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366263 cookie 94659374766816 notifier 7460 bl.length()=931 2024-09-12T18:00:30.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.116+0000 7ff90f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 info.flags=0x17 2024-09-12T18:00:30.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.116+0000 7ff90f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 to cache LRU end 2024-09-12T18:00:30.120 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.116+0000 7ff90f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:30.122 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.116+0000 7ffa3b1d89c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): orig_sources= new_sources= 2024-09-12T18:00:30.122 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.116+0000 7ffa3b1d89c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): potential sources added=[] removed=[] 2024-09-12T18:00:30.122 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.116+0000 7ffa3b1d89c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): orig_dests= new_dests= 2024-09-12T18:00:30.122 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.116+0000 7ffa3b1d89c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): potential dests added=[] removed=[] 2024-09-12T18:00:30.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.0 2024-09-12T18:00:30.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.0 2024-09-12T18:00:30.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.1 2024-09-12T18:00:30.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.1 2024-09-12T18:00:30.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.2 2024-09-12T18:00:30.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.2 2024-09-12T18:00:30.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.3 2024-09-12T18:00:30.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.3 2024-09-12T18:00:30.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.4 2024-09-12T18:00:30.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.4 2024-09-12T18:00:30.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.5 2024-09-12T18:00:30.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.5 2024-09-12T18:00:30.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.6 2024-09-12T18:00:30.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.6 2024-09-12T18:00:30.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.7 2024-09-12T18:00:30.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.7 2024-09-12T18:00:30.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.8 2024-09-12T18:00:30.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.8 2024-09-12T18:00:30.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.9 2024-09-12T18:00:30.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.9 2024-09-12T18:00:30.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.10 2024-09-12T18:00:30.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.10 2024-09-12T18:00:30.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.11 2024-09-12T18:00:30.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.11 2024-09-12T18:00:30.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.0 2024-09-12T18:00:30.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.128+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1 2024-09-12T18:00:30.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.128+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2 2024-09-12T18:00:30.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.128+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.3 2024-09-12T18:00:30.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.128+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.4 2024-09-12T18:00:30.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.128+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.5 2024-09-12T18:00:30.135 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.128+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.6 2024-09-12T18:00:30.135 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.132+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.7 2024-09-12T18:00:30.136 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.132+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.8 2024-09-12T18:00:30.137 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.132+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.9 2024-09-12T18:00:30.138 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.132+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.10 2024-09-12T18:00:30.144 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffa3b1d89c0 time 2024-09-12T18:00:30.145778+0000 2024-09-12T18:00:30.145 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:00:30.146 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:30.146 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ffa3eab22eb] 2024-09-12T18:00:30.146 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffa3eab249f] 2024-09-12T18:00:30.146 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561798bfa0c1] 2024-09-12T18:00:30.146 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x561798c0b4f1] 2024-09-12T18:00:30.146 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561798c0cb44] 2024-09-12T18:00:30.147 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T18:00:30.147 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffa3d918d90] 2024-09-12T18:00:30.147 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T18:00:30.147 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T18:00:30.147 INFO:tasks.workunit.client.0.smithi098.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:00:30.147 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7ffa3b1d89c0 thread_name:radosgw-admin 2024-09-12T18:00:30.147 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.140+0000 7ffa3b1d89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffa3b1d89c0 time 2024-09-12T18:00:30.145778+0000 2024-09-12T18:00:30.147 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:00:30.147 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.147 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:30.147 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ffa3eab22eb] 2024-09-12T18:00:30.147 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffa3eab249f] 2024-09-12T18:00:30.147 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561798bfa0c1] 2024-09-12T18:00:30.148 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x561798c0b4f1] 2024-09-12T18:00:30.148 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561798c0cb44] 2024-09-12T18:00:30.148 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T18:00:30.148 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffa3d918d90] 2024-09-12T18:00:30.148 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T18:00:30.148 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T18:00:30.148 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.167 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:30.167 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ffa3d931520] 2024-09-12T18:00:30.167 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T18:00:30.167 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T18:00:30.167 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T18:00:30.167 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ffa3eab2345] 2024-09-12T18:00:30.167 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffa3eab249f] 2024-09-12T18:00:30.167 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561798bfa0c1] 2024-09-12T18:00:30.167 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x561798c0b4f1] 2024-09-12T18:00:30.167 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561798c0cb44] 2024-09-12T18:00:30.167 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T18:00:30.167 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffa3d918d90] 2024-09-12T18:00:30.168 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T18:00:30.168 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T18:00:30.168 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.144+0000 7ffa3b1d89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:00:30.168 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7ffa3b1d89c0 thread_name:radosgw-admin 2024-09-12T18:00:30.168 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.168 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:30.168 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ffa3d931520] 2024-09-12T18:00:30.168 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T18:00:30.168 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T18:00:30.168 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T18:00:30.168 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ffa3eab2345] 2024-09-12T18:00:30.168 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffa3eab249f] 2024-09-12T18:00:30.169 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561798bfa0c1] 2024-09-12T18:00:30.169 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x561798c0b4f1] 2024-09-12T18:00:30.169 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561798c0cb44] 2024-09-12T18:00:30.169 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T18:00:30.169 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffa3d918d90] 2024-09-12T18:00:30.169 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T18:00:30.169 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T18:00:30.169 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:00:30.169 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.169 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T18:00:30.169 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a592cd0) adding con mode: crc 2024-09-12T18:00:30.169 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a592cd0) adding con mode: secure 2024-09-12T18:00:30.169 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.170 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 1 librados: starting msgr at 2024-09-12T18:00:30.170 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 1 librados: starting objecter 2024-09-12T18:00:30.170 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command objecter_requests hook 0x56179a2fba30 2024-09-12T18:00:30.170 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 1 librados: setting wanted keys 2024-09-12T18:00:30.170 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 1 librados: calling monclient init 2024-09-12T18:00:30.170 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient: init 2024-09-12T18:00:30.170 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding auth protocol: cephx 2024-09-12T18:00:30.170 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding auth protocol: cephx 2024-09-12T18:00:30.170 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding auth protocol: cephx 2024-09-12T18:00:30.170 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: secure 2024-09-12T18:00:30.170 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: crc 2024-09-12T18:00:30.170 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: secure 2024-09-12T18:00:30.170 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: crc 2024-09-12T18:00:30.170 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: secure 2024-09-12T18:00:30.171 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: crc 2024-09-12T18:00:30.171 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: crc 2024-09-12T18:00:30.171 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: secure 2024-09-12T18:00:30.171 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: crc 2024-09-12T18:00:30.171 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: secure 2024-09-12T18:00:30.171 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: crc 2024-09-12T18:00:30.171 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: secure 2024-09-12T18:00:30.171 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.171 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.171 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command rotate-key hook 0x56179a58cef8 2024-09-12T18:00:30.171 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:00:30.171 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:00:30.171 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-a con 0x56179a43cd00 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:00:30.171 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-b con 0x56179a43d0e0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:00:30.172 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-c con 0x56179a43d4f0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:00:30.172 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.172 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.172 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.172 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:00:30.172 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient(hunting): authenticate will time out at 2826.611990s 2024-09-12T18:00:30.172 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T18:00:30.040+0000 7ffa394df640 10 monclient(hunting): get_auth_request con 0x56179a43d4f0 auth_method 0 2024-09-12T18:00:30.172 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T18:00:30.040+0000 7ffa394df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:30.172 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T18:00:30.040+0000 7ffa394df640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:30.172 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T18:00:30.040+0000 7ffa394df640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:30.172 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T18:00:30.040+0000 7ffa38cde640 10 monclient(hunting): get_auth_request con 0x56179a43cd00 auth_method 0 2024-09-12T18:00:30.172 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T18:00:30.040+0000 7ffa38cde640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:30.172 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T18:00:30.040+0000 7ffa38cde640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:30.173 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T18:00:30.040+0000 7ffa38cde640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:30.173 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T18:00:30.040+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:30.173 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T18:00:30.040+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:30.173 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T18:00:30.040+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:30.173 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T18:00:30.040+0000 7ffa394df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:30.173 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T18:00:30.040+0000 7ffa394df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:30.173 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T18:00:30.040+0000 7ffa394df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:30.173 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T18:00:30.040+0000 7ffa38cde640 10 monclient(hunting): handle_auth_done global_id 8091 payload 824 2024-09-12T18:00:30.173 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T18:00:30.040+0000 7ffa38cde640 10 monclient: _finish_hunting 0 2024-09-12T18:00:30.173 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T18:00:30.040+0000 7ffa38cde640 1 monclient: found mon.noname-a 2024-09-12T18:00:30.173 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T18:00:30.040+0000 7ffa38cde640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T18:00:30.173 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T18:00:30.040+0000 7ff92560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:30.176 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T18:00:30.040+0000 7ff92560a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:00:30.177 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T18:00:30.040+0000 7ff92560a640 10 monclient: dump: 2024-09-12T18:00:30.177 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:00:30.177 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:00:30.177 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.177 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.177 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:30.177 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.177 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:00:30.177 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:00:30.177 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:00:30.177 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.177 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T18:00:30.040+0000 7ff92560a640 10 monclient: _finish_auth 0 2024-09-12T18:00:30.177 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T18:00:30.040+0000 7ff92560a640 10 monclient: _check_auth_tickets 2024-09-12T18:00:30.178 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T18:00:30.040+0000 7ff92560a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:30.178 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T18:00:30.040+0000 7ff92560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:30.178 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T18:00:30.040+0000 7ff92560a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:00:30.178 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T18:00:30.040+0000 7ff92560a640 10 monclient: dump: 2024-09-12T18:00:30.178 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:00:30.178 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:00:30.178 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.178 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.178 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:30.178 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.178 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:00:30.178 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:00:30.178 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:00:30.179 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.179 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T18:00:30.040+0000 7ffa3b1d89c0 5 monclient: authenticate success, global_id 8091 2024-09-12T18:00:30.179 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T18:00:30.040+0000 7ffa3b1d89c0 10 monclient: _renew_subs 2024-09-12T18:00:30.179 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T18:00:30.040+0000 7ff926e0d640 4 set_mon_vals no callback set 2024-09-12T18:00:30.179 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T18:00:30.040+0000 7ffa3b1d89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:00:30.179 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T18:00:30.040+0000 7ffa3b1d89c0 10 monclient: _renew_subs 2024-09-12T18:00:30.179 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T18:00:30.040+0000 7ffa3b1d89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:00:30.179 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T18:00:30.040+0000 7ffa3b1d89c0 1 librados: init done 2024-09-12T18:00:30.179 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T18:00:30.040+0000 7ff92560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:00:30.179 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T18:00:30.040+0000 7ff92560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:00:30.179 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T18:00:30.040+0000 7ff92560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:00:30.179 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T18:00:30.040+0000 7ffa384dd640 10 monclient: get_auth_request con 0x7ff920070ae0 auth_method 0 2024-09-12T18:00:30.179 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T18:00:30.040+0000 7ffa394df640 10 monclient: get_auth_request con 0x56179a5ceb00 auth_method 0 2024-09-12T18:00:30.180 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T18:00:30.044+0000 7ffa38cde640 10 monclient: get_auth_request con 0x56179a5d8c90 auth_method 0 2024-09-12T18:00:30.180 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T18:00:30.044+0000 7ffa384dd640 10 monclient: get_auth_request con 0x56179a5de1d0 auth_method 0 2024-09-12T18:00:30.180 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient: build_initial_monmap 2024-09-12T18:00:30.180 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 1 build_initial for_mkfs: 0 2024-09-12T18:00:30.180 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient: monmap: 2024-09-12T18:00:30.180 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:00:30.180 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:30.180 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:00:30.180 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:00:30.180 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:30.180 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.180 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:00:30.180 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:00:30.181 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:00:30.181 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.181 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding auth protocol: cephx 2024-09-12T18:00:30.181 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding auth protocol: cephx 2024-09-12T18:00:30.181 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding auth protocol: cephx 2024-09-12T18:00:30.181 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: secure 2024-09-12T18:00:30.181 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: crc 2024-09-12T18:00:30.181 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: secure 2024-09-12T18:00:30.181 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: crc 2024-09-12T18:00:30.181 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: secure 2024-09-12T18:00:30.181 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: crc 2024-09-12T18:00:30.181 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: crc 2024-09-12T18:00:30.181 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: secure 2024-09-12T18:00:30.181 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: crc 2024-09-12T18:00:30.182 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: secure 2024-09-12T18:00:30.182 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: crc 2024-09-12T18:00:30.182 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: secure 2024-09-12T18:00:30.182 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.182 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command objecter_requests cmddesc objecter_requests hook 0x56179a5e7c50 EEXIST 2024-09-12T18:00:30.182 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient: init 2024-09-12T18:00:30.182 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding auth protocol: cephx 2024-09-12T18:00:30.182 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding auth protocol: cephx 2024-09-12T18:00:30.182 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding auth protocol: cephx 2024-09-12T18:00:30.182 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: secure 2024-09-12T18:00:30.182 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: crc 2024-09-12T18:00:30.182 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: secure 2024-09-12T18:00:30.183 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: crc 2024-09-12T18:00:30.183 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: secure 2024-09-12T18:00:30.183 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: crc 2024-09-12T18:00:30.183 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: crc 2024-09-12T18:00:30.183 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: secure 2024-09-12T18:00:30.183 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: crc 2024-09-12T18:00:30.183 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: secure 2024-09-12T18:00:30.183 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: crc 2024-09-12T18:00:30.183 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: secure 2024-09-12T18:00:30.183 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.183 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.183 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command rotate-key cmddesc rotate-key hook 0x56179a5e10b0 EEXIST 2024-09-12T18:00:30.183 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:00:30.183 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:00:30.184 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-a con 0x56179a60b910 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:00:30.184 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-c con 0x56179a611da0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:00:30.184 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-b con 0x56179a60bcf0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:00:30.184 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.184 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.184 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.184 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:00:30.184 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient(hunting): authenticate will time out at 2826.621873s 2024-09-12T18:00:30.184 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T18:00:30.048+0000 7ffa38cde640 10 monclient(hunting): get_auth_request con 0x56179a60b910 auth_method 0 2024-09-12T18:00:30.184 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T18:00:30.048+0000 7ffa38cde640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:30.184 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T18:00:30.048+0000 7ffa38cde640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:30.184 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T18:00:30.048+0000 7ffa38cde640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:30.184 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T18:00:30.048+0000 7ffa384dd640 10 monclient(hunting): get_auth_request con 0x56179a611da0 auth_method 0 2024-09-12T18:00:30.185 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T18:00:30.048+0000 7ffa384dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:30.185 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T18:00:30.048+0000 7ffa384dd640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:30.185 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T18:00:30.048+0000 7ffa384dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:30.185 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T18:00:30.048+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:30.185 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T18:00:30.048+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:30.185 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T18:00:30.048+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:30.185 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T18:00:30.048+0000 7ffa384dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:30.185 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T18:00:30.048+0000 7ffa384dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:30.185 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T18:00:30.048+0000 7ffa384dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:30.185 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T18:00:30.048+0000 7ffa394df640 10 monclient(hunting): get_auth_request con 0x56179a60bcf0 auth_method 0 2024-09-12T18:00:30.185 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T18:00:30.048+0000 7ffa394df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:30.185 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T18:00:30.048+0000 7ffa394df640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:30.185 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T18:00:30.048+0000 7ffa394df640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:30.185 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T18:00:30.048+0000 7ffa384dd640 10 monclient(hunting): handle_auth_done global_id 7454 payload 824 2024-09-12T18:00:30.186 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T18:00:30.048+0000 7ffa384dd640 10 monclient: _finish_hunting 0 2024-09-12T18:00:30.186 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T18:00:30.048+0000 7ffa384dd640 1 monclient: found mon.noname-c 2024-09-12T18:00:30.186 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T18:00:30.048+0000 7ffa384dd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:00:30.186 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T18:00:30.048+0000 7ff91e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:30.186 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T18:00:30.048+0000 7ff91e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:00:30.186 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T18:00:30.048+0000 7ff91e7fc640 10 monclient: dump: 2024-09-12T18:00:30.186 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:00:30.186 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:00:30.186 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.186 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.186 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:30.186 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.186 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:00:30.186 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:00:30.187 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:00:30.187 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.187 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T18:00:30.048+0000 7ff91e7fc640 10 monclient: _finish_auth 0 2024-09-12T18:00:30.187 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T18:00:30.048+0000 7ff91e7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:00:30.187 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 monclient: authenticate success, global_id 7454 2024-09-12T18:00:30.187 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T18:00:30.048+0000 7ff91e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:30.187 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T18:00:30.048+0000 7ff91e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:30.187 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T18:00:30.048+0000 7ff91e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:00:30.187 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T18:00:30.048+0000 7ff91e7fc640 10 monclient: dump: 2024-09-12T18:00:30.187 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:00:30.187 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:00:30.187 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.187 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.188 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:30.188 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.188 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:00:30.188 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:00:30.188 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:00:30.188 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.188 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T18:00:30.048+0000 7ffa39ce0640 4 set_mon_vals no callback set 2024-09-12T18:00:30.188 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient: _renew_subs 2024-09-12T18:00:30.188 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:00:30.188 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient: _renew_subs 2024-09-12T18:00:30.188 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:00:30.188 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T18:00:30.052+0000 7ff91e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:00:30.188 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T18:00:30.052+0000 7ff91e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:00:30.188 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T18:00:30.052+0000 7ff91e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:00:30.189 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient: get_monmap_and_config 2024-09-12T18:00:30.189 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient: build_initial_monmap 2024-09-12T18:00:30.189 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 1 build_initial for_mkfs: 0 2024-09-12T18:00:30.189 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient: monmap: 2024-09-12T18:00:30.189 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:00:30.189 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:30.189 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:00:30.189 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:00:30.189 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:30.189 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.189 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:00:30.189 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:00:30.189 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:00:30.189 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.190 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding auth protocol: cephx 2024-09-12T18:00:30.190 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding auth protocol: cephx 2024-09-12T18:00:30.190 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding auth protocol: cephx 2024-09-12T18:00:30.190 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: secure 2024-09-12T18:00:30.190 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: crc 2024-09-12T18:00:30.190 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: secure 2024-09-12T18:00:30.190 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: crc 2024-09-12T18:00:30.190 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: secure 2024-09-12T18:00:30.190 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: crc 2024-09-12T18:00:30.190 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: crc 2024-09-12T18:00:30.190 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: secure 2024-09-12T18:00:30.191 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: crc 2024-09-12T18:00:30.191 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: secure 2024-09-12T18:00:30.191 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: crc 2024-09-12T18:00:30.191 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: secure 2024-09-12T18:00:30.191 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient: get_auth_request con 0x7ff9100709f0 auth_method 0 2024-09-12T18:00:30.191 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.191 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient: init 2024-09-12T18:00:30.191 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding auth protocol: cephx 2024-09-12T18:00:30.191 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding auth protocol: cephx 2024-09-12T18:00:30.191 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding auth protocol: cephx 2024-09-12T18:00:30.191 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: secure 2024-09-12T18:00:30.191 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: crc 2024-09-12T18:00:30.191 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: secure 2024-09-12T18:00:30.192 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: crc 2024-09-12T18:00:30.192 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: secure 2024-09-12T18:00:30.192 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: crc 2024-09-12T18:00:30.192 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: crc 2024-09-12T18:00:30.192 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: secure 2024-09-12T18:00:30.192 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: crc 2024-09-12T18:00:30.192 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: secure 2024-09-12T18:00:30.192 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: crc 2024-09-12T18:00:30.192 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: secure 2024-09-12T18:00:30.192 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.192 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.192 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command rotate-key cmddesc rotate-key hook 0x7fff4c9ed5a8 EEXIST 2024-09-12T18:00:30.193 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:00:30.193 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:00:30.193 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-a con 0x56179a65fbc0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:00:30.193 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-b con 0x56179a65afb0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:00:30.193 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-c con 0x56179a65b930 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:00:30.193 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.193 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.193 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.193 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:00:30.193 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient(hunting): authenticate will time out at 2826.626125s 2024-09-12T18:00:30.193 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient(hunting): get_auth_request con 0x56179a65fbc0 auth_method 0 2024-09-12T18:00:30.193 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:30.193 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:30.193 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:30.194 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T18:00:30.052+0000 7ffa394df640 10 monclient(hunting): get_auth_request con 0x56179a65b930 auth_method 0 2024-09-12T18:00:30.194 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T18:00:30.052+0000 7ffa394df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:30.194 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T18:00:30.052+0000 7ffa394df640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:30.194 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T18:00:30.052+0000 7ffa394df640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:30.194 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:30.194 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:30.194 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:30.194 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T18:00:30.052+0000 7ffa394df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:30.194 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T18:00:30.052+0000 7ffa394df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:30.194 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T18:00:30.052+0000 7ffa394df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:30.194 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient(hunting): handle_auth_done global_id 8097 payload 274 2024-09-12T18:00:30.194 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient: _finish_hunting 0 2024-09-12T18:00:30.194 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T18:00:30.052+0000 7ffa38cde640 1 monclient: found mon.noname-a 2024-09-12T18:00:30.194 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T18:00:30.195 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T18:00:30.052+0000 7ffa384dd640 10 monclient: get_auth_request con 0x56179a65afb0 auth_method 0 2024-09-12T18:00:30.195 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T18:00:30.052+0000 7ff90ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:30.195 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T18:00:30.052+0000 7ff90ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:00:30.195 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T18:00:30.052+0000 7ff90ffff640 10 monclient: dump: 2024-09-12T18:00:30.195 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:00:30.195 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:00:30.195 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.195 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.195 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:30.195 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.195 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:00:30.195 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:00:30.195 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:00:30.195 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.196 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T18:00:30.052+0000 7ff90ffff640 10 monclient: _finish_auth 0 2024-09-12T18:00:30.196 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T18:00:30.052+0000 7ff90ffff640 10 monclient: _check_auth_tickets 2024-09-12T18:00:30.196 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T18:00:30.052+0000 7ff90ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:30.196 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T18:00:30.052+0000 7ff90ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:30.196 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T18:00:30.052+0000 7ff90ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:00:30.196 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T18:00:30.052+0000 7ff90ffff640 10 monclient: dump: 2024-09-12T18:00:30.196 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:00:30.196 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:00:30.196 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.196 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.196 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:30.196 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.196 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:00:30.197 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:00:30.197 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:00:30.197 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.197 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 monclient: authenticate success, global_id 8097 2024-09-12T18:00:30.197 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient: get_monmap_and_config success 2024-09-12T18:00:30.197 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 4 set_mon_vals no callback set 2024-09-12T18:00:30.197 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient: shutdown 2024-09-12T18:00:30.197 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient: build_initial_monmap 2024-09-12T18:00:30.197 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 1 build_initial for_mkfs: 0 2024-09-12T18:00:30.197 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient: monmap: 2024-09-12T18:00:30.197 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:00:30.197 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:30.197 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:00:30.198 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:00:30.198 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:30.198 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.198 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:00:30.198 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:00:30.198 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:00:30.198 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.198 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding auth protocol: cephx 2024-09-12T18:00:30.198 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding auth protocol: cephx 2024-09-12T18:00:30.198 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding auth protocol: cephx 2024-09-12T18:00:30.198 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: secure 2024-09-12T18:00:30.198 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: crc 2024-09-12T18:00:30.198 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: secure 2024-09-12T18:00:30.199 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: crc 2024-09-12T18:00:30.199 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: secure 2024-09-12T18:00:30.199 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: crc 2024-09-12T18:00:30.199 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: crc 2024-09-12T18:00:30.199 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: secure 2024-09-12T18:00:30.199 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: crc 2024-09-12T18:00:30.199 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: secure 2024-09-12T18:00:30.199 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: crc 2024-09-12T18:00:30.199 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: secure 2024-09-12T18:00:30.199 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.199 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 1 librados: starting msgr at 2024-09-12T18:00:30.199 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 1 librados: starting objecter 2024-09-12T18:00:30.199 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command objecter_requests cmddesc objecter_requests hook 0x56179a652c20 EEXIST 2024-09-12T18:00:30.199 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 1 librados: setting wanted keys 2024-09-12T18:00:30.200 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 1 librados: calling monclient init 2024-09-12T18:00:30.200 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient: init 2024-09-12T18:00:30.200 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding auth protocol: cephx 2024-09-12T18:00:30.200 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding auth protocol: cephx 2024-09-12T18:00:30.200 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding auth protocol: cephx 2024-09-12T18:00:30.200 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: secure 2024-09-12T18:00:30.200 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: crc 2024-09-12T18:00:30.200 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: secure 2024-09-12T18:00:30.200 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: crc 2024-09-12T18:00:30.200 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: secure 2024-09-12T18:00:30.200 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: crc 2024-09-12T18:00:30.200 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: crc 2024-09-12T18:00:30.200 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: secure 2024-09-12T18:00:30.200 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: crc 2024-09-12T18:00:30.201 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: secure 2024-09-12T18:00:30.201 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: crc 2024-09-12T18:00:30.201 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: secure 2024-09-12T18:00:30.201 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.201 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.201 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command rotate-key cmddesc rotate-key hook 0x56179a609eb8 EEXIST 2024-09-12T18:00:30.201 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:00:30.201 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:00:30.201 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-c con 0x56179a65afb0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:00:30.201 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-a con 0x56179a65b930 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:00:30.201 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-b con 0x56179a65fbc0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:00:30.201 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.201 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.201 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.202 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:00:30.202 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient(hunting): authenticate will time out at 2826.628632s 2024-09-12T18:00:30.202 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T18:00:30.056+0000 7ffa38cde640 10 monclient(hunting): get_auth_request con 0x56179a65afb0 auth_method 0 2024-09-12T18:00:30.202 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T18:00:30.056+0000 7ffa38cde640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:30.202 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T18:00:30.056+0000 7ffa38cde640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:30.202 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T18:00:30.056+0000 7ffa38cde640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:30.202 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T18:00:30.056+0000 7ffa384dd640 10 monclient(hunting): get_auth_request con 0x56179a65b930 auth_method 0 2024-09-12T18:00:30.202 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T18:00:30.056+0000 7ffa384dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:30.202 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T18:00:30.056+0000 7ffa384dd640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:30.202 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T18:00:30.056+0000 7ffa384dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:30.202 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T18:00:30.056+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:30.202 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T18:00:30.056+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:30.202 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T18:00:30.056+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:30.202 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T18:00:30.056+0000 7ffa384dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:30.203 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T18:00:30.056+0000 7ffa384dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:30.203 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T18:00:30.056+0000 7ffa384dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:30.203 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T18:00:30.056+0000 7ffa38cde640 10 monclient(hunting): handle_auth_done global_id 7460 payload 824 2024-09-12T18:00:30.203 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T18:00:30.056+0000 7ffa38cde640 10 monclient: _finish_hunting 0 2024-09-12T18:00:30.203 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T18:00:30.056+0000 7ffa38cde640 1 monclient: found mon.noname-c 2024-09-12T18:00:30.203 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T18:00:30.056+0000 7ffa38cde640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:00:30.203 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T18:00:30.056+0000 7ffa394df640 10 monclient: get_auth_request con 0x56179a65fbc0 auth_method 0 2024-09-12T18:00:30.203 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:30.203 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:00:30.203 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 10 monclient: dump: 2024-09-12T18:00:30.203 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:00:30.203 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:00:30.203 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.203 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.204 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:30.204 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.204 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:00:30.204 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:00:30.204 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:00:30.204 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.204 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 10 monclient: _finish_auth 0 2024-09-12T18:00:30.204 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:00:30.204 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:30.204 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:30.204 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:00:30.204 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 10 monclient: dump: 2024-09-12T18:00:30.204 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:00:30.204 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:00:30.205 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.205 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.205 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:30.205 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.205 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:00:30.205 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:00:30.205 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:00:30.205 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.205 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T18:00:30.056+0000 7ff90ffff640 4 set_mon_vals no callback set 2024-09-12T18:00:30.205 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 monclient: authenticate success, global_id 7460 2024-09-12T18:00:30.205 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient: _renew_subs 2024-09-12T18:00:30.205 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:00:30.205 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient: _renew_subs 2024-09-12T18:00:30.205 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:00:30.205 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 1 librados: init done 2024-09-12T18:00:30.206 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command cr dump hook 0x56179a651df8 2024-09-12T18:00:30.206 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.206 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:00:30.206 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:00:30.206 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:00:30.206 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T18:00:30.060+0000 7ffa384dd640 10 monclient: get_auth_request con 0x7ff904070ae0 auth_method 0 2024-09-12T18:00:30.206 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T18:00:30.060+0000 7ffa394df640 10 monclient: get_auth_request con 0x56179a678ee0 auth_method 0 2024-09-12T18:00:30.206 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.206 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 realm 2024-09-12T18:00:30.206 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.206 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.206 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:30.206 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.206 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.207 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.207 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T18:00:30.060+0000 7ffa38cde640 10 monclient: get_auth_request con 0x56179a67d140 auth_method 0 2024-09-12T18:00:30.207 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:30.207 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.207 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:30.207 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 searching for the correct realm 2024-09-12T18:00:30.207 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T18:00:30.060+0000 7ffa384dd640 10 monclient: get_auth_request con 0x56179a682420 auth_method 0 2024-09-12T18:00:30.207 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T18:00:30.064+0000 7ffa394df640 10 monclient: get_auth_request con 0x7ffa2c01d040 auth_method 0 2024-09-12T18:00:30.207 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T18:00:30.064+0000 7ffa38cde640 10 monclient: get_auth_request con 0x7ffa30004040 auth_method 0 2024-09-12T18:00:30.207 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T18:00:30.064+0000 7ffa384dd640 10 monclient: get_auth_request con 0x7ffa280627d0 auth_method 0 2024-09-12T18:00:30.207 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T18:00:30.068+0000 7ffa384dd640 0 -- 172.21.15.98:0/3835894165 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x56179a682420 msgr2=0x56179a6848e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:30.207 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T18:00:30.068+0000 7ff90e7fc640 1 client.7460.objecter ms_handle_reset 0x56179a682420 session 0x56179a681da0 osd.3 2024-09-12T18:00:30.207 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T18:00:30.068+0000 7ff90e7fc640 10 monclient: _renew_subs 2024-09-12T18:00:30.208 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T18:00:30.068+0000 7ff90e7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:00:30.208 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T18:00:30.068+0000 7ffa384dd640 10 monclient: get_auth_request con 0x7ff904081180 auth_method 0 2024-09-12T18:00:30.208 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T18:00:30.068+0000 7ffa394df640 10 monclient: get_auth_request con 0x7ffa2c06c8d0 auth_method 0 2024-09-12T18:00:30.208 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T18:00:30.072+0000 7ffa38cde640 10 monclient: get_auth_request con 0x7ffa2c08abf0 auth_method 0 2024-09-12T18:00:30.208 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T18:00:30.072+0000 7ffa38cde640 0 -- 172.21.15.98:0/3835894165 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7ffa2c08abf0 msgr2=0x7ffa2c061ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:30.208 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T18:00:30.072+0000 7ff90e7fc640 1 client.7460.objecter ms_handle_reset 0x7ffa2c08abf0 session 0x7ffa2c084920 osd.0 2024-09-12T18:00:30.208 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T18:00:30.072+0000 7ffa38cde640 10 monclient: get_auth_request con 0x56179a682420 auth_method 0 2024-09-12T18:00:30.208 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:30.208 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:00:30.208 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:30.208 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:00:30.208 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:30.208 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:30.209 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.209 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.209 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.209 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:30.209 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.209 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:30.209 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 zone default found 2024-09-12T18:00:30.209 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 4 Realm: () 2024-09-12T18:00:30.209 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:00:30.209 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:00:30.209 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:30.209 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 zonegroup default 2024-09-12T18:00:30.209 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.209 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.210 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.210 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T18:00:30.084+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.210 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T18:00:30.084+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.210 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T18:00:30.084+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.210 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T18:00:30.084+0000 7ffa3b1d89c0 20 started sync module instance, tier type = 2024-09-12T18:00:30.210 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T18:00:30.084+0000 7ffa3b1d89c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:00:30.210 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=0 2024-09-12T18:00:30.210 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=1 2024-09-12T18:00:30.210 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=2 2024-09-12T18:00:30.210 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=3 2024-09-12T18:00:30.210 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=4 2024-09-12T18:00:30.210 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=5 2024-09-12T18:00:30.210 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=6 2024-09-12T18:00:30.210 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=7 2024-09-12T18:00:30.211 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:30.211 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding auth protocol: cephx 2024-09-12T18:00:30.211 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding auth protocol: cephx 2024-09-12T18:00:30.211 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding auth protocol: cephx 2024-09-12T18:00:30.211 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: secure 2024-09-12T18:00:30.211 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: crc 2024-09-12T18:00:30.211 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: secure 2024-09-12T18:00:30.211 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: crc 2024-09-12T18:00:30.211 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: secure 2024-09-12T18:00:30.211 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: crc 2024-09-12T18:00:30.211 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T18:00:30.100+0000 7ff8ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:30.211 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: crc 2024-09-12T18:00:30.211 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: secure 2024-09-12T18:00:30.211 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: crc 2024-09-12T18:00:30.211 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: secure 2024-09-12T18:00:30.212 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: crc 2024-09-12T18:00:30.212 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: secure 2024-09-12T18:00:30.212 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.212 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:30.212 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:30.212 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command cache list hook 0x56179a652ee0 2024-09-12T18:00:30.212 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command cache inspect hook 0x56179a652ee0 2024-09-12T18:00:30.212 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command cache erase hook 0x56179a652ee0 2024-09-12T18:00:30.212 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command cache zap hook 0x56179a652ee0 2024-09-12T18:00:30.212 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 note: GC not initialized 2024-09-12T18:00:30.212 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T18:00:30.104+0000 7ff8ee7e4640 20 reqs_thread_entry: start 2024-09-12T18:00:30.212 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command sync trace show hook 0x7ffa28081f20 2024-09-12T18:00:30.212 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command sync trace history hook 0x7ffa28081f20 2024-09-12T18:00:30.212 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command sync trace active hook 0x7ffa28081f20 2024-09-12T18:00:30.213 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command sync trace active_short hook 0x7ffa28081f20 2024-09-12T18:00:30.213 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 20 init_complete bucket index max shards: 11 2024-09-12T18:00:30.213 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 20 Filter name: none 2024-09-12T18:00:30.213 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T18:00:30.104+0000 7ff8e77fe640 20 reqs_thread_entry: start 2024-09-12T18:00:30.213 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T18:00:30.213 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.213 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:30.213 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T18:00:30.213 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T18:00:30.213 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 : miss 2024-09-12T18:00:30.213 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.213 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:00:30.213 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 info.flags=0x17 2024-09-12T18:00:30.213 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 to cache LRU end 2024-09-12T18:00:30.214 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:30.214 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:30.214 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 2024-09-12T18:00:30.214 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T18:00:30.112+0000 7ffa3b1d89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 info.flags=0x17 2024-09-12T18:00:30.214 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T18:00:30.112+0000 7ffa3b1d89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 to cache LRU end 2024-09-12T18:00:30.214 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T18:00:30.112+0000 7ffa3b1d89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:30.214 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T18:00:30.112+0000 7ffa3b1d89c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39, ofs0, ns] 2024-09-12T18:00:30.214 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T18:00:30.116+0000 7ff90f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366263 cookie 94659374766816 notifier 7460 bl.length()=931 2024-09-12T18:00:30.214 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T18:00:30.116+0000 7ff90f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 info.flags=0x17 2024-09-12T18:00:30.214 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T18:00:30.116+0000 7ff90f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 to cache LRU end 2024-09-12T18:00:30.214 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T18:00:30.116+0000 7ff90f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:30.214 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T18:00:30.116+0000 7ffa3b1d89c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): orig_sources= new_sources= 2024-09-12T18:00:30.214 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T18:00:30.116+0000 7ffa3b1d89c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): potential sources added=[] removed=[] 2024-09-12T18:00:30.214 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T18:00:30.116+0000 7ffa3b1d89c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): orig_dests= new_dests= 2024-09-12T18:00:30.215 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T18:00:30.116+0000 7ffa3b1d89c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): potential dests added=[] removed=[] 2024-09-12T18:00:30.215 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.0 2024-09-12T18:00:30.215 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.0 2024-09-12T18:00:30.215 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.1 2024-09-12T18:00:30.215 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.1 2024-09-12T18:00:30.215 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.2 2024-09-12T18:00:30.215 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.2 2024-09-12T18:00:30.215 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.3 2024-09-12T18:00:30.215 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.3 2024-09-12T18:00:30.215 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.4 2024-09-12T18:00:30.215 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.4 2024-09-12T18:00:30.215 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.5 2024-09-12T18:00:30.215 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.5 2024-09-12T18:00:30.216 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.6 2024-09-12T18:00:30.216 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.6 2024-09-12T18:00:30.216 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.7 2024-09-12T18:00:30.216 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.7 2024-09-12T18:00:30.216 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.8 2024-09-12T18:00:30.216 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.8 2024-09-12T18:00:30.216 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.9 2024-09-12T18:00:30.216 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.9 2024-09-12T18:00:30.216 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.10 2024-09-12T18:00:30.216 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.10 2024-09-12T18:00:30.216 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.11 2024-09-12T18:00:30.216 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.11 2024-09-12T18:00:30.216 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.0 2024-09-12T18:00:30.216 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T18:00:30.128+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1 2024-09-12T18:00:30.217 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T18:00:30.128+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2 2024-09-12T18:00:30.217 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T18:00:30.128+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.3 2024-09-12T18:00:30.217 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T18:00:30.128+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.4 2024-09-12T18:00:30.217 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T18:00:30.128+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.5 2024-09-12T18:00:30.217 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T18:00:30.128+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.6 2024-09-12T18:00:30.217 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T18:00:30.132+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.7 2024-09-12T18:00:30.217 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T18:00:30.132+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.8 2024-09-12T18:00:30.217 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T18:00:30.132+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.9 2024-09-12T18:00:30.217 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T18:00:30.132+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.10 2024-09-12T18:00:30.217 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T18:00:30.140+0000 7ffa3b1d89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffa3b1d89c0 time 2024-09-12T18:00:30.145778+0000 2024-09-12T18:00:30.217 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:00:30.217 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.217 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:30.218 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ffa3eab22eb] 2024-09-12T18:00:30.218 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffa3eab249f] 2024-09-12T18:00:30.218 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561798bfa0c1] 2024-09-12T18:00:30.218 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x561798c0b4f1] 2024-09-12T18:00:30.218 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561798c0cb44] 2024-09-12T18:00:30.218 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T18:00:30.218 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffa3d918d90] 2024-09-12T18:00:30.218 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T18:00:30.218 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T18:00:30.218 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.218 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T18:00:30.144+0000 7ffa3b1d89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:00:30.218 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7ffa3b1d89c0 thread_name:radosgw-admin 2024-09-12T18:00:30.218 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.218 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:30.219 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ffa3d931520] 2024-09-12T18:00:30.219 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T18:00:30.219 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T18:00:30.219 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T18:00:30.219 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ffa3eab2345] 2024-09-12T18:00:30.219 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffa3eab249f] 2024-09-12T18:00:30.219 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561798bfa0c1] 2024-09-12T18:00:30.219 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x561798c0b4f1] 2024-09-12T18:00:30.219 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561798c0cb44] 2024-09-12T18:00:30.219 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T18:00:30.219 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffa3d918d90] 2024-09-12T18:00:30.219 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T18:00:30.219 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T18:00:30.219 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:00:30.220 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.220 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T18:00:30.220 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T18:00:30.220 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T18:00:30.220 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T18:00:30.220 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T18:00:30.220 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T18:00:30.220 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T18:00:30.220 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T18:00:30.220 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T18:00:30.220 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T18:00:30.220 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T18:00:30.220 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T18:00:30.221 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T18:00:30.221 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T18:00:30.221 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T18:00:30.221 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T18:00:30.221 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T18:00:30.221 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T18:00:30.221 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T18:00:30.221 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T18:00:30.221 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T18:00:30.221 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T18:00:30.221 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T18:00:30.221 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T18:00:30.221 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:00:30.221 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T18:00:30.221 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T18:00:30.222 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T18:00:30.222 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T18:00:30.222 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T18:00:30.222 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T18:00:30.222 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T18:00:30.222 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T18:00:30.222 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T18:00:30.222 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T18:00:30.222 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T18:00:30.222 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T18:00:30.222 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T18:00:30.222 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T18:00:30.222 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T18:00:30.222 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T18:00:30.223 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T18:00:30.223 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T18:00:30.223 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T18:00:30.223 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T18:00:30.223 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T18:00:30.223 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:00:30.223 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T18:00:30.223 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:00:30.223 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T18:00:30.223 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T18:00:30.223 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T18:00:30.223 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T18:00:30.223 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T18:00:30.223 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T18:00:30.224 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T18:00:30.224 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T18:00:30.224 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T18:00:30.224 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T18:00:30.224 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T18:00:30.224 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T18:00:30.224 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T18:00:30.224 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T18:00:30.224 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T18:00:30.224 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T18:00:30.224 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T18:00:30.224 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T18:00:30.224 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:00:30.224 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T18:00:30.225 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:00:30.225 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T18:00:30.225 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T18:00:30.225 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T18:00:30.225 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T18:00:30.225 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T18:00:30.225 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T18:00:30.225 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:00:30.225 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T18:00:30.225 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T18:00:30.225 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:00:30.225 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T18:00:30.225 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T18:00:30.225 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T18:00:30.226 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T18:00:30.226 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T18:00:30.226 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T18:00:30.226 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T18:00:30.226 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T18:00:30.226 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T18:00:30.226 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T18:00:30.226 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T18:00:30.226 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T18:00:30.226 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T18:00:30.226 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:00:30.226 INFO:tasks.workunit.client.0.smithi098.stderr: 7ff8e77fe640 / http_manager 2024-09-12T18:00:30.226 INFO:tasks.workunit.client.0.smithi098.stderr: 7ff8ee7e4640 / http_manager 2024-09-12T18:00:30.226 INFO:tasks.workunit.client.0.smithi098.stderr: 7ff8ef7e6640 / rgw_dt_lg_renew 2024-09-12T18:00:30.226 INFO:tasks.workunit.client.0.smithi098.stderr: 7ff90e7fc640 / ms_dispatch 2024-09-12T18:00:30.227 INFO:tasks.workunit.client.0.smithi098.stderr: 7ff90f7fe640 / io_context_pool 2024-09-12T18:00:30.227 INFO:tasks.workunit.client.0.smithi098.stderr: 7ff90ffff640 / io_context_pool 2024-09-12T18:00:30.227 INFO:tasks.workunit.client.0.smithi098.stderr: 7ff91e7fc640 / ms_dispatch 2024-09-12T18:00:30.227 INFO:tasks.workunit.client.0.smithi098.stderr: 7ff92560a640 / ms_dispatch 2024-09-12T18:00:30.227 INFO:tasks.workunit.client.0.smithi098.stderr: 7ff926e0d640 / io_context_pool 2024-09-12T18:00:30.227 INFO:tasks.workunit.client.0.smithi098.stderr: 7ffa384dd640 / msgr-worker-2 2024-09-12T18:00:30.227 INFO:tasks.workunit.client.0.smithi098.stderr: 7ffa38cde640 / msgr-worker-1 2024-09-12T18:00:30.227 INFO:tasks.workunit.client.0.smithi098.stderr: 7ffa394df640 / msgr-worker-0 2024-09-12T18:00:30.227 INFO:tasks.workunit.client.0.smithi098.stderr: 7ffa39ce0640 / io_context_pool 2024-09-12T18:00:30.227 INFO:tasks.workunit.client.0.smithi098.stderr: 7ffa3b1d89c0 / radosgw-admin 2024-09-12T18:00:30.227 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T18:00:30.227 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T18:00:30.227 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/log/ceph/ceph-client.admin.134693.log 2024-09-12T18:00:30.227 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T18:00:30.227 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T18:00:30.228 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a592cd0) adding con mode: crc 2024-09-12T18:00:30.228 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a592cd0) adding con mode: secure 2024-09-12T18:00:30.228 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.228 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 1 librados: starting msgr at 2024-09-12T18:00:30.228 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 1 librados: starting objecter 2024-09-12T18:00:30.228 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command objecter_requests hook 0x56179a2fba30 2024-09-12T18:00:30.228 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 1 librados: setting wanted keys 2024-09-12T18:00:30.228 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 1 librados: calling monclient init 2024-09-12T18:00:30.228 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient: init 2024-09-12T18:00:30.228 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding auth protocol: cephx 2024-09-12T18:00:30.228 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding auth protocol: cephx 2024-09-12T18:00:30.228 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding auth protocol: cephx 2024-09-12T18:00:30.228 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: secure 2024-09-12T18:00:30.229 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: crc 2024-09-12T18:00:30.229 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: secure 2024-09-12T18:00:30.229 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: crc 2024-09-12T18:00:30.229 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: secure 2024-09-12T18:00:30.229 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: crc 2024-09-12T18:00:30.229 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: crc 2024-09-12T18:00:30.229 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: secure 2024-09-12T18:00:30.229 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: crc 2024-09-12T18:00:30.229 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: secure 2024-09-12T18:00:30.229 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: crc 2024-09-12T18:00:30.229 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a58cdb0) adding con mode: secure 2024-09-12T18:00:30.229 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.229 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.229 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command rotate-key hook 0x56179a58cef8 2024-09-12T18:00:30.230 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:00:30.230 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:00:30.230 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-a con 0x56179a43cd00 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:00:30.230 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-b con 0x56179a43d0e0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:00:30.230 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-c con 0x56179a43d4f0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:00:30.230 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.230 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.230 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.230 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:00:30.230 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T18:00:30.036+0000 7ffa3b1d89c0 10 monclient(hunting): authenticate will time out at 2826.611990s 2024-09-12T18:00:30.230 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T18:00:30.040+0000 7ffa394df640 10 monclient(hunting): get_auth_request con 0x56179a43d4f0 auth_method 0 2024-09-12T18:00:30.230 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T18:00:30.040+0000 7ffa394df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:30.230 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T18:00:30.040+0000 7ffa394df640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:30.230 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T18:00:30.040+0000 7ffa394df640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:30.231 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T18:00:30.040+0000 7ffa38cde640 10 monclient(hunting): get_auth_request con 0x56179a43cd00 auth_method 0 2024-09-12T18:00:30.231 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T18:00:30.040+0000 7ffa38cde640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:30.231 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T18:00:30.040+0000 7ffa38cde640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:30.231 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T18:00:30.040+0000 7ffa38cde640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:30.231 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T18:00:30.040+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:30.231 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T18:00:30.040+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:30.231 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T18:00:30.040+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:30.231 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T18:00:30.040+0000 7ffa394df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:30.231 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T18:00:30.040+0000 7ffa394df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:30.231 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T18:00:30.040+0000 7ffa394df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:30.231 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T18:00:30.040+0000 7ffa38cde640 10 monclient(hunting): handle_auth_done global_id 8091 payload 824 2024-09-12T18:00:30.231 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T18:00:30.040+0000 7ffa38cde640 10 monclient: _finish_hunting 0 2024-09-12T18:00:30.231 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T18:00:30.040+0000 7ffa38cde640 1 monclient: found mon.noname-a 2024-09-12T18:00:30.231 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T18:00:30.040+0000 7ffa38cde640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T18:00:30.232 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T18:00:30.040+0000 7ff92560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:30.232 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T18:00:30.040+0000 7ff92560a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:00:30.232 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T18:00:30.040+0000 7ff92560a640 10 monclient: dump: 2024-09-12T18:00:30.232 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:00:30.232 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:00:30.232 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.232 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.232 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:30.232 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.232 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:00:30.232 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:00:30.232 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:00:30.232 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.232 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T18:00:30.040+0000 7ff92560a640 10 monclient: _finish_auth 0 2024-09-12T18:00:30.232 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T18:00:30.040+0000 7ff92560a640 10 monclient: _check_auth_tickets 2024-09-12T18:00:30.233 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T18:00:30.040+0000 7ff92560a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:30.233 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T18:00:30.040+0000 7ff92560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:30.233 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T18:00:30.040+0000 7ff92560a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:00:30.233 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T18:00:30.040+0000 7ff92560a640 10 monclient: dump: 2024-09-12T18:00:30.233 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:00:30.233 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:00:30.233 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.233 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.233 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:30.233 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.233 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:00:30.233 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:00:30.233 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:00:30.233 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.234 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T18:00:30.040+0000 7ffa3b1d89c0 5 monclient: authenticate success, global_id 8091 2024-09-12T18:00:30.234 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T18:00:30.040+0000 7ffa3b1d89c0 10 monclient: _renew_subs 2024-09-12T18:00:30.234 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T18:00:30.040+0000 7ff926e0d640 4 set_mon_vals no callback set 2024-09-12T18:00:30.234 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T18:00:30.040+0000 7ffa3b1d89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:00:30.234 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T18:00:30.040+0000 7ffa3b1d89c0 10 monclient: _renew_subs 2024-09-12T18:00:30.234 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T18:00:30.040+0000 7ffa3b1d89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:00:30.234 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T18:00:30.040+0000 7ffa3b1d89c0 1 librados: init done 2024-09-12T18:00:30.234 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T18:00:30.040+0000 7ff92560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:00:30.234 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T18:00:30.040+0000 7ff92560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:00:30.234 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T18:00:30.040+0000 7ff92560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:00:30.234 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T18:00:30.040+0000 7ffa384dd640 10 monclient: get_auth_request con 0x7ff920070ae0 auth_method 0 2024-09-12T18:00:30.234 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T18:00:30.040+0000 7ffa394df640 10 monclient: get_auth_request con 0x56179a5ceb00 auth_method 0 2024-09-12T18:00:30.234 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T18:00:30.044+0000 7ffa38cde640 10 monclient: get_auth_request con 0x56179a5d8c90 auth_method 0 2024-09-12T18:00:30.234 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T18:00:30.044+0000 7ffa384dd640 10 monclient: get_auth_request con 0x56179a5de1d0 auth_method 0 2024-09-12T18:00:30.234 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient: build_initial_monmap 2024-09-12T18:00:30.235 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 1 build_initial for_mkfs: 0 2024-09-12T18:00:30.235 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient: monmap: 2024-09-12T18:00:30.235 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:00:30.235 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:30.235 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:00:30.235 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:00:30.235 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:30.235 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.235 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:00:30.235 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:00:30.235 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:00:30.235 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.235 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding auth protocol: cephx 2024-09-12T18:00:30.235 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding auth protocol: cephx 2024-09-12T18:00:30.236 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding auth protocol: cephx 2024-09-12T18:00:30.236 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: secure 2024-09-12T18:00:30.236 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: crc 2024-09-12T18:00:30.236 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: secure 2024-09-12T18:00:30.236 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: crc 2024-09-12T18:00:30.236 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: secure 2024-09-12T18:00:30.236 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: crc 2024-09-12T18:00:30.236 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: crc 2024-09-12T18:00:30.236 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: secure 2024-09-12T18:00:30.236 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: crc 2024-09-12T18:00:30.236 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: secure 2024-09-12T18:00:30.236 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: crc 2024-09-12T18:00:30.236 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e1fb0) adding con mode: secure 2024-09-12T18:00:30.236 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.237 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command objecter_requests cmddesc objecter_requests hook 0x56179a5e7c50 EEXIST 2024-09-12T18:00:30.237 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient: init 2024-09-12T18:00:30.237 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding auth protocol: cephx 2024-09-12T18:00:30.237 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding auth protocol: cephx 2024-09-12T18:00:30.237 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding auth protocol: cephx 2024-09-12T18:00:30.237 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: secure 2024-09-12T18:00:30.237 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: crc 2024-09-12T18:00:30.237 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: secure 2024-09-12T18:00:30.237 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: crc 2024-09-12T18:00:30.237 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: secure 2024-09-12T18:00:30.237 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: crc 2024-09-12T18:00:30.237 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: crc 2024-09-12T18:00:30.237 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: secure 2024-09-12T18:00:30.237 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: crc 2024-09-12T18:00:30.238 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: secure 2024-09-12T18:00:30.238 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: crc 2024-09-12T18:00:30.238 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a5e0f68) adding con mode: secure 2024-09-12T18:00:30.238 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.238 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.238 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command rotate-key cmddesc rotate-key hook 0x56179a5e10b0 EEXIST 2024-09-12T18:00:30.238 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:00:30.238 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:00:30.238 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-a con 0x56179a60b910 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:00:30.238 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-c con 0x56179a611da0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:00:30.238 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-b con 0x56179a60bcf0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:00:30.238 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.238 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.239 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.239 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:00:30.239 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient(hunting): authenticate will time out at 2826.621873s 2024-09-12T18:00:30.239 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T18:00:30.048+0000 7ffa38cde640 10 monclient(hunting): get_auth_request con 0x56179a60b910 auth_method 0 2024-09-12T18:00:30.239 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T18:00:30.048+0000 7ffa38cde640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:30.239 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T18:00:30.048+0000 7ffa38cde640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:30.239 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T18:00:30.048+0000 7ffa38cde640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:30.239 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T18:00:30.048+0000 7ffa384dd640 10 monclient(hunting): get_auth_request con 0x56179a611da0 auth_method 0 2024-09-12T18:00:30.239 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T18:00:30.048+0000 7ffa384dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:30.239 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T18:00:30.048+0000 7ffa384dd640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:30.239 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T18:00:30.048+0000 7ffa384dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:30.239 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T18:00:30.048+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:30.239 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T18:00:30.048+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:30.239 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T18:00:30.048+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:30.240 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T18:00:30.048+0000 7ffa384dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:30.240 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T18:00:30.048+0000 7ffa384dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:30.240 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T18:00:30.048+0000 7ffa384dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:30.240 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T18:00:30.048+0000 7ffa394df640 10 monclient(hunting): get_auth_request con 0x56179a60bcf0 auth_method 0 2024-09-12T18:00:30.240 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T18:00:30.048+0000 7ffa394df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:30.240 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T18:00:30.048+0000 7ffa394df640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:30.240 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T18:00:30.048+0000 7ffa394df640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:30.240 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T18:00:30.048+0000 7ffa384dd640 10 monclient(hunting): handle_auth_done global_id 7454 payload 824 2024-09-12T18:00:30.240 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T18:00:30.048+0000 7ffa384dd640 10 monclient: _finish_hunting 0 2024-09-12T18:00:30.240 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T18:00:30.048+0000 7ffa384dd640 1 monclient: found mon.noname-c 2024-09-12T18:00:30.240 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T18:00:30.048+0000 7ffa384dd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:00:30.240 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T18:00:30.048+0000 7ff91e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:30.240 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T18:00:30.048+0000 7ff91e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:00:30.240 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T18:00:30.048+0000 7ff91e7fc640 10 monclient: dump: 2024-09-12T18:00:30.241 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:00:30.241 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:00:30.241 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.241 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.241 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:30.241 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.241 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:00:30.241 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:00:30.241 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:00:30.241 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.241 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T18:00:30.048+0000 7ff91e7fc640 10 monclient: _finish_auth 0 2024-09-12T18:00:30.241 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T18:00:30.048+0000 7ff91e7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:00:30.241 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 5 monclient: authenticate success, global_id 7454 2024-09-12T18:00:30.241 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T18:00:30.048+0000 7ff91e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:30.242 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T18:00:30.048+0000 7ff91e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:30.242 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T18:00:30.048+0000 7ff91e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:00:30.242 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T18:00:30.048+0000 7ff91e7fc640 10 monclient: dump: 2024-09-12T18:00:30.242 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:00:30.242 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:00:30.242 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.242 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.242 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:30.242 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.242 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:00:30.242 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:00:30.242 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:00:30.242 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.242 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T18:00:30.048+0000 7ffa39ce0640 4 set_mon_vals no callback set 2024-09-12T18:00:30.243 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient: _renew_subs 2024-09-12T18:00:30.243 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:00:30.243 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient: _renew_subs 2024-09-12T18:00:30.243 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T18:00:30.048+0000 7ffa3b1d89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:00:30.243 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T18:00:30.052+0000 7ff91e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:00:30.243 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T18:00:30.052+0000 7ff91e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:00:30.243 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T18:00:30.052+0000 7ff91e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:00:30.243 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient: get_monmap_and_config 2024-09-12T18:00:30.243 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient: build_initial_monmap 2024-09-12T18:00:30.243 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 1 build_initial for_mkfs: 0 2024-09-12T18:00:30.243 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient: monmap: 2024-09-12T18:00:30.243 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:00:30.243 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:30.243 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:00:30.243 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:00:30.244 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:30.244 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.244 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:00:30.244 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:00:30.244 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:00:30.244 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.244 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding auth protocol: cephx 2024-09-12T18:00:30.244 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding auth protocol: cephx 2024-09-12T18:00:30.244 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding auth protocol: cephx 2024-09-12T18:00:30.244 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: secure 2024-09-12T18:00:30.244 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: crc 2024-09-12T18:00:30.244 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: secure 2024-09-12T18:00:30.244 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: crc 2024-09-12T18:00:30.244 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: secure 2024-09-12T18:00:30.245 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: crc 2024-09-12T18:00:30.245 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: crc 2024-09-12T18:00:30.245 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: secure 2024-09-12T18:00:30.245 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: crc 2024-09-12T18:00:30.245 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: secure 2024-09-12T18:00:30.245 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: crc 2024-09-12T18:00:30.245 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a62b6e0) adding con mode: secure 2024-09-12T18:00:30.245 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient: get_auth_request con 0x7ff9100709f0 auth_method 0 2024-09-12T18:00:30.245 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.245 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient: init 2024-09-12T18:00:30.245 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding auth protocol: cephx 2024-09-12T18:00:30.245 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding auth protocol: cephx 2024-09-12T18:00:30.245 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding auth protocol: cephx 2024-09-12T18:00:30.246 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: secure 2024-09-12T18:00:30.246 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: crc 2024-09-12T18:00:30.246 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: secure 2024-09-12T18:00:30.246 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: crc 2024-09-12T18:00:30.246 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: secure 2024-09-12T18:00:30.246 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: crc 2024-09-12T18:00:30.246 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: crc 2024-09-12T18:00:30.246 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: secure 2024-09-12T18:00:30.246 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: crc 2024-09-12T18:00:30.246 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: secure 2024-09-12T18:00:30.246 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: crc 2024-09-12T18:00:30.246 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed460) adding con mode: secure 2024-09-12T18:00:30.246 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.246 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.247 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command rotate-key cmddesc rotate-key hook 0x7fff4c9ed5a8 EEXIST 2024-09-12T18:00:30.247 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:00:30.247 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:00:30.247 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-a con 0x56179a65fbc0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:00:30.247 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-b con 0x56179a65afb0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:00:30.247 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-c con 0x56179a65b930 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:00:30.247 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.247 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.247 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.247 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:00:30.247 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient(hunting): authenticate will time out at 2826.626125s 2024-09-12T18:00:30.247 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient(hunting): get_auth_request con 0x56179a65fbc0 auth_method 0 2024-09-12T18:00:30.247 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:30.247 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:30.248 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:30.248 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T18:00:30.052+0000 7ffa394df640 10 monclient(hunting): get_auth_request con 0x56179a65b930 auth_method 0 2024-09-12T18:00:30.248 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T18:00:30.052+0000 7ffa394df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:30.248 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T18:00:30.052+0000 7ffa394df640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:30.248 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T18:00:30.052+0000 7ffa394df640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:30.248 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:30.248 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:30.248 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:30.248 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T18:00:30.052+0000 7ffa394df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:30.248 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T18:00:30.052+0000 7ffa394df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:30.248 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T18:00:30.052+0000 7ffa394df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:30.248 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient(hunting): handle_auth_done global_id 8097 payload 274 2024-09-12T18:00:30.248 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient: _finish_hunting 0 2024-09-12T18:00:30.249 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T18:00:30.052+0000 7ffa38cde640 1 monclient: found mon.noname-a 2024-09-12T18:00:30.249 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T18:00:30.052+0000 7ffa38cde640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T18:00:30.249 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T18:00:30.052+0000 7ffa384dd640 10 monclient: get_auth_request con 0x56179a65afb0 auth_method 0 2024-09-12T18:00:30.249 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T18:00:30.052+0000 7ff90ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:30.249 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T18:00:30.052+0000 7ff90ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:00:30.249 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T18:00:30.052+0000 7ff90ffff640 10 monclient: dump: 2024-09-12T18:00:30.249 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:00:30.249 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:00:30.249 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.249 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.249 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:30.249 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.249 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:00:30.249 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:00:30.250 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:00:30.250 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.250 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T18:00:30.052+0000 7ff90ffff640 10 monclient: _finish_auth 0 2024-09-12T18:00:30.250 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T18:00:30.052+0000 7ff90ffff640 10 monclient: _check_auth_tickets 2024-09-12T18:00:30.250 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T18:00:30.052+0000 7ff90ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:30.250 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T18:00:30.052+0000 7ff90ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:30.250 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T18:00:30.052+0000 7ff90ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:00:30.250 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T18:00:30.052+0000 7ff90ffff640 10 monclient: dump: 2024-09-12T18:00:30.250 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:00:30.250 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:00:30.250 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.250 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.250 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:30.250 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.251 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:00:30.251 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:00:30.251 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:00:30.251 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.251 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 monclient: authenticate success, global_id 8097 2024-09-12T18:00:30.251 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient: get_monmap_and_config success 2024-09-12T18:00:30.251 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 4 set_mon_vals no callback set 2024-09-12T18:00:30.251 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient: shutdown 2024-09-12T18:00:30.251 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient: build_initial_monmap 2024-09-12T18:00:30.251 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 1 build_initial for_mkfs: 0 2024-09-12T18:00:30.251 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 10 monclient: monmap: 2024-09-12T18:00:30.251 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:00:30.251 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:00:30.251 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:00:30.252 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:00:30.252 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:00:30.252 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.252 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:00:30.252 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:00:30.252 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:00:30.252 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.252 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding auth protocol: cephx 2024-09-12T18:00:30.252 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding auth protocol: cephx 2024-09-12T18:00:30.252 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding auth protocol: cephx 2024-09-12T18:00:30.252 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: secure 2024-09-12T18:00:30.252 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: crc 2024-09-12T18:00:30.252 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: secure 2024-09-12T18:00:30.253 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: crc 2024-09-12T18:00:30.253 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: secure 2024-09-12T18:00:30.253 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: crc 2024-09-12T18:00:30.253 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: crc 2024-09-12T18:00:30.253 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: secure 2024-09-12T18:00:30.253 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: crc 2024-09-12T18:00:30.253 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: secure 2024-09-12T18:00:30.253 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: crc 2024-09-12T18:00:30.253 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a6521b0) adding con mode: secure 2024-09-12T18:00:30.253 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.253 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 1 librados: starting msgr at 2024-09-12T18:00:30.253 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 1 librados: starting objecter 2024-09-12T18:00:30.253 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T18:00:30.052+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command objecter_requests cmddesc objecter_requests hook 0x56179a652c20 EEXIST 2024-09-12T18:00:30.253 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 1 librados: setting wanted keys 2024-09-12T18:00:30.254 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 1 librados: calling monclient init 2024-09-12T18:00:30.254 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient: init 2024-09-12T18:00:30.254 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding auth protocol: cephx 2024-09-12T18:00:30.254 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding auth protocol: cephx 2024-09-12T18:00:30.254 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding auth protocol: cephx 2024-09-12T18:00:30.254 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: secure 2024-09-12T18:00:30.254 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: crc 2024-09-12T18:00:30.254 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: secure 2024-09-12T18:00:30.254 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: crc 2024-09-12T18:00:30.254 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: secure 2024-09-12T18:00:30.254 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: crc 2024-09-12T18:00:30.254 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: crc 2024-09-12T18:00:30.254 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: secure 2024-09-12T18:00:30.255 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: crc 2024-09-12T18:00:30.255 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: secure 2024-09-12T18:00:30.255 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: crc 2024-09-12T18:00:30.255 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 AuthRegistry(0x56179a609d70) adding con mode: secure 2024-09-12T18:00:30.255 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.255 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.255 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command rotate-key cmddesc rotate-key hook 0x56179a609eb8 EEXIST 2024-09-12T18:00:30.255 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient: _reopen_session rank -1 2024-09-12T18:00:30.255 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:00:30.255 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-c con 0x56179a65afb0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:00:30.255 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-a con 0x56179a65b930 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:00:30.255 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient(hunting): picked mon.noname-b con 0x56179a65fbc0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:00:30.255 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.255 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.255 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:00:30.256 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient(hunting): _renew_subs 2024-09-12T18:00:30.256 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient(hunting): authenticate will time out at 2826.628632s 2024-09-12T18:00:30.256 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T18:00:30.056+0000 7ffa38cde640 10 monclient(hunting): get_auth_request con 0x56179a65afb0 auth_method 0 2024-09-12T18:00:30.256 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T18:00:30.056+0000 7ffa38cde640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:30.256 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T18:00:30.056+0000 7ffa38cde640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:30.256 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T18:00:30.056+0000 7ffa38cde640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:30.256 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T18:00:30.056+0000 7ffa384dd640 10 monclient(hunting): get_auth_request con 0x56179a65b930 auth_method 0 2024-09-12T18:00:30.256 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T18:00:30.056+0000 7ffa384dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:00:30.256 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T18:00:30.056+0000 7ffa384dd640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:00:30.256 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T18:00:30.056+0000 7ffa384dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:00:30.256 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T18:00:30.056+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:30.256 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T18:00:30.056+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:30.256 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T18:00:30.056+0000 7ffa38cde640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:30.256 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T18:00:30.056+0000 7ffa384dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:00:30.257 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T18:00:30.056+0000 7ffa384dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:00:30.257 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T18:00:30.056+0000 7ffa384dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:00:30.257 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T18:00:30.056+0000 7ffa38cde640 10 monclient(hunting): handle_auth_done global_id 7460 payload 824 2024-09-12T18:00:30.257 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T18:00:30.056+0000 7ffa38cde640 10 monclient: _finish_hunting 0 2024-09-12T18:00:30.257 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T18:00:30.056+0000 7ffa38cde640 1 monclient: found mon.noname-c 2024-09-12T18:00:30.257 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T18:00:30.056+0000 7ffa38cde640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:00:30.257 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T18:00:30.056+0000 7ffa394df640 10 monclient: get_auth_request con 0x56179a65fbc0 auth_method 0 2024-09-12T18:00:30.257 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:30.257 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:00:30.257 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 10 monclient: dump: 2024-09-12T18:00:30.257 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:00:30.257 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:00:30.257 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.257 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.257 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:30.258 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.258 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:00:30.258 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:00:30.258 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:00:30.258 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.258 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 10 monclient: _finish_auth 0 2024-09-12T18:00:30.258 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:00:30.258 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:00:30.258 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:00:30.258 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:00:30.258 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 10 monclient: dump: 2024-09-12T18:00:30.258 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:00:30.258 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:00:30.259 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.259 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:00:30.259 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:00:30.259 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:00:30.259 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:00:30.259 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:00:30.259 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:00:30.259 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.259 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T18:00:30.056+0000 7ff90ffff640 4 set_mon_vals no callback set 2024-09-12T18:00:30.259 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 monclient: authenticate success, global_id 7460 2024-09-12T18:00:30.259 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient: _renew_subs 2024-09-12T18:00:30.259 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:00:30.259 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient: _renew_subs 2024-09-12T18:00:30.260 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:00:30.260 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 1 librados: init done 2024-09-12T18:00:30.260 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command cr dump hook 0x56179a651df8 2024-09-12T18:00:30.260 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T18:00:30.056+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.260 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:00:30.260 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:00:30.260 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T18:00:30.056+0000 7ff90e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:00:30.260 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T18:00:30.060+0000 7ffa384dd640 10 monclient: get_auth_request con 0x7ff904070ae0 auth_method 0 2024-09-12T18:00:30.260 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T18:00:30.060+0000 7ffa394df640 10 monclient: get_auth_request con 0x56179a678ee0 auth_method 0 2024-09-12T18:00:30.260 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.260 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 realm 2024-09-12T18:00:30.260 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.260 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.261 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:30.261 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.261 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.261 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.261 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T18:00:30.060+0000 7ffa38cde640 10 monclient: get_auth_request con 0x56179a67d140 auth_method 0 2024-09-12T18:00:30.261 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:30.261 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.261 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:30.261 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T18:00:30.060+0000 7ffa3b1d89c0 20 searching for the correct realm 2024-09-12T18:00:30.261 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T18:00:30.060+0000 7ffa384dd640 10 monclient: get_auth_request con 0x56179a682420 auth_method 0 2024-09-12T18:00:30.261 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T18:00:30.064+0000 7ffa394df640 10 monclient: get_auth_request con 0x7ffa2c01d040 auth_method 0 2024-09-12T18:00:30.261 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T18:00:30.064+0000 7ffa38cde640 10 monclient: get_auth_request con 0x7ffa30004040 auth_method 0 2024-09-12T18:00:30.261 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T18:00:30.064+0000 7ffa384dd640 10 monclient: get_auth_request con 0x7ffa280627d0 auth_method 0 2024-09-12T18:00:30.261 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T18:00:30.068+0000 7ffa384dd640 0 -- 172.21.15.98:0/3835894165 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x56179a682420 msgr2=0x56179a6848e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:30.262 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T18:00:30.068+0000 7ff90e7fc640 1 client.7460.objecter ms_handle_reset 0x56179a682420 session 0x56179a681da0 osd.3 2024-09-12T18:00:30.262 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T18:00:30.068+0000 7ff90e7fc640 10 monclient: _renew_subs 2024-09-12T18:00:30.262 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T18:00:30.068+0000 7ff90e7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:00:30.262 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T18:00:30.068+0000 7ffa384dd640 10 monclient: get_auth_request con 0x7ff904081180 auth_method 0 2024-09-12T18:00:30.262 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T18:00:30.068+0000 7ffa394df640 10 monclient: get_auth_request con 0x7ffa2c06c8d0 auth_method 0 2024-09-12T18:00:30.262 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T18:00:30.072+0000 7ffa38cde640 10 monclient: get_auth_request con 0x7ffa2c08abf0 auth_method 0 2024-09-12T18:00:30.262 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T18:00:30.072+0000 7ffa38cde640 0 -- 172.21.15.98:0/3835894165 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7ffa2c08abf0 msgr2=0x7ffa2c061ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:30.262 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T18:00:30.072+0000 7ff90e7fc640 1 client.7460.objecter ms_handle_reset 0x7ffa2c08abf0 session 0x7ffa2c084920 osd.0 2024-09-12T18:00:30.262 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T18:00:30.072+0000 7ffa38cde640 10 monclient: get_auth_request con 0x56179a682420 auth_method 0 2024-09-12T18:00:30.262 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:30.262 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:00:30.262 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:30.262 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:00:30.263 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:30.263 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:30.263 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.263 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.263 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.263 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:30.263 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.263 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:30.263 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 zone default found 2024-09-12T18:00:30.263 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 4 Realm: () 2024-09-12T18:00:30.263 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:00:30.263 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:00:30.263 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:30.263 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 zonegroup default 2024-09-12T18:00:30.264 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.264 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.264 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T18:00:30.080+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.264 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T18:00:30.084+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.264 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T18:00:30.084+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.264 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T18:00:30.084+0000 7ffa3b1d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.264 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T18:00:30.084+0000 7ffa3b1d89c0 20 started sync module instance, tier type = 2024-09-12T18:00:30.264 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T18:00:30.084+0000 7ffa3b1d89c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:00:30.264 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=0 2024-09-12T18:00:30.264 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=1 2024-09-12T18:00:30.264 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=2 2024-09-12T18:00:30.264 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=3 2024-09-12T18:00:30.264 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=4 2024-09-12T18:00:30.264 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=5 2024-09-12T18:00:30.265 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=6 2024-09-12T18:00:30.265 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 add_watcher() i=7 2024-09-12T18:00:30.265 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:30.265 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding auth protocol: cephx 2024-09-12T18:00:30.265 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding auth protocol: cephx 2024-09-12T18:00:30.265 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding auth protocol: cephx 2024-09-12T18:00:30.265 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: secure 2024-09-12T18:00:30.265 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: crc 2024-09-12T18:00:30.265 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: secure 2024-09-12T18:00:30.265 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: crc 2024-09-12T18:00:30.265 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: secure 2024-09-12T18:00:30.265 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: crc 2024-09-12T18:00:30.265 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T18:00:30.100+0000 7ff8ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:30.265 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: crc 2024-09-12T18:00:30.266 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: secure 2024-09-12T18:00:30.266 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: crc 2024-09-12T18:00:30.266 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: secure 2024-09-12T18:00:30.266 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: crc 2024-09-12T18:00:30.266 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 AuthRegistry(0x7fff4c9ed930) adding con mode: secure 2024-09-12T18:00:30.266 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:00:30.266 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:30.266 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:30.266 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command cache list hook 0x56179a652ee0 2024-09-12T18:00:30.266 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command cache inspect hook 0x56179a652ee0 2024-09-12T18:00:30.266 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command cache erase hook 0x56179a652ee0 2024-09-12T18:00:30.266 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command cache zap hook 0x56179a652ee0 2024-09-12T18:00:30.266 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T18:00:30.100+0000 7ffa3b1d89c0 5 note: GC not initialized 2024-09-12T18:00:30.267 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T18:00:30.104+0000 7ff8ee7e4640 20 reqs_thread_entry: start 2024-09-12T18:00:30.267 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command sync trace show hook 0x7ffa28081f20 2024-09-12T18:00:30.267 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command sync trace history hook 0x7ffa28081f20 2024-09-12T18:00:30.267 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command sync trace active hook 0x7ffa28081f20 2024-09-12T18:00:30.267 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 5 asok(0x56179a3832b0) register_command sync trace active_short hook 0x7ffa28081f20 2024-09-12T18:00:30.267 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 20 init_complete bucket index max shards: 11 2024-09-12T18:00:30.267 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 20 Filter name: none 2024-09-12T18:00:30.267 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T18:00:30.104+0000 7ff8e77fe640 20 reqs_thread_entry: start 2024-09-12T18:00:30.267 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T18:00:30.267 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.267 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:30.267 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T18:00:30.267 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T18:00:30.267 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 : miss 2024-09-12T18:00:30.268 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.268 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:00:30.268 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 info.flags=0x17 2024-09-12T18:00:30.268 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 to cache LRU end 2024-09-12T18:00:30.268 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:30.268 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:30.268 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T18:00:30.104+0000 7ffa3b1d89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 2024-09-12T18:00:30.268 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T18:00:30.112+0000 7ffa3b1d89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 info.flags=0x17 2024-09-12T18:00:30.268 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T18:00:30.112+0000 7ffa3b1d89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 to cache LRU end 2024-09-12T18:00:30.268 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T18:00:30.112+0000 7ffa3b1d89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:30.268 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T18:00:30.112+0000 7ffa3b1d89c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39, ofs0, ns] 2024-09-12T18:00:30.268 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T18:00:30.116+0000 7ff90f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366263 cookie 94659374766816 notifier 7460 bl.length()=931 2024-09-12T18:00:30.268 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T18:00:30.116+0000 7ff90f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 info.flags=0x17 2024-09-12T18:00:30.269 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T18:00:30.116+0000 7ff90f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 to cache LRU end 2024-09-12T18:00:30.269 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T18:00:30.116+0000 7ff90f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:30.269 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T18:00:30.116+0000 7ffa3b1d89c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): orig_sources= new_sources= 2024-09-12T18:00:30.269 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T18:00:30.116+0000 7ffa3b1d89c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): potential sources added=[] removed=[] 2024-09-12T18:00:30.269 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T18:00:30.116+0000 7ffa3b1d89c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): orig_dests= new_dests= 2024-09-12T18:00:30.269 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T18:00:30.116+0000 7ffa3b1d89c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): potential dests added=[] removed=[] 2024-09-12T18:00:30.269 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.0 2024-09-12T18:00:30.269 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.0 2024-09-12T18:00:30.269 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.1 2024-09-12T18:00:30.269 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.1 2024-09-12T18:00:30.269 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.2 2024-09-12T18:00:30.269 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.2 2024-09-12T18:00:30.269 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.3 2024-09-12T18:00:30.270 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.3 2024-09-12T18:00:30.270 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.4 2024-09-12T18:00:30.270 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.4 2024-09-12T18:00:30.270 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.5 2024-09-12T18:00:30.270 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.5 2024-09-12T18:00:30.270 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.6 2024-09-12T18:00:30.270 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.6 2024-09-12T18:00:30.270 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.7 2024-09-12T18:00:30.270 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.7 2024-09-12T18:00:30.270 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.8 2024-09-12T18:00:30.270 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.8 2024-09-12T18:00:30.270 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.9 2024-09-12T18:00:30.270 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.9 2024-09-12T18:00:30.270 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.10 2024-09-12T18:00:30.271 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.10 2024-09-12T18:00:30.271 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.11 2024-09-12T18:00:30.271 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1.11 2024-09-12T18:00:30.271 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T18:00:30.124+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.0 2024-09-12T18:00:30.271 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T18:00:30.128+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1 2024-09-12T18:00:30.271 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T18:00:30.128+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2 2024-09-12T18:00:30.271 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T18:00:30.128+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.3 2024-09-12T18:00:30.271 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T18:00:30.128+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.4 2024-09-12T18:00:30.271 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T18:00:30.128+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.5 2024-09-12T18:00:30.271 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T18:00:30.128+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.6 2024-09-12T18:00:30.271 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T18:00:30.132+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.7 2024-09-12T18:00:30.271 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T18:00:30.132+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.8 2024-09-12T18:00:30.271 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T18:00:30.132+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.9 2024-09-12T18:00:30.272 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T18:00:30.132+0000 7ffa3b1d89c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.10 2024-09-12T18:00:30.272 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T18:00:30.140+0000 7ffa3b1d89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffa3b1d89c0 time 2024-09-12T18:00:30.145778+0000 2024-09-12T18:00:30.272 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:00:30.272 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.272 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:30.272 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ffa3eab22eb] 2024-09-12T18:00:30.272 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffa3eab249f] 2024-09-12T18:00:30.272 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561798bfa0c1] 2024-09-12T18:00:30.272 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x561798c0b4f1] 2024-09-12T18:00:30.272 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561798c0cb44] 2024-09-12T18:00:30.272 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T18:00:30.272 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffa3d918d90] 2024-09-12T18:00:30.272 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T18:00:30.273 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T18:00:30.273 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.273 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T18:00:30.144+0000 7ffa3b1d89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:00:30.273 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7ffa3b1d89c0 thread_name:radosgw-admin 2024-09-12T18:00:30.273 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.273 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:00:30.273 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ffa3d931520] 2024-09-12T18:00:30.273 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T18:00:30.273 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T18:00:30.273 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T18:00:30.273 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ffa3eab2345] 2024-09-12T18:00:30.273 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffa3eab249f] 2024-09-12T18:00:30.273 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561798bfa0c1] 2024-09-12T18:00:30.273 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x561798c0b4f1] 2024-09-12T18:00:30.274 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561798c0cb44] 2024-09-12T18:00:30.274 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T18:00:30.274 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffa3d918d90] 2024-09-12T18:00:30.274 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T18:00:30.274 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T18:00:30.274 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:00:30.274 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.274 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T18:00:30.274 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T18:00:30.274 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T18:00:30.274 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T18:00:30.274 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T18:00:30.274 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T18:00:30.274 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T18:00:30.275 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T18:00:30.275 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T18:00:30.275 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T18:00:30.275 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T18:00:30.275 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T18:00:30.275 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T18:00:30.275 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T18:00:30.275 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T18:00:30.275 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T18:00:30.275 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T18:00:30.275 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T18:00:30.275 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T18:00:30.275 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T18:00:30.275 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T18:00:30.276 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T18:00:30.276 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T18:00:30.276 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T18:00:30.276 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:00:30.276 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T18:00:30.276 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T18:00:30.276 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T18:00:30.276 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T18:00:30.276 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T18:00:30.276 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T18:00:30.276 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T18:00:30.276 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T18:00:30.276 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T18:00:30.276 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T18:00:30.276 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T18:00:30.277 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T18:00:30.277 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T18:00:30.277 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T18:00:30.277 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T18:00:30.277 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T18:00:30.277 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T18:00:30.277 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T18:00:30.277 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T18:00:30.277 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T18:00:30.277 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T18:00:30.277 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:00:30.277 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T18:00:30.277 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:00:30.278 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T18:00:30.278 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T18:00:30.278 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T18:00:30.278 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T18:00:30.278 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T18:00:30.278 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T18:00:30.278 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T18:00:30.278 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T18:00:30.278 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T18:00:30.278 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T18:00:30.278 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T18:00:30.278 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T18:00:30.278 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T18:00:30.278 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T18:00:30.279 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T18:00:30.279 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T18:00:30.279 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T18:00:30.279 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T18:00:30.279 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:00:30.279 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T18:00:30.279 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:00:30.279 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T18:00:30.279 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T18:00:30.279 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T18:00:30.279 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T18:00:30.279 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T18:00:30.279 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T18:00:30.279 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:00:30.279 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T18:00:30.280 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T18:00:30.280 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:00:30.280 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T18:00:30.280 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T18:00:30.280 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T18:00:30.280 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T18:00:30.280 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T18:00:30.280 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T18:00:30.280 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T18:00:30.280 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T18:00:30.280 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T18:00:30.280 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T18:00:30.280 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T18:00:30.280 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T18:00:30.281 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T18:00:30.281 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:00:30.281 INFO:tasks.workunit.client.0.smithi098.stderr: 7ff8e77fe640 / http_manager 2024-09-12T18:00:30.281 INFO:tasks.workunit.client.0.smithi098.stderr: 7ff8ee7e4640 / http_manager 2024-09-12T18:00:30.281 INFO:tasks.workunit.client.0.smithi098.stderr: 7ff8ef7e6640 / rgw_dt_lg_renew 2024-09-12T18:00:30.281 INFO:tasks.workunit.client.0.smithi098.stderr: 7ff90e7fc640 / ms_dispatch 2024-09-12T18:00:30.281 INFO:tasks.workunit.client.0.smithi098.stderr: 7ff90f7fe640 / io_context_pool 2024-09-12T18:00:30.281 INFO:tasks.workunit.client.0.smithi098.stderr: 7ff90ffff640 / io_context_pool 2024-09-12T18:00:30.281 INFO:tasks.workunit.client.0.smithi098.stderr: 7ff91e7fc640 / ms_dispatch 2024-09-12T18:00:30.281 INFO:tasks.workunit.client.0.smithi098.stderr: 7ff92560a640 / ms_dispatch 2024-09-12T18:00:30.281 INFO:tasks.workunit.client.0.smithi098.stderr: 7ff926e0d640 / io_context_pool 2024-09-12T18:00:30.281 INFO:tasks.workunit.client.0.smithi098.stderr: 7ffa384dd640 / msgr-worker-2 2024-09-12T18:00:30.281 INFO:tasks.workunit.client.0.smithi098.stderr: 7ffa38cde640 / msgr-worker-1 2024-09-12T18:00:30.282 INFO:tasks.workunit.client.0.smithi098.stderr: 7ffa394df640 / msgr-worker-0 2024-09-12T18:00:30.282 INFO:tasks.workunit.client.0.smithi098.stderr: 7ffa39ce0640 / io_context_pool 2024-09-12T18:00:30.282 INFO:tasks.workunit.client.0.smithi098.stderr: 7ffa3b1d89c0 / radosgw-admin 2024-09-12T18:00:30.282 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T18:00:30.282 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T18:00:30.282 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:00:30.148652Z_95f28e1c-e50c-4093-80fd-3dfad4cd3b81/log 2024-09-12T18:00:30.282 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T18:00:30.282 INFO:tasks.workunit.client.0.smithi098.stderr:Aborted 2024-09-12T18:00:30.282 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T18:00:30.283 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:30.283 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:30.432 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.428+0000 7f895eb859c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.428+0000 7f895eb859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.428+0000 7f895eb859c0 20 realm 2024-09-12T18:00:30.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.428+0000 7f895eb859c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.434 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.428+0000 7f895eb859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.428+0000 7f895eb859c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:30.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.428+0000 7f895eb859c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.428+0000 7f895eb859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.435 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.428+0000 7f895eb859c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.432+0000 7f895eb859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:30.436 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.432+0000 7f895eb859c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.437 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.432+0000 7f895eb859c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:30.437 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.432+0000 7f895eb859c0 20 searching for the correct realm 2024-09-12T18:00:30.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.436+0000 7f895be8a640 0 -- 172.21.15.98:0/2138515424 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x558178475cb0 msgr2=0x5581784780a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:30.449 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.444+0000 7f895c68b640 0 -- 172.21.15.98:0/2138515424 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f89500ec8d0 msgr2=0x7f89500b63c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:30.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:30.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:00:30.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:30.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:00:30.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:30.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:30.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.458 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.458 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:30.458 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:30.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 20 zone default found 2024-09-12T18:00:30.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 4 Realm: () 2024-09-12T18:00:30.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:00:30.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:00:30.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:30.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 20 zonegroup default 2024-09-12T18:00:30.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.460 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.452+0000 7f895eb859c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.460 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.456+0000 7f895eb859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.460 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.456+0000 7f895eb859c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.460 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.456+0000 7f895eb859c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.460 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.456+0000 7f895eb859c0 20 started sync module instance, tier type = 2024-09-12T18:00:30.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.456+0000 7f895eb859c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:00:30.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.472+0000 7f895eb859c0 20 add_watcher() i=0 2024-09-12T18:00:30.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.472+0000 7f895eb859c0 20 add_watcher() i=1 2024-09-12T18:00:30.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.472+0000 7f895eb859c0 20 add_watcher() i=2 2024-09-12T18:00:30.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.472+0000 7f895eb859c0 20 add_watcher() i=3 2024-09-12T18:00:30.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.472+0000 7f895eb859c0 20 add_watcher() i=4 2024-09-12T18:00:30.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.472+0000 7f895eb859c0 20 add_watcher() i=5 2024-09-12T18:00:30.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.472+0000 7f895eb859c0 20 add_watcher() i=6 2024-09-12T18:00:30.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.472+0000 7f895eb859c0 20 add_watcher() i=7 2024-09-12T18:00:30.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.472+0000 7f895eb859c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:30.480 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.476+0000 7f8812fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:30.481 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.476+0000 7f895eb859c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:30.481 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.476+0000 7f895eb859c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:30.481 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.476+0000 7f895eb859c0 5 note: GC not initialized 2024-09-12T18:00:30.481 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.476+0000 7f8811fdb640 20 reqs_thread_entry: start 2024-09-12T18:00:30.482 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.476+0000 7f895eb859c0 20 init_complete bucket index max shards: 11 2024-09-12T18:00:30.482 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.476+0000 7f895eb859c0 20 Filter name: none 2024-09-12T18:00:30.482 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.476+0000 7f87837fe640 20 reqs_thread_entry: start 2024-09-12T18:00:30.482 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.476+0000 7f895eb859c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.483 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.476+0000 7f895eb859c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:30.483 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.476+0000 7f895eb859c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.483 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.476+0000 7f895eb859c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:00:30.483 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.476+0000 7f895eb859c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:30.483 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.476+0000 7f895eb859c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.483 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.476+0000 7f895eb859c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:30.483 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.476+0000 7f895eb859c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.484 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.480+0000 7f895eb859c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:00:30.484 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.480+0000 7f895eb859c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:00:30.485 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.480+0000 7f8812fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:30.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.484+0000 7f895eb859c0 20 remove_watcher() i=0 2024-09-12T18:00:30.490 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.484+0000 7f895eb859c0 2 removed watcher, disabling cache 2024-09-12T18:00:30.492 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.488+0000 7f895eb859c0 20 remove_watcher() i=1 2024-09-12T18:00:30.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.488+0000 7f895eb859c0 20 remove_watcher() i=2 2024-09-12T18:00:30.496 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.492+0000 7f895eb859c0 20 remove_watcher() i=3 2024-09-12T18:00:30.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.492+0000 7f895eb859c0 20 remove_watcher() i=4 2024-09-12T18:00:30.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.496+0000 7f895eb859c0 20 remove_watcher() i=5 2024-09-12T18:00:30.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.496+0000 7f895eb859c0 20 remove_watcher() i=6 2024-09-12T18:00:30.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.496+0000 7f895eb859c0 20 remove_watcher() i=7 2024-09-12T18:00:30.515 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.516 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T18:00:30.516 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-change-reshard-state id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:00:30.516 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:00:30.517 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:30.517 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:30.560 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:00:30.560 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:00:30.629 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:00:30.664 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:00:30.664 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:00:30.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.704+0000 7f7d47ea69c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.708+0000 7f7d47ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.708+0000 7f7d47ea69c0 20 realm 2024-09-12T18:00:30.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.708+0000 7f7d47ea69c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.708+0000 7f7d47ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.708+0000 7f7d47ea69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:00:30.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.708+0000 7f7d47ea69c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.708+0000 7f7d47ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.713 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.708+0000 7f7d47ea69c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.708+0000 7f7d47ea69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:30.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.708+0000 7f7d47ea69c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.708+0000 7f7d47ea69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:00:30.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.708+0000 7f7d47ea69c0 20 searching for the correct realm 2024-09-12T18:00:30.719 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.712+0000 7f7d451ab640 0 -- 172.21.15.98:0/1035216494 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f7d30063040 msgr2=0x7f7d3005b680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:30.725 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.720+0000 7f7d459ac640 0 -- 172.21.15.98:0/1035216494 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f7d38007d10 msgr2=0x7f7d38131220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:00:30.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.936+0000 7f7d47ea69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:00:30.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.936+0000 7f7d47ea69c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:00:30.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.936+0000 7f7d47ea69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:00:30.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.936+0000 7f7d47ea69c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:00:30.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.936+0000 7f7d47ea69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:00:30.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.936+0000 7f7d47ea69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:00:30.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.936+0000 7f7d47ea69c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.936+0000 7f7d47ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.936+0000 7f7d47ea69c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.940+0000 7f7d47ea69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:00:30.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.940+0000 7f7d47ea69c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.940+0000 7f7d47ea69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:00:30.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.940+0000 7f7d47ea69c0 20 zone default found 2024-09-12T18:00:30.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.940+0000 7f7d47ea69c0 4 Realm: () 2024-09-12T18:00:30.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.940+0000 7f7d47ea69c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:00:30.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.940+0000 7f7d47ea69c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:00:30.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.940+0000 7f7d47ea69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:00:30.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.940+0000 7f7d47ea69c0 20 zonegroup default 2024-09-12T18:00:30.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.940+0000 7f7d47ea69c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.940+0000 7f7d47ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.940+0000 7f7d47ea69c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.940+0000 7f7d47ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.940+0000 7f7d47ea69c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.947 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.940+0000 7f7d47ea69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:00:30.947 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.940+0000 7f7d47ea69c0 20 started sync module instance, tier type = 2024-09-12T18:00:30.947 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.940+0000 7f7d47ea69c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:00:30.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.964+0000 7f7d47ea69c0 20 add_watcher() i=0 2024-09-12T18:00:30.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.964+0000 7f7d47ea69c0 20 add_watcher() i=1 2024-09-12T18:00:30.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.964+0000 7f7d47ea69c0 20 add_watcher() i=2 2024-09-12T18:00:30.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.964+0000 7f7d47ea69c0 20 add_watcher() i=3 2024-09-12T18:00:30.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.964+0000 7f7d47ea69c0 20 add_watcher() i=4 2024-09-12T18:00:30.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.964+0000 7f7d47ea69c0 20 add_watcher() i=5 2024-09-12T18:00:30.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.964+0000 7f7d47ea69c0 20 add_watcher() i=6 2024-09-12T18:00:30.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.964+0000 7f7d47ea69c0 20 add_watcher() i=7 2024-09-12T18:00:30.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.964+0000 7f7d47ea69c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:00:30.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.968+0000 7f7bf77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:30.974 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.968+0000 7f7d47ea69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:00:30.975 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.968+0000 7f7d47ea69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:00:30.975 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.968+0000 7f7d47ea69c0 5 note: GC not initialized 2024-09-12T18:00:30.975 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.968+0000 7f7bf67fc640 20 reqs_thread_entry: start 2024-09-12T18:00:30.975 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.972+0000 7f7d47ea69c0 20 init_complete bucket index max shards: 11 2024-09-12T18:00:30.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.972+0000 7f7d47ea69c0 20 Filter name: none 2024-09-12T18:00:30.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.972+0000 7f7b67fff640 20 reqs_thread_entry: start 2024-09-12T18:00:30.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.972+0000 7f7d47ea69c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T18:00:30.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.972+0000 7f7d47ea69c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.972+0000 7f7d47ea69c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:00:30.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.972+0000 7f7d47ea69c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T18:00:30.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.972+0000 7f7d47ea69c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T18:00:30.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.972+0000 7f7d47ea69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 : miss 2024-09-12T18:00:30.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.972+0000 7f7d47ea69c0 20 rados->read ofs=0 len=0 2024-09-12T18:00:30.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.972+0000 7f7d47ea69c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:00:30.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.972+0000 7f7d47ea69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 info.flags=0x17 2024-09-12T18:00:30.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.972+0000 7f7d47ea69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 to cache LRU end 2024-09-12T18:00:30.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.972+0000 7f7d47ea69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:00:30.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.972+0000 7f7d47ea69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:00:30.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.972+0000 7f7d47ea69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 2024-09-12T18:00:30.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.976+0000 7f7d47ea69c0 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 to be held by another RGW process; skipping for now 2024-09-12T18:00:30.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.976+0000 7f7bf77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:00:30.987 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.980+0000 7f7d47ea69c0 20 remove_watcher() i=0 2024-09-12T18:00:30.987 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.980+0000 7f7d47ea69c0 2 removed watcher, disabling cache 2024-09-12T18:00:30.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.984+0000 7f7d47ea69c0 20 remove_watcher() i=1 2024-09-12T18:00:30.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.988+0000 7f7d47ea69c0 20 remove_watcher() i=2 2024-09-12T18:00:30.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.988+0000 7f7d47ea69c0 20 remove_watcher() i=3 2024-09-12T18:00:30.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.992+0000 7f7d47ea69c0 20 remove_watcher() i=4 2024-09-12T18:00:30.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.992+0000 7f7d47ea69c0 20 remove_watcher() i=5 2024-09-12T18:00:31.000 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.996+0000 7f7d47ea69c0 20 remove_watcher() i=6 2024-09-12T18:00:31.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:00:30.996+0000 7f7d47ea69c0 20 remove_watcher() i=7 2024-09-12T18:00:31.015 INFO:tasks.workunit.client.0.smithi098.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:01:01.047 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:01:01.083 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:01.084 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:01.129 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.128+0000 7f77bdd739c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.128+0000 7f77bdd739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:01.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.128+0000 7f77bdd739c0 20 realm 2024-09-12T18:01:01.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.128+0000 7f77bdd739c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.128+0000 7f77bdd739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:01.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.128+0000 7f77bdd739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:01.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.128+0000 7f77bdd739c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.128+0000 7f77bdd739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:01.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.128+0000 7f77bdd739c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.132+0000 7f77bdd739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:01.132 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.132+0000 7f77bdd739c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.132+0000 7f77bdd739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:01.133 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.132+0000 7f77bdd739c0 20 searching for the correct realm 2024-09-12T18:01:01.139 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.136+0000 7f77bc07a640 0 -- 172.21.15.98:0/1227656134 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x564f2874b560 msgr2=0x564f2874d9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:01.145 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.144+0000 7f77bb078640 0 -- 172.21.15.98:0/1227656134 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f77ac03d070 msgr2=0x7f77ac096870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:01.152 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:01.152 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:01:01.152 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:01.152 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:01:01.153 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:01.153 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:01.153 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.153 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:01.153 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.154 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:01.154 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.155 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:01.155 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 20 zone default found 2024-09-12T18:01:01.155 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 4 Realm: () 2024-09-12T18:01:01.155 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:01:01.155 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:01:01.155 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:01.155 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 20 zonegroup default 2024-09-12T18:01:01.155 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.155 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:01.155 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.156 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:01.156 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.152+0000 7f77bdd739c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.156 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.156+0000 7f77bdd739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:01.156 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.156+0000 7f77bdd739c0 20 started sync module instance, tier type = 2024-09-12T18:01:01.156 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.156+0000 7f77bdd739c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:01:01.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.172+0000 7f77bdd739c0 20 add_watcher() i=0 2024-09-12T18:01:01.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.172+0000 7f77bdd739c0 20 add_watcher() i=1 2024-09-12T18:01:01.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.172+0000 7f77bdd739c0 20 add_watcher() i=2 2024-09-12T18:01:01.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.172+0000 7f77bdd739c0 20 add_watcher() i=3 2024-09-12T18:01:01.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.172+0000 7f77bdd739c0 20 add_watcher() i=4 2024-09-12T18:01:01.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.172+0000 7f77bdd739c0 20 add_watcher() i=5 2024-09-12T18:01:01.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.172+0000 7f77bdd739c0 20 add_watcher() i=6 2024-09-12T18:01:01.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.172+0000 7f77bdd739c0 20 add_watcher() i=7 2024-09-12T18:01:01.173 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.172+0000 7f77bdd739c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:01.175 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.172+0000 7f7671fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:01.176 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.176+0000 7f77bdd739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:01.176 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.176+0000 7f77bdd739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:01.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.176+0000 7f77bdd739c0 5 note: GC not initialized 2024-09-12T18:01:01.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.176+0000 7f7670fe1640 20 reqs_thread_entry: start 2024-09-12T18:01:01.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.176+0000 7f77bdd739c0 20 init_complete bucket index max shards: 11 2024-09-12T18:01:01.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.176+0000 7f77bdd739c0 20 Filter name: none 2024-09-12T18:01:01.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.176+0000 7f75ea7fc640 20 reqs_thread_entry: start 2024-09-12T18:01:01.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.176+0000 7f77bdd739c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T18:01:01.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.176+0000 7f77bdd739c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.176+0000 7f77bdd739c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:01:01.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.176+0000 7f77bdd739c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T18:01:01.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.176+0000 7f77bdd739c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T18:01:01.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.176+0000 7f77bdd739c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 : miss 2024-09-12T18:01:01.177 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.176+0000 7f77bdd739c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.178 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.176+0000 7f77bdd739c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:01:01.178 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.176+0000 7f77bdd739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 info.flags=0x17 2024-09-12T18:01:01.178 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.176+0000 7f77bdd739c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 to cache LRU end 2024-09-12T18:01:01.178 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.176+0000 7f77bdd739c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:01.178 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.176+0000 7f77bdd739c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:01.178 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.176+0000 7f77bdd739c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 2024-09-12T18:01:01.180 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.180+0000 7f77bdd739c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:01:01.192 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.192+0000 7f77bdd739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 info.flags=0x17 2024-09-12T18:01:01.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.192+0000 7f77bdd739c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 to cache LRU end 2024-09-12T18:01:01.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.192+0000 7f77bdd739c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:01.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.192+0000 7f77bdd739c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39, ofs0, ns] 2024-09-12T18:01:01.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.192+0000 7f769affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366264 cookie 94897981194448 notifier 8157 bl.length()=931 2024-09-12T18:01:01.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.192+0000 7f769affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 info.flags=0x17 2024-09-12T18:01:01.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.192+0000 7f769affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 to cache LRU end 2024-09-12T18:01:01.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.192+0000 7f769affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:01.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.196+0000 7f77bdd739c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): orig_sources= new_sources= 2024-09-12T18:01:01.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.196+0000 7f77bdd739c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): potential sources added=[] removed=[] 2024-09-12T18:01:01.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.196+0000 7f77bdd739c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): orig_dests= new_dests= 2024-09-12T18:01:01.195 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.196+0000 7f77bdd739c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): potential dests added=[] removed=[] 2024-09-12T18:01:01.205 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.0 2024-09-12T18:01:01.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.0 2024-09-12T18:01:01.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.1 2024-09-12T18:01:01.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.1 2024-09-12T18:01:01.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.2 2024-09-12T18:01:01.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.2 2024-09-12T18:01:01.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.3 2024-09-12T18:01:01.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.3 2024-09-12T18:01:01.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.4 2024-09-12T18:01:01.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.4 2024-09-12T18:01:01.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.5 2024-09-12T18:01:01.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.5 2024-09-12T18:01:01.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.6 2024-09-12T18:01:01.206 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.6 2024-09-12T18:01:01.207 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.7 2024-09-12T18:01:01.207 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.7 2024-09-12T18:01:01.207 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.8 2024-09-12T18:01:01.207 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.8 2024-09-12T18:01:01.207 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.9 2024-09-12T18:01:01.207 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.9 2024-09-12T18:01:01.207 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.10 2024-09-12T18:01:01.207 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.10 2024-09-12T18:01:01.207 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.11 2024-09-12T18:01:01.207 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2.11 2024-09-12T18:01:01.207 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.0 2024-09-12T18:01:01.208 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1 2024-09-12T18:01:01.208 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2 2024-09-12T18:01:01.208 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.204+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.3 2024-09-12T18:01:01.208 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.208+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.4 2024-09-12T18:01:01.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.208+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.5 2024-09-12T18:01:01.209 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.208+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.6 2024-09-12T18:01:01.210 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.208+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.7 2024-09-12T18:01:01.211 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.208+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.8 2024-09-12T18:01:01.211 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.212+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.9 2024-09-12T18:01:01.213 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.212+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.10 2024-09-12T18:01:01.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.216+0000 7f77bdd739c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 : hit (requested=0x17, cached=0x17) 2024-09-12T18:01:01.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.216+0000 7f77bdd739c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 2024-09-12T18:01:01.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.220+0000 7f77bdd739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 info.flags=0x17 2024-09-12T18:01:01.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.220+0000 7f77bdd739c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 to cache LRU end 2024-09-12T18:01:01.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.220+0000 7f77bdd739c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:01.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.220+0000 7f77bdd739c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39, ofs0, ns] 2024-09-12T18:01:01.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.220+0000 7f769a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366265 cookie 94897981194448 notifier 8157 bl.length()=931 2024-09-12T18:01:01.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.220+0000 7f769a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 info.flags=0x17 2024-09-12T18:01:01.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.220+0000 7f769a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 to cache LRU end 2024-09-12T18:01:01.222 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.220+0000 7f769a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:01.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.224+0000 7f77bdd739c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): orig_sources= new_sources= 2024-09-12T18:01:01.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.224+0000 7f77bdd739c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): potential sources added=[] removed=[] 2024-09-12T18:01:01.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.224+0000 7f77bdd739c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): orig_dests= new_dests= 2024-09-12T18:01:01.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.224+0000 7f77bdd739c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): potential dests added=[] removed=[] 2024-09-12T18:01:01.228 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.228+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.0 2024-09-12T18:01:01.228 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.228+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.1 2024-09-12T18:01:01.229 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.228+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.2 2024-09-12T18:01:01.229 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.228+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.3 2024-09-12T18:01:01.229 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.228+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.4 2024-09-12T18:01:01.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.228+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.5 2024-09-12T18:01:01.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.228+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.6 2024-09-12T18:01:01.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.228+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.7 2024-09-12T18:01:01.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.232+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.8 2024-09-12T18:01:01.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.232+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.9 2024-09-12T18:01:01.233 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.232+0000 7f77bdd739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.39.10 2024-09-12T18:01:01.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.232+0000 7f77bdd739c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 : hit (requested=0x17, cached=0x17) 2024-09-12T18:01:01.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.232+0000 7f77bdd739c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 2024-09-12T18:01:01.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.232+0000 7f77bdd739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 info.flags=0x17 2024-09-12T18:01:01.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.232+0000 7f77bdd739c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 to cache LRU end 2024-09-12T18:01:01.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.232+0000 7f77bdd739c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:01.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.232+0000 7f77bdd739c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39, ofs0, ns] 2024-09-12T18:01:01.236 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.236+0000 7f769a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366266 cookie 94897981194448 notifier 8157 bl.length()=899 2024-09-12T18:01:01.236 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.236+0000 7f769a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 info.flags=0x17 2024-09-12T18:01:01.236 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.236+0000 7f769a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 to cache LRU end 2024-09-12T18:01:01.236 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.236+0000 7f769a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:01:01.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.236+0000 7f77bdd739c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): orig_sources= new_sources= 2024-09-12T18:01:01.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.236+0000 7f77bdd739c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): potential sources added=[] removed=[] 2024-09-12T18:01:01.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.236+0000 7f77bdd739c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): orig_dests= new_dests= 2024-09-12T18:01:01.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.236+0000 7f77bdd739c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a01e4849-e968-46ce-97f1-a673c26b3735.4529.39]): potential dests added=[] removed=[] 2024-09-12T18:01:01.242 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.240+0000 7f77bdd739c0 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T18:01:01.246 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.244+0000 7f7671fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:01.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.248+0000 7f77bdd739c0 20 remove_watcher() i=0 2024-09-12T18:01:01.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.248+0000 7f77bdd739c0 2 removed watcher, disabling cache 2024-09-12T18:01:01.253 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.252+0000 7f77bdd739c0 20 remove_watcher() i=1 2024-09-12T18:01:01.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.252+0000 7f77bdd739c0 20 remove_watcher() i=2 2024-09-12T18:01:01.257 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.256+0000 7f77bdd739c0 20 remove_watcher() i=3 2024-09-12T18:01:01.259 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.256+0000 7f77bdd739c0 20 remove_watcher() i=4 2024-09-12T18:01:01.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.260+0000 7f77bdd739c0 20 remove_watcher() i=5 2024-09-12T18:01:01.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.260+0000 7f77bdd739c0 20 remove_watcher() i=6 2024-09-12T18:01:01.263 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.260+0000 7f77bdd739c0 20 remove_watcher() i=7 2024-09-12T18:01:01.277 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T18:01:01.304 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:01.304 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:01.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.344+0000 7f14dbdb09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.348+0000 7f14dbdb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:01.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.348+0000 7f14dbdb09c0 20 realm 2024-09-12T18:01:01.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.348+0000 7f14dbdb09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.348+0000 7f14dbdb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:01.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.348+0000 7f14dbdb09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:01.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.348+0000 7f14dbdb09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.348+0000 7f14dbdb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:01.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.348+0000 7f14dbdb09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.348+0000 7f14dbdb09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:01.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.348+0000 7f14dbdb09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.348+0000 7f14dbdb09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:01.352 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.348+0000 7f14dbdb09c0 20 searching for the correct realm 2024-09-12T18:01:01.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.356+0000 7f14d90b5640 0 -- 172.21.15.98:0/1797810526 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f14cc09c070 msgr2=0x7f14cc062800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:01.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.364+0000 7f14da0b7640 0 -- 172.21.15.98:0/1797810526 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x559394340170 msgr2=0x7f14d00d0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:01.369 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.368+0000 7f14dbdb09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:01.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.368+0000 7f14dbdb09c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:01:01.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.368+0000 7f14dbdb09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:01.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.368+0000 7f14dbdb09c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:01:01.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.368+0000 7f14dbdb09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:01.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.368+0000 7f14dbdb09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:01.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.368+0000 7f14dbdb09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.368+0000 7f14dbdb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:01.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.368+0000 7f14dbdb09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.368+0000 7f14dbdb09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:01.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.368+0000 7f14dbdb09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.368+0000 7f14dbdb09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:01.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.368+0000 7f14dbdb09c0 20 zone default found 2024-09-12T18:01:01.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.368+0000 7f14dbdb09c0 4 Realm: () 2024-09-12T18:01:01.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.368+0000 7f14dbdb09c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:01:01.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.368+0000 7f14dbdb09c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:01:01.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.368+0000 7f14dbdb09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:01.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.368+0000 7f14dbdb09c0 20 zonegroup default 2024-09-12T18:01:01.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.368+0000 7f14dbdb09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.372+0000 7f14dbdb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:01.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.372+0000 7f14dbdb09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.372+0000 7f14dbdb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:01.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.372+0000 7f14dbdb09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.372+0000 7f14dbdb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:01.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.372+0000 7f14dbdb09c0 20 started sync module instance, tier type = 2024-09-12T18:01:01.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.372+0000 7f14dbdb09c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:01:01.387 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.384+0000 7f14dbdb09c0 20 add_watcher() i=0 2024-09-12T18:01:01.387 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.384+0000 7f14dbdb09c0 20 add_watcher() i=1 2024-09-12T18:01:01.387 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.384+0000 7f14dbdb09c0 20 add_watcher() i=2 2024-09-12T18:01:01.387 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.384+0000 7f14dbdb09c0 20 add_watcher() i=3 2024-09-12T18:01:01.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.384+0000 7f14dbdb09c0 20 add_watcher() i=4 2024-09-12T18:01:01.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.384+0000 7f14dbdb09c0 20 add_watcher() i=5 2024-09-12T18:01:01.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.384+0000 7f14dbdb09c0 20 add_watcher() i=6 2024-09-12T18:01:01.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.388+0000 7f14dbdb09c0 20 add_watcher() i=7 2024-09-12T18:01:01.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.388+0000 7f14dbdb09c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:01.390 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.388+0000 7f138ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:01.391 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.388+0000 7f14dbdb09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:01.391 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.388+0000 7f14dbdb09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:01.391 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.388+0000 7f14dbdb09c0 5 note: GC not initialized 2024-09-12T18:01:01.391 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.388+0000 7f138efe5640 20 reqs_thread_entry: start 2024-09-12T18:01:01.391 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.388+0000 7f14dbdb09c0 20 init_complete bucket index max shards: 11 2024-09-12T18:01:01.391 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.388+0000 7f14dbdb09c0 20 Filter name: none 2024-09-12T18:01:01.391 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.388+0000 7f138cfe1640 20 reqs_thread_entry: start 2024-09-12T18:01:01.391 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.388+0000 7f14dbdb09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.392+0000 7f14dbdb09c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:01:01.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.392+0000 7f14dbdb09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.392+0000 7f14dbdb09c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:01:01.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.392+0000 7f14dbdb09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:01.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.392+0000 7f14dbdb09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.392+0000 7f14dbdb09c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:01:01.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.392+0000 7f14dbdb09c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:01.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.392+0000 7f14dbdb09c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:01:01.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.392+0000 7f14dbdb09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:01.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.392+0000 7f138ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:01.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.400+0000 7f14dbdb09c0 20 remove_watcher() i=0 2024-09-12T18:01:01.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.400+0000 7f14dbdb09c0 2 removed watcher, disabling cache 2024-09-12T18:01:01.401 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.400+0000 7f14dbdb09c0 20 remove_watcher() i=1 2024-09-12T18:01:01.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.400+0000 7f14dbdb09c0 20 remove_watcher() i=2 2024-09-12T18:01:01.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.404+0000 7f14dbdb09c0 20 remove_watcher() i=3 2024-09-12T18:01:01.407 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.404+0000 7f14dbdb09c0 20 remove_watcher() i=4 2024-09-12T18:01:01.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.408+0000 7f14dbdb09c0 20 remove_watcher() i=5 2024-09-12T18:01:01.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.408+0000 7f14dbdb09c0 20 remove_watcher() i=6 2024-09-12T18:01:01.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:01.408+0000 7f14dbdb09c0 20 remove_watcher() i=7 2024-09-12T18:01:01.421 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:01.421 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T18:01:01.421 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: abort-at-change-reshard-state id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.39 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:01:01.421 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:01.422 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:01:01.422 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:01:01.445 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:01:01.445 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:01:01.941 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:01:01.941 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:01:02.324 INFO:tasks.workunit.client.0.smithi098.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T18:01:02.324 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:01:02.357 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:02.357 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:02.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.400+0000 7febfe0439c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.404+0000 7febfe0439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.404+0000 7febfe0439c0 20 realm 2024-09-12T18:01:02.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.404+0000 7febfe0439c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.405 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.404+0000 7febfe0439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.404+0000 7febfe0439c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:02.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.404+0000 7febfe0439c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.404+0000 7febfe0439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.406 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.404+0000 7febfe0439c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.407 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.404+0000 7febfe0439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:02.407 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.404+0000 7febfe0439c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.407 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.404+0000 7febfe0439c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:02.408 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.404+0000 7febfe0439c0 20 searching for the correct realm 2024-09-12T18:01:02.412 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.412+0000 7febfb348640 0 -- 172.21.15.98:0/1071501411 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x556dd02c3c70 msgr2=0x556dd02c6060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:02.418 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.416+0000 7febfbb49640 0 -- 172.21.15.98:0/1071501411 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7febe4019c20 msgr2=0x7febe405dd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:02.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.424+0000 7febfe0439c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:02.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.424+0000 7febfe0439c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:01:02.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.424+0000 7febfe0439c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:02.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.424+0000 7febfe0439c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:01:02.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.424+0000 7febfe0439c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:02.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.424+0000 7febfe0439c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:02.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.424+0000 7febfe0439c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.424+0000 7febfe0439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.424+0000 7febfe0439c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.428+0000 7febfe0439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:02.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.428+0000 7febfe0439c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.428+0000 7febfe0439c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:02.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.428+0000 7febfe0439c0 20 zone default found 2024-09-12T18:01:02.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.428+0000 7febfe0439c0 4 Realm: () 2024-09-12T18:01:02.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.428+0000 7febfe0439c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:01:02.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.428+0000 7febfe0439c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:01:02.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.428+0000 7febfe0439c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:02.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.428+0000 7febfe0439c0 20 zonegroup default 2024-09-12T18:01:02.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.428+0000 7febfe0439c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.428+0000 7febfe0439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.428+0000 7febfe0439c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.428+0000 7febfe0439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.428+0000 7febfe0439c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.428+0000 7febfe0439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.428+0000 7febfe0439c0 20 started sync module instance, tier type = 2024-09-12T18:01:02.431 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.428+0000 7febfe0439c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:01:02.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.444+0000 7febfe0439c0 20 add_watcher() i=0 2024-09-12T18:01:02.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.444+0000 7febfe0439c0 20 add_watcher() i=1 2024-09-12T18:01:02.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.444+0000 7febfe0439c0 20 add_watcher() i=2 2024-09-12T18:01:02.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.444+0000 7febfe0439c0 20 add_watcher() i=3 2024-09-12T18:01:02.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.444+0000 7febfe0439c0 20 add_watcher() i=4 2024-09-12T18:01:02.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.444+0000 7febfe0439c0 20 add_watcher() i=5 2024-09-12T18:01:02.447 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.444+0000 7febfe0439c0 20 add_watcher() i=6 2024-09-12T18:01:02.448 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.448+0000 7febfe0439c0 20 add_watcher() i=7 2024-09-12T18:01:02.448 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.448+0000 7febfe0439c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:02.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.448+0000 7feab1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:02.451 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.448+0000 7febfe0439c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:02.451 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.448+0000 7febfe0439c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:02.451 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.448+0000 7febfe0439c0 5 note: GC not initialized 2024-09-12T18:01:02.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.448+0000 7feab0fe1640 20 reqs_thread_entry: start 2024-09-12T18:01:02.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.452+0000 7febfe0439c0 20 init_complete bucket index max shards: 11 2024-09-12T18:01:02.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.452+0000 7febfe0439c0 20 Filter name: none 2024-09-12T18:01:02.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.452+0000 7fea2a7fc640 20 reqs_thread_entry: start 2024-09-12T18:01:02.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.452+0000 7febfe0439c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.452+0000 7febfe0439c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:02.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.452+0000 7febfe0439c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.452+0000 7febfe0439c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:02.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.452+0000 7febfe0439c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:02.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.452+0000 7febfe0439c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.452+0000 7febfe0439c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:02.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.452+0000 7febfe0439c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.456+0000 7febfe0439c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:02.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.456+0000 7febfe0439c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:02.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.456+0000 7feab1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:02.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.464+0000 7febfe0439c0 20 remove_watcher() i=0 2024-09-12T18:01:02.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.464+0000 7febfe0439c0 2 removed watcher, disabling cache 2024-09-12T18:01:02.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.464+0000 7febfe0439c0 20 remove_watcher() i=1 2024-09-12T18:01:02.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.468+0000 7febfe0439c0 20 remove_watcher() i=2 2024-09-12T18:01:02.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.468+0000 7febfe0439c0 20 remove_watcher() i=3 2024-09-12T18:01:02.472 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.472+0000 7febfe0439c0 20 remove_watcher() i=4 2024-09-12T18:01:02.473 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.472+0000 7febfe0439c0 20 remove_watcher() i=5 2024-09-12T18:01:02.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.472+0000 7febfe0439c0 20 remove_watcher() i=6 2024-09-12T18:01:02.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.476+0000 7febfe0439c0 20 remove_watcher() i=7 2024-09-12T18:01:02.492 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.492 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T18:01:02.492 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: a-bucket id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T18:01:02.492 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.492 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:01:02.518 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:02.518 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:02.561 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.560+0000 7fb257ae49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.560+0000 7fb257ae49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.560+0000 7fb257ae49c0 20 realm 2024-09-12T18:01:02.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.560+0000 7fb257ae49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.560+0000 7fb257ae49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.560+0000 7fb257ae49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:02.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.560+0000 7fb257ae49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.560+0000 7fb257ae49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.560+0000 7fb257ae49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.565 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.564+0000 7fb257ae49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:02.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.564+0000 7fb257ae49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.564+0000 7fb257ae49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:02.566 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.564+0000 7fb257ae49c0 20 searching for the correct realm 2024-09-12T18:01:02.570 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.568+0000 7fb255deb640 0 -- 172.21.15.98:0/2866785511 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x56060dfd6aa0 msgr2=0x56060dfd8f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:01:02.577 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.576+0000 7fb2555ea640 0 -- 172.21.15.98:0/2866785511 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fb24005c8a0 msgr2=0x7fb24009d050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:02.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:02.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:01:02.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:02.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:01:02.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:02.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:02.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:02.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:02.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 20 zone default found 2024-09-12T18:01:02.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 4 Realm: () 2024-09-12T18:01:02.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:01:02.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:01:02.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:02.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 20 zonegroup default 2024-09-12T18:01:02.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.584+0000 7fb257ae49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.588+0000 7fb257ae49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.588+0000 7fb257ae49c0 20 started sync module instance, tier type = 2024-09-12T18:01:02.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.588+0000 7fb257ae49c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:01:02.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.600+0000 7fb257ae49c0 20 add_watcher() i=0 2024-09-12T18:01:02.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.600+0000 7fb257ae49c0 20 add_watcher() i=1 2024-09-12T18:01:02.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.600+0000 7fb257ae49c0 20 add_watcher() i=2 2024-09-12T18:01:02.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.600+0000 7fb257ae49c0 20 add_watcher() i=3 2024-09-12T18:01:02.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.600+0000 7fb257ae49c0 20 add_watcher() i=4 2024-09-12T18:01:02.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.600+0000 7fb257ae49c0 20 add_watcher() i=5 2024-09-12T18:01:02.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.600+0000 7fb257ae49c0 20 add_watcher() i=6 2024-09-12T18:01:02.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.604+0000 7fb257ae49c0 20 add_watcher() i=7 2024-09-12T18:01:02.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.604+0000 7fb257ae49c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:02.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.604+0000 7fb10bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:02.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.604+0000 7fb257ae49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:02.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.604+0000 7fb257ae49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:02.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.604+0000 7fb257ae49c0 5 note: GC not initialized 2024-09-12T18:01:02.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.608+0000 7fb10afe5640 20 reqs_thread_entry: start 2024-09-12T18:01:02.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.608+0000 7fb257ae49c0 20 init_complete bucket index max shards: 11 2024-09-12T18:01:02.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.608+0000 7fb257ae49c0 20 Filter name: none 2024-09-12T18:01:02.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.608+0000 7fb108fe1640 20 reqs_thread_entry: start 2024-09-12T18:01:02.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.608+0000 7fb257ae49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.608+0000 7fb257ae49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:02.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.608+0000 7fb257ae49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.608+0000 7fb257ae49c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:02.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.608+0000 7fb257ae49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:02.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.608+0000 7fb257ae49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.612+0000 7fb257ae49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:02.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.612+0000 7fb257ae49c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.612+0000 7fb257ae49c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:02.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.612+0000 7fb257ae49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:02.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.616+0000 7fb10bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:02.620 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.620+0000 7fb257ae49c0 20 remove_watcher() i=0 2024-09-12T18:01:02.620 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.620+0000 7fb257ae49c0 2 removed watcher, disabling cache 2024-09-12T18:01:02.622 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.620+0000 7fb257ae49c0 20 remove_watcher() i=1 2024-09-12T18:01:02.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.624+0000 7fb257ae49c0 20 remove_watcher() i=2 2024-09-12T18:01:02.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.628+0000 7fb257ae49c0 20 remove_watcher() i=3 2024-09-12T18:01:02.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.628+0000 7fb257ae49c0 20 remove_watcher() i=4 2024-09-12T18:01:02.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.628+0000 7fb257ae49c0 20 remove_watcher() i=5 2024-09-12T18:01:02.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.632+0000 7fb257ae49c0 20 remove_watcher() i=6 2024-09-12T18:01:02.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.632+0000 7fb257ae49c0 20 remove_watcher() i=7 2024-09-12T18:01:02.649 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T18:01:02.681 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:02.681 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:02.725 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.727 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.727 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 realm 2024-09-12T18:01:02.727 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.727 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.727 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:02.727 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.727 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.727 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.729 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.728+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:02.729 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.728+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.729 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.728+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:02.729 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.728+0000 7f7e0ae2a9c0 20 searching for the correct realm 2024-09-12T18:01:02.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.732+0000 7f7e09131640 0 -- 172.21.15.98:0/3455850634 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x560807dd8410 msgr2=0x560807dda8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:02.741 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.740+0000 7f7e0812f640 0 -- 172.21.15.98:0/3455850634 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f7df8018040 msgr2=0x7f7df8067130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:02.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:02.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:01:02.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:02.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:01:02.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:02.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:02.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:02.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:02.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 zone default found 2024-09-12T18:01:02.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 4 Realm: () 2024-09-12T18:01:02.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:01:02.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:01:02.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:02.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 zonegroup default 2024-09-12T18:01:02.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 started sync module instance, tier type = 2024-09-12T18:01:02.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:01:02.766 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=0 2024-09-12T18:01:02.767 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=1 2024-09-12T18:01:02.767 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=2 2024-09-12T18:01:02.767 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=3 2024-09-12T18:01:02.767 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=4 2024-09-12T18:01:02.767 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=5 2024-09-12T18:01:02.767 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=6 2024-09-12T18:01:02.767 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 20 add_watcher() i=7 2024-09-12T18:01:02.767 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:02.770 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.768+0000 7f7cbefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:02.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:02.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:02.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 note: GC not initialized 2024-09-12T18:01:02.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.768+0000 7f7cbdfe3640 20 reqs_thread_entry: start 2024-09-12T18:01:02.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:01:02.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 20 Filter name: none 2024-09-12T18:01:02.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.768+0000 7f7c2f7fe640 20 reqs_thread_entry: start 2024-09-12T18:01:02.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:01:02.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:02.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:01:02.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:01:02.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T18:01:02.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:02.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:02.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:02.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:02.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:02.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:01:02.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.780+0000 7f7e0ae2a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:02.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.780+0000 7f7e0ae2a9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:02.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.780+0000 7f7e0ae2a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:02.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.780+0000 7f7e0ae2a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T18:01:02.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.784+0000 7f7cdffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366218 cookie 94592491690768 notifier 7577 bl.length()=827 2024-09-12T18:01:02.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.784+0000 7f7cdffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:02.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.784+0000 7f7cdffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:02.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.784+0000 7f7cdffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:02.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.784+0000 7f7e0ae2a9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T18:01:02.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.784+0000 7f7e0ae2a9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T18:01:02.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.784+0000 7f7e0ae2a9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T18:01:02.786 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.784+0000 7f7e0ae2a9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T18:01:02.799 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.0 2024-09-12T18:01:02.799 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.0 2024-09-12T18:01:02.799 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.1 2024-09-12T18:01:02.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.1 2024-09-12T18:01:02.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.2 2024-09-12T18:01:02.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.2 2024-09-12T18:01:02.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.3 2024-09-12T18:01:02.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.3 2024-09-12T18:01:02.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.4 2024-09-12T18:01:02.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.4 2024-09-12T18:01:02.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.5 2024-09-12T18:01:02.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.5 2024-09-12T18:01:02.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.6 2024-09-12T18:01:02.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.6 2024-09-12T18:01:02.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.7 2024-09-12T18:01:02.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.7 2024-09-12T18:01:02.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.8 2024-09-12T18:01:02.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.8 2024-09-12T18:01:02.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.9 2024-09-12T18:01:02.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.9 2024-09-12T18:01:02.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.10 2024-09-12T18:01:02.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.10 2024-09-12T18:01:02.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.11 2024-09-12T18:01:02.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.11 2024-09-12T18:01:02.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.12 2024-09-12T18:01:02.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.12 2024-09-12T18:01:02.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.13 2024-09-12T18:01:02.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.13 2024-09-12T18:01:02.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:01:02.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:01:02.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:01:02.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:01:02.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:01:02.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:01:02.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:01:02.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:01:02.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:01:02.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:01:02.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:01:02.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:01:02.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:01:02.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:01:02.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:01:02.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:01:02.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:01:02.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:01:02.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:01:02.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:01:02.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:01:02.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:01:02.810 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:01:02.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:01:02.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:01:02.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:01:02.815 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7e0ae2a9c0 time 2024-09-12T18:01:02.815857+0000 2024-09-12T18:01:02.815 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:01:02.816 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:02.816 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7e0e7042eb] 2024-09-12T18:01:02.816 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7e0e70449f] 2024-09-12T18:01:02.816 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56080648d0c1] 2024-09-12T18:01:02.816 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x56080649e4f1] 2024-09-12T18:01:02.816 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56080649fb44] 2024-09-12T18:01:02.817 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T18:01:02.817 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7e0d56ad90] 2024-09-12T18:01:02.817 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T18:01:02.817 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T18:01:02.817 INFO:tasks.workunit.client.0.smithi098.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:01:02.817 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f7e0ae2a9c0 thread_name:radosgw-admin 2024-09-12T18:01:02.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.816+0000 7f7e0ae2a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7e0ae2a9c0 time 2024-09-12T18:01:02.815857+0000 2024-09-12T18:01:02.817 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:01:02.817 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.817 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:02.817 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7e0e7042eb] 2024-09-12T18:01:02.818 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7e0e70449f] 2024-09-12T18:01:02.818 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56080648d0c1] 2024-09-12T18:01:02.818 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x56080649e4f1] 2024-09-12T18:01:02.818 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56080649fb44] 2024-09-12T18:01:02.818 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T18:01:02.818 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7e0d56ad90] 2024-09-12T18:01:02.818 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T18:01:02.818 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T18:01:02.818 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.836 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:02.836 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7e0d583520] 2024-09-12T18:01:02.836 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T18:01:02.836 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T18:01:02.836 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T18:01:02.837 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7e0e704345] 2024-09-12T18:01:02.837 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7e0e70449f] 2024-09-12T18:01:02.837 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56080648d0c1] 2024-09-12T18:01:02.837 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x56080649e4f1] 2024-09-12T18:01:02.837 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56080649fb44] 2024-09-12T18:01:02.837 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T18:01:02.837 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7e0d56ad90] 2024-09-12T18:01:02.837 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T18:01:02.837 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T18:01:02.837 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.816+0000 7f7e0ae2a9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:01:02.837 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f7e0ae2a9c0 thread_name:radosgw-admin 2024-09-12T18:01:02.837 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.838 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:02.838 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7e0d583520] 2024-09-12T18:01:02.838 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T18:01:02.838 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T18:01:02.838 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T18:01:02.838 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7e0e704345] 2024-09-12T18:01:02.838 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7e0e70449f] 2024-09-12T18:01:02.838 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56080648d0c1] 2024-09-12T18:01:02.838 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x56080649e4f1] 2024-09-12T18:01:02.838 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56080649fb44] 2024-09-12T18:01:02.838 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T18:01:02.838 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7e0d56ad90] 2024-09-12T18:01:02.838 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T18:01:02.839 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T18:01:02.839 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:01:02.839 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.839 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T18:01:02.839 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807cef3c0) adding con mode: crc 2024-09-12T18:01:02.839 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807cef3c0) adding con mode: secure 2024-09-12T18:01:02.839 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.839 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.839 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command rotate-key hook 0x560807cef508 2024-09-12T18:01:02.839 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:02.839 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:01:02.839 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-b con 0x560807baab80 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:01:02.839 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-a con 0x560807bab970 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:01:02.840 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-c con 0x560807c38460 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:01:02.840 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.840 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.840 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.840 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:02.840 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient(hunting): authenticate will time out at 2859.273482s 2024-09-12T18:01:02.840 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T18:01:02.704+0000 7f7e0812f640 10 monclient(hunting): get_auth_request con 0x560807bab970 auth_method 0 2024-09-12T18:01:02.840 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T18:01:02.704+0000 7f7e0812f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:02.840 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T18:01:02.704+0000 7f7e0812f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:02.840 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T18:01:02.704+0000 7f7e0812f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:02.841 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T18:01:02.704+0000 7f7e09131640 10 monclient(hunting): get_auth_request con 0x560807c38460 auth_method 0 2024-09-12T18:01:02.841 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T18:01:02.704+0000 7f7e09131640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:02.841 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T18:01:02.704+0000 7f7e09131640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:02.841 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T18:01:02.704+0000 7f7e09131640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:02.841 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T18:01:02.704+0000 7f7e0812f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:02.841 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T18:01:02.704+0000 7f7e0812f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:02.841 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T18:01:02.704+0000 7f7e0812f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:02.841 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T18:01:02.704+0000 7f7e09131640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:02.841 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T18:01:02.704+0000 7f7e09131640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:02.841 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T18:01:02.704+0000 7f7e09131640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:02.841 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T18:01:02.704+0000 7f7e0812f640 10 monclient(hunting): handle_auth_done global_id 8226 payload 824 2024-09-12T18:01:02.841 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T18:01:02.704+0000 7f7e0812f640 10 monclient: _finish_hunting 0 2024-09-12T18:01:02.841 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T18:01:02.704+0000 7f7e0812f640 1 monclient: found mon.noname-a 2024-09-12T18:01:02.842 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T18:01:02.704+0000 7f7e0812f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T18:01:02.842 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T18:01:02.704+0000 7f7e08930640 10 monclient: get_auth_request con 0x560807baab80 auth_method 0 2024-09-12T18:01:02.842 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T18:01:02.704+0000 7f7cf560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:02.842 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T18:01:02.704+0000 7f7cf560a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:01:02.842 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T18:01:02.704+0000 7f7cf560a640 10 monclient: dump: 2024-09-12T18:01:02.842 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:02.842 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:02.842 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.842 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.842 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:02.842 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.842 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:02.842 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:02.843 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:02.843 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.843 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T18:01:02.704+0000 7f7cf560a640 10 monclient: _finish_auth 0 2024-09-12T18:01:02.843 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T18:01:02.704+0000 7f7cf560a640 10 monclient: _check_auth_tickets 2024-09-12T18:01:02.843 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T18:01:02.704+0000 7f7cf560a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:02.843 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T18:01:02.704+0000 7f7cf560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:02.843 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T18:01:02.704+0000 7f7cf560a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:02.843 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T18:01:02.704+0000 7f7cf560a640 10 monclient: dump: 2024-09-12T18:01:02.843 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:02.843 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:02.843 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.843 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.843 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:02.844 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.844 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:02.844 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:02.844 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:02.844 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.844 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T18:01:02.704+0000 7f7cf6e0d640 4 set_mon_vals no callback set 2024-09-12T18:01:02.844 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 5 monclient: authenticate success, global_id 8226 2024-09-12T18:01:02.844 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient: _renew_subs 2024-09-12T18:01:02.844 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:01:02.844 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient: _renew_subs 2024-09-12T18:01:02.844 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:01:02.844 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 1 librados: init done 2024-09-12T18:01:02.844 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T18:01:02.708+0000 7f7cf560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:02.845 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T18:01:02.708+0000 7f7cf560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:02.845 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T18:01:02.708+0000 7f7cf560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:02.845 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T18:01:02.708+0000 7f7e08930640 10 monclient: get_auth_request con 0x7f7cf0070ae0 auth_method 0 2024-09-12T18:01:02.845 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T18:01:02.708+0000 7f7e09131640 10 monclient: get_auth_request con 0x560807d1d220 auth_method 0 2024-09-12T18:01:02.845 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T18:01:02.708+0000 7f7e08930640 10 monclient: get_auth_request con 0x560807d39b40 auth_method 0 2024-09-12T18:01:02.845 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T18:01:02.712+0000 7f7e0812f640 10 monclient: get_auth_request con 0x560807d3d430 auth_method 0 2024-09-12T18:01:02.845 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient: build_initial_monmap 2024-09-12T18:01:02.845 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:02.845 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient: monmap: 2024-09-12T18:01:02.845 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:01:02.845 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:02.845 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:01:02.845 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:01:02.845 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:02.846 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.846 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:01:02.846 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:01:02.846 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:01:02.846 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.846 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding auth protocol: cephx 2024-09-12T18:01:02.846 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding auth protocol: cephx 2024-09-12T18:01:02.846 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding auth protocol: cephx 2024-09-12T18:01:02.846 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: secure 2024-09-12T18:01:02.846 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: crc 2024-09-12T18:01:02.846 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: secure 2024-09-12T18:01:02.846 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: crc 2024-09-12T18:01:02.846 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: secure 2024-09-12T18:01:02.846 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: crc 2024-09-12T18:01:02.847 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: crc 2024-09-12T18:01:02.847 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: secure 2024-09-12T18:01:02.847 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: crc 2024-09-12T18:01:02.847 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: secure 2024-09-12T18:01:02.847 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: crc 2024-09-12T18:01:02.847 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: secure 2024-09-12T18:01:02.847 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.847 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command objecter_requests cmddesc objecter_requests hook 0x560807d468e0 EEXIST 2024-09-12T18:01:02.847 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient: init 2024-09-12T18:01:02.847 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding auth protocol: cephx 2024-09-12T18:01:02.847 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding auth protocol: cephx 2024-09-12T18:01:02.847 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding auth protocol: cephx 2024-09-12T18:01:02.847 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: secure 2024-09-12T18:01:02.847 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: crc 2024-09-12T18:01:02.847 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: secure 2024-09-12T18:01:02.848 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: crc 2024-09-12T18:01:02.848 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: secure 2024-09-12T18:01:02.848 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: crc 2024-09-12T18:01:02.848 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: crc 2024-09-12T18:01:02.848 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: secure 2024-09-12T18:01:02.848 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: crc 2024-09-12T18:01:02.848 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: secure 2024-09-12T18:01:02.848 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: crc 2024-09-12T18:01:02.848 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: secure 2024-09-12T18:01:02.848 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.848 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.848 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command rotate-key cmddesc rotate-key hook 0x560807d42030 EEXIST 2024-09-12T18:01:02.848 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:02.848 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:01:02.849 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-b con 0x560807d6aa90 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:01:02.849 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-a con 0x560807d6a3c0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:01:02.849 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-c con 0x560807d68da0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:01:02.849 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.849 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.849 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.849 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:02.849 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient(hunting): authenticate will time out at 2859.283973s 2024-09-12T18:01:02.849 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T18:01:02.716+0000 7f7e09131640 10 monclient(hunting): get_auth_request con 0x560807d68da0 auth_method 0 2024-09-12T18:01:02.849 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T18:01:02.716+0000 7f7e09131640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:02.849 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T18:01:02.716+0000 7f7e09131640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:02.849 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T18:01:02.716+0000 7f7e09131640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:02.849 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T18:01:02.716+0000 7f7e0812f640 10 monclient(hunting): get_auth_request con 0x560807d6a3c0 auth_method 0 2024-09-12T18:01:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T18:01:02.716+0000 7f7e0812f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T18:01:02.716+0000 7f7e0812f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T18:01:02.716+0000 7f7e0812f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T18:01:02.716+0000 7f7e09131640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T18:01:02.716+0000 7f7e09131640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T18:01:02.716+0000 7f7e09131640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T18:01:02.716+0000 7f7e0812f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T18:01:02.716+0000 7f7e0812f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T18:01:02.716+0000 7f7e0812f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T18:01:02.716+0000 7f7e08930640 10 monclient(hunting): get_auth_request con 0x560807d6aa90 auth_method 0 2024-09-12T18:01:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T18:01:02.716+0000 7f7e08930640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T18:01:02.716+0000 7f7e08930640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T18:01:02.716+0000 7f7e08930640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:02.850 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T18:01:02.716+0000 7f7e09131640 10 monclient(hunting): handle_auth_done global_id 7571 payload 824 2024-09-12T18:01:02.851 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T18:01:02.716+0000 7f7e09131640 10 monclient: _finish_hunting 0 2024-09-12T18:01:02.851 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T18:01:02.716+0000 7f7e09131640 1 monclient: found mon.noname-c 2024-09-12T18:01:02.851 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T18:01:02.716+0000 7f7e09131640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:01:02.851 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:02.851 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:01:02.851 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 10 monclient: dump: 2024-09-12T18:01:02.851 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:02.851 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:02.851 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.851 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.851 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:02.851 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.852 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:02.852 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:02.852 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:02.852 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.852 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 10 monclient: _finish_auth 0 2024-09-12T18:01:02.852 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:01:02.852 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:02.852 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:02.852 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:01:02.852 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 10 monclient: dump: 2024-09-12T18:01:02.852 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:02.852 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:02.852 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.853 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.853 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:02.853 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.853 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:02.853 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:02.853 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:02.853 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.853 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T18:01:02.716+0000 7f7e09932640 4 set_mon_vals no callback set 2024-09-12T18:01:02.853 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 monclient: authenticate success, global_id 7571 2024-09-12T18:01:02.853 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 10 monclient: _renew_subs 2024-09-12T18:01:02.853 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:01:02.853 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 10 monclient: _renew_subs 2024-09-12T18:01:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:01:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 10 monclient: get_monmap_and_config 2024-09-12T18:01:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 10 monclient: build_initial_monmap 2024-09-12T18:01:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:02.854 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 10 monclient: monmap: 2024-09-12T18:01:02.854 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:01:02.854 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:02.854 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:01:02.854 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:01:02.854 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:02.855 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.855 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:01:02.855 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:01:02.855 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:01:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding auth protocol: cephx 2024-09-12T18:01:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding auth protocol: cephx 2024-09-12T18:01:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding auth protocol: cephx 2024-09-12T18:01:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: secure 2024-09-12T18:01:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: crc 2024-09-12T18:01:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: secure 2024-09-12T18:01:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: crc 2024-09-12T18:01:02.855 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: secure 2024-09-12T18:01:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: crc 2024-09-12T18:01:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: crc 2024-09-12T18:01:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: secure 2024-09-12T18:01:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: crc 2024-09-12T18:01:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: secure 2024-09-12T18:01:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: crc 2024-09-12T18:01:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: secure 2024-09-12T18:01:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T18:01:02.716+0000 7f7e08930640 10 monclient: get_auth_request con 0x7f7ce0070a20 auth_method 0 2024-09-12T18:01:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 10 monclient: init 2024-09-12T18:01:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding auth protocol: cephx 2024-09-12T18:01:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding auth protocol: cephx 2024-09-12T18:01:02.856 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding auth protocol: cephx 2024-09-12T18:01:02.857 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: secure 2024-09-12T18:01:02.857 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: crc 2024-09-12T18:01:02.857 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: secure 2024-09-12T18:01:02.857 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: crc 2024-09-12T18:01:02.857 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: secure 2024-09-12T18:01:02.857 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: crc 2024-09-12T18:01:02.857 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: crc 2024-09-12T18:01:02.857 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: secure 2024-09-12T18:01:02.857 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: crc 2024-09-12T18:01:02.857 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: secure 2024-09-12T18:01:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: crc 2024-09-12T18:01:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: secure 2024-09-12T18:01:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdcb586f78 EEXIST 2024-09-12T18:01:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:01:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-a con 0x560807d8e3f0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:01:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-c con 0x560807db9c50 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:01:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-b con 0x560807daf3d0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:01:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.858 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): authenticate will time out at 2859.288213s 2024-09-12T18:01:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): get_auth_request con 0x560807db9c50 auth_method 0 2024-09-12T18:01:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): get_auth_request con 0x560807d8e3f0 auth_method 0 2024-09-12T18:01:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:02.859 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:02.860 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:02.860 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:02.860 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): handle_auth_done global_id 7574 payload 274 2024-09-12T18:01:02.860 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient: _finish_hunting 0 2024-09-12T18:01:02.860 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T18:01:02.720+0000 7f7e0812f640 1 monclient: found mon.noname-c 2024-09-12T18:01:02.860 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:01:02.860 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T18:01:02.720+0000 7f7cdffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:02.860 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T18:01:02.720+0000 7f7cdffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:01:02.860 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T18:01:02.720+0000 7f7cdffff640 10 monclient: dump: 2024-09-12T18:01:02.860 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:02.860 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:02.861 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.861 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.861 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:02.861 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.861 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:02.861 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:02.861 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:02.861 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.861 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T18:01:02.720+0000 7f7cdffff640 10 monclient: _finish_auth 0 2024-09-12T18:01:02.861 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T18:01:02.720+0000 7f7cdffff640 10 monclient: _check_auth_tickets 2024-09-12T18:01:02.861 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T18:01:02.720+0000 7f7cdffff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:02.861 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 monclient: authenticate success, global_id 7574 2024-09-12T18:01:02.861 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:01:02.862 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 4 set_mon_vals no callback set 2024-09-12T18:01:02.862 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T18:01:02.720+0000 7f7cdffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:02.862 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T18:01:02.720+0000 7f7cdffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:01:02.862 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T18:01:02.720+0000 7f7cdffff640 10 monclient: dump: 2024-09-12T18:01:02.862 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:02.862 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:02.862 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.862 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.862 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:02.862 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.862 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:02.862 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:02.862 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:02.863 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.863 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient: shutdown 2024-09-12T18:01:02.863 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient: build_initial_monmap 2024-09-12T18:01:02.863 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:02.863 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient: monmap: 2024-09-12T18:01:02.863 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:01:02.863 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:02.863 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:01:02.863 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:01:02.863 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:02.863 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.863 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:01:02.863 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:01:02.864 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:01:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding auth protocol: cephx 2024-09-12T18:01:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding auth protocol: cephx 2024-09-12T18:01:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding auth protocol: cephx 2024-09-12T18:01:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: secure 2024-09-12T18:01:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: crc 2024-09-12T18:01:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: secure 2024-09-12T18:01:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: crc 2024-09-12T18:01:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: secure 2024-09-12T18:01:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: crc 2024-09-12T18:01:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: crc 2024-09-12T18:01:02.864 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: secure 2024-09-12T18:01:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: crc 2024-09-12T18:01:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: secure 2024-09-12T18:01:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: crc 2024-09-12T18:01:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: secure 2024-09-12T18:01:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 1 librados: starting msgr at 2024-09-12T18:01:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 1 librados: starting objecter 2024-09-12T18:01:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command objecter_requests cmddesc objecter_requests hook 0x560807db9490 EEXIST 2024-09-12T18:01:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 1 librados: setting wanted keys 2024-09-12T18:01:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 1 librados: calling monclient init 2024-09-12T18:01:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient: init 2024-09-12T18:01:02.865 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding auth protocol: cephx 2024-09-12T18:01:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding auth protocol: cephx 2024-09-12T18:01:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding auth protocol: cephx 2024-09-12T18:01:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: secure 2024-09-12T18:01:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: crc 2024-09-12T18:01:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: secure 2024-09-12T18:01:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: crc 2024-09-12T18:01:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: secure 2024-09-12T18:01:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: crc 2024-09-12T18:01:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: crc 2024-09-12T18:01:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: secure 2024-09-12T18:01:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: crc 2024-09-12T18:01:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: secure 2024-09-12T18:01:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: crc 2024-09-12T18:01:02.866 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: secure 2024-09-12T18:01:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command rotate-key cmddesc rotate-key hook 0x560807d6c9f8 EEXIST 2024-09-12T18:01:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:01:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-c con 0x560807d8e3f0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:01:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-b con 0x560807daf3d0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:01:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-a con 0x560807db9c50 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:01:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:02.867 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): authenticate will time out at 2859.290815s 2024-09-12T18:01:02.868 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): get_auth_request con 0x560807d8e3f0 auth_method 0 2024-09-12T18:01:02.868 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:02.868 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:02.868 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:02.868 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T18:01:02.720+0000 7f7e09131640 10 monclient(hunting): get_auth_request con 0x560807db9c50 auth_method 0 2024-09-12T18:01:02.868 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T18:01:02.720+0000 7f7e09131640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:02.868 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T18:01:02.720+0000 7f7e09131640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:02.868 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T18:01:02.720+0000 7f7e09131640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:02.868 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:02.868 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:02.868 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:02.868 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T18:01:02.720+0000 7f7e09131640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:02.868 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T18:01:02.720+0000 7f7e09131640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T18:01:02.720+0000 7f7e09131640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): get_auth_request con 0x560807daf3d0 auth_method 0 2024-09-12T18:01:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): handle_auth_done global_id 7577 payload 824 2024-09-12T18:01:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient: _finish_hunting 0 2024-09-12T18:01:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T18:01:02.720+0000 7f7e08930640 1 monclient: found mon.noname-c 2024-09-12T18:01:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:01:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T18:01:02.720+0000 7f7cde7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T18:01:02.720+0000 7f7cde7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:01:02.869 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T18:01:02.720+0000 7f7cde7fc640 10 monclient: dump: 2024-09-12T18:01:02.869 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:02.870 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:02.870 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.870 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.870 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:02.870 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.870 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:02.870 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:02.870 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:02.870 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.870 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T18:01:02.720+0000 7f7cde7fc640 10 monclient: _finish_auth 0 2024-09-12T18:01:02.870 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T18:01:02.720+0000 7f7cde7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:01:02.870 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T18:01:02.720+0000 7f7cde7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:02.870 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T18:01:02.720+0000 7f7cde7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:02.871 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T18:01:02.720+0000 7f7cde7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:01:02.871 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T18:01:02.720+0000 7f7cde7fc640 10 monclient: dump: 2024-09-12T18:01:02.871 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:02.871 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:02.871 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.871 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.871 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:02.871 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.871 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:02.871 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:02.871 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:02.871 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.871 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T18:01:02.720+0000 7f7cdffff640 4 set_mon_vals no callback set 2024-09-12T18:01:02.871 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 5 monclient: authenticate success, global_id 7577 2024-09-12T18:01:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 10 monclient: _renew_subs 2024-09-12T18:01:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:01:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 10 monclient: _renew_subs 2024-09-12T18:01:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:01:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 1 librados: init done 2024-09-12T18:01:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command cr dump hook 0x560807dabf18 2024-09-12T18:01:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T18:01:02.724+0000 7f7cde7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T18:01:02.724+0000 7f7cde7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T18:01:02.724+0000 7f7cde7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T18:01:02.724+0000 7f7e0812f640 10 monclient: get_auth_request con 0x7f7cd4070ae0 auth_method 0 2024-09-12T18:01:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T18:01:02.724+0000 7f7e09131640 10 monclient: get_auth_request con 0x560807dd8410 auth_method 0 2024-09-12T18:01:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.872 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 realm 2024-09-12T18:01:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T18:01:02.728+0000 7f7e08930640 10 monclient: get_auth_request con 0x560807ddc530 auth_method 0 2024-09-12T18:01:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T18:01:02.728+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T18:01:02.728+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T18:01:02.728+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T18:01:02.728+0000 7f7e0ae2a9c0 20 searching for the correct realm 2024-09-12T18:01:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T18:01:02.728+0000 7f7e0812f640 10 monclient: get_auth_request con 0x560807de1860 auth_method 0 2024-09-12T18:01:02.873 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T18:01:02.728+0000 7f7e09131640 10 monclient: get_auth_request con 0x7f7dfc027020 auth_method 0 2024-09-12T18:01:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T18:01:02.732+0000 7f7e08930640 10 monclient: get_auth_request con 0x7f7e000faa50 auth_method 0 2024-09-12T18:01:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T18:01:02.732+0000 7f7e0812f640 10 monclient: get_auth_request con 0x7f7df8018040 auth_method 0 2024-09-12T18:01:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T18:01:02.732+0000 7f7e09131640 0 -- 172.21.15.98:0/3455850634 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x560807dd8410 msgr2=0x560807dda8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T18:01:02.732+0000 7f7cde7fc640 1 client.7577.objecter ms_handle_reset 0x560807dd8410 session 0x560807dd7d40 osd.1 2024-09-12T18:01:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T18:01:02.732+0000 7f7cde7fc640 10 monclient: _renew_subs 2024-09-12T18:01:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T18:01:02.732+0000 7f7cde7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:01:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T18:01:02.732+0000 7f7e09131640 10 monclient: get_auth_request con 0x7f7cd4081180 auth_method 0 2024-09-12T18:01:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T18:01:02.736+0000 7f7e09131640 10 monclient: get_auth_request con 0x7f7dfc008050 auth_method 0 2024-09-12T18:01:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T18:01:02.740+0000 7f7e08930640 10 monclient: get_auth_request con 0x7f7dfc067b20 auth_method 0 2024-09-12T18:01:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T18:01:02.740+0000 7f7e0812f640 0 -- 172.21.15.98:0/3455850634 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f7df8018040 msgr2=0x7f7df8067130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T18:01:02.740+0000 7f7cde7fc640 1 client.7577.objecter ms_handle_reset 0x7f7df8018040 session 0x7f7df8030040 osd.4 2024-09-12T18:01:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T18:01:02.740+0000 7f7e0812f640 10 monclient: get_auth_request con 0x560807dd8410 auth_method 0 2024-09-12T18:01:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:02.874 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:01:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:01:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 zone default found 2024-09-12T18:01:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 4 Realm: () 2024-09-12T18:01:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:01:02.875 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:01:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 zonegroup default 2024-09-12T18:01:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 started sync module instance, tier type = 2024-09-12T18:01:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:01:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=0 2024-09-12T18:01:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=1 2024-09-12T18:01:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=2 2024-09-12T18:01:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=3 2024-09-12T18:01:02.876 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=4 2024-09-12T18:01:02.877 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=5 2024-09-12T18:01:02.877 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=6 2024-09-12T18:01:02.877 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 20 add_watcher() i=7 2024-09-12T18:01:02.877 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:02.877 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding auth protocol: cephx 2024-09-12T18:01:02.877 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding auth protocol: cephx 2024-09-12T18:01:02.877 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding auth protocol: cephx 2024-09-12T18:01:02.877 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: secure 2024-09-12T18:01:02.877 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: crc 2024-09-12T18:01:02.877 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: secure 2024-09-12T18:01:02.877 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: crc 2024-09-12T18:01:02.877 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: secure 2024-09-12T18:01:02.877 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: crc 2024-09-12T18:01:02.877 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: crc 2024-09-12T18:01:02.878 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: secure 2024-09-12T18:01:02.878 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: crc 2024-09-12T18:01:02.878 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: secure 2024-09-12T18:01:02.878 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: crc 2024-09-12T18:01:02.878 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T18:01:02.768+0000 7f7cbefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:02.878 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: secure 2024-09-12T18:01:02.878 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.878 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:02.878 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:02.878 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command cache list hook 0x560807dac190 2024-09-12T18:01:02.878 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command cache inspect hook 0x560807dac190 2024-09-12T18:01:02.878 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command cache erase hook 0x560807dac190 2024-09-12T18:01:02.878 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command cache zap hook 0x560807dac190 2024-09-12T18:01:02.878 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 note: GC not initialized 2024-09-12T18:01:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T18:01:02.768+0000 7f7cbdfe3640 20 reqs_thread_entry: start 2024-09-12T18:01:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command sync trace show hook 0x7f7df8004410 2024-09-12T18:01:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command sync trace history hook 0x7f7df8004410 2024-09-12T18:01:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command sync trace active hook 0x7f7df8004410 2024-09-12T18:01:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command sync trace active_short hook 0x7f7df8004410 2024-09-12T18:01:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:01:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 20 Filter name: none 2024-09-12T18:01:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T18:01:02.768+0000 7f7c2f7fe640 20 reqs_thread_entry: start 2024-09-12T18:01:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:01:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:01:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:01:02.879 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T18:01:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:01:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T18:01:02.780+0000 7f7e0ae2a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T18:01:02.780+0000 7f7e0ae2a9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T18:01:02.780+0000 7f7e0ae2a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T18:01:02.780+0000 7f7e0ae2a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T18:01:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T18:01:02.784+0000 7f7cdffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366218 cookie 94592491690768 notifier 7577 bl.length()=827 2024-09-12T18:01:02.880 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T18:01:02.784+0000 7f7cdffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T18:01:02.784+0000 7f7cdffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T18:01:02.784+0000 7f7cdffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T18:01:02.784+0000 7f7e0ae2a9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T18:01:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T18:01:02.784+0000 7f7e0ae2a9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T18:01:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T18:01:02.784+0000 7f7e0ae2a9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T18:01:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T18:01:02.784+0000 7f7e0ae2a9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T18:01:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.0 2024-09-12T18:01:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.0 2024-09-12T18:01:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.1 2024-09-12T18:01:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.1 2024-09-12T18:01:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.2 2024-09-12T18:01:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.2 2024-09-12T18:01:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.3 2024-09-12T18:01:02.881 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.3 2024-09-12T18:01:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.4 2024-09-12T18:01:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.4 2024-09-12T18:01:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.5 2024-09-12T18:01:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.5 2024-09-12T18:01:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.6 2024-09-12T18:01:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.6 2024-09-12T18:01:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.7 2024-09-12T18:01:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.7 2024-09-12T18:01:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.8 2024-09-12T18:01:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.8 2024-09-12T18:01:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.9 2024-09-12T18:01:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.9 2024-09-12T18:01:02.882 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.10 2024-09-12T18:01:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.10 2024-09-12T18:01:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.11 2024-09-12T18:01:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.11 2024-09-12T18:01:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.12 2024-09-12T18:01:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.12 2024-09-12T18:01:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.13 2024-09-12T18:01:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.13 2024-09-12T18:01:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:01:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:01:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:01:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:01:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:01:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:01:02.883 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:01:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:01:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:01:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:01:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:01:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:01:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:01:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:01:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:01:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:01:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:01:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:01:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:01:02.884 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:01:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:01:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:01:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:01:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:01:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:01:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:01:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T18:01:02.816+0000 7f7e0ae2a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7e0ae2a9c0 time 2024-09-12T18:01:02.815857+0000 2024-09-12T18:01:02.885 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:01:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7e0e7042eb] 2024-09-12T18:01:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7e0e70449f] 2024-09-12T18:01:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56080648d0c1] 2024-09-12T18:01:02.885 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x56080649e4f1] 2024-09-12T18:01:02.886 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56080649fb44] 2024-09-12T18:01:02.886 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T18:01:02.886 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7e0d56ad90] 2024-09-12T18:01:02.886 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T18:01:02.886 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T18:01:02.886 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.886 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T18:01:02.816+0000 7f7e0ae2a9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:01:02.886 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f7e0ae2a9c0 thread_name:radosgw-admin 2024-09-12T18:01:02.886 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.886 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:02.886 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7e0d583520] 2024-09-12T18:01:02.886 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T18:01:02.886 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T18:01:02.886 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T18:01:02.887 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7e0e704345] 2024-09-12T18:01:02.887 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7e0e70449f] 2024-09-12T18:01:02.887 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56080648d0c1] 2024-09-12T18:01:02.887 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x56080649e4f1] 2024-09-12T18:01:02.887 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56080649fb44] 2024-09-12T18:01:02.887 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T18:01:02.887 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7e0d56ad90] 2024-09-12T18:01:02.887 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T18:01:02.887 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T18:01:02.887 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:01:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.888 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T18:01:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T18:01:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T18:01:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T18:01:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T18:01:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T18:01:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T18:01:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T18:01:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T18:01:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T18:01:02.888 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T18:01:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T18:01:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T18:01:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T18:01:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T18:01:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T18:01:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T18:01:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T18:01:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T18:01:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T18:01:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T18:01:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T18:01:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T18:01:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T18:01:02.889 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:01:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T18:01:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T18:01:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T18:01:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T18:01:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T18:01:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T18:01:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T18:01:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T18:01:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T18:01:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T18:01:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T18:01:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T18:01:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T18:01:02.890 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T18:01:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T18:01:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T18:01:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T18:01:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T18:01:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T18:01:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T18:01:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T18:01:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:01:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T18:01:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:01:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T18:01:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T18:01:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T18:01:02.891 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T18:01:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T18:01:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T18:01:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T18:01:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T18:01:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T18:01:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T18:01:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T18:01:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T18:01:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T18:01:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T18:01:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T18:01:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T18:01:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T18:01:02.892 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T18:01:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:01:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T18:01:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:01:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T18:01:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T18:01:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T18:01:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T18:01:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T18:01:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T18:01:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:01:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T18:01:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T18:01:02.893 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:01:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T18:01:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T18:01:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T18:01:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T18:01:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T18:01:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T18:01:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T18:01:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T18:01:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T18:01:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T18:01:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T18:01:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T18:01:02.894 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T18:01:02.894 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:01:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7c2f7fe640 / http_manager 2024-09-12T18:01:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7cbdfe3640 / http_manager 2024-09-12T18:01:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7cbefe5640 / rgw_dt_lg_renew 2024-09-12T18:01:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7cde7fc640 / ms_dispatch 2024-09-12T18:01:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7cdffff640 / io_context_pool 2024-09-12T18:01:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7cee7fc640 / ms_dispatch 2024-09-12T18:01:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7cf560a640 / ms_dispatch 2024-09-12T18:01:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7cf6e0d640 / io_context_pool 2024-09-12T18:01:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7e0812f640 / msgr-worker-2 2024-09-12T18:01:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7e08930640 / msgr-worker-1 2024-09-12T18:01:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7e09131640 / msgr-worker-0 2024-09-12T18:01:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7e09932640 / io_context_pool 2024-09-12T18:01:02.895 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7e0ae2a9c0 / radosgw-admin 2024-09-12T18:01:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T18:01:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T18:01:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/log/ceph/ceph-client.admin.138823.log 2024-09-12T18:01:02.896 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T18:01:02.896 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T18:01:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807cef3c0) adding con mode: crc 2024-09-12T18:01:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807cef3c0) adding con mode: secure 2024-09-12T18:01:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command rotate-key hook 0x560807cef508 2024-09-12T18:01:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:01:02.896 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-b con 0x560807baab80 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:01:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-a con 0x560807bab970 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:01:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-c con 0x560807c38460 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:01:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient(hunting): authenticate will time out at 2859.273482s 2024-09-12T18:01:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T18:01:02.704+0000 7f7e0812f640 10 monclient(hunting): get_auth_request con 0x560807bab970 auth_method 0 2024-09-12T18:01:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T18:01:02.704+0000 7f7e0812f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T18:01:02.704+0000 7f7e0812f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T18:01:02.704+0000 7f7e0812f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T18:01:02.704+0000 7f7e09131640 10 monclient(hunting): get_auth_request con 0x560807c38460 auth_method 0 2024-09-12T18:01:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T18:01:02.704+0000 7f7e09131640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:02.897 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T18:01:02.704+0000 7f7e09131640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T18:01:02.704+0000 7f7e09131640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T18:01:02.704+0000 7f7e0812f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T18:01:02.704+0000 7f7e0812f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T18:01:02.704+0000 7f7e0812f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T18:01:02.704+0000 7f7e09131640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T18:01:02.704+0000 7f7e09131640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T18:01:02.704+0000 7f7e09131640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T18:01:02.704+0000 7f7e0812f640 10 monclient(hunting): handle_auth_done global_id 8226 payload 824 2024-09-12T18:01:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T18:01:02.704+0000 7f7e0812f640 10 monclient: _finish_hunting 0 2024-09-12T18:01:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T18:01:02.704+0000 7f7e0812f640 1 monclient: found mon.noname-a 2024-09-12T18:01:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T18:01:02.704+0000 7f7e0812f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T18:01:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T18:01:02.704+0000 7f7e08930640 10 monclient: get_auth_request con 0x560807baab80 auth_method 0 2024-09-12T18:01:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T18:01:02.704+0000 7f7cf560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:02.898 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T18:01:02.704+0000 7f7cf560a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:01:02.899 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T18:01:02.704+0000 7f7cf560a640 10 monclient: dump: 2024-09-12T18:01:02.899 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:02.899 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:02.899 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.899 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.899 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:02.899 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.899 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:02.899 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:02.899 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:02.899 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.899 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T18:01:02.704+0000 7f7cf560a640 10 monclient: _finish_auth 0 2024-09-12T18:01:02.899 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T18:01:02.704+0000 7f7cf560a640 10 monclient: _check_auth_tickets 2024-09-12T18:01:02.900 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T18:01:02.704+0000 7f7cf560a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:02.900 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T18:01:02.704+0000 7f7cf560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:02.900 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T18:01:02.704+0000 7f7cf560a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:02.900 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T18:01:02.704+0000 7f7cf560a640 10 monclient: dump: 2024-09-12T18:01:02.900 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:02.900 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:02.900 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.900 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.900 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:02.900 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.900 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:02.900 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:02.900 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:02.900 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T18:01:02.704+0000 7f7cf6e0d640 4 set_mon_vals no callback set 2024-09-12T18:01:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 5 monclient: authenticate success, global_id 8226 2024-09-12T18:01:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient: _renew_subs 2024-09-12T18:01:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:01:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient: _renew_subs 2024-09-12T18:01:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:01:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T18:01:02.704+0000 7f7e0ae2a9c0 1 librados: init done 2024-09-12T18:01:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T18:01:02.708+0000 7f7cf560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T18:01:02.708+0000 7f7cf560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T18:01:02.708+0000 7f7cf560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T18:01:02.708+0000 7f7e08930640 10 monclient: get_auth_request con 0x7f7cf0070ae0 auth_method 0 2024-09-12T18:01:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T18:01:02.708+0000 7f7e09131640 10 monclient: get_auth_request con 0x560807d1d220 auth_method 0 2024-09-12T18:01:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T18:01:02.708+0000 7f7e08930640 10 monclient: get_auth_request con 0x560807d39b40 auth_method 0 2024-09-12T18:01:02.901 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T18:01:02.712+0000 7f7e0812f640 10 monclient: get_auth_request con 0x560807d3d430 auth_method 0 2024-09-12T18:01:02.902 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient: build_initial_monmap 2024-09-12T18:01:02.902 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:02.902 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient: monmap: 2024-09-12T18:01:02.902 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:01:02.902 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:02.902 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:01:02.902 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:01:02.902 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:02.902 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.902 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:01:02.902 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:01:02.902 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:01:02.902 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding auth protocol: cephx 2024-09-12T18:01:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding auth protocol: cephx 2024-09-12T18:01:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding auth protocol: cephx 2024-09-12T18:01:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: secure 2024-09-12T18:01:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: crc 2024-09-12T18:01:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: secure 2024-09-12T18:01:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: crc 2024-09-12T18:01:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: secure 2024-09-12T18:01:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: crc 2024-09-12T18:01:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: crc 2024-09-12T18:01:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: secure 2024-09-12T18:01:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: crc 2024-09-12T18:01:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: secure 2024-09-12T18:01:02.903 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: crc 2024-09-12T18:01:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d42fa0) adding con mode: secure 2024-09-12T18:01:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command objecter_requests cmddesc objecter_requests hook 0x560807d468e0 EEXIST 2024-09-12T18:01:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient: init 2024-09-12T18:01:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding auth protocol: cephx 2024-09-12T18:01:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding auth protocol: cephx 2024-09-12T18:01:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding auth protocol: cephx 2024-09-12T18:01:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: secure 2024-09-12T18:01:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: crc 2024-09-12T18:01:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: secure 2024-09-12T18:01:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: crc 2024-09-12T18:01:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: secure 2024-09-12T18:01:02.904 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: crc 2024-09-12T18:01:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: crc 2024-09-12T18:01:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: secure 2024-09-12T18:01:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: crc 2024-09-12T18:01:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: secure 2024-09-12T18:01:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: crc 2024-09-12T18:01:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d41ee8) adding con mode: secure 2024-09-12T18:01:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command rotate-key cmddesc rotate-key hook 0x560807d42030 EEXIST 2024-09-12T18:01:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:01:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-b con 0x560807d6aa90 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:01:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-a con 0x560807d6a3c0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:01:02.905 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-c con 0x560807d68da0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:01:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T18:01:02.712+0000 7f7e0ae2a9c0 10 monclient(hunting): authenticate will time out at 2859.283973s 2024-09-12T18:01:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T18:01:02.716+0000 7f7e09131640 10 monclient(hunting): get_auth_request con 0x560807d68da0 auth_method 0 2024-09-12T18:01:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T18:01:02.716+0000 7f7e09131640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T18:01:02.716+0000 7f7e09131640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T18:01:02.716+0000 7f7e09131640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T18:01:02.716+0000 7f7e0812f640 10 monclient(hunting): get_auth_request con 0x560807d6a3c0 auth_method 0 2024-09-12T18:01:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T18:01:02.716+0000 7f7e0812f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T18:01:02.716+0000 7f7e0812f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T18:01:02.716+0000 7f7e0812f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:02.906 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T18:01:02.716+0000 7f7e09131640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T18:01:02.716+0000 7f7e09131640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T18:01:02.716+0000 7f7e09131640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T18:01:02.716+0000 7f7e0812f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T18:01:02.716+0000 7f7e0812f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T18:01:02.716+0000 7f7e0812f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T18:01:02.716+0000 7f7e08930640 10 monclient(hunting): get_auth_request con 0x560807d6aa90 auth_method 0 2024-09-12T18:01:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T18:01:02.716+0000 7f7e08930640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T18:01:02.716+0000 7f7e08930640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T18:01:02.716+0000 7f7e08930640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T18:01:02.716+0000 7f7e09131640 10 monclient(hunting): handle_auth_done global_id 7571 payload 824 2024-09-12T18:01:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T18:01:02.716+0000 7f7e09131640 10 monclient: _finish_hunting 0 2024-09-12T18:01:02.907 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T18:01:02.716+0000 7f7e09131640 1 monclient: found mon.noname-c 2024-09-12T18:01:02.908 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T18:01:02.716+0000 7f7e09131640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:01:02.908 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:02.908 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:01:02.908 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 10 monclient: dump: 2024-09-12T18:01:02.908 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:02.908 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:02.908 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.908 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.908 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:02.908 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.908 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:02.908 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:02.908 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:02.909 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.909 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 10 monclient: _finish_auth 0 2024-09-12T18:01:02.909 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:01:02.909 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:02.909 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:02.909 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:01:02.909 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 10 monclient: dump: 2024-09-12T18:01:02.909 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:02.909 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:02.909 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.909 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.909 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:02.909 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.910 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:02.910 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:02.910 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:02.910 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.910 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T18:01:02.716+0000 7f7e09932640 4 set_mon_vals no callback set 2024-09-12T18:01:02.910 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 monclient: authenticate success, global_id 7571 2024-09-12T18:01:02.910 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 10 monclient: _renew_subs 2024-09-12T18:01:02.910 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:01:02.910 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 10 monclient: _renew_subs 2024-09-12T18:01:02.910 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:01:02.910 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:02.910 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:02.910 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T18:01:02.716+0000 7f7cee7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:02.910 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 10 monclient: get_monmap_and_config 2024-09-12T18:01:02.911 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 10 monclient: build_initial_monmap 2024-09-12T18:01:02.911 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:02.911 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 10 monclient: monmap: 2024-09-12T18:01:02.911 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:01:02.911 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:02.911 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:01:02.911 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:01:02.911 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:02.911 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.911 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:01:02.911 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:01:02.911 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:01:02.911 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.911 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding auth protocol: cephx 2024-09-12T18:01:02.912 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding auth protocol: cephx 2024-09-12T18:01:02.912 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding auth protocol: cephx 2024-09-12T18:01:02.912 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: secure 2024-09-12T18:01:02.912 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: crc 2024-09-12T18:01:02.912 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: secure 2024-09-12T18:01:02.912 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: crc 2024-09-12T18:01:02.912 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: secure 2024-09-12T18:01:02.912 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: crc 2024-09-12T18:01:02.912 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: crc 2024-09-12T18:01:02.912 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: secure 2024-09-12T18:01:02.912 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: crc 2024-09-12T18:01:02.912 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: secure 2024-09-12T18:01:02.912 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: crc 2024-09-12T18:01:02.912 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d8a3c0) adding con mode: secure 2024-09-12T18:01:02.913 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T18:01:02.716+0000 7f7e08930640 10 monclient: get_auth_request con 0x7f7ce0070a20 auth_method 0 2024-09-12T18:01:02.913 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.913 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 10 monclient: init 2024-09-12T18:01:02.913 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding auth protocol: cephx 2024-09-12T18:01:02.913 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding auth protocol: cephx 2024-09-12T18:01:02.913 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding auth protocol: cephx 2024-09-12T18:01:02.913 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: secure 2024-09-12T18:01:02.913 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: crc 2024-09-12T18:01:02.913 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: secure 2024-09-12T18:01:02.913 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: crc 2024-09-12T18:01:02.913 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: secure 2024-09-12T18:01:02.913 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: crc 2024-09-12T18:01:02.913 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: crc 2024-09-12T18:01:02.914 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: secure 2024-09-12T18:01:02.914 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: crc 2024-09-12T18:01:02.914 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: secure 2024-09-12T18:01:02.914 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: crc 2024-09-12T18:01:02.914 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb586e30) adding con mode: secure 2024-09-12T18:01:02.914 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T18:01:02.716+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.914 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.914 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdcb586f78 EEXIST 2024-09-12T18:01:02.914 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:02.914 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:01:02.914 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-a con 0x560807d8e3f0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:01:02.914 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-c con 0x560807db9c50 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:01:02.914 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-b con 0x560807daf3d0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:01:02.914 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.915 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.915 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.915 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:02.915 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): authenticate will time out at 2859.288213s 2024-09-12T18:01:02.915 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): get_auth_request con 0x560807db9c50 auth_method 0 2024-09-12T18:01:02.915 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:02.915 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:02.915 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:02.915 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): get_auth_request con 0x560807d8e3f0 auth_method 0 2024-09-12T18:01:02.915 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:02.915 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:02.915 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:02.915 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:02.916 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:02.916 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:02.916 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:02.916 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:02.916 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:02.916 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): handle_auth_done global_id 7574 payload 274 2024-09-12T18:01:02.916 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient: _finish_hunting 0 2024-09-12T18:01:02.916 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T18:01:02.720+0000 7f7e0812f640 1 monclient: found mon.noname-c 2024-09-12T18:01:02.916 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:01:02.916 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T18:01:02.720+0000 7f7cdffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:02.916 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T18:01:02.720+0000 7f7cdffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:01:02.916 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T18:01:02.720+0000 7f7cdffff640 10 monclient: dump: 2024-09-12T18:01:02.916 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:02.916 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:02.917 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.917 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.917 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:02.917 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.917 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:02.917 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:02.917 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:02.917 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.917 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T18:01:02.720+0000 7f7cdffff640 10 monclient: _finish_auth 0 2024-09-12T18:01:02.917 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T18:01:02.720+0000 7f7cdffff640 10 monclient: _check_auth_tickets 2024-09-12T18:01:02.917 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T18:01:02.720+0000 7f7cdffff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:02.917 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 monclient: authenticate success, global_id 7574 2024-09-12T18:01:02.917 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:01:02.920 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 4 set_mon_vals no callback set 2024-09-12T18:01:02.920 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T18:01:02.720+0000 7f7cdffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:02.920 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T18:01:02.720+0000 7f7cdffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:01:02.920 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T18:01:02.720+0000 7f7cdffff640 10 monclient: dump: 2024-09-12T18:01:02.920 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:02.920 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:02.920 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.920 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.920 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:02.921 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.921 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:02.921 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:02.921 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:02.921 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.921 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient: shutdown 2024-09-12T18:01:02.921 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient: build_initial_monmap 2024-09-12T18:01:02.921 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:02.921 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient: monmap: 2024-09-12T18:01:02.921 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:01:02.921 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:02.921 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:01:02.921 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:01:02.922 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:02.922 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.922 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:01:02.922 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:01:02.922 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:01:02.922 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.922 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding auth protocol: cephx 2024-09-12T18:01:02.922 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding auth protocol: cephx 2024-09-12T18:01:02.922 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding auth protocol: cephx 2024-09-12T18:01:02.922 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: secure 2024-09-12T18:01:02.922 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: crc 2024-09-12T18:01:02.922 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: secure 2024-09-12T18:01:02.922 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: crc 2024-09-12T18:01:02.922 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: secure 2024-09-12T18:01:02.923 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: crc 2024-09-12T18:01:02.923 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: crc 2024-09-12T18:01:02.923 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: secure 2024-09-12T18:01:02.923 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: crc 2024-09-12T18:01:02.923 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: secure 2024-09-12T18:01:02.923 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: crc 2024-09-12T18:01:02.923 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807db8970) adding con mode: secure 2024-09-12T18:01:02.923 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.923 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 1 librados: starting msgr at 2024-09-12T18:01:02.923 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 1 librados: starting objecter 2024-09-12T18:01:02.923 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command objecter_requests cmddesc objecter_requests hook 0x560807db9490 EEXIST 2024-09-12T18:01:02.923 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 1 librados: setting wanted keys 2024-09-12T18:01:02.923 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 1 librados: calling monclient init 2024-09-12T18:01:02.924 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient: init 2024-09-12T18:01:02.924 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding auth protocol: cephx 2024-09-12T18:01:02.924 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding auth protocol: cephx 2024-09-12T18:01:02.924 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding auth protocol: cephx 2024-09-12T18:01:02.924 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: secure 2024-09-12T18:01:02.924 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: crc 2024-09-12T18:01:02.924 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: secure 2024-09-12T18:01:02.924 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: crc 2024-09-12T18:01:02.924 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: secure 2024-09-12T18:01:02.924 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: crc 2024-09-12T18:01:02.924 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: crc 2024-09-12T18:01:02.924 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: secure 2024-09-12T18:01:02.925 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: crc 2024-09-12T18:01:02.925 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: secure 2024-09-12T18:01:02.925 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: crc 2024-09-12T18:01:02.925 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 AuthRegistry(0x560807d6c8b0) adding con mode: secure 2024-09-12T18:01:02.925 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.925 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.925 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command rotate-key cmddesc rotate-key hook 0x560807d6c9f8 EEXIST 2024-09-12T18:01:02.925 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:02.925 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:01:02.925 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-c con 0x560807d8e3f0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:01:02.925 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-b con 0x560807daf3d0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:01:02.925 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): picked mon.noname-a con 0x560807db9c50 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:01:02.925 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.926 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.926 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:02.926 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:02.926 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T18:01:02.720+0000 7f7e0ae2a9c0 10 monclient(hunting): authenticate will time out at 2859.290815s 2024-09-12T18:01:02.926 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): get_auth_request con 0x560807d8e3f0 auth_method 0 2024-09-12T18:01:02.926 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:02.926 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:02.926 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:02.926 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T18:01:02.720+0000 7f7e09131640 10 monclient(hunting): get_auth_request con 0x560807db9c50 auth_method 0 2024-09-12T18:01:02.926 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T18:01:02.720+0000 7f7e09131640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:02.926 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T18:01:02.720+0000 7f7e09131640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:02.926 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T18:01:02.720+0000 7f7e09131640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:02.926 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:02.927 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:02.927 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:02.927 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T18:01:02.720+0000 7f7e09131640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:02.927 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T18:01:02.720+0000 7f7e09131640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:02.927 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T18:01:02.720+0000 7f7e09131640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:02.927 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): get_auth_request con 0x560807daf3d0 auth_method 0 2024-09-12T18:01:02.927 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:02.927 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:02.927 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T18:01:02.720+0000 7f7e0812f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:02.927 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient(hunting): handle_auth_done global_id 7577 payload 824 2024-09-12T18:01:02.927 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient: _finish_hunting 0 2024-09-12T18:01:02.927 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T18:01:02.720+0000 7f7e08930640 1 monclient: found mon.noname-c 2024-09-12T18:01:02.928 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T18:01:02.720+0000 7f7e08930640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:01:02.928 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T18:01:02.720+0000 7f7cde7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:02.928 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T18:01:02.720+0000 7f7cde7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:01:02.928 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T18:01:02.720+0000 7f7cde7fc640 10 monclient: dump: 2024-09-12T18:01:02.928 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:02.928 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:02.928 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.928 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.928 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:02.928 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.928 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:02.928 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:02.928 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:02.928 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.929 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T18:01:02.720+0000 7f7cde7fc640 10 monclient: _finish_auth 0 2024-09-12T18:01:02.929 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T18:01:02.720+0000 7f7cde7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:01:02.929 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T18:01:02.720+0000 7f7cde7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:02.929 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T18:01:02.720+0000 7f7cde7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:02.929 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T18:01:02.720+0000 7f7cde7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:01:02.929 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T18:01:02.720+0000 7f7cde7fc640 10 monclient: dump: 2024-09-12T18:01:02.929 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:02.929 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:02.929 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.929 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:02.929 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:02.929 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:02.929 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:02.929 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:02.930 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:02.930 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.930 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T18:01:02.720+0000 7f7cdffff640 4 set_mon_vals no callback set 2024-09-12T18:01:02.930 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 5 monclient: authenticate success, global_id 7577 2024-09-12T18:01:02.930 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 10 monclient: _renew_subs 2024-09-12T18:01:02.930 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:01:02.930 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 10 monclient: _renew_subs 2024-09-12T18:01:02.930 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:01:02.930 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 1 librados: init done 2024-09-12T18:01:02.930 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command cr dump hook 0x560807dabf18 2024-09-12T18:01:02.930 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.930 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T18:01:02.724+0000 7f7cde7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:02.930 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T18:01:02.724+0000 7f7cde7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:02.930 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T18:01:02.724+0000 7f7cde7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:02.931 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T18:01:02.724+0000 7f7e0812f640 10 monclient: get_auth_request con 0x7f7cd4070ae0 auth_method 0 2024-09-12T18:01:02.931 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T18:01:02.724+0000 7f7e09131640 10 monclient: get_auth_request con 0x560807dd8410 auth_method 0 2024-09-12T18:01:02.931 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.931 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 realm 2024-09-12T18:01:02.931 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.931 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.931 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:02.931 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.931 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.931 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T18:01:02.724+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.931 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T18:01:02.728+0000 7f7e08930640 10 monclient: get_auth_request con 0x560807ddc530 auth_method 0 2024-09-12T18:01:02.931 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T18:01:02.728+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:02.931 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T18:01:02.728+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.931 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T18:01:02.728+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T18:01:02.728+0000 7f7e0ae2a9c0 20 searching for the correct realm 2024-09-12T18:01:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T18:01:02.728+0000 7f7e0812f640 10 monclient: get_auth_request con 0x560807de1860 auth_method 0 2024-09-12T18:01:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T18:01:02.728+0000 7f7e09131640 10 monclient: get_auth_request con 0x7f7dfc027020 auth_method 0 2024-09-12T18:01:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T18:01:02.732+0000 7f7e08930640 10 monclient: get_auth_request con 0x7f7e000faa50 auth_method 0 2024-09-12T18:01:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T18:01:02.732+0000 7f7e0812f640 10 monclient: get_auth_request con 0x7f7df8018040 auth_method 0 2024-09-12T18:01:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T18:01:02.732+0000 7f7e09131640 0 -- 172.21.15.98:0/3455850634 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x560807dd8410 msgr2=0x560807dda8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T18:01:02.732+0000 7f7cde7fc640 1 client.7577.objecter ms_handle_reset 0x560807dd8410 session 0x560807dd7d40 osd.1 2024-09-12T18:01:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T18:01:02.732+0000 7f7cde7fc640 10 monclient: _renew_subs 2024-09-12T18:01:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T18:01:02.732+0000 7f7cde7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:01:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T18:01:02.732+0000 7f7e09131640 10 monclient: get_auth_request con 0x7f7cd4081180 auth_method 0 2024-09-12T18:01:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T18:01:02.736+0000 7f7e09131640 10 monclient: get_auth_request con 0x7f7dfc008050 auth_method 0 2024-09-12T18:01:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T18:01:02.740+0000 7f7e08930640 10 monclient: get_auth_request con 0x7f7dfc067b20 auth_method 0 2024-09-12T18:01:02.932 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T18:01:02.740+0000 7f7e0812f640 0 -- 172.21.15.98:0/3455850634 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f7df8018040 msgr2=0x7f7df8067130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:02.933 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T18:01:02.740+0000 7f7cde7fc640 1 client.7577.objecter ms_handle_reset 0x7f7df8018040 session 0x7f7df8030040 osd.4 2024-09-12T18:01:02.933 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T18:01:02.740+0000 7f7e0812f640 10 monclient: get_auth_request con 0x560807dd8410 auth_method 0 2024-09-12T18:01:02.933 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:02.933 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:01:02.933 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:02.933 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:01:02.933 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:02.933 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:02.933 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.933 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.933 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.933 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:02.933 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 zone default found 2024-09-12T18:01:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 4 Realm: () 2024-09-12T18:01:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:01:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:01:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 zonegroup default 2024-09-12T18:01:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.934 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 started sync module instance, tier type = 2024-09-12T18:01:02.935 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T18:01:02.748+0000 7f7e0ae2a9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:01:02.935 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=0 2024-09-12T18:01:02.935 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=1 2024-09-12T18:01:02.935 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=2 2024-09-12T18:01:02.935 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=3 2024-09-12T18:01:02.935 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=4 2024-09-12T18:01:02.935 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=5 2024-09-12T18:01:02.935 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T18:01:02.764+0000 7f7e0ae2a9c0 20 add_watcher() i=6 2024-09-12T18:01:02.935 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 20 add_watcher() i=7 2024-09-12T18:01:02.935 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:02.935 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding auth protocol: cephx 2024-09-12T18:01:02.935 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding auth protocol: cephx 2024-09-12T18:01:02.935 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding auth protocol: cephx 2024-09-12T18:01:02.935 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: secure 2024-09-12T18:01:02.936 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: crc 2024-09-12T18:01:02.936 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: secure 2024-09-12T18:01:02.936 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: crc 2024-09-12T18:01:02.936 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: secure 2024-09-12T18:01:02.936 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: crc 2024-09-12T18:01:02.936 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: crc 2024-09-12T18:01:02.936 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: secure 2024-09-12T18:01:02.936 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: crc 2024-09-12T18:01:02.936 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: secure 2024-09-12T18:01:02.936 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: crc 2024-09-12T18:01:02.936 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T18:01:02.768+0000 7f7cbefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:02.936 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 AuthRegistry(0x7ffdcb587300) adding con mode: secure 2024-09-12T18:01:02.936 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:02.937 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:02.937 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:02.937 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command cache list hook 0x560807dac190 2024-09-12T18:01:02.937 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command cache inspect hook 0x560807dac190 2024-09-12T18:01:02.937 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command cache erase hook 0x560807dac190 2024-09-12T18:01:02.937 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command cache zap hook 0x560807dac190 2024-09-12T18:01:02.937 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 note: GC not initialized 2024-09-12T18:01:02.937 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T18:01:02.768+0000 7f7cbdfe3640 20 reqs_thread_entry: start 2024-09-12T18:01:02.937 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command sync trace show hook 0x7f7df8004410 2024-09-12T18:01:02.937 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command sync trace history hook 0x7f7df8004410 2024-09-12T18:01:02.937 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command sync trace active hook 0x7f7df8004410 2024-09-12T18:01:02.937 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 5 asok(0x560807ae22b0) register_command sync trace active_short hook 0x7f7df8004410 2024-09-12T18:01:02.937 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:01:02.937 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 20 Filter name: none 2024-09-12T18:01:02.938 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T18:01:02.768+0000 7f7c2f7fe640 20 reqs_thread_entry: start 2024-09-12T18:01:02.938 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:01:02.938 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T18:01:02.768+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.938 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:02.938 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:01:02.938 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:01:02.938 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T18:01:02.938 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.938 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:02.938 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:02.938 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:02.938 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:02.938 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:02.939 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T18:01:02.772+0000 7f7e0ae2a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:01:02.939 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T18:01:02.780+0000 7f7e0ae2a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:02.939 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T18:01:02.780+0000 7f7e0ae2a9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:02.939 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T18:01:02.780+0000 7f7e0ae2a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:02.939 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T18:01:02.780+0000 7f7e0ae2a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T18:01:02.939 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T18:01:02.784+0000 7f7cdffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366218 cookie 94592491690768 notifier 7577 bl.length()=827 2024-09-12T18:01:02.939 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T18:01:02.784+0000 7f7cdffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:02.939 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T18:01:02.784+0000 7f7cdffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:02.939 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T18:01:02.784+0000 7f7cdffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:02.939 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T18:01:02.784+0000 7f7e0ae2a9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T18:01:02.939 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T18:01:02.784+0000 7f7e0ae2a9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T18:01:02.939 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T18:01:02.784+0000 7f7e0ae2a9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T18:01:02.939 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T18:01:02.784+0000 7f7e0ae2a9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T18:01:02.939 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.0 2024-09-12T18:01:02.939 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.0 2024-09-12T18:01:02.940 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.1 2024-09-12T18:01:02.940 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.1 2024-09-12T18:01:02.940 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.2 2024-09-12T18:01:02.940 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.2 2024-09-12T18:01:02.940 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.3 2024-09-12T18:01:02.940 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.3 2024-09-12T18:01:02.940 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.4 2024-09-12T18:01:02.940 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.4 2024-09-12T18:01:02.940 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.5 2024-09-12T18:01:02.940 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.5 2024-09-12T18:01:02.940 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.6 2024-09-12T18:01:02.940 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.6 2024-09-12T18:01:02.940 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.7 2024-09-12T18:01:02.941 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.7 2024-09-12T18:01:02.941 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.8 2024-09-12T18:01:02.941 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.8 2024-09-12T18:01:02.941 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.9 2024-09-12T18:01:02.941 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.9 2024-09-12T18:01:02.941 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.10 2024-09-12T18:01:02.941 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.10 2024-09-12T18:01:02.941 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.11 2024-09-12T18:01:02.941 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.11 2024-09-12T18:01:02.941 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.12 2024-09-12T18:01:02.941 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.12 2024-09-12T18:01:02.941 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.13 2024-09-12T18:01:02.941 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.13 2024-09-12T18:01:02.942 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:01:02.942 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T18:01:02.796+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:01:02.942 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:01:02.942 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:01:02.942 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:01:02.942 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:01:02.942 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:01:02.942 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:01:02.942 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:01:02.942 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T18:01:02.800+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:01:02.942 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:01:02.942 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:01:02.942 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:01:02.943 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:01:02.943 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:01:02.943 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:01:02.943 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:01:02.943 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T18:01:02.804+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:01:02.943 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:01:02.943 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:01:02.943 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:01:02.943 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:01:02.943 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:01:02.943 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:01:02.944 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:01:02.944 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T18:01:02.808+0000 7f7e0ae2a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:01:02.944 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T18:01:02.816+0000 7f7e0ae2a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7e0ae2a9c0 time 2024-09-12T18:01:02.815857+0000 2024-09-12T18:01:02.944 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:01:02.944 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.944 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:02.944 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7e0e7042eb] 2024-09-12T18:01:02.944 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7e0e70449f] 2024-09-12T18:01:02.944 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56080648d0c1] 2024-09-12T18:01:02.944 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x56080649e4f1] 2024-09-12T18:01:02.944 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56080649fb44] 2024-09-12T18:01:02.944 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T18:01:02.944 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7e0d56ad90] 2024-09-12T18:01:02.945 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T18:01:02.945 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T18:01:02.945 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.945 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T18:01:02.816+0000 7f7e0ae2a9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:01:02.945 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f7e0ae2a9c0 thread_name:radosgw-admin 2024-09-12T18:01:02.945 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.945 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:02.945 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7e0d583520] 2024-09-12T18:01:02.945 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T18:01:02.945 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T18:01:02.945 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T18:01:02.945 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7e0e704345] 2024-09-12T18:01:02.946 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7e0e70449f] 2024-09-12T18:01:02.946 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56080648d0c1] 2024-09-12T18:01:02.946 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x56080649e4f1] 2024-09-12T18:01:02.946 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56080649fb44] 2024-09-12T18:01:02.946 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T18:01:02.946 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7e0d56ad90] 2024-09-12T18:01:02.946 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T18:01:02.946 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T18:01:02.946 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:01:02.946 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:02.946 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T18:01:02.946 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T18:01:02.947 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T18:01:02.947 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T18:01:02.947 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T18:01:02.947 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T18:01:02.947 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T18:01:02.947 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T18:01:02.947 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T18:01:02.947 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T18:01:02.947 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T18:01:02.947 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T18:01:02.947 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T18:01:02.947 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T18:01:02.947 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T18:01:02.948 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T18:01:02.948 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T18:01:02.948 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T18:01:02.948 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T18:01:02.948 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T18:01:02.948 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T18:01:02.948 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T18:01:02.948 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T18:01:02.948 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T18:01:02.948 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:01:02.948 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T18:01:02.949 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T18:01:02.949 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T18:01:02.949 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T18:01:02.949 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T18:01:02.949 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T18:01:02.949 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T18:01:02.949 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T18:01:02.949 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T18:01:02.949 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T18:01:02.949 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T18:01:02.949 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T18:01:02.949 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T18:01:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T18:01:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T18:01:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T18:01:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T18:01:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T18:01:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T18:01:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T18:01:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T18:01:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:01:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T18:01:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:01:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T18:01:02.950 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T18:01:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T18:01:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T18:01:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T18:01:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T18:01:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T18:01:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T18:01:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T18:01:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T18:01:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T18:01:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T18:01:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T18:01:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T18:01:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T18:01:02.951 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T18:01:02.952 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T18:01:02.952 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T18:01:02.952 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:01:02.952 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T18:01:02.952 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:01:02.952 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T18:01:02.952 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T18:01:02.952 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T18:01:02.952 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T18:01:02.952 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T18:01:02.952 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T18:01:02.952 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:01:02.952 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T18:01:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T18:01:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:01:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T18:01:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T18:01:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T18:01:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T18:01:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T18:01:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T18:01:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T18:01:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T18:01:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T18:01:02.953 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T18:01:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T18:01:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T18:01:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T18:01:02.954 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:01:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7c2f7fe640 / http_manager 2024-09-12T18:01:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7cbdfe3640 / http_manager 2024-09-12T18:01:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7cbefe5640 / rgw_dt_lg_renew 2024-09-12T18:01:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7cde7fc640 / ms_dispatch 2024-09-12T18:01:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7cdffff640 / io_context_pool 2024-09-12T18:01:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7cee7fc640 / ms_dispatch 2024-09-12T18:01:02.954 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7cf560a640 / ms_dispatch 2024-09-12T18:01:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7cf6e0d640 / io_context_pool 2024-09-12T18:01:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7e0812f640 / msgr-worker-2 2024-09-12T18:01:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7e08930640 / msgr-worker-1 2024-09-12T18:01:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7e09131640 / msgr-worker-0 2024-09-12T18:01:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7e09932640 / io_context_pool 2024-09-12T18:01:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: 7f7e0ae2a9c0 / radosgw-admin 2024-09-12T18:01:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T18:01:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T18:01:02.955 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:01:02.818259Z_7646d4f0-9e5f-4b4b-9bb1-0e15df1b7ee9/log 2024-09-12T18:01:02.955 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T18:01:02.955 INFO:tasks.workunit.client.0.smithi098.stderr:Aborted 2024-09-12T18:01:02.955 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:01:02.960 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:02.960 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:02.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.896+0000 7f3c18f209c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.896+0000 7f3c18f209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.896+0000 7f3c18f209c0 20 realm 2024-09-12T18:01:02.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.896+0000 7f3c18f209c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.896+0000 7f3c18f209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.896+0000 7f3c18f209c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:02.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.896+0000 7f3c18f209c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.960 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.900+0000 7f3c18f209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.900+0000 7f3c18f209c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.900+0000 7f3c18f209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:02.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.900+0000 7f3c18f209c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.900+0000 7f3c18f209c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:02.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.900+0000 7f3c18f209c0 20 searching for the correct realm 2024-09-12T18:01:02.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.908+0000 7f3c16225640 0 -- 172.21.15.98:0/2391245314 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f3c0804a070 msgr2=0x7f3c08059920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:02.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.912+0000 7f3c16225640 0 -- 172.21.15.98:0/2391245314 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f3ae0081100 msgr2=0x7f3ae0083530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:02.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.920+0000 7f3c18f209c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:02.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.920+0000 7f3c18f209c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:01:02.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.920+0000 7f3c18f209c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:02.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.920+0000 7f3c18f209c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:01:02.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.920+0000 7f3c18f209c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:02.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.920+0000 7f3c18f209c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:02.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.920+0000 7f3c18f209c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.920+0000 7f3c18f209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.920+0000 7f3c18f209c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.920+0000 7f3c18f209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:02.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.920+0000 7f3c18f209c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.924+0000 7f3c18f209c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:02.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.924+0000 7f3c18f209c0 20 zone default found 2024-09-12T18:01:02.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.924+0000 7f3c18f209c0 4 Realm: () 2024-09-12T18:01:02.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.924+0000 7f3c18f209c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:01:02.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.924+0000 7f3c18f209c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:01:02.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.924+0000 7f3c18f209c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:02.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.924+0000 7f3c18f209c0 20 zonegroup default 2024-09-12T18:01:02.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.924+0000 7f3c18f209c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.924+0000 7f3c18f209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.924+0000 7f3c18f209c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.924+0000 7f3c18f209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.924+0000 7f3c18f209c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.924+0000 7f3c18f209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:02.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.924+0000 7f3c18f209c0 20 started sync module instance, tier type = 2024-09-12T18:01:02.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.924+0000 7f3c18f209c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:01:02.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.944+0000 7f3c18f209c0 20 add_watcher() i=0 2024-09-12T18:01:02.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.944+0000 7f3c18f209c0 20 add_watcher() i=1 2024-09-12T18:01:02.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.944+0000 7f3c18f209c0 20 add_watcher() i=2 2024-09-12T18:01:02.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.944+0000 7f3c18f209c0 20 add_watcher() i=3 2024-09-12T18:01:02.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.944+0000 7f3c18f209c0 20 add_watcher() i=4 2024-09-12T18:01:02.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.944+0000 7f3c18f209c0 20 add_watcher() i=5 2024-09-12T18:01:02.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.944+0000 7f3c18f209c0 20 add_watcher() i=6 2024-09-12T18:01:02.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.944+0000 7f3c18f209c0 20 add_watcher() i=7 2024-09-12T18:01:02.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.944+0000 7f3c18f209c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:02.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.948+0000 7f3acd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:02.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.948+0000 7f3c18f209c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:02.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.948+0000 7f3c18f209c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:02.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.948+0000 7f3c18f209c0 5 note: GC not initialized 2024-09-12T18:01:02.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.948+0000 7f3a47fff640 20 reqs_thread_entry: start 2024-09-12T18:01:02.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.948+0000 7f3c18f209c0 20 init_complete bucket index max shards: 11 2024-09-12T18:01:02.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.948+0000 7f3c18f209c0 20 Filter name: none 2024-09-12T18:01:02.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.948+0000 7f3a45ffb640 20 reqs_thread_entry: start 2024-09-12T18:01:02.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.948+0000 7f3c18f209c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.948+0000 7f3c18f209c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:02.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.948+0000 7f3c18f209c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.948+0000 7f3c18f209c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:01:02.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.948+0000 7f3c18f209c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:02.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.948+0000 7f3c18f209c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.952+0000 7f3c18f209c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:02.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.952+0000 7f3c18f209c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:02.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.952+0000 7f3c18f209c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:01:02.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.952+0000 7f3c18f209c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:02.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.956+0000 7f3acd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:02.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.964+0000 7f3c18f209c0 20 remove_watcher() i=0 2024-09-12T18:01:02.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.964+0000 7f3c18f209c0 2 removed watcher, disabling cache 2024-09-12T18:01:02.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.964+0000 7f3c18f209c0 20 remove_watcher() i=1 2024-09-12T18:01:02.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.968+0000 7f3c18f209c0 20 remove_watcher() i=2 2024-09-12T18:01:02.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.968+0000 7f3c18f209c0 20 remove_watcher() i=3 2024-09-12T18:01:02.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.972+0000 7f3c18f209c0 20 remove_watcher() i=4 2024-09-12T18:01:02.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.972+0000 7f3c18f209c0 20 remove_watcher() i=5 2024-09-12T18:01:02.974 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.972+0000 7f3c18f209c0 20 remove_watcher() i=6 2024-09-12T18:01:02.975 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:02.972+0000 7f3c18f209c0 20 remove_watcher() i=7 2024-09-12T18:01:02.990 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:01:02.990 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:01:03.036 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:01:03.062 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:03.062 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:03.104 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.104+0000 7f0e26fd29c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:03.105 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.104+0000 7f0e26fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:03.106 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.104+0000 7f0e26fd29c0 20 realm 2024-09-12T18:01:03.106 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.104+0000 7f0e26fd29c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:03.106 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.104+0000 7f0e26fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:03.106 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.104+0000 7f0e26fd29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:03.106 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.104+0000 7f0e26fd29c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:03.106 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.104+0000 7f0e26fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:03.106 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.104+0000 7f0e26fd29c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:03.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.108+0000 7f0e26fd29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:03.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.108+0000 7f0e26fd29c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:03.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.108+0000 7f0e26fd29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:03.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.108+0000 7f0e26fd29c0 20 searching for the correct realm 2024-09-12T18:01:03.111 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.112+0000 7f0e1ffff640 0 -- 172.21.15.98:0/1705392855 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f0e1800ebb0 msgr2=0x7f0e18087a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:03.328 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.328+0000 7f0e24ad8640 0 -- 172.21.15.98:0/1705392855 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f0e100ed420 msgr2=0x7f0e100ed8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:03.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.544+0000 7f0e26fd29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:03.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.544+0000 7f0e26fd29c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:01:03.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.544+0000 7f0e26fd29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:03.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.544+0000 7f0e26fd29c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:01:03.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.544+0000 7f0e26fd29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:03.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.544+0000 7f0e26fd29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:03.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.544+0000 7f0e26fd29c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:03.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.548+0000 7f0e26fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:03.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.548+0000 7f0e26fd29c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:03.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.548+0000 7f0e26fd29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:03.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.548+0000 7f0e26fd29c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:03.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.548+0000 7f0e26fd29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:03.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.548+0000 7f0e26fd29c0 20 zone default found 2024-09-12T18:01:03.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.548+0000 7f0e26fd29c0 4 Realm: () 2024-09-12T18:01:03.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.548+0000 7f0e26fd29c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:01:03.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.548+0000 7f0e26fd29c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:01:03.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.548+0000 7f0e26fd29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:03.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.548+0000 7f0e26fd29c0 20 zonegroup default 2024-09-12T18:01:03.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.548+0000 7f0e26fd29c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:03.551 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.548+0000 7f0e26fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:03.551 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.548+0000 7f0e26fd29c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:03.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.552+0000 7f0e26fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:03.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.552+0000 7f0e26fd29c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:03.553 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.552+0000 7f0e26fd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:03.553 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.552+0000 7f0e26fd29c0 20 started sync module instance, tier type = 2024-09-12T18:01:03.553 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.552+0000 7f0e26fd29c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:01:03.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.580+0000 7f0e26fd29c0 20 add_watcher() i=0 2024-09-12T18:01:03.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.580+0000 7f0e26fd29c0 20 add_watcher() i=1 2024-09-12T18:01:03.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.580+0000 7f0e26fd29c0 20 add_watcher() i=2 2024-09-12T18:01:03.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.580+0000 7f0e26fd29c0 20 add_watcher() i=3 2024-09-12T18:01:03.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.580+0000 7f0e26fd29c0 20 add_watcher() i=4 2024-09-12T18:01:03.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.580+0000 7f0e26fd29c0 20 add_watcher() i=5 2024-09-12T18:01:03.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.580+0000 7f0e26fd29c0 20 add_watcher() i=6 2024-09-12T18:01:03.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.580+0000 7f0e26fd29c0 20 add_watcher() i=7 2024-09-12T18:01:03.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.580+0000 7f0e26fd29c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:03.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.584+0000 7f0cdb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:03.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.588+0000 7f0e26fd29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:03.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.588+0000 7f0e26fd29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:03.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.588+0000 7f0e26fd29c0 5 note: GC not initialized 2024-09-12T18:01:03.588 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.588+0000 7f0cda7e4640 20 reqs_thread_entry: start 2024-09-12T18:01:03.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.588+0000 7f0e26fd29c0 20 init_complete bucket index max shards: 11 2024-09-12T18:01:03.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.588+0000 7f0e26fd29c0 20 Filter name: none 2024-09-12T18:01:03.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.588+0000 7f0cd3fff640 20 reqs_thread_entry: start 2024-09-12T18:01:03.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.588+0000 7f0e26fd29c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:01:03.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.588+0000 7f0e26fd29c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:03.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.588+0000 7f0e26fd29c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:03.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.588+0000 7f0e26fd29c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:01:03.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.588+0000 7f0e26fd29c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:01:03.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.588+0000 7f0e26fd29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T18:01:03.590 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.588+0000 7f0e26fd29c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:03.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.592+0000 7f0e26fd29c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:01:03.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.592+0000 7f0e26fd29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:03.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.592+0000 7f0e26fd29c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:03.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.592+0000 7f0e26fd29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:03.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.592+0000 7f0e26fd29c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:03.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.592+0000 7f0e26fd29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:01:03.592 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.592+0000 7f0e26fd29c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:01:03.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.592+0000 7f0e26fd29c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:01:03.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.592+0000 7f0e26fd29c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:01:03.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.592+0000 7f0e26fd29c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:01:03.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.592+0000 7f0e26fd29c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:01:03.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.592+0000 7f0e26fd29c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:01:03.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.592+0000 7f0e26fd29c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:01:03.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.592+0000 7f0e26fd29c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:01:03.595 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.592+0000 7f0e26fd29c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:01:03.595 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.592+0000 7f0e26fd29c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:01:03.596 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.596+0000 7f0e26fd29c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:01:03.596 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.596+0000 7f0e26fd29c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:01:03.597 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.596+0000 7f0e26fd29c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:01:03.597 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.596+0000 7f0e26fd29c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:01:03.598 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.596+0000 7f0e26fd29c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:01:03.598 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.596+0000 7f0e26fd29c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:01:03.599 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.596+0000 7f0e26fd29c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:01:03.599 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.596+0000 7f0e26fd29c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:01:03.600 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.600+0000 7f0e26fd29c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:01:03.600 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.600+0000 7f0e26fd29c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:01:03.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.600+0000 7f0e26fd29c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:01:03.601 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.600+0000 7f0e26fd29c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:01:03.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.600+0000 7f0e26fd29c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:01:03.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.600+0000 7f0e26fd29c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:01:03.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.600+0000 7f0e26fd29c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:01:03.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.600+0000 7f0e26fd29c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:01:03.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.604+0000 7f0cdb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:03.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.608+0000 7f0e26fd29c0 20 remove_watcher() i=0 2024-09-12T18:01:03.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.608+0000 7f0e26fd29c0 2 removed watcher, disabling cache 2024-09-12T18:01:03.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.612+0000 7f0e26fd29c0 20 remove_watcher() i=1 2024-09-12T18:01:03.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.612+0000 7f0e26fd29c0 20 remove_watcher() i=2 2024-09-12T18:01:03.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.616+0000 7f0e26fd29c0 20 remove_watcher() i=3 2024-09-12T18:01:03.621 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.620+0000 7f0e26fd29c0 20 remove_watcher() i=4 2024-09-12T18:01:03.623 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.620+0000 7f0e26fd29c0 20 remove_watcher() i=5 2024-09-12T18:01:03.624 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.624+0000 7f0e26fd29c0 20 remove_watcher() i=6 2024-09-12T18:01:03.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:03.624+0000 7f0e26fd29c0 20 remove_watcher() i=7 2024-09-12T18:01:33.671 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:01:33.702 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:33.703 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:33.748 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.747+0000 7f315f61a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.747+0000 7f315f61a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:33.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.747+0000 7f315f61a9c0 20 realm 2024-09-12T18:01:33.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.747+0000 7f315f61a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.747+0000 7f315f61a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:33.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.747+0000 7f315f61a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:33.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.747+0000 7f315f61a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.747+0000 7f315f61a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:33.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.747+0000 7f315f61a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.751+0000 7f315f61a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:33.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.751+0000 7f315f61a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.753 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.751+0000 7f315f61a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:33.753 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.751+0000 7f315f61a9c0 20 searching for the correct realm 2024-09-12T18:01:33.759 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.755+0000 7f315c91f640 0 -- 172.21.15.98:0/1149431584 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f31580de030 msgr2=0x7f31581017d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:33.765 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.763+0000 7f315c91f640 0 -- 172.21.15.98:0/1149431584 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f3028081100 msgr2=0x7f3028083530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:33.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:33.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:01:33.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:33.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:01:33.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:33.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:33.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:33.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:33.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:33.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 zone default found 2024-09-12T18:01:33.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 4 Realm: () 2024-09-12T18:01:33.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:01:33.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:01:33.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:33.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 zonegroup default 2024-09-12T18:01:33.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:33.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:33.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:33.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 started sync module instance, tier type = 2024-09-12T18:01:33.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.771+0000 7f315f61a9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:01:33.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.795+0000 7f315f61a9c0 20 add_watcher() i=0 2024-09-12T18:01:33.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.795+0000 7f315f61a9c0 20 add_watcher() i=1 2024-09-12T18:01:33.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.795+0000 7f315f61a9c0 20 add_watcher() i=2 2024-09-12T18:01:33.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.795+0000 7f315f61a9c0 20 add_watcher() i=3 2024-09-12T18:01:33.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.795+0000 7f315f61a9c0 20 add_watcher() i=4 2024-09-12T18:01:33.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.795+0000 7f315f61a9c0 20 add_watcher() i=5 2024-09-12T18:01:33.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.795+0000 7f315f61a9c0 20 add_watcher() i=6 2024-09-12T18:01:33.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.795+0000 7f315f61a9c0 20 add_watcher() i=7 2024-09-12T18:01:33.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.795+0000 7f315f61a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:33.800 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.799+0000 7f30137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:33.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.799+0000 7f315f61a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:33.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.799+0000 7f315f61a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:33.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.799+0000 7f315f61a9c0 5 note: GC not initialized 2024-09-12T18:01:33.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.799+0000 7f30127e4640 20 reqs_thread_entry: start 2024-09-12T18:01:33.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.799+0000 7f315f61a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:01:33.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.799+0000 7f315f61a9c0 20 Filter name: none 2024-09-12T18:01:33.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.799+0000 7f2f83fff640 20 reqs_thread_entry: start 2024-09-12T18:01:33.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.799+0000 7f315f61a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.799+0000 7f315f61a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:33.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.799+0000 7f315f61a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.799+0000 7f315f61a9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:01:33.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.799+0000 7f315f61a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:33.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.803+0000 7f315f61a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.803+0000 7f315f61a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:33.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.803+0000 7f315f61a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:33.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.803+0000 7f315f61a9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:01:33.805 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.803+0000 7f315f61a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:33.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.807+0000 7f30137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:33.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.815+0000 7f315f61a9c0 20 remove_watcher() i=0 2024-09-12T18:01:33.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.815+0000 7f315f61a9c0 2 removed watcher, disabling cache 2024-09-12T18:01:33.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.815+0000 7f315f61a9c0 20 remove_watcher() i=1 2024-09-12T18:01:33.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.819+0000 7f315f61a9c0 20 remove_watcher() i=2 2024-09-12T18:01:33.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.819+0000 7f315f61a9c0 20 remove_watcher() i=3 2024-09-12T18:01:33.824 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.823+0000 7f315f61a9c0 20 remove_watcher() i=4 2024-09-12T18:01:33.825 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.823+0000 7f315f61a9c0 20 remove_watcher() i=5 2024-09-12T18:01:33.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.823+0000 7f315f61a9c0 20 remove_watcher() i=6 2024-09-12T18:01:33.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:33.827+0000 7f315f61a9c0 20 remove_watcher() i=7 2024-09-12T18:01:33.843 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:01:33.843 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:01:33.969 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:01:34.001 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:34.002 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:34.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.047+0000 7f5bb9cbf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.047+0000 7f5bb9cbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.047+0000 7f5bb9cbf9c0 20 realm 2024-09-12T18:01:34.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.047+0000 7f5bb9cbf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.047+0000 7f5bb9cbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.047+0000 7f5bb9cbf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:34.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.047+0000 7f5bb9cbf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.047+0000 7f5bb9cbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.047+0000 7f5bb9cbf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.051+0000 7f5bb9cbf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:34.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.051+0000 7f5bb9cbf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.051+0000 7f5bb9cbf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:34.053 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.051+0000 7f5bb9cbf9c0 20 searching for the correct realm 2024-09-12T18:01:34.055 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.051+0000 7f5bb77c5640 0 -- 172.21.15.98:0/400286871 >> [v2:172.21.15.98:6816/1225764258,v1:172.21.15.98:6817/1225764258] conn(0x7f5bb0010040 msgr2=0x7f5bb0010420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:34.272 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.267+0000 7f5bb7fc6640 0 -- 172.21.15.98:0/400286871 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f5bac029040 msgr2=0x7f5bac064010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:34.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.287+0000 7f5bb9cbf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:34.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.287+0000 7f5bb9cbf9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:01:34.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.287+0000 7f5bb9cbf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:34.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.287+0000 7f5bb9cbf9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:01:34.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.287+0000 7f5bb9cbf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:34.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.287+0000 7f5bb9cbf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:34.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.287+0000 7f5bb9cbf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.287+0000 7f5bb9cbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.287+0000 7f5bb9cbf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.287+0000 7f5bb9cbf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:34.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.287+0000 7f5bb9cbf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.291+0000 7f5bb9cbf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:34.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.291+0000 7f5bb9cbf9c0 20 zone default found 2024-09-12T18:01:34.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.291+0000 7f5bb9cbf9c0 4 Realm: () 2024-09-12T18:01:34.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.291+0000 7f5bb9cbf9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:01:34.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.291+0000 7f5bb9cbf9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:01:34.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.291+0000 7f5bb9cbf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:34.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.291+0000 7f5bb9cbf9c0 20 zonegroup default 2024-09-12T18:01:34.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.291+0000 7f5bb9cbf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.291+0000 7f5bb9cbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.291+0000 7f5bb9cbf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.291+0000 7f5bb9cbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.291+0000 7f5bb9cbf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.291+0000 7f5bb9cbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.291+0000 7f5bb9cbf9c0 20 started sync module instance, tier type = 2024-09-12T18:01:34.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.291+0000 7f5bb9cbf9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:01:34.318 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.315+0000 7f5bb9cbf9c0 20 add_watcher() i=0 2024-09-12T18:01:34.318 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.315+0000 7f5bb9cbf9c0 20 add_watcher() i=1 2024-09-12T18:01:34.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.315+0000 7f5bb9cbf9c0 20 add_watcher() i=2 2024-09-12T18:01:34.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.315+0000 7f5bb9cbf9c0 20 add_watcher() i=3 2024-09-12T18:01:34.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.315+0000 7f5bb9cbf9c0 20 add_watcher() i=4 2024-09-12T18:01:34.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.315+0000 7f5bb9cbf9c0 20 add_watcher() i=5 2024-09-12T18:01:34.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.315+0000 7f5bb9cbf9c0 20 add_watcher() i=6 2024-09-12T18:01:34.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.319+0000 7f5bb9cbf9c0 20 add_watcher() i=7 2024-09-12T18:01:34.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.319+0000 7f5bb9cbf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:34.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.323+0000 7f5a6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:34.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.323+0000 7f5bb9cbf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:34.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.323+0000 7f5bb9cbf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:34.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.323+0000 7f5bb9cbf9c0 5 note: GC not initialized 2024-09-12T18:01:34.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.323+0000 7f5a6cfe1640 20 reqs_thread_entry: start 2024-09-12T18:01:34.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.323+0000 7f5bb9cbf9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:01:34.326 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.323+0000 7f5bb9cbf9c0 20 Filter name: none 2024-09-12T18:01:34.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.323+0000 7f59e67fc640 20 reqs_thread_entry: start 2024-09-12T18:01:34.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.323+0000 7f5bb9cbf9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:01:34.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.323+0000 7f5bb9cbf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.328 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.327+0000 7f5bb9cbf9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:34.328 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.327+0000 7f5bb9cbf9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:01:34.328 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.327+0000 7f5bb9cbf9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:01:34.328 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.327+0000 7f5bb9cbf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T18:01:34.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.327+0000 7f5bb9cbf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.327+0000 7f5bb9cbf9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:34.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.327+0000 7f5bb9cbf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:34.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.327+0000 7f5bb9cbf9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:34.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.327+0000 7f5bb9cbf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:34.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.327+0000 7f5bb9cbf9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:34.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.327+0000 7f5bb9cbf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:01:34.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.327+0000 7f5bb9cbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:01:34.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.327+0000 7f5bb9cbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:01:34.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.327+0000 7f5bb9cbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:01:34.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.327+0000 7f5bb9cbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:01:34.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.331+0000 7f5bb9cbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:01:34.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.331+0000 7f5bb9cbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:01:34.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.331+0000 7f5bb9cbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:01:34.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.331+0000 7f5bb9cbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:01:34.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.331+0000 7f5bb9cbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:01:34.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.331+0000 7f5bb9cbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:01:34.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.331+0000 7f5bb9cbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:01:34.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.331+0000 7f5bb9cbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:01:34.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.331+0000 7f5bb9cbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:01:34.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.331+0000 7f5bb9cbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:01:34.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.335+0000 7f5bb9cbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:01:34.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.335+0000 7f5bb9cbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:01:34.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.335+0000 7f5bb9cbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:01:34.337 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.335+0000 7f5bb9cbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:01:34.337 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.335+0000 7f5bb9cbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:01:34.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.335+0000 7f5bb9cbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:01:34.338 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.335+0000 7f5bb9cbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:01:34.339 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.335+0000 7f5bb9cbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:01:34.339 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.335+0000 7f5bb9cbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:01:34.340 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.335+0000 7f5bb9cbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:01:34.340 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.339+0000 7f5bb9cbf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:01:34.340 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.339+0000 7f5bb9cbf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:01:34.343 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.339+0000 7f5a6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:34.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.347+0000 7f5bb9cbf9c0 20 remove_watcher() i=0 2024-09-12T18:01:34.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.347+0000 7f5bb9cbf9c0 2 removed watcher, disabling cache 2024-09-12T18:01:34.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.347+0000 7f5bb9cbf9c0 20 remove_watcher() i=1 2024-09-12T18:01:34.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.351+0000 7f5bb9cbf9c0 20 remove_watcher() i=2 2024-09-12T18:01:34.355 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.351+0000 7f5bb9cbf9c0 20 remove_watcher() i=3 2024-09-12T18:01:34.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.355+0000 7f5bb9cbf9c0 20 remove_watcher() i=4 2024-09-12T18:01:34.358 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.355+0000 7f5bb9cbf9c0 20 remove_watcher() i=5 2024-09-12T18:01:34.360 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.359+0000 7f5bb9cbf9c0 20 remove_watcher() i=6 2024-09-12T18:01:34.361 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.359+0000 7f5bb9cbf9c0 20 remove_watcher() i=7 2024-09-12T18:01:34.385 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:01:34.417 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:34.418 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:34.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.643+0000 7fb6a623b640 0 --2- 172.21.15.98:0/2019976531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a0e2c0090 0x556a0e385010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T18:01:34.673 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.671+0000 7fb6a7f349c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.675 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.671+0000 7fb6a7f349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.675 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.671+0000 7fb6a7f349c0 20 realm 2024-09-12T18:01:34.675 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.671+0000 7fb6a7f349c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.671+0000 7fb6a7f349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.671+0000 7fb6a7f349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:34.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.671+0000 7fb6a7f349c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.675+0000 7fb6a7f349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:34.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.675+0000 7fb6a7f349c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.675+0000 7fb6a7f349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:34.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.675+0000 7fb6a7f349c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:34.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.675+0000 7fb6a7f349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:34.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.675+0000 7fb6a7f349c0 20 searching for the correct realm 2024-09-12T18:01:34.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.679+0000 7fb6a5239640 0 -- 172.21.15.98:0/3442816964 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fb6980ff360 msgr2=0x7fb6980f75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:34.897 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:34.895+0000 7fb6a5a3a640 0 -- 172.21.15.98:0/3442816964 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fb69c03e400 msgr2=0x7fb69c03e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:01:35.114 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.111+0000 7fb6a7f349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:35.115 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.111+0000 7fb6a7f349c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:01:35.115 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.111+0000 7fb6a7f349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:35.115 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.111+0000 7fb6a7f349c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:01:35.115 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.111+0000 7fb6a7f349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:35.115 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.111+0000 7fb6a7f349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:35.115 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.111+0000 7fb6a7f349c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.115 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.111+0000 7fb6a7f349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.115 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.111+0000 7fb6a7f349c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.116 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.115+0000 7fb6a7f349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:35.116 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.115+0000 7fb6a7f349c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.117 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.115+0000 7fb6a7f349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:35.117 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.115+0000 7fb6a7f349c0 20 zone default found 2024-09-12T18:01:35.117 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.115+0000 7fb6a7f349c0 4 Realm: () 2024-09-12T18:01:35.117 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.115+0000 7fb6a7f349c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:01:35.117 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.115+0000 7fb6a7f349c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:01:35.117 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.115+0000 7fb6a7f349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:35.117 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.115+0000 7fb6a7f349c0 20 zonegroup default 2024-09-12T18:01:35.117 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.115+0000 7fb6a7f349c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.115+0000 7fb6a7f349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.115+0000 7fb6a7f349c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.115+0000 7fb6a7f349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.115+0000 7fb6a7f349c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.115+0000 7fb6a7f349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.115+0000 7fb6a7f349c0 20 started sync module instance, tier type = 2024-09-12T18:01:35.119 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.115+0000 7fb6a7f349c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:01:35.141 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.139+0000 7fb6a7f349c0 20 add_watcher() i=0 2024-09-12T18:01:35.141 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.139+0000 7fb6a7f349c0 20 add_watcher() i=1 2024-09-12T18:01:35.141 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.139+0000 7fb6a7f349c0 20 add_watcher() i=2 2024-09-12T18:01:35.141 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.139+0000 7fb6a7f349c0 20 add_watcher() i=3 2024-09-12T18:01:35.141 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.139+0000 7fb6a7f349c0 20 add_watcher() i=4 2024-09-12T18:01:35.141 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.139+0000 7fb6a7f349c0 20 add_watcher() i=5 2024-09-12T18:01:35.142 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.139+0000 7fb6a7f349c0 20 add_watcher() i=6 2024-09-12T18:01:35.143 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.139+0000 7fb6a7f349c0 20 add_watcher() i=7 2024-09-12T18:01:35.143 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.139+0000 7fb6a7f349c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:35.147 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.143+0000 7fb5577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:35.148 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.147+0000 7fb6a7f349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:35.148 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.147+0000 7fb6a7f349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:35.148 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.147+0000 7fb6a7f349c0 5 note: GC not initialized 2024-09-12T18:01:35.148 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.147+0000 7fb5567fc640 20 reqs_thread_entry: start 2024-09-12T18:01:35.148 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.147+0000 7fb6a7f349c0 20 init_complete bucket index max shards: 11 2024-09-12T18:01:35.148 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.147+0000 7fb6a7f349c0 20 Filter name: none 2024-09-12T18:01:35.149 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.147+0000 7fb4c7fff640 20 reqs_thread_entry: start 2024-09-12T18:01:35.149 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.147+0000 7fb6a7f349c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.149 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.147+0000 7fb6a7f349c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:35.149 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.147+0000 7fb6a7f349c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.150 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.147+0000 7fb6a7f349c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:35.151 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.147+0000 7fb6a7f349c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:35.151 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.147+0000 7fb6a7f349c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.151 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.151+0000 7fb6a7f349c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:35.152 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.151+0000 7fb6a7f349c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.153 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.151+0000 7fb6a7f349c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:35.153 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.151+0000 7fb6a7f349c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:35.156 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.155+0000 7fb5577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:35.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.159+0000 7fb6a7f349c0 20 remove_watcher() i=0 2024-09-12T18:01:35.160 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.159+0000 7fb6a7f349c0 2 removed watcher, disabling cache 2024-09-12T18:01:35.162 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.159+0000 7fb6a7f349c0 20 remove_watcher() i=1 2024-09-12T18:01:35.164 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.163+0000 7fb6a7f349c0 20 remove_watcher() i=2 2024-09-12T18:01:35.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.163+0000 7fb6a7f349c0 20 remove_watcher() i=3 2024-09-12T18:01:35.168 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.167+0000 7fb6a7f349c0 20 remove_watcher() i=4 2024-09-12T18:01:35.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.167+0000 7fb6a7f349c0 20 remove_watcher() i=5 2024-09-12T18:01:35.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.167+0000 7fb6a7f349c0 20 remove_watcher() i=6 2024-09-12T18:01:35.173 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.171+0000 7fb6a7f349c0 20 remove_watcher() i=7 2024-09-12T18:01:35.189 INFO:tasks.workunit.client.0.smithi098.stderr: test: duplicated entries should be purged before reshard 2024-09-12T18:01:35.189 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:01:35.216 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:35.216 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:35.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.259+0000 7ff353f329c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.263 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.259+0000 7ff353f329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.263 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.259+0000 7ff353f329c0 20 realm 2024-09-12T18:01:35.263 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.259+0000 7ff353f329c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.264 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.263+0000 7ff353f329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.264 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.263+0000 7ff353f329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:35.264 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.263+0000 7ff353f329c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.264 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.263+0000 7ff353f329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.264 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.263+0000 7ff353f329c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.263+0000 7ff353f329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:35.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.263+0000 7ff353f329c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.263+0000 7ff353f329c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:35.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.263+0000 7ff353f329c0 20 searching for the correct realm 2024-09-12T18:01:35.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.267+0000 7ff351a38640 0 -- 172.21.15.98:0/396690680 >> [v2:172.21.15.98:6816/1225764258,v1:172.21.15.98:6817/1225764258] conn(0x7ff34c022020 msgr2=0x7ff34c05f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:35.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.271+0000 7ff351a38640 0 -- 172.21.15.98:0/396690680 >> [v2:172.21.15.98:6816/1225764258,v1:172.21.15.98:6817/1225764258] conn(0x7ff21c081180 msgr2=0x7ff21c0835b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:35.285 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:35.285 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:01:35.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:35.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:01:35.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:35.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:35.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:35.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:35.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 20 zone default found 2024-09-12T18:01:35.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 4 Realm: () 2024-09-12T18:01:35.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:01:35.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:01:35.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:35.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 20 zonegroup default 2024-09-12T18:01:35.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.283+0000 7ff353f329c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.287+0000 7ff353f329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.287+0000 7ff353f329c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.287+0000 7ff353f329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.287+0000 7ff353f329c0 20 started sync module instance, tier type = 2024-09-12T18:01:35.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.287+0000 7ff353f329c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:01:35.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.303+0000 7ff353f329c0 20 add_watcher() i=0 2024-09-12T18:01:35.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.303+0000 7ff353f329c0 20 add_watcher() i=1 2024-09-12T18:01:35.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.303+0000 7ff353f329c0 20 add_watcher() i=2 2024-09-12T18:01:35.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.303+0000 7ff353f329c0 20 add_watcher() i=3 2024-09-12T18:01:35.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.303+0000 7ff353f329c0 20 add_watcher() i=4 2024-09-12T18:01:35.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.303+0000 7ff353f329c0 20 add_watcher() i=5 2024-09-12T18:01:35.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.303+0000 7ff353f329c0 20 add_watcher() i=6 2024-09-12T18:01:35.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.303+0000 7ff353f329c0 20 add_watcher() i=7 2024-09-12T18:01:35.305 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.303+0000 7ff353f329c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:35.308 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.307+0000 7ff2037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:35.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.307+0000 7ff353f329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:35.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.307+0000 7ff353f329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:35.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.307+0000 7ff353f329c0 5 note: GC not initialized 2024-09-12T18:01:35.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.307+0000 7ff2027fc640 20 reqs_thread_entry: start 2024-09-12T18:01:35.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.307+0000 7ff353f329c0 20 init_complete bucket index max shards: 11 2024-09-12T18:01:35.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.307+0000 7ff353f329c0 20 Filter name: none 2024-09-12T18:01:35.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.307+0000 7ff173fff640 20 reqs_thread_entry: start 2024-09-12T18:01:35.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.307+0000 7ff353f329c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.307+0000 7ff353f329c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:35.310 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.307+0000 7ff353f329c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.307+0000 7ff353f329c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:35.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.307+0000 7ff353f329c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:35.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.307+0000 7ff353f329c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.312 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.311+0000 7ff353f329c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:35.312 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.311+0000 7ff353f329c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.311+0000 7ff353f329c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:35.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.311+0000 7ff353f329c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:35.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.311+0000 7ff2037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:35.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.319+0000 7ff353f329c0 20 remove_watcher() i=0 2024-09-12T18:01:35.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.319+0000 7ff353f329c0 2 removed watcher, disabling cache 2024-09-12T18:01:35.322 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.319+0000 7ff353f329c0 20 remove_watcher() i=1 2024-09-12T18:01:35.324 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.323+0000 7ff353f329c0 20 remove_watcher() i=2 2024-09-12T18:01:35.325 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.323+0000 7ff353f329c0 20 remove_watcher() i=3 2024-09-12T18:01:35.327 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.327+0000 7ff353f329c0 20 remove_watcher() i=4 2024-09-12T18:01:35.329 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.327+0000 7ff353f329c0 20 remove_watcher() i=5 2024-09-12T18:01:35.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.327+0000 7ff353f329c0 20 remove_watcher() i=6 2024-09-12T18:01:35.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.327+0000 7ff353f329c0 20 remove_watcher() i=7 2024-09-12T18:01:35.344 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.345 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T18:01:35.345 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: a-bucket id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-12T18:01:35.345 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.345 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T18:01:35.377 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:35.377 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:35.420 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 realm 2024-09-12T18:01:35.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.419+0000 7f465b1ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:35.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.423 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:35.424 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.424 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.423+0000 7f465b1ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:35.424 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.423+0000 7f465b1ec9c0 20 searching for the correct realm 2024-09-12T18:01:35.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.427+0000 7f4653fff640 0 -- 172.21.15.98:0/822975416 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f464c024040 msgr2=0x7f464c08fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:35.437 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.435+0000 7f46594f3640 0 -- 172.21.15.98:0/822975416 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f4644102220 msgr2=0x7f4644103800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:35.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:35.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:01:35.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:35.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:01:35.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:35.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:35.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.443 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:35.444 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:35.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 zone default found 2024-09-12T18:01:35.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.443+0000 7f465b1ec9c0 4 Realm: () 2024-09-12T18:01:35.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.443+0000 7f465b1ec9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:01:35.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.443+0000 7f465b1ec9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:01:35.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.443+0000 7f465b1ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:35.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 zonegroup default 2024-09-12T18:01:35.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.445 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 started sync module instance, tier type = 2024-09-12T18:01:35.446 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:01:35.460 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=0 2024-09-12T18:01:35.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=1 2024-09-12T18:01:35.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=2 2024-09-12T18:01:35.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=3 2024-09-12T18:01:35.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=4 2024-09-12T18:01:35.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=5 2024-09-12T18:01:35.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=6 2024-09-12T18:01:35.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=7 2024-09-12T18:01:35.461 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.459+0000 7f465b1ec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:35.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f450dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:35.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:35.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:35.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 note: GC not initialized 2024-09-12T18:01:35.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f450cfe1640 20 reqs_thread_entry: start 2024-09-12T18:01:35.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:01:35.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 Filter name: none 2024-09-12T18:01:35.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f44867fc640 20 reqs_thread_entry: start 2024-09-12T18:01:35.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:01:35.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:35.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:01:35.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:01:35.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T18:01:35.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:35.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:35.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:35.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:35.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:35.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:01:35.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.475+0000 7f465b1ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:35.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.475+0000 7f465b1ec9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:35.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.475+0000 7f465b1ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:35.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.475+0000 7f465b1ec9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T18:01:35.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.475+0000 7f45367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366220 cookie 94764458422816 notifier 8355 bl.length()=827 2024-09-12T18:01:35.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.475+0000 7f45367fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:35.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.475+0000 7f45367fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:35.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.475+0000 7f45367fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:35.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.475+0000 7f465b1ec9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T18:01:35.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.475+0000 7f465b1ec9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T18:01:35.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.475+0000 7f465b1ec9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T18:01:35.479 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.475+0000 7f465b1ec9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T18:01:35.491 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f465b1ec9c0 time 2024-09-12T18:01:35.492068+0000 2024-09-12T18:01:35.491 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:01:35.492 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:35.492 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f465eac62eb] 2024-09-12T18:01:35.492 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f465eac649f] 2024-09-12T18:01:35.493 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56301053b0c1] 2024-09-12T18:01:35.493 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56301054d1fa] 2024-09-12T18:01:35.493 INFO:tasks.workunit.client.0.smithi098.stderr: 5: main() 2024-09-12T18:01:35.493 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f465d92cd90] 2024-09-12T18:01:35.493 INFO:tasks.workunit.client.0.smithi098.stderr: 7: __libc_start_main() 2024-09-12T18:01:35.493 INFO:tasks.workunit.client.0.smithi098.stderr: 8: _start() 2024-09-12T18:01:35.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.491+0000 7f465b1ec9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f465b1ec9c0 time 2024-09-12T18:01:35.492068+0000 2024-09-12T18:01:35.493 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:01:35.493 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.493 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:35.493 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f465eac62eb] 2024-09-12T18:01:35.494 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f465eac649f] 2024-09-12T18:01:35.494 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56301053b0c1] 2024-09-12T18:01:35.494 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56301054d1fa] 2024-09-12T18:01:35.494 INFO:tasks.workunit.client.0.smithi098.stderr: 5: main() 2024-09-12T18:01:35.494 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f465d92cd90] 2024-09-12T18:01:35.494 INFO:tasks.workunit.client.0.smithi098.stderr: 7: __libc_start_main() 2024-09-12T18:01:35.494 INFO:tasks.workunit.client.0.smithi098.stderr: 8: _start() 2024-09-12T18:01:35.494 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.494 INFO:tasks.workunit.client.0.smithi098.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:01:35.494 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f465b1ec9c0 thread_name:radosgw-admin 2024-09-12T18:01:35.516 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:35.516 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f465d945520] 2024-09-12T18:01:35.516 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T18:01:35.516 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T18:01:35.516 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T18:01:35.516 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f465eac6345] 2024-09-12T18:01:35.516 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f465eac649f] 2024-09-12T18:01:35.516 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56301053b0c1] 2024-09-12T18:01:35.516 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56301054d1fa] 2024-09-12T18:01:35.516 INFO:tasks.workunit.client.0.smithi098.stderr: 9: main() 2024-09-12T18:01:35.517 INFO:tasks.workunit.client.0.smithi098.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f465d92cd90] 2024-09-12T18:01:35.517 INFO:tasks.workunit.client.0.smithi098.stderr: 11: __libc_start_main() 2024-09-12T18:01:35.517 INFO:tasks.workunit.client.0.smithi098.stderr: 12: _start() 2024-09-12T18:01:35.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.491+0000 7f465b1ec9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:01:35.517 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f465b1ec9c0 thread_name:radosgw-admin 2024-09-12T18:01:35.517 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.517 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:35.517 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f465d945520] 2024-09-12T18:01:35.517 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T18:01:35.517 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T18:01:35.517 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T18:01:35.517 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f465eac6345] 2024-09-12T18:01:35.517 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f465eac649f] 2024-09-12T18:01:35.517 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56301053b0c1] 2024-09-12T18:01:35.518 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56301054d1fa] 2024-09-12T18:01:35.518 INFO:tasks.workunit.client.0.smithi098.stderr: 9: main() 2024-09-12T18:01:35.518 INFO:tasks.workunit.client.0.smithi098.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f465d92cd90] 2024-09-12T18:01:35.518 INFO:tasks.workunit.client.0.smithi098.stderr: 11: __libc_start_main() 2024-09-12T18:01:35.518 INFO:tasks.workunit.client.0.smithi098.stderr: 12: _start() 2024-09-12T18:01:35.518 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:01:35.518 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.518 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T18:01:35.518 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T18:01:35.395+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:35.518 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T18:01:35.395+0000 7f4658cf2640 10 monclient(hunting): handle_auth_done global_id 7682 payload 274 2024-09-12T18:01:35.518 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T18:01:35.395+0000 7f4658cf2640 10 monclient: _finish_hunting 0 2024-09-12T18:01:35.518 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T18:01:35.395+0000 7f4658cf2640 1 monclient: found mon.noname-c 2024-09-12T18:01:35.518 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T18:01:35.395+0000 7f4658cf2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:01:35.518 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T18:01:35.395+0000 7f46594f3640 10 monclient: get_auth_request con 0x563011d52140 auth_method 0 2024-09-12T18:01:35.519 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T18:01:35.395+0000 7f4545e13640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:35.519 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T18:01:35.395+0000 7f4545e13640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:01:35.519 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T18:01:35.395+0000 7f4545e13640 10 monclient: dump: 2024-09-12T18:01:35.519 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:35.519 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:35.519 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.519 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.519 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:35.519 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.519 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:35.519 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:35.519 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:35.519 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.519 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T18:01:35.395+0000 7f4545e13640 10 monclient: _finish_auth 0 2024-09-12T18:01:35.520 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T18:01:35.395+0000 7f4545e13640 10 monclient: _check_auth_tickets 2024-09-12T18:01:35.520 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T18:01:35.395+0000 7f4545e13640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:35.520 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T18:01:35.395+0000 7f4545e13640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:35.520 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T18:01:35.395+0000 7f4545e13640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:01:35.520 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T18:01:35.395+0000 7f4545e13640 10 monclient: dump: 2024-09-12T18:01:35.520 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:35.520 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:35.520 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.520 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.520 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:35.520 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.520 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:35.520 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:35.520 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:35.521 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.521 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T18:01:35.395+0000 7f465b1ec9c0 5 monclient: authenticate success, global_id 7682 2024-09-12T18:01:35.521 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T18:01:35.395+0000 7f465b1ec9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:01:35.521 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T18:01:35.395+0000 7f465b1ec9c0 4 set_mon_vals no callback set 2024-09-12T18:01:35.521 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T18:01:35.395+0000 7f465b1ec9c0 10 monclient: shutdown 2024-09-12T18:01:35.521 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T18:01:35.395+0000 7f465b1ec9c0 5 asok(0x563011b162b0) unregister_commands rotate-key 2024-09-12T18:01:35.521 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient: build_initial_monmap 2024-09-12T18:01:35.521 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:35.521 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient: monmap: 2024-09-12T18:01:35.521 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:01:35.521 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:35.521 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:01:35.521 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:01:35.521 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:35.522 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.522 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:01:35.522 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:01:35.522 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:01:35.522 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.522 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding auth protocol: cephx 2024-09-12T18:01:35.522 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding auth protocol: cephx 2024-09-12T18:01:35.522 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding auth protocol: cephx 2024-09-12T18:01:35.522 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: secure 2024-09-12T18:01:35.522 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: crc 2024-09-12T18:01:35.522 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: secure 2024-09-12T18:01:35.522 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: crc 2024-09-12T18:01:35.522 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: secure 2024-09-12T18:01:35.522 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: crc 2024-09-12T18:01:35.523 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: crc 2024-09-12T18:01:35.523 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: secure 2024-09-12T18:01:35.523 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: crc 2024-09-12T18:01:35.523 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: secure 2024-09-12T18:01:35.523 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: crc 2024-09-12T18:01:35.523 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: secure 2024-09-12T18:01:35.523 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.523 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 1 librados: starting msgr at 2024-09-12T18:01:35.523 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 1 librados: starting objecter 2024-09-12T18:01:35.523 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command objecter_requests hook 0x563011d23460 2024-09-12T18:01:35.523 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 1 librados: setting wanted keys 2024-09-12T18:01:35.523 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 1 librados: calling monclient init 2024-09-12T18:01:35.523 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient: init 2024-09-12T18:01:35.523 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding auth protocol: cephx 2024-09-12T18:01:35.524 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding auth protocol: cephx 2024-09-12T18:01:35.524 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding auth protocol: cephx 2024-09-12T18:01:35.524 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: secure 2024-09-12T18:01:35.524 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: crc 2024-09-12T18:01:35.524 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: secure 2024-09-12T18:01:35.524 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: crc 2024-09-12T18:01:35.524 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: secure 2024-09-12T18:01:35.524 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: crc 2024-09-12T18:01:35.524 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: crc 2024-09-12T18:01:35.524 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: secure 2024-09-12T18:01:35.524 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: crc 2024-09-12T18:01:35.524 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: secure 2024-09-12T18:01:35.524 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: crc 2024-09-12T18:01:35.524 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: secure 2024-09-12T18:01:35.525 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.525 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.525 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command rotate-key hook 0x563011d21788 2024-09-12T18:01:35.525 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:35.525 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:01:35.525 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-b con 0x563011bd1360 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:01:35.525 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-a con 0x563011be0aa0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:01:35.525 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-c con 0x563011d52140 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:01:35.525 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.525 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.525 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.525 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:35.525 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient(hunting): authenticate will time out at 2891.969294s 2024-09-12T18:01:35.526 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T18:01:35.399+0000 7f46594f3640 10 monclient(hunting): get_auth_request con 0x563011d52140 auth_method 0 2024-09-12T18:01:35.526 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T18:01:35.399+0000 7f46594f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:35.526 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T18:01:35.399+0000 7f46594f3640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:35.526 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T18:01:35.399+0000 7f46594f3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:35.526 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T18:01:35.399+0000 7f4653fff640 10 monclient(hunting): get_auth_request con 0x563011be0aa0 auth_method 0 2024-09-12T18:01:35.526 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T18:01:35.399+0000 7f4653fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:35.526 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T18:01:35.399+0000 7f4653fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:35.526 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T18:01:35.399+0000 7f4653fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:35.526 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T18:01:35.399+0000 7f46594f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:35.526 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T18:01:35.399+0000 7f46594f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:35.526 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T18:01:35.399+0000 7f46594f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:35.526 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T18:01:35.399+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:35.526 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T18:01:35.399+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:35.526 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T18:01:35.399+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:35.527 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T18:01:35.399+0000 7f46594f3640 10 monclient(hunting): handle_auth_done global_id 7685 payload 824 2024-09-12T18:01:35.527 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T18:01:35.399+0000 7f46594f3640 10 monclient: _finish_hunting 0 2024-09-12T18:01:35.527 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T18:01:35.399+0000 7f46594f3640 1 monclient: found mon.noname-c 2024-09-12T18:01:35.527 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T18:01:35.399+0000 7f46594f3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:01:35.527 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T18:01:35.399+0000 7f453ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:35.527 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T18:01:35.399+0000 7f453ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:01:35.527 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T18:01:35.399+0000 7f453ffff640 10 monclient: dump: 2024-09-12T18:01:35.527 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:35.527 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:35.527 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.527 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.527 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:35.527 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.527 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:35.527 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:35.528 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:35.528 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.528 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T18:01:35.399+0000 7f453ffff640 10 monclient: _finish_auth 0 2024-09-12T18:01:35.528 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T18:01:35.399+0000 7f453ffff640 10 monclient: _check_auth_tickets 2024-09-12T18:01:35.528 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T18:01:35.399+0000 7f453ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:35.528 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T18:01:35.399+0000 7f453ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:35.528 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T18:01:35.399+0000 7f453ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:01:35.528 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T18:01:35.399+0000 7f453ffff640 10 monclient: dump: 2024-09-12T18:01:35.528 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:35.528 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:35.528 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.528 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.528 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:35.528 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.529 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:35.529 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:35.529 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:35.529 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.529 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 monclient: authenticate success, global_id 7685 2024-09-12T18:01:35.529 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T18:01:35.399+0000 7f4545e13640 4 set_mon_vals no callback set 2024-09-12T18:01:35.529 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient: _renew_subs 2024-09-12T18:01:35.529 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:01:35.529 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient: _renew_subs 2024-09-12T18:01:35.529 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:01:35.529 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 1 librados: init done 2024-09-12T18:01:35.529 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T18:01:35.403+0000 7f453ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:35.529 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T18:01:35.403+0000 7f453ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:35.529 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T18:01:35.403+0000 7f453ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:35.530 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T18:01:35.403+0000 7f4658cf2640 10 monclient: get_auth_request con 0x7f4540070ae0 auth_method 0 2024-09-12T18:01:35.530 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T18:01:35.403+0000 7f4653fff640 10 monclient: get_auth_request con 0x563011d4c260 auth_method 0 2024-09-12T18:01:35.530 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T18:01:35.403+0000 7f4658cf2640 10 monclient: get_auth_request con 0x563011d6c310 auth_method 0 2024-09-12T18:01:35.530 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient: get_auth_request con 0x563011d716f0 auth_method 0 2024-09-12T18:01:35.530 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient: build_initial_monmap 2024-09-12T18:01:35.530 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:35.530 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient: monmap: 2024-09-12T18:01:35.530 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:01:35.530 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:35.530 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:01:35.530 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:01:35.530 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:35.530 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.530 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:01:35.531 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:01:35.531 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:01:35.531 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.531 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding auth protocol: cephx 2024-09-12T18:01:35.531 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding auth protocol: cephx 2024-09-12T18:01:35.531 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding auth protocol: cephx 2024-09-12T18:01:35.531 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: secure 2024-09-12T18:01:35.531 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: crc 2024-09-12T18:01:35.531 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: secure 2024-09-12T18:01:35.531 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: crc 2024-09-12T18:01:35.531 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: secure 2024-09-12T18:01:35.531 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: crc 2024-09-12T18:01:35.531 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: crc 2024-09-12T18:01:35.531 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: secure 2024-09-12T18:01:35.532 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: crc 2024-09-12T18:01:35.532 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: secure 2024-09-12T18:01:35.532 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: crc 2024-09-12T18:01:35.532 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: secure 2024-09-12T18:01:35.532 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.532 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command objecter_requests cmddesc objecter_requests hook 0x563011d79100 EEXIST 2024-09-12T18:01:35.532 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient: init 2024-09-12T18:01:35.532 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding auth protocol: cephx 2024-09-12T18:01:35.532 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding auth protocol: cephx 2024-09-12T18:01:35.532 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding auth protocol: cephx 2024-09-12T18:01:35.532 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: secure 2024-09-12T18:01:35.532 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: crc 2024-09-12T18:01:35.532 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: secure 2024-09-12T18:01:35.532 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: crc 2024-09-12T18:01:35.533 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: secure 2024-09-12T18:01:35.533 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: crc 2024-09-12T18:01:35.533 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: crc 2024-09-12T18:01:35.533 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: secure 2024-09-12T18:01:35.533 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: crc 2024-09-12T18:01:35.533 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: secure 2024-09-12T18:01:35.533 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: crc 2024-09-12T18:01:35.533 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: secure 2024-09-12T18:01:35.533 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.533 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.533 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command rotate-key cmddesc rotate-key hook 0x563011d74890 EEXIST 2024-09-12T18:01:35.533 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:35.533 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:01:35.533 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-b con 0x563011d9d2b0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:01:35.534 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-a con 0x563011d9cbe0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:01:35.534 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-c con 0x563011d9b5c0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:01:35.534 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.534 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.534 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.534 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:35.534 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient(hunting): authenticate will time out at 2891.979112s 2024-09-12T18:01:35.534 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient(hunting): get_auth_request con 0x563011d9cbe0 auth_method 0 2024-09-12T18:01:35.534 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:35.534 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:35.534 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:35.534 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T18:01:35.407+0000 7f46594f3640 10 monclient(hunting): get_auth_request con 0x563011d9b5c0 auth_method 0 2024-09-12T18:01:35.534 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T18:01:35.407+0000 7f46594f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:35.534 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T18:01:35.407+0000 7f46594f3640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:35.535 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T18:01:35.407+0000 7f46594f3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:35.535 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:35.535 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:35.535 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:35.535 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T18:01:35.407+0000 7f46594f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:35.535 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T18:01:35.407+0000 7f46594f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:35.535 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T18:01:35.407+0000 7f46594f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:35.535 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient(hunting): handle_auth_done global_id 8349 payload 824 2024-09-12T18:01:35.535 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient: _finish_hunting 0 2024-09-12T18:01:35.535 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T18:01:35.407+0000 7f4653fff640 1 monclient: found mon.noname-a 2024-09-12T18:01:35.535 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T18:01:35.535 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T18:01:35.407+0000 7f453d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:35.535 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T18:01:35.407+0000 7f453d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:01:35.535 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T18:01:35.407+0000 7f453d7fa640 10 monclient: dump: 2024-09-12T18:01:35.535 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:35.536 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:35.536 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.536 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.536 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:35.536 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.536 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:35.536 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:35.536 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:35.536 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.536 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T18:01:35.407+0000 7f453d7fa640 10 monclient: _finish_auth 0 2024-09-12T18:01:35.536 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T18:01:35.407+0000 7f453d7fa640 10 monclient: _check_auth_tickets 2024-09-12T18:01:35.536 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T18:01:35.407+0000 7f453d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:35.536 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T18:01:35.407+0000 7f453d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:35.537 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T18:01:35.407+0000 7f453d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:35.537 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T18:01:35.407+0000 7f453d7fa640 10 monclient: dump: 2024-09-12T18:01:35.537 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:35.537 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:35.537 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.537 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.537 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:35.537 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.537 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:35.537 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:35.537 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:35.537 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.537 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 monclient: authenticate success, global_id 8349 2024-09-12T18:01:35.537 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T18:01:35.407+0000 7f4659cf4640 4 set_mon_vals no callback set 2024-09-12T18:01:35.538 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient: _renew_subs 2024-09-12T18:01:35.538 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:01:35.538 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient: _renew_subs 2024-09-12T18:01:35.538 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:01:35.538 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T18:01:35.411+0000 7f453d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:35.538 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T18:01:35.411+0000 7f453d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:35.538 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T18:01:35.411+0000 7f453d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:35.538 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient: get_monmap_and_config 2024-09-12T18:01:35.538 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient: build_initial_monmap 2024-09-12T18:01:35.538 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:35.538 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient: monmap: 2024-09-12T18:01:35.538 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:01:35.538 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:35.538 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:01:35.538 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:01:35.539 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:35.539 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.539 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:01:35.539 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:01:35.539 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:01:35.539 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.539 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding auth protocol: cephx 2024-09-12T18:01:35.539 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding auth protocol: cephx 2024-09-12T18:01:35.539 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding auth protocol: cephx 2024-09-12T18:01:35.539 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: secure 2024-09-12T18:01:35.539 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient: get_auth_request con 0x7f4530070a20 auth_method 0 2024-09-12T18:01:35.539 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: crc 2024-09-12T18:01:35.539 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: secure 2024-09-12T18:01:35.539 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: crc 2024-09-12T18:01:35.540 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: secure 2024-09-12T18:01:35.540 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: crc 2024-09-12T18:01:35.540 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: crc 2024-09-12T18:01:35.540 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: secure 2024-09-12T18:01:35.540 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: crc 2024-09-12T18:01:35.540 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: secure 2024-09-12T18:01:35.540 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: crc 2024-09-12T18:01:35.540 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: secure 2024-09-12T18:01:35.540 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.540 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient: init 2024-09-12T18:01:35.540 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding auth protocol: cephx 2024-09-12T18:01:35.540 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding auth protocol: cephx 2024-09-12T18:01:35.540 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding auth protocol: cephx 2024-09-12T18:01:35.540 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: secure 2024-09-12T18:01:35.541 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: crc 2024-09-12T18:01:35.541 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: secure 2024-09-12T18:01:35.541 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: crc 2024-09-12T18:01:35.541 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: secure 2024-09-12T18:01:35.541 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: crc 2024-09-12T18:01:35.541 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: crc 2024-09-12T18:01:35.541 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: secure 2024-09-12T18:01:35.541 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: crc 2024-09-12T18:01:35.541 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: secure 2024-09-12T18:01:35.541 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: crc 2024-09-12T18:01:35.541 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: secure 2024-09-12T18:01:35.541 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.541 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.541 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc3e14e428 EEXIST 2024-09-12T18:01:35.542 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:35.542 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:01:35.542 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-a con 0x563011dc0c20 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:01:35.542 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-c con 0x563011df0e40 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:01:35.542 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-b con 0x563011decb50 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:01:35.542 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.542 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.542 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.542 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:35.542 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient(hunting): authenticate will time out at 2891.983383s 2024-09-12T18:01:35.542 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient(hunting): get_auth_request con 0x563011dc0c20 auth_method 0 2024-09-12T18:01:35.542 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:35.542 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:35.542 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:35.543 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T18:01:35.411+0000 7f4653fff640 10 monclient(hunting): get_auth_request con 0x563011df0e40 auth_method 0 2024-09-12T18:01:35.543 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T18:01:35.411+0000 7f4653fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:35.543 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T18:01:35.411+0000 7f4653fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:35.543 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T18:01:35.411+0000 7f4653fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:35.543 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:35.543 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:35.543 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:35.543 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T18:01:35.411+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:35.543 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T18:01:35.411+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:35.543 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T18:01:35.411+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:35.543 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T18:01:35.411+0000 7f46594f3640 10 monclient(hunting): get_auth_request con 0x563011decb50 auth_method 0 2024-09-12T18:01:35.543 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T18:01:35.411+0000 7f46594f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:35.543 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T18:01:35.411+0000 7f46594f3640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:35.543 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T18:01:35.411+0000 7f46594f3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:35.543 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient(hunting): handle_auth_done global_id 8352 payload 274 2024-09-12T18:01:35.544 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient: _finish_hunting 0 2024-09-12T18:01:35.544 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T18:01:35.411+0000 7f4658cf2640 1 monclient: found mon.noname-a 2024-09-12T18:01:35.544 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T18:01:35.544 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T18:01:35.415+0000 7f4536ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:35.544 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T18:01:35.415+0000 7f4536ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:01:35.544 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T18:01:35.415+0000 7f4536ffd640 10 monclient: dump: 2024-09-12T18:01:35.544 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:35.544 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:35.544 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.544 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.544 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:35.544 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.544 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:35.545 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:35.545 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:35.545 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.545 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T18:01:35.415+0000 7f4536ffd640 10 monclient: _finish_auth 0 2024-09-12T18:01:35.545 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T18:01:35.415+0000 7f4536ffd640 10 monclient: _check_auth_tickets 2024-09-12T18:01:35.545 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T18:01:35.415+0000 7f4536ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:35.545 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T18:01:35.415+0000 7f4536ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:35.545 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T18:01:35.415+0000 7f4536ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:35.545 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T18:01:35.415+0000 7f4536ffd640 10 monclient: dump: 2024-09-12T18:01:35.545 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:35.545 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:35.545 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.545 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.545 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:35.545 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.546 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:35.546 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:35.546 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:35.546 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.546 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 monclient: authenticate success, global_id 8352 2024-09-12T18:01:35.546 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:01:35.546 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 4 set_mon_vals no callback set 2024-09-12T18:01:35.546 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: shutdown 2024-09-12T18:01:35.546 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: build_initial_monmap 2024-09-12T18:01:35.546 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:35.546 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: monmap: 2024-09-12T18:01:35.546 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:01:35.546 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:35.546 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:01:35.547 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:01:35.547 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:35.547 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.547 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:01:35.547 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:01:35.547 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:01:35.547 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.547 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding auth protocol: cephx 2024-09-12T18:01:35.547 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding auth protocol: cephx 2024-09-12T18:01:35.547 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding auth protocol: cephx 2024-09-12T18:01:35.547 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: secure 2024-09-12T18:01:35.547 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: crc 2024-09-12T18:01:35.547 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: secure 2024-09-12T18:01:35.547 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: crc 2024-09-12T18:01:35.548 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: secure 2024-09-12T18:01:35.548 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: crc 2024-09-12T18:01:35.548 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: crc 2024-09-12T18:01:35.548 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: secure 2024-09-12T18:01:35.548 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: crc 2024-09-12T18:01:35.548 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: secure 2024-09-12T18:01:35.548 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: crc 2024-09-12T18:01:35.548 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: secure 2024-09-12T18:01:35.548 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.548 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 1 librados: starting msgr at 2024-09-12T18:01:35.548 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 1 librados: starting objecter 2024-09-12T18:01:35.548 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command objecter_requests cmddesc objecter_requests hook 0x563011dbee70 EEXIST 2024-09-12T18:01:35.548 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 1 librados: setting wanted keys 2024-09-12T18:01:35.548 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 1 librados: calling monclient init 2024-09-12T18:01:35.549 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: init 2024-09-12T18:01:35.549 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding auth protocol: cephx 2024-09-12T18:01:35.549 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding auth protocol: cephx 2024-09-12T18:01:35.549 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding auth protocol: cephx 2024-09-12T18:01:35.549 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: secure 2024-09-12T18:01:35.549 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: crc 2024-09-12T18:01:35.549 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: secure 2024-09-12T18:01:35.549 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: crc 2024-09-12T18:01:35.549 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: secure 2024-09-12T18:01:35.549 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: crc 2024-09-12T18:01:35.549 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: crc 2024-09-12T18:01:35.549 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: secure 2024-09-12T18:01:35.549 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: crc 2024-09-12T18:01:35.549 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: secure 2024-09-12T18:01:35.550 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: crc 2024-09-12T18:01:35.550 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: secure 2024-09-12T18:01:35.550 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.550 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.550 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command rotate-key cmddesc rotate-key hook 0x563011d9f218 EEXIST 2024-09-12T18:01:35.550 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:35.550 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:01:35.550 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-a con 0x563011dc0c20 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:01:35.550 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-c con 0x563011decb50 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:01:35.550 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-b con 0x563011df0e40 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:01:35.551 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.551 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.551 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.551 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:35.551 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient(hunting): authenticate will time out at 2891.985975s 2024-09-12T18:01:35.551 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T18:01:35.415+0000 7f4658cf2640 10 monclient(hunting): get_auth_request con 0x563011dc0c20 auth_method 0 2024-09-12T18:01:35.551 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T18:01:35.415+0000 7f4658cf2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:35.551 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T18:01:35.415+0000 7f4658cf2640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:35.551 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T18:01:35.415+0000 7f4658cf2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:35.551 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T18:01:35.415+0000 7f4653fff640 10 monclient(hunting): get_auth_request con 0x563011decb50 auth_method 0 2024-09-12T18:01:35.551 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T18:01:35.415+0000 7f4653fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:35.551 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T18:01:35.415+0000 7f4653fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:35.551 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T18:01:35.415+0000 7f4653fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:35.551 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T18:01:35.415+0000 7f4658cf2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:35.552 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T18:01:35.415+0000 7f4658cf2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:35.552 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T18:01:35.415+0000 7f4658cf2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:35.552 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T18:01:35.415+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:35.552 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T18:01:35.415+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:35.552 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T18:01:35.415+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:35.552 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T18:01:35.415+0000 7f4658cf2640 10 monclient(hunting): handle_auth_done global_id 8355 payload 824 2024-09-12T18:01:35.552 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T18:01:35.415+0000 7f4658cf2640 10 monclient: _finish_hunting 0 2024-09-12T18:01:35.552 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T18:01:35.415+0000 7f4658cf2640 1 monclient: found mon.noname-a 2024-09-12T18:01:35.552 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T18:01:35.415+0000 7f4658cf2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T18:01:35.552 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T18:01:35.415+0000 7f46594f3640 10 monclient: get_auth_request con 0x563011df0e40 auth_method 0 2024-09-12T18:01:35.552 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T18:01:35.415+0000 7f45357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:35.552 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T18:01:35.415+0000 7f45357fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:01:35.552 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T18:01:35.415+0000 7f45357fa640 10 monclient: dump: 2024-09-12T18:01:35.552 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:35.553 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:35.553 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.553 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.553 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:35.553 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.553 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:35.553 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:35.553 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:35.553 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.553 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T18:01:35.415+0000 7f45357fa640 10 monclient: _finish_auth 0 2024-09-12T18:01:35.553 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T18:01:35.415+0000 7f45357fa640 10 monclient: _check_auth_tickets 2024-09-12T18:01:35.553 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T18:01:35.415+0000 7f45357fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:35.553 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T18:01:35.415+0000 7f45357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:35.553 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T18:01:35.415+0000 7f45357fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:35.554 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T18:01:35.415+0000 7f45357fa640 10 monclient: dump: 2024-09-12T18:01:35.554 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:35.554 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:35.554 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.554 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.554 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:35.554 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.554 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:35.554 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:35.554 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:35.554 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.554 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 monclient: authenticate success, global_id 8355 2024-09-12T18:01:35.554 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T18:01:35.415+0000 7f4536ffd640 4 set_mon_vals no callback set 2024-09-12T18:01:35.554 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: _renew_subs 2024-09-12T18:01:35.555 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:01:35.555 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: _renew_subs 2024-09-12T18:01:35.555 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:01:35.555 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 1 librados: init done 2024-09-12T18:01:35.555 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command cr dump hook 0x563011de51a8 2024-09-12T18:01:35.555 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.555 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T18:01:35.419+0000 7f45357fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:35.555 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T18:01:35.419+0000 7f45357fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:35.555 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T18:01:35.419+0000 7f45357fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:35.555 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T18:01:35.419+0000 7f4653fff640 10 monclient: get_auth_request con 0x7f4520070ae0 auth_method 0 2024-09-12T18:01:35.555 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T18:01:35.419+0000 7f46594f3640 10 monclient: get_auth_request con 0x563011e0a8d0 auth_method 0 2024-09-12T18:01:35.555 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.555 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 realm 2024-09-12T18:01:35.555 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.555 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.556 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:35.556 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.556 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.556 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.556 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T18:01:35.419+0000 7f4658cf2640 10 monclient: get_auth_request con 0x563011e0eb10 auth_method 0 2024-09-12T18:01:35.556 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:35.556 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.556 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T18:01:35.423+0000 7f465b1ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:35.556 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T18:01:35.423+0000 7f465b1ec9c0 20 searching for the correct realm 2024-09-12T18:01:35.556 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T18:01:35.423+0000 7f4653fff640 10 monclient: get_auth_request con 0x563011e13d80 auth_method 0 2024-09-12T18:01:35.556 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T18:01:35.423+0000 7f46594f3640 10 monclient: get_auth_request con 0x7f46440c9070 auth_method 0 2024-09-12T18:01:35.556 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T18:01:35.423+0000 7f4658cf2640 10 monclient: get_auth_request con 0x7f465405ebe0 auth_method 0 2024-09-12T18:01:35.556 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T18:01:35.423+0000 7f4653fff640 10 monclient: get_auth_request con 0x7f464c024040 auth_method 0 2024-09-12T18:01:35.557 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T18:01:35.427+0000 7f4653fff640 0 -- 172.21.15.98:0/822975416 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f464c024040 msgr2=0x7f464c08fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:35.557 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T18:01:35.427+0000 7f45357fa640 1 client.8355.objecter ms_handle_reset 0x7f464c024040 session 0x7f464c0196b0 osd.4 2024-09-12T18:01:35.557 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T18:01:35.427+0000 7f45357fa640 10 monclient: _renew_subs 2024-09-12T18:01:35.557 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T18:01:35.427+0000 7f45357fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:01:35.557 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T18:01:35.427+0000 7f4653fff640 10 monclient: get_auth_request con 0x7f4520081180 auth_method 0 2024-09-12T18:01:35.557 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T18:01:35.427+0000 7f46594f3640 10 monclient: get_auth_request con 0x7f4644102220 auth_method 0 2024-09-12T18:01:35.557 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T18:01:35.431+0000 7f4658cf2640 10 monclient: get_auth_request con 0x7f4644106c00 auth_method 0 2024-09-12T18:01:35.557 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T18:01:35.435+0000 7f46594f3640 0 -- 172.21.15.98:0/822975416 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f4644102220 msgr2=0x7f4644103800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:35.557 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T18:01:35.435+0000 7f45357fa640 1 client.8355.objecter ms_handle_reset 0x7f4644102220 session 0x7f46440a6070 osd.6 2024-09-12T18:01:35.557 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T18:01:35.435+0000 7f46594f3640 10 monclient: get_auth_request con 0x7f464c024040 auth_method 0 2024-09-12T18:01:35.557 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:35.557 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:01:35.557 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:35.557 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:01:35.558 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:35.558 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:35.558 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.558 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.558 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.558 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:35.558 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.558 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:35.558 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 zone default found 2024-09-12T18:01:35.558 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 4 Realm: () 2024-09-12T18:01:35.558 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:01:35.558 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:01:35.558 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:35.558 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 zonegroup default 2024-09-12T18:01:35.559 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.559 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.559 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.559 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.559 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.559 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.559 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 started sync module instance, tier type = 2024-09-12T18:01:35.559 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:01:35.559 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=0 2024-09-12T18:01:35.559 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=1 2024-09-12T18:01:35.559 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=2 2024-09-12T18:01:35.559 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=3 2024-09-12T18:01:35.559 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=4 2024-09-12T18:01:35.559 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=5 2024-09-12T18:01:35.560 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=6 2024-09-12T18:01:35.560 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=7 2024-09-12T18:01:35.560 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T18:01:35.459+0000 7f465b1ec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:35.560 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding auth protocol: cephx 2024-09-12T18:01:35.560 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding auth protocol: cephx 2024-09-12T18:01:35.560 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding auth protocol: cephx 2024-09-12T18:01:35.560 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: secure 2024-09-12T18:01:35.560 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: crc 2024-09-12T18:01:35.560 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: secure 2024-09-12T18:01:35.560 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: crc 2024-09-12T18:01:35.560 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: secure 2024-09-12T18:01:35.560 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: crc 2024-09-12T18:01:35.560 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: crc 2024-09-12T18:01:35.560 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: secure 2024-09-12T18:01:35.561 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T18:01:35.463+0000 7f450dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:35.561 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: crc 2024-09-12T18:01:35.561 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: secure 2024-09-12T18:01:35.561 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: crc 2024-09-12T18:01:35.561 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: secure 2024-09-12T18:01:35.561 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.561 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:35.561 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:35.561 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command cache list hook 0x563011de5d70 2024-09-12T18:01:35.561 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command cache inspect hook 0x563011de5d70 2024-09-12T18:01:35.561 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command cache erase hook 0x563011de5d70 2024-09-12T18:01:35.561 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command cache zap hook 0x563011de5d70 2024-09-12T18:01:35.561 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 note: GC not initialized 2024-09-12T18:01:35.561 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T18:01:35.463+0000 7f450cfe1640 20 reqs_thread_entry: start 2024-09-12T18:01:35.562 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command sync trace show hook 0x7f464c029040 2024-09-12T18:01:35.562 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command sync trace history hook 0x7f464c029040 2024-09-12T18:01:35.562 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command sync trace active hook 0x7f464c029040 2024-09-12T18:01:35.562 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command sync trace active_short hook 0x7f464c029040 2024-09-12T18:01:35.562 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:01:35.562 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 Filter name: none 2024-09-12T18:01:35.562 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T18:01:35.463+0000 7f44867fc640 20 reqs_thread_entry: start 2024-09-12T18:01:35.562 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:01:35.562 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.562 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:35.562 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:01:35.562 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:01:35.562 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T18:01:35.562 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.563 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:35.563 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:35.563 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:35.563 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:35.563 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:35.563 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:01:35.563 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T18:01:35.475+0000 7f465b1ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:35.563 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T18:01:35.475+0000 7f465b1ec9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:35.563 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T18:01:35.475+0000 7f465b1ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:35.563 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T18:01:35.475+0000 7f465b1ec9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T18:01:35.563 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T18:01:35.475+0000 7f45367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366220 cookie 94764458422816 notifier 8355 bl.length()=827 2024-09-12T18:01:35.563 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T18:01:35.475+0000 7f45367fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:35.563 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T18:01:35.475+0000 7f45367fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:35.563 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T18:01:35.475+0000 7f45367fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:35.564 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T18:01:35.475+0000 7f465b1ec9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T18:01:35.564 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T18:01:35.475+0000 7f465b1ec9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T18:01:35.564 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T18:01:35.475+0000 7f465b1ec9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T18:01:35.564 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T18:01:35.475+0000 7f465b1ec9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T18:01:35.564 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T18:01:35.491+0000 7f465b1ec9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f465b1ec9c0 time 2024-09-12T18:01:35.492068+0000 2024-09-12T18:01:35.564 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:01:35.564 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.564 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:35.564 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f465eac62eb] 2024-09-12T18:01:35.565 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f465eac649f] 2024-09-12T18:01:35.565 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56301053b0c1] 2024-09-12T18:01:35.565 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56301054d1fa] 2024-09-12T18:01:35.565 INFO:tasks.workunit.client.0.smithi098.stderr: 5: main() 2024-09-12T18:01:35.565 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f465d92cd90] 2024-09-12T18:01:35.565 INFO:tasks.workunit.client.0.smithi098.stderr: 7: __libc_start_main() 2024-09-12T18:01:35.565 INFO:tasks.workunit.client.0.smithi098.stderr: 8: _start() 2024-09-12T18:01:35.565 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.565 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T18:01:35.491+0000 7f465b1ec9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:01:35.565 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f465b1ec9c0 thread_name:radosgw-admin 2024-09-12T18:01:35.565 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.565 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:35.565 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f465d945520] 2024-09-12T18:01:35.565 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T18:01:35.566 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T18:01:35.566 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T18:01:35.566 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f465eac6345] 2024-09-12T18:01:35.566 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f465eac649f] 2024-09-12T18:01:35.566 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56301053b0c1] 2024-09-12T18:01:35.566 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56301054d1fa] 2024-09-12T18:01:35.566 INFO:tasks.workunit.client.0.smithi098.stderr: 9: main() 2024-09-12T18:01:35.566 INFO:tasks.workunit.client.0.smithi098.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f465d92cd90] 2024-09-12T18:01:35.566 INFO:tasks.workunit.client.0.smithi098.stderr: 11: __libc_start_main() 2024-09-12T18:01:35.566 INFO:tasks.workunit.client.0.smithi098.stderr: 12: _start() 2024-09-12T18:01:35.566 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:01:35.566 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.566 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T18:01:35.566 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T18:01:35.567 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T18:01:35.567 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T18:01:35.567 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T18:01:35.567 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T18:01:35.567 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T18:01:35.567 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T18:01:35.567 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T18:01:35.567 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T18:01:35.567 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T18:01:35.567 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T18:01:35.567 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T18:01:35.567 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T18:01:35.567 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T18:01:35.567 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T18:01:35.567 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T18:01:35.568 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T18:01:35.568 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T18:01:35.568 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T18:01:35.568 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T18:01:35.568 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T18:01:35.568 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T18:01:35.568 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T18:01:35.568 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:01:35.568 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T18:01:35.568 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T18:01:35.568 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T18:01:35.568 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T18:01:35.568 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T18:01:35.568 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T18:01:35.569 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T18:01:35.569 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T18:01:35.569 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T18:01:35.569 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T18:01:35.569 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T18:01:35.569 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T18:01:35.569 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T18:01:35.569 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T18:01:35.569 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T18:01:35.569 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T18:01:35.569 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T18:01:35.569 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T18:01:35.569 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T18:01:35.569 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T18:01:35.570 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T18:01:35.570 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:01:35.570 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T18:01:35.570 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:01:35.570 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T18:01:35.570 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T18:01:35.570 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T18:01:35.570 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T18:01:35.570 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T18:01:35.570 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T18:01:35.570 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T18:01:35.570 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T18:01:35.570 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T18:01:35.570 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T18:01:35.570 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T18:01:35.571 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T18:01:35.571 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T18:01:35.571 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T18:01:35.571 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T18:01:35.571 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T18:01:35.571 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T18:01:35.571 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T18:01:35.571 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:01:35.571 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T18:01:35.571 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:01:35.571 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T18:01:35.571 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T18:01:35.571 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T18:01:35.571 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T18:01:35.572 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T18:01:35.572 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T18:01:35.572 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:01:35.572 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T18:01:35.572 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T18:01:35.572 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:01:35.572 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T18:01:35.572 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T18:01:35.572 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T18:01:35.572 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T18:01:35.572 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T18:01:35.572 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T18:01:35.572 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T18:01:35.573 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T18:01:35.573 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T18:01:35.573 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T18:01:35.573 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T18:01:35.573 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T18:01:35.573 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T18:01:35.573 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:01:35.573 INFO:tasks.workunit.client.0.smithi098.stderr: 7f44867fc640 / http_manager 2024-09-12T18:01:35.573 INFO:tasks.workunit.client.0.smithi098.stderr: 7f450cfe1640 / http_manager 2024-09-12T18:01:35.573 INFO:tasks.workunit.client.0.smithi098.stderr: 7f450dfe3640 / rgw_dt_lg_renew 2024-09-12T18:01:35.573 INFO:tasks.workunit.client.0.smithi098.stderr: 7f45357fa640 / ms_dispatch 2024-09-12T18:01:35.573 INFO:tasks.workunit.client.0.smithi098.stderr: 7f45367fc640 / io_context_pool 2024-09-12T18:01:35.573 INFO:tasks.workunit.client.0.smithi098.stderr: 7f4536ffd640 / io_context_pool 2024-09-12T18:01:35.573 INFO:tasks.workunit.client.0.smithi098.stderr: 7f453d7fa640 / ms_dispatch 2024-09-12T18:01:35.574 INFO:tasks.workunit.client.0.smithi098.stderr: 7f453ffff640 / ms_dispatch 2024-09-12T18:01:35.574 INFO:tasks.workunit.client.0.smithi098.stderr: 7f4545e13640 / io_context_pool 2024-09-12T18:01:35.574 INFO:tasks.workunit.client.0.smithi098.stderr: 7f4653fff640 / msgr-worker-2 2024-09-12T18:01:35.574 INFO:tasks.workunit.client.0.smithi098.stderr: 7f4658cf2640 / msgr-worker-1 2024-09-12T18:01:35.574 INFO:tasks.workunit.client.0.smithi098.stderr: 7f46594f3640 / msgr-worker-0 2024-09-12T18:01:35.574 INFO:tasks.workunit.client.0.smithi098.stderr: 7f4659cf4640 / io_context_pool 2024-09-12T18:01:35.574 INFO:tasks.workunit.client.0.smithi098.stderr: 7f465b1ec9c0 / radosgw-admin 2024-09-12T18:01:35.574 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T18:01:35.574 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T18:01:35.574 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/log/ceph/ceph-client.admin.142953.log 2024-09-12T18:01:35.574 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T18:01:35.574 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T18:01:35.574 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T18:01:35.395+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:35.574 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T18:01:35.395+0000 7f4658cf2640 10 monclient(hunting): handle_auth_done global_id 7682 payload 274 2024-09-12T18:01:35.575 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T18:01:35.395+0000 7f4658cf2640 10 monclient: _finish_hunting 0 2024-09-12T18:01:35.575 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T18:01:35.395+0000 7f4658cf2640 1 monclient: found mon.noname-c 2024-09-12T18:01:35.575 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T18:01:35.395+0000 7f4658cf2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:01:35.575 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T18:01:35.395+0000 7f46594f3640 10 monclient: get_auth_request con 0x563011d52140 auth_method 0 2024-09-12T18:01:35.575 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T18:01:35.395+0000 7f4545e13640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:35.575 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T18:01:35.395+0000 7f4545e13640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:01:35.575 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T18:01:35.395+0000 7f4545e13640 10 monclient: dump: 2024-09-12T18:01:35.575 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:35.575 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:35.575 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.575 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.575 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:35.575 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.575 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:35.576 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:35.576 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:35.576 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.576 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T18:01:35.395+0000 7f4545e13640 10 monclient: _finish_auth 0 2024-09-12T18:01:35.576 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T18:01:35.395+0000 7f4545e13640 10 monclient: _check_auth_tickets 2024-09-12T18:01:35.576 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T18:01:35.395+0000 7f4545e13640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:35.576 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T18:01:35.395+0000 7f4545e13640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:35.576 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T18:01:35.395+0000 7f4545e13640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:01:35.576 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T18:01:35.395+0000 7f4545e13640 10 monclient: dump: 2024-09-12T18:01:35.576 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:35.576 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:35.576 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.576 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.576 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:35.577 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.577 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:35.577 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:35.577 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:35.577 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.577 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T18:01:35.395+0000 7f465b1ec9c0 5 monclient: authenticate success, global_id 7682 2024-09-12T18:01:35.577 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T18:01:35.395+0000 7f465b1ec9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:01:35.577 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T18:01:35.395+0000 7f465b1ec9c0 4 set_mon_vals no callback set 2024-09-12T18:01:35.577 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T18:01:35.395+0000 7f465b1ec9c0 10 monclient: shutdown 2024-09-12T18:01:35.577 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T18:01:35.395+0000 7f465b1ec9c0 5 asok(0x563011b162b0) unregister_commands rotate-key 2024-09-12T18:01:35.577 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient: build_initial_monmap 2024-09-12T18:01:35.577 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:35.577 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient: monmap: 2024-09-12T18:01:35.577 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:01:35.578 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:35.578 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:01:35.578 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:01:35.578 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:35.578 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.578 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:01:35.578 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:01:35.578 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:01:35.578 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.578 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding auth protocol: cephx 2024-09-12T18:01:35.578 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding auth protocol: cephx 2024-09-12T18:01:35.578 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding auth protocol: cephx 2024-09-12T18:01:35.578 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: secure 2024-09-12T18:01:35.578 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: crc 2024-09-12T18:01:35.579 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: secure 2024-09-12T18:01:35.579 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: crc 2024-09-12T18:01:35.579 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: secure 2024-09-12T18:01:35.579 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: crc 2024-09-12T18:01:35.579 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: crc 2024-09-12T18:01:35.579 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: secure 2024-09-12T18:01:35.579 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: crc 2024-09-12T18:01:35.579 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: secure 2024-09-12T18:01:35.579 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: crc 2024-09-12T18:01:35.579 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d4e6a0) adding con mode: secure 2024-09-12T18:01:35.579 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.579 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 1 librados: starting msgr at 2024-09-12T18:01:35.579 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 1 librados: starting objecter 2024-09-12T18:01:35.579 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command objecter_requests hook 0x563011d23460 2024-09-12T18:01:35.580 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 1 librados: setting wanted keys 2024-09-12T18:01:35.580 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 1 librados: calling monclient init 2024-09-12T18:01:35.580 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient: init 2024-09-12T18:01:35.580 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding auth protocol: cephx 2024-09-12T18:01:35.580 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding auth protocol: cephx 2024-09-12T18:01:35.580 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding auth protocol: cephx 2024-09-12T18:01:35.580 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: secure 2024-09-12T18:01:35.580 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: crc 2024-09-12T18:01:35.580 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: secure 2024-09-12T18:01:35.580 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: crc 2024-09-12T18:01:35.580 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: secure 2024-09-12T18:01:35.580 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: crc 2024-09-12T18:01:35.580 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: crc 2024-09-12T18:01:35.580 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: secure 2024-09-12T18:01:35.581 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: crc 2024-09-12T18:01:35.581 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: secure 2024-09-12T18:01:35.581 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: crc 2024-09-12T18:01:35.581 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d21640) adding con mode: secure 2024-09-12T18:01:35.581 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.581 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.581 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command rotate-key hook 0x563011d21788 2024-09-12T18:01:35.581 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:35.581 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:01:35.581 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-b con 0x563011bd1360 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:01:35.581 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-a con 0x563011be0aa0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:01:35.581 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-c con 0x563011d52140 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:01:35.581 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.581 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.582 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.582 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:35.582 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient(hunting): authenticate will time out at 2891.969294s 2024-09-12T18:01:35.582 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T18:01:35.399+0000 7f46594f3640 10 monclient(hunting): get_auth_request con 0x563011d52140 auth_method 0 2024-09-12T18:01:35.582 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T18:01:35.399+0000 7f46594f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:35.582 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T18:01:35.399+0000 7f46594f3640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:35.582 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T18:01:35.399+0000 7f46594f3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:35.582 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T18:01:35.399+0000 7f4653fff640 10 monclient(hunting): get_auth_request con 0x563011be0aa0 auth_method 0 2024-09-12T18:01:35.582 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T18:01:35.399+0000 7f4653fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:35.582 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T18:01:35.399+0000 7f4653fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:35.582 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T18:01:35.399+0000 7f4653fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:35.582 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T18:01:35.399+0000 7f46594f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:35.582 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T18:01:35.399+0000 7f46594f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:35.582 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T18:01:35.399+0000 7f46594f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:35.583 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T18:01:35.399+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:35.583 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T18:01:35.399+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:35.583 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T18:01:35.399+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:35.583 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T18:01:35.399+0000 7f46594f3640 10 monclient(hunting): handle_auth_done global_id 7685 payload 824 2024-09-12T18:01:35.583 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T18:01:35.399+0000 7f46594f3640 10 monclient: _finish_hunting 0 2024-09-12T18:01:35.583 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T18:01:35.399+0000 7f46594f3640 1 monclient: found mon.noname-c 2024-09-12T18:01:35.583 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T18:01:35.399+0000 7f46594f3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:01:35.583 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T18:01:35.399+0000 7f453ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:35.583 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T18:01:35.399+0000 7f453ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:01:35.583 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T18:01:35.399+0000 7f453ffff640 10 monclient: dump: 2024-09-12T18:01:35.583 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:35.583 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:35.583 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.583 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.584 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:35.584 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.584 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:35.584 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:35.584 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:35.584 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.584 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T18:01:35.399+0000 7f453ffff640 10 monclient: _finish_auth 0 2024-09-12T18:01:35.584 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T18:01:35.399+0000 7f453ffff640 10 monclient: _check_auth_tickets 2024-09-12T18:01:35.584 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T18:01:35.399+0000 7f453ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:35.584 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T18:01:35.399+0000 7f453ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:35.584 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T18:01:35.399+0000 7f453ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:01:35.584 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T18:01:35.399+0000 7f453ffff640 10 monclient: dump: 2024-09-12T18:01:35.584 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:35.584 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:35.585 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.585 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.585 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:35.585 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.585 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:35.585 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:35.585 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:35.585 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.585 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 5 monclient: authenticate success, global_id 7685 2024-09-12T18:01:35.585 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T18:01:35.399+0000 7f4545e13640 4 set_mon_vals no callback set 2024-09-12T18:01:35.585 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient: _renew_subs 2024-09-12T18:01:35.585 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:01:35.585 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient: _renew_subs 2024-09-12T18:01:35.585 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:01:35.585 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T18:01:35.399+0000 7f465b1ec9c0 1 librados: init done 2024-09-12T18:01:35.586 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T18:01:35.403+0000 7f453ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:35.586 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T18:01:35.403+0000 7f453ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:35.586 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T18:01:35.403+0000 7f453ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:35.586 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T18:01:35.403+0000 7f4658cf2640 10 monclient: get_auth_request con 0x7f4540070ae0 auth_method 0 2024-09-12T18:01:35.586 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T18:01:35.403+0000 7f4653fff640 10 monclient: get_auth_request con 0x563011d4c260 auth_method 0 2024-09-12T18:01:35.586 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T18:01:35.403+0000 7f4658cf2640 10 monclient: get_auth_request con 0x563011d6c310 auth_method 0 2024-09-12T18:01:35.586 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient: get_auth_request con 0x563011d716f0 auth_method 0 2024-09-12T18:01:35.586 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient: build_initial_monmap 2024-09-12T18:01:35.586 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:35.586 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient: monmap: 2024-09-12T18:01:35.586 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:01:35.586 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:35.586 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:01:35.586 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:01:35.587 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:35.587 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.587 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:01:35.587 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:01:35.587 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:01:35.587 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.587 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding auth protocol: cephx 2024-09-12T18:01:35.587 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding auth protocol: cephx 2024-09-12T18:01:35.587 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding auth protocol: cephx 2024-09-12T18:01:35.587 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: secure 2024-09-12T18:01:35.587 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: crc 2024-09-12T18:01:35.587 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: secure 2024-09-12T18:01:35.587 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: crc 2024-09-12T18:01:35.587 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: secure 2024-09-12T18:01:35.588 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: crc 2024-09-12T18:01:35.588 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: crc 2024-09-12T18:01:35.588 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: secure 2024-09-12T18:01:35.588 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: crc 2024-09-12T18:01:35.588 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: secure 2024-09-12T18:01:35.588 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: crc 2024-09-12T18:01:35.588 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d756f0) adding con mode: secure 2024-09-12T18:01:35.588 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.588 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command objecter_requests cmddesc objecter_requests hook 0x563011d79100 EEXIST 2024-09-12T18:01:35.588 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient: init 2024-09-12T18:01:35.588 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding auth protocol: cephx 2024-09-12T18:01:35.588 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding auth protocol: cephx 2024-09-12T18:01:35.588 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding auth protocol: cephx 2024-09-12T18:01:35.588 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: secure 2024-09-12T18:01:35.589 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: crc 2024-09-12T18:01:35.589 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: secure 2024-09-12T18:01:35.589 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: crc 2024-09-12T18:01:35.589 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: secure 2024-09-12T18:01:35.589 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: crc 2024-09-12T18:01:35.589 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: crc 2024-09-12T18:01:35.589 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: secure 2024-09-12T18:01:35.589 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: crc 2024-09-12T18:01:35.589 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: secure 2024-09-12T18:01:35.589 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: crc 2024-09-12T18:01:35.589 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d74748) adding con mode: secure 2024-09-12T18:01:35.589 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.589 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.589 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command rotate-key cmddesc rotate-key hook 0x563011d74890 EEXIST 2024-09-12T18:01:35.590 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:35.590 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:01:35.590 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-b con 0x563011d9d2b0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:01:35.590 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-a con 0x563011d9cbe0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:01:35.590 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-c con 0x563011d9b5c0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:01:35.590 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.590 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.590 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.590 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:35.590 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient(hunting): authenticate will time out at 2891.979112s 2024-09-12T18:01:35.591 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient(hunting): get_auth_request con 0x563011d9cbe0 auth_method 0 2024-09-12T18:01:35.591 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:35.591 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:35.591 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:35.591 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T18:01:35.407+0000 7f46594f3640 10 monclient(hunting): get_auth_request con 0x563011d9b5c0 auth_method 0 2024-09-12T18:01:35.591 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T18:01:35.407+0000 7f46594f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:35.591 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T18:01:35.407+0000 7f46594f3640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:35.591 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T18:01:35.407+0000 7f46594f3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:35.591 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:35.591 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:35.591 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:35.591 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T18:01:35.407+0000 7f46594f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:35.591 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T18:01:35.407+0000 7f46594f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:35.591 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T18:01:35.407+0000 7f46594f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:35.591 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient(hunting): handle_auth_done global_id 8349 payload 824 2024-09-12T18:01:35.592 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient: _finish_hunting 0 2024-09-12T18:01:35.592 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T18:01:35.407+0000 7f4653fff640 1 monclient: found mon.noname-a 2024-09-12T18:01:35.592 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T18:01:35.407+0000 7f4653fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T18:01:35.592 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T18:01:35.407+0000 7f453d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:35.592 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T18:01:35.407+0000 7f453d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:01:35.592 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T18:01:35.407+0000 7f453d7fa640 10 monclient: dump: 2024-09-12T18:01:35.592 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:35.592 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:35.592 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.592 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.592 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:35.592 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.592 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:35.593 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:35.593 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:35.593 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.593 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T18:01:35.407+0000 7f453d7fa640 10 monclient: _finish_auth 0 2024-09-12T18:01:35.593 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T18:01:35.407+0000 7f453d7fa640 10 monclient: _check_auth_tickets 2024-09-12T18:01:35.593 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T18:01:35.407+0000 7f453d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:35.593 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T18:01:35.407+0000 7f453d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:35.593 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T18:01:35.407+0000 7f453d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:35.593 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T18:01:35.407+0000 7f453d7fa640 10 monclient: dump: 2024-09-12T18:01:35.593 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:35.593 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:35.593 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.593 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.593 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:35.594 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.594 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:35.594 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:35.594 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:35.594 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.594 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 5 monclient: authenticate success, global_id 8349 2024-09-12T18:01:35.594 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T18:01:35.407+0000 7f4659cf4640 4 set_mon_vals no callback set 2024-09-12T18:01:35.594 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient: _renew_subs 2024-09-12T18:01:35.594 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T18:01:35.407+0000 7f465b1ec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:01:35.594 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient: _renew_subs 2024-09-12T18:01:35.594 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:01:35.595 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T18:01:35.411+0000 7f453d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:35.595 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T18:01:35.411+0000 7f453d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:35.595 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T18:01:35.411+0000 7f453d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:35.595 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient: get_monmap_and_config 2024-09-12T18:01:35.595 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient: build_initial_monmap 2024-09-12T18:01:35.595 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:35.595 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient: monmap: 2024-09-12T18:01:35.595 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:01:35.595 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:35.595 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:01:35.595 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:01:35.595 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:35.595 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.596 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:01:35.596 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:01:35.596 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:01:35.596 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.596 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding auth protocol: cephx 2024-09-12T18:01:35.596 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding auth protocol: cephx 2024-09-12T18:01:35.596 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding auth protocol: cephx 2024-09-12T18:01:35.596 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: secure 2024-09-12T18:01:35.596 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient: get_auth_request con 0x7f4530070a20 auth_method 0 2024-09-12T18:01:35.596 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: crc 2024-09-12T18:01:35.596 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: secure 2024-09-12T18:01:35.596 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: crc 2024-09-12T18:01:35.596 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: secure 2024-09-12T18:01:35.596 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: crc 2024-09-12T18:01:35.597 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: crc 2024-09-12T18:01:35.597 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: secure 2024-09-12T18:01:35.597 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: crc 2024-09-12T18:01:35.597 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: secure 2024-09-12T18:01:35.597 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: crc 2024-09-12T18:01:35.597 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x563011dbcae0) adding con mode: secure 2024-09-12T18:01:35.597 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.597 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient: init 2024-09-12T18:01:35.597 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding auth protocol: cephx 2024-09-12T18:01:35.597 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding auth protocol: cephx 2024-09-12T18:01:35.597 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding auth protocol: cephx 2024-09-12T18:01:35.597 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: secure 2024-09-12T18:01:35.597 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: crc 2024-09-12T18:01:35.597 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: secure 2024-09-12T18:01:35.598 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: crc 2024-09-12T18:01:35.598 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: secure 2024-09-12T18:01:35.598 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: crc 2024-09-12T18:01:35.598 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: crc 2024-09-12T18:01:35.598 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: secure 2024-09-12T18:01:35.598 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: crc 2024-09-12T18:01:35.598 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: secure 2024-09-12T18:01:35.598 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: crc 2024-09-12T18:01:35.598 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e2e0) adding con mode: secure 2024-09-12T18:01:35.598 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.598 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.598 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc3e14e428 EEXIST 2024-09-12T18:01:35.598 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:35.598 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:01:35.599 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-a con 0x563011dc0c20 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:01:35.599 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-c con 0x563011df0e40 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:01:35.599 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-b con 0x563011decb50 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:01:35.599 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.599 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.599 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.599 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:35.599 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T18:01:35.411+0000 7f465b1ec9c0 10 monclient(hunting): authenticate will time out at 2891.983383s 2024-09-12T18:01:35.599 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient(hunting): get_auth_request con 0x563011dc0c20 auth_method 0 2024-09-12T18:01:35.599 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:35.599 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:35.599 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:35.599 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T18:01:35.411+0000 7f4653fff640 10 monclient(hunting): get_auth_request con 0x563011df0e40 auth_method 0 2024-09-12T18:01:35.599 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T18:01:35.411+0000 7f4653fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:35.600 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T18:01:35.411+0000 7f4653fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:35.600 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T18:01:35.411+0000 7f4653fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:35.600 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:35.600 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:35.600 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:35.600 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T18:01:35.411+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:35.600 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T18:01:35.411+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:35.600 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T18:01:35.411+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:35.600 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T18:01:35.411+0000 7f46594f3640 10 monclient(hunting): get_auth_request con 0x563011decb50 auth_method 0 2024-09-12T18:01:35.600 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T18:01:35.411+0000 7f46594f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:35.600 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T18:01:35.411+0000 7f46594f3640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:35.600 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T18:01:35.411+0000 7f46594f3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:35.600 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient(hunting): handle_auth_done global_id 8352 payload 274 2024-09-12T18:01:35.600 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient: _finish_hunting 0 2024-09-12T18:01:35.601 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T18:01:35.411+0000 7f4658cf2640 1 monclient: found mon.noname-a 2024-09-12T18:01:35.601 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T18:01:35.411+0000 7f4658cf2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T18:01:35.601 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T18:01:35.415+0000 7f4536ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:35.601 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T18:01:35.415+0000 7f4536ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:01:35.601 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T18:01:35.415+0000 7f4536ffd640 10 monclient: dump: 2024-09-12T18:01:35.601 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:35.601 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:35.601 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.601 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.601 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:35.601 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.601 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:35.601 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:35.601 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:35.602 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.602 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T18:01:35.415+0000 7f4536ffd640 10 monclient: _finish_auth 0 2024-09-12T18:01:35.602 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T18:01:35.415+0000 7f4536ffd640 10 monclient: _check_auth_tickets 2024-09-12T18:01:35.602 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T18:01:35.415+0000 7f4536ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:35.602 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T18:01:35.415+0000 7f4536ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:35.602 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T18:01:35.415+0000 7f4536ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:35.602 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T18:01:35.415+0000 7f4536ffd640 10 monclient: dump: 2024-09-12T18:01:35.602 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:35.602 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:35.602 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.602 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.602 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:35.602 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.602 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:35.603 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:35.603 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:35.603 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.603 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 monclient: authenticate success, global_id 8352 2024-09-12T18:01:35.603 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:01:35.603 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 4 set_mon_vals no callback set 2024-09-12T18:01:35.603 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: shutdown 2024-09-12T18:01:35.603 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: build_initial_monmap 2024-09-12T18:01:35.603 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 1 build_initial for_mkfs: 0 2024-09-12T18:01:35.603 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: monmap: 2024-09-12T18:01:35.603 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:01:35.603 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:01:35.603 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:01:35.603 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:01:35.603 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:01:35.604 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.604 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:01:35.604 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:01:35.604 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:01:35.604 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.604 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding auth protocol: cephx 2024-09-12T18:01:35.604 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding auth protocol: cephx 2024-09-12T18:01:35.604 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding auth protocol: cephx 2024-09-12T18:01:35.604 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: secure 2024-09-12T18:01:35.604 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: crc 2024-09-12T18:01:35.604 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: secure 2024-09-12T18:01:35.604 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: crc 2024-09-12T18:01:35.604 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: secure 2024-09-12T18:01:35.604 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: crc 2024-09-12T18:01:35.605 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: crc 2024-09-12T18:01:35.605 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: secure 2024-09-12T18:01:35.605 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: crc 2024-09-12T18:01:35.605 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: secure 2024-09-12T18:01:35.605 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: crc 2024-09-12T18:01:35.605 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011de3520) adding con mode: secure 2024-09-12T18:01:35.605 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.605 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 1 librados: starting msgr at 2024-09-12T18:01:35.605 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 1 librados: starting objecter 2024-09-12T18:01:35.605 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command objecter_requests cmddesc objecter_requests hook 0x563011dbee70 EEXIST 2024-09-12T18:01:35.606 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 1 librados: setting wanted keys 2024-09-12T18:01:35.606 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 1 librados: calling monclient init 2024-09-12T18:01:35.606 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: init 2024-09-12T18:01:35.606 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding auth protocol: cephx 2024-09-12T18:01:35.606 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding auth protocol: cephx 2024-09-12T18:01:35.606 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding auth protocol: cephx 2024-09-12T18:01:35.606 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: secure 2024-09-12T18:01:35.606 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: crc 2024-09-12T18:01:35.606 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: secure 2024-09-12T18:01:35.606 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: crc 2024-09-12T18:01:35.606 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: secure 2024-09-12T18:01:35.607 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: crc 2024-09-12T18:01:35.607 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: crc 2024-09-12T18:01:35.607 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: secure 2024-09-12T18:01:35.607 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: crc 2024-09-12T18:01:35.607 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: secure 2024-09-12T18:01:35.607 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: crc 2024-09-12T18:01:35.607 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 AuthRegistry(0x563011d9f0d0) adding con mode: secure 2024-09-12T18:01:35.607 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.607 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.607 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command rotate-key cmddesc rotate-key hook 0x563011d9f218 EEXIST 2024-09-12T18:01:35.607 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:01:35.607 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:01:35.607 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-a con 0x563011dc0c20 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:01:35.607 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-c con 0x563011decb50 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:01:35.608 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient(hunting): picked mon.noname-b con 0x563011df0e40 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:01:35.608 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.608 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.608 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:01:35.608 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:01:35.608 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient(hunting): authenticate will time out at 2891.985975s 2024-09-12T18:01:35.608 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T18:01:35.415+0000 7f4658cf2640 10 monclient(hunting): get_auth_request con 0x563011dc0c20 auth_method 0 2024-09-12T18:01:35.608 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T18:01:35.415+0000 7f4658cf2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:35.608 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T18:01:35.415+0000 7f4658cf2640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:35.608 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T18:01:35.415+0000 7f4658cf2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:35.608 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T18:01:35.415+0000 7f4653fff640 10 monclient(hunting): get_auth_request con 0x563011decb50 auth_method 0 2024-09-12T18:01:35.608 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T18:01:35.415+0000 7f4653fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:01:35.608 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T18:01:35.415+0000 7f4653fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:01:35.608 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T18:01:35.415+0000 7f4653fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:01:35.609 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T18:01:35.415+0000 7f4658cf2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:35.609 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T18:01:35.415+0000 7f4658cf2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:35.609 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T18:01:35.415+0000 7f4658cf2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:35.609 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T18:01:35.415+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:01:35.609 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T18:01:35.415+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:01:35.609 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T18:01:35.415+0000 7f4653fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:01:35.609 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T18:01:35.415+0000 7f4658cf2640 10 monclient(hunting): handle_auth_done global_id 8355 payload 824 2024-09-12T18:01:35.609 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T18:01:35.415+0000 7f4658cf2640 10 monclient: _finish_hunting 0 2024-09-12T18:01:35.609 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T18:01:35.415+0000 7f4658cf2640 1 monclient: found mon.noname-a 2024-09-12T18:01:35.609 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T18:01:35.415+0000 7f4658cf2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T18:01:35.609 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T18:01:35.415+0000 7f46594f3640 10 monclient: get_auth_request con 0x563011df0e40 auth_method 0 2024-09-12T18:01:35.609 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T18:01:35.415+0000 7f45357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:35.609 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T18:01:35.415+0000 7f45357fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:01:35.609 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T18:01:35.415+0000 7f45357fa640 10 monclient: dump: 2024-09-12T18:01:35.610 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:35.610 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:35.610 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.610 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.610 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:35.610 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.610 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:35.610 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:35.610 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:35.610 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.610 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T18:01:35.415+0000 7f45357fa640 10 monclient: _finish_auth 0 2024-09-12T18:01:35.610 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T18:01:35.415+0000 7f45357fa640 10 monclient: _check_auth_tickets 2024-09-12T18:01:35.610 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T18:01:35.415+0000 7f45357fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:01:35.610 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T18:01:35.415+0000 7f45357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:01:35.611 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T18:01:35.415+0000 7f45357fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:01:35.611 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T18:01:35.415+0000 7f45357fa640 10 monclient: dump: 2024-09-12T18:01:35.611 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:01:35.611 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:01:35.611 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.611 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:01:35.611 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:01:35.611 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:01:35.611 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:01:35.611 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:01:35.611 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:01:35.611 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.611 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 monclient: authenticate success, global_id 8355 2024-09-12T18:01:35.611 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T18:01:35.415+0000 7f4536ffd640 4 set_mon_vals no callback set 2024-09-12T18:01:35.612 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: _renew_subs 2024-09-12T18:01:35.612 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:01:35.612 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: _renew_subs 2024-09-12T18:01:35.612 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:01:35.612 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 1 librados: init done 2024-09-12T18:01:35.612 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T18:01:35.415+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command cr dump hook 0x563011de51a8 2024-09-12T18:01:35.612 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.612 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T18:01:35.419+0000 7f45357fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:01:35.612 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T18:01:35.419+0000 7f45357fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:35.612 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T18:01:35.419+0000 7f45357fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:01:35.612 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T18:01:35.419+0000 7f4653fff640 10 monclient: get_auth_request con 0x7f4520070ae0 auth_method 0 2024-09-12T18:01:35.612 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T18:01:35.419+0000 7f46594f3640 10 monclient: get_auth_request con 0x563011e0a8d0 auth_method 0 2024-09-12T18:01:35.612 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.612 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 realm 2024-09-12T18:01:35.612 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.613 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.613 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:35.613 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.613 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.613 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.613 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T18:01:35.419+0000 7f4658cf2640 10 monclient: get_auth_request con 0x563011e0eb10 auth_method 0 2024-09-12T18:01:35.613 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:35.613 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T18:01:35.419+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.613 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T18:01:35.423+0000 7f465b1ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:35.613 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T18:01:35.423+0000 7f465b1ec9c0 20 searching for the correct realm 2024-09-12T18:01:35.613 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T18:01:35.423+0000 7f4653fff640 10 monclient: get_auth_request con 0x563011e13d80 auth_method 0 2024-09-12T18:01:35.613 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T18:01:35.423+0000 7f46594f3640 10 monclient: get_auth_request con 0x7f46440c9070 auth_method 0 2024-09-12T18:01:35.613 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T18:01:35.423+0000 7f4658cf2640 10 monclient: get_auth_request con 0x7f465405ebe0 auth_method 0 2024-09-12T18:01:35.613 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T18:01:35.423+0000 7f4653fff640 10 monclient: get_auth_request con 0x7f464c024040 auth_method 0 2024-09-12T18:01:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T18:01:35.427+0000 7f4653fff640 0 -- 172.21.15.98:0/822975416 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f464c024040 msgr2=0x7f464c08fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T18:01:35.427+0000 7f45357fa640 1 client.8355.objecter ms_handle_reset 0x7f464c024040 session 0x7f464c0196b0 osd.4 2024-09-12T18:01:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T18:01:35.427+0000 7f45357fa640 10 monclient: _renew_subs 2024-09-12T18:01:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T18:01:35.427+0000 7f45357fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:01:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T18:01:35.427+0000 7f4653fff640 10 monclient: get_auth_request con 0x7f4520081180 auth_method 0 2024-09-12T18:01:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T18:01:35.427+0000 7f46594f3640 10 monclient: get_auth_request con 0x7f4644102220 auth_method 0 2024-09-12T18:01:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T18:01:35.431+0000 7f4658cf2640 10 monclient: get_auth_request con 0x7f4644106c00 auth_method 0 2024-09-12T18:01:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T18:01:35.435+0000 7f46594f3640 0 -- 172.21.15.98:0/822975416 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f4644102220 msgr2=0x7f4644103800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T18:01:35.435+0000 7f45357fa640 1 client.8355.objecter ms_handle_reset 0x7f4644102220 session 0x7f46440a6070 osd.6 2024-09-12T18:01:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T18:01:35.435+0000 7f46594f3640 10 monclient: get_auth_request con 0x7f464c024040 auth_method 0 2024-09-12T18:01:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:01:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:35.614 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:01:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T18:01:35.439+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 zone default found 2024-09-12T18:01:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 4 Realm: () 2024-09-12T18:01:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:01:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:01:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:35.615 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 zonegroup default 2024-09-12T18:01:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 started sync module instance, tier type = 2024-09-12T18:01:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T18:01:35.443+0000 7f465b1ec9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:01:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=0 2024-09-12T18:01:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=1 2024-09-12T18:01:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=2 2024-09-12T18:01:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=3 2024-09-12T18:01:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=4 2024-09-12T18:01:35.616 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=5 2024-09-12T18:01:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=6 2024-09-12T18:01:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T18:01:35.459+0000 7f465b1ec9c0 20 add_watcher() i=7 2024-09-12T18:01:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T18:01:35.459+0000 7f465b1ec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding auth protocol: cephx 2024-09-12T18:01:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding auth protocol: cephx 2024-09-12T18:01:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding auth protocol: cephx 2024-09-12T18:01:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: secure 2024-09-12T18:01:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: crc 2024-09-12T18:01:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: secure 2024-09-12T18:01:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: crc 2024-09-12T18:01:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: secure 2024-09-12T18:01:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: crc 2024-09-12T18:01:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: crc 2024-09-12T18:01:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: secure 2024-09-12T18:01:35.617 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T18:01:35.463+0000 7f450dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: crc 2024-09-12T18:01:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: secure 2024-09-12T18:01:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: crc 2024-09-12T18:01:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 AuthRegistry(0x7ffc3e14e7b0) adding con mode: secure 2024-09-12T18:01:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:01:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command cache list hook 0x563011de5d70 2024-09-12T18:01:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command cache inspect hook 0x563011de5d70 2024-09-12T18:01:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command cache erase hook 0x563011de5d70 2024-09-12T18:01:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command cache zap hook 0x563011de5d70 2024-09-12T18:01:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 note: GC not initialized 2024-09-12T18:01:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T18:01:35.463+0000 7f450cfe1640 20 reqs_thread_entry: start 2024-09-12T18:01:35.618 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command sync trace show hook 0x7f464c029040 2024-09-12T18:01:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command sync trace history hook 0x7f464c029040 2024-09-12T18:01:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command sync trace active hook 0x7f464c029040 2024-09-12T18:01:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 5 asok(0x563011b162b0) register_command sync trace active_short hook 0x7f464c029040 2024-09-12T18:01:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:01:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 Filter name: none 2024-09-12T18:01:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T18:01:35.463+0000 7f44867fc640 20 reqs_thread_entry: start 2024-09-12T18:01:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:01:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:01:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:01:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T18:01:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:01:35.619 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:35.620 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:35.620 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:35.620 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:35.620 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T18:01:35.463+0000 7f465b1ec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:01:35.620 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T18:01:35.475+0000 7f465b1ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:35.620 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T18:01:35.475+0000 7f465b1ec9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:35.620 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T18:01:35.475+0000 7f465b1ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:35.620 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T18:01:35.475+0000 7f465b1ec9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T18:01:35.620 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T18:01:35.475+0000 7f45367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366220 cookie 94764458422816 notifier 8355 bl.length()=827 2024-09-12T18:01:35.620 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T18:01:35.475+0000 7f45367fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:35.620 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T18:01:35.475+0000 7f45367fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:35.620 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T18:01:35.475+0000 7f45367fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:35.620 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T18:01:35.475+0000 7f465b1ec9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T18:01:35.621 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T18:01:35.475+0000 7f465b1ec9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T18:01:35.621 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T18:01:35.475+0000 7f465b1ec9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T18:01:35.621 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T18:01:35.475+0000 7f465b1ec9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T18:01:35.621 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T18:01:35.491+0000 7f465b1ec9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f465b1ec9c0 time 2024-09-12T18:01:35.492068+0000 2024-09-12T18:01:35.621 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:01:35.621 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.621 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:35.621 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f465eac62eb] 2024-09-12T18:01:35.621 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f465eac649f] 2024-09-12T18:01:35.621 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56301053b0c1] 2024-09-12T18:01:35.621 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56301054d1fa] 2024-09-12T18:01:35.621 INFO:tasks.workunit.client.0.smithi098.stderr: 5: main() 2024-09-12T18:01:35.621 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f465d92cd90] 2024-09-12T18:01:35.621 INFO:tasks.workunit.client.0.smithi098.stderr: 7: __libc_start_main() 2024-09-12T18:01:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: 8: _start() 2024-09-12T18:01:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T18:01:35.491+0000 7f465b1ec9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:01:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f465b1ec9c0 thread_name:radosgw-admin 2024-09-12T18:01:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:01:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f465d945520] 2024-09-12T18:01:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T18:01:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T18:01:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T18:01:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f465eac6345] 2024-09-12T18:01:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f465eac649f] 2024-09-12T18:01:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56301053b0c1] 2024-09-12T18:01:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56301054d1fa] 2024-09-12T18:01:35.622 INFO:tasks.workunit.client.0.smithi098.stderr: 9: main() 2024-09-12T18:01:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f465d92cd90] 2024-09-12T18:01:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: 11: __libc_start_main() 2024-09-12T18:01:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: 12: _start() 2024-09-12T18:01:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:01:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:01:35.623 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T18:01:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T18:01:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T18:01:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T18:01:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T18:01:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T18:01:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T18:01:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T18:01:35.623 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T18:01:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T18:01:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T18:01:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T18:01:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T18:01:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T18:01:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T18:01:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T18:01:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T18:01:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T18:01:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T18:01:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T18:01:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T18:01:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T18:01:35.624 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T18:01:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T18:01:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:01:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T18:01:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T18:01:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T18:01:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T18:01:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T18:01:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T18:01:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T18:01:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T18:01:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T18:01:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T18:01:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T18:01:35.625 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T18:01:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T18:01:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T18:01:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T18:01:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T18:01:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T18:01:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T18:01:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T18:01:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T18:01:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T18:01:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:01:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T18:01:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:01:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T18:01:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T18:01:35.626 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T18:01:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T18:01:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T18:01:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T18:01:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T18:01:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T18:01:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T18:01:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T18:01:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T18:01:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T18:01:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T18:01:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T18:01:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T18:01:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T18:01:35.627 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T18:01:35.628 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T18:01:35.628 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:01:35.628 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T18:01:35.628 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:01:35.628 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T18:01:35.628 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T18:01:35.628 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T18:01:35.628 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T18:01:35.628 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T18:01:35.628 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T18:01:35.628 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:01:35.628 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T18:01:35.628 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T18:01:35.628 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:01:35.628 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T18:01:35.629 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T18:01:35.629 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T18:01:35.629 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T18:01:35.629 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T18:01:35.629 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T18:01:35.629 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T18:01:35.629 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T18:01:35.629 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T18:01:35.629 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T18:01:35.629 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T18:01:35.629 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T18:01:35.629 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T18:01:35.629 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:01:35.629 INFO:tasks.workunit.client.0.smithi098.stderr: 7f44867fc640 / http_manager 2024-09-12T18:01:35.630 INFO:tasks.workunit.client.0.smithi098.stderr: 7f450cfe1640 / http_manager 2024-09-12T18:01:35.630 INFO:tasks.workunit.client.0.smithi098.stderr: 7f450dfe3640 / rgw_dt_lg_renew 2024-09-12T18:01:35.630 INFO:tasks.workunit.client.0.smithi098.stderr: 7f45357fa640 / ms_dispatch 2024-09-12T18:01:35.630 INFO:tasks.workunit.client.0.smithi098.stderr: 7f45367fc640 / io_context_pool 2024-09-12T18:01:35.630 INFO:tasks.workunit.client.0.smithi098.stderr: 7f4536ffd640 / io_context_pool 2024-09-12T18:01:35.630 INFO:tasks.workunit.client.0.smithi098.stderr: 7f453d7fa640 / ms_dispatch 2024-09-12T18:01:35.630 INFO:tasks.workunit.client.0.smithi098.stderr: 7f453ffff640 / ms_dispatch 2024-09-12T18:01:35.630 INFO:tasks.workunit.client.0.smithi098.stderr: 7f4545e13640 / io_context_pool 2024-09-12T18:01:35.630 INFO:tasks.workunit.client.0.smithi098.stderr: 7f4653fff640 / msgr-worker-2 2024-09-12T18:01:35.630 INFO:tasks.workunit.client.0.smithi098.stderr: 7f4658cf2640 / msgr-worker-1 2024-09-12T18:01:35.630 INFO:tasks.workunit.client.0.smithi098.stderr: 7f46594f3640 / msgr-worker-0 2024-09-12T18:01:35.630 INFO:tasks.workunit.client.0.smithi098.stderr: 7f4659cf4640 / io_context_pool 2024-09-12T18:01:35.630 INFO:tasks.workunit.client.0.smithi098.stderr: 7f465b1ec9c0 / radosgw-admin 2024-09-12T18:01:35.630 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T18:01:35.630 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T18:01:35.631 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:01:35.494103Z_b38a93be-52d5-4159-a370-38744fd1fa39/log 2024-09-12T18:01:35.631 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T18:01:35.631 INFO:tasks.workunit.client.0.smithi098.stderr:Aborted 2024-09-12T18:01:35.631 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:01:35.631 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:35.631 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:35.769 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.767+0000 7fb4b313e640 0 --2- 172.21.15.98:0/4291817768 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d6ce350e90 0x55d6ce351290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T18:01:35.777 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.775+0000 7fb4b5e399c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.779+0000 7fb4b5e399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.779+0000 7fb4b5e399c0 20 realm 2024-09-12T18:01:35.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.779+0000 7fb4b5e399c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.779+0000 7fb4b5e399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.779+0000 7fb4b5e399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:35.780 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.779+0000 7fb4b5e399c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.779+0000 7fb4b5e399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:35.781 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.779+0000 7fb4b5e399c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.779+0000 7fb4b5e399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:35.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.779+0000 7fb4b5e399c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:35.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.779+0000 7fb4b5e399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:35.783 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.779+0000 7fb4b5e399c0 20 searching for the correct realm 2024-09-12T18:01:35.785 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.783+0000 7fb4b393f640 0 -- 172.21.15.98:0/9559612 >> [v2:172.21.15.98:6816/1225764258,v1:172.21.15.98:6817/1225764258] conn(0x7fb4ac021040 msgr2=0x7fb4ac05fbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:01:35.997 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:35.995+0000 7fb4b313e640 0 -- 172.21.15.98:0/9559612 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55d6ce36f690 msgr2=0x55d6ce371aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:36.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.011+0000 7fb4b5e399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:36.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.011+0000 7fb4b5e399c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:01:36.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.011+0000 7fb4b5e399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:36.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.011+0000 7fb4b5e399c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:01:36.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.011+0000 7fb4b5e399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:36.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.011+0000 7fb4b5e399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:36.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.011+0000 7fb4b5e399c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.011+0000 7fb4b5e399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:36.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.011+0000 7fb4b5e399c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.016 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.015+0000 7fb4b5e399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:36.016 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.015+0000 7fb4b5e399c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.015+0000 7fb4b5e399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:36.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.015+0000 7fb4b5e399c0 20 zone default found 2024-09-12T18:01:36.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.015+0000 7fb4b5e399c0 4 Realm: () 2024-09-12T18:01:36.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.015+0000 7fb4b5e399c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:01:36.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.015+0000 7fb4b5e399c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:01:36.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.015+0000 7fb4b5e399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:36.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.015+0000 7fb4b5e399c0 20 zonegroup default 2024-09-12T18:01:36.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.015+0000 7fb4b5e399c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.015+0000 7fb4b5e399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:36.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.015+0000 7fb4b5e399c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.015+0000 7fb4b5e399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:36.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.015+0000 7fb4b5e399c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.015+0000 7fb4b5e399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:36.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.015+0000 7fb4b5e399c0 20 started sync module instance, tier type = 2024-09-12T18:01:36.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.015+0000 7fb4b5e399c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:01:36.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.039+0000 7fb4b5e399c0 20 add_watcher() i=0 2024-09-12T18:01:36.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.039+0000 7fb4b5e399c0 20 add_watcher() i=1 2024-09-12T18:01:36.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.039+0000 7fb4b5e399c0 20 add_watcher() i=2 2024-09-12T18:01:36.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.039+0000 7fb4b5e399c0 20 add_watcher() i=3 2024-09-12T18:01:36.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.039+0000 7fb4b5e399c0 20 add_watcher() i=4 2024-09-12T18:01:36.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.039+0000 7fb4b5e399c0 20 add_watcher() i=5 2024-09-12T18:01:36.041 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.039+0000 7fb4b5e399c0 20 add_watcher() i=6 2024-09-12T18:01:36.042 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.039+0000 7fb4b5e399c0 20 add_watcher() i=7 2024-09-12T18:01:36.043 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.039+0000 7fb4b5e399c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:36.046 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.043+0000 7fb369fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:36.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.043+0000 7fb4b5e399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:36.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.043+0000 7fb4b5e399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:36.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.043+0000 7fb4b5e399c0 5 note: GC not initialized 2024-09-12T18:01:36.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.047+0000 7fb368fe1640 20 reqs_thread_entry: start 2024-09-12T18:01:36.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.047+0000 7fb4b5e399c0 20 init_complete bucket index max shards: 11 2024-09-12T18:01:36.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.047+0000 7fb4b5e399c0 20 Filter name: none 2024-09-12T18:01:36.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.047+0000 7fb2e27fc640 20 reqs_thread_entry: start 2024-09-12T18:01:36.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.047+0000 7fb4b5e399c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.047+0000 7fb4b5e399c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:36.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.047+0000 7fb4b5e399c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.047+0000 7fb4b5e399c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:01:36.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.047+0000 7fb4b5e399c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:36.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.047+0000 7fb4b5e399c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.051+0000 7fb4b5e399c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:36.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.051+0000 7fb4b5e399c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.053 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.051+0000 7fb4b5e399c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:01:36.053 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.051+0000 7fb4b5e399c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:01:36.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.055+0000 7fb369fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:36.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.059+0000 7fb4b5e399c0 20 remove_watcher() i=0 2024-09-12T18:01:36.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.059+0000 7fb4b5e399c0 2 removed watcher, disabling cache 2024-09-12T18:01:36.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.063+0000 7fb4b5e399c0 20 remove_watcher() i=1 2024-09-12T18:01:36.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.063+0000 7fb4b5e399c0 20 remove_watcher() i=2 2024-09-12T18:01:36.068 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.067+0000 7fb4b5e399c0 20 remove_watcher() i=3 2024-09-12T18:01:36.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.067+0000 7fb4b5e399c0 20 remove_watcher() i=4 2024-09-12T18:01:36.072 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.071+0000 7fb4b5e399c0 20 remove_watcher() i=5 2024-09-12T18:01:36.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.071+0000 7fb4b5e399c0 20 remove_watcher() i=6 2024-09-12T18:01:36.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.075+0000 7fb4b5e399c0 20 remove_watcher() i=7 2024-09-12T18:01:36.093 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:01:36.094 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:01:36.140 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:01:36.171 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:01:36.171 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:01:36.214 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.211+0000 7f2fcf8a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.215+0000 7f2fcf8a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:36.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.215+0000 7f2fcf8a39c0 20 realm 2024-09-12T18:01:36.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.215+0000 7f2fcf8a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.215+0000 7f2fcf8a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:36.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.215+0000 7f2fcf8a39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:01:36.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.215+0000 7f2fcf8a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.215+0000 7f2fcf8a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:36.217 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.215+0000 7f2fcf8a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.218 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.215+0000 7f2fcf8a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:36.218 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.215+0000 7f2fcf8a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.215+0000 7f2fcf8a39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:01:36.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.215+0000 7f2fcf8a39c0 20 searching for the correct realm 2024-09-12T18:01:36.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.223+0000 7f2fccba8640 0 -- 172.21.15.98:0/3792077377 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f2fc0008070 msgr2=0x7f2fc005cf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:36.231 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.227+0000 7f2fccba8640 0 -- 172.21.15.98:0/3792077377 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f2e98081100 msgr2=0x7f2e98083530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:01:36.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:01:36.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:01:36.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:01:36.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:01:36.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:01:36.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:01:36.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:36.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:01:36.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:01:36.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 20 zone default found 2024-09-12T18:01:36.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 4 Realm: () 2024-09-12T18:01:36.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:01:36.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:01:36.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:01:36.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 20 zonegroup default 2024-09-12T18:01:36.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:36.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.235+0000 7f2fcf8a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.239+0000 7f2fcf8a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:36.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.239+0000 7f2fcf8a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.239+0000 7f2fcf8a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:01:36.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.239+0000 7f2fcf8a39c0 20 started sync module instance, tier type = 2024-09-12T18:01:36.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.239+0000 7f2fcf8a39c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:01:36.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.255+0000 7f2fcf8a39c0 20 add_watcher() i=0 2024-09-12T18:01:36.256 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.255+0000 7f2fcf8a39c0 20 add_watcher() i=1 2024-09-12T18:01:36.256 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.255+0000 7f2fcf8a39c0 20 add_watcher() i=2 2024-09-12T18:01:36.256 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.255+0000 7f2fcf8a39c0 20 add_watcher() i=3 2024-09-12T18:01:36.256 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.255+0000 7f2fcf8a39c0 20 add_watcher() i=4 2024-09-12T18:01:36.256 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.255+0000 7f2fcf8a39c0 20 add_watcher() i=5 2024-09-12T18:01:36.256 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.255+0000 7f2fcf8a39c0 20 add_watcher() i=6 2024-09-12T18:01:36.256 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.255+0000 7f2fcf8a39c0 20 add_watcher() i=7 2024-09-12T18:01:36.257 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.255+0000 7f2fcf8a39c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:01:36.259 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.255+0000 7f2e83fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:36.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:01:36.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:01:36.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 5 note: GC not initialized 2024-09-12T18:01:36.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2e82fe5640 20 reqs_thread_entry: start 2024-09-12T18:01:36.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 20 init_complete bucket index max shards: 11 2024-09-12T18:01:36.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 20 Filter name: none 2024-09-12T18:01:36.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2e80fe1640 20 reqs_thread_entry: start 2024-09-12T18:01:36.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:01:36.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:01:36.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:01:36.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:01:36.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T18:01:36.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 20 rados->read ofs=0 len=0 2024-09-12T18:01:36.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:01:36.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:01:36.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:01:36.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:01:36.262 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:01:36.263 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:01:36.263 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:01:36.263 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:01:36.263 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:01:36.263 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.259+0000 7f2fcf8a39c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:01:36.263 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.263+0000 7f2fcf8a39c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:01:36.264 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.263+0000 7f2fcf8a39c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:01:36.264 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.263+0000 7f2fcf8a39c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:01:36.264 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.263+0000 7f2fcf8a39c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:01:36.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.263+0000 7f2fcf8a39c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:01:36.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.263+0000 7f2fcf8a39c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:01:36.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.263+0000 7f2fcf8a39c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:01:36.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.263+0000 7f2fcf8a39c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:01:36.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.263+0000 7f2fcf8a39c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:01:36.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.263+0000 7f2fcf8a39c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:01:36.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.263+0000 7f2fcf8a39c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:01:36.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.263+0000 7f2fcf8a39c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:01:36.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.267+0000 7f2fcf8a39c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:01:36.268 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.267+0000 7f2fcf8a39c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:01:36.268 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.267+0000 7f2fcf8a39c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:01:36.268 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.267+0000 7f2fcf8a39c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:01:36.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.267+0000 7f2fcf8a39c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:01:36.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.267+0000 7f2fcf8a39c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:01:36.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.267+0000 7f2fcf8a39c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:01:36.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.267+0000 7f2fcf8a39c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:01:36.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.267+0000 7f2fcf8a39c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:01:36.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.267+0000 7f2fcf8a39c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:01:36.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.271+0000 7f2e83fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:01:36.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.275+0000 7f2fcf8a39c0 20 remove_watcher() i=0 2024-09-12T18:01:36.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.275+0000 7f2fcf8a39c0 2 removed watcher, disabling cache 2024-09-12T18:01:36.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.275+0000 7f2fcf8a39c0 20 remove_watcher() i=1 2024-09-12T18:01:36.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.279+0000 7f2fcf8a39c0 20 remove_watcher() i=2 2024-09-12T18:01:36.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.279+0000 7f2fcf8a39c0 20 remove_watcher() i=3 2024-09-12T18:01:36.285 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.283+0000 7f2fcf8a39c0 20 remove_watcher() i=4 2024-09-12T18:01:36.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.283+0000 7f2fcf8a39c0 20 remove_watcher() i=5 2024-09-12T18:01:36.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.287+0000 7f2fcf8a39c0 20 remove_watcher() i=6 2024-09-12T18:01:36.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:01:36.287+0000 7f2fcf8a39c0 20 remove_watcher() i=7 2024-09-12T18:02:06.332 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T18:02:06.372 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:06.372 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:06.417 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.415+0000 7fa570e529c0 20 realm 2024-09-12T18:02:06.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.415+0000 7fa570e529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:06.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.419 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.420 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.419+0000 7fa570e529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:06.421 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.419+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.419+0000 7fa570e529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:06.422 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.419+0000 7fa570e529c0 20 searching for the correct realm 2024-09-12T18:02:06.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.427+0000 7fa56f159640 0 -- 172.21.15.98:0/1942326995 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7fa55810aca0 msgr2=0x7fa5581370b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:06.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.643+0000 7fa56e958640 0 -- 172.21.15.98:0/1942326995 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x563982bb3db0 msgr2=0x563982bb6250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:06.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.651+0000 7fa570e529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:06.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.651+0000 7fa570e529c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:02:06.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.651+0000 7fa570e529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:06.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.651+0000 7fa570e529c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:02:06.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.651+0000 7fa570e529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:06.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.651+0000 7fa570e529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:06.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.651+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.651+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.651+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.651+0000 7fa570e529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:06.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.651+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.651+0000 7fa570e529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:06.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.651+0000 7fa570e529c0 20 zone default found 2024-09-12T18:02:06.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.651+0000 7fa570e529c0 4 Realm: () 2024-09-12T18:02:06.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.651+0000 7fa570e529c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:02:06.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.651+0000 7fa570e529c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:02:06.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.651+0000 7fa570e529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:06.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.651+0000 7fa570e529c0 20 zonegroup default 2024-09-12T18:02:06.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.655+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.655+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.655+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.655+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.655+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.655+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.655+0000 7fa570e529c0 20 started sync module instance, tier type = 2024-09-12T18:02:06.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.655+0000 7fa570e529c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:02:06.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=0 2024-09-12T18:02:06.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=1 2024-09-12T18:02:06.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=2 2024-09-12T18:02:06.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=3 2024-09-12T18:02:06.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=4 2024-09-12T18:02:06.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=5 2024-09-12T18:02:06.682 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=6 2024-09-12T18:02:06.684 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.683+0000 7fa570e529c0 20 add_watcher() i=7 2024-09-12T18:02:06.684 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.683+0000 7fa570e529c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:06.689 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.687+0000 7fa425fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:06.690 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.687+0000 7fa570e529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:06.690 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.687+0000 7fa570e529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:06.690 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.687+0000 7fa570e529c0 5 note: GC not initialized 2024-09-12T18:02:06.690 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.687+0000 7fa424fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:06.690 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.687+0000 7fa570e529c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:06.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.687+0000 7fa570e529c0 20 Filter name: none 2024-09-12T18:02:06.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.687+0000 7fa41dffb640 20 reqs_thread_entry: start 2024-09-12T18:02:06.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.687+0000 7fa570e529c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:02:06.691 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.687+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.691+0000 7fa570e529c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:06.692 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.691+0000 7fa570e529c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:02:06.693 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.691+0000 7fa570e529c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:02:06.693 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.691+0000 7fa570e529c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T18:02:06.693 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.691+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.693 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.691+0000 7fa570e529c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:02:06.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.691+0000 7fa570e529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:02:06.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.691+0000 7fa570e529c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:02:06.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.691+0000 7fa570e529c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:06.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.691+0000 7fa570e529c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:06.694 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.691+0000 7fa570e529c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:02:06.696 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.695+0000 7fa570e529c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:02:06.710 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.707+0000 7fa570e529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:02:06.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.707+0000 7fa570e529c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:02:06.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.707+0000 7fa570e529c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:06.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.707+0000 7fa570e529c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T18:02:06.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.707+0000 7fa451ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366221 cookie 94805006471024 notifier 7745 bl.length()=827 2024-09-12T18:02:06.711 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.707+0000 7fa451ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:02:06.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.707+0000 7fa451ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:02:06.712 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.707+0000 7fa451ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:06.713 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.711+0000 7fa570e529c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T18:02:06.713 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.711+0000 7fa570e529c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T18:02:06.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.711+0000 7fa570e529c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T18:02:06.714 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.711+0000 7fa570e529c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T18:02:06.721 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa570e529c0 time 2024-09-12T18:02:06.721891+0000 2024-09-12T18:02:06.721 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:02:06.723 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:06.723 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa57472c2eb] 2024-09-12T18:02:06.723 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa57472c49f] 2024-09-12T18:02:06.723 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5639815410c1] 2024-09-12T18:02:06.723 INFO:tasks.workunit.client.0.smithi098.stderr: 4: radosgw-admin(+0x14100ec) [0x563981f970ec] 2024-09-12T18:02:06.723 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56398155318d] 2024-09-12T18:02:06.723 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T18:02:06.723 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa573592d90] 2024-09-12T18:02:06.723 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T18:02:06.723 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T18:02:06.723 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.719+0000 7fa570e529c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa570e529c0 time 2024-09-12T18:02:06.721891+0000 2024-09-12T18:02:06.724 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:02:06.724 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.724 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:06.724 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa57472c2eb] 2024-09-12T18:02:06.724 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa57472c49f] 2024-09-12T18:02:06.724 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5639815410c1] 2024-09-12T18:02:06.724 INFO:tasks.workunit.client.0.smithi098.stderr: 4: radosgw-admin(+0x14100ec) [0x563981f970ec] 2024-09-12T18:02:06.724 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56398155318d] 2024-09-12T18:02:06.724 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T18:02:06.724 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa573592d90] 2024-09-12T18:02:06.724 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T18:02:06.724 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T18:02:06.724 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.725 INFO:tasks.workunit.client.0.smithi098.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:02:06.725 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7fa570e529c0 thread_name:radosgw-admin 2024-09-12T18:02:06.736 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:06.736 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa5735ab520] 2024-09-12T18:02:06.736 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T18:02:06.736 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T18:02:06.736 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T18:02:06.736 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa57472c345] 2024-09-12T18:02:06.736 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa57472c49f] 2024-09-12T18:02:06.736 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5639815410c1] 2024-09-12T18:02:06.736 INFO:tasks.workunit.client.0.smithi098.stderr: 8: radosgw-admin(+0x14100ec) [0x563981f970ec] 2024-09-12T18:02:06.736 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56398155318d] 2024-09-12T18:02:06.737 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T18:02:06.737 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa573592d90] 2024-09-12T18:02:06.737 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T18:02:06.737 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T18:02:06.737 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.723+0000 7fa570e529c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:02:06.737 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7fa570e529c0 thread_name:radosgw-admin 2024-09-12T18:02:06.737 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.737 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:06.737 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa5735ab520] 2024-09-12T18:02:06.737 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T18:02:06.737 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T18:02:06.737 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T18:02:06.737 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa57472c345] 2024-09-12T18:02:06.738 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa57472c49f] 2024-09-12T18:02:06.738 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5639815410c1] 2024-09-12T18:02:06.738 INFO:tasks.workunit.client.0.smithi098.stderr: 8: radosgw-admin(+0x14100ec) [0x563981f970ec] 2024-09-12T18:02:06.738 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56398155318d] 2024-09-12T18:02:06.738 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T18:02:06.738 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa573592d90] 2024-09-12T18:02:06.738 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T18:02:06.738 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T18:02:06.738 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:02:06.738 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.738 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T18:02:06.738 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T18:02:06.391+0000 7fa56f159640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:06.738 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T18:02:06.391+0000 7fa56f159640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:06.739 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T18:02:06.391+0000 7fa56f159640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:06.739 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T18:02:06.391+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:06.739 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T18:02:06.391+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:06.739 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T18:02:06.391+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:06.739 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T18:02:06.391+0000 7fa56f159640 10 monclient(hunting): handle_auth_done global_id 7733 payload 274 2024-09-12T18:02:06.739 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T18:02:06.391+0000 7fa56f159640 10 monclient: _finish_hunting 0 2024-09-12T18:02:06.739 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T18:02:06.391+0000 7fa56f159640 1 monclient: found mon.noname-c 2024-09-12T18:02:06.739 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T18:02:06.391+0000 7fa56f159640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:02:06.739 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T18:02:06.391+0000 7fa45ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:06.739 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T18:02:06.391+0000 7fa45ce09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:06.739 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T18:02:06.391+0000 7fa45ce09640 10 monclient: dump: 2024-09-12T18:02:06.739 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:06.739 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:06.739 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.740 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.740 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:06.740 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.740 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:06.740 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:06.740 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:06.740 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.740 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T18:02:06.391+0000 7fa45ce09640 10 monclient: _finish_auth 0 2024-09-12T18:02:06.740 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T18:02:06.391+0000 7fa45ce09640 10 monclient: _check_auth_tickets 2024-09-12T18:02:06.740 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T18:02:06.391+0000 7fa45ce09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:06.740 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T18:02:06.391+0000 7fa45ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:06.740 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T18:02:06.391+0000 7fa45ce09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:06.740 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T18:02:06.391+0000 7fa45ce09640 10 monclient: dump: 2024-09-12T18:02:06.740 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:06.741 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:06.741 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.741 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.741 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:06.741 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.741 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:06.741 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:06.741 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:06.741 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.741 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T18:02:06.391+0000 7fa570e529c0 5 monclient: authenticate success, global_id 7733 2024-09-12T18:02:06.741 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T18:02:06.391+0000 7fa570e529c0 10 monclient: get_monmap_and_config success 2024-09-12T18:02:06.742 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T18:02:06.391+0000 7fa570e529c0 4 set_mon_vals no callback set 2024-09-12T18:02:06.742 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T18:02:06.391+0000 7fa570e529c0 10 monclient: shutdown 2024-09-12T18:02:06.742 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T18:02:06.391+0000 7fa570e529c0 5 asok(0x5639828bb2b0) unregister_commands rotate-key 2024-09-12T18:02:06.742 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient: build_initial_monmap 2024-09-12T18:02:06.742 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T18:02:06.395+0000 7fa570e529c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:06.742 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient: monmap: 2024-09-12T18:02:06.742 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:02:06.742 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:06.742 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:02:06.742 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:02:06.742 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:06.742 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.742 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:02:06.742 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:02:06.743 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:02:06.743 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.743 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding auth protocol: cephx 2024-09-12T18:02:06.743 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding auth protocol: cephx 2024-09-12T18:02:06.743 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding auth protocol: cephx 2024-09-12T18:02:06.743 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: secure 2024-09-12T18:02:06.743 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: crc 2024-09-12T18:02:06.743 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: secure 2024-09-12T18:02:06.743 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: crc 2024-09-12T18:02:06.743 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: secure 2024-09-12T18:02:06.743 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: crc 2024-09-12T18:02:06.743 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: crc 2024-09-12T18:02:06.743 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: secure 2024-09-12T18:02:06.744 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: crc 2024-09-12T18:02:06.744 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: secure 2024-09-12T18:02:06.744 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: crc 2024-09-12T18:02:06.744 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: secure 2024-09-12T18:02:06.744 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T18:02:06.395+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.744 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T18:02:06.395+0000 7fa570e529c0 1 librados: starting msgr at 2024-09-12T18:02:06.744 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T18:02:06.395+0000 7fa570e529c0 1 librados: starting objecter 2024-09-12T18:02:06.744 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command objecter_requests hook 0x563982977f90 2024-09-12T18:02:06.744 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T18:02:06.395+0000 7fa570e529c0 1 librados: setting wanted keys 2024-09-12T18:02:06.744 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T18:02:06.395+0000 7fa570e529c0 1 librados: calling monclient init 2024-09-12T18:02:06.744 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient: init 2024-09-12T18:02:06.745 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding auth protocol: cephx 2024-09-12T18:02:06.745 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding auth protocol: cephx 2024-09-12T18:02:06.745 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding auth protocol: cephx 2024-09-12T18:02:06.745 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: secure 2024-09-12T18:02:06.745 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: crc 2024-09-12T18:02:06.745 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: secure 2024-09-12T18:02:06.745 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: crc 2024-09-12T18:02:06.745 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: secure 2024-09-12T18:02:06.745 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: crc 2024-09-12T18:02:06.745 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: crc 2024-09-12T18:02:06.745 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: secure 2024-09-12T18:02:06.745 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: crc 2024-09-12T18:02:06.745 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: secure 2024-09-12T18:02:06.746 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: crc 2024-09-12T18:02:06.746 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: secure 2024-09-12T18:02:06.746 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T18:02:06.395+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.746 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T18:02:06.395+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.746 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command rotate-key hook 0x563982ac69e8 2024-09-12T18:02:06.746 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:06.746 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:02:06.746 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-b con 0x563982953840 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:02:06.746 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-c con 0x563982a0e9c0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:02:06.746 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-a con 0x563982af3240 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:02:06.746 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.746 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.746 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.747 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:06.747 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient(hunting): authenticate will time out at 2922.965224s 2024-09-12T18:02:06.747 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T18:02:06.395+0000 7fa56f159640 10 monclient(hunting): get_auth_request con 0x563982af3240 auth_method 0 2024-09-12T18:02:06.747 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T18:02:06.395+0000 7fa56f159640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:06.747 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T18:02:06.395+0000 7fa56f159640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:06.747 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T18:02:06.395+0000 7fa56f159640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:06.747 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T18:02:06.395+0000 7fa56e157640 10 monclient(hunting): get_auth_request con 0x563982a0e9c0 auth_method 0 2024-09-12T18:02:06.747 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T18:02:06.395+0000 7fa56e157640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:06.747 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T18:02:06.395+0000 7fa56e157640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:06.747 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T18:02:06.395+0000 7fa56e157640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:06.747 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T18:02:06.395+0000 7fa56f159640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:06.747 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T18:02:06.395+0000 7fa56f159640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:06.747 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T18:02:06.395+0000 7fa56f159640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:06.748 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T18:02:06.395+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:06.748 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T18:02:06.395+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:06.748 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T18:02:06.395+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:06.748 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T18:02:06.395+0000 7fa56f159640 10 monclient(hunting): handle_auth_done global_id 8400 payload 824 2024-09-12T18:02:06.748 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T18:02:06.395+0000 7fa56f159640 10 monclient: _finish_hunting 0 2024-09-12T18:02:06.748 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T18:02:06.395+0000 7fa56f159640 1 monclient: found mon.noname-a 2024-09-12T18:02:06.748 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T18:02:06.395+0000 7fa56f159640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T18:02:06.748 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T18:02:06.395+0000 7fa45b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:06.748 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T18:02:06.395+0000 7fa45b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:02:06.748 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T18:02:06.395+0000 7fa45b606640 10 monclient: dump: 2024-09-12T18:02:06.748 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:06.748 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:06.748 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.748 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.749 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:06.749 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.749 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:06.749 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:06.749 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:06.749 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.749 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T18:02:06.395+0000 7fa45b606640 10 monclient: _finish_auth 0 2024-09-12T18:02:06.749 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T18:02:06.395+0000 7fa45b606640 10 monclient: _check_auth_tickets 2024-09-12T18:02:06.749 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T18:02:06.395+0000 7fa45b606640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:06.749 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T18:02:06.395+0000 7fa45b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:06.749 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T18:02:06.395+0000 7fa45b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:02:06.749 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T18:02:06.395+0000 7fa45b606640 10 monclient: dump: 2024-09-12T18:02:06.749 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:06.749 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:06.750 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.750 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.750 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:06.750 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.750 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:06.750 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:06.750 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:06.750 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.750 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 monclient: authenticate success, global_id 8400 2024-09-12T18:02:06.750 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient: _renew_subs 2024-09-12T18:02:06.750 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T18:02:06.395+0000 7fa45ce09640 4 set_mon_vals no callback set 2024-09-12T18:02:06.750 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:02:06.751 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient: _renew_subs 2024-09-12T18:02:06.751 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:02:06.751 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T18:02:06.395+0000 7fa570e529c0 1 librados: init done 2024-09-12T18:02:06.751 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T18:02:06.399+0000 7fa45b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:06.751 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T18:02:06.399+0000 7fa45b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:06.751 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T18:02:06.399+0000 7fa45b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:06.751 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T18:02:06.399+0000 7fa56e958640 10 monclient: get_auth_request con 0x7fa454070b10 auth_method 0 2024-09-12T18:02:06.751 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T18:02:06.399+0000 7fa56e157640 10 monclient: get_auth_request con 0x563982af16d0 auth_method 0 2024-09-12T18:02:06.751 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T18:02:06.399+0000 7fa56e958640 10 monclient: get_auth_request con 0x563982b11440 auth_method 0 2024-09-12T18:02:06.751 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T18:02:06.403+0000 7fa56e157640 10 monclient: get_auth_request con 0x563982b165d0 auth_method 0 2024-09-12T18:02:06.751 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient: build_initial_monmap 2024-09-12T18:02:06.751 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T18:02:06.403+0000 7fa570e529c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:06.751 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient: monmap: 2024-09-12T18:02:06.752 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:02:06.752 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:06.752 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:02:06.752 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:02:06.752 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:06.752 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.752 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:02:06.752 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:02:06.752 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:02:06.752 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.752 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding auth protocol: cephx 2024-09-12T18:02:06.752 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding auth protocol: cephx 2024-09-12T18:02:06.752 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding auth protocol: cephx 2024-09-12T18:02:06.753 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: secure 2024-09-12T18:02:06.753 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: crc 2024-09-12T18:02:06.753 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: secure 2024-09-12T18:02:06.753 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: crc 2024-09-12T18:02:06.753 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: secure 2024-09-12T18:02:06.753 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: crc 2024-09-12T18:02:06.753 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: crc 2024-09-12T18:02:06.753 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: secure 2024-09-12T18:02:06.753 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: crc 2024-09-12T18:02:06.753 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: secure 2024-09-12T18:02:06.753 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: crc 2024-09-12T18:02:06.753 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: secure 2024-09-12T18:02:06.753 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T18:02:06.403+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.754 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command objecter_requests cmddesc objecter_requests hook 0x563982b1df80 EEXIST 2024-09-12T18:02:06.754 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient: init 2024-09-12T18:02:06.754 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding auth protocol: cephx 2024-09-12T18:02:06.754 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding auth protocol: cephx 2024-09-12T18:02:06.754 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding auth protocol: cephx 2024-09-12T18:02:06.754 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: secure 2024-09-12T18:02:06.754 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: crc 2024-09-12T18:02:06.754 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: secure 2024-09-12T18:02:06.754 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: crc 2024-09-12T18:02:06.754 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: secure 2024-09-12T18:02:06.754 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: crc 2024-09-12T18:02:06.754 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: crc 2024-09-12T18:02:06.754 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: secure 2024-09-12T18:02:06.755 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: crc 2024-09-12T18:02:06.755 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: secure 2024-09-12T18:02:06.755 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: crc 2024-09-12T18:02:06.755 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: secure 2024-09-12T18:02:06.755 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T18:02:06.403+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.755 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T18:02:06.403+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.755 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command rotate-key cmddesc rotate-key hook 0x563982b19750 EEXIST 2024-09-12T18:02:06.755 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:06.755 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:02:06.755 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-c con 0x563982b42130 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:02:06.755 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-a con 0x563982b41a60 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:02:06.755 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-b con 0x563982b40440 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:02:06.755 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.756 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.756 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.756 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:06.756 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient(hunting): authenticate will time out at 2922.975538s 2024-09-12T18:02:06.756 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T18:02:06.403+0000 7fa56e958640 10 monclient(hunting): get_auth_request con 0x563982b42130 auth_method 0 2024-09-12T18:02:06.756 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T18:02:06.403+0000 7fa56e958640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:06.756 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T18:02:06.403+0000 7fa56e958640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:06.756 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T18:02:06.403+0000 7fa56e958640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:06.756 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T18:02:06.403+0000 7fa56e157640 10 monclient(hunting): get_auth_request con 0x563982b41a60 auth_method 0 2024-09-12T18:02:06.756 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T18:02:06.403+0000 7fa56e157640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:06.756 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T18:02:06.403+0000 7fa56e157640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:06.756 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T18:02:06.403+0000 7fa56e157640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:06.756 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T18:02:06.403+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:06.756 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T18:02:06.403+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:06.757 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T18:02:06.403+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:06.757 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T18:02:06.403+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:06.757 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T18:02:06.403+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:06.757 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T18:02:06.403+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:06.757 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T18:02:06.403+0000 7fa56e958640 10 monclient(hunting): handle_auth_done global_id 7739 payload 824 2024-09-12T18:02:06.757 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T18:02:06.403+0000 7fa56e958640 10 monclient: _finish_hunting 0 2024-09-12T18:02:06.757 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T18:02:06.403+0000 7fa56e958640 1 monclient: found mon.noname-c 2024-09-12T18:02:06.757 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T18:02:06.403+0000 7fa56e958640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:02:06.757 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T18:02:06.403+0000 7fa56f159640 10 monclient: get_auth_request con 0x563982b40440 auth_method 0 2024-09-12T18:02:06.757 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T18:02:06.407+0000 7fa458e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:06.757 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T18:02:06.407+0000 7fa458e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:06.757 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T18:02:06.407+0000 7fa458e01640 10 monclient: dump: 2024-09-12T18:02:06.757 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:06.758 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:06.758 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.758 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.758 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:06.758 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.758 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:06.758 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:06.758 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:06.758 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.758 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T18:02:06.407+0000 7fa458e01640 10 monclient: _finish_auth 0 2024-09-12T18:02:06.758 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T18:02:06.407+0000 7fa458e01640 10 monclient: _check_auth_tickets 2024-09-12T18:02:06.758 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T18:02:06.407+0000 7fa458e01640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:06.758 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T18:02:06.407+0000 7fa458e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:06.758 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T18:02:06.407+0000 7fa458e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:06.759 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T18:02:06.407+0000 7fa458e01640 10 monclient: dump: 2024-09-12T18:02:06.759 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:06.759 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:06.759 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.759 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.759 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:06.759 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.759 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:06.759 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:06.759 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:06.759 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.759 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T18:02:06.407+0000 7fa56f95a640 4 set_mon_vals no callback set 2024-09-12T18:02:06.759 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 monclient: authenticate success, global_id 7739 2024-09-12T18:02:06.760 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T18:02:06.407+0000 7fa570e529c0 10 monclient: _renew_subs 2024-09-12T18:02:06.760 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T18:02:06.407+0000 7fa570e529c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:06.760 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T18:02:06.407+0000 7fa570e529c0 10 monclient: _renew_subs 2024-09-12T18:02:06.760 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T18:02:06.407+0000 7fa570e529c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:06.760 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T18:02:06.407+0000 7fa458e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:06.760 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T18:02:06.407+0000 7fa458e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:06.760 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T18:02:06.407+0000 7fa458e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:06.760 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T18:02:06.407+0000 7fa570e529c0 10 monclient: get_monmap_and_config 2024-09-12T18:02:06.760 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T18:02:06.407+0000 7fa570e529c0 10 monclient: build_initial_monmap 2024-09-12T18:02:06.760 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T18:02:06.407+0000 7fa570e529c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:06.760 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T18:02:06.407+0000 7fa570e529c0 10 monclient: monmap: 2024-09-12T18:02:06.760 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:02:06.760 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:06.761 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:02:06.761 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:02:06.761 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:06.761 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.761 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:02:06.761 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:02:06.761 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:02:06.761 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.761 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding auth protocol: cephx 2024-09-12T18:02:06.761 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding auth protocol: cephx 2024-09-12T18:02:06.761 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding auth protocol: cephx 2024-09-12T18:02:06.761 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: secure 2024-09-12T18:02:06.761 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: crc 2024-09-12T18:02:06.762 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: secure 2024-09-12T18:02:06.762 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: crc 2024-09-12T18:02:06.762 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: secure 2024-09-12T18:02:06.762 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: crc 2024-09-12T18:02:06.762 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: crc 2024-09-12T18:02:06.762 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: secure 2024-09-12T18:02:06.762 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: crc 2024-09-12T18:02:06.762 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: secure 2024-09-12T18:02:06.762 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: crc 2024-09-12T18:02:06.762 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: secure 2024-09-12T18:02:06.762 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T18:02:06.407+0000 7fa56e157640 10 monclient: get_auth_request con 0x7fa448070a20 auth_method 0 2024-09-12T18:02:06.762 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T18:02:06.407+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.762 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T18:02:06.407+0000 7fa570e529c0 10 monclient: init 2024-09-12T18:02:06.763 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding auth protocol: cephx 2024-09-12T18:02:06.763 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding auth protocol: cephx 2024-09-12T18:02:06.763 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding auth protocol: cephx 2024-09-12T18:02:06.763 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: secure 2024-09-12T18:02:06.763 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: crc 2024-09-12T18:02:06.763 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: secure 2024-09-12T18:02:06.763 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: crc 2024-09-12T18:02:06.763 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: secure 2024-09-12T18:02:06.763 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: crc 2024-09-12T18:02:06.763 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: crc 2024-09-12T18:02:06.763 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: secure 2024-09-12T18:02:06.763 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: crc 2024-09-12T18:02:06.763 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: secure 2024-09-12T18:02:06.763 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: crc 2024-09-12T18:02:06.764 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: secure 2024-09-12T18:02:06.764 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T18:02:06.411+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.764 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T18:02:06.411+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.764 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffebf517268 EEXIST 2024-09-12T18:02:06.764 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:06.764 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:02:06.764 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-a con 0x563982b95e00 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:02:06.764 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-c con 0x563982b961e0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:02:06.764 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-b con 0x563982b919c0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:02:06.764 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.764 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.764 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.764 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:06.765 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): authenticate will time out at 2922.980350s 2024-09-12T18:02:06.765 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): get_auth_request con 0x563982b961e0 auth_method 0 2024-09-12T18:02:06.765 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:06.765 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:06.765 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:06.765 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): get_auth_request con 0x563982b95e00 auth_method 0 2024-09-12T18:02:06.765 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:06.765 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:06.765 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:06.765 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:06.765 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:06.765 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:06.765 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:06.765 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:06.766 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:06.766 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): handle_auth_done global_id 7742 payload 274 2024-09-12T18:02:06.766 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient: _finish_hunting 0 2024-09-12T18:02:06.766 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T18:02:06.411+0000 7fa56e157640 1 monclient: found mon.noname-c 2024-09-12T18:02:06.766 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:02:06.766 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T18:02:06.411+0000 7fa4527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:06.766 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T18:02:06.411+0000 7fa4527fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:06.766 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T18:02:06.411+0000 7fa4527fc640 10 monclient: dump: 2024-09-12T18:02:06.766 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:06.766 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:06.766 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.766 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.766 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:06.766 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.767 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:06.767 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:06.767 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:06.767 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.767 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T18:02:06.411+0000 7fa4527fc640 10 monclient: _finish_auth 0 2024-09-12T18:02:06.767 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T18:02:06.411+0000 7fa4527fc640 10 monclient: _check_auth_tickets 2024-09-12T18:02:06.767 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T18:02:06.411+0000 7fa4527fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:06.767 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 monclient: authenticate success, global_id 7742 2024-09-12T18:02:06.767 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient: get_monmap_and_config success 2024-09-12T18:02:06.767 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T18:02:06.411+0000 7fa570e529c0 4 set_mon_vals no callback set 2024-09-12T18:02:06.767 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T18:02:06.411+0000 7fa4527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:06.767 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T18:02:06.411+0000 7fa4527fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:06.767 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T18:02:06.411+0000 7fa4527fc640 10 monclient: dump: 2024-09-12T18:02:06.767 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:06.767 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:06.768 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.768 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.768 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:06.768 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.768 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:06.768 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:06.768 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:06.768 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.768 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient: shutdown 2024-09-12T18:02:06.768 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient: build_initial_monmap 2024-09-12T18:02:06.768 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T18:02:06.411+0000 7fa570e529c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:06.768 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient: monmap: 2024-09-12T18:02:06.768 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:02:06.768 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:06.769 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:02:06.769 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:02:06.769 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:06.769 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.769 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:02:06.769 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:02:06.769 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:02:06.769 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.769 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding auth protocol: cephx 2024-09-12T18:02:06.769 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding auth protocol: cephx 2024-09-12T18:02:06.769 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding auth protocol: cephx 2024-09-12T18:02:06.769 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: secure 2024-09-12T18:02:06.769 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: crc 2024-09-12T18:02:06.769 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: secure 2024-09-12T18:02:06.770 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: crc 2024-09-12T18:02:06.770 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: secure 2024-09-12T18:02:06.770 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: crc 2024-09-12T18:02:06.770 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: crc 2024-09-12T18:02:06.770 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: secure 2024-09-12T18:02:06.770 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: crc 2024-09-12T18:02:06.770 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: secure 2024-09-12T18:02:06.770 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: crc 2024-09-12T18:02:06.770 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: secure 2024-09-12T18:02:06.770 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T18:02:06.411+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.770 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T18:02:06.411+0000 7fa570e529c0 1 librados: starting msgr at 2024-09-12T18:02:06.770 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T18:02:06.411+0000 7fa570e529c0 1 librados: starting objecter 2024-09-12T18:02:06.770 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command objecter_requests cmddesc objecter_requests hook 0x563982b64f10 EEXIST 2024-09-12T18:02:06.770 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T18:02:06.411+0000 7fa570e529c0 1 librados: setting wanted keys 2024-09-12T18:02:06.771 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T18:02:06.411+0000 7fa570e529c0 1 librados: calling monclient init 2024-09-12T18:02:06.771 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient: init 2024-09-12T18:02:06.771 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding auth protocol: cephx 2024-09-12T18:02:06.771 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding auth protocol: cephx 2024-09-12T18:02:06.771 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding auth protocol: cephx 2024-09-12T18:02:06.771 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: secure 2024-09-12T18:02:06.771 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: crc 2024-09-12T18:02:06.771 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: secure 2024-09-12T18:02:06.771 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: crc 2024-09-12T18:02:06.771 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: secure 2024-09-12T18:02:06.771 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: crc 2024-09-12T18:02:06.771 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: crc 2024-09-12T18:02:06.771 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: secure 2024-09-12T18:02:06.771 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: crc 2024-09-12T18:02:06.772 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: secure 2024-09-12T18:02:06.772 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: crc 2024-09-12T18:02:06.772 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: secure 2024-09-12T18:02:06.772 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T18:02:06.411+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.772 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T18:02:06.411+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.772 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command rotate-key cmddesc rotate-key hook 0x563982b44098 EEXIST 2024-09-12T18:02:06.772 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:06.772 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:02:06.772 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-a con 0x563982b919c0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:02:06.772 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-c con 0x563982b95e00 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:02:06.772 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-b con 0x563982b8ef80 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:02:06.772 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.772 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.773 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.773 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:06.773 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): authenticate will time out at 2922.982937s 2024-09-12T18:02:06.773 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): get_auth_request con 0x563982b95e00 auth_method 0 2024-09-12T18:02:06.773 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:06.773 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:06.773 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:06.773 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): get_auth_request con 0x563982b919c0 auth_method 0 2024-09-12T18:02:06.773 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:06.773 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:06.773 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:06.773 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:06.773 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:06.773 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:06.774 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:06.774 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:06.774 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:06.774 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): handle_auth_done global_id 7745 payload 824 2024-09-12T18:02:06.774 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient: _finish_hunting 0 2024-09-12T18:02:06.774 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T18:02:06.411+0000 7fa56e157640 1 monclient: found mon.noname-c 2024-09-12T18:02:06.774 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:02:06.774 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T18:02:06.411+0000 7fa450ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:06.774 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T18:02:06.411+0000 7fa450ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:06.774 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T18:02:06.411+0000 7fa450ff9640 10 monclient: dump: 2024-09-12T18:02:06.774 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:06.774 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:06.774 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.775 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.775 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:06.775 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.775 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:06.775 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:06.775 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:06.775 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.776 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T18:02:06.411+0000 7fa450ff9640 10 monclient: _finish_auth 0 2024-09-12T18:02:06.776 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T18:02:06.411+0000 7fa450ff9640 10 monclient: _check_auth_tickets 2024-09-12T18:02:06.776 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T18:02:06.411+0000 7fa450ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:06.776 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T18:02:06.411+0000 7fa450ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:06.776 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T18:02:06.411+0000 7fa450ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:06.776 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T18:02:06.411+0000 7fa450ff9640 10 monclient: dump: 2024-09-12T18:02:06.776 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:06.776 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:06.776 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.776 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.776 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:06.776 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.776 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:06.777 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:06.777 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:06.777 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.777 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T18:02:06.411+0000 7fa4527fc640 4 set_mon_vals no callback set 2024-09-12T18:02:06.777 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T18:02:06.415+0000 7fa570e529c0 5 monclient: authenticate success, global_id 7745 2024-09-12T18:02:06.777 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T18:02:06.415+0000 7fa570e529c0 10 monclient: _renew_subs 2024-09-12T18:02:06.777 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T18:02:06.415+0000 7fa570e529c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:06.777 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T18:02:06.415+0000 7fa570e529c0 10 monclient: _renew_subs 2024-09-12T18:02:06.777 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T18:02:06.415+0000 7fa570e529c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:06.777 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T18:02:06.415+0000 7fa570e529c0 1 librados: init done 2024-09-12T18:02:06.777 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T18:02:06.415+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command cr dump hook 0x563982b8a6a8 2024-09-12T18:02:06.777 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.777 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T18:02:06.415+0000 7fa450ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:06.777 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T18:02:06.415+0000 7fa450ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:06.778 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T18:02:06.415+0000 7fa450ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:06.778 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T18:02:06.415+0000 7fa56f159640 10 monclient: get_auth_request con 0x563982bafcf0 auth_method 0 2024-09-12T18:02:06.778 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T18:02:06.415+0000 7fa56e958640 10 monclient: get_auth_request con 0x7fa438070ae0 auth_method 0 2024-09-12T18:02:06.778 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.778 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T18:02:06.415+0000 7fa570e529c0 20 realm 2024-09-12T18:02:06.778 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.778 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.778 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T18:02:06.415+0000 7fa570e529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:06.778 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.778 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.778 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.778 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T18:02:06.419+0000 7fa56e958640 10 monclient: get_auth_request con 0x563982bb3db0 auth_method 0 2024-09-12T18:02:06.778 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T18:02:06.419+0000 7fa570e529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:06.778 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T18:02:06.419+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.779 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T18:02:06.419+0000 7fa570e529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:06.779 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T18:02:06.419+0000 7fa570e529c0 20 searching for the correct realm 2024-09-12T18:02:06.779 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T18:02:06.419+0000 7fa56e157640 10 monclient: get_auth_request con 0x563982bb9090 auth_method 0 2024-09-12T18:02:06.779 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T18:02:06.419+0000 7fa56f159640 10 monclient: get_auth_request con 0x7fa5580c3620 auth_method 0 2024-09-12T18:02:06.779 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T18:02:06.423+0000 7fa56e958640 10 monclient: get_auth_request con 0x7fa56005fdb0 auth_method 0 2024-09-12T18:02:06.779 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T18:02:06.423+0000 7fa56e157640 10 monclient: get_auth_request con 0x7fa568008040 auth_method 0 2024-09-12T18:02:06.779 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T18:02:06.427+0000 7fa56f159640 0 -- 172.21.15.98:0/1942326995 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7fa55810aca0 msgr2=0x7fa5581370b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:06.779 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T18:02:06.427+0000 7fa56f159640 10 monclient: get_auth_request con 0x7fa55810aca0 auth_method 0 2024-09-12T18:02:06.779 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T18:02:06.631+0000 7fa56f159640 10 monclient: get_auth_request con 0x7fa55810aca0 auth_method 0 2024-09-12T18:02:06.779 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T18:02:06.639+0000 7fa56e958640 10 monclient: get_auth_request con 0x7fa558117720 auth_method 0 2024-09-12T18:02:06.779 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T18:02:06.643+0000 7fa56e958640 0 -- 172.21.15.98:0/1942326995 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x563982bb3db0 msgr2=0x563982bb6250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:06.779 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T18:02:06.643+0000 7fa450ff9640 1 client.7745.objecter ms_handle_reset 0x563982bb3db0 session 0x563982baf4e0 osd.5 2024-09-12T18:02:06.779 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T18:02:06.643+0000 7fa450ff9640 10 monclient: _renew_subs 2024-09-12T18:02:06.779 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T18:02:06.643+0000 7fa450ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:06.780 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T18:02:06.643+0000 7fa56e958640 10 monclient: get_auth_request con 0x7fa438081180 auth_method 0 2024-09-12T18:02:06.780 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:06.780 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:02:06.780 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:06.780 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:02:06.780 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:06.780 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:06.780 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.780 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.780 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.780 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:06.780 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.780 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:06.781 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 zone default found 2024-09-12T18:02:06.781 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T18:02:06.651+0000 7fa570e529c0 4 Realm: () 2024-09-12T18:02:06.781 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T18:02:06.651+0000 7fa570e529c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:02:06.781 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T18:02:06.651+0000 7fa570e529c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:02:06.781 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T18:02:06.651+0000 7fa570e529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:06.781 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 zonegroup default 2024-09-12T18:02:06.781 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T18:02:06.655+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.781 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T18:02:06.655+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.781 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T18:02:06.655+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.781 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T18:02:06.655+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.781 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T18:02:06.655+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.781 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T18:02:06.655+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.781 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T18:02:06.655+0000 7fa570e529c0 20 started sync module instance, tier type = 2024-09-12T18:02:06.781 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T18:02:06.655+0000 7fa570e529c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:02:06.781 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=0 2024-09-12T18:02:06.782 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=1 2024-09-12T18:02:06.782 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=2 2024-09-12T18:02:06.782 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=3 2024-09-12T18:02:06.782 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=4 2024-09-12T18:02:06.782 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=5 2024-09-12T18:02:06.782 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=6 2024-09-12T18:02:06.782 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T18:02:06.683+0000 7fa570e529c0 20 add_watcher() i=7 2024-09-12T18:02:06.782 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T18:02:06.683+0000 7fa570e529c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:06.782 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding auth protocol: cephx 2024-09-12T18:02:06.782 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding auth protocol: cephx 2024-09-12T18:02:06.782 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding auth protocol: cephx 2024-09-12T18:02:06.782 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: secure 2024-09-12T18:02:06.782 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: crc 2024-09-12T18:02:06.783 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: secure 2024-09-12T18:02:06.783 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: crc 2024-09-12T18:02:06.783 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: secure 2024-09-12T18:02:06.783 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: crc 2024-09-12T18:02:06.783 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T18:02:06.687+0000 7fa425fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:06.783 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: crc 2024-09-12T18:02:06.783 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: secure 2024-09-12T18:02:06.783 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: crc 2024-09-12T18:02:06.783 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: secure 2024-09-12T18:02:06.783 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: crc 2024-09-12T18:02:06.783 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: secure 2024-09-12T18:02:06.783 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T18:02:06.687+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.783 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T18:02:06.687+0000 7fa570e529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:06.783 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T18:02:06.687+0000 7fa570e529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:06.784 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command cache list hook 0x563982b8f3c0 2024-09-12T18:02:06.784 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command cache inspect hook 0x563982b8f3c0 2024-09-12T18:02:06.784 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command cache erase hook 0x563982b8f3c0 2024-09-12T18:02:06.784 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command cache zap hook 0x563982b8f3c0 2024-09-12T18:02:06.784 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 note: GC not initialized 2024-09-12T18:02:06.784 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T18:02:06.687+0000 7fa424fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:06.784 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command sync trace show hook 0x7fa5580accf0 2024-09-12T18:02:06.784 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command sync trace history hook 0x7fa5580accf0 2024-09-12T18:02:06.784 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command sync trace active hook 0x7fa5580accf0 2024-09-12T18:02:06.784 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command sync trace active_short hook 0x7fa5580accf0 2024-09-12T18:02:06.784 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T18:02:06.687+0000 7fa570e529c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:06.784 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T18:02:06.687+0000 7fa570e529c0 20 Filter name: none 2024-09-12T18:02:06.784 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T18:02:06.687+0000 7fa41dffb640 20 reqs_thread_entry: start 2024-09-12T18:02:06.785 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T18:02:06.687+0000 7fa570e529c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:02:06.785 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T18:02:06.687+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.785 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T18:02:06.691+0000 7fa570e529c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:06.785 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T18:02:06.691+0000 7fa570e529c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:02:06.785 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T18:02:06.691+0000 7fa570e529c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:02:06.785 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T18:02:06.691+0000 7fa570e529c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T18:02:06.785 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T18:02:06.691+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.785 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T18:02:06.691+0000 7fa570e529c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:02:06.785 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T18:02:06.691+0000 7fa570e529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:02:06.785 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T18:02:06.691+0000 7fa570e529c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:02:06.785 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T18:02:06.691+0000 7fa570e529c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:06.785 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T18:02:06.691+0000 7fa570e529c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:06.785 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T18:02:06.691+0000 7fa570e529c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:02:06.785 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T18:02:06.695+0000 7fa570e529c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:02:06.786 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T18:02:06.707+0000 7fa570e529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:02:06.786 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T18:02:06.707+0000 7fa570e529c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:02:06.786 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T18:02:06.707+0000 7fa570e529c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:06.786 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T18:02:06.707+0000 7fa570e529c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T18:02:06.786 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T18:02:06.707+0000 7fa451ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366221 cookie 94805006471024 notifier 7745 bl.length()=827 2024-09-12T18:02:06.786 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T18:02:06.707+0000 7fa451ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:02:06.786 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T18:02:06.707+0000 7fa451ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:02:06.786 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T18:02:06.707+0000 7fa451ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:06.786 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T18:02:06.711+0000 7fa570e529c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T18:02:06.786 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T18:02:06.711+0000 7fa570e529c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T18:02:06.786 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T18:02:06.711+0000 7fa570e529c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T18:02:06.786 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T18:02:06.711+0000 7fa570e529c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T18:02:06.786 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T18:02:06.719+0000 7fa570e529c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa570e529c0 time 2024-09-12T18:02:06.721891+0000 2024-09-12T18:02:06.786 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:02:06.787 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.787 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:06.787 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa57472c2eb] 2024-09-12T18:02:06.787 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa57472c49f] 2024-09-12T18:02:06.787 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5639815410c1] 2024-09-12T18:02:06.787 INFO:tasks.workunit.client.0.smithi098.stderr: 4: radosgw-admin(+0x14100ec) [0x563981f970ec] 2024-09-12T18:02:06.787 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56398155318d] 2024-09-12T18:02:06.787 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T18:02:06.787 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa573592d90] 2024-09-12T18:02:06.787 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T18:02:06.787 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T18:02:06.787 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.787 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T18:02:06.723+0000 7fa570e529c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:02:06.788 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7fa570e529c0 thread_name:radosgw-admin 2024-09-12T18:02:06.788 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.788 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:06.788 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa5735ab520] 2024-09-12T18:02:06.788 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T18:02:06.788 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T18:02:06.788 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T18:02:06.788 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa57472c345] 2024-09-12T18:02:06.788 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa57472c49f] 2024-09-12T18:02:06.788 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5639815410c1] 2024-09-12T18:02:06.788 INFO:tasks.workunit.client.0.smithi098.stderr: 8: radosgw-admin(+0x14100ec) [0x563981f970ec] 2024-09-12T18:02:06.788 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56398155318d] 2024-09-12T18:02:06.788 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T18:02:06.789 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa573592d90] 2024-09-12T18:02:06.789 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T18:02:06.789 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T18:02:06.789 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:02:06.789 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.789 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T18:02:06.789 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T18:02:06.789 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T18:02:06.789 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T18:02:06.789 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T18:02:06.789 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T18:02:06.789 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T18:02:06.789 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T18:02:06.789 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T18:02:06.790 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T18:02:06.790 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T18:02:06.790 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T18:02:06.790 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T18:02:06.790 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T18:02:06.790 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T18:02:06.790 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T18:02:06.790 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T18:02:06.790 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T18:02:06.790 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T18:02:06.790 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T18:02:06.790 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T18:02:06.790 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T18:02:06.790 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T18:02:06.790 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T18:02:06.791 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:02:06.791 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T18:02:06.791 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T18:02:06.791 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T18:02:06.791 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T18:02:06.791 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T18:02:06.791 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T18:02:06.791 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T18:02:06.791 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T18:02:06.791 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T18:02:06.791 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T18:02:06.791 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T18:02:06.791 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T18:02:06.791 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T18:02:06.792 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T18:02:06.792 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T18:02:06.792 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T18:02:06.792 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T18:02:06.792 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T18:02:06.792 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T18:02:06.792 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T18:02:06.792 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T18:02:06.792 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:02:06.792 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T18:02:06.792 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:02:06.792 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T18:02:06.792 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T18:02:06.793 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T18:02:06.793 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T18:02:06.793 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T18:02:06.793 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T18:02:06.793 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T18:02:06.793 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T18:02:06.793 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T18:02:06.793 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T18:02:06.793 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T18:02:06.793 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T18:02:06.793 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T18:02:06.793 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T18:02:06.793 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T18:02:06.793 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T18:02:06.794 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T18:02:06.794 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T18:02:06.794 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:02:06.794 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T18:02:06.794 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:02:06.794 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T18:02:06.794 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T18:02:06.794 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T18:02:06.794 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T18:02:06.794 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T18:02:06.794 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T18:02:06.794 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:02:06.794 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T18:02:06.795 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T18:02:06.795 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:02:06.795 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T18:02:06.795 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T18:02:06.795 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T18:02:06.795 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T18:02:06.795 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T18:02:06.795 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T18:02:06.795 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T18:02:06.795 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T18:02:06.795 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T18:02:06.795 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T18:02:06.795 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T18:02:06.795 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T18:02:06.796 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T18:02:06.796 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:02:06.796 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa41dffb640 / http_manager 2024-09-12T18:02:06.796 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa424fe1640 / http_manager 2024-09-12T18:02:06.796 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa425fe3640 / rgw_dt_lg_renew 2024-09-12T18:02:06.796 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa450ff9640 / ms_dispatch 2024-09-12T18:02:06.796 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa451ffb640 / io_context_pool 2024-09-12T18:02:06.796 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa4527fc640 / io_context_pool 2024-09-12T18:02:06.796 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa458e01640 / ms_dispatch 2024-09-12T18:02:06.796 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa45b606640 / ms_dispatch 2024-09-12T18:02:06.796 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa45ce09640 / io_context_pool 2024-09-12T18:02:06.796 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa56e157640 / msgr-worker-2 2024-09-12T18:02:06.796 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa56e958640 / msgr-worker-1 2024-09-12T18:02:06.797 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa56f159640 / msgr-worker-0 2024-09-12T18:02:06.797 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa56f95a640 / io_context_pool 2024-09-12T18:02:06.797 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa570e529c0 / radosgw-admin 2024-09-12T18:02:06.797 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T18:02:06.797 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T18:02:06.797 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/log/ceph/ceph-client.admin.144723.log 2024-09-12T18:02:06.797 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T18:02:06.797 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T18:02:06.797 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T18:02:06.391+0000 7fa56f159640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:06.797 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T18:02:06.391+0000 7fa56f159640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:06.797 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T18:02:06.391+0000 7fa56f159640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:06.797 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T18:02:06.391+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:06.797 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T18:02:06.391+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:06.798 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T18:02:06.391+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:06.798 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T18:02:06.391+0000 7fa56f159640 10 monclient(hunting): handle_auth_done global_id 7733 payload 274 2024-09-12T18:02:06.798 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T18:02:06.391+0000 7fa56f159640 10 monclient: _finish_hunting 0 2024-09-12T18:02:06.798 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T18:02:06.391+0000 7fa56f159640 1 monclient: found mon.noname-c 2024-09-12T18:02:06.798 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T18:02:06.391+0000 7fa56f159640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:02:06.798 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T18:02:06.391+0000 7fa45ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:06.798 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T18:02:06.391+0000 7fa45ce09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:06.798 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T18:02:06.391+0000 7fa45ce09640 10 monclient: dump: 2024-09-12T18:02:06.798 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:06.798 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:06.798 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.798 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.798 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:06.799 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.799 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:06.799 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:06.799 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:06.799 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.799 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T18:02:06.391+0000 7fa45ce09640 10 monclient: _finish_auth 0 2024-09-12T18:02:06.799 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T18:02:06.391+0000 7fa45ce09640 10 monclient: _check_auth_tickets 2024-09-12T18:02:06.799 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T18:02:06.391+0000 7fa45ce09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:06.799 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T18:02:06.391+0000 7fa45ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:06.799 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T18:02:06.391+0000 7fa45ce09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:06.799 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T18:02:06.391+0000 7fa45ce09640 10 monclient: dump: 2024-09-12T18:02:06.799 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:06.799 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:06.800 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.800 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.800 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:06.800 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.800 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:06.800 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:06.800 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:06.800 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.800 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T18:02:06.391+0000 7fa570e529c0 5 monclient: authenticate success, global_id 7733 2024-09-12T18:02:06.800 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T18:02:06.391+0000 7fa570e529c0 10 monclient: get_monmap_and_config success 2024-09-12T18:02:06.800 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T18:02:06.391+0000 7fa570e529c0 4 set_mon_vals no callback set 2024-09-12T18:02:06.800 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T18:02:06.391+0000 7fa570e529c0 10 monclient: shutdown 2024-09-12T18:02:06.800 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T18:02:06.391+0000 7fa570e529c0 5 asok(0x5639828bb2b0) unregister_commands rotate-key 2024-09-12T18:02:06.801 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient: build_initial_monmap 2024-09-12T18:02:06.801 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T18:02:06.395+0000 7fa570e529c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:06.801 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient: monmap: 2024-09-12T18:02:06.801 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:02:06.801 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:06.801 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:02:06.801 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:02:06.801 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:06.801 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.801 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:02:06.802 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:02:06.802 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:02:06.802 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.802 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding auth protocol: cephx 2024-09-12T18:02:06.802 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding auth protocol: cephx 2024-09-12T18:02:06.802 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding auth protocol: cephx 2024-09-12T18:02:06.802 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: secure 2024-09-12T18:02:06.802 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: crc 2024-09-12T18:02:06.802 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: secure 2024-09-12T18:02:06.802 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: crc 2024-09-12T18:02:06.802 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: secure 2024-09-12T18:02:06.802 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: crc 2024-09-12T18:02:06.802 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: crc 2024-09-12T18:02:06.803 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: secure 2024-09-12T18:02:06.803 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: crc 2024-09-12T18:02:06.803 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: secure 2024-09-12T18:02:06.803 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: crc 2024-09-12T18:02:06.803 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982acc090) adding con mode: secure 2024-09-12T18:02:06.803 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T18:02:06.395+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.803 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T18:02:06.395+0000 7fa570e529c0 1 librados: starting msgr at 2024-09-12T18:02:06.803 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T18:02:06.395+0000 7fa570e529c0 1 librados: starting objecter 2024-09-12T18:02:06.803 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command objecter_requests hook 0x563982977f90 2024-09-12T18:02:06.803 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T18:02:06.395+0000 7fa570e529c0 1 librados: setting wanted keys 2024-09-12T18:02:06.803 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T18:02:06.395+0000 7fa570e529c0 1 librados: calling monclient init 2024-09-12T18:02:06.803 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient: init 2024-09-12T18:02:06.803 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding auth protocol: cephx 2024-09-12T18:02:06.803 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding auth protocol: cephx 2024-09-12T18:02:06.804 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding auth protocol: cephx 2024-09-12T18:02:06.804 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: secure 2024-09-12T18:02:06.804 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: crc 2024-09-12T18:02:06.804 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: secure 2024-09-12T18:02:06.804 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: crc 2024-09-12T18:02:06.804 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: secure 2024-09-12T18:02:06.804 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: crc 2024-09-12T18:02:06.804 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: crc 2024-09-12T18:02:06.804 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: secure 2024-09-12T18:02:06.804 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: crc 2024-09-12T18:02:06.804 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: secure 2024-09-12T18:02:06.804 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: crc 2024-09-12T18:02:06.804 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 AuthRegistry(0x563982ac68a0) adding con mode: secure 2024-09-12T18:02:06.805 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T18:02:06.395+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.805 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T18:02:06.395+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.805 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command rotate-key hook 0x563982ac69e8 2024-09-12T18:02:06.805 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:06.805 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:02:06.805 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-b con 0x563982953840 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:02:06.805 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-c con 0x563982a0e9c0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:02:06.805 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-a con 0x563982af3240 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:02:06.805 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.805 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.805 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.805 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:06.805 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient(hunting): authenticate will time out at 2922.965224s 2024-09-12T18:02:06.805 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T18:02:06.395+0000 7fa56f159640 10 monclient(hunting): get_auth_request con 0x563982af3240 auth_method 0 2024-09-12T18:02:06.806 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T18:02:06.395+0000 7fa56f159640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:06.806 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T18:02:06.395+0000 7fa56f159640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:06.806 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T18:02:06.395+0000 7fa56f159640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:06.806 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T18:02:06.395+0000 7fa56e157640 10 monclient(hunting): get_auth_request con 0x563982a0e9c0 auth_method 0 2024-09-12T18:02:06.806 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T18:02:06.395+0000 7fa56e157640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:06.806 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T18:02:06.395+0000 7fa56e157640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:06.806 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T18:02:06.395+0000 7fa56e157640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:06.806 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T18:02:06.395+0000 7fa56f159640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:06.806 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T18:02:06.395+0000 7fa56f159640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:06.806 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T18:02:06.395+0000 7fa56f159640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:06.806 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T18:02:06.395+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:06.806 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T18:02:06.395+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:06.807 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T18:02:06.395+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:06.807 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T18:02:06.395+0000 7fa56f159640 10 monclient(hunting): handle_auth_done global_id 8400 payload 824 2024-09-12T18:02:06.807 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T18:02:06.395+0000 7fa56f159640 10 monclient: _finish_hunting 0 2024-09-12T18:02:06.807 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T18:02:06.395+0000 7fa56f159640 1 monclient: found mon.noname-a 2024-09-12T18:02:06.807 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T18:02:06.395+0000 7fa56f159640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T18:02:06.807 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T18:02:06.395+0000 7fa45b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:06.807 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T18:02:06.395+0000 7fa45b606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:02:06.807 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T18:02:06.395+0000 7fa45b606640 10 monclient: dump: 2024-09-12T18:02:06.807 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:06.807 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:06.807 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.807 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.807 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:06.808 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.808 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:06.808 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:06.808 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:06.808 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.808 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T18:02:06.395+0000 7fa45b606640 10 monclient: _finish_auth 0 2024-09-12T18:02:06.808 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T18:02:06.395+0000 7fa45b606640 10 monclient: _check_auth_tickets 2024-09-12T18:02:06.808 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T18:02:06.395+0000 7fa45b606640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:06.808 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T18:02:06.395+0000 7fa45b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:06.808 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T18:02:06.395+0000 7fa45b606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:02:06.808 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T18:02:06.395+0000 7fa45b606640 10 monclient: dump: 2024-09-12T18:02:06.808 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:06.808 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:06.808 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.809 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.809 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:06.809 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.809 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:06.809 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:06.809 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:06.809 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.809 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T18:02:06.395+0000 7fa570e529c0 5 monclient: authenticate success, global_id 8400 2024-09-12T18:02:06.809 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient: _renew_subs 2024-09-12T18:02:06.809 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T18:02:06.395+0000 7fa45ce09640 4 set_mon_vals no callback set 2024-09-12T18:02:06.810 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:02:06.810 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient: _renew_subs 2024-09-12T18:02:06.810 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T18:02:06.395+0000 7fa570e529c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.98:3300/0 2024-09-12T18:02:06.810 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T18:02:06.395+0000 7fa570e529c0 1 librados: init done 2024-09-12T18:02:06.810 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T18:02:06.399+0000 7fa45b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:06.810 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T18:02:06.399+0000 7fa45b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:06.810 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T18:02:06.399+0000 7fa45b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:06.810 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T18:02:06.399+0000 7fa56e958640 10 monclient: get_auth_request con 0x7fa454070b10 auth_method 0 2024-09-12T18:02:06.810 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T18:02:06.399+0000 7fa56e157640 10 monclient: get_auth_request con 0x563982af16d0 auth_method 0 2024-09-12T18:02:06.810 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T18:02:06.399+0000 7fa56e958640 10 monclient: get_auth_request con 0x563982b11440 auth_method 0 2024-09-12T18:02:06.810 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T18:02:06.403+0000 7fa56e157640 10 monclient: get_auth_request con 0x563982b165d0 auth_method 0 2024-09-12T18:02:06.810 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient: build_initial_monmap 2024-09-12T18:02:06.810 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T18:02:06.403+0000 7fa570e529c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:06.811 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient: monmap: 2024-09-12T18:02:06.811 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:02:06.811 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:06.811 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:02:06.811 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:02:06.811 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:06.811 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.811 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:02:06.811 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:02:06.811 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:02:06.811 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.811 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding auth protocol: cephx 2024-09-12T18:02:06.811 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding auth protocol: cephx 2024-09-12T18:02:06.812 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding auth protocol: cephx 2024-09-12T18:02:06.812 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: secure 2024-09-12T18:02:06.812 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: crc 2024-09-12T18:02:06.812 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: secure 2024-09-12T18:02:06.812 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: crc 2024-09-12T18:02:06.812 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: secure 2024-09-12T18:02:06.812 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: crc 2024-09-12T18:02:06.812 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: crc 2024-09-12T18:02:06.812 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: secure 2024-09-12T18:02:06.812 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: crc 2024-09-12T18:02:06.812 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: secure 2024-09-12T18:02:06.812 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: crc 2024-09-12T18:02:06.812 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b1a6c0) adding con mode: secure 2024-09-12T18:02:06.813 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T18:02:06.403+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.813 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command objecter_requests cmddesc objecter_requests hook 0x563982b1df80 EEXIST 2024-09-12T18:02:06.813 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient: init 2024-09-12T18:02:06.813 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding auth protocol: cephx 2024-09-12T18:02:06.813 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding auth protocol: cephx 2024-09-12T18:02:06.813 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding auth protocol: cephx 2024-09-12T18:02:06.813 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: secure 2024-09-12T18:02:06.813 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: crc 2024-09-12T18:02:06.813 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: secure 2024-09-12T18:02:06.813 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: crc 2024-09-12T18:02:06.813 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: secure 2024-09-12T18:02:06.813 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: crc 2024-09-12T18:02:06.814 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: crc 2024-09-12T18:02:06.814 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: secure 2024-09-12T18:02:06.814 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: crc 2024-09-12T18:02:06.814 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: secure 2024-09-12T18:02:06.814 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: crc 2024-09-12T18:02:06.814 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 AuthRegistry(0x563982b19608) adding con mode: secure 2024-09-12T18:02:06.814 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T18:02:06.403+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.814 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T18:02:06.403+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.814 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T18:02:06.403+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command rotate-key cmddesc rotate-key hook 0x563982b19750 EEXIST 2024-09-12T18:02:06.814 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:06.814 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:02:06.814 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-c con 0x563982b42130 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:02:06.814 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-a con 0x563982b41a60 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:02:06.814 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-b con 0x563982b40440 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:02:06.815 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.815 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.815 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.815 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:06.815 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T18:02:06.403+0000 7fa570e529c0 10 monclient(hunting): authenticate will time out at 2922.975538s 2024-09-12T18:02:06.815 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T18:02:06.403+0000 7fa56e958640 10 monclient(hunting): get_auth_request con 0x563982b42130 auth_method 0 2024-09-12T18:02:06.815 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T18:02:06.403+0000 7fa56e958640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:06.815 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T18:02:06.403+0000 7fa56e958640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:06.815 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T18:02:06.403+0000 7fa56e958640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:06.815 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T18:02:06.403+0000 7fa56e157640 10 monclient(hunting): get_auth_request con 0x563982b41a60 auth_method 0 2024-09-12T18:02:06.815 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T18:02:06.403+0000 7fa56e157640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:06.815 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T18:02:06.403+0000 7fa56e157640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:06.815 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T18:02:06.403+0000 7fa56e157640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:06.816 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T18:02:06.403+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:06.816 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T18:02:06.403+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:06.816 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T18:02:06.403+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:06.816 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T18:02:06.403+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:06.816 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T18:02:06.403+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:06.816 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T18:02:06.403+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:06.816 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T18:02:06.403+0000 7fa56e958640 10 monclient(hunting): handle_auth_done global_id 7739 payload 824 2024-09-12T18:02:06.816 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T18:02:06.403+0000 7fa56e958640 10 monclient: _finish_hunting 0 2024-09-12T18:02:06.816 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T18:02:06.403+0000 7fa56e958640 1 monclient: found mon.noname-c 2024-09-12T18:02:06.816 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T18:02:06.403+0000 7fa56e958640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:02:06.816 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T18:02:06.403+0000 7fa56f159640 10 monclient: get_auth_request con 0x563982b40440 auth_method 0 2024-09-12T18:02:06.816 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T18:02:06.407+0000 7fa458e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:06.816 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T18:02:06.407+0000 7fa458e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:06.817 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T18:02:06.407+0000 7fa458e01640 10 monclient: dump: 2024-09-12T18:02:06.817 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:06.817 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:06.817 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.817 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.817 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:06.817 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.817 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:06.817 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:06.817 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:06.817 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.817 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T18:02:06.407+0000 7fa458e01640 10 monclient: _finish_auth 0 2024-09-12T18:02:06.817 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T18:02:06.407+0000 7fa458e01640 10 monclient: _check_auth_tickets 2024-09-12T18:02:06.818 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T18:02:06.407+0000 7fa458e01640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:06.818 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T18:02:06.407+0000 7fa458e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:06.818 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T18:02:06.407+0000 7fa458e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:06.818 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T18:02:06.407+0000 7fa458e01640 10 monclient: dump: 2024-09-12T18:02:06.818 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:06.818 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:06.818 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.818 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.818 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:06.818 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.818 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:06.818 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:06.819 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:06.819 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.819 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T18:02:06.407+0000 7fa56f95a640 4 set_mon_vals no callback set 2024-09-12T18:02:06.819 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 monclient: authenticate success, global_id 7739 2024-09-12T18:02:06.819 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T18:02:06.407+0000 7fa570e529c0 10 monclient: _renew_subs 2024-09-12T18:02:06.819 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T18:02:06.407+0000 7fa570e529c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:06.819 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T18:02:06.407+0000 7fa570e529c0 10 monclient: _renew_subs 2024-09-12T18:02:06.819 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T18:02:06.407+0000 7fa570e529c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:06.819 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T18:02:06.407+0000 7fa458e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:06.819 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T18:02:06.407+0000 7fa458e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:06.819 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T18:02:06.407+0000 7fa458e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:06.820 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T18:02:06.407+0000 7fa570e529c0 10 monclient: get_monmap_and_config 2024-09-12T18:02:06.820 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T18:02:06.407+0000 7fa570e529c0 10 monclient: build_initial_monmap 2024-09-12T18:02:06.820 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T18:02:06.407+0000 7fa570e529c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:06.820 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T18:02:06.407+0000 7fa570e529c0 10 monclient: monmap: 2024-09-12T18:02:06.820 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:02:06.820 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:06.820 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:02:06.820 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:02:06.820 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:06.820 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.820 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:02:06.820 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:02:06.820 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:02:06.821 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.821 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding auth protocol: cephx 2024-09-12T18:02:06.821 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding auth protocol: cephx 2024-09-12T18:02:06.821 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding auth protocol: cephx 2024-09-12T18:02:06.821 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: secure 2024-09-12T18:02:06.821 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: crc 2024-09-12T18:02:06.821 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: secure 2024-09-12T18:02:06.821 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: crc 2024-09-12T18:02:06.821 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: secure 2024-09-12T18:02:06.821 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: crc 2024-09-12T18:02:06.821 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: crc 2024-09-12T18:02:06.821 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: secure 2024-09-12T18:02:06.822 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: crc 2024-09-12T18:02:06.822 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: secure 2024-09-12T18:02:06.822 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: crc 2024-09-12T18:02:06.822 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x563982b61ac0) adding con mode: secure 2024-09-12T18:02:06.822 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T18:02:06.407+0000 7fa56e157640 10 monclient: get_auth_request con 0x7fa448070a20 auth_method 0 2024-09-12T18:02:06.822 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T18:02:06.407+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.822 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T18:02:06.407+0000 7fa570e529c0 10 monclient: init 2024-09-12T18:02:06.822 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding auth protocol: cephx 2024-09-12T18:02:06.822 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding auth protocol: cephx 2024-09-12T18:02:06.822 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding auth protocol: cephx 2024-09-12T18:02:06.822 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: secure 2024-09-12T18:02:06.822 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: crc 2024-09-12T18:02:06.822 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: secure 2024-09-12T18:02:06.822 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: crc 2024-09-12T18:02:06.823 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: secure 2024-09-12T18:02:06.823 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: crc 2024-09-12T18:02:06.823 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: crc 2024-09-12T18:02:06.823 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: secure 2024-09-12T18:02:06.823 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: crc 2024-09-12T18:02:06.823 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: secure 2024-09-12T18:02:06.823 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: crc 2024-09-12T18:02:06.823 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T18:02:06.407+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf517120) adding con mode: secure 2024-09-12T18:02:06.823 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T18:02:06.411+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.823 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T18:02:06.411+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.823 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffebf517268 EEXIST 2024-09-12T18:02:06.823 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:06.823 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:02:06.823 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-a con 0x563982b95e00 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:02:06.824 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-c con 0x563982b961e0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:02:06.824 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-b con 0x563982b919c0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:02:06.824 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.824 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.824 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.824 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:06.824 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): authenticate will time out at 2922.980350s 2024-09-12T18:02:06.824 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): get_auth_request con 0x563982b961e0 auth_method 0 2024-09-12T18:02:06.824 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:06.824 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:06.824 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:06.824 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): get_auth_request con 0x563982b95e00 auth_method 0 2024-09-12T18:02:06.824 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:06.825 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:06.825 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:06.825 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:06.825 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:06.825 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:06.825 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:06.825 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:06.825 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:06.825 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): handle_auth_done global_id 7742 payload 274 2024-09-12T18:02:06.825 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient: _finish_hunting 0 2024-09-12T18:02:06.825 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T18:02:06.411+0000 7fa56e157640 1 monclient: found mon.noname-c 2024-09-12T18:02:06.825 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:02:06.825 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T18:02:06.411+0000 7fa4527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:06.826 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T18:02:06.411+0000 7fa4527fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:06.826 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T18:02:06.411+0000 7fa4527fc640 10 monclient: dump: 2024-09-12T18:02:06.826 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:06.826 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:06.826 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.826 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.826 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:06.826 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.826 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:06.826 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:06.826 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:06.826 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.826 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T18:02:06.411+0000 7fa4527fc640 10 monclient: _finish_auth 0 2024-09-12T18:02:06.826 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T18:02:06.411+0000 7fa4527fc640 10 monclient: _check_auth_tickets 2024-09-12T18:02:06.827 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T18:02:06.411+0000 7fa4527fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:06.827 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 monclient: authenticate success, global_id 7742 2024-09-12T18:02:06.827 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient: get_monmap_and_config success 2024-09-12T18:02:06.827 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T18:02:06.411+0000 7fa570e529c0 4 set_mon_vals no callback set 2024-09-12T18:02:06.827 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T18:02:06.411+0000 7fa4527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:06.827 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T18:02:06.411+0000 7fa4527fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:06.827 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T18:02:06.411+0000 7fa4527fc640 10 monclient: dump: 2024-09-12T18:02:06.827 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:06.827 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:06.827 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.827 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.827 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:06.827 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.828 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:06.828 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:06.828 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:06.828 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.828 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient: shutdown 2024-09-12T18:02:06.828 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient: build_initial_monmap 2024-09-12T18:02:06.828 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T18:02:06.411+0000 7fa570e529c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:06.828 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient: monmap: 2024-09-12T18:02:06.828 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:02:06.828 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:06.828 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:02:06.828 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:02:06.828 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:06.828 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.829 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:02:06.829 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:02:06.829 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:02:06.829 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.829 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding auth protocol: cephx 2024-09-12T18:02:06.829 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding auth protocol: cephx 2024-09-12T18:02:06.829 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding auth protocol: cephx 2024-09-12T18:02:06.829 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: secure 2024-09-12T18:02:06.829 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: crc 2024-09-12T18:02:06.829 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: secure 2024-09-12T18:02:06.829 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: crc 2024-09-12T18:02:06.829 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: secure 2024-09-12T18:02:06.829 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: crc 2024-09-12T18:02:06.829 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: crc 2024-09-12T18:02:06.829 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: secure 2024-09-12T18:02:06.830 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: crc 2024-09-12T18:02:06.830 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: secure 2024-09-12T18:02:06.830 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: crc 2024-09-12T18:02:06.830 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b86640) adding con mode: secure 2024-09-12T18:02:06.830 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T18:02:06.411+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.830 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T18:02:06.411+0000 7fa570e529c0 1 librados: starting msgr at 2024-09-12T18:02:06.830 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T18:02:06.411+0000 7fa570e529c0 1 librados: starting objecter 2024-09-12T18:02:06.830 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command objecter_requests cmddesc objecter_requests hook 0x563982b64f10 EEXIST 2024-09-12T18:02:06.830 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T18:02:06.411+0000 7fa570e529c0 1 librados: setting wanted keys 2024-09-12T18:02:06.830 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T18:02:06.411+0000 7fa570e529c0 1 librados: calling monclient init 2024-09-12T18:02:06.830 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient: init 2024-09-12T18:02:06.830 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding auth protocol: cephx 2024-09-12T18:02:06.830 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding auth protocol: cephx 2024-09-12T18:02:06.830 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding auth protocol: cephx 2024-09-12T18:02:06.830 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: secure 2024-09-12T18:02:06.831 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: crc 2024-09-12T18:02:06.831 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: secure 2024-09-12T18:02:06.831 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: crc 2024-09-12T18:02:06.831 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: secure 2024-09-12T18:02:06.831 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: crc 2024-09-12T18:02:06.831 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: crc 2024-09-12T18:02:06.831 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: secure 2024-09-12T18:02:06.831 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: crc 2024-09-12T18:02:06.831 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: secure 2024-09-12T18:02:06.831 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: crc 2024-09-12T18:02:06.831 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 AuthRegistry(0x563982b43f50) adding con mode: secure 2024-09-12T18:02:06.831 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T18:02:06.411+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.831 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T18:02:06.411+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.831 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T18:02:06.411+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command rotate-key cmddesc rotate-key hook 0x563982b44098 EEXIST 2024-09-12T18:02:06.831 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:06.832 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:02:06.832 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-a con 0x563982b919c0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:02:06.832 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-c con 0x563982b95e00 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:02:06.832 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): picked mon.noname-b con 0x563982b8ef80 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:02:06.832 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.832 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.832 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:06.832 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:06.832 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T18:02:06.411+0000 7fa570e529c0 10 monclient(hunting): authenticate will time out at 2922.982937s 2024-09-12T18:02:06.832 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): get_auth_request con 0x563982b95e00 auth_method 0 2024-09-12T18:02:06.832 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:06.832 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:06.832 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:06.832 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): get_auth_request con 0x563982b919c0 auth_method 0 2024-09-12T18:02:06.833 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:06.833 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:06.833 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:06.833 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:06.833 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:06.833 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:06.833 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:06.833 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:06.833 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T18:02:06.411+0000 7fa56e958640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:06.833 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient(hunting): handle_auth_done global_id 7745 payload 824 2024-09-12T18:02:06.833 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient: _finish_hunting 0 2024-09-12T18:02:06.833 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T18:02:06.411+0000 7fa56e157640 1 monclient: found mon.noname-c 2024-09-12T18:02:06.833 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T18:02:06.411+0000 7fa56e157640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:02:06.833 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T18:02:06.411+0000 7fa450ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:06.834 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T18:02:06.411+0000 7fa450ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:06.834 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T18:02:06.411+0000 7fa450ff9640 10 monclient: dump: 2024-09-12T18:02:06.834 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:06.834 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:06.834 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.834 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.834 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:06.834 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.834 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:06.834 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:06.834 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:06.834 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.834 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T18:02:06.411+0000 7fa450ff9640 10 monclient: _finish_auth 0 2024-09-12T18:02:06.834 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T18:02:06.411+0000 7fa450ff9640 10 monclient: _check_auth_tickets 2024-09-12T18:02:06.835 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T18:02:06.411+0000 7fa450ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:06.835 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T18:02:06.411+0000 7fa450ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:06.835 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T18:02:06.411+0000 7fa450ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:06.835 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T18:02:06.411+0000 7fa450ff9640 10 monclient: dump: 2024-09-12T18:02:06.835 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:06.835 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:06.835 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.835 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:06.835 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:06.835 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:06.835 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:06.835 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:06.836 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:06.836 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.836 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T18:02:06.411+0000 7fa4527fc640 4 set_mon_vals no callback set 2024-09-12T18:02:06.836 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T18:02:06.415+0000 7fa570e529c0 5 monclient: authenticate success, global_id 7745 2024-09-12T18:02:06.836 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T18:02:06.415+0000 7fa570e529c0 10 monclient: _renew_subs 2024-09-12T18:02:06.836 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T18:02:06.415+0000 7fa570e529c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:06.836 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T18:02:06.415+0000 7fa570e529c0 10 monclient: _renew_subs 2024-09-12T18:02:06.836 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T18:02:06.415+0000 7fa570e529c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:06.836 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T18:02:06.415+0000 7fa570e529c0 1 librados: init done 2024-09-12T18:02:06.836 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T18:02:06.415+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command cr dump hook 0x563982b8a6a8 2024-09-12T18:02:06.836 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.836 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T18:02:06.415+0000 7fa450ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:06.836 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T18:02:06.415+0000 7fa450ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:06.837 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T18:02:06.415+0000 7fa450ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:06.837 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T18:02:06.415+0000 7fa56f159640 10 monclient: get_auth_request con 0x563982bafcf0 auth_method 0 2024-09-12T18:02:06.837 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T18:02:06.415+0000 7fa56e958640 10 monclient: get_auth_request con 0x7fa438070ae0 auth_method 0 2024-09-12T18:02:06.837 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.837 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T18:02:06.415+0000 7fa570e529c0 20 realm 2024-09-12T18:02:06.837 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.837 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.837 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T18:02:06.415+0000 7fa570e529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:06.837 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.837 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.837 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T18:02:06.415+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.837 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T18:02:06.419+0000 7fa56e958640 10 monclient: get_auth_request con 0x563982bb3db0 auth_method 0 2024-09-12T18:02:06.837 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T18:02:06.419+0000 7fa570e529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:06.837 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T18:02:06.419+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.838 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T18:02:06.419+0000 7fa570e529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:06.838 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T18:02:06.419+0000 7fa570e529c0 20 searching for the correct realm 2024-09-12T18:02:06.838 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T18:02:06.419+0000 7fa56e157640 10 monclient: get_auth_request con 0x563982bb9090 auth_method 0 2024-09-12T18:02:06.838 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T18:02:06.419+0000 7fa56f159640 10 monclient: get_auth_request con 0x7fa5580c3620 auth_method 0 2024-09-12T18:02:06.838 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T18:02:06.423+0000 7fa56e958640 10 monclient: get_auth_request con 0x7fa56005fdb0 auth_method 0 2024-09-12T18:02:06.838 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T18:02:06.423+0000 7fa56e157640 10 monclient: get_auth_request con 0x7fa568008040 auth_method 0 2024-09-12T18:02:06.838 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T18:02:06.427+0000 7fa56f159640 0 -- 172.21.15.98:0/1942326995 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7fa55810aca0 msgr2=0x7fa5581370b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:06.838 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T18:02:06.427+0000 7fa56f159640 10 monclient: get_auth_request con 0x7fa55810aca0 auth_method 0 2024-09-12T18:02:06.838 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T18:02:06.631+0000 7fa56f159640 10 monclient: get_auth_request con 0x7fa55810aca0 auth_method 0 2024-09-12T18:02:06.838 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T18:02:06.639+0000 7fa56e958640 10 monclient: get_auth_request con 0x7fa558117720 auth_method 0 2024-09-12T18:02:06.838 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T18:02:06.643+0000 7fa56e958640 0 -- 172.21.15.98:0/1942326995 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x563982bb3db0 msgr2=0x563982bb6250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:06.838 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T18:02:06.643+0000 7fa450ff9640 1 client.7745.objecter ms_handle_reset 0x563982bb3db0 session 0x563982baf4e0 osd.5 2024-09-12T18:02:06.838 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T18:02:06.643+0000 7fa450ff9640 10 monclient: _renew_subs 2024-09-12T18:02:06.839 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T18:02:06.643+0000 7fa450ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:06.839 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T18:02:06.643+0000 7fa56e958640 10 monclient: get_auth_request con 0x7fa438081180 auth_method 0 2024-09-12T18:02:06.839 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:06.839 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:02:06.839 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:06.839 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:02:06.839 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:06.839 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:06.839 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.839 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.839 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.839 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:06.839 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.840 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:06.840 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 zone default found 2024-09-12T18:02:06.840 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T18:02:06.651+0000 7fa570e529c0 4 Realm: () 2024-09-12T18:02:06.840 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T18:02:06.651+0000 7fa570e529c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:02:06.840 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T18:02:06.651+0000 7fa570e529c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:02:06.840 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T18:02:06.651+0000 7fa570e529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:06.840 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T18:02:06.651+0000 7fa570e529c0 20 zonegroup default 2024-09-12T18:02:06.840 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T18:02:06.655+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.840 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T18:02:06.655+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.840 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T18:02:06.655+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.840 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T18:02:06.655+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.840 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T18:02:06.655+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.840 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T18:02:06.655+0000 7fa570e529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.841 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T18:02:06.655+0000 7fa570e529c0 20 started sync module instance, tier type = 2024-09-12T18:02:06.841 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T18:02:06.655+0000 7fa570e529c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:02:06.841 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=0 2024-09-12T18:02:06.841 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=1 2024-09-12T18:02:06.841 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=2 2024-09-12T18:02:06.841 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=3 2024-09-12T18:02:06.841 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=4 2024-09-12T18:02:06.841 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=5 2024-09-12T18:02:06.841 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T18:02:06.679+0000 7fa570e529c0 20 add_watcher() i=6 2024-09-12T18:02:06.841 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T18:02:06.683+0000 7fa570e529c0 20 add_watcher() i=7 2024-09-12T18:02:06.841 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T18:02:06.683+0000 7fa570e529c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:06.841 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding auth protocol: cephx 2024-09-12T18:02:06.841 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding auth protocol: cephx 2024-09-12T18:02:06.841 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding auth protocol: cephx 2024-09-12T18:02:06.842 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: secure 2024-09-12T18:02:06.842 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: crc 2024-09-12T18:02:06.842 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: secure 2024-09-12T18:02:06.842 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: crc 2024-09-12T18:02:06.842 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: secure 2024-09-12T18:02:06.842 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: crc 2024-09-12T18:02:06.842 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T18:02:06.687+0000 7fa425fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:06.842 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: crc 2024-09-12T18:02:06.842 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: secure 2024-09-12T18:02:06.842 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: crc 2024-09-12T18:02:06.842 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: secure 2024-09-12T18:02:06.842 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: crc 2024-09-12T18:02:06.842 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 AuthRegistry(0x7ffebf5175f0) adding con mode: secure 2024-09-12T18:02:06.843 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T18:02:06.687+0000 7fa570e529c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:06.843 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T18:02:06.687+0000 7fa570e529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:06.843 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T18:02:06.687+0000 7fa570e529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:06.843 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command cache list hook 0x563982b8f3c0 2024-09-12T18:02:06.843 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command cache inspect hook 0x563982b8f3c0 2024-09-12T18:02:06.843 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command cache erase hook 0x563982b8f3c0 2024-09-12T18:02:06.843 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command cache zap hook 0x563982b8f3c0 2024-09-12T18:02:06.843 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 note: GC not initialized 2024-09-12T18:02:06.843 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T18:02:06.687+0000 7fa424fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:06.843 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command sync trace show hook 0x7fa5580accf0 2024-09-12T18:02:06.843 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command sync trace history hook 0x7fa5580accf0 2024-09-12T18:02:06.843 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command sync trace active hook 0x7fa5580accf0 2024-09-12T18:02:06.843 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T18:02:06.687+0000 7fa570e529c0 5 asok(0x5639828bb2b0) register_command sync trace active_short hook 0x7fa5580accf0 2024-09-12T18:02:06.843 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T18:02:06.687+0000 7fa570e529c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:06.844 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T18:02:06.687+0000 7fa570e529c0 20 Filter name: none 2024-09-12T18:02:06.844 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T18:02:06.687+0000 7fa41dffb640 20 reqs_thread_entry: start 2024-09-12T18:02:06.844 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T18:02:06.687+0000 7fa570e529c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:02:06.844 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T18:02:06.687+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.844 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T18:02:06.691+0000 7fa570e529c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:06.844 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T18:02:06.691+0000 7fa570e529c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:02:06.844 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T18:02:06.691+0000 7fa570e529c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:02:06.844 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T18:02:06.691+0000 7fa570e529c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T18:02:06.844 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T18:02:06.691+0000 7fa570e529c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.844 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T18:02:06.691+0000 7fa570e529c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:02:06.844 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T18:02:06.691+0000 7fa570e529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:02:06.844 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T18:02:06.691+0000 7fa570e529c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:02:06.844 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T18:02:06.691+0000 7fa570e529c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:06.844 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T18:02:06.691+0000 7fa570e529c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:06.845 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T18:02:06.691+0000 7fa570e529c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:02:06.845 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T18:02:06.695+0000 7fa570e529c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:02:06.845 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T18:02:06.707+0000 7fa570e529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:02:06.845 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T18:02:06.707+0000 7fa570e529c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:02:06.845 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T18:02:06.707+0000 7fa570e529c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:06.845 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T18:02:06.707+0000 7fa570e529c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T18:02:06.845 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T18:02:06.707+0000 7fa451ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366221 cookie 94805006471024 notifier 7745 bl.length()=827 2024-09-12T18:02:06.845 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T18:02:06.707+0000 7fa451ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:02:06.845 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T18:02:06.707+0000 7fa451ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:02:06.845 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T18:02:06.707+0000 7fa451ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:06.845 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T18:02:06.711+0000 7fa570e529c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T18:02:06.845 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T18:02:06.711+0000 7fa570e529c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T18:02:06.845 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T18:02:06.711+0000 7fa570e529c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T18:02:06.846 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T18:02:06.711+0000 7fa570e529c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T18:02:06.846 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T18:02:06.719+0000 7fa570e529c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa570e529c0 time 2024-09-12T18:02:06.721891+0000 2024-09-12T18:02:06.846 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:02:06.846 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.846 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:06.846 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa57472c2eb] 2024-09-12T18:02:06.846 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa57472c49f] 2024-09-12T18:02:06.846 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5639815410c1] 2024-09-12T18:02:06.846 INFO:tasks.workunit.client.0.smithi098.stderr: 4: radosgw-admin(+0x14100ec) [0x563981f970ec] 2024-09-12T18:02:06.846 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56398155318d] 2024-09-12T18:02:06.846 INFO:tasks.workunit.client.0.smithi098.stderr: 6: main() 2024-09-12T18:02:06.846 INFO:tasks.workunit.client.0.smithi098.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa573592d90] 2024-09-12T18:02:06.846 INFO:tasks.workunit.client.0.smithi098.stderr: 8: __libc_start_main() 2024-09-12T18:02:06.847 INFO:tasks.workunit.client.0.smithi098.stderr: 9: _start() 2024-09-12T18:02:06.847 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.847 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T18:02:06.723+0000 7fa570e529c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:02:06.847 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7fa570e529c0 thread_name:radosgw-admin 2024-09-12T18:02:06.847 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.847 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:06.847 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa5735ab520] 2024-09-12T18:02:06.847 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T18:02:06.847 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T18:02:06.847 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T18:02:06.847 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa57472c345] 2024-09-12T18:02:06.847 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa57472c49f] 2024-09-12T18:02:06.847 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5639815410c1] 2024-09-12T18:02:06.847 INFO:tasks.workunit.client.0.smithi098.stderr: 8: radosgw-admin(+0x14100ec) [0x563981f970ec] 2024-09-12T18:02:06.848 INFO:tasks.workunit.client.0.smithi098.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56398155318d] 2024-09-12T18:02:06.848 INFO:tasks.workunit.client.0.smithi098.stderr: 10: main() 2024-09-12T18:02:06.848 INFO:tasks.workunit.client.0.smithi098.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa573592d90] 2024-09-12T18:02:06.848 INFO:tasks.workunit.client.0.smithi098.stderr: 12: __libc_start_main() 2024-09-12T18:02:06.848 INFO:tasks.workunit.client.0.smithi098.stderr: 13: _start() 2024-09-12T18:02:06.848 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:02:06.848 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:06.848 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T18:02:06.848 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T18:02:06.848 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T18:02:06.848 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T18:02:06.848 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T18:02:06.848 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T18:02:06.848 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T18:02:06.849 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T18:02:06.849 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T18:02:06.849 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T18:02:06.849 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T18:02:06.849 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T18:02:06.849 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T18:02:06.849 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T18:02:06.849 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T18:02:06.849 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T18:02:06.849 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T18:02:06.849 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T18:02:06.849 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T18:02:06.850 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T18:02:06.850 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T18:02:06.850 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T18:02:06.850 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T18:02:06.850 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T18:02:06.850 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:02:06.850 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T18:02:06.850 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T18:02:06.850 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T18:02:06.850 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T18:02:06.850 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T18:02:06.850 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T18:02:06.850 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T18:02:06.851 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T18:02:06.851 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T18:02:06.851 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T18:02:06.851 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T18:02:06.851 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T18:02:06.851 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T18:02:06.851 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T18:02:06.851 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T18:02:06.851 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T18:02:06.851 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T18:02:06.851 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T18:02:06.851 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T18:02:06.852 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T18:02:06.852 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T18:02:06.852 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:02:06.852 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T18:02:06.852 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:02:06.852 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T18:02:06.852 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T18:02:06.852 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T18:02:06.852 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T18:02:06.852 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T18:02:06.852 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T18:02:06.852 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T18:02:06.852 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T18:02:06.852 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T18:02:06.853 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T18:02:06.853 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T18:02:06.853 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T18:02:06.853 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T18:02:06.853 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T18:02:06.853 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T18:02:06.853 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T18:02:06.853 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T18:02:06.853 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T18:02:06.853 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:02:06.853 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T18:02:06.853 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:02:06.853 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T18:02:06.853 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T18:02:06.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T18:02:06.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T18:02:06.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T18:02:06.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T18:02:06.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:02:06.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T18:02:06.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T18:02:06.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:02:06.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T18:02:06.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T18:02:06.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T18:02:06.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T18:02:06.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T18:02:06.854 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T18:02:06.854 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T18:02:06.854 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T18:02:06.855 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T18:02:06.855 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T18:02:06.855 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T18:02:06.855 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T18:02:06.855 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T18:02:06.855 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:02:06.855 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa41dffb640 / http_manager 2024-09-12T18:02:06.855 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa424fe1640 / http_manager 2024-09-12T18:02:06.855 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa425fe3640 / rgw_dt_lg_renew 2024-09-12T18:02:06.855 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa450ff9640 / ms_dispatch 2024-09-12T18:02:06.855 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa451ffb640 / io_context_pool 2024-09-12T18:02:06.855 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa4527fc640 / io_context_pool 2024-09-12T18:02:06.855 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa458e01640 / ms_dispatch 2024-09-12T18:02:06.855 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa45b606640 / ms_dispatch 2024-09-12T18:02:06.855 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa45ce09640 / io_context_pool 2024-09-12T18:02:06.855 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa56e157640 / msgr-worker-2 2024-09-12T18:02:06.856 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa56e958640 / msgr-worker-1 2024-09-12T18:02:06.856 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa56f159640 / msgr-worker-0 2024-09-12T18:02:06.856 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa56f95a640 / io_context_pool 2024-09-12T18:02:06.856 INFO:tasks.workunit.client.0.smithi098.stderr: 7fa570e529c0 / radosgw-admin 2024-09-12T18:02:06.856 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T18:02:06.856 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T18:02:06.856 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:02:06.724818Z_459bb6f9-4067-42ff-b67a-dde631738b04/log 2024-09-12T18:02:06.856 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T18:02:06.857 INFO:tasks.workunit.client.0.smithi098.stderr:Aborted 2024-09-12T18:02:06.857 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:02:06.857 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:06.857 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:06.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.803+0000 7f29193929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.807+0000 7f29193929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.857 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.807+0000 7f29193929c0 20 realm 2024-09-12T18:02:06.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.807+0000 7f29193929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.807+0000 7f29193929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.807+0000 7f29193929c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:06.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.807+0000 7f29193929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:06.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.807+0000 7f29193929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:06.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:06.807+0000 7f29193929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:07.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.011+0000 7f29193929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:07.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.011+0000 7f29193929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:07.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.011+0000 7f29193929c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:07.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.011+0000 7f29193929c0 20 searching for the correct realm 2024-09-12T18:02:07.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.019+0000 7f2916697640 0 -- 172.21.15.98:0/1510296108 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f290811b070 msgr2=0x7f2908113980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:07.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.031+0000 7f2916e98640 0 -- 172.21.15.98:0/1510296108 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f290c06a330 msgr2=0x7f290c084280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:07.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.247+0000 7f29193929c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:07.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.247+0000 7f29193929c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:02:07.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.247+0000 7f29193929c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:07.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.247+0000 7f29193929c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:02:07.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.247+0000 7f29193929c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:07.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.247+0000 7f29193929c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:07.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.247+0000 7f29193929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:07.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.251+0000 7f29193929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:07.253 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.251+0000 7f29193929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:07.253 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.251+0000 7f29193929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:07.253 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.251+0000 7f29193929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:07.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.251+0000 7f29193929c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:07.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.251+0000 7f29193929c0 20 zone default found 2024-09-12T18:02:07.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.251+0000 7f29193929c0 4 Realm: () 2024-09-12T18:02:07.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.251+0000 7f29193929c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:02:07.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.251+0000 7f29193929c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:02:07.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.251+0000 7f29193929c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:07.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.251+0000 7f29193929c0 20 zonegroup default 2024-09-12T18:02:07.254 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.251+0000 7f29193929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:07.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.251+0000 7f29193929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:07.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.251+0000 7f29193929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:07.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.251+0000 7f29193929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:07.255 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.251+0000 7f29193929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:07.256 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.255+0000 7f29193929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:07.256 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.255+0000 7f29193929c0 20 started sync module instance, tier type = 2024-09-12T18:02:07.256 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.255+0000 7f29193929c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:02:07.278 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.275+0000 7f29193929c0 20 add_watcher() i=0 2024-09-12T18:02:07.278 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.275+0000 7f29193929c0 20 add_watcher() i=1 2024-09-12T18:02:07.278 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.275+0000 7f29193929c0 20 add_watcher() i=2 2024-09-12T18:02:07.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.275+0000 7f29193929c0 20 add_watcher() i=3 2024-09-12T18:02:07.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.275+0000 7f29193929c0 20 add_watcher() i=4 2024-09-12T18:02:07.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.275+0000 7f29193929c0 20 add_watcher() i=5 2024-09-12T18:02:07.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.275+0000 7f29193929c0 20 add_watcher() i=6 2024-09-12T18:02:07.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.279+0000 7f29193929c0 20 add_watcher() i=7 2024-09-12T18:02:07.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.279+0000 7f29193929c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:07.285 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.283+0000 7f27cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:07.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.283+0000 7f29193929c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:07.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.283+0000 7f29193929c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:07.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.283+0000 7f29193929c0 5 note: GC not initialized 2024-09-12T18:02:07.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.283+0000 7f2747fff640 20 reqs_thread_entry: start 2024-09-12T18:02:07.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.283+0000 7f29193929c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:07.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.283+0000 7f29193929c0 20 Filter name: none 2024-09-12T18:02:07.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.283+0000 7f2745ffb640 20 reqs_thread_entry: start 2024-09-12T18:02:07.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.283+0000 7f29193929c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:02:07.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.283+0000 7f29193929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:07.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.287+0000 7f29193929c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:07.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.287+0000 7f29193929c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:02:07.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.287+0000 7f29193929c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:02:07.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.287+0000 7f29193929c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T18:02:07.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.287+0000 7f29193929c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:07.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.287+0000 7f29193929c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:02:07.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.287+0000 7f29193929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:02:07.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.287+0000 7f29193929c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:02:07.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.287+0000 7f29193929c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:07.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.287+0000 7f29193929c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:07.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.287+0000 7f29193929c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:02:07.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.287+0000 7f29193929c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:02:07.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.287+0000 7f29193929c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:02:07.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.287+0000 7f29193929c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:02:07.291 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.287+0000 7f29193929c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:02:07.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.291+0000 7f29193929c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:02:07.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.291+0000 7f29193929c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:02:07.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.291+0000 7f29193929c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:02:07.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.291+0000 7f29193929c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:02:07.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.291+0000 7f29193929c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:02:07.293 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.291+0000 7f29193929c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:02:07.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.291+0000 7f29193929c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:02:07.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.291+0000 7f29193929c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:02:07.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.291+0000 7f29193929c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:02:07.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.291+0000 7f29193929c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:02:07.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.295+0000 7f29193929c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:02:07.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.295+0000 7f29193929c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:02:07.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.295+0000 7f29193929c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:02:07.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.295+0000 7f29193929c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:02:07.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.295+0000 7f29193929c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:02:07.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.295+0000 7f29193929c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:02:07.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.295+0000 7f29193929c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:02:07.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.295+0000 7f29193929c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:02:07.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.299+0000 7f29193929c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:02:07.300 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.299+0000 7f29193929c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:02:07.301 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.299+0000 7f29193929c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:02:07.301 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.299+0000 7f29193929c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:02:07.304 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.299+0000 7f27cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:07.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.307+0000 7f29193929c0 20 remove_watcher() i=0 2024-09-12T18:02:07.309 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.307+0000 7f29193929c0 2 removed watcher, disabling cache 2024-09-12T18:02:07.311 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.307+0000 7f29193929c0 20 remove_watcher() i=1 2024-09-12T18:02:07.313 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.311+0000 7f29193929c0 20 remove_watcher() i=2 2024-09-12T18:02:07.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.311+0000 7f29193929c0 20 remove_watcher() i=3 2024-09-12T18:02:07.318 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.315+0000 7f29193929c0 20 remove_watcher() i=4 2024-09-12T18:02:07.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.315+0000 7f29193929c0 20 remove_watcher() i=5 2024-09-12T18:02:07.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.319+0000 7f29193929c0 20 remove_watcher() i=6 2024-09-12T18:02:07.323 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:07.319+0000 7f29193929c0 20 remove_watcher() i=7 2024-09-12T18:02:07.340 INFO:tasks.workunit.client.0.smithi098.stderr: test: duplicated entries can be purged manually 2024-09-12T18:02:37.372 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:02:37.405 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:37.405 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:37.450 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.446+0000 7f75437649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.450+0000 7f75437649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.450+0000 7f75437649c0 20 realm 2024-09-12T18:02:37.452 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.450+0000 7f75437649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.450+0000 7f75437649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.450+0000 7f75437649c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:37.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.450+0000 7f75437649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.450+0000 7f75437649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.450+0000 7f75437649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.450+0000 7f75437649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:37.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.450+0000 7f75437649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.450+0000 7f75437649c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:37.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.450+0000 7f75437649c0 20 searching for the correct realm 2024-09-12T18:02:37.460 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.458+0000 7f7540a69640 0 -- 172.21.15.98:0/2925208375 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x5573008c6730 msgr2=0x5573008c8b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:37.466 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.462+0000 7f754126a640 0 -- 172.21.15.98:0/2925208375 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f75380ce410 msgr2=0x7f75380ce870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:37.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.470+0000 7f75437649c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:37.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.470+0000 7f75437649c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:02:37.474 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.470+0000 7f75437649c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:37.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.470+0000 7f75437649c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:02:37.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.470+0000 7f75437649c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:37.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.470+0000 7f75437649c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:37.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.470+0000 7f75437649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.470+0000 7f75437649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.470+0000 7f75437649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.470+0000 7f75437649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:37.475 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.470+0000 7f75437649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.474+0000 7f75437649c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:37.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.474+0000 7f75437649c0 20 zone default found 2024-09-12T18:02:37.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.474+0000 7f75437649c0 4 Realm: () 2024-09-12T18:02:37.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.474+0000 7f75437649c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:02:37.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.474+0000 7f75437649c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:02:37.476 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.474+0000 7f75437649c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:37.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.474+0000 7f75437649c0 20 zonegroup default 2024-09-12T18:02:37.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.474+0000 7f75437649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.474+0000 7f75437649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.477 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.474+0000 7f75437649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.474+0000 7f75437649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.474+0000 7f75437649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.474+0000 7f75437649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.474+0000 7f75437649c0 20 started sync module instance, tier type = 2024-09-12T18:02:37.478 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.474+0000 7f75437649c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:02:37.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.490+0000 7f75437649c0 20 add_watcher() i=0 2024-09-12T18:02:37.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.490+0000 7f75437649c0 20 add_watcher() i=1 2024-09-12T18:02:37.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.490+0000 7f75437649c0 20 add_watcher() i=2 2024-09-12T18:02:37.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.490+0000 7f75437649c0 20 add_watcher() i=3 2024-09-12T18:02:37.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.490+0000 7f75437649c0 20 add_watcher() i=4 2024-09-12T18:02:37.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.490+0000 7f75437649c0 20 add_watcher() i=5 2024-09-12T18:02:37.493 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.490+0000 7f75437649c0 20 add_watcher() i=6 2024-09-12T18:02:37.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.490+0000 7f75437649c0 20 add_watcher() i=7 2024-09-12T18:02:37.494 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.490+0000 7f75437649c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:37.497 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.494+0000 7f73f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:37.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.494+0000 7f75437649c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:37.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.494+0000 7f75437649c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:37.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.494+0000 7f75437649c0 5 note: GC not initialized 2024-09-12T18:02:37.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.494+0000 7f73f67e4640 20 reqs_thread_entry: start 2024-09-12T18:02:37.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.494+0000 7f75437649c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:37.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.494+0000 7f75437649c0 20 Filter name: none 2024-09-12T18:02:37.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.494+0000 7f7367fff640 20 reqs_thread_entry: start 2024-09-12T18:02:37.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.494+0000 7f75437649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.494+0000 7f75437649c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:37.499 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.494+0000 7f75437649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.498+0000 7f75437649c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:02:37.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.498+0000 7f75437649c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:37.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.498+0000 7f75437649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.498+0000 7f75437649c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:37.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.498+0000 7f75437649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.498+0000 7f75437649c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:02:37.503 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.498+0000 7f75437649c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:37.506 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.502+0000 7f73f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:37.510 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.506+0000 7f75437649c0 20 remove_watcher() i=0 2024-09-12T18:02:37.510 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.506+0000 7f75437649c0 2 removed watcher, disabling cache 2024-09-12T18:02:37.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.510+0000 7f75437649c0 20 remove_watcher() i=1 2024-09-12T18:02:37.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.510+0000 7f75437649c0 20 remove_watcher() i=2 2024-09-12T18:02:37.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.514+0000 7f75437649c0 20 remove_watcher() i=3 2024-09-12T18:02:37.519 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.514+0000 7f75437649c0 20 remove_watcher() i=4 2024-09-12T18:02:37.519 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.514+0000 7f75437649c0 20 remove_watcher() i=5 2024-09-12T18:02:37.521 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.518+0000 7f75437649c0 20 remove_watcher() i=6 2024-09-12T18:02:37.522 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.518+0000 7f75437649c0 20 remove_watcher() i=7 2024-09-12T18:02:37.536 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:37.536 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T18:02:37.536 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: a-bucket id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-12T18:02:37.536 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:37.536 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T18:02:37.568 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:37.568 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:37.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.606+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.610+0000 7f54119f79c0 20 realm 2024-09-12T18:02:37.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.610+0000 7f54119f79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:37.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:37.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:37.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:37.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:37.616 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.614+0000 7f54119f79c0 20 searching for the correct realm 2024-09-12T18:02:37.621 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.618+0000 7f540fcfe640 0 -- 172.21.15.98:0/1048950127 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f5404036070 msgr2=0x7f5404020440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:37.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:37.826+0000 7f540f4fd640 0 -- 172.21.15.98:0/1048950127 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f5404073520 msgr2=0x7f5404020440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:38.247 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.242+0000 7f54119f79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:38.248 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.242+0000 7f54119f79c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:02:38.248 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.242+0000 7f54119f79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:38.248 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.242+0000 7f54119f79c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:02:38.248 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.242+0000 7f54119f79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:38.248 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.242+0000 7f54119f79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:38.248 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.242+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.248 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.248 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.249 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:38.249 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:38.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.246+0000 7f54119f79c0 20 zone default found 2024-09-12T18:02:38.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.246+0000 7f54119f79c0 4 Realm: () 2024-09-12T18:02:38.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.246+0000 7f54119f79c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:02:38.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.246+0000 7f54119f79c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:02:38.250 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.246+0000 7f54119f79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:38.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.246+0000 7f54119f79c0 20 zonegroup default 2024-09-12T18:02:38.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.251 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.250+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.250+0000 7f54119f79c0 20 started sync module instance, tier type = 2024-09-12T18:02:38.252 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.250+0000 7f54119f79c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:02:38.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=0 2024-09-12T18:02:38.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=1 2024-09-12T18:02:38.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=2 2024-09-12T18:02:38.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=3 2024-09-12T18:02:38.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=4 2024-09-12T18:02:38.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=5 2024-09-12T18:02:38.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=6 2024-09-12T18:02:38.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=7 2024-09-12T18:02:38.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.270+0000 7f54119f79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:38.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.274+0000 7f52c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:38.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.278+0000 7f54119f79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:38.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.278+0000 7f54119f79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:38.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.278+0000 7f54119f79c0 5 note: GC not initialized 2024-09-12T18:02:38.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.278+0000 7f52c4fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:38.282 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.278+0000 7f54119f79c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:38.282 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.278+0000 7f54119f79c0 20 Filter name: none 2024-09-12T18:02:38.282 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.278+0000 7f523e7fc640 20 reqs_thread_entry: start 2024-09-12T18:02:38.282 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.278+0000 7f54119f79c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:02:38.282 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.278+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.283 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.278+0000 7f54119f79c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:38.283 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.278+0000 7f54119f79c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:02:38.283 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.278+0000 7f54119f79c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:02:38.283 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.278+0000 7f54119f79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T18:02:38.283 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.278+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.282+0000 7f54119f79c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:02:38.285 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.282+0000 7f54119f79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:02:38.285 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.282+0000 7f54119f79c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:02:38.285 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.282+0000 7f54119f79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:38.285 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.282+0000 7f54119f79c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:38.285 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.282+0000 7f54119f79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:02:38.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.282+0000 7f54119f79c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:02:38.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.298+0000 7f54119f79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:02:38.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.298+0000 7f54119f79c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:02:38.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.298+0000 7f54119f79c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:38.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.298+0000 7f54119f79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T18:02:38.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.298+0000 7f52f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366222 cookie 94607934245424 notifier 7796 bl.length()=827 2024-09-12T18:02:38.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.298+0000 7f52f2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:02:38.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.298+0000 7f52f2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:02:38.303 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.298+0000 7f52f2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:38.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.302+0000 7f54119f79c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T18:02:38.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.302+0000 7f54119f79c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T18:02:38.306 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.302+0000 7f54119f79c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T18:02:38.307 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.302+0000 7f54119f79c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T18:02:38.317 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f54119f79c0 time 2024-09-12T18:02:38.317661+0000 2024-09-12T18:02:38.317 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:02:38.318 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:38.318 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f54152d12eb] 2024-09-12T18:02:38.318 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f54152d149f] 2024-09-12T18:02:38.318 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560b9e9f00c1] 2024-09-12T18:02:38.318 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560b9ea021fa] 2024-09-12T18:02:38.318 INFO:tasks.workunit.client.0.smithi098.stderr: 5: main() 2024-09-12T18:02:38.318 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5414137d90] 2024-09-12T18:02:38.318 INFO:tasks.workunit.client.0.smithi098.stderr: 7: __libc_start_main() 2024-09-12T18:02:38.319 INFO:tasks.workunit.client.0.smithi098.stderr: 8: _start() 2024-09-12T18:02:38.319 INFO:tasks.workunit.client.0.smithi098.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:02:38.319 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f54119f79c0 thread_name:radosgw-admin 2024-09-12T18:02:38.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.314+0000 7f54119f79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f54119f79c0 time 2024-09-12T18:02:38.317661+0000 2024-09-12T18:02:38.319 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:02:38.319 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.319 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:38.319 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f54152d12eb] 2024-09-12T18:02:38.319 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f54152d149f] 2024-09-12T18:02:38.319 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560b9e9f00c1] 2024-09-12T18:02:38.319 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560b9ea021fa] 2024-09-12T18:02:38.319 INFO:tasks.workunit.client.0.smithi098.stderr: 5: main() 2024-09-12T18:02:38.319 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5414137d90] 2024-09-12T18:02:38.320 INFO:tasks.workunit.client.0.smithi098.stderr: 7: __libc_start_main() 2024-09-12T18:02:38.320 INFO:tasks.workunit.client.0.smithi098.stderr: 8: _start() 2024-09-12T18:02:38.320 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.335 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:38.335 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5414150520] 2024-09-12T18:02:38.335 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T18:02:38.336 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T18:02:38.336 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T18:02:38.336 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f54152d1345] 2024-09-12T18:02:38.336 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f54152d149f] 2024-09-12T18:02:38.336 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560b9e9f00c1] 2024-09-12T18:02:38.336 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560b9ea021fa] 2024-09-12T18:02:38.336 INFO:tasks.workunit.client.0.smithi098.stderr: 9: main() 2024-09-12T18:02:38.336 INFO:tasks.workunit.client.0.smithi098.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5414137d90] 2024-09-12T18:02:38.336 INFO:tasks.workunit.client.0.smithi098.stderr: 11: __libc_start_main() 2024-09-12T18:02:38.336 INFO:tasks.workunit.client.0.smithi098.stderr: 12: _start() 2024-09-12T18:02:38.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.314+0000 7f54119f79c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:02:38.336 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f54119f79c0 thread_name:radosgw-admin 2024-09-12T18:02:38.336 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.337 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:38.337 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5414150520] 2024-09-12T18:02:38.337 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T18:02:38.337 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T18:02:38.337 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T18:02:38.337 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f54152d1345] 2024-09-12T18:02:38.337 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f54152d149f] 2024-09-12T18:02:38.337 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560b9e9f00c1] 2024-09-12T18:02:38.337 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560b9ea021fa] 2024-09-12T18:02:38.337 INFO:tasks.workunit.client.0.smithi098.stderr: 9: main() 2024-09-12T18:02:38.337 INFO:tasks.workunit.client.0.smithi098.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5414137d90] 2024-09-12T18:02:38.337 INFO:tasks.workunit.client.0.smithi098.stderr: 11: __libc_start_main() 2024-09-12T18:02:38.338 INFO:tasks.workunit.client.0.smithi098.stderr: 12: _start() 2024-09-12T18:02:38.338 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:02:38.338 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.338 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T18:02:38.338 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T18:02:37.586+0000 7f540ecfc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:38.338 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T18:02:37.586+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:38.338 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T18:02:37.586+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:38.338 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T18:02:37.586+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:38.338 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T18:02:37.586+0000 7f540ecfc640 10 monclient(hunting): handle_auth_done global_id 8460 payload 274 2024-09-12T18:02:38.338 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T18:02:37.586+0000 7f540ecfc640 10 monclient: _finish_hunting 0 2024-09-12T18:02:38.338 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T18:02:37.586+0000 7f540ecfc640 1 monclient: found mon.noname-a 2024-09-12T18:02:38.338 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T18:02:37.586+0000 7f540ecfc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T18:02:38.338 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T18:02:37.586+0000 7f540fcfe640 10 monclient: get_auth_request con 0x560ba04146c0 auth_method 0 2024-09-12T18:02:38.339 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T18:02:37.586+0000 7f52fd60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:38.339 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T18:02:37.586+0000 7f52fd60a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:02:38.339 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T18:02:37.586+0000 7f52fd60a640 10 monclient: dump: 2024-09-12T18:02:38.339 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:38.339 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:38.339 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.339 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.339 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:38.339 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.339 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:38.339 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:38.339 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:38.339 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.339 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T18:02:37.586+0000 7f52fd60a640 10 monclient: _finish_auth 0 2024-09-12T18:02:38.340 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T18:02:37.586+0000 7f52fd60a640 10 monclient: _check_auth_tickets 2024-09-12T18:02:38.340 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T18:02:37.586+0000 7f52fd60a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:38.340 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 monclient: authenticate success, global_id 8460 2024-09-12T18:02:38.340 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T18:02:37.586+0000 7f54119f79c0 10 monclient: get_monmap_and_config success 2024-09-12T18:02:38.340 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T18:02:37.586+0000 7f54119f79c0 4 set_mon_vals no callback set 2024-09-12T18:02:38.340 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T18:02:37.586+0000 7f52fd60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:38.340 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T18:02:37.586+0000 7f52fd60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:02:38.340 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T18:02:37.586+0000 7f52fd60a640 10 monclient: dump: 2024-09-12T18:02:38.340 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:38.340 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:38.340 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.340 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.340 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:38.341 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.341 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:38.341 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:38.341 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:38.341 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.341 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T18:02:37.586+0000 7f54119f79c0 10 monclient: shutdown 2024-09-12T18:02:38.341 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 asok(0x560ba02032b0) unregister_commands rotate-key 2024-09-12T18:02:38.341 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T18:02:37.586+0000 7f54119f79c0 10 monclient: build_initial_monmap 2024-09-12T18:02:38.341 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T18:02:37.586+0000 7f54119f79c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:38.341 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T18:02:37.586+0000 7f54119f79c0 10 monclient: monmap: 2024-09-12T18:02:38.341 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:02:38.341 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:38.341 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:02:38.341 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:02:38.342 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:38.342 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.342 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:02:38.342 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:02:38.342 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:02:38.342 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.342 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding auth protocol: cephx 2024-09-12T18:02:38.342 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding auth protocol: cephx 2024-09-12T18:02:38.342 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding auth protocol: cephx 2024-09-12T18:02:38.342 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: secure 2024-09-12T18:02:38.342 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: crc 2024-09-12T18:02:38.342 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: secure 2024-09-12T18:02:38.342 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: crc 2024-09-12T18:02:38.342 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: secure 2024-09-12T18:02:38.343 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: crc 2024-09-12T18:02:38.343 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: crc 2024-09-12T18:02:38.343 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: secure 2024-09-12T18:02:38.343 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: crc 2024-09-12T18:02:38.343 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: secure 2024-09-12T18:02:38.343 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: crc 2024-09-12T18:02:38.343 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: secure 2024-09-12T18:02:38.343 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T18:02:37.586+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.343 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T18:02:37.586+0000 7f54119f79c0 1 librados: starting msgr at 2024-09-12T18:02:38.343 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T18:02:37.586+0000 7f54119f79c0 1 librados: starting objecter 2024-09-12T18:02:38.343 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command objecter_requests hook 0x560ba0413430 2024-09-12T18:02:38.343 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T18:02:37.586+0000 7f54119f79c0 1 librados: setting wanted keys 2024-09-12T18:02:38.343 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T18:02:37.586+0000 7f54119f79c0 1 librados: calling monclient init 2024-09-12T18:02:38.344 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T18:02:37.586+0000 7f54119f79c0 10 monclient: init 2024-09-12T18:02:38.344 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding auth protocol: cephx 2024-09-12T18:02:38.344 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding auth protocol: cephx 2024-09-12T18:02:38.344 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding auth protocol: cephx 2024-09-12T18:02:38.344 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: secure 2024-09-12T18:02:38.344 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: crc 2024-09-12T18:02:38.344 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: secure 2024-09-12T18:02:38.344 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: crc 2024-09-12T18:02:38.344 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: secure 2024-09-12T18:02:38.344 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: crc 2024-09-12T18:02:38.344 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: crc 2024-09-12T18:02:38.344 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: secure 2024-09-12T18:02:38.344 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: crc 2024-09-12T18:02:38.345 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: secure 2024-09-12T18:02:38.345 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: crc 2024-09-12T18:02:38.345 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: secure 2024-09-12T18:02:38.345 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T18:02:37.586+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.345 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T18:02:37.590+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.345 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T18:02:37.590+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command rotate-key hook 0x560ba040e2e8 2024-09-12T18:02:38.345 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:38.345 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:02:38.345 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-c con 0x560ba02be360 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:02:38.345 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-a con 0x560ba02cdaa0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:02:38.345 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-b con 0x560ba04146c0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:02:38.345 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.345 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.345 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.346 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:38.346 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient(hunting): authenticate will time out at 2954.160306s 2024-09-12T18:02:38.346 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T18:02:37.590+0000 7f540f4fd640 10 monclient(hunting): get_auth_request con 0x560ba02be360 auth_method 0 2024-09-12T18:02:38.346 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T18:02:37.590+0000 7f540f4fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:38.346 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T18:02:37.590+0000 7f540f4fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:38.346 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T18:02:37.590+0000 7f540f4fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:38.346 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T18:02:37.590+0000 7f540ecfc640 10 monclient(hunting): get_auth_request con 0x560ba02cdaa0 auth_method 0 2024-09-12T18:02:38.346 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T18:02:37.590+0000 7f540ecfc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:38.346 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T18:02:37.590+0000 7f540ecfc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:38.346 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T18:02:37.590+0000 7f540ecfc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:38.346 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T18:02:37.590+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:38.346 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T18:02:37.590+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:38.346 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T18:02:37.590+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:38.346 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T18:02:37.590+0000 7f540ecfc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:38.347 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T18:02:37.590+0000 7f540ecfc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:38.347 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T18:02:37.590+0000 7f540ecfc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:38.347 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T18:02:37.590+0000 7f540f4fd640 10 monclient(hunting): handle_auth_done global_id 7787 payload 824 2024-09-12T18:02:38.347 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T18:02:37.590+0000 7f540f4fd640 10 monclient: _finish_hunting 0 2024-09-12T18:02:38.347 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T18:02:37.590+0000 7f540f4fd640 1 monclient: found mon.noname-c 2024-09-12T18:02:38.347 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T18:02:37.590+0000 7f540f4fd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.347 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T18:02:37.590+0000 7f52fbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:38.347 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T18:02:37.590+0000 7f52fbe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:38.347 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T18:02:37.590+0000 7f52fbe07640 10 monclient: dump: 2024-09-12T18:02:38.347 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:38.347 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:38.347 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.347 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.347 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:38.348 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.348 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:38.348 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:38.348 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:38.348 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.348 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T18:02:37.590+0000 7f52fbe07640 10 monclient: _finish_auth 0 2024-09-12T18:02:38.348 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T18:02:37.590+0000 7f52fbe07640 10 monclient: _check_auth_tickets 2024-09-12T18:02:38.348 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T18:02:37.590+0000 7f52fbe07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:38.348 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T18:02:37.590+0000 7f52fbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:38.348 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T18:02:37.590+0000 7f52fbe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:38.348 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T18:02:37.590+0000 7f52fbe07640 10 monclient: dump: 2024-09-12T18:02:38.348 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:38.348 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:38.348 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.349 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.349 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:38.349 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.349 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:38.349 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:38.349 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:38.349 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.349 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T18:02:37.590+0000 7f54119f79c0 5 monclient: authenticate success, global_id 7787 2024-09-12T18:02:38.349 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient: _renew_subs 2024-09-12T18:02:38.349 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.350 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T18:02:37.590+0000 7f52fd60a640 4 set_mon_vals no callback set 2024-09-12T18:02:38.350 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient: _renew_subs 2024-09-12T18:02:38.350 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.350 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T18:02:37.590+0000 7f54119f79c0 1 librados: init done 2024-09-12T18:02:38.350 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T18:02:37.590+0000 7f52fbe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:38.350 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T18:02:37.590+0000 7f52fbe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:38.350 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T18:02:37.590+0000 7f52fbe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:38.350 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T18:02:37.590+0000 7f540ecfc640 10 monclient: get_auth_request con 0x7f52f4070ae0 auth_method 0 2024-09-12T18:02:38.350 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T18:02:37.590+0000 7f540fcfe640 10 monclient: get_auth_request con 0x560ba0436cd0 auth_method 0 2024-09-12T18:02:38.350 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T18:02:37.594+0000 7f540f4fd640 10 monclient: get_auth_request con 0x560ba0459110 auth_method 0 2024-09-12T18:02:38.350 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T18:02:37.594+0000 7f540ecfc640 10 monclient: get_auth_request con 0x560ba045ca20 auth_method 0 2024-09-12T18:02:38.350 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient: build_initial_monmap 2024-09-12T18:02:38.350 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T18:02:37.598+0000 7f54119f79c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:38.351 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient: monmap: 2024-09-12T18:02:38.351 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:02:38.351 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:38.351 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:02:38.351 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:02:38.351 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:38.351 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.351 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:02:38.351 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:02:38.351 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:02:38.351 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.351 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding auth protocol: cephx 2024-09-12T18:02:38.351 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding auth protocol: cephx 2024-09-12T18:02:38.351 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding auth protocol: cephx 2024-09-12T18:02:38.352 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: secure 2024-09-12T18:02:38.352 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: crc 2024-09-12T18:02:38.352 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: secure 2024-09-12T18:02:38.352 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: crc 2024-09-12T18:02:38.352 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: secure 2024-09-12T18:02:38.352 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: crc 2024-09-12T18:02:38.352 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: crc 2024-09-12T18:02:38.352 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: secure 2024-09-12T18:02:38.352 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: crc 2024-09-12T18:02:38.352 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: secure 2024-09-12T18:02:38.352 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: crc 2024-09-12T18:02:38.352 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: secure 2024-09-12T18:02:38.352 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T18:02:37.598+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.353 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command objecter_requests cmddesc objecter_requests hook 0x560ba0465e20 EEXIST 2024-09-12T18:02:38.353 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient: init 2024-09-12T18:02:38.353 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding auth protocol: cephx 2024-09-12T18:02:38.353 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding auth protocol: cephx 2024-09-12T18:02:38.353 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding auth protocol: cephx 2024-09-12T18:02:38.353 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: secure 2024-09-12T18:02:38.353 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: crc 2024-09-12T18:02:38.353 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: secure 2024-09-12T18:02:38.353 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: crc 2024-09-12T18:02:38.353 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: secure 2024-09-12T18:02:38.353 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: crc 2024-09-12T18:02:38.353 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: crc 2024-09-12T18:02:38.353 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: secure 2024-09-12T18:02:38.353 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: crc 2024-09-12T18:02:38.353 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: secure 2024-09-12T18:02:38.354 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: crc 2024-09-12T18:02:38.354 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: secure 2024-09-12T18:02:38.354 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T18:02:37.598+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.354 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T18:02:37.598+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.354 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command rotate-key cmddesc rotate-key hook 0x560ba0461550 EEXIST 2024-09-12T18:02:38.354 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:38.354 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:02:38.354 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-c con 0x560ba0489fd0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:02:38.354 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-a con 0x560ba0489900 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:02:38.354 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-b con 0x560ba04882e0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:02:38.354 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.354 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.354 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.354 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:38.355 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient(hunting): authenticate will time out at 2954.170224s 2024-09-12T18:02:38.355 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T18:02:37.598+0000 7f540f4fd640 10 monclient(hunting): get_auth_request con 0x560ba0489fd0 auth_method 0 2024-09-12T18:02:38.355 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T18:02:37.598+0000 7f540f4fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:38.355 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T18:02:37.598+0000 7f540f4fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:38.355 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T18:02:37.598+0000 7f540f4fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:38.355 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T18:02:37.598+0000 7f540ecfc640 10 monclient(hunting): get_auth_request con 0x560ba0489900 auth_method 0 2024-09-12T18:02:38.355 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T18:02:37.598+0000 7f540ecfc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:38.355 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T18:02:37.598+0000 7f540ecfc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:38.355 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T18:02:37.598+0000 7f540ecfc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:38.355 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T18:02:37.598+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:38.355 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T18:02:37.598+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:38.355 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T18:02:37.598+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:38.355 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T18:02:37.598+0000 7f540ecfc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:38.355 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T18:02:37.598+0000 7f540ecfc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:38.355 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T18:02:37.598+0000 7f540ecfc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:38.356 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T18:02:37.598+0000 7f540f4fd640 10 monclient(hunting): handle_auth_done global_id 7790 payload 824 2024-09-12T18:02:38.356 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T18:02:37.598+0000 7f540f4fd640 10 monclient: _finish_hunting 0 2024-09-12T18:02:38.356 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T18:02:37.598+0000 7f540f4fd640 1 monclient: found mon.noname-c 2024-09-12T18:02:38.356 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T18:02:37.598+0000 7f540f4fd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.356 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T18:02:37.598+0000 7f540fcfe640 10 monclient: get_auth_request con 0x560ba04882e0 auth_method 0 2024-09-12T18:02:38.356 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T18:02:37.598+0000 7f52f9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:38.356 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T18:02:37.598+0000 7f52f9602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:38.356 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T18:02:37.598+0000 7f52f9602640 10 monclient: dump: 2024-09-12T18:02:38.356 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:38.356 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:38.356 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.356 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.356 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:38.356 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.357 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:38.357 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:38.357 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:38.357 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.357 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T18:02:37.598+0000 7f52f9602640 10 monclient: _finish_auth 0 2024-09-12T18:02:38.357 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T18:02:37.598+0000 7f52f9602640 10 monclient: _check_auth_tickets 2024-09-12T18:02:38.357 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T18:02:37.598+0000 7f52f9602640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:38.357 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T18:02:37.598+0000 7f52f9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:38.357 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T18:02:37.598+0000 7f52f9602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:38.357 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T18:02:37.598+0000 7f52f9602640 10 monclient: dump: 2024-09-12T18:02:38.357 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:38.357 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:38.357 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.357 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.358 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:38.358 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.358 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:38.358 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:38.358 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:38.358 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.358 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 monclient: authenticate success, global_id 7790 2024-09-12T18:02:38.358 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient: _renew_subs 2024-09-12T18:02:38.358 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T18:02:37.598+0000 7f54104ff640 4 set_mon_vals no callback set 2024-09-12T18:02:38.358 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.358 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient: _renew_subs 2024-09-12T18:02:38.358 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.358 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T18:02:37.602+0000 7f52f9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:38.358 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T18:02:37.602+0000 7f52f9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:38.359 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T18:02:37.602+0000 7f52f9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:38.359 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient: get_monmap_and_config 2024-09-12T18:02:38.359 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient: build_initial_monmap 2024-09-12T18:02:38.359 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T18:02:37.602+0000 7f54119f79c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:38.359 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient: monmap: 2024-09-12T18:02:38.359 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:02:38.359 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:38.359 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:02:38.359 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:02:38.359 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:38.359 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.359 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:02:38.359 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:02:38.359 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:02:38.360 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.360 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding auth protocol: cephx 2024-09-12T18:02:38.360 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding auth protocol: cephx 2024-09-12T18:02:38.360 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding auth protocol: cephx 2024-09-12T18:02:38.360 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: secure 2024-09-12T18:02:38.360 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: crc 2024-09-12T18:02:38.360 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: secure 2024-09-12T18:02:38.360 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: crc 2024-09-12T18:02:38.360 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: secure 2024-09-12T18:02:38.360 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: crc 2024-09-12T18:02:38.360 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: crc 2024-09-12T18:02:38.360 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: secure 2024-09-12T18:02:38.360 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: crc 2024-09-12T18:02:38.361 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: secure 2024-09-12T18:02:38.361 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: crc 2024-09-12T18:02:38.361 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: secure 2024-09-12T18:02:38.361 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T18:02:37.602+0000 7f540ecfc640 10 monclient: get_auth_request con 0x7f52e8070a20 auth_method 0 2024-09-12T18:02:38.361 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T18:02:37.602+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.361 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient: init 2024-09-12T18:02:38.361 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding auth protocol: cephx 2024-09-12T18:02:38.361 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding auth protocol: cephx 2024-09-12T18:02:38.361 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding auth protocol: cephx 2024-09-12T18:02:38.361 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: secure 2024-09-12T18:02:38.361 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: crc 2024-09-12T18:02:38.361 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: secure 2024-09-12T18:02:38.361 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: crc 2024-09-12T18:02:38.361 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: secure 2024-09-12T18:02:38.361 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: crc 2024-09-12T18:02:38.362 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: crc 2024-09-12T18:02:38.362 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: secure 2024-09-12T18:02:38.362 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: crc 2024-09-12T18:02:38.362 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: secure 2024-09-12T18:02:38.362 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: crc 2024-09-12T18:02:38.362 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: secure 2024-09-12T18:02:38.362 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T18:02:37.602+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.362 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T18:02:37.602+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.362 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command rotate-key cmddesc rotate-key hook 0x7ffcc2e856b8 EEXIST 2024-09-12T18:02:38.362 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:38.362 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:02:38.362 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-c con 0x560ba04d7c90 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:02:38.362 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-b con 0x560ba04d8070 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:02:38.363 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-a con 0x560ba04dd900 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:02:38.363 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.363 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.363 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.363 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:38.363 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient(hunting): authenticate will time out at 2954.174143s 2024-09-12T18:02:38.363 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T18:02:37.602+0000 7f540f4fd640 10 monclient(hunting): get_auth_request con 0x560ba04d7c90 auth_method 0 2024-09-12T18:02:38.363 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T18:02:37.602+0000 7f540f4fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:38.363 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T18:02:37.602+0000 7f540f4fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:38.363 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T18:02:37.602+0000 7f540f4fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:38.363 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T18:02:37.602+0000 7f540fcfe640 10 monclient(hunting): get_auth_request con 0x560ba04dd900 auth_method 0 2024-09-12T18:02:38.363 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T18:02:37.602+0000 7f540fcfe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:38.363 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T18:02:37.602+0000 7f540fcfe640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:38.363 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T18:02:37.602+0000 7f540fcfe640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:38.364 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T18:02:37.602+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:38.364 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T18:02:37.602+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:38.364 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T18:02:37.602+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:38.364 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T18:02:37.602+0000 7f540fcfe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:38.364 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T18:02:37.602+0000 7f540fcfe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:38.364 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T18:02:37.602+0000 7f540fcfe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:38.364 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T18:02:37.602+0000 7f540f4fd640 10 monclient(hunting): handle_auth_done global_id 7793 payload 274 2024-09-12T18:02:38.364 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T18:02:37.602+0000 7f540f4fd640 10 monclient: _finish_hunting 0 2024-09-12T18:02:38.364 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T18:02:37.602+0000 7f540f4fd640 1 monclient: found mon.noname-c 2024-09-12T18:02:38.364 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T18:02:37.602+0000 7f540f4fd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.364 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T18:02:37.602+0000 7f52f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:38.364 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T18:02:37.602+0000 7f52f2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:38.364 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T18:02:37.602+0000 7f52f2ffd640 10 monclient: dump: 2024-09-12T18:02:38.364 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:38.365 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:38.365 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.365 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.365 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:38.365 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.365 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:38.365 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:38.365 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:38.365 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.365 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T18:02:37.602+0000 7f52f2ffd640 10 monclient: _finish_auth 0 2024-09-12T18:02:38.365 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T18:02:37.602+0000 7f52f2ffd640 10 monclient: _check_auth_tickets 2024-09-12T18:02:38.365 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T18:02:37.602+0000 7f52f2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:38.365 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 monclient: authenticate success, global_id 7793 2024-09-12T18:02:38.365 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient: get_monmap_and_config success 2024-09-12T18:02:38.366 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T18:02:37.602+0000 7f54119f79c0 4 set_mon_vals no callback set 2024-09-12T18:02:38.366 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T18:02:37.602+0000 7f52f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:38.366 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T18:02:37.602+0000 7f52f2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:38.366 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T18:02:37.602+0000 7f52f2ffd640 10 monclient: dump: 2024-09-12T18:02:38.366 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:38.366 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:38.366 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.366 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.366 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:38.366 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.366 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:38.366 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:38.366 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:38.366 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.367 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient: shutdown 2024-09-12T18:02:38.367 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient: build_initial_monmap 2024-09-12T18:02:38.367 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T18:02:37.602+0000 7f54119f79c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:38.367 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient: monmap: 2024-09-12T18:02:38.367 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:02:38.367 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:38.367 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:02:38.367 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:02:38.367 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:38.367 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.367 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:02:38.367 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:02:38.367 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:02:38.368 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.368 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding auth protocol: cephx 2024-09-12T18:02:38.368 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding auth protocol: cephx 2024-09-12T18:02:38.368 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding auth protocol: cephx 2024-09-12T18:02:38.368 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: secure 2024-09-12T18:02:38.368 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: crc 2024-09-12T18:02:38.368 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: secure 2024-09-12T18:02:38.368 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: crc 2024-09-12T18:02:38.368 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: secure 2024-09-12T18:02:38.368 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: crc 2024-09-12T18:02:38.368 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: crc 2024-09-12T18:02:38.368 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: secure 2024-09-12T18:02:38.368 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: crc 2024-09-12T18:02:38.368 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: secure 2024-09-12T18:02:38.369 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: crc 2024-09-12T18:02:38.369 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: secure 2024-09-12T18:02:38.369 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T18:02:37.602+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.369 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T18:02:37.602+0000 7f54119f79c0 1 librados: starting msgr at 2024-09-12T18:02:38.369 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T18:02:37.602+0000 7f54119f79c0 1 librados: starting objecter 2024-09-12T18:02:38.369 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command objecter_requests cmddesc objecter_requests hook 0x560ba04abaa0 EEXIST 2024-09-12T18:02:38.369 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T18:02:37.606+0000 7f54119f79c0 1 librados: setting wanted keys 2024-09-12T18:02:38.369 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T18:02:37.606+0000 7f54119f79c0 1 librados: calling monclient init 2024-09-12T18:02:38.369 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient: init 2024-09-12T18:02:38.369 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding auth protocol: cephx 2024-09-12T18:02:38.369 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding auth protocol: cephx 2024-09-12T18:02:38.369 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding auth protocol: cephx 2024-09-12T18:02:38.369 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: secure 2024-09-12T18:02:38.370 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: crc 2024-09-12T18:02:38.370 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: secure 2024-09-12T18:02:38.370 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: crc 2024-09-12T18:02:38.370 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: secure 2024-09-12T18:02:38.370 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: crc 2024-09-12T18:02:38.370 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: crc 2024-09-12T18:02:38.370 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: secure 2024-09-12T18:02:38.370 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: crc 2024-09-12T18:02:38.370 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: secure 2024-09-12T18:02:38.370 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: crc 2024-09-12T18:02:38.370 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: secure 2024-09-12T18:02:38.370 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T18:02:37.606+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.370 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T18:02:37.606+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.370 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command rotate-key cmddesc rotate-key hook 0x560ba048bf38 EEXIST 2024-09-12T18:02:38.371 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:38.371 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:02:38.371 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-a con 0x560ba04d7c90 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:02:38.371 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-c con 0x560ba04dd900 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:02:38.371 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-b con 0x560ba04ea360 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:02:38.371 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.371 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.371 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.371 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:38.371 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient(hunting): authenticate will time out at 2954.176686s 2024-09-12T18:02:38.371 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T18:02:37.606+0000 7f540f4fd640 10 monclient(hunting): get_auth_request con 0x560ba04d7c90 auth_method 0 2024-09-12T18:02:38.371 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T18:02:37.606+0000 7f540f4fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:38.371 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T18:02:37.606+0000 7f540f4fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:38.372 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T18:02:37.606+0000 7f540f4fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:38.372 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T18:02:37.606+0000 7f540ecfc640 10 monclient(hunting): get_auth_request con 0x560ba04dd900 auth_method 0 2024-09-12T18:02:38.372 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T18:02:37.606+0000 7f540ecfc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:38.372 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T18:02:37.606+0000 7f540ecfc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:38.372 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T18:02:37.606+0000 7f540ecfc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:38.372 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T18:02:37.606+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:38.372 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T18:02:37.606+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:38.372 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T18:02:37.606+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:38.372 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T18:02:37.606+0000 7f540ecfc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:38.372 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T18:02:37.606+0000 7f540ecfc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:38.372 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T18:02:37.606+0000 7f540ecfc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:38.372 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T18:02:37.606+0000 7f540ecfc640 10 monclient(hunting): handle_auth_done global_id 7796 payload 824 2024-09-12T18:02:38.372 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T18:02:37.606+0000 7f540ecfc640 10 monclient: _finish_hunting 0 2024-09-12T18:02:38.373 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T18:02:37.606+0000 7f540ecfc640 1 monclient: found mon.noname-c 2024-09-12T18:02:38.373 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T18:02:37.606+0000 7f540ecfc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.373 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T18:02:37.606+0000 7f540fcfe640 10 monclient: get_auth_request con 0x560ba04ea360 auth_method 0 2024-09-12T18:02:38.373 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T18:02:37.606+0000 7f52f17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:38.373 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T18:02:37.606+0000 7f52f17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:38.373 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T18:02:37.606+0000 7f52f17fa640 10 monclient: dump: 2024-09-12T18:02:38.373 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:38.373 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:38.373 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.373 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.373 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:38.373 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.373 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:38.373 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:38.374 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:38.374 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.374 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T18:02:37.606+0000 7f52f17fa640 10 monclient: _finish_auth 0 2024-09-12T18:02:38.374 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T18:02:37.606+0000 7f52f17fa640 10 monclient: _check_auth_tickets 2024-09-12T18:02:38.374 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T18:02:37.606+0000 7f52f17fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:38.374 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T18:02:37.606+0000 7f52f17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:38.374 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T18:02:37.606+0000 7f52f17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:38.374 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T18:02:37.606+0000 7f52f17fa640 10 monclient: dump: 2024-09-12T18:02:38.374 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:38.374 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:38.374 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.374 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.374 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:38.374 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.375 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:38.375 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:38.375 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:38.375 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.375 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T18:02:37.606+0000 7f52f2ffd640 4 set_mon_vals no callback set 2024-09-12T18:02:38.375 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 monclient: authenticate success, global_id 7796 2024-09-12T18:02:38.375 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient: _renew_subs 2024-09-12T18:02:38.375 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.375 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient: _renew_subs 2024-09-12T18:02:38.375 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.375 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T18:02:37.606+0000 7f54119f79c0 1 librados: init done 2024-09-12T18:02:38.375 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command cr dump hook 0x560ba04d30b8 2024-09-12T18:02:38.375 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T18:02:37.606+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.376 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T18:02:37.610+0000 7f52f17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:38.376 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T18:02:37.610+0000 7f52f17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:38.376 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T18:02:37.610+0000 7f52f17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:38.376 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T18:02:37.610+0000 7f540f4fd640 10 monclient: get_auth_request con 0x7f52d8070b10 auth_method 0 2024-09-12T18:02:38.376 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T18:02:37.610+0000 7f540fcfe640 10 monclient: get_auth_request con 0x560ba04f6fb0 auth_method 0 2024-09-12T18:02:38.376 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.376 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T18:02:37.610+0000 7f54119f79c0 20 realm 2024-09-12T18:02:38.376 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.376 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.376 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T18:02:37.610+0000 7f54119f79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:38.376 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.376 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.376 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.376 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T18:02:37.610+0000 7f540f4fd640 10 monclient: get_auth_request con 0x560ba04fb290 auth_method 0 2024-09-12T18:02:38.376 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:38.377 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.377 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:38.377 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T18:02:37.614+0000 7f54119f79c0 20 searching for the correct realm 2024-09-12T18:02:38.377 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T18:02:37.614+0000 7f540ecfc640 10 monclient: get_auth_request con 0x560ba0500400 auth_method 0 2024-09-12T18:02:38.377 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T18:02:37.614+0000 7f540fcfe640 10 monclient: get_auth_request con 0x7f5404036070 auth_method 0 2024-09-12T18:02:38.377 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T18:02:37.614+0000 7f540f4fd640 10 monclient: get_auth_request con 0x7f5408016040 auth_method 0 2024-09-12T18:02:38.377 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T18:02:37.614+0000 7f540ecfc640 10 monclient: get_auth_request con 0x7f540011c040 auth_method 0 2024-09-12T18:02:38.377 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T18:02:37.618+0000 7f540fcfe640 0 -- 172.21.15.98:0/1048950127 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f5404036070 msgr2=0x7f5404020440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:38.377 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T18:02:37.618+0000 7f52f17fa640 1 client.7796.objecter ms_handle_reset 0x7f5404036070 session 0x7f540403d050 osd.7 2024-09-12T18:02:38.377 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T18:02:37.618+0000 7f52f17fa640 10 monclient: _renew_subs 2024-09-12T18:02:38.377 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T18:02:37.618+0000 7f52f17fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.377 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T18:02:37.618+0000 7f540fcfe640 10 monclient: get_auth_request con 0x7f52d8081210 auth_method 0 2024-09-12T18:02:38.377 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T18:02:37.618+0000 7f540fcfe640 10 monclient: get_auth_request con 0x7f5404008050 auth_method 0 2024-09-12T18:02:38.378 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T18:02:37.622+0000 7f540f4fd640 10 monclient: get_auth_request con 0x7f5404073520 auth_method 0 2024-09-12T18:02:38.378 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T18:02:37.826+0000 7f540f4fd640 0 -- 172.21.15.98:0/1048950127 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f5404073520 msgr2=0x7f5404020440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:38.378 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T18:02:38.230+0000 7f540f4fd640 10 monclient: get_auth_request con 0x7f5404073520 auth_method 0 2024-09-12T18:02:38.378 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T18:02:38.242+0000 7f54119f79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:38.378 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T18:02:38.242+0000 7f54119f79c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:02:38.378 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T18:02:38.242+0000 7f54119f79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:38.378 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T18:02:38.242+0000 7f54119f79c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:02:38.378 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T18:02:38.242+0000 7f54119f79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:38.378 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T18:02:38.242+0000 7f54119f79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:38.378 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T18:02:38.242+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.378 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.378 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.379 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:38.379 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.379 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:38.379 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 zone default found 2024-09-12T18:02:38.379 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T18:02:38.246+0000 7f54119f79c0 4 Realm: () 2024-09-12T18:02:38.379 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T18:02:38.246+0000 7f54119f79c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:02:38.379 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T18:02:38.246+0000 7f54119f79c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:02:38.379 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T18:02:38.246+0000 7f54119f79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:38.379 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 zonegroup default 2024-09-12T18:02:38.379 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.379 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.379 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.379 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.379 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.380 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T18:02:38.250+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.380 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T18:02:38.250+0000 7f54119f79c0 20 started sync module instance, tier type = 2024-09-12T18:02:38.380 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T18:02:38.250+0000 7f54119f79c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:02:38.380 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=0 2024-09-12T18:02:38.380 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=1 2024-09-12T18:02:38.380 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=2 2024-09-12T18:02:38.380 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=3 2024-09-12T18:02:38.380 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=4 2024-09-12T18:02:38.380 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=5 2024-09-12T18:02:38.380 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=6 2024-09-12T18:02:38.380 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=7 2024-09-12T18:02:38.380 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T18:02:38.270+0000 7f54119f79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:38.380 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T18:02:38.274+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding auth protocol: cephx 2024-09-12T18:02:38.380 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T18:02:38.274+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding auth protocol: cephx 2024-09-12T18:02:38.380 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T18:02:38.274+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding auth protocol: cephx 2024-09-12T18:02:38.381 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T18:02:38.274+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: secure 2024-09-12T18:02:38.381 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T18:02:38.274+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: crc 2024-09-12T18:02:38.381 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T18:02:38.274+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: secure 2024-09-12T18:02:38.381 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T18:02:38.274+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: crc 2024-09-12T18:02:38.381 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T18:02:38.274+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: secure 2024-09-12T18:02:38.381 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T18:02:38.274+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: crc 2024-09-12T18:02:38.381 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: crc 2024-09-12T18:02:38.381 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: secure 2024-09-12T18:02:38.381 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T18:02:38.274+0000 7f52c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:38.381 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: crc 2024-09-12T18:02:38.381 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: secure 2024-09-12T18:02:38.381 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: crc 2024-09-12T18:02:38.381 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: secure 2024-09-12T18:02:38.381 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T18:02:38.278+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.381 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T18:02:38.278+0000 7f54119f79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:38.382 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T18:02:38.278+0000 7f54119f79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:38.382 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command cache list hook 0x560ba04ea780 2024-09-12T18:02:38.382 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command cache inspect hook 0x560ba04ea780 2024-09-12T18:02:38.382 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command cache erase hook 0x560ba04ea780 2024-09-12T18:02:38.382 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command cache zap hook 0x560ba04ea780 2024-09-12T18:02:38.382 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 note: GC not initialized 2024-09-12T18:02:38.382 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T18:02:38.278+0000 7f52c4fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:38.382 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command sync trace show hook 0x7f5400110030 2024-09-12T18:02:38.382 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command sync trace history hook 0x7f5400110030 2024-09-12T18:02:38.382 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command sync trace active hook 0x7f5400110030 2024-09-12T18:02:38.382 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command sync trace active_short hook 0x7f5400110030 2024-09-12T18:02:38.382 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T18:02:38.278+0000 7f54119f79c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:38.382 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T18:02:38.278+0000 7f54119f79c0 20 Filter name: none 2024-09-12T18:02:38.382 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T18:02:38.278+0000 7f523e7fc640 20 reqs_thread_entry: start 2024-09-12T18:02:38.382 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T18:02:38.278+0000 7f54119f79c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:02:38.383 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T18:02:38.278+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.383 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T18:02:38.278+0000 7f54119f79c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:38.383 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T18:02:38.278+0000 7f54119f79c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:02:38.383 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T18:02:38.278+0000 7f54119f79c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:02:38.383 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T18:02:38.278+0000 7f54119f79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T18:02:38.383 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T18:02:38.278+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.383 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T18:02:38.282+0000 7f54119f79c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:02:38.383 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T18:02:38.282+0000 7f54119f79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:02:38.383 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T18:02:38.282+0000 7f54119f79c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:02:38.383 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T18:02:38.282+0000 7f54119f79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:38.383 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T18:02:38.282+0000 7f54119f79c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:38.383 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T18:02:38.282+0000 7f54119f79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:02:38.383 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T18:02:38.282+0000 7f54119f79c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:02:38.383 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T18:02:38.298+0000 7f54119f79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:02:38.384 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T18:02:38.298+0000 7f54119f79c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:02:38.384 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T18:02:38.298+0000 7f54119f79c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:38.384 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T18:02:38.298+0000 7f54119f79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T18:02:38.384 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T18:02:38.298+0000 7f52f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366222 cookie 94607934245424 notifier 7796 bl.length()=827 2024-09-12T18:02:38.384 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T18:02:38.298+0000 7f52f2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:02:38.384 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T18:02:38.298+0000 7f52f2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:02:38.384 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T18:02:38.298+0000 7f52f2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:38.384 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T18:02:38.302+0000 7f54119f79c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T18:02:38.384 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T18:02:38.302+0000 7f54119f79c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T18:02:38.384 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T18:02:38.302+0000 7f54119f79c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T18:02:38.384 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T18:02:38.302+0000 7f54119f79c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T18:02:38.384 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T18:02:38.314+0000 7f54119f79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f54119f79c0 time 2024-09-12T18:02:38.317661+0000 2024-09-12T18:02:38.385 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:02:38.385 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.385 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:38.385 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f54152d12eb] 2024-09-12T18:02:38.385 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f54152d149f] 2024-09-12T18:02:38.385 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560b9e9f00c1] 2024-09-12T18:02:38.385 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560b9ea021fa] 2024-09-12T18:02:38.385 INFO:tasks.workunit.client.0.smithi098.stderr: 5: main() 2024-09-12T18:02:38.385 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5414137d90] 2024-09-12T18:02:38.385 INFO:tasks.workunit.client.0.smithi098.stderr: 7: __libc_start_main() 2024-09-12T18:02:38.385 INFO:tasks.workunit.client.0.smithi098.stderr: 8: _start() 2024-09-12T18:02:38.385 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.385 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T18:02:38.314+0000 7f54119f79c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:02:38.386 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f54119f79c0 thread_name:radosgw-admin 2024-09-12T18:02:38.386 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.386 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:38.386 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5414150520] 2024-09-12T18:02:38.386 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T18:02:38.386 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T18:02:38.386 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T18:02:38.386 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f54152d1345] 2024-09-12T18:02:38.386 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f54152d149f] 2024-09-12T18:02:38.386 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560b9e9f00c1] 2024-09-12T18:02:38.386 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560b9ea021fa] 2024-09-12T18:02:38.386 INFO:tasks.workunit.client.0.smithi098.stderr: 9: main() 2024-09-12T18:02:38.386 INFO:tasks.workunit.client.0.smithi098.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5414137d90] 2024-09-12T18:02:38.386 INFO:tasks.workunit.client.0.smithi098.stderr: 11: __libc_start_main() 2024-09-12T18:02:38.387 INFO:tasks.workunit.client.0.smithi098.stderr: 12: _start() 2024-09-12T18:02:38.387 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:02:38.387 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.387 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T18:02:38.387 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T18:02:38.387 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T18:02:38.387 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T18:02:38.387 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T18:02:38.387 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T18:02:38.387 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T18:02:38.387 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T18:02:38.387 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T18:02:38.387 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T18:02:38.387 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T18:02:38.388 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T18:02:38.388 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T18:02:38.388 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T18:02:38.388 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T18:02:38.388 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T18:02:38.388 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T18:02:38.388 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T18:02:38.388 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T18:02:38.388 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T18:02:38.388 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T18:02:38.388 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T18:02:38.388 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T18:02:38.388 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T18:02:38.389 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:02:38.389 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T18:02:38.389 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T18:02:38.389 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T18:02:38.389 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T18:02:38.389 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T18:02:38.389 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T18:02:38.389 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T18:02:38.389 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T18:02:38.389 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T18:02:38.389 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T18:02:38.389 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T18:02:38.389 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T18:02:38.389 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T18:02:38.389 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T18:02:38.390 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T18:02:38.390 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T18:02:38.390 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T18:02:38.390 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T18:02:38.390 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T18:02:38.390 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T18:02:38.390 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T18:02:38.390 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:02:38.390 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T18:02:38.390 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:02:38.390 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T18:02:38.390 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T18:02:38.390 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T18:02:38.390 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T18:02:38.390 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T18:02:38.391 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T18:02:38.391 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T18:02:38.391 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T18:02:38.391 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T18:02:38.391 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T18:02:38.391 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T18:02:38.391 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T18:02:38.391 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T18:02:38.391 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T18:02:38.391 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T18:02:38.391 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T18:02:38.391 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T18:02:38.391 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T18:02:38.391 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:02:38.392 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T18:02:38.392 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:02:38.392 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T18:02:38.392 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T18:02:38.392 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T18:02:38.392 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T18:02:38.392 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T18:02:38.392 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T18:02:38.392 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:02:38.392 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T18:02:38.392 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T18:02:38.392 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:02:38.392 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T18:02:38.392 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T18:02:38.393 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T18:02:38.393 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T18:02:38.393 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T18:02:38.393 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T18:02:38.393 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T18:02:38.393 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T18:02:38.393 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T18:02:38.393 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T18:02:38.393 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T18:02:38.393 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T18:02:38.393 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T18:02:38.393 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:02:38.393 INFO:tasks.workunit.client.0.smithi098.stderr: 7f523e7fc640 / http_manager 2024-09-12T18:02:38.393 INFO:tasks.workunit.client.0.smithi098.stderr: 7f52c4fe1640 / http_manager 2024-09-12T18:02:38.394 INFO:tasks.workunit.client.0.smithi098.stderr: 7f52c5fe3640 / rgw_dt_lg_renew 2024-09-12T18:02:38.394 INFO:tasks.workunit.client.0.smithi098.stderr: 7f52f17fa640 / ms_dispatch 2024-09-12T18:02:38.394 INFO:tasks.workunit.client.0.smithi098.stderr: 7f52f2ffd640 / io_context_pool 2024-09-12T18:02:38.394 INFO:tasks.workunit.client.0.smithi098.stderr: 7f52f9602640 / ms_dispatch 2024-09-12T18:02:38.394 INFO:tasks.workunit.client.0.smithi098.stderr: 7f52fbe07640 / ms_dispatch 2024-09-12T18:02:38.394 INFO:tasks.workunit.client.0.smithi098.stderr: 7f52fd60a640 / io_context_pool 2024-09-12T18:02:38.394 INFO:tasks.workunit.client.0.smithi098.stderr: 7f540ecfc640 / msgr-worker-2 2024-09-12T18:02:38.394 INFO:tasks.workunit.client.0.smithi098.stderr: 7f540f4fd640 / msgr-worker-1 2024-09-12T18:02:38.394 INFO:tasks.workunit.client.0.smithi098.stderr: 7f540fcfe640 / msgr-worker-0 2024-09-12T18:02:38.394 INFO:tasks.workunit.client.0.smithi098.stderr: 7f54104ff640 / io_context_pool 2024-09-12T18:02:38.394 INFO:tasks.workunit.client.0.smithi098.stderr: 7f54119f79c0 / radosgw-admin 2024-09-12T18:02:38.394 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T18:02:38.394 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T18:02:38.394 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/log/ceph/ceph-client.admin.146493.log 2024-09-12T18:02:38.394 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T18:02:38.395 INFO:tasks.workunit.client.0.smithi098.stderr:--- begin dump of recent events --- 2024-09-12T18:02:38.395 INFO:tasks.workunit.client.0.smithi098.stderr: -499> 2024-09-12T18:02:37.586+0000 7f540ecfc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:38.395 INFO:tasks.workunit.client.0.smithi098.stderr: -498> 2024-09-12T18:02:37.586+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:38.395 INFO:tasks.workunit.client.0.smithi098.stderr: -497> 2024-09-12T18:02:37.586+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:38.395 INFO:tasks.workunit.client.0.smithi098.stderr: -496> 2024-09-12T18:02:37.586+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:38.395 INFO:tasks.workunit.client.0.smithi098.stderr: -495> 2024-09-12T18:02:37.586+0000 7f540ecfc640 10 monclient(hunting): handle_auth_done global_id 8460 payload 274 2024-09-12T18:02:38.395 INFO:tasks.workunit.client.0.smithi098.stderr: -494> 2024-09-12T18:02:37.586+0000 7f540ecfc640 10 monclient: _finish_hunting 0 2024-09-12T18:02:38.395 INFO:tasks.workunit.client.0.smithi098.stderr: -493> 2024-09-12T18:02:37.586+0000 7f540ecfc640 1 monclient: found mon.noname-a 2024-09-12T18:02:38.395 INFO:tasks.workunit.client.0.smithi098.stderr: -492> 2024-09-12T18:02:37.586+0000 7f540ecfc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.98:3300/0 2024-09-12T18:02:38.395 INFO:tasks.workunit.client.0.smithi098.stderr: -491> 2024-09-12T18:02:37.586+0000 7f540fcfe640 10 monclient: get_auth_request con 0x560ba04146c0 auth_method 0 2024-09-12T18:02:38.395 INFO:tasks.workunit.client.0.smithi098.stderr: -490> 2024-09-12T18:02:37.586+0000 7f52fd60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:38.395 INFO:tasks.workunit.client.0.smithi098.stderr: -489> 2024-09-12T18:02:37.586+0000 7f52fd60a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:02:38.395 INFO:tasks.workunit.client.0.smithi098.stderr: -488> 2024-09-12T18:02:37.586+0000 7f52fd60a640 10 monclient: dump: 2024-09-12T18:02:38.395 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:38.396 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:38.396 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.396 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.396 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:38.396 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.396 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:38.396 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:38.396 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:38.396 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.396 INFO:tasks.workunit.client.0.smithi098.stderr: -487> 2024-09-12T18:02:37.586+0000 7f52fd60a640 10 monclient: _finish_auth 0 2024-09-12T18:02:38.396 INFO:tasks.workunit.client.0.smithi098.stderr: -486> 2024-09-12T18:02:37.586+0000 7f52fd60a640 10 monclient: _check_auth_tickets 2024-09-12T18:02:38.396 INFO:tasks.workunit.client.0.smithi098.stderr: -485> 2024-09-12T18:02:37.586+0000 7f52fd60a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:38.396 INFO:tasks.workunit.client.0.smithi098.stderr: -484> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 monclient: authenticate success, global_id 8460 2024-09-12T18:02:38.396 INFO:tasks.workunit.client.0.smithi098.stderr: -483> 2024-09-12T18:02:37.586+0000 7f54119f79c0 10 monclient: get_monmap_and_config success 2024-09-12T18:02:38.397 INFO:tasks.workunit.client.0.smithi098.stderr: -482> 2024-09-12T18:02:37.586+0000 7f54119f79c0 4 set_mon_vals no callback set 2024-09-12T18:02:38.397 INFO:tasks.workunit.client.0.smithi098.stderr: -481> 2024-09-12T18:02:37.586+0000 7f52fd60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:38.397 INFO:tasks.workunit.client.0.smithi098.stderr: -480> 2024-09-12T18:02:37.586+0000 7f52fd60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:02:38.397 INFO:tasks.workunit.client.0.smithi098.stderr: -479> 2024-09-12T18:02:37.586+0000 7f52fd60a640 10 monclient: dump: 2024-09-12T18:02:38.397 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:38.397 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:38.397 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.397 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.397 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:38.397 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.397 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:38.397 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:38.397 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:38.397 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.397 INFO:tasks.workunit.client.0.smithi098.stderr: -478> 2024-09-12T18:02:37.586+0000 7f54119f79c0 10 monclient: shutdown 2024-09-12T18:02:38.398 INFO:tasks.workunit.client.0.smithi098.stderr: -477> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 asok(0x560ba02032b0) unregister_commands rotate-key 2024-09-12T18:02:38.398 INFO:tasks.workunit.client.0.smithi098.stderr: -476> 2024-09-12T18:02:37.586+0000 7f54119f79c0 10 monclient: build_initial_monmap 2024-09-12T18:02:38.398 INFO:tasks.workunit.client.0.smithi098.stderr: -475> 2024-09-12T18:02:37.586+0000 7f54119f79c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:38.398 INFO:tasks.workunit.client.0.smithi098.stderr: -474> 2024-09-12T18:02:37.586+0000 7f54119f79c0 10 monclient: monmap: 2024-09-12T18:02:38.398 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:02:38.398 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:38.398 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:02:38.398 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:02:38.398 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:38.398 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.398 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:02:38.398 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:02:38.398 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:02:38.398 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.398 INFO:tasks.workunit.client.0.smithi098.stderr: -473> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding auth protocol: cephx 2024-09-12T18:02:38.399 INFO:tasks.workunit.client.0.smithi098.stderr: -472> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding auth protocol: cephx 2024-09-12T18:02:38.399 INFO:tasks.workunit.client.0.smithi098.stderr: -471> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding auth protocol: cephx 2024-09-12T18:02:38.399 INFO:tasks.workunit.client.0.smithi098.stderr: -470> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: secure 2024-09-12T18:02:38.399 INFO:tasks.workunit.client.0.smithi098.stderr: -469> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: crc 2024-09-12T18:02:38.399 INFO:tasks.workunit.client.0.smithi098.stderr: -468> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: secure 2024-09-12T18:02:38.399 INFO:tasks.workunit.client.0.smithi098.stderr: -467> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: crc 2024-09-12T18:02:38.399 INFO:tasks.workunit.client.0.smithi098.stderr: -466> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: secure 2024-09-12T18:02:38.399 INFO:tasks.workunit.client.0.smithi098.stderr: -465> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: crc 2024-09-12T18:02:38.399 INFO:tasks.workunit.client.0.smithi098.stderr: -464> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: crc 2024-09-12T18:02:38.399 INFO:tasks.workunit.client.0.smithi098.stderr: -463> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: secure 2024-09-12T18:02:38.399 INFO:tasks.workunit.client.0.smithi098.stderr: -462> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: crc 2024-09-12T18:02:38.399 INFO:tasks.workunit.client.0.smithi098.stderr: -461> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: secure 2024-09-12T18:02:38.399 INFO:tasks.workunit.client.0.smithi098.stderr: -460> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: crc 2024-09-12T18:02:38.399 INFO:tasks.workunit.client.0.smithi098.stderr: -459> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba04137b0) adding con mode: secure 2024-09-12T18:02:38.399 INFO:tasks.workunit.client.0.smithi098.stderr: -458> 2024-09-12T18:02:37.586+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.400 INFO:tasks.workunit.client.0.smithi098.stderr: -457> 2024-09-12T18:02:37.586+0000 7f54119f79c0 1 librados: starting msgr at 2024-09-12T18:02:38.400 INFO:tasks.workunit.client.0.smithi098.stderr: -456> 2024-09-12T18:02:37.586+0000 7f54119f79c0 1 librados: starting objecter 2024-09-12T18:02:38.400 INFO:tasks.workunit.client.0.smithi098.stderr: -455> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command objecter_requests hook 0x560ba0413430 2024-09-12T18:02:38.400 INFO:tasks.workunit.client.0.smithi098.stderr: -454> 2024-09-12T18:02:37.586+0000 7f54119f79c0 1 librados: setting wanted keys 2024-09-12T18:02:38.400 INFO:tasks.workunit.client.0.smithi098.stderr: -453> 2024-09-12T18:02:37.586+0000 7f54119f79c0 1 librados: calling monclient init 2024-09-12T18:02:38.400 INFO:tasks.workunit.client.0.smithi098.stderr: -452> 2024-09-12T18:02:37.586+0000 7f54119f79c0 10 monclient: init 2024-09-12T18:02:38.400 INFO:tasks.workunit.client.0.smithi098.stderr: -451> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding auth protocol: cephx 2024-09-12T18:02:38.400 INFO:tasks.workunit.client.0.smithi098.stderr: -450> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding auth protocol: cephx 2024-09-12T18:02:38.400 INFO:tasks.workunit.client.0.smithi098.stderr: -449> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding auth protocol: cephx 2024-09-12T18:02:38.400 INFO:tasks.workunit.client.0.smithi098.stderr: -448> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: secure 2024-09-12T18:02:38.400 INFO:tasks.workunit.client.0.smithi098.stderr: -447> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: crc 2024-09-12T18:02:38.400 INFO:tasks.workunit.client.0.smithi098.stderr: -446> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: secure 2024-09-12T18:02:38.400 INFO:tasks.workunit.client.0.smithi098.stderr: -445> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: crc 2024-09-12T18:02:38.400 INFO:tasks.workunit.client.0.smithi098.stderr: -444> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: secure 2024-09-12T18:02:38.400 INFO:tasks.workunit.client.0.smithi098.stderr: -443> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: crc 2024-09-12T18:02:38.401 INFO:tasks.workunit.client.0.smithi098.stderr: -442> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: crc 2024-09-12T18:02:38.401 INFO:tasks.workunit.client.0.smithi098.stderr: -441> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: secure 2024-09-12T18:02:38.401 INFO:tasks.workunit.client.0.smithi098.stderr: -440> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: crc 2024-09-12T18:02:38.401 INFO:tasks.workunit.client.0.smithi098.stderr: -439> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: secure 2024-09-12T18:02:38.401 INFO:tasks.workunit.client.0.smithi098.stderr: -438> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: crc 2024-09-12T18:02:38.401 INFO:tasks.workunit.client.0.smithi098.stderr: -437> 2024-09-12T18:02:37.586+0000 7f54119f79c0 5 AuthRegistry(0x560ba040e1a0) adding con mode: secure 2024-09-12T18:02:38.401 INFO:tasks.workunit.client.0.smithi098.stderr: -436> 2024-09-12T18:02:37.586+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.401 INFO:tasks.workunit.client.0.smithi098.stderr: -435> 2024-09-12T18:02:37.590+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.401 INFO:tasks.workunit.client.0.smithi098.stderr: -434> 2024-09-12T18:02:37.590+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command rotate-key hook 0x560ba040e2e8 2024-09-12T18:02:38.401 INFO:tasks.workunit.client.0.smithi098.stderr: -433> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:38.401 INFO:tasks.workunit.client.0.smithi098.stderr: -432> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:02:38.401 INFO:tasks.workunit.client.0.smithi098.stderr: -431> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-c con 0x560ba02be360 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:02:38.401 INFO:tasks.workunit.client.0.smithi098.stderr: -430> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-a con 0x560ba02cdaa0 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:02:38.401 INFO:tasks.workunit.client.0.smithi098.stderr: -429> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-b con 0x560ba04146c0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:02:38.401 INFO:tasks.workunit.client.0.smithi098.stderr: -428> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.402 INFO:tasks.workunit.client.0.smithi098.stderr: -427> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.402 INFO:tasks.workunit.client.0.smithi098.stderr: -426> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.402 INFO:tasks.workunit.client.0.smithi098.stderr: -425> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:38.402 INFO:tasks.workunit.client.0.smithi098.stderr: -424> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient(hunting): authenticate will time out at 2954.160306s 2024-09-12T18:02:38.402 INFO:tasks.workunit.client.0.smithi098.stderr: -423> 2024-09-12T18:02:37.590+0000 7f540f4fd640 10 monclient(hunting): get_auth_request con 0x560ba02be360 auth_method 0 2024-09-12T18:02:38.402 INFO:tasks.workunit.client.0.smithi098.stderr: -422> 2024-09-12T18:02:37.590+0000 7f540f4fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:38.402 INFO:tasks.workunit.client.0.smithi098.stderr: -421> 2024-09-12T18:02:37.590+0000 7f540f4fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:38.402 INFO:tasks.workunit.client.0.smithi098.stderr: -420> 2024-09-12T18:02:37.590+0000 7f540f4fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:38.402 INFO:tasks.workunit.client.0.smithi098.stderr: -419> 2024-09-12T18:02:37.590+0000 7f540ecfc640 10 monclient(hunting): get_auth_request con 0x560ba02cdaa0 auth_method 0 2024-09-12T18:02:38.402 INFO:tasks.workunit.client.0.smithi098.stderr: -418> 2024-09-12T18:02:37.590+0000 7f540ecfc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:38.402 INFO:tasks.workunit.client.0.smithi098.stderr: -417> 2024-09-12T18:02:37.590+0000 7f540ecfc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:38.402 INFO:tasks.workunit.client.0.smithi098.stderr: -416> 2024-09-12T18:02:37.590+0000 7f540ecfc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:38.402 INFO:tasks.workunit.client.0.smithi098.stderr: -415> 2024-09-12T18:02:37.590+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:38.402 INFO:tasks.workunit.client.0.smithi098.stderr: -414> 2024-09-12T18:02:37.590+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:38.403 INFO:tasks.workunit.client.0.smithi098.stderr: -413> 2024-09-12T18:02:37.590+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:38.403 INFO:tasks.workunit.client.0.smithi098.stderr: -412> 2024-09-12T18:02:37.590+0000 7f540ecfc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:38.403 INFO:tasks.workunit.client.0.smithi098.stderr: -411> 2024-09-12T18:02:37.590+0000 7f540ecfc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:38.403 INFO:tasks.workunit.client.0.smithi098.stderr: -410> 2024-09-12T18:02:37.590+0000 7f540ecfc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:38.403 INFO:tasks.workunit.client.0.smithi098.stderr: -409> 2024-09-12T18:02:37.590+0000 7f540f4fd640 10 monclient(hunting): handle_auth_done global_id 7787 payload 824 2024-09-12T18:02:38.403 INFO:tasks.workunit.client.0.smithi098.stderr: -408> 2024-09-12T18:02:37.590+0000 7f540f4fd640 10 monclient: _finish_hunting 0 2024-09-12T18:02:38.403 INFO:tasks.workunit.client.0.smithi098.stderr: -407> 2024-09-12T18:02:37.590+0000 7f540f4fd640 1 monclient: found mon.noname-c 2024-09-12T18:02:38.403 INFO:tasks.workunit.client.0.smithi098.stderr: -406> 2024-09-12T18:02:37.590+0000 7f540f4fd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.403 INFO:tasks.workunit.client.0.smithi098.stderr: -405> 2024-09-12T18:02:37.590+0000 7f52fbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:38.403 INFO:tasks.workunit.client.0.smithi098.stderr: -404> 2024-09-12T18:02:37.590+0000 7f52fbe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:38.403 INFO:tasks.workunit.client.0.smithi098.stderr: -403> 2024-09-12T18:02:37.590+0000 7f52fbe07640 10 monclient: dump: 2024-09-12T18:02:38.403 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:38.403 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:38.403 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.403 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.404 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:38.404 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.404 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:38.404 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:38.404 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:38.404 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.404 INFO:tasks.workunit.client.0.smithi098.stderr: -402> 2024-09-12T18:02:37.590+0000 7f52fbe07640 10 monclient: _finish_auth 0 2024-09-12T18:02:38.404 INFO:tasks.workunit.client.0.smithi098.stderr: -401> 2024-09-12T18:02:37.590+0000 7f52fbe07640 10 monclient: _check_auth_tickets 2024-09-12T18:02:38.404 INFO:tasks.workunit.client.0.smithi098.stderr: -400> 2024-09-12T18:02:37.590+0000 7f52fbe07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:38.404 INFO:tasks.workunit.client.0.smithi098.stderr: -399> 2024-09-12T18:02:37.590+0000 7f52fbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:38.404 INFO:tasks.workunit.client.0.smithi098.stderr: -398> 2024-09-12T18:02:37.590+0000 7f52fbe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:38.404 INFO:tasks.workunit.client.0.smithi098.stderr: -397> 2024-09-12T18:02:37.590+0000 7f52fbe07640 10 monclient: dump: 2024-09-12T18:02:38.404 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:38.404 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:38.404 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.405 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.405 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:38.405 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.405 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:38.405 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:38.405 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:38.405 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.405 INFO:tasks.workunit.client.0.smithi098.stderr: -396> 2024-09-12T18:02:37.590+0000 7f54119f79c0 5 monclient: authenticate success, global_id 7787 2024-09-12T18:02:38.405 INFO:tasks.workunit.client.0.smithi098.stderr: -395> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient: _renew_subs 2024-09-12T18:02:38.405 INFO:tasks.workunit.client.0.smithi098.stderr: -394> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.405 INFO:tasks.workunit.client.0.smithi098.stderr: -393> 2024-09-12T18:02:37.590+0000 7f52fd60a640 4 set_mon_vals no callback set 2024-09-12T18:02:38.405 INFO:tasks.workunit.client.0.smithi098.stderr: -392> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient: _renew_subs 2024-09-12T18:02:38.405 INFO:tasks.workunit.client.0.smithi098.stderr: -391> 2024-09-12T18:02:37.590+0000 7f54119f79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.406 INFO:tasks.workunit.client.0.smithi098.stderr: -390> 2024-09-12T18:02:37.590+0000 7f54119f79c0 1 librados: init done 2024-09-12T18:02:38.406 INFO:tasks.workunit.client.0.smithi098.stderr: -389> 2024-09-12T18:02:37.590+0000 7f52fbe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:38.406 INFO:tasks.workunit.client.0.smithi098.stderr: -388> 2024-09-12T18:02:37.590+0000 7f52fbe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:38.406 INFO:tasks.workunit.client.0.smithi098.stderr: -387> 2024-09-12T18:02:37.590+0000 7f52fbe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:38.406 INFO:tasks.workunit.client.0.smithi098.stderr: -386> 2024-09-12T18:02:37.590+0000 7f540ecfc640 10 monclient: get_auth_request con 0x7f52f4070ae0 auth_method 0 2024-09-12T18:02:38.406 INFO:tasks.workunit.client.0.smithi098.stderr: -385> 2024-09-12T18:02:37.590+0000 7f540fcfe640 10 monclient: get_auth_request con 0x560ba0436cd0 auth_method 0 2024-09-12T18:02:38.406 INFO:tasks.workunit.client.0.smithi098.stderr: -384> 2024-09-12T18:02:37.594+0000 7f540f4fd640 10 monclient: get_auth_request con 0x560ba0459110 auth_method 0 2024-09-12T18:02:38.406 INFO:tasks.workunit.client.0.smithi098.stderr: -383> 2024-09-12T18:02:37.594+0000 7f540ecfc640 10 monclient: get_auth_request con 0x560ba045ca20 auth_method 0 2024-09-12T18:02:38.406 INFO:tasks.workunit.client.0.smithi098.stderr: -382> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient: build_initial_monmap 2024-09-12T18:02:38.406 INFO:tasks.workunit.client.0.smithi098.stderr: -381> 2024-09-12T18:02:37.598+0000 7f54119f79c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:38.406 INFO:tasks.workunit.client.0.smithi098.stderr: -380> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient: monmap: 2024-09-12T18:02:38.406 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:02:38.406 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:38.406 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:02:38.406 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:02:38.406 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:38.407 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.407 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:02:38.407 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:02:38.407 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:02:38.407 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.407 INFO:tasks.workunit.client.0.smithi098.stderr: -379> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding auth protocol: cephx 2024-09-12T18:02:38.407 INFO:tasks.workunit.client.0.smithi098.stderr: -378> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding auth protocol: cephx 2024-09-12T18:02:38.407 INFO:tasks.workunit.client.0.smithi098.stderr: -377> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding auth protocol: cephx 2024-09-12T18:02:38.407 INFO:tasks.workunit.client.0.smithi098.stderr: -376> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: secure 2024-09-12T18:02:38.407 INFO:tasks.workunit.client.0.smithi098.stderr: -375> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: crc 2024-09-12T18:02:38.407 INFO:tasks.workunit.client.0.smithi098.stderr: -374> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: secure 2024-09-12T18:02:38.407 INFO:tasks.workunit.client.0.smithi098.stderr: -373> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: crc 2024-09-12T18:02:38.407 INFO:tasks.workunit.client.0.smithi098.stderr: -372> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: secure 2024-09-12T18:02:38.407 INFO:tasks.workunit.client.0.smithi098.stderr: -371> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: crc 2024-09-12T18:02:38.408 INFO:tasks.workunit.client.0.smithi098.stderr: -370> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: crc 2024-09-12T18:02:38.408 INFO:tasks.workunit.client.0.smithi098.stderr: -369> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: secure 2024-09-12T18:02:38.408 INFO:tasks.workunit.client.0.smithi098.stderr: -368> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: crc 2024-09-12T18:02:38.408 INFO:tasks.workunit.client.0.smithi098.stderr: -367> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: secure 2024-09-12T18:02:38.408 INFO:tasks.workunit.client.0.smithi098.stderr: -366> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: crc 2024-09-12T18:02:38.408 INFO:tasks.workunit.client.0.smithi098.stderr: -365> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba04623b0) adding con mode: secure 2024-09-12T18:02:38.408 INFO:tasks.workunit.client.0.smithi098.stderr: -364> 2024-09-12T18:02:37.598+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.408 INFO:tasks.workunit.client.0.smithi098.stderr: -363> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command objecter_requests cmddesc objecter_requests hook 0x560ba0465e20 EEXIST 2024-09-12T18:02:38.408 INFO:tasks.workunit.client.0.smithi098.stderr: -362> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient: init 2024-09-12T18:02:38.408 INFO:tasks.workunit.client.0.smithi098.stderr: -361> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding auth protocol: cephx 2024-09-12T18:02:38.408 INFO:tasks.workunit.client.0.smithi098.stderr: -360> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding auth protocol: cephx 2024-09-12T18:02:38.408 INFO:tasks.workunit.client.0.smithi098.stderr: -359> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding auth protocol: cephx 2024-09-12T18:02:38.408 INFO:tasks.workunit.client.0.smithi098.stderr: -358> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: secure 2024-09-12T18:02:38.408 INFO:tasks.workunit.client.0.smithi098.stderr: -357> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: crc 2024-09-12T18:02:38.408 INFO:tasks.workunit.client.0.smithi098.stderr: -356> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: secure 2024-09-12T18:02:38.409 INFO:tasks.workunit.client.0.smithi098.stderr: -355> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: crc 2024-09-12T18:02:38.409 INFO:tasks.workunit.client.0.smithi098.stderr: -354> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: secure 2024-09-12T18:02:38.409 INFO:tasks.workunit.client.0.smithi098.stderr: -353> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: crc 2024-09-12T18:02:38.409 INFO:tasks.workunit.client.0.smithi098.stderr: -352> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: crc 2024-09-12T18:02:38.409 INFO:tasks.workunit.client.0.smithi098.stderr: -351> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: secure 2024-09-12T18:02:38.409 INFO:tasks.workunit.client.0.smithi098.stderr: -350> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: crc 2024-09-12T18:02:38.409 INFO:tasks.workunit.client.0.smithi098.stderr: -349> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: secure 2024-09-12T18:02:38.409 INFO:tasks.workunit.client.0.smithi098.stderr: -348> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: crc 2024-09-12T18:02:38.409 INFO:tasks.workunit.client.0.smithi098.stderr: -347> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 AuthRegistry(0x560ba0461408) adding con mode: secure 2024-09-12T18:02:38.409 INFO:tasks.workunit.client.0.smithi098.stderr: -346> 2024-09-12T18:02:37.598+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.409 INFO:tasks.workunit.client.0.smithi098.stderr: -345> 2024-09-12T18:02:37.598+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.409 INFO:tasks.workunit.client.0.smithi098.stderr: -344> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command rotate-key cmddesc rotate-key hook 0x560ba0461550 EEXIST 2024-09-12T18:02:38.409 INFO:tasks.workunit.client.0.smithi098.stderr: -343> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:38.409 INFO:tasks.workunit.client.0.smithi098.stderr: -342> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:02:38.409 INFO:tasks.workunit.client.0.smithi098.stderr: -341> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-c con 0x560ba0489fd0 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:02:38.410 INFO:tasks.workunit.client.0.smithi098.stderr: -340> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-a con 0x560ba0489900 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:02:38.410 INFO:tasks.workunit.client.0.smithi098.stderr: -339> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-b con 0x560ba04882e0 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:02:38.410 INFO:tasks.workunit.client.0.smithi098.stderr: -338> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.410 INFO:tasks.workunit.client.0.smithi098.stderr: -337> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.410 INFO:tasks.workunit.client.0.smithi098.stderr: -336> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.410 INFO:tasks.workunit.client.0.smithi098.stderr: -335> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:38.410 INFO:tasks.workunit.client.0.smithi098.stderr: -334> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient(hunting): authenticate will time out at 2954.170224s 2024-09-12T18:02:38.410 INFO:tasks.workunit.client.0.smithi098.stderr: -333> 2024-09-12T18:02:37.598+0000 7f540f4fd640 10 monclient(hunting): get_auth_request con 0x560ba0489fd0 auth_method 0 2024-09-12T18:02:38.410 INFO:tasks.workunit.client.0.smithi098.stderr: -332> 2024-09-12T18:02:37.598+0000 7f540f4fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:38.410 INFO:tasks.workunit.client.0.smithi098.stderr: -331> 2024-09-12T18:02:37.598+0000 7f540f4fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:38.410 INFO:tasks.workunit.client.0.smithi098.stderr: -330> 2024-09-12T18:02:37.598+0000 7f540f4fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:38.410 INFO:tasks.workunit.client.0.smithi098.stderr: -329> 2024-09-12T18:02:37.598+0000 7f540ecfc640 10 monclient(hunting): get_auth_request con 0x560ba0489900 auth_method 0 2024-09-12T18:02:38.410 INFO:tasks.workunit.client.0.smithi098.stderr: -328> 2024-09-12T18:02:37.598+0000 7f540ecfc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:38.410 INFO:tasks.workunit.client.0.smithi098.stderr: -327> 2024-09-12T18:02:37.598+0000 7f540ecfc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:38.410 INFO:tasks.workunit.client.0.smithi098.stderr: -326> 2024-09-12T18:02:37.598+0000 7f540ecfc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:38.411 INFO:tasks.workunit.client.0.smithi098.stderr: -325> 2024-09-12T18:02:37.598+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:38.411 INFO:tasks.workunit.client.0.smithi098.stderr: -324> 2024-09-12T18:02:37.598+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:38.411 INFO:tasks.workunit.client.0.smithi098.stderr: -323> 2024-09-12T18:02:37.598+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:38.411 INFO:tasks.workunit.client.0.smithi098.stderr: -322> 2024-09-12T18:02:37.598+0000 7f540ecfc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:38.411 INFO:tasks.workunit.client.0.smithi098.stderr: -321> 2024-09-12T18:02:37.598+0000 7f540ecfc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:38.411 INFO:tasks.workunit.client.0.smithi098.stderr: -320> 2024-09-12T18:02:37.598+0000 7f540ecfc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:38.411 INFO:tasks.workunit.client.0.smithi098.stderr: -319> 2024-09-12T18:02:37.598+0000 7f540f4fd640 10 monclient(hunting): handle_auth_done global_id 7790 payload 824 2024-09-12T18:02:38.411 INFO:tasks.workunit.client.0.smithi098.stderr: -318> 2024-09-12T18:02:37.598+0000 7f540f4fd640 10 monclient: _finish_hunting 0 2024-09-12T18:02:38.411 INFO:tasks.workunit.client.0.smithi098.stderr: -317> 2024-09-12T18:02:37.598+0000 7f540f4fd640 1 monclient: found mon.noname-c 2024-09-12T18:02:38.411 INFO:tasks.workunit.client.0.smithi098.stderr: -316> 2024-09-12T18:02:37.598+0000 7f540f4fd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.411 INFO:tasks.workunit.client.0.smithi098.stderr: -315> 2024-09-12T18:02:37.598+0000 7f540fcfe640 10 monclient: get_auth_request con 0x560ba04882e0 auth_method 0 2024-09-12T18:02:38.411 INFO:tasks.workunit.client.0.smithi098.stderr: -314> 2024-09-12T18:02:37.598+0000 7f52f9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:38.411 INFO:tasks.workunit.client.0.smithi098.stderr: -313> 2024-09-12T18:02:37.598+0000 7f52f9602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:38.411 INFO:tasks.workunit.client.0.smithi098.stderr: -312> 2024-09-12T18:02:37.598+0000 7f52f9602640 10 monclient: dump: 2024-09-12T18:02:38.411 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:38.412 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:38.412 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.412 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.412 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:38.412 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.412 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:38.412 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:38.412 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:38.412 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.412 INFO:tasks.workunit.client.0.smithi098.stderr: -311> 2024-09-12T18:02:37.598+0000 7f52f9602640 10 monclient: _finish_auth 0 2024-09-12T18:02:38.412 INFO:tasks.workunit.client.0.smithi098.stderr: -310> 2024-09-12T18:02:37.598+0000 7f52f9602640 10 monclient: _check_auth_tickets 2024-09-12T18:02:38.412 INFO:tasks.workunit.client.0.smithi098.stderr: -309> 2024-09-12T18:02:37.598+0000 7f52f9602640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:38.412 INFO:tasks.workunit.client.0.smithi098.stderr: -308> 2024-09-12T18:02:37.598+0000 7f52f9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:38.412 INFO:tasks.workunit.client.0.smithi098.stderr: -307> 2024-09-12T18:02:37.598+0000 7f52f9602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:38.412 INFO:tasks.workunit.client.0.smithi098.stderr: -306> 2024-09-12T18:02:37.598+0000 7f52f9602640 10 monclient: dump: 2024-09-12T18:02:38.413 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:38.413 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:38.413 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.413 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.413 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:38.413 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.413 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:38.413 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:38.413 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:38.413 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.413 INFO:tasks.workunit.client.0.smithi098.stderr: -305> 2024-09-12T18:02:37.598+0000 7f54119f79c0 5 monclient: authenticate success, global_id 7790 2024-09-12T18:02:38.413 INFO:tasks.workunit.client.0.smithi098.stderr: -304> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient: _renew_subs 2024-09-12T18:02:38.413 INFO:tasks.workunit.client.0.smithi098.stderr: -303> 2024-09-12T18:02:37.598+0000 7f54104ff640 4 set_mon_vals no callback set 2024-09-12T18:02:38.413 INFO:tasks.workunit.client.0.smithi098.stderr: -302> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.413 INFO:tasks.workunit.client.0.smithi098.stderr: -301> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient: _renew_subs 2024-09-12T18:02:38.414 INFO:tasks.workunit.client.0.smithi098.stderr: -300> 2024-09-12T18:02:37.598+0000 7f54119f79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.414 INFO:tasks.workunit.client.0.smithi098.stderr: -299> 2024-09-12T18:02:37.602+0000 7f52f9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:38.414 INFO:tasks.workunit.client.0.smithi098.stderr: -298> 2024-09-12T18:02:37.602+0000 7f52f9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:38.414 INFO:tasks.workunit.client.0.smithi098.stderr: -297> 2024-09-12T18:02:37.602+0000 7f52f9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:38.414 INFO:tasks.workunit.client.0.smithi098.stderr: -296> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient: get_monmap_and_config 2024-09-12T18:02:38.414 INFO:tasks.workunit.client.0.smithi098.stderr: -295> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient: build_initial_monmap 2024-09-12T18:02:38.414 INFO:tasks.workunit.client.0.smithi098.stderr: -294> 2024-09-12T18:02:37.602+0000 7f54119f79c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:38.414 INFO:tasks.workunit.client.0.smithi098.stderr: -293> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient: monmap: 2024-09-12T18:02:38.414 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:02:38.414 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:38.414 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:02:38.414 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:02:38.414 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:38.414 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.415 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:02:38.415 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:02:38.415 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:02:38.415 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.415 INFO:tasks.workunit.client.0.smithi098.stderr: -292> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding auth protocol: cephx 2024-09-12T18:02:38.415 INFO:tasks.workunit.client.0.smithi098.stderr: -291> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding auth protocol: cephx 2024-09-12T18:02:38.415 INFO:tasks.workunit.client.0.smithi098.stderr: -290> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding auth protocol: cephx 2024-09-12T18:02:38.415 INFO:tasks.workunit.client.0.smithi098.stderr: -289> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: secure 2024-09-12T18:02:38.415 INFO:tasks.workunit.client.0.smithi098.stderr: -288> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: crc 2024-09-12T18:02:38.415 INFO:tasks.workunit.client.0.smithi098.stderr: -287> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: secure 2024-09-12T18:02:38.415 INFO:tasks.workunit.client.0.smithi098.stderr: -286> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: crc 2024-09-12T18:02:38.415 INFO:tasks.workunit.client.0.smithi098.stderr: -285> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: secure 2024-09-12T18:02:38.415 INFO:tasks.workunit.client.0.smithi098.stderr: -284> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: crc 2024-09-12T18:02:38.416 INFO:tasks.workunit.client.0.smithi098.stderr: -283> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: crc 2024-09-12T18:02:38.416 INFO:tasks.workunit.client.0.smithi098.stderr: -282> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: secure 2024-09-12T18:02:38.416 INFO:tasks.workunit.client.0.smithi098.stderr: -281> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: crc 2024-09-12T18:02:38.416 INFO:tasks.workunit.client.0.smithi098.stderr: -280> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: secure 2024-09-12T18:02:38.416 INFO:tasks.workunit.client.0.smithi098.stderr: -279> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: crc 2024-09-12T18:02:38.416 INFO:tasks.workunit.client.0.smithi098.stderr: -278> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04a9640) adding con mode: secure 2024-09-12T18:02:38.416 INFO:tasks.workunit.client.0.smithi098.stderr: -277> 2024-09-12T18:02:37.602+0000 7f540ecfc640 10 monclient: get_auth_request con 0x7f52e8070a20 auth_method 0 2024-09-12T18:02:38.416 INFO:tasks.workunit.client.0.smithi098.stderr: -276> 2024-09-12T18:02:37.602+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.416 INFO:tasks.workunit.client.0.smithi098.stderr: -275> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient: init 2024-09-12T18:02:38.416 INFO:tasks.workunit.client.0.smithi098.stderr: -274> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding auth protocol: cephx 2024-09-12T18:02:38.416 INFO:tasks.workunit.client.0.smithi098.stderr: -273> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding auth protocol: cephx 2024-09-12T18:02:38.416 INFO:tasks.workunit.client.0.smithi098.stderr: -272> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding auth protocol: cephx 2024-09-12T18:02:38.416 INFO:tasks.workunit.client.0.smithi098.stderr: -271> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: secure 2024-09-12T18:02:38.416 INFO:tasks.workunit.client.0.smithi098.stderr: -270> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: crc 2024-09-12T18:02:38.417 INFO:tasks.workunit.client.0.smithi098.stderr: -269> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: secure 2024-09-12T18:02:38.417 INFO:tasks.workunit.client.0.smithi098.stderr: -268> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: crc 2024-09-12T18:02:38.417 INFO:tasks.workunit.client.0.smithi098.stderr: -267> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: secure 2024-09-12T18:02:38.417 INFO:tasks.workunit.client.0.smithi098.stderr: -266> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: crc 2024-09-12T18:02:38.417 INFO:tasks.workunit.client.0.smithi098.stderr: -265> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: crc 2024-09-12T18:02:38.417 INFO:tasks.workunit.client.0.smithi098.stderr: -264> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: secure 2024-09-12T18:02:38.417 INFO:tasks.workunit.client.0.smithi098.stderr: -263> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: crc 2024-09-12T18:02:38.417 INFO:tasks.workunit.client.0.smithi098.stderr: -262> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: secure 2024-09-12T18:02:38.417 INFO:tasks.workunit.client.0.smithi098.stderr: -261> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: crc 2024-09-12T18:02:38.417 INFO:tasks.workunit.client.0.smithi098.stderr: -260> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85570) adding con mode: secure 2024-09-12T18:02:38.417 INFO:tasks.workunit.client.0.smithi098.stderr: -259> 2024-09-12T18:02:37.602+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.417 INFO:tasks.workunit.client.0.smithi098.stderr: -258> 2024-09-12T18:02:37.602+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.417 INFO:tasks.workunit.client.0.smithi098.stderr: -257> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command rotate-key cmddesc rotate-key hook 0x7ffcc2e856b8 EEXIST 2024-09-12T18:02:38.417 INFO:tasks.workunit.client.0.smithi098.stderr: -256> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:38.417 INFO:tasks.workunit.client.0.smithi098.stderr: -255> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:02:38.418 INFO:tasks.workunit.client.0.smithi098.stderr: -254> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-c con 0x560ba04d7c90 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:02:38.418 INFO:tasks.workunit.client.0.smithi098.stderr: -253> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-b con 0x560ba04d8070 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:02:38.418 INFO:tasks.workunit.client.0.smithi098.stderr: -252> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-a con 0x560ba04dd900 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:02:38.418 INFO:tasks.workunit.client.0.smithi098.stderr: -251> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.418 INFO:tasks.workunit.client.0.smithi098.stderr: -250> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.418 INFO:tasks.workunit.client.0.smithi098.stderr: -249> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.418 INFO:tasks.workunit.client.0.smithi098.stderr: -248> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:38.418 INFO:tasks.workunit.client.0.smithi098.stderr: -247> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient(hunting): authenticate will time out at 2954.174143s 2024-09-12T18:02:38.418 INFO:tasks.workunit.client.0.smithi098.stderr: -246> 2024-09-12T18:02:37.602+0000 7f540f4fd640 10 monclient(hunting): get_auth_request con 0x560ba04d7c90 auth_method 0 2024-09-12T18:02:38.418 INFO:tasks.workunit.client.0.smithi098.stderr: -245> 2024-09-12T18:02:37.602+0000 7f540f4fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:38.418 INFO:tasks.workunit.client.0.smithi098.stderr: -244> 2024-09-12T18:02:37.602+0000 7f540f4fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:38.418 INFO:tasks.workunit.client.0.smithi098.stderr: -243> 2024-09-12T18:02:37.602+0000 7f540f4fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:38.418 INFO:tasks.workunit.client.0.smithi098.stderr: -242> 2024-09-12T18:02:37.602+0000 7f540fcfe640 10 monclient(hunting): get_auth_request con 0x560ba04dd900 auth_method 0 2024-09-12T18:02:38.418 INFO:tasks.workunit.client.0.smithi098.stderr: -241> 2024-09-12T18:02:37.602+0000 7f540fcfe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:38.418 INFO:tasks.workunit.client.0.smithi098.stderr: -240> 2024-09-12T18:02:37.602+0000 7f540fcfe640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:38.419 INFO:tasks.workunit.client.0.smithi098.stderr: -239> 2024-09-12T18:02:37.602+0000 7f540fcfe640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:38.419 INFO:tasks.workunit.client.0.smithi098.stderr: -238> 2024-09-12T18:02:37.602+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:38.419 INFO:tasks.workunit.client.0.smithi098.stderr: -237> 2024-09-12T18:02:37.602+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:38.419 INFO:tasks.workunit.client.0.smithi098.stderr: -236> 2024-09-12T18:02:37.602+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:38.419 INFO:tasks.workunit.client.0.smithi098.stderr: -235> 2024-09-12T18:02:37.602+0000 7f540fcfe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:38.419 INFO:tasks.workunit.client.0.smithi098.stderr: -234> 2024-09-12T18:02:37.602+0000 7f540fcfe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:38.419 INFO:tasks.workunit.client.0.smithi098.stderr: -233> 2024-09-12T18:02:37.602+0000 7f540fcfe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:38.419 INFO:tasks.workunit.client.0.smithi098.stderr: -232> 2024-09-12T18:02:37.602+0000 7f540f4fd640 10 monclient(hunting): handle_auth_done global_id 7793 payload 274 2024-09-12T18:02:38.419 INFO:tasks.workunit.client.0.smithi098.stderr: -231> 2024-09-12T18:02:37.602+0000 7f540f4fd640 10 monclient: _finish_hunting 0 2024-09-12T18:02:38.419 INFO:tasks.workunit.client.0.smithi098.stderr: -230> 2024-09-12T18:02:37.602+0000 7f540f4fd640 1 monclient: found mon.noname-c 2024-09-12T18:02:38.419 INFO:tasks.workunit.client.0.smithi098.stderr: -229> 2024-09-12T18:02:37.602+0000 7f540f4fd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.419 INFO:tasks.workunit.client.0.smithi098.stderr: -228> 2024-09-12T18:02:37.602+0000 7f52f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:38.419 INFO:tasks.workunit.client.0.smithi098.stderr: -227> 2024-09-12T18:02:37.602+0000 7f52f2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:38.419 INFO:tasks.workunit.client.0.smithi098.stderr: -226> 2024-09-12T18:02:37.602+0000 7f52f2ffd640 10 monclient: dump: 2024-09-12T18:02:38.419 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:38.420 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:38.420 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.420 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.420 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:38.420 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.420 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:38.420 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:38.420 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:38.420 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.420 INFO:tasks.workunit.client.0.smithi098.stderr: -225> 2024-09-12T18:02:37.602+0000 7f52f2ffd640 10 monclient: _finish_auth 0 2024-09-12T18:02:38.420 INFO:tasks.workunit.client.0.smithi098.stderr: -224> 2024-09-12T18:02:37.602+0000 7f52f2ffd640 10 monclient: _check_auth_tickets 2024-09-12T18:02:38.420 INFO:tasks.workunit.client.0.smithi098.stderr: -223> 2024-09-12T18:02:37.602+0000 7f52f2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:38.420 INFO:tasks.workunit.client.0.smithi098.stderr: -222> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 monclient: authenticate success, global_id 7793 2024-09-12T18:02:38.420 INFO:tasks.workunit.client.0.smithi098.stderr: -221> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient: get_monmap_and_config success 2024-09-12T18:02:38.421 INFO:tasks.workunit.client.0.smithi098.stderr: -220> 2024-09-12T18:02:37.602+0000 7f54119f79c0 4 set_mon_vals no callback set 2024-09-12T18:02:38.421 INFO:tasks.workunit.client.0.smithi098.stderr: -219> 2024-09-12T18:02:37.602+0000 7f52f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:38.421 INFO:tasks.workunit.client.0.smithi098.stderr: -218> 2024-09-12T18:02:37.602+0000 7f52f2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:38.421 INFO:tasks.workunit.client.0.smithi098.stderr: -217> 2024-09-12T18:02:37.602+0000 7f52f2ffd640 10 monclient: dump: 2024-09-12T18:02:38.421 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:38.421 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:38.421 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.421 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.421 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:38.421 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.421 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:38.421 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:38.421 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:38.421 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.422 INFO:tasks.workunit.client.0.smithi098.stderr: -216> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient: shutdown 2024-09-12T18:02:38.422 INFO:tasks.workunit.client.0.smithi098.stderr: -215> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient: build_initial_monmap 2024-09-12T18:02:38.422 INFO:tasks.workunit.client.0.smithi098.stderr: -214> 2024-09-12T18:02:37.602+0000 7f54119f79c0 1 build_initial for_mkfs: 0 2024-09-12T18:02:38.422 INFO:tasks.workunit.client.0.smithi098.stderr: -213> 2024-09-12T18:02:37.602+0000 7f54119f79c0 10 monclient: monmap: 2024-09-12T18:02:38.422 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 0 2024-09-12T18:02:38.422 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:02:38.422 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 0.000000 2024-09-12T18:02:38.422 INFO:tasks.workunit.client.0.smithi098.stderr:created 0.000000 2024-09-12T18:02:38.422 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 0 (unknown) 2024-09-12T18:02:38.422 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.422 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.noname-a 2024-09-12T18:02:38.422 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.noname-b 2024-09-12T18:02:38.422 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.noname-c 2024-09-12T18:02:38.422 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.422 INFO:tasks.workunit.client.0.smithi098.stderr: -212> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding auth protocol: cephx 2024-09-12T18:02:38.423 INFO:tasks.workunit.client.0.smithi098.stderr: -211> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding auth protocol: cephx 2024-09-12T18:02:38.423 INFO:tasks.workunit.client.0.smithi098.stderr: -210> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding auth protocol: cephx 2024-09-12T18:02:38.423 INFO:tasks.workunit.client.0.smithi098.stderr: -209> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: secure 2024-09-12T18:02:38.423 INFO:tasks.workunit.client.0.smithi098.stderr: -208> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: crc 2024-09-12T18:02:38.423 INFO:tasks.workunit.client.0.smithi098.stderr: -207> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: secure 2024-09-12T18:02:38.423 INFO:tasks.workunit.client.0.smithi098.stderr: -206> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: crc 2024-09-12T18:02:38.423 INFO:tasks.workunit.client.0.smithi098.stderr: -205> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: secure 2024-09-12T18:02:38.423 INFO:tasks.workunit.client.0.smithi098.stderr: -204> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: crc 2024-09-12T18:02:38.423 INFO:tasks.workunit.client.0.smithi098.stderr: -203> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: crc 2024-09-12T18:02:38.423 INFO:tasks.workunit.client.0.smithi098.stderr: -202> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: secure 2024-09-12T18:02:38.423 INFO:tasks.workunit.client.0.smithi098.stderr: -201> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: crc 2024-09-12T18:02:38.423 INFO:tasks.workunit.client.0.smithi098.stderr: -200> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: secure 2024-09-12T18:02:38.423 INFO:tasks.workunit.client.0.smithi098.stderr: -199> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: crc 2024-09-12T18:02:38.423 INFO:tasks.workunit.client.0.smithi098.stderr: -198> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 AuthRegistry(0x560ba04e2d80) adding con mode: secure 2024-09-12T18:02:38.423 INFO:tasks.workunit.client.0.smithi098.stderr: -197> 2024-09-12T18:02:37.602+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.424 INFO:tasks.workunit.client.0.smithi098.stderr: -196> 2024-09-12T18:02:37.602+0000 7f54119f79c0 1 librados: starting msgr at 2024-09-12T18:02:38.424 INFO:tasks.workunit.client.0.smithi098.stderr: -195> 2024-09-12T18:02:37.602+0000 7f54119f79c0 1 librados: starting objecter 2024-09-12T18:02:38.424 INFO:tasks.workunit.client.0.smithi098.stderr: -194> 2024-09-12T18:02:37.602+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command objecter_requests cmddesc objecter_requests hook 0x560ba04abaa0 EEXIST 2024-09-12T18:02:38.424 INFO:tasks.workunit.client.0.smithi098.stderr: -193> 2024-09-12T18:02:37.606+0000 7f54119f79c0 1 librados: setting wanted keys 2024-09-12T18:02:38.424 INFO:tasks.workunit.client.0.smithi098.stderr: -192> 2024-09-12T18:02:37.606+0000 7f54119f79c0 1 librados: calling monclient init 2024-09-12T18:02:38.424 INFO:tasks.workunit.client.0.smithi098.stderr: -191> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient: init 2024-09-12T18:02:38.424 INFO:tasks.workunit.client.0.smithi098.stderr: -190> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding auth protocol: cephx 2024-09-12T18:02:38.424 INFO:tasks.workunit.client.0.smithi098.stderr: -189> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding auth protocol: cephx 2024-09-12T18:02:38.424 INFO:tasks.workunit.client.0.smithi098.stderr: -188> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding auth protocol: cephx 2024-09-12T18:02:38.424 INFO:tasks.workunit.client.0.smithi098.stderr: -187> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: secure 2024-09-12T18:02:38.424 INFO:tasks.workunit.client.0.smithi098.stderr: -186> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: crc 2024-09-12T18:02:38.424 INFO:tasks.workunit.client.0.smithi098.stderr: -185> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: secure 2024-09-12T18:02:38.424 INFO:tasks.workunit.client.0.smithi098.stderr: -184> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: crc 2024-09-12T18:02:38.424 INFO:tasks.workunit.client.0.smithi098.stderr: -183> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: secure 2024-09-12T18:02:38.424 INFO:tasks.workunit.client.0.smithi098.stderr: -182> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: crc 2024-09-12T18:02:38.425 INFO:tasks.workunit.client.0.smithi098.stderr: -181> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: crc 2024-09-12T18:02:38.425 INFO:tasks.workunit.client.0.smithi098.stderr: -180> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: secure 2024-09-12T18:02:38.425 INFO:tasks.workunit.client.0.smithi098.stderr: -179> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: crc 2024-09-12T18:02:38.425 INFO:tasks.workunit.client.0.smithi098.stderr: -178> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: secure 2024-09-12T18:02:38.425 INFO:tasks.workunit.client.0.smithi098.stderr: -177> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: crc 2024-09-12T18:02:38.425 INFO:tasks.workunit.client.0.smithi098.stderr: -176> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 AuthRegistry(0x560ba048bdf0) adding con mode: secure 2024-09-12T18:02:38.425 INFO:tasks.workunit.client.0.smithi098.stderr: -175> 2024-09-12T18:02:37.606+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.425 INFO:tasks.workunit.client.0.smithi098.stderr: -174> 2024-09-12T18:02:37.606+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.425 INFO:tasks.workunit.client.0.smithi098.stderr: -173> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command rotate-key cmddesc rotate-key hook 0x560ba048bf38 EEXIST 2024-09-12T18:02:38.425 INFO:tasks.workunit.client.0.smithi098.stderr: -172> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient: _reopen_session rank -1 2024-09-12T18:02:38.425 INFO:tasks.workunit.client.0.smithi098.stderr: -171> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:02:38.425 INFO:tasks.workunit.client.0.smithi098.stderr: -170> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-a con 0x560ba04d7c90 addr [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-12T18:02:38.425 INFO:tasks.workunit.client.0.smithi098.stderr: -169> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-c con 0x560ba04dd900 addr [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] 2024-09-12T18:02:38.425 INFO:tasks.workunit.client.0.smithi098.stderr: -168> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient(hunting): picked mon.noname-b con 0x560ba04ea360 addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2024-09-12T18:02:38.426 INFO:tasks.workunit.client.0.smithi098.stderr: -167> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.426 INFO:tasks.workunit.client.0.smithi098.stderr: -166> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.426 INFO:tasks.workunit.client.0.smithi098.stderr: -165> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:02:38.426 INFO:tasks.workunit.client.0.smithi098.stderr: -164> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient(hunting): _renew_subs 2024-09-12T18:02:38.426 INFO:tasks.workunit.client.0.smithi098.stderr: -163> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient(hunting): authenticate will time out at 2954.176686s 2024-09-12T18:02:38.426 INFO:tasks.workunit.client.0.smithi098.stderr: -162> 2024-09-12T18:02:37.606+0000 7f540f4fd640 10 monclient(hunting): get_auth_request con 0x560ba04d7c90 auth_method 0 2024-09-12T18:02:38.426 INFO:tasks.workunit.client.0.smithi098.stderr: -161> 2024-09-12T18:02:37.606+0000 7f540f4fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:38.426 INFO:tasks.workunit.client.0.smithi098.stderr: -160> 2024-09-12T18:02:37.606+0000 7f540f4fd640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:38.426 INFO:tasks.workunit.client.0.smithi098.stderr: -159> 2024-09-12T18:02:37.606+0000 7f540f4fd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:38.426 INFO:tasks.workunit.client.0.smithi098.stderr: -158> 2024-09-12T18:02:37.606+0000 7f540ecfc640 10 monclient(hunting): get_auth_request con 0x560ba04dd900 auth_method 0 2024-09-12T18:02:38.426 INFO:tasks.workunit.client.0.smithi098.stderr: -157> 2024-09-12T18:02:37.606+0000 7f540ecfc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:02:38.426 INFO:tasks.workunit.client.0.smithi098.stderr: -156> 2024-09-12T18:02:37.606+0000 7f540ecfc640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:02:38.426 INFO:tasks.workunit.client.0.smithi098.stderr: -155> 2024-09-12T18:02:37.606+0000 7f540ecfc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:02:38.426 INFO:tasks.workunit.client.0.smithi098.stderr: -154> 2024-09-12T18:02:37.606+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:38.426 INFO:tasks.workunit.client.0.smithi098.stderr: -153> 2024-09-12T18:02:37.606+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:38.427 INFO:tasks.workunit.client.0.smithi098.stderr: -152> 2024-09-12T18:02:37.606+0000 7f540f4fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:38.427 INFO:tasks.workunit.client.0.smithi098.stderr: -151> 2024-09-12T18:02:37.606+0000 7f540ecfc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:02:38.427 INFO:tasks.workunit.client.0.smithi098.stderr: -150> 2024-09-12T18:02:37.606+0000 7f540ecfc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:02:38.427 INFO:tasks.workunit.client.0.smithi098.stderr: -149> 2024-09-12T18:02:37.606+0000 7f540ecfc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:02:38.427 INFO:tasks.workunit.client.0.smithi098.stderr: -148> 2024-09-12T18:02:37.606+0000 7f540ecfc640 10 monclient(hunting): handle_auth_done global_id 7796 payload 824 2024-09-12T18:02:38.427 INFO:tasks.workunit.client.0.smithi098.stderr: -147> 2024-09-12T18:02:37.606+0000 7f540ecfc640 10 monclient: _finish_hunting 0 2024-09-12T18:02:38.427 INFO:tasks.workunit.client.0.smithi098.stderr: -146> 2024-09-12T18:02:37.606+0000 7f540ecfc640 1 monclient: found mon.noname-c 2024-09-12T18:02:38.427 INFO:tasks.workunit.client.0.smithi098.stderr: -145> 2024-09-12T18:02:37.606+0000 7f540ecfc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.427 INFO:tasks.workunit.client.0.smithi098.stderr: -144> 2024-09-12T18:02:37.606+0000 7f540fcfe640 10 monclient: get_auth_request con 0x560ba04ea360 auth_method 0 2024-09-12T18:02:38.427 INFO:tasks.workunit.client.0.smithi098.stderr: -143> 2024-09-12T18:02:37.606+0000 7f52f17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:38.427 INFO:tasks.workunit.client.0.smithi098.stderr: -142> 2024-09-12T18:02:37.606+0000 7f52f17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:02:38.427 INFO:tasks.workunit.client.0.smithi098.stderr: -141> 2024-09-12T18:02:37.606+0000 7f52f17fa640 10 monclient: dump: 2024-09-12T18:02:38.427 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:38.427 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:38.427 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.428 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.428 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:38.428 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.428 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:38.428 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:38.428 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:38.428 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.428 INFO:tasks.workunit.client.0.smithi098.stderr: -140> 2024-09-12T18:02:37.606+0000 7f52f17fa640 10 monclient: _finish_auth 0 2024-09-12T18:02:38.428 INFO:tasks.workunit.client.0.smithi098.stderr: -139> 2024-09-12T18:02:37.606+0000 7f52f17fa640 10 monclient: _check_auth_tickets 2024-09-12T18:02:38.428 INFO:tasks.workunit.client.0.smithi098.stderr: -138> 2024-09-12T18:02:37.606+0000 7f52f17fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:02:38.428 INFO:tasks.workunit.client.0.smithi098.stderr: -137> 2024-09-12T18:02:37.606+0000 7f52f17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:02:38.428 INFO:tasks.workunit.client.0.smithi098.stderr: -136> 2024-09-12T18:02:37.606+0000 7f52f17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:02:38.428 INFO:tasks.workunit.client.0.smithi098.stderr: -135> 2024-09-12T18:02:37.606+0000 7f52f17fa640 10 monclient: dump: 2024-09-12T18:02:38.428 INFO:tasks.workunit.client.0.smithi098.stderr:epoch 1 2024-09-12T18:02:38.428 INFO:tasks.workunit.client.0.smithi098.stderr:fsid 3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b 2024-09-12T18:02:38.429 INFO:tasks.workunit.client.0.smithi098.stderr:last_changed 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.429 INFO:tasks.workunit.client.0.smithi098.stderr:created 2024-09-12T17:28:35.538883+0000 2024-09-12T18:02:38.429 INFO:tasks.workunit.client.0.smithi098.stderr:min_mon_release 19 (squid) 2024-09-12T18:02:38.429 INFO:tasks.workunit.client.0.smithi098.stderr:election_strategy: 1 2024-09-12T18:02:38.429 INFO:tasks.workunit.client.0.smithi098.stderr:0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-12T18:02:38.429 INFO:tasks.workunit.client.0.smithi098.stderr:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2024-09-12T18:02:38.429 INFO:tasks.workunit.client.0.smithi098.stderr:2: [v2:172.21.15.98:3301/0,v1:172.21.15.98:6790/0] mon.c 2024-09-12T18:02:38.429 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.429 INFO:tasks.workunit.client.0.smithi098.stderr: -134> 2024-09-12T18:02:37.606+0000 7f52f2ffd640 4 set_mon_vals no callback set 2024-09-12T18:02:38.429 INFO:tasks.workunit.client.0.smithi098.stderr: -133> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 monclient: authenticate success, global_id 7796 2024-09-12T18:02:38.429 INFO:tasks.workunit.client.0.smithi098.stderr: -132> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient: _renew_subs 2024-09-12T18:02:38.429 INFO:tasks.workunit.client.0.smithi098.stderr: -131> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.429 INFO:tasks.workunit.client.0.smithi098.stderr: -130> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient: _renew_subs 2024-09-12T18:02:38.430 INFO:tasks.workunit.client.0.smithi098.stderr: -129> 2024-09-12T18:02:37.606+0000 7f54119f79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.430 INFO:tasks.workunit.client.0.smithi098.stderr: -128> 2024-09-12T18:02:37.606+0000 7f54119f79c0 1 librados: init done 2024-09-12T18:02:38.430 INFO:tasks.workunit.client.0.smithi098.stderr: -127> 2024-09-12T18:02:37.606+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command cr dump hook 0x560ba04d30b8 2024-09-12T18:02:38.430 INFO:tasks.workunit.client.0.smithi098.stderr: -126> 2024-09-12T18:02:37.606+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.430 INFO:tasks.workunit.client.0.smithi098.stderr: -125> 2024-09-12T18:02:37.610+0000 7f52f17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:02:38.430 INFO:tasks.workunit.client.0.smithi098.stderr: -124> 2024-09-12T18:02:37.610+0000 7f52f17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:38.430 INFO:tasks.workunit.client.0.smithi098.stderr: -123> 2024-09-12T18:02:37.610+0000 7f52f17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.187:6832/3605168434,v1:172.21.15.187:6833/3605168434] 2024-09-12T18:02:38.430 INFO:tasks.workunit.client.0.smithi098.stderr: -122> 2024-09-12T18:02:37.610+0000 7f540f4fd640 10 monclient: get_auth_request con 0x7f52d8070b10 auth_method 0 2024-09-12T18:02:38.430 INFO:tasks.workunit.client.0.smithi098.stderr: -121> 2024-09-12T18:02:37.610+0000 7f540fcfe640 10 monclient: get_auth_request con 0x560ba04f6fb0 auth_method 0 2024-09-12T18:02:38.430 INFO:tasks.workunit.client.0.smithi098.stderr: -120> 2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.430 INFO:tasks.workunit.client.0.smithi098.stderr: -119> 2024-09-12T18:02:37.610+0000 7f54119f79c0 20 realm 2024-09-12T18:02:38.430 INFO:tasks.workunit.client.0.smithi098.stderr: -118> 2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.430 INFO:tasks.workunit.client.0.smithi098.stderr: -117> 2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.430 INFO:tasks.workunit.client.0.smithi098.stderr: -116> 2024-09-12T18:02:37.610+0000 7f54119f79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:38.430 INFO:tasks.workunit.client.0.smithi098.stderr: -115> 2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.430 INFO:tasks.workunit.client.0.smithi098.stderr: -114> 2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.431 INFO:tasks.workunit.client.0.smithi098.stderr: -113> 2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.431 INFO:tasks.workunit.client.0.smithi098.stderr: -112> 2024-09-12T18:02:37.610+0000 7f540f4fd640 10 monclient: get_auth_request con 0x560ba04fb290 auth_method 0 2024-09-12T18:02:38.431 INFO:tasks.workunit.client.0.smithi098.stderr: -111> 2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:38.431 INFO:tasks.workunit.client.0.smithi098.stderr: -110> 2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.431 INFO:tasks.workunit.client.0.smithi098.stderr: -109> 2024-09-12T18:02:37.610+0000 7f54119f79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:38.431 INFO:tasks.workunit.client.0.smithi098.stderr: -108> 2024-09-12T18:02:37.614+0000 7f54119f79c0 20 searching for the correct realm 2024-09-12T18:02:38.431 INFO:tasks.workunit.client.0.smithi098.stderr: -107> 2024-09-12T18:02:37.614+0000 7f540ecfc640 10 monclient: get_auth_request con 0x560ba0500400 auth_method 0 2024-09-12T18:02:38.431 INFO:tasks.workunit.client.0.smithi098.stderr: -106> 2024-09-12T18:02:37.614+0000 7f540fcfe640 10 monclient: get_auth_request con 0x7f5404036070 auth_method 0 2024-09-12T18:02:38.431 INFO:tasks.workunit.client.0.smithi098.stderr: -105> 2024-09-12T18:02:37.614+0000 7f540f4fd640 10 monclient: get_auth_request con 0x7f5408016040 auth_method 0 2024-09-12T18:02:38.431 INFO:tasks.workunit.client.0.smithi098.stderr: -104> 2024-09-12T18:02:37.614+0000 7f540ecfc640 10 monclient: get_auth_request con 0x7f540011c040 auth_method 0 2024-09-12T18:02:38.431 INFO:tasks.workunit.client.0.smithi098.stderr: -103> 2024-09-12T18:02:37.618+0000 7f540fcfe640 0 -- 172.21.15.98:0/1048950127 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f5404036070 msgr2=0x7f5404020440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:38.431 INFO:tasks.workunit.client.0.smithi098.stderr: -102> 2024-09-12T18:02:37.618+0000 7f52f17fa640 1 client.7796.objecter ms_handle_reset 0x7f5404036070 session 0x7f540403d050 osd.7 2024-09-12T18:02:38.431 INFO:tasks.workunit.client.0.smithi098.stderr: -101> 2024-09-12T18:02:37.618+0000 7f52f17fa640 10 monclient: _renew_subs 2024-09-12T18:02:38.431 INFO:tasks.workunit.client.0.smithi098.stderr: -100> 2024-09-12T18:02:37.618+0000 7f52f17fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.98:3301/0 2024-09-12T18:02:38.431 INFO:tasks.workunit.client.0.smithi098.stderr: -99> 2024-09-12T18:02:37.618+0000 7f540fcfe640 10 monclient: get_auth_request con 0x7f52d8081210 auth_method 0 2024-09-12T18:02:38.432 INFO:tasks.workunit.client.0.smithi098.stderr: -98> 2024-09-12T18:02:37.618+0000 7f540fcfe640 10 monclient: get_auth_request con 0x7f5404008050 auth_method 0 2024-09-12T18:02:38.432 INFO:tasks.workunit.client.0.smithi098.stderr: -97> 2024-09-12T18:02:37.622+0000 7f540f4fd640 10 monclient: get_auth_request con 0x7f5404073520 auth_method 0 2024-09-12T18:02:38.432 INFO:tasks.workunit.client.0.smithi098.stderr: -96> 2024-09-12T18:02:37.826+0000 7f540f4fd640 0 -- 172.21.15.98:0/1048950127 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f5404073520 msgr2=0x7f5404020440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:38.432 INFO:tasks.workunit.client.0.smithi098.stderr: -95> 2024-09-12T18:02:38.230+0000 7f540f4fd640 10 monclient: get_auth_request con 0x7f5404073520 auth_method 0 2024-09-12T18:02:38.432 INFO:tasks.workunit.client.0.smithi098.stderr: -94> 2024-09-12T18:02:38.242+0000 7f54119f79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:38.432 INFO:tasks.workunit.client.0.smithi098.stderr: -93> 2024-09-12T18:02:38.242+0000 7f54119f79c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:02:38.432 INFO:tasks.workunit.client.0.smithi098.stderr: -92> 2024-09-12T18:02:38.242+0000 7f54119f79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:38.432 INFO:tasks.workunit.client.0.smithi098.stderr: -91> 2024-09-12T18:02:38.242+0000 7f54119f79c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:02:38.432 INFO:tasks.workunit.client.0.smithi098.stderr: -90> 2024-09-12T18:02:38.242+0000 7f54119f79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:38.432 INFO:tasks.workunit.client.0.smithi098.stderr: -89> 2024-09-12T18:02:38.242+0000 7f54119f79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:38.432 INFO:tasks.workunit.client.0.smithi098.stderr: -88> 2024-09-12T18:02:38.242+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.432 INFO:tasks.workunit.client.0.smithi098.stderr: -87> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.432 INFO:tasks.workunit.client.0.smithi098.stderr: -86> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.432 INFO:tasks.workunit.client.0.smithi098.stderr: -85> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:38.433 INFO:tasks.workunit.client.0.smithi098.stderr: -84> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.433 INFO:tasks.workunit.client.0.smithi098.stderr: -83> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:38.433 INFO:tasks.workunit.client.0.smithi098.stderr: -82> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 zone default found 2024-09-12T18:02:38.433 INFO:tasks.workunit.client.0.smithi098.stderr: -81> 2024-09-12T18:02:38.246+0000 7f54119f79c0 4 Realm: () 2024-09-12T18:02:38.433 INFO:tasks.workunit.client.0.smithi098.stderr: -80> 2024-09-12T18:02:38.246+0000 7f54119f79c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:02:38.433 INFO:tasks.workunit.client.0.smithi098.stderr: -79> 2024-09-12T18:02:38.246+0000 7f54119f79c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:02:38.433 INFO:tasks.workunit.client.0.smithi098.stderr: -78> 2024-09-12T18:02:38.246+0000 7f54119f79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:38.433 INFO:tasks.workunit.client.0.smithi098.stderr: -77> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 zonegroup default 2024-09-12T18:02:38.433 INFO:tasks.workunit.client.0.smithi098.stderr: -76> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.433 INFO:tasks.workunit.client.0.smithi098.stderr: -75> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.433 INFO:tasks.workunit.client.0.smithi098.stderr: -74> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.433 INFO:tasks.workunit.client.0.smithi098.stderr: -73> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.433 INFO:tasks.workunit.client.0.smithi098.stderr: -72> 2024-09-12T18:02:38.246+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.433 INFO:tasks.workunit.client.0.smithi098.stderr: -71> 2024-09-12T18:02:38.250+0000 7f54119f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.434 INFO:tasks.workunit.client.0.smithi098.stderr: -70> 2024-09-12T18:02:38.250+0000 7f54119f79c0 20 started sync module instance, tier type = 2024-09-12T18:02:38.434 INFO:tasks.workunit.client.0.smithi098.stderr: -69> 2024-09-12T18:02:38.250+0000 7f54119f79c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:02:38.434 INFO:tasks.workunit.client.0.smithi098.stderr: -68> 2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=0 2024-09-12T18:02:38.434 INFO:tasks.workunit.client.0.smithi098.stderr: -67> 2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=1 2024-09-12T18:02:38.434 INFO:tasks.workunit.client.0.smithi098.stderr: -66> 2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=2 2024-09-12T18:02:38.434 INFO:tasks.workunit.client.0.smithi098.stderr: -65> 2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=3 2024-09-12T18:02:38.434 INFO:tasks.workunit.client.0.smithi098.stderr: -64> 2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=4 2024-09-12T18:02:38.434 INFO:tasks.workunit.client.0.smithi098.stderr: -63> 2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=5 2024-09-12T18:02:38.434 INFO:tasks.workunit.client.0.smithi098.stderr: -62> 2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=6 2024-09-12T18:02:38.434 INFO:tasks.workunit.client.0.smithi098.stderr: -61> 2024-09-12T18:02:38.270+0000 7f54119f79c0 20 add_watcher() i=7 2024-09-12T18:02:38.434 INFO:tasks.workunit.client.0.smithi098.stderr: -60> 2024-09-12T18:02:38.270+0000 7f54119f79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:38.434 INFO:tasks.workunit.client.0.smithi098.stderr: -59> 2024-09-12T18:02:38.274+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding auth protocol: cephx 2024-09-12T18:02:38.434 INFO:tasks.workunit.client.0.smithi098.stderr: -58> 2024-09-12T18:02:38.274+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding auth protocol: cephx 2024-09-12T18:02:38.434 INFO:tasks.workunit.client.0.smithi098.stderr: -57> 2024-09-12T18:02:38.274+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding auth protocol: cephx 2024-09-12T18:02:38.434 INFO:tasks.workunit.client.0.smithi098.stderr: -56> 2024-09-12T18:02:38.274+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: secure 2024-09-12T18:02:38.434 INFO:tasks.workunit.client.0.smithi098.stderr: -55> 2024-09-12T18:02:38.274+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: crc 2024-09-12T18:02:38.435 INFO:tasks.workunit.client.0.smithi098.stderr: -54> 2024-09-12T18:02:38.274+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: secure 2024-09-12T18:02:38.435 INFO:tasks.workunit.client.0.smithi098.stderr: -53> 2024-09-12T18:02:38.274+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: crc 2024-09-12T18:02:38.435 INFO:tasks.workunit.client.0.smithi098.stderr: -52> 2024-09-12T18:02:38.274+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: secure 2024-09-12T18:02:38.435 INFO:tasks.workunit.client.0.smithi098.stderr: -51> 2024-09-12T18:02:38.274+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: crc 2024-09-12T18:02:38.435 INFO:tasks.workunit.client.0.smithi098.stderr: -50> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: crc 2024-09-12T18:02:38.435 INFO:tasks.workunit.client.0.smithi098.stderr: -49> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: secure 2024-09-12T18:02:38.435 INFO:tasks.workunit.client.0.smithi098.stderr: -48> 2024-09-12T18:02:38.274+0000 7f52c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:38.435 INFO:tasks.workunit.client.0.smithi098.stderr: -47> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: crc 2024-09-12T18:02:38.435 INFO:tasks.workunit.client.0.smithi098.stderr: -46> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: secure 2024-09-12T18:02:38.435 INFO:tasks.workunit.client.0.smithi098.stderr: -45> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: crc 2024-09-12T18:02:38.435 INFO:tasks.workunit.client.0.smithi098.stderr: -44> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 AuthRegistry(0x7ffcc2e85a40) adding con mode: secure 2024-09-12T18:02:38.435 INFO:tasks.workunit.client.0.smithi098.stderr: -43> 2024-09-12T18:02:38.278+0000 7f54119f79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:02:38.435 INFO:tasks.workunit.client.0.smithi098.stderr: -42> 2024-09-12T18:02:38.278+0000 7f54119f79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:38.435 INFO:tasks.workunit.client.0.smithi098.stderr: -41> 2024-09-12T18:02:38.278+0000 7f54119f79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:38.435 INFO:tasks.workunit.client.0.smithi098.stderr: -40> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command cache list hook 0x560ba04ea780 2024-09-12T18:02:38.436 INFO:tasks.workunit.client.0.smithi098.stderr: -39> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command cache inspect hook 0x560ba04ea780 2024-09-12T18:02:38.436 INFO:tasks.workunit.client.0.smithi098.stderr: -38> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command cache erase hook 0x560ba04ea780 2024-09-12T18:02:38.436 INFO:tasks.workunit.client.0.smithi098.stderr: -37> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command cache zap hook 0x560ba04ea780 2024-09-12T18:02:38.436 INFO:tasks.workunit.client.0.smithi098.stderr: -36> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 note: GC not initialized 2024-09-12T18:02:38.436 INFO:tasks.workunit.client.0.smithi098.stderr: -35> 2024-09-12T18:02:38.278+0000 7f52c4fe1640 20 reqs_thread_entry: start 2024-09-12T18:02:38.436 INFO:tasks.workunit.client.0.smithi098.stderr: -34> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command sync trace show hook 0x7f5400110030 2024-09-12T18:02:38.436 INFO:tasks.workunit.client.0.smithi098.stderr: -33> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command sync trace history hook 0x7f5400110030 2024-09-12T18:02:38.436 INFO:tasks.workunit.client.0.smithi098.stderr: -32> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command sync trace active hook 0x7f5400110030 2024-09-12T18:02:38.436 INFO:tasks.workunit.client.0.smithi098.stderr: -31> 2024-09-12T18:02:38.278+0000 7f54119f79c0 5 asok(0x560ba02032b0) register_command sync trace active_short hook 0x7f5400110030 2024-09-12T18:02:38.436 INFO:tasks.workunit.client.0.smithi098.stderr: -30> 2024-09-12T18:02:38.278+0000 7f54119f79c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:38.436 INFO:tasks.workunit.client.0.smithi098.stderr: -29> 2024-09-12T18:02:38.278+0000 7f54119f79c0 20 Filter name: none 2024-09-12T18:02:38.436 INFO:tasks.workunit.client.0.smithi098.stderr: -28> 2024-09-12T18:02:38.278+0000 7f523e7fc640 20 reqs_thread_entry: start 2024-09-12T18:02:38.436 INFO:tasks.workunit.client.0.smithi098.stderr: -27> 2024-09-12T18:02:38.278+0000 7f54119f79c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:02:38.436 INFO:tasks.workunit.client.0.smithi098.stderr: -26> 2024-09-12T18:02:38.278+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.437 INFO:tasks.workunit.client.0.smithi098.stderr: -25> 2024-09-12T18:02:38.278+0000 7f54119f79c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:38.437 INFO:tasks.workunit.client.0.smithi098.stderr: -24> 2024-09-12T18:02:38.278+0000 7f54119f79c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:02:38.437 INFO:tasks.workunit.client.0.smithi098.stderr: -23> 2024-09-12T18:02:38.278+0000 7f54119f79c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:02:38.437 INFO:tasks.workunit.client.0.smithi098.stderr: -22> 2024-09-12T18:02:38.278+0000 7f54119f79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T18:02:38.437 INFO:tasks.workunit.client.0.smithi098.stderr: -21> 2024-09-12T18:02:38.278+0000 7f54119f79c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.437 INFO:tasks.workunit.client.0.smithi098.stderr: -20> 2024-09-12T18:02:38.282+0000 7f54119f79c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:02:38.437 INFO:tasks.workunit.client.0.smithi098.stderr: -19> 2024-09-12T18:02:38.282+0000 7f54119f79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:02:38.437 INFO:tasks.workunit.client.0.smithi098.stderr: -18> 2024-09-12T18:02:38.282+0000 7f54119f79c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:02:38.437 INFO:tasks.workunit.client.0.smithi098.stderr: -17> 2024-09-12T18:02:38.282+0000 7f54119f79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:38.437 INFO:tasks.workunit.client.0.smithi098.stderr: -16> 2024-09-12T18:02:38.282+0000 7f54119f79c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:38.437 INFO:tasks.workunit.client.0.smithi098.stderr: -15> 2024-09-12T18:02:38.282+0000 7f54119f79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:02:38.437 INFO:tasks.workunit.client.0.smithi098.stderr: -14> 2024-09-12T18:02:38.282+0000 7f54119f79c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:02:38.437 INFO:tasks.workunit.client.0.smithi098.stderr: -13> 2024-09-12T18:02:38.298+0000 7f54119f79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:02:38.437 INFO:tasks.workunit.client.0.smithi098.stderr: -12> 2024-09-12T18:02:38.298+0000 7f54119f79c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:02:38.438 INFO:tasks.workunit.client.0.smithi098.stderr: -11> 2024-09-12T18:02:38.298+0000 7f54119f79c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:38.438 INFO:tasks.workunit.client.0.smithi098.stderr: -10> 2024-09-12T18:02:38.298+0000 7f54119f79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T18:02:38.438 INFO:tasks.workunit.client.0.smithi098.stderr: -9> 2024-09-12T18:02:38.298+0000 7f52f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366222 cookie 94607934245424 notifier 7796 bl.length()=827 2024-09-12T18:02:38.438 INFO:tasks.workunit.client.0.smithi098.stderr: -8> 2024-09-12T18:02:38.298+0000 7f52f2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:02:38.438 INFO:tasks.workunit.client.0.smithi098.stderr: -7> 2024-09-12T18:02:38.298+0000 7f52f2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:02:38.438 INFO:tasks.workunit.client.0.smithi098.stderr: -6> 2024-09-12T18:02:38.298+0000 7f52f2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:38.438 INFO:tasks.workunit.client.0.smithi098.stderr: -5> 2024-09-12T18:02:38.302+0000 7f54119f79c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T18:02:38.438 INFO:tasks.workunit.client.0.smithi098.stderr: -4> 2024-09-12T18:02:38.302+0000 7f54119f79c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T18:02:38.438 INFO:tasks.workunit.client.0.smithi098.stderr: -3> 2024-09-12T18:02:38.302+0000 7f54119f79c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T18:02:38.438 INFO:tasks.workunit.client.0.smithi098.stderr: -2> 2024-09-12T18:02:38.302+0000 7f54119f79c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T18:02:38.438 INFO:tasks.workunit.client.0.smithi098.stderr: -1> 2024-09-12T18:02:38.314+0000 7f54119f79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f54119f79c0 time 2024-09-12T18:02:38.317661+0000 2024-09-12T18:02:38.438 INFO:tasks.workunit.client.0.smithi098.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:02:38.438 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.438 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:38.439 INFO:tasks.workunit.client.0.smithi098.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f54152d12eb] 2024-09-12T18:02:38.439 INFO:tasks.workunit.client.0.smithi098.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f54152d149f] 2024-09-12T18:02:38.439 INFO:tasks.workunit.client.0.smithi098.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560b9e9f00c1] 2024-09-12T18:02:38.439 INFO:tasks.workunit.client.0.smithi098.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560b9ea021fa] 2024-09-12T18:02:38.439 INFO:tasks.workunit.client.0.smithi098.stderr: 5: main() 2024-09-12T18:02:38.439 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5414137d90] 2024-09-12T18:02:38.439 INFO:tasks.workunit.client.0.smithi098.stderr: 7: __libc_start_main() 2024-09-12T18:02:38.439 INFO:tasks.workunit.client.0.smithi098.stderr: 8: _start() 2024-09-12T18:02:38.439 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.439 INFO:tasks.workunit.client.0.smithi098.stderr: 0> 2024-09-12T18:02:38.314+0000 7f54119f79c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:02:38.439 INFO:tasks.workunit.client.0.smithi098.stderr: in thread 7f54119f79c0 thread_name:radosgw-admin 2024-09-12T18:02:38.439 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.439 INFO:tasks.workunit.client.0.smithi098.stderr: ceph version 19.3.0-4762-gbad475c1 (bad475c18c96ec20c5778159aa33ba72b84e9c1b) squid (dev) 2024-09-12T18:02:38.440 INFO:tasks.workunit.client.0.smithi098.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5414150520] 2024-09-12T18:02:38.440 INFO:tasks.workunit.client.0.smithi098.stderr: 2: pthread_kill() 2024-09-12T18:02:38.440 INFO:tasks.workunit.client.0.smithi098.stderr: 3: raise() 2024-09-12T18:02:38.440 INFO:tasks.workunit.client.0.smithi098.stderr: 4: abort() 2024-09-12T18:02:38.440 INFO:tasks.workunit.client.0.smithi098.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f54152d1345] 2024-09-12T18:02:38.440 INFO:tasks.workunit.client.0.smithi098.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f54152d149f] 2024-09-12T18:02:38.440 INFO:tasks.workunit.client.0.smithi098.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560b9e9f00c1] 2024-09-12T18:02:38.440 INFO:tasks.workunit.client.0.smithi098.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560b9ea021fa] 2024-09-12T18:02:38.440 INFO:tasks.workunit.client.0.smithi098.stderr: 9: main() 2024-09-12T18:02:38.440 INFO:tasks.workunit.client.0.smithi098.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5414137d90] 2024-09-12T18:02:38.440 INFO:tasks.workunit.client.0.smithi098.stderr: 11: __libc_start_main() 2024-09-12T18:02:38.440 INFO:tasks.workunit.client.0.smithi098.stderr: 12: _start() 2024-09-12T18:02:38.440 INFO:tasks.workunit.client.0.smithi098.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:02:38.441 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:02:38.441 INFO:tasks.workunit.client.0.smithi098.stderr:--- logging levels --- 2024-09-12T18:02:38.441 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 none 2024-09-12T18:02:38.441 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 lockdep 2024-09-12T18:02:38.441 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 context 2024-09-12T18:02:38.441 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 crush 2024-09-12T18:02:38.441 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds 2024-09-12T18:02:38.441 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_balancer 2024-09-12T18:02:38.441 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_locker 2024-09-12T18:02:38.441 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log 2024-09-12T18:02:38.441 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_log_expire 2024-09-12T18:02:38.441 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mds_migrator 2024-09-12T18:02:38.441 INFO:tasks.workunit.client.0.smithi098.stderr: 3/ 5 mds_quiesce 2024-09-12T18:02:38.441 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 buffer 2024-09-12T18:02:38.442 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 timer 2024-09-12T18:02:38.442 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 filer 2024-09-12T18:02:38.442 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 striper 2024-09-12T18:02:38.442 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 1 objecter 2024-09-12T18:02:38.442 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rados 2024-09-12T18:02:38.442 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd 2024-09-12T18:02:38.442 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_mirror 2024-09-12T18:02:38.442 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_replay 2024-09-12T18:02:38.442 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 rbd_pwl 2024-09-12T18:02:38.442 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 journaler 2024-09-12T18:02:38.442 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objectcacher 2024-09-12T18:02:38.442 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:02:38.442 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 client 2024-09-12T18:02:38.442 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 osd 2024-09-12T18:02:38.442 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 optracker 2024-09-12T18:02:38.443 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 objclass 2024-09-12T18:02:38.443 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 filestore 2024-09-12T18:02:38.443 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 journal 2024-09-12T18:02:38.443 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 ms 2024-09-12T18:02:38.443 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mon 2024-09-12T18:02:38.443 INFO:tasks.workunit.client.0.smithi098.stderr: 0/10 monc 2024-09-12T18:02:38.443 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 paxos 2024-09-12T18:02:38.443 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 tp 2024-09-12T18:02:38.443 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 auth 2024-09-12T18:02:38.443 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 crypto 2024-09-12T18:02:38.443 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 finisher 2024-09-12T18:02:38.443 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 reserver 2024-09-12T18:02:38.443 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 heartbeatmap 2024-09-12T18:02:38.443 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 perfcounter 2024-09-12T18:02:38.443 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw 2024-09-12T18:02:38.444 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_sync 2024-09-12T18:02:38.444 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_datacache 2024-09-12T18:02:38.444 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_access 2024-09-12T18:02:38.444 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:02:38.444 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_flight 2024-09-12T18:02:38.444 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:02:38.444 INFO:tasks.workunit.client.0.smithi098.stderr: 20/20 rgw_notification 2024-09-12T18:02:38.444 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 javaclient 2024-09-12T18:02:38.444 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 asok 2024-09-12T18:02:38.444 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 1 throttle 2024-09-12T18:02:38.444 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 0 refs 2024-09-12T18:02:38.444 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 compressor 2024-09-12T18:02:38.444 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluestore 2024-09-12T18:02:38.444 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 bluefs 2024-09-12T18:02:38.445 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 3 bdev 2024-09-12T18:02:38.445 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 kstore 2024-09-12T18:02:38.445 INFO:tasks.workunit.client.0.smithi098.stderr: 4/ 5 rocksdb 2024-09-12T18:02:38.445 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 fuse 2024-09-12T18:02:38.445 INFO:tasks.workunit.client.0.smithi098.stderr: 2/ 5 mgr 2024-09-12T18:02:38.445 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mgrc 2024-09-12T18:02:38.445 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 dpdk 2024-09-12T18:02:38.445 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 eventtrace 2024-09-12T18:02:38.445 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 prioritycache 2024-09-12T18:02:38.445 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 test 2024-09-12T18:02:38.445 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:02:38.445 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cephsqlite 2024-09-12T18:02:38.445 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:02:38.445 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore 2024-09-12T18:02:38.446 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_onode 2024-09-12T18:02:38.446 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_odata 2024-09-12T18:02:38.446 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_omap 2024-09-12T18:02:38.446 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_tm 2024-09-12T18:02:38.446 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_t 2024-09-12T18:02:38.446 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:02:38.446 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_epm 2024-09-12T18:02:38.446 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_lba 2024-09-12T18:02:38.446 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:02:38.446 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_cache 2024-09-12T18:02:38.446 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_journal 2024-09-12T18:02:38.446 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_device 2024-09-12T18:02:38.446 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 seastore_backref 2024-09-12T18:02:38.446 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 alienstore 2024-09-12T18:02:38.446 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 mclock 2024-09-12T18:02:38.447 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 cyanstore 2024-09-12T18:02:38.447 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 ceph_exporter 2024-09-12T18:02:38.447 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 memstore 2024-09-12T18:02:38.447 INFO:tasks.workunit.client.0.smithi098.stderr: 1/ 5 trace 2024-09-12T18:02:38.447 INFO:tasks.workunit.client.0.smithi098.stderr: 0/ 5 ceph_dedup 2024-09-12T18:02:38.447 INFO:tasks.workunit.client.0.smithi098.stderr: -2/-2 (syslog threshold) 2024-09-12T18:02:38.447 INFO:tasks.workunit.client.0.smithi098.stderr: 99/99 (stderr threshold) 2024-09-12T18:02:38.447 INFO:tasks.workunit.client.0.smithi098.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:02:38.447 INFO:tasks.workunit.client.0.smithi098.stderr: 7f523e7fc640 / http_manager 2024-09-12T18:02:38.447 INFO:tasks.workunit.client.0.smithi098.stderr: 7f52c4fe1640 / http_manager 2024-09-12T18:02:38.447 INFO:tasks.workunit.client.0.smithi098.stderr: 7f52c5fe3640 / rgw_dt_lg_renew 2024-09-12T18:02:38.447 INFO:tasks.workunit.client.0.smithi098.stderr: 7f52f17fa640 / ms_dispatch 2024-09-12T18:02:38.447 INFO:tasks.workunit.client.0.smithi098.stderr: 7f52f2ffd640 / io_context_pool 2024-09-12T18:02:38.447 INFO:tasks.workunit.client.0.smithi098.stderr: 7f52f9602640 / ms_dispatch 2024-09-12T18:02:38.447 INFO:tasks.workunit.client.0.smithi098.stderr: 7f52fbe07640 / ms_dispatch 2024-09-12T18:02:38.447 INFO:tasks.workunit.client.0.smithi098.stderr: 7f52fd60a640 / io_context_pool 2024-09-12T18:02:38.448 INFO:tasks.workunit.client.0.smithi098.stderr: 7f540ecfc640 / msgr-worker-2 2024-09-12T18:02:38.448 INFO:tasks.workunit.client.0.smithi098.stderr: 7f540f4fd640 / msgr-worker-1 2024-09-12T18:02:38.448 INFO:tasks.workunit.client.0.smithi098.stderr: 7f540fcfe640 / msgr-worker-0 2024-09-12T18:02:38.448 INFO:tasks.workunit.client.0.smithi098.stderr: 7f54104ff640 / io_context_pool 2024-09-12T18:02:38.448 INFO:tasks.workunit.client.0.smithi098.stderr: 7f54119f79c0 / radosgw-admin 2024-09-12T18:02:38.448 INFO:tasks.workunit.client.0.smithi098.stderr: max_recent 500 2024-09-12T18:02:38.448 INFO:tasks.workunit.client.0.smithi098.stderr: max_new 1000 2024-09-12T18:02:38.448 INFO:tasks.workunit.client.0.smithi098.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:02:38.319687Z_2836aecf-6671-4cdc-ad58-2f59b1c6a449/log 2024-09-12T18:02:38.448 INFO:tasks.workunit.client.0.smithi098.stderr:--- end dump of recent events --- 2024-09-12T18:02:38.448 INFO:tasks.workunit.client.0.smithi098.stderr:Aborted 2024-09-12T18:02:38.448 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:02:38.452 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:38.452 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:38.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.394+0000 7f56bb9649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.398+0000 7f56bb9649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.398+0000 7f56bb9649c0 20 realm 2024-09-12T18:02:38.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.398+0000 7f56bb9649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.398+0000 7f56bb9649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.398+0000 7f56bb9649c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:38.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.398+0000 7f56bb9649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.398+0000 7f56bb9649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.398+0000 7f56bb9649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.398+0000 7f56bb9649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:38.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.398+0000 7f56bb9649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.398+0000 7f56bb9649c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:38.453 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.398+0000 7f56bb9649c0 20 searching for the correct realm 2024-09-12T18:02:38.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.406+0000 7f56b8c69640 0 -- 172.21.15.98:0/2009434146 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f56ac0f8400 msgr2=0x7f56ac0f8820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:38.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.414+0000 7f56b8c69640 0 -- 172.21.15.98:0/2009434146 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f5584081180 msgr2=0x7f55840835b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:38.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.418+0000 7f56bb9649c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:38.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.418+0000 7f56bb9649c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:02:38.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.418+0000 7f56bb9649c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:38.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.418+0000 7f56bb9649c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:02:38.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.418+0000 7f56bb9649c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:38.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.418+0000 7f56bb9649c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:38.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.418+0000 7f56bb9649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.418+0000 7f56bb9649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.418+0000 7f56bb9649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.422+0000 7f56bb9649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:38.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.422+0000 7f56bb9649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.422+0000 7f56bb9649c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:38.454 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.422+0000 7f56bb9649c0 20 zone default found 2024-09-12T18:02:38.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.422+0000 7f56bb9649c0 4 Realm: () 2024-09-12T18:02:38.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.422+0000 7f56bb9649c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:02:38.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.422+0000 7f56bb9649c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:02:38.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.422+0000 7f56bb9649c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:38.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.422+0000 7f56bb9649c0 20 zonegroup default 2024-09-12T18:02:38.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.422+0000 7f56bb9649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.422+0000 7f56bb9649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.422+0000 7f56bb9649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.422+0000 7f56bb9649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.422+0000 7f56bb9649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.422+0000 7f56bb9649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.422+0000 7f56bb9649c0 20 started sync module instance, tier type = 2024-09-12T18:02:38.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.422+0000 7f56bb9649c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:02:38.455 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.438+0000 7f56bb9649c0 20 add_watcher() i=0 2024-09-12T18:02:38.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.438+0000 7f56bb9649c0 20 add_watcher() i=1 2024-09-12T18:02:38.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.438+0000 7f56bb9649c0 20 add_watcher() i=2 2024-09-12T18:02:38.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.438+0000 7f56bb9649c0 20 add_watcher() i=3 2024-09-12T18:02:38.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.438+0000 7f56bb9649c0 20 add_watcher() i=4 2024-09-12T18:02:38.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.438+0000 7f56bb9649c0 20 add_watcher() i=5 2024-09-12T18:02:38.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.438+0000 7f56bb9649c0 20 add_watcher() i=6 2024-09-12T18:02:38.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.442+0000 7f56bb9649c0 20 add_watcher() i=7 2024-09-12T18:02:38.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.442+0000 7f56bb9649c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:38.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.442+0000 7f556f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:38.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.442+0000 7f56bb9649c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:38.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.442+0000 7f56bb9649c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:38.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.442+0000 7f56bb9649c0 5 note: GC not initialized 2024-09-12T18:02:38.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.442+0000 7f556e7e4640 20 reqs_thread_entry: start 2024-09-12T18:02:38.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.442+0000 7f56bb9649c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:38.456 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.442+0000 7f56bb9649c0 20 Filter name: none 2024-09-12T18:02:38.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.442+0000 7f54dffff640 20 reqs_thread_entry: start 2024-09-12T18:02:38.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.446+0000 7f56bb9649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.446+0000 7f56bb9649c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:38.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.446+0000 7f56bb9649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.446+0000 7f56bb9649c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:02:38.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.446+0000 7f56bb9649c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:38.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.446+0000 7f56bb9649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.446+0000 7f56bb9649c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:38.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.446+0000 7f56bb9649c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.450+0000 7f56bb9649c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:02:38.457 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.450+0000 7f56bb9649c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:02:38.458 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.450+0000 7f556f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:38.459 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.454+0000 7f56bb9649c0 20 remove_watcher() i=0 2024-09-12T18:02:38.460 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.454+0000 7f56bb9649c0 2 removed watcher, disabling cache 2024-09-12T18:02:38.462 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.458+0000 7f56bb9649c0 20 remove_watcher() i=1 2024-09-12T18:02:38.464 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.458+0000 7f56bb9649c0 20 remove_watcher() i=2 2024-09-12T18:02:38.465 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.462+0000 7f56bb9649c0 20 remove_watcher() i=3 2024-09-12T18:02:38.467 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.462+0000 7f56bb9649c0 20 remove_watcher() i=4 2024-09-12T18:02:38.468 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.466+0000 7f56bb9649c0 20 remove_watcher() i=5 2024-09-12T18:02:38.470 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.466+0000 7f56bb9649c0 20 remove_watcher() i=6 2024-09-12T18:02:38.471 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.466+0000 7f56bb9649c0 20 remove_watcher() i=7 2024-09-12T18:02:38.486 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:02:38.486 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:02:38.536 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:02:38.562 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:02:38.562 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:02:38.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.602+0000 7f8ad2b229c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.602+0000 7f8ad2b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.602+0000 7f8ad2b229c0 20 realm 2024-09-12T18:02:38.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.602+0000 7f8ad2b229c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.602+0000 7f8ad2b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.602+0000 7f8ad2b229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:02:38.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.602+0000 7f8ad2b229c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.606+0000 7f8ad2b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.606+0000 7f8ad2b229c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.606+0000 7f8ad2b229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:38.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.606+0000 7f8ad2b229c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.606+0000 7f8ad2b229c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:02:38.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.606+0000 7f8ad2b229c0 20 searching for the correct realm 2024-09-12T18:02:38.615 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.610+0000 7f8acfe27640 0 -- 172.21.15.98:0/3833723939 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x55d818fbfd20 msgr2=0x55d818fc21e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:38.621 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.618+0000 7f8ad0628640 0 -- 172.21.15.98:0/3833723939 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f8ac40318d0 msgr2=0x7f8ac404d390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:02:38.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.626+0000 7f8ad2b229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:02:38.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.626+0000 7f8ad2b229c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:02:38.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.626+0000 7f8ad2b229c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:02:38.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.626+0000 7f8ad2b229c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:02:38.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.626+0000 7f8ad2b229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:02:38.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.626+0000 7f8ad2b229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:02:38.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.626+0000 7f8ad2b229c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.626+0000 7f8ad2b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.626+0000 7f8ad2b229c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.626+0000 7f8ad2b229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:02:38.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.626+0000 7f8ad2b229c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.630+0000 7f8ad2b229c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:02:38.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.630+0000 7f8ad2b229c0 20 zone default found 2024-09-12T18:02:38.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.630+0000 7f8ad2b229c0 4 Realm: () 2024-09-12T18:02:38.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.630+0000 7f8ad2b229c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:02:38.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.630+0000 7f8ad2b229c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:02:38.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.630+0000 7f8ad2b229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:02:38.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.630+0000 7f8ad2b229c0 20 zonegroup default 2024-09-12T18:02:38.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.630+0000 7f8ad2b229c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.630+0000 7f8ad2b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.630+0000 7f8ad2b229c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.630+0000 7f8ad2b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.630+0000 7f8ad2b229c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.630+0000 7f8ad2b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:02:38.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.630+0000 7f8ad2b229c0 20 started sync module instance, tier type = 2024-09-12T18:02:38.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.630+0000 7f8ad2b229c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:02:38.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.646+0000 7f8ad2b229c0 20 add_watcher() i=0 2024-09-12T18:02:38.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.646+0000 7f8ad2b229c0 20 add_watcher() i=1 2024-09-12T18:02:38.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.646+0000 7f8ad2b229c0 20 add_watcher() i=2 2024-09-12T18:02:38.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.646+0000 7f8ad2b229c0 20 add_watcher() i=3 2024-09-12T18:02:38.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.646+0000 7f8ad2b229c0 20 add_watcher() i=4 2024-09-12T18:02:38.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.646+0000 7f8ad2b229c0 20 add_watcher() i=5 2024-09-12T18:02:38.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.646+0000 7f8ad2b229c0 20 add_watcher() i=6 2024-09-12T18:02:38.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.646+0000 7f8ad2b229c0 20 add_watcher() i=7 2024-09-12T18:02:38.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.646+0000 7f8ad2b229c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:02:38.652 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.650+0000 7f8986fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:38.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.650+0000 7f8ad2b229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:02:38.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.650+0000 7f8ad2b229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:02:38.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.650+0000 7f8ad2b229c0 5 note: GC not initialized 2024-09-12T18:02:38.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.650+0000 7f8985fdb640 20 reqs_thread_entry: start 2024-09-12T18:02:38.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.650+0000 7f8ad2b229c0 20 init_complete bucket index max shards: 11 2024-09-12T18:02:38.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.650+0000 7f8ad2b229c0 20 Filter name: none 2024-09-12T18:02:38.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.650+0000 7f88f77fe640 20 reqs_thread_entry: start 2024-09-12T18:02:38.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.650+0000 7f8ad2b229c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:02:38.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.650+0000 7f8ad2b229c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.650+0000 7f8ad2b229c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:02:38.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.650+0000 7f8ad2b229c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:02:38.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.650+0000 7f8ad2b229c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:02:38.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.650+0000 7f8ad2b229c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T18:02:38.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.650+0000 7f8ad2b229c0 20 rados->read ofs=0 len=0 2024-09-12T18:02:38.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.654+0000 7f8ad2b229c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:02:38.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.654+0000 7f8ad2b229c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:02:38.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.654+0000 7f8ad2b229c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:02:38.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.654+0000 7f8ad2b229c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:02:38.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.654+0000 7f8ad2b229c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:02:38.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.654+0000 7f8ad2b229c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:02:38.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.654+0000 7f8ad2b229c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:02:38.656 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.654+0000 7f8ad2b229c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:02:38.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.654+0000 7f8ad2b229c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:02:38.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.654+0000 7f8ad2b229c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:02:38.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.654+0000 7f8ad2b229c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:02:38.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.654+0000 7f8ad2b229c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:02:38.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.654+0000 7f8ad2b229c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:02:38.659 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.654+0000 7f8ad2b229c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:02:38.659 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.654+0000 7f8ad2b229c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:02:38.659 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.654+0000 7f8ad2b229c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:02:38.660 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.658+0000 7f8ad2b229c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:02:38.660 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.658+0000 7f8ad2b229c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:02:38.660 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.658+0000 7f8ad2b229c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:02:38.660 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.658+0000 7f8ad2b229c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:02:38.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.658+0000 7f8ad2b229c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:02:38.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.658+0000 7f8ad2b229c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:02:38.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.658+0000 7f8ad2b229c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:02:38.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.658+0000 7f8ad2b229c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:02:38.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.658+0000 7f8ad2b229c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:02:38.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.658+0000 7f8ad2b229c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:02:38.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.662+0000 7f8ad2b229c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:02:38.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.662+0000 7f8ad2b229c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:02:38.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.662+0000 7f8ad2b229c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:02:38.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.662+0000 7f8ad2b229c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:02:38.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.662+0000 7f8ad2b229c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:02:38.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.662+0000 7f8ad2b229c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:02:38.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.662+0000 7f8986fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:02:38.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.670+0000 7f8ad2b229c0 20 remove_watcher() i=0 2024-09-12T18:02:38.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.670+0000 7f8ad2b229c0 2 removed watcher, disabling cache 2024-09-12T18:02:38.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.670+0000 7f8ad2b229c0 20 remove_watcher() i=1 2024-09-12T18:02:38.675 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.670+0000 7f8ad2b229c0 20 remove_watcher() i=2 2024-09-12T18:02:38.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.674+0000 7f8ad2b229c0 20 remove_watcher() i=3 2024-09-12T18:02:38.679 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.674+0000 7f8ad2b229c0 20 remove_watcher() i=4 2024-09-12T18:02:38.680 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.678+0000 7f8ad2b229c0 20 remove_watcher() i=5 2024-09-12T18:02:38.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.678+0000 7f8ad2b229c0 20 remove_watcher() i=6 2024-09-12T18:02:38.683 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:02:38.678+0000 7f8ad2b229c0 20 remove_watcher() i=7 2024-09-12T18:03:08.727 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T18:03:08.759 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:08.759 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:08.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.801+0000 7fd511e8c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.801+0000 7fd511e8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.801+0000 7fd511e8c9c0 20 realm 2024-09-12T18:03:08.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.801+0000 7fd511e8c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.806 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.801+0000 7fd511e8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.801+0000 7fd511e8c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:08.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.801+0000 7fd511e8c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.801+0000 7fd511e8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.807 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.801+0000 7fd511e8c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.805+0000 7fd511e8c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:08.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.805+0000 7fd511e8c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.805+0000 7fd511e8c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:08.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.805+0000 7fd511e8c9c0 20 searching for the correct realm 2024-09-12T18:03:08.814 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.809+0000 7fd507191640 0 -- 172.21.15.98:0/1203819888 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x55f4d72a4d50 msgr2=0x55f4d72a7210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:08.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.817+0000 7fd50f992640 0 -- 172.21.15.98:0/1203819888 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fd4f806d350 msgr2=0x7fd4f8065880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:08.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:08.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:08.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:08.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:08.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:08.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:08.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:08.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:08.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 zone default found 2024-09-12T18:03:08.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 4 Realm: () 2024-09-12T18:03:08.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:08.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:08.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:08.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 zonegroup default 2024-09-12T18:03:08.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 started sync module instance, tier type = 2024-09-12T18:03:08.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.825+0000 7fd511e8c9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:08.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.841+0000 7fd511e8c9c0 20 add_watcher() i=0 2024-09-12T18:03:08.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.841+0000 7fd511e8c9c0 20 add_watcher() i=1 2024-09-12T18:03:08.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.841+0000 7fd511e8c9c0 20 add_watcher() i=2 2024-09-12T18:03:08.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.841+0000 7fd511e8c9c0 20 add_watcher() i=3 2024-09-12T18:03:08.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.841+0000 7fd511e8c9c0 20 add_watcher() i=4 2024-09-12T18:03:08.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.841+0000 7fd511e8c9c0 20 add_watcher() i=5 2024-09-12T18:03:08.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.841+0000 7fd511e8c9c0 20 add_watcher() i=6 2024-09-12T18:03:08.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.841+0000 7fd511e8c9c0 20 add_watcher() i=7 2024-09-12T18:03:08.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.841+0000 7fd511e8c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:08.850 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.845+0000 7fd3c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:08.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.845+0000 7fd511e8c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:08.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.845+0000 7fd511e8c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:08.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.845+0000 7fd511e8c9c0 5 note: GC not initialized 2024-09-12T18:03:08.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.845+0000 7fd3c4fe1640 20 reqs_thread_entry: start 2024-09-12T18:03:08.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.845+0000 7fd511e8c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:08.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.845+0000 7fd511e8c9c0 20 Filter name: none 2024-09-12T18:03:08.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.845+0000 7fd33e7fc640 20 reqs_thread_entry: start 2024-09-12T18:03:08.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.845+0000 7fd511e8c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:03:08.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.845+0000 7fd511e8c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.849+0000 7fd511e8c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:03:08.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.849+0000 7fd511e8c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:03:08.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.849+0000 7fd511e8c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:03:08.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.849+0000 7fd511e8c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T18:03:08.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.849+0000 7fd511e8c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.849+0000 7fd511e8c9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:03:08.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.849+0000 7fd511e8c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:03:08.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.849+0000 7fd511e8c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:03:08.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.849+0000 7fd511e8c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:08.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.849+0000 7fd511e8c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:08.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.849+0000 7fd511e8c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:03:08.864 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.857+0000 7fd3c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:08.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.865+0000 7fd511e8c9c0 20 remove_watcher() i=0 2024-09-12T18:03:08.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.865+0000 7fd511e8c9c0 2 removed watcher, disabling cache 2024-09-12T18:03:08.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.865+0000 7fd511e8c9c0 20 remove_watcher() i=1 2024-09-12T18:03:08.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.869+0000 7fd511e8c9c0 20 remove_watcher() i=2 2024-09-12T18:03:08.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.869+0000 7fd511e8c9c0 20 remove_watcher() i=3 2024-09-12T18:03:08.876 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.873+0000 7fd511e8c9c0 20 remove_watcher() i=4 2024-09-12T18:03:08.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.873+0000 7fd511e8c9c0 20 remove_watcher() i=5 2024-09-12T18:03:08.878 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.873+0000 7fd511e8c9c0 20 remove_watcher() i=6 2024-09-12T18:03:08.879 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.873+0000 7fd511e8c9c0 20 remove_watcher() i=7 2024-09-12T18:03:08.893 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:03:08.919 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:08.919 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:08.962 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.957+0000 7fb3648479c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.957+0000 7fb3648479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.957+0000 7fb3648479c0 20 realm 2024-09-12T18:03:08.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.957+0000 7fb3648479c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.957+0000 7fb3648479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.957+0000 7fb3648479c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:08.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.957+0000 7fb3648479c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.961+0000 7fb3648479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.964 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.961+0000 7fb3648479c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.961+0000 7fb3648479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:08.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.961+0000 7fb3648479c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.961+0000 7fb3648479c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:08.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.961+0000 7fb3648479c0 20 searching for the correct realm 2024-09-12T18:03:08.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.969+0000 7fb361b4c640 0 -- 172.21.15.98:0/1566833187 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fb35401bc60 msgr2=0x7fb354062490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:08.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.973+0000 7fb362b4e640 0 -- 172.21.15.98:0/1566833187 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7fb3580890b0 msgr2=0x7fb3580610c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:03:08.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.981+0000 7fb3648479c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:08.987 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.981+0000 7fb3648479c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:08.987 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.981+0000 7fb3648479c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:08.987 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.981+0000 7fb3648479c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:08.987 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.981+0000 7fb3648479c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:08.987 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.981+0000 7fb3648479c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:08.987 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.981+0000 7fb3648479c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.987 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.981+0000 7fb3648479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.987 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.981+0000 7fb3648479c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.987 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.981+0000 7fb3648479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:08.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.981+0000 7fb3648479c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.985+0000 7fb3648479c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:08.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.985+0000 7fb3648479c0 20 zone default found 2024-09-12T18:03:08.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.985+0000 7fb3648479c0 4 Realm: () 2024-09-12T18:03:08.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.985+0000 7fb3648479c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:08.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.985+0000 7fb3648479c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:08.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.985+0000 7fb3648479c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:08.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.985+0000 7fb3648479c0 20 zonegroup default 2024-09-12T18:03:08.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.985+0000 7fb3648479c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.985+0000 7fb3648479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.985+0000 7fb3648479c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.990 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.985+0000 7fb3648479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.990 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.985+0000 7fb3648479c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:08.990 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.985+0000 7fb3648479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:08.990 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.985+0000 7fb3648479c0 20 started sync module instance, tier type = 2024-09-12T18:03:08.990 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:08.985+0000 7fb3648479c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:09.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.001+0000 7fb3648479c0 20 add_watcher() i=0 2024-09-12T18:03:09.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.001+0000 7fb3648479c0 20 add_watcher() i=1 2024-09-12T18:03:09.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.001+0000 7fb3648479c0 20 add_watcher() i=2 2024-09-12T18:03:09.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.001+0000 7fb3648479c0 20 add_watcher() i=3 2024-09-12T18:03:09.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.001+0000 7fb3648479c0 20 add_watcher() i=4 2024-09-12T18:03:09.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.001+0000 7fb3648479c0 20 add_watcher() i=5 2024-09-12T18:03:09.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.001+0000 7fb3648479c0 20 add_watcher() i=6 2024-09-12T18:03:09.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.001+0000 7fb3648479c0 20 add_watcher() i=7 2024-09-12T18:03:09.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.001+0000 7fb3648479c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:09.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.005+0000 7fb218fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:09.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.005+0000 7fb3648479c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:09.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.005+0000 7fb3648479c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:09.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.005+0000 7fb3648479c0 5 note: GC not initialized 2024-09-12T18:03:09.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.005+0000 7fb1937fe640 20 reqs_thread_entry: start 2024-09-12T18:03:09.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.005+0000 7fb3648479c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:09.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.005+0000 7fb3648479c0 20 Filter name: none 2024-09-12T18:03:09.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.005+0000 7fb1917fa640 20 reqs_thread_entry: start 2024-09-12T18:03:09.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.005+0000 7fb3648479c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:03:09.010 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.005+0000 7fb3648479c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.005+0000 7fb3648479c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:03:09.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.005+0000 7fb3648479c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:03:09.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.005+0000 7fb3648479c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:03:09.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.005+0000 7fb3648479c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T18:03:09.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.005+0000 7fb3648479c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.009+0000 7fb3648479c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:03:09.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.009+0000 7fb3648479c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:03:09.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.009+0000 7fb3648479c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:03:09.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.009+0000 7fb3648479c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:09.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.009+0000 7fb3648479c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:09.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.009+0000 7fb3648479c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:03:09.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.009+0000 7fb3648479c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:03:09.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.009+0000 7fb3648479c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:03:09.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.009+0000 7fb3648479c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:03:09.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.009+0000 7fb3648479c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:03:09.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.009+0000 7fb3648479c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:03:09.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.009+0000 7fb3648479c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:03:09.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.009+0000 7fb3648479c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:03:09.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.009+0000 7fb3648479c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:03:09.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.009+0000 7fb3648479c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:03:09.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.009+0000 7fb3648479c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:03:09.016 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.013+0000 7fb3648479c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:03:09.016 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.013+0000 7fb3648479c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:03:09.016 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.013+0000 7fb3648479c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:03:09.016 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.013+0000 7fb3648479c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:03:09.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.013+0000 7fb3648479c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:03:09.017 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.013+0000 7fb3648479c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:03:09.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.013+0000 7fb3648479c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:03:09.018 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.013+0000 7fb3648479c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:03:09.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.013+0000 7fb3648479c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:03:09.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.013+0000 7fb3648479c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:03:09.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.017+0000 7fb3648479c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:03:09.020 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.017+0000 7fb3648479c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:03:09.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.017+0000 7fb3648479c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:03:09.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.017+0000 7fb3648479c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:03:09.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.017+0000 7fb3648479c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:03:09.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.017+0000 7fb3648479c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:03:09.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.017+0000 7fb218fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:09.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.021+0000 7fb3648479c0 20 remove_watcher() i=0 2024-09-12T18:03:09.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.021+0000 7fb3648479c0 2 removed watcher, disabling cache 2024-09-12T18:03:09.030 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.025+0000 7fb3648479c0 20 remove_watcher() i=1 2024-09-12T18:03:09.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.029+0000 7fb3648479c0 20 remove_watcher() i=2 2024-09-12T18:03:09.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.029+0000 7fb3648479c0 20 remove_watcher() i=3 2024-09-12T18:03:09.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.033+0000 7fb3648479c0 20 remove_watcher() i=4 2024-09-12T18:03:09.037 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.033+0000 7fb3648479c0 20 remove_watcher() i=5 2024-09-12T18:03:09.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.033+0000 7fb3648479c0 20 remove_watcher() i=6 2024-09-12T18:03:09.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.033+0000 7fb3648479c0 20 remove_watcher() i=7 2024-09-12T18:03:09.054 INFO:tasks.workunit.client.0.smithi098.stderr:check reshard logrecord successfully 2024-09-12T18:03:09.054 INFO:tasks.workunit.client.0.smithi098.stderr: test: reshard versioned bucket 2024-09-12T18:03:09.054 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T18:03:09.080 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:09.081 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:09.124 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.121+0000 7f63b35d39c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.121+0000 7f63b35d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.121+0000 7f63b35d39c0 20 realm 2024-09-12T18:03:09.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.121+0000 7f63b35d39c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.121+0000 7f63b35d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.121+0000 7f63b35d39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:09.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.121+0000 7f63b35d39c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.126 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.121+0000 7f63b35d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.121+0000 7f63b35d39c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.125+0000 7f63b35d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:09.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.125+0000 7f63b35d39c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.125+0000 7f63b35d39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:09.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.125+0000 7f63b35d39c0 20 searching for the correct realm 2024-09-12T18:03:09.134 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.129+0000 7f63b08d8640 0 -- 172.21.15.98:0/490891973 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f63a40ee950 msgr2=0x7f63a40d43f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:09.141 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.137+0000 7f63b18da640 0 -- 172.21.15.98:0/490891973 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f63a8008030 msgr2=0x7f63a809c380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:09.147 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.141+0000 7f63b35d39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:09.147 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.141+0000 7f63b35d39c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:09.147 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.141+0000 7f63b35d39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:09.147 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.141+0000 7f63b35d39c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:09.147 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.141+0000 7f63b35d39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:09.147 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.141+0000 7f63b35d39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:09.148 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.141+0000 7f63b35d39c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.148 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.141+0000 7f63b35d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.148 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.141+0000 7f63b35d39c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.148 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.145+0000 7f63b35d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:09.148 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.145+0000 7f63b35d39c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.149 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.145+0000 7f63b35d39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:09.149 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.145+0000 7f63b35d39c0 20 zone default found 2024-09-12T18:03:09.149 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.145+0000 7f63b35d39c0 4 Realm: () 2024-09-12T18:03:09.149 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.145+0000 7f63b35d39c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:09.149 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.145+0000 7f63b35d39c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:09.150 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.145+0000 7f63b35d39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:09.150 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.145+0000 7f63b35d39c0 20 zonegroup default 2024-09-12T18:03:09.150 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.145+0000 7f63b35d39c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.150 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.145+0000 7f63b35d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.151 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.145+0000 7f63b35d39c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.151 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.145+0000 7f63b35d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.151 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.145+0000 7f63b35d39c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.151 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.145+0000 7f63b35d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.151 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.145+0000 7f63b35d39c0 20 started sync module instance, tier type = 2024-09-12T18:03:09.151 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.145+0000 7f63b35d39c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:09.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.161+0000 7f63b35d39c0 20 add_watcher() i=0 2024-09-12T18:03:09.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.161+0000 7f63b35d39c0 20 add_watcher() i=1 2024-09-12T18:03:09.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.161+0000 7f63b35d39c0 20 add_watcher() i=2 2024-09-12T18:03:09.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.161+0000 7f63b35d39c0 20 add_watcher() i=3 2024-09-12T18:03:09.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.161+0000 7f63b35d39c0 20 add_watcher() i=4 2024-09-12T18:03:09.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.161+0000 7f63b35d39c0 20 add_watcher() i=5 2024-09-12T18:03:09.166 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.161+0000 7f63b35d39c0 20 add_watcher() i=6 2024-09-12T18:03:09.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.161+0000 7f63b35d39c0 20 add_watcher() i=7 2024-09-12T18:03:09.167 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.161+0000 7f63b35d39c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:09.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.165+0000 7f6267fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:09.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.165+0000 7f63b35d39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:09.170 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.165+0000 7f63b35d39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:09.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.165+0000 7f63b35d39c0 5 note: GC not initialized 2024-09-12T18:03:09.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.165+0000 7f6266fe5640 20 reqs_thread_entry: start 2024-09-12T18:03:09.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.165+0000 7f63b35d39c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:09.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.165+0000 7f63b35d39c0 20 Filter name: none 2024-09-12T18:03:09.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.165+0000 7f6264fe1640 20 reqs_thread_entry: start 2024-09-12T18:03:09.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.165+0000 7f63b35d39c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.165+0000 7f63b35d39c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:03:09.171 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.165+0000 7f63b35d39c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.169+0000 7f63b35d39c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:03:09.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.169+0000 7f63b35d39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:09.172 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.169+0000 7f63b35d39c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.173 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.169+0000 7f63b35d39c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:03:09.173 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.169+0000 7f63b35d39c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.169+0000 7f63b35d39c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:03:09.174 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.169+0000 7f63b35d39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:09.176 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.173+0000 7f6267fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:09.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.177+0000 7f63b35d39c0 20 remove_watcher() i=0 2024-09-12T18:03:09.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.177+0000 7f63b35d39c0 2 removed watcher, disabling cache 2024-09-12T18:03:09.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.177+0000 7f63b35d39c0 20 remove_watcher() i=1 2024-09-12T18:03:09.187 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.181+0000 7f63b35d39c0 20 remove_watcher() i=2 2024-09-12T18:03:09.187 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.181+0000 7f63b35d39c0 20 remove_watcher() i=3 2024-09-12T18:03:09.189 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.185+0000 7f63b35d39c0 20 remove_watcher() i=4 2024-09-12T18:03:09.190 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.185+0000 7f63b35d39c0 20 remove_watcher() i=5 2024-09-12T18:03:09.191 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.185+0000 7f63b35d39c0 20 remove_watcher() i=6 2024-09-12T18:03:09.193 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.189+0000 7f63b35d39c0 20 remove_watcher() i=7 2024-09-12T18:03:09.206 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:03:09.206 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T18:03:09.206 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: myver id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T18:03:09.206 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:03:09.206 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-12T18:03:09.235 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:09.235 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:09.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.273+0000 7f36990739c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.273+0000 7f36990739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.273+0000 7f36990739c0 20 realm 2024-09-12T18:03:09.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.273+0000 7f36990739c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.273+0000 7f36990739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.273+0000 7f36990739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:09.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.273+0000 7f36990739c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.273+0000 7f36990739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.273+0000 7f36990739c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.277+0000 7f36990739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:09.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.277+0000 7f36990739c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.277+0000 7f36990739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:09.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.277+0000 7f36990739c0 20 searching for the correct realm 2024-09-12T18:03:09.287 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.281+0000 7f3696378640 0 -- 172.21.15.98:0/4020556446 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f369013a040 msgr2=0x7f369012aa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:09.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.289+0000 7f3696378640 0 -- 172.21.15.98:0/4020556446 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f369013a040 msgr2=0x7f3560085f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:09.511 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.505+0000 7f36990739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:09.511 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.505+0000 7f36990739c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:09.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.505+0000 7f36990739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:09.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.505+0000 7f36990739c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:09.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.505+0000 7f36990739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:09.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.505+0000 7f36990739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:09.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.505+0000 7f36990739c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.505+0000 7f36990739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.512 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.505+0000 7f36990739c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.513 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.509+0000 7f36990739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:09.513 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.509+0000 7f36990739c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.509+0000 7f36990739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:09.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.509+0000 7f36990739c0 20 zone default found 2024-09-12T18:03:09.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.509+0000 7f36990739c0 4 Realm: () 2024-09-12T18:03:09.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.509+0000 7f36990739c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:09.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.509+0000 7f36990739c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:09.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.509+0000 7f36990739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:09.514 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.509+0000 7f36990739c0 20 zonegroup default 2024-09-12T18:03:09.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.509+0000 7f36990739c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.509+0000 7f36990739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.509+0000 7f36990739c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.513+0000 7f36990739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.516 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.513+0000 7f36990739c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.513+0000 7f36990739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.513+0000 7f36990739c0 20 started sync module instance, tier type = 2024-09-12T18:03:09.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.513+0000 7f36990739c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:09.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.537+0000 7f36990739c0 20 add_watcher() i=0 2024-09-12T18:03:09.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.537+0000 7f36990739c0 20 add_watcher() i=1 2024-09-12T18:03:09.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.537+0000 7f36990739c0 20 add_watcher() i=2 2024-09-12T18:03:09.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.537+0000 7f36990739c0 20 add_watcher() i=3 2024-09-12T18:03:09.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.537+0000 7f36990739c0 20 add_watcher() i=4 2024-09-12T18:03:09.541 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.537+0000 7f36990739c0 20 add_watcher() i=5 2024-09-12T18:03:09.542 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.537+0000 7f36990739c0 20 add_watcher() i=6 2024-09-12T18:03:09.543 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.537+0000 7f36990739c0 20 add_watcher() i=7 2024-09-12T18:03:09.544 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.537+0000 7f36990739c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:09.547 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.541+0000 7f354d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:09.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.545+0000 7f36990739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:09.548 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.545+0000 7f36990739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:09.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.545+0000 7f36990739c0 5 note: GC not initialized 2024-09-12T18:03:09.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.545+0000 7f34c7fff640 20 reqs_thread_entry: start 2024-09-12T18:03:09.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.545+0000 7f36990739c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:09.549 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.545+0000 7f36990739c0 20 Filter name: none 2024-09-12T18:03:09.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.545+0000 7f34c5ffb640 20 reqs_thread_entry: start 2024-09-12T18:03:09.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.545+0000 7f36990739c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T18:03:09.550 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.545+0000 7f36990739c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.551 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.545+0000 7f36990739c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:03:09.551 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.545+0000 7f36990739c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T18:03:09.551 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.545+0000 7f36990739c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T18:03:09.551 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.545+0000 7f36990739c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 : miss 2024-09-12T18:03:09.551 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.545+0000 7f36990739c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.545+0000 7f36990739c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:03:09.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.545+0000 7f36990739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:09.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.545+0000 7f36990739c0 10 adding default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:09.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.545+0000 7f36990739c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:09.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.545+0000 7f36990739c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:09.552 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.545+0000 7f36990739c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 2024-09-12T18:03:09.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.557+0000 7f36990739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:09.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.557+0000 7f36990739c0 10 moving default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:09.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.557+0000 7f36990739c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:09.563 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.557+0000 7f36990739c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18, ofs0, ns] 2024-09-12T18:03:09.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.557+0000 7f357a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366193 cookie 94216206139808 notifier 8592 bl.length()=821 2024-09-12T18:03:09.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.557+0000 7f357a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:09.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.557+0000 7f357a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:09.564 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.557+0000 7f357a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:09.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.561+0000 7f36990739c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): orig_sources= new_sources= 2024-09-12T18:03:09.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.561+0000 7f36990739c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): potential sources added=[] removed=[] 2024-09-12T18:03:09.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.561+0000 7f36990739c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): orig_dests= new_dests= 2024-09-12T18:03:09.567 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.561+0000 7f36990739c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): potential dests added=[] removed=[] 2024-09-12T18:03:09.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.0 2024-09-12T18:03:09.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.0 2024-09-12T18:03:09.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.1 2024-09-12T18:03:09.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.1 2024-09-12T18:03:09.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.2 2024-09-12T18:03:09.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.2 2024-09-12T18:03:09.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.3 2024-09-12T18:03:09.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.3 2024-09-12T18:03:09.579 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.4 2024-09-12T18:03:09.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.4 2024-09-12T18:03:09.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.5 2024-09-12T18:03:09.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.5 2024-09-12T18:03:09.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.6 2024-09-12T18:03:09.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.6 2024-09-12T18:03:09.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.7 2024-09-12T18:03:09.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.7 2024-09-12T18:03:09.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.8 2024-09-12T18:03:09.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.8 2024-09-12T18:03:09.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.9 2024-09-12T18:03:09.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.9 2024-09-12T18:03:09.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.10 2024-09-12T18:03:09.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.10 2024-09-12T18:03:09.580 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.11 2024-09-12T18:03:09.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.11 2024-09-12T18:03:09.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.0 2024-09-12T18:03:09.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.573+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1 2024-09-12T18:03:09.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.577+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2 2024-09-12T18:03:09.581 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.577+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3 2024-09-12T18:03:09.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.577+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.4 2024-09-12T18:03:09.583 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.577+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.5 2024-09-12T18:03:09.584 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.581+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.6 2024-09-12T18:03:09.585 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.581+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.7 2024-09-12T18:03:09.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.581+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.8 2024-09-12T18:03:09.586 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.581+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.9 2024-09-12T18:03:09.587 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.581+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.10 2024-09-12T18:03:09.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.585+0000 7f36990739c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:09.589 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.585+0000 7f36990739c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 2024-09-12T18:03:09.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.589+0000 7f36990739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:09.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.589+0000 7f36990739c0 10 moving default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:09.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.589+0000 7f36990739c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:09.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.589+0000 7f36990739c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18, ofs0, ns] 2024-09-12T18:03:09.593 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.589+0000 7f357a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366194 cookie 94216206139808 notifier 8592 bl.length()=821 2024-09-12T18:03:09.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.589+0000 7f357a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:09.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.589+0000 7f357a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:09.594 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.589+0000 7f357a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:09.596 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.593+0000 7f36990739c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): orig_sources= new_sources= 2024-09-12T18:03:09.596 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.593+0000 7f36990739c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): potential sources added=[] removed=[] 2024-09-12T18:03:09.596 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.593+0000 7f36990739c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): orig_dests= new_dests= 2024-09-12T18:03:09.596 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.593+0000 7f36990739c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): potential dests added=[] removed=[] 2024-09-12T18:03:09.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.597+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.0 2024-09-12T18:03:09.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.597+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1 2024-09-12T18:03:09.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.597+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2 2024-09-12T18:03:09.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.601+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3 2024-09-12T18:03:09.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.601+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.4 2024-09-12T18:03:09.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.601+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.5 2024-09-12T18:03:09.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.601+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.6 2024-09-12T18:03:09.607 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.601+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.7 2024-09-12T18:03:09.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.601+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.8 2024-09-12T18:03:09.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.605+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.9 2024-09-12T18:03:09.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.605+0000 7f36990739c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.10 2024-09-12T18:03:09.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.605+0000 7f36990739c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:09.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.605+0000 7f36990739c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 2024-09-12T18:03:09.613 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.609+0000 7f36990739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:09.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.609+0000 7f36990739c0 10 moving default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:09.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.609+0000 7f36990739c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:09.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.609+0000 7f36990739c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18, ofs0, ns] 2024-09-12T18:03:09.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.609+0000 7f3579ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366195 cookie 94216206139808 notifier 8592 bl.length()=789 2024-09-12T18:03:09.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.609+0000 7f3579ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:09.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.609+0000 7f3579ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:09.614 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.609+0000 7f3579ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:09.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.613+0000 7f36990739c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): orig_sources= new_sources= 2024-09-12T18:03:09.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.613+0000 7f36990739c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): potential sources added=[] removed=[] 2024-09-12T18:03:09.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.613+0000 7f36990739c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): orig_dests= new_dests= 2024-09-12T18:03:09.617 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.613+0000 7f36990739c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): potential dests added=[] removed=[] 2024-09-12T18:03:09.623 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.617+0000 7f36990739c0 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-12T18:03:09.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.621+0000 7f354d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:09.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.625+0000 7f36990739c0 20 remove_watcher() i=0 2024-09-12T18:03:09.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.625+0000 7f36990739c0 2 removed watcher, disabling cache 2024-09-12T18:03:09.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.629+0000 7f36990739c0 20 remove_watcher() i=1 2024-09-12T18:03:09.635 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.629+0000 7f36990739c0 20 remove_watcher() i=2 2024-09-12T18:03:09.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.633+0000 7f36990739c0 20 remove_watcher() i=3 2024-09-12T18:03:09.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.633+0000 7f36990739c0 20 remove_watcher() i=4 2024-09-12T18:03:09.641 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.637+0000 7f36990739c0 20 remove_watcher() i=5 2024-09-12T18:03:09.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.637+0000 7f36990739c0 20 remove_watcher() i=6 2024-09-12T18:03:09.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.641+0000 7f36990739c0 20 remove_watcher() i=7 2024-09-12T18:03:09.662 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T18:03:09.692 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:09.692 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:09.735 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.729+0000 7fa585ac09c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.737 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.733+0000 7fa585ac09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.737 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.733+0000 7fa585ac09c0 20 realm 2024-09-12T18:03:09.737 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.733+0000 7fa585ac09c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.738 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.733+0000 7fa585ac09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.738 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.733+0000 7fa585ac09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:09.738 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.733+0000 7fa585ac09c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.738 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.733+0000 7fa585ac09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.738 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.733+0000 7fa585ac09c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.740 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.737+0000 7fa585ac09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:09.740 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.737+0000 7fa585ac09c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.740 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.737+0000 7fa585ac09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:09.740 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.737+0000 7fa585ac09c0 20 searching for the correct realm 2024-09-12T18:03:09.745 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.741+0000 7fa582dc5640 0 -- 172.21.15.98:0/2688930957 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fa574097030 msgr2=0x7fa57405afe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:09.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.745+0000 7fa5835c6640 0 -- 172.21.15.98:0/2688930957 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fa56c0cd920 msgr2=0x7fa56c0d6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:09.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.969+0000 7fa585ac09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:09.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.969+0000 7fa585ac09c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:09.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.969+0000 7fa585ac09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:09.973 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.969+0000 7fa585ac09c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:09.974 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.969+0000 7fa585ac09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:09.974 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.969+0000 7fa585ac09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:09.974 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.969+0000 7fa585ac09c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.974 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.969+0000 7fa585ac09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.974 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.969+0000 7fa585ac09c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.975 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.969+0000 7fa585ac09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:09.975 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.969+0000 7fa585ac09c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.973+0000 7fa585ac09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:09.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.973+0000 7fa585ac09c0 20 zone default found 2024-09-12T18:03:09.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.973+0000 7fa585ac09c0 4 Realm: () 2024-09-12T18:03:09.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.973+0000 7fa585ac09c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:09.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.973+0000 7fa585ac09c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:09.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.973+0000 7fa585ac09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:09.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.973+0000 7fa585ac09c0 20 zonegroup default 2024-09-12T18:03:09.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.973+0000 7fa585ac09c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.973+0000 7fa585ac09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.973+0000 7fa585ac09c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.973+0000 7fa585ac09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.973+0000 7fa585ac09c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:09.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.977+0000 7fa585ac09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:09.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.977+0000 7fa585ac09c0 20 started sync module instance, tier type = 2024-09-12T18:03:09.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:09.977+0000 7fa585ac09c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:10.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.001+0000 7fa585ac09c0 20 add_watcher() i=0 2024-09-12T18:03:10.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.001+0000 7fa585ac09c0 20 add_watcher() i=1 2024-09-12T18:03:10.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.001+0000 7fa585ac09c0 20 add_watcher() i=2 2024-09-12T18:03:10.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.001+0000 7fa585ac09c0 20 add_watcher() i=3 2024-09-12T18:03:10.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.001+0000 7fa585ac09c0 20 add_watcher() i=4 2024-09-12T18:03:10.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.001+0000 7fa585ac09c0 20 add_watcher() i=5 2024-09-12T18:03:10.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.001+0000 7fa585ac09c0 20 add_watcher() i=6 2024-09-12T18:03:10.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.001+0000 7fa585ac09c0 20 add_watcher() i=7 2024-09-12T18:03:10.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.001+0000 7fa585ac09c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:10.011 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.005+0000 7fa43a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:10.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.005+0000 7fa585ac09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:10.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.005+0000 7fa585ac09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:10.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.005+0000 7fa585ac09c0 5 note: GC not initialized 2024-09-12T18:03:10.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.009+0000 7fa4397e2640 20 reqs_thread_entry: start 2024-09-12T18:03:10.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.009+0000 7fa585ac09c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:10.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.009+0000 7fa585ac09c0 20 Filter name: none 2024-09-12T18:03:10.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.009+0000 7fa4327fc640 20 reqs_thread_entry: start 2024-09-12T18:03:10.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.009+0000 7fa585ac09c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:10.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.009+0000 7fa585ac09c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:03:10.013 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.009+0000 7fa585ac09c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:10.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.009+0000 7fa585ac09c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:03:10.014 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.009+0000 7fa585ac09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:10.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.009+0000 7fa585ac09c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:10.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.009+0000 7fa585ac09c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:03:10.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.009+0000 7fa585ac09c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:10.016 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.009+0000 7fa585ac09c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:03:10.016 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.013+0000 7fa585ac09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:10.019 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.013+0000 7fa43a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:10.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.017+0000 7fa585ac09c0 20 remove_watcher() i=0 2024-09-12T18:03:10.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.017+0000 7fa585ac09c0 2 removed watcher, disabling cache 2024-09-12T18:03:10.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.021+0000 7fa585ac09c0 20 remove_watcher() i=1 2024-09-12T18:03:10.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.025+0000 7fa585ac09c0 20 remove_watcher() i=2 2024-09-12T18:03:10.030 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.025+0000 7fa585ac09c0 20 remove_watcher() i=3 2024-09-12T18:03:10.032 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.029+0000 7fa585ac09c0 20 remove_watcher() i=4 2024-09-12T18:03:10.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.029+0000 7fa585ac09c0 20 remove_watcher() i=5 2024-09-12T18:03:10.035 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.029+0000 7fa585ac09c0 20 remove_watcher() i=6 2024-09-12T18:03:10.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:10.033+0000 7fa585ac09c0 20 remove_watcher() i=7 2024-09-12T18:03:10.050 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:03:10.051 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T18:03:10.051 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: myver id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T18:03:10.051 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:03:10.052 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:10.053 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:10.076 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:10.076 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:10.137 INFO:tasks.workunit.client.0.smithi098.stderr: test: reshard removes olh entries with empty name 2024-09-12T18:03:10.142 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:10.142 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:10.288 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:10.288 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:10.944 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:03:10.978 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:10.978 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:11.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.017+0000 7fe992dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.021+0000 7fe992dcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.021+0000 7fe992dcc9c0 20 realm 2024-09-12T18:03:11.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.021+0000 7fe992dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.021+0000 7fe992dcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.021+0000 7fe992dcc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:11.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.021+0000 7fe992dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.021+0000 7fe992dcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.026 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.021+0000 7fe992dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.021+0000 7fe992dcc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:11.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.021+0000 7fe992dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.025+0000 7fe992dcc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:11.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.025+0000 7fe992dcc9c0 20 searching for the correct realm 2024-09-12T18:03:11.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.029+0000 7fe9900d1640 0 -- 172.21.15.98:0/334705704 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x559202913ed0 msgr2=0x5592029162c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:11.040 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.037+0000 7fe9908d2640 0 -- 172.21.15.98:0/334705704 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fe9841035b0 msgr2=0x7fe984134150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:11.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:11.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:11.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:11.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:11.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:11.048 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:11.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:11.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:11.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 zone default found 2024-09-12T18:03:11.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 4 Realm: () 2024-09-12T18:03:11.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:11.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:11.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:11.050 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 zonegroup default 2024-09-12T18:03:11.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 started sync module instance, tier type = 2024-09-12T18:03:11.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.045+0000 7fe992dcc9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:11.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.061+0000 7fe992dcc9c0 20 add_watcher() i=0 2024-09-12T18:03:11.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.061+0000 7fe992dcc9c0 20 add_watcher() i=1 2024-09-12T18:03:11.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.061+0000 7fe992dcc9c0 20 add_watcher() i=2 2024-09-12T18:03:11.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.061+0000 7fe992dcc9c0 20 add_watcher() i=3 2024-09-12T18:03:11.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.061+0000 7fe992dcc9c0 20 add_watcher() i=4 2024-09-12T18:03:11.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.061+0000 7fe992dcc9c0 20 add_watcher() i=5 2024-09-12T18:03:11.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.061+0000 7fe992dcc9c0 20 add_watcher() i=6 2024-09-12T18:03:11.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.061+0000 7fe992dcc9c0 20 add_watcher() i=7 2024-09-12T18:03:11.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.061+0000 7fe992dcc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:11.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.065+0000 7fe846fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:11.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.065+0000 7fe992dcc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:11.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.065+0000 7fe992dcc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:11.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.065+0000 7fe992dcc9c0 5 note: GC not initialized 2024-09-12T18:03:11.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.065+0000 7fe845fe3640 20 reqs_thread_entry: start 2024-09-12T18:03:11.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.065+0000 7fe992dcc9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:11.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.065+0000 7fe992dcc9c0 20 Filter name: none 2024-09-12T18:03:11.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.065+0000 7fe7b77fe640 20 reqs_thread_entry: start 2024-09-12T18:03:11.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.065+0000 7fe992dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.065+0000 7fe992dcc9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:03:11.071 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.065+0000 7fe992dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.069+0000 7fe992dcc9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:03:11.073 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.069+0000 7fe992dcc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:11.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.069+0000 7fe992dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.069+0000 7fe992dcc9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:03:11.074 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.069+0000 7fe992dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.069+0000 7fe992dcc9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:03:11.076 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.069+0000 7fe992dcc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:11.078 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.073+0000 7fe846fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:11.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.077+0000 7fe992dcc9c0 20 remove_watcher() i=0 2024-09-12T18:03:11.083 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.077+0000 7fe992dcc9c0 2 removed watcher, disabling cache 2024-09-12T18:03:11.085 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.081+0000 7fe992dcc9c0 20 remove_watcher() i=1 2024-09-12T18:03:11.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.081+0000 7fe992dcc9c0 20 remove_watcher() i=2 2024-09-12T18:03:11.089 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.085+0000 7fe992dcc9c0 20 remove_watcher() i=3 2024-09-12T18:03:11.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.085+0000 7fe992dcc9c0 20 remove_watcher() i=4 2024-09-12T18:03:11.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.089+0000 7fe992dcc9c0 20 remove_watcher() i=5 2024-09-12T18:03:11.093 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.089+0000 7fe992dcc9c0 20 remove_watcher() i=6 2024-09-12T18:03:11.094 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.089+0000 7fe992dcc9c0 20 remove_watcher() i=7 2024-09-12T18:03:11.108 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:03:11.108 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T18:03:11.108 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: a-bucket id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-12T18:03:11.108 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:03:11.109 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T18:03:11.135 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:11.135 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:11.178 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.173+0000 7fbd796919c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.177+0000 7fbd796919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.177+0000 7fbd796919c0 20 realm 2024-09-12T18:03:11.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.177+0000 7fbd796919c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.177+0000 7fbd796919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.177+0000 7fbd796919c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:11.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.177+0000 7fbd796919c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.177+0000 7fbd796919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.181 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.177+0000 7fbd796919c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.182 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.177+0000 7fbd796919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:11.182 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.177+0000 7fbd796919c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.177+0000 7fbd796919c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:11.183 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.177+0000 7fbd796919c0 20 searching for the correct realm 2024-09-12T18:03:11.188 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.185+0000 7fbd77998640 0 -- 172.21.15.98:0/77099825 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x561b05f9fc80 msgr2=0x561b05fa20b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:11.194 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.189+0000 7fbd76996640 0 -- 172.21.15.98:0/77099825 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fbd6801a040 msgr2=0x7fbd680853b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:11.201 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:11.201 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:11.201 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:11.201 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:11.201 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:11.201 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:11.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:11.202 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.203 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:11.203 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 20 zone default found 2024-09-12T18:03:11.203 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 4 Realm: () 2024-09-12T18:03:11.203 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:11.203 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:11.203 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:11.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 20 zonegroup default 2024-09-12T18:03:11.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.197+0000 7fbd796919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.201+0000 7fbd796919c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.204 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.201+0000 7fbd796919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.205 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.201+0000 7fbd796919c0 20 started sync module instance, tier type = 2024-09-12T18:03:11.205 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.201+0000 7fbd796919c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:11.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.213+0000 7fbd796919c0 20 add_watcher() i=0 2024-09-12T18:03:11.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.213+0000 7fbd796919c0 20 add_watcher() i=1 2024-09-12T18:03:11.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.213+0000 7fbd796919c0 20 add_watcher() i=2 2024-09-12T18:03:11.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.213+0000 7fbd796919c0 20 add_watcher() i=3 2024-09-12T18:03:11.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.213+0000 7fbd796919c0 20 add_watcher() i=4 2024-09-12T18:03:11.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.213+0000 7fbd796919c0 20 add_watcher() i=5 2024-09-12T18:03:11.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.213+0000 7fbd796919c0 20 add_watcher() i=6 2024-09-12T18:03:11.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.217+0000 7fbd796919c0 20 add_watcher() i=7 2024-09-12T18:03:11.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.217+0000 7fbd796919c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:11.223 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.217+0000 7fbc2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:11.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.217+0000 7fbd796919c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:11.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.217+0000 7fbd796919c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:11.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.217+0000 7fbd796919c0 5 note: GC not initialized 2024-09-12T18:03:11.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.217+0000 7fbc2cfe1640 20 reqs_thread_entry: start 2024-09-12T18:03:11.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.217+0000 7fbd796919c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:11.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.221+0000 7fbd796919c0 20 Filter name: none 2024-09-12T18:03:11.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.221+0000 7fbba67fc640 20 reqs_thread_entry: start 2024-09-12T18:03:11.224 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.221+0000 7fbd796919c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.221+0000 7fbd796919c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:03:11.225 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.221+0000 7fbd796919c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.226 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.221+0000 7fbd796919c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:03:11.226 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.221+0000 7fbd796919c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:11.227 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.221+0000 7fbc2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:11.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.229+0000 7fbd796919c0 20 remove_watcher() i=0 2024-09-12T18:03:11.232 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.229+0000 7fbd796919c0 2 removed watcher, disabling cache 2024-09-12T18:03:11.234 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.229+0000 7fbd796919c0 20 remove_watcher() i=1 2024-09-12T18:03:11.236 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.229+0000 7fbd796919c0 20 remove_watcher() i=2 2024-09-12T18:03:11.237 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.233+0000 7fbd796919c0 20 remove_watcher() i=3 2024-09-12T18:03:11.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.233+0000 7fbd796919c0 20 remove_watcher() i=4 2024-09-12T18:03:11.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.237+0000 7fbd796919c0 20 remove_watcher() i=5 2024-09-12T18:03:11.242 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.237+0000 7fbd796919c0 20 remove_watcher() i=6 2024-09-12T18:03:11.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.237+0000 7fbd796919c0 20 remove_watcher() i=7 2024-09-12T18:03:11.256 INFO:tasks.workunit.client.0.smithi098.stderr:rados -p default.rgw.buckets.index setomapval .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T18:03:11.282 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:11.282 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:11.301 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T18:03:11.326 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:11.326 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:11.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.361+0000 7f97810679c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.365+0000 7f97810679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.365+0000 7f97810679c0 20 realm 2024-09-12T18:03:11.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.365+0000 7f97810679c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.365+0000 7f97810679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.365+0000 7f97810679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:11.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.365+0000 7f97810679c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.365+0000 7f97810679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.365+0000 7f97810679c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.365+0000 7f97810679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:11.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.365+0000 7f97810679c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.365+0000 7f97810679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:11.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.365+0000 7f97810679c0 20 searching for the correct realm 2024-09-12T18:03:11.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.373+0000 7f977f36e640 0 -- 172.21.15.98:0/3451598529 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f9774008050 msgr2=0x7f977407a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:11.595 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.589+0000 7f977eb6d640 0 -- 172.21.15.98:0/3451598529 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x55c490519aa0 msgr2=0x55c49051bf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:11.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.597+0000 7f97810679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:11.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.597+0000 7f97810679c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:11.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.597+0000 7f97810679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:11.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.597+0000 7f97810679c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:11.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.597+0000 7f97810679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:11.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.597+0000 7f97810679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:11.602 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.597+0000 7f97810679c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.597+0000 7f97810679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.597+0000 7f97810679c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.597+0000 7f97810679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:11.603 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.597+0000 7f97810679c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.601+0000 7f97810679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:11.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.601+0000 7f97810679c0 20 zone default found 2024-09-12T18:03:11.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.601+0000 7f97810679c0 4 Realm: () 2024-09-12T18:03:11.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.601+0000 7f97810679c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:11.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.601+0000 7f97810679c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:11.604 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.601+0000 7f97810679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:11.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.601+0000 7f97810679c0 20 zonegroup default 2024-09-12T18:03:11.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.601+0000 7f97810679c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.601+0000 7f97810679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.601+0000 7f97810679c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.601+0000 7f97810679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.605 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.601+0000 7f97810679c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.601+0000 7f97810679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.601+0000 7f97810679c0 20 started sync module instance, tier type = 2024-09-12T18:03:11.606 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.601+0000 7f97810679c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:11.631 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.625+0000 7f97810679c0 20 add_watcher() i=0 2024-09-12T18:03:11.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.625+0000 7f97810679c0 20 add_watcher() i=1 2024-09-12T18:03:11.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.625+0000 7f97810679c0 20 add_watcher() i=2 2024-09-12T18:03:11.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.625+0000 7f97810679c0 20 add_watcher() i=3 2024-09-12T18:03:11.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.625+0000 7f97810679c0 20 add_watcher() i=4 2024-09-12T18:03:11.632 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.625+0000 7f97810679c0 20 add_watcher() i=5 2024-09-12T18:03:11.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.629+0000 7f97810679c0 20 add_watcher() i=6 2024-09-12T18:03:11.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.629+0000 7f97810679c0 20 add_watcher() i=7 2024-09-12T18:03:11.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.629+0000 7f97810679c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:11.638 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.633+0000 7f9635fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:11.639 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.633+0000 7f97810679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:11.639 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.633+0000 7f97810679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:11.639 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.633+0000 7f97810679c0 5 note: GC not initialized 2024-09-12T18:03:11.639 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.633+0000 7f9634fe1640 20 reqs_thread_entry: start 2024-09-12T18:03:11.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.633+0000 7f97810679c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:11.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.633+0000 7f97810679c0 20 Filter name: none 2024-09-12T18:03:11.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.637+0000 7f962dffb640 20 reqs_thread_entry: start 2024-09-12T18:03:11.640 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.637+0000 7f97810679c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.641 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.637+0000 7f97810679c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:03:11.641 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.637+0000 7f97810679c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.642 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.637+0000 7f97810679c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:03:11.642 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.637+0000 7f97810679c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:11.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.637+0000 7f97810679c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T18:03:11.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.637+0000 7f97810679c0 20 INFO: main: starting shard=0 2024-09-12T18:03:11.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.637+0000 7f97810679c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:03:11.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.637+0000 7f97810679c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:03:11.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.637+0000 7f97810679c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:03:11.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.637+0000 7f97810679c0 20 INFO: main: starting shard=1 2024-09-12T18:03:11.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.637+0000 7f97810679c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:03:11.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.637+0000 7f97810679c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:03:11.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.641+0000 7f97810679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:11.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.641+0000 7f97810679c0 20 INFO: main: starting shard=2 2024-09-12T18:03:11.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.641+0000 7f97810679c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:03:11.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.641+0000 7f97810679c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:03:11.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.641+0000 7f97810679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:11.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.641+0000 7f97810679c0 20 INFO: main: starting shard=3 2024-09-12T18:03:11.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.641+0000 7f97810679c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:03:11.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.641+0000 7f97810679c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:03:11.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.641+0000 7f97810679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:11.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.641+0000 7f97810679c0 20 INFO: main: starting shard=4 2024-09-12T18:03:11.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.641+0000 7f97810679c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:03:11.647 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.641+0000 7f97810679c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:03:11.647 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.641+0000 7f97810679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:11.647 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.641+0000 7f97810679c0 20 INFO: main: starting shard=5 2024-09-12T18:03:11.647 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.641+0000 7f97810679c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:03:11.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.641+0000 7f97810679c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:03:11.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.645+0000 7f97810679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:11.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.645+0000 7f97810679c0 20 INFO: main: starting shard=6 2024-09-12T18:03:11.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.645+0000 7f97810679c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:03:11.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.645+0000 7f97810679c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:03:11.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.645+0000 7f97810679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:11.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.645+0000 7f97810679c0 20 INFO: main: starting shard=7 2024-09-12T18:03:11.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.645+0000 7f97810679c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:03:11.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.645+0000 7f97810679c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:03:11.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.645+0000 7f97810679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:11.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.645+0000 7f97810679c0 20 INFO: main: starting shard=8 2024-09-12T18:03:11.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.645+0000 7f97810679c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:03:11.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.645+0000 7f97810679c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:03:11.652 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.645+0000 7f97810679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:11.652 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.645+0000 7f97810679c0 20 INFO: main: starting shard=9 2024-09-12T18:03:11.652 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.645+0000 7f97810679c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:03:11.652 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.645+0000 7f97810679c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:03:11.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.649+0000 7f97810679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:11.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.649+0000 7f97810679c0 20 INFO: main: starting shard=10 2024-09-12T18:03:11.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.649+0000 7f97810679c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:03:11.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.649+0000 7f97810679c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:03:11.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.649+0000 7f97810679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:11.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.649+0000 7f97810679c0 20 INFO: main: starting shard=11 2024-09-12T18:03:11.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.649+0000 7f97810679c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:03:11.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.649+0000 7f97810679c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:03:11.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.653+0000 7f97810679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:11.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.653+0000 7f97810679c0 20 INFO: main: starting shard=12 2024-09-12T18:03:11.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.653+0000 7f97810679c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:03:11.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.653+0000 7f97810679c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:03:11.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.653+0000 7f97810679c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:11.658 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.653+0000 7f97810679c0 20 INFO: main: done 2024-09-12T18:03:11.660 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.657+0000 7f9635fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:11.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.661+0000 7f97810679c0 20 remove_watcher() i=0 2024-09-12T18:03:11.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.661+0000 7f97810679c0 2 removed watcher, disabling cache 2024-09-12T18:03:11.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.661+0000 7f97810679c0 20 remove_watcher() i=1 2024-09-12T18:03:11.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.665+0000 7f97810679c0 20 remove_watcher() i=2 2024-09-12T18:03:11.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.669+0000 7f97810679c0 20 remove_watcher() i=3 2024-09-12T18:03:11.675 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.669+0000 7f97810679c0 20 remove_watcher() i=4 2024-09-12T18:03:11.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.673+0000 7f97810679c0 20 remove_watcher() i=5 2024-09-12T18:03:11.678 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.673+0000 7f97810679c0 20 remove_watcher() i=6 2024-09-12T18:03:11.679 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.673+0000 7f97810679c0 20 remove_watcher() i=7 2024-09-12T18:03:11.694 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T18:03:11.729 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:11.729 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:11.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.769+0000 7f518c0ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.769+0000 7f518c0ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.769+0000 7f518c0ff9c0 20 realm 2024-09-12T18:03:11.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.769+0000 7f518c0ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.769+0000 7f518c0ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.769+0000 7f518c0ff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:11.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.769+0000 7f518c0ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.769+0000 7f518c0ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.775 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.769+0000 7f518c0ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.769+0000 7f518c0ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:11.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.769+0000 7f518c0ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.773+0000 7f518c0ff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:11.776 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.773+0000 7f518c0ff9c0 20 searching for the correct realm 2024-09-12T18:03:11.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.777+0000 7f5189404640 0 -- 172.21.15.98:0/3899217222 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55a4c8925ee0 msgr2=0x55a4c89283a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:11.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.781+0000 7f5189404640 0 -- 172.21.15.98:0/3899217222 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f517c013030 msgr2=0x7f517c09a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:11.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.789+0000 7f518c0ff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:11.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.789+0000 7f518c0ff9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:11.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.789+0000 7f518c0ff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:11.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.789+0000 7f518c0ff9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:11.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.789+0000 7f518c0ff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:11.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.789+0000 7f518c0ff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:11.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.789+0000 7f518c0ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.789+0000 7f518c0ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.795 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.789+0000 7f518c0ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.789+0000 7f518c0ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:11.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.789+0000 7f518c0ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.793+0000 7f518c0ff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:11.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.793+0000 7f518c0ff9c0 20 zone default found 2024-09-12T18:03:11.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.793+0000 7f518c0ff9c0 4 Realm: () 2024-09-12T18:03:11.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.793+0000 7f518c0ff9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:11.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.793+0000 7f518c0ff9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:11.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.793+0000 7f518c0ff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:11.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.793+0000 7f518c0ff9c0 20 zonegroup default 2024-09-12T18:03:11.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.793+0000 7f518c0ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.793+0000 7f518c0ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.793+0000 7f518c0ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.793+0000 7f518c0ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.793+0000 7f518c0ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.793+0000 7f518c0ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:11.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.793+0000 7f518c0ff9c0 20 started sync module instance, tier type = 2024-09-12T18:03:11.798 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.793+0000 7f518c0ff9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:11.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.809+0000 7f518c0ff9c0 20 add_watcher() i=0 2024-09-12T18:03:11.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.809+0000 7f518c0ff9c0 20 add_watcher() i=1 2024-09-12T18:03:11.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.809+0000 7f518c0ff9c0 20 add_watcher() i=2 2024-09-12T18:03:11.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.809+0000 7f518c0ff9c0 20 add_watcher() i=3 2024-09-12T18:03:11.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.809+0000 7f518c0ff9c0 20 add_watcher() i=4 2024-09-12T18:03:11.812 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.809+0000 7f518c0ff9c0 20 add_watcher() i=5 2024-09-12T18:03:11.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.809+0000 7f518c0ff9c0 20 add_watcher() i=6 2024-09-12T18:03:11.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.809+0000 7f518c0ff9c0 20 add_watcher() i=7 2024-09-12T18:03:11.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.809+0000 7f518c0ff9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:11.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.809+0000 7f503b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:11.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.809+0000 7f518c0ff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:11.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.813+0000 7f518c0ff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:11.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.813+0000 7f518c0ff9c0 5 note: GC not initialized 2024-09-12T18:03:11.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.813+0000 7f503a7fc640 20 reqs_thread_entry: start 2024-09-12T18:03:11.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.813+0000 7f518c0ff9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:11.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.813+0000 7f518c0ff9c0 20 Filter name: none 2024-09-12T18:03:11.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.813+0000 7f4fabfff640 20 reqs_thread_entry: start 2024-09-12T18:03:11.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.813+0000 7f518c0ff9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:03:11.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.813+0000 7f518c0ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.813+0000 7f518c0ff9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:03:11.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.813+0000 7f518c0ff9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:03:11.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.813+0000 7f518c0ff9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:03:11.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.813+0000 7f518c0ff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : miss 2024-09-12T18:03:11.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.813+0000 7f518c0ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:11.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.813+0000 7f518c0ff9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:03:11.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.813+0000 7f518c0ff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:03:11.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.813+0000 7f518c0ff9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:03:11.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.813+0000 7f518c0ff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:11.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.813+0000 7f518c0ff9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:11.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.813+0000 7f518c0ff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:03:11.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.821+0000 7f518c0ff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:03:11.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.821+0000 7f518c0ff9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:03:11.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.821+0000 7f518c0ff9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:11.826 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.821+0000 7f518c0ff9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T18:03:11.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.821+0000 7f506cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366224 cookie 94166228040304 notifier 7985 bl.length()=827 2024-09-12T18:03:11.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.821+0000 7f506cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:03:11.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.821+0000 7f506cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:03:11.827 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.821+0000 7f506cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:11.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.825+0000 7f518c0ff9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T18:03:11.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.825+0000 7f518c0ff9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T18:03:11.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.825+0000 7f518c0ff9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T18:03:11.829 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.825+0000 7f518c0ff9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T18:03:11.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.837+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.0 2024-09-12T18:03:11.842 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.837+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.0 2024-09-12T18:03:11.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.837+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:03:11.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.837+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:03:11.843 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.837+0000 7f518c0ff9c0 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T18:03:11.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.837+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:03:11.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.837+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:03:11.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.841+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:03:11.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.841+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:03:11.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.841+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:03:11.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.841+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:03:11.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.841+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:03:11.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.841+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:03:11.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.841+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:03:11.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.841+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:03:11.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.841+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:03:11.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.841+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:03:11.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.845+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:03:11.848 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.845+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:03:11.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.845+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:03:11.849 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.845+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:03:11.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.845+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:03:11.851 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.845+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:03:11.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.849+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:03:11.852 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.849+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:03:11.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.849+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:03:11.853 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.849+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:03:11.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.849+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:03:11.854 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.849+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:03:11.855 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.849+0000 7f518c0ff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:11.855 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.849+0000 7f518c0ff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:03:11.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.853+0000 7f518c0ff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:03:11.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.853+0000 7f518c0ff9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:03:11.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.853+0000 7f518c0ff9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:11.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.853+0000 7f518c0ff9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T18:03:11.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.853+0000 7f506cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366225 cookie 94166228040304 notifier 7985 bl.length()=827 2024-09-12T18:03:11.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.853+0000 7f506cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:03:11.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.853+0000 7f506cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:03:11.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.853+0000 7f506cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:11.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.857+0000 7f518c0ff9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T18:03:11.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.857+0000 7f518c0ff9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T18:03:11.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.857+0000 7f518c0ff9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T18:03:11.861 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.857+0000 7f518c0ff9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T18:03:11.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.861+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:03:11.867 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.861+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.0 2024-09-12T18:03:11.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.865+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:03:11.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.865+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.1 2024-09-12T18:03:11.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.865+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:03:11.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.865+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.2 2024-09-12T18:03:11.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.865+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:03:11.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.865+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.3 2024-09-12T18:03:11.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.865+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:03:11.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.865+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.4 2024-09-12T18:03:11.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.865+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:03:11.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.865+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.5 2024-09-12T18:03:11.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.865+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:03:11.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.865+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.6 2024-09-12T18:03:11.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.865+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:03:11.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.865+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.7 2024-09-12T18:03:11.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.869+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:03:11.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.869+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.8 2024-09-12T18:03:11.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.869+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:03:11.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.869+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.9 2024-09-12T18:03:11.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.869+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:03:11.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.869+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.10 2024-09-12T18:03:11.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.869+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:03:11.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.869+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.11 2024-09-12T18:03:11.876 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.873+0000 7f518c0ff9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:03:11.876 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.873+0000 7f518c0ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.2.12 2024-09-12T18:03:11.876 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.873+0000 7f518c0ff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:11.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.873+0000 7f518c0ff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 2024-09-12T18:03:11.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.877+0000 7f518c0ff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:03:11.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.877+0000 7f518c0ff9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:03:11.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.877+0000 7f518c0ff9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:11.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.877+0000 7f518c0ff9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17, ofs0, ns] 2024-09-12T18:03:11.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.877+0000 7f506d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366226 cookie 94166228040304 notifier 7985 bl.length()=795 2024-09-12T18:03:11.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.877+0000 7f506d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 info.flags=0x17 2024-09-12T18:03:11.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.877+0000 7f506d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17 to cache LRU end 2024-09-12T18:03:11.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.877+0000 7f506d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:11.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.877+0000 7f518c0ff9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_sources= new_sources= 2024-09-12T18:03:11.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.877+0000 7f518c0ff9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential sources added=[] removed=[] 2024-09-12T18:03:11.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.877+0000 7f518c0ff9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): orig_dests= new_dests= 2024-09-12T18:03:11.884 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.877+0000 7f518c0ff9c0 20 handle_bi_update(): bucket=:a-bucket[a01e4849-e968-46ce-97f1-a673c26b3735.4529.17]): potential dests added=[] removed=[] 2024-09-12T18:03:11.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.889+0000 7f518c0ff9c0 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-12T18:03:11.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.893+0000 7f503b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:11.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.897+0000 7f518c0ff9c0 20 remove_watcher() i=0 2024-09-12T18:03:11.901 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.897+0000 7f518c0ff9c0 2 removed watcher, disabling cache 2024-09-12T18:03:11.903 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.897+0000 7f518c0ff9c0 20 remove_watcher() i=1 2024-09-12T18:03:11.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.901+0000 7f518c0ff9c0 20 remove_watcher() i=2 2024-09-12T18:03:11.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.901+0000 7f518c0ff9c0 20 remove_watcher() i=3 2024-09-12T18:03:11.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.905+0000 7f518c0ff9c0 20 remove_watcher() i=4 2024-09-12T18:03:11.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.905+0000 7f518c0ff9c0 20 remove_watcher() i=5 2024-09-12T18:03:11.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.905+0000 7f518c0ff9c0 20 remove_watcher() i=6 2024-09-12T18:03:11.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.909+0000 7f518c0ff9c0 20 remove_watcher() i=7 2024-09-12T18:03:11.928 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T18:03:11.958 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:11.958 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:12.003 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:11.997+0000 7fb6632ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.001+0000 7fb6632ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.001+0000 7fb6632ce9c0 20 realm 2024-09-12T18:03:12.005 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.001+0000 7fb6632ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.001+0000 7fb6632ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.001+0000 7fb6632ce9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:12.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.001+0000 7fb6632ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.001+0000 7fb6632ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.001+0000 7fb6632ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.001+0000 7fb6632ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:12.007 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.001+0000 7fb6632ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.001+0000 7fb6632ce9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:12.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.001+0000 7fb6632ce9c0 20 searching for the correct realm 2024-09-12T18:03:12.015 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.009+0000 7fb6615d5640 0 -- 172.21.15.98:0/2010708534 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7fb64c032420 msgr2=0x7fb64c0328a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:12.230 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.225+0000 7fb660dd4640 0 -- 172.21.15.98:0/2010708534 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x55dc90d5f750 msgr2=0x55dc90d61b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:12.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.233+0000 7fb6632ce9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:12.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.233+0000 7fb6632ce9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:12.238 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.233+0000 7fb6632ce9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:12.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.233+0000 7fb6632ce9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:12.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.233+0000 7fb6632ce9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:12.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.233+0000 7fb6632ce9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:12.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.233+0000 7fb6632ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.233+0000 7fb6632ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.239 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.233+0000 7fb6632ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.233+0000 7fb6632ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:12.240 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.233+0000 7fb6632ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.237+0000 7fb6632ce9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:12.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.237+0000 7fb6632ce9c0 20 zone default found 2024-09-12T18:03:12.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.237+0000 7fb6632ce9c0 4 Realm: () 2024-09-12T18:03:12.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.237+0000 7fb6632ce9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:12.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.237+0000 7fb6632ce9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:12.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.237+0000 7fb6632ce9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:12.241 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.237+0000 7fb6632ce9c0 20 zonegroup default 2024-09-12T18:03:12.242 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.237+0000 7fb6632ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.242 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.237+0000 7fb6632ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.242 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.237+0000 7fb6632ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.242 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.237+0000 7fb6632ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.237+0000 7fb6632ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.237+0000 7fb6632ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.237+0000 7fb6632ce9c0 20 started sync module instance, tier type = 2024-09-12T18:03:12.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.237+0000 7fb6632ce9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:12.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.261+0000 7fb6632ce9c0 20 add_watcher() i=0 2024-09-12T18:03:12.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.261+0000 7fb6632ce9c0 20 add_watcher() i=1 2024-09-12T18:03:12.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.261+0000 7fb6632ce9c0 20 add_watcher() i=2 2024-09-12T18:03:12.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.261+0000 7fb6632ce9c0 20 add_watcher() i=3 2024-09-12T18:03:12.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.261+0000 7fb6632ce9c0 20 add_watcher() i=4 2024-09-12T18:03:12.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.261+0000 7fb6632ce9c0 20 add_watcher() i=5 2024-09-12T18:03:12.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.261+0000 7fb6632ce9c0 20 add_watcher() i=6 2024-09-12T18:03:12.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.265+0000 7fb6632ce9c0 20 add_watcher() i=7 2024-09-12T18:03:12.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.265+0000 7fb6632ce9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:12.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.269+0000 7fb516fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:12.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.269+0000 7fb6632ce9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:12.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.269+0000 7fb6632ce9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:12.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.269+0000 7fb6632ce9c0 5 note: GC not initialized 2024-09-12T18:03:12.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.269+0000 7fb515fe3640 20 reqs_thread_entry: start 2024-09-12T18:03:12.275 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.269+0000 7fb6632ce9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:12.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.269+0000 7fb6632ce9c0 20 Filter name: none 2024-09-12T18:03:12.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.269+0000 7fb4877fe640 20 reqs_thread_entry: start 2024-09-12T18:03:12.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.273+0000 7fb6632ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.273+0000 7fb6632ce9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:03:12.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.273+0000 7fb6632ce9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.273+0000 7fb6632ce9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:03:12.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.273+0000 7fb6632ce9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:12.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.273+0000 7fb6632ce9c0 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T18:03:12.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.273+0000 7fb6632ce9c0 20 INFO: main: starting shard=0 2024-09-12T18:03:12.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.273+0000 7fb6632ce9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.0 2024-09-12T18:03:12.279 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.273+0000 7fb6632ce9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.17.3.0 2024-09-12T18:03:12.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.273+0000 7fb6632ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:12.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.273+0000 7fb6632ce9c0 20 INFO: main: done 2024-09-12T18:03:12.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.277+0000 7fb516fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:12.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.281+0000 7fb6632ce9c0 20 remove_watcher() i=0 2024-09-12T18:03:12.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.281+0000 7fb6632ce9c0 2 removed watcher, disabling cache 2024-09-12T18:03:12.288 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.285+0000 7fb6632ce9c0 20 remove_watcher() i=1 2024-09-12T18:03:12.290 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.285+0000 7fb6632ce9c0 20 remove_watcher() i=2 2024-09-12T18:03:12.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.289+0000 7fb6632ce9c0 20 remove_watcher() i=3 2024-09-12T18:03:12.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.289+0000 7fb6632ce9c0 20 remove_watcher() i=4 2024-09-12T18:03:12.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.289+0000 7fb6632ce9c0 20 remove_watcher() i=5 2024-09-12T18:03:12.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.293+0000 7fb6632ce9c0 20 remove_watcher() i=6 2024-09-12T18:03:12.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.293+0000 7fb6632ce9c0 20 remove_watcher() i=7 2024-09-12T18:03:12.318 INFO:tasks.workunit.client.0.smithi098.stderr: test: PUT succeeds during reshard 2024-09-12T18:03:12.318 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T18:03:12.346 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:12.346 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:12.391 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.385+0000 7f4fb776f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.389+0000 7f4fb776f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.389+0000 7f4fb776f9c0 20 realm 2024-09-12T18:03:12.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.389+0000 7f4fb776f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.393 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.389+0000 7f4fb776f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.389+0000 7f4fb776f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:12.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.389+0000 7f4fb776f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.389+0000 7f4fb776f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.389+0000 7f4fb776f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.389+0000 7f4fb776f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:12.395 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.389+0000 7f4fb776f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.389+0000 7f4fb776f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:12.396 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.389+0000 7f4fb776f9c0 20 searching for the correct realm 2024-09-12T18:03:12.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.397+0000 7f4fb5a76640 0 -- 172.21.15.98:0/1791930459 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f4fac04a040 msgr2=0x7f4fac049410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:12.618 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.613+0000 7f4fb5275640 0 -- 172.21.15.98:0/1791930459 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x5579f4a7c5f0 msgr2=0x5579f4a7e9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:12.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.621+0000 7f4fb776f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:12.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.621+0000 7f4fb776f9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:12.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.621+0000 7f4fb776f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:12.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.621+0000 7f4fb776f9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:12.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.621+0000 7f4fb776f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:12.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.621+0000 7f4fb776f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:12.625 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.621+0000 7f4fb776f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.621+0000 7f4fb776f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.621+0000 7f4fb776f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.626 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.621+0000 7f4fb776f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:12.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.621+0000 7f4fb776f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.627 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.621+0000 7f4fb776f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:12.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.621+0000 7f4fb776f9c0 20 zone default found 2024-09-12T18:03:12.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.621+0000 7f4fb776f9c0 4 Realm: () 2024-09-12T18:03:12.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.621+0000 7f4fb776f9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:12.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.621+0000 7f4fb776f9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:12.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.621+0000 7f4fb776f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:12.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.621+0000 7f4fb776f9c0 20 zonegroup default 2024-09-12T18:03:12.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.621+0000 7f4fb776f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.625+0000 7f4fb776f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.628 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.625+0000 7f4fb776f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.625+0000 7f4fb776f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.629 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.625+0000 7f4fb776f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.625+0000 7f4fb776f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.625+0000 7f4fb776f9c0 20 started sync module instance, tier type = 2024-09-12T18:03:12.630 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.625+0000 7f4fb776f9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:12.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.649+0000 7f4fb776f9c0 20 add_watcher() i=0 2024-09-12T18:03:12.654 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.649+0000 7f4fb776f9c0 20 add_watcher() i=1 2024-09-12T18:03:12.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.649+0000 7f4fb776f9c0 20 add_watcher() i=2 2024-09-12T18:03:12.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.649+0000 7f4fb776f9c0 20 add_watcher() i=3 2024-09-12T18:03:12.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.649+0000 7f4fb776f9c0 20 add_watcher() i=4 2024-09-12T18:03:12.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.649+0000 7f4fb776f9c0 20 add_watcher() i=5 2024-09-12T18:03:12.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.649+0000 7f4fb776f9c0 20 add_watcher() i=6 2024-09-12T18:03:12.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.653+0000 7f4fb776f9c0 20 add_watcher() i=7 2024-09-12T18:03:12.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.653+0000 7f4fb776f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:12.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.657+0000 7f4e6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:12.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.657+0000 7f4fb776f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:12.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.657+0000 7f4fb776f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:12.662 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.657+0000 7f4fb776f9c0 5 note: GC not initialized 2024-09-12T18:03:12.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.657+0000 7f4e6a7e4640 20 reqs_thread_entry: start 2024-09-12T18:03:12.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.657+0000 7f4fb776f9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:12.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.657+0000 7f4fb776f9c0 20 Filter name: none 2024-09-12T18:03:12.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.657+0000 7f4ddbfff640 20 reqs_thread_entry: start 2024-09-12T18:03:12.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.657+0000 7f4fb776f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.657+0000 7f4fb776f9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:03:12.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.657+0000 7f4fb776f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.661+0000 7f4fb776f9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:03:12.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.661+0000 7f4fb776f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:12.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.661+0000 7f4fb776f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.665 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.661+0000 7f4fb776f9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:03:12.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.661+0000 7f4fb776f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.661+0000 7f4fb776f9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:03:12.667 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.661+0000 7f4fb776f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:12.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.665+0000 7f4e6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:12.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.669+0000 7f4fb776f9c0 20 remove_watcher() i=0 2024-09-12T18:03:12.675 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.669+0000 7f4fb776f9c0 2 removed watcher, disabling cache 2024-09-12T18:03:12.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.673+0000 7f4fb776f9c0 20 remove_watcher() i=1 2024-09-12T18:03:12.679 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.673+0000 7f4fb776f9c0 20 remove_watcher() i=2 2024-09-12T18:03:12.681 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.677+0000 7f4fb776f9c0 20 remove_watcher() i=3 2024-09-12T18:03:12.683 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.677+0000 7f4fb776f9c0 20 remove_watcher() i=4 2024-09-12T18:03:12.685 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.681+0000 7f4fb776f9c0 20 remove_watcher() i=5 2024-09-12T18:03:12.686 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.681+0000 7f4fb776f9c0 20 remove_watcher() i=6 2024-09-12T18:03:12.688 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.681+0000 7f4fb776f9c0 20 remove_watcher() i=7 2024-09-12T18:03:12.704 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:03:12.705 INFO:tasks.workunit.client.0.smithi098.stderr:BUCKET_STATS: 2024-09-12T18:03:12.705 INFO:tasks.workunit.client.0.smithi098.stderr:bucket: myver id: a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T18:03:12.705 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:03:12.705 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-12T18:03:12.742 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:12.742 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:12.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.785+0000 7fcbcbeaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.789+0000 7fcbcbeaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.789+0000 7fcbcbeaf9c0 20 realm 2024-09-12T18:03:12.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.789+0000 7fcbcbeaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.789+0000 7fcbcbeaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.789+0000 7fcbcbeaf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:12.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.789+0000 7fcbcbeaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.789+0000 7fcbcbeaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.789+0000 7fcbcbeaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.793+0000 7fcbcbeaf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:12.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.793+0000 7fcbcbeaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.793+0000 7fcbcbeaf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:12.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.793+0000 7fcbcbeaf9c0 20 searching for the correct realm 2024-09-12T18:03:12.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.797+0000 7fcbca1b6640 0 -- 172.21.15.98:0/2025538819 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55cf761a42d0 msgr2=0x55cf761a66c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:12.808 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.805+0000 7fcbc91b4640 0 -- 172.21.15.98:0/2025538819 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fcbbc053070 msgr2=0x7fcbbc0429b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:03:12.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:12.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:12.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:12.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:12.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:12.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:12.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:12.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:12.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 20 zone default found 2024-09-12T18:03:12.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 4 Realm: () 2024-09-12T18:03:12.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:12.832 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:12.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:12.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 20 zonegroup default 2024-09-12T18:03:12.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.813+0000 7fcbcbeaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.817+0000 7fcbcbeaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.817+0000 7fcbcbeaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.817+0000 7fcbcbeaf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:12.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.817+0000 7fcbcbeaf9c0 20 started sync module instance, tier type = 2024-09-12T18:03:12.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.817+0000 7fcbcbeaf9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:12.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.837+0000 7fcbcbeaf9c0 20 add_watcher() i=0 2024-09-12T18:03:12.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.837+0000 7fcbcbeaf9c0 20 add_watcher() i=1 2024-09-12T18:03:12.840 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.837+0000 7fcbcbeaf9c0 20 add_watcher() i=2 2024-09-12T18:03:12.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.837+0000 7fcbcbeaf9c0 20 add_watcher() i=3 2024-09-12T18:03:12.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.837+0000 7fcbcbeaf9c0 20 add_watcher() i=4 2024-09-12T18:03:12.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.837+0000 7fcbcbeaf9c0 20 add_watcher() i=5 2024-09-12T18:03:12.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.837+0000 7fcbcbeaf9c0 20 add_watcher() i=6 2024-09-12T18:03:12.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.837+0000 7fcbcbeaf9c0 20 add_watcher() i=7 2024-09-12T18:03:12.841 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.837+0000 7fcbcbeaf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:12.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fca7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:12.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fcbcbeaf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:12.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fcbcbeaf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:12.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fcbcbeaf9c0 5 note: GC not initialized 2024-09-12T18:03:12.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fca7a7fc640 20 reqs_thread_entry: start 2024-09-12T18:03:12.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fcbcbeaf9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:12.845 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fcbcbeaf9c0 20 Filter name: none 2024-09-12T18:03:12.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fc9ebfff640 20 reqs_thread_entry: start 2024-09-12T18:03:12.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fcbcbeaf9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T18:03:12.846 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fcbcbeaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fcbcbeaf9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:03:12.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fcbcbeaf9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T18:03:12.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fcbcbeaf9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T18:03:12.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fcbcbeaf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 : miss 2024-09-12T18:03:12.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fcbcbeaf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:12.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fcbcbeaf9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:03:12.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fcbcbeaf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:12.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fcbcbeaf9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:12.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fcbcbeaf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:12.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fcbcbeaf9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:12.847 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.841+0000 7fcbcbeaf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 2024-09-12T18:03:12.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.853+0000 7fcbcbeaf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:12.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.853+0000 7fcbcbeaf9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:12.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.853+0000 7fcbcbeaf9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:12.858 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.853+0000 7fcbcbeaf9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18, ofs0, ns] 2024-09-12T18:03:12.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.853+0000 7fcaacff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366196 cookie 94349528076768 notifier 8748 bl.length()=821 2024-09-12T18:03:12.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.853+0000 7fcaacff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:12.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.853+0000 7fcaacff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:12.859 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.853+0000 7fcaacff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:12.860 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.857+0000 7fcbcbeaf9c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): orig_sources= new_sources= 2024-09-12T18:03:12.860 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.857+0000 7fcbcbeaf9c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): potential sources added=[] removed=[] 2024-09-12T18:03:12.860 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.857+0000 7fcbcbeaf9c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): orig_dests= new_dests= 2024-09-12T18:03:12.860 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.857+0000 7fcbcbeaf9c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): potential dests added=[] removed=[] 2024-09-12T18:03:12.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:12.865+0000 7fcbcbeaf9c0 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T18:03:13.710 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:13.710 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:13.864 INFO:tasks.workunit.client.0.smithi098.stderr:put object successful 2024-09-12T18:03:17.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.0 2024-09-12T18:03:17.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.0 2024-09-12T18:03:17.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.1 2024-09-12T18:03:17.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.1 2024-09-12T18:03:17.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.2 2024-09-12T18:03:17.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.2 2024-09-12T18:03:17.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.3 2024-09-12T18:03:17.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.3 2024-09-12T18:03:17.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.4 2024-09-12T18:03:17.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.4 2024-09-12T18:03:17.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.5 2024-09-12T18:03:17.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.5 2024-09-12T18:03:17.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.6 2024-09-12T18:03:17.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.6 2024-09-12T18:03:17.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.7 2024-09-12T18:03:17.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.7 2024-09-12T18:03:17.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.8 2024-09-12T18:03:17.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.8 2024-09-12T18:03:17.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.9 2024-09-12T18:03:17.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.9 2024-09-12T18:03:17.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.10 2024-09-12T18:03:17.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.10 2024-09-12T18:03:17.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.11 2024-09-12T18:03:17.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.11 2024-09-12T18:03:17.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.12 2024-09-12T18:03:17.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.12 2024-09-12T18:03:17.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.0 2024-09-12T18:03:17.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.865+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.0 2024-09-12T18:03:17.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.869+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.1 2024-09-12T18:03:17.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.869+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.1 2024-09-12T18:03:17.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.869+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.2 2024-09-12T18:03:17.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.869+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.2 2024-09-12T18:03:17.875 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.869+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.3 2024-09-12T18:03:17.876 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.869+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.3 2024-09-12T18:03:17.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.873+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.4 2024-09-12T18:03:17.877 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.873+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.4 2024-09-12T18:03:17.878 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.873+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.5 2024-09-12T18:03:17.879 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.873+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.5 2024-09-12T18:03:17.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.877+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.6 2024-09-12T18:03:17.880 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.877+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.6 2024-09-12T18:03:17.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.877+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.7 2024-09-12T18:03:17.881 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.877+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.7 2024-09-12T18:03:17.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.877+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.8 2024-09-12T18:03:17.883 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.877+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.8 2024-09-12T18:03:17.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.881+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.9 2024-09-12T18:03:17.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.881+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.9 2024-09-12T18:03:17.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.881+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.10 2024-09-12T18:03:17.885 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.881+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.10 2024-09-12T18:03:17.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.881+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.11 2024-09-12T18:03:17.887 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.881+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.11 2024-09-12T18:03:17.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.885+0000 7fcbcbeaf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:17.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.885+0000 7fcbcbeaf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 2024-09-12T18:03:17.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.889+0000 7fcbcbeaf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:17.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.889+0000 7fcbcbeaf9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:17.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.889+0000 7fcbcbeaf9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:17.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.889+0000 7fcbcbeaf9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18, ofs0, ns] 2024-09-12T18:03:17.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.889+0000 7fcaacff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366197 cookie 94349528076768 notifier 8748 bl.length()=821 2024-09-12T18:03:17.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.889+0000 7fcaacff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:17.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.889+0000 7fcaacff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:17.896 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.889+0000 7fcaacff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:17.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.897+0000 7fcbcbeaf9c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): orig_sources= new_sources= 2024-09-12T18:03:17.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.897+0000 7fcbcbeaf9c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): potential sources added=[] removed=[] 2024-09-12T18:03:17.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.897+0000 7fcbcbeaf9c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): orig_dests= new_dests= 2024-09-12T18:03:17.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.897+0000 7fcbcbeaf9c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): potential dests added=[] removed=[] 2024-09-12T18:03:17.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.901+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.0 2024-09-12T18:03:17.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.901+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.0 2024-09-12T18:03:17.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.901+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.1 2024-09-12T18:03:17.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.901+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.1 2024-09-12T18:03:17.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.905+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.2 2024-09-12T18:03:17.908 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.905+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.2 2024-09-12T18:03:17.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.905+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.3 2024-09-12T18:03:17.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.905+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.3 2024-09-12T18:03:17.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.905+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.4 2024-09-12T18:03:17.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.905+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.4 2024-09-12T18:03:17.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.905+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.5 2024-09-12T18:03:17.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.905+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.5 2024-09-12T18:03:17.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.909+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.6 2024-09-12T18:03:17.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.909+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.6 2024-09-12T18:03:17.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.909+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.7 2024-09-12T18:03:17.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.909+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.7 2024-09-12T18:03:17.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.909+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.8 2024-09-12T18:03:17.914 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.909+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.8 2024-09-12T18:03:17.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.909+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.9 2024-09-12T18:03:17.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.909+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.9 2024-09-12T18:03:17.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.913+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.10 2024-09-12T18:03:17.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.913+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.10 2024-09-12T18:03:17.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.913+0000 7fcbcbeaf9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.11 2024-09-12T18:03:17.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.913+0000 7fcbcbeaf9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.1.11 2024-09-12T18:03:17.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.917+0000 7fcbcbeaf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:17.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.917+0000 7fcbcbeaf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 2024-09-12T18:03:17.927 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.921+0000 7fcbcbeaf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:17.927 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.921+0000 7fcbcbeaf9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:17.927 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.921+0000 7fcbcbeaf9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:17.928 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.921+0000 7fcbcbeaf9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18, ofs0, ns] 2024-09-12T18:03:17.928 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.925+0000 7fcaacff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366198 cookie 94349528076768 notifier 8748 bl.length()=789 2024-09-12T18:03:17.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.925+0000 7fcaacff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:17.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.925+0000 7fcaacff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:17.929 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.925+0000 7fcaacff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:17.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.929+0000 7fcbcbeaf9c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): orig_sources= new_sources= 2024-09-12T18:03:17.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.929+0000 7fcbcbeaf9c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): potential sources added=[] removed=[] 2024-09-12T18:03:17.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.929+0000 7fcbcbeaf9c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): orig_dests= new_dests= 2024-09-12T18:03:17.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.929+0000 7fcbcbeaf9c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): potential dests added=[] removed=[] 2024-09-12T18:03:17.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.933+0000 7fcbcbeaf9c0 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-12T18:03:17.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.937+0000 7fca7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:17.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.945+0000 7fcbcbeaf9c0 20 remove_watcher() i=0 2024-09-12T18:03:17.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.945+0000 7fcbcbeaf9c0 2 removed watcher, disabling cache 2024-09-12T18:03:17.952 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.949+0000 7fcbcbeaf9c0 20 remove_watcher() i=1 2024-09-12T18:03:17.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.949+0000 7fcbcbeaf9c0 20 remove_watcher() i=2 2024-09-12T18:03:17.958 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.953+0000 7fcbcbeaf9c0 20 remove_watcher() i=3 2024-09-12T18:03:17.961 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.957+0000 7fcbcbeaf9c0 20 remove_watcher() i=4 2024-09-12T18:03:17.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.957+0000 7fcbcbeaf9c0 20 remove_watcher() i=5 2024-09-12T18:03:17.966 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.961+0000 7fcbcbeaf9c0 20 remove_watcher() i=6 2024-09-12T18:03:17.969 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:17.965+0000 7fcbcbeaf9c0 20 remove_watcher() i=7 2024-09-12T18:03:18.869 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T18:03:18.870 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T18:03:18.875 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:18.875 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:18.970 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:18.970 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:19.132 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:19.132 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:19.273 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:19.274 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:19.347 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:19.348 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:19.482 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:19.482 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:19.550 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:19.551 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:19.696 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:19.696 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:19.762 INFO:tasks.workunit.client.0.smithi098.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:03:20.212 INFO:tasks.workunit.client.0.smithi098.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T18:03:21.647 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:21.647 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:21.809 INFO:tasks.workunit.client.0.smithi098.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:03:21.810 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T18:03:21.845 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:21.845 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:21.891 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:21.885+0000 7f968011d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:21.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:21.889+0000 7f968011d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:21.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:21.889+0000 7f968011d9c0 20 realm 2024-09-12T18:03:21.892 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:21.889+0000 7f968011d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:21.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:21.889+0000 7f968011d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:21.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:21.889+0000 7f968011d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:21.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:21.889+0000 7f968011d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:21.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:21.889+0000 7f968011d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:21.893 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:21.889+0000 7f968011d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:21.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:21.889+0000 7f968011d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:21.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:21.889+0000 7f968011d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:21.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:21.889+0000 7f968011d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:21.895 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:21.889+0000 7f968011d9c0 20 searching for the correct realm 2024-09-12T18:03:21.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:21.893+0000 7f967d422640 0 -- 172.21.15.98:0/3892849156 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f96700f7aa0 msgr2=0x7f96700fd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:22.114 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.109+0000 7f967dc23640 0 -- 172.21.15.98:0/3892849156 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f966c003100 msgr2=0x7f96680368f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:03:22.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.325+0000 7f968011d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:22.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.325+0000 7f968011d9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:22.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.325+0000 7f968011d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:22.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.325+0000 7f968011d9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:22.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.325+0000 7f968011d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:22.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.325+0000 7f968011d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:22.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.325+0000 7f968011d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.325+0000 7f968011d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:22.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.325+0000 7f968011d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.332 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.329+0000 7f968011d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:22.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.329+0000 7f968011d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.329+0000 7f968011d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:22.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.329+0000 7f968011d9c0 20 zone default found 2024-09-12T18:03:22.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.329+0000 7f968011d9c0 4 Realm: () 2024-09-12T18:03:22.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.329+0000 7f968011d9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:22.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.329+0000 7f968011d9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:22.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.329+0000 7f968011d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:22.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.329+0000 7f968011d9c0 20 zonegroup default 2024-09-12T18:03:22.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.329+0000 7f968011d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.329+0000 7f968011d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:22.334 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.329+0000 7f968011d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.329+0000 7f968011d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:22.335 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.329+0000 7f968011d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.329+0000 7f968011d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:22.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.333+0000 7f968011d9c0 20 started sync module instance, tier type = 2024-09-12T18:03:22.336 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.333+0000 7f968011d9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:22.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.353+0000 7f968011d9c0 20 add_watcher() i=0 2024-09-12T18:03:22.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.353+0000 7f968011d9c0 20 add_watcher() i=1 2024-09-12T18:03:22.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.353+0000 7f968011d9c0 20 add_watcher() i=2 2024-09-12T18:03:22.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.353+0000 7f968011d9c0 20 add_watcher() i=3 2024-09-12T18:03:22.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.353+0000 7f968011d9c0 20 add_watcher() i=4 2024-09-12T18:03:22.359 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.353+0000 7f968011d9c0 20 add_watcher() i=5 2024-09-12T18:03:22.360 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.353+0000 7f968011d9c0 20 add_watcher() i=6 2024-09-12T18:03:22.361 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.357+0000 7f968011d9c0 20 add_watcher() i=7 2024-09-12T18:03:22.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.357+0000 7f968011d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:22.364 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.361+0000 7f952f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:22.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.361+0000 7f968011d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:22.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.361+0000 7f968011d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:22.365 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.361+0000 7f968011d9c0 5 note: GC not initialized 2024-09-12T18:03:22.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.361+0000 7f952e7fc640 20 reqs_thread_entry: start 2024-09-12T18:03:22.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.361+0000 7f968011d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:22.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.361+0000 7f968011d9c0 20 Filter name: none 2024-09-12T18:03:22.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.361+0000 7f949ffff640 20 reqs_thread_entry: start 2024-09-12T18:03:22.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.361+0000 7f968011d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.361+0000 7f968011d9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:03:22.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.361+0000 7f968011d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.361+0000 7f968011d9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:03:22.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.361+0000 7f968011d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:22.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.361+0000 7f968011d9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T18:03:22.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.361+0000 7f968011d9c0 20 INFO: main: starting shard=0 2024-09-12T18:03:22.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.361+0000 7f968011d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.0 2024-09-12T18:03:22.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.361+0000 7f968011d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.0 2024-09-12T18:03:22.369 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.365+0000 7f968011d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.369 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.365+0000 7f968011d9c0 20 INFO: main: starting shard=1 2024-09-12T18:03:22.369 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.365+0000 7f968011d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.1 2024-09-12T18:03:22.369 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.365+0000 7f968011d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.1 2024-09-12T18:03:22.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.365+0000 7f968011d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.365+0000 7f968011d9c0 20 INFO: main: starting shard=2 2024-09-12T18:03:22.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.365+0000 7f968011d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.2 2024-09-12T18:03:22.370 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.365+0000 7f968011d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.2 2024-09-12T18:03:22.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.365+0000 7f968011d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.365+0000 7f968011d9c0 20 INFO: main: starting shard=3 2024-09-12T18:03:22.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.365+0000 7f968011d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.3 2024-09-12T18:03:22.371 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.365+0000 7f968011d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.3 2024-09-12T18:03:22.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.369+0000 7f968011d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.369+0000 7f968011d9c0 20 INFO: main: starting shard=4 2024-09-12T18:03:22.372 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.369+0000 7f968011d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.4 2024-09-12T18:03:22.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.369+0000 7f968011d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.4 2024-09-12T18:03:22.373 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.369+0000 7f968011d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.374 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.369+0000 7f968011d9c0 20 INFO: main: starting shard=5 2024-09-12T18:03:22.374 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.369+0000 7f968011d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.5 2024-09-12T18:03:22.374 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.369+0000 7f968011d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.5 2024-09-12T18:03:22.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.369+0000 7f968011d9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:03:22.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.369+0000 7f968011d9c0 20 INFO: main: starting shard=6 2024-09-12T18:03:22.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.369+0000 7f968011d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.6 2024-09-12T18:03:22.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.369+0000 7f968011d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.6 2024-09-12T18:03:22.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.369+0000 7f968011d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.369+0000 7f968011d9c0 20 INFO: main: starting shard=7 2024-09-12T18:03:22.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.369+0000 7f968011d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.7 2024-09-12T18:03:22.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.369+0000 7f968011d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.7 2024-09-12T18:03:22.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.373+0000 7f968011d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.373+0000 7f968011d9c0 20 INFO: main: starting shard=8 2024-09-12T18:03:22.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.373+0000 7f968011d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.8 2024-09-12T18:03:22.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.373+0000 7f968011d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.8 2024-09-12T18:03:22.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.373+0000 7f968011d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.373+0000 7f968011d9c0 20 INFO: main: starting shard=9 2024-09-12T18:03:22.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.373+0000 7f968011d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.9 2024-09-12T18:03:22.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.373+0000 7f968011d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.9 2024-09-12T18:03:22.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.373+0000 7f968011d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.373+0000 7f968011d9c0 20 INFO: main: starting shard=10 2024-09-12T18:03:22.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.373+0000 7f968011d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.10 2024-09-12T18:03:22.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.373+0000 7f968011d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.10 2024-09-12T18:03:22.381 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.377+0000 7f968011d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.381 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.377+0000 7f968011d9c0 20 INFO: main: starting shard=11 2024-09-12T18:03:22.381 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.377+0000 7f968011d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.11 2024-09-12T18:03:22.381 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.377+0000 7f968011d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.11 2024-09-12T18:03:22.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.377+0000 7f968011d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.377+0000 7f968011d9c0 20 INFO: main: starting shard=12 2024-09-12T18:03:22.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.377+0000 7f968011d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.12 2024-09-12T18:03:22.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.377+0000 7f968011d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.12 2024-09-12T18:03:22.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.377+0000 7f968011d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.383 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.377+0000 7f968011d9c0 20 INFO: main: done 2024-09-12T18:03:22.385 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.381+0000 7f952f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:22.390 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.385+0000 7f968011d9c0 20 remove_watcher() i=0 2024-09-12T18:03:22.390 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.385+0000 7f968011d9c0 2 removed watcher, disabling cache 2024-09-12T18:03:22.392 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.389+0000 7f968011d9c0 20 remove_watcher() i=1 2024-09-12T18:03:22.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.389+0000 7f968011d9c0 20 remove_watcher() i=2 2024-09-12T18:03:22.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.393+0000 7f968011d9c0 20 remove_watcher() i=3 2024-09-12T18:03:22.399 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.393+0000 7f968011d9c0 20 remove_watcher() i=4 2024-09-12T18:03:22.400 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.397+0000 7f968011d9c0 20 remove_watcher() i=5 2024-09-12T18:03:22.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.397+0000 7f968011d9c0 20 remove_watcher() i=6 2024-09-12T18:03:22.403 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.397+0000 7f968011d9c0 20 remove_watcher() i=7 2024-09-12T18:03:22.419 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:22.419 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:22.446 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:22.446 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:22.577 INFO:tasks.workunit.client.0.smithi098.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:03:22.578 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T18:03:22.615 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:22.616 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:22.661 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.657+0000 7f280d6089c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.657+0000 7f280d6089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:22.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.657+0000 7f280d6089c0 20 realm 2024-09-12T18:03:22.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.657+0000 7f280d6089c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.657+0000 7f280d6089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:22.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.657+0000 7f280d6089c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:22.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.657+0000 7f280d6089c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.657+0000 7f280d6089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:22.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.657+0000 7f280d6089c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.661+0000 7f280d6089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:22.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.661+0000 7f280d6089c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.661+0000 7f280d6089c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:22.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.661+0000 7f280d6089c0 20 searching for the correct realm 2024-09-12T18:03:22.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.673+0000 7f280b90f640 0 -- 172.21.15.98:0/3517642476 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f2800074040 msgr2=0x7f2800066820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:22.894 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.889+0000 7f280b10e640 0 -- 172.21.15.98:0/3517642476 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x55a37affcf90 msgr2=0x55a37afff450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:22.902 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.897+0000 7f280d6089c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:22.902 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.897+0000 7f280d6089c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:22.902 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.897+0000 7f280d6089c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:22.902 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.897+0000 7f280d6089c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:22.902 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.897+0000 7f280d6089c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:22.902 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.897+0000 7f280d6089c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:22.902 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.897+0000 7f280d6089c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.903 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.897+0000 7f280d6089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:22.903 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.897+0000 7f280d6089c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.901+0000 7f280d6089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:22.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.901+0000 7f280d6089c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.901+0000 7f280d6089c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:22.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.901+0000 7f280d6089c0 20 zone default found 2024-09-12T18:03:22.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.901+0000 7f280d6089c0 4 Realm: () 2024-09-12T18:03:22.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.901+0000 7f280d6089c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:22.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.901+0000 7f280d6089c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:22.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.901+0000 7f280d6089c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:22.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.901+0000 7f280d6089c0 20 zonegroup default 2024-09-12T18:03:22.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.901+0000 7f280d6089c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.901+0000 7f280d6089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:22.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.901+0000 7f280d6089c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.901+0000 7f280d6089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:22.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.901+0000 7f280d6089c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.901+0000 7f280d6089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:22.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.901+0000 7f280d6089c0 20 started sync module instance, tier type = 2024-09-12T18:03:22.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.901+0000 7f280d6089c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:22.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.925+0000 7f280d6089c0 20 add_watcher() i=0 2024-09-12T18:03:22.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.925+0000 7f280d6089c0 20 add_watcher() i=1 2024-09-12T18:03:22.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.925+0000 7f280d6089c0 20 add_watcher() i=2 2024-09-12T18:03:22.931 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.925+0000 7f280d6089c0 20 add_watcher() i=3 2024-09-12T18:03:22.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.925+0000 7f280d6089c0 20 add_watcher() i=4 2024-09-12T18:03:22.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.925+0000 7f280d6089c0 20 add_watcher() i=5 2024-09-12T18:03:22.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.925+0000 7f280d6089c0 20 add_watcher() i=6 2024-09-12T18:03:22.934 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.929+0000 7f280d6089c0 20 add_watcher() i=7 2024-09-12T18:03:22.934 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.929+0000 7f280d6089c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:22.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.933+0000 7f26c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:22.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.933+0000 7f280d6089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:22.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.933+0000 7f280d6089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:22.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.933+0000 7f280d6089c0 5 note: GC not initialized 2024-09-12T18:03:22.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.933+0000 7f26c0fe1640 20 reqs_thread_entry: start 2024-09-12T18:03:22.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.933+0000 7f280d6089c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:22.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.937+0000 7f280d6089c0 20 Filter name: none 2024-09-12T18:03:22.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.937+0000 7f263a7fc640 20 reqs_thread_entry: start 2024-09-12T18:03:22.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.937+0000 7f280d6089c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.937+0000 7f280d6089c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:03:22.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.937+0000 7f280d6089c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:22.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.937+0000 7f280d6089c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:03:22.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.937+0000 7f280d6089c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:22.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.937+0000 7f280d6089c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T18:03:22.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.937+0000 7f280d6089c0 20 INFO: main: starting shard=0 2024-09-12T18:03:22.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.937+0000 7f280d6089c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.0 2024-09-12T18:03:22.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.937+0000 7f280d6089c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.0 2024-09-12T18:03:22.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.937+0000 7f280d6089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.937+0000 7f280d6089c0 20 INFO: main: starting shard=1 2024-09-12T18:03:22.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.937+0000 7f280d6089c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.1 2024-09-12T18:03:22.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.937+0000 7f280d6089c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.1 2024-09-12T18:03:22.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.941+0000 7f280d6089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.941+0000 7f280d6089c0 20 INFO: main: starting shard=2 2024-09-12T18:03:22.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.941+0000 7f280d6089c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.2 2024-09-12T18:03:22.945 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.941+0000 7f280d6089c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.2 2024-09-12T18:03:22.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.941+0000 7f280d6089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.941+0000 7f280d6089c0 20 INFO: main: starting shard=3 2024-09-12T18:03:22.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.941+0000 7f280d6089c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.3 2024-09-12T18:03:22.946 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.941+0000 7f280d6089c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.3 2024-09-12T18:03:22.947 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.941+0000 7f280d6089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.947 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.941+0000 7f280d6089c0 20 INFO: main: starting shard=4 2024-09-12T18:03:22.947 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.941+0000 7f280d6089c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.4 2024-09-12T18:03:22.947 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.941+0000 7f280d6089c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.4 2024-09-12T18:03:22.948 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.945+0000 7f280d6089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.945+0000 7f280d6089c0 20 INFO: main: starting shard=5 2024-09-12T18:03:22.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.945+0000 7f280d6089c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.5 2024-09-12T18:03:22.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.945+0000 7f280d6089c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.5 2024-09-12T18:03:22.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.945+0000 7f280d6089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.945+0000 7f280d6089c0 20 INFO: main: starting shard=6 2024-09-12T18:03:22.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.945+0000 7f280d6089c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.6 2024-09-12T18:03:22.949 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.945+0000 7f280d6089c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.6 2024-09-12T18:03:22.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.945+0000 7f280d6089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.945+0000 7f280d6089c0 20 INFO: main: starting shard=7 2024-09-12T18:03:22.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.945+0000 7f280d6089c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.7 2024-09-12T18:03:22.950 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.945+0000 7f280d6089c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.7 2024-09-12T18:03:22.951 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.945+0000 7f280d6089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.951 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.945+0000 7f280d6089c0 20 INFO: main: starting shard=8 2024-09-12T18:03:22.951 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.945+0000 7f280d6089c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.8 2024-09-12T18:03:22.951 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.945+0000 7f280d6089c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.8 2024-09-12T18:03:22.952 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.949+0000 7f280d6089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.952 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.949+0000 7f280d6089c0 20 INFO: main: starting shard=9 2024-09-12T18:03:22.952 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.949+0000 7f280d6089c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.9 2024-09-12T18:03:22.953 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.949+0000 7f280d6089c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.9 2024-09-12T18:03:22.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.949+0000 7f280d6089c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:03:22.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.949+0000 7f280d6089c0 20 INFO: main: starting shard=10 2024-09-12T18:03:22.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.949+0000 7f280d6089c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.10 2024-09-12T18:03:22.954 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.949+0000 7f280d6089c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.10 2024-09-12T18:03:22.955 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.949+0000 7f280d6089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.955 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.949+0000 7f280d6089c0 20 INFO: main: starting shard=11 2024-09-12T18:03:22.955 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.949+0000 7f280d6089c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.11 2024-09-12T18:03:22.955 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.949+0000 7f280d6089c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.11 2024-09-12T18:03:22.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.949+0000 7f280d6089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.949+0000 7f280d6089c0 20 INFO: main: starting shard=12 2024-09-12T18:03:22.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.949+0000 7f280d6089c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.12 2024-09-12T18:03:22.956 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.949+0000 7f280d6089c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.12 2024-09-12T18:03:22.957 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.953+0000 7f280d6089c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:22.957 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.953+0000 7f280d6089c0 20 INFO: main: done 2024-09-12T18:03:22.958 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.953+0000 7f26c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:22.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.957+0000 7f280d6089c0 20 remove_watcher() i=0 2024-09-12T18:03:22.963 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.957+0000 7f280d6089c0 2 removed watcher, disabling cache 2024-09-12T18:03:22.965 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.961+0000 7f280d6089c0 20 remove_watcher() i=1 2024-09-12T18:03:22.967 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.961+0000 7f280d6089c0 20 remove_watcher() i=2 2024-09-12T18:03:22.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.965+0000 7f280d6089c0 20 remove_watcher() i=3 2024-09-12T18:03:22.972 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.965+0000 7f280d6089c0 20 remove_watcher() i=4 2024-09-12T18:03:22.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.969+0000 7f280d6089c0 20 remove_watcher() i=5 2024-09-12T18:03:22.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.969+0000 7f280d6089c0 20 remove_watcher() i=6 2024-09-12T18:03:22.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:22.973+0000 7f280d6089c0 20 remove_watcher() i=7 2024-09-12T18:03:22.996 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:22.996 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:23.029 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:23.029 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:23.137 INFO:tasks.workunit.client.0.smithi098.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:03:23.137 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T18:03:23.172 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:23.172 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:23.216 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.213+0000 7f6f6a2709c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:23.218 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.213+0000 7f6f6a2709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:23.218 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.213+0000 7f6f6a2709c0 20 realm 2024-09-12T18:03:23.218 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.213+0000 7f6f6a2709c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:23.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.213+0000 7f6f6a2709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:23.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.213+0000 7f6f6a2709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:23.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.213+0000 7f6f6a2709c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:23.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.213+0000 7f6f6a2709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:23.219 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.213+0000 7f6f6a2709c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:23.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.217+0000 7f6f6a2709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:23.220 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.217+0000 7f6f6a2709c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:23.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.217+0000 7f6f6a2709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:23.221 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.217+0000 7f6f6a2709c0 20 searching for the correct realm 2024-09-12T18:03:23.227 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.221+0000 7f6f67575640 0 -- 172.21.15.98:0/2182615109 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f6f58029070 msgr2=0x7f6f5801c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:03:23.235 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.229+0000 7f6f67575640 0 -- 172.21.15.98:0/2182615109 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f6e30081210 msgr2=0x7f6e30083640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:23.242 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.237+0000 7f6f6a2709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:23.242 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.237+0000 7f6f6a2709c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:23.242 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.237+0000 7f6f6a2709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:23.242 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.237+0000 7f6f6a2709c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:23.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.237+0000 7f6f6a2709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:23.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.237+0000 7f6f6a2709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:23.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.237+0000 7f6f6a2709c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:23.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.237+0000 7f6f6a2709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:23.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.237+0000 7f6f6a2709c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:23.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.237+0000 7f6f6a2709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:23.243 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.237+0000 7f6f6a2709c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:23.244 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.237+0000 7f6f6a2709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:23.244 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.237+0000 7f6f6a2709c0 20 zone default found 2024-09-12T18:03:23.244 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.237+0000 7f6f6a2709c0 4 Realm: () 2024-09-12T18:03:23.244 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.237+0000 7f6f6a2709c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:23.244 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.237+0000 7f6f6a2709c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:23.244 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.237+0000 7f6f6a2709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:23.244 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.237+0000 7f6f6a2709c0 20 zonegroup default 2024-09-12T18:03:23.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.237+0000 7f6f6a2709c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:23.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.241+0000 7f6f6a2709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:23.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.241+0000 7f6f6a2709c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:23.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.241+0000 7f6f6a2709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:23.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.241+0000 7f6f6a2709c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:23.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.241+0000 7f6f6a2709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:23.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.241+0000 7f6f6a2709c0 20 started sync module instance, tier type = 2024-09-12T18:03:23.245 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.241+0000 7f6f6a2709c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:23.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.257+0000 7f6f6a2709c0 20 add_watcher() i=0 2024-09-12T18:03:23.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.257+0000 7f6f6a2709c0 20 add_watcher() i=1 2024-09-12T18:03:23.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.257+0000 7f6f6a2709c0 20 add_watcher() i=2 2024-09-12T18:03:23.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.257+0000 7f6f6a2709c0 20 add_watcher() i=3 2024-09-12T18:03:23.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.257+0000 7f6f6a2709c0 20 add_watcher() i=4 2024-09-12T18:03:23.260 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.257+0000 7f6f6a2709c0 20 add_watcher() i=5 2024-09-12T18:03:23.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.257+0000 7f6f6a2709c0 20 add_watcher() i=6 2024-09-12T18:03:23.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.257+0000 7f6f6a2709c0 20 add_watcher() i=7 2024-09-12T18:03:23.261 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.257+0000 7f6f6a2709c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:23.264 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.257+0000 7f6e1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:23.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.261+0000 7f6f6a2709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:23.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.261+0000 7f6f6a2709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:23.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.261+0000 7f6f6a2709c0 5 note: GC not initialized 2024-09-12T18:03:23.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.261+0000 7f6e1cfe1640 20 reqs_thread_entry: start 2024-09-12T18:03:23.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.261+0000 7f6f6a2709c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:23.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.261+0000 7f6f6a2709c0 20 Filter name: none 2024-09-12T18:03:23.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.261+0000 7f6d967fc640 20 reqs_thread_entry: start 2024-09-12T18:03:23.265 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.261+0000 7f6f6a2709c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:23.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.261+0000 7f6f6a2709c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:03:23.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.261+0000 7f6f6a2709c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:23.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.261+0000 7f6f6a2709c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:03:23.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.261+0000 7f6f6a2709c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:23.266 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.261+0000 7f6f6a2709c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T18:03:23.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.261+0000 7f6f6a2709c0 20 INFO: main: starting shard=0 2024-09-12T18:03:23.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.261+0000 7f6f6a2709c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.0 2024-09-12T18:03:23.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.261+0000 7f6f6a2709c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.0 2024-09-12T18:03:23.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.261+0000 7f6f6a2709c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:03:23.267 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.261+0000 7f6f6a2709c0 20 INFO: main: starting shard=1 2024-09-12T18:03:23.268 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.261+0000 7f6f6a2709c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.1 2024-09-12T18:03:23.268 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.261+0000 7f6f6a2709c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.1 2024-09-12T18:03:23.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.265+0000 7f6f6a2709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:23.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.265+0000 7f6f6a2709c0 20 INFO: main: starting shard=2 2024-09-12T18:03:23.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.265+0000 7f6f6a2709c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.2 2024-09-12T18:03:23.269 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.265+0000 7f6f6a2709c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.2 2024-09-12T18:03:23.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.265+0000 7f6f6a2709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:23.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.265+0000 7f6f6a2709c0 20 INFO: main: starting shard=3 2024-09-12T18:03:23.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.265+0000 7f6f6a2709c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.3 2024-09-12T18:03:23.270 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.265+0000 7f6f6a2709c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.3 2024-09-12T18:03:23.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.265+0000 7f6f6a2709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:23.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.265+0000 7f6f6a2709c0 20 INFO: main: starting shard=4 2024-09-12T18:03:23.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.265+0000 7f6f6a2709c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.4 2024-09-12T18:03:23.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.265+0000 7f6f6a2709c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.4 2024-09-12T18:03:23.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.269+0000 7f6f6a2709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:23.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.269+0000 7f6f6a2709c0 20 INFO: main: starting shard=5 2024-09-12T18:03:23.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.269+0000 7f6f6a2709c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.5 2024-09-12T18:03:23.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.269+0000 7f6f6a2709c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.5 2024-09-12T18:03:23.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.269+0000 7f6f6a2709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:23.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.269+0000 7f6f6a2709c0 20 INFO: main: starting shard=6 2024-09-12T18:03:23.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.269+0000 7f6f6a2709c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.6 2024-09-12T18:03:23.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.269+0000 7f6f6a2709c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.6 2024-09-12T18:03:23.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.269+0000 7f6f6a2709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:23.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.269+0000 7f6f6a2709c0 20 INFO: main: starting shard=7 2024-09-12T18:03:23.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.269+0000 7f6f6a2709c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.7 2024-09-12T18:03:23.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.269+0000 7f6f6a2709c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.7 2024-09-12T18:03:23.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.273+0000 7f6f6a2709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:23.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.273+0000 7f6f6a2709c0 20 INFO: main: starting shard=8 2024-09-12T18:03:23.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.273+0000 7f6f6a2709c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.8 2024-09-12T18:03:23.277 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.273+0000 7f6f6a2709c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.8 2024-09-12T18:03:23.278 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.273+0000 7f6f6a2709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:23.278 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.273+0000 7f6f6a2709c0 20 INFO: main: starting shard=9 2024-09-12T18:03:23.278 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.273+0000 7f6f6a2709c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.9 2024-09-12T18:03:23.278 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.273+0000 7f6f6a2709c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.9 2024-09-12T18:03:23.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.273+0000 7f6f6a2709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:23.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.273+0000 7f6f6a2709c0 20 INFO: main: starting shard=10 2024-09-12T18:03:23.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.273+0000 7f6f6a2709c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.10 2024-09-12T18:03:23.280 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.273+0000 7f6f6a2709c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.10 2024-09-12T18:03:23.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.277+0000 7f6f6a2709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:23.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.277+0000 7f6f6a2709c0 20 INFO: main: starting shard=11 2024-09-12T18:03:23.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.277+0000 7f6f6a2709c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.11 2024-09-12T18:03:23.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.277+0000 7f6f6a2709c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.11 2024-09-12T18:03:23.282 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.277+0000 7f6f6a2709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:23.282 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.277+0000 7f6f6a2709c0 20 INFO: main: starting shard=12 2024-09-12T18:03:23.282 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.277+0000 7f6f6a2709c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.12 2024-09-12T18:03:23.282 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.277+0000 7f6f6a2709c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.12 2024-09-12T18:03:23.283 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.277+0000 7f6f6a2709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:03:23.283 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.277+0000 7f6f6a2709c0 20 INFO: main: done 2024-09-12T18:03:23.284 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.277+0000 7f6e1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:23.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.285+0000 7f6f6a2709c0 20 remove_watcher() i=0 2024-09-12T18:03:23.289 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.285+0000 7f6f6a2709c0 2 removed watcher, disabling cache 2024-09-12T18:03:23.292 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.289+0000 7f6f6a2709c0 20 remove_watcher() i=1 2024-09-12T18:03:23.294 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.289+0000 7f6f6a2709c0 20 remove_watcher() i=2 2024-09-12T18:03:23.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.293+0000 7f6f6a2709c0 20 remove_watcher() i=3 2024-09-12T18:03:23.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.293+0000 7f6f6a2709c0 20 remove_watcher() i=4 2024-09-12T18:03:23.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.293+0000 7f6f6a2709c0 20 remove_watcher() i=5 2024-09-12T18:03:23.301 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.297+0000 7f6f6a2709c0 20 remove_watcher() i=6 2024-09-12T18:03:23.302 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:23.297+0000 7f6f6a2709c0 20 remove_watcher() i=7 2024-09-12T18:03:23.317 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:23.317 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:23.341 INFO:tasks.workunit.client.0.smithi098.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:03:23.773 INFO:tasks.workunit.client.0.smithi098.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T18:03:24.205 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T18:03:24.230 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:24.230 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:24.271 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.265+0000 7fc8f9bd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.269+0000 7fc8f9bd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:24.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.269+0000 7fc8f9bd79c0 20 realm 2024-09-12T18:03:24.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.269+0000 7fc8f9bd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.269+0000 7fc8f9bd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:24.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.269+0000 7fc8f9bd79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:24.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.269+0000 7fc8f9bd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.273 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.269+0000 7fc8f9bd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:24.274 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.269+0000 7fc8f9bd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.269+0000 7fc8f9bd79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:24.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.269+0000 7fc8f9bd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.269+0000 7fc8f9bd79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:24.276 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.269+0000 7fc8f9bd79c0 20 searching for the correct realm 2024-09-12T18:03:24.281 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.277+0000 7fc8f6edc640 0 -- 172.21.15.98:0/1843599756 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x5649796089c0 msgr2=0x56497960ae80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:24.286 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.281+0000 7fc8f76dd640 0 -- 172.21.15.98:0/1843599756 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fc8ec02d3d0 msgr2=0x7fc8ec02d810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:24.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.289+0000 7fc8f9bd79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:24.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.289+0000 7fc8f9bd79c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:24.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.289+0000 7fc8f9bd79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:24.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.289+0000 7fc8f9bd79c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:24.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.289+0000 7fc8f9bd79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:24.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.289+0000 7fc8f9bd79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:24.295 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.289+0000 7fc8f9bd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.289+0000 7fc8f9bd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:24.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.289+0000 7fc8f9bd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.293+0000 7fc8f9bd79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:24.296 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.293+0000 7fc8f9bd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.293+0000 7fc8f9bd79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:24.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.293+0000 7fc8f9bd79c0 20 zone default found 2024-09-12T18:03:24.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.293+0000 7fc8f9bd79c0 4 Realm: () 2024-09-12T18:03:24.297 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.293+0000 7fc8f9bd79c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:24.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.293+0000 7fc8f9bd79c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:24.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.293+0000 7fc8f9bd79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:24.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.293+0000 7fc8f9bd79c0 20 zonegroup default 2024-09-12T18:03:24.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.293+0000 7fc8f9bd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.293+0000 7fc8f9bd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:24.298 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.293+0000 7fc8f9bd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.293+0000 7fc8f9bd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:24.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.293+0000 7fc8f9bd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.293+0000 7fc8f9bd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:24.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.293+0000 7fc8f9bd79c0 20 started sync module instance, tier type = 2024-09-12T18:03:24.299 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.293+0000 7fc8f9bd79c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:24.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.309+0000 7fc8f9bd79c0 20 add_watcher() i=0 2024-09-12T18:03:24.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.309+0000 7fc8f9bd79c0 20 add_watcher() i=1 2024-09-12T18:03:24.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.309+0000 7fc8f9bd79c0 20 add_watcher() i=2 2024-09-12T18:03:24.314 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.309+0000 7fc8f9bd79c0 20 add_watcher() i=3 2024-09-12T18:03:24.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.309+0000 7fc8f9bd79c0 20 add_watcher() i=4 2024-09-12T18:03:24.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.309+0000 7fc8f9bd79c0 20 add_watcher() i=5 2024-09-12T18:03:24.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.309+0000 7fc8f9bd79c0 20 add_watcher() i=6 2024-09-12T18:03:24.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.309+0000 7fc8f9bd79c0 20 add_watcher() i=7 2024-09-12T18:03:24.315 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.309+0000 7fc8f9bd79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:24.318 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.313+0000 7fc7adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:24.318 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.313+0000 7fc8f9bd79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:24.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.313+0000 7fc8f9bd79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:24.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.313+0000 7fc8f9bd79c0 5 note: GC not initialized 2024-09-12T18:03:24.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.313+0000 7fc7acfe1640 20 reqs_thread_entry: start 2024-09-12T18:03:24.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.313+0000 7fc8f9bd79c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:24.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.313+0000 7fc8f9bd79c0 20 Filter name: none 2024-09-12T18:03:24.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.313+0000 7fc7267fc640 20 reqs_thread_entry: start 2024-09-12T18:03:24.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.313+0000 7fc8f9bd79c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T18:03:24.319 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.313+0000 7fc8f9bd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.313+0000 7fc8f9bd79c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:03:24.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.313+0000 7fc8f9bd79c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T18:03:24.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.313+0000 7fc8f9bd79c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T18:03:24.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.313+0000 7fc8f9bd79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 : miss 2024-09-12T18:03:24.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.313+0000 7fc8f9bd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.317+0000 7fc8f9bd79c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:03:24.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.317+0000 7fc8f9bd79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:24.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.317+0000 7fc8f9bd79c0 10 adding default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:24.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.317+0000 7fc8f9bd79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:24.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.317+0000 7fc8f9bd79c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:24.321 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.317+0000 7fc8f9bd79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 2024-09-12T18:03:24.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.325+0000 7fc8f9bd79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:24.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.325+0000 7fc8f9bd79c0 10 moving default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:24.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.325+0000 7fc8f9bd79c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:24.330 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.325+0000 7fc8f9bd79c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18, ofs0, ns] 2024-09-12T18:03:24.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.325+0000 7fc7daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366199 cookie 94873568989632 notifier 8123 bl.length()=821 2024-09-12T18:03:24.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.325+0000 7fc7daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:24.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.325+0000 7fc7daffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:24.331 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.325+0000 7fc7daffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:24.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.329+0000 7fc8f9bd79c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): orig_sources= new_sources= 2024-09-12T18:03:24.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.329+0000 7fc8f9bd79c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): potential sources added=[] removed=[] 2024-09-12T18:03:24.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.329+0000 7fc8f9bd79c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): orig_dests= new_dests= 2024-09-12T18:03:24.333 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.329+0000 7fc8f9bd79c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): potential dests added=[] removed=[] 2024-09-12T18:03:24.343 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.0 2024-09-12T18:03:24.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.0 2024-09-12T18:03:24.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.1 2024-09-12T18:03:24.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.1 2024-09-12T18:03:24.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.2 2024-09-12T18:03:24.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.2 2024-09-12T18:03:24.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.3 2024-09-12T18:03:24.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.3 2024-09-12T18:03:24.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.4 2024-09-12T18:03:24.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.4 2024-09-12T18:03:24.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.5 2024-09-12T18:03:24.344 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.5 2024-09-12T18:03:24.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.6 2024-09-12T18:03:24.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.6 2024-09-12T18:03:24.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.7 2024-09-12T18:03:24.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.7 2024-09-12T18:03:24.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.8 2024-09-12T18:03:24.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.8 2024-09-12T18:03:24.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:24.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:24.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.10 2024-09-12T18:03:24.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.10 2024-09-12T18:03:24.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.11 2024-09-12T18:03:24.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.11 2024-09-12T18:03:24.345 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.12 2024-09-12T18:03:24.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.12 2024-09-12T18:03:24.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.13 2024-09-12T18:03:24.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.13 2024-09-12T18:03:24.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.14 2024-09-12T18:03:24.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.14 2024-09-12T18:03:24.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.15 2024-09-12T18:03:24.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.15 2024-09-12T18:03:24.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.16 2024-09-12T18:03:24.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.16 2024-09-12T18:03:24.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.0 2024-09-12T18:03:24.346 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.337+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.0 2024-09-12T18:03:24.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.341+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.1 2024-09-12T18:03:24.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.341+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.1 2024-09-12T18:03:24.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.341+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.2 2024-09-12T18:03:24.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.341+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.2 2024-09-12T18:03:24.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.341+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.3 2024-09-12T18:03:24.347 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.341+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.3 2024-09-12T18:03:24.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.341+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.4 2024-09-12T18:03:24.348 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.341+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.4 2024-09-12T18:03:24.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.345+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.5 2024-09-12T18:03:24.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.345+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.5 2024-09-12T18:03:24.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.345+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.6 2024-09-12T18:03:24.349 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.345+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.6 2024-09-12T18:03:24.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.345+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.7 2024-09-12T18:03:24.350 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.345+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.7 2024-09-12T18:03:24.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.345+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.8 2024-09-12T18:03:24.351 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.345+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.8 2024-09-12T18:03:24.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.349+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.9 2024-09-12T18:03:24.353 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.349+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.9 2024-09-12T18:03:24.355 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.349+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.10 2024-09-12T18:03:24.355 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.349+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.10 2024-09-12T18:03:24.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.353+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.11 2024-09-12T18:03:24.357 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.353+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.11 2024-09-12T18:03:24.358 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.353+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.12 2024-09-12T18:03:24.358 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.353+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.12 2024-09-12T18:03:24.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.357+0000 7fc8f9bd79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:24.363 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.357+0000 7fc8f9bd79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 2024-09-12T18:03:24.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.361+0000 7fc8f9bd79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:24.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.361+0000 7fc8f9bd79c0 10 moving default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:24.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.361+0000 7fc8f9bd79c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:24.366 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.361+0000 7fc8f9bd79c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18, ofs0, ns] 2024-09-12T18:03:24.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.361+0000 7fc7daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366200 cookie 94873568989632 notifier 8123 bl.length()=821 2024-09-12T18:03:24.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.361+0000 7fc7daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:24.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.361+0000 7fc7daffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:24.367 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.361+0000 7fc7daffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:24.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.365+0000 7fc8f9bd79c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): orig_sources= new_sources= 2024-09-12T18:03:24.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.365+0000 7fc8f9bd79c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): potential sources added=[] removed=[] 2024-09-12T18:03:24.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.365+0000 7fc8f9bd79c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): orig_dests= new_dests= 2024-09-12T18:03:24.368 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.365+0000 7fc8f9bd79c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): potential dests added=[] removed=[] 2024-09-12T18:03:24.374 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.369+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.0 2024-09-12T18:03:24.374 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.369+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.0 2024-09-12T18:03:24.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.369+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.1 2024-09-12T18:03:24.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.369+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.1 2024-09-12T18:03:24.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.369+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.2 2024-09-12T18:03:24.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.369+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.2 2024-09-12T18:03:24.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.373+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.3 2024-09-12T18:03:24.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.373+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.3 2024-09-12T18:03:24.376 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.373+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.4 2024-09-12T18:03:24.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.373+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.4 2024-09-12T18:03:24.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.373+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.5 2024-09-12T18:03:24.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.373+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.5 2024-09-12T18:03:24.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.373+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.6 2024-09-12T18:03:24.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.373+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.6 2024-09-12T18:03:24.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.373+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.7 2024-09-12T18:03:24.378 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.373+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.7 2024-09-12T18:03:24.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.373+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.8 2024-09-12T18:03:24.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.373+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.8 2024-09-12T18:03:24.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.373+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.9 2024-09-12T18:03:24.379 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.373+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.9 2024-09-12T18:03:24.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.377+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.10 2024-09-12T18:03:24.380 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.377+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.10 2024-09-12T18:03:24.381 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.377+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.11 2024-09-12T18:03:24.381 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.377+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.11 2024-09-12T18:03:24.381 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.377+0000 7fc8f9bd79c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.12 2024-09-12T18:03:24.381 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.377+0000 7fc8f9bd79c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.2.12 2024-09-12T18:03:24.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.377+0000 7fc8f9bd79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:03:24.382 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.377+0000 7fc8f9bd79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 2024-09-12T18:03:24.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.381+0000 7fc8f9bd79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:24.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.381+0000 7fc8f9bd79c0 10 moving default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:24.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.381+0000 7fc8f9bd79c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:24.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.381+0000 7fc8f9bd79c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18, ofs0, ns] 2024-09-12T18:03:24.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.381+0000 7fc7daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366201 cookie 94873568989632 notifier 8123 bl.length()=789 2024-09-12T18:03:24.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.381+0000 7fc7daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:24.386 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.381+0000 7fc7daffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:24.387 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.381+0000 7fc7daffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:24.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.385+0000 7fc8f9bd79c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): orig_sources= new_sources= 2024-09-12T18:03:24.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.385+0000 7fc8f9bd79c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): potential sources added=[] removed=[] 2024-09-12T18:03:24.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.385+0000 7fc8f9bd79c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): orig_dests= new_dests= 2024-09-12T18:03:24.388 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.385+0000 7fc8f9bd79c0 20 handle_bi_update(): bucket=:myver[a01e4849-e968-46ce-97f1-a673c26b3735.4529.18]): potential dests added=[] removed=[] 2024-09-12T18:03:24.394 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.389+0000 7fc8f9bd79c0 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-12T18:03:24.397 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.393+0000 7fc7adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:24.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.397+0000 7fc8f9bd79c0 20 remove_watcher() i=0 2024-09-12T18:03:24.402 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.397+0000 7fc8f9bd79c0 2 removed watcher, disabling cache 2024-09-12T18:03:24.404 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.401+0000 7fc8f9bd79c0 20 remove_watcher() i=1 2024-09-12T18:03:24.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.401+0000 7fc8f9bd79c0 20 remove_watcher() i=2 2024-09-12T18:03:24.409 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.405+0000 7fc8f9bd79c0 20 remove_watcher() i=3 2024-09-12T18:03:24.410 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.405+0000 7fc8f9bd79c0 20 remove_watcher() i=4 2024-09-12T18:03:24.411 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.405+0000 7fc8f9bd79c0 20 remove_watcher() i=5 2024-09-12T18:03:24.413 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.409+0000 7fc8f9bd79c0 20 remove_watcher() i=6 2024-09-12T18:03:24.414 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.409+0000 7fc8f9bd79c0 20 remove_watcher() i=7 2024-09-12T18:03:24.427 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T18:03:24.457 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:24.457 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:24.498 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.493+0000 7fd27851d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.497+0000 7fd27851d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:24.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.497+0000 7fd27851d9c0 20 realm 2024-09-12T18:03:24.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.497+0000 7fd27851d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.497+0000 7fd27851d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:24.500 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.497+0000 7fd27851d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:24.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.497+0000 7fd27851d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.497+0000 7fd27851d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:24.501 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.497+0000 7fd27851d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.497+0000 7fd27851d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:24.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.497+0000 7fd27851d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.497+0000 7fd27851d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:24.502 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.497+0000 7fd27851d9c0 20 searching for the correct realm 2024-09-12T18:03:24.506 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.501+0000 7fd275822640 0 -- 172.21.15.98:0/3245994869 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fd2680636e0 msgr2=0x7fd26801e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:03:24.721 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.717+0000 7fd276023640 0 -- 172.21.15.98:0/3245994869 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fd26c0fbbf0 msgr2=0x7fd26c104040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:24.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.933+0000 7fd27851d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:24.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.933+0000 7fd27851d9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:24.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.933+0000 7fd27851d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:24.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.933+0000 7fd27851d9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:24.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.933+0000 7fd27851d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:24.939 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.933+0000 7fd27851d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:24.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.933+0000 7fd27851d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.933+0000 7fd27851d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:24.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.933+0000 7fd27851d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.937+0000 7fd27851d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:24.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.937+0000 7fd27851d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.937+0000 7fd27851d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:24.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.937+0000 7fd27851d9c0 20 zone default found 2024-09-12T18:03:24.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.937+0000 7fd27851d9c0 4 Realm: () 2024-09-12T18:03:24.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.937+0000 7fd27851d9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:24.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.937+0000 7fd27851d9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:24.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.937+0000 7fd27851d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:24.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.937+0000 7fd27851d9c0 20 zonegroup default 2024-09-12T18:03:24.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.937+0000 7fd27851d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.937+0000 7fd27851d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:24.942 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.937+0000 7fd27851d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.937+0000 7fd27851d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:24.943 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.937+0000 7fd27851d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.937+0000 7fd27851d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:24.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.937+0000 7fd27851d9c0 20 started sync module instance, tier type = 2024-09-12T18:03:24.944 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.937+0000 7fd27851d9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:24.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.965+0000 7fd27851d9c0 20 add_watcher() i=0 2024-09-12T18:03:24.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.965+0000 7fd27851d9c0 20 add_watcher() i=1 2024-09-12T18:03:24.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.965+0000 7fd27851d9c0 20 add_watcher() i=2 2024-09-12T18:03:24.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.965+0000 7fd27851d9c0 20 add_watcher() i=3 2024-09-12T18:03:24.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.965+0000 7fd27851d9c0 20 add_watcher() i=4 2024-09-12T18:03:24.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.965+0000 7fd27851d9c0 20 add_watcher() i=5 2024-09-12T18:03:24.968 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.965+0000 7fd27851d9c0 20 add_watcher() i=6 2024-09-12T18:03:24.970 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.965+0000 7fd27851d9c0 20 add_watcher() i=7 2024-09-12T18:03:24.971 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.965+0000 7fd27851d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:24.975 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.969+0000 7fd12cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:24.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.969+0000 7fd27851d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:24.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.969+0000 7fd27851d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:24.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.969+0000 7fd27851d9c0 5 note: GC not initialized 2024-09-12T18:03:24.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.973+0000 7fd0a77fe640 20 reqs_thread_entry: start 2024-09-12T18:03:24.976 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.973+0000 7fd27851d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:24.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.973+0000 7fd27851d9c0 20 Filter name: none 2024-09-12T18:03:24.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.973+0000 7fd0a57fa640 20 reqs_thread_entry: start 2024-09-12T18:03:24.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.973+0000 7fd27851d9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T18:03:24.977 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.973+0000 7fd27851d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.973+0000 7fd27851d9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:03:24.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.973+0000 7fd27851d9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T18:03:24.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.973+0000 7fd27851d9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T18:03:24.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.973+0000 7fd27851d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 : miss 2024-09-12T18:03:24.978 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.973+0000 7fd27851d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:24.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.973+0000 7fd27851d9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:03:24.979 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.973+0000 7fd27851d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 info.flags=0x17 2024-09-12T18:03:24.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.973+0000 7fd27851d9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 to cache LRU end 2024-09-12T18:03:24.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.973+0000 7fd27851d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:03:24.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.973+0000 7fd27851d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:03:24.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.973+0000 7fd27851d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18 2024-09-12T18:03:24.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.973+0000 7fd27851d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.0 2024-09-12T18:03:24.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.973+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.0 2024-09-12T18:03:24.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.977+0000 7fd27851d9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T18:03:24.980 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.977+0000 7fd27851d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.1 2024-09-12T18:03:24.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.977+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.1 2024-09-12T18:03:24.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.977+0000 7fd27851d9c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T18:03:24.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.977+0000 7fd27851d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.2 2024-09-12T18:03:24.981 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.977+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.2 2024-09-12T18:03:24.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.977+0000 7fd27851d9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T18:03:24.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.977+0000 7fd27851d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.3 2024-09-12T18:03:24.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.977+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.3 2024-09-12T18:03:24.982 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.977+0000 7fd27851d9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T18:03:24.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.977+0000 7fd27851d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.4 2024-09-12T18:03:24.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.977+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.4 2024-09-12T18:03:24.983 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.977+0000 7fd27851d9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T18:03:24.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.977+0000 7fd27851d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.5 2024-09-12T18:03:24.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.977+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.5 2024-09-12T18:03:24.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.981+0000 7fd27851d9c0 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T18:03:24.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.981+0000 7fd27851d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.6 2024-09-12T18:03:24.984 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.981+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.6 2024-09-12T18:03:24.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.981+0000 7fd27851d9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T18:03:24.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.981+0000 7fd27851d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.7 2024-09-12T18:03:24.985 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.981+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.7 2024-09-12T18:03:24.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.981+0000 7fd27851d9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T18:03:24.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.981+0000 7fd27851d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.8 2024-09-12T18:03:24.986 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.981+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.8 2024-09-12T18:03:24.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.981+0000 7fd27851d9c0 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T18:03:24.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.981+0000 7fd27851d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:24.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.981+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:24.988 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.985+0000 7fd27851d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.10 2024-09-12T18:03:24.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.985+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.10 2024-09-12T18:03:24.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.985+0000 7fd27851d9c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T18:03:24.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.985+0000 7fd27851d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.11 2024-09-12T18:03:24.989 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.985+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.11 2024-09-12T18:03:24.990 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.985+0000 7fd27851d9c0 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T18:03:24.990 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.985+0000 7fd27851d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.12 2024-09-12T18:03:24.990 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.985+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.12 2024-09-12T18:03:24.991 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.985+0000 7fd27851d9c0 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T18:03:24.991 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.985+0000 7fd27851d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.13 2024-09-12T18:03:24.991 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.985+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.13 2024-09-12T18:03:24.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.985+0000 7fd27851d9c0 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T18:03:24.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.989+0000 7fd27851d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.14 2024-09-12T18:03:24.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.989+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.14 2024-09-12T18:03:24.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.989+0000 7fd27851d9c0 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T18:03:24.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.989+0000 7fd27851d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.15 2024-09-12T18:03:24.992 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.989+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.15 2024-09-12T18:03:24.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.989+0000 7fd27851d9c0 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T18:03:24.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.989+0000 7fd27851d9c0 10 bucket_obj is .dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.16 2024-09-12T18:03:24.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.989+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.16 2024-09-12T18:03:24.993 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.989+0000 7fd27851d9c0 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T18:03:24.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.989+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:24.994 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.989+0000 7fd27851d9c0 20 get_obj_state: octx=0x55cdc0c973b0 obj=myver:x state=0x55cdc0fde9f8 s->prefetch_data=0 2024-09-12T18:03:24.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.989+0000 7fd27851d9c0 20 get_obj_state: setting s->obj_tag to ukok7f6mltv6obvapyi6gwq0uey3wu0y 2024-09-12T18:03:24.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.989+0000 7fd27851d9c0 20 get_obj_state_impl: setting s->olh_tag to ejewyn7m8rbh2jre2qgcdyg3sjez3x82 2024-09-12T18:03:24.995 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.989+0000 7fd27851d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ejewyn7m8rbh2jre2qgcdyg3sjez3x82 2024-09-12T18:03:24.998 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.993+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:25.000 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.997+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:25.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.997+0000 7fd27851d9c0 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T18:03:25.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.997+0000 7fd27851d9c0 20 olh_log_entry: epoch=2 op=3 key=x[GxmepmhDGUaVpNnLb3lslzxreWoJjLN] 2024-09-12T18:03:25.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.997+0000 7fd27851d9c0 20 get_obj_state: octx=0x55cdc0c973b0 obj=myver:_:GxmepmhDGUaVpNnLb3lslzxreWoJjLN_x state=0x55cdc10076a8 s->prefetch_data=0 2024-09-12T18:03:25.001 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.997+0000 7fd27851d9c0 10 manifest: total_size = 22 2024-09-12T18:03:25.002 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.997+0000 7fd27851d9c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.6743249531391236368 2024-09-12T18:03:25.002 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.997+0000 7fd27851d9c0 20 get_obj_state: octx=0x55cdc0c973b0 obj=myver:_:GxmepmhDGUaVpNnLb3lslzxreWoJjLN_x state=0x55cdc10076a8 s->prefetch_data=0 2024-09-12T18:03:25.002 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.997+0000 7fd27851d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55cdc10076a8 2024-09-12T18:03:25.002 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:24.997+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:25.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.001+0000 7fd27851d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:03:25.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.001+0000 7fd27851d9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T18:03:25.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.001+0000 7fd27851d9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T18:03:25.006 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.001+0000 7fd27851d9c0 5 delete_objs_inline: removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18__shadow:GxmepmhDGUaVpNnLb3lslzxreWoJjLN_.0Et7yYTjdOKpvfXm39MGwJOakLxbTX__0 2024-09-12T18:03:25.008 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.005+0000 7fd159ffb640 20 handle_completion(): completion ok for obj=x[GxmepmhDGUaVpNnLb3lslzxreWoJjLN] 2024-09-12T18:03:25.009 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.005+0000 7fd27851d9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:03:25.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.009+0000 7fd27851d9c0 20 get_obj_state: octx=0x55cdc0c973b0 obj=myver:x state=0x55cdc0fde9f8 s->prefetch_data=0 2024-09-12T18:03:25.012 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.009+0000 7fd27851d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ejewyn7m8rbh2jre2qgcdyg3sjez3x82 2024-09-12T18:03:25.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.013+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:25.021 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.017+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:25.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.017+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:25.022 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.017+0000 7fd27851d9c0 20 get_obj_state: octx=0x55cdc0c973b0 obj=myver:y state=0x55cdc10076a8 s->prefetch_data=0 2024-09-12T18:03:25.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.017+0000 7fd27851d9c0 20 get_obj_state: setting s->obj_tag to nzrg6tc0twag8wq9tyw64c2vvgjut5um 2024-09-12T18:03:25.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.017+0000 7fd27851d9c0 20 get_obj_state_impl: setting s->olh_tag to az5nr7n1dcqrjvc7zfktlj5blbydnf38 2024-09-12T18:03:25.023 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.017+0000 7fd27851d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=az5nr7n1dcqrjvc7zfktlj5blbydnf38 2024-09-12T18:03:25.025 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.021+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:25.027 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.021+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:25.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.025+0000 7fd27851d9c0 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T18:03:25.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.025+0000 7fd27851d9c0 20 olh_log_entry: epoch=2 op=3 key=y[rnmUhsBV.ZCGp6qYtUMzJbjv6mzLvV0] 2024-09-12T18:03:25.028 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.025+0000 7fd27851d9c0 20 get_obj_state: octx=0x55cdc0c973b0 obj=myver:_:rnmUhsBV.ZCGp6qYtUMzJbjv6mzLvV0_y state=0x55cdc0fd6918 s->prefetch_data=0 2024-09-12T18:03:25.029 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.025+0000 7fd27851d9c0 10 manifest: total_size = 22 2024-09-12T18:03:25.029 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.025+0000 7fd27851d9c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.9927169974486704363 2024-09-12T18:03:25.029 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.025+0000 7fd27851d9c0 20 get_obj_state: octx=0x55cdc0c973b0 obj=myver:_:rnmUhsBV.ZCGp6qYtUMzJbjv6mzLvV0_y state=0x55cdc0fd6918 s->prefetch_data=0 2024-09-12T18:03:25.029 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.025+0000 7fd27851d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55cdc0fd6918 2024-09-12T18:03:25.029 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.025+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:25.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.029+0000 7fd27851d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:03:25.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.029+0000 7fd27851d9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T18:03:25.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.029+0000 7fd27851d9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T18:03:25.033 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.029+0000 7fd27851d9c0 5 delete_objs_inline: removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18__shadow:rnmUhsBV.ZCGp6qYtUMzJbjv6mzLvV0_.otCCHtJuwZ3wvOmcPXhbX5kou46_Yvl_0 2024-09-12T18:03:25.034 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.029+0000 7fd159ffb640 20 handle_completion(): completion ok for obj=y[rnmUhsBV.ZCGp6qYtUMzJbjv6mzLvV0] 2024-09-12T18:03:25.036 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.033+0000 7fd27851d9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:03:25.038 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.033+0000 7fd27851d9c0 20 get_obj_state: octx=0x55cdc0c973b0 obj=myver:y state=0x55cdc10076a8 s->prefetch_data=0 2024-09-12T18:03:25.039 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.033+0000 7fd27851d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=az5nr7n1dcqrjvc7zfktlj5blbydnf38 2024-09-12T18:03:25.044 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.037+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:25.045 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.041+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:25.046 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.041+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:25.046 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.041+0000 7fd27851d9c0 20 get_obj_state: octx=0x55cdc0c973b0 obj=myver:z state=0x55cdc10076a8 s->prefetch_data=0 2024-09-12T18:03:25.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.041+0000 7fd27851d9c0 20 get_obj_state: setting s->obj_tag to tqvnk3rdt55gk1l3kwzz5w1vcd5h4qiy 2024-09-12T18:03:25.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.041+0000 7fd27851d9c0 20 get_obj_state_impl: setting s->olh_tag to drdb0r1qrspm3enkx5en24vd9febzmw1 2024-09-12T18:03:25.047 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.041+0000 7fd27851d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=drdb0r1qrspm3enkx5en24vd9febzmw1 2024-09-12T18:03:25.049 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.045+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:25.051 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.045+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:25.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.045+0000 7fd27851d9c0 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T18:03:25.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.045+0000 7fd27851d9c0 20 olh_log_entry: epoch=2 op=3 key=z[97RBMV-xnDEQQqphkSOdR6jPOPaCfaL] 2024-09-12T18:03:25.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.045+0000 7fd27851d9c0 20 get_obj_state: octx=0x55cdc0c973b0 obj=myver:_:97RBMV-xnDEQQqphkSOdR6jPOPaCfaL_z state=0x55cdc0fd6918 s->prefetch_data=0 2024-09-12T18:03:25.052 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.049+0000 7fd27851d9c0 10 manifest: total_size = 11 2024-09-12T18:03:25.053 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.049+0000 7fd27851d9c0 20 get_obj_state: setting s->obj_tag to a01e4849-e968-46ce-97f1-a673c26b3735.4529.17641603399244276124 2024-09-12T18:03:25.053 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.049+0000 7fd27851d9c0 20 get_obj_state: octx=0x55cdc0c973b0 obj=myver:_:97RBMV-xnDEQQqphkSOdR6jPOPaCfaL_z state=0x55cdc0fd6918 s->prefetch_data=0 2024-09-12T18:03:25.053 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.049+0000 7fd27851d9c0 20 prepare_atomic_modification: state is not atomic. state=0x55cdc0fd6918 2024-09-12T18:03:25.053 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.049+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:25.056 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.053+0000 7fd27851d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:03:25.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.053+0000 7fd27851d9c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T18:03:25.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.053+0000 7fd27851d9c0 0 deleting objects inline since gc isn't initialized 2024-09-12T18:03:25.057 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.053+0000 7fd27851d9c0 5 delete_objs_inline: removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18__shadow:97RBMV-xnDEQQqphkSOdR6jPOPaCfaL_.X0rbuLd_zQf-conPK6kKpZB7dvKT4W7_0 2024-09-12T18:03:25.058 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.053+0000 7fd159ffb640 20 handle_completion(): completion ok for obj=z[97RBMV-xnDEQQqphkSOdR6jPOPaCfaL] 2024-09-12T18:03:25.060 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.053+0000 7fd27851d9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:03:25.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.057+0000 7fd27851d9c0 20 get_obj_state: octx=0x55cdc0c973b0 obj=myver:z state=0x55cdc10076a8 s->prefetch_data=0 2024-09-12T18:03:25.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.057+0000 7fd27851d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=drdb0r1qrspm3enkx5en24vd9febzmw1 2024-09-12T18:03:25.067 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.061+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:25.069 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.065+0000 7fd27851d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.18.3.9 2024-09-12T18:03:25.069 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.065+0000 7fd27851d9c0 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T18:03:25.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.065+0000 7fd27851d9c0 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T18:03:25.070 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.065+0000 7fd12cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:25.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.069+0000 7fd27851d9c0 20 remove_watcher() i=0 2024-09-12T18:03:25.075 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.069+0000 7fd27851d9c0 2 removed watcher, disabling cache 2024-09-12T18:03:25.077 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.073+0000 7fd27851d9c0 20 remove_watcher() i=1 2024-09-12T18:03:25.079 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.073+0000 7fd27851d9c0 20 remove_watcher() i=2 2024-09-12T18:03:25.081 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.077+0000 7fd27851d9c0 20 remove_watcher() i=3 2024-09-12T18:03:25.084 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.081+0000 7fd27851d9c0 20 remove_watcher() i=4 2024-09-12T18:03:25.086 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.081+0000 7fd27851d9c0 20 remove_watcher() i=5 2024-09-12T18:03:25.087 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.081+0000 7fd27851d9c0 20 remove_watcher() i=6 2024-09-12T18:03:25.088 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.085+0000 7fd27851d9c0 20 remove_watcher() i=7 2024-09-12T18:03:25.104 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:25.104 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:25.166 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:25.166 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:25.439 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T18:03:25.471 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:25.471 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:25.515 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.509+0000 7fb5e557d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:25.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.513+0000 7fb5e557d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:25.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.513+0000 7fb5e557d9c0 20 realm 2024-09-12T18:03:25.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.513+0000 7fb5e557d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:25.517 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.513+0000 7fb5e557d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:25.518 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.513+0000 7fb5e557d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:25.518 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.513+0000 7fb5e557d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:25.518 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.513+0000 7fb5e557d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:25.518 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.513+0000 7fb5e557d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:25.519 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.513+0000 7fb5e557d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:25.519 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.513+0000 7fb5e557d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:25.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.513+0000 7fb5e557d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:25.520 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.513+0000 7fb5e557d9c0 20 searching for the correct realm 2024-09-12T18:03:25.525 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.521+0000 7fb5e3884640 0 -- 172.21.15.98:0/1067875923 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7fb5d812cb80 msgr2=0x7fb5d80f7360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:25.532 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.529+0000 7fb5e3083640 0 -- 172.21.15.98:0/1067875923 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fb5d81248e0 msgr2=0x7fb5d80f6a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:25.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:25.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:25.753 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:25.753 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:25.753 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:25.753 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:25.753 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:25.753 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:25.753 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:25.754 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:25.754 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:25.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:25.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 20 zone default found 2024-09-12T18:03:25.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 4 Realm: () 2024-09-12T18:03:25.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:25.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:25.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:25.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 20 zonegroup default 2024-09-12T18:03:25.755 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:25.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:25.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.749+0000 7fb5e557d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:25.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.753+0000 7fb5e557d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:25.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.753+0000 7fb5e557d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:25.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.753+0000 7fb5e557d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:25.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.753+0000 7fb5e557d9c0 20 started sync module instance, tier type = 2024-09-12T18:03:25.757 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.753+0000 7fb5e557d9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:25.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.777+0000 7fb5e557d9c0 20 add_watcher() i=0 2024-09-12T18:03:25.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.777+0000 7fb5e557d9c0 20 add_watcher() i=1 2024-09-12T18:03:25.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.777+0000 7fb5e557d9c0 20 add_watcher() i=2 2024-09-12T18:03:25.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.777+0000 7fb5e557d9c0 20 add_watcher() i=3 2024-09-12T18:03:25.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.777+0000 7fb5e557d9c0 20 add_watcher() i=4 2024-09-12T18:03:25.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.777+0000 7fb5e557d9c0 20 add_watcher() i=5 2024-09-12T18:03:25.782 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.777+0000 7fb5e557d9c0 20 add_watcher() i=6 2024-09-12T18:03:25.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.781+0000 7fb5e557d9c0 20 add_watcher() i=7 2024-09-12T18:03:25.784 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.781+0000 7fb5e557d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:25.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.785+0000 7fb499fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:25.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.785+0000 7fb5e557d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:25.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.785+0000 7fb5e557d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:25.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.785+0000 7fb5e557d9c0 5 note: GC not initialized 2024-09-12T18:03:25.790 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.785+0000 7fb498fe1640 20 reqs_thread_entry: start 2024-09-12T18:03:25.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.785+0000 7fb5e557d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:25.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.785+0000 7fb5e557d9c0 20 Filter name: none 2024-09-12T18:03:25.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.785+0000 7fb4127fc640 20 reqs_thread_entry: start 2024-09-12T18:03:25.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.785+0000 7fb5e557d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:25.791 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.785+0000 7fb5e557d9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:03:25.792 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.785+0000 7fb5e557d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:25.792 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.789+0000 7fb5e557d9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:03:25.792 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.789+0000 7fb5e557d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:25.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.789+0000 7fb5e557d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:25.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.789+0000 7fb5e557d9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:03:25.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.789+0000 7fb5e557d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:25.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.789+0000 7fb5e557d9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:03:25.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.789+0000 7fb5e557d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:03:25.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.793+0000 7fb499fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:25.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.797+0000 7fb5e557d9c0 20 remove_watcher() i=0 2024-09-12T18:03:25.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.797+0000 7fb5e557d9c0 2 removed watcher, disabling cache 2024-09-12T18:03:25.804 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.801+0000 7fb5e557d9c0 20 remove_watcher() i=1 2024-09-12T18:03:25.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.805+0000 7fb5e557d9c0 20 remove_watcher() i=2 2024-09-12T18:03:25.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.805+0000 7fb5e557d9c0 20 remove_watcher() i=3 2024-09-12T18:03:25.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.809+0000 7fb5e557d9c0 20 remove_watcher() i=4 2024-09-12T18:03:25.816 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.813+0000 7fb5e557d9c0 20 remove_watcher() i=5 2024-09-12T18:03:25.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.813+0000 7fb5e557d9c0 20 remove_watcher() i=6 2024-09-12T18:03:25.819 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T18:03:25.813+0000 7fb5e557d9c0 20 remove_watcher() i=7 2024-09-12T18:03:25.837 INFO:tasks.workunit.client.0.smithi098.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T18:03:25.837 INFO:tasks.workunit.client.0.smithi098.stderr:Deleting bucket a-bucket 2024-09-12T18:03:25.837 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:25.837 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:25.866 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:25.866 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:25.974 INFO:tasks.workunit.client.0.smithi098.stderr:Deleting bucket myver 2024-09-12T18:03:25.976 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:25.977 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:26.112 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:03:26.112 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T18:03:26.576 INFO:tasks.workunit.client.0.smithi098.stderr:Completed resharding tests 2024-09-12T18:03:26.577 INFO:tasks.workunit.client.0.smithi098.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T18:03:26.577 INFO:tasks.workunit.client.0.smithi098.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T18:03:26.577 INFO:tasks.workunit.client.0.smithi098.stdout:connected to https://localhost:443 2024-09-12T18:03:26.701 INFO:tasks.workunit.client.0.smithi098.stderr:+ deactivate 2024-09-12T18:03:26.702 INFO:tasks.workunit.client.0.smithi098.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T18:03:26.702 INFO:tasks.workunit.client.0.smithi098.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T18:03:26.702 INFO:tasks.workunit.client.0.smithi098.stderr:+ export PATH 2024-09-12T18:03:26.702 INFO:tasks.workunit.client.0.smithi098.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T18:03:26.702 INFO:tasks.workunit.client.0.smithi098.stderr:+ '[' -n '' ']' 2024-09-12T18:03:26.702 INFO:tasks.workunit.client.0.smithi098.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:03:26.702 INFO:tasks.workunit.client.0.smithi098.stderr:+ hash -r 2024-09-12T18:03:26.702 INFO:tasks.workunit.client.0.smithi098.stderr:+ '[' -n '' ']' 2024-09-12T18:03:26.702 INFO:tasks.workunit.client.0.smithi098.stderr:+ unset VIRTUAL_ENV 2024-09-12T18:03:26.702 INFO:tasks.workunit.client.0.smithi098.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T18:03:26.703 INFO:tasks.workunit.client.0.smithi098.stdout:OK. 2024-09-12T18:03:26.704 INFO:tasks.workunit.client.0.smithi098.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T18:03:26.704 INFO:tasks.workunit.client.0.smithi098.stderr:+ unset -f deactivate 2024-09-12T18:03:26.704 INFO:tasks.workunit.client.0.smithi098.stderr:+ echo OK. 2024-09-12T18:03:26.704 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:03:26.705 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:03:26.765 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T18:03:26.766 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T18:03:27.204 DEBUG:teuthology.parallel:result is None 2024-09-12T18:03:27.204 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:03:27.216 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:03:27.217 DEBUG:teuthology.orchestra.run.smithi098:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:03:27.264 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:03:27.265 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T18:03:27.279 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T18:03:27.280 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T18:03:27.280 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T18:03:27.280 DEBUG:teuthology.orchestra.run.smithi098:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T18:03:27.312 INFO:teuthology.orchestra.run.smithi098.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T18:03:32.210 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T18:03:32.210 DEBUG:teuthology.orchestra.run.smithi098:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T18:03:32.301 INFO:teuthology.orchestra.run.smithi098.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-09-12T18:03:32.360 INFO:teuthology.orchestra.run.smithi098.stdout:Reading package lists... 2024-09-12T18:03:32.572 INFO:teuthology.orchestra.run.smithi098.stdout:Building dependency tree... 2024-09-12T18:03:32.573 INFO:teuthology.orchestra.run.smithi098.stdout:Reading state information... 2024-09-12T18:03:32.772 INFO:teuthology.orchestra.run.smithi098.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:03:32.772 INFO:teuthology.orchestra.run.smithi098.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:03:32.772 INFO:teuthology.orchestra.run.smithi098.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:03:32.772 INFO:teuthology.orchestra.run.smithi098.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:03:32.773 INFO:teuthology.orchestra.run.smithi098.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:03:32.773 INFO:teuthology.orchestra.run.smithi098.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:03:32.773 INFO:teuthology.orchestra.run.smithi098.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:03:32.773 INFO:teuthology.orchestra.run.smithi098.stdout:The following additional packages will be installed: 2024-09-12T18:03:32.774 INFO:teuthology.orchestra.run.smithi098.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T18:03:32.774 INFO:teuthology.orchestra.run.smithi098.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T18:03:32.776 INFO:teuthology.orchestra.run.smithi098.stdout:Suggested packages: 2024-09-12T18:03:32.776 INFO:teuthology.orchestra.run.smithi098.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-09-12T18:03:32.777 INFO:teuthology.orchestra.run.smithi098.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-09-12T18:03:32.777 INFO:teuthology.orchestra.run.smithi098.stdout: fonts-wqy-zenhei fonts-indic 2024-09-12T18:03:32.813 INFO:teuthology.orchestra.run.smithi098.stdout:The following NEW packages will be installed: 2024-09-12T18:03:32.813 INFO:teuthology.orchestra.run.smithi098.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T18:03:32.813 INFO:teuthology.orchestra.run.smithi098.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T18:03:32.996 INFO:teuthology.orchestra.run.smithi098.stdout:0 upgraded, 9 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T18:03:32.996 INFO:teuthology.orchestra.run.smithi098.stdout:Need to get 46.0 MB of archives. 2024-09-12T18:03:32.996 INFO:teuthology.orchestra.run.smithi098.stdout:After this operation, 155 MB of additional disk space will be used. 2024-09-12T18:03:32.996 INFO:teuthology.orchestra.run.smithi098.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2.1 [125 kB] 2024-09-12T18:03:33.360 INFO:teuthology.orchestra.run.smithi098.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2.1 [2,038 kB] 2024-09-12T18:03:33.715 INFO:teuthology.orchestra.run.smithi098.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail18 amd64 2.24.33-2ubuntu2.1 [15.9 kB] 2024-09-12T18:03:33.716 INFO:teuthology.orchestra.run.smithi098.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail-common amd64 2.24.33-2ubuntu2.1 [132 kB] 2024-09-12T18:03:33.722 INFO:teuthology.orchestra.run.smithi098.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2.1 [7,936 B] 2024-09-12T18:03:33.723 INFO:teuthology.orchestra.run.smithi098.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u422-b05-1~22.04 [30.8 MB] 2024-09-12T18:03:34.793 INFO:teuthology.orchestra.run.smithi098.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u422-b05-1~22.04 [75.5 kB] 2024-09-12T18:03:34.795 INFO:teuthology.orchestra.run.smithi098.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u422-b05-1~22.04 [8,843 kB] 2024-09-12T18:03:35.038 INFO:teuthology.orchestra.run.smithi098.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u422-b05-1~22.04 [4,012 kB] 2024-09-12T18:03:35.440 INFO:teuthology.orchestra.run.smithi098.stderr:debconf: unable to initialize frontend: Dialog 2024-09-12T18:03:35.440 INFO:teuthology.orchestra.run.smithi098.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-09-12T18:03:35.440 INFO:teuthology.orchestra.run.smithi098.stderr:debconf: falling back to frontend: Readline 2024-09-12T18:03:35.457 INFO:teuthology.orchestra.run.smithi098.stderr:debconf: unable to initialize frontend: Readline 2024-09-12T18:03:35.457 INFO:teuthology.orchestra.run.smithi098.stderr:debconf: (This frontend requires a controlling tty.) 2024-09-12T18:03:35.457 INFO:teuthology.orchestra.run.smithi098.stderr:debconf: falling back to frontend: Teletype 2024-09-12T18:03:35.461 INFO:teuthology.orchestra.run.smithi098.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-09-12T18:03:35.495 INFO:teuthology.orchestra.run.smithi098.stdout:Fetched 46.0 MB in 2s (19.8 MB/s) 2024-09-12T18:03:35.587 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libgtk2.0-common. 2024-09-12T18:03:35.671 INFO:teuthology.orchestra.run.smithi098.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 177243 files and directories currently installed.) 2024-09-12T18:03:35.677 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2.1_all.deb ... 2024-09-12T18:03:35.719 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T18:03:36.098 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-09-12T18:03:36.126 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T18:03:36.214 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:03:36.627 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libgail18:amd64. 2024-09-12T18:03:36.643 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T18:03:36.676 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:03:36.929 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libgail-common:amd64. 2024-09-12T18:03:36.946 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T18:03:36.987 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:03:37.257 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-09-12T18:03:37.273 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T18:03:37.315 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T18:03:37.711 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-09-12T18:03:37.740 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T18:03:37.781 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:03:39.333 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-09-12T18:03:39.362 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../6-openjdk-8-jre_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T18:03:39.403 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:03:39.855 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-09-12T18:03:39.883 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T18:03:39.925 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:03:40.650 INFO:teuthology.orchestra.run.smithi098.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-09-12T18:03:40.678 INFO:teuthology.orchestra.run.smithi098.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T18:03:40.720 INFO:teuthology.orchestra.run.smithi098.stdout:Unpacking openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:03:41.079 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:03:42.208 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-09-12T18:03:42.242 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-09-12T18:03:42.269 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-09-12T18:03:42.626 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T18:03:42.777 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:03:43.137 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:03:43.213 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-09-12T18:03:43.264 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:03:43.375 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-09-12T18:03:43.402 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-09-12T18:03:43.418 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-09-12T18:03:43.445 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-09-12T18:03:43.554 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-09-12T18:03:43.706 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-09-12T18:03:43.834 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-09-12T18:03:43.929 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-09-12T18:03:43.970 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-09-12T18:03:44.022 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-09-12T18:03:44.047 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-09-12T18:03:44.072 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-09-12T18:03:44.153 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:03:44.263 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T18:03:44.364 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:03:44.447 INFO:teuthology.orchestra.run.smithi098.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-09-12T18:03:44.533 INFO:teuthology.orchestra.run.smithi098.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:03:44.660 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:03:45.711 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T18:03:45.820 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-12T18:03:46.097 INFO:teuthology.orchestra.run.smithi098.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:03:46.561 INFO:teuthology.orchestra.run.smithi098.stdout: Gradle will be installed under /opt/gradle 2024-09-12T18:03:46.590 INFO:teuthology.orchestra.run.smithi098.stderr:--2024-09-12 18:03:46-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T18:03:46.595 INFO:teuthology.orchestra.run.smithi098.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-09-12T18:03:46.608 INFO:teuthology.orchestra.run.smithi098.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-12T18:03:46.665 INFO:teuthology.orchestra.run.smithi098.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T18:03:46.665 INFO:teuthology.orchestra.run.smithi098.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T18:03:46.665 INFO:teuthology.orchestra.run.smithi098.stderr:--2024-09-12 18:03:46-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T18:03:46.667 INFO:teuthology.orchestra.run.smithi098.stderr:Resolving github.com (github.com)... 140.82.113.4 2024-09-12T18:03:46.676 INFO:teuthology.orchestra.run.smithi098.stderr:Connecting to github.com (github.com)|140.82.113.4|:443... connected. 2024-09-12T18:03:46.769 INFO:teuthology.orchestra.run.smithi098.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T18:03:46.769 INFO:teuthology.orchestra.run.smithi098.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T180346Z&X-Amz-Expires=300&X-Amz-Signature=5b45327c2c3bc3461cec68d5489c6e32cee3232660fa39dd5e33c1a13d7844be&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T18:03:46.769 INFO:teuthology.orchestra.run.smithi098.stderr:--2024-09-12 18:03:46-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T180346Z&X-Amz-Expires=300&X-Amz-Signature=5b45327c2c3bc3461cec68d5489c6e32cee3232660fa39dd5e33c1a13d7844be&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T18:03:46.771 INFO:teuthology.orchestra.run.smithi098.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.111.133, 185.199.110.133, 185.199.109.133, ... 2024-09-12T18:03:46.783 INFO:teuthology.orchestra.run.smithi098.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.111.133|:443... connected. 2024-09-12T18:03:46.867 INFO:teuthology.orchestra.run.smithi098.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T18:03:46.867 INFO:teuthology.orchestra.run.smithi098.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T18:03:46.867 INFO:teuthology.orchestra.run.smithi098.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-09-12T18:03:46.867 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-12T18:03:46.878 INFO:teuthology.orchestra.run.smithi098.stderr: 0K .......... .......... .......... .......... .......... 0% 4.17M 22s 2024-09-12T18:03:46.889 INFO:teuthology.orchestra.run.smithi098.stderr: 50K .......... .......... .......... .......... .......... 0% 4.23M 22s 2024-09-12T18:03:46.892 INFO:teuthology.orchestra.run.smithi098.stderr: 100K .......... .......... .......... .......... .......... 0% 20.1M 16s 2024-09-12T18:03:46.895 INFO:teuthology.orchestra.run.smithi098.stderr: 150K .......... .......... .......... .......... .......... 0% 15.6M 13s 2024-09-12T18:03:46.901 INFO:teuthology.orchestra.run.smithi098.stderr: 200K .......... .......... .......... .......... .......... 0% 7.61M 13s 2024-09-12T18:03:46.903 INFO:teuthology.orchestra.run.smithi098.stderr: 250K .......... .......... .......... .......... .......... 0% 46.9M 11s 2024-09-12T18:03:46.905 INFO:teuthology.orchestra.run.smithi098.stderr: 300K .......... .......... .......... .......... .......... 0% 19.1M 10s 2024-09-12T18:03:46.906 INFO:teuthology.orchestra.run.smithi098.stderr: 350K .......... .......... .......... .......... .......... 0% 78.5M 9s 2024-09-12T18:03:46.907 INFO:teuthology.orchestra.run.smithi098.stderr: 400K .......... .......... .......... .......... .......... 0% 43.0M 8s 2024-09-12T18:03:46.912 INFO:teuthology.orchestra.run.smithi098.stderr: 450K .......... .......... .......... .......... .......... 0% 8.99M 8s 2024-09-12T18:03:46.914 INFO:teuthology.orchestra.run.smithi098.stderr: 500K .......... .......... .......... .......... .......... 0% 40.4M 8s 2024-09-12T18:03:46.914 INFO:teuthology.orchestra.run.smithi098.stderr: 550K .......... .......... .......... .......... .......... 0% 141M 7s 2024-09-12T18:03:46.920 INFO:teuthology.orchestra.run.smithi098.stderr: 600K .......... .......... .......... .......... .......... 0% 37.9M 7s 2024-09-12T18:03:46.920 INFO:teuthology.orchestra.run.smithi098.stderr: 650K .......... .......... .......... .......... .......... 0% 111M 6s 2024-09-12T18:03:46.920 INFO:teuthology.orchestra.run.smithi098.stderr: 700K .......... .......... .......... .......... .......... 0% 42.5M 6s 2024-09-12T18:03:46.920 INFO:teuthology.orchestra.run.smithi098.stderr: 750K .......... .......... .......... .......... .......... 0% 94.7M 6s 2024-09-12T18:03:46.920 INFO:teuthology.orchestra.run.smithi098.stderr: 800K .......... .......... .......... .......... .......... 0% 134M 6s 2024-09-12T18:03:46.920 INFO:teuthology.orchestra.run.smithi098.stderr: 850K .......... .......... .......... .......... .......... 0% 69.5M 5s 2024-09-12T18:03:46.920 INFO:teuthology.orchestra.run.smithi098.stderr: 900K .......... .......... .......... .......... .......... 1% 78.5M 5s 2024-09-12T18:03:47.992 INFO:teuthology.orchestra.run.smithi098.stderr: 950K .......... .......... .......... .......... .......... 1% 10.1M 5s 2024-09-12T18:03:47.993 INFO:teuthology.orchestra.run.smithi098.stderr: 1000K .......... .......... .......... .......... .......... 1% 135M 5s 2024-09-12T18:03:47.993 INFO:teuthology.orchestra.run.smithi098.stderr: 1050K .......... .......... .......... .......... .......... 1% 64.7M 5s 2024-09-12T18:03:47.993 INFO:teuthology.orchestra.run.smithi098.stderr: 1100K .......... .......... .......... .......... .......... 1% 111M 5s 2024-09-12T18:03:47.993 INFO:teuthology.orchestra.run.smithi098.stderr: 1150K .......... .......... .......... .......... .......... 1% 82.5M 5s 2024-09-12T18:03:47.993 INFO:teuthology.orchestra.run.smithi098.stderr: 1200K .......... .......... .......... .......... .......... 1% 134M 4s 2024-09-12T18:03:47.993 INFO:teuthology.orchestra.run.smithi098.stderr: 1250K .......... .......... .......... .......... .......... 1% 132M 4s 2024-09-12T18:03:47.993 INFO:teuthology.orchestra.run.smithi098.stderr: 1300K .......... .......... .......... .......... .......... 1% 115M 4s 2024-09-12T18:03:47.993 INFO:teuthology.orchestra.run.smithi098.stderr: 1350K .......... .......... .......... .......... .......... 1% 136M 4s 2024-09-12T18:03:47.993 INFO:teuthology.orchestra.run.smithi098.stderr: 1400K .......... .......... .......... .......... .......... 1% 129M 4s 2024-09-12T18:03:47.993 INFO:teuthology.orchestra.run.smithi098.stderr: 1450K .......... .......... .......... .......... .......... 1% 123M 4s 2024-09-12T18:03:47.993 INFO:teuthology.orchestra.run.smithi098.stderr: 1500K .......... .......... .......... .......... .......... 1% 103M 4s 2024-09-12T18:03:47.993 INFO:teuthology.orchestra.run.smithi098.stderr: 1550K .......... .......... .......... .......... .......... 1% 131M 4s 2024-09-12T18:03:47.994 INFO:teuthology.orchestra.run.smithi098.stderr: 1600K .......... .......... .......... .......... .......... 1% 136M 3s 2024-09-12T18:03:47.994 INFO:teuthology.orchestra.run.smithi098.stderr: 1650K .......... .......... .......... .......... .......... 1% 141M 3s 2024-09-12T18:03:47.994 INFO:teuthology.orchestra.run.smithi098.stderr: 1700K .......... .......... .......... .......... .......... 1% 114M 3s 2024-09-12T18:03:47.994 INFO:teuthology.orchestra.run.smithi098.stderr: 1750K .......... .......... .......... .......... .......... 1% 139M 3s 2024-09-12T18:03:47.994 INFO:teuthology.orchestra.run.smithi098.stderr: 1800K .......... .......... .......... .......... .......... 1% 137M 3s 2024-09-12T18:03:47.994 INFO:teuthology.orchestra.run.smithi098.stderr: 1850K .......... .......... .......... .......... .......... 2% 129M 3s 2024-09-12T18:03:47.994 INFO:teuthology.orchestra.run.smithi098.stderr: 1900K .......... .......... .......... .......... .......... 2% 12.5M 3s 2024-09-12T18:03:47.994 INFO:teuthology.orchestra.run.smithi098.stderr: 1950K .......... .......... .......... .......... .......... 2% 127M 3s 2024-09-12T18:03:47.994 INFO:teuthology.orchestra.run.smithi098.stderr: 2000K .......... .......... .......... .......... .......... 2% 135M 3s 2024-09-12T18:03:47.994 INFO:teuthology.orchestra.run.smithi098.stderr: 2050K .......... .......... .......... .......... .......... 2% 102M 3s 2024-09-12T18:03:47.994 INFO:teuthology.orchestra.run.smithi098.stderr: 2100K .......... .......... .......... .......... .......... 2% 107M 3s 2024-09-12T18:03:47.994 INFO:teuthology.orchestra.run.smithi098.stderr: 2150K .......... .......... .......... .......... .......... 2% 135M 3s 2024-09-12T18:03:47.995 INFO:teuthology.orchestra.run.smithi098.stderr: 2200K .......... .......... .......... .......... .......... 2% 130M 3s 2024-09-12T18:03:47.995 INFO:teuthology.orchestra.run.smithi098.stderr: 2250K .......... .......... .......... .......... .......... 2% 130M 3s 2024-09-12T18:03:47.995 INFO:teuthology.orchestra.run.smithi098.stderr: 2300K .......... .......... .......... .......... .......... 2% 109M 3s 2024-09-12T18:03:47.995 INFO:teuthology.orchestra.run.smithi098.stderr: 2350K .......... .......... .......... .......... .......... 2% 123M 3s 2024-09-12T18:03:47.995 INFO:teuthology.orchestra.run.smithi098.stderr: 2400K .......... .......... .......... .......... .......... 2% 126M 3s 2024-09-12T18:03:47.995 INFO:teuthology.orchestra.run.smithi098.stderr: 2450K .......... .......... .......... .......... .......... 2% 126M 3s 2024-09-12T18:03:47.995 INFO:teuthology.orchestra.run.smithi098.stderr: 2500K .......... .......... .......... .......... .......... 2% 115M 3s 2024-09-12T18:03:47.995 INFO:teuthology.orchestra.run.smithi098.stderr: 2550K .......... .......... .......... .......... .......... 2% 115M 3s 2024-09-12T18:03:47.995 INFO:teuthology.orchestra.run.smithi098.stderr: 2600K .......... .......... .......... .......... .......... 2% 121M 3s 2024-09-12T18:03:47.995 INFO:teuthology.orchestra.run.smithi098.stderr: 2650K .......... .......... .......... .......... .......... 2% 124M 3s 2024-09-12T18:03:47.995 INFO:teuthology.orchestra.run.smithi098.stderr: 2700K .......... .......... .......... .......... .......... 2% 101M 2s 2024-09-12T18:03:47.995 INFO:teuthology.orchestra.run.smithi098.stderr: 2750K .......... .......... .......... .......... .......... 3% 123M 2s 2024-09-12T18:03:47.995 INFO:teuthology.orchestra.run.smithi098.stderr: 2800K .......... .......... .......... .......... .......... 3% 126M 2s 2024-09-12T18:03:47.995 INFO:teuthology.orchestra.run.smithi098.stderr: 2850K .......... .......... .......... .......... .......... 3% 117M 2s 2024-09-12T18:03:47.996 INFO:teuthology.orchestra.run.smithi098.stderr: 2900K .......... .......... .......... .......... .......... 3% 119M 2s 2024-09-12T18:03:47.996 INFO:teuthology.orchestra.run.smithi098.stderr: 2950K .......... .......... .......... .......... .......... 3% 124M 2s 2024-09-12T18:03:47.996 INFO:teuthology.orchestra.run.smithi098.stderr: 3000K .......... .......... .......... .......... .......... 3% 133M 2s 2024-09-12T18:03:47.996 INFO:teuthology.orchestra.run.smithi098.stderr: 3050K .......... .......... .......... .......... .......... 3% 128M 2s 2024-09-12T18:03:47.996 INFO:teuthology.orchestra.run.smithi098.stderr: 3100K .......... .......... .......... .......... .......... 3% 108M 2s 2024-09-12T18:03:47.996 INFO:teuthology.orchestra.run.smithi098.stderr: 3150K .......... .......... .......... .......... .......... 3% 132M 2s 2024-09-12T18:03:47.996 INFO:teuthology.orchestra.run.smithi098.stderr: 3200K .......... .......... .......... .......... .......... 3% 132M 2s 2024-09-12T18:03:47.996 INFO:teuthology.orchestra.run.smithi098.stderr: 3250K .......... .......... .......... .......... .......... 3% 130M 2s 2024-09-12T18:03:47.996 INFO:teuthology.orchestra.run.smithi098.stderr: 3300K .......... .......... .......... .......... .......... 3% 118M 2s 2024-09-12T18:03:47.996 INFO:teuthology.orchestra.run.smithi098.stderr: 3350K .......... .......... .......... .......... .......... 3% 128M 2s 2024-09-12T18:03:47.996 INFO:teuthology.orchestra.run.smithi098.stderr: 3400K .......... .......... .......... .......... .......... 3% 124M 2s 2024-09-12T18:03:47.996 INFO:teuthology.orchestra.run.smithi098.stderr: 3450K .......... .......... .......... .......... .......... 3% 128M 2s 2024-09-12T18:03:47.996 INFO:teuthology.orchestra.run.smithi098.stderr: 3500K .......... .......... .......... .......... .......... 3% 103M 2s 2024-09-12T18:03:47.997 INFO:teuthology.orchestra.run.smithi098.stderr: 3550K .......... .......... .......... .......... .......... 3% 111M 2s 2024-09-12T18:03:47.997 INFO:teuthology.orchestra.run.smithi098.stderr: 3600K .......... .......... .......... .......... .......... 3% 125M 2s 2024-09-12T18:03:47.997 INFO:teuthology.orchestra.run.smithi098.stderr: 3650K .......... .......... .......... .......... .......... 3% 127M 2s 2024-09-12T18:03:47.997 INFO:teuthology.orchestra.run.smithi098.stderr: 3700K .......... .......... .......... .......... .......... 4% 116M 2s 2024-09-12T18:03:47.997 INFO:teuthology.orchestra.run.smithi098.stderr: 3750K .......... .......... .......... .......... .......... 4% 119M 2s 2024-09-12T18:03:47.997 INFO:teuthology.orchestra.run.smithi098.stderr: 3800K .......... .......... .......... .......... .......... 4% 124M 2s 2024-09-12T18:03:47.997 INFO:teuthology.orchestra.run.smithi098.stderr: 3850K .......... .......... .......... .......... .......... 4% 123M 2s 2024-09-12T18:03:47.997 INFO:teuthology.orchestra.run.smithi098.stderr: 3900K .......... .......... .......... .......... .......... 4% 101M 2s 2024-09-12T18:03:47.997 INFO:teuthology.orchestra.run.smithi098.stderr: 3950K .......... .......... .......... .......... .......... 4% 130M 2s 2024-09-12T18:03:47.997 INFO:teuthology.orchestra.run.smithi098.stderr: 4000K .......... .......... .......... .......... .......... 4% 122M 2s 2024-09-12T18:03:47.997 INFO:teuthology.orchestra.run.smithi098.stderr: 4050K .......... .......... .......... .......... .......... 4% 130M 2s 2024-09-12T18:03:47.997 INFO:teuthology.orchestra.run.smithi098.stderr: 4100K .......... .......... .......... .......... .......... 4% 122M 2s 2024-09-12T18:03:47.997 INFO:teuthology.orchestra.run.smithi098.stderr: 4150K .......... .......... .......... .......... .......... 4% 120M 2s 2024-09-12T18:03:47.998 INFO:teuthology.orchestra.run.smithi098.stderr: 4200K .......... .......... .......... .......... .......... 4% 99.0M 2s 2024-09-12T18:03:47.998 INFO:teuthology.orchestra.run.smithi098.stderr: 4250K .......... .......... .......... .......... .......... 4% 134M 2s 2024-09-12T18:03:47.998 INFO:teuthology.orchestra.run.smithi098.stderr: 4300K .......... .......... .......... .......... .......... 4% 106M 2s 2024-09-12T18:03:47.998 INFO:teuthology.orchestra.run.smithi098.stderr: 4350K .......... .......... .......... .......... .......... 4% 138M 2s 2024-09-12T18:03:47.998 INFO:teuthology.orchestra.run.smithi098.stderr: 4400K .......... .......... .......... .......... .......... 4% 136M 2s 2024-09-12T18:03:47.998 INFO:teuthology.orchestra.run.smithi098.stderr: 4450K .......... .......... .......... .......... .......... 4% 121M 2s 2024-09-12T18:03:47.998 INFO:teuthology.orchestra.run.smithi098.stderr: 4500K .......... .......... .......... .......... .......... 4% 109M 2s 2024-09-12T18:03:47.998 INFO:teuthology.orchestra.run.smithi098.stderr: 4550K .......... .......... .......... .......... .......... 4% 126M 2s 2024-09-12T18:03:47.998 INFO:teuthology.orchestra.run.smithi098.stderr: 4600K .......... .......... .......... .......... .......... 5% 135M 2s 2024-09-12T18:03:47.998 INFO:teuthology.orchestra.run.smithi098.stderr: 4650K .......... .......... .......... .......... .......... 5% 138M 2s 2024-09-12T18:03:47.998 INFO:teuthology.orchestra.run.smithi098.stderr: 4700K .......... .......... .......... .......... .......... 5% 111M 2s 2024-09-12T18:03:47.998 INFO:teuthology.orchestra.run.smithi098.stderr: 4750K .......... .......... .......... .......... .......... 5% 132M 2s 2024-09-12T18:03:47.998 INFO:teuthology.orchestra.run.smithi098.stderr: 4800K .......... .......... .......... .......... .......... 5% 122M 2s 2024-09-12T18:03:47.998 INFO:teuthology.orchestra.run.smithi098.stderr: 4850K .......... .......... .......... .......... .......... 5% 121M 2s 2024-09-12T18:03:47.999 INFO:teuthology.orchestra.run.smithi098.stderr: 4900K .......... .......... .......... .......... .......... 5% 121M 2s 2024-09-12T18:03:47.999 INFO:teuthology.orchestra.run.smithi098.stderr: 4950K .......... .......... .......... .......... .......... 5% 126M 2s 2024-09-12T18:03:47.999 INFO:teuthology.orchestra.run.smithi098.stderr: 5000K .......... .......... .......... .......... .......... 5% 128M 2s 2024-09-12T18:03:47.999 INFO:teuthology.orchestra.run.smithi098.stderr: 5050K .......... .......... .......... .......... .......... 5% 120M 2s 2024-09-12T18:03:47.999 INFO:teuthology.orchestra.run.smithi098.stderr: 5100K .......... .......... .......... .......... .......... 5% 109M 2s 2024-09-12T18:03:47.999 INFO:teuthology.orchestra.run.smithi098.stderr: 5150K .......... .......... .......... .......... .......... 5% 117M 2s 2024-09-12T18:03:47.999 INFO:teuthology.orchestra.run.smithi098.stderr: 5200K .......... .......... .......... .......... .......... 5% 128M 2s 2024-09-12T18:03:47.999 INFO:teuthology.orchestra.run.smithi098.stderr: 5250K .......... .......... .......... .......... .......... 5% 127M 2s 2024-09-12T18:03:47.999 INFO:teuthology.orchestra.run.smithi098.stderr: 5300K .......... .......... .......... .......... .......... 5% 113M 2s 2024-09-12T18:03:47.999 INFO:teuthology.orchestra.run.smithi098.stderr: 5350K .......... .......... .......... .......... .......... 5% 129M 2s 2024-09-12T18:03:47.999 INFO:teuthology.orchestra.run.smithi098.stderr: 5400K .......... .......... .......... .......... .......... 5% 134M 2s 2024-09-12T18:03:47.999 INFO:teuthology.orchestra.run.smithi098.stderr: 5450K .......... .......... .......... .......... .......... 5% 122M 2s 2024-09-12T18:03:47.999 INFO:teuthology.orchestra.run.smithi098.stderr: 5500K .......... .......... .......... .......... .......... 5% 99.8M 2s 2024-09-12T18:03:47.999 INFO:teuthology.orchestra.run.smithi098.stderr: 5550K .......... .......... .......... .......... .......... 6% 120M 2s 2024-09-12T18:03:48.000 INFO:teuthology.orchestra.run.smithi098.stderr: 5600K .......... .......... .......... .......... .......... 6% 132M 2s 2024-09-12T18:03:48.000 INFO:teuthology.orchestra.run.smithi098.stderr: 5650K .......... .......... .......... .......... .......... 6% 134M 2s 2024-09-12T18:03:48.000 INFO:teuthology.orchestra.run.smithi098.stderr: 5700K .......... .......... .......... .......... .......... 6% 110M 2s 2024-09-12T18:03:48.000 INFO:teuthology.orchestra.run.smithi098.stderr: 5750K .......... .......... .......... .......... .......... 6% 134M 2s 2024-09-12T18:03:48.000 INFO:teuthology.orchestra.run.smithi098.stderr: 5800K .......... .......... .......... .......... .......... 6% 132M 1s 2024-09-12T18:03:48.000 INFO:teuthology.orchestra.run.smithi098.stderr: 5850K .......... .......... .......... .......... .......... 6% 126M 1s 2024-09-12T18:03:48.000 INFO:teuthology.orchestra.run.smithi098.stderr: 5900K .......... .......... .......... .......... .......... 6% 108M 1s 2024-09-12T18:03:48.000 INFO:teuthology.orchestra.run.smithi098.stderr: 5950K .......... .......... .......... .......... .......... 6% 129M 1s 2024-09-12T18:03:48.000 INFO:teuthology.orchestra.run.smithi098.stderr: 6000K .......... .......... .......... .......... .......... 6% 130M 1s 2024-09-12T18:03:48.000 INFO:teuthology.orchestra.run.smithi098.stderr: 6050K .......... .......... .......... .......... .......... 6% 135M 1s 2024-09-12T18:03:48.000 INFO:teuthology.orchestra.run.smithi098.stderr: 6100K .......... .......... .......... .......... .......... 6% 125M 1s 2024-09-12T18:03:48.000 INFO:teuthology.orchestra.run.smithi098.stderr: 6150K .......... .......... .......... .......... .......... 6% 147M 1s 2024-09-12T18:03:48.000 INFO:teuthology.orchestra.run.smithi098.stderr: 6200K .......... .......... .......... .......... .......... 6% 136M 1s 2024-09-12T18:03:48.001 INFO:teuthology.orchestra.run.smithi098.stderr: 6250K .......... .......... .......... .......... .......... 6% 134M 1s 2024-09-12T18:03:48.001 INFO:teuthology.orchestra.run.smithi098.stderr: 6300K .......... .......... .......... .......... .......... 6% 112M 1s 2024-09-12T18:03:48.001 INFO:teuthology.orchestra.run.smithi098.stderr: 6350K .......... .......... .......... .......... .......... 6% 133M 1s 2024-09-12T18:03:48.001 INFO:teuthology.orchestra.run.smithi098.stderr: 6400K .......... .......... .......... .......... .......... 6% 151M 1s 2024-09-12T18:03:48.001 INFO:teuthology.orchestra.run.smithi098.stderr: 6450K .......... .......... .......... .......... .......... 6% 147M 1s 2024-09-12T18:03:48.001 INFO:teuthology.orchestra.run.smithi098.stderr: 6500K .......... .......... .......... .......... .......... 7% 123M 1s 2024-09-12T18:03:48.001 INFO:teuthology.orchestra.run.smithi098.stderr: 6550K .......... .......... .......... .......... .......... 7% 134M 1s 2024-09-12T18:03:48.001 INFO:teuthology.orchestra.run.smithi098.stderr: 6600K .......... .......... .......... .......... .......... 7% 142M 1s 2024-09-12T18:03:48.001 INFO:teuthology.orchestra.run.smithi098.stderr: 6650K .......... .......... .......... .......... .......... 7% 134M 1s 2024-09-12T18:03:48.001 INFO:teuthology.orchestra.run.smithi098.stderr: 6700K .......... .......... .......... .......... .......... 7% 127M 1s 2024-09-12T18:03:48.001 INFO:teuthology.orchestra.run.smithi098.stderr: 6750K .......... .......... .......... .......... .......... 7% 153M 1s 2024-09-12T18:03:48.001 INFO:teuthology.orchestra.run.smithi098.stderr: 6800K .......... .......... .......... .......... .......... 7% 143M 1s 2024-09-12T18:03:48.001 INFO:teuthology.orchestra.run.smithi098.stderr: 6850K .......... .......... .......... .......... .......... 7% 148M 1s 2024-09-12T18:03:48.001 INFO:teuthology.orchestra.run.smithi098.stderr: 6900K .......... .......... .......... .......... .......... 7% 141M 1s 2024-09-12T18:03:48.002 INFO:teuthology.orchestra.run.smithi098.stderr: 6950K .......... .......... .......... .......... .......... 7% 146M 1s 2024-09-12T18:03:48.002 INFO:teuthology.orchestra.run.smithi098.stderr: 7000K .......... .......... .......... .......... .......... 7% 143M 1s 2024-09-12T18:03:48.002 INFO:teuthology.orchestra.run.smithi098.stderr: 7050K .......... .......... .......... .......... .......... 7% 158M 1s 2024-09-12T18:03:48.002 INFO:teuthology.orchestra.run.smithi098.stderr: 7100K .......... .......... .......... .......... .......... 7% 112M 1s 2024-09-12T18:03:48.002 INFO:teuthology.orchestra.run.smithi098.stderr: 7150K .......... .......... .......... .......... .......... 7% 138M 1s 2024-09-12T18:03:48.002 INFO:teuthology.orchestra.run.smithi098.stderr: 7200K .......... .......... .......... .......... .......... 7% 144M 1s 2024-09-12T18:03:48.002 INFO:teuthology.orchestra.run.smithi098.stderr: 7250K .......... .......... .......... .......... .......... 7% 161M 1s 2024-09-12T18:03:48.002 INFO:teuthology.orchestra.run.smithi098.stderr: 7300K .......... .......... .......... .......... .......... 7% 148M 1s 2024-09-12T18:03:48.002 INFO:teuthology.orchestra.run.smithi098.stderr: 7350K .......... .......... .......... .......... .......... 7% 151M 1s 2024-09-12T18:03:48.002 INFO:teuthology.orchestra.run.smithi098.stderr: 7400K .......... .......... .......... .......... .......... 8% 170M 1s 2024-09-12T18:03:48.002 INFO:teuthology.orchestra.run.smithi098.stderr: 7450K .......... .......... .......... .......... .......... 8% 165M 1s 2024-09-12T18:03:48.002 INFO:teuthology.orchestra.run.smithi098.stderr: 7500K .......... .......... .......... .......... .......... 8% 129M 1s 2024-09-12T18:03:48.002 INFO:teuthology.orchestra.run.smithi098.stderr: 7550K .......... .......... .......... .......... .......... 8% 154M 1s 2024-09-12T18:03:48.002 INFO:teuthology.orchestra.run.smithi098.stderr: 7600K .......... .......... .......... .......... .......... 8% 141M 1s 2024-09-12T18:03:48.003 INFO:teuthology.orchestra.run.smithi098.stderr: 7650K .......... .......... .......... .......... .......... 8% 163M 1s 2024-09-12T18:03:48.003 INFO:teuthology.orchestra.run.smithi098.stderr: 7700K .......... .......... .......... .......... .......... 8% 140M 1s 2024-09-12T18:03:48.003 INFO:teuthology.orchestra.run.smithi098.stderr: 7750K .......... .......... .......... .......... .......... 8% 150M 1s 2024-09-12T18:03:48.003 INFO:teuthology.orchestra.run.smithi098.stderr: 7800K .......... .......... .......... .......... .......... 8% 170M 1s 2024-09-12T18:03:48.003 INFO:teuthology.orchestra.run.smithi098.stderr: 7850K .......... .......... .......... .......... .......... 8% 171M 1s 2024-09-12T18:03:48.003 INFO:teuthology.orchestra.run.smithi098.stderr: 7900K .......... .......... .......... .......... .......... 8% 150M 1s 2024-09-12T18:03:48.003 INFO:teuthology.orchestra.run.smithi098.stderr: 7950K .......... .......... .......... .......... .......... 8% 177M 1s 2024-09-12T18:03:48.003 INFO:teuthology.orchestra.run.smithi098.stderr: 8000K .......... .......... .......... .......... .......... 8% 159M 1s 2024-09-12T18:03:48.003 INFO:teuthology.orchestra.run.smithi098.stderr: 8050K .......... .......... .......... .......... .......... 8% 171M 1s 2024-09-12T18:03:48.003 INFO:teuthology.orchestra.run.smithi098.stderr: 8100K .......... .......... .......... .......... .......... 8% 156M 1s 2024-09-12T18:03:48.003 INFO:teuthology.orchestra.run.smithi098.stderr: 8150K .......... .......... .......... .......... .......... 8% 173M 1s 2024-09-12T18:03:48.003 INFO:teuthology.orchestra.run.smithi098.stderr: 8200K .......... .......... .......... .......... .......... 8% 181M 1s 2024-09-12T18:03:48.003 INFO:teuthology.orchestra.run.smithi098.stderr: 8250K .......... .......... .......... .......... .......... 8% 167M 1s 2024-09-12T18:03:48.003 INFO:teuthology.orchestra.run.smithi098.stderr: 8300K .......... .......... .......... .......... .......... 8% 118M 1s 2024-09-12T18:03:48.004 INFO:teuthology.orchestra.run.smithi098.stderr: 8350K .......... .......... .......... .......... .......... 9% 183M 1s 2024-09-12T18:03:48.004 INFO:teuthology.orchestra.run.smithi098.stderr: 8400K .......... .......... .......... .......... .......... 9% 174M 1s 2024-09-12T18:03:48.004 INFO:teuthology.orchestra.run.smithi098.stderr: 8450K .......... .......... .......... .......... .......... 9% 167M 1s 2024-09-12T18:03:48.004 INFO:teuthology.orchestra.run.smithi098.stderr: 8500K .......... .......... .......... .......... .......... 9% 156M 1s 2024-09-12T18:03:48.004 INFO:teuthology.orchestra.run.smithi098.stderr: 8550K .......... .......... .......... .......... .......... 9% 193M 1s 2024-09-12T18:03:48.004 INFO:teuthology.orchestra.run.smithi098.stderr: 8600K .......... .......... .......... .......... .......... 9% 177M 1s 2024-09-12T18:03:48.004 INFO:teuthology.orchestra.run.smithi098.stderr: 8650K .......... .......... .......... .......... .......... 9% 187M 1s 2024-09-12T18:03:48.004 INFO:teuthology.orchestra.run.smithi098.stderr: 8700K .......... .......... .......... .......... .......... 9% 146M 1s 2024-09-12T18:03:48.004 INFO:teuthology.orchestra.run.smithi098.stderr: 8750K .......... .......... .......... .......... .......... 9% 185M 1s 2024-09-12T18:03:48.004 INFO:teuthology.orchestra.run.smithi098.stderr: 8800K .......... .......... .......... .......... .......... 9% 179M 1s 2024-09-12T18:03:48.004 INFO:teuthology.orchestra.run.smithi098.stderr: 8850K .......... .......... .......... .......... .......... 9% 196M 1s 2024-09-12T18:03:48.004 INFO:teuthology.orchestra.run.smithi098.stderr: 8900K .......... .......... .......... .......... .......... 9% 172M 1s 2024-09-12T18:03:48.004 INFO:teuthology.orchestra.run.smithi098.stderr: 8950K .......... .......... .......... .......... .......... 9% 196M 1s 2024-09-12T18:03:48.005 INFO:teuthology.orchestra.run.smithi098.stderr: 9000K .......... .......... .......... .......... .......... 9% 181M 1s 2024-09-12T18:03:48.005 INFO:teuthology.orchestra.run.smithi098.stderr: 9050K .......... .......... .......... .......... .......... 9% 181M 1s 2024-09-12T18:03:48.005 INFO:teuthology.orchestra.run.smithi098.stderr: 9100K .......... .......... .......... .......... .......... 9% 156M 1s 2024-09-12T18:03:48.005 INFO:teuthology.orchestra.run.smithi098.stderr: 9150K .......... .......... .......... .......... .......... 9% 167M 1s 2024-09-12T18:03:48.005 INFO:teuthology.orchestra.run.smithi098.stderr: 9200K .......... .......... .......... .......... .......... 9% 173M 1s 2024-09-12T18:03:48.005 INFO:teuthology.orchestra.run.smithi098.stderr: 9250K .......... .......... .......... .......... .......... 10% 184M 1s 2024-09-12T18:03:48.005 INFO:teuthology.orchestra.run.smithi098.stderr: 9300K .......... .......... .......... .......... .......... 10% 195M 1s 2024-09-12T18:03:48.005 INFO:teuthology.orchestra.run.smithi098.stderr: 9350K .......... .......... .......... .......... .......... 10% 188M 1s 2024-09-12T18:03:48.005 INFO:teuthology.orchestra.run.smithi098.stderr: 9400K .......... .......... .......... .......... .......... 10% 180M 1s 2024-09-12T18:03:48.005 INFO:teuthology.orchestra.run.smithi098.stderr: 9450K .......... .......... .......... .......... .......... 10% 186M 1s 2024-09-12T18:03:48.005 INFO:teuthology.orchestra.run.smithi098.stderr: 9500K .......... .......... .......... .......... .......... 10% 197M 1s 2024-09-12T18:03:48.005 INFO:teuthology.orchestra.run.smithi098.stderr: 9550K .......... .......... .......... .......... .......... 10% 192M 1s 2024-09-12T18:03:48.005 INFO:teuthology.orchestra.run.smithi098.stderr: 9600K .......... .......... .......... .......... .......... 10% 169M 1s 2024-09-12T18:03:48.005 INFO:teuthology.orchestra.run.smithi098.stderr: 9650K .......... .......... .......... .......... .......... 10% 195M 1s 2024-09-12T18:03:48.006 INFO:teuthology.orchestra.run.smithi098.stderr: 9700K .......... .......... .......... .......... .......... 10% 190M 1s 2024-09-12T18:03:48.006 INFO:teuthology.orchestra.run.smithi098.stderr: 9750K .......... .......... .......... .......... .......... 10% 190M 1s 2024-09-12T18:03:48.006 INFO:teuthology.orchestra.run.smithi098.stderr: 9800K .......... .......... .......... .......... .......... 10% 169M 1s 2024-09-12T18:03:48.006 INFO:teuthology.orchestra.run.smithi098.stderr: 9850K .......... .......... .......... .......... .......... 10% 196M 1s 2024-09-12T18:03:48.006 INFO:teuthology.orchestra.run.smithi098.stderr: 9900K .......... .......... .......... .......... .......... 10% 193M 1s 2024-09-12T18:03:48.006 INFO:teuthology.orchestra.run.smithi098.stderr: 9950K .......... .......... .......... .......... .......... 10% 208M 1s 2024-09-12T18:03:48.006 INFO:teuthology.orchestra.run.smithi098.stderr: 10000K .......... .......... .......... .......... .......... 10% 156M 1s 2024-09-12T18:03:48.006 INFO:teuthology.orchestra.run.smithi098.stderr: 10050K .......... .......... .......... .......... .......... 10% 194M 1s 2024-09-12T18:03:48.006 INFO:teuthology.orchestra.run.smithi098.stderr: 10100K .......... .......... .......... .......... .......... 10% 207M 1s 2024-09-12T18:03:48.006 INFO:teuthology.orchestra.run.smithi098.stderr: 10150K .......... .......... .......... .......... .......... 10% 182M 1s 2024-09-12T18:03:48.006 INFO:teuthology.orchestra.run.smithi098.stderr: 10200K .......... .......... .......... .......... .......... 11% 181M 1s 2024-09-12T18:03:48.006 INFO:teuthology.orchestra.run.smithi098.stderr: 10250K .......... .......... .......... .......... .......... 11% 225M 1s 2024-09-12T18:03:48.006 INFO:teuthology.orchestra.run.smithi098.stderr: 10300K .......... .......... .......... .......... .......... 11% 222M 1s 2024-09-12T18:03:48.006 INFO:teuthology.orchestra.run.smithi098.stderr: 10350K .......... .......... .......... .......... .......... 11% 160M 1s 2024-09-12T18:03:48.007 INFO:teuthology.orchestra.run.smithi098.stderr: 10400K .......... .......... .......... .......... .......... 11% 218M 1s 2024-09-12T18:03:48.007 INFO:teuthology.orchestra.run.smithi098.stderr: 10450K .......... .......... .......... .......... .......... 11% 211M 1s 2024-09-12T18:03:48.007 INFO:teuthology.orchestra.run.smithi098.stderr: 10500K .......... .......... .......... .......... .......... 11% 183M 1s 2024-09-12T18:03:48.007 INFO:teuthology.orchestra.run.smithi098.stderr: 10550K .......... .......... .......... .......... .......... 11% 191M 1s 2024-09-12T18:03:48.007 INFO:teuthology.orchestra.run.smithi098.stderr: 10600K .......... .......... .......... .......... .......... 11% 213M 1s 2024-09-12T18:03:48.007 INFO:teuthology.orchestra.run.smithi098.stderr: 10650K .......... .......... .......... .......... .......... 11% 203M 1s 2024-09-12T18:03:48.007 INFO:teuthology.orchestra.run.smithi098.stderr: 10700K .......... .......... .......... .......... .......... 11% 190M 1s 2024-09-12T18:03:48.007 INFO:teuthology.orchestra.run.smithi098.stderr: 10750K .......... .......... .......... .......... .......... 11% 171M 1s 2024-09-12T18:03:48.007 INFO:teuthology.orchestra.run.smithi098.stderr: 10800K .......... .......... .......... .......... .......... 11% 206M 1s 2024-09-12T18:03:48.007 INFO:teuthology.orchestra.run.smithi098.stderr: 10850K .......... .......... .......... .......... .......... 11% 209M 1s 2024-09-12T18:03:48.007 INFO:teuthology.orchestra.run.smithi098.stderr: 10900K .......... .......... .......... .......... .......... 11% 229M 1s 2024-09-12T18:03:48.007 INFO:teuthology.orchestra.run.smithi098.stderr: 10950K .......... .......... .......... .......... .......... 11% 184M 1s 2024-09-12T18:03:48.007 INFO:teuthology.orchestra.run.smithi098.stderr: 11000K .......... .......... .......... .......... .......... 11% 178M 1s 2024-09-12T18:03:48.007 INFO:teuthology.orchestra.run.smithi098.stderr: 11050K .......... .......... .......... .......... .......... 11% 205M 1s 2024-09-12T18:03:48.007 INFO:teuthology.orchestra.run.smithi098.stderr: 11100K .......... .......... .......... .......... .......... 12% 218M 1s 2024-09-12T18:03:48.007 INFO:teuthology.orchestra.run.smithi098.stderr: 11150K .......... .......... .......... .......... .......... 12% 172M 1s 2024-09-12T18:03:48.008 INFO:teuthology.orchestra.run.smithi098.stderr: 11200K .......... .......... .......... .......... .......... 12% 199M 1s 2024-09-12T18:03:48.008 INFO:teuthology.orchestra.run.smithi098.stderr: 11250K .......... .......... .......... .......... .......... 12% 217M 1s 2024-09-12T18:03:48.008 INFO:teuthology.orchestra.run.smithi098.stderr: 11300K .......... .......... .......... .......... .......... 12% 204M 1s 2024-09-12T18:03:48.008 INFO:teuthology.orchestra.run.smithi098.stderr: 11350K .......... .......... .......... .......... .......... 12% 187M 1s 2024-09-12T18:03:48.008 INFO:teuthology.orchestra.run.smithi098.stderr: 11400K .......... .......... .......... .......... .......... 12% 198M 1s 2024-09-12T18:03:48.008 INFO:teuthology.orchestra.run.smithi098.stderr: 11450K .......... .......... .......... .......... .......... 12% 195M 1s 2024-09-12T18:03:48.008 INFO:teuthology.orchestra.run.smithi098.stderr: 11500K .......... .......... .......... .......... .......... 12% 194M 1s 2024-09-12T18:03:48.008 INFO:teuthology.orchestra.run.smithi098.stderr: 11550K .......... .......... .......... .......... .......... 12% 189M 1s 2024-09-12T18:03:48.008 INFO:teuthology.orchestra.run.smithi098.stderr: 11600K .......... .......... .......... .......... .......... 12% 215M 1s 2024-09-12T18:03:48.008 INFO:teuthology.orchestra.run.smithi098.stderr: 11650K .......... .......... .......... .......... .......... 12% 238M 1s 2024-09-12T18:03:48.008 INFO:teuthology.orchestra.run.smithi098.stderr: 11700K .......... .......... .......... .......... .......... 12% 219M 1s 2024-09-12T18:03:48.008 INFO:teuthology.orchestra.run.smithi098.stderr: 11750K .......... .......... .......... .......... .......... 12% 183M 1s 2024-09-12T18:03:48.008 INFO:teuthology.orchestra.run.smithi098.stderr: 11800K .......... .......... .......... .......... .......... 12% 229M 1s 2024-09-12T18:03:48.009 INFO:teuthology.orchestra.run.smithi098.stderr: 11850K .......... .......... .......... .......... .......... 12% 237M 1s 2024-09-12T18:03:48.009 INFO:teuthology.orchestra.run.smithi098.stderr: 11900K .......... .......... .......... .......... .......... 12% 231M 1s 2024-09-12T18:03:48.009 INFO:teuthology.orchestra.run.smithi098.stderr: 11950K .......... .......... .......... .......... .......... 12% 182M 1s 2024-09-12T18:03:48.009 INFO:teuthology.orchestra.run.smithi098.stderr: 12000K .......... .......... .......... .......... .......... 12% 205M 1s 2024-09-12T18:03:48.009 INFO:teuthology.orchestra.run.smithi098.stderr: 12050K .......... .......... .......... .......... .......... 13% 213M 1s 2024-09-12T18:03:48.009 INFO:teuthology.orchestra.run.smithi098.stderr: 12100K .......... .......... .......... .......... .......... 13% 209M 1s 2024-09-12T18:03:48.009 INFO:teuthology.orchestra.run.smithi098.stderr: 12150K .......... .......... .......... .......... .......... 13% 193M 1s 2024-09-12T18:03:48.009 INFO:teuthology.orchestra.run.smithi098.stderr: 12200K .......... .......... .......... .......... .......... 13% 245M 1s 2024-09-12T18:03:48.009 INFO:teuthology.orchestra.run.smithi098.stderr: 12250K .......... .......... .......... .......... .......... 13% 230M 1s 2024-09-12T18:03:48.009 INFO:teuthology.orchestra.run.smithi098.stderr: 12300K .......... .......... .......... .......... .......... 13% 241M 1s 2024-09-12T18:03:48.009 INFO:teuthology.orchestra.run.smithi098.stderr: 12350K .......... .......... .......... .......... .......... 13% 187M 1s 2024-09-12T18:03:48.009 INFO:teuthology.orchestra.run.smithi098.stderr: 12400K .......... .......... .......... .......... .......... 13% 171M 1s 2024-09-12T18:03:48.009 INFO:teuthology.orchestra.run.smithi098.stderr: 12450K .......... .......... .......... .......... .......... 13% 251M 1s 2024-09-12T18:03:48.009 INFO:teuthology.orchestra.run.smithi098.stderr: 12500K .......... .......... .......... .......... .......... 13% 222M 1s 2024-09-12T18:03:48.010 INFO:teuthology.orchestra.run.smithi098.stderr: 12550K .......... .......... .......... .......... .......... 13% 219M 1s 2024-09-12T18:03:48.010 INFO:teuthology.orchestra.run.smithi098.stderr: 12600K .......... .......... .......... .......... .......... 13% 225M 1s 2024-09-12T18:03:48.010 INFO:teuthology.orchestra.run.smithi098.stderr: 12650K .......... .......... .......... .......... .......... 13% 219M 1s 2024-09-12T18:03:48.010 INFO:teuthology.orchestra.run.smithi098.stderr: 12700K .......... .......... .......... .......... .......... 13% 253M 1s 2024-09-12T18:03:48.010 INFO:teuthology.orchestra.run.smithi098.stderr: 12750K .......... .......... .......... .......... .......... 13% 194M 1s 2024-09-12T18:03:48.010 INFO:teuthology.orchestra.run.smithi098.stderr: 12800K .......... .......... .......... .......... .......... 13% 232M 1s 2024-09-12T18:03:48.010 INFO:teuthology.orchestra.run.smithi098.stderr: 12850K .......... .......... .......... .......... .......... 13% 225M 1s 2024-09-12T18:03:48.010 INFO:teuthology.orchestra.run.smithi098.stderr: 12900K .......... .......... .......... .......... .......... 13% 192M 1s 2024-09-12T18:03:48.010 INFO:teuthology.orchestra.run.smithi098.stderr: 12950K .......... .......... .......... .......... .......... 13% 218M 1s 2024-09-12T18:03:48.010 INFO:teuthology.orchestra.run.smithi098.stderr: 13000K .......... .......... .......... .......... .......... 14% 235M 1s 2024-09-12T18:03:48.010 INFO:teuthology.orchestra.run.smithi098.stderr: 13050K .......... .......... .......... .......... .......... 14% 233M 1s 2024-09-12T18:03:48.010 INFO:teuthology.orchestra.run.smithi098.stderr: 13100K .......... .......... .......... .......... .......... 14% 222M 1s 2024-09-12T18:03:48.010 INFO:teuthology.orchestra.run.smithi098.stderr: 13150K .......... .......... .......... .......... .......... 14% 200M 1s 2024-09-12T18:03:48.010 INFO:teuthology.orchestra.run.smithi098.stderr: 13200K .......... .......... .......... .......... .......... 14% 228M 1s 2024-09-12T18:03:48.011 INFO:teuthology.orchestra.run.smithi098.stderr: 13250K .......... .......... .......... .......... .......... 14% 232M 1s 2024-09-12T18:03:48.011 INFO:teuthology.orchestra.run.smithi098.stderr: 13300K .......... .......... .......... .......... .......... 14% 201M 1s 2024-09-12T18:03:48.011 INFO:teuthology.orchestra.run.smithi098.stderr: 13350K .......... .......... .......... .......... .......... 14% 218M 1s 2024-09-12T18:03:48.011 INFO:teuthology.orchestra.run.smithi098.stderr: 13400K .......... .......... .......... .......... .......... 14% 270M 1s 2024-09-12T18:03:48.011 INFO:teuthology.orchestra.run.smithi098.stderr: 13450K .......... .......... .......... .......... .......... 14% 223M 1s 2024-09-12T18:03:48.011 INFO:teuthology.orchestra.run.smithi098.stderr: 13500K .......... .......... .......... .......... .......... 14% 228M 1s 2024-09-12T18:03:48.011 INFO:teuthology.orchestra.run.smithi098.stderr: 13550K .......... .......... .......... .......... .......... 14% 210M 1s 2024-09-12T18:03:48.011 INFO:teuthology.orchestra.run.smithi098.stderr: 13600K .......... .......... .......... .......... .......... 14% 255M 1s 2024-09-12T18:03:48.011 INFO:teuthology.orchestra.run.smithi098.stderr: 13650K .......... .......... .......... .......... .......... 14% 205M 1s 2024-09-12T18:03:48.011 INFO:teuthology.orchestra.run.smithi098.stderr: 13700K .......... .......... .......... .......... .......... 14% 228M 1s 2024-09-12T18:03:48.011 INFO:teuthology.orchestra.run.smithi098.stderr: 13750K .......... .......... .......... .......... .......... 14% 222M 1s 2024-09-12T18:03:48.011 INFO:teuthology.orchestra.run.smithi098.stderr: 13800K .......... .......... .......... .......... .......... 14% 235M 1s 2024-09-12T18:03:48.011 INFO:teuthology.orchestra.run.smithi098.stderr: 13850K .......... .......... .......... .......... .......... 14% 237M 1s 2024-09-12T18:03:48.011 INFO:teuthology.orchestra.run.smithi098.stderr: 13900K .......... .......... .......... .......... .......... 15% 263M 1s 2024-09-12T18:03:48.012 INFO:teuthology.orchestra.run.smithi098.stderr: 13950K .......... .......... .......... .......... .......... 15% 221M 1s 2024-09-12T18:03:48.012 INFO:teuthology.orchestra.run.smithi098.stderr: 14000K .......... .......... .......... .......... .......... 15% 237M 1s 2024-09-12T18:03:48.012 INFO:teuthology.orchestra.run.smithi098.stderr: 14050K .......... .......... .......... .......... .......... 15% 263M 1s 2024-09-12T18:03:48.012 INFO:teuthology.orchestra.run.smithi098.stderr: 14100K .......... .......... .......... .......... .......... 15% 260M 1s 2024-09-12T18:03:48.012 INFO:teuthology.orchestra.run.smithi098.stderr: 14150K .......... .......... .......... .......... .......... 15% 225M 1s 2024-09-12T18:03:48.012 INFO:teuthology.orchestra.run.smithi098.stderr: 14200K .......... .......... .......... .......... .......... 15% 211M 1s 2024-09-12T18:03:48.012 INFO:teuthology.orchestra.run.smithi098.stderr: 14250K .......... .......... .......... .......... .......... 15% 227M 1s 2024-09-12T18:03:48.012 INFO:teuthology.orchestra.run.smithi098.stderr: 14300K .......... .......... .......... .......... .......... 15% 259M 1s 2024-09-12T18:03:48.012 INFO:teuthology.orchestra.run.smithi098.stderr: 14350K .......... .......... .......... .......... .......... 15% 202M 1s 2024-09-12T18:03:48.012 INFO:teuthology.orchestra.run.smithi098.stderr: 14400K .......... .......... .......... .......... .......... 15% 253M 1s 2024-09-12T18:03:48.012 INFO:teuthology.orchestra.run.smithi098.stderr: 14450K .......... .......... .......... .......... .......... 15% 259M 1s 2024-09-12T18:03:48.012 INFO:teuthology.orchestra.run.smithi098.stderr: 14500K .......... .......... .......... .......... .......... 15% 268M 1s 2024-09-12T18:03:48.012 INFO:teuthology.orchestra.run.smithi098.stderr: 14550K .......... .......... .......... .......... .......... 15% 235M 1s 2024-09-12T18:03:48.013 INFO:teuthology.orchestra.run.smithi098.stderr: 14600K .......... .......... .......... .......... .......... 15% 259M 1s 2024-09-12T18:03:48.013 INFO:teuthology.orchestra.run.smithi098.stderr: 14650K .......... .......... .......... .......... .......... 15% 271M 1s 2024-09-12T18:03:48.013 INFO:teuthology.orchestra.run.smithi098.stderr: 14700K .......... .......... .......... .......... .......... 15% 261M 1s 2024-09-12T18:03:48.013 INFO:teuthology.orchestra.run.smithi098.stderr: 14750K .......... .......... .......... .......... .......... 15% 208M 1s 2024-09-12T18:03:48.013 INFO:teuthology.orchestra.run.smithi098.stderr: 14800K .......... .......... .......... .......... .......... 15% 259M 1s 2024-09-12T18:03:48.013 INFO:teuthology.orchestra.run.smithi098.stderr: 14850K .......... .......... .......... .......... .......... 16% 238M 1s 2024-09-12T18:03:48.013 INFO:teuthology.orchestra.run.smithi098.stderr: 14900K .......... .......... .......... .......... .......... 16% 255M 1s 2024-09-12T18:03:48.013 INFO:teuthology.orchestra.run.smithi098.stderr: 14950K .......... .......... .......... .......... .......... 16% 257M 1s 2024-09-12T18:03:48.013 INFO:teuthology.orchestra.run.smithi098.stderr: 15000K .......... .......... .......... .......... .......... 16% 272M 1s 2024-09-12T18:03:48.013 INFO:teuthology.orchestra.run.smithi098.stderr: 15050K .......... .......... .......... .......... .......... 16% 273M 1s 2024-09-12T18:03:48.013 INFO:teuthology.orchestra.run.smithi098.stderr: 15100K .......... .......... .......... .......... .......... 16% 284M 1s 2024-09-12T18:03:48.013 INFO:teuthology.orchestra.run.smithi098.stderr: 15150K .......... .......... .......... .......... .......... 16% 235M 1s 2024-09-12T18:03:48.013 INFO:teuthology.orchestra.run.smithi098.stderr: 15200K .......... .......... .......... .......... .......... 16% 258M 1s 2024-09-12T18:03:48.013 INFO:teuthology.orchestra.run.smithi098.stderr: 15250K .......... .......... .......... .......... .......... 16% 239M 1s 2024-09-12T18:03:48.014 INFO:teuthology.orchestra.run.smithi098.stderr: 15300K .......... .......... .......... .......... .......... 16% 281M 1s 2024-09-12T18:03:48.014 INFO:teuthology.orchestra.run.smithi098.stderr: 15350K .......... .......... .......... .......... .......... 16% 235M 1s 2024-09-12T18:03:48.014 INFO:teuthology.orchestra.run.smithi098.stderr: 15400K .......... .......... .......... .......... .......... 16% 253M 1s 2024-09-12T18:03:48.014 INFO:teuthology.orchestra.run.smithi098.stderr: 15450K .......... .......... .......... .......... .......... 16% 252M 1s 2024-09-12T18:03:48.014 INFO:teuthology.orchestra.run.smithi098.stderr: 15500K .......... .......... .......... .......... .......... 16% 263M 1s 2024-09-12T18:03:48.014 INFO:teuthology.orchestra.run.smithi098.stderr: 15550K .......... .......... .......... .......... .......... 16% 244M 1s 2024-09-12T18:03:48.014 INFO:teuthology.orchestra.run.smithi098.stderr: 15600K .......... .......... .......... .......... .......... 16% 277M 1s 2024-09-12T18:03:48.014 INFO:teuthology.orchestra.run.smithi098.stderr: 15650K .......... .......... .......... .......... .......... 16% 281M 1s 2024-09-12T18:03:48.014 INFO:teuthology.orchestra.run.smithi098.stderr: 15700K .......... .......... .......... .......... .......... 16% 257M 1s 2024-09-12T18:03:48.014 INFO:teuthology.orchestra.run.smithi098.stderr: 15750K .......... .......... .......... .......... .......... 17% 251M 1s 2024-09-12T18:03:48.014 INFO:teuthology.orchestra.run.smithi098.stderr: 15800K .......... .......... .......... .......... .......... 17% 259M 1s 2024-09-12T18:03:48.014 INFO:teuthology.orchestra.run.smithi098.stderr: 15850K .......... .......... .......... .......... .......... 17% 282M 1s 2024-09-12T18:03:48.014 INFO:teuthology.orchestra.run.smithi098.stderr: 15900K .......... .......... .......... .......... .......... 17% 277M 1s 2024-09-12T18:03:48.014 INFO:teuthology.orchestra.run.smithi098.stderr: 15950K .......... .......... .......... .......... .......... 17% 229M 1s 2024-09-12T18:03:48.014 INFO:teuthology.orchestra.run.smithi098.stderr: 16000K .......... .......... .......... .......... .......... 17% 277M 1s 2024-09-12T18:03:48.015 INFO:teuthology.orchestra.run.smithi098.stderr: 16050K .......... .......... .......... .......... .......... 17% 285M 1s 2024-09-12T18:03:48.015 INFO:teuthology.orchestra.run.smithi098.stderr: 16100K .......... .......... .......... .......... .......... 17% 276M 1s 2024-09-12T18:03:48.015 INFO:teuthology.orchestra.run.smithi098.stderr: 16150K .......... .......... .......... .......... .......... 17% 250M 1s 2024-09-12T18:03:48.015 INFO:teuthology.orchestra.run.smithi098.stderr: 16200K .......... .......... .......... .......... .......... 17% 298M 1s 2024-09-12T18:03:48.015 INFO:teuthology.orchestra.run.smithi098.stderr: 16250K .......... .......... .......... .......... .......... 17% 279M 1s 2024-09-12T18:03:48.015 INFO:teuthology.orchestra.run.smithi098.stderr: 16300K .......... .......... .......... .......... .......... 17% 270M 1s 2024-09-12T18:03:48.015 INFO:teuthology.orchestra.run.smithi098.stderr: 16350K .......... .......... .......... .......... .......... 17% 221M 1s 2024-09-12T18:03:48.015 INFO:teuthology.orchestra.run.smithi098.stderr: 16400K .......... .......... .......... .......... .......... 17% 264M 1s 2024-09-12T18:03:48.015 INFO:teuthology.orchestra.run.smithi098.stderr: 16450K .......... .......... .......... .......... .......... 17% 245M 1s 2024-09-12T18:03:48.015 INFO:teuthology.orchestra.run.smithi098.stderr: 16500K .......... .......... .......... .......... .......... 17% 194M 1s 2024-09-12T18:03:48.015 INFO:teuthology.orchestra.run.smithi098.stderr: 16550K .......... .......... .......... .......... .......... 17% 251M 1s 2024-09-12T18:03:48.015 INFO:teuthology.orchestra.run.smithi098.stderr: 16600K .......... .......... .......... .......... .......... 17% 221M 1s 2024-09-12T18:03:48.015 INFO:teuthology.orchestra.run.smithi098.stderr: 16650K .......... .......... .......... .......... .......... 17% 257M 1s 2024-09-12T18:03:48.015 INFO:teuthology.orchestra.run.smithi098.stderr: 16700K .......... .......... .......... .......... .......... 18% 241M 1s 2024-09-12T18:03:48.016 INFO:teuthology.orchestra.run.smithi098.stderr: 16750K .......... .......... .......... .......... .......... 18% 210M 1s 2024-09-12T18:03:48.016 INFO:teuthology.orchestra.run.smithi098.stderr: 16800K .......... .......... .......... .......... .......... 18% 251M 1s 2024-09-12T18:03:48.016 INFO:teuthology.orchestra.run.smithi098.stderr: 16850K .......... .......... .......... .......... .......... 18% 241M 1s 2024-09-12T18:03:48.016 INFO:teuthology.orchestra.run.smithi098.stderr: 16900K .......... .......... .......... .......... .......... 18% 267M 1s 2024-09-12T18:03:48.016 INFO:teuthology.orchestra.run.smithi098.stderr: 16950K .......... .......... .......... .......... .......... 18% 254M 1s 2024-09-12T18:03:48.016 INFO:teuthology.orchestra.run.smithi098.stderr: 17000K .......... .......... .......... .......... .......... 18% 297M 1s 2024-09-12T18:03:48.016 INFO:teuthology.orchestra.run.smithi098.stderr: 17050K .......... .......... .......... .......... .......... 18% 262M 1s 2024-09-12T18:03:48.016 INFO:teuthology.orchestra.run.smithi098.stderr: 17100K .......... .......... .......... .......... .......... 18% 305M 1s 2024-09-12T18:03:48.016 INFO:teuthology.orchestra.run.smithi098.stderr: 17150K .......... .......... .......... .......... .......... 18% 237M 1s 2024-09-12T18:03:48.016 INFO:teuthology.orchestra.run.smithi098.stderr: 17200K .......... .......... .......... .......... .......... 18% 282M 1s 2024-09-12T18:03:48.016 INFO:teuthology.orchestra.run.smithi098.stderr: 17250K .......... .......... .......... .......... .......... 18% 288M 1s 2024-09-12T18:03:48.016 INFO:teuthology.orchestra.run.smithi098.stderr: 17300K .......... .......... .......... .......... .......... 18% 269M 1s 2024-09-12T18:03:48.016 INFO:teuthology.orchestra.run.smithi098.stderr: 17350K .......... .......... .......... .......... .......... 18% 261M 1s 2024-09-12T18:03:48.016 INFO:teuthology.orchestra.run.smithi098.stderr: 17400K .......... .......... .......... .......... .......... 18% 271M 1s 2024-09-12T18:03:48.017 INFO:teuthology.orchestra.run.smithi098.stderr: 17450K .......... .......... .......... .......... .......... 18% 283M 1s 2024-09-12T18:03:48.017 INFO:teuthology.orchestra.run.smithi098.stderr: 17500K .......... .......... .......... .......... .......... 18% 279M 1s 2024-09-12T18:03:48.017 INFO:teuthology.orchestra.run.smithi098.stderr: 17550K .......... .......... .......... .......... .......... 18% 258M 1s 2024-09-12T18:03:48.017 INFO:teuthology.orchestra.run.smithi098.stderr: 17600K .......... .......... .......... .......... .......... 18% 305M 1s 2024-09-12T18:03:48.017 INFO:teuthology.orchestra.run.smithi098.stderr: 17650K .......... .......... .......... .......... .......... 19% 203M 1s 2024-09-12T18:03:48.017 INFO:teuthology.orchestra.run.smithi098.stderr: 17700K .......... .......... .......... .......... .......... 19% 267M 1s 2024-09-12T18:03:48.017 INFO:teuthology.orchestra.run.smithi098.stderr: 17750K .......... .......... .......... .......... .......... 19% 275M 1s 2024-09-12T18:03:48.017 INFO:teuthology.orchestra.run.smithi098.stderr: 17800K .......... .......... .......... .......... .......... 19% 304M 1s 2024-09-12T18:03:48.017 INFO:teuthology.orchestra.run.smithi098.stderr: 17850K .......... .......... .......... .......... .......... 19% 82.3M 1s 2024-09-12T18:03:48.017 INFO:teuthology.orchestra.run.smithi098.stderr: 17900K .......... .......... .......... .......... .......... 19% 290M 1s 2024-09-12T18:03:48.017 INFO:teuthology.orchestra.run.smithi098.stderr: 17950K .......... .......... .......... .......... .......... 19% 233M 1s 2024-09-12T18:03:48.017 INFO:teuthology.orchestra.run.smithi098.stderr: 18000K .......... .......... .......... .......... .......... 19% 309M 1s 2024-09-12T18:03:48.017 INFO:teuthology.orchestra.run.smithi098.stderr: 18050K .......... .......... .......... .......... .......... 19% 55.4M 1s 2024-09-12T18:03:48.017 INFO:teuthology.orchestra.run.smithi098.stderr: 18100K .......... .......... .......... .......... .......... 19% 224M 1s 2024-09-12T18:03:48.018 INFO:teuthology.orchestra.run.smithi098.stderr: 18150K .......... .......... .......... .......... .......... 19% 263M 1s 2024-09-12T18:03:48.018 INFO:teuthology.orchestra.run.smithi098.stderr: 18200K .......... .......... .......... .......... .......... 19% 289M 1s 2024-09-12T18:03:48.018 INFO:teuthology.orchestra.run.smithi098.stderr: 18250K .......... .......... .......... .......... .......... 19% 281M 1s 2024-09-12T18:03:48.018 INFO:teuthology.orchestra.run.smithi098.stderr: 18300K .......... .......... .......... .......... .......... 19% 288M 1s 2024-09-12T18:03:48.018 INFO:teuthology.orchestra.run.smithi098.stderr: 18350K .......... .......... .......... .......... .......... 19% 236M 1s 2024-09-12T18:03:48.018 INFO:teuthology.orchestra.run.smithi098.stderr: 18400K .......... .......... .......... .......... .......... 19% 303M 1s 2024-09-12T18:03:48.018 INFO:teuthology.orchestra.run.smithi098.stderr: 18450K .......... .......... .......... .......... .......... 19% 311M 1s 2024-09-12T18:03:48.018 INFO:teuthology.orchestra.run.smithi098.stderr: 18500K .......... .......... .......... .......... .......... 19% 298M 1s 2024-09-12T18:03:48.018 INFO:teuthology.orchestra.run.smithi098.stderr: 18550K .......... .......... .......... .......... .......... 20% 268M 1s 2024-09-12T18:03:48.018 INFO:teuthology.orchestra.run.smithi098.stderr: 18600K .......... .......... .......... .......... .......... 20% 303M 1s 2024-09-12T18:03:48.018 INFO:teuthology.orchestra.run.smithi098.stderr: 18650K .......... .......... .......... .......... .......... 20% 301M 1s 2024-09-12T18:03:48.018 INFO:teuthology.orchestra.run.smithi098.stderr: 18700K .......... .......... .......... .......... .......... 20% 311M 1s 2024-09-12T18:03:48.018 INFO:teuthology.orchestra.run.smithi098.stderr: 18750K .......... .......... .......... .......... .......... 20% 217M 1s 2024-09-12T18:03:48.018 INFO:teuthology.orchestra.run.smithi098.stderr: 18800K .......... .......... .......... .......... .......... 20% 311M 1s 2024-09-12T18:03:48.018 INFO:teuthology.orchestra.run.smithi098.stderr: 18850K .......... .......... .......... .......... .......... 20% 303M 1s 2024-09-12T18:03:48.019 INFO:teuthology.orchestra.run.smithi098.stderr: 18900K .......... .......... .......... .......... .......... 20% 288M 1s 2024-09-12T18:03:48.019 INFO:teuthology.orchestra.run.smithi098.stderr: 18950K .......... .......... .......... .......... .......... 20% 253M 1s 2024-09-12T18:03:48.019 INFO:teuthology.orchestra.run.smithi098.stderr: 19000K .......... .......... .......... .......... .......... 20% 320M 1s 2024-09-12T18:03:48.019 INFO:teuthology.orchestra.run.smithi098.stderr: 19050K .......... .......... .......... .......... .......... 20% 318M 1s 2024-09-12T18:03:48.019 INFO:teuthology.orchestra.run.smithi098.stderr: 19100K .......... .......... .......... .......... .......... 20% 325M 1s 2024-09-12T18:03:48.019 INFO:teuthology.orchestra.run.smithi098.stderr: 19150K .......... .......... .......... .......... .......... 20% 273M 1s 2024-09-12T18:03:48.019 INFO:teuthology.orchestra.run.smithi098.stderr: 19200K .......... .......... .......... .......... .......... 20% 133M 1s 2024-09-12T18:03:48.019 INFO:teuthology.orchestra.run.smithi098.stderr: 19250K .......... .......... .......... .......... .......... 20% 280M 1s 2024-09-12T18:03:48.019 INFO:teuthology.orchestra.run.smithi098.stderr: 19300K .......... .......... .......... .......... .......... 20% 284M 1s 2024-09-12T18:03:48.019 INFO:teuthology.orchestra.run.smithi098.stderr: 19350K .......... .......... .......... .......... .......... 20% 251M 1s 2024-09-12T18:03:48.019 INFO:teuthology.orchestra.run.smithi098.stderr: 19400K .......... .......... .......... .......... .......... 20% 313M 1s 2024-09-12T18:03:48.019 INFO:teuthology.orchestra.run.smithi098.stderr: 19450K .......... .......... .......... .......... .......... 20% 328M 1s 2024-09-12T18:03:48.019 INFO:teuthology.orchestra.run.smithi098.stderr: 19500K .......... .......... .......... .......... .......... 21% 303M 1s 2024-09-12T18:03:48.019 INFO:teuthology.orchestra.run.smithi098.stderr: 19550K .......... .......... .......... .......... .......... 21% 252M 1s 2024-09-12T18:03:48.020 INFO:teuthology.orchestra.run.smithi098.stderr: 19600K .......... .......... .......... .......... .......... 21% 312M 1s 2024-09-12T18:03:48.020 INFO:teuthology.orchestra.run.smithi098.stderr: 19650K .......... .......... .......... .......... .......... 21% 303M 1s 2024-09-12T18:03:48.020 INFO:teuthology.orchestra.run.smithi098.stderr: 19700K .......... .......... .......... .......... .......... 21% 295M 1s 2024-09-12T18:03:48.020 INFO:teuthology.orchestra.run.smithi098.stderr: 19750K .......... .......... .......... .......... .......... 21% 260M 1s 2024-09-12T18:03:48.020 INFO:teuthology.orchestra.run.smithi098.stderr: 19800K .......... .......... .......... .......... .......... 21% 305M 1s 2024-09-12T18:03:48.020 INFO:teuthology.orchestra.run.smithi098.stderr: 19850K .......... .......... .......... .......... .......... 21% 308M 1s 2024-09-12T18:03:48.020 INFO:teuthology.orchestra.run.smithi098.stderr: 19900K .......... .......... .......... .......... .......... 21% 295M 1s 2024-09-12T18:03:48.020 INFO:teuthology.orchestra.run.smithi098.stderr: 19950K .......... .......... .......... .......... .......... 21% 262M 1s 2024-09-12T18:03:48.020 INFO:teuthology.orchestra.run.smithi098.stderr: 20000K .......... .......... .......... .......... .......... 21% 284M 1s 2024-09-12T18:03:48.020 INFO:teuthology.orchestra.run.smithi098.stderr: 20050K .......... .......... .......... .......... .......... 21% 305M 1s 2024-09-12T18:03:48.020 INFO:teuthology.orchestra.run.smithi098.stderr: 20100K .......... .......... .......... .......... .......... 21% 283M 1s 2024-09-12T18:03:48.020 INFO:teuthology.orchestra.run.smithi098.stderr: 20150K .......... .......... .......... .......... .......... 21% 286M 1s 2024-09-12T18:03:48.020 INFO:teuthology.orchestra.run.smithi098.stderr: 20200K .......... .......... .......... .......... .......... 21% 288M 1s 2024-09-12T18:03:48.020 INFO:teuthology.orchestra.run.smithi098.stderr: 20250K .......... .......... .......... .......... .......... 21% 302M 1s 2024-09-12T18:03:48.021 INFO:teuthology.orchestra.run.smithi098.stderr: 20300K .......... .......... .......... .......... .......... 21% 313M 1s 2024-09-12T18:03:48.021 INFO:teuthology.orchestra.run.smithi098.stderr: 20350K .......... .......... .......... .......... .......... 21% 253M 1s 2024-09-12T18:03:48.021 INFO:teuthology.orchestra.run.smithi098.stderr: 20400K .......... .......... .......... .......... .......... 22% 286M 1s 2024-09-12T18:03:48.021 INFO:teuthology.orchestra.run.smithi098.stderr: 20450K .......... .......... .......... .......... .......... 22% 211M 1s 2024-09-12T18:03:48.021 INFO:teuthology.orchestra.run.smithi098.stderr: 20500K .......... .......... .......... .......... .......... 22% 306M 1s 2024-09-12T18:03:48.021 INFO:teuthology.orchestra.run.smithi098.stderr: 20550K .......... .......... .......... .......... .......... 22% 227M 1s 2024-09-12T18:03:48.021 INFO:teuthology.orchestra.run.smithi098.stderr: 20600K .......... .......... .......... .......... .......... 22% 238M 1s 2024-09-12T18:03:48.021 INFO:teuthology.orchestra.run.smithi098.stderr: 20650K .......... .......... .......... .......... .......... 22% 277M 1s 2024-09-12T18:03:48.021 INFO:teuthology.orchestra.run.smithi098.stderr: 20700K .......... .......... .......... .......... .......... 22% 251M 1s 2024-09-12T18:03:48.021 INFO:teuthology.orchestra.run.smithi098.stderr: 20750K .......... .......... .......... .......... .......... 22% 326M 1s 2024-09-12T18:03:48.021 INFO:teuthology.orchestra.run.smithi098.stderr: 20800K .......... .......... .......... .......... .......... 22% 149M 1s 2024-09-12T18:03:48.021 INFO:teuthology.orchestra.run.smithi098.stderr: 20850K .......... .......... .......... .......... .......... 22% 204M 1s 2024-09-12T18:03:48.021 INFO:teuthology.orchestra.run.smithi098.stderr: 20900K .......... .......... .......... .......... .......... 22% 103M 1s 2024-09-12T18:03:48.021 INFO:teuthology.orchestra.run.smithi098.stderr: 20950K .......... .......... .......... .......... .......... 22% 42.0M 1s 2024-09-12T18:03:48.022 INFO:teuthology.orchestra.run.smithi098.stderr: 21000K .......... .......... .......... .......... .......... 22% 300M 1s 2024-09-12T18:03:48.022 INFO:teuthology.orchestra.run.smithi098.stderr: 21050K .......... .......... .......... .......... .......... 22% 277M 1s 2024-09-12T18:03:48.022 INFO:teuthology.orchestra.run.smithi098.stderr: 21100K .......... .......... .......... .......... .......... 22% 244M 1s 2024-09-12T18:03:48.022 INFO:teuthology.orchestra.run.smithi098.stderr: 21150K .......... .......... .......... .......... .......... 22% 322M 1s 2024-09-12T18:03:48.022 INFO:teuthology.orchestra.run.smithi098.stderr: 21200K .......... .......... .......... .......... .......... 22% 318M 1s 2024-09-12T18:03:48.022 INFO:teuthology.orchestra.run.smithi098.stderr: 21250K .......... .......... .......... .......... .......... 22% 287M 1s 2024-09-12T18:03:48.022 INFO:teuthology.orchestra.run.smithi098.stderr: 21300K .......... .......... .......... .......... .......... 22% 285M 1s 2024-09-12T18:03:48.022 INFO:teuthology.orchestra.run.smithi098.stderr: 21350K .......... .......... .......... .......... .......... 23% 332M 1s 2024-09-12T18:03:48.022 INFO:teuthology.orchestra.run.smithi098.stderr: 21400K .......... .......... .......... .......... .......... 23% 301M 1s 2024-09-12T18:03:48.022 INFO:teuthology.orchestra.run.smithi098.stderr: 21450K .......... .......... .......... .......... .......... 23% 319M 1s 2024-09-12T18:03:48.022 INFO:teuthology.orchestra.run.smithi098.stderr: 21500K .......... .......... .......... .......... .......... 23% 246M 1s 2024-09-12T18:03:48.022 INFO:teuthology.orchestra.run.smithi098.stderr: 21550K .......... .......... .......... .......... .......... 23% 308M 1s 2024-09-12T18:03:48.022 INFO:teuthology.orchestra.run.smithi098.stderr: 21600K .......... .......... .......... .......... .......... 23% 303M 1s 2024-09-12T18:03:48.022 INFO:teuthology.orchestra.run.smithi098.stderr: 21650K .......... .......... .......... .......... .......... 23% 311M 1s 2024-09-12T18:03:48.022 INFO:teuthology.orchestra.run.smithi098.stderr: 21700K .......... .......... .......... .......... .......... 23% 255M 1s 2024-09-12T18:03:48.023 INFO:teuthology.orchestra.run.smithi098.stderr: 21750K .......... .......... .......... .......... .......... 23% 297M 1s 2024-09-12T18:03:48.023 INFO:teuthology.orchestra.run.smithi098.stderr: 21800K .......... .......... .......... .......... .......... 23% 303M 1s 2024-09-12T18:03:48.023 INFO:teuthology.orchestra.run.smithi098.stderr: 21850K .......... .......... .......... .......... .......... 23% 321M 1s 2024-09-12T18:03:48.023 INFO:teuthology.orchestra.run.smithi098.stderr: 21900K .......... .......... .......... .......... .......... 23% 269M 1s 2024-09-12T18:03:48.023 INFO:teuthology.orchestra.run.smithi098.stderr: 21950K .......... .......... .......... .......... .......... 23% 327M 1s 2024-09-12T18:03:48.023 INFO:teuthology.orchestra.run.smithi098.stderr: 22000K .......... .......... .......... .......... .......... 23% 67.9M 1s 2024-09-12T18:03:48.023 INFO:teuthology.orchestra.run.smithi098.stderr: 22050K .......... .......... .......... .......... .......... 23% 287M 1s 2024-09-12T18:03:48.023 INFO:teuthology.orchestra.run.smithi098.stderr: 22100K .......... .......... .......... .......... .......... 23% 255M 1s 2024-09-12T18:03:48.023 INFO:teuthology.orchestra.run.smithi098.stderr: 22150K .......... .......... .......... .......... .......... 23% 288M 1s 2024-09-12T18:03:48.023 INFO:teuthology.orchestra.run.smithi098.stderr: 22200K .......... .......... .......... .......... .......... 23% 293M 1s 2024-09-12T18:03:48.023 INFO:teuthology.orchestra.run.smithi098.stderr: 22250K .......... .......... .......... .......... .......... 24% 329M 1s 2024-09-12T18:03:48.023 INFO:teuthology.orchestra.run.smithi098.stderr: 22300K .......... .......... .......... .......... .......... 24% 275M 1s 2024-09-12T18:03:48.023 INFO:teuthology.orchestra.run.smithi098.stderr: 22350K .......... .......... .......... .......... .......... 24% 310M 1s 2024-09-12T18:03:48.023 INFO:teuthology.orchestra.run.smithi098.stderr: 22400K .......... .......... .......... .......... .......... 24% 222M 1s 2024-09-12T18:03:48.024 INFO:teuthology.orchestra.run.smithi098.stderr: 22450K .......... .......... .......... .......... .......... 24% 247M 1s 2024-09-12T18:03:48.024 INFO:teuthology.orchestra.run.smithi098.stderr: 22500K .......... .......... .......... .......... .......... 24% 192M 1s 2024-09-12T18:03:48.024 INFO:teuthology.orchestra.run.smithi098.stderr: 22550K .......... .......... .......... .......... .......... 24% 247M 1s 2024-09-12T18:03:48.024 INFO:teuthology.orchestra.run.smithi098.stderr: 22600K .......... .......... .......... .......... .......... 24% 283M 1s 2024-09-12T18:03:48.024 INFO:teuthology.orchestra.run.smithi098.stderr: 22650K .......... .......... .......... .......... .......... 24% 263M 1s 2024-09-12T18:03:48.024 INFO:teuthology.orchestra.run.smithi098.stderr: 22700K .......... .......... .......... .......... .......... 24% 229M 1s 2024-09-12T18:03:48.024 INFO:teuthology.orchestra.run.smithi098.stderr: 22750K .......... .......... .......... .......... .......... 24% 291M 1s 2024-09-12T18:03:48.024 INFO:teuthology.orchestra.run.smithi098.stderr: 22800K .......... .......... .......... .......... .......... 24% 293M 1s 2024-09-12T18:03:48.024 INFO:teuthology.orchestra.run.smithi098.stderr: 22850K .......... .......... .......... .......... .......... 24% 320M 1s 2024-09-12T18:03:48.024 INFO:teuthology.orchestra.run.smithi098.stderr: 22900K .......... .......... .......... .......... .......... 24% 242M 1s 2024-09-12T18:03:48.024 INFO:teuthology.orchestra.run.smithi098.stderr: 22950K .......... .......... .......... .......... .......... 24% 308M 1s 2024-09-12T18:03:48.024 INFO:teuthology.orchestra.run.smithi098.stderr: 23000K .......... .......... .......... .......... .......... 24% 312M 1s 2024-09-12T18:03:48.024 INFO:teuthology.orchestra.run.smithi098.stderr: 23050K .......... .......... .......... .......... .......... 24% 325M 1s 2024-09-12T18:03:48.025 INFO:teuthology.orchestra.run.smithi098.stderr: 23100K .......... .......... .......... .......... .......... 24% 268M 1s 2024-09-12T18:03:48.025 INFO:teuthology.orchestra.run.smithi098.stderr: 23150K .......... .......... .......... .......... .......... 24% 291M 1s 2024-09-12T18:03:48.025 INFO:teuthology.orchestra.run.smithi098.stderr: 23200K .......... .......... .......... .......... .......... 25% 320M 1s 2024-09-12T18:03:48.025 INFO:teuthology.orchestra.run.smithi098.stderr: 23250K .......... .......... .......... .......... .......... 25% 274M 1s 2024-09-12T18:03:48.025 INFO:teuthology.orchestra.run.smithi098.stderr: 23300K .......... .......... .......... .......... .......... 25% 263M 1s 2024-09-12T18:03:48.025 INFO:teuthology.orchestra.run.smithi098.stderr: 23350K .......... .......... .......... .......... .......... 25% 311M 1s 2024-09-12T18:03:48.025 INFO:teuthology.orchestra.run.smithi098.stderr: 23400K .......... .......... .......... .......... .......... 25% 301M 1s 2024-09-12T18:03:48.025 INFO:teuthology.orchestra.run.smithi098.stderr: 23450K .......... .......... .......... .......... .......... 25% 310M 1s 2024-09-12T18:03:48.025 INFO:teuthology.orchestra.run.smithi098.stderr: 23500K .......... .......... .......... .......... .......... 25% 262M 1s 2024-09-12T18:03:48.025 INFO:teuthology.orchestra.run.smithi098.stderr: 23550K .......... .......... .......... .......... .......... 25% 296M 1s 2024-09-12T18:03:48.025 INFO:teuthology.orchestra.run.smithi098.stderr: 23600K .......... .......... .......... .......... .......... 25% 316M 1s 2024-09-12T18:03:48.025 INFO:teuthology.orchestra.run.smithi098.stderr: 23650K .......... .......... .......... .......... .......... 25% 308M 1s 2024-09-12T18:03:48.025 INFO:teuthology.orchestra.run.smithi098.stderr: 23700K .......... .......... .......... .......... .......... 25% 275M 1s 2024-09-12T18:03:48.026 INFO:teuthology.orchestra.run.smithi098.stderr: 23750K .......... .......... .......... .......... .......... 25% 313M 1s 2024-09-12T18:03:48.026 INFO:teuthology.orchestra.run.smithi098.stderr: 23800K .......... .......... .......... .......... .......... 25% 302M 1s 2024-09-12T18:03:48.026 INFO:teuthology.orchestra.run.smithi098.stderr: 23850K .......... .......... .......... .......... .......... 25% 325M 1s 2024-09-12T18:03:48.026 INFO:teuthology.orchestra.run.smithi098.stderr: 23900K .......... .......... .......... .......... .......... 25% 43.5M 1s 2024-09-12T18:03:48.026 INFO:teuthology.orchestra.run.smithi098.stderr: 23950K .......... .......... .......... .......... .......... 25% 322M 1s 2024-09-12T18:03:48.026 INFO:teuthology.orchestra.run.smithi098.stderr: 24000K .......... .......... .......... .......... .......... 25% 213M 1s 2024-09-12T18:03:48.026 INFO:teuthology.orchestra.run.smithi098.stderr: 24050K .......... .......... .......... .......... .......... 25% 282M 1s 2024-09-12T18:03:48.026 INFO:teuthology.orchestra.run.smithi098.stderr: 24100K .......... .......... .......... .......... .......... 25% 83.1M 1s 2024-09-12T18:03:48.026 INFO:teuthology.orchestra.run.smithi098.stderr: 24150K .......... .......... .......... .......... .......... 26% 302M 1s 2024-09-12T18:03:48.026 INFO:teuthology.orchestra.run.smithi098.stderr: 24200K .......... .......... .......... .......... .......... 26% 297M 1s 2024-09-12T18:03:48.026 INFO:teuthology.orchestra.run.smithi098.stderr: 24250K .......... .......... .......... .......... .......... 26% 294M 1s 2024-09-12T18:03:48.026 INFO:teuthology.orchestra.run.smithi098.stderr: 24300K .......... .......... .......... .......... .......... 26% 249M 1s 2024-09-12T18:03:48.026 INFO:teuthology.orchestra.run.smithi098.stderr: 24350K .......... .......... .......... .......... .......... 26% 293M 1s 2024-09-12T18:03:48.027 INFO:teuthology.orchestra.run.smithi098.stderr: 24400K .......... .......... .......... .......... .......... 26% 309M 1s 2024-09-12T18:03:48.027 INFO:teuthology.orchestra.run.smithi098.stderr: 24450K .......... .......... .......... .......... .......... 26% 214M 1s 2024-09-12T18:03:48.027 INFO:teuthology.orchestra.run.smithi098.stderr: 24500K .......... .......... .......... .......... .......... 26% 263M 1s 2024-09-12T18:03:48.027 INFO:teuthology.orchestra.run.smithi098.stderr: 24550K .......... .......... .......... .......... .......... 26% 233M 1s 2024-09-12T18:03:48.027 INFO:teuthology.orchestra.run.smithi098.stderr: 24600K .......... .......... .......... .......... .......... 26% 208M 1s 2024-09-12T18:03:48.027 INFO:teuthology.orchestra.run.smithi098.stderr: 24650K .......... .......... .......... .......... .......... 26% 309M 1s 2024-09-12T18:03:48.027 INFO:teuthology.orchestra.run.smithi098.stderr: 24700K .......... .......... .......... .......... .......... 26% 202M 1s 2024-09-12T18:03:48.027 INFO:teuthology.orchestra.run.smithi098.stderr: 24750K .......... .......... .......... .......... .......... 26% 303M 1s 2024-09-12T18:03:48.027 INFO:teuthology.orchestra.run.smithi098.stderr: 24800K .......... .......... .......... .......... .......... 26% 307M 1s 2024-09-12T18:03:48.027 INFO:teuthology.orchestra.run.smithi098.stderr: 24850K .......... .......... .......... .......... .......... 26% 315M 1s 2024-09-12T18:03:48.027 INFO:teuthology.orchestra.run.smithi098.stderr: 24900K .......... .......... .......... .......... .......... 26% 295M 1s 2024-09-12T18:03:48.027 INFO:teuthology.orchestra.run.smithi098.stderr: 24950K .......... .......... .......... .......... .......... 26% 280M 1s 2024-09-12T18:03:48.027 INFO:teuthology.orchestra.run.smithi098.stderr: 25000K .......... .......... .......... .......... .......... 26% 271M 1s 2024-09-12T18:03:48.027 INFO:teuthology.orchestra.run.smithi098.stderr: 25050K .......... .......... .......... .......... .......... 27% 316M 1s 2024-09-12T18:03:48.027 INFO:teuthology.orchestra.run.smithi098.stderr: 25100K .......... .......... .......... .......... .......... 27% 244M 1s 2024-09-12T18:03:48.028 INFO:teuthology.orchestra.run.smithi098.stderr: 25150K .......... .......... .......... .......... .......... 27% 288M 1s 2024-09-12T18:03:48.028 INFO:teuthology.orchestra.run.smithi098.stderr: 25200K .......... .......... .......... .......... .......... 27% 321M 1s 2024-09-12T18:03:48.028 INFO:teuthology.orchestra.run.smithi098.stderr: 25250K .......... .......... .......... .......... .......... 27% 173M 1s 2024-09-12T18:03:48.028 INFO:teuthology.orchestra.run.smithi098.stderr: 25300K .......... .......... .......... .......... .......... 27% 262M 1s 2024-09-12T18:03:48.028 INFO:teuthology.orchestra.run.smithi098.stderr: 25350K .......... .......... .......... .......... .......... 27% 292M 1s 2024-09-12T18:03:48.028 INFO:teuthology.orchestra.run.smithi098.stderr: 25400K .......... .......... .......... .......... .......... 27% 323M 1s 2024-09-12T18:03:48.028 INFO:teuthology.orchestra.run.smithi098.stderr: 25450K .......... .......... .......... .......... .......... 27% 296M 1s 2024-09-12T18:03:48.028 INFO:teuthology.orchestra.run.smithi098.stderr: 25500K .......... .......... .......... .......... .......... 27% 234M 1s 2024-09-12T18:03:48.028 INFO:teuthology.orchestra.run.smithi098.stderr: 25550K .......... .......... .......... .......... .......... 27% 296M 1s 2024-09-12T18:03:48.028 INFO:teuthology.orchestra.run.smithi098.stderr: 25600K .......... .......... .......... .......... .......... 27% 280M 1s 2024-09-12T18:03:48.028 INFO:teuthology.orchestra.run.smithi098.stderr: 25650K .......... .......... .......... .......... .......... 27% 315M 1s 2024-09-12T18:03:48.028 INFO:teuthology.orchestra.run.smithi098.stderr: 25700K .......... .......... .......... .......... .......... 27% 272M 1s 2024-09-12T18:03:48.028 INFO:teuthology.orchestra.run.smithi098.stderr: 25750K .......... .......... .......... .......... .......... 27% 325M 0s 2024-09-12T18:03:48.028 INFO:teuthology.orchestra.run.smithi098.stderr: 25800K .......... .......... .......... .......... .......... 27% 301M 0s 2024-09-12T18:03:48.029 INFO:teuthology.orchestra.run.smithi098.stderr: 25850K .......... .......... .......... .......... .......... 27% 299M 0s 2024-09-12T18:03:48.029 INFO:teuthology.orchestra.run.smithi098.stderr: 25900K .......... .......... .......... .......... .......... 27% 243M 0s 2024-09-12T18:03:48.029 INFO:teuthology.orchestra.run.smithi098.stderr: 25950K .......... .......... .......... .......... .......... 27% 306M 0s 2024-09-12T18:03:48.029 INFO:teuthology.orchestra.run.smithi098.stderr: 26000K .......... .......... .......... .......... .......... 28% 298M 0s 2024-09-12T18:03:48.029 INFO:teuthology.orchestra.run.smithi098.stderr: 26050K .......... .......... .......... .......... .......... 28% 307M 0s 2024-09-12T18:03:48.029 INFO:teuthology.orchestra.run.smithi098.stderr: 26100K .......... .......... .......... .......... .......... 28% 266M 0s 2024-09-12T18:03:48.029 INFO:teuthology.orchestra.run.smithi098.stderr: 26150K .......... .......... .......... .......... .......... 28% 336M 0s 2024-09-12T18:03:48.029 INFO:teuthology.orchestra.run.smithi098.stderr: 26200K .......... .......... .......... .......... .......... 28% 311M 0s 2024-09-12T18:03:48.029 INFO:teuthology.orchestra.run.smithi098.stderr: 26250K .......... .......... .......... .......... .......... 28% 294M 0s 2024-09-12T18:03:48.029 INFO:teuthology.orchestra.run.smithi098.stderr: 26300K .......... .......... .......... .......... .......... 28% 232M 0s 2024-09-12T18:03:48.029 INFO:teuthology.orchestra.run.smithi098.stderr: 26350K .......... .......... .......... .......... .......... 28% 302M 0s 2024-09-12T18:03:48.029 INFO:teuthology.orchestra.run.smithi098.stderr: 26400K .......... .......... .......... .......... .......... 28% 299M 0s 2024-09-12T18:03:48.029 INFO:teuthology.orchestra.run.smithi098.stderr: 26450K .......... .......... .......... .......... .......... 28% 308M 0s 2024-09-12T18:03:48.029 INFO:teuthology.orchestra.run.smithi098.stderr: 26500K .......... .......... .......... .......... .......... 28% 267M 0s 2024-09-12T18:03:48.029 INFO:teuthology.orchestra.run.smithi098.stderr: 26550K .......... .......... .......... .......... .......... 28% 291M 0s 2024-09-12T18:03:48.030 INFO:teuthology.orchestra.run.smithi098.stderr: 26600K .......... .......... .......... .......... .......... 28% 327M 0s 2024-09-12T18:03:48.030 INFO:teuthology.orchestra.run.smithi098.stderr: 26650K .......... .......... .......... .......... .......... 28% 281M 0s 2024-09-12T18:03:48.030 INFO:teuthology.orchestra.run.smithi098.stderr: 26700K .......... .......... .......... .......... .......... 28% 273M 0s 2024-09-12T18:03:48.030 INFO:teuthology.orchestra.run.smithi098.stderr: 26750K .......... .......... .......... .......... .......... 28% 312M 0s 2024-09-12T18:03:48.030 INFO:teuthology.orchestra.run.smithi098.stderr: 26800K .......... .......... .......... .......... .......... 28% 309M 0s 2024-09-12T18:03:48.030 INFO:teuthology.orchestra.run.smithi098.stderr: 26850K .......... .......... .......... .......... .......... 28% 55.2M 0s 2024-09-12T18:03:48.030 INFO:teuthology.orchestra.run.smithi098.stderr: 26900K .......... .......... .......... .......... .......... 29% 260M 0s 2024-09-12T18:03:48.030 INFO:teuthology.orchestra.run.smithi098.stderr: 26950K .......... .......... .......... .......... .......... 29% 330M 0s 2024-09-12T18:03:48.030 INFO:teuthology.orchestra.run.smithi098.stderr: 27000K .......... .......... .......... .......... .......... 29% 298M 0s 2024-09-12T18:03:48.030 INFO:teuthology.orchestra.run.smithi098.stderr: 27050K .......... .......... .......... .......... .......... 29% 64.6M 0s 2024-09-12T18:03:48.030 INFO:teuthology.orchestra.run.smithi098.stderr: 27100K .......... .......... .......... .......... .......... 29% 234M 0s 2024-09-12T18:03:48.030 INFO:teuthology.orchestra.run.smithi098.stderr: 27150K .......... .......... .......... .......... .......... 29% 197M 0s 2024-09-12T18:03:48.030 INFO:teuthology.orchestra.run.smithi098.stderr: 27200K .......... .......... .......... .......... .......... 29% 263M 0s 2024-09-12T18:03:48.031 INFO:teuthology.orchestra.run.smithi098.stderr: 27250K .......... .......... .......... .......... .......... 29% 314M 0s 2024-09-12T18:03:48.031 INFO:teuthology.orchestra.run.smithi098.stderr: 27300K .......... .......... .......... .......... .......... 29% 173M 0s 2024-09-12T18:03:48.031 INFO:teuthology.orchestra.run.smithi098.stderr: 27350K .......... .......... .......... .......... .......... 29% 234M 0s 2024-09-12T18:03:48.031 INFO:teuthology.orchestra.run.smithi098.stderr: 27400K .......... .......... .......... .......... .......... 29% 259M 0s 2024-09-12T18:03:48.031 INFO:teuthology.orchestra.run.smithi098.stderr: 27450K .......... .......... .......... .......... .......... 29% 228M 0s 2024-09-12T18:03:48.031 INFO:teuthology.orchestra.run.smithi098.stderr: 27500K .......... .......... .......... .......... .......... 29% 152M 0s 2024-09-12T18:03:48.031 INFO:teuthology.orchestra.run.smithi098.stderr: 27550K .......... .......... .......... .......... .......... 29% 283M 0s 2024-09-12T18:03:48.031 INFO:teuthology.orchestra.run.smithi098.stderr: 27600K .......... .......... .......... .......... .......... 29% 275M 0s 2024-09-12T18:03:48.031 INFO:teuthology.orchestra.run.smithi098.stderr: 27650K .......... .......... .......... .......... .......... 29% 279M 0s 2024-09-12T18:03:48.031 INFO:teuthology.orchestra.run.smithi098.stderr: 27700K .......... .......... .......... .......... .......... 29% 270M 0s 2024-09-12T18:03:48.031 INFO:teuthology.orchestra.run.smithi098.stderr: 27750K .......... .......... .......... .......... .......... 29% 289M 0s 2024-09-12T18:03:48.031 INFO:teuthology.orchestra.run.smithi098.stderr: 27800K .......... .......... .......... .......... .......... 29% 297M 0s 2024-09-12T18:03:48.031 INFO:teuthology.orchestra.run.smithi098.stderr: 27850K .......... .......... .......... .......... .......... 30% 284M 0s 2024-09-12T18:03:48.031 INFO:teuthology.orchestra.run.smithi098.stderr: 27900K .......... .......... .......... .......... .......... 30% 242M 0s 2024-09-12T18:03:48.032 INFO:teuthology.orchestra.run.smithi098.stderr: 27950K .......... .......... .......... .......... .......... 30% 318M 0s 2024-09-12T18:03:48.032 INFO:teuthology.orchestra.run.smithi098.stderr: 28000K .......... .......... .......... .......... .......... 30% 301M 0s 2024-09-12T18:03:48.032 INFO:teuthology.orchestra.run.smithi098.stderr: 28050K .......... .......... .......... .......... .......... 30% 299M 0s 2024-09-12T18:03:48.032 INFO:teuthology.orchestra.run.smithi098.stderr: 28100K .......... .......... .......... .......... .......... 30% 257M 0s 2024-09-12T18:03:48.032 INFO:teuthology.orchestra.run.smithi098.stderr: 28150K .......... .......... .......... .......... .......... 30% 305M 0s 2024-09-12T18:03:48.032 INFO:teuthology.orchestra.run.smithi098.stderr: 28200K .......... .......... .......... .......... .......... 30% 95.4M 0s 2024-09-12T18:03:48.032 INFO:teuthology.orchestra.run.smithi098.stderr: 28250K .......... .......... .......... .......... .......... 30% 295M 0s 2024-09-12T18:03:48.032 INFO:teuthology.orchestra.run.smithi098.stderr: 28300K .......... .......... .......... .......... .......... 30% 254M 0s 2024-09-12T18:03:48.032 INFO:teuthology.orchestra.run.smithi098.stderr: 28350K .......... .......... .......... .......... .......... 30% 283M 0s 2024-09-12T18:03:48.032 INFO:teuthology.orchestra.run.smithi098.stderr: 28400K .......... .......... .......... .......... .......... 30% 299M 0s 2024-09-12T18:03:48.032 INFO:teuthology.orchestra.run.smithi098.stderr: 28450K .......... .......... .......... .......... .......... 30% 297M 0s 2024-09-12T18:03:48.032 INFO:teuthology.orchestra.run.smithi098.stderr: 28500K .......... .......... .......... .......... .......... 30% 269M 0s 2024-09-12T18:03:48.032 INFO:teuthology.orchestra.run.smithi098.stderr: 28550K .......... .......... .......... .......... .......... 30% 278M 0s 2024-09-12T18:03:48.033 INFO:teuthology.orchestra.run.smithi098.stderr: 28600K .......... .......... .......... .......... .......... 30% 306M 0s 2024-09-12T18:03:48.033 INFO:teuthology.orchestra.run.smithi098.stderr: 28650K .......... .......... .......... .......... .......... 30% 316M 0s 2024-09-12T18:03:48.033 INFO:teuthology.orchestra.run.smithi098.stderr: 28700K .......... .......... .......... .......... .......... 30% 255M 0s 2024-09-12T18:03:48.033 INFO:teuthology.orchestra.run.smithi098.stderr: 28750K .......... .......... .......... .......... .......... 31% 246M 0s 2024-09-12T18:03:48.033 INFO:teuthology.orchestra.run.smithi098.stderr: 28800K .......... .......... .......... .......... .......... 31% 288M 0s 2024-09-12T18:03:48.033 INFO:teuthology.orchestra.run.smithi098.stderr: 28850K .......... .......... .......... .......... .......... 31% 310M 0s 2024-09-12T18:03:48.033 INFO:teuthology.orchestra.run.smithi098.stderr: 28900K .......... .......... .......... .......... .......... 31% 296M 0s 2024-09-12T18:03:48.033 INFO:teuthology.orchestra.run.smithi098.stderr: 28950K .......... .......... .......... .......... .......... 31% 284M 0s 2024-09-12T18:03:48.033 INFO:teuthology.orchestra.run.smithi098.stderr: 29000K .......... .......... .......... .......... .......... 31% 319M 0s 2024-09-12T18:03:48.033 INFO:teuthology.orchestra.run.smithi098.stderr: 29050K .......... .......... .......... .......... .......... 31% 286M 0s 2024-09-12T18:03:48.033 INFO:teuthology.orchestra.run.smithi098.stderr: 29100K .......... .......... .......... .......... .......... 31% 255M 0s 2024-09-12T18:03:48.033 INFO:teuthology.orchestra.run.smithi098.stderr: 29150K .......... .......... .......... .......... .......... 31% 324M 0s 2024-09-12T18:03:48.033 INFO:teuthology.orchestra.run.smithi098.stderr: 29200K .......... .......... .......... .......... .......... 31% 293M 0s 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi098.stderr: 29250K .......... .......... .......... .......... .......... 31% 304M 0s 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi098.stderr: 29300K .......... .......... .......... .......... .......... 31% 267M 0s 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi098.stderr: 29350K .......... .......... .......... .......... .......... 31% 313M 0s 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi098.stderr: 29400K .......... .......... .......... .......... .......... 31% 289M 0s 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi098.stderr: 29450K .......... .......... .......... .......... .......... 31% 292M 0s 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi098.stderr: 29500K .......... .......... .......... .......... .......... 31% 266M 0s 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi098.stderr: 29550K .......... .......... .......... .......... .......... 31% 305M 0s 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi098.stderr: 29600K .......... .......... .......... .......... .......... 31% 314M 0s 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi098.stderr: 29650K .......... .......... .......... .......... .......... 31% 311M 0s 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi098.stderr: 29700K .......... .......... .......... .......... .......... 32% 288M 0s 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi098.stderr: 29750K .......... .......... .......... .......... .......... 32% 327M 0s 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi098.stderr: 29800K .......... .......... .......... .......... .......... 32% 95.2M 0s 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi098.stderr: 29850K .......... .......... .......... .......... .......... 32% 267M 0s 2024-09-12T18:03:48.034 INFO:teuthology.orchestra.run.smithi098.stderr: 29900K .......... .......... .......... .......... .......... 32% 260M 0s 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi098.stderr: 29950K .......... .......... .......... .......... .......... 32% 299M 0s 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi098.stderr: 30000K .......... .......... .......... .......... .......... 32% 305M 0s 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi098.stderr: 30050K .......... .......... .......... .......... .......... 32% 127M 0s 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi098.stderr: 30100K .......... .......... .......... .......... .......... 32% 272M 0s 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi098.stderr: 30150K .......... .......... .......... .......... .......... 32% 228M 0s 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi098.stderr: 30200K .......... .......... .......... .......... .......... 32% 293M 0s 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi098.stderr: 30250K .......... .......... .......... .......... .......... 32% 221M 0s 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi098.stderr: 30300K .......... .......... .......... .......... .......... 32% 233M 0s 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi098.stderr: 30350K .......... .......... .......... .......... .......... 32% 105M 0s 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi098.stderr: 30400K .......... .......... .......... .......... .......... 32% 271M 0s 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi098.stderr: 30450K .......... .......... .......... .......... .......... 32% 305M 0s 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi098.stderr: 30500K .......... .......... .......... .......... .......... 32% 240M 0s 2024-09-12T18:03:48.035 INFO:teuthology.orchestra.run.smithi098.stderr: 30550K .......... .......... .......... .......... .......... 32% 180M 0s 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi098.stderr: 30600K .......... .......... .......... .......... .......... 32% 251M 0s 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi098.stderr: 30650K .......... .......... .......... .......... .......... 33% 141M 0s 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi098.stderr: 30700K .......... .......... .......... .......... .......... 33% 310M 0s 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi098.stderr: 30750K .......... .......... .......... .......... .......... 33% 254M 0s 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi098.stderr: 30800K .......... .......... .......... .......... .......... 33% 295M 0s 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi098.stderr: 30850K .......... .......... .......... .......... .......... 33% 302M 0s 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi098.stderr: 30900K .......... .......... .......... .......... .......... 33% 331M 0s 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi098.stderr: 30950K .......... .......... .......... .......... .......... 33% 194M 0s 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi098.stderr: 31000K .......... .......... .......... .......... .......... 33% 298M 0s 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi098.stderr: 31050K .......... .......... .......... .......... .......... 33% 312M 0s 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi098.stderr: 31100K .......... .......... .......... .......... .......... 33% 307M 0s 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi098.stderr: 31150K .......... .......... .......... .......... .......... 33% 109M 0s 2024-09-12T18:03:48.036 INFO:teuthology.orchestra.run.smithi098.stderr: 31200K .......... .......... .......... .......... .......... 33% 322M 0s 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi098.stderr: 31250K .......... .......... .......... .......... .......... 33% 326M 0s 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi098.stderr: 31300K .......... .......... .......... .......... .......... 33% 177M 0s 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi098.stderr: 31350K .......... .......... .......... .......... .......... 33% 202M 0s 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi098.stderr: 31400K .......... .......... .......... .......... .......... 33% 222M 0s 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi098.stderr: 31450K .......... .......... .......... .......... .......... 33% 310M 0s 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi098.stderr: 31500K .......... .......... .......... .......... .......... 33% 329M 0s 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi098.stderr: 31550K .......... .......... .......... .......... .......... 34% 227M 0s 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi098.stderr: 31600K .......... .......... .......... .......... .......... 34% 276M 0s 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi098.stderr: 31650K .......... .......... .......... .......... .......... 34% 293M 0s 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi098.stderr: 31700K .......... .......... .......... .......... .......... 34% 288M 0s 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi098.stderr: 31750K .......... .......... .......... .......... .......... 34% 295M 0s 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi098.stderr: 31800K .......... .......... .......... .......... .......... 34% 322M 0s 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi098.stderr: 31850K .......... .......... .......... .......... .......... 34% 275M 0s 2024-09-12T18:03:48.037 INFO:teuthology.orchestra.run.smithi098.stderr: 31900K .......... .......... .......... .......... .......... 34% 285M 0s 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi098.stderr: 31950K .......... .......... .......... .......... .......... 34% 273M 0s 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi098.stderr: 32000K .......... .......... .......... .......... .......... 34% 325M 0s 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi098.stderr: 32050K .......... .......... .......... .......... .......... 34% 323M 0s 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi098.stderr: 32100K .......... .......... .......... .......... .......... 34% 312M 0s 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi098.stderr: 32150K .......... .......... .......... .......... .......... 34% 269M 0s 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi098.stderr: 32200K .......... .......... .......... .......... .......... 34% 240M 0s 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi098.stderr: 32250K .......... .......... .......... .......... .......... 34% 282M 0s 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi098.stderr: 32300K .......... .......... .......... .......... .......... 34% 335M 0s 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi098.stderr: 32350K .......... .......... .......... .......... .......... 34% 237M 0s 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi098.stderr: 32400K .......... .......... .......... .......... .......... 34% 319M 0s 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi098.stderr: 32450K .......... .......... .......... .......... .......... 34% 310M 0s 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi098.stderr: 32500K .......... .......... .......... .......... .......... 35% 319M 0s 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi098.stderr: 32550K .......... .......... .......... .......... .......... 35% 283M 0s 2024-09-12T18:03:48.038 INFO:teuthology.orchestra.run.smithi098.stderr: 32600K .......... .......... .......... .......... .......... 35% 330M 0s 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi098.stderr: 32650K .......... .......... .......... .......... .......... 35% 75.2M 0s 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi098.stderr: 32700K .......... .......... .......... .......... .......... 35% 281M 0s 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi098.stderr: 32750K .......... .......... .......... .......... .......... 35% 255M 0s 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi098.stderr: 32800K .......... .......... .......... .......... .......... 35% 323M 0s 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi098.stderr: 32850K .......... .......... .......... .......... .......... 35% 249M 0s 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi098.stderr: 32900K .......... .......... .......... .......... .......... 35% 308M 0s 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi098.stderr: 32950K .......... .......... .......... .......... .......... 35% 280M 0s 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi098.stderr: 33000K .......... .......... .......... .......... .......... 35% 335M 0s 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi098.stderr: 33050K .......... .......... .......... .......... .......... 35% 334M 0s 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi098.stderr: 33100K .......... .......... .......... .......... .......... 35% 283M 0s 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi098.stderr: 33150K .......... .......... .......... .......... .......... 35% 271M 0s 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi098.stderr: 33200K .......... .......... .......... .......... .......... 35% 337M 0s 2024-09-12T18:03:48.039 INFO:teuthology.orchestra.run.smithi098.stderr: 33250K .......... .......... .......... .......... .......... 35% 274M 0s 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi098.stderr: 33300K .......... .......... .......... .......... .......... 35% 323M 0s 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi098.stderr: 33350K .......... .......... .......... .......... .......... 35% 128M 0s 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi098.stderr: 33400K .......... .......... .......... .......... .......... 36% 214M 0s 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi098.stderr: 33450K .......... .......... .......... .......... .......... 36% 326M 0s 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi098.stderr: 33500K .......... .......... .......... .......... .......... 36% 309M 0s 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi098.stderr: 33550K .......... .......... .......... .......... .......... 36% 254M 0s 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi098.stderr: 33600K .......... .......... .......... .......... .......... 36% 76.6M 0s 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi098.stderr: 33650K .......... .......... .......... .......... .......... 36% 292M 0s 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi098.stderr: 33700K .......... .......... .......... .......... .......... 36% 301M 0s 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi098.stderr: 33750K .......... .......... .......... .......... .......... 36% 268M 0s 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi098.stderr: 33800K .......... .......... .......... .......... .......... 36% 327M 0s 2024-09-12T18:03:48.040 INFO:teuthology.orchestra.run.smithi098.stderr: 33850K .......... .......... .......... .......... .......... 36% 212M 0s 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi098.stderr: 33900K .......... .......... .......... .......... .......... 36% 290M 0s 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi098.stderr: 33950K .......... .......... .......... .......... .......... 36% 241M 0s 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi098.stderr: 34000K .......... .......... .......... .......... .......... 36% 313M 0s 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi098.stderr: 34050K .......... .......... .......... .......... .......... 36% 178M 0s 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi098.stderr: 34100K .......... .......... .......... .......... .......... 36% 313M 0s 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi098.stderr: 34150K .......... .......... .......... .......... .......... 36% 252M 0s 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi098.stderr: 34200K .......... .......... .......... .......... .......... 36% 323M 0s 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi098.stderr: 34250K .......... .......... .......... .......... .......... 36% 167M 0s 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi098.stderr: 34300K .......... .......... .......... .......... .......... 36% 183M 0s 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi098.stderr: 34350K .......... .......... .......... .......... .......... 37% 93.3M 0s 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi098.stderr: 34400K .......... .......... .......... .......... .......... 37% 302M 0s 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi098.stderr: 34450K .......... .......... .......... .......... .......... 37% 304M 0s 2024-09-12T18:03:48.041 INFO:teuthology.orchestra.run.smithi098.stderr: 34500K .......... .......... .......... .......... .......... 37% 309M 0s 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi098.stderr: 34550K .......... .......... .......... .......... .......... 37% 275M 0s 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi098.stderr: 34600K .......... .......... .......... .......... .......... 37% 154M 0s 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi098.stderr: 34650K .......... .......... .......... .......... .......... 37% 291M 0s 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi098.stderr: 34700K .......... .......... .......... .......... .......... 37% 299M 0s 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi098.stderr: 34750K .......... .......... .......... .......... .......... 37% 239M 0s 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi098.stderr: 34800K .......... .......... .......... .......... .......... 37% 262M 0s 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi098.stderr: 34850K .......... .......... .......... .......... .......... 37% 318M 0s 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi098.stderr: 34900K .......... .......... .......... .......... .......... 37% 316M 0s 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi098.stderr: 34950K .......... .......... .......... .......... .......... 37% 260M 0s 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi098.stderr: 35000K .......... .......... .......... .......... .......... 37% 298M 0s 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi098.stderr: 35050K .......... .......... .......... .......... .......... 37% 298M 0s 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi098.stderr: 35100K .......... .......... .......... .......... .......... 37% 289M 0s 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi098.stderr: 35150K .......... .......... .......... .......... .......... 37% 254M 0s 2024-09-12T18:03:48.042 INFO:teuthology.orchestra.run.smithi098.stderr: 35200K .......... .......... .......... .......... .......... 37% 292M 0s 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi098.stderr: 35250K .......... .......... .......... .......... .......... 37% 301M 0s 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi098.stderr: 35300K .......... .......... .......... .......... .......... 38% 325M 0s 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi098.stderr: 35350K .......... .......... .......... .......... .......... 38% 264M 0s 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi098.stderr: 35400K .......... .......... .......... .......... .......... 38% 342M 0s 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi098.stderr: 35450K .......... .......... .......... .......... .......... 38% 321M 0s 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi098.stderr: 35500K .......... .......... .......... .......... .......... 38% 132M 0s 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi098.stderr: 35550K .......... .......... .......... .......... .......... 38% 185M 0s 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi098.stderr: 35600K .......... .......... .......... .......... .......... 38% 316M 0s 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi098.stderr: 35650K .......... .......... .......... .......... .......... 38% 309M 0s 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi098.stderr: 35700K .......... .......... .......... .......... .......... 38% 291M 0s 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi098.stderr: 35750K .......... .......... .......... .......... .......... 38% 266M 0s 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi098.stderr: 35800K .......... .......... .......... .......... .......... 38% 323M 0s 2024-09-12T18:03:48.043 INFO:teuthology.orchestra.run.smithi098.stderr: 35850K .......... .......... .......... .......... .......... 38% 301M 0s 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi098.stderr: 35900K .......... .......... .......... .......... .......... 38% 292M 0s 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi098.stderr: 35950K .......... .......... .......... .......... .......... 38% 261M 0s 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi098.stderr: 36000K .......... .......... .......... .......... .......... 38% 331M 0s 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi098.stderr: 36050K .......... .......... .......... .......... .......... 38% 296M 0s 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi098.stderr: 36100K .......... .......... .......... .......... .......... 38% 307M 0s 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi098.stderr: 36150K .......... .......... .......... .......... .......... 38% 289M 0s 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi098.stderr: 36200K .......... .......... .......... .......... .......... 39% 334M 0s 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi098.stderr: 36250K .......... .......... .......... .......... .......... 39% 285M 0s 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi098.stderr: 36300K .......... .......... .......... .......... .......... 39% 305M 0s 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi098.stderr: 36350K .......... .......... .......... .......... .......... 39% 258M 0s 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi098.stderr: 36400K .......... .......... .......... .......... .......... 39% 292M 0s 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi098.stderr: 36450K .......... .......... .......... .......... .......... 39% 298M 0s 2024-09-12T18:03:48.044 INFO:teuthology.orchestra.run.smithi098.stderr: 36500K .......... .......... .......... .......... .......... 39% 298M 0s 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi098.stderr: 36550K .......... .......... .......... .......... .......... 39% 284M 0s 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi098.stderr: 36600K .......... .......... .......... .......... .......... 39% 102M 0s 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi098.stderr: 36650K .......... .......... .......... .......... .......... 39% 136M 0s 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi098.stderr: 36700K .......... .......... .......... .......... .......... 39% 290M 0s 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi098.stderr: 36750K .......... .......... .......... .......... .......... 39% 148M 0s 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi098.stderr: 36800K .......... .......... .......... .......... .......... 39% 207M 0s 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi098.stderr: 36850K .......... .......... .......... .......... .......... 39% 288M 0s 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi098.stderr: 36900K .......... .......... .......... .......... .......... 39% 278M 0s 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi098.stderr: 36950K .......... .......... .......... .......... .......... 39% 238M 0s 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi098.stderr: 37000K .......... .......... .......... .......... .......... 39% 296M 0s 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi098.stderr: 37050K .......... .......... .......... .......... .......... 39% 296M 0s 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi098.stderr: 37100K .......... .......... .......... .......... .......... 39% 305M 0s 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi098.stderr: 37150K .......... .......... .......... .......... .......... 40% 244M 0s 2024-09-12T18:03:48.045 INFO:teuthology.orchestra.run.smithi098.stderr: 37200K .......... .......... .......... .......... .......... 40% 293M 0s 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi098.stderr: 37250K .......... .......... .......... .......... .......... 40% 307M 0s 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi098.stderr: 37300K .......... .......... .......... .......... .......... 40% 301M 0s 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi098.stderr: 37350K .......... .......... .......... .......... .......... 40% 120M 0s 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi098.stderr: 37400K .......... .......... .......... .......... .......... 40% 98.1M 0s 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi098.stderr: 37450K .......... .......... .......... .......... .......... 40% 302M 0s 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi098.stderr: 37500K .......... .......... .......... .......... .......... 40% 288M 0s 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi098.stderr: 37550K .......... .......... .......... .......... .......... 40% 282M 0s 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi098.stderr: 37600K .......... .......... .......... .......... .......... 40% 300M 0s 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi098.stderr: 37650K .......... .......... .......... .......... .......... 40% 225M 0s 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi098.stderr: 37700K .......... .......... .......... .......... .......... 40% 319M 0s 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi098.stderr: 37750K .......... .......... .......... .......... .......... 40% 280M 0s 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi098.stderr: 37800K .......... .......... .......... .......... .......... 40% 296M 0s 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi098.stderr: 37850K .......... .......... .......... .......... .......... 40% 229M 0s 2024-09-12T18:03:48.046 INFO:teuthology.orchestra.run.smithi098.stderr: 37900K .......... .......... .......... .......... .......... 40% 246M 0s 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi098.stderr: 37950K .......... .......... .......... .......... .......... 40% 235M 0s 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi098.stderr: 38000K .......... .......... .......... .......... .......... 40% 319M 0s 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi098.stderr: 38050K .......... .......... .......... .......... .......... 41% 318M 0s 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi098.stderr: 38100K .......... .......... .......... .......... .......... 41% 163M 0s 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi098.stderr: 38150K .......... .......... .......... .......... .......... 41% 245M 0s 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi098.stderr: 38200K .......... .......... .......... .......... .......... 41% 310M 0s 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi098.stderr: 38250K .......... .......... .......... .......... .......... 41% 311M 0s 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi098.stderr: 38300K .......... .......... .......... .......... .......... 41% 306M 0s 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi098.stderr: 38350K .......... .......... .......... .......... .......... 41% 276M 0s 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi098.stderr: 38400K .......... .......... .......... .......... .......... 41% 314M 0s 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi098.stderr: 38450K .......... .......... .......... .......... .......... 41% 192M 0s 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi098.stderr: 38500K .......... .......... .......... .......... .......... 41% 287M 0s 2024-09-12T18:03:48.047 INFO:teuthology.orchestra.run.smithi098.stderr: 38550K .......... .......... .......... .......... .......... 41% 282M 0s 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi098.stderr: 38600K .......... .......... .......... .......... .......... 41% 274M 0s 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi098.stderr: 38650K .......... .......... .......... .......... .......... 41% 313M 0s 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi098.stderr: 38700K .......... .......... .......... .......... .......... 41% 289M 0s 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi098.stderr: 38750K .......... .......... .......... .......... .......... 41% 233M 0s 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi098.stderr: 38800K .......... .......... .......... .......... .......... 41% 332M 0s 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi098.stderr: 38850K .......... .......... .......... .......... .......... 41% 305M 0s 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi098.stderr: 38900K .......... .......... .......... .......... .......... 41% 294M 0s 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi098.stderr: 38950K .......... .......... .......... .......... .......... 41% 270M 0s 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi098.stderr: 39000K .......... .......... .......... .......... .......... 42% 311M 0s 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi098.stderr: 39050K .......... .......... .......... .......... .......... 42% 330M 0s 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi098.stderr: 39100K .......... .......... .......... .......... .......... 42% 286M 0s 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi098.stderr: 39150K .......... .......... .......... .......... .......... 42% 268M 0s 2024-09-12T18:03:48.048 INFO:teuthology.orchestra.run.smithi098.stderr: 39200K .......... .......... .......... .......... .......... 42% 285M 0s 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi098.stderr: 39250K .......... .......... .......... .......... .......... 42% 293M 0s 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi098.stderr: 39300K .......... .......... .......... .......... .......... 42% 307M 0s 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi098.stderr: 39350K .......... .......... .......... .......... .......... 42% 265M 0s 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi098.stderr: 39400K .......... .......... .......... .......... .......... 42% 296M 0s 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi098.stderr: 39450K .......... .......... .......... .......... .......... 42% 317M 0s 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi098.stderr: 39500K .......... .......... .......... .......... .......... 42% 331M 0s 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi098.stderr: 39550K .......... .......... .......... .......... .......... 42% 282M 0s 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi098.stderr: 39600K .......... .......... .......... .......... .......... 42% 214M 0s 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi098.stderr: 39650K .......... .......... .......... .......... .......... 42% 181M 0s 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi098.stderr: 39700K .......... .......... .......... .......... .......... 42% 121M 0s 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi098.stderr: 39750K .......... .......... .......... .......... .......... 42% 125M 0s 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi098.stderr: 39800K .......... .......... .......... .......... .......... 42% 249M 0s 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi098.stderr: 39850K .......... .......... .......... .......... .......... 42% 306M 0s 2024-09-12T18:03:48.049 INFO:teuthology.orchestra.run.smithi098.stderr: 39900K .......... .......... .......... .......... .......... 43% 240M 0s 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi098.stderr: 39950K .......... .......... .......... .......... .......... 43% 208M 0s 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi098.stderr: 40000K .......... .......... .......... .......... .......... 43% 224M 0s 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi098.stderr: 40050K .......... .......... .......... .......... .......... 43% 348M 0s 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi098.stderr: 40100K .......... .......... .......... .......... .......... 43% 228M 0s 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi098.stderr: 40150K .......... .......... .......... .......... .......... 43% 288M 0s 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi098.stderr: 40200K .......... .......... .......... .......... .......... 43% 315M 0s 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi098.stderr: 40250K .......... .......... .......... .......... .......... 43% 304M 0s 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi098.stderr: 40300K .......... .......... .......... .......... .......... 43% 309M 0s 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi098.stderr: 40350K .......... .......... .......... .......... .......... 43% 256M 0s 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi098.stderr: 40400K .......... .......... .......... .......... .......... 43% 83.6M 0s 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi098.stderr: 40450K .......... .......... .......... .......... .......... 43% 302M 0s 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi098.stderr: 40500K .......... .......... .......... .......... .......... 43% 325M 0s 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi098.stderr: 40550K .......... .......... .......... .......... .......... 43% 208M 0s 2024-09-12T18:03:48.050 INFO:teuthology.orchestra.run.smithi098.stderr: 40600K .......... .......... .......... .......... .......... 43% 310M 0s 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi098.stderr: 40650K .......... .......... .......... .......... .......... 43% 330M 0s 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi098.stderr: 40700K .......... .......... .......... .......... .......... 43% 331M 0s 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi098.stderr: 40750K .......... .......... .......... .......... .......... 43% 215M 0s 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi098.stderr: 40800K .......... .......... .......... .......... .......... 43% 127M 0s 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi098.stderr: 40850K .......... .......... .......... .......... .......... 44% 319M 0s 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi098.stderr: 40900K .......... .......... .......... .......... .......... 44% 179M 0s 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi098.stderr: 40950K .......... .......... .......... .......... .......... 44% 309M 0s 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi098.stderr: 41000K .......... .......... .......... .......... .......... 44% 201M 0s 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi098.stderr: 41050K .......... .......... .......... .......... .......... 44% 253M 0s 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi098.stderr: 41100K .......... .......... .......... .......... .......... 44% 317M 0s 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi098.stderr: 41150K .......... .......... .......... .......... .......... 44% 241M 0s 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi098.stderr: 41200K .......... .......... .......... .......... .......... 44% 288M 0s 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi098.stderr: 41250K .......... .......... .......... .......... .......... 44% 131M 0s 2024-09-12T18:03:48.051 INFO:teuthology.orchestra.run.smithi098.stderr: 41300K .......... .......... .......... .......... .......... 44% 303M 0s 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi098.stderr: 41350K .......... .......... .......... .......... .......... 44% 286M 0s 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi098.stderr: 41400K .......... .......... .......... .......... .......... 44% 281M 0s 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi098.stderr: 41450K .......... .......... .......... .......... .......... 44% 282M 0s 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi098.stderr: 41500K .......... .......... .......... .......... .......... 44% 326M 0s 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi098.stderr: 41550K .......... .......... .......... .......... .......... 44% 256M 0s 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi098.stderr: 41600K .......... .......... .......... .......... .......... 44% 322M 0s 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi098.stderr: 41650K .......... .......... .......... .......... .......... 44% 298M 0s 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi098.stderr: 41700K .......... .......... .......... .......... .......... 44% 298M 0s 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi098.stderr: 41750K .......... .......... .......... .......... .......... 44% 281M 0s 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi098.stderr: 41800K .......... .......... .......... .......... .......... 45% 321M 0s 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi098.stderr: 41850K .......... .......... .......... .......... .......... 45% 277M 0s 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi098.stderr: 41900K .......... .......... .......... .......... .......... 45% 301M 0s 2024-09-12T18:03:48.052 INFO:teuthology.orchestra.run.smithi098.stderr: 41950K .......... .......... .......... .......... .......... 45% 239M 0s 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi098.stderr: 42000K .......... .......... .......... .......... .......... 45% 288M 0s 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi098.stderr: 42050K .......... .......... .......... .......... .......... 45% 319M 0s 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi098.stderr: 42100K .......... .......... .......... .......... .......... 45% 347M 0s 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi098.stderr: 42150K .......... .......... .......... .......... .......... 45% 231M 0s 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi098.stderr: 42200K .......... .......... .......... .......... .......... 45% 309M 0s 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi098.stderr: 42250K .......... .......... .......... .......... .......... 45% 299M 0s 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi098.stderr: 42300K .......... .......... .......... .......... .......... 45% 333M 0s 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi098.stderr: 42350K .......... .......... .......... .......... .......... 45% 246M 0s 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi098.stderr: 42400K .......... .......... .......... .......... .......... 45% 313M 0s 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi098.stderr: 42450K .......... .......... .......... .......... .......... 45% 261M 0s 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi098.stderr: 42500K .......... .......... .......... .......... .......... 45% 305M 0s 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi098.stderr: 42550K .......... .......... .......... .......... .......... 45% 262M 0s 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi098.stderr: 42600K .......... .......... .......... .......... .......... 45% 328M 0s 2024-09-12T18:03:48.053 INFO:teuthology.orchestra.run.smithi098.stderr: 42650K .......... .......... .......... .......... .......... 45% 330M 0s 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi098.stderr: 42700K .......... .......... .......... .......... .......... 46% 210M 0s 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi098.stderr: 42750K .......... .......... .......... .......... .......... 46% 76.7M 0s 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi098.stderr: 42800K .......... .......... .......... .......... .......... 46% 314M 0s 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi098.stderr: 42850K .......... .......... .......... .......... .......... 46% 349M 0s 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi098.stderr: 42900K .......... .......... .......... .......... .......... 46% 253M 0s 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi098.stderr: 42950K .......... .......... .......... .......... .......... 46% 284M 0s 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi098.stderr: 43000K .......... .......... .......... .......... .......... 46% 330M 0s 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi098.stderr: 43050K .......... .......... .......... .......... .......... 46% 330M 0s 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi098.stderr: 43100K .......... .......... .......... .......... .......... 46% 316M 0s 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi098.stderr: 43150K .......... .......... .......... .......... .......... 46% 199M 0s 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi098.stderr: 43200K .......... .......... .......... .......... .......... 46% 301M 0s 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi098.stderr: 43250K .......... .......... .......... .......... .......... 46% 315M 0s 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi098.stderr: 43300K .......... .......... .......... .......... .......... 46% 330M 0s 2024-09-12T18:03:48.054 INFO:teuthology.orchestra.run.smithi098.stderr: 43350K .......... .......... .......... .......... .......... 46% 309M 0s 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi098.stderr: 43400K .......... .......... .......... .......... .......... 46% 166M 0s 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi098.stderr: 43450K .......... .......... .......... .......... .......... 46% 162M 0s 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi098.stderr: 43500K .......... .......... .......... .......... .......... 46% 323M 0s 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi098.stderr: 43550K .......... .......... .......... .......... .......... 46% 151M 0s 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi098.stderr: 43600K .......... .......... .......... .......... .......... 46% 274M 0s 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi098.stderr: 43650K .......... .......... .......... .......... .......... 47% 272M 0s 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi098.stderr: 43700K .......... .......... .......... .......... .......... 47% 282M 0s 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi098.stderr: 43750K .......... .......... .......... .......... .......... 47% 309M 0s 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi098.stderr: 43800K .......... .......... .......... .......... .......... 47% 116M 0s 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi098.stderr: 43850K .......... .......... .......... .......... .......... 47% 323M 0s 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi098.stderr: 43900K .......... .......... .......... .......... .......... 47% 305M 0s 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi098.stderr: 43950K .......... .......... .......... .......... .......... 47% 201M 0s 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi098.stderr: 44000K .......... .......... .......... .......... .......... 47% 329M 0s 2024-09-12T18:03:48.055 INFO:teuthology.orchestra.run.smithi098.stderr: 44050K .......... .......... .......... .......... .......... 47% 189M 0s 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi098.stderr: 44100K .......... .......... .......... .......... .......... 47% 325M 0s 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi098.stderr: 44150K .......... .......... .......... .......... .......... 47% 307M 0s 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi098.stderr: 44200K .......... .......... .......... .......... .......... 47% 329M 0s 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi098.stderr: 44250K .......... .......... .......... .......... .......... 47% 99.6M 0s 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi098.stderr: 44300K .......... .......... .......... .......... .......... 47% 309M 0s 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi098.stderr: 44350K .......... .......... .......... .......... .......... 47% 211M 0s 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi098.stderr: 44400K .......... .......... .......... .......... .......... 47% 257M 0s 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi098.stderr: 44450K .......... .......... .......... .......... .......... 47% 312M 0s 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi098.stderr: 44500K .......... .......... .......... .......... .......... 47% 316M 0s 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi098.stderr: 44550K .......... .......... .......... .......... .......... 48% 148M 0s 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi098.stderr: 44600K .......... .......... .......... .......... .......... 48% 319M 0s 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi098.stderr: 44650K .......... .......... .......... .......... .......... 48% 330M 0s 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi098.stderr: 44700K .......... .......... .......... .......... .......... 48% 321M 0s 2024-09-12T18:03:48.056 INFO:teuthology.orchestra.run.smithi098.stderr: 44750K .......... .......... .......... .......... .......... 48% 290M 0s 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi098.stderr: 44800K .......... .......... .......... .......... .......... 48% 342M 0s 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi098.stderr: 44850K .......... .......... .......... .......... .......... 48% 287M 0s 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi098.stderr: 44900K .......... .......... .......... .......... .......... 48% 146M 0s 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi098.stderr: 44950K .......... .......... .......... .......... .......... 48% 204M 0s 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi098.stderr: 45000K .......... .......... .......... .......... .......... 48% 328M 0s 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi098.stderr: 45050K .......... .......... .......... .......... .......... 48% 205M 0s 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi098.stderr: 45100K .......... .......... .......... .......... .......... 48% 274M 0s 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi098.stderr: 45150K .......... .......... .......... .......... .......... 48% 239M 0s 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi098.stderr: 45200K .......... .......... .......... .......... .......... 48% 314M 0s 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi098.stderr: 45250K .......... .......... .......... .......... .......... 48% 181M 0s 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi098.stderr: 45300K .......... .......... .......... .......... .......... 48% 284M 0s 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi098.stderr: 45350K .......... .......... .......... .......... .......... 48% 275M 0s 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi098.stderr: 45400K .......... .......... .......... .......... .......... 48% 331M 0s 2024-09-12T18:03:48.057 INFO:teuthology.orchestra.run.smithi098.stderr: 45450K .......... .......... .......... .......... .......... 48% 308M 0s 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi098.stderr: 45500K .......... .......... .......... .......... .......... 49% 347M 0s 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi098.stderr: 45550K .......... .......... .......... .......... .......... 49% 266M 0s 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi098.stderr: 45600K .......... .......... .......... .......... .......... 49% 322M 0s 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi098.stderr: 45650K .......... .......... .......... .......... .......... 49% 349M 0s 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi098.stderr: 45700K .......... .......... .......... .......... .......... 49% 316M 0s 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi098.stderr: 45750K .......... .......... .......... .......... .......... 49% 92.3M 0s 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi098.stderr: 45800K .......... .......... .......... .......... .......... 49% 310M 0s 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi098.stderr: 45850K .......... .......... .......... .......... .......... 49% 104M 0s 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi098.stderr: 45900K .......... .......... .......... .......... .......... 49% 306M 0s 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi098.stderr: 45950K .......... .......... .......... .......... .......... 49% 273M 0s 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi098.stderr: 46000K .......... .......... .......... .......... .......... 49% 297M 0s 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi098.stderr: 46050K .......... .......... .......... .......... .......... 49% 268M 0s 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi098.stderr: 46100K .......... .......... .......... .......... .......... 49% 306M 0s 2024-09-12T18:03:48.058 INFO:teuthology.orchestra.run.smithi098.stderr: 46150K .......... .......... .......... .......... .......... 49% 273M 0s 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi098.stderr: 46200K .......... .......... .......... .......... .......... 49% 272M 0s 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi098.stderr: 46250K .......... .......... .......... .......... .......... 49% 325M 0s 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi098.stderr: 46300K .......... .......... .......... .......... .......... 49% 305M 0s 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi098.stderr: 46350K .......... .......... .......... .......... .......... 49% 264M 0s 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi098.stderr: 46400K .......... .......... .......... .......... .......... 49% 324M 0s 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi098.stderr: 46450K .......... .......... .......... .......... .......... 50% 344M 0s 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi098.stderr: 46500K .......... .......... .......... .......... .......... 50% 299M 0s 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi098.stderr: 46550K .......... .......... .......... .......... .......... 50% 265M 0s 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi098.stderr: 46600K .......... .......... .......... .......... .......... 50% 329M 0s 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi098.stderr: 46650K .......... .......... .......... .......... .......... 50% 257M 0s 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi098.stderr: 46700K .......... .......... .......... .......... .......... 50% 240M 0s 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi098.stderr: 46750K .......... .......... .......... .......... .......... 50% 113M 0s 2024-09-12T18:03:48.059 INFO:teuthology.orchestra.run.smithi098.stderr: 46800K .......... .......... .......... .......... .......... 50% 256M 0s 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi098.stderr: 46850K .......... .......... .......... .......... .......... 50% 303M 0s 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi098.stderr: 46900K .......... .......... .......... .......... .......... 50% 361M 0s 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi098.stderr: 46950K .......... .......... .......... .......... .......... 50% 268M 0s 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi098.stderr: 47000K .......... .......... .......... .......... .......... 50% 321M 0s 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi098.stderr: 47050K .......... .......... .......... .......... .......... 50% 318M 0s 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi098.stderr: 47100K .......... .......... .......... .......... .......... 50% 344M 0s 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi098.stderr: 47150K .......... .......... .......... .......... .......... 50% 293M 0s 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi098.stderr: 47200K .......... .......... .......... .......... .......... 50% 188M 0s 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi098.stderr: 47250K .......... .......... .......... .......... .......... 50% 315M 0s 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi098.stderr: 47300K .......... .......... .......... .......... .......... 50% 327M 0s 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi098.stderr: 47350K .......... .......... .......... .......... .......... 51% 281M 0s 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi098.stderr: 47400K .......... .......... .......... .......... .......... 51% 240M 0s 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi098.stderr: 47450K .......... .......... .......... .......... .......... 51% 324M 0s 2024-09-12T18:03:48.060 INFO:teuthology.orchestra.run.smithi098.stderr: 47500K .......... .......... .......... .......... .......... 51% 90.3M 0s 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi098.stderr: 47550K .......... .......... .......... .......... .......... 51% 271M 0s 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi098.stderr: 47600K .......... .......... .......... .......... .......... 51% 334M 0s 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi098.stderr: 47650K .......... .......... .......... .......... .......... 51% 327M 0s 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi098.stderr: 47700K .......... .......... .......... .......... .......... 51% 331M 0s 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi098.stderr: 47750K .......... .......... .......... .......... .......... 51% 313M 0s 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi098.stderr: 47800K .......... .......... .......... .......... .......... 51% 334M 0s 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi098.stderr: 47850K .......... .......... .......... .......... .......... 51% 325M 0s 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi098.stderr: 47900K .......... .......... .......... .......... .......... 51% 205M 0s 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi098.stderr: 47950K .......... .......... .......... .......... .......... 51% 121M 0s 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi098.stderr: 48000K .......... .......... .......... .......... .......... 51% 302M 0s 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi098.stderr: 48050K .......... .......... .......... .......... .......... 51% 327M 0s 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi098.stderr: 48100K .......... .......... .......... .......... .......... 51% 299M 0s 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi098.stderr: 48150K .......... .......... .......... .......... .......... 51% 209M 0s 2024-09-12T18:03:48.061 INFO:teuthology.orchestra.run.smithi098.stderr: 48200K .......... .......... .......... .......... .......... 51% 324M 0s 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi098.stderr: 48250K .......... .......... .......... .......... .......... 51% 317M 0s 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi098.stderr: 48300K .......... .......... .......... .......... .......... 52% 141M 0s 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi098.stderr: 48350K .......... .......... .......... .......... .......... 52% 242M 0s 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi098.stderr: 48400K .......... .......... .......... .......... .......... 52% 331M 0s 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi098.stderr: 48450K .......... .......... .......... .......... .......... 52% 339M 0s 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi098.stderr: 48500K .......... .......... .......... .......... .......... 52% 116M 0s 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi098.stderr: 48550K .......... .......... .......... .......... .......... 52% 280M 0s 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi098.stderr: 48600K .......... .......... .......... .......... .......... 52% 335M 0s 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi098.stderr: 48650K .......... .......... .......... .......... .......... 52% 356M 0s 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi098.stderr: 48700K .......... .......... .......... .......... .......... 52% 61.5M 0s 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi098.stderr: 48750K .......... .......... .......... .......... .......... 52% 261M 0s 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi098.stderr: 48800K .......... .......... .......... .......... .......... 52% 227M 0s 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi098.stderr: 48850K .......... .......... .......... .......... .......... 52% 115M 0s 2024-09-12T18:03:48.062 INFO:teuthology.orchestra.run.smithi098.stderr: 48900K .......... .......... .......... .......... .......... 52% 277M 0s 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi098.stderr: 48950K .......... .......... .......... .......... .......... 52% 204M 0s 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi098.stderr: 49000K .......... .......... .......... .......... .......... 52% 325M 0s 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi098.stderr: 49050K .......... .......... .......... .......... .......... 52% 329M 0s 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi098.stderr: 49100K .......... .......... .......... .......... .......... 52% 344M 0s 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi098.stderr: 49150K .......... .......... .......... .......... .......... 52% 276M 0s 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi098.stderr: 49200K .......... .......... .......... .......... .......... 53% 213M 0s 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi098.stderr: 49250K .......... .......... .......... .......... .......... 53% 258M 0s 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi098.stderr: 49300K .......... .......... .......... .......... .......... 53% 353M 0s 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi098.stderr: 49350K .......... .......... .......... .......... .......... 53% 293M 0s 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi098.stderr: 49400K .......... .......... .......... .......... .......... 53% 315M 0s 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi098.stderr: 49450K .......... .......... .......... .......... .......... 53% 340M 0s 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi098.stderr: 49500K .......... .......... .......... .......... .......... 53% 319M 0s 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi098.stderr: 49550K .......... .......... .......... .......... .......... 53% 280M 0s 2024-09-12T18:03:48.063 INFO:teuthology.orchestra.run.smithi098.stderr: 49600K .......... .......... .......... .......... .......... 53% 363M 0s 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi098.stderr: 49650K .......... .......... .......... .......... .......... 53% 346M 0s 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi098.stderr: 49700K .......... .......... .......... .......... .......... 53% 328M 0s 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi098.stderr: 49750K .......... .......... .......... .......... .......... 53% 286M 0s 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi098.stderr: 49800K .......... .......... .......... .......... .......... 53% 329M 0s 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi098.stderr: 49850K .......... .......... .......... .......... .......... 53% 336M 0s 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi098.stderr: 49900K .......... .......... .......... .......... .......... 53% 325M 0s 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi098.stderr: 49950K .......... .......... .......... .......... .......... 53% 278M 0s 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi098.stderr: 50000K .......... .......... .......... .......... .......... 53% 307M 0s 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi098.stderr: 50050K .......... .......... .......... .......... .......... 53% 316M 0s 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi098.stderr: 50100K .......... .......... .......... .......... .......... 53% 318M 0s 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi098.stderr: 50150K .......... .......... .......... .......... .......... 54% 285M 0s 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi098.stderr: 50200K .......... .......... .......... .......... .......... 54% 347M 0s 2024-09-12T18:03:48.064 INFO:teuthology.orchestra.run.smithi098.stderr: 50250K .......... .......... .......... .......... .......... 54% 315M 0s 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi098.stderr: 50300K .......... .......... .......... .......... .......... 54% 354M 0s 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi098.stderr: 50350K .......... .......... .......... .......... .......... 54% 290M 0s 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi098.stderr: 50400K .......... .......... .......... .......... .......... 54% 350M 0s 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi098.stderr: 50450K .......... .......... .......... .......... .......... 54% 108M 0s 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi098.stderr: 50500K .......... .......... .......... .......... .......... 54% 323M 0s 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi098.stderr: 50550K .......... .......... .......... .......... .......... 54% 320M 0s 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi098.stderr: 50600K .......... .......... .......... .......... .......... 54% 260M 0s 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi098.stderr: 50650K .......... .......... .......... .......... .......... 54% 274M 0s 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi098.stderr: 50700K .......... .......... .......... .......... .......... 54% 321M 0s 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi098.stderr: 50750K .......... .......... .......... .......... .......... 54% 277M 0s 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi098.stderr: 50800K .......... .......... .......... .......... .......... 54% 365M 0s 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi098.stderr: 50850K .......... .......... .......... .......... .......... 54% 186M 0s 2024-09-12T18:03:48.065 INFO:teuthology.orchestra.run.smithi098.stderr: 50900K .......... .......... .......... .......... .......... 54% 316M 0s 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi098.stderr: 50950K .......... .......... .......... .......... .......... 54% 311M 0s 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi098.stderr: 51000K .......... .......... .......... .......... .......... 54% 230M 0s 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi098.stderr: 51050K .......... .......... .......... .......... .......... 55% 318M 0s 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi098.stderr: 51100K .......... .......... .......... .......... .......... 55% 234M 0s 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi098.stderr: 51150K .......... .......... .......... .......... .......... 55% 237M 0s 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi098.stderr: 51200K .......... .......... .......... .......... .......... 55% 216M 0s 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi098.stderr: 51250K .......... .......... .......... .......... .......... 55% 358M 0s 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi098.stderr: 51300K .......... .......... .......... .......... .......... 55% 230M 0s 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi098.stderr: 51350K .......... .......... .......... .......... .......... 55% 104M 0s 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi098.stderr: 51400K .......... .......... .......... .......... .......... 55% 334M 0s 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi098.stderr: 51450K .......... .......... .......... .......... .......... 55% 343M 0s 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi098.stderr: 51500K .......... .......... .......... .......... .......... 55% 186M 0s 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi098.stderr: 51550K .......... .......... .......... .......... .......... 55% 195M 0s 2024-09-12T18:03:48.066 INFO:teuthology.orchestra.run.smithi098.stderr: 51600K .......... .......... .......... .......... .......... 55% 342M 0s 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi098.stderr: 51650K .......... .......... .......... .......... .......... 55% 48.2M 0s 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi098.stderr: 51700K .......... .......... .......... .......... .......... 55% 298M 0s 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi098.stderr: 51750K .......... .......... .......... .......... .......... 55% 338M 0s 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi098.stderr: 51800K .......... .......... .......... .......... .......... 55% 370M 0s 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi098.stderr: 51850K .......... .......... .......... .......... .......... 55% 361M 0s 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi098.stderr: 51900K .......... .......... .......... .......... .......... 55% 89.0M 0s 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi098.stderr: 51950K .......... .......... .......... .......... .......... 55% 334M 0s 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi098.stderr: 52000K .......... .......... .......... .......... .......... 56% 330M 0s 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi098.stderr: 52050K .......... .......... .......... .......... .......... 56% 307M 0s 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi098.stderr: 52100K .......... .......... .......... .......... .......... 56% 327M 0s 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi098.stderr: 52150K .......... .......... .......... .......... .......... 56% 368M 0s 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi098.stderr: 52200K .......... .......... .......... .......... .......... 56% 167M 0s 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi098.stderr: 52250K .......... .......... .......... .......... .......... 56% 320M 0s 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi098.stderr: 52300K .......... .......... .......... .......... .......... 56% 273M 0s 2024-09-12T18:03:48.067 INFO:teuthology.orchestra.run.smithi098.stderr: 52350K .......... .......... .......... .......... .......... 56% 327M 0s 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi098.stderr: 52400K .......... .......... .......... .......... .......... 56% 344M 0s 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi098.stderr: 52450K .......... .......... .......... .......... .......... 56% 193M 0s 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi098.stderr: 52500K .......... .......... .......... .......... .......... 56% 294M 0s 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi098.stderr: 52550K .......... .......... .......... .......... .......... 56% 317M 0s 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi098.stderr: 52600K .......... .......... .......... .......... .......... 56% 395M 0s 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi098.stderr: 52650K .......... .......... .......... .......... .......... 56% 324M 0s 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi098.stderr: 52700K .......... .......... .......... .......... .......... 56% 291M 0s 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi098.stderr: 52750K .......... .......... .......... .......... .......... 56% 326M 0s 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi098.stderr: 52800K .......... .......... .......... .......... .......... 56% 317M 0s 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi098.stderr: 52850K .......... .......... .......... .......... .......... 56% 338M 0s 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi098.stderr: 52900K .......... .......... .......... .......... .......... 56% 288M 0s 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi098.stderr: 52950K .......... .......... .......... .......... .......... 57% 310M 0s 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi098.stderr: 53000K .......... .......... .......... .......... .......... 57% 315M 0s 2024-09-12T18:03:48.068 INFO:teuthology.orchestra.run.smithi098.stderr: 53050K .......... .......... .......... .......... .......... 57% 344M 0s 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi098.stderr: 53100K .......... .......... .......... .......... .......... 57% 269M 0s 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi098.stderr: 53150K .......... .......... .......... .......... .......... 57% 349M 0s 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi098.stderr: 53200K .......... .......... .......... .......... .......... 57% 349M 0s 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi098.stderr: 53250K .......... .......... .......... .......... .......... 57% 310M 0s 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi098.stderr: 53300K .......... .......... .......... .......... .......... 57% 301M 0s 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi098.stderr: 53350K .......... .......... .......... .......... .......... 57% 294M 0s 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi098.stderr: 53400K .......... .......... .......... .......... .......... 57% 128M 0s 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi098.stderr: 53450K .......... .......... .......... .......... .......... 57% 315M 0s 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi098.stderr: 53500K .......... .......... .......... .......... .......... 57% 262M 0s 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi098.stderr: 53550K .......... .......... .......... .......... .......... 57% 307M 0s 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi098.stderr: 53600K .......... .......... .......... .......... .......... 57% 317M 0s 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi098.stderr: 53650K .......... .......... .......... .......... .......... 57% 334M 0s 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi098.stderr: 53700K .......... .......... .......... .......... .......... 57% 318M 0s 2024-09-12T18:03:48.069 INFO:teuthology.orchestra.run.smithi098.stderr: 53750K .......... .......... .......... .......... .......... 57% 135M 0s 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi098.stderr: 53800K .......... .......... .......... .......... .......... 57% 273M 0s 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi098.stderr: 53850K .......... .......... .......... .......... .......... 58% 327M 0s 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi098.stderr: 53900K .......... .......... .......... .......... .......... 58% 282M 0s 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi098.stderr: 53950K .......... .......... .......... .......... .......... 58% 312M 0s 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi098.stderr: 54000K .......... .......... .......... .......... .......... 58% 341M 0s 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi098.stderr: 54050K .......... .......... .......... .......... .......... 58% 322M 0s 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi098.stderr: 54100K .......... .......... .......... .......... .......... 58% 315M 0s 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi098.stderr: 54150K .......... .......... .......... .......... .......... 58% 355M 0s 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi098.stderr: 54200K .......... .......... .......... .......... .......... 58% 285M 0s 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi098.stderr: 54250K .......... .......... .......... .......... .......... 58% 321M 0s 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi098.stderr: 54300K .......... .......... .......... .......... .......... 58% 285M 0s 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi098.stderr: 54350K .......... .......... .......... .......... .......... 58% 127M 0s 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi098.stderr: 54400K .......... .......... .......... .......... .......... 58% 218M 0s 2024-09-12T18:03:48.070 INFO:teuthology.orchestra.run.smithi098.stderr: 54450K .......... .......... .......... .......... .......... 58% 315M 0s 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi098.stderr: 54500K .......... .......... .......... .......... .......... 58% 303M 0s 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi098.stderr: 54550K .......... .......... .......... .......... .......... 58% 312M 0s 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi098.stderr: 54600K .......... .......... .......... .......... .......... 58% 183M 0s 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi098.stderr: 54650K .......... .......... .......... .......... .......... 58% 53.7M 0s 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi098.stderr: 54700K .......... .......... .......... .......... .......... 58% 141M 0s 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi098.stderr: 54750K .......... .......... .......... .......... .......... 58% 328M 0s 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi098.stderr: 54800K .......... .......... .......... .......... .......... 59% 325M 0s 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi098.stderr: 54850K .......... .......... .......... .......... .......... 59% 322M 0s 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi098.stderr: 54900K .......... .......... .......... .......... .......... 59% 105M 0s 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi098.stderr: 54950K .......... .......... .......... .......... .......... 59% 321M 0s 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi098.stderr: 55000K .......... .......... .......... .......... .......... 59% 239M 0s 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi098.stderr: 55050K .......... .......... .......... .......... .......... 59% 309M 0s 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi098.stderr: 55100K .......... .......... .......... .......... .......... 59% 285M 0s 2024-09-12T18:03:48.071 INFO:teuthology.orchestra.run.smithi098.stderr: 55150K .......... .......... .......... .......... .......... 59% 276M 0s 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi098.stderr: 55200K .......... .......... .......... .......... .......... 59% 325M 0s 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi098.stderr: 55250K .......... .......... .......... .......... .......... 59% 130M 0s 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi098.stderr: 55300K .......... .......... .......... .......... .......... 59% 279M 0s 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi098.stderr: 55350K .......... .......... .......... .......... .......... 59% 325M 0s 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi098.stderr: 55400K .......... .......... .......... .......... .......... 59% 326M 0s 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi098.stderr: 55450K .......... .......... .......... .......... .......... 59% 343M 0s 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi098.stderr: 55500K .......... .......... .......... .......... .......... 59% 220M 0s 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi098.stderr: 55550K .......... .......... .......... .......... .......... 59% 310M 0s 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi098.stderr: 55600K .......... .......... .......... .......... .......... 59% 344M 0s 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi098.stderr: 55650K .......... .......... .......... .......... .......... 59% 328M 0s 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi098.stderr: 55700K .......... .......... .......... .......... .......... 60% 288M 0s 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi098.stderr: 55750K .......... .......... .......... .......... .......... 60% 335M 0s 2024-09-12T18:03:48.072 INFO:teuthology.orchestra.run.smithi098.stderr: 55800K .......... .......... .......... .......... .......... 60% 316M 0s 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi098.stderr: 55850K .......... .......... .......... .......... .......... 60% 249M 0s 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi098.stderr: 55900K .......... .......... .......... .......... .......... 60% 270M 0s 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi098.stderr: 55950K .......... .......... .......... .......... .......... 60% 327M 0s 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi098.stderr: 56000K .......... .......... .......... .......... .......... 60% 355M 0s 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi098.stderr: 56050K .......... .......... .......... .......... .......... 60% 321M 0s 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi098.stderr: 56100K .......... .......... .......... .......... .......... 60% 322M 0s 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi098.stderr: 56150K .......... .......... .......... .......... .......... 60% 286M 0s 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi098.stderr: 56200K .......... .......... .......... .......... .......... 60% 341M 0s 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi098.stderr: 56250K .......... .......... .......... .......... .......... 60% 369M 0s 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi098.stderr: 56300K .......... .......... .......... .......... .......... 60% 167M 0s 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi098.stderr: 56350K .......... .......... .......... .......... .......... 60% 311M 0s 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi098.stderr: 56400K .......... .......... .......... .......... .......... 60% 339M 0s 2024-09-12T18:03:48.073 INFO:teuthology.orchestra.run.smithi098.stderr: 56450K .......... .......... .......... .......... .......... 60% 349M 0s 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi098.stderr: 56500K .......... .......... .......... .......... .......... 60% 321M 0s 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi098.stderr: 56550K .......... .......... .......... .......... .......... 60% 326M 0s 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi098.stderr: 56600K .......... .......... .......... .......... .......... 60% 333M 0s 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi098.stderr: 56650K .......... .......... .......... .......... .......... 61% 352M 0s 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi098.stderr: 56700K .......... .......... .......... .......... .......... 61% 109M 0s 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi098.stderr: 56750K .......... .......... .......... .......... .......... 61% 331M 0s 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi098.stderr: 56800K .......... .......... .......... .......... .......... 61% 328M 0s 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi098.stderr: 56850K .......... .......... .......... .......... .......... 61% 370M 0s 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi098.stderr: 56900K .......... .......... .......... .......... .......... 61% 291M 0s 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi098.stderr: 56950K .......... .......... .......... .......... .......... 61% 344M 0s 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi098.stderr: 57000K .......... .......... .......... .......... .......... 61% 355M 0s 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi098.stderr: 57050K .......... .......... .......... .......... .......... 61% 314M 0s 2024-09-12T18:03:48.074 INFO:teuthology.orchestra.run.smithi098.stderr: 57100K .......... .......... .......... .......... .......... 61% 314M 0s 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi098.stderr: 57150K .......... .......... .......... .......... .......... 61% 169M 0s 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi098.stderr: 57200K .......... .......... .......... .......... .......... 61% 326M 0s 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi098.stderr: 57250K .......... .......... .......... .......... .......... 61% 331M 0s 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi098.stderr: 57300K .......... .......... .......... .......... .......... 61% 273M 0s 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi098.stderr: 57350K .......... .......... .......... .......... .......... 61% 346M 0s 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi098.stderr: 57400K .......... .......... .......... .......... .......... 61% 234M 0s 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi098.stderr: 57450K .......... .......... .......... .......... .......... 61% 269M 0s 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi098.stderr: 57500K .......... .......... .......... .......... .......... 61% 277M 0s 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi098.stderr: 57550K .......... .......... .......... .......... .......... 62% 332M 0s 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi098.stderr: 57600K .......... .......... .......... .......... .......... 62% 227M 0s 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi098.stderr: 57650K .......... .......... .......... .......... .......... 62% 52.3M 0s 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi098.stderr: 57700K .......... .......... .......... .......... .......... 62% 178M 0s 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi098.stderr: 57750K .......... .......... .......... .......... .......... 62% 330M 0s 2024-09-12T18:03:48.075 INFO:teuthology.orchestra.run.smithi098.stderr: 57800K .......... .......... .......... .......... .......... 62% 236M 0s 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi098.stderr: 57850K .......... .......... .......... .......... .......... 62% 69.7M 0s 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi098.stderr: 57900K .......... .......... .......... .......... .......... 62% 226M 0s 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi098.stderr: 57950K .......... .......... .......... .......... .......... 62% 330M 0s 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi098.stderr: 58000K .......... .......... .......... .......... .......... 62% 322M 0s 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi098.stderr: 58050K .......... .......... .......... .......... .......... 62% 312M 0s 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi098.stderr: 58100K .......... .......... .......... .......... .......... 62% 320M 0s 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi098.stderr: 58150K .......... .......... .......... .......... .......... 62% 367M 0s 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi098.stderr: 58200K .......... .......... .......... .......... .......... 62% 352M 0s 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi098.stderr: 58250K .......... .......... .......... .......... .......... 62% 96.2M 0s 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi098.stderr: 58300K .......... .......... .......... .......... .......... 62% 285M 0s 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi098.stderr: 58350K .......... .......... .......... .......... .......... 62% 338M 0s 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi098.stderr: 58400K .......... .......... .......... .......... .......... 62% 322M 0s 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi098.stderr: 58450K .......... .......... .......... .......... .......... 62% 350M 0s 2024-09-12T18:03:48.076 INFO:teuthology.orchestra.run.smithi098.stderr: 58500K .......... .......... .......... .......... .......... 63% 329M 0s 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi098.stderr: 58550K .......... .......... .......... .......... .......... 63% 325M 0s 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi098.stderr: 58600K .......... .......... .......... .......... .......... 63% 355M 0s 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi098.stderr: 58650K .......... .......... .......... .......... .......... 63% 337M 0s 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi098.stderr: 58700K .......... .......... .......... .......... .......... 63% 284M 0s 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi098.stderr: 58750K .......... .......... .......... .......... .......... 63% 344M 0s 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi098.stderr: 58800K .......... .......... .......... .......... .......... 63% 339M 0s 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi098.stderr: 58850K .......... .......... .......... .......... .......... 63% 229M 0s 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi098.stderr: 58900K .......... .......... .......... .......... .......... 63% 295M 0s 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi098.stderr: 58950K .......... .......... .......... .......... .......... 63% 348M 0s 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi098.stderr: 59000K .......... .......... .......... .......... .......... 63% 405M 0s 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi098.stderr: 59050K .......... .......... .......... .......... .......... 63% 250M 0s 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi098.stderr: 59100K .......... .......... .......... .......... .......... 63% 222M 0s 2024-09-12T18:03:48.077 INFO:teuthology.orchestra.run.smithi098.stderr: 59150K .......... .......... .......... .......... .......... 63% 337M 0s 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi098.stderr: 59200K .......... .......... .......... .......... .......... 63% 350M 0s 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi098.stderr: 59250K .......... .......... .......... .......... .......... 63% 223M 0s 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi098.stderr: 59300K .......... .......... .......... .......... .......... 63% 236M 0s 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi098.stderr: 59350K .......... .......... .......... .......... .......... 63% 321M 0s 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi098.stderr: 59400K .......... .......... .......... .......... .......... 63% 358M 0s 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi098.stderr: 59450K .......... .......... .......... .......... .......... 64% 332M 0s 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi098.stderr: 59500K .......... .......... .......... .......... .......... 64% 292M 0s 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi098.stderr: 59550K .......... .......... .......... .......... .......... 64% 341M 0s 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi098.stderr: 59600K .......... .......... .......... .......... .......... 64% 339M 0s 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi098.stderr: 59650K .......... .......... .......... .......... .......... 64% 339M 0s 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi098.stderr: 59700K .......... .......... .......... .......... .......... 64% 241M 0s 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi098.stderr: 59750K .......... .......... .......... .......... .......... 64% 174M 0s 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi098.stderr: 59800K .......... .......... .......... .......... .......... 64% 245M 0s 2024-09-12T18:03:48.078 INFO:teuthology.orchestra.run.smithi098.stderr: 59850K .......... .......... .......... .......... .......... 64% 344M 0s 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi098.stderr: 59900K .......... .......... .......... .......... .......... 64% 278M 0s 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi098.stderr: 59950K .......... .......... .......... .......... .......... 64% 319M 0s 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi098.stderr: 60000K .......... .......... .......... .......... .......... 64% 331M 0s 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi098.stderr: 60050K .......... .......... .......... .......... .......... 64% 360M 0s 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi098.stderr: 60100K .......... .......... .......... .......... .......... 64% 314M 0s 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi098.stderr: 60150K .......... .......... .......... .......... .......... 64% 262M 0s 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi098.stderr: 60200K .......... .......... .......... .......... .......... 64% 242M 0s 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi098.stderr: 60250K .......... .......... .......... .......... .......... 64% 317M 0s 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi098.stderr: 60300K .......... .......... .......... .......... .......... 64% 265M 0s 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi098.stderr: 60350K .......... .......... .......... .......... .......... 65% 369M 0s 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi098.stderr: 60400K .......... .......... .......... .......... .......... 65% 326M 0s 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi098.stderr: 60450K .......... .......... .......... .......... .......... 65% 330M 0s 2024-09-12T18:03:48.079 INFO:teuthology.orchestra.run.smithi098.stderr: 60500K .......... .......... .......... .......... .......... 65% 310M 0s 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi098.stderr: 60550K .......... .......... .......... .......... .......... 65% 365M 0s 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi098.stderr: 60600K .......... .......... .......... .......... .......... 65% 324M 0s 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi098.stderr: 60650K .......... .......... .......... .......... .......... 65% 54.8M 0s 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi098.stderr: 60700K .......... .......... .......... .......... .......... 65% 195M 0s 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi098.stderr: 60750K .......... .......... .......... .......... .......... 65% 226M 0s 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi098.stderr: 60800K .......... .......... .......... .......... .......... 65% 329M 0s 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi098.stderr: 60850K .......... .......... .......... .......... .......... 65% 59.4M 0s 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi098.stderr: 60900K .......... .......... .......... .......... .......... 65% 193M 0s 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi098.stderr: 60950K .......... .......... .......... .......... .......... 65% 183M 0s 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi098.stderr: 61000K .......... .......... .......... .......... .......... 65% 323M 0s 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi098.stderr: 61050K .......... .......... .......... .......... .......... 65% 350M 0s 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi098.stderr: 61100K .......... .......... .......... .......... .......... 65% 301M 0s 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi098.stderr: 61150K .......... .......... .......... .......... .......... 65% 142M 0s 2024-09-12T18:03:48.080 INFO:teuthology.orchestra.run.smithi098.stderr: 61200K .......... .......... .......... .......... .......... 65% 295M 0s 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi098.stderr: 61250K .......... .......... .......... .......... .......... 65% 339M 0s 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi098.stderr: 61300K .......... .......... .......... .......... .......... 66% 340M 0s 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi098.stderr: 61350K .......... .......... .......... .......... .......... 66% 280M 0s 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi098.stderr: 61400K .......... .......... .......... .......... .......... 66% 250M 0s 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi098.stderr: 61450K .......... .......... .......... .......... .......... 66% 103M 0s 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi098.stderr: 61500K .......... .......... .......... .......... .......... 66% 207M 0s 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi098.stderr: 61550K .......... .......... .......... .......... .......... 66% 279M 0s 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi098.stderr: 61600K .......... .......... .......... .......... .......... 66% 348M 0s 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi098.stderr: 61650K .......... .......... .......... .......... .......... 66% 280M 0s 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi098.stderr: 61700K .......... .......... .......... .......... .......... 66% 336M 0s 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi098.stderr: 61750K .......... .......... .......... .......... .......... 66% 351M 0s 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi098.stderr: 61800K .......... .......... .......... .......... .......... 66% 335M 0s 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi098.stderr: 61850K .......... .......... .......... .......... .......... 66% 279M 0s 2024-09-12T18:03:48.081 INFO:teuthology.orchestra.run.smithi098.stderr: 61900K .......... .......... .......... .......... .......... 66% 364M 0s 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi098.stderr: 61950K .......... .......... .......... .......... .......... 66% 339M 0s 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi098.stderr: 62000K .......... .......... .......... .......... .......... 66% 350M 0s 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi098.stderr: 62050K .......... .......... .......... .......... .......... 66% 326M 0s 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi098.stderr: 62100K .......... .......... .......... .......... .......... 66% 349M 0s 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi098.stderr: 62150K .......... .......... .......... .......... .......... 66% 319M 0s 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi098.stderr: 62200K .......... .......... .......... .......... .......... 67% 338M 0s 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi098.stderr: 62250K .......... .......... .......... .......... .......... 67% 295M 0s 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi098.stderr: 62300K .......... .......... .......... .......... .......... 67% 374M 0s 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi098.stderr: 62350K .......... .......... .......... .......... .......... 67% 312M 0s 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi098.stderr: 62400K .......... .......... .......... .......... .......... 67% 334M 0s 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi098.stderr: 62450K .......... .......... .......... .......... .......... 67% 313M 0s 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi098.stderr: 62500K .......... .......... .......... .......... .......... 67% 361M 0s 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi098.stderr: 62550K .......... .......... .......... .......... .......... 67% 325M 0s 2024-09-12T18:03:48.082 INFO:teuthology.orchestra.run.smithi098.stderr: 62600K .......... .......... .......... .......... .......... 67% 293M 0s 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi098.stderr: 62650K .......... .......... .......... .......... .......... 67% 323M 0s 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi098.stderr: 62700K .......... .......... .......... .......... .......... 67% 326M 0s 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi098.stderr: 62750K .......... .......... .......... .......... .......... 67% 285M 0s 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi098.stderr: 62800K .......... .......... .......... .......... .......... 67% 146M 0s 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi098.stderr: 62850K .......... .......... .......... .......... .......... 67% 232M 0s 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi098.stderr: 62900K .......... .......... .......... .......... .......... 67% 271M 0s 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi098.stderr: 62950K .......... .......... .......... .......... .......... 67% 318M 0s 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi098.stderr: 63000K .......... .......... .......... .......... .......... 67% 343M 0s 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi098.stderr: 63050K .......... .......... .......... .......... .......... 67% 359M 0s 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi098.stderr: 63100K .......... .......... .......... .......... .......... 67% 327M 0s 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi098.stderr: 63150K .......... .......... .......... .......... .......... 68% 282M 0s 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi098.stderr: 63200K .......... .......... .......... .......... .......... 68% 339M 0s 2024-09-12T18:03:48.083 INFO:teuthology.orchestra.run.smithi098.stderr: 63250K .......... .......... .......... .......... .......... 68% 352M 0s 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi098.stderr: 63300K .......... .......... .......... .......... .......... 68% 345M 0s 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi098.stderr: 63350K .......... .......... .......... .......... .......... 68% 286M 0s 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi098.stderr: 63400K .......... .......... .......... .......... .......... 68% 372M 0s 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi098.stderr: 63450K .......... .......... .......... .......... .......... 68% 333M 0s 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi098.stderr: 63500K .......... .......... .......... .......... .......... 68% 339M 0s 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi098.stderr: 63550K .......... .......... .......... .......... .......... 68% 293M 0s 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi098.stderr: 63600K .......... .......... .......... .......... .......... 68% 77.2M 0s 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi098.stderr: 63650K .......... .......... .......... .......... .......... 68% 209M 0s 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi098.stderr: 63700K .......... .......... .......... .......... .......... 68% 253M 0s 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi098.stderr: 63750K .......... .......... .......... .......... .......... 68% 238M 0s 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi098.stderr: 63800K .......... .......... .......... .......... .......... 68% 49.9M 0s 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi098.stderr: 63850K .......... .......... .......... .......... .......... 68% 265M 0s 2024-09-12T18:03:48.084 INFO:teuthology.orchestra.run.smithi098.stderr: 63900K .......... .......... .......... .......... .......... 68% 346M 0s 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi098.stderr: 63950K .......... .......... .......... .......... .......... 68% 209M 0s 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi098.stderr: 64000K .......... .......... .......... .......... .......... 68% 160M 0s 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi098.stderr: 64050K .......... .......... .......... .......... .......... 68% 340M 0s 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi098.stderr: 64100K .......... .......... .......... .......... .......... 69% 350M 0s 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi098.stderr: 64150K .......... .......... .......... .......... .......... 69% 214M 0s 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi098.stderr: 64200K .......... .......... .......... .......... .......... 69% 251M 0s 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi098.stderr: 64250K .......... .......... .......... .......... .......... 69% 187M 0s 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi098.stderr: 64300K .......... .......... .......... .......... .......... 69% 332M 0s 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi098.stderr: 64350K .......... .......... .......... .......... .......... 69% 271M 0s 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi098.stderr: 64400K .......... .......... .......... .......... .......... 69% 366M 0s 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi098.stderr: 64450K .......... .......... .......... .......... .......... 69% 85.9M 0s 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi098.stderr: 64500K .......... .......... .......... .......... .......... 69% 216M 0s 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi098.stderr: 64550K .......... .......... .......... .......... .......... 69% 314M 0s 2024-09-12T18:03:48.085 INFO:teuthology.orchestra.run.smithi098.stderr: 64600K .......... .......... .......... .......... .......... 69% 200M 0s 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi098.stderr: 64650K .......... .......... .......... .......... .......... 69% 338M 0s 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi098.stderr: 64700K .......... .......... .......... .......... .......... 69% 331M 0s 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi098.stderr: 64750K .......... .......... .......... .......... .......... 69% 287M 0s 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi098.stderr: 64800K .......... .......... .......... .......... .......... 69% 337M 0s 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi098.stderr: 64850K .......... .......... .......... .......... .......... 69% 347M 0s 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi098.stderr: 64900K .......... .......... .......... .......... .......... 69% 344M 0s 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi098.stderr: 64950K .......... .......... .......... .......... .......... 69% 290M 0s 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi098.stderr: 65000K .......... .......... .......... .......... .......... 70% 409M 0s 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi098.stderr: 65050K .......... .......... .......... .......... .......... 70% 340M 0s 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi098.stderr: 65100K .......... .......... .......... .......... .......... 70% 341M 0s 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi098.stderr: 65150K .......... .......... .......... .......... .......... 70% 279M 0s 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi098.stderr: 65200K .......... .......... .......... .......... .......... 70% 337M 0s 2024-09-12T18:03:48.086 INFO:teuthology.orchestra.run.smithi098.stderr: 65250K .......... .......... .......... .......... .......... 70% 357M 0s 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi098.stderr: 65300K .......... .......... .......... .......... .......... 70% 347M 0s 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi098.stderr: 65350K .......... .......... .......... .......... .......... 70% 313M 0s 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi098.stderr: 65400K .......... .......... .......... .......... .......... 70% 345M 0s 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi098.stderr: 65450K .......... .......... .......... .......... .......... 70% 370M 0s 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi098.stderr: 65500K .......... .......... .......... .......... .......... 70% 378M 0s 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi098.stderr: 65550K .......... .......... .......... .......... .......... 70% 273M 0s 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi098.stderr: 65600K .......... .......... .......... .......... .......... 70% 329M 0s 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi098.stderr: 65650K .......... .......... .......... .......... .......... 70% 298M 0s 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi098.stderr: 65700K .......... .......... .......... .......... .......... 70% 360M 0s 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi098.stderr: 65750K .......... .......... .......... .......... .......... 70% 255M 0s 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi098.stderr: 65800K .......... .......... .......... .......... .......... 70% 297M 0s 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi098.stderr: 65850K .......... .......... .......... .......... .......... 70% 235M 0s 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi098.stderr: 65900K .......... .......... .......... .......... .......... 70% 325M 0s 2024-09-12T18:03:48.087 INFO:teuthology.orchestra.run.smithi098.stderr: 65950K .......... .......... .......... .......... .......... 71% 266M 0s 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi098.stderr: 66000K .......... .......... .......... .......... .......... 71% 357M 0s 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi098.stderr: 66050K .......... .......... .......... .......... .......... 71% 354M 0s 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi098.stderr: 66100K .......... .......... .......... .......... .......... 71% 355M 0s 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi098.stderr: 66150K .......... .......... .......... .......... .......... 71% 282M 0s 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi098.stderr: 66200K .......... .......... .......... .......... .......... 71% 354M 0s 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi098.stderr: 66250K .......... .......... .......... .......... .......... 71% 355M 0s 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi098.stderr: 66300K .......... .......... .......... .......... .......... 71% 334M 0s 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi098.stderr: 66350K .......... .......... .......... .......... .......... 71% 290M 0s 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi098.stderr: 66400K .......... .......... .......... .......... .......... 71% 350M 0s 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi098.stderr: 66450K .......... .......... .......... .......... .......... 71% 334M 0s 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi098.stderr: 66500K .......... .......... .......... .......... .......... 71% 336M 0s 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi098.stderr: 66550K .......... .......... .......... .......... .......... 71% 304M 0s 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi098.stderr: 66600K .......... .......... .......... .......... .......... 71% 89.4M 0s 2024-09-12T18:03:48.088 INFO:teuthology.orchestra.run.smithi098.stderr: 66650K .......... .......... .......... .......... .......... 71% 255M 0s 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi098.stderr: 66700K .......... .......... .......... .......... .......... 71% 113M 0s 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi098.stderr: 66750K .......... .......... .......... .......... .......... 71% 296M 0s 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi098.stderr: 66800K .......... .......... .......... .......... .......... 71% 58.5M 0s 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi098.stderr: 66850K .......... .......... .......... .......... .......... 72% 136M 0s 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi098.stderr: 66900K .......... .......... .......... .......... .......... 72% 244M 0s 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi098.stderr: 66950K .......... .......... .......... .......... .......... 72% 307M 0s 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi098.stderr: 67000K .......... .......... .......... .......... .......... 72% 235M 0s 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi098.stderr: 67050K .......... .......... .......... .......... .......... 72% 351M 0s 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi098.stderr: 67100K .......... .......... .......... .......... .......... 72% 365M 0s 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi098.stderr: 67150K .......... .......... .......... .......... .......... 72% 250M 0s 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi098.stderr: 67200K .......... .......... .......... .......... .......... 72% 127M 0s 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi098.stderr: 67250K .......... .......... .......... .......... .......... 72% 336M 0s 2024-09-12T18:03:48.089 INFO:teuthology.orchestra.run.smithi098.stderr: 67300K .......... .......... .......... .......... .......... 72% 349M 0s 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi098.stderr: 67350K .......... .......... .......... .......... .......... 72% 315M 0s 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi098.stderr: 67400K .......... .......... .......... .......... .......... 72% 63.9M 0s 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi098.stderr: 67450K .......... .......... .......... .......... .......... 72% 327M 0s 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi098.stderr: 67500K .......... .......... .......... .......... .......... 72% 330M 0s 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi098.stderr: 67550K .......... .......... .......... .......... .......... 72% 285M 0s 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi098.stderr: 67600K .......... .......... .......... .......... .......... 72% 358M 0s 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi098.stderr: 67650K .......... .......... .......... .......... .......... 72% 90.2M 0s 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi098.stderr: 67700K .......... .......... .......... .......... .......... 72% 337M 0s 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi098.stderr: 67750K .......... .......... .......... .......... .......... 72% 300M 0s 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi098.stderr: 67800K .......... .......... .......... .......... .......... 73% 342M 0s 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi098.stderr: 67850K .......... .......... .......... .......... .......... 73% 339M 0s 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi098.stderr: 67900K .......... .......... .......... .......... .......... 73% 363M 0s 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi098.stderr: 67950K .......... .......... .......... .......... .......... 73% 289M 0s 2024-09-12T18:03:48.090 INFO:teuthology.orchestra.run.smithi098.stderr: 68000K .......... .......... .......... .......... .......... 73% 347M 0s 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi098.stderr: 68050K .......... .......... .......... .......... .......... 73% 345M 0s 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi098.stderr: 68100K .......... .......... .......... .......... .......... 73% 324M 0s 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi098.stderr: 68150K .......... .......... .......... .......... .......... 73% 299M 0s 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi098.stderr: 68200K .......... .......... .......... .......... .......... 73% 317M 0s 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi098.stderr: 68250K .......... .......... .......... .......... .......... 73% 373M 0s 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi098.stderr: 68300K .......... .......... .......... .......... .......... 73% 337M 0s 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi098.stderr: 68350K .......... .......... .......... .......... .......... 73% 283M 0s 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi098.stderr: 68400K .......... .......... .......... .......... .......... 73% 354M 0s 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi098.stderr: 68450K .......... .......... .......... .......... .......... 73% 374M 0s 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi098.stderr: 68500K .......... .......... .......... .......... .......... 73% 366M 0s 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi098.stderr: 68550K .......... .......... .......... .......... .......... 73% 334M 0s 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi098.stderr: 68600K .......... .......... .......... .......... .......... 73% 368M 0s 2024-09-12T18:03:48.091 INFO:teuthology.orchestra.run.smithi098.stderr: 68650K .......... .......... .......... .......... .......... 73% 329M 0s 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi098.stderr: 68700K .......... .......... .......... .......... .......... 74% 327M 0s 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi098.stderr: 68750K .......... .......... .......... .......... .......... 74% 309M 0s 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi098.stderr: 68800K .......... .......... .......... .......... .......... 74% 339M 0s 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi098.stderr: 68850K .......... .......... .......... .......... .......... 74% 345M 0s 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi098.stderr: 68900K .......... .......... .......... .......... .......... 74% 359M 0s 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi098.stderr: 68950K .......... .......... .......... .......... .......... 74% 308M 0s 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi098.stderr: 69000K .......... .......... .......... .......... .......... 74% 343M 0s 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi098.stderr: 69050K .......... .......... .......... .......... .......... 74% 358M 0s 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi098.stderr: 69100K .......... .......... .......... .......... .......... 74% 338M 0s 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi098.stderr: 69150K .......... .......... .......... .......... .......... 74% 297M 0s 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi098.stderr: 69200K .......... .......... .......... .......... .......... 74% 348M 0s 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi098.stderr: 69250K .......... .......... .......... .......... .......... 74% 350M 0s 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi098.stderr: 69300K .......... .......... .......... .......... .......... 74% 356M 0s 2024-09-12T18:03:48.092 INFO:teuthology.orchestra.run.smithi098.stderr: 69350K .......... .......... .......... .......... .......... 74% 315M 0s 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi098.stderr: 69400K .......... .......... .......... .......... .......... 74% 328M 0s 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi098.stderr: 69450K .......... .......... .......... .......... .......... 74% 342M 0s 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi098.stderr: 69500K .......... .......... .......... .......... .......... 74% 369M 0s 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi098.stderr: 69550K .......... .......... .......... .......... .......... 74% 99.4M 0s 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi098.stderr: 69600K .......... .......... .......... .......... .......... 74% 334M 0s 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi098.stderr: 69650K .......... .......... .......... .......... .......... 75% 98.7M 0s 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi098.stderr: 69700K .......... .......... .......... .......... .......... 75% 358M 0s 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi098.stderr: 69750K .......... .......... .......... .......... .......... 75% 60.0M 0s 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi098.stderr: 69800K .......... .......... .......... .......... .......... 75% 338M 0s 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi098.stderr: 69850K .......... .......... .......... .......... .......... 75% 338M 0s 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi098.stderr: 69900K .......... .......... .......... .......... .......... 75% 355M 0s 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi098.stderr: 69950K .......... .......... .......... .......... .......... 75% 121M 0s 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi098.stderr: 70000K .......... .......... .......... .......... .......... 75% 326M 0s 2024-09-12T18:03:48.093 INFO:teuthology.orchestra.run.smithi098.stderr: 70050K .......... .......... .......... .......... .......... 75% 374M 0s 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi098.stderr: 70100K .......... .......... .......... .......... .......... 75% 291M 0s 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi098.stderr: 70150K .......... .......... .......... .......... .......... 75% 323M 0s 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi098.stderr: 70200K .......... .......... .......... .......... .......... 75% 156M 0s 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi098.stderr: 70250K .......... .......... .......... .......... .......... 75% 245M 0s 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi098.stderr: 70300K .......... .......... .......... .......... .......... 75% 349M 0s 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi098.stderr: 70350K .......... .......... .......... .......... .......... 75% 73.7M 0s 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi098.stderr: 70400K .......... .......... .......... .......... .......... 75% 350M 0s 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi098.stderr: 70450K .......... .......... .......... .......... .......... 75% 130M 0s 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi098.stderr: 70500K .......... .......... .......... .......... .......... 75% 311M 0s 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi098.stderr: 70550K .......... .......... .......... .......... .......... 75% 131M 0s 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi098.stderr: 70600K .......... .......... .......... .......... .......... 76% 313M 0s 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi098.stderr: 70650K .......... .......... .......... .......... .......... 76% 322M 0s 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi098.stderr: 70700K .......... .......... .......... .......... .......... 76% 208M 0s 2024-09-12T18:03:48.094 INFO:teuthology.orchestra.run.smithi098.stderr: 70750K .......... .......... .......... .......... .......... 76% 220M 0s 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi098.stderr: 70800K .......... .......... .......... .......... .......... 76% 263M 0s 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi098.stderr: 70850K .......... .......... .......... .......... .......... 76% 343M 0s 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi098.stderr: 70900K .......... .......... .......... .......... .......... 76% 317M 0s 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi098.stderr: 70950K .......... .......... .......... .......... .......... 76% 299M 0s 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi098.stderr: 71000K .......... .......... .......... .......... .......... 76% 364M 0s 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi098.stderr: 71050K .......... .......... .......... .......... .......... 76% 333M 0s 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi098.stderr: 71100K .......... .......... .......... .......... .......... 76% 378M 0s 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi098.stderr: 71150K .......... .......... .......... .......... .......... 76% 282M 0s 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi098.stderr: 71200K .......... .......... .......... .......... .......... 76% 351M 0s 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi098.stderr: 71250K .......... .......... .......... .......... .......... 76% 325M 0s 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi098.stderr: 71300K .......... .......... .......... .......... .......... 76% 363M 0s 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi098.stderr: 71350K .......... .......... .......... .......... .......... 76% 327M 0s 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi098.stderr: 71400K .......... .......... .......... .......... .......... 76% 335M 0s 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi098.stderr: 71450K .......... .......... .......... .......... .......... 76% 350M 0s 2024-09-12T18:03:48.095 INFO:teuthology.orchestra.run.smithi098.stderr: 71500K .......... .......... .......... .......... .......... 77% 363M 0s 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi098.stderr: 71550K .......... .......... .......... .......... .......... 77% 293M 0s 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi098.stderr: 71600K .......... .......... .......... .......... .......... 77% 368M 0s 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi098.stderr: 71650K .......... .......... .......... .......... .......... 77% 296M 0s 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi098.stderr: 71700K .......... .......... .......... .......... .......... 77% 322M 0s 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi098.stderr: 71750K .......... .......... .......... .......... .......... 77% 300M 0s 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi098.stderr: 71800K .......... .......... .......... .......... .......... 77% 360M 0s 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi098.stderr: 71850K .......... .......... .......... .......... .......... 77% 352M 0s 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi098.stderr: 71900K .......... .......... .......... .......... .......... 77% 270M 0s 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi098.stderr: 71950K .......... .......... .......... .......... .......... 77% 339M 0s 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi098.stderr: 72000K .......... .......... .......... .......... .......... 77% 323M 0s 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi098.stderr: 72050K .......... .......... .......... .......... .......... 77% 344M 0s 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi098.stderr: 72100K .......... .......... .......... .......... .......... 77% 343M 0s 2024-09-12T18:03:48.096 INFO:teuthology.orchestra.run.smithi098.stderr: 72150K .......... .......... .......... .......... .......... 77% 319M 0s 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi098.stderr: 72200K .......... .......... .......... .......... .......... 77% 266M 0s 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi098.stderr: 72250K .......... .......... .......... .......... .......... 77% 323M 0s 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi098.stderr: 72300K .......... .......... .......... .......... .......... 77% 313M 0s 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi098.stderr: 72350K .......... .......... .......... .......... .......... 77% 355M 0s 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi098.stderr: 72400K .......... .......... .......... .......... .......... 77% 298M 0s 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi098.stderr: 72450K .......... .......... .......... .......... .......... 78% 362M 0s 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi098.stderr: 72500K .......... .......... .......... .......... .......... 78% 331M 0s 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi098.stderr: 72550K .......... .......... .......... .......... .......... 78% 319M 0s 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi098.stderr: 72600K .......... .......... .......... .......... .......... 78% 77.3M 0s 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi098.stderr: 72650K .......... .......... .......... .......... .......... 78% 324M 0s 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi098.stderr: 72700K .......... .......... .......... .......... .......... 78% 356M 0s 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi098.stderr: 72750K .......... .......... .......... .......... .......... 78% 261M 0s 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi098.stderr: 72800K .......... .......... .......... .......... .......... 78% 81.8M 0s 2024-09-12T18:03:48.097 INFO:teuthology.orchestra.run.smithi098.stderr: 72850K .......... .......... .......... .......... .......... 78% 346M 0s 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi098.stderr: 72900K .......... .......... .......... .......... .......... 78% 202M 0s 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi098.stderr: 72950K .......... .......... .......... .......... .......... 78% 312M 0s 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi098.stderr: 73000K .......... .......... .......... .......... .......... 78% 142M 0s 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi098.stderr: 73050K .......... .......... .......... .......... .......... 78% 228M 0s 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi098.stderr: 73100K .......... .......... .......... .......... .......... 78% 320M 0s 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi098.stderr: 73150K .......... .......... .......... .......... .......... 78% 239M 0s 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi098.stderr: 73200K .......... .......... .......... .......... .......... 78% 289M 0s 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi098.stderr: 73250K .......... .......... .......... .......... .......... 78% 273M 0s 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi098.stderr: 73300K .......... .......... .......... .......... .......... 78% 269M 0s 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi098.stderr: 73350K .......... .......... .......... .......... .......... 79% 79.3M 0s 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi098.stderr: 73400K .......... .......... .......... .......... .......... 79% 224M 0s 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi098.stderr: 73450K .......... .......... .......... .......... .......... 79% 356M 0s 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi098.stderr: 73500K .......... .......... .......... .......... .......... 79% 120M 0s 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi098.stderr: 73550K .......... .......... .......... .......... .......... 79% 114M 0s 2024-09-12T18:03:48.098 INFO:teuthology.orchestra.run.smithi098.stderr: 73600K .......... .......... .......... .......... .......... 79% 260M 0s 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi098.stderr: 73650K .......... .......... .......... .......... .......... 79% 340M 0s 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi098.stderr: 73700K .......... .......... .......... .......... .......... 79% 285M 0s 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi098.stderr: 73750K .......... .......... .......... .......... .......... 79% 299M 0s 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi098.stderr: 73800K .......... .......... .......... .......... .......... 79% 345M 0s 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi098.stderr: 73850K .......... .......... .......... .......... .......... 79% 282M 0s 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi098.stderr: 73900K .......... .......... .......... .......... .......... 79% 170M 0s 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi098.stderr: 73950K .......... .......... .......... .......... .......... 79% 337M 0s 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi098.stderr: 74000K .......... .......... .......... .......... .......... 79% 344M 0s 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi098.stderr: 74050K .......... .......... .......... .......... .......... 79% 362M 0s 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi098.stderr: 74100K .......... .......... .......... .......... .......... 79% 279M 0s 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi098.stderr: 74150K .......... .......... .......... .......... .......... 79% 347M 0s 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi098.stderr: 74200K .......... .......... .......... .......... .......... 79% 355M 0s 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi098.stderr: 74250K .......... .......... .......... .......... .......... 79% 303M 0s 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi098.stderr: 74300K .......... .......... .......... .......... .......... 80% 260M 0s 2024-09-12T18:03:48.099 INFO:teuthology.orchestra.run.smithi098.stderr: 74350K .......... .......... .......... .......... .......... 80% 346M 0s 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi098.stderr: 74400K .......... .......... .......... .......... .......... 80% 332M 0s 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi098.stderr: 74450K .......... .......... .......... .......... .......... 80% 333M 0s 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi098.stderr: 74500K .......... .......... .......... .......... .......... 80% 339M 0s 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi098.stderr: 74550K .......... .......... .......... .......... .......... 80% 322M 0s 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi098.stderr: 74600K .......... .......... .......... .......... .......... 80% 331M 0s 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi098.stderr: 74650K .......... .......... .......... .......... .......... 80% 331M 0s 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi098.stderr: 74700K .......... .......... .......... .......... .......... 80% 261M 0s 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi098.stderr: 74750K .......... .......... .......... .......... .......... 80% 341M 0s 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi098.stderr: 74800K .......... .......... .......... .......... .......... 80% 360M 0s 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi098.stderr: 74850K .......... .......... .......... .......... .......... 80% 275M 0s 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi098.stderr: 74900K .......... .......... .......... .......... .......... 80% 314M 0s 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi098.stderr: 74950K .......... .......... .......... .......... .......... 80% 338M 0s 2024-09-12T18:03:48.100 INFO:teuthology.orchestra.run.smithi098.stderr: 75000K .......... .......... .......... .......... .......... 80% 339M 0s 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi098.stderr: 75050K .......... .......... .......... .......... .......... 80% 363M 0s 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi098.stderr: 75100K .......... .......... .......... .......... .......... 80% 277M 0s 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi098.stderr: 75150K .......... .......... .......... .......... .......... 80% 344M 0s 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi098.stderr: 75200K .......... .......... .......... .......... .......... 81% 338M 0s 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi098.stderr: 75250K .......... .......... .......... .......... .......... 81% 288M 0s 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi098.stderr: 75300K .......... .......... .......... .......... .......... 81% 277M 0s 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi098.stderr: 75350K .......... .......... .......... .......... .......... 81% 375M 0s 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi098.stderr: 75400K .......... .......... .......... .......... .......... 81% 337M 0s 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi098.stderr: 75450K .......... .......... .......... .......... .......... 81% 310M 0s 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi098.stderr: 75500K .......... .......... .......... .......... .......... 81% 283M 0s 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi098.stderr: 75550K .......... .......... .......... .......... .......... 81% 331M 0s 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi098.stderr: 75600K .......... .......... .......... .......... .......... 81% 323M 0s 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi098.stderr: 75650K .......... .......... .......... .......... .......... 81% 122M 0s 2024-09-12T18:03:48.101 INFO:teuthology.orchestra.run.smithi098.stderr: 75700K .......... .......... .......... .......... .......... 81% 204M 0s 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi098.stderr: 75750K .......... .......... .......... .......... .......... 81% 266M 0s 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi098.stderr: 75800K .......... .......... .......... .......... .......... 81% 122M 0s 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi098.stderr: 75850K .......... .......... .......... .......... .......... 81% 143M 0s 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi098.stderr: 75900K .......... .......... .......... .......... .......... 81% 265M 0s 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi098.stderr: 75950K .......... .......... .......... .......... .......... 81% 200M 0s 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi098.stderr: 76000K .......... .......... .......... .......... .......... 81% 356M 0s 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi098.stderr: 76050K .......... .......... .......... .......... .......... 81% 171M 0s 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi098.stderr: 76100K .......... .......... .......... .......... .......... 81% 207M 0s 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi098.stderr: 76150K .......... .......... .......... .......... .......... 82% 281M 0s 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi098.stderr: 76200K .......... .......... .......... .......... .......... 82% 313M 0s 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi098.stderr: 76250K .......... .......... .......... .......... .......... 82% 330M 0s 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi098.stderr: 76300K .......... .......... .......... .......... .......... 82% 251M 0s 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi098.stderr: 76350K .......... .......... .......... .......... .......... 82% 87.9M 0s 2024-09-12T18:03:48.102 INFO:teuthology.orchestra.run.smithi098.stderr: 76400K .......... .......... .......... .......... .......... 82% 176M 0s 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi098.stderr: 76450K .......... .......... .......... .......... .......... 82% 244M 0s 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi098.stderr: 76500K .......... .......... .......... .......... .......... 82% 231M 0s 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi098.stderr: 76550K .......... .......... .......... .......... .......... 82% 66.2M 0s 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi098.stderr: 76600K .......... .......... .......... .......... .......... 82% 316M 0s 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi098.stderr: 76650K .......... .......... .......... .......... .......... 82% 314M 0s 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi098.stderr: 76700K .......... .......... .......... .......... .......... 82% 259M 0s 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi098.stderr: 76750K .......... .......... .......... .......... .......... 82% 344M 0s 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi098.stderr: 76800K .......... .......... .......... .......... .......... 82% 347M 0s 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi098.stderr: 76850K .......... .......... .......... .......... .......... 82% 355M 0s 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi098.stderr: 76900K .......... .......... .......... .......... .......... 82% 311M 0s 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi098.stderr: 76950K .......... .......... .......... .......... .......... 82% 340M 0s 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi098.stderr: 77000K .......... .......... .......... .......... .......... 82% 329M 0s 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi098.stderr: 77050K .......... .......... .......... .......... .......... 82% 69.7M 0s 2024-09-12T18:03:48.103 INFO:teuthology.orchestra.run.smithi098.stderr: 77100K .......... .......... .......... .......... .......... 83% 236M 0s 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi098.stderr: 77150K .......... .......... .......... .......... .......... 83% 346M 0s 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi098.stderr: 77200K .......... .......... .......... .......... .......... 83% 312M 0s 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi098.stderr: 77250K .......... .......... .......... .......... .......... 83% 326M 0s 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi098.stderr: 77300K .......... .......... .......... .......... .......... 83% 290M 0s 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi098.stderr: 77350K .......... .......... .......... .......... .......... 83% 338M 0s 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi098.stderr: 77400K .......... .......... .......... .......... .......... 83% 343M 0s 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi098.stderr: 77450K .......... .......... .......... .......... .......... 83% 321M 0s 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi098.stderr: 77500K .......... .......... .......... .......... .......... 83% 280M 0s 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi098.stderr: 77550K .......... .......... .......... .......... .......... 83% 307M 0s 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi098.stderr: 77600K .......... .......... .......... .......... .......... 83% 318M 0s 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi098.stderr: 77650K .......... .......... .......... .......... .......... 83% 328M 0s 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi098.stderr: 77700K .......... .......... .......... .......... .......... 83% 279M 0s 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi098.stderr: 77750K .......... .......... .......... .......... .......... 83% 319M 0s 2024-09-12T18:03:48.104 INFO:teuthology.orchestra.run.smithi098.stderr: 77800K .......... .......... .......... .......... .......... 83% 326M 0s 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi098.stderr: 77850K .......... .......... .......... .......... .......... 83% 326M 0s 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi098.stderr: 77900K .......... .......... .......... .......... .......... 83% 266M 0s 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi098.stderr: 77950K .......... .......... .......... .......... .......... 83% 321M 0s 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi098.stderr: 78000K .......... .......... .......... .......... .......... 84% 355M 0s 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi098.stderr: 78050K .......... .......... .......... .......... .......... 84% 376M 0s 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi098.stderr: 78100K .......... .......... .......... .......... .......... 84% 308M 0s 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi098.stderr: 78150K .......... .......... .......... .......... .......... 84% 322M 0s 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi098.stderr: 78200K .......... .......... .......... .......... .......... 84% 326M 0s 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi098.stderr: 78250K .......... .......... .......... .......... .......... 84% 347M 0s 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi098.stderr: 78300K .......... .......... .......... .......... .......... 84% 323M 0s 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi098.stderr: 78350K .......... .......... .......... .......... .......... 84% 337M 0s 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi098.stderr: 78400K .......... .......... .......... .......... .......... 84% 344M 0s 2024-09-12T18:03:48.105 INFO:teuthology.orchestra.run.smithi098.stderr: 78450K .......... .......... .......... .......... .......... 84% 332M 0s 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi098.stderr: 78500K .......... .......... .......... .......... .......... 84% 291M 0s 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi098.stderr: 78550K .......... .......... .......... .......... .......... 84% 360M 0s 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi098.stderr: 78600K .......... .......... .......... .......... .......... 84% 307M 0s 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi098.stderr: 78650K .......... .......... .......... .......... .......... 84% 340M 0s 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi098.stderr: 78700K .......... .......... .......... .......... .......... 84% 312M 0s 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi098.stderr: 78750K .......... .......... .......... .......... .......... 84% 378M 0s 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi098.stderr: 78800K .......... .......... .......... .......... .......... 84% 348M 0s 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi098.stderr: 78850K .......... .......... .......... .......... .......... 84% 150M 0s 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi098.stderr: 78900K .......... .......... .......... .......... .......... 84% 163M 0s 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi098.stderr: 78950K .......... .......... .......... .......... .......... 85% 258M 0s 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi098.stderr: 79000K .......... .......... .......... .......... .......... 85% 355M 0s 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi098.stderr: 79050K .......... .......... .......... .......... .......... 85% 195M 0s 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi098.stderr: 79100K .......... .......... .......... .......... .......... 85% 218M 0s 2024-09-12T18:03:48.106 INFO:teuthology.orchestra.run.smithi098.stderr: 79150K .......... .......... .......... .......... .......... 85% 227M 0s 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi098.stderr: 79200K .......... .......... .......... .......... .......... 85% 256M 0s 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi098.stderr: 79250K .......... .......... .......... .......... .......... 85% 318M 0s 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi098.stderr: 79300K .......... .......... .......... .......... .......... 85% 256M 0s 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi098.stderr: 79350K .......... .......... .......... .......... .......... 85% 93.7M 0s 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi098.stderr: 79400K .......... .......... .......... .......... .......... 85% 199M 0s 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi098.stderr: 79450K .......... .......... .......... .......... .......... 85% 333M 0s 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi098.stderr: 79500K .......... .......... .......... .......... .......... 85% 86.7M 0s 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi098.stderr: 79550K .......... .......... .......... .......... .......... 85% 73.9M 0s 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi098.stderr: 79600K .......... .......... .......... .......... .......... 85% 320M 0s 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi098.stderr: 79650K .......... .......... .......... .......... .......... 85% 339M 0s 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi098.stderr: 79700K .......... .......... .......... .......... .......... 85% 308M 0s 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi098.stderr: 79750K .......... .......... .......... .......... .......... 85% 316M 0s 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi098.stderr: 79800K .......... .......... .......... .......... .......... 85% 365M 0s 2024-09-12T18:03:48.107 INFO:teuthology.orchestra.run.smithi098.stderr: 79850K .......... .......... .......... .......... .......... 86% 335M 0s 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi098.stderr: 79900K .......... .......... .......... .......... .......... 86% 286M 0s 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi098.stderr: 79950K .......... .......... .......... .......... .......... 86% 336M 0s 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi098.stderr: 80000K .......... .......... .......... .......... .......... 86% 366M 0s 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi098.stderr: 80050K .......... .......... .......... .......... .......... 86% 84.2M 0s 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi098.stderr: 80100K .......... .......... .......... .......... .......... 86% 181M 0s 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi098.stderr: 80150K .......... .......... .......... .......... .......... 86% 174M 0s 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi098.stderr: 80200K .......... .......... .......... .......... .......... 86% 268M 0s 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi098.stderr: 80250K .......... .......... .......... .......... .......... 86% 272M 0s 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi098.stderr: 80300K .......... .......... .......... .......... .......... 86% 242M 0s 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi098.stderr: 80350K .......... .......... .......... .......... .......... 86% 305M 0s 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi098.stderr: 80400K .......... .......... .......... .......... .......... 86% 320M 0s 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi098.stderr: 80450K .......... .......... .......... .......... .......... 86% 352M 0s 2024-09-12T18:03:48.108 INFO:teuthology.orchestra.run.smithi098.stderr: 80500K .......... .......... .......... .......... .......... 86% 271M 0s 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi098.stderr: 80550K .......... .......... .......... .......... .......... 86% 322M 0s 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi098.stderr: 80600K .......... .......... .......... .......... .......... 86% 369M 0s 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi098.stderr: 80650K .......... .......... .......... .......... .......... 86% 326M 0s 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi098.stderr: 80700K .......... .......... .......... .......... .......... 86% 280M 0s 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi098.stderr: 80750K .......... .......... .......... .......... .......... 86% 340M 0s 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi098.stderr: 80800K .......... .......... .......... .......... .......... 87% 367M 0s 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi098.stderr: 80850K .......... .......... .......... .......... .......... 87% 273M 0s 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi098.stderr: 80900K .......... .......... .......... .......... .......... 87% 293M 0s 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi098.stderr: 80950K .......... .......... .......... .......... .......... 87% 333M 0s 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi098.stderr: 81000K .......... .......... .......... .......... .......... 87% 342M 0s 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi098.stderr: 81050K .......... .......... .......... .......... .......... 87% 325M 0s 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi098.stderr: 81100K .......... .......... .......... .......... .......... 87% 301M 0s 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi098.stderr: 81150K .......... .......... .......... .......... .......... 87% 331M 0s 2024-09-12T18:03:48.109 INFO:teuthology.orchestra.run.smithi098.stderr: 81200K .......... .......... .......... .......... .......... 87% 343M 0s 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi098.stderr: 81250K .......... .......... .......... .......... .......... 87% 354M 0s 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi098.stderr: 81300K .......... .......... .......... .......... .......... 87% 191M 0s 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi098.stderr: 81350K .......... .......... .......... .......... .......... 87% 340M 0s 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi098.stderr: 81400K .......... .......... .......... .......... .......... 87% 337M 0s 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi098.stderr: 81450K .......... .......... .......... .......... .......... 87% 307M 0s 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi098.stderr: 81500K .......... .......... .......... .......... .......... 87% 253M 0s 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi098.stderr: 81550K .......... .......... .......... .......... .......... 87% 335M 0s 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi098.stderr: 81600K .......... .......... .......... .......... .......... 87% 317M 0s 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi098.stderr: 81650K .......... .......... .......... .......... .......... 87% 330M 0s 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi098.stderr: 81700K .......... .......... .......... .......... .......... 87% 299M 0s 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi098.stderr: 81750K .......... .......... .......... .......... .......... 88% 333M 0s 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi098.stderr: 81800K .......... .......... .......... .......... .......... 88% 326M 0s 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi098.stderr: 81850K .......... .......... .......... .......... .......... 88% 334M 0s 2024-09-12T18:03:48.110 INFO:teuthology.orchestra.run.smithi098.stderr: 81900K .......... .......... .......... .......... .......... 88% 315M 0s 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi098.stderr: 81950K .......... .......... .......... .......... .......... 88% 319M 0s 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi098.stderr: 82000K .......... .......... .......... .......... .......... 88% 270M 0s 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi098.stderr: 82050K .......... .......... .......... .......... .......... 88% 332M 0s 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi098.stderr: 82100K .......... .......... .......... .......... .......... 88% 333M 0s 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi098.stderr: 82150K .......... .......... .......... .......... .......... 88% 275M 0s 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi098.stderr: 82200K .......... .......... .......... .......... .......... 88% 149M 0s 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi098.stderr: 82250K .......... .......... .......... .......... .......... 88% 317M 0s 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi098.stderr: 82300K .......... .......... .......... .......... .......... 88% 334M 0s 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi098.stderr: 82350K .......... .......... .......... .......... .......... 88% 132M 0s 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi098.stderr: 82400K .......... .......... .......... .......... .......... 88% 230M 0s 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi098.stderr: 82450K .......... .......... .......... .......... .......... 88% 86.4M 0s 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi098.stderr: 82500K .......... .......... .......... .......... .......... 88% 78.5M 0s 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi098.stderr: 82550K .......... .......... .......... .......... .......... 88% 208M 0s 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi098.stderr: 82600K .......... .......... .......... .......... .......... 88% 191M 0s 2024-09-12T18:03:48.111 INFO:teuthology.orchestra.run.smithi098.stderr: 82650K .......... .......... .......... .......... .......... 89% 251M 0s 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi098.stderr: 82700K .......... .......... .......... .......... .......... 89% 309M 0s 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi098.stderr: 82750K .......... .......... .......... .......... .......... 89% 288M 0s 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi098.stderr: 82800K .......... .......... .......... .......... .......... 89% 325M 0s 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi098.stderr: 82850K .......... .......... .......... .......... .......... 89% 322M 0s 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi098.stderr: 82900K .......... .......... .......... .......... .......... 89% 272M 0s 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi098.stderr: 82950K .......... .......... .......... .......... .......... 89% 89.6M 0s 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi098.stderr: 83000K .......... .......... .......... .......... .......... 89% 287M 0s 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi098.stderr: 83050K .......... .......... .......... .......... .......... 89% 345M 0s 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi098.stderr: 83100K .......... .......... .......... .......... .......... 89% 333M 0s 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi098.stderr: 83150K .......... .......... .......... .......... .......... 89% 134M 0s 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi098.stderr: 83200K .......... .......... .......... .......... .......... 89% 317M 0s 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi098.stderr: 83250K .......... .......... .......... .......... .......... 89% 342M 0s 2024-09-12T18:03:48.112 INFO:teuthology.orchestra.run.smithi098.stderr: 83300K .......... .......... .......... .......... .......... 89% 306M 0s 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi098.stderr: 83350K .......... .......... .......... .......... .......... 89% 231M 0s 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi098.stderr: 83400K .......... .......... .......... .......... .......... 89% 155M 0s 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi098.stderr: 83450K .......... .......... .......... .......... .......... 89% 337M 0s 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi098.stderr: 83500K .......... .......... .......... .......... .......... 89% 320M 0s 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi098.stderr: 83550K .......... .......... .......... .......... .......... 89% 286M 0s 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi098.stderr: 83600K .......... .......... .......... .......... .......... 90% 349M 0s 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi098.stderr: 83650K .......... .......... .......... .......... .......... 90% 331M 0s 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi098.stderr: 83700K .......... .......... .......... .......... .......... 90% 344M 0s 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi098.stderr: 83750K .......... .......... .......... .......... .......... 90% 308M 0s 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi098.stderr: 83800K .......... .......... .......... .......... .......... 90% 349M 0s 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi098.stderr: 83850K .......... .......... .......... .......... .......... 90% 367M 0s 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi098.stderr: 83900K .......... .......... .......... .......... .......... 90% 360M 0s 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi098.stderr: 83950K .......... .......... .......... .......... .......... 90% 96.9M 0s 2024-09-12T18:03:48.113 INFO:teuthology.orchestra.run.smithi098.stderr: 84000K .......... .......... .......... .......... .......... 90% 306M 0s 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi098.stderr: 84050K .......... .......... .......... .......... .......... 90% 337M 0s 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi098.stderr: 84100K .......... .......... .......... .......... .......... 90% 331M 0s 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi098.stderr: 84150K .......... .......... .......... .......... .......... 90% 333M 0s 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi098.stderr: 84200K .......... .......... .......... .......... .......... 90% 327M 0s 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi098.stderr: 84250K .......... .......... .......... .......... .......... 90% 362M 0s 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi098.stderr: 84300K .......... .......... .......... .......... .......... 90% 331M 0s 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi098.stderr: 84350K .......... .......... .......... .......... .......... 90% 281M 0s 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi098.stderr: 84400K .......... .......... .......... .......... .......... 90% 304M 0s 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi098.stderr: 84450K .......... .......... .......... .......... .......... 90% 335M 0s 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi098.stderr: 84500K .......... .......... .......... .......... .......... 91% 326M 0s 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi098.stderr: 84550K .......... .......... .......... .......... .......... 91% 318M 0s 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi098.stderr: 84600K .......... .......... .......... .......... .......... 91% 327M 0s 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi098.stderr: 84650K .......... .......... .......... .......... .......... 91% 364M 0s 2024-09-12T18:03:48.114 INFO:teuthology.orchestra.run.smithi098.stderr: 84700K .......... .......... .......... .......... .......... 91% 337M 0s 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi098.stderr: 84750K .......... .......... .......... .......... .......... 91% 284M 0s 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi098.stderr: 84800K .......... .......... .......... .......... .......... 91% 311M 0s 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi098.stderr: 84850K .......... .......... .......... .......... .......... 91% 330M 0s 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi098.stderr: 84900K .......... .......... .......... .......... .......... 91% 329M 0s 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi098.stderr: 84950K .......... .......... .......... .......... .......... 91% 296M 0s 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi098.stderr: 85000K .......... .......... .......... .......... .......... 91% 340M 0s 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi098.stderr: 85050K .......... .......... .......... .......... .......... 91% 356M 0s 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi098.stderr: 85100K .......... .......... .......... .......... .......... 91% 355M 0s 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi098.stderr: 85150K .......... .......... .......... .......... .......... 91% 289M 0s 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi098.stderr: 85200K .......... .......... .......... .......... .......... 91% 349M 0s 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi098.stderr: 85250K .......... .......... .......... .......... .......... 91% 307M 0s 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi098.stderr: 85300K .......... .......... .......... .......... .......... 91% 252M 0s 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi098.stderr: 85350K .......... .......... .......... .......... .......... 91% 247M 0s 2024-09-12T18:03:48.115 INFO:teuthology.orchestra.run.smithi098.stderr: 85400K .......... .......... .......... .......... .......... 91% 250M 0s 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi098.stderr: 85450K .......... .......... .......... .......... .......... 92% 82.0M 0s 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi098.stderr: 85500K .......... .......... .......... .......... .......... 92% 77.9M 0s 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi098.stderr: 85550K .......... .......... .......... .......... .......... 92% 184M 0s 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi098.stderr: 85600K .......... .......... .......... .......... .......... 92% 339M 0s 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi098.stderr: 85650K .......... .......... .......... .......... .......... 92% 153M 0s 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi098.stderr: 85700K .......... .......... .......... .......... .......... 92% 351M 0s 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi098.stderr: 85750K .......... .......... .......... .......... .......... 92% 142M 0s 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi098.stderr: 85800K .......... .......... .......... .......... .......... 92% 232M 0s 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi098.stderr: 85850K .......... .......... .......... .......... .......... 92% 322M 0s 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi098.stderr: 85900K .......... .......... .......... .......... .......... 92% 374M 0s 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi098.stderr: 85950K .......... .......... .......... .......... .......... 92% 92.8M 0s 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi098.stderr: 86000K .......... .......... .......... .......... .......... 92% 341M 0s 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi098.stderr: 86050K .......... .......... .......... .......... .......... 92% 358M 0s 2024-09-12T18:03:48.116 INFO:teuthology.orchestra.run.smithi098.stderr: 86100K .......... .......... .......... .......... .......... 92% 157M 0s 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi098.stderr: 86150K .......... .......... .......... .......... .......... 92% 292M 0s 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi098.stderr: 86200K .......... .......... .......... .......... .......... 92% 349M 0s 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi098.stderr: 86250K .......... .......... .......... .......... .......... 92% 353M 0s 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi098.stderr: 86300K .......... .......... .......... .......... .......... 92% 263M 0s 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi098.stderr: 86350K .......... .......... .......... .......... .......... 93% 301M 0s 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi098.stderr: 86400K .......... .......... .......... .......... .......... 93% 220M 0s 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi098.stderr: 86450K .......... .......... .......... .......... .......... 93% 201M 0s 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi098.stderr: 86500K .......... .......... .......... .......... .......... 93% 318M 0s 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi098.stderr: 86550K .......... .......... .......... .......... .......... 93% 292M 0s 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi098.stderr: 86600K .......... .......... .......... .......... .......... 93% 350M 0s 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi098.stderr: 86650K .......... .......... .......... .......... .......... 93% 322M 0s 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi098.stderr: 86700K .......... .......... .......... .......... .......... 93% 350M 0s 2024-09-12T18:03:48.117 INFO:teuthology.orchestra.run.smithi098.stderr: 86750K .......... .......... .......... .......... .......... 93% 277M 0s 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi098.stderr: 86800K .......... .......... .......... .......... .......... 93% 335M 0s 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi098.stderr: 86850K .......... .......... .......... .......... .......... 93% 92.6M 0s 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi098.stderr: 86900K .......... .......... .......... .......... .......... 93% 318M 0s 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi098.stderr: 86950K .......... .......... .......... .......... .......... 93% 287M 0s 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi098.stderr: 87000K .......... .......... .......... .......... .......... 93% 161M 0s 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi098.stderr: 87050K .......... .......... .......... .......... .......... 93% 325M 0s 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi098.stderr: 87100K .......... .......... .......... .......... .......... 93% 361M 0s 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi098.stderr: 87150K .......... .......... .......... .......... .......... 93% 267M 0s 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi098.stderr: 87200K .......... .......... .......... .......... .......... 93% 351M 0s 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi098.stderr: 87250K .......... .......... .......... .......... .......... 93% 345M 0s 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi098.stderr: 87300K .......... .......... .......... .......... .......... 94% 327M 0s 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi098.stderr: 87350K .......... .......... .......... .......... .......... 94% 310M 0s 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi098.stderr: 87400K .......... .......... .......... .......... .......... 94% 351M 0s 2024-09-12T18:03:48.118 INFO:teuthology.orchestra.run.smithi098.stderr: 87450K .......... .......... .......... .......... .......... 94% 348M 0s 2024-09-12T18:03:48.119 INFO:teuthology.orchestra.run.smithi098.stderr: 87500K .......... .......... .......... .......... .......... 94% 343M 0s 2024-09-12T18:03:48.119 INFO:teuthology.orchestra.run.smithi098.stderr: 87550K .......... .......... .......... .......... .......... 94% 274M 0s 2024-09-12T18:03:48.119 INFO:teuthology.orchestra.run.smithi098.stderr: 87600K .......... .......... .......... .......... .......... 94% 346M 0s 2024-09-12T18:03:48.119 INFO:teuthology.orchestra.run.smithi098.stderr: 87650K .......... .......... .......... .......... .......... 94% 362M 0s 2024-09-12T18:03:48.119 INFO:teuthology.orchestra.run.smithi098.stderr: 87700K .......... .......... .......... .......... .......... 94% 359M 0s 2024-09-12T18:03:48.119 INFO:teuthology.orchestra.run.smithi098.stderr: 87750K .......... .......... .......... .......... .......... 94% 335M 0s 2024-09-12T18:03:48.119 INFO:teuthology.orchestra.run.smithi098.stderr: 87800K .......... .......... .......... .......... .......... 94% 342M 0s 2024-09-12T18:03:48.119 INFO:teuthology.orchestra.run.smithi098.stderr: 87850K .......... .......... .......... .......... .......... 94% 345M 0s 2024-09-12T18:03:48.119 INFO:teuthology.orchestra.run.smithi098.stderr: 87900K .......... .......... .......... .......... .......... 94% 353M 0s 2024-09-12T18:03:48.119 INFO:teuthology.orchestra.run.smithi098.stderr: 87950K .......... .......... .......... .......... .......... 94% 280M 0s 2024-09-12T18:03:48.119 INFO:teuthology.orchestra.run.smithi098.stderr: 88000K .......... .......... .......... .......... .......... 94% 340M 0s 2024-09-12T18:03:48.119 INFO:teuthology.orchestra.run.smithi098.stderr: 88050K .......... .......... .......... .......... .......... 94% 356M 0s 2024-09-12T18:03:48.119 INFO:teuthology.orchestra.run.smithi098.stderr: 88100K .......... .......... .......... .......... .......... 94% 344M 0s 2024-09-12T18:03:48.119 INFO:teuthology.orchestra.run.smithi098.stderr: 88150K .......... .......... .......... .......... .......... 94% 345M 0s 2024-09-12T18:03:48.120 INFO:teuthology.orchestra.run.smithi098.stderr: 88200K .......... .......... .......... .......... .......... 94% 332M 0s 2024-09-12T18:03:48.120 INFO:teuthology.orchestra.run.smithi098.stderr: 88250K .......... .......... .......... .......... .......... 95% 322M 0s 2024-09-12T18:03:48.120 INFO:teuthology.orchestra.run.smithi098.stderr: 88300K .......... .......... .......... .......... .......... 95% 351M 0s 2024-09-12T18:03:48.120 INFO:teuthology.orchestra.run.smithi098.stderr: 88350K .......... .......... .......... .......... .......... 95% 283M 0s 2024-09-12T18:03:48.120 INFO:teuthology.orchestra.run.smithi098.stderr: 88400K .......... .......... .......... .......... .......... 95% 365M 0s 2024-09-12T18:03:48.120 INFO:teuthology.orchestra.run.smithi098.stderr: 88450K .......... .......... .......... .......... .......... 95% 111M 0s 2024-09-12T18:03:48.120 INFO:teuthology.orchestra.run.smithi098.stderr: 88500K .......... .......... .......... .......... .......... 95% 75.6M 0s 2024-09-12T18:03:48.120 INFO:teuthology.orchestra.run.smithi098.stderr: 88550K .......... .......... .......... .......... .......... 95% 242M 0s 2024-09-12T18:03:48.120 INFO:teuthology.orchestra.run.smithi098.stderr: 88600K .......... .......... .......... .......... .......... 95% 353M 0s 2024-09-12T18:03:48.120 INFO:teuthology.orchestra.run.smithi098.stderr: 88650K .......... .......... .......... .......... .......... 95% 122M 0s 2024-09-12T18:03:48.120 INFO:teuthology.orchestra.run.smithi098.stderr: 88700K .......... .......... .......... .......... .......... 95% 153M 0s 2024-09-12T18:03:48.120 INFO:teuthology.orchestra.run.smithi098.stderr: 88750K .......... .......... .......... .......... .......... 95% 277M 0s 2024-09-12T18:03:48.120 INFO:teuthology.orchestra.run.smithi098.stderr: 88800K .......... .......... .......... .......... .......... 95% 138M 0s 2024-09-12T18:03:48.120 INFO:teuthology.orchestra.run.smithi098.stderr: 88850K .......... .......... .......... .......... .......... 95% 345M 0s 2024-09-12T18:03:48.121 INFO:teuthology.orchestra.run.smithi098.stderr: 88900K .......... .......... .......... .......... .......... 95% 76.8M 0s 2024-09-12T18:03:48.121 INFO:teuthology.orchestra.run.smithi098.stderr: 88950K .......... .......... .......... .......... .......... 95% 291M 0s 2024-09-12T18:03:48.121 INFO:teuthology.orchestra.run.smithi098.stderr: 89000K .......... .......... .......... .......... .......... 95% 330M 0s 2024-09-12T18:03:48.121 INFO:teuthology.orchestra.run.smithi098.stderr: 89050K .......... .......... .......... .......... .......... 95% 300M 0s 2024-09-12T18:03:48.121 INFO:teuthology.orchestra.run.smithi098.stderr: 89100K .......... .......... .......... .......... .......... 95% 360M 0s 2024-09-12T18:03:48.121 INFO:teuthology.orchestra.run.smithi098.stderr: 89150K .......... .......... .......... .......... .......... 96% 215M 0s 2024-09-12T18:03:48.121 INFO:teuthology.orchestra.run.smithi098.stderr: 89200K .......... .......... .......... .......... .......... 96% 317M 0s 2024-09-12T18:03:48.121 INFO:teuthology.orchestra.run.smithi098.stderr: 89250K .......... .......... .......... .......... .......... 96% 357M 0s 2024-09-12T18:03:48.121 INFO:teuthology.orchestra.run.smithi098.stderr: 89300K .......... .......... .......... .......... .......... 96% 311M 0s 2024-09-12T18:03:48.121 INFO:teuthology.orchestra.run.smithi098.stderr: 89350K .......... .......... .......... .......... .......... 96% 316M 0s 2024-09-12T18:03:48.121 INFO:teuthology.orchestra.run.smithi098.stderr: 89400K .......... .......... .......... .......... .......... 96% 356M 0s 2024-09-12T18:03:48.121 INFO:teuthology.orchestra.run.smithi098.stderr: 89450K .......... .......... .......... .......... .......... 96% 363M 0s 2024-09-12T18:03:48.121 INFO:teuthology.orchestra.run.smithi098.stderr: 89500K .......... .......... .......... .......... .......... 96% 295M 0s 2024-09-12T18:03:48.122 INFO:teuthology.orchestra.run.smithi098.stderr: 89550K .......... .......... .......... .......... .......... 96% 149M 0s 2024-09-12T18:03:48.122 INFO:teuthology.orchestra.run.smithi098.stderr: 89600K .......... .......... .......... .......... .......... 96% 361M 0s 2024-09-12T18:03:48.122 INFO:teuthology.orchestra.run.smithi098.stderr: 89650K .......... .......... .......... .......... .......... 96% 304M 0s 2024-09-12T18:03:48.122 INFO:teuthology.orchestra.run.smithi098.stderr: 89700K .......... .......... .......... .......... .......... 96% 358M 0s 2024-09-12T18:03:48.122 INFO:teuthology.orchestra.run.smithi098.stderr: 89750K .......... .......... .......... .......... .......... 96% 301M 0s 2024-09-12T18:03:48.122 INFO:teuthology.orchestra.run.smithi098.stderr: 89800K .......... .......... .......... .......... .......... 96% 365M 0s 2024-09-12T18:03:48.122 INFO:teuthology.orchestra.run.smithi098.stderr: 89850K .......... .......... .......... .......... .......... 96% 105M 0s 2024-09-12T18:03:48.122 INFO:teuthology.orchestra.run.smithi098.stderr: 89900K .......... .......... .......... .......... .......... 96% 338M 0s 2024-09-12T18:03:48.122 INFO:teuthology.orchestra.run.smithi098.stderr: 89950K .......... .......... .......... .......... .......... 96% 178M 0s 2024-09-12T18:03:48.122 INFO:teuthology.orchestra.run.smithi098.stderr: 90000K .......... .......... .......... .......... .......... 96% 253M 0s 2024-09-12T18:03:48.122 INFO:teuthology.orchestra.run.smithi098.stderr: 90050K .......... .......... .......... .......... .......... 96% 125M 0s 2024-09-12T18:03:48.122 INFO:teuthology.orchestra.run.smithi098.stderr: 90100K .......... .......... .......... .......... .......... 97% 326M 0s 2024-09-12T18:03:48.122 INFO:teuthology.orchestra.run.smithi098.stderr: 90150K .......... .......... .......... .......... .......... 97% 311M 0s 2024-09-12T18:03:48.122 INFO:teuthology.orchestra.run.smithi098.stderr: 90200K .......... .......... .......... .......... .......... 97% 291M 0s 2024-09-12T18:03:48.123 INFO:teuthology.orchestra.run.smithi098.stderr: 90250K .......... .......... .......... .......... .......... 97% 315M 0s 2024-09-12T18:03:48.123 INFO:teuthology.orchestra.run.smithi098.stderr: 90300K .......... .......... .......... .......... .......... 97% 339M 0s 2024-09-12T18:03:48.123 INFO:teuthology.orchestra.run.smithi098.stderr: 90350K .......... .......... .......... .......... .......... 97% 259M 0s 2024-09-12T18:03:48.123 INFO:teuthology.orchestra.run.smithi098.stderr: 90400K .......... .......... .......... .......... .......... 97% 317M 0s 2024-09-12T18:03:48.123 INFO:teuthology.orchestra.run.smithi098.stderr: 90450K .......... .......... .......... .......... .......... 97% 348M 0s 2024-09-12T18:03:48.123 INFO:teuthology.orchestra.run.smithi098.stderr: 90500K .......... .......... .......... .......... .......... 97% 336M 0s 2024-09-12T18:03:48.123 INFO:teuthology.orchestra.run.smithi098.stderr: 90550K .......... .......... .......... .......... .......... 97% 312M 0s 2024-09-12T18:03:48.123 INFO:teuthology.orchestra.run.smithi098.stderr: 90600K .......... .......... .......... .......... .......... 97% 353M 0s 2024-09-12T18:03:48.123 INFO:teuthology.orchestra.run.smithi098.stderr: 90650K .......... .......... .......... .......... .......... 97% 365M 0s 2024-09-12T18:03:48.123 INFO:teuthology.orchestra.run.smithi098.stderr: 90700K .......... .......... .......... .......... .......... 97% 354M 0s 2024-09-12T18:03:48.123 INFO:teuthology.orchestra.run.smithi098.stderr: 90750K .......... .......... .......... .......... .......... 97% 262M 0s 2024-09-12T18:03:48.123 INFO:teuthology.orchestra.run.smithi098.stderr: 90800K .......... .......... .......... .......... .......... 97% 347M 0s 2024-09-12T18:03:48.123 INFO:teuthology.orchestra.run.smithi098.stderr: 90850K .......... .......... .......... .......... .......... 97% 325M 0s 2024-09-12T18:03:48.123 INFO:teuthology.orchestra.run.smithi098.stderr: 90900K .......... .......... .......... .......... .......... 97% 331M 0s 2024-09-12T18:03:48.124 INFO:teuthology.orchestra.run.smithi098.stderr: 90950K .......... .......... .......... .......... .......... 97% 326M 0s 2024-09-12T18:03:48.124 INFO:teuthology.orchestra.run.smithi098.stderr: 91000K .......... .......... .......... .......... .......... 98% 355M 0s 2024-09-12T18:03:48.124 INFO:teuthology.orchestra.run.smithi098.stderr: 91050K .......... .......... .......... .......... .......... 98% 270M 0s 2024-09-12T18:03:48.124 INFO:teuthology.orchestra.run.smithi098.stderr: 91100K .......... .......... .......... .......... .......... 98% 327M 0s 2024-09-12T18:03:48.124 INFO:teuthology.orchestra.run.smithi098.stderr: 91150K .......... .......... .......... .......... .......... 98% 271M 0s 2024-09-12T18:03:48.124 INFO:teuthology.orchestra.run.smithi098.stderr: 91200K .......... .......... .......... .......... .......... 98% 325M 0s 2024-09-12T18:03:48.124 INFO:teuthology.orchestra.run.smithi098.stderr: 91250K .......... .......... .......... .......... .......... 98% 324M 0s 2024-09-12T18:03:48.124 INFO:teuthology.orchestra.run.smithi098.stderr: 91300K .......... .......... .......... .......... .......... 98% 354M 0s 2024-09-12T18:03:48.124 INFO:teuthology.orchestra.run.smithi098.stderr: 91350K .......... .......... .......... .......... .......... 98% 296M 0s 2024-09-12T18:03:48.124 INFO:teuthology.orchestra.run.smithi098.stderr: 91400K .......... .......... .......... .......... .......... 98% 344M 0s 2024-09-12T18:03:48.124 INFO:teuthology.orchestra.run.smithi098.stderr: 91450K .......... .......... .......... .......... .......... 98% 362M 0s 2024-09-12T18:03:48.124 INFO:teuthology.orchestra.run.smithi098.stderr: 91500K .......... .......... .......... .......... .......... 98% 96.0M 0s 2024-09-12T18:03:48.124 INFO:teuthology.orchestra.run.smithi098.stderr: 91550K .......... .......... .......... .......... .......... 98% 203M 0s 2024-09-12T18:03:48.124 INFO:teuthology.orchestra.run.smithi098.stderr: 91600K .......... .......... .......... .......... .......... 98% 131M 0s 2024-09-12T18:03:48.125 INFO:teuthology.orchestra.run.smithi098.stderr: 91650K .......... .......... .......... .......... .......... 98% 343M 0s 2024-09-12T18:03:48.125 INFO:teuthology.orchestra.run.smithi098.stderr: 91700K .......... .......... .......... .......... .......... 98% 200M 0s 2024-09-12T18:03:48.125 INFO:teuthology.orchestra.run.smithi098.stderr: 91750K .......... .......... .......... .......... .......... 98% 156M 0s 2024-09-12T18:03:48.125 INFO:teuthology.orchestra.run.smithi098.stderr: 91800K .......... .......... .......... .......... .......... 98% 100M 0s 2024-09-12T18:03:48.125 INFO:teuthology.orchestra.run.smithi098.stderr: 91850K .......... .......... .......... .......... .......... 98% 334M 0s 2024-09-12T18:03:48.125 INFO:teuthology.orchestra.run.smithi098.stderr: 91900K .......... .......... .......... .......... .......... 98% 145M 0s 2024-09-12T18:03:48.125 INFO:teuthology.orchestra.run.smithi098.stderr: 91950K .......... .......... .......... .......... .......... 99% 129M 0s 2024-09-12T18:03:48.125 INFO:teuthology.orchestra.run.smithi098.stderr: 92000K .......... .......... .......... .......... .......... 99% 311M 0s 2024-09-12T18:03:48.125 INFO:teuthology.orchestra.run.smithi098.stderr: 92050K .......... .......... .......... .......... .......... 99% 193M 0s 2024-09-12T18:03:48.125 INFO:teuthology.orchestra.run.smithi098.stderr: 92100K .......... .......... .......... .......... .......... 99% 309M 0s 2024-09-12T18:03:48.125 INFO:teuthology.orchestra.run.smithi098.stderr: 92150K .......... .......... .......... .......... .......... 99% 319M 0s 2024-09-12T18:03:48.125 INFO:teuthology.orchestra.run.smithi098.stderr: 92200K .......... .......... .......... .......... .......... 99% 309M 0s 2024-09-12T18:03:48.125 INFO:teuthology.orchestra.run.smithi098.stderr: 92250K .......... .......... .......... .......... .......... 99% 263M 0s 2024-09-12T18:03:48.125 INFO:teuthology.orchestra.run.smithi098.stderr: 92300K .......... .......... .......... .......... .......... 99% 340M 0s 2024-09-12T18:03:48.126 INFO:teuthology.orchestra.run.smithi098.stderr: 92350K .......... .......... .......... .......... .......... 99% 282M 0s 2024-09-12T18:03:48.126 INFO:teuthology.orchestra.run.smithi098.stderr: 92400K .......... .......... .......... .......... .......... 99% 94.8M 0s 2024-09-12T18:03:48.126 INFO:teuthology.orchestra.run.smithi098.stderr: 92450K .......... .......... .......... .......... .......... 99% 322M 0s 2024-09-12T18:03:48.126 INFO:teuthology.orchestra.run.smithi098.stderr: 92500K .......... .......... .......... .......... .......... 99% 360M 0s 2024-09-12T18:03:48.126 INFO:teuthology.orchestra.run.smithi098.stderr: 92550K .......... .......... .......... .......... .......... 99% 324M 0s 2024-09-12T18:03:48.126 INFO:teuthology.orchestra.run.smithi098.stderr: 92600K .......... .......... .......... .......... .......... 99% 169M 0s 2024-09-12T18:03:48.126 INFO:teuthology.orchestra.run.smithi098.stderr: 92650K .......... .......... .......... .......... .......... 99% 337M 0s 2024-09-12T18:03:48.126 INFO:teuthology.orchestra.run.smithi098.stderr: 92700K .......... .......... .......... .......... .......... 99% 333M 0s 2024-09-12T18:03:48.126 INFO:teuthology.orchestra.run.smithi098.stderr: 92750K .......... .......... .......... .......... .......... 99% 166M 0s 2024-09-12T18:03:48.126 INFO:teuthology.orchestra.run.smithi098.stderr: 92800K .......... .......... .......... .......... .......... 99% 328M 0s 2024-09-12T18:03:48.126 INFO:teuthology.orchestra.run.smithi098.stderr: 92850K .......... .......... .......... .......... .......... 99% 366M 0s 2024-09-12T18:03:48.126 INFO:teuthology.orchestra.run.smithi098.stderr: 92900K 100% 134G=0.5s 2024-09-12T18:03:48.126 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-12T18:03:48.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12 18:03:47 (198 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-09-12T18:03:48.126 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-12T18:03:48.155 INFO:teuthology.orchestra.run.smithi098.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T18:03:48.155 INFO:teuthology.orchestra.run.smithi098.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T18:03:48.155 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T18:03:48.155 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T18:03:48.155 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T18:03:48.155 INFO:teuthology.orchestra.run.smithi098.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T18:03:48.155 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T18:03:48.155 INFO:teuthology.orchestra.run.smithi098.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T18:03:48.155 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T18:03:48.155 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T18:03:48.155 INFO:teuthology.orchestra.run.smithi098.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T18:03:48.155 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T18:03:48.156 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T18:03:48.156 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T18:03:48.156 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T18:03:48.156 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T18:03:48.156 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T18:03:48.156 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T18:03:48.156 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T18:03:48.156 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T18:03:48.156 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T18:03:48.156 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T18:03:48.156 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T18:03:48.156 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T18:03:48.156 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T18:03:48.157 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T18:03:48.157 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T18:03:48.157 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T18:03:48.157 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T18:03:48.157 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T18:03:48.157 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T18:03:48.157 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T18:03:48.157 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T18:03:48.157 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T18:03:48.157 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T18:03:48.157 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T18:03:48.157 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T18:03:48.157 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T18:03:48.158 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T18:03:48.158 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T18:03:48.158 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T18:03:48.158 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T18:03:48.158 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T18:03:48.158 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T18:03:48.158 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T18:03:48.158 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T18:03:48.158 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T18:03:48.158 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T18:03:48.158 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T18:03:48.158 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T18:03:48.158 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T18:03:48.158 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T18:03:48.159 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T18:03:48.159 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T18:03:48.159 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T18:03:48.159 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T18:03:48.159 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T18:03:48.159 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T18:03:48.159 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T18:03:48.159 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T18:03:48.159 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T18:03:48.159 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T18:03:48.159 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T18:03:48.159 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T18:03:48.159 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T18:03:48.159 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T18:03:48.160 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T18:03:48.160 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T18:03:48.160 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T18:03:48.160 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T18:03:48.160 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T18:03:48.160 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T18:03:48.160 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T18:03:48.160 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T18:03:48.160 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T18:03:48.160 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T18:03:48.160 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T18:03:48.160 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T18:03:48.160 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T18:03:48.161 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T18:03:48.161 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T18:03:48.161 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T18:03:48.161 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T18:03:48.161 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T18:03:48.161 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T18:03:48.161 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T18:03:48.161 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T18:03:48.161 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T18:03:48.161 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T18:03:48.161 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T18:03:48.161 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T18:03:48.161 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T18:03:48.162 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T18:03:48.162 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T18:03:48.162 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T18:03:48.162 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T18:03:48.162 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T18:03:48.162 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T18:03:48.162 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T18:03:48.162 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T18:03:48.162 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T18:03:48.162 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T18:03:48.162 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T18:03:48.162 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T18:03:48.162 INFO:teuthology.orchestra.run.smithi098.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T18:03:48.163 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T18:03:48.163 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T18:03:48.163 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T18:03:48.163 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T18:03:48.163 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T18:03:48.163 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T18:03:48.163 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T18:03:48.163 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T18:03:48.163 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T18:03:48.163 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T18:03:48.163 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T18:03:48.163 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T18:03:48.164 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T18:03:48.164 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T18:03:48.164 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T18:03:48.164 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T18:03:48.164 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T18:03:48.164 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T18:03:48.164 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T18:03:48.164 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T18:03:48.164 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T18:03:48.164 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T18:03:48.164 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T18:03:48.164 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T18:03:48.164 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T18:03:48.165 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T18:03:48.165 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T18:03:48.165 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T18:03:48.165 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T18:03:48.165 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T18:03:48.165 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T18:03:48.165 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T18:03:48.165 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T18:03:48.165 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T18:03:48.165 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T18:03:48.165 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T18:03:48.165 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T18:03:48.165 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T18:03:48.166 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T18:03:48.166 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T18:03:48.166 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T18:03:48.166 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T18:03:48.166 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T18:03:48.166 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T18:03:48.166 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T18:03:48.166 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T18:03:48.166 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T18:03:48.166 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T18:03:48.166 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T18:03:48.166 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T18:03:48.166 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T18:03:48.167 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T18:03:48.167 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T18:03:48.167 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T18:03:48.167 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T18:03:48.167 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T18:03:48.167 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T18:03:48.167 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T18:03:48.167 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T18:03:48.167 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T18:03:48.167 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T18:03:48.167 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T18:03:48.167 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T18:03:48.167 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T18:03:48.167 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T18:03:48.168 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T18:03:48.168 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T18:03:48.168 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T18:03:48.168 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T18:03:48.168 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T18:03:48.168 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T18:03:48.168 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T18:03:48.168 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T18:03:48.168 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T18:03:48.168 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T18:03:48.168 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T18:03:48.168 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T18:03:48.168 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T18:03:48.169 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T18:03:48.169 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T18:03:48.169 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T18:03:48.169 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T18:03:48.169 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T18:03:48.169 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T18:03:48.169 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T18:03:48.169 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T18:03:48.169 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T18:03:48.169 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T18:03:48.169 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T18:03:48.169 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T18:03:48.169 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T18:03:48.170 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T18:03:48.170 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T18:03:48.170 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T18:03:48.170 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T18:03:48.170 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T18:03:48.170 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T18:03:48.170 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T18:03:48.170 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T18:03:48.170 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T18:03:48.170 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T18:03:48.170 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T18:03:48.170 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T18:03:48.170 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T18:03:48.170 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T18:03:48.171 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T18:03:48.171 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T18:03:48.171 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T18:03:48.171 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T18:03:48.171 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T18:03:48.171 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T18:03:48.171 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T18:03:48.171 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T18:03:48.171 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T18:03:48.171 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T18:03:48.171 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T18:03:48.171 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T18:03:48.171 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T18:03:48.172 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T18:03:48.172 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T18:03:48.172 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T18:03:48.172 INFO:teuthology.orchestra.run.smithi098.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T18:03:48.172 INFO:teuthology.orchestra.run.smithi098.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-09-12T18:03:48.497 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:03:48.498 INFO:teuthology.orchestra.run.smithi098.stdout:Welcome to Gradle 6.0.1! 2024-09-12T18:03:48.498 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:03:48.498 INFO:teuthology.orchestra.run.smithi098.stdout:Here are the highlights of this release: 2024-09-12T18:03:48.498 INFO:teuthology.orchestra.run.smithi098.stdout: - Substantial improvements in dependency management, including 2024-09-12T18:03:48.498 INFO:teuthology.orchestra.run.smithi098.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T18:03:48.498 INFO:teuthology.orchestra.run.smithi098.stdout: - Advanced control of transitive versions 2024-09-12T18:03:48.498 INFO:teuthology.orchestra.run.smithi098.stdout: - Support for optional features and dependencies 2024-09-12T18:03:48.498 INFO:teuthology.orchestra.run.smithi098.stdout: - Rules to tweak published metadata 2024-09-12T18:03:48.498 INFO:teuthology.orchestra.run.smithi098.stdout: - Support for Java 13 2024-09-12T18:03:48.498 INFO:teuthology.orchestra.run.smithi098.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T18:03:48.498 INFO:teuthology.orchestra.run.smithi098.stdout: - New Zinc compiler for Scala 2024-09-12T18:03:48.498 INFO:teuthology.orchestra.run.smithi098.stdout: - VS2019 support 2024-09-12T18:03:48.498 INFO:teuthology.orchestra.run.smithi098.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T18:03:48.499 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:03:48.499 INFO:teuthology.orchestra.run.smithi098.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T18:03:48.499 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:03:48.499 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:03:48.499 INFO:teuthology.orchestra.run.smithi098.stdout:------------------------------------------------------------ 2024-09-12T18:03:48.499 INFO:teuthology.orchestra.run.smithi098.stdout:Gradle 6.0.1 2024-09-12T18:03:48.499 INFO:teuthology.orchestra.run.smithi098.stdout:------------------------------------------------------------ 2024-09-12T18:03:48.501 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:03:48.501 INFO:teuthology.orchestra.run.smithi098.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T18:03:48.501 INFO:teuthology.orchestra.run.smithi098.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T18:03:48.501 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:03:48.501 INFO:teuthology.orchestra.run.smithi098.stdout:Kotlin: 1.3.50 2024-09-12T18:03:48.501 INFO:teuthology.orchestra.run.smithi098.stdout:Groovy: 2.5.8 2024-09-12T18:03:48.501 INFO:teuthology.orchestra.run.smithi098.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T18:03:48.501 INFO:teuthology.orchestra.run.smithi098.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-09-12T18:03:48.501 INFO:teuthology.orchestra.run.smithi098.stdout:OS: Linux 5.15.0-119-generic amd64 2024-09-12T18:03:48.502 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:03:48.508 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T18:03:48.508 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T18:03:48.508 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi098.front.sepia.ceph.com 2024-09-12T18:03:48.508 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T18:03:48.509 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T18:03:48.509 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T18:03:48.763 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T18:03:48.764 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T18:03:48.764 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'WEMGIJJQYUXWFNNOXISF', 'access_secret': 'p1oJKgm6pb2w7vPrSNp+G0ex1Qt1aWdA+WJ5xaWuwkaOcaJ40TGTSw==', 'region': 'mexico', 'endpoint': 'smithi098.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi098.front.sepia.ceph.com'} 2024-09-12T18:03:48.764 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T18:03:48.764 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'WEMGIJJQYUXWFNNOXISF', '--secret', 'p1oJKgm6pb2w7vPrSNp+G0ex1Qt1aWdA+WJ5xaWuwkaOcaJ40TGTSw==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T18:03:48.764 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key WEMGIJJQYUXWFNNOXISF --secret p1oJKgm6pb2w7vPrSNp+G0ex1Qt1aWdA+WJ5xaWuwkaOcaJ40TGTSw== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T18:03:48.809 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:48.809 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:48.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:48.845+0000 7f1da86789c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:48.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:48.845+0000 7f1da86789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:48.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:48.845+0000 7f1da86789c0 20 realm 2024-09-12T18:03:48.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:48.845+0000 7f1da86789c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:48.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:48.845+0000 7f1da86789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:48.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:48.845+0000 7f1da86789c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:48.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:48.845+0000 7f1da86789c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:48.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:48.845+0000 7f1da86789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:48.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:48.845+0000 7f1da86789c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:48.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:48.849+0000 7f1da86789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:48.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:48.849+0000 7f1da86789c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:48.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:48.849+0000 7f1da86789c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:48.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:48.849+0000 7f1da86789c0 20 searching for the correct realm 2024-09-12T18:03:48.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:48.857+0000 7f1da697f640 0 -- 172.21.15.98:0/2105117872 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f1d9c03c030 msgr2=0x7f1d9c04b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:49.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.073+0000 7f1da617e640 0 -- 172.21.15.98:0/2105117872 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x56524c818860 msgr2=0x56524c81ac50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:49.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.081+0000 7f1da86789c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:49.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.081+0000 7f1da86789c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:49.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.081+0000 7f1da86789c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:49.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.081+0000 7f1da86789c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:49.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.081+0000 7f1da86789c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:49.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.081+0000 7f1da86789c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:49.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.081+0000 7f1da86789c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:49.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.081+0000 7f1da86789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:49.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.081+0000 7f1da86789c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:49.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.081+0000 7f1da86789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:49.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.081+0000 7f1da86789c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:49.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.085+0000 7f1da86789c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:49.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.085+0000 7f1da86789c0 20 zone default found 2024-09-12T18:03:49.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.085+0000 7f1da86789c0 4 Realm: () 2024-09-12T18:03:49.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.085+0000 7f1da86789c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:49.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.085+0000 7f1da86789c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:49.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.085+0000 7f1da86789c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:49.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.085+0000 7f1da86789c0 20 zonegroup default 2024-09-12T18:03:49.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.085+0000 7f1da86789c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:49.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.085+0000 7f1da86789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:49.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.085+0000 7f1da86789c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:49.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.085+0000 7f1da86789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:49.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.085+0000 7f1da86789c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:49.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.085+0000 7f1da86789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:49.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.085+0000 7f1da86789c0 20 started sync module instance, tier type = 2024-09-12T18:03:49.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.085+0000 7f1da86789c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:49.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.109+0000 7f1da86789c0 20 add_watcher() i=0 2024-09-12T18:03:49.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.109+0000 7f1da86789c0 20 add_watcher() i=1 2024-09-12T18:03:49.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.109+0000 7f1da86789c0 20 add_watcher() i=2 2024-09-12T18:03:49.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.109+0000 7f1da86789c0 20 add_watcher() i=3 2024-09-12T18:03:49.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.109+0000 7f1da86789c0 20 add_watcher() i=4 2024-09-12T18:03:49.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.109+0000 7f1da86789c0 20 add_watcher() i=5 2024-09-12T18:03:49.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.113+0000 7f1da86789c0 20 add_watcher() i=6 2024-09-12T18:03:49.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.113+0000 7f1da86789c0 20 add_watcher() i=7 2024-09-12T18:03:49.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.113+0000 7f1da86789c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:49.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.117+0000 7f1c5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:49.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.117+0000 7f1da86789c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:49.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.117+0000 7f1da86789c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:49.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.117+0000 7f1da86789c0 5 note: GC not initialized 2024-09-12T18:03:49.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.117+0000 7f1c577fe640 20 reqs_thread_entry: start 2024-09-12T18:03:49.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.117+0000 7f1da86789c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:49.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.117+0000 7f1da86789c0 20 Filter name: none 2024-09-12T18:03:49.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.117+0000 7f1c557fa640 20 reqs_thread_entry: start 2024-09-12T18:03:49.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.117+0000 7f1da86789c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T18:03:49.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.117+0000 7f1da86789c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:49.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.117+0000 7f1da86789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:49.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.117+0000 7f1da86789c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T18:03:49.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.117+0000 7f1da86789c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:03:49.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.117+0000 7f1da86789c0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T18:03:49.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.117+0000 7f1da86789c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:49.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.117+0000 7f1da86789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:49.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.117+0000 7f1da86789c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T18:03:49.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.117+0000 7f1da86789c0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T18:03:49.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.117+0000 7f1da86789c0 10 cache get: name=default.rgw.meta+users.keys+WEMGIJJQYUXWFNNOXISF : miss 2024-09-12T18:03:49.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.117+0000 7f1da86789c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:49.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.121+0000 7f1da86789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:49.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.121+0000 7f1da86789c0 10 cache put: name=default.rgw.meta+users.keys+WEMGIJJQYUXWFNNOXISF info.flags=0x0 2024-09-12T18:03:49.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.121+0000 7f1da86789c0 10 adding default.rgw.meta+users.keys+WEMGIJJQYUXWFNNOXISF to cache LRU end 2024-09-12T18:03:49.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.121+0000 7f1da86789c0 10 cache get: name=default.rgw.meta+users.keys+WEMGIJJQYUXWFNNOXISF : hit (negative entry) 2024-09-12T18:03:49.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.121+0000 7f1da86789c0 10 cache get: name=default.rgw.meta+users.keys+WEMGIJJQYUXWFNNOXISF : hit (negative entry) 2024-09-12T18:03:49.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.125+0000 7f1da86789c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T18:03:49.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.125+0000 7f1da86789c0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:03:49.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.125+0000 7f1da86789c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T18:03:49.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.125+0000 7f1c89ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366182 cookie 94911470913680 notifier 8171 bl.length()=670 2024-09-12T18:03:49.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.125+0000 7f1c89ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T18:03:49.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.125+0000 7f1c89ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:03:49.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.129+0000 7f1da86789c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T18:03:49.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.129+0000 7f1da86789c0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T18:03:49.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.129+0000 7f1da86789c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T18:03:49.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.129+0000 7f1c89ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366204 cookie 94911470905280 notifier 8171 bl.length()=200 2024-09-12T18:03:49.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.129+0000 7f1c89ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T18:03:49.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.129+0000 7f1c89ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T18:03:49.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.133+0000 7f1da86789c0 10 cache put: name=default.rgw.meta+users.keys+WEMGIJJQYUXWFNNOXISF info.flags=0x7 2024-09-12T18:03:49.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.133+0000 7f1da86789c0 10 moving default.rgw.meta+users.keys+WEMGIJJQYUXWFNNOXISF to cache LRU end 2024-09-12T18:03:49.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.133+0000 7f1da86789c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:WEMGIJJQYUXWFNNOXISF, ofs0, ns] 2024-09-12T18:03:49.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.133+0000 7f1c897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366205 cookie 94911470905280 notifier 8171 bl.length()=189 2024-09-12T18:03:49.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.133+0000 7f1c897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WEMGIJJQYUXWFNNOXISF info.flags=0x7 2024-09-12T18:03:49.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.133+0000 7f1c897fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WEMGIJJQYUXWFNNOXISF to cache LRU end 2024-09-12T18:03:49.140 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T18:03:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "user_id": "tester.client.0", 2024-09-12T18:03:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T18:03:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T18:03:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "suspended": 0, 2024-09-12T18:03:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "max_buckets": 1000, 2024-09-12T18:03:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "subusers": [], 2024-09-12T18:03:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "keys": [ 2024-09-12T18:03:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-12T18:03:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "user": "tester.client.0", 2024-09-12T18:03:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "access_key": "WEMGIJJQYUXWFNNOXISF", 2024-09-12T18:03:49.141 INFO:teuthology.orchestra.run.smithi098.stdout: "secret_key": "p1oJKgm6pb2w7vPrSNp+G0ex1Qt1aWdA+WJ5xaWuwkaOcaJ40TGTSw==", 2024-09-12T18:03:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "active": true, 2024-09-12T18:03:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "create_date": "2024-09-12T18:03:49.124891Z" 2024-09-12T18:03:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-12T18:03:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-12T18:03:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "swift_keys": [], 2024-09-12T18:03:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": [], 2024-09-12T18:03:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "op_mask": "read, write, delete", 2024-09-12T18:03:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "default_placement": "", 2024-09-12T18:03:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "default_storage_class": "", 2024-09-12T18:03:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "placement_tags": [], 2024-09-12T18:03:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "bucket_quota": { 2024-09-12T18:03:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:03:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:03:49.142 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:03:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:03:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:03:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:03:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "user_quota": { 2024-09-12T18:03:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:03:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:03:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:03:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:03:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:03:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:03:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "temp_url_keys": [], 2024-09-12T18:03:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "rgw", 2024-09-12T18:03:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "mfa_ids": [], 2024-09-12T18:03:49.143 INFO:teuthology.orchestra.run.smithi098.stdout: "account_id": "", 2024-09-12T18:03:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/", 2024-09-12T18:03:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "create_date": "2024-09-12T18:03:49.124856Z", 2024-09-12T18:03:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-12T18:03:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: "group_ids": [] 2024-09-12T18:03:49.144 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T18:03:49.144 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:03:49.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.137+0000 7f1c5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:49.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.145+0000 7f1da86789c0 20 remove_watcher() i=0 2024-09-12T18:03:49.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.145+0000 7f1da86789c0 2 removed watcher, disabling cache 2024-09-12T18:03:49.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.149+0000 7f1da86789c0 20 remove_watcher() i=1 2024-09-12T18:03:49.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.149+0000 7f1da86789c0 20 remove_watcher() i=2 2024-09-12T18:03:49.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.153+0000 7f1da86789c0 20 remove_watcher() i=3 2024-09-12T18:03:49.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.153+0000 7f1da86789c0 20 remove_watcher() i=4 2024-09-12T18:03:49.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.157+0000 7f1da86789c0 20 remove_watcher() i=5 2024-09-12T18:03:49.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.157+0000 7f1da86789c0 20 remove_watcher() i=6 2024-09-12T18:03:49.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.161+0000 7f1da86789c0 20 remove_watcher() i=7 2024-09-12T18:03:49.181 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T18:03:49.181 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T18:03:49.232 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T18:03:49.232 DEBUG:teuthology.orchestra.run.smithi098:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T18:03:49.281 DEBUG:teuthology.orchestra.run.smithi098:> radosgw-admin gc process --include-all 2024-09-12T18:03:49.355 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:49.356 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:49.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.397+0000 7f7894c0a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:49.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.397+0000 7f7894c0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:49.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.397+0000 7f7894c0a9c0 20 realm 2024-09-12T18:03:49.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.397+0000 7f7894c0a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:49.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.397+0000 7f7894c0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:49.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.397+0000 7f7894c0a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:49.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.397+0000 7f7894c0a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:49.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.397+0000 7f7894c0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:49.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.397+0000 7f7894c0a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:49.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.401+0000 7f7894c0a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:49.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.401+0000 7f7894c0a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:49.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.401+0000 7f7894c0a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:49.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.401+0000 7f7894c0a9c0 20 searching for the correct realm 2024-09-12T18:03:49.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.405+0000 7f7891f0f640 0 -- 172.21.15.98:0/3097295179 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x55b5f892c470 msgr2=0x55b5f892e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:49.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.413+0000 7f7892710640 0 -- 172.21.15.98:0/3097295179 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f788806def0 msgr2=0x7f78880634c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:03:49.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:49.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:49.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:49.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:49.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:49.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:49.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:49.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:49.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:49.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:49.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:49.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:49.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 20 zone default found 2024-09-12T18:03:49.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 4 Realm: () 2024-09-12T18:03:49.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:49.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:49.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:49.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 20 zonegroup default 2024-09-12T18:03:49.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:49.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:49.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.421+0000 7f7894c0a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:49.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.425+0000 7f7894c0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:49.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.425+0000 7f7894c0a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:49.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.425+0000 7f7894c0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:49.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.425+0000 7f7894c0a9c0 20 started sync module instance, tier type = 2024-09-12T18:03:49.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.425+0000 7f7894c0a9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:49.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.441+0000 7f7894c0a9c0 20 add_watcher() i=0 2024-09-12T18:03:49.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.441+0000 7f7894c0a9c0 20 add_watcher() i=1 2024-09-12T18:03:49.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.441+0000 7f7894c0a9c0 20 add_watcher() i=2 2024-09-12T18:03:49.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.441+0000 7f7894c0a9c0 20 add_watcher() i=3 2024-09-12T18:03:49.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.441+0000 7f7894c0a9c0 20 add_watcher() i=4 2024-09-12T18:03:49.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.441+0000 7f7894c0a9c0 20 add_watcher() i=5 2024-09-12T18:03:49.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.441+0000 7f7894c0a9c0 20 add_watcher() i=6 2024-09-12T18:03:49.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.441+0000 7f7894c0a9c0 20 add_watcher() i=7 2024-09-12T18:03:49.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.441+0000 7f7894c0a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:49.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.445+0000 7f7748fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:49.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.445+0000 7f7894c0a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:49.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.445+0000 7f7894c0a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:49.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.521+0000 7f76c37fe640 20 reqs_thread_entry: start 2024-09-12T18:03:49.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.521+0000 7f7894c0a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:49.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.521+0000 7f7894c0a9c0 20 Filter name: none 2024-09-12T18:03:49.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.521+0000 7f76c17fa640 20 reqs_thread_entry: start 2024-09-12T18:03:49.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.521+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:03:49.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.525+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.525+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.525+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:03:49.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.525+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4990251547276362604', time=2024-09-12T19:53:45.609270+0000, chain.objs.size()=1 2024-09-12T18:03:49.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.525+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.4__shadow_.S1G9eTpfxTM_M_uS11wg5I9ORkuVELi_0 2024-09-12T18:03:49.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.525+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_VMVfURgNJoJBoSZxQeub6oFIDS93W_q', time=2024-09-12T19:53:46.045845+0000, chain.objs.size()=1 2024-09-12T18:03:49.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.525+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__shadow_.-O_AMJVfGGekcORSDUO2K4_dLEfAR2t_0 2024-09-12T18:03:49.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.525+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2342739269260234119', time=2024-09-12T19:55:28.636948+0000, chain.objs.size()=1 2024-09-12T18:03:49.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.525+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19__shadow_.yTVObJJsajz6jAz7QM6bCl96TEbKx_w_0 2024-09-12T18:03:49.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.525+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8613545781271524096', time=2024-09-12T19:56:07.661997+0000, chain.objs.size()=1 2024-09-12T18:03:49.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.525+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21__shadow_.QKcA92lXp3Gp-Le2-jkyGanfK5eUiVg_0 2024-09-12T18:03:49.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.525+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15671343419208730637', time=2024-09-12T19:56:12.065443+0000, chain.objs.size()=1 2024-09-12T18:03:49.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.525+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22__shadow_.h3L8ZlbGaxHscImKZFg7Tg6gZlJzfOe_0 2024-09-12T18:03:49.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.525+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5772493903302757306', time=2024-09-12T19:56:50.450868+0000, chain.objs.size()=1 2024-09-12T18:03:49.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.525+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24__shadow_.kKlUlCfxf0BEsvATufJEsT6Xg-KMF68_0 2024-09-12T18:03:49.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.529+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5081814247068978371', time=2024-09-12T19:56:55.041882+0000, chain.objs.size()=1 2024-09-12T18:03:49.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.529+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25__shadow_.RbOqCHnlgaYVqaCbZf2SWzPLGd4HXJR_0 2024-09-12T18:03:49.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.529+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5696613750774221675', time=2024-09-12T19:57:38.410731+0000, chain.objs.size()=1 2024-09-12T18:03:49.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.529+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28__shadow_.jSn8BNgqJCBj-DGjy6tGJ5LrS70lLV-_0 2024-09-12T18:03:49.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.529+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4686886027497485705', time=2024-09-12T19:57:38.587254+0000, chain.objs.size()=1 2024-09-12T18:03:49.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.529+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28__shadow_.-qu4W7OOusnLn72WgjOF1Dd2iNl55JC_0 2024-09-12T18:03:49.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.529+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13607628241721225966', time=2024-09-12T19:58:17.973495+0000, chain.objs.size()=1 2024-09-12T18:03:49.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.529+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30__shadow_.9FLLsDLw-5yAGU7p4vPdcp4-ZxIHaid_0 2024-09-12T18:03:49.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.529+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16725206369933185791', time=2024-09-12T19:58:17.983615+0000, chain.objs.size()=1 2024-09-12T18:03:49.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.529+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30__shadow_.In33K9PZfN6OkJkQdjwKxvrsqvZ2Mcf_0 2024-09-12T18:03:49.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.529+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9940230870377614469', time=2024-09-12T19:58:57.000582+0000, chain.objs.size()=1 2024-09-12T18:03:49.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.529+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32__shadow_.OHuw_BqcGmJQHMpAWJ_jYqqEgq4SKu__0 2024-09-12T18:03:49.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.537+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8427871764656028609', time=2024-09-12T19:58:57.004318+0000, chain.objs.size()=1 2024-09-12T18:03:49.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.537+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32__shadow_.Mh_dF6aWNZYw8aeblCV1T0nl3N9Pp7r_0 2024-09-12T18:03:49.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.537+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8629651310962362989', time=2024-09-12T20:00:22.675187+0000, chain.objs.size()=1 2024-09-12T18:03:49.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.537+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37__shadow_.JBHNizJzFOSXejpOwlTW-iqcDMHFHJy_0 2024-09-12T18:03:49.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.537+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14551054791928165953', time=2024-09-12T20:00:27.162235+0000, chain.objs.size()=1 2024-09-12T18:03:49.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.537+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38__shadow_.972BbTc-VTjh9uLISn-1ZoSuGUoykm5_0 2024-09-12T18:03:49.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.541+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.549+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:03:49.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:03:49.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11833545329352341966', time=2024-09-12T19:53:45.555669+0000, chain.objs.size()=1 2024-09-12T18:03:49.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.4__shadow_.Un_PGwb_6YSl-d1cjUxRslW12c97tcy_0 2024-09-12T18:03:49.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2618137070292821566', time=2024-09-12T19:53:46.442765+0000, chain.objs.size()=1 2024-09-12T18:03:49.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.7__shadow_.YKo78AYUPbhXMOlfMeu_oSSSG9_R0w6_0 2024-09-12T18:03:49.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8229521278353248611', time=2024-09-12T19:53:46.533340+0000, chain.objs.size()=1 2024-09-12T18:03:49.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.8__shadow_.c5nzFKP9F9109Vk_Edu1jXbBezXf_a5_0 2024-09-12T18:03:49.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7241097191219157756', time=2024-09-12T19:56:07.639340+0000, chain.objs.size()=1 2024-09-12T18:03:49.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21__shadow_.aTOne6h8KxcuD9ANlSF_yrf7ZRgcRFC_0 2024-09-12T18:03:49.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1407041852359187397', time=2024-09-12T19:56:15.827324+0000, chain.objs.size()=1 2024-09-12T18:03:49.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23__shadow_.54ZQy02e76aOSZ2dH6HWhjnJi_zjyvt_0 2024-09-12T18:03:49.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8196001360395409161', time=2024-09-12T19:56:16.060411+0000, chain.objs.size()=1 2024-09-12T18:03:49.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23__shadow_.8lP5wp6mv0Ox_Z0j0S-ELzik0PMY14F_0 2024-09-12T18:03:49.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16353015938846963348', time=2024-09-12T19:56:50.527377+0000, chain.objs.size()=1 2024-09-12T18:03:49.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24__shadow_.1BUMqnmX4kKOKpjl66v8mUZ4e6FdHlW_0 2024-09-12T18:03:49.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10530733657036158589', time=2024-09-12T19:56:59.150434+0000, chain.objs.size()=1 2024-09-12T18:03:49.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26__shadow_.uYnhxuu3nUWnPwpvzqunVaYzxGsZbPy_0 2024-09-12T18:03:49.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6090008238407100429', time=2024-09-12T19:56:59.207162+0000, chain.objs.size()=1 2024-09-12T18:03:49.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26__shadow_.R0egDT592UhgN-PjWXuY7vSnAh5ljGg_0 2024-09-12T18:03:49.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16456571041385014135', time=2024-09-12T19:57:34.233088+0000, chain.objs.size()=1 2024-09-12T18:03:49.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27__shadow_.w8_km68ZMJbMXKOUsykBTNmujiWgEbY_0 2024-09-12T18:03:49.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15664451579149525673', time=2024-09-12T19:58:13.393782+0000, chain.objs.size()=1 2024-09-12T18:03:49.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29__shadow_.XPQ-rMyu1EVm9TIE6yLvtt2vVtGase6_0 2024-09-12T18:03:49.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6773481336242769991', time=2024-09-12T19:58:13.460114+0000, chain.objs.size()=1 2024-09-12T18:03:49.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.553+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29__shadow_.K7CB74aMaubK3NkOyOYQSjLZo0KuKHS_0 2024-09-12T18:03:49.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.569+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11868289831526082807', time=2024-09-12T19:58:56.990292+0000, chain.objs.size()=1 2024-09-12T18:03:49.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.569+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32__shadow_.Zgp7roNvaYZQQqG1UqZScpi-JkZ1DWp_0 2024-09-12T18:03:49.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.569+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10814300539054959951', time=2024-09-12T19:58:56.992267+0000, chain.objs.size()=1 2024-09-12T18:03:49.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.569+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32__shadow_.Zjq1mTaPhd4DISB7NukRsQyToXYcPUP_0 2024-09-12T18:03:49.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.569+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10665674684856780554', time=2024-09-12T19:59:37.291120+0000, chain.objs.size()=1 2024-09-12T18:03:49.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.569+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34__shadow_.Yn37p3MjK4oR56cyx2HgJmKL6eNGFAq_0 2024-09-12T18:03:49.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.569+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9739120386427464469', time=2024-09-12T20:01:01.737340+0000, chain.objs.size()=1 2024-09-12T18:03:49.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.569+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39__shadow_.dw1x5UcB5s9xyl7c3RxNCYArKkAMCrC_0 2024-09-12T18:03:49.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.569+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8519144300629919569', time=2024-09-12T20:03:10.882195+0000, chain.objs.size()=1 2024-09-12T18:03:49.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.569+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17__shadow_.YSkJ1UGjPhZQl556vVrKyAkhHYJ2XZV_0 2024-09-12T18:03:49.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.577+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.585+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:03:49.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.585+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T18:03:49.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_Rv61WR_5rCks8TC2J9K27BJyeP95I9W', time=2024-09-12T19:53:45.883644+0000, chain.objs.size()=1 2024-09-12T18:03:49.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.mUQ-9ndo5M7QJgJFZXCp7okPoG5jcq2_0 2024-09-12T18:03:49.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14969153813386303562', time=2024-09-12T19:55:27.238891+0000, chain.objs.size()=1 2024-09-12T18:03:49.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19__shadow_.CCEIuWkVMMgqlT0dfg0mqAJs6mD3EP__0 2024-09-12T18:03:49.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.966207333798779722', time=2024-09-12T19:55:35.785855+0000, chain.objs.size()=1 2024-09-12T18:03:49.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21__shadow_.a9eFkM-UDedpzYzZJ1GHtkRTktGaPXr_0 2024-09-12T18:03:49.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17573990124872600834', time=2024-09-12T19:56:07.493303+0000, chain.objs.size()=1 2024-09-12T18:03:49.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21__shadow_.Kxn3yQDUdBHWseS5bHwd8jbbiSex1qs_0 2024-09-12T18:03:49.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17701292622431458411', time=2024-09-12T19:57:38.394990+0000, chain.objs.size()=1 2024-09-12T18:03:49.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28__shadow_.t6ysrO_aTs8wlEYi6XgAr4UFcT0E3Qo_0 2024-09-12T18:03:49.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17860315816971004883', time=2024-09-12T19:58:18.011046+0000, chain.objs.size()=1 2024-09-12T18:03:49.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30__shadow_.3AEBCkjjgFmFotb4X1AuVq-9XgHinuH_0 2024-09-12T18:03:49.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9153634583885003291', time=2024-09-12T19:58:22.243609+0000, chain.objs.size()=1 2024-09-12T18:03:49.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31__shadow_.KXqsL5WNBmK3wLzn-MRIf2xjWjaMGZ8_0 2024-09-12T18:03:49.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15429973409253648487', time=2024-09-12T19:58:22.395630+0000, chain.objs.size()=1 2024-09-12T18:03:49.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31__shadow_.GPw_S_1cC4sKxK9r1zNO3Rwls9u2qh8_0 2024-09-12T18:03:49.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15122466237280850516', time=2024-09-12T19:59:01.589676+0000, chain.objs.size()=1 2024-09-12T18:03:49.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33__shadow_.2fRaSvsWloxxGmutI9RgA2hd02FKjXU_0 2024-09-12T18:03:49.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9289909544497109761', time=2024-09-12T19:59:42.104120+0000, chain.objs.size()=1 2024-09-12T18:03:49.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35__shadow_.fQY0hgY14mqYf5Fibz043d9F3YxLzTa_0 2024-09-12T18:03:49.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7812189758524577255', time=2024-09-12T19:59:42.107851+0000, chain.objs.size()=1 2024-09-12T18:03:49.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35__shadow_.b3D23blFBuMcTCI2sBEebwz6v65S43S_0 2024-09-12T18:03:49.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5590907157727194766', time=2024-09-12T19:59:42.138650+0000, chain.objs.size()=1 2024-09-12T18:03:49.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.589+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35__shadow_.wHtMsCHo3H8nq-TA9O_QNhfsqjkuiPy_0 2024-09-12T18:03:49.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.597+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10834727114537544918', time=2024-09-12T20:00:22.682155+0000, chain.objs.size()=1 2024-09-12T18:03:49.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.597+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37__shadow_.NXdibAcXDQD5Q_oXBCjNK4yLERDwcY-_0 2024-09-12T18:03:49.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.605+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.609+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:03:49.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:03:49.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.654577059740990499', time=2024-09-12T19:55:28.521443+0000, chain.objs.size()=1 2024-09-12T18:03:49.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19__shadow_.XTI-co8N5Zq1WZlcBKHt_gshKXQmcWu_0 2024-09-12T18:03:49.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9339255394029292057', time=2024-09-12T19:56:11.867547+0000, chain.objs.size()=1 2024-09-12T18:03:49.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22__shadow_.VZuQQ38WRPSCp1U_x6qAwIx_JIHvnin_0 2024-09-12T18:03:49.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10310092932080049445', time=2024-09-12T19:56:11.896716+0000, chain.objs.size()=1 2024-09-12T18:03:49.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22__shadow_.jIY0QCxgOAkJm3v-14jb2drV_Clna2-_0 2024-09-12T18:03:49.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15613839971375256617', time=2024-09-12T19:56:15.852484+0000, chain.objs.size()=1 2024-09-12T18:03:49.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23__shadow_.3-yEKrIUK4Log-hm-sUA1XaLAwJpWFz_0 2024-09-12T18:03:49.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17681728285560790180', time=2024-09-12T19:56:55.049991+0000, chain.objs.size()=1 2024-09-12T18:03:49.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25__shadow_.6Qa87NQDz6BPU9QU6xRNPTrrht5ydFn_0 2024-09-12T18:03:49.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7877532025397065161', time=2024-09-12T19:57:38.397824+0000, chain.objs.size()=1 2024-09-12T18:03:49.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28__shadow_.eN4LVpBuLpFwavgY_BSTzMlJuuWJ3NE_0 2024-09-12T18:03:49.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16555522115554108873', time=2024-09-12T19:58:13.524809+0000, chain.objs.size()=1 2024-09-12T18:03:49.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29__shadow_.o8ibsHknvaBuTgqfg_Bx3VJeJI4-aAY_0 2024-09-12T18:03:49.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13778485634795335401', time=2024-09-12T19:58:22.304751+0000, chain.objs.size()=1 2024-09-12T18:03:49.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31__shadow_.Lsw4jfAKJSrEq7askF0aEXwMkbpWhLB_0 2024-09-12T18:03:49.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16429895931078958496', time=2024-09-12T19:58:22.516242+0000, chain.objs.size()=1 2024-09-12T18:03:49.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31__shadow_.b2cnoqWQiTdLXBhBdejVT5VrvEu9AyN_0 2024-09-12T18:03:49.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1119458972693004511', time=2024-09-12T19:59:01.596812+0000, chain.objs.size()=1 2024-09-12T18:03:49.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33__shadow_.DjW04yluS4OIzzYrXaeeI9bD-mH69L5_0 2024-09-12T18:03:49.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4837861646626465808', time=2024-09-12T19:59:42.047774+0000, chain.objs.size()=1 2024-09-12T18:03:49.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35__shadow_.6UUj6n4_6apCp4AJDpEVAy8xrWz8GMn_0 2024-09-12T18:03:49.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17220973035249518494', time=2024-09-12T20:00:22.833598+0000, chain.objs.size()=1 2024-09-12T18:03:49.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.613+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37__shadow_.MVxefXHpcKcOq8tqGvlXIUUiAw9R2u__0 2024-09-12T18:03:49.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.621+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12535696011729058416', time=2024-09-12T20:00:26.927304+0000, chain.objs.size()=1 2024-09-12T18:03:49.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.621+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38__shadow_.cGfExMqP7V_p_q-8zXvflqd8Ze_GMUy_0 2024-09-12T18:03:49.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.625+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17225277940427876626', time=2024-09-12T20:00:27.058343+0000, chain.objs.size()=1 2024-09-12T18:03:49.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.625+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38__shadow_.vuA1FWrTVUsdOZhMLbDf4oMdLaK9NVZ_0 2024-09-12T18:03:49.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.625+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8812064723952355579', time=2024-09-12T20:01:01.825624+0000, chain.objs.size()=1 2024-09-12T18:03:49.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.625+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39__shadow_.8KqNx3CH2jCweBgzxzYLcbDuQiBXo6k_0 2024-09-12T18:03:49.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.633+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.633+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:03:49.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:03:49.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4410566173522830500', time=2024-09-12T19:53:46.432970+0000, chain.objs.size()=1 2024-09-12T18:03:49.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.7__shadow_.uCMRsBvhfse7CEI4DXY4lZ3MsTBT8nH_0 2024-09-12T18:03:49.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15601182951599574927', time=2024-09-12T19:53:46.463749+0000, chain.objs.size()=1 2024-09-12T18:03:49.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.7__shadow_.qPao8U24e0udHsz7PlGtUG8U_vUcBQa_0 2024-09-12T18:03:49.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.69310336604776182', time=2024-09-12T19:55:32.589326+0000, chain.objs.size()=1 2024-09-12T18:03:49.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20__shadow_._NcI3xb154lGWiORAYDticdGEKZUGIx_0 2024-09-12T18:03:49.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3785879401636316228', time=2024-09-12T19:56:07.426975+0000, chain.objs.size()=1 2024-09-12T18:03:49.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21__shadow_.Vrk1HbkohRuMTZ3DaGOmRhSqd7EsM9b_0 2024-09-12T18:03:49.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12218154716904028331', time=2024-09-12T19:56:12.065508+0000, chain.objs.size()=1 2024-09-12T18:03:49.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22__shadow_.5gcam_15p2DP21f-laV6fmQZA5fP3pJ_0 2024-09-12T18:03:49.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13262649495404262548', time=2024-09-12T19:56:15.812283+0000, chain.objs.size()=1 2024-09-12T18:03:49.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23__shadow_.1CBaMwx0bEAM6FiRH_okTpsqzsfjpep_0 2024-09-12T18:03:49.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6728337305424700468', time=2024-09-12T19:56:15.859148+0000, chain.objs.size()=1 2024-09-12T18:03:49.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23__shadow_.oVTCY701E93eIlw2FBLRG6DMqq72hFy_0 2024-09-12T18:03:49.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.694266276198086280', time=2024-09-12T19:56:50.360494+0000, chain.objs.size()=1 2024-09-12T18:03:49.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24__shadow_.hlCSEH07kW_aRodgHPK4OTATbzpoUQ-_0 2024-09-12T18:03:49.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16369588698063877804', time=2024-09-12T19:56:59.229614+0000, chain.objs.size()=1 2024-09-12T18:03:49.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26__shadow_.qSrEeCKEJRT4mOZEwotYgDxmwDnaqsI_0 2024-09-12T18:03:49.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16228179293650911104', time=2024-09-12T19:58:13.552136+0000, chain.objs.size()=1 2024-09-12T18:03:49.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29__shadow_.HNMnBbsDtetyt1eVAvmNzXI6GBsfkkq_0 2024-09-12T18:03:49.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4182845826772888360', time=2024-09-12T19:58:18.138232+0000, chain.objs.size()=1 2024-09-12T18:03:49.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30__shadow_.KmQYfE0uubX7k2g4lkYbz8U2APTQAL__0 2024-09-12T18:03:49.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4638307999572320353', time=2024-09-12T19:58:57.084857+0000, chain.objs.size()=1 2024-09-12T18:03:49.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.637+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32__shadow_.33s2VuvK2TdSVfBD9NNK1XROgExKRry_0 2024-09-12T18:03:49.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.645+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14346575798897251165', time=2024-09-12T19:59:40.993184+0000, chain.objs.size()=1 2024-09-12T18:03:49.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.645+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35__shadow_.kzs8bdI8AMjT7w2yWaZovtZyZq_A9hB_0 2024-09-12T18:03:49.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.645+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8084164727304924020', time=2024-09-12T20:00:22.543844+0000, chain.objs.size()=1 2024-09-12T18:03:49.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.645+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37__shadow_.uAQg-Qj3agtX7b_7hecptBZrn07uTkc_0 2024-09-12T18:03:49.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.645+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4467219941327003316', time=2024-09-12T20:00:26.939549+0000, chain.objs.size()=1 2024-09-12T18:03:49.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.645+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38__shadow_.u4SC5TMNrA0RX-7Q4cXJuLc6NytLT43_0 2024-09-12T18:03:49.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.645+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16098096300552859640', time=2024-09-12T20:00:27.071132+0000, chain.objs.size()=1 2024-09-12T18:03:49.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.645+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38__shadow_.VssPXjzmRfe1ivGMouEcG7chSXzEGgb_0 2024-09-12T18:03:49.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.645+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12859520514919873311', time=2024-09-12T20:03:19.096382+0000, chain.objs.size()=1 2024-09-12T18:03:49.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.645+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18__shadow:lctGNeDVheKoWcjLzEn29CQD--o2yWo_.LGH1Q6kdNpW75vNNhoniLeGZZYYv74x_0 2024-09-12T18:03:49.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.653+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.657+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:03:49.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.657+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.657+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.657+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T18:03:49.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.657+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5380348803516012093', time=2024-09-12T19:53:45.965102+0000, chain.objs.size()=1 2024-09-12T18:03:49.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.657+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.GwVpewUfzUPb5YtrfUmhPiEKbsuXFZE_0 2024-09-12T18:03:49.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.657+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12013579726307846731', time=2024-09-12T19:55:32.531612+0000, chain.objs.size()=1 2024-09-12T18:03:49.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.657+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20__shadow_._a-zixZcDiOReh3oHT4ctKVoooFCcgY_0 2024-09-12T18:03:49.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.657+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12800010988128113511', time=2024-09-12T19:56:07.489250+0000, chain.objs.size()=1 2024-09-12T18:03:49.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.657+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21__shadow_.Y3KjixfFduabSnuWRGdhsOE4B85Welh_0 2024-09-12T18:03:49.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.657+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6734580220239468833', time=2024-09-12T19:56:12.008640+0000, chain.objs.size()=1 2024-09-12T18:03:49.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.657+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22__shadow_.0mlGteZ6gdALT0o6dbFtGyS9qGQ_po8_0 2024-09-12T18:03:49.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.661+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7230115180994408295', time=2024-09-12T19:56:12.065467+0000, chain.objs.size()=1 2024-09-12T18:03:49.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.661+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22__shadow_.fNmaFfnT1e5EPy471TtKHQk_H5DhdaR_0 2024-09-12T18:03:49.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.661+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14028647651193083595', time=2024-09-12T19:56:12.144562+0000, chain.objs.size()=1 2024-09-12T18:03:49.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.661+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22__shadow_.soVDiHrld4ms0Mw90BlC6gERvrISEYo_0 2024-09-12T18:03:49.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.661+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3737538457761178882', time=2024-09-12T19:56:55.039619+0000, chain.objs.size()=1 2024-09-12T18:03:49.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.661+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25__shadow_.gWO0B7IwjCDA_9ekUprm4Ednl9rNL27_0 2024-09-12T18:03:49.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.661+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7008613104344052698', time=2024-09-12T19:56:55.191798+0000, chain.objs.size()=1 2024-09-12T18:03:49.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.661+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25__shadow_.FDM0hHJCIQFylj2V9n7ngUr0gbalsZN_0 2024-09-12T18:03:49.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.661+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7940041734876860295', time=2024-09-12T19:56:59.308797+0000, chain.objs.size()=1 2024-09-12T18:03:49.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.661+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26__shadow_.Y1wwhYhJvUgxt78iun9XKKkau60hY9b_0 2024-09-12T18:03:49.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.661+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11627159536309083588', time=2024-09-12T19:57:34.110428+0000, chain.objs.size()=1 2024-09-12T18:03:49.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.661+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27__shadow_.R_NnpQkuHUgPIQLkNqZdwlqA1K4jRtc_0 2024-09-12T18:03:49.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.661+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2427146327890481143', time=2024-09-12T19:57:38.413612+0000, chain.objs.size()=1 2024-09-12T18:03:49.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.661+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28__shadow_.q4s5LjfQV1yuZCx9_PxgC1pkO0C7PNy_0 2024-09-12T18:03:49.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.661+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1857058584637089380', time=2024-09-12T19:58:17.981777+0000, chain.objs.size()=1 2024-09-12T18:03:49.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.661+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30__shadow_.40HdP8mY9EUARBdbc8YkjTCBntesCCG_0 2024-09-12T18:03:49.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.665+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7597485944601170341', time=2024-09-12T19:58:18.150772+0000, chain.objs.size()=1 2024-09-12T18:03:49.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.665+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30__shadow_.jXsPM1MCkpG6mTqH9EgWfiOI2gFzPnD_0 2024-09-12T18:03:49.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.665+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15829756502427044838', time=2024-09-12T19:58:56.123114+0000, chain.objs.size()=1 2024-09-12T18:03:49.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.665+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32__shadow_.qMtRLaipej-h3zbCjJBk-DBRDvWii8X_0 2024-09-12T18:03:49.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.669+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6067853981629955696', time=2024-09-12T19:59:01.569727+0000, chain.objs.size()=1 2024-09-12T18:03:49.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.669+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33__shadow_.XlmqIMxHHB_UnX_-ChFmaZFEs8CcwTn_0 2024-09-12T18:03:49.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.669+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11129111639243906768', time=2024-09-12T19:59:37.200459+0000, chain.objs.size()=1 2024-09-12T18:03:49.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.669+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34__shadow_.Bgh6d-UVIsEMl_lQrIkwqPFL8XYne3e_0 2024-09-12T18:03:49.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.669+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3478893449498499499', time=2024-09-12T20:00:17.777299+0000, chain.objs.size()=1 2024-09-12T18:03:49.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.669+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36__shadow_.UkWp22Q9dpUDooNtJOPWdS5iYzKfCWC_0 2024-09-12T18:03:49.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.669+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14933071710490321299', time=2024-09-12T20:00:17.817970+0000, chain.objs.size()=1 2024-09-12T18:03:49.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.669+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36__shadow_.df_lbpOh__0Kwuj9hDrV09yiZ2y-VDE_0 2024-09-12T18:03:49.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.669+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11225483266866217479', time=2024-09-12T20:00:17.938164+0000, chain.objs.size()=1 2024-09-12T18:03:49.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.669+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36__shadow_.6Kyc5ZetNgP5kC3705CIzpQxcH6Pzfw_0 2024-09-12T18:03:49.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.669+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8363935526460216517', time=2024-09-12T20:00:22.576655+0000, chain.objs.size()=1 2024-09-12T18:03:49.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.669+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37__shadow_.HO2GWjsJAbfjWlpCU2w1kWYlAa5wvhd_0 2024-09-12T18:03:49.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.669+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1439877265285101750', time=2024-09-12T20:01:01.718187+0000, chain.objs.size()=1 2024-09-12T18:03:49.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.669+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39__shadow_.-8myBuYZqiQxkCuE8upCjp2kj_PNF20_0 2024-09-12T18:03:49.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.669+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15202969125054805085', time=2024-09-12T20:01:01.909094+0000, chain.objs.size()=1 2024-09-12T18:03:49.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.669+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39__shadow_.Y62PbtZvh1f-T9x6L9v25x-tLlVU-f9_0 2024-09-12T18:03:49.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.677+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.681+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:03:49.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.681+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.681+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.681+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T18:03:49.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.681+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_4WSRWh1FTSMn_Z0Oh4I8flAf8m6PA_R', time=2024-09-12T19:53:46.148252+0000, chain.objs.size()=1 2024-09-12T18:03:49.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.681+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__shadow_.QQOK2JUa1VDtEzAUpjCN-RiFMmVL_b5_0 2024-09-12T18:03:49.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.681+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10495904345774527872', time=2024-09-12T19:55:32.721848+0000, chain.objs.size()=1 2024-09-12T18:03:49.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.681+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20__shadow_.w2KFHEfZi8HfMR4qksZVzAGu5AkKTX0_0 2024-09-12T18:03:49.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.681+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11358164986770120004', time=2024-09-12T19:56:15.812239+0000, chain.objs.size()=1 2024-09-12T18:03:49.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.681+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23__shadow_.s0sXB7bPLievuo4cJK5aDAayaDplRc7_0 2024-09-12T18:03:49.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.681+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8793960702422331355', time=2024-09-12T19:56:16.030199+0000, chain.objs.size()=1 2024-09-12T18:03:49.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.681+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23__shadow_.A8Mrwue08FUaGmg-QOEsmNyFiphIiDj_0 2024-09-12T18:03:49.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.681+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13089675308985996112', time=2024-09-12T19:57:34.004379+0000, chain.objs.size()=1 2024-09-12T18:03:49.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.681+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27__shadow_.MZ9mxM_32IgsF0IVJDULI3G7VJyFG5n_0 2024-09-12T18:03:49.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.681+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14953968837682199426', time=2024-09-12T20:03:10.888091+0000, chain.objs.size()=1 2024-09-12T18:03:49.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.681+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17__shadow_.l0NuvHkWFkD0IfJnuuYor34y5L4KcAY_0 2024-09-12T18:03:49.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.685+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.689+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:03:49.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:03:49.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15781349157837900732', time=2024-09-12T19:55:32.603491+0000, chain.objs.size()=1 2024-09-12T18:03:49.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20__shadow_.UhCK-3MHv0lz8jH925un0GdJPC8ckmc_0 2024-09-12T18:03:49.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7686928266871373050', time=2024-09-12T19:56:50.326197+0000, chain.objs.size()=1 2024-09-12T18:03:49.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24__shadow_.glmu3vS6_5yifkcpWr8oEDssiwM_wge_0 2024-09-12T18:03:49.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12904363421076922721', time=2024-09-12T19:56:50.351754+0000, chain.objs.size()=1 2024-09-12T18:03:49.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24__shadow_.fwIIAz1cI7cLWaswwSnUtoujeeX8Ayi_0 2024-09-12T18:03:49.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10465971724243621656', time=2024-09-12T19:56:50.382696+0000, chain.objs.size()=1 2024-09-12T18:03:49.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24__shadow_.J_bzY6Jlymes18UAkdltg_6c2xCBEhR_0 2024-09-12T18:03:49.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11842756686798483937', time=2024-09-12T19:56:55.125357+0000, chain.objs.size()=1 2024-09-12T18:03:49.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25__shadow_.7pzRyg22Gt-6VFZD-9TAOXezPWPc2wU_0 2024-09-12T18:03:49.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3008750209828826592', time=2024-09-12T19:57:34.015345+0000, chain.objs.size()=1 2024-09-12T18:03:49.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27__shadow_.HGX5hnZNlrEE1tzvzU-kguKkWO8oXaf_0 2024-09-12T18:03:49.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16344148776330960470', time=2024-09-12T19:57:34.122809+0000, chain.objs.size()=1 2024-09-12T18:03:49.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27__shadow_.mFHltVQ9Nm_-VXEddTi6dDYj_QrlTTq_0 2024-09-12T18:03:49.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.686618271164323256', time=2024-09-12T19:58:16.952821+0000, chain.objs.size()=1 2024-09-12T18:03:49.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30__shadow_.xnSV-9uXe5JCHbLggzdsWdiqby4kvCm_0 2024-09-12T18:03:49.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1599154472620764033', time=2024-09-12T19:58:22.445767+0000, chain.objs.size()=1 2024-09-12T18:03:49.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31__shadow_.3D2JusqNSPCxS76Nj-CbaRU46JOex_A_0 2024-09-12T18:03:49.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9767219276648957226', time=2024-09-12T19:58:22.486044+0000, chain.objs.size()=1 2024-09-12T18:03:49.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31__shadow_.bZf8xLc0HiXqWb5IqSgdAzBtxl6ehL5_0 2024-09-12T18:03:49.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12381597847483697880', time=2024-09-12T19:58:56.980621+0000, chain.objs.size()=1 2024-09-12T18:03:49.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32__shadow_.76U2Gjb6K0jGpTQuCMqYJzcBff41pAu_0 2024-09-12T18:03:49.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1374508917019612159', time=2024-09-12T19:59:37.257655+0000, chain.objs.size()=1 2024-09-12T18:03:49.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.693+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34__shadow_.ElHPBAOZt3hmVRaq-XX8i28ivkfSg-a_0 2024-09-12T18:03:49.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.697+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.837454268403851111', time=2024-09-12T19:59:37.355545+0000, chain.objs.size()=1 2024-09-12T18:03:49.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.697+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34__shadow_.rANslSo7fFCjgSEqdPW_hUMeMrn2r8R_0 2024-09-12T18:03:49.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.697+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2713603268774087999', time=2024-09-12T19:59:37.385527+0000, chain.objs.size()=1 2024-09-12T18:03:49.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.697+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34__shadow_.HlHBWJjRIST26teHcapsCqs4P4MzrL-_0 2024-09-12T18:03:49.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.697+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4086523207258415562', time=2024-09-12T19:59:42.275364+0000, chain.objs.size()=1 2024-09-12T18:03:49.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.697+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35__shadow_.fHqG4dp_hSIto_i_57nBtOBX00S4n9y_0 2024-09-12T18:03:49.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.697+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1610085960749839410', time=2024-09-12T20:00:17.687388+0000, chain.objs.size()=1 2024-09-12T18:03:49.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.697+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36__shadow_._N2g_PoqqXW6cdr2rhlTyWVOMhiMnTV_0 2024-09-12T18:03:49.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.701+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13509364885244750819', time=2024-09-12T20:00:22.553435+0000, chain.objs.size()=1 2024-09-12T18:03:49.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.701+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37__shadow_.MGKsyz56oW3sONFqjn4ymlajYIBCLur_0 2024-09-12T18:03:49.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.701+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.705+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:03:49.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:03:49.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8895919814836118501', time=2024-09-12T19:53:46.309202+0000, chain.objs.size()=2 2024-09-12T18:03:49.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.13__shadow_.0pNvgjtOYm0vS-exPBTld7AtKJWLLkG_0 2024-09-12T18:03:49.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.13__shadow_.0pNvgjtOYm0vS-exPBTld7AtKJWLLkG_1 2024-09-12T18:03:49.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10274914175249688856', time=2024-09-12T19:56:07.528937+0000, chain.objs.size()=1 2024-09-12T18:03:49.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21__shadow_.DgoeeyVHY0t442Nyrhea4ATvpL3GbPx_0 2024-09-12T18:03:49.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6996668440533671062', time=2024-09-12T19:56:10.683699+0000, chain.objs.size()=1 2024-09-12T18:03:49.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22__shadow_.pD49UEGgwbdCpd52mJAJL2-AuysUN7i_0 2024-09-12T18:03:49.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8043598493137777151', time=2024-09-12T19:56:15.935131+0000, chain.objs.size()=1 2024-09-12T18:03:49.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23__shadow_.bOHX0LFRVHPgkpdfXEHHRxzlh__7bkK_0 2024-09-12T18:03:49.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16305853313437951155', time=2024-09-12T19:56:55.035219+0000, chain.objs.size()=1 2024-09-12T18:03:49.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25__shadow_.HC3nxLgOX-XNFNtiZE5iDesytcBiE5j_0 2024-09-12T18:03:49.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2141384973141153670', time=2024-09-12T19:56:55.099575+0000, chain.objs.size()=1 2024-09-12T18:03:49.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25__shadow_.UoRRl_52sz-6nExfq438fCtGsFlprci_0 2024-09-12T18:03:49.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13222152060709145246', time=2024-09-12T19:56:59.014299+0000, chain.objs.size()=1 2024-09-12T18:03:49.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26__shadow_.2ih1Xz9X2o5A9y9gEKiLinW-3M9zS8g_0 2024-09-12T18:03:49.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9255959263153454593', time=2024-09-12T19:56:59.298135+0000, chain.objs.size()=1 2024-09-12T18:03:49.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26__shadow_.iDApJ306OLZIr9Q8TWjpQ6kRbJQPpvo_0 2024-09-12T18:03:49.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13007440230166547283', time=2024-09-12T19:58:17.973578+0000, chain.objs.size()=1 2024-09-12T18:03:49.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30__shadow_.zb9NptmWlkoWx82uxF9dDiT2XoyZeZT_0 2024-09-12T18:03:49.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13782360700577988347', time=2024-09-12T19:58:18.156814+0000, chain.objs.size()=1 2024-09-12T18:03:49.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30__shadow_.Eag99bGcNPJeycqT8dHCiCnYNpCimFj_0 2024-09-12T18:03:49.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7485257832915571953', time=2024-09-12T19:58:22.205744+0000, chain.objs.size()=1 2024-09-12T18:03:49.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.709+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31__shadow_.KJYk6ITUxk3-0uodJQ92OPzTlLkWm_e_0 2024-09-12T18:03:49.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.717+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15744420108680710740', time=2024-09-12T19:58:57.084857+0000, chain.objs.size()=1 2024-09-12T18:03:49.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.717+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32__shadow_.xJ3r90TkS3dVkdg7XglFN3M-WlK3aEa_0 2024-09-12T18:03:49.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.717+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2015795498038746875', time=2024-09-12T19:59:01.692469+0000, chain.objs.size()=1 2024-09-12T18:03:49.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.717+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33__shadow_.VGsLQfcIbAAS_Ec31JKh_Es5zjGpvcH_0 2024-09-12T18:03:49.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.717+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14566383386020065370', time=2024-09-12T20:00:17.781424+0000, chain.objs.size()=1 2024-09-12T18:03:49.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.717+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36__shadow_.ygObm9u_p4NrwV5PVbfIKHfBcgAC017_0 2024-09-12T18:03:49.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.717+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2661983044462008015', time=2024-09-12T20:03:25.363834+0000, chain.objs.size()=1 2024-09-12T18:03:49.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.717+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18__shadow:ozv8r.6tFfcQ1YazYCsCz8Jkq8fz1Fi_.lUmQ8eoqrtdi9ENqXa92FuLZaHUc0Xi_0 2024-09-12T18:03:49.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.721+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.721+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:03:49.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:03:49.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16577060782736365732', time=2024-09-12T19:53:45.591897+0000, chain.objs.size()=1 2024-09-12T18:03:49.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.4__shadow_.eME5ZVwXO1X7z0hzKhnXH-kfeiOt7ck_0 2024-09-12T18:03:49.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8997838973003994388', time=2024-09-12T19:53:46.128732+0000, chain.objs.size()=3 2024-09-12T18:03:49.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-STANDARD.2~cp5buN3zOGyebj-cIPtL0Oq7WywKLVH.1 2024-09-12T18:03:49.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-STANDARD.2~cp5buN3zOGyebj-cIPtL0Oq7WywKLVH.2 2024-09-12T18:03:49.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-STANDARD.2~cp5buN3zOGyebj-cIPtL0Oq7WywKLVH.3 2024-09-12T18:03:49.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16836036630623833389', time=2024-09-12T19:55:32.521420+0000, chain.objs.size()=1 2024-09-12T18:03:49.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20__shadow_.wBye37QvaAlffas7SGRBT1dLg20WYkk_0 2024-09-12T18:03:49.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9158313789802334317', time=2024-09-12T19:56:15.827168+0000, chain.objs.size()=1 2024-09-12T18:03:49.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23__shadow_.s3GvEY-qugj0A9n3ssdo2ibXzK2G1kx_0 2024-09-12T18:03:49.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2330747639614962179', time=2024-09-12T19:56:15.829138+0000, chain.objs.size()=1 2024-09-12T18:03:49.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23__shadow_.qbWP0H_4Svuhm7zFQvyI0Pw8Ja7CeXN_0 2024-09-12T18:03:49.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8833006877786231757', time=2024-09-12T19:56:16.073108+0000, chain.objs.size()=1 2024-09-12T18:03:49.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23__shadow_.cUZ6umPL8dMtVl8BOCT8EZ6014l-ncm_0 2024-09-12T18:03:49.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18282773877798919848', time=2024-09-12T19:56:16.087750+0000, chain.objs.size()=1 2024-09-12T18:03:49.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23__shadow_.qMT-O-pavz3-cS_nUUQK4SRNAxOIE8c_0 2024-09-12T18:03:49.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13406833135392619446', time=2024-09-12T19:56:50.296072+0000, chain.objs.size()=1 2024-09-12T18:03:49.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24__shadow_.a-hsaWCS2xNtlfxqolBPg3-Lr8PhaKE_0 2024-09-12T18:03:49.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17142536541131589469', time=2024-09-12T19:56:59.298577+0000, chain.objs.size()=1 2024-09-12T18:03:49.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26__shadow_.5n3oRTulT8xH2C63yLyemHp1l4zfDmB_0 2024-09-12T18:03:49.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15264196100301449300', time=2024-09-12T19:57:34.146206+0000, chain.objs.size()=1 2024-09-12T18:03:49.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.725+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27__shadow_.IzDM3TFOJRGe39Z3ofGvAJUyKe3sxqV_0 2024-09-12T18:03:49.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.729+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3213532107798653836', time=2024-09-12T19:58:13.391848+0000, chain.objs.size()=1 2024-09-12T18:03:49.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.729+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29__shadow_.u9FgflXRsTlr4U2-UO3BeEkY6PWJZub_0 2024-09-12T18:03:49.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.729+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3954488359588499762', time=2024-09-12T20:00:17.711794+0000, chain.objs.size()=1 2024-09-12T18:03:49.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.729+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36__shadow_.imJad898eJeVLL_qCRE8-qZm3zvadFI_0 2024-09-12T18:03:49.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.729+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16555597056877417214', time=2024-09-12T20:00:17.713671+0000, chain.objs.size()=1 2024-09-12T18:03:49.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.729+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36__shadow_.MYsXTIpLk_ZN543BlTQMbKyLjKBsnZH_0 2024-09-12T18:03:49.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.729+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16413192365461934551', time=2024-09-12T20:00:22.646448+0000, chain.objs.size()=1 2024-09-12T18:03:49.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.729+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37__shadow_.7TkOabzk9ubDzvF-UJP9n0tbPcjM8zp_0 2024-09-12T18:03:49.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.733+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.737+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:03:49.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.737+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T18:03:49.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4591068624644584780', time=2024-09-12T19:53:46.159257+0000, chain.objs.size()=3 2024-09-12T18:03:49.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-FROZEN.2~8eE3-4ymQewMsqSi4egz_JNJMh3wwAY.1 2024-09-12T18:03:49.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-FROZEN.2~8eE3-4ymQewMsqSi4egz_JNJMh3wwAY.2 2024-09-12T18:03:49.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-FROZEN.2~8eE3-4ymQewMsqSi4egz_JNJMh3wwAY.3 2024-09-12T18:03:49.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12196430640975160811', time=2024-09-12T19:55:28.354515+0000, chain.objs.size()=1 2024-09-12T18:03:49.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19__shadow_.qhjqXz3J5zmJShACC39yOilA6aysfII_0 2024-09-12T18:03:49.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14683261789676895592', time=2024-09-12T19:55:28.369921+0000, chain.objs.size()=1 2024-09-12T18:03:49.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19__shadow_.0qCdzY2UuVdaackLG5s3OVN6zGNe0Z3_0 2024-09-12T18:03:49.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17290591325566772135', time=2024-09-12T19:55:32.480623+0000, chain.objs.size()=1 2024-09-12T18:03:49.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20__shadow_.6eLpPG-IojnTgkocNdhoUqvh6wb_UO-_0 2024-09-12T18:03:49.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5838480261396145302', time=2024-09-12T19:56:50.548249+0000, chain.objs.size()=1 2024-09-12T18:03:49.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24__shadow_.MA8aaliYsE5g2GM0Qivfk0HFnuCHxdt_0 2024-09-12T18:03:49.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14832114095650343386', time=2024-09-12T19:56:55.049626+0000, chain.objs.size()=1 2024-09-12T18:03:49.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25__shadow_.BFaPLtuAPwYJnaGsPAzA-Ki1d-VHXnf_0 2024-09-12T18:03:49.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12767314290846477046', time=2024-09-12T19:56:55.051222+0000, chain.objs.size()=1 2024-09-12T18:03:49.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25__shadow_.Zp6VBCfJo53HT3mA9rxbV8IhkVkvZGY_0 2024-09-12T18:03:49.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15850863491953208743', time=2024-09-12T19:58:13.524659+0000, chain.objs.size()=1 2024-09-12T18:03:49.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29__shadow_.1f4_UVG6bum6eL8OvZJN4ppuylHQX9z_0 2024-09-12T18:03:49.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9337408373987058628', time=2024-09-12T19:58:17.971694+0000, chain.objs.size()=1 2024-09-12T18:03:49.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30__shadow_.J38QF7lhlsx_45jeZbtzIT-0QJN1a8o_0 2024-09-12T18:03:49.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5042875927767829441', time=2024-09-12T19:58:22.526749+0000, chain.objs.size()=1 2024-09-12T18:03:49.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.741+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31__shadow_.iOfRImu0RtWfKlL_9dk-_N0sZaOoyDw_0 2024-09-12T18:03:49.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.745+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13778957109929823351', time=2024-09-12T19:58:57.081127+0000, chain.objs.size()=1 2024-09-12T18:03:49.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.745+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32__shadow_.qsmuu1a_Qmv6f3-lHKzrXFTb7epz6Dj_0 2024-09-12T18:03:49.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.745+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7072232592665531843', time=2024-09-12T19:59:01.596941+0000, chain.objs.size()=1 2024-09-12T18:03:49.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.745+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33__shadow_.l9rx1l8iIOMlTuOXGRFNapz6WgeR6eK_0 2024-09-12T18:03:49.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.745+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3489721318583233979', time=2024-09-12T19:59:01.781022+0000, chain.objs.size()=1 2024-09-12T18:03:49.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.745+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33__shadow_.i1Sbwf5IvGJkwd--QxAJKkXftpUc8P0_0 2024-09-12T18:03:49.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.745+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6970212729611412974', time=2024-09-12T19:59:37.271953+0000, chain.objs.size()=1 2024-09-12T18:03:49.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.745+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34__shadow_.-ZEGZSYcaFWNOyPAF8twKYs_OK2IAyP_0 2024-09-12T18:03:49.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.745+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17001584627330160783', time=2024-09-12T20:00:22.711796+0000, chain.objs.size()=1 2024-09-12T18:03:49.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.745+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37__shadow_.HlUWHY5JYlJRIqEPMt84QC7F5zrGrZM_0 2024-09-12T18:03:49.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.745+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1115126830766417786', time=2024-09-12T20:03:10.931228+0000, chain.objs.size()=1 2024-09-12T18:03:49.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.745+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17__shadow_.C7vCEljZQ0VaLxNfssQ_8NVxpjQkCQK_0 2024-09-12T18:03:49.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.749+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.749+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:03:49.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.753+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.753+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.753+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:03:49.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.753+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11772464744916594661', time=2024-09-12T19:53:45.723791+0000, chain.objs.size()=4 2024-09-12T18:03:49.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.753+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.12__multipart_foo.2~Mk37YGmijScCmC4v-O-SPA6H-do0gvy.1 2024-09-12T18:03:49.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.753+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.12__multipart_foo.2~Mk37YGmijScCmC4v-O-SPA6H-do0gvy.2 2024-09-12T18:03:49.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.753+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.12__multipart_foo.2~Mk37YGmijScCmC4v-O-SPA6H-do0gvy.3 2024-09-12T18:03:49.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.753+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.12__multipart_foo.2~Mk37YGmijScCmC4v-O-SPA6H-do0gvy.4 2024-09-12T18:03:49.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.753+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6313873860498680439', time=2024-09-12T19:53:45.834709+0000, chain.objs.size()=4 2024-09-12T18:03:49.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.753+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.9__multipart_foo.2~onaz8u--QSuIZL3kIqyOPd1voXSDV50.1 2024-09-12T18:03:49.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.753+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.9__multipart_foo.2~onaz8u--QSuIZL3kIqyOPd1voXSDV50.2 2024-09-12T18:03:49.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.753+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.9__multipart_foo.2~onaz8u--QSuIZL3kIqyOPd1voXSDV50.3 2024-09-12T18:03:49.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.753+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.9__multipart_foo.2~onaz8u--QSuIZL3kIqyOPd1voXSDV50.4 2024-09-12T18:03:49.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.753+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_-5rCVq2Jj9g-50H6z0CBuXq-lrcXJq8', time=2024-09-12T19:53:46.085418+0000, chain.objs.size()=2 2024-09-12T18:03:49.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.753+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__shadow_.GbYYvOwNvfMFUmCdLDEfctAmbQyyV2Q_0 2024-09-12T18:03:49.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.753+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__shadow_.GbYYvOwNvfMFUmCdLDEfctAmbQyyV2Q_1 2024-09-12T18:03:49.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.753+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_reuhuzPTmqIVVbJw08R0vNo4Le7tezu', time=2024-09-12T19:53:46.107384+0000, chain.objs.size()=2 2024-09-12T18:03:49.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.753+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__shadow_.Oq3LxxO9at2kWFk6PeFkbKze-0OEAF0_0 2024-09-12T18:03:49.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.753+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__shadow_.Oq3LxxO9at2kWFk6PeFkbKze-0OEAF0_1 2024-09-12T18:03:49.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.761+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4058829191739861866', time=2024-09-12T19:56:12.110413+0000, chain.objs.size()=1 2024-09-12T18:03:49.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.761+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22__shadow_.k33qTxKoeGXkTZaN-y8eTaJWtjYZSAw_0 2024-09-12T18:03:49.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.761+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15007058328116811521', time=2024-09-12T19:56:15.921270+0000, chain.objs.size()=1 2024-09-12T18:03:49.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.761+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23__shadow_.Go8nV47K7TvH4Vk1HlNSmkpAUEWQnJH_0 2024-09-12T18:03:49.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.761+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.410223143003806302', time=2024-09-12T19:56:15.971423+0000, chain.objs.size()=1 2024-09-12T18:03:49.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.761+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23__shadow_.JXwB4EbiWfm41I-viRBJB086ZiLN0wJ_0 2024-09-12T18:03:49.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.761+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12813695447283093480', time=2024-09-12T19:57:34.034315+0000, chain.objs.size()=1 2024-09-12T18:03:49.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.761+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27__shadow_.KjsQXAwv7npn7ar7bx4O5Pis3ASxCfM_0 2024-09-12T18:03:49.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.761+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4498603667569093816', time=2024-09-12T19:58:22.363175+0000, chain.objs.size()=1 2024-09-12T18:03:49.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.761+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31__shadow_.UWDDpbhdg1tJDIIMSmL7NeS8P7J-qnq_0 2024-09-12T18:03:49.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.761+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7035491885740588116', time=2024-09-12T19:58:56.984659+0000, chain.objs.size()=1 2024-09-12T18:03:49.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.761+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32__shadow_.26QGDWsZx_brZ3PgK6JEM-3TfZAw8wG_0 2024-09-12T18:03:49.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.761+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11755949491466793833', time=2024-09-12T19:59:01.656093+0000, chain.objs.size()=1 2024-09-12T18:03:49.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.761+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33__shadow_.aWn0RMEVe4Mj-qBQ5U6njMxe5F_LlbN_0 2024-09-12T18:03:49.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.761+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17682499953341118447', time=2024-09-12T19:59:01.795033+0000, chain.objs.size()=1 2024-09-12T18:03:49.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.761+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33__shadow_.kUAgw4gqBPjNMt3j6KsZ6agdYHy-oMA_0 2024-09-12T18:03:49.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.761+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17406890511843886944', time=2024-09-12T20:00:22.661946+0000, chain.objs.size()=1 2024-09-12T18:03:49.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.761+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37__shadow_.0tGASD9RnGcmdT4eRyWRtntgUDD2nKV_0 2024-09-12T18:03:49.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.761+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1864627808616734099', time=2024-09-12T20:01:01.928962+0000, chain.objs.size()=1 2024-09-12T18:03:49.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.761+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39__shadow_.r2N9e7QL_ZxdGQtYVBWUrxI72CBRbnm_0 2024-09-12T18:03:49.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.769+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.769+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:03:49.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T18:03:49.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3592224321994284688', time=2024-09-12T19:53:45.954882+0000, chain.objs.size()=1 2024-09-12T18:03:49.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.wxPegvjj9b3j9bxWwpZd6sr5Kd40dcP_0 2024-09-12T18:03:49.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3460684477473836712', time=2024-09-12T19:53:46.452847+0000, chain.objs.size()=1 2024-09-12T18:03:49.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.7__shadow_.HH_tip4sZbq4E6bQzJiyP_Tw5qCadX8_0 2024-09-12T18:03:49.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10066916386761290628', time=2024-09-12T19:53:46.555924+0000, chain.objs.size()=1 2024-09-12T18:03:49.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.8__shadow_.bDNq8AdYpJsMTuEOOwzAktKhKrQEx-p_0 2024-09-12T18:03:49.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2085057301133268451', time=2024-09-12T19:55:28.649825+0000, chain.objs.size()=1 2024-09-12T18:03:49.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19__shadow_.3kPPfFrsyB6rvIMKyhnhYroTwihzoxZ_0 2024-09-12T18:03:49.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1154234948633384520', time=2024-09-12T19:55:32.531563+0000, chain.objs.size()=1 2024-09-12T18:03:49.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20__shadow_.hwohnlv514jziXqjBXxzqKOw18Zq60V_0 2024-09-12T18:03:49.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18014962959642202139', time=2024-09-12T19:56:15.967886+0000, chain.objs.size()=1 2024-09-12T18:03:49.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23__shadow_.cypsRNMNK4KmtbI_MDwknT5q3yQysNo_0 2024-09-12T18:03:49.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.567560014960034141', time=2024-09-12T19:56:50.392087+0000, chain.objs.size()=1 2024-09-12T18:03:49.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24__shadow_.86pmRIFLhpw2VfIpAGOQynBOLjoOqV2_0 2024-09-12T18:03:49.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13131937815106060363', time=2024-09-12T19:56:55.222702+0000, chain.objs.size()=1 2024-09-12T18:03:49.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25__shadow_.ye362QxH2tKL6TwwfODLdYtwiU0ROxP_0 2024-09-12T18:03:49.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4947231929134040520', time=2024-09-12T19:57:33.978323+0000, chain.objs.size()=1 2024-09-12T18:03:49.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27__shadow_._lVMwR_mAIEC4GAWmUs3a0-Z3GCRCI__0 2024-09-12T18:03:49.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13738908492091897590', time=2024-09-12T19:57:38.565993+0000, chain.objs.size()=1 2024-09-12T18:03:49.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28__shadow_.yKPiEpgNHvBZfJtbfUXFe8SDTULaOdp_0 2024-09-12T18:03:49.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6132898952834714382', time=2024-09-12T19:58:13.406224+0000, chain.objs.size()=1 2024-09-12T18:03:49.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29__shadow_.bf1QGyU-Lhi6g4dy5SSeJS6Zl1Ap-5A_0 2024-09-12T18:03:49.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6487197952050790495', time=2024-09-12T19:58:17.970128+0000, chain.objs.size()=1 2024-09-12T18:03:49.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.773+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30__shadow_.1j6heXgC2MoRYGHQrP8XOijC9y6jxhU_0 2024-09-12T18:03:49.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.777+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6028658559279572700', time=2024-09-12T19:58:18.089107+0000, chain.objs.size()=1 2024-09-12T18:03:49.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.777+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30__shadow_._A7XPZoGq4xDCAsrm0zooyg_X6L7lsd_0 2024-09-12T18:03:49.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.781+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5364634221987674556', time=2024-09-12T19:58:22.450934+0000, chain.objs.size()=1 2024-09-12T18:03:49.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.781+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31__shadow_.WYsbtDU_Vip5hUwtuYBjfod9kORH5Cd_0 2024-09-12T18:03:49.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.781+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.685672928579842714', time=2024-09-12T19:58:57.133244+0000, chain.objs.size()=1 2024-09-12T18:03:49.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.781+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32__shadow_.yJF-U5qx-ofruouJ-0qgBOKYeD4DhLy_0 2024-09-12T18:03:49.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.781+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8942993815048935837', time=2024-09-12T19:59:37.214538+0000, chain.objs.size()=1 2024-09-12T18:03:49.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.781+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34__shadow_.hNBghGyhEgRmb7_E5lZNYdNXfF5Xnrv_0 2024-09-12T18:03:49.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.781+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3479731773545388433', time=2024-09-12T19:59:42.135995+0000, chain.objs.size()=1 2024-09-12T18:03:49.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.781+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35__shadow_.tgcYwbjad3rFdZRE36WMqmIaz6-PvgD_0 2024-09-12T18:03:49.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.781+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11007983441712843753', time=2024-09-12T20:00:17.656175+0000, chain.objs.size()=1 2024-09-12T18:03:49.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.781+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36__shadow_.vzHPrqejt5nxOgD9Q7z3pl8tQKFpNAS_0 2024-09-12T18:03:49.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.781+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11850104600118911129', time=2024-09-12T20:00:17.938443+0000, chain.objs.size()=1 2024-09-12T18:03:49.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.781+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36__shadow_.63lx8an1IBWN9WK4z0PzyGHL1K32OIj_0 2024-09-12T18:03:49.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.781+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2908599932751701276', time=2024-09-12T20:01:01.783490+0000, chain.objs.size()=1 2024-09-12T18:03:49.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.781+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39__shadow_.PKlzmO_k96dJxhN2GkJBBipqtfmUHzq_0 2024-09-12T18:03:49.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.785+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.789+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:03:49.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.789+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.789+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.789+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T18:03:49.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.789+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9075455197111326044', time=2024-09-12T19:55:28.586460+0000, chain.objs.size()=1 2024-09-12T18:03:49.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.789+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19__shadow_.er0ZKe18x7SoHpXwpBog8SH-Mq_gXHx_0 2024-09-12T18:03:49.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.789+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17648508399186257072', time=2024-09-12T19:55:28.588788+0000, chain.objs.size()=1 2024-09-12T18:03:49.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.789+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19__shadow_.Vad7dPg3jb1hJDhNHajodjSm5epSDXq_0 2024-09-12T18:03:49.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.789+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13749874301573229619', time=2024-09-12T19:55:32.521066+0000, chain.objs.size()=1 2024-09-12T18:03:49.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.789+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20__shadow_.B9GNI-TgEj_i2OenGmCElWFcjq9K7UT_0 2024-09-12T18:03:49.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.789+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3830823199512148031', time=2024-09-12T19:56:55.040246+0000, chain.objs.size()=1 2024-09-12T18:03:49.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.789+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25__shadow_.2gKRHcSpv7OqSpQ0F9OQzZtbhxG4seH_0 2024-09-12T18:03:49.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.789+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15143907564710074244', time=2024-09-12T19:56:59.148013+0000, chain.objs.size()=1 2024-09-12T18:03:49.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.789+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26__shadow_.kz5EOcv983QGrFIS7FnLvePuiWh03WV_0 2024-09-12T18:03:49.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.789+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1302768267037027341', time=2024-09-12T19:56:59.149987+0000, chain.objs.size()=1 2024-09-12T18:03:49.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.789+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26__shadow_.aYERmIcsu1l1_JrpX3PByabtZSCQTtb_0 2024-09-12T18:03:49.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.789+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13708686355287403373', time=2024-09-12T19:57:34.146309+0000, chain.objs.size()=1 2024-09-12T18:03:49.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.789+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27__shadow_.ucm2q9H1hSyFR9NMNbm_y7QUD55L4_R_0 2024-09-12T18:03:49.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.789+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8126593117097480256', time=2024-09-12T20:00:27.016695+0000, chain.objs.size()=1 2024-09-12T18:03:49.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.789+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38__shadow_.qn_PlTthHUN9VnfU5D0qrurj0UALm18_0 2024-09-12T18:03:49.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.793+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.797+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:03:49.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.797+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.797+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T18:03:49.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_QcoWSbKN_HA3AVYzgepmCvYjN4jkvID', time=2024-09-12T19:53:45.944475+0000, chain.objs.size()=1 2024-09-12T18:03:49.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.kAapTv5N4HHbPaKBObkQIrDcSG0kRvM_0 2024-09-12T18:03:49.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7602611214280128968', time=2024-09-12T19:55:28.478796+0000, chain.objs.size()=1 2024-09-12T18:03:49.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19__shadow_.woKrAR2740NfI_rbJrlspNsNp34vjxu_0 2024-09-12T18:03:49.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2698243636858141373', time=2024-09-12T19:55:32.533979+0000, chain.objs.size()=1 2024-09-12T18:03:49.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20__shadow_.Jitgf_aK-YutEmtJNEoUSHl72eWcmSy_0 2024-09-12T18:03:49.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11298798043270937139', time=2024-09-12T19:56:11.942363+0000, chain.objs.size()=1 2024-09-12T18:03:49.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22__shadow_.IQSfgK_NB_gMFABJ27zRNiVEZ3gmnmU_0 2024-09-12T18:03:49.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.354836905129577165', time=2024-09-12T19:56:50.321107+0000, chain.objs.size()=1 2024-09-12T18:03:49.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24__shadow_.bbFS0GYq8mv6WeHUNxonaG2D3DeBHb9_0 2024-09-12T18:03:49.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2309570072486410429', time=2024-09-12T19:57:03.024326+0000, chain.objs.size()=1 2024-09-12T18:03:49.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27__shadow_.UNj8GcKciifZijZl3uobzQpRplzDgbU_0 2024-09-12T18:03:49.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1071033518232540256', time=2024-09-12T19:57:38.465213+0000, chain.objs.size()=1 2024-09-12T18:03:49.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28__shadow_.OsUbZn57lYu_kJKHCAjOcZKbaBzc_2h_0 2024-09-12T18:03:49.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13869104963408920093', time=2024-09-12T19:57:42.169166+0000, chain.objs.size()=1 2024-09-12T18:03:49.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29__shadow_.hM4SU9Fo9D6SxlHDnHbzTQfj_BNzQEJ_0 2024-09-12T18:03:49.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18169366449059485662', time=2024-09-12T19:58:18.045879+0000, chain.objs.size()=1 2024-09-12T18:03:49.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30__shadow_.uWs71XaBiL0hVakMp_JG5617ezMTmM1_0 2024-09-12T18:03:49.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4545752471665190501', time=2024-09-12T19:59:37.345129+0000, chain.objs.size()=1 2024-09-12T18:03:49.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34__shadow_.PcOlK9v0cGmEAuIwziRVLgUkcwLugd0_0 2024-09-12T18:03:49.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8336940498716659756', time=2024-09-12T19:59:37.346769+0000, chain.objs.size()=1 2024-09-12T18:03:49.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34__shadow_.Aa1cdZO_ZwBHVSErfHIBnoddDXsDPt__0 2024-09-12T18:03:49.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5196181679378485730', time=2024-09-12T20:01:01.713332+0000, chain.objs.size()=1 2024-09-12T18:03:49.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.801+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39__shadow_.16qiMe24rl-sKm9TIQIZJqBCX-2GyBW_0 2024-09-12T18:03:49.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.805+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.809+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:03:49.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.809+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.809+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.809+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:03:49.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.809+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15048431275124179164', time=2024-09-12T19:53:46.544603+0000, chain.objs.size()=1 2024-09-12T18:03:49.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.809+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.8__shadow_.jfdh2srSO8cLfefphV4Q9xKEhKa69Zj_0 2024-09-12T18:03:49.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.809+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17011438100296786084', time=2024-09-12T19:55:28.629617+0000, chain.objs.size()=1 2024-09-12T18:03:49.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.809+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19__shadow_.huPASCYN_YtwpvzBJkLVIyH30IpwufX_0 2024-09-12T18:03:49.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.809+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14617210897047377687', time=2024-09-12T19:56:11.896790+0000, chain.objs.size()=1 2024-09-12T18:03:49.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.809+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22__shadow_.0Jz7YIYjVan698eL19-aIKW31VtU9NJ_0 2024-09-12T18:03:49.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.809+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8810805573569162700', time=2024-09-12T19:56:55.149752+0000, chain.objs.size()=1 2024-09-12T18:03:49.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.809+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25__shadow_.4PAP67hCnoxiJhvtHY4VTmO79dxKho5_0 2024-09-12T18:03:49.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.809+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1961073303812143457', time=2024-09-12T19:56:59.058452+0000, chain.objs.size()=1 2024-09-12T18:03:49.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.809+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26__shadow_.7PcIEhGMqZLWJlg-MJRJisy0hBfBqj5_0 2024-09-12T18:03:49.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.809+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11453237432453293463', time=2024-09-12T19:57:34.241731+0000, chain.objs.size()=1 2024-09-12T18:03:49.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.809+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27__shadow_.SOXHc7TTYiAxF-Z_zB3njjN37YCykyq_0 2024-09-12T18:03:49.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.809+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.117420692618755847', time=2024-09-12T19:58:17.973662+0000, chain.objs.size()=1 2024-09-12T18:03:49.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.809+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30__shadow_.iPymMGPtIA8qm3u81BiVRWpMVVOceo2_0 2024-09-12T18:03:49.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.809+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11920203878997659510', time=2024-09-12T19:58:22.407424+0000, chain.objs.size()=1 2024-09-12T18:03:49.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.809+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31__shadow_.QypQ_GujGq0HhzxRwhPfVAxfCyUA3ZF_0 2024-09-12T18:03:49.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.813+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12521272724370677456', time=2024-09-12T19:58:22.538261+0000, chain.objs.size()=1 2024-09-12T18:03:49.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.813+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31__shadow_.zWiXSfkMoNrhCVlNidaFj9sPOSxJPxN_0 2024-09-12T18:03:49.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.813+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6104385747498324788', time=2024-09-12T19:59:37.273831+0000, chain.objs.size()=1 2024-09-12T18:03:49.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.813+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34__shadow_.xpjmsCg0c6FViZ9P009UVARjzaXeHOq_0 2024-09-12T18:03:49.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.813+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3278507798491298289', time=2024-09-12T19:59:42.289061+0000, chain.objs.size()=1 2024-09-12T18:03:49.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.813+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35__shadow_.66orwpNW4g1grFUiTKSGE_vvmMhR0En_0 2024-09-12T18:03:49.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.813+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16000054905428222473', time=2024-09-12T20:00:17.896668+0000, chain.objs.size()=1 2024-09-12T18:03:49.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.813+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36__shadow_.L3ouKMK8O80jB_KtQ-Ropn6lsmcCjG-_0 2024-09-12T18:03:49.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.813+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9055228483053417234', time=2024-09-12T20:00:26.927275+0000, chain.objs.size()=1 2024-09-12T18:03:49.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.813+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38__shadow_.w2Ln1ZcxrkxZ8S-PnQL6iNW-4eE8WBf_0 2024-09-12T18:03:49.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.817+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17123873679853648349', time=2024-09-12T20:00:27.058248+0000, chain.objs.size()=1 2024-09-12T18:03:49.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.817+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38__shadow_.qwEZfDrNcbenfF0CPAEJY5nxG0it6E5_0 2024-09-12T18:03:49.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.817+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12906742072036316730', time=2024-09-12T20:01:01.731198+0000, chain.objs.size()=1 2024-09-12T18:03:49.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.817+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39__shadow_.-sxLk_g7MVx4RIKidsM_CWL3lv9TTMj_0 2024-09-12T18:03:49.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.817+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6380288692177485513', time=2024-09-12T20:01:01.733189+0000, chain.objs.size()=1 2024-09-12T18:03:49.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.817+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39__shadow_.a4OGSNmUKh0IrPeXEN8qskTqrylQqOu_0 2024-09-12T18:03:49.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.817+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4443809480537304026', time=2024-09-12T20:03:10.880240+0000, chain.objs.size()=1 2024-09-12T18:03:49.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.817+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17__shadow_.82zsZL6Ypn43Zw4OVeO7_GEiSfcJPPf_0 2024-09-12T18:03:49.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.821+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.821+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:03:49.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:03:49.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.689766352208573506', time=2024-09-12T19:53:46.096080+0000, chain.objs.size()=3 2024-09-12T18:03:49.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-STANDARD.2~cp5buN3zOGyebj-cIPtL0Oq7WywKLVH.1 2024-09-12T18:03:49.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-STANDARD.2~cp5buN3zOGyebj-cIPtL0Oq7WywKLVH.2 2024-09-12T18:03:49.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-STANDARD.2~cp5buN3zOGyebj-cIPtL0Oq7WywKLVH.3 2024-09-12T18:03:49.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2191798065973513794', time=2024-09-12T19:55:28.478853+0000, chain.objs.size()=1 2024-09-12T18:03:49.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19__shadow_.Rf69eo6Z50K5ujf_ECL2DSshq6x4Y0V_0 2024-09-12T18:03:49.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14250873983108766125', time=2024-09-12T19:55:32.534721+0000, chain.objs.size()=1 2024-09-12T18:03:49.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20__shadow_.w-AQUDh8VR4VGCRQ29o5Z0wBVrx8Hbl_0 2024-09-12T18:03:49.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12609409179532849530', time=2024-09-12T19:56:07.423651+0000, chain.objs.size()=1 2024-09-12T18:03:49.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21__shadow_.TQFZMEZJUhbENsPR8ZSSXadDVIXnLMQ_0 2024-09-12T18:03:49.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11314970703825936812', time=2024-09-12T19:56:50.451639+0000, chain.objs.size()=1 2024-09-12T18:03:49.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24__shadow_.8I_n7TpliysVmvQX7x-032IPbyXBJlX_0 2024-09-12T18:03:49.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10790028758783504197', time=2024-09-12T19:56:54.964587+0000, chain.objs.size()=1 2024-09-12T18:03:49.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25__shadow_.0wwT44-0bi8I7lnGO8z0RzIiTexSVaV_0 2024-09-12T18:03:49.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17295279875258574164', time=2024-09-12T19:57:38.368313+0000, chain.objs.size()=1 2024-09-12T18:03:49.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28__shadow_.D-QWczLR2-ZjZ53nsaP2nfDS0Ktjikb_0 2024-09-12T18:03:49.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4850885609804568414', time=2024-09-12T19:58:22.370876+0000, chain.objs.size()=1 2024-09-12T18:03:49.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31__shadow_.x1ur5GZz8NvW8I2AiOd7KNW3irJO7TN_0 2024-09-12T18:03:49.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8776498553745239272', time=2024-09-12T19:58:22.374983+0000, chain.objs.size()=1 2024-09-12T18:03:49.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31__shadow_.4o-REJu8QYlvl7ahZABN0ViLQEkytNI_0 2024-09-12T18:03:49.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.562385548193197737', time=2024-09-12T19:58:56.986265+0000, chain.objs.size()=1 2024-09-12T18:03:49.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.825+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32__shadow_.Jfk5sduMpMhd3fb-fU0ReDb0bXHJ487_0 2024-09-12T18:03:49.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.829+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15875600732210366788', time=2024-09-12T19:59:01.535383+0000, chain.objs.size()=1 2024-09-12T18:03:49.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.829+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33__shadow_.rZA5-pti4Ld7z_iWyyj8sfgwk2bLuY9_0 2024-09-12T18:03:49.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.829+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7989814518236634868', time=2024-09-12T19:59:01.600178+0000, chain.objs.size()=1 2024-09-12T18:03:49.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.829+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33__shadow_.xPtHLiFp-M_H5NvnaN3j1OH43majWBN_0 2024-09-12T18:03:49.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.829+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5807223177550785924', time=2024-09-12T19:59:01.647783+0000, chain.objs.size()=1 2024-09-12T18:03:49.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.829+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33__shadow_.1IZbXJ2vQsteWuC9LwKZuEg4hylN80q_0 2024-09-12T18:03:49.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.829+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14831877112532836671', time=2024-09-12T20:00:17.760346+0000, chain.objs.size()=1 2024-09-12T18:03:49.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.829+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36__shadow_.6qpq9z37EBxWfoIdPph-MDpHgYo2ILi_0 2024-09-12T18:03:49.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.829+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9031524974351867952', time=2024-09-12T20:00:22.773591+0000, chain.objs.size()=1 2024-09-12T18:03:49.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.829+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37__shadow_.nRccohRvtw-UwKmFitxgwOKOVJHK-Fj_0 2024-09-12T18:03:49.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.829+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11945430577558098927', time=2024-09-12T20:00:27.164768+0000, chain.objs.size()=1 2024-09-12T18:03:49.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.829+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38__shadow_.cKVuFcoZGOqm2YGhO2f5xDyjaTYCPxm_0 2024-09-12T18:03:49.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.829+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2448844096938799413', time=2024-09-12T20:03:10.850014+0000, chain.objs.size()=1 2024-09-12T18:03:49.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.829+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17__shadow_.QWMyyKjmnZSOmjh2cMfP3PKQgd5TWjD_0 2024-09-12T18:03:49.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.829+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14905575797593572753', time=2024-09-12T20:03:10.851424+0000, chain.objs.size()=1 2024-09-12T18:03:49.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.829+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17__shadow_.DJXRB9wjeVckispf2WY8_VnrqBkNT6S_0 2024-09-12T18:03:49.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.837+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.837+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:03:49.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T18:03:49.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2998966436136903859', time=2024-09-12T19:53:45.566039+0000, chain.objs.size()=1 2024-09-12T18:03:49.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.4__shadow_.6_HbPiSmOGOm9v1E7oFyhdav6wRS2S7_0 2024-09-12T18:03:49.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7555747374904160377', time=2024-09-12T19:56:07.601240+0000, chain.objs.size()=1 2024-09-12T18:03:49.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21__shadow_.VCs20rRDyV89GjGYxNp0KY_CJEbEbiM_0 2024-09-12T18:03:49.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5946547986093887452', time=2024-09-12T19:58:17.919421+0000, chain.objs.size()=1 2024-09-12T18:03:49.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30__shadow_.EBl-ANOyQ1CtXCnSN52IEPbkkw8Ctom_0 2024-09-12T18:03:49.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15138919410787539214', time=2024-09-12T19:59:37.377036+0000, chain.objs.size()=1 2024-09-12T18:03:49.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34__shadow_.5JHpSX8SRn-qGAoUIIsN-pro1HGmqCW_0 2024-09-12T18:03:49.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13033363487678971292', time=2024-09-12T19:59:42.155460+0000, chain.objs.size()=1 2024-09-12T18:03:49.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35__shadow_.tt4kUYjuAJVsslIK8M0OjTnGQ3aR_X4_0 2024-09-12T18:03:49.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10277500317702868531', time=2024-09-12T20:00:22.658498+0000, chain.objs.size()=1 2024-09-12T18:03:49.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37__shadow_.AX7u7NqOg8yBjgUOixghQYX6ErVjPzS_0 2024-09-12T18:03:49.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3425146963512765237', time=2024-09-12T20:00:22.669934+0000, chain.objs.size()=1 2024-09-12T18:03:49.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37__shadow_.JXB3uT36-ovrnA7Dxjc7VERXSsIs9bH_0 2024-09-12T18:03:49.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17097493290362278783', time=2024-09-12T20:00:30.554693+0000, chain.objs.size()=1 2024-09-12T18:03:49.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39__shadow_.G3wgpT0WJkpX36UJAC0juIMwIpdgkeh_0 2024-09-12T18:03:49.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16870563966814247799', time=2024-09-12T20:01:01.784024+0000, chain.objs.size()=1 2024-09-12T18:03:49.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39__shadow_.7VLxNjILUqkKRr6Mh10KKwKqNNt8yeO_0 2024-09-12T18:03:49.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2287777678125614814', time=2024-09-12T20:03:25.370400+0000, chain.objs.size()=1 2024-09-12T18:03:49.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.841+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18__shadow:zD54wzhsJ8I1cBPDzUY5V5p8rzW26tF_.bn5l4oaZMqlnigec-EDLURcQAnytWo3_0 2024-09-12T18:03:49.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.845+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.849+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:03:49.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.849+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.849+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.853+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:03:49.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.853+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3003820382018611848', time=2024-09-12T19:53:46.224591+0000, chain.objs.size()=3 2024-09-12T18:03:49.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.853+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.14__multipart_foo-STANDARD.2~gCgIYF4mq-2lNGbjYIN_3THBa2zg-5F.1 2024-09-12T18:03:49.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.853+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.14__multipart_foo-STANDARD.2~gCgIYF4mq-2lNGbjYIN_3THBa2zg-5F.2 2024-09-12T18:03:49.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.853+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.14__multipart_foo-STANDARD.2~gCgIYF4mq-2lNGbjYIN_3THBa2zg-5F.3 2024-09-12T18:03:49.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.853+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.747800769529085388', time=2024-09-12T19:55:32.697509+0000, chain.objs.size()=1 2024-09-12T18:03:49.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.853+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20__shadow_.DpGQUhMTOB-_45vUd-l82uG4c1pRRRJ_0 2024-09-12T18:03:49.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.853+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2693575546403155075', time=2024-09-12T19:56:12.077493+0000, chain.objs.size()=1 2024-09-12T18:03:49.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.853+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22__shadow_.gdWvDMPwrbxQuz4oqoAB-iyV9D2X9Qe_0 2024-09-12T18:03:49.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.853+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6136856987297385789', time=2024-09-12T19:56:59.061266+0000, chain.objs.size()=1 2024-09-12T18:03:49.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.853+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26__shadow_.UpWFnrTeregta_qfp87fK2kxFc-as-__0 2024-09-12T18:03:49.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.853+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15944421977734439061', time=2024-09-12T19:58:13.412286+0000, chain.objs.size()=1 2024-09-12T18:03:49.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.853+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29__shadow_.lOnuf1jk6BESdKYZt0wZdwyiOGkrXFR_0 2024-09-12T18:03:49.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.853+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4253685892375434062', time=2024-09-12T19:58:18.049930+0000, chain.objs.size()=1 2024-09-12T18:03:49.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.853+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30__shadow_.ZgRxur--B8ZCnZhRVupp-YP0w6jMIC9_0 2024-09-12T18:03:49.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.853+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12208611012287763274', time=2024-09-12T19:59:37.257446+0000, chain.objs.size()=1 2024-09-12T18:03:49.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.853+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34__shadow_.tgUYCOY4BtF537pDfkexl7M9GFnnVpm_0 2024-09-12T18:03:49.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.857+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.857+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:03:49.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T18:03:49.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2931709165800341903', time=2024-09-12T19:53:45.903338+0000, chain.objs.size()=1 2024-09-12T18:03:49.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.MmXhR-EalpuTrU-3MVchLufQEb3qzXj_0 2024-09-12T18:03:49.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.722690577163222127', time=2024-09-12T19:55:28.509810+0000, chain.objs.size()=1 2024-09-12T18:03:49.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19__shadow_.4NR76jn2K-ifvShwyWhZeg1bsNuk61d_0 2024-09-12T18:03:49.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10897900075237298614', time=2024-09-12T19:55:28.560424+0000, chain.objs.size()=1 2024-09-12T18:03:49.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19__shadow_.G_mwRZEmRDuimaWR3QohaB9ek-eXax0_0 2024-09-12T18:03:49.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13079096796916378533', time=2024-09-12T19:56:12.008672+0000, chain.objs.size()=1 2024-09-12T18:03:49.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22__shadow_.G2zKu2u7ZTnmL2jt2s39MsmowxtaPba_0 2024-09-12T18:03:49.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3114795227472258577', time=2024-09-12T19:56:55.039711+0000, chain.objs.size()=1 2024-09-12T18:03:49.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25__shadow_.aiTDbXsUvrBYjOcm68I7TFi-cvj3itY_0 2024-09-12T18:03:49.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9975845988562556005', time=2024-09-12T19:56:59.143591+0000, chain.objs.size()=1 2024-09-12T18:03:49.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26__shadow_.6CpWBk6U2vPEnUY7-dg0QbUf122LR4d_0 2024-09-12T18:03:49.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1017877221206335784', time=2024-09-12T19:57:37.637762+0000, chain.objs.size()=1 2024-09-12T18:03:49.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28__shadow_.3DkOsLU9fzR2aVHEbjsLLff7Wl0tBeG_0 2024-09-12T18:03:49.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17114495010647213148', time=2024-09-12T19:58:13.297503+0000, chain.objs.size()=1 2024-09-12T18:03:49.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29__shadow_.8RLA5Qx7Lixnx0RCtQq0XANzAu13V3A_0 2024-09-12T18:03:49.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8844797782711662240', time=2024-09-12T19:59:37.214562+0000, chain.objs.size()=1 2024-09-12T18:03:49.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34__shadow_.AbE7XbXiwjuFktjACU0oWSzMyYjgZoc_0 2024-09-12T18:03:49.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16587083480886187886', time=2024-09-12T19:59:42.135757+0000, chain.objs.size()=1 2024-09-12T18:03:49.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35__shadow_.enzS3F6T3tIkekMtPpvGXOjgplnAHI__0 2024-09-12T18:03:49.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15579180793689531178', time=2024-09-12T20:00:27.071234+0000, chain.objs.size()=1 2024-09-12T18:03:49.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38__shadow_.-klria3_y8k-s-D1as54g8WmdeLe6yh_0 2024-09-12T18:03:49.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16209596179802292139', time=2024-09-12T20:00:27.162238+0000, chain.objs.size()=1 2024-09-12T18:03:49.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.861+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38__shadow_.XqEd7wNKM6IeepOMUYcbL3AC3JlHOKp_0 2024-09-12T18:03:49.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.865+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5943713657013337761', time=2024-09-12T20:01:01.721677+0000, chain.objs.size()=1 2024-09-12T18:03:49.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.865+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39__shadow_.3C30O6xMCz0wPXHwAa8bP0wdK60fGZi_0 2024-09-12T18:03:49.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.869+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.869+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:03:49.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:03:49.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_zJGQAWYJE2LVUPjxiZAmzpsQ7BnUAO_', time=2024-09-12T19:53:46.074711+0000, chain.objs.size()=2 2024-09-12T18:03:49.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__shadow_.h5PtwKe3uXL216I_-svneEzbAIV3_Gn_0 2024-09-12T18:03:49.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__shadow_.h5PtwKe3uXL216I_-svneEzbAIV3_Gn_1 2024-09-12T18:03:49.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11044869304635923915', time=2024-09-12T19:56:07.519004+0000, chain.objs.size()=1 2024-09-12T18:03:49.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21__shadow_.ytQOLnu3u23xIpHoD9VSzLW1_N-YH9N_0 2024-09-12T18:03:49.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2987709653229176242', time=2024-09-12T19:56:07.521069+0000, chain.objs.size()=1 2024-09-12T18:03:49.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21__shadow_.t0SDbgyxKxn6nTGZX2M_HTVfmcYk_VD_0 2024-09-12T18:03:49.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9683221681930100518', time=2024-09-12T19:56:12.014264+0000, chain.objs.size()=1 2024-09-12T18:03:49.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22__shadow_.jrx0GVg9rndjCmII39JJGV4ezalYFdm_0 2024-09-12T18:03:49.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1178615705962828212', time=2024-09-12T19:56:50.351644+0000, chain.objs.size()=1 2024-09-12T18:03:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24__shadow_.-FbqKbJkUuezRQG_bnxVCz7nDF16o86_0 2024-09-12T18:03:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.32311064182773090', time=2024-09-12T19:56:50.467044+0000, chain.objs.size()=1 2024-09-12T18:03:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24__shadow_.MWlpAXIgbPd25j46B_PjFxdNret1FQK_0 2024-09-12T18:03:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12829752497151205898', time=2024-09-12T19:56:55.035894+0000, chain.objs.size()=1 2024-09-12T18:03:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25__shadow_.tLpS5xNMFRyvwG9nh8JzKRCT6-pdpPq_0 2024-09-12T18:03:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13634421423749687998', time=2024-09-12T19:56:55.208769+0000, chain.objs.size()=1 2024-09-12T18:03:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25__shadow_.vrD0fiCSGPXew-5NOba6tD30Z54UI8f_0 2024-09-12T18:03:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18408543779446886344', time=2024-09-12T19:57:34.122744+0000, chain.objs.size()=1 2024-09-12T18:03:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27__shadow_.DK5fny_uWcJg5t2Xu2nIj6u4NuSSpqi_0 2024-09-12T18:03:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17528538771707170228', time=2024-09-12T19:57:38.492341+0000, chain.objs.size()=1 2024-09-12T18:03:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28__shadow_.rvTUi3Rlx3HU7FO78hD0nKpqg_PAtX__0 2024-09-12T18:03:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11727616963933516941', time=2024-09-12T19:59:37.259836+0000, chain.objs.size()=1 2024-09-12T18:03:49.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.873+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34__shadow_.3sRAM9J4M7PiqxgQKDJ2I_-czfFRtCd_0 2024-09-12T18:03:49.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.877+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14946856064923873469', time=2024-09-12T19:59:42.156240+0000, chain.objs.size()=1 2024-09-12T18:03:49.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.877+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35__shadow_.pCTr_O8RUdrGiyZI4SgQ_54FCJ8g7B2_0 2024-09-12T18:03:49.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.877+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3066823314369982463', time=2024-09-12T20:01:01.717820+0000, chain.objs.size()=1 2024-09-12T18:03:49.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.877+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39__shadow_.oQ5Drs8EfYQAMgKS48Bcffx7u-8f8aJ_0 2024-09-12T18:03:49.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.877+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1577387032215232278', time=2024-09-12T20:01:01.719929+0000, chain.objs.size()=1 2024-09-12T18:03:49.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.877+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39__shadow_.QEWwUcKdvzD_HzzjYYN11TB8x1aDlZr_0 2024-09-12T18:03:49.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.877+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4768081368202525118', time=2024-09-12T20:03:10.891708+0000, chain.objs.size()=1 2024-09-12T18:03:49.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.877+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17__shadow_._ux4ga5j24xvkHcvMxts3lMErsfxdqN_0 2024-09-12T18:03:49.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.881+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.885+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:03:49.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.885+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.885+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.885+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T18:03:49.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.885+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13262867404422745717', time=2024-09-12T19:53:45.619718+0000, chain.objs.size()=1 2024-09-12T18:03:49.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.885+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.4__shadow_.TQO8ahdoTL0vmXZeVXB6ie-AZE5ezG3_0 2024-09-12T18:03:49.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.885+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15393283868674497938', time=2024-09-12T19:53:45.673806+0000, chain.objs.size()=4 2024-09-12T18:03:49.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.885+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.11__multipart_foo.2~m4nj-daoW1MiQBx9c0p_yE-7lU0Co0Y.1 2024-09-12T18:03:49.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.885+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.11__multipart_foo.2~m4nj-daoW1MiQBx9c0p_yE-7lU0Co0Y.2 2024-09-12T18:03:49.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.885+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.11__multipart_foo.2~m4nj-daoW1MiQBx9c0p_yE-7lU0Co0Y.3 2024-09-12T18:03:49.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.885+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.11__multipart_foo.2~m4nj-daoW1MiQBx9c0p_yE-7lU0Co0Y.4 2024-09-12T18:03:49.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.885+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7276173074187817833', time=2024-09-12T19:53:45.777955+0000, chain.objs.size()=4 2024-09-12T18:03:49.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.885+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.10__multipart_foo.2~YZYXZJvquHG64XE6FM_Ztf7lsdh3eHc.1 2024-09-12T18:03:49.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.885+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.10__multipart_foo.2~YZYXZJvquHG64XE6FM_Ztf7lsdh3eHc.2 2024-09-12T18:03:49.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.885+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.10__multipart_foo.2~YZYXZJvquHG64XE6FM_Ztf7lsdh3eHc.3 2024-09-12T18:03:49.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.885+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.10__multipart_foo.2~YZYXZJvquHG64XE6FM_Ztf7lsdh3eHc.4 2024-09-12T18:03:49.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.889+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4067176979123772629', time=2024-09-12T19:53:45.996711+0000, chain.objs.size()=1 2024-09-12T18:03:49.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.889+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.MmXhR-EalpuTrU-3MVchLufQEb3qzXj_0 2024-09-12T18:03:49.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.889+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16368420932414978693', time=2024-09-12T19:53:46.117861+0000, chain.objs.size()=3 2024-09-12T18:03:49.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.889+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-LUKEWARM.2~kLWd2_KpDEADPR16U-qahYGe1fQza51.1 2024-09-12T18:03:49.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.889+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-LUKEWARM.2~kLWd2_KpDEADPR16U-qahYGe1fQza51.2 2024-09-12T18:03:49.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.889+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-LUKEWARM.2~kLWd2_KpDEADPR16U-qahYGe1fQza51.3 2024-09-12T18:03:49.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.889+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15189259312509476998', time=2024-09-12T19:55:28.396562+0000, chain.objs.size()=1 2024-09-12T18:03:49.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.889+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19__shadow_.t_o3eQPq9CaL7s5Ivqjk76C_dd0Uaen_0 2024-09-12T18:03:49.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12739424324501588912', time=2024-09-12T19:56:50.296126+0000, chain.objs.size()=1 2024-09-12T18:03:49.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24__shadow_.i6KVmiVstxoXmI7283-ud4q0O9Qb7O__0 2024-09-12T18:03:49.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17862874325388372160', time=2024-09-12T19:56:50.392726+0000, chain.objs.size()=1 2024-09-12T18:03:49.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24__shadow_.qq0uoqgruXNfFcYg-ceYW2dRr-D3c7y_0 2024-09-12T18:03:49.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9281784635447713603', time=2024-09-12T19:56:59.147975+0000, chain.objs.size()=1 2024-09-12T18:03:49.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26__shadow_.Mm17az_gbA81AvlgRDQlwKFlaB5earh_0 2024-09-12T18:03:49.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6309629482620606918', time=2024-09-12T19:56:59.152506+0000, chain.objs.size()=1 2024-09-12T18:03:49.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26__shadow_.XEe_yAQLms2NBHg4Ttxv0Zaw1VPyDR4_0 2024-09-12T18:03:49.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16927510806152775590', time=2024-09-12T19:57:34.146326+0000, chain.objs.size()=1 2024-09-12T18:03:49.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27__shadow_.9xJ_ABFVRNpQAlDin5DfkuXHWPM0GjJ_0 2024-09-12T18:03:49.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4294929418120484401', time=2024-09-12T19:57:38.404611+0000, chain.objs.size()=1 2024-09-12T18:03:49.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28__shadow_.vnvh-yfj2HU1Vxqq_fOf_tiz1_3F7a9_0 2024-09-12T18:03:49.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11804360869061805479', time=2024-09-12T19:58:13.391864+0000, chain.objs.size()=1 2024-09-12T18:03:49.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29__shadow_.ocVWItCDwSUPl8K5umMikOY-BDkiniN_0 2024-09-12T18:03:49.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1185958312809652847', time=2024-09-12T19:58:13.458279+0000, chain.objs.size()=1 2024-09-12T18:03:49.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29__shadow_.EuvjK3gsdlrHgQYDmzWU7f4JzM4OXv4_0 2024-09-12T18:03:49.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3986062092375687602', time=2024-09-12T19:58:22.284146+0000, chain.objs.size()=1 2024-09-12T18:03:49.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31__shadow_.gdmzWo-2sLFdXvVlOou3HgJa0QTGaWY_0 2024-09-12T18:03:49.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2126973421872748355', time=2024-09-12T19:58:57.118301+0000, chain.objs.size()=1 2024-09-12T18:03:49.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32__shadow_.lQegNCQGQTwzJGLRLVr_YR98ExLVKcG_0 2024-09-12T18:03:49.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2945049309765174217', time=2024-09-12T19:58:57.139538+0000, chain.objs.size()=1 2024-09-12T18:03:49.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.893+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32__shadow_.XkSQVkPNDTR7ek19i1H5hoIKHEhDNpZ_0 2024-09-12T18:03:49.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.897+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10825750989996040467', time=2024-09-12T19:59:37.147589+0000, chain.objs.size()=1 2024-09-12T18:03:49.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.897+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34__shadow_.9hBzjPkFTIz4j08u2d1fV4vkzo5oJjw_0 2024-09-12T18:03:49.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.897+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8847401661371083242', time=2024-09-12T20:00:26.964414+0000, chain.objs.size()=1 2024-09-12T18:03:49.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.897+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38__shadow_.kcgbaa_FyZvV0KI95PpUmjVd0xmuC8B_0 2024-09-12T18:03:49.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.897+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14793909555779030444', time=2024-09-12T20:00:26.966088+0000, chain.objs.size()=1 2024-09-12T18:03:49.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.897+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38__shadow_.j7yBbEmAGO09q-aIa0HCOy1XwbwpX4e_0 2024-09-12T18:03:49.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.897+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14884327320000046137', time=2024-09-12T20:01:01.905224+0000, chain.objs.size()=1 2024-09-12T18:03:49.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.897+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39__shadow_.oj--56j0TouBDpSDrP1zxt_jpx-jQeW_0 2024-09-12T18:03:49.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.901+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2525303679449595304', time=2024-09-12T20:03:10.884226+0000, chain.objs.size()=1 2024-09-12T18:03:49.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.901+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17__shadow_.1xdY0BwnpIXPtkmK66VUiKodUM5ylUt_0 2024-09-12T18:03:49.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.905+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.905+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:03:49.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:03:49.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11415282150812076584', time=2024-09-12T19:53:45.576904+0000, chain.objs.size()=1 2024-09-12T18:03:49.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.4__shadow_.TLo-TIq3IqzbWehESA2ErrsAEG-Ezlu_0 2024-09-12T18:03:49.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7530054836250421682', time=2024-09-12T19:53:45.935556+0000, chain.objs.size()=1 2024-09-12T18:03:49.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.GwVpewUfzUPb5YtrfUmhPiEKbsuXFZE_0 2024-09-12T18:03:49.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_nz2UFoTNN_pDu0PRO-qVCG_g9BysldH', time=2024-09-12T19:53:46.055543+0000, chain.objs.size()=2 2024-09-12T18:03:49.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__shadow_.5qHV4TouE5F93MDxP9LsymmZqMqrfNI_0 2024-09-12T18:03:49.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__shadow_.5qHV4TouE5F93MDxP9LsymmZqMqrfNI_1 2024-09-12T18:03:49.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12872915347131241723', time=2024-09-12T19:53:46.287414+0000, chain.objs.size()=2 2024-09-12T18:03:49.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.13__shadow_.gxZH-HJc8vgLuRpA_z4oULcibBgwtqF_0 2024-09-12T18:03:49.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.13__shadow_.gxZH-HJc8vgLuRpA_z4oULcibBgwtqF_1 2024-09-12T18:03:49.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7513351968571044962', time=2024-09-12T19:55:28.397762+0000, chain.objs.size()=1 2024-09-12T18:03:49.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19__shadow_.lGsr3X0FnJLUzk1Ty6ToKsjmSuEGAr6_0 2024-09-12T18:03:49.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5279314707594901038', time=2024-09-12T19:56:07.519418+0000, chain.objs.size()=1 2024-09-12T18:03:49.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21__shadow_.fqScDTISu9ZZlUnpkMvNTzQN5MdFtIr_0 2024-09-12T18:03:49.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16630550906560488601', time=2024-09-12T19:56:07.521389+0000, chain.objs.size()=1 2024-09-12T18:03:49.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21__shadow_.e5sZxjks86u-vB-tIrkea4qxMBpcqvw_0 2024-09-12T18:03:49.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6606965441754721002', time=2024-09-12T19:56:15.927123+0000, chain.objs.size()=1 2024-09-12T18:03:49.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23__shadow_.Q1DYWymSc8asduRyU9nIAQaSGY7Xpw5_0 2024-09-12T18:03:49.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8940018219093570094', time=2024-09-12T19:56:59.121739+0000, chain.objs.size()=1 2024-09-12T18:03:49.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26__shadow_.w_4jUpNGZYKnr3Qgki23BdQpxeMAPAG_0 2024-09-12T18:03:49.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18435085963769902189', time=2024-09-12T19:56:59.124159+0000, chain.objs.size()=1 2024-09-12T18:03:49.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.909+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26__shadow_.EV03fnGfDAVSnDmMyTx8CTQPcIY59KR_0 2024-09-12T18:03:49.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.913+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5692559173281202006', time=2024-09-12T19:56:59.142440+0000, chain.objs.size()=1 2024-09-12T18:03:49.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.913+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26__shadow_.nL6Y8vHjmw2nGpfMLaOaOty2sQ4TwOy_0 2024-09-12T18:03:49.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.913+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16161070482168182297', time=2024-09-12T19:58:13.412230+0000, chain.objs.size()=1 2024-09-12T18:03:49.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.913+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29__shadow_._YhwSx0QkOX_IWgi1wYe4t_4adG5A-p_0 2024-09-12T18:03:49.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.913+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1915957594230031292', time=2024-09-12T19:58:56.980631+0000, chain.objs.size()=1 2024-09-12T18:03:49.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.913+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32__shadow_.Ofzh7hCyyg5T4_RHkL7m_c3mVl57W8N_0 2024-09-12T18:03:49.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.917+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10367914240045590613', time=2024-09-12T19:59:37.257815+0000, chain.objs.size()=1 2024-09-12T18:03:49.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.917+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34__shadow_.gjne2TQnxZ7cZJN1U7em4ia62s4Zi6G_0 2024-09-12T18:03:49.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.917+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5251100107901500188', time=2024-09-12T19:59:42.156514+0000, chain.objs.size()=1 2024-09-12T18:03:49.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.917+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35__shadow_.QmFnUwWihCTMrb7b3boxnA7rX8z0nMm_0 2024-09-12T18:03:49.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.917+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7604426376153125336', time=2024-09-12T20:00:26.937671+0000, chain.objs.size()=1 2024-09-12T18:03:49.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.917+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38__shadow_.AydgRkfgNQCoi9UCvmJEvDQh3OGuuun_0 2024-09-12T18:03:49.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.917+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8123453233062459107', time=2024-09-12T20:00:26.939480+0000, chain.objs.size()=1 2024-09-12T18:03:49.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.917+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38__shadow_.MT3f2RDgiVocoxWQyZsZO23iD_ksxvW_0 2024-09-12T18:03:49.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.917+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10771978441944808597', time=2024-09-12T20:03:10.891740+0000, chain.objs.size()=1 2024-09-12T18:03:49.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.917+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17__shadow_.PpITLrB_EZc2URLq6P0n-Ls80_onCS0_0 2024-09-12T18:03:49.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.921+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:03:49.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T18:03:49.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2779729993939602240', time=2024-09-12T19:53:45.627194+0000, chain.objs.size()=1 2024-09-12T18:03:49.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.4__shadow_.XAPodn2gUNalOij2wJ4XAd5doc5FVhO_0 2024-09-12T18:03:49.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_PUv19cHqlOc0f85RObEaPz9-OzSnpzL', time=2024-09-12T19:53:45.913671+0000, chain.objs.size()=1 2024-09-12T18:03:49.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.RT3pBBv9tU-YCzCu7KyvJ1IactVwrPZ_0 2024-09-12T18:03:49.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4273025409571144564', time=2024-09-12T19:55:28.402434+0000, chain.objs.size()=1 2024-09-12T18:03:49.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19__shadow_.B5Pcr8aFKDLJaQEQTYq3MhVldPvi0dy_0 2024-09-12T18:03:49.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8073722057523978215', time=2024-09-12T19:55:28.519858+0000, chain.objs.size()=1 2024-09-12T18:03:49.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19__shadow_.8jdMVAzF922uBcLqwo2uCzfN8foI0oI_0 2024-09-12T18:03:49.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12614423118493306925', time=2024-09-12T19:56:12.106455+0000, chain.objs.size()=1 2024-09-12T18:03:49.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22__shadow_.uwz_Y-uCZUV7n7d1W_7aJf7x3mLhVK7_0 2024-09-12T18:03:49.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9090439312803043378', time=2024-09-12T19:57:34.078439+0000, chain.objs.size()=1 2024-09-12T18:03:49.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27__shadow_.qu2k-Yq86glDpJH9VYkpp376tjWJz7t_0 2024-09-12T18:03:49.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6359506963069949794', time=2024-09-12T19:57:38.371973+0000, chain.objs.size()=1 2024-09-12T18:03:49.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28__shadow_.tlkMPMj5xf1X4-thE1IGlZa2z4srwrj_0 2024-09-12T18:03:49.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1233400658742686908', time=2024-09-12T19:58:22.398893+0000, chain.objs.size()=1 2024-09-12T18:03:49.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31__shadow_.pk2viqnK66Dk1E_MED0zUX0BM7dZXPO_0 2024-09-12T18:03:49.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13314788289535764772', time=2024-09-12T19:58:56.932913+0000, chain.objs.size()=1 2024-09-12T18:03:49.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32__shadow_.Sg88UVrR2OjqmD8CQRrCDsKLr_4_Wx3_0 2024-09-12T18:03:49.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12782574083318863249', time=2024-09-12T19:59:01.720719+0000, chain.objs.size()=1 2024-09-12T18:03:49.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33__shadow_.-6WlSNYUSc4mAySGm0kyXI9ZKeSMhne_0 2024-09-12T18:03:49.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.36711451526272508', time=2024-09-12T19:59:42.104216+0000, chain.objs.size()=1 2024-09-12T18:03:49.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35__shadow_.vzSO4pvwmCOenSKS_kyHJNwRwvexCgU_0 2024-09-12T18:03:49.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7837332229969732753', time=2024-09-12T20:00:22.682257+0000, chain.objs.size()=1 2024-09-12T18:03:49.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.925+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37__shadow_.n85xVwUhsVUtGxIn-y5Yuz0KXMqVASI_0 2024-09-12T18:03:49.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.933+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8005803498782871739', time=2024-09-12T20:00:22.740740+0000, chain.objs.size()=1 2024-09-12T18:03:49.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.933+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37__shadow_.kQYdp02mvJTkjYKxrNq2On8j1MSQ0P1_0 2024-09-12T18:03:49.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.933+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5575694389072244710', time=2024-09-12T20:00:22.833158+0000, chain.objs.size()=1 2024-09-12T18:03:49.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.933+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37__shadow_.z7XkSs7b8wNHcnAqZ2HbqO2d6mMNgzV_0 2024-09-12T18:03:49.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.933+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.937+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:03:49.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.937+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.937+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T18:03:49.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8357067074828445176', time=2024-09-12T19:55:32.586331+0000, chain.objs.size()=1 2024-09-12T18:03:49.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20__shadow_.2KXTdMq0Pv91M6tKqpEBN-K_KDeb6Qe_0 2024-09-12T18:03:49.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9802912501572874825', time=2024-09-12T19:56:12.122332+0000, chain.objs.size()=1 2024-09-12T18:03:49.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22__shadow_.zxx4r7Lf3cVWL5hfTTRovQbgPfg-Mbx_0 2024-09-12T18:03:49.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15342833149486683995', time=2024-09-12T19:56:15.854705+0000, chain.objs.size()=1 2024-09-12T18:03:49.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23__shadow_.DMt_YXOfzdlCr63HQEHDPe7eC80O6Nh_0 2024-09-12T18:03:49.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17554774209212963200', time=2024-09-12T19:56:55.149534+0000, chain.objs.size()=1 2024-09-12T18:03:49.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25__shadow_.W0Ibs1hvr60Ol3JYOI5wJOuh1YIc04x_0 2024-09-12T18:03:49.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6601648728852878784', time=2024-09-12T19:57:34.026705+0000, chain.objs.size()=1 2024-09-12T18:03:49.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27__shadow_.uJ9CtOrLpZXI0CvBGNVEoRl8EnCuPww_0 2024-09-12T18:03:49.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10926960336986636299', time=2024-09-12T19:57:34.028241+0000, chain.objs.size()=1 2024-09-12T18:03:49.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27__shadow_._DrmqRYcu7VPLu7Y5iTLgj_AKB20e1G_0 2024-09-12T18:03:49.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15275936867533803592', time=2024-09-12T19:58:13.576805+0000, chain.objs.size()=1 2024-09-12T18:03:49.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29__shadow_.3sXwr9OefKn71DC61NDEtpncNWDXSux_0 2024-09-12T18:03:49.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8380471780316947232', time=2024-09-12T19:58:56.927119+0000, chain.objs.size()=1 2024-09-12T18:03:49.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32__shadow_.kfSXML_vXX6FzFSXeYeGFrv897nPAxu_0 2024-09-12T18:03:49.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13830824945339151947', time=2024-09-12T20:00:17.820241+0000, chain.objs.size()=1 2024-09-12T18:03:49.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36__shadow_.57k0meBg53WPTKMW0BF7RM7UX4mSqS1_0 2024-09-12T18:03:49.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.834315503216549169', time=2024-09-12T20:00:26.928903+0000, chain.objs.size()=1 2024-09-12T18:03:49.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38__shadow_.ct47dTHn0U9Rr7uLkUKcGl5Uz-YKwtI_0 2024-09-12T18:03:49.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4516228014807917342', time=2024-09-12T20:01:01.731254+0000, chain.objs.size()=1 2024-09-12T18:03:49.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39__shadow_.OhvOt1ExN5mVzR0MXikcgnFlFSj5Jn2_0 2024-09-12T18:03:49.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2491657076145015672', time=2024-09-12T20:01:01.821164+0000, chain.objs.size()=1 2024-09-12T18:03:49.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.941+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39__shadow_.AmiCBAZQtZfs8nSBtu9uIQqZ7HSA6E8_0 2024-09-12T18:03:49.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.945+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6412838717325682531', time=2024-09-12T20:01:01.823709+0000, chain.objs.size()=1 2024-09-12T18:03:49.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.945+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39__shadow_.vgM5zj_2pd9uqNaDzXqRWSFU6kIwBPt_0 2024-09-12T18:03:49.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.945+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.949+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:03:49.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.949+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.949+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.953+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T18:03:49.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.953+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_kH7BwyBWRCSVJC3QW1902CL0-fR0jZt', time=2024-09-12T19:53:45.892518+0000, chain.objs.size()=1 2024-09-12T18:03:49.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.953+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.-e2o6uHm-TtHTQ6lPqEH4MNmtX3RWaX_0 2024-09-12T18:03:49.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.953+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8340893922495841766', time=2024-09-12T19:56:59.159333+0000, chain.objs.size()=1 2024-09-12T18:03:49.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.953+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26__shadow_.blo2gKhVsWKvXFqJGFEipxHxLi41aoJ_0 2024-09-12T18:03:49.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.953+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18265913729333849055', time=2024-09-12T19:57:34.037819+0000, chain.objs.size()=1 2024-09-12T18:03:49.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.953+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27__shadow_.Ssrb0r6cf5djJZgPh8g5GQFA0aBDjby_0 2024-09-12T18:03:49.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.953+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10635664596542033269', time=2024-09-12T19:57:34.052167+0000, chain.objs.size()=1 2024-09-12T18:03:49.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.953+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27__shadow_.QNwzcqMVcVVv71QHoMxRwM3l_HGZSyU_0 2024-09-12T18:03:49.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.953+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3682052262330864407', time=2024-09-12T19:58:22.321337+0000, chain.objs.size()=1 2024-09-12T18:03:49.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.953+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31__shadow_.g52ANb6TfNVtqRcurSOuJvcO9hAcp4F_0 2024-09-12T18:03:49.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.953+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5372364336701258035', time=2024-09-12T19:59:01.609990+0000, chain.objs.size()=1 2024-09-12T18:03:49.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.953+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33__shadow_.b2_VRk0oYFUs1kCK-ez0TChPouxW2Fp_0 2024-09-12T18:03:49.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.953+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11111245343866545997', time=2024-09-12T19:59:01.644221+0000, chain.objs.size()=1 2024-09-12T18:03:49.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.953+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33__shadow_.QRdC6mMiKtFqGGjCTNZU42YisT7Tnt7_0 2024-09-12T18:03:49.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.953+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1813738496821385348', time=2024-09-12T19:59:42.155416+0000, chain.objs.size()=1 2024-09-12T18:03:49.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.953+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35__shadow_.iaVxpl-fJxp_OUdafnfGXi01xRXgVdJ_0 2024-09-12T18:03:49.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.953+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14202984080901289628', time=2024-09-12T20:01:01.816081+0000, chain.objs.size()=1 2024-09-12T18:03:49.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.953+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39__shadow_.k1W9gx_SXP1b-LNv590htlHj0N19JvE_0 2024-09-12T18:03:49.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.957+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.957+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:03:49.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T18:03:49.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10972923907665149171', time=2024-09-12T19:55:28.368552+0000, chain.objs.size()=1 2024-09-12T18:03:49.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19__shadow_.uRhnxyrT3K6Cnv57fjrw8N2rwu1cOWZ_0 2024-09-12T18:03:49.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11250849505711108736', time=2024-09-12T19:56:54.994059+0000, chain.objs.size()=1 2024-09-12T18:03:49.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25__shadow_.ETe4cTAvleTLTR47sOOYNV7v2F7WiSL_0 2024-09-12T18:03:49.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16788546515690722796', time=2024-09-12T19:57:34.208765+0000, chain.objs.size()=1 2024-09-12T18:03:49.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27__shadow_.h2fYWZmfZnDThXU4oTpMVWVTDHAdcAy_0 2024-09-12T18:03:49.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13486525234370476641', time=2024-09-12T19:57:38.404494+0000, chain.objs.size()=1 2024-09-12T18:03:49.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28__shadow_.UAvfEfwsTNz8XEqZc1v5da8UAoZ_rpz_0 2024-09-12T18:03:49.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10671098901631316758', time=2024-09-12T19:57:38.576191+0000, chain.objs.size()=1 2024-09-12T18:03:49.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28__shadow_._ivJ5XLfeELlN5XsOtIzFOGYsPXheFy_0 2024-09-12T18:03:49.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5126140249866940263', time=2024-09-12T19:58:18.030272+0000, chain.objs.size()=1 2024-09-12T18:03:49.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30__shadow_.NUUyuRP1J5v0xQDg61nZupi41k4F2_I_0 2024-09-12T18:03:49.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9814036895372659092', time=2024-09-12T19:58:56.883906+0000, chain.objs.size()=1 2024-09-12T18:03:49.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32__shadow_.exdV7BDDCWBgzrZrA4oHjp11fhGMfiH_0 2024-09-12T18:03:49.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17140009736263426637', time=2024-09-12T19:59:01.702816+0000, chain.objs.size()=1 2024-09-12T18:03:49.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33__shadow_.ZfyA7Y4wQZNht5l4OdCjTqtR8MWv5G0_0 2024-09-12T18:03:49.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17561624864508480530', time=2024-09-12T19:59:01.705025+0000, chain.objs.size()=1 2024-09-12T18:03:49.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33__shadow_.1sWHXfLQR-Bsu30XThxKGyMdGbUy-N9_0 2024-09-12T18:03:49.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3149727687475647790', time=2024-09-12T19:59:42.142226+0000, chain.objs.size()=1 2024-09-12T18:03:49.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35__shadow_.WTuc3EHKeZ4fb9Ceo8n9ra0KCBpNvfB_0 2024-09-12T18:03:49.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7905111873349019212', time=2024-09-12T20:00:17.897519+0000, chain.objs.size()=1 2024-09-12T18:03:49.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36__shadow_.p26oX3MDZQlDv3kxA3B2fi8nRz75X47_0 2024-09-12T18:03:49.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14372501233975117710', time=2024-09-12T20:00:22.812251+0000, chain.objs.size()=1 2024-09-12T18:03:49.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.961+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37__shadow_.ps21ZMlf_iq3nLXi4V3L-JGzMqTb5V0_0 2024-09-12T18:03:49.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.969+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.969+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:03:49.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T18:03:49.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12369751013056469465', time=2024-09-12T19:53:46.064846+0000, chain.objs.size()=3 2024-09-12T18:03:49.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-FROZEN.2~8eE3-4ymQewMsqSi4egz_JNJMh3wwAY.1 2024-09-12T18:03:49.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-FROZEN.2~8eE3-4ymQewMsqSi4egz_JNJMh3wwAY.2 2024-09-12T18:03:49.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-FROZEN.2~8eE3-4ymQewMsqSi4egz_JNJMh3wwAY.3 2024-09-12T18:03:49.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9435168276899800202', time=2024-09-12T19:53:46.213165+0000, chain.objs.size()=3 2024-09-12T18:03:49.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.14__multipart_foo-FROZEN.2~HCrmfwkurp7xMdkup7m-6IwqmdLr2ru.1 2024-09-12T18:03:49.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.14__multipart_foo-FROZEN.2~HCrmfwkurp7xMdkup7m-6IwqmdLr2ru.2 2024-09-12T18:03:49.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.14__multipart_foo-FROZEN.2~HCrmfwkurp7xMdkup7m-6IwqmdLr2ru.3 2024-09-12T18:03:49.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.474011564448420692', time=2024-09-12T19:55:28.555889+0000, chain.objs.size()=1 2024-09-12T18:03:49.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19__shadow_.wDG3W_ipu5nPC4CKIV4mLSD3qhKtFYD_0 2024-09-12T18:03:49.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13756444385934545693', time=2024-09-12T19:57:38.421210+0000, chain.objs.size()=1 2024-09-12T18:03:49.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28__shadow_.p-FCUX4c33g8vaeNFeegZlkWAVmygZh_0 2024-09-12T18:03:49.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12245526540782101178', time=2024-09-12T19:57:38.466362+0000, chain.objs.size()=1 2024-09-12T18:03:49.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28__shadow_.HbiAAUUPntkhjmPcclBlwmTLbtJO-dt_0 2024-09-12T18:03:49.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7880264408336110036', time=2024-09-12T19:58:17.943003+0000, chain.objs.size()=1 2024-09-12T18:03:49.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30__shadow_.4AbdHKU2_Czrc8-hB7ZI33WZvH9NbKp_0 2024-09-12T18:03:49.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13529720322627329708', time=2024-09-12T19:59:42.133635+0000, chain.objs.size()=1 2024-09-12T18:03:49.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35__shadow_.oMvkrJRWZHbk2Hfz5NZe2MXLCchODA6_0 2024-09-12T18:03:49.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8231680821988923483', time=2024-09-12T19:59:42.267918+0000, chain.objs.size()=1 2024-09-12T18:03:49.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.973+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35__shadow_.qy5Fe3sv7QTk4M7IkT9El0n3fzMUVxQ_0 2024-09-12T18:03:49.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.977+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15661746024933640127', time=2024-09-12T20:00:17.923088+0000, chain.objs.size()=1 2024-09-12T18:03:49.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.977+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36__shadow_.qZcabDNjIkWu3CFAQs9l2rVPYWBeI41_0 2024-09-12T18:03:49.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.977+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15865180890359236373', time=2024-09-12T20:00:26.941747+0000, chain.objs.size()=1 2024-09-12T18:03:49.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.977+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38__shadow_.F40_Z4a5gjBmZwgu59AVKQLdK30Xf_n_0 2024-09-12T18:03:49.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.981+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:49.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.981+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:03:49.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:49.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:49.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T18:03:49.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10275951813108638432', time=2024-09-12T19:53:45.599933+0000, chain.objs.size()=1 2024-09-12T18:03:49.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.4__shadow_.VlIjrfSGEx5TUjum6i8feWDg9PJ9i4z_0 2024-09-12T18:03:49.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8024533845262548384', time=2024-09-12T19:53:46.137863+0000, chain.objs.size()=3 2024-09-12T18:03:49.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-LUKEWARM.2~kLWd2_KpDEADPR16U-qahYGe1fQza51.1 2024-09-12T18:03:49.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-LUKEWARM.2~kLWd2_KpDEADPR16U-qahYGe1fQza51.2 2024-09-12T18:03:49.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.16__multipart_foo-LUKEWARM.2~kLWd2_KpDEADPR16U-qahYGe1fQza51.3 2024-09-12T18:03:49.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7957723257167744493', time=2024-09-12T19:55:32.534634+0000, chain.objs.size()=1 2024-09-12T18:03:49.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20__shadow_.CWR9td_uaUyw_DyFHa9u9X-yh9hCEpk_0 2024-09-12T18:03:49.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9393410158506166579', time=2024-09-12T19:55:32.580937+0000, chain.objs.size()=1 2024-09-12T18:03:49.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20__shadow_.ERzqdpilY_1tPWWhZEYH0bMIrGSiwyt_0 2024-09-12T18:03:49.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13553521671449500864', time=2024-09-12T19:56:07.519829+0000, chain.objs.size()=1 2024-09-12T18:03:49.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21__shadow_.vWJkHcKpn8vqkcRCuhO-TohHLFaMv7G_0 2024-09-12T18:03:49.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8918628947075343892', time=2024-09-12T19:56:07.659280+0000, chain.objs.size()=1 2024-09-12T18:03:49.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21__shadow_.fdKkdEGAPE_G4D8tXvHV-b2lLYXxEc-_0 2024-09-12T18:03:49.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7327837532714228711', time=2024-09-12T19:56:12.154493+0000, chain.objs.size()=1 2024-09-12T18:03:49.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22__shadow_.P8As57ri0_eNBPG8Jt4Ls6RGX0ctJt8_0 2024-09-12T18:03:49.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8552160522356474257', time=2024-09-12T19:56:53.740410+0000, chain.objs.size()=1 2024-09-12T18:03:49.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25__shadow_.HlBPynUA_ogAqwLqNx9osogLHurKGJN_0 2024-09-12T18:03:49.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1837585089183100308', time=2024-09-12T19:57:38.405663+0000, chain.objs.size()=1 2024-09-12T18:03:49.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28__shadow_.STDZIP_nUihnfyFSt1ORFdZMeVbAejS_0 2024-09-12T18:03:49.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13022911218571000577', time=2024-09-12T19:57:38.465373+0000, chain.objs.size()=1 2024-09-12T18:03:49.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.985+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28__shadow_.5wsN3IHXkQrCzMK6b9Vkl1TexzWl1nZ_0 2024-09-12T18:03:49.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.989+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8243657021843457424', time=2024-09-12T19:58:13.575789+0000, chain.objs.size()=1 2024-09-12T18:03:49.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.989+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29__shadow_.yOgMSSGpxDPw-KdzgPX00eiNScBsWie_0 2024-09-12T18:03:49.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.989+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15725470388587241980', time=2024-09-12T19:58:17.923142+0000, chain.objs.size()=1 2024-09-12T18:03:49.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.989+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30__shadow_.6l4dEX03XN35Ak_NgYViP3tF7zBH_WB_0 2024-09-12T18:03:49.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.989+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10927643231393238452', time=2024-09-12T19:58:22.274888+0000, chain.objs.size()=1 2024-09-12T18:03:49.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.989+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31__shadow_.PUlmfss52MXaShl4heQATUp-EYloqzt_0 2024-09-12T18:03:49.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.989+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4652134668354798435', time=2024-09-12T19:59:01.596117+0000, chain.objs.size()=1 2024-09-12T18:03:49.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.989+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33__shadow_.eTC8WK5sGUkO14Vs3lGhernZf9xUY3G_0 2024-09-12T18:03:49.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.989+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12442260850456359335', time=2024-09-12T19:59:37.167706+0000, chain.objs.size()=1 2024-09-12T18:03:49.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.989+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34__shadow_.1GANu3RUYNc7bvEZ-I_GN4DY0CWZwgf_0 2024-09-12T18:03:49.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.989+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6217886120057364814', time=2024-09-12T19:59:42.155436+0000, chain.objs.size()=1 2024-09-12T18:03:49.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.989+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35__shadow_.caVnR-SBP03KfESbTfxQJbHB4uWnFhj_0 2024-09-12T18:03:49.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.989+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13677671213138079881', time=2024-09-12T20:00:17.760398+0000, chain.objs.size()=1 2024-09-12T18:03:49.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.989+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36__shadow_.IuhA4jghA4TwJGtmyppW8kPpOZVgDt5_0 2024-09-12T18:03:49.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.989+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13663731068284148020', time=2024-09-12T20:00:22.717407+0000, chain.objs.size()=1 2024-09-12T18:03:49.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.989+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37__shadow_.0QOTnEZ2_zLxjiKBG8xUEl0YGqPZltH_0 2024-09-12T18:03:49.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.989+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5123368301379549316', time=2024-09-12T20:00:27.064285+0000, chain.objs.size()=1 2024-09-12T18:03:49.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.989+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38__shadow_.WROd_CnDZgkce5Faj5E6LhUAAFj7mG-_0 2024-09-12T18:03:49.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.989+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7249760100672074898', time=2024-09-12T20:03:25.382493+0000, chain.objs.size()=1 2024-09-12T18:03:49.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.989+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.18__shadow:7dy58gL1y2Kmz9ASKtcNFhycrh-FTVV_.3SDN5UZdwDnRYDkd4bvQFgpQukTFWsx_0 2024-09-12T18:03:49.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.993+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:50.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.997+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:03:50.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:49.997+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T18:03:50.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.642563197023511844', time=2024-09-12T19:53:46.235109+0000, chain.objs.size()=3 2024-09-12T18:03:50.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.14__multipart_foo-LUKEWARM.2~SLbG_8uhKEhaNehbNCFwlYMwNsnJtop.1 2024-09-12T18:03:50.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.14__multipart_foo-LUKEWARM.2~SLbG_8uhKEhaNehbNCFwlYMwNsnJtop.2 2024-09-12T18:03:50.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.14__multipart_foo-LUKEWARM.2~SLbG_8uhKEhaNehbNCFwlYMwNsnJtop.3 2024-09-12T18:03:50.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15567505903181073114', time=2024-09-12T19:53:46.522070+0000, chain.objs.size()=1 2024-09-12T18:03:50.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.8__shadow_.uMOZt6oJjpahHRtuacyRC1ixaMPvzBY_0 2024-09-12T18:03:50.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7889665145257200265', time=2024-09-12T19:55:28.586560+0000, chain.objs.size()=1 2024-09-12T18:03:50.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.19__shadow_.csOl0tZ8MqlSA3jzxhCu5a_t_---VW3_0 2024-09-12T18:03:50.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12987355719293635227', time=2024-09-12T19:55:32.521554+0000, chain.objs.size()=1 2024-09-12T18:03:50.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20__shadow_.by8DlcSg52dj5sEPgc3nCgbcWAtDW1c_0 2024-09-12T18:03:50.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3194164853487075580', time=2024-09-12T19:55:32.523344+0000, chain.objs.size()=1 2024-09-12T18:03:50.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20__shadow_.Kq0rUZsb4ZoaCqWxt76owWoJLcBewme_0 2024-09-12T18:03:50.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10310046971275354339', time=2024-09-12T19:55:32.734366+0000, chain.objs.size()=1 2024-09-12T18:03:50.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20__shadow_.wyEvLnYM9mux_VhoqFKqxLiERxRIjd6_0 2024-09-12T18:03:50.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1867648710389156783', time=2024-09-12T19:56:12.009638+0000, chain.objs.size()=1 2024-09-12T18:03:50.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22__shadow_.DB3aFCxNwkOZa0YX4xmgpWFsj_JGB6Z_0 2024-09-12T18:03:50.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4721061555868655137', time=2024-09-12T19:56:12.131719+0000, chain.objs.size()=1 2024-09-12T18:03:50.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22__shadow_.lDJhvdO79axbHpWsfIdFZNPGN2651Pj_0 2024-09-12T18:03:50.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17015485683380830332', time=2024-09-12T19:56:15.827428+0000, chain.objs.size()=1 2024-09-12T18:03:50.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23__shadow_.DyG6PkxvfoZYvF_Pir8B0CYvI2DTC_z_0 2024-09-12T18:03:50.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4628853978869973482', time=2024-09-12T19:56:15.842542+0000, chain.objs.size()=1 2024-09-12T18:03:50.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.001+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23__shadow_.wVCkIlfvzs_8IWUj9PaxKJSPbFC7s3h_0 2024-09-12T18:03:50.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.009+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2945354527562074554', time=2024-09-12T19:56:19.172336+0000, chain.objs.size()=1 2024-09-12T18:03:50.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.009+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24__shadow_.8jfHXuFa1IRTuLPytwOoXvRx05BWFDV_0 2024-09-12T18:03:50.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.009+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15829817169314842088', time=2024-09-12T19:56:50.527321+0000, chain.objs.size()=1 2024-09-12T18:03:50.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.009+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24__shadow_.ApLnvFt7nbAwGI3E-wGCGEqpR4uoL9v_0 2024-09-12T18:03:50.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.009+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10261413550723504305', time=2024-09-12T19:56:59.148453+0000, chain.objs.size()=1 2024-09-12T18:03:50.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.009+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26__shadow_.XEL8SMxvtBcKx7zfsZdz3FsrhGfLJHX_0 2024-09-12T18:03:50.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1927685813617238705', time=2024-09-12T19:57:34.146206+0000, chain.objs.size()=1 2024-09-12T18:03:50.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.27__shadow_.J3z_3OVJlTMmgX3FnGy2n6LqHVA69Yu_0 2024-09-12T18:03:50.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7508873274771027352', time=2024-09-12T19:58:13.391764+0000, chain.objs.size()=1 2024-09-12T18:03:50.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29__shadow_.k44169Wdl7EzMqe5hOpgdCNh1nNGMyg_0 2024-09-12T18:03:50.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6096638609548633572', time=2024-09-12T19:58:13.523821+0000, chain.objs.size()=1 2024-09-12T18:03:50.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29__shadow_.y6GASL0Rn8ILFZBkfPySrAVlcoKqHuA_0 2024-09-12T18:03:50.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5280417388947571078', time=2024-09-12T19:58:13.525433+0000, chain.objs.size()=1 2024-09-12T18:03:50.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29__shadow_.qNYts889KJyCX9aJOLTPwgwNtgQt9wF_0 2024-09-12T18:03:50.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14911429209513661437', time=2024-09-12T19:58:18.030500+0000, chain.objs.size()=1 2024-09-12T18:03:50.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.30__shadow_.NkSW5adZ-sg5gY8_4BwuqjsN55zqHLz_0 2024-09-12T18:03:50.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10534458896007206631', time=2024-09-12T19:59:00.575578+0000, chain.objs.size()=1 2024-09-12T18:03:50.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33__shadow_.3hYPXLi29lzieIyXHyL9XpFeTpFOu_M_0 2024-09-12T18:03:50.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7900365948887614382', time=2024-09-12T19:59:01.704962+0000, chain.objs.size()=1 2024-09-12T18:03:50.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33__shadow_.BseYJ918vgfRN8cnKa1yfUxKAiOtOQe_0 2024-09-12T18:03:50.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5136820108925436271', time=2024-09-12T19:59:37.229042+0000, chain.objs.size()=1 2024-09-12T18:03:50.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34__shadow_.loowQl5xVGYemoAnGIO6tn8PSt2kpEI_0 2024-09-12T18:03:50.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17204760454808598004', time=2024-09-12T19:59:42.142151+0000, chain.objs.size()=1 2024-09-12T18:03:50.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35__shadow_.QRc8JiG-j_JgSF1kzPBl9vpVTFSzUa9_0 2024-09-12T18:03:50.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12534844209969326454', time=2024-09-12T20:00:17.770020+0000, chain.objs.size()=1 2024-09-12T18:03:50.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36__shadow_.2P4WmEfs7xoDWlTKKvJXB7i3v7fNn0T_0 2024-09-12T18:03:50.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14008601539775771632', time=2024-09-12T20:00:17.772379+0000, chain.objs.size()=1 2024-09-12T18:03:50.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.017+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36__shadow_.cLvbSiyeOUMZaQEFe1fnoTgxitqaJEF_0 2024-09-12T18:03:50.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.021+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1456698990672050661', time=2024-09-12T20:00:22.609127+0000, chain.objs.size()=1 2024-09-12T18:03:50.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.021+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37__shadow_.AIQQUrnxaQfsD3Lij_DtXY1qp5t2BdK_0 2024-09-12T18:03:50.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.021+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15317385840352208341', time=2024-09-12T20:00:27.166182+0000, chain.objs.size()=1 2024-09-12T18:03:50.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.021+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38__shadow_._XB4iU07aNzVDaKK1yJjS86syGkDwbd_0 2024-09-12T18:03:50.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.021+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14450420167598837405', time=2024-09-12T20:03:10.882099+0000, chain.objs.size()=1 2024-09-12T18:03:50.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.021+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17__shadow_.7xBqmyMXuAyLmnVj4dgydEHwIwAuZo2_0 2024-09-12T18:03:50.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.021+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14289783384168814957', time=2024-09-12T20:03:10.884324+0000, chain.objs.size()=1 2024-09-12T18:03:50.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.021+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17__shadow_.40y5503NW73vzJPkRY_qQv9-XdHBJbv_0 2024-09-12T18:03:50.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.029+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:50.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.029+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:03:50.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:03:50.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3501906017109249237', time=2024-09-12T19:55:32.603441+0000, chain.objs.size()=1 2024-09-12T18:03:50.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20__shadow_.BFmiGTwgC92DdkSYR_4TrA6J32xw1Ql_0 2024-09-12T18:03:50.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7745120839010246570', time=2024-09-12T19:55:32.753404+0000, chain.objs.size()=1 2024-09-12T18:03:50.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20__shadow_.ohJoKjOO1WOu474OvgbmU99mHV7R7um_0 2024-09-12T18:03:50.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2489951303650094218', time=2024-09-12T19:56:07.519015+0000, chain.objs.size()=1 2024-09-12T18:03:50.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21__shadow_.pNPyTf0xy5r2iGeWOfkVKraAJLDLo1t_0 2024-09-12T18:03:50.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7384820471535371432', time=2024-09-12T19:56:12.077383+0000, chain.objs.size()=1 2024-09-12T18:03:50.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.22__shadow_.1r99mSDcmZlussVNGjsMl1JDGAqH4nX_0 2024-09-12T18:03:50.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18011742016055065246', time=2024-09-12T19:56:50.465335+0000, chain.objs.size()=1 2024-09-12T18:03:50.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24__shadow_.-cYF4jUxD8RuL5hVs9ypiPRTGkTUNCV_0 2024-09-12T18:03:50.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15490079750043835582', time=2024-09-12T19:56:55.125465+0000, chain.objs.size()=1 2024-09-12T18:03:50.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.25__shadow_.M9PGThRPaMKGfG4oua8hbjm395H1cRp_0 2024-09-12T18:03:50.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3163102964547891184', time=2024-09-12T19:57:38.346838+0000, chain.objs.size()=1 2024-09-12T18:03:50.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28__shadow_.7Il6NnJEfq0TrKJ-lhw6k9gQbxZblYt_0 2024-09-12T18:03:50.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3248501122554754015', time=2024-09-12T19:57:38.492364+0000, chain.objs.size()=1 2024-09-12T18:03:50.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.28__shadow_.Z2fgzy1E1D3rFFly7LwSovaR_SzUYra_0 2024-09-12T18:03:50.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16685250725979889018', time=2024-09-12T19:58:13.315768+0000, chain.objs.size()=1 2024-09-12T18:03:50.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29__shadow_.c4YPzXo8wtO0cYz976Bse2jOPb5oP8Y_0 2024-09-12T18:03:50.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15976243192768848333', time=2024-09-12T19:58:22.230062+0000, chain.objs.size()=1 2024-09-12T18:03:50.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31__shadow_.yTFg2ukpy4sGhBgDtrUAsi63a3PnPhx_0 2024-09-12T18:03:50.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1931966585185489217', time=2024-09-12T19:58:22.445778+0000, chain.objs.size()=1 2024-09-12T18:03:50.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.31__shadow_.8YKJORB3H1DLAfqy0GAvHyXJjitu2vz_0 2024-09-12T18:03:50.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11822116748555857996', time=2024-09-12T19:59:37.257917+0000, chain.objs.size()=1 2024-09-12T18:03:50.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.033+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34__shadow_.Pd2vshMZh6cb0oXVzOvwf5J1WTUqC7w_0 2024-09-12T18:03:50.041 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.037+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6549087338844699343', time=2024-09-12T19:59:46.010699+0000, chain.objs.size()=1 2024-09-12T18:03:50.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.037+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36__shadow_.u4wx-t1lcz7M9xROOVua9PWAgC9pRme_0 2024-09-12T18:03:50.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.037+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8686798900790737673', time=2024-09-12T20:00:17.685685+0000, chain.objs.size()=1 2024-09-12T18:03:50.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.037+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36__shadow_.gGifD_YsmmQdiChNcEvBKifMPe8H-Z2_0 2024-09-12T18:03:50.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.037+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13350218907366787266', time=2024-09-12T20:00:17.866239+0000, chain.objs.size()=1 2024-09-12T18:03:50.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.037+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.36__shadow_.1f3w-5P0dAcSnvDjNS97cWFCMEiEoVm_0 2024-09-12T18:03:50.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.037+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15881097540942715751', time=2024-09-12T20:00:26.937684+0000, chain.objs.size()=1 2024-09-12T18:03:50.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.037+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.38__shadow_.fevBKQUGpocGDyQeY3tSryAN5b-SGeR_0 2024-09-12T18:03:50.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.037+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3600995615795064740', time=2024-09-12T20:01:01.717819+0000, chain.objs.size()=1 2024-09-12T18:03:50.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.037+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.39__shadow_.tKuaUAQDbZd-qDj9J7ziXwYBo_WsCUw_0 2024-09-12T18:03:50.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.037+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12034350876828150972', time=2024-09-12T20:03:10.891722+0000, chain.objs.size()=1 2024-09-12T18:03:50.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.037+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.17__shadow_.IpH3Mzk194eGGDc6iSUqsfHdkf03alb_0 2024-09-12T18:03:50.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.045+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:50.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.045+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:03:50.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T18:03:50.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11984111510339937189', time=2024-09-12T19:53:45.584472+0000, chain.objs.size()=1 2024-09-12T18:03:50.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.4__shadow_.DvEwQgMOKkpmVXTXzUqpYID00DwPDGG_0 2024-09-12T18:03:50.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_C36e_4s3DS6rRtPqxhMoviyKbAU2VFM', time=2024-09-12T19:53:45.924158+0000, chain.objs.size()=1 2024-09-12T18:03:50.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_._Dbg7kcu2jGAmMoW0kFMVIaNPdtX0N2_0 2024-09-12T18:03:50.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.710539255089247395', time=2024-09-12T19:53:45.976263+0000, chain.objs.size()=1 2024-09-12T18:03:50.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.wxPegvjj9b3j9bxWwpZd6sr5Kd40dcP_0 2024-09-12T18:03:50.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='_PL4L44mXsEh1WOOAJmVkfywbxfls6d7', time=2024-09-12T19:53:45.986907+0000, chain.objs.size()=1 2024-09-12T18:03:50.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.15__shadow_.Fw-O8L3A1Z2hlqzB4erpKMOo4gB74BZ_0 2024-09-12T18:03:50.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5394966377387876416', time=2024-09-12T19:53:46.297234+0000, chain.objs.size()=1 2024-09-12T18:03:50.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.13__shadow_.uDuEwSdSM5jqXrCMbLZhtL4V9H7WK8Q_0 2024-09-12T18:03:50.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14607590301177392965', time=2024-09-12T19:55:32.586328+0000, chain.objs.size()=1 2024-09-12T18:03:50.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.20__shadow_.lyA-re3p-3HPL7v6cgAllYFiuOnNrMd_0 2024-09-12T18:03:50.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7663375398884117165', time=2024-09-12T19:56:07.530772+0000, chain.objs.size()=1 2024-09-12T18:03:50.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21__shadow_.KC6xzua_s6IEIyzwsFvoE0U5AY7-zMG_0 2024-09-12T18:03:50.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3690402381900267128', time=2024-09-12T19:56:07.532297+0000, chain.objs.size()=1 2024-09-12T18:03:50.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21__shadow_.LDbnJ8ajtxbSoiMArcFSndiN0jFdpql_0 2024-09-12T18:03:50.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3573625731109900952', time=2024-09-12T19:56:07.533851+0000, chain.objs.size()=1 2024-09-12T18:03:50.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21__shadow_.NpGTqX-hC2Rx8EZjelUnc8Jn04sdm41_0 2024-09-12T18:03:50.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12558289842521444978', time=2024-09-12T19:56:07.582932+0000, chain.objs.size()=1 2024-09-12T18:03:50.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.21__shadow_.h6wLEZheXv1XjcJMEQogT4Cr2shrh1j_0 2024-09-12T18:03:50.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5502556824404906610', time=2024-09-12T19:56:15.852203+0000, chain.objs.size()=1 2024-09-12T18:03:50.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.23__shadow_.N3va2hr4lAExJPI5t1kGudHUQslPvyW_0 2024-09-12T18:03:50.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11992060962159805082', time=2024-09-12T19:56:50.298977+0000, chain.objs.size()=1 2024-09-12T18:03:50.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.049+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24__shadow_.XQ6H59JVGUyEM1befyKQ0xeK6vpOQLw_0 2024-09-12T18:03:50.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.053+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2571992909858714565', time=2024-09-12T19:56:50.389195+0000, chain.objs.size()=1 2024-09-12T18:03:50.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.053+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.24__shadow_.Dv4d2dB_fPBFQbjvA1vjHzLazgVFkfe_0 2024-09-12T18:03:50.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.053+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15833829803976531020', time=2024-09-12T19:56:59.276013+0000, chain.objs.size()=1 2024-09-12T18:03:50.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.053+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.26__shadow_.Je6vIHNMwWNVoaLkLZNF9lCDskSVDNt_0 2024-09-12T18:03:50.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.053+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16727976589682728879', time=2024-09-12T19:58:13.399226+0000, chain.objs.size()=1 2024-09-12T18:03:50.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.053+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.29__shadow_.AoTa8_2iLpJFUxX35BgZ__vMxHVHCJd_0 2024-09-12T18:03:50.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.053+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2085711408296298139', time=2024-09-12T19:58:56.994494+0000, chain.objs.size()=1 2024-09-12T18:03:50.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.053+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32__shadow_.b8iLHenMO8qtWdnKw2JZCOV3lCLIvxb_0 2024-09-12T18:03:50.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.053+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8877938894474578402', time=2024-09-12T19:58:57.078671+0000, chain.objs.size()=1 2024-09-12T18:03:50.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.053+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.32__shadow_._szCB9K7K94aHmTmxUjFvwEobu32S0F_0 2024-09-12T18:03:50.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.053+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12270416556368986096', time=2024-09-12T19:59:01.776762+0000, chain.objs.size()=1 2024-09-12T18:03:50.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.053+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.33__shadow_.B_UDzK0E-txyLFXLxmBpvtDmgLuCW8t_0 2024-09-12T18:03:50.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.053+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5318937787480528972', time=2024-09-12T19:59:05.118971+0000, chain.objs.size()=1 2024-09-12T18:03:50.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.053+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.34__shadow_.CGJ1VZi61HQ2h7oh7XEBgtIFfGbXX0e_0 2024-09-12T18:03:50.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.053+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14529930910163438750', time=2024-09-12T19:59:42.145967+0000, chain.objs.size()=1 2024-09-12T18:03:50.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.053+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.35__shadow_.vptH-tRm_5n0rGq7is8X3zp4xIc3uqI_0 2024-09-12T18:03:50.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.053+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15028591529910398689', time=2024-09-12T20:00:21.582818+0000, chain.objs.size()=1 2024-09-12T18:03:50.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.053+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37__shadow_.PyX2MaNo4zK0Qov8N_TGPJd8K6v50TK_0 2024-09-12T18:03:50.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.053+0000 7f7894c0a9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1357667091028406362', time=2024-09-12T20:00:22.776275+0000, chain.objs.size()=1 2024-09-12T18:03:50.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.053+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.37__shadow_.Tr9Sr9PamSZrQJQYL6ZQEQ1o-q3qUmW_0 2024-09-12T18:03:50.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.061+0000 7f7894c0a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:03:50.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.065+0000 7f7748fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:50.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.065+0000 7f7894c0a9c0 20 remove_watcher() i=0 2024-09-12T18:03:50.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.065+0000 7f7894c0a9c0 2 removed watcher, disabling cache 2024-09-12T18:03:50.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.069+0000 7f7894c0a9c0 20 remove_watcher() i=1 2024-09-12T18:03:50.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.069+0000 7f7894c0a9c0 20 remove_watcher() i=2 2024-09-12T18:03:50.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.069+0000 7f7894c0a9c0 20 remove_watcher() i=3 2024-09-12T18:03:50.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.073+0000 7f7894c0a9c0 20 remove_watcher() i=4 2024-09-12T18:03:50.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.073+0000 7f7894c0a9c0 20 remove_watcher() i=5 2024-09-12T18:03:50.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.073+0000 7f7894c0a9c0 20 remove_watcher() i=6 2024-09-12T18:03:50.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.077+0000 7f7894c0a9c0 20 remove_watcher() i=7 2024-09-12T18:03:50.093 DEBUG:teuthology.orchestra.run.smithi098:> radosgw-admin gc process --include-all 2024-09-12T18:03:50.164 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:03:50.164 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:03:50.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.201+0000 7f35de22b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.201+0000 7f35de22b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.201+0000 7f35de22b9c0 20 realm 2024-09-12T18:03:50.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.201+0000 7f35de22b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.201+0000 7f35de22b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.201+0000 7f35de22b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:03:50.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.201+0000 7f35de22b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.201+0000 7f35de22b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.201+0000 7f35de22b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.205+0000 7f35de22b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:50.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.205+0000 7f35de22b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.205+0000 7f35de22b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:03:50.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.205+0000 7f35de22b9c0 20 searching for the correct realm 2024-09-12T18:03:50.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.213+0000 7f35db530640 0 -- 172.21.15.98:0/272161901 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f35cc041940 msgr2=0x7f35cc0293d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:50.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.217+0000 7f35db530640 0 -- 172.21.15.98:0/272161901 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f34a4081180 msgr2=0x7f34a40835b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:03:50.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:03:50.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:03:50.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:03:50.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:03:50.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:03:50.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:03:50.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:03:50.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:03:50.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 zone default found 2024-09-12T18:03:50.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 4 Realm: () 2024-09-12T18:03:50.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:03:50.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:03:50.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:03:50.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 zonegroup default 2024-09-12T18:03:50.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:03:50.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:03:50.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 started sync module instance, tier type = 2024-09-12T18:03:50.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.225+0000 7f35de22b9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:03:50.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.245+0000 7f35de22b9c0 20 add_watcher() i=0 2024-09-12T18:03:50.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.245+0000 7f35de22b9c0 20 add_watcher() i=1 2024-09-12T18:03:50.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.245+0000 7f35de22b9c0 20 add_watcher() i=2 2024-09-12T18:03:50.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.245+0000 7f35de22b9c0 20 add_watcher() i=3 2024-09-12T18:03:50.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.245+0000 7f35de22b9c0 20 add_watcher() i=4 2024-09-12T18:03:50.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.245+0000 7f35de22b9c0 20 add_watcher() i=5 2024-09-12T18:03:50.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.245+0000 7f35de22b9c0 20 add_watcher() i=6 2024-09-12T18:03:50.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.245+0000 7f35de22b9c0 20 add_watcher() i=7 2024-09-12T18:03:50.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.245+0000 7f35de22b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:03:50.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.249+0000 7f3491fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:50.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.249+0000 7f35de22b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:03:50.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.249+0000 7f35de22b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:03:50.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.333+0000 7f3490fe1640 20 reqs_thread_entry: start 2024-09-12T18:03:50.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.333+0000 7f35de22b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:03:50.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.333+0000 7f35de22b9c0 20 Filter name: none 2024-09-12T18:03:50.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.333+0000 7f340a7fc640 20 reqs_thread_entry: start 2024-09-12T18:03:50.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.333+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:03:50.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.337+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.337+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.337+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.341+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:03:50.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.345+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.345+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.345+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.349+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:03:50.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.353+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.353+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.353+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.357+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:03:50.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.361+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.361+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.361+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.361+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:03:50.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.365+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.365+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.365+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.369+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:03:50.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.369+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.373+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.373+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.377+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:03:50.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.381+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.381+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.381+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.385+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:03:50.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.389+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.389+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.389+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.389+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:03:50.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.393+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.397+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.397+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.397+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:03:50.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.401+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.401+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.401+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.405+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:03:50.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.409+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.409+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.409+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.413+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:03:50.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.417+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.417+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.417+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.421+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:03:50.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.425+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.425+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.425+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.429+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:03:50.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.433+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.433+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.433+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.437+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:03:50.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.441+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.441+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.445+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.445+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:03:50.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.449+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.453+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.453+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.457+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:03:50.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.457+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.461+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.461+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.465+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:03:50.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.465+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.469+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.469+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.473+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:03:50.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.473+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.473+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.473+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.477+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:03:50.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.481+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.481+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.485+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.485+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:03:50.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.489+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.489+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.489+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.493+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:03:50.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.493+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.493+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.497+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.497+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:03:50.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.501+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.501+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.505+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.505+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:03:50.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.509+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.509+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.509+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.509+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:03:50.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.513+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.517+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.517+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.521+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:03:50.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.521+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.521+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.521+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.525+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:03:50.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.529+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.529+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.533+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.533+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:03:50.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.537+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.541+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.541+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.541+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:03:50.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.545+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.545+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.549+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.549+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:03:50.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.557+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.557+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.557+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.561+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:03:50.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.565+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.565+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.565+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.569+0000 7f35de22b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:03:50.578 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.573+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.573+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:03:50.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.573+0000 7f35de22b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:03:50.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.581+0000 7f3491fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:03:50.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.585+0000 7f35de22b9c0 20 remove_watcher() i=0 2024-09-12T18:03:50.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.585+0000 7f35de22b9c0 2 removed watcher, disabling cache 2024-09-12T18:03:50.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.585+0000 7f35de22b9c0 20 remove_watcher() i=1 2024-09-12T18:03:50.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.589+0000 7f35de22b9c0 20 remove_watcher() i=2 2024-09-12T18:03:50.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.593+0000 7f35de22b9c0 20 remove_watcher() i=3 2024-09-12T18:03:50.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.593+0000 7f35de22b9c0 20 remove_watcher() i=4 2024-09-12T18:03:50.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.597+0000 7f35de22b9c0 20 remove_watcher() i=5 2024-09-12T18:03:50.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.597+0000 7f35de22b9c0 20 remove_watcher() i=6 2024-09-12T18:03:50.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:03:50.601+0000 7f35de22b9c0 20 remove_watcher() i=7 2024-09-12T18:03:50.622 DEBUG:teuthology.orchestra.run.smithi098:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T18:03:51.226 INFO:teuthology.orchestra.run.smithi098.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T18:03:55.823 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :clean UP-TO-DATE 2024-09-12T18:04:15.423 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :compileJava 2024-09-12T18:04:15.423 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :processResources 2024-09-12T18:04:15.423 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :classes 2024-09-12T18:04:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:04:16.222 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :compileTestJava 2024-09-12T18:04:16.222 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:04:16.222 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T18:04:16.222 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :testClasses 2024-09-12T18:04:16.223 INFO:teuthology.orchestra.run.smithi098.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T18:04:16.223 INFO:teuthology.orchestra.run.smithi098.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T18:04:22.622 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:04:22.622 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :test 2024-09-12T18:04:22.622 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:04:22.622 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T18:04:33.522 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:04:33.522 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T18:04:34.321 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:04:34.322 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T18:04:34.622 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:04:34.622 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T18:04:35.421 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:04:35.421 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T18:04:55.922 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:04:55.922 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T18:04:56.821 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:04:56.822 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T18:04:56.921 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:04:56.921 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T18:04:57.021 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:04:57.021 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T18:04:57.222 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:04:57.222 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T18:04:58.021 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:04:58.021 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T18:05:11.122 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:05:11.122 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T18:05:12.722 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:05:12.722 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T18:05:13.222 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:05:13.222 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T18:05:13.222 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12 18:05:13,174 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T18:06:30.323 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:06:30.323 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T18:06:31.922 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:06:31.922 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T18:06:32.022 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:06:32.022 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T18:06:32.822 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:06:32.822 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T18:06:33.222 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:06:33.222 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T18:06:34.521 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:06:34.522 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T18:06:47.622 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:06:47.622 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T18:06:48.522 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:06:48.522 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T18:06:48.522 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:06:48.522 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T18:06:48.722 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:06:48.722 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T18:07:15.622 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:07:15.622 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T18:07:20.322 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:07:20.322 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T18:07:53.822 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:07:53.822 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T18:07:55.022 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:07:55.022 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T18:08:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:08:00.722 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T18:08:01.622 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:08:01.622 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T18:10:23.423 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:10:23.423 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T18:10:24.322 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:10:24.322 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T18:10:49.422 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:10:49.423 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T18:10:50.222 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:10:50.222 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T18:11:10.022 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:11:10.022 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T18:11:10.822 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:11:10.822 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T18:11:16.722 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:11:16.722 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T18:11:40.822 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:11:40.823 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T18:11:41.022 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:11:41.022 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T18:11:41.922 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:11:41.922 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T18:11:42.222 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:11:42.222 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T18:11:43.022 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:11:43.022 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T18:11:43.322 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:11:43.322 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T18:11:44.222 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:11:44.222 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T18:11:44.422 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:11:44.422 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T18:11:45.322 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:11:45.322 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T18:11:45.622 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:11:45.622 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T18:11:46.422 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:11:46.422 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T18:11:46.622 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:11:46.622 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T18:11:47.521 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:11:47.522 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T18:11:47.822 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:11:47.822 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T18:11:48.622 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:11:48.622 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T18:12:37.822 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:37.823 INFO:teuthology.orchestra.run.smithi098.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T18:12:38.822 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:38.822 INFO:teuthology.orchestra.run.smithi098.stdout:---------------------------------------------------------------------- 2024-09-12T18:12:38.822 INFO:teuthology.orchestra.run.smithi098.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T18:12:38.822 INFO:teuthology.orchestra.run.smithi098.stdout:---------------------------------------------------------------------- 2024-09-12T18:12:38.822 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:38.822 INFO:teuthology.orchestra.run.smithi098.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T18:12:38.823 INFO:teuthology.orchestra.run.smithi098.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T18:12:38.823 INFO:teuthology.orchestra.run.smithi098.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T18:12:38.823 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:38.823 INFO:teuthology.orchestra.run.smithi098.stdout:BUILD SUCCESSFUL in 8m 48s 2024-09-12T18:12:38.823 INFO:teuthology.orchestra.run.smithi098.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T18:12:39.172 DEBUG:teuthology.orchestra.run.smithi098:> radosgw-admin gc process --include-all 2024-09-12T18:12:39.202 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:12:39.202 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:12:39.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.241+0000 7f41642589c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:39.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.241+0000 7f41642589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:39.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.241+0000 7f41642589c0 20 realm 2024-09-12T18:12:39.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.241+0000 7f41642589c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:39.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.241+0000 7f41642589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:39.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.241+0000 7f41642589c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:12:39.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.241+0000 7f41642589c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:39.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.241+0000 7f41642589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:39.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.241+0000 7f41642589c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:39.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.245+0000 7f41642589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:12:39.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.245+0000 7f41642589c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:39.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.245+0000 7f41642589c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:12:39.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.245+0000 7f41642589c0 20 searching for the correct realm 2024-09-12T18:12:39.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.249+0000 7f416155d640 0 -- 172.21.15.98:0/1178902407 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f415c05c0b0 msgr2=0x7f415c05baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:12:39.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.465+0000 7f4161d5e640 0 -- 172.21.15.98:0/1178902407 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f414c0b5410 msgr2=0x7f414c0b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:12:39.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.681+0000 7f41642589c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:12:39.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.681+0000 7f41642589c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:12:39.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.681+0000 7f41642589c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:12:39.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.681+0000 7f41642589c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:12:39.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.681+0000 7f41642589c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:12:39.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.681+0000 7f41642589c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:12:39.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.681+0000 7f41642589c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:39.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.685+0000 7f41642589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:39.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.685+0000 7f41642589c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:39.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.685+0000 7f41642589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:12:39.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.685+0000 7f41642589c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:39.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.685+0000 7f41642589c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:12:39.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.685+0000 7f41642589c0 20 zone default found 2024-09-12T18:12:39.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.685+0000 7f41642589c0 4 Realm: () 2024-09-12T18:12:39.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.685+0000 7f41642589c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:12:39.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.685+0000 7f41642589c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:12:39.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.685+0000 7f41642589c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:12:39.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.685+0000 7f41642589c0 20 zonegroup default 2024-09-12T18:12:39.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.685+0000 7f41642589c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:39.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.685+0000 7f41642589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:39.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.685+0000 7f41642589c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:39.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.685+0000 7f41642589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:39.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.685+0000 7f41642589c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:39.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.689+0000 7f41642589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:39.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.689+0000 7f41642589c0 20 started sync module instance, tier type = 2024-09-12T18:12:39.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.689+0000 7f41642589c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:12:39.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.713+0000 7f41642589c0 20 add_watcher() i=0 2024-09-12T18:12:39.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.713+0000 7f41642589c0 20 add_watcher() i=1 2024-09-12T18:12:39.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.713+0000 7f41642589c0 20 add_watcher() i=2 2024-09-12T18:12:39.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.713+0000 7f41642589c0 20 add_watcher() i=3 2024-09-12T18:12:39.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.713+0000 7f41642589c0 20 add_watcher() i=4 2024-09-12T18:12:39.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.713+0000 7f41642589c0 20 add_watcher() i=5 2024-09-12T18:12:39.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.713+0000 7f41642589c0 20 add_watcher() i=6 2024-09-12T18:12:39.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.713+0000 7f41642589c0 20 add_watcher() i=7 2024-09-12T18:12:39.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.713+0000 7f41642589c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:12:39.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.717+0000 7f40137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:12:39.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.721+0000 7f41642589c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:12:39.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.721+0000 7f41642589c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:12:39.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.809+0000 7f40127fc640 20 reqs_thread_entry: start 2024-09-12T18:12:39.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.809+0000 7f41642589c0 20 init_complete bucket index max shards: 11 2024-09-12T18:12:39.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.809+0000 7f41642589c0 20 Filter name: none 2024-09-12T18:12:39.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.809+0000 7f3f83fff640 20 reqs_thread_entry: start 2024-09-12T18:12:39.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.809+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:12:39.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.813+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:39.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.817+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:39.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.817+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:12:39.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.817+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7984096091752520405', time=2024-09-12T20:06:47.830752+0000, chain.objs.size()=5 2024-09-12T18:12:39.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.817+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.51__multipart_key1.2~2gBKBCdIzJYkgr2FEq2DB8s95Z4wgj6.1 2024-09-12T18:12:39.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.817+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.51__multipart_key1.2~2gBKBCdIzJYkgr2FEq2DB8s95Z4wgj6.2 2024-09-12T18:12:39.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.817+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.51__multipart_key1.2~2gBKBCdIzJYkgr2FEq2DB8s95Z4wgj6.3 2024-09-12T18:12:39.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.817+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.51__multipart_key1.2~2gBKBCdIzJYkgr2FEq2DB8s95Z4wgj6.4 2024-09-12T18:12:39.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.817+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.51__multipart_key1.2~2gBKBCdIzJYkgr2FEq2DB8s95Z4wgj6.5 2024-09-12T18:12:39.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.817+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3306312625033226785', time=2024-09-12T20:12:38.102128+0000, chain.objs.size()=11 2024-09-12T18:12:39.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.817+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.66__multipart_key1.2~StV7XTUcJ84lTPjaUEHGDyHvTmBu7Ka.1 2024-09-12T18:12:39.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.817+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.66__multipart_key1.2~StV7XTUcJ84lTPjaUEHGDyHvTmBu7Ka.2 2024-09-12T18:12:39.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.817+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.66__multipart_key1.2~StV7XTUcJ84lTPjaUEHGDyHvTmBu7Ka.3 2024-09-12T18:12:39.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.817+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.66__multipart_key1.2~StV7XTUcJ84lTPjaUEHGDyHvTmBu7Ka.4 2024-09-12T18:12:39.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.817+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.66__multipart_key1.2~StV7XTUcJ84lTPjaUEHGDyHvTmBu7Ka.5 2024-09-12T18:12:39.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.817+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.66__multipart_key1.2~StV7XTUcJ84lTPjaUEHGDyHvTmBu7Ka.6 2024-09-12T18:12:39.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.817+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.66__multipart_key1.2~StV7XTUcJ84lTPjaUEHGDyHvTmBu7Ka.7 2024-09-12T18:12:39.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.825+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.66__multipart_key1.2~StV7XTUcJ84lTPjaUEHGDyHvTmBu7Ka.8 2024-09-12T18:12:39.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.825+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.66__multipart_key1.2~StV7XTUcJ84lTPjaUEHGDyHvTmBu7Ka.9 2024-09-12T18:12:39.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.825+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.66__multipart_key1.2~StV7XTUcJ84lTPjaUEHGDyHvTmBu7Ka.10 2024-09-12T18:12:39.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.829+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.66__multipart_key1.2~StV7XTUcJ84lTPjaUEHGDyHvTmBu7Ka.11 2024-09-12T18:12:39.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.841+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:39.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.845+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:12:39.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.849+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:39.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.849+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:39.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.849+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:39.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.849+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:12:39.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.853+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:39.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.853+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:39.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.857+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:12:39.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.857+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18023654662781193105', time=2024-09-12T20:06:07.258056+0000, chain.objs.size()=5 2024-09-12T18:12:39.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.857+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~05EPByvHvaoobBZcA6zGPSKJdcVrDVg.1 2024-09-12T18:12:39.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.857+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~05EPByvHvaoobBZcA6zGPSKJdcVrDVg.2 2024-09-12T18:12:39.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.857+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~05EPByvHvaoobBZcA6zGPSKJdcVrDVg.3 2024-09-12T18:12:39.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.857+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~05EPByvHvaoobBZcA6zGPSKJdcVrDVg.4 2024-09-12T18:12:39.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.857+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~05EPByvHvaoobBZcA6zGPSKJdcVrDVg.5 2024-09-12T18:12:39.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.857+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10897617075480085015', time=2024-09-12T20:11:46.916302+0000, chain.objs.size()=1 2024-09-12T18:12:39.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.857+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.64__shadow_.1sADfn0u0hpi4-jr9R-UUWxHOAc_3qd_0 2024-09-12T18:12:39.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.869+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:39.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.873+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:12:39.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.877+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:39.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.877+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:39.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.877+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:12:39.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.877+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14123952847270370906', time=2024-09-12T20:06:25.885464+0000, chain.objs.size()=5 2024-09-12T18:12:39.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.877+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~q5wFYKttrCcaKmRgTK94Y-OtvFnKBc4.1 2024-09-12T18:12:39.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.877+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__shadow_key1.2~q5wFYKttrCcaKmRgTK94Y-OtvFnKBc4.1_1 2024-09-12T18:12:39.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.877+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~q5wFYKttrCcaKmRgTK94Y-OtvFnKBc4.2 2024-09-12T18:12:39.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.877+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__shadow_key1.2~q5wFYKttrCcaKmRgTK94Y-OtvFnKBc4.2_1 2024-09-12T18:12:39.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.877+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~q5wFYKttrCcaKmRgTK94Y-OtvFnKBc4.3 2024-09-12T18:12:39.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.877+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15868706504130658088', time=2024-09-12T20:07:18.228726+0000, chain.objs.size()=5 2024-09-12T18:12:39.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.877+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.52__multipart_key1.2~1KerPC4vmNXBYql7BZDY9-RHFLl5bi7.1 2024-09-12T18:12:39.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.877+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.52__multipart_key1.2~1KerPC4vmNXBYql7BZDY9-RHFLl5bi7.2 2024-09-12T18:12:39.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.877+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.52__multipart_key1.2~1KerPC4vmNXBYql7BZDY9-RHFLl5bi7.3 2024-09-12T18:12:39.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.877+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.52__multipart_key1.2~1KerPC4vmNXBYql7BZDY9-RHFLl5bi7.4 2024-09-12T18:12:39.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.877+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.52__multipart_key1.2~1KerPC4vmNXBYql7BZDY9-RHFLl5bi7.5 2024-09-12T18:12:39.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.893+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:39.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.901+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:12:39.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.905+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:39.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.905+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:39.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.905+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:12:39.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.905+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7787624249583644714', time=2024-09-12T20:04:56.230181+0000, chain.objs.size()=5 2024-09-12T18:12:39.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.905+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.42__multipart_key1.2~UQHte5daJM6YdC5XobVnlnALUpZNQ6E.1 2024-09-12T18:12:39.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.905+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.42__multipart_key1.2~UQHte5daJM6YdC5XobVnlnALUpZNQ6E.2 2024-09-12T18:12:39.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.905+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.42__multipart_key1.2~UQHte5daJM6YdC5XobVnlnALUpZNQ6E.3 2024-09-12T18:12:39.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.905+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.42__multipart_key1.2~UQHte5daJM6YdC5XobVnlnALUpZNQ6E.4 2024-09-12T18:12:39.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.905+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.42__multipart_key1.2~UQHte5daJM6YdC5XobVnlnALUpZNQ6E.5 2024-09-12T18:12:39.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.905+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8666890117732394154', time=2024-09-12T20:06:01.757948+0000, chain.objs.size()=5 2024-09-12T18:12:39.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.905+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~CTYjGKPY6Ggml132zAkUn_X7-DqVD9W.1 2024-09-12T18:12:39.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.905+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~CTYjGKPY6Ggml132zAkUn_X7-DqVD9W.2 2024-09-12T18:12:39.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.905+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~CTYjGKPY6Ggml132zAkUn_X7-DqVD9W.3 2024-09-12T18:12:39.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.905+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~CTYjGKPY6Ggml132zAkUn_X7-DqVD9W.4 2024-09-12T18:12:39.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.905+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~CTYjGKPY6Ggml132zAkUn_X7-DqVD9W.5 2024-09-12T18:12:39.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.917+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:39.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.925+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:12:39.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.925+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:39.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.925+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:39.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.929+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:39.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.929+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:12:39.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.933+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:39.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.933+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:39.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.933+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:39.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.933+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:12:39.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.937+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:39.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.937+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:39.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.937+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:12:39.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.937+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12266342589094359484', time=2024-09-12T20:07:54.222679+0000, chain.objs.size()=5 2024-09-12T18:12:39.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.937+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.53__multipart_file2.mpg.2~8veXJ2LIFw-SaMMjbFrD8gw8DWHHijE.1 2024-09-12T18:12:39.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.937+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.53__multipart_file2.mpg.2~8veXJ2LIFw-SaMMjbFrD8gw8DWHHijE.2 2024-09-12T18:12:39.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.937+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.53__multipart_file2.mpg.2~8veXJ2LIFw-SaMMjbFrD8gw8DWHHijE.3 2024-09-12T18:12:39.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.937+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.53__multipart_file2.mpg.2~8veXJ2LIFw-SaMMjbFrD8gw8DWHHijE.4 2024-09-12T18:12:39.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.937+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.53__multipart_file2.mpg.2~8veXJ2LIFw-SaMMjbFrD8gw8DWHHijE.5 2024-09-12T18:12:39.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.945+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:39.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.949+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:12:39.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.949+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:39.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.949+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:39.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.953+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:39.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.953+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:12:39.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.957+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:39.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.957+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:39.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.957+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:12:39.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.957+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6097587592146381949', time=2024-09-12T20:05:11.396501+0000, chain.objs.size()=5 2024-09-12T18:12:39.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.957+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.44__multipart_key1.2~HDIuYM8N7WUoZad4mD7UsiQzmYBcF_h.1 2024-09-12T18:12:39.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.957+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.44__multipart_key1.2~HDIuYM8N7WUoZad4mD7UsiQzmYBcF_h.2 2024-09-12T18:12:39.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.957+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.44__multipart_key1.2~HDIuYM8N7WUoZad4mD7UsiQzmYBcF_h.3 2024-09-12T18:12:39.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.957+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.44__multipart_key1.2~HDIuYM8N7WUoZad4mD7UsiQzmYBcF_h.4 2024-09-12T18:12:39.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.957+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.44__multipart_key1.2~HDIuYM8N7WUoZad4mD7UsiQzmYBcF_h.5 2024-09-12T18:12:39.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.957+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6396436673657279310', time=2024-09-12T20:11:42.432661+0000, chain.objs.size()=1 2024-09-12T18:12:39.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.957+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.60__shadow_.RYZIXWranA0foM7BGsTq1KLb0h6lBK7_0 2024-09-12T18:12:39.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.965+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:39.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.969+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:12:39.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.973+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:39.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.973+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.973+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:12:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.973+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5856933215242307937', time=2024-09-12T20:06:31.297914+0000, chain.objs.size()=5 2024-09-12T18:12:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.973+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~hB5SMj5Uni62xra994nefZRtIlDJdUc.1 2024-09-12T18:12:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.973+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__shadow_key1.2~hB5SMj5Uni62xra994nefZRtIlDJdUc.1_1 2024-09-12T18:12:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.973+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~hB5SMj5Uni62xra994nefZRtIlDJdUc.2 2024-09-12T18:12:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.973+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__shadow_key1.2~hB5SMj5Uni62xra994nefZRtIlDJdUc.2_1 2024-09-12T18:12:39.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.973+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~hB5SMj5Uni62xra994nefZRtIlDJdUc.3 2024-09-12T18:12:39.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.981+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:39.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.985+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:12:39.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.989+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:39.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.989+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:39.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.989+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:12:39.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.989+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10207512060302556150', time=2024-09-12T20:09:11.313525+0000, chain.objs.size()=11 2024-09-12T18:12:39.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.989+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~MrL58P2WMRf5b9IiRspbgJj_JMH-FND.1 2024-09-12T18:12:39.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.989+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~MrL58P2WMRf5b9IiRspbgJj_JMH-FND.2 2024-09-12T18:12:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.989+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~MrL58P2WMRf5b9IiRspbgJj_JMH-FND.3 2024-09-12T18:12:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.989+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~MrL58P2WMRf5b9IiRspbgJj_JMH-FND.4 2024-09-12T18:12:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.989+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~MrL58P2WMRf5b9IiRspbgJj_JMH-FND.5 2024-09-12T18:12:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.989+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~MrL58P2WMRf5b9IiRspbgJj_JMH-FND.6 2024-09-12T18:12:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.989+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~MrL58P2WMRf5b9IiRspbgJj_JMH-FND.7 2024-09-12T18:12:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.989+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~MrL58P2WMRf5b9IiRspbgJj_JMH-FND.8 2024-09-12T18:12:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.989+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~MrL58P2WMRf5b9IiRspbgJj_JMH-FND.9 2024-09-12T18:12:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.989+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~MrL58P2WMRf5b9IiRspbgJj_JMH-FND.10 2024-09-12T18:12:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:39.989+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~MrL58P2WMRf5b9IiRspbgJj_JMH-FND.11 2024-09-12T18:12:40.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.005+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:40.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.009+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:12:40.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.009+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.009+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.013+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:12:40.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.013+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12133842539138812559', time=2024-09-12T20:06:11.967685+0000, chain.objs.size()=5 2024-09-12T18:12:40.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.013+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~xubgWXB9I2HVQS2JWNqJkkMNSCwTJ4j.1 2024-09-12T18:12:40.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.013+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~xubgWXB9I2HVQS2JWNqJkkMNSCwTJ4j.2 2024-09-12T18:12:40.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.013+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~xubgWXB9I2HVQS2JWNqJkkMNSCwTJ4j.3 2024-09-12T18:12:40.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.013+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~xubgWXB9I2HVQS2JWNqJkkMNSCwTJ4j.4 2024-09-12T18:12:40.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.013+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~xubgWXB9I2HVQS2JWNqJkkMNSCwTJ4j.5 2024-09-12T18:12:40.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.017+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:40.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.021+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:12:40.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.021+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.025+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.025+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:12:40.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.025+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16609100948326961072', time=2024-09-12T20:07:54.028434+0000, chain.objs.size()=5 2024-09-12T18:12:40.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.025+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.53__multipart_file.mpg.2~ildjt9MAc_VbSC1u7E1gufbZp6wUdjt.1 2024-09-12T18:12:40.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.025+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.53__multipart_file.mpg.2~ildjt9MAc_VbSC1u7E1gufbZp6wUdjt.2 2024-09-12T18:12:40.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.025+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.53__multipart_file.mpg.2~ildjt9MAc_VbSC1u7E1gufbZp6wUdjt.3 2024-09-12T18:12:40.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.025+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.53__multipart_file.mpg.2~ildjt9MAc_VbSC1u7E1gufbZp6wUdjt.4 2024-09-12T18:12:40.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.025+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.53__multipart_file.mpg.2~ildjt9MAc_VbSC1u7E1gufbZp6wUdjt.5 2024-09-12T18:12:40.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.025+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10526664738535096980', time=2024-09-12T20:08:48.490841+0000, chain.objs.size()=11 2024-09-12T18:12:40.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.025+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~nxXNQoVnJDRXcealMWib_QzkvGHxhep.1 2024-09-12T18:12:40.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.025+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~nxXNQoVnJDRXcealMWib_QzkvGHxhep.2 2024-09-12T18:12:40.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.025+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~nxXNQoVnJDRXcealMWib_QzkvGHxhep.3 2024-09-12T18:12:40.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.025+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~nxXNQoVnJDRXcealMWib_QzkvGHxhep.4 2024-09-12T18:12:40.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.025+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~nxXNQoVnJDRXcealMWib_QzkvGHxhep.5 2024-09-12T18:12:40.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.025+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~nxXNQoVnJDRXcealMWib_QzkvGHxhep.6 2024-09-12T18:12:40.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.025+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~nxXNQoVnJDRXcealMWib_QzkvGHxhep.7 2024-09-12T18:12:40.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.033+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~nxXNQoVnJDRXcealMWib_QzkvGHxhep.8 2024-09-12T18:12:40.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.033+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~nxXNQoVnJDRXcealMWib_QzkvGHxhep.9 2024-09-12T18:12:40.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.033+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~nxXNQoVnJDRXcealMWib_QzkvGHxhep.10 2024-09-12T18:12:40.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.033+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~nxXNQoVnJDRXcealMWib_QzkvGHxhep.11 2024-09-12T18:12:40.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.033+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16933024988163789323', time=2024-09-12T20:11:43.575395+0000, chain.objs.size()=1 2024-09-12T18:12:40.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.033+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.61__shadow_.LYy2LdEai2e9Zt7BdazjB-b0UeZ1CXJ_0 2024-09-12T18:12:40.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.041+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:40.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.045+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:12:40.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.049+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.049+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.049+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:12:40.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.049+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15800645561814516806', time=2024-09-12T20:09:59.552823+0000, chain.objs.size()=11 2024-09-12T18:12:40.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.049+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~FD4TKCIIJklWXRK37yu8QubBNe3QFDH.1 2024-09-12T18:12:40.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.049+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__shadow_key1.2~FD4TKCIIJklWXRK37yu8QubBNe3QFDH.1_1 2024-09-12T18:12:40.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.049+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~FD4TKCIIJklWXRK37yu8QubBNe3QFDH.2 2024-09-12T18:12:40.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.049+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__shadow_key1.2~FD4TKCIIJklWXRK37yu8QubBNe3QFDH.2_1 2024-09-12T18:12:40.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.049+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~FD4TKCIIJklWXRK37yu8QubBNe3QFDH.3 2024-09-12T18:12:40.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.049+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__shadow_key1.2~FD4TKCIIJklWXRK37yu8QubBNe3QFDH.3_1 2024-09-12T18:12:40.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.049+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~FD4TKCIIJklWXRK37yu8QubBNe3QFDH.4 2024-09-12T18:12:40.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.049+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__shadow_key1.2~FD4TKCIIJklWXRK37yu8QubBNe3QFDH.4_1 2024-09-12T18:12:40.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.049+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~FD4TKCIIJklWXRK37yu8QubBNe3QFDH.5 2024-09-12T18:12:40.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.049+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__shadow_key1.2~FD4TKCIIJklWXRK37yu8QubBNe3QFDH.5_1 2024-09-12T18:12:40.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.049+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~FD4TKCIIJklWXRK37yu8QubBNe3QFDH.6 2024-09-12T18:12:40.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.061+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:40.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.065+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:12:40.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.065+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.065+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.065+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:12:40.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.065+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10896133144076976173', time=2024-09-12T20:11:10.191068+0000, chain.objs.size()=5 2024-09-12T18:12:40.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.065+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.57__multipart_key1.2~oIpTBt89awylncCJhV8Dcc9pv_Y0cp1.1 2024-09-12T18:12:40.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.065+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.57__multipart_key1.2~oIpTBt89awylncCJhV8Dcc9pv_Y0cp1.2 2024-09-12T18:12:40.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.065+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.57__multipart_key1.2~oIpTBt89awylncCJhV8Dcc9pv_Y0cp1.3 2024-09-12T18:12:40.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.065+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.57__multipart_key1.2~oIpTBt89awylncCJhV8Dcc9pv_Y0cp1.4 2024-09-12T18:12:40.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.065+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.57__multipart_key1.2~oIpTBt89awylncCJhV8Dcc9pv_Y0cp1.5 2024-09-12T18:12:40.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.069+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:40.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.077+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:12:40.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.077+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.077+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.077+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:12:40.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.077+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6826658229945819186', time=2024-09-12T20:05:12.102622+0000, chain.objs.size()=5 2024-09-12T18:12:40.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.077+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.44__multipart_key1.2~HDIuYM8N7WUoZad4mD7UsiQzmYBcF_h.1 2024-09-12T18:12:40.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.077+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.44__multipart_key1.2~HDIuYM8N7WUoZad4mD7UsiQzmYBcF_h.2 2024-09-12T18:12:40.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.077+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.44__multipart_key1.2~HDIuYM8N7WUoZad4mD7UsiQzmYBcF_h.3 2024-09-12T18:12:40.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.077+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.44__multipart_key1.2~HDIuYM8N7WUoZad4mD7UsiQzmYBcF_h.4 2024-09-12T18:12:40.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.077+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.44__multipart_key1.2~HDIuYM8N7WUoZad4mD7UsiQzmYBcF_h.5 2024-09-12T18:12:40.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.081+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:40.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.085+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:12:40.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.089+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.089+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.089+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:12:40.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.089+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18073964072144181936', time=2024-09-12T20:10:23.262131+0000, chain.objs.size()=11 2024-09-12T18:12:40.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.089+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~-Z6VS19uoEMbJeBjGf2xmee-DBmi7sU.1 2024-09-12T18:12:40.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.089+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__shadow_key1.2~-Z6VS19uoEMbJeBjGf2xmee-DBmi7sU.1_1 2024-09-12T18:12:40.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.089+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~-Z6VS19uoEMbJeBjGf2xmee-DBmi7sU.2 2024-09-12T18:12:40.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.089+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__shadow_key1.2~-Z6VS19uoEMbJeBjGf2xmee-DBmi7sU.2_1 2024-09-12T18:12:40.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.089+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~-Z6VS19uoEMbJeBjGf2xmee-DBmi7sU.3 2024-09-12T18:12:40.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.089+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__shadow_key1.2~-Z6VS19uoEMbJeBjGf2xmee-DBmi7sU.3_1 2024-09-12T18:12:40.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.089+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~-Z6VS19uoEMbJeBjGf2xmee-DBmi7sU.4 2024-09-12T18:12:40.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.089+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__shadow_key1.2~-Z6VS19uoEMbJeBjGf2xmee-DBmi7sU.4_1 2024-09-12T18:12:40.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.089+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~-Z6VS19uoEMbJeBjGf2xmee-DBmi7sU.5 2024-09-12T18:12:40.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.089+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__shadow_key1.2~-Z6VS19uoEMbJeBjGf2xmee-DBmi7sU.5_1 2024-09-12T18:12:40.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.089+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~-Z6VS19uoEMbJeBjGf2xmee-DBmi7sU.6 2024-09-12T18:12:40.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.097+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:40.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.101+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:12:40.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.105+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.105+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.105+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.105+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:12:40.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.105+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.109+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.109+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:12:40.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.109+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9283381486719658897', time=2024-09-12T20:07:54.295881+0000, chain.objs.size()=1 2024-09-12T18:12:40.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.109+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.53__shadow_.E9DF67M_4P9qVCTnqIFKli5OgoC54_U_0 2024-09-12T18:12:40.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.109+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:40.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.113+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:12:40.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.113+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.113+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.117+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:12:40.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.117+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='2~H9rIac9EcXqTPT3O2RCGtcRjjykwp6B', time=2024-09-12T20:08:01.303536+0000, chain.objs.size()=3 2024-09-12T18:12:40.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.117+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.54__multipart_key1.2~H9rIac9EcXqTPT3O2RCGtcRjjykwp6B.7 2024-09-12T18:12:40.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.117+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.54__multipart_key1.2~H9rIac9EcXqTPT3O2RCGtcRjjykwp6B.10 2024-09-12T18:12:40.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.117+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.54__multipart_key1.2~H9rIac9EcXqTPT3O2RCGtcRjjykwp6B.13 2024-09-12T18:12:40.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.117+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:40.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.121+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:12:40.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.125+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.125+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.125+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:12:40.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.125+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='2~PHarv1jg2nofu9j7KLEnOPKq-FhFVrF', time=2024-09-12T20:04:33.413358+0000, chain.objs.size()=5 2024-09-12T18:12:40.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.125+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.40__multipart_key1.2~PHarv1jg2nofu9j7KLEnOPKq-FhFVrF.1 2024-09-12T18:12:40.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.125+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.40__multipart_key1.2~PHarv1jg2nofu9j7KLEnOPKq-FhFVrF.2 2024-09-12T18:12:40.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.125+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.40__multipart_key1.2~PHarv1jg2nofu9j7KLEnOPKq-FhFVrF.3 2024-09-12T18:12:40.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.125+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.40__multipart_key1.2~PHarv1jg2nofu9j7KLEnOPKq-FhFVrF.4 2024-09-12T18:12:40.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.125+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.40__multipart_key1.2~PHarv1jg2nofu9j7KLEnOPKq-FhFVrF.5 2024-09-12T18:12:40.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.125+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3368284207406991014', time=2024-09-12T20:07:54.127313+0000, chain.objs.size()=1 2024-09-12T18:12:40.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.125+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.53__shadow_.ZjsLzymp3lVdpDv2m3c9Fa6vjVEh911_0 2024-09-12T18:12:40.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.129+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:40.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.133+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:12:40.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.137+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.137+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.137+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:12:40.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.137+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18264320797250247292', time=2024-09-12T20:06:30.223145+0000, chain.objs.size()=5 2024-09-12T18:12:40.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.137+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~P9rB_GRLWZ9-GjLOwIRGXHXebr_nlpD.1 2024-09-12T18:12:40.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.137+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__shadow_key1.2~P9rB_GRLWZ9-GjLOwIRGXHXebr_nlpD.1_1 2024-09-12T18:12:40.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.137+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~P9rB_GRLWZ9-GjLOwIRGXHXebr_nlpD.2 2024-09-12T18:12:40.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.137+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__shadow_key1.2~P9rB_GRLWZ9-GjLOwIRGXHXebr_nlpD.2_1 2024-09-12T18:12:40.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.137+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.47__multipart_key1.2~P9rB_GRLWZ9-GjLOwIRGXHXebr_nlpD.3 2024-09-12T18:12:40.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.137+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18142921555096992529', time=2024-09-12T20:09:35.593923+0000, chain.objs.size()=10 2024-09-12T18:12:40.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.137+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~DbZObBH3UgDfMTzWsctXPJv9IObVKcE.1 2024-09-12T18:12:40.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.137+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~DbZObBH3UgDfMTzWsctXPJv9IObVKcE.2 2024-09-12T18:12:40.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.137+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~DbZObBH3UgDfMTzWsctXPJv9IObVKcE.3 2024-09-12T18:12:40.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.137+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~DbZObBH3UgDfMTzWsctXPJv9IObVKcE.4 2024-09-12T18:12:40.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.137+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~DbZObBH3UgDfMTzWsctXPJv9IObVKcE.5 2024-09-12T18:12:40.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.137+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~DbZObBH3UgDfMTzWsctXPJv9IObVKcE.6 2024-09-12T18:12:40.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.137+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~DbZObBH3UgDfMTzWsctXPJv9IObVKcE.7 2024-09-12T18:12:40.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.141+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~DbZObBH3UgDfMTzWsctXPJv9IObVKcE.8 2024-09-12T18:12:40.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.141+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~DbZObBH3UgDfMTzWsctXPJv9IObVKcE.9 2024-09-12T18:12:40.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.145+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~DbZObBH3UgDfMTzWsctXPJv9IObVKcE.10 2024-09-12T18:12:40.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.145+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.209556313319758831', time=2024-09-12T20:10:45.017863+0000, chain.objs.size()=1 2024-09-12T18:12:40.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.145+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.56__shadow_.8vEYVntMZDDlNnEVJEcTPVnwko4bQxV_0 2024-09-12T18:12:40.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.149+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:40.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.153+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:12:40.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.157+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.157+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.157+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:12:40.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.157+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6964301983724213290', time=2024-09-12T20:07:54.394478+0000, chain.objs.size()=1 2024-09-12T18:12:40.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.157+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.53__shadow_.OfYY6cPCMMQEakQasi4Zfgp8uMoT8GR_0 2024-09-12T18:12:40.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.157+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3', time=2024-09-12T20:11:34.679060+0000, chain.objs.size()=54 2024-09-12T18:12:40.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.157+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.1 2024-09-12T18:12:40.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.157+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.2 2024-09-12T18:12:40.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.157+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.3 2024-09-12T18:12:40.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.157+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.4 2024-09-12T18:12:40.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.157+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.5 2024-09-12T18:12:40.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.157+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.6 2024-09-12T18:12:40.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.157+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.7 2024-09-12T18:12:40.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.157+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.8 2024-09-12T18:12:40.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.157+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.9 2024-09-12T18:12:40.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.157+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.10 2024-09-12T18:12:40.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.157+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.11 2024-09-12T18:12:40.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.161+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.12 2024-09-12T18:12:40.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.161+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.13 2024-09-12T18:12:40.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.161+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.14 2024-09-12T18:12:40.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.161+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.15 2024-09-12T18:12:40.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.161+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.16 2024-09-12T18:12:40.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.161+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.17 2024-09-12T18:12:40.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.161+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.18 2024-09-12T18:12:40.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.161+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.19 2024-09-12T18:12:40.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.161+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.20 2024-09-12T18:12:40.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.161+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.21 2024-09-12T18:12:40.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.161+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.22 2024-09-12T18:12:40.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.169+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.23 2024-09-12T18:12:40.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.169+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.24 2024-09-12T18:12:40.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.169+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.25 2024-09-12T18:12:40.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.169+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.26 2024-09-12T18:12:40.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.169+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.27 2024-09-12T18:12:40.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.169+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.28 2024-09-12T18:12:40.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.169+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.29 2024-09-12T18:12:40.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.169+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.30 2024-09-12T18:12:40.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.169+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.31 2024-09-12T18:12:40.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.169+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.32 2024-09-12T18:12:40.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.169+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.33 2024-09-12T18:12:40.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.173+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.34 2024-09-12T18:12:40.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.177+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.35 2024-09-12T18:12:40.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.177+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.36 2024-09-12T18:12:40.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.177+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.37 2024-09-12T18:12:40.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.177+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.38 2024-09-12T18:12:40.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.177+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.39 2024-09-12T18:12:40.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.177+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.40 2024-09-12T18:12:40.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.177+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.41 2024-09-12T18:12:40.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.177+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.42 2024-09-12T18:12:40.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.177+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.43 2024-09-12T18:12:40.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.177+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.44 2024-09-12T18:12:40.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.181+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.45 2024-09-12T18:12:40.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.181+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.46 2024-09-12T18:12:40.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.181+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.47 2024-09-12T18:12:40.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.181+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.48 2024-09-12T18:12:40.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.181+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.49 2024-09-12T18:12:40.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.185+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.50 2024-09-12T18:12:40.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.185+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.51 2024-09-12T18:12:40.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.185+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.52 2024-09-12T18:12:40.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.185+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.53 2024-09-12T18:12:40.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.185+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.58__multipart_key1.2~7XzRnHmFa8WypHxlfK_HXapQ4TtC2C3.54 2024-09-12T18:12:40.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.185+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9844571051107988297', time=2024-09-12T20:11:41.298634+0000, chain.objs.size()=1 2024-09-12T18:12:40.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.185+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.59__shadow_.yRlC2iLNEMcJXSbnxMP_ZSj_1Y9p50O_0 2024-09-12T18:12:40.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.193+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:40.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.197+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:12:40.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.197+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.197+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.197+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:12:40.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.197+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2018998851449673245', time=2024-09-12T20:11:45.844698+0000, chain.objs.size()=1 2024-09-12T18:12:40.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.197+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.63__shadow_.FEVMxfH2lcD2O7KRdRUeUdnpBXLUst2_0 2024-09-12T18:12:40.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.201+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:40.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.201+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:12:40.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.205+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.205+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.205+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:12:40.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.205+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6228663630256459638', time=2024-09-12T20:06:30.596516+0000, chain.objs.size()=4 2024-09-12T18:12:40.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.205+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.46__shadow_.enm7Dol4yPPA3NwYhffvI6ZH9JLsF05_0 2024-09-12T18:12:40.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.205+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.46__shadow_.enm7Dol4yPPA3NwYhffvI6ZH9JLsF05_1 2024-09-12T18:12:40.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.205+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.46__shadow_.enm7Dol4yPPA3NwYhffvI6ZH9JLsF05_2 2024-09-12T18:12:40.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.205+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.46__shadow_.enm7Dol4yPPA3NwYhffvI6ZH9JLsF05_3 2024-09-12T18:12:40.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.205+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10536465374400576669', time=2024-09-12T20:11:44.720333+0000, chain.objs.size()=1 2024-09-12T18:12:40.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.205+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.62__shadow_.Gs4whyGaA8JWMxb3zpgU-A0fFgmh1dz_0 2024-09-12T18:12:40.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.209+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:40.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.213+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:12:40.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.213+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.213+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.213+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.213+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:12:40.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.217+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.217+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.217+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.217+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:12:40.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.221+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.221+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.221+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.221+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:12:40.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.221+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.225+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.225+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.225+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:12:40.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.225+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.225+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.225+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:12:40.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.225+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8461062395631890498', time=2024-09-12T20:10:23.655082+0000, chain.objs.size()=11 2024-09-12T18:12:40.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.225+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~wCXK2wnEY6C064vL5np91tg4CBpDCF-.1 2024-09-12T18:12:40.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.225+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__shadow_key1.2~wCXK2wnEY6C064vL5np91tg4CBpDCF-.1_1 2024-09-12T18:12:40.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.225+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~wCXK2wnEY6C064vL5np91tg4CBpDCF-.2 2024-09-12T18:12:40.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.225+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__shadow_key1.2~wCXK2wnEY6C064vL5np91tg4CBpDCF-.2_1 2024-09-12T18:12:40.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.225+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~wCXK2wnEY6C064vL5np91tg4CBpDCF-.3 2024-09-12T18:12:40.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.225+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__shadow_key1.2~wCXK2wnEY6C064vL5np91tg4CBpDCF-.3_1 2024-09-12T18:12:40.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.229+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~wCXK2wnEY6C064vL5np91tg4CBpDCF-.4 2024-09-12T18:12:40.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.229+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__shadow_key1.2~wCXK2wnEY6C064vL5np91tg4CBpDCF-.4_1 2024-09-12T18:12:40.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.229+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~wCXK2wnEY6C064vL5np91tg4CBpDCF-.5 2024-09-12T18:12:40.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.229+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__shadow_key1.2~wCXK2wnEY6C064vL5np91tg4CBpDCF-.5_1 2024-09-12T18:12:40.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.229+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.55__multipart_key1.2~wCXK2wnEY6C064vL5np91tg4CBpDCF-.6 2024-09-12T18:12:40.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.233+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:40.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.237+0000 7f41642589c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:12:40.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.237+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.241+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.241+0000 7f41642589c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:12:40.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.241+0000 7f41642589c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11727616682610957598', time=2024-09-12T20:10:49.592455+0000, chain.objs.size()=5 2024-09-12T18:12:40.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.241+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.56__multipart_key1.2~nxtYgZmR8qHhIaufQQoG4iwELW9Nr-c.1 2024-09-12T18:12:40.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.241+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.56__multipart_key1.2~nxtYgZmR8qHhIaufQQoG4iwELW9Nr-c.2 2024-09-12T18:12:40.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.241+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.56__multipart_key1.2~nxtYgZmR8qHhIaufQQoG4iwELW9Nr-c.3 2024-09-12T18:12:40.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.241+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.56__multipart_key1.2~nxtYgZmR8qHhIaufQQoG4iwELW9Nr-c.4 2024-09-12T18:12:40.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.241+0000 7f41642589c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.56__multipart_key1.2~nxtYgZmR8qHhIaufQQoG4iwELW9Nr-c.5 2024-09-12T18:12:40.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.241+0000 7f41642589c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:40.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.249+0000 7f40137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:12:40.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.249+0000 7f41642589c0 20 remove_watcher() i=0 2024-09-12T18:12:40.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.249+0000 7f41642589c0 2 removed watcher, disabling cache 2024-09-12T18:12:40.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.249+0000 7f41642589c0 20 remove_watcher() i=1 2024-09-12T18:12:40.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.253+0000 7f41642589c0 20 remove_watcher() i=2 2024-09-12T18:12:40.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.253+0000 7f41642589c0 20 remove_watcher() i=3 2024-09-12T18:12:40.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.253+0000 7f41642589c0 20 remove_watcher() i=4 2024-09-12T18:12:40.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.257+0000 7f41642589c0 20 remove_watcher() i=5 2024-09-12T18:12:40.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.257+0000 7f41642589c0 20 remove_watcher() i=6 2024-09-12T18:12:40.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.257+0000 7f41642589c0 20 remove_watcher() i=7 2024-09-12T18:12:40.276 DEBUG:teuthology.orchestra.run.smithi098:> radosgw-admin gc process --include-all 2024-09-12T18:12:40.348 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:12:40.348 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:12:40.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.385+0000 7fe3afbcb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:40.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.389+0000 7fe3afbcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:40.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.389+0000 7fe3afbcb9c0 20 realm 2024-09-12T18:12:40.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.389+0000 7fe3afbcb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:40.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.389+0000 7fe3afbcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:40.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.389+0000 7fe3afbcb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:12:40.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.389+0000 7fe3afbcb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:40.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.389+0000 7fe3afbcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:40.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.389+0000 7fe3afbcb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:40.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.389+0000 7fe3afbcb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:12:40.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.389+0000 7fe3afbcb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:40.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.389+0000 7fe3afbcb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:12:40.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.389+0000 7fe3afbcb9c0 20 searching for the correct realm 2024-09-12T18:12:40.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.397+0000 7fe3aced0640 0 -- 172.21.15.98:0/766918217 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fe3a0019040 msgr2=0x7fe3a00263f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:12:40.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.405+0000 7fe3aced0640 0 -- 172.21.15.98:0/766918217 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fe278081180 msgr2=0x7fe2780835b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:12:40.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.409+0000 7fe3afbcb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:12:40.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.409+0000 7fe3afbcb9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:12:40.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.409+0000 7fe3afbcb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:12:40.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.409+0000 7fe3afbcb9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:12:40.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.409+0000 7fe3afbcb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:12:40.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.409+0000 7fe3afbcb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:12:40.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.409+0000 7fe3afbcb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:40.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.409+0000 7fe3afbcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:40.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.409+0000 7fe3afbcb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:40.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.413+0000 7fe3afbcb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:12:40.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.413+0000 7fe3afbcb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:40.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.413+0000 7fe3afbcb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:12:40.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.413+0000 7fe3afbcb9c0 20 zone default found 2024-09-12T18:12:40.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.413+0000 7fe3afbcb9c0 4 Realm: () 2024-09-12T18:12:40.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.413+0000 7fe3afbcb9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:12:40.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.413+0000 7fe3afbcb9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:12:40.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.413+0000 7fe3afbcb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:12:40.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.413+0000 7fe3afbcb9c0 20 zonegroup default 2024-09-12T18:12:40.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.413+0000 7fe3afbcb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:40.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.413+0000 7fe3afbcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:40.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.413+0000 7fe3afbcb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:40.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.413+0000 7fe3afbcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:40.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.413+0000 7fe3afbcb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:40.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.413+0000 7fe3afbcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:40.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.413+0000 7fe3afbcb9c0 20 started sync module instance, tier type = 2024-09-12T18:12:40.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.413+0000 7fe3afbcb9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:12:40.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.429+0000 7fe3afbcb9c0 20 add_watcher() i=0 2024-09-12T18:12:40.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.429+0000 7fe3afbcb9c0 20 add_watcher() i=1 2024-09-12T18:12:40.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.429+0000 7fe3afbcb9c0 20 add_watcher() i=2 2024-09-12T18:12:40.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.429+0000 7fe3afbcb9c0 20 add_watcher() i=3 2024-09-12T18:12:40.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.429+0000 7fe3afbcb9c0 20 add_watcher() i=4 2024-09-12T18:12:40.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.429+0000 7fe3afbcb9c0 20 add_watcher() i=5 2024-09-12T18:12:40.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.429+0000 7fe3afbcb9c0 20 add_watcher() i=6 2024-09-12T18:12:40.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.429+0000 7fe3afbcb9c0 20 add_watcher() i=7 2024-09-12T18:12:40.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.429+0000 7fe3afbcb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:12:40.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.433+0000 7fe2637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:12:40.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.433+0000 7fe3afbcb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:12:40.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.433+0000 7fe3afbcb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:12:40.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.505+0000 7fe2627e4640 20 reqs_thread_entry: start 2024-09-12T18:12:40.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.505+0000 7fe3afbcb9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:12:40.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.505+0000 7fe3afbcb9c0 20 Filter name: none 2024-09-12T18:12:40.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.505+0000 7fe1d3fff640 20 reqs_thread_entry: start 2024-09-12T18:12:40.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.505+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:12:40.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.509+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.509+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.509+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.513+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:12:40.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.517+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.521+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.521+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.521+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:12:40.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.525+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.529+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.529+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.533+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:12:40.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.533+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.537+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.537+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.537+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:12:40.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.541+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.545+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.545+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.549+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:12:40.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.549+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.553+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.553+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.553+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:12:40.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.557+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.557+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.557+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.561+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:12:40.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.565+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.565+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.565+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.569+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:12:40.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.573+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.577+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.577+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.581+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:12:40.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.585+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.585+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.585+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.585+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:12:40.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.589+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.589+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.593+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.593+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:12:40.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.597+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.597+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.597+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.601+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:12:40.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.605+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.605+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.605+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.609+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:12:40.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.613+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.613+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.613+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.617+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:12:40.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.621+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.621+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.621+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.621+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:12:40.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.625+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.629+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.629+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.633+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:12:40.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.633+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.637+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.637+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.641+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:12:40.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.641+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.641+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.641+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.645+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:12:40.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.649+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.649+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.649+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.653+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:12:40.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.657+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.657+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.657+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.661+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:12:40.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.665+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.665+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.665+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.669+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:12:40.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.669+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.673+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.673+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.677+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:12:40.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.677+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.677+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.677+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.681+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:12:40.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.685+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.685+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.685+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.689+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:12:40.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.693+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.697+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.697+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.701+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:12:40.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.701+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.705+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.705+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.705+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:12:40.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.709+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.709+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.709+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.713+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:12:40.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.713+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.717+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.717+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.717+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:12:40.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.721+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.725+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.725+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.729+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:12:40.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.733+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.733+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.733+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.733+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:12:40.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.737+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.741+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.741+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.741+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:12:40.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.745+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.745+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:40.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.745+0000 7fe3afbcb9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:40.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.749+0000 7fe2637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:12:40.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.757+0000 7fe3afbcb9c0 20 remove_watcher() i=0 2024-09-12T18:12:40.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.757+0000 7fe3afbcb9c0 2 removed watcher, disabling cache 2024-09-12T18:12:40.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.757+0000 7fe3afbcb9c0 20 remove_watcher() i=1 2024-09-12T18:12:40.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.761+0000 7fe3afbcb9c0 20 remove_watcher() i=2 2024-09-12T18:12:40.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.765+0000 7fe3afbcb9c0 20 remove_watcher() i=3 2024-09-12T18:12:40.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.765+0000 7fe3afbcb9c0 20 remove_watcher() i=4 2024-09-12T18:12:40.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.765+0000 7fe3afbcb9c0 20 remove_watcher() i=5 2024-09-12T18:12:40.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.769+0000 7fe3afbcb9c0 20 remove_watcher() i=6 2024-09-12T18:12:40.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.769+0000 7fe3afbcb9c0 20 remove_watcher() i=7 2024-09-12T18:12:40.795 DEBUG:teuthology.orchestra.run.smithi098:> radosgw-admin gc process --include-all 2024-09-12T18:12:40.867 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:12:40.868 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:12:40.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.909+0000 7f6fce8b69c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:40.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.909+0000 7f6fce8b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:40.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.909+0000 7f6fce8b69c0 20 realm 2024-09-12T18:12:40.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.909+0000 7f6fce8b69c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:40.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.909+0000 7f6fce8b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:40.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.909+0000 7f6fce8b69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:12:40.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.909+0000 7f6fce8b69c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:40.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.909+0000 7f6fce8b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:40.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.909+0000 7f6fce8b69c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:40.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.913+0000 7f6fce8b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:12:40.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.913+0000 7f6fce8b69c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:40.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.913+0000 7f6fce8b69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:12:40.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.913+0000 7f6fce8b69c0 20 searching for the correct realm 2024-09-12T18:12:40.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.917+0000 7f6fccbbd640 0 -- 172.21.15.98:0/3918992214 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f6fb4018040 msgr2=0x7f6fb40644e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:12:40.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:40.925+0000 7f6fcc3bc640 0 -- 172.21.15.98:0/3918992214 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f6fb4065a70 msgr2=0x7f6fb4098280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:12:41.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.141+0000 7f6fce8b69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:12:41.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.141+0000 7f6fce8b69c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:12:41.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.141+0000 7f6fce8b69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:12:41.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.141+0000 7f6fce8b69c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:12:41.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.141+0000 7f6fce8b69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:12:41.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.141+0000 7f6fce8b69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:12:41.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.141+0000 7f6fce8b69c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:41.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.141+0000 7f6fce8b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:41.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.141+0000 7f6fce8b69c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:41.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.145+0000 7f6fce8b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:12:41.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.145+0000 7f6fce8b69c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:41.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.145+0000 7f6fce8b69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:12:41.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.145+0000 7f6fce8b69c0 20 zone default found 2024-09-12T18:12:41.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.145+0000 7f6fce8b69c0 4 Realm: () 2024-09-12T18:12:41.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.145+0000 7f6fce8b69c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:12:41.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.145+0000 7f6fce8b69c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:12:41.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.145+0000 7f6fce8b69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:12:41.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.145+0000 7f6fce8b69c0 20 zonegroup default 2024-09-12T18:12:41.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.145+0000 7f6fce8b69c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:41.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.145+0000 7f6fce8b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:41.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.145+0000 7f6fce8b69c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:41.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.145+0000 7f6fce8b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:41.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.145+0000 7f6fce8b69c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:41.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.145+0000 7f6fce8b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:41.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.145+0000 7f6fce8b69c0 20 started sync module instance, tier type = 2024-09-12T18:12:41.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.145+0000 7f6fce8b69c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:12:41.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.169+0000 7f6fce8b69c0 20 add_watcher() i=0 2024-09-12T18:12:41.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.169+0000 7f6fce8b69c0 20 add_watcher() i=1 2024-09-12T18:12:41.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.169+0000 7f6fce8b69c0 20 add_watcher() i=2 2024-09-12T18:12:41.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.169+0000 7f6fce8b69c0 20 add_watcher() i=3 2024-09-12T18:12:41.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.169+0000 7f6fce8b69c0 20 add_watcher() i=4 2024-09-12T18:12:41.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.169+0000 7f6fce8b69c0 20 add_watcher() i=5 2024-09-12T18:12:41.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.169+0000 7f6fce8b69c0 20 add_watcher() i=6 2024-09-12T18:12:41.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.173+0000 7f6fce8b69c0 20 add_watcher() i=7 2024-09-12T18:12:41.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.173+0000 7f6fce8b69c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:12:41.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.173+0000 7f6e837de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:12:41.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.177+0000 7f6fce8b69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:12:41.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.177+0000 7f6fce8b69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:12:41.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.261+0000 7f6e827dc640 20 reqs_thread_entry: start 2024-09-12T18:12:41.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.265+0000 7f6fce8b69c0 20 init_complete bucket index max shards: 11 2024-09-12T18:12:41.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.265+0000 7f6fce8b69c0 20 Filter name: none 2024-09-12T18:12:41.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.265+0000 7f6e7b7fe640 20 reqs_thread_entry: start 2024-09-12T18:12:41.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.265+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:12:41.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.265+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.269+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.269+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.273+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:12:41.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.273+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.277+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.277+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.277+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:12:41.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.281+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.281+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.281+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.285+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:12:41.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.289+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.289+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.289+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.289+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:12:41.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.293+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.293+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.297+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.297+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:12:41.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.301+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.305+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.305+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.309+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:12:41.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.313+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.313+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.317+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.317+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:12:41.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.321+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.321+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.321+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.325+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:12:41.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.325+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.329+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.329+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.329+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:12:41.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.333+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.333+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.333+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.337+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:12:41.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.341+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.341+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.341+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.345+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:12:41.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.349+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.349+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.349+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.353+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:12:41.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.357+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.357+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.357+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.361+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:12:41.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.365+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.365+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.365+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.369+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:12:41.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.373+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.373+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.377+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.377+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:12:41.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.381+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.385+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.385+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.385+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:12:41.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.389+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.393+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.393+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.397+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:12:41.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.401+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.401+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.405+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.405+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:12:41.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.409+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.413+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.413+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.413+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:12:41.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.421+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.421+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.421+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.425+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:12:41.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.429+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.433+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.433+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.433+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:12:41.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.437+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.441+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.441+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.445+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:12:41.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.449+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.449+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.449+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.457+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:12:41.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.461+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.461+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.461+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.465+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:12:41.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.469+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.469+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.469+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.473+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:12:41.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.477+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.481+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.481+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.485+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:12:41.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.489+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.489+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.489+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.493+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:12:41.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.497+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.497+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.497+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.501+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:12:41.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.505+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.505+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.505+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.509+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:12:41.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.513+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.513+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.513+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.517+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:12:41.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.521+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.521+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.525+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.525+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:12:41.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.529+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.529+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:41.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.533+0000 7f6fce8b69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:41.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.537+0000 7f6e837de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:12:41.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.541+0000 7f6fce8b69c0 20 remove_watcher() i=0 2024-09-12T18:12:41.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.541+0000 7f6fce8b69c0 2 removed watcher, disabling cache 2024-09-12T18:12:41.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.545+0000 7f6fce8b69c0 20 remove_watcher() i=1 2024-09-12T18:12:41.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.545+0000 7f6fce8b69c0 20 remove_watcher() i=2 2024-09-12T18:12:41.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.549+0000 7f6fce8b69c0 20 remove_watcher() i=3 2024-09-12T18:12:41.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.549+0000 7f6fce8b69c0 20 remove_watcher() i=4 2024-09-12T18:12:41.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.553+0000 7f6fce8b69c0 20 remove_watcher() i=5 2024-09-12T18:12:41.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.553+0000 7f6fce8b69c0 20 remove_watcher() i=6 2024-09-12T18:12:41.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.557+0000 7f6fce8b69c0 20 remove_watcher() i=7 2024-09-12T18:12:41.579 DEBUG:teuthology.orchestra.run.smithi098:> radosgw-admin gc process --include-all 2024-09-12T18:12:41.651 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:12:41.652 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:12:41.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.693+0000 7f10c2a419c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:41.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.693+0000 7f10c2a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:41.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.693+0000 7f10c2a419c0 20 realm 2024-09-12T18:12:41.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.693+0000 7f10c2a419c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:41.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.693+0000 7f10c2a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:41.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.693+0000 7f10c2a419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:12:41.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.693+0000 7f10c2a419c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:41.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.693+0000 7f10c2a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:41.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.693+0000 7f10c2a419c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:41.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.697+0000 7f10c2a419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:12:41.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.697+0000 7f10c2a419c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:41.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.697+0000 7f10c2a419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:12:41.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.697+0000 7f10c2a419c0 20 searching for the correct realm 2024-09-12T18:12:41.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.701+0000 7f10c0547640 0 -- 172.21.15.98:0/2493222892 >> [v2:172.21.15.98:6816/1225764258,v1:172.21.15.98:6817/1225764258] conn(0x7f10a8003cc0 msgr2=0x7f10b005da70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:12:41.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.913+0000 7f10c0d48640 0 -- 172.21.15.98:0/2493222892 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f10b411d2d0 msgr2=0x7f10b4114040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:12:41.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.933+0000 7f10c2a419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:12:41.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.933+0000 7f10c2a419c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:12:41.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.933+0000 7f10c2a419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:12:41.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.933+0000 7f10c2a419c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:12:41.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.933+0000 7f10c2a419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:12:41.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.933+0000 7f10c2a419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:12:41.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.933+0000 7f10c2a419c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:41.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.933+0000 7f10c2a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:41.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.933+0000 7f10c2a419c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:41.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.933+0000 7f10c2a419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:12:41.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.933+0000 7f10c2a419c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:41.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.937+0000 7f10c2a419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:12:41.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.937+0000 7f10c2a419c0 20 zone default found 2024-09-12T18:12:41.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.937+0000 7f10c2a419c0 4 Realm: () 2024-09-12T18:12:41.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.937+0000 7f10c2a419c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:12:41.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.937+0000 7f10c2a419c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:12:41.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.937+0000 7f10c2a419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:12:41.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.937+0000 7f10c2a419c0 20 zonegroup default 2024-09-12T18:12:41.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.937+0000 7f10c2a419c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:41.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.937+0000 7f10c2a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:41.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.937+0000 7f10c2a419c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:41.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.937+0000 7f10c2a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:41.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.937+0000 7f10c2a419c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:41.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.937+0000 7f10c2a419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:41.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.937+0000 7f10c2a419c0 20 started sync module instance, tier type = 2024-09-12T18:12:41.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.937+0000 7f10c2a419c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:12:41.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.961+0000 7f10c2a419c0 20 add_watcher() i=0 2024-09-12T18:12:41.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.961+0000 7f10c2a419c0 20 add_watcher() i=1 2024-09-12T18:12:41.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.961+0000 7f10c2a419c0 20 add_watcher() i=2 2024-09-12T18:12:41.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.961+0000 7f10c2a419c0 20 add_watcher() i=3 2024-09-12T18:12:41.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.961+0000 7f10c2a419c0 20 add_watcher() i=4 2024-09-12T18:12:41.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.961+0000 7f10c2a419c0 20 add_watcher() i=5 2024-09-12T18:12:41.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.961+0000 7f10c2a419c0 20 add_watcher() i=6 2024-09-12T18:12:41.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.965+0000 7f10c2a419c0 20 add_watcher() i=7 2024-09-12T18:12:41.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.965+0000 7f10c2a419c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:12:41.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.969+0000 7f0f76fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:12:41.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.969+0000 7f10c2a419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:12:41.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:41.969+0000 7f10c2a419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:12:42.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.057+0000 7f0f75fdb640 20 reqs_thread_entry: start 2024-09-12T18:12:42.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.061+0000 7f10c2a419c0 20 init_complete bucket index max shards: 11 2024-09-12T18:12:42.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.061+0000 7f10c2a419c0 20 Filter name: none 2024-09-12T18:12:42.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.061+0000 7f0ee77fe640 20 reqs_thread_entry: start 2024-09-12T18:12:42.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.061+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:12:42.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.065+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.065+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.065+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.069+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:12:42.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.073+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.073+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.073+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.077+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:12:42.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.077+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.077+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.077+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.081+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:12:42.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.081+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.085+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.085+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.085+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:12:42.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.089+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.089+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.089+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.093+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:12:42.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.093+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.097+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.097+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.097+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:12:42.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.101+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.101+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.101+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.105+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:12:42.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.109+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.109+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.109+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.113+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:12:42.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.117+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.117+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.117+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.121+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:12:42.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.125+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.125+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.129+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.129+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:12:42.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.133+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.133+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.133+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.137+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:12:42.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.141+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.141+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.141+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.145+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:12:42.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.149+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.149+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.153+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.153+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:12:42.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.157+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.161+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.161+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.165+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:12:42.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.165+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.165+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.169+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.169+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:12:42.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.173+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.173+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.173+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.177+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:12:42.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.181+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.181+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.181+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.185+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:12:42.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.189+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.189+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.189+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.193+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:12:42.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.193+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.197+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.197+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.201+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:12:42.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.205+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.205+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.205+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.209+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:12:42.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.213+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.213+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.213+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.217+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:12:42.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.221+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.221+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.221+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.225+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:12:42.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.229+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.229+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.229+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.229+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:12:42.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.233+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.237+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.237+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.241+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:12:42.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.245+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.245+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.245+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.249+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:12:42.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.253+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.253+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.253+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.257+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:12:42.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.261+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.261+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.261+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.265+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:12:42.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.269+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.269+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.269+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.273+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:12:42.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.277+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.277+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.277+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.277+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:12:42.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.281+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.285+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.285+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.285+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:12:42.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.289+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.293+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.293+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.293+0000 7f10c2a419c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:12:42.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.301+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.301+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:42.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.301+0000 7f10c2a419c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:42.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.305+0000 7f0f76fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:12:42.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.313+0000 7f10c2a419c0 20 remove_watcher() i=0 2024-09-12T18:12:42.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.313+0000 7f10c2a419c0 2 removed watcher, disabling cache 2024-09-12T18:12:42.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.313+0000 7f10c2a419c0 20 remove_watcher() i=1 2024-09-12T18:12:42.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.317+0000 7f10c2a419c0 20 remove_watcher() i=2 2024-09-12T18:12:42.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.321+0000 7f10c2a419c0 20 remove_watcher() i=3 2024-09-12T18:12:42.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.321+0000 7f10c2a419c0 20 remove_watcher() i=4 2024-09-12T18:12:42.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.325+0000 7f10c2a419c0 20 remove_watcher() i=5 2024-09-12T18:12:42.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.325+0000 7f10c2a419c0 20 remove_watcher() i=6 2024-09-12T18:12:42.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:42.329+0000 7f10c2a419c0 20 remove_watcher() i=7 2024-09-12T18:12:42.353 DEBUG:teuthology.orchestra.run.smithi098:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T18:12:43.055 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :clean 2024-09-12T18:12:43.853 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :compileJava 2024-09-12T18:12:43.853 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :processResources 2024-09-12T18:12:43.853 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :classes 2024-09-12T18:12:44.353 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:44.353 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :compileTestJava 2024-09-12T18:12:44.354 INFO:teuthology.orchestra.run.smithi098.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T18:12:44.354 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:44.354 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T18:12:44.354 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :testClasses 2024-09-12T18:12:44.354 INFO:teuthology.orchestra.run.smithi098.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T18:12:46.354 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:46.354 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :test 2024-09-12T18:12:46.354 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:46.354 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T18:12:46.354 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12 18:12:45,811 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T18:12:46.354 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:46.354 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T18:12:46.354 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:46.355 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T18:12:46.953 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:46.953 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T18:12:47.053 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:47.053 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T18:12:47.753 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:47.753 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T18:12:47.853 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:47.853 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T18:12:48.553 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:48.553 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T18:12:49.153 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:49.153 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T18:12:49.253 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:49.253 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T18:12:49.653 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:49.653 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T18:12:50.353 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:50.453 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T18:12:50.453 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:50.453 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T18:12:50.653 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:50.653 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T18:12:51.053 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:51.053 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T18:12:52.353 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:52.353 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T18:12:52.553 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:52.553 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T18:12:53.253 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:53.253 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T18:12:53.353 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:53.353 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T18:12:53.552 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:53.552 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------- 2024-09-12T18:12:53.552 INFO:teuthology.orchestra.run.smithi098.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T18:12:53.552 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------- 2024-09-12T18:12:53.552 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:53.552 INFO:teuthology.orchestra.run.smithi098.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T18:12:53.552 INFO:teuthology.orchestra.run.smithi098.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T18:12:53.552 INFO:teuthology.orchestra.run.smithi098.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T18:12:53.553 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:53.553 INFO:teuthology.orchestra.run.smithi098.stdout:BUILD SUCCESSFUL in 11s 2024-09-12T18:12:53.553 INFO:teuthology.orchestra.run.smithi098.stdout:5 actionable tasks: 5 executed 2024-09-12T18:12:53.562 DEBUG:teuthology.orchestra.run.smithi098:> radosgw-admin gc process --include-all 2024-09-12T18:12:53.589 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:12:53.590 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:12:53.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.633+0000 7fdb992cf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:53.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.633+0000 7fdb992cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:53.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.633+0000 7fdb992cf9c0 20 realm 2024-09-12T18:12:53.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.633+0000 7fdb992cf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:53.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.637+0000 7fdb992cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:53.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.637+0000 7fdb992cf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:12:53.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.637+0000 7fdb992cf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:53.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.637+0000 7fdb992cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:53.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.637+0000 7fdb992cf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:53.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.637+0000 7fdb992cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:12:53.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.637+0000 7fdb992cf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:53.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.637+0000 7fdb992cf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:12:53.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.637+0000 7fdb992cf9c0 20 searching for the correct realm 2024-09-12T18:12:53.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.645+0000 7fdb975d6640 0 -- 172.21.15.98:0/2590663245 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7fdb800ac550 msgr2=0x7fdb800c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:12:53.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.861+0000 7fdb96dd5640 0 -- 172.21.15.98:0/2590663245 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x559cb9a05110 msgr2=0x559cb9a07540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:12:53.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:12:53.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:12:53.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:12:53.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:12:53.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:12:53.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:12:53.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:53.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:53.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:53.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:12:53.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:53.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:12:53.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 20 zone default found 2024-09-12T18:12:53.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 4 Realm: () 2024-09-12T18:12:53.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:12:53.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:12:53.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:12:53.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 20 zonegroup default 2024-09-12T18:12:53.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:53.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:53.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.869+0000 7fdb992cf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:53.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.873+0000 7fdb992cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:53.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.873+0000 7fdb992cf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:53.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.873+0000 7fdb992cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:53.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.873+0000 7fdb992cf9c0 20 started sync module instance, tier type = 2024-09-12T18:12:53.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.873+0000 7fdb992cf9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:12:53.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.897+0000 7fdb992cf9c0 20 add_watcher() i=0 2024-09-12T18:12:53.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.897+0000 7fdb992cf9c0 20 add_watcher() i=1 2024-09-12T18:12:53.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.897+0000 7fdb992cf9c0 20 add_watcher() i=2 2024-09-12T18:12:53.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.897+0000 7fdb992cf9c0 20 add_watcher() i=3 2024-09-12T18:12:53.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.897+0000 7fdb992cf9c0 20 add_watcher() i=4 2024-09-12T18:12:53.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.897+0000 7fdb992cf9c0 20 add_watcher() i=5 2024-09-12T18:12:53.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.897+0000 7fdb992cf9c0 20 add_watcher() i=6 2024-09-12T18:12:53.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.897+0000 7fdb992cf9c0 20 add_watcher() i=7 2024-09-12T18:12:53.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.897+0000 7fdb992cf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:12:53.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.901+0000 7fda4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:12:53.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.901+0000 7fdb992cf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:12:53.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.901+0000 7fdb992cf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:12:54.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.997+0000 7fd9c7fff640 20 reqs_thread_entry: start 2024-09-12T18:12:54.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.997+0000 7fdb992cf9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:12:54.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.997+0000 7fdb992cf9c0 20 Filter name: none 2024-09-12T18:12:54.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.997+0000 7fd9c5ffb640 20 reqs_thread_entry: start 2024-09-12T18:12:54.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:53.997+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:12:54.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.001+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.001+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.001+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:12:54.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.001+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15331186951731795270', time=2024-09-12T20:12:51.264806+0000, chain.objs.size()=1 2024-09-12T18:12:54.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.001+0000 7fdb992cf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.72__shadow_._8GAps27pACxGr3KbEjpvpTpe_w9Pqx_0 2024-09-12T18:12:54.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.005+0000 7fdb992cf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:54.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.009+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:12:54.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.009+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.013+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.013+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.017+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:12:54.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.017+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.017+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.017+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.021+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:12:54.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.021+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.021+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.021+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.025+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:12:54.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.029+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.029+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.029+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.033+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:12:54.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.033+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.033+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.033+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.041 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.037+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:12:54.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.041+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.041+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.041+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.041+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:12:54.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.045+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.045+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.045+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.049+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:12:54.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.053+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.053+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.057+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.057+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:12:54.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.061+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.061+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.065+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.065+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:12:54.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.069+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.069+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.069+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.073+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:12:54.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.077+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.077+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.077+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.081+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:12:54.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.085+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.085+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.085+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.089+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:12:54.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.093+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.093+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.093+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.097+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:12:54.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.101+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.101+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.105+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.105+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:12:54.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.109+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.109+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.109+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.113+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:12:54.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.117+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.117+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.121+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.121+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:12:54.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.125+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.129+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.129+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.129+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:12:54.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.133+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.133+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.137+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.137+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:12:54.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.141+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.145+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.145+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.149+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:12:54.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.153+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.153+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.157+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.157+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:12:54.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.161+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.165+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.165+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.165+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:12:54.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.173+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.173+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.173+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.177+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:12:54.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.181+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.181+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.181+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:12:54.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.181+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1568504547283497245', time=2024-09-12T20:12:49.819389+0000, chain.objs.size()=1 2024-09-12T18:12:54.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.181+0000 7fdb992cf9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.71__shadow_.C7mVtR6hAjJ02l543dNjfc2vLexvJap_0 2024-09-12T18:12:54.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.185+0000 7fdb992cf9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:12:54.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.193+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:12:54.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.197+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.197+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.197+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.201+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:12:54.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.205+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.205+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.205+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.209+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:12:54.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.213+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.217+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.217+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.217+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:12:54.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.221+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.225+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.225+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.225+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:12:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.229+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.233+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.233+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.233+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:12:54.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.237+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.237+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.237+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.241+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:12:54.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.245+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.245+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.245+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.249+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:12:54.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.253+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.257+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.257+0000 7fdb992cf9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.261+0000 7fda4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:12:54.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.265+0000 7fdb992cf9c0 20 remove_watcher() i=0 2024-09-12T18:12:54.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.265+0000 7fdb992cf9c0 2 removed watcher, disabling cache 2024-09-12T18:12:54.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.269+0000 7fdb992cf9c0 20 remove_watcher() i=1 2024-09-12T18:12:54.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.273+0000 7fdb992cf9c0 20 remove_watcher() i=2 2024-09-12T18:12:54.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.273+0000 7fdb992cf9c0 20 remove_watcher() i=3 2024-09-12T18:12:54.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.277+0000 7fdb992cf9c0 20 remove_watcher() i=4 2024-09-12T18:12:54.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.277+0000 7fdb992cf9c0 20 remove_watcher() i=5 2024-09-12T18:12:54.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.281+0000 7fdb992cf9c0 20 remove_watcher() i=6 2024-09-12T18:12:54.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.281+0000 7fdb992cf9c0 20 remove_watcher() i=7 2024-09-12T18:12:54.304 DEBUG:teuthology.orchestra.run.smithi098:> radosgw-admin gc process --include-all 2024-09-12T18:12:54.379 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:12:54.379 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:12:54.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.421+0000 7ff41f33e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:54.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.421+0000 7ff41f33e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:54.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.421+0000 7ff41f33e9c0 20 realm 2024-09-12T18:12:54.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.421+0000 7ff41f33e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:54.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.421+0000 7ff41f33e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:54.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.421+0000 7ff41f33e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:12:54.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.421+0000 7ff41f33e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:54.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.421+0000 7ff41f33e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:54.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.421+0000 7ff41f33e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:54.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.425+0000 7ff41f33e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:12:54.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.425+0000 7ff41f33e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:54.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.425+0000 7ff41f33e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:12:54.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.425+0000 7ff41f33e9c0 20 searching for the correct realm 2024-09-12T18:12:54.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.429+0000 7ff41c643640 0 -- 172.21.15.98:0/2590454604 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x560f06511cc0 msgr2=0x560f06514180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:12:54.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.437+0000 7ff41c643640 0 -- 172.21.15.98:0/2590454604 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7ff40c066b00 msgr2=0x7ff40c07b9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:12:54.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:12:54.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:12:54.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:12:54.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:12:54.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:12:54.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:12:54.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:54.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:54.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:54.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:12:54.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:54.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:12:54.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 zone default found 2024-09-12T18:12:54.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 4 Realm: () 2024-09-12T18:12:54.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:12:54.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:12:54.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:12:54.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 zonegroup default 2024-09-12T18:12:54.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:54.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:54.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:54.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:54.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:54.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:54.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 started sync module instance, tier type = 2024-09-12T18:12:54.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.445+0000 7ff41f33e9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:12:54.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.461+0000 7ff41f33e9c0 20 add_watcher() i=0 2024-09-12T18:12:54.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.461+0000 7ff41f33e9c0 20 add_watcher() i=1 2024-09-12T18:12:54.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.461+0000 7ff41f33e9c0 20 add_watcher() i=2 2024-09-12T18:12:54.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.461+0000 7ff41f33e9c0 20 add_watcher() i=3 2024-09-12T18:12:54.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.461+0000 7ff41f33e9c0 20 add_watcher() i=4 2024-09-12T18:12:54.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.461+0000 7ff41f33e9c0 20 add_watcher() i=5 2024-09-12T18:12:54.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.461+0000 7ff41f33e9c0 20 add_watcher() i=6 2024-09-12T18:12:54.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.461+0000 7ff41f33e9c0 20 add_watcher() i=7 2024-09-12T18:12:54.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.461+0000 7ff41f33e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:12:54.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.465+0000 7ff2d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:12:54.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.465+0000 7ff41f33e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:12:54.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.465+0000 7ff41f33e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:12:54.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.537+0000 7ff2d27e4640 20 reqs_thread_entry: start 2024-09-12T18:12:54.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.537+0000 7ff41f33e9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:12:54.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.537+0000 7ff41f33e9c0 20 Filter name: none 2024-09-12T18:12:54.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.537+0000 7ff2cb7fe640 20 reqs_thread_entry: start 2024-09-12T18:12:54.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.537+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:12:54.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.541+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.541+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.541+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.541+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:12:54.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.545+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.549+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.549+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.553+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:12:54.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.553+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.553+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.553+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.557+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:12:54.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.557+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.561+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.561+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.561+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:12:54.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.565+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.565+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.569+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.569+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:12:54.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.573+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.577+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.577+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.581+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:12:54.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.581+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.581+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.581+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.585+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:12:54.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.589+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.593+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.593+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.593+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:12:54.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.597+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.597+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.601+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.601+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:12:54.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.605+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.609+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.609+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.613+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:12:54.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.617+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.617+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.617+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.621+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:12:54.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.625+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.625+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.625+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.629+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:12:54.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.633+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.633+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.633+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.637+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:12:54.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.637+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.641+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.641+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.641+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:12:54.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.645+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.645+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.649+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.649+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:12:54.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.653+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.653+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.653+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.657+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:12:54.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.661+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.661+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.665+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.665+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:12:54.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.669+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.669+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.669+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.673+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:12:54.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.677+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.677+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.681+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.681+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:12:54.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.685+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.685+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.685+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.689+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:12:54.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.689+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.693+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.693+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.693+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:12:54.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.697+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.697+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.701+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.701+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:12:54.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.705+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.705+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.705+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.709+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:12:54.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.709+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.709+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.709+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.713+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:12:54.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.717+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.717+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.717+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.721+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:12:54.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.721+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.725+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.725+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.729+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:12:54.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.729+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.733+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.733+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.733+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:12:54.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.737+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.737+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.737+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.741+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:12:54.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.745+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.745+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.745+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.749+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:12:54.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.753+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.753+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.757+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.757+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:12:54.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.761+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.765+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.765+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.765+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:12:54.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.769+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.773+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:54.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.773+0000 7ff41f33e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:54.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.777+0000 7ff2d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:12:54.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.781+0000 7ff41f33e9c0 20 remove_watcher() i=0 2024-09-12T18:12:54.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.781+0000 7ff41f33e9c0 2 removed watcher, disabling cache 2024-09-12T18:12:54.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.785+0000 7ff41f33e9c0 20 remove_watcher() i=1 2024-09-12T18:12:54.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.789+0000 7ff41f33e9c0 20 remove_watcher() i=2 2024-09-12T18:12:54.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.789+0000 7ff41f33e9c0 20 remove_watcher() i=3 2024-09-12T18:12:54.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.793+0000 7ff41f33e9c0 20 remove_watcher() i=4 2024-09-12T18:12:54.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.793+0000 7ff41f33e9c0 20 remove_watcher() i=5 2024-09-12T18:12:54.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.797+0000 7ff41f33e9c0 20 remove_watcher() i=6 2024-09-12T18:12:54.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:54.797+0000 7ff41f33e9c0 20 remove_watcher() i=7 2024-09-12T18:12:54.819 DEBUG:teuthology.orchestra.run.smithi098:> radosgw-admin gc process --include-all 2024-09-12T18:12:54.891 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:12:54.892 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:12:55.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.117+0000 7fe5423b9640 0 --2- 172.21.15.98:0/605856823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565468a001f0 0x565468a2abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T18:12:55.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.141+0000 7fe5450b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.145+0000 7fe5450b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:55.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.145+0000 7fe5450b49c0 20 realm 2024-09-12T18:12:55.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.145+0000 7fe5450b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.145+0000 7fe5450b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:55.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.145+0000 7fe5450b49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:12:55.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.145+0000 7fe5450b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.145+0000 7fe5450b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:55.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.145+0000 7fe5450b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.145+0000 7fe5450b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:12:55.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.145+0000 7fe5450b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.145+0000 7fe5450b49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:12:55.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.145+0000 7fe5450b49c0 20 searching for the correct realm 2024-09-12T18:12:55.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.145+0000 7fe5423b9640 0 -- 172.21.15.98:0/1973551402 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x565468ae54d0 msgr2=0x565468ae7970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:12:55.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.153+0000 7fe5423b9640 0 -- 172.21.15.98:0/1973551402 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x7fe40c081180 msgr2=0x7fe40c0835b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:12:55.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:12:55.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:12:55.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:12:55.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:12:55.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:12:55.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:12:55.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:55.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:12:55.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:12:55.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 20 zone default found 2024-09-12T18:12:55.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 4 Realm: () 2024-09-12T18:12:55.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:12:55.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:12:55.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:12:55.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 20 zonegroup default 2024-09-12T18:12:55.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:55.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.169+0000 7fe5450b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.173+0000 7fe5450b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:55.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.173+0000 7fe5450b49c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.173+0000 7fe5450b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:55.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.173+0000 7fe5450b49c0 20 started sync module instance, tier type = 2024-09-12T18:12:55.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.173+0000 7fe5450b49c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:12:55.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.189+0000 7fe5450b49c0 20 add_watcher() i=0 2024-09-12T18:12:55.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.189+0000 7fe5450b49c0 20 add_watcher() i=1 2024-09-12T18:12:55.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.189+0000 7fe5450b49c0 20 add_watcher() i=2 2024-09-12T18:12:55.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.189+0000 7fe5450b49c0 20 add_watcher() i=3 2024-09-12T18:12:55.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.189+0000 7fe5450b49c0 20 add_watcher() i=4 2024-09-12T18:12:55.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.189+0000 7fe5450b49c0 20 add_watcher() i=5 2024-09-12T18:12:55.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.189+0000 7fe5450b49c0 20 add_watcher() i=6 2024-09-12T18:12:55.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.189+0000 7fe5450b49c0 20 add_watcher() i=7 2024-09-12T18:12:55.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.189+0000 7fe5450b49c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:12:55.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.193+0000 7fe3f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:12:55.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.193+0000 7fe5450b49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:12:55.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.193+0000 7fe5450b49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:12:55.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.269+0000 7fe373fff640 20 reqs_thread_entry: start 2024-09-12T18:12:55.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.269+0000 7fe5450b49c0 20 init_complete bucket index max shards: 11 2024-09-12T18:12:55.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.269+0000 7fe5450b49c0 20 Filter name: none 2024-09-12T18:12:55.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.269+0000 7fe371ffb640 20 reqs_thread_entry: start 2024-09-12T18:12:55.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.269+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:12:55.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.273+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.273+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.273+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.277+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:12:55.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.281+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.281+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.281+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.285+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:12:55.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.289+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.289+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.289+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.293+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:12:55.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.297+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.297+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.297+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.297+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:12:55.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.301+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.301+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.305+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.305+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:12:55.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.309+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.309+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.309+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.313+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:12:55.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.313+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.317+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.317+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.321+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:12:55.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.321+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.325+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.325+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.329+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:12:55.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.329+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.329+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.333+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.333+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:12:55.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.337+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.337+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.341+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.341+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:12:55.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.345+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.345+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.345+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.349+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:12:55.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.353+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.353+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.353+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.353+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:12:55.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.357+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.357+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.357+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.361+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:12:55.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.365+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.365+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.365+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.369+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:12:55.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.373+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.373+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.373+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.377+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:12:55.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.377+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.381+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.381+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.385+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:12:55.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.385+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.389+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.389+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.389+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:12:55.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.393+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.393+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.393+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.397+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:12:55.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.397+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.401+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.401+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.405+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:12:55.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.409+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.409+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.409+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.409+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:12:55.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.413+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.417+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.417+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.421+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:12:55.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.421+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.425+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.425+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.425+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:12:55.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.429+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.433+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.433+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.437+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:12:55.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.437+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.437+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.437+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.441+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:12:55.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.445+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.445+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.445+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.449+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:12:55.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.453+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.453+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.457+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.457+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:12:55.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.461+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.461+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.465+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.465+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:12:55.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.469+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.469+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.473+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.473+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:12:55.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.477+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.481+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.481+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.485+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:12:55.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.485+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.489+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.489+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.489+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:12:55.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.493+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.497+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.497+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.501+0000 7fe5450b49c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:12:55.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.501+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.501+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.505+0000 7fe5450b49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.509+0000 7fe3f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:12:55.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.513+0000 7fe5450b49c0 20 remove_watcher() i=0 2024-09-12T18:12:55.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.513+0000 7fe5450b49c0 2 removed watcher, disabling cache 2024-09-12T18:12:55.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.517+0000 7fe5450b49c0 20 remove_watcher() i=1 2024-09-12T18:12:55.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.517+0000 7fe5450b49c0 20 remove_watcher() i=2 2024-09-12T18:12:55.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.521+0000 7fe5450b49c0 20 remove_watcher() i=3 2024-09-12T18:12:55.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.521+0000 7fe5450b49c0 20 remove_watcher() i=4 2024-09-12T18:12:55.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.525+0000 7fe5450b49c0 20 remove_watcher() i=5 2024-09-12T18:12:55.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.525+0000 7fe5450b49c0 20 remove_watcher() i=6 2024-09-12T18:12:55.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.529+0000 7fe5450b49c0 20 remove_watcher() i=7 2024-09-12T18:12:55.550 DEBUG:teuthology.orchestra.run.smithi098:> radosgw-admin gc process --include-all 2024-09-12T18:12:55.620 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:12:55.620 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:12:55.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.661+0000 7f530e8319c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.661+0000 7f530e8319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:55.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.661+0000 7f530e8319c0 20 realm 2024-09-12T18:12:55.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.661+0000 7f530e8319c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.661+0000 7f530e8319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:55.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.661+0000 7f530e8319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:12:55.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.661+0000 7f530e8319c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.661+0000 7f530e8319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:55.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.661+0000 7f530e8319c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.665+0000 7f530e8319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:12:55.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.665+0000 7f530e8319c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.665+0000 7f530e8319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:12:55.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.665+0000 7f530e8319c0 20 searching for the correct realm 2024-09-12T18:12:55.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.673+0000 7f530bb36640 0 -- 172.21.15.98:0/1006679953 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f52fc0ee030 msgr2=0x7f52fc007730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:12:55.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.677+0000 7f530cb38640 0 -- 172.21.15.98:0/1006679953 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f530003b930 msgr2=0x7f5300039400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:12:55.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:12:55.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:12:55.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:12:55.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:12:55.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:12:55.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:12:55.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:55.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:12:55.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:12:55.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 20 zone default found 2024-09-12T18:12:55.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 4 Realm: () 2024-09-12T18:12:55.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:12:55.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:12:55.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:12:55.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 20 zonegroup default 2024-09-12T18:12:55.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:55.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.685+0000 7f530e8319c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.689+0000 7f530e8319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:55.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.689+0000 7f530e8319c0 20 rados->read ofs=0 len=0 2024-09-12T18:12:55.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.689+0000 7f530e8319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:12:55.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.689+0000 7f530e8319c0 20 started sync module instance, tier type = 2024-09-12T18:12:55.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.689+0000 7f530e8319c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:12:55.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.705+0000 7f530e8319c0 20 add_watcher() i=0 2024-09-12T18:12:55.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.705+0000 7f530e8319c0 20 add_watcher() i=1 2024-09-12T18:12:55.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.705+0000 7f530e8319c0 20 add_watcher() i=2 2024-09-12T18:12:55.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.705+0000 7f530e8319c0 20 add_watcher() i=3 2024-09-12T18:12:55.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.705+0000 7f530e8319c0 20 add_watcher() i=4 2024-09-12T18:12:55.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.705+0000 7f530e8319c0 20 add_watcher() i=5 2024-09-12T18:12:55.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.705+0000 7f530e8319c0 20 add_watcher() i=6 2024-09-12T18:12:55.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.705+0000 7f530e8319c0 20 add_watcher() i=7 2024-09-12T18:12:55.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.705+0000 7f530e8319c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:12:55.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.709+0000 7f51c37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:12:55.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.709+0000 7f530e8319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:12:55.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.709+0000 7f530e8319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:12:55.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.781+0000 7f51c27dc640 20 reqs_thread_entry: start 2024-09-12T18:12:55.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.781+0000 7f530e8319c0 20 init_complete bucket index max shards: 11 2024-09-12T18:12:55.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.781+0000 7f530e8319c0 20 Filter name: none 2024-09-12T18:12:55.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.781+0000 7f51bb7fe640 20 reqs_thread_entry: start 2024-09-12T18:12:55.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.781+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:12:55.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.785+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.785+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.785+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.785+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:12:55.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.789+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.789+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.789+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.789+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:12:55.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.793+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.793+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.793+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.797+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:12:55.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.797+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.797+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.797+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.801+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:12:55.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.801+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.805+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.805+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.805+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:12:55.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.809+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.809+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.809+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.813+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:12:55.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.817+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.821+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.821+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.825+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:12:55.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.825+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.825+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.825+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.829+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:12:55.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.833+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.833+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.833+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.837+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:12:55.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.841+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.841+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.841+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.845+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:12:55.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.849+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.849+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.849+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.853+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:12:55.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.861+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.861+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.861+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.865+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:12:55.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.869+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.869+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.873+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.873+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:12:55.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.877+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.877+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.877+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.881+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:12:55.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.885+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.885+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.889+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.889+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:12:55.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.893+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.893+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.893+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.897+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:12:55.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.897+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.901+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.901+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.901+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:12:55.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.905+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.909+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.909+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.913+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:12:55.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.917+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.917+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.917+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.921+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:12:55.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.925+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.925+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.925+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.929+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:12:55.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.933+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.933+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.933+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.937+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:12:55.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.941+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.941+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.941+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.945+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:12:55.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.949+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.953+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.953+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.957+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:12:55.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.961+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.961+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.961+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.965+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:12:55.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.969+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.969+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.969+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.973+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:12:55.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.977+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.977+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.981+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.981+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:12:55.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.985+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.985+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:55.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.989+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:55.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.993+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:12:56.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.997+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:56.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.997+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:56.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:55.997+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:56.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.001+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:12:56.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.005+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:56.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.005+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:56.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.005+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:56.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.009+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:12:56.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.013+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:56.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.013+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:56.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.013+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:56.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.017+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:12:56.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.021+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:56.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.021+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:56.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.025+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:56.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.029+0000 7f530e8319c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:12:56.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.029+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:56.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.033+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:12:56.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.033+0000 7f530e8319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:12:56.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.037+0000 7f51c37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:12:56.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.041+0000 7f530e8319c0 20 remove_watcher() i=0 2024-09-12T18:12:56.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.041+0000 7f530e8319c0 2 removed watcher, disabling cache 2024-09-12T18:12:56.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.045+0000 7f530e8319c0 20 remove_watcher() i=1 2024-09-12T18:12:56.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.049+0000 7f530e8319c0 20 remove_watcher() i=2 2024-09-12T18:12:56.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.053+0000 7f530e8319c0 20 remove_watcher() i=3 2024-09-12T18:12:56.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.053+0000 7f530e8319c0 20 remove_watcher() i=4 2024-09-12T18:12:56.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.057+0000 7f530e8319c0 20 remove_watcher() i=5 2024-09-12T18:12:56.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.061+0000 7f530e8319c0 20 remove_watcher() i=6 2024-09-12T18:12:56.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:12:56.061+0000 7f530e8319c0 20 remove_watcher() i=7 2024-09-12T18:12:56.090 DEBUG:teuthology.orchestra.run.smithi098:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T18:12:56.794 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :clean 2024-09-12T18:12:57.491 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :compileJava 2024-09-12T18:12:57.492 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :processResources 2024-09-12T18:12:57.492 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :classes 2024-09-12T18:12:57.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:57.991 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :compileTestJava 2024-09-12T18:12:57.992 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:57.992 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T18:12:57.992 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :testClasses 2024-09-12T18:12:57.992 INFO:teuthology.orchestra.run.smithi098.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T18:12:57.992 INFO:teuthology.orchestra.run.smithi098.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T18:12:59.994 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:59.994 INFO:teuthology.orchestra.run.smithi098.stdout:> Task :test 2024-09-12T18:12:59.994 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:59.994 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests STANDARD_OUT 2024-09-12T18:12:59.994 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12 18:12:59,239 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T18:12:59.994 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:59.994 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T18:12:59.994 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:12:59.994 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T18:13:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:01.091 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T18:13:01.391 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:01.391 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T18:13:02.091 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:02.091 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T18:13:02.291 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:02.291 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T18:13:02.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:02.991 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T18:13:13.891 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:13.891 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T18:13:14.491 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:14.491 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T18:13:14.691 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:14.691 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T18:13:15.391 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:15.391 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T18:13:15.891 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:15.892 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T18:13:16.691 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:16.691 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T18:13:16.691 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:16.692 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T18:13:16.891 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:16.891 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T18:13:16.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:16.991 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T18:13:17.691 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:17.691 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T18:13:26.291 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:26.291 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T18:13:26.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:26.991 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T18:13:27.391 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:27.391 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T18:13:28.091 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:28.091 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T18:13:28.491 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:28.491 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T18:13:29.191 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:29.191 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T18:13:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:29.391 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T18:13:30.091 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:30.091 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T18:13:30.291 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:30.291 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T18:13:30.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:30.991 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T18:13:31.191 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:31.191 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T18:13:31.891 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:31.891 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T18:13:32.091 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:32.091 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T18:13:32.791 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:32.791 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T18:13:33.191 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:33.191 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T18:13:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:33.891 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T18:13:45.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:45.991 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T18:13:47.491 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:13:47.491 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T18:14:28.091 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:14:28.092 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T18:14:29.391 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:14:29.391 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T18:14:29.491 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:14:29.491 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T18:14:30.192 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:14:30.192 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T18:14:30.391 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:14:30.391 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T18:14:31.591 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:14:31.591 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T18:14:43.591 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:14:43.591 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T18:14:44.391 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:14:44.391 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T18:14:44.491 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:14:44.491 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T18:14:44.591 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:14:44.591 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T18:15:00.891 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:15:00.892 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T18:15:05.191 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:15:05.191 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests STANDARD_OUT 2024-09-12T18:15:05.191 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12 18:15:05,139 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T18:15:05.291 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12 18:15:05,185 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T18:15:06.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:15:06.991 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T18:15:40.891 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:15:40.892 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T18:15:41.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:15:41.991 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T18:15:52.591 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:15:52.591 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T18:15:53.291 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:15:53.291 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T18:16:58.692 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:16:58.692 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T18:16:59.491 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:16:59.491 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T18:17:15.491 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:17:15.492 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T18:17:16.191 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:17:16.191 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T18:17:27.791 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:17:27.792 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T18:17:28.490 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:17:28.491 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T18:17:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:17:33.891 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T18:18:01.891 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:01.891 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T18:18:02.091 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:02.091 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T18:18:02.191 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:02.191 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T18:18:02.391 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:02.391 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T18:18:03.191 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:03.191 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T18:18:03.391 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:03.391 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T18:18:04.091 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:04.091 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T18:18:04.193 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:04.193 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T18:18:04.891 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:04.891 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T18:18:05.090 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:05.091 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T18:18:05.791 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:05.791 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T18:18:05.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:05.991 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T18:18:06.691 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:06.691 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T18:18:06.891 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:06.891 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T18:18:07.691 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:07.691 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T18:18:08.291 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:08.291 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T18:18:09.291 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:09.291 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T18:18:09.791 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:09.791 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T18:18:10.791 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:10.791 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T18:18:11.391 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:11.391 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T18:18:12.391 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:12.391 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T18:18:12.891 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:12.891 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T18:18:13.891 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:13.891 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T18:18:14.491 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:14.491 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T18:18:15.391 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:15.391 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T18:18:15.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:15.991 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T18:18:16.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:16.991 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T18:18:17.591 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:17.591 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T18:18:18.591 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:18.591 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T18:18:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:19.191 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T18:18:20.091 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:20.091 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T18:18:20.691 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:20.691 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T18:18:21.591 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:21.591 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T18:18:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:22.191 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T18:18:23.191 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:23.191 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T18:18:23.791 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:23.791 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T18:18:24.791 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:24.791 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T18:18:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:25.192 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T18:18:26.091 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:26.091 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T18:18:26.491 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:26.491 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T18:18:27.491 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:27.491 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T18:18:27.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:27.991 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T18:18:28.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:28.991 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T18:18:29.590 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:29.591 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T18:18:30.491 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:30.491 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T18:18:31.091 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:31.091 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T18:18:32.091 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:32.091 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T18:18:32.691 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:32.691 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T18:18:33.691 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:33.691 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T18:18:34.291 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:34.291 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T18:18:35.191 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:35.191 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T18:18:35.691 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:35.691 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T18:18:36.591 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:36.591 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T18:18:37.091 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:37.091 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T18:18:37.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:37.991 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T18:18:38.491 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:38.491 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T18:18:39.491 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:39.491 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T18:18:39.891 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:39.891 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T18:18:40.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:40.991 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T18:18:41.091 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:41.091 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T18:18:41.793 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:41.793 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T18:18:41.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:41.991 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T18:18:42.691 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:42.691 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T18:18:42.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:42.991 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T18:18:43.791 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:43.791 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T18:18:44.091 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:44.091 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T18:18:44.891 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:44.891 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T18:18:45.491 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:45.491 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T18:18:46.191 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:46.191 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T18:18:46.191 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:46.191 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T18:18:46.391 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:46.391 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T18:18:46.691 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:46.691 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T18:18:47.391 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:47.391 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T18:18:47.691 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:47.691 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T18:18:48.491 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:48.491 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T18:18:48.891 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:48.891 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T18:18:49.591 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:49.591 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T18:18:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:49.791 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T18:18:50.391 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:18:50.391 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T18:19:03.191 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:19:03.191 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T18:19:03.890 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:19:03.891 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T18:19:16.791 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:19:16.791 INFO:teuthology.orchestra.run.smithi098.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T18:19:17.681 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:19:17.681 INFO:teuthology.orchestra.run.smithi098.stdout:---------------------------------------------------------------------- 2024-09-12T18:19:17.681 INFO:teuthology.orchestra.run.smithi098.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T18:19:17.681 INFO:teuthology.orchestra.run.smithi098.stdout:---------------------------------------------------------------------- 2024-09-12T18:19:17.682 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:19:17.682 INFO:teuthology.orchestra.run.smithi098.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T18:19:17.682 INFO:teuthology.orchestra.run.smithi098.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T18:19:17.682 INFO:teuthology.orchestra.run.smithi098.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T18:19:17.682 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:19:17.682 INFO:teuthology.orchestra.run.smithi098.stdout:BUILD SUCCESSFUL in 6m 21s 2024-09-12T18:19:17.682 INFO:teuthology.orchestra.run.smithi098.stdout:5 actionable tasks: 5 executed 2024-09-12T18:19:17.689 DEBUG:teuthology.orchestra.run.smithi098:> radosgw-admin gc process --include-all 2024-09-12T18:19:17.717 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:17.717 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:17.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.753+0000 7f948646c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:17.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.757+0000 7f948646c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:17.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.757+0000 7f948646c9c0 20 realm 2024-09-12T18:19:17.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.757+0000 7f948646c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:17.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.757+0000 7f948646c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:17.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.757+0000 7f948646c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:17.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.757+0000 7f948646c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:17.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.757+0000 7f948646c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:17.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.757+0000 7f948646c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:17.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.757+0000 7f948646c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:17.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.757+0000 7f948646c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:17.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.757+0000 7f948646c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:17.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.761+0000 7f948646c9c0 20 searching for the correct realm 2024-09-12T18:19:17.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.765+0000 7f9483771640 0 -- 172.21.15.98:0/264682012 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x556d5b1cdf50 msgr2=0x556d5b1d0340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:17.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.773+0000 7f9483f72640 0 -- 172.21.15.98:0/264682012 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f94781259b0 msgr2=0x7f94780ac040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:17.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.777+0000 7f948646c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:17.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.777+0000 7f948646c9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:19:17.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.777+0000 7f948646c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:17.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.777+0000 7f948646c9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:19:17.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.777+0000 7f948646c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:17.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.777+0000 7f948646c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:17.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.777+0000 7f948646c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:17.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.777+0000 7f948646c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:17.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.777+0000 7f948646c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:17.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.781+0000 7f948646c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:17.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.781+0000 7f948646c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:17.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.781+0000 7f948646c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:17.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.781+0000 7f948646c9c0 20 zone default found 2024-09-12T18:19:17.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.781+0000 7f948646c9c0 4 Realm: () 2024-09-12T18:19:17.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.781+0000 7f948646c9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:19:17.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.781+0000 7f948646c9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:19:17.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.781+0000 7f948646c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:17.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.781+0000 7f948646c9c0 20 zonegroup default 2024-09-12T18:19:17.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.781+0000 7f948646c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:17.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.781+0000 7f948646c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:17.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.781+0000 7f948646c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:17.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.781+0000 7f948646c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:17.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.781+0000 7f948646c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:17.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.781+0000 7f948646c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:17.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.781+0000 7f948646c9c0 20 started sync module instance, tier type = 2024-09-12T18:19:17.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.781+0000 7f948646c9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:19:17.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.797+0000 7f948646c9c0 20 add_watcher() i=0 2024-09-12T18:19:17.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.797+0000 7f948646c9c0 20 add_watcher() i=1 2024-09-12T18:19:17.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.797+0000 7f948646c9c0 20 add_watcher() i=2 2024-09-12T18:19:17.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.797+0000 7f948646c9c0 20 add_watcher() i=3 2024-09-12T18:19:17.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.797+0000 7f948646c9c0 20 add_watcher() i=4 2024-09-12T18:19:17.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.797+0000 7f948646c9c0 20 add_watcher() i=5 2024-09-12T18:19:17.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.797+0000 7f948646c9c0 20 add_watcher() i=6 2024-09-12T18:19:17.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.797+0000 7f948646c9c0 20 add_watcher() i=7 2024-09-12T18:19:17.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.797+0000 7f948646c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:17.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.801+0000 7f9339fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:17.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.801+0000 7f948646c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:17.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.801+0000 7f948646c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:17.879 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.873+0000 7f9338fe1640 20 reqs_thread_entry: start 2024-09-12T18:19:17.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.873+0000 7f948646c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:17.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.873+0000 7f948646c9c0 20 Filter name: none 2024-09-12T18:19:17.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.873+0000 7f92b27fc640 20 reqs_thread_entry: start 2024-09-12T18:19:17.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.873+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:19:17.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.877+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:17.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.877+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:17.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.881+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T18:19:17.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.881+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11081352730269079171', time=2024-09-12T20:13:33.012594+0000, chain.objs.size()=1 2024-09-12T18:19:17.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.881+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.90__shadow_.b-6rKrd9PIgVgGKvmykSc3-szw9sfpJ_0 2024-09-12T18:19:17.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.881+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16947106251714989173', time=2024-09-12T20:13:46.886849+0000, chain.objs.size()=5 2024-09-12T18:19:17.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.881+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.91__multipart_key1.2~aeiL8OIbusNNfdqeVQOoWSP5PLrDAeW.1 2024-09-12T18:19:17.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.881+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.91__multipart_key1.2~aeiL8OIbusNNfdqeVQOoWSP5PLrDAeW.2 2024-09-12T18:19:17.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.881+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.91__multipart_key1.2~aeiL8OIbusNNfdqeVQOoWSP5PLrDAeW.3 2024-09-12T18:19:17.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.881+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.91__multipart_key1.2~aeiL8OIbusNNfdqeVQOoWSP5PLrDAeW.4 2024-09-12T18:19:17.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.881+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.91__multipart_key1.2~aeiL8OIbusNNfdqeVQOoWSP5PLrDAeW.5 2024-09-12T18:19:17.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.881+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9503714998850946867', time=2024-09-12T20:14:43.803367+0000, chain.objs.size()=5 2024-09-12T18:19:17.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.881+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.98__multipart_key1.2~GlbYw9i1uxZUsBxSBhT-TTEbeXbk1G-.1 2024-09-12T18:19:17.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.881+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.98__multipart_key1.2~GlbYw9i1uxZUsBxSBhT-TTEbeXbk1G-.2 2024-09-12T18:19:17.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.881+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.98__multipart_key1.2~GlbYw9i1uxZUsBxSBhT-TTEbeXbk1G-.3 2024-09-12T18:19:17.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.881+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.98__multipart_key1.2~GlbYw9i1uxZUsBxSBhT-TTEbeXbk1G-.4 2024-09-12T18:19:17.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.881+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.98__multipart_key1.2~GlbYw9i1uxZUsBxSBhT-TTEbeXbk1G-.5 2024-09-12T18:19:17.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.881+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5771100959346341621', time=2024-09-12T20:18:24.103565+0000, chain.objs.size()=1 2024-09-12T18:19:17.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.881+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.122__shadow_.nbvl8WiO05ombUJ0eEMHRDDOFAFFOgE_0 2024-09-12T18:19:17.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.889+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12706936437278999449', time=2024-09-12T20:18:25.470721+0000, chain.objs.size()=1 2024-09-12T18:19:17.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.889+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.123__shadow_.2NQNn48NUMUbT57yTC-iArZMWX2EpDb_0 2024-09-12T18:19:17.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.889+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9846633205598119619', time=2024-09-12T20:19:17.007465+0000, chain.objs.size()=5 2024-09-12T18:19:17.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.889+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.144__multipart_key1/data/file.mpg.2~sLjHa31earkI5kKSbOmxfrNi568MqvC.1 2024-09-12T18:19:17.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.889+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.144__multipart_key1/data/file.mpg.2~sLjHa31earkI5kKSbOmxfrNi568MqvC.2 2024-09-12T18:19:17.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.889+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.144__multipart_key1/data/file.mpg.2~sLjHa31earkI5kKSbOmxfrNi568MqvC.3 2024-09-12T18:19:17.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.893+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.144__multipart_key1/data/file.mpg.2~sLjHa31earkI5kKSbOmxfrNi568MqvC.4 2024-09-12T18:19:17.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.893+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.144__multipart_key1/data/file.mpg.2~sLjHa31earkI5kKSbOmxfrNi568MqvC.5 2024-09-12T18:19:17.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.905+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:17.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.909+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:19:17.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.913+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:17.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.913+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:17.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.913+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:19:17.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.913+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10678007953906652517', time=2024-09-12T20:18:32.835329+0000, chain.objs.size()=1 2024-09-12T18:19:17.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.913+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.128__shadow_.51rmcs9daZkGf2rKHT3yXq7aCzCVYv9_0 2024-09-12T18:19:17.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.913+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9220798281184326678', time=2024-09-12T20:18:40.252575+0000, chain.objs.size()=1 2024-09-12T18:19:17.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.913+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.133__shadow_.CA5yWHli_12yIONNj-EDCsuTLzuglw4_0 2024-09-12T18:19:17.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.917+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:17.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.925+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:19:17.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.925+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:17.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.925+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:17.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.925+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:19:17.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.925+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15618697756987774570', time=2024-09-12T20:18:35.963926+0000, chain.objs.size()=1 2024-09-12T18:19:17.932 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.925+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.130__shadow_.40VJgqSkAKBYdFauc0Viiza9jcjd9Ul_0 2024-09-12T18:19:17.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.929+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:17.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.933+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:19:17.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.937+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:17.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.937+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:17.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.937+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:19:17.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.937+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2364969328508368846', time=2024-09-12T20:14:08.286183+0000, chain.objs.size()=5 2024-09-12T18:19:17.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.937+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~WH00LHL-BXoYs8PLZa-D3lPv_AyTGkx.1 2024-09-12T18:19:17.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.937+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~WH00LHL-BXoYs8PLZa-D3lPv_AyTGkx.2 2024-09-12T18:19:17.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.937+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~WH00LHL-BXoYs8PLZa-D3lPv_AyTGkx.3 2024-09-12T18:19:17.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.937+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~WH00LHL-BXoYs8PLZa-D3lPv_AyTGkx.4 2024-09-12T18:19:17.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.937+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~WH00LHL-BXoYs8PLZa-D3lPv_AyTGkx.5 2024-09-12T18:19:17.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.937+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6593425601722764218', time=2024-09-12T20:18:26.787502+0000, chain.objs.size()=1 2024-09-12T18:19:17.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.937+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.124__shadow_.PBBSzupeuNg21cvs-Mow5rrkia1F3FI_0 2024-09-12T18:19:17.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.937+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11496771623916694754', time=2024-09-12T20:18:36.043408+0000, chain.objs.size()=1 2024-09-12T18:19:17.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.937+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.130__shadow_.0WhkgC3eKrgHQFGtrzOdlstnQT9p9r7_0 2024-09-12T18:19:17.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.945+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:17.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.949+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:19:17.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.953+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:17.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.957+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:17.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.957+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:19:17.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.957+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6470671559516139956', time=2024-09-12T20:15:03.476346+0000, chain.objs.size()=5 2024-09-12T18:19:17.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.957+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.99__multipart_key1.2~m7GzksxMUp_F7SaG2oM3bB2xyCROPt8.1 2024-09-12T18:19:17.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.957+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.99__multipart_key1.2~m7GzksxMUp_F7SaG2oM3bB2xyCROPt8.2 2024-09-12T18:19:17.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.957+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.99__multipart_key1.2~m7GzksxMUp_F7SaG2oM3bB2xyCROPt8.3 2024-09-12T18:19:17.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.957+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.99__multipart_key1.2~m7GzksxMUp_F7SaG2oM3bB2xyCROPt8.4 2024-09-12T18:19:17.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.957+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.99__multipart_key1.2~m7GzksxMUp_F7SaG2oM3bB2xyCROPt8.5 2024-09-12T18:19:17.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.957+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5258018510393808309', time=2024-09-12T20:18:13.193492+0000, chain.objs.size()=1 2024-09-12T18:19:17.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.957+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.115__shadow_.Ux2d5dJ4BpmaMAqAkanpdudiSm6dsCm_0 2024-09-12T18:19:17.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.957+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5802769600916049796', time=2024-09-12T20:18:40.129802+0000, chain.objs.size()=1 2024-09-12T18:19:17.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.957+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.133__shadow_.nsR1u_FZxRS0xRSUFHCIIqZLIXT3_Br_0 2024-09-12T18:19:17.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.969+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:17.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.973+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:19:17.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.977+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:17.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.977+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:17.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.977+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:19:17.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.977+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14728045989614044535', time=2024-09-12T20:13:27.520847+0000, chain.objs.size()=1 2024-09-12T18:19:17.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.977+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.84__shadow_.I1npLRn3IdwHX3a6G0YvNvqwc2lJcP3_0 2024-09-12T18:19:17.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.977+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12018278599034326331', time=2024-09-12T20:14:28.834427+0000, chain.objs.size()=4 2024-09-12T18:19:17.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.977+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.93__shadow_.qSn-tKW1K7bEpdKc0iP49r9FrMCGOly_0 2024-09-12T18:19:17.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.977+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.93__shadow_.qSn-tKW1K7bEpdKc0iP49r9FrMCGOly_1 2024-09-12T18:19:17.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.977+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.93__shadow_.qSn-tKW1K7bEpdKc0iP49r9FrMCGOly_2 2024-09-12T18:19:17.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.977+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.93__shadow_.qSn-tKW1K7bEpdKc0iP49r9FrMCGOly_3 2024-09-12T18:19:17.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.977+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16377555205332343423', time=2024-09-12T20:17:27.949837+0000, chain.objs.size()=5 2024-09-12T18:19:17.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.977+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.104__multipart_key1.2~gxxlzcu2itHCMnfNlGo22xduzSGUwXR.1 2024-09-12T18:19:17.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.977+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.104__multipart_key1.2~gxxlzcu2itHCMnfNlGo22xduzSGUwXR.2 2024-09-12T18:19:17.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.977+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.104__multipart_key1.2~gxxlzcu2itHCMnfNlGo22xduzSGUwXR.3 2024-09-12T18:19:17.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.977+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.104__multipart_key1.2~gxxlzcu2itHCMnfNlGo22xduzSGUwXR.4 2024-09-12T18:19:17.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.977+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.104__multipart_key1.2~gxxlzcu2itHCMnfNlGo22xduzSGUwXR.5 2024-09-12T18:19:17.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.977+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9435279994168382974', time=2024-09-12T20:18:22.607163+0000, chain.objs.size()=1 2024-09-12T18:19:17.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.977+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.121__shadow_.xbp167D81kzLecOqHkB0s1nWH1-7_Ma_0 2024-09-12T18:19:17.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.977+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2290385282698338577', time=2024-09-12T20:18:37.296159+0000, chain.objs.size()=1 2024-09-12T18:19:17.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.977+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.131__shadow_.ksLcy-yApOGGJpp7_7uAWGS3lGdFkxd_0 2024-09-12T18:19:18.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.993+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:17.997+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:19:18.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.001+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.001+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.001+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:19:18.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.001+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8207073619326712753', time=2024-09-12T20:16:15.727235+0000, chain.objs.size()=5 2024-09-12T18:19:18.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.001+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~XAXl8gw-3KXxfuhe8FDgeUQOoCsNKD2.1 2024-09-12T18:19:18.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.001+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~XAXl8gw-3KXxfuhe8FDgeUQOoCsNKD2.2 2024-09-12T18:19:18.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.001+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~XAXl8gw-3KXxfuhe8FDgeUQOoCsNKD2.3 2024-09-12T18:19:18.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.001+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~XAXl8gw-3KXxfuhe8FDgeUQOoCsNKD2.4 2024-09-12T18:19:18.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.001+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~XAXl8gw-3KXxfuhe8FDgeUQOoCsNKD2.5 2024-09-12T18:19:18.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.001+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5324719322560455746', time=2024-09-12T20:17:15.627228+0000, chain.objs.size()=5 2024-09-12T18:19:18.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.001+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.103__multipart_key1.2~N79dWffWnCaAycYLORxoUYMuDDWC5bN.1 2024-09-12T18:19:18.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.001+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.103__multipart_key1.2~N79dWffWnCaAycYLORxoUYMuDDWC5bN.2 2024-09-12T18:19:18.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.001+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.103__multipart_key1.2~N79dWffWnCaAycYLORxoUYMuDDWC5bN.3 2024-09-12T18:19:18.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.001+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.103__multipart_key1.2~N79dWffWnCaAycYLORxoUYMuDDWC5bN.4 2024-09-12T18:19:18.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.001+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.103__multipart_key1.2~N79dWffWnCaAycYLORxoUYMuDDWC5bN.5 2024-09-12T18:19:18.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.001+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6817250343995720920', time=2024-09-12T20:18:23.950283+0000, chain.objs.size()=1 2024-09-12T18:19:18.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.001+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.122__shadow_.uvk2qjDH9ek94N_SfwaQfJDl4Fkli0K_0 2024-09-12T18:19:18.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.001+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13375006491477064990', time=2024-09-12T20:18:40.182579+0000, chain.objs.size()=1 2024-09-12T18:19:18.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.001+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.133__shadow_.Xtu1Vd43H_YRuJ0N5c8MkO4dvxzIReK_0 2024-09-12T18:19:18.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.017+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.021+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:19:18.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.021+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.025+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.025+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:19:18.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.025+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15930421391480257515', time=2024-09-12T20:13:01.539110+0000, chain.objs.size()=1 2024-09-12T18:19:18.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.025+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.77__shadow_.dAB6tgtjfabyEoflmZhNh11U4A9oXFs_0 2024-09-12T18:19:18.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.025+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4785084548787767523', time=2024-09-12T20:18:08.548007+0000, chain.objs.size()=1 2024-09-12T18:19:18.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.025+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.112__shadow_.O1ToI7plTJP1jkQcR0IKwnW8MkqkMFZ_0 2024-09-12T18:19:18.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.025+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18095181801826205692', time=2024-09-12T20:18:28.221537+0000, chain.objs.size()=1 2024-09-12T18:19:18.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.025+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.125__shadow_.0LxpUEPjxSJeGmnXB4HVR84Y5KqV-0I_0 2024-09-12T18:19:18.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.029+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.033+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:19:18.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.033+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.033+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.033+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:19:18.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.033+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1621396164878852661', time=2024-09-12T20:18:29.902771+0000, chain.objs.size()=1 2024-09-12T18:19:18.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.033+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.126__shadow_.IzxehnZiQqecJL-3jf-zYWR4wPFvRSs_0 2024-09-12T18:19:18.041 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.037+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.041+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:19:18.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.041+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.045+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.045+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:19:18.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.045+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~GaW4L7Lg-1wDEV0bBk5g7MGy7V-VKBh', time=2024-09-12T20:15:53.007993+0000, chain.objs.size()=5 2024-09-12T18:19:18.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.045+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.101__multipart_key1.2~GaW4L7Lg-1wDEV0bBk5g7MGy7V-VKBh.7 2024-09-12T18:19:18.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.045+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.101__multipart_key1.2~GaW4L7Lg-1wDEV0bBk5g7MGy7V-VKBh.8 2024-09-12T18:19:18.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.045+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.101__multipart_key1.2~GaW4L7Lg-1wDEV0bBk5g7MGy7V-VKBh.9 2024-09-12T18:19:18.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.045+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.101__multipart_key1.2~GaW4L7Lg-1wDEV0bBk5g7MGy7V-VKBh.10 2024-09-12T18:19:18.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.045+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.101__multipart_key1.2~GaW4L7Lg-1wDEV0bBk5g7MGy7V-VKBh.11 2024-09-12T18:19:18.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.045+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16846843898736722240', time=2024-09-12T20:18:28.295674+0000, chain.objs.size()=1 2024-09-12T18:19:18.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.045+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.125__shadow_.D27JrNo_-dqi7Wa_8CfRkGAWLzyLOmS_0 2024-09-12T18:19:18.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.045+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.496529330774761994', time=2024-09-12T20:18:34.530637+0000, chain.objs.size()=1 2024-09-12T18:19:18.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.045+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.129__shadow_.MKcKWxn_4ddXhSwTyIfE-aokut2N-G__0 2024-09-12T18:19:18.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.053+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.057+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:19:18.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.057+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.061+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.061+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:19:18.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.061+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8946221843240050371', time=2024-09-12T20:13:26.454222+0000, chain.objs.size()=2 2024-09-12T18:19:18.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.061+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.83__shadow_.mqMHewfiEYxO7GFBI312OPdwffW5LJA_0 2024-09-12T18:19:18.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.061+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.83__shadow_.mqMHewfiEYxO7GFBI312OPdwffW5LJA_1 2024-09-12T18:19:18.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.061+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1911726101354675771', time=2024-09-12T20:18:11.640136+0000, chain.objs.size()=1 2024-09-12T18:19:18.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.061+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.114__shadow_.AMV6CZ_3IhYMOSxBayAkudUq-TnTxQQ_0 2024-09-12T18:19:18.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.061+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13967155416690468014', time=2024-09-12T20:18:11.777422+0000, chain.objs.size()=1 2024-09-12T18:19:18.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.061+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.114__shadow_.7s6_KeOoNypPbopOtRaxttHNdCfn6wt_0 2024-09-12T18:19:18.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.061+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16773901251948017491', time=2024-09-12T20:18:13.341358+0000, chain.objs.size()=1 2024-09-12T18:19:18.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.061+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.115__shadow_.RA1H0F7Ic_rTliBRaOjaG5_Z7y_aqc2_0 2024-09-12T18:19:18.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.061+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3992561405859575061', time=2024-09-12T20:18:19.526095+0000, chain.objs.size()=1 2024-09-12T18:19:18.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.061+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.119__shadow_.PxNWnBSkCZ0iJ_V2xbVwLNDkOpyOUax_0 2024-09-12T18:19:18.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.061+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1611835093426424193', time=2024-09-12T20:18:26.713523+0000, chain.objs.size()=1 2024-09-12T18:19:18.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.061+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.124__shadow_.-_0mGsMdplIKHsW_QHTBUJCfrkXF-_7_0 2024-09-12T18:19:18.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.061+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11724574773989103668', time=2024-09-12T20:18:34.456295+0000, chain.objs.size()=1 2024-09-12T18:19:18.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.061+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.129__shadow_.SceSBd4qdO_yFLu2sea73Zx-6A08c5o_0 2024-09-12T18:19:18.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.065+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.069+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:19:18.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.073+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.073+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.073+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:19:18.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.073+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.642781879142158093', time=2024-09-12T20:18:37.372200+0000, chain.objs.size()=1 2024-09-12T18:19:18.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.073+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.131__shadow_.Mvv4IBCEZ0ocusJXo6bwA7Wi8G9B5Uo_0 2024-09-12T18:19:18.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.073+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10348586450349837138', time=2024-09-12T20:18:44.311356+0000, chain.objs.size()=1 2024-09-12T18:19:18.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.073+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.137__shadow_.eJXxm4I_wMJrq1m4laBsA_WSHZrjdCw_0 2024-09-12T18:19:18.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.077+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.081+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:19:18.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.081+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.081+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.081+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T18:19:18.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.081+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6769989384540949051', time=2024-09-12T20:18:11.565587+0000, chain.objs.size()=1 2024-09-12T18:19:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.081+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.114__shadow_.kra6F9Ry6KcXn8xKTD1WMaKG5z-9xi8_0 2024-09-12T18:19:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.081+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10354586850085948666', time=2024-09-12T20:18:17.980575+0000, chain.objs.size()=1 2024-09-12T18:19:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.081+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.118__shadow_.euoXpJkWhnWe-sGGyad-QvzzrKDF0S4_0 2024-09-12T18:19:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.081+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2420491782336348579', time=2024-09-12T20:18:20.897733+0000, chain.objs.size()=1 2024-09-12T18:19:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.081+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.120__shadow_.hyK7CAy5-pvkqwTqaTdTVEFOgwNJY-6_0 2024-09-12T18:19:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.081+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13630157428454976322', time=2024-09-12T20:18:29.809960+0000, chain.objs.size()=1 2024-09-12T18:19:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.081+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.126__shadow_.s0O4m6XVu0V3eOTWDXbYOKpamcEyyF5_0 2024-09-12T18:19:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.081+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4639283688485685432', time=2024-09-12T20:18:35.889906+0000, chain.objs.size()=1 2024-09-12T18:19:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.081+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.130__shadow_.ajiGs2hAvI5QDnjrd8x1ZW_REwNwVyT_0 2024-09-12T18:19:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.081+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14109845334821134037', time=2024-09-12T20:18:45.328683+0000, chain.objs.size()=1 2024-09-12T18:19:18.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.081+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.138__shadow_.9MvV2CLtz_wdDVycfuBmUNcJ_luzDWI_0 2024-09-12T18:19:18.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.089+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.093+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:19:18.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.097+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.097+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.097+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:19:18.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.097+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16179512777969579887', time=2024-09-12T20:18:08.623433+0000, chain.objs.size()=1 2024-09-12T18:19:18.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.097+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.112__shadow_.25VuuuME6jpQzZluH1_F5CsmZRrN9ss_0 2024-09-12T18:19:18.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.097+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16516932419329016316', time=2024-09-12T20:18:38.877348+0000, chain.objs.size()=1 2024-09-12T18:19:18.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.097+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.132__shadow_.0x99vxUbs17C2dAzoCfMzBLj4hbH_c6_0 2024-09-12T18:19:18.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.101+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.105+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:19:18.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.105+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.109+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.109+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:19:18.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.109+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~-Q09DJ-Izb1fezgoLIPQ9TCazqNuhZ2', time=2024-09-12T20:13:13.752942+0000, chain.objs.size()=5 2024-09-12T18:19:18.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.109+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.79__multipart_key1.2~-Q09DJ-Izb1fezgoLIPQ9TCazqNuhZ2.1 2024-09-12T18:19:18.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.109+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.79__multipart_key1.2~-Q09DJ-Izb1fezgoLIPQ9TCazqNuhZ2.2 2024-09-12T18:19:18.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.109+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.79__multipart_key1.2~-Q09DJ-Izb1fezgoLIPQ9TCazqNuhZ2.3 2024-09-12T18:19:18.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.109+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.79__multipart_key1.2~-Q09DJ-Izb1fezgoLIPQ9TCazqNuhZ2.4 2024-09-12T18:19:18.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.109+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.79__multipart_key1.2~-Q09DJ-Izb1fezgoLIPQ9TCazqNuhZ2.5 2024-09-12T18:19:18.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.109+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7120620781550635189', time=2024-09-12T20:13:28.613521+0000, chain.objs.size()=1 2024-09-12T18:19:18.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.109+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.85__shadow_.GBv6IsiMM4Br55doxGca-saKnQIwEni_0 2024-09-12T18:19:18.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.109+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3507263171739639157', time=2024-09-12T20:18:47.893942+0000, chain.objs.size()=1 2024-09-12T18:19:18.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.109+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.140__shadow_.zBuoXk9bmiD-s_z9xBEbDo0LnlIegsP_0 2024-09-12T18:19:18.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.113+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.117+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:19:18.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.121+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.121+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.125+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:19:18.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.125+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.603909580447435742', time=2024-09-12T20:18:08.471447+0000, chain.objs.size()=1 2024-09-12T18:19:18.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.125+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.112__shadow_.T1Z2LXcRP6LT6ykbhohj55KsVKVITf-_0 2024-09-12T18:19:18.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.125+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9026472174223213069', time=2024-09-12T20:18:25.398518+0000, chain.objs.size()=1 2024-09-12T18:19:18.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.125+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.123__shadow_.yzVprpnhCkwlJ429g3go812G8ZtBfF2_0 2024-09-12T18:19:18.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.125+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14982167666132273444', time=2024-09-12T20:18:34.680640+0000, chain.objs.size()=1 2024-09-12T18:19:18.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.125+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.129__shadow_.qkUqXNcUsFdZZSQ3XreT6HTAECUEcxL_0 2024-09-12T18:19:18.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.129+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.129+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:19:18.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.133+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.133+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.133+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:19:18.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.133+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15740856000963669000', time=2024-09-12T20:18:02.566357+0000, chain.objs.size()=1 2024-09-12T18:19:18.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.133+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.106__shadow_.IhKdmQ31E8E-4G8Ppb9nTswg-eQ9F5Q_0 2024-09-12T18:19:18.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.133+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8493907633372377326', time=2024-09-12T20:18:28.366825+0000, chain.objs.size()=1 2024-09-12T18:19:18.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.133+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.125__shadow_.58NtKbvRl-CYmIWMZezm-SHp8kkIpEW_0 2024-09-12T18:19:18.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.133+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3310747690214041247', time=2024-09-12T20:18:28.441245+0000, chain.objs.size()=1 2024-09-12T18:19:18.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.133+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.125__shadow_.fcFN2HFKxOZKiKXLIPXLQ_mbaDU2GF2_0 2024-09-12T18:19:18.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.133+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6747833366813449664', time=2024-09-12T20:18:29.859557+0000, chain.objs.size()=1 2024-09-12T18:19:18.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.133+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.126__shadow_.-vQbRBBevSL7CHYzA81h9Clhh6b5A6E_0 2024-09-12T18:19:18.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.137+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.141+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:19:18.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.141+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.145+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.145+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:19:18.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.145+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1327335889118405634', time=2024-09-12T20:18:14.690011+0000, chain.objs.size()=1 2024-09-12T18:19:18.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.145+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.116__shadow_.xzk9taIN0JShUblc421wY24N0DrL0JZ_0 2024-09-12T18:19:18.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.145+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3001057689258173331', time=2024-09-12T20:18:16.259436+0000, chain.objs.size()=1 2024-09-12T18:19:18.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.145+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.117__shadow_.oDF-xJeOL0aE0Y1fUcyyv8E2Bpko42p_0 2024-09-12T18:19:18.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.145+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.585164416214633397', time=2024-09-12T20:18:16.338546+0000, chain.objs.size()=1 2024-09-12T18:19:18.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.145+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.117__shadow_.AaBe24oZl6PTVz_olrMIjsCYRF3hxC1_0 2024-09-12T18:19:18.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.145+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15661720759590810582', time=2024-09-12T20:18:17.831479+0000, chain.objs.size()=1 2024-09-12T18:19:18.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.145+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.118__shadow_.XBsBDTwnwoCF-B2Mw1nXqpZEKI2b59i_0 2024-09-12T18:19:18.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.145+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12314062774341018585', time=2024-09-12T20:18:46.833691+0000, chain.objs.size()=1 2024-09-12T18:19:18.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.145+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.139__shadow_.I_C09996N3oFhidvd7NRVFjaVmms07__0 2024-09-12T18:19:18.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.149+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.153+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:19:18.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.157+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.157+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.163 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.157+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:19:18.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.157+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1135705337611068403', time=2024-09-12T20:15:41.349489+0000, chain.objs.size()=1 2024-09-12T18:19:18.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.157+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.100__shadow_.vBfVTy13bfeSrucKFddO1yLKrycgl43_0 2024-09-12T18:19:18.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.157+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7070294610946610693', time=2024-09-12T20:16:58.606185+0000, chain.objs.size()=5 2024-09-12T18:19:18.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.157+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~ylWnOt97czrniJk2PoJQRbE_I1NHCD1.1 2024-09-12T18:19:18.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.157+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__shadow_key1.2~ylWnOt97czrniJk2PoJQRbE_I1NHCD1.1_1 2024-09-12T18:19:18.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.157+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~ylWnOt97czrniJk2PoJQRbE_I1NHCD1.2 2024-09-12T18:19:18.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.157+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__shadow_key1.2~ylWnOt97czrniJk2PoJQRbE_I1NHCD1.2_1 2024-09-12T18:19:18.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.157+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~ylWnOt97czrniJk2PoJQRbE_I1NHCD1.3 2024-09-12T18:19:18.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.157+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4036958570380064820', time=2024-09-12T20:16:58.932682+0000, chain.objs.size()=5 2024-09-12T18:19:18.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.157+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~9QNpt0eP8dGorq-o3Pp0811gekfLHOO.1 2024-09-12T18:19:18.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.157+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__shadow_key1.2~9QNpt0eP8dGorq-o3Pp0811gekfLHOO.1_1 2024-09-12T18:19:18.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.157+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~9QNpt0eP8dGorq-o3Pp0811gekfLHOO.2 2024-09-12T18:19:18.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.157+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__shadow_key1.2~9QNpt0eP8dGorq-o3Pp0811gekfLHOO.2_1 2024-09-12T18:19:18.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.157+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~9QNpt0eP8dGorq-o3Pp0811gekfLHOO.3 2024-09-12T18:19:18.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.157+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9425146132805094922', time=2024-09-12T20:18:19.475357+0000, chain.objs.size()=1 2024-09-12T18:19:18.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.157+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.119__shadow_.fTiYVXVOrtPE0GX4H1ZRBxFY6g4UgzQ_0 2024-09-12T18:19:18.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.169+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.173+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:19:18.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.177+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.177+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.177+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:19:18.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.177+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16856589567180590135', time=2024-09-12T20:15:41.195508+0000, chain.objs.size()=1 2024-09-12T18:19:18.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.177+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.100__shadow_.9Sq-E1I5_72DEJUmHkLccLOFDBQeSnQ_0 2024-09-12T18:19:18.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.177+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2619844608033115386', time=2024-09-12T20:18:17.907887+0000, chain.objs.size()=1 2024-09-12T18:19:18.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.177+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.118__shadow_.hjz3AG00mPa3G3OQn65ThMCtn_rU9da_0 2024-09-12T18:19:18.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.177+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14368552560466937736', time=2024-09-12T20:18:38.804387+0000, chain.objs.size()=1 2024-09-12T18:19:18.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.177+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.132__shadow_.fLJe09gbUYzAveqyeUYPOeQwTQXxlEE_0 2024-09-12T18:19:18.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.181+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.185+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:19:18.191 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.185+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.189+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.189+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:19:18.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.189+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4918687501288547953', time=2024-09-12T20:18:11.715453+0000, chain.objs.size()=1 2024-09-12T18:19:18.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.189+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.114__shadow_.s9qTY-p2navEhUvf7Iof_kjjZHFcqbS_0 2024-09-12T18:19:18.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.189+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13328407350859449532', time=2024-09-12T20:18:22.530375+0000, chain.objs.size()=1 2024-09-12T18:19:18.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.189+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.121__shadow_.ZNwfY-7D4SgzlBdh5_5OcJPRVeKztCy_0 2024-09-12T18:19:18.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.189+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4342745010369768933', time=2024-09-12T20:18:33.065515+0000, chain.objs.size()=1 2024-09-12T18:19:18.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.189+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.128__shadow_.uAePCe17KnhVs9t-bAqjKmh8B0wSwz5_0 2024-09-12T18:19:18.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.189+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14067976950869223870', time=2024-09-12T20:19:17.079020+0000, chain.objs.size()=1 2024-09-12T18:19:18.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.189+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.144__shadow_.AHb_1hSdd_f009cQtGHHltB5mF8QwjA_0 2024-09-12T18:19:18.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.189+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.193+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:19:18.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.197+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.197+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.197+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:19:18.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.197+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10392312364211197716', time=2024-09-12T20:14:13.542449+0000, chain.objs.size()=5 2024-09-12T18:19:18.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.197+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~j1GxWXxwZNO3jIZ1PAVE-PWektvA8ec.1 2024-09-12T18:19:18.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.197+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~j1GxWXxwZNO3jIZ1PAVE-PWektvA8ec.2 2024-09-12T18:19:18.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.197+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~j1GxWXxwZNO3jIZ1PAVE-PWektvA8ec.3 2024-09-12T18:19:18.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.197+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~j1GxWXxwZNO3jIZ1PAVE-PWektvA8ec.4 2024-09-12T18:19:18.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.197+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~j1GxWXxwZNO3jIZ1PAVE-PWektvA8ec.5 2024-09-12T18:19:18.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.197+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15823074286329575369', time=2024-09-12T20:15:41.121674+0000, chain.objs.size()=5 2024-09-12T18:19:18.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.197+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.100__multipart_file.mpg.2~ejzz9v8BXc8vMNVPzOSa3Xu6NSXLI7Q.1 2024-09-12T18:19:18.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.197+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.100__multipart_file.mpg.2~ejzz9v8BXc8vMNVPzOSa3Xu6NSXLI7Q.2 2024-09-12T18:19:18.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.197+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.100__multipart_file.mpg.2~ejzz9v8BXc8vMNVPzOSa3Xu6NSXLI7Q.3 2024-09-12T18:19:18.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.197+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.100__multipart_file.mpg.2~ejzz9v8BXc8vMNVPzOSa3Xu6NSXLI7Q.4 2024-09-12T18:19:18.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.197+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.100__multipart_file.mpg.2~ejzz9v8BXc8vMNVPzOSa3Xu6NSXLI7Q.5 2024-09-12T18:19:18.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.197+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7874715252132701939', time=2024-09-12T20:16:37.412111+0000, chain.objs.size()=5 2024-09-12T18:19:18.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.197+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~4HcWbsTxcb2E2Tk8gtSMn7JZvJ1f_pf.1 2024-09-12T18:19:18.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.197+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~4HcWbsTxcb2E2Tk8gtSMn7JZvJ1f_pf.2 2024-09-12T18:19:18.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.205+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~4HcWbsTxcb2E2Tk8gtSMn7JZvJ1f_pf.3 2024-09-12T18:19:18.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.205+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~4HcWbsTxcb2E2Tk8gtSMn7JZvJ1f_pf.4 2024-09-12T18:19:18.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.205+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~4HcWbsTxcb2E2Tk8gtSMn7JZvJ1f_pf.5 2024-09-12T18:19:18.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.205+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4104039928217002475', time=2024-09-12T20:18:10.217117+0000, chain.objs.size()=1 2024-09-12T18:19:18.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.205+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.113__shadow_.hyB95PcDjJREXl26iasJFPGkq21xiue_0 2024-09-12T18:19:18.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.205+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8723007927405993595', time=2024-09-12T20:18:19.407195+0000, chain.objs.size()=1 2024-09-12T18:19:18.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.205+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.119__shadow_.2xoNpypMv7aDwBgXx3hCFFP_tNhK5Le_0 2024-09-12T18:19:18.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.205+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.543602551444914891', time=2024-09-12T20:18:26.867452+0000, chain.objs.size()=1 2024-09-12T18:19:18.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.205+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.124__shadow_.LzdjsN5eotKZ5oxyFVTNeBQYRp82ld2_0 2024-09-12T18:19:18.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.205+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6880271435610922103', time=2024-09-12T20:18:31.319758+0000, chain.objs.size()=1 2024-09-12T18:19:18.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.205+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.127__shadow_.hbh7zWjFMiBagdVWRQ43NSNwtQfT4pB_0 2024-09-12T18:19:18.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.213+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.217+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:19:18.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.221+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.221+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.221+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:19:18.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.221+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16985701202873690221', time=2024-09-12T20:13:16.053161+0000, chain.objs.size()=1 2024-09-12T18:19:18.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.221+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.81__shadow_.mSJYzS33xAvKwg9FXNVGvVfrK2ei5f6_0 2024-09-12T18:19:18.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.221+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13138583875885903124', time=2024-09-12T20:18:10.007902+0000, chain.objs.size()=1 2024-09-12T18:19:18.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.221+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.113__shadow_.Xcu-925OuzqtfQWMoDwg9FdcFceEBTV_0 2024-09-12T18:19:18.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.221+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16145814372659072989', time=2024-09-12T20:18:10.141088+0000, chain.objs.size()=1 2024-09-12T18:19:18.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.221+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.113__shadow_._5LdPLas09-tVctq-z6qUKlUwTbWWbr_0 2024-09-12T18:19:18.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.221+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7644479338384467516', time=2024-09-12T20:18:31.246646+0000, chain.objs.size()=1 2024-09-12T18:19:18.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.221+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.127__shadow_.DUGHxAOuxS4lsQ152PJwWkhb6jFKluk_0 2024-09-12T18:19:18.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.221+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.225+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:19:18.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.229+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.229+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.229+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:19:18.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.229+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10902485738182397413', time=2024-09-12T20:18:13.265701+0000, chain.objs.size()=1 2024-09-12T18:19:18.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.229+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.115__shadow_._TyUrSyyLeTsG3idpP542lh2W3BqbC9_0 2024-09-12T18:19:18.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.229+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3582575512263348452', time=2024-09-12T20:18:14.822896+0000, chain.objs.size()=1 2024-09-12T18:19:18.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.229+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.116__shadow_.d3tU7ogt4RtD8i8XBP_-bFpm1XFvHS-_0 2024-09-12T18:19:18.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.229+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.561916087414134701', time=2024-09-12T20:18:20.823070+0000, chain.objs.size()=1 2024-09-12T18:19:18.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.229+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.120__shadow_.yz7oFFLldrqpvS6jvJ1T7m98fmqQ4y5_0 2024-09-12T18:19:18.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.229+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1723350488366629617', time=2024-09-12T20:19:03.363100+0000, chain.objs.size()=5 2024-09-12T18:19:18.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.229+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.143__multipart_key1.2~VHftx_M_sVg-p8LZcTpdb1QmrXRpaQY.1 2024-09-12T18:19:18.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.229+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.143__multipart_key1.2~VHftx_M_sVg-p8LZcTpdb1QmrXRpaQY.2 2024-09-12T18:19:18.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.229+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.143__multipart_key1.2~VHftx_M_sVg-p8LZcTpdb1QmrXRpaQY.3 2024-09-12T18:19:18.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.229+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.143__multipart_key1.2~VHftx_M_sVg-p8LZcTpdb1QmrXRpaQY.4 2024-09-12T18:19:18.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.229+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.143__multipart_key1.2~VHftx_M_sVg-p8LZcTpdb1QmrXRpaQY.5 2024-09-12T18:19:18.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.237+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.237+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:19:18.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.241+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.241+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.241+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:19:18.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.241+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14324807834501608878', time=2024-09-12T20:16:26.773787+0000, chain.objs.size()=5 2024-09-12T18:19:18.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.241+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~oW-Emsr0w-L3pTrJREuywkYclLs5nBe.1 2024-09-12T18:19:18.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.241+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~oW-Emsr0w-L3pTrJREuywkYclLs5nBe.2 2024-09-12T18:19:18.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.241+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~oW-Emsr0w-L3pTrJREuywkYclLs5nBe.3 2024-09-12T18:19:18.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.241+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~oW-Emsr0w-L3pTrJREuywkYclLs5nBe.4 2024-09-12T18:19:18.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.241+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~oW-Emsr0w-L3pTrJREuywkYclLs5nBe.5 2024-09-12T18:19:18.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.241+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17729447336927210097', time=2024-09-12T20:18:19.348224+0000, chain.objs.size()=1 2024-09-12T18:19:18.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.241+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.119__shadow_.XnpC8ZhX2ejQBo4xLqgEkKExR9CpqJm_0 2024-09-12T18:19:18.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.241+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6553143610715593235', time=2024-09-12T20:18:22.378049+0000, chain.objs.size()=1 2024-09-12T18:19:18.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.241+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.121__shadow_.TStzoINzdGTjD-QJUEXMMg81Kzu4CGT_0 2024-09-12T18:19:18.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.241+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7046009889837425161', time=2024-09-12T20:18:29.747785+0000, chain.objs.size()=1 2024-09-12T18:19:18.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.241+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.126__shadow_.gC_A48h2EQgyiRnfce7_CKXGMwy7Hpf_0 2024-09-12T18:19:18.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.241+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1538060019627074448', time=2024-09-12T20:18:34.604782+0000, chain.objs.size()=1 2024-09-12T18:19:18.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.241+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.129__shadow_.B1siaDhC64ON1kWKqFGb561kNj3ZBjW_0 2024-09-12T18:19:18.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.249+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.253+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:19:18.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.253+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.253+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.257+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:19:18.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.257+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16309715519987891537', time=2024-09-12T20:15:41.274878+0000, chain.objs.size()=5 2024-09-12T18:19:18.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.257+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.100__multipart_file2.mpg.2~U_wmxgHh-j620yOb0AEMc7JGV5Ngf6Q.1 2024-09-12T18:19:18.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.257+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.100__multipart_file2.mpg.2~U_wmxgHh-j620yOb0AEMc7JGV5Ngf6Q.2 2024-09-12T18:19:18.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.257+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.100__multipart_file2.mpg.2~U_wmxgHh-j620yOb0AEMc7JGV5Ngf6Q.3 2024-09-12T18:19:18.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.257+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.100__multipart_file2.mpg.2~U_wmxgHh-j620yOb0AEMc7JGV5Ngf6Q.4 2024-09-12T18:19:18.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.257+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.100__multipart_file2.mpg.2~U_wmxgHh-j620yOb0AEMc7JGV5Ngf6Q.5 2024-09-12T18:19:18.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.257+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9141595780097263494', time=2024-09-12T20:18:25.325914+0000, chain.objs.size()=1 2024-09-12T18:19:18.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.257+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.123__shadow_.BQLZGm6UFUVdpwVGqKWsEdIvk4tRepn_0 2024-09-12T18:19:18.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.257+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1522559097213806787', time=2024-09-12T20:18:31.469282+0000, chain.objs.size()=1 2024-09-12T18:19:18.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.257+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.127__shadow_.w67RhijLY2qJTDWfK6W9YI75sj9n_gb_0 2024-09-12T18:19:18.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.261+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.265+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:19:18.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.265+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.269+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.269+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:19:18.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.269+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12383444536810861547', time=2024-09-12T20:18:08.696681+0000, chain.objs.size()=1 2024-09-12T18:19:18.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.269+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.112__shadow_.dZPZ08QOo528lcyHfmEAcKZ0VIi7pUh_0 2024-09-12T18:19:18.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.269+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17382292887033679788', time=2024-09-12T20:18:13.133540+0000, chain.objs.size()=1 2024-09-12T18:19:18.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.269+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.115__shadow_.tTDFR_HAFPtBDo7-stalv50TLaJ9vNt_0 2024-09-12T18:19:18.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.269+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12103519244325462971', time=2024-09-12T20:18:14.624539+0000, chain.objs.size()=1 2024-09-12T18:19:18.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.269+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.116__shadow_.I8DrLOgusOFg-JmoA63cwNid9NODKPx_0 2024-09-12T18:19:18.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.269+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7382346347000821143', time=2024-09-12T20:18:16.412349+0000, chain.objs.size()=1 2024-09-12T18:19:18.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.269+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.117__shadow_.rajvq1qdjgX5lHpuQCcXVEb1Z7kN3jl_0 2024-09-12T18:19:18.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.269+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16104190790873818910', time=2024-09-12T20:18:17.756093+0000, chain.objs.size()=1 2024-09-12T18:19:18.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.269+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.118__shadow_.VgFKiztEBEts62CdsRp55xalUhd329C_0 2024-09-12T18:19:18.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.269+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16359127963509121363', time=2024-09-12T20:18:32.912977+0000, chain.objs.size()=1 2024-09-12T18:19:18.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.269+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.128__shadow_.NtIp3T9rHrrgEnXkpop5yg4q0G8IYFd_0 2024-09-12T18:19:18.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.269+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6099365009551416389', time=2024-09-12T20:18:37.443799+0000, chain.objs.size()=1 2024-09-12T18:19:18.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.269+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.131__shadow_.ITpDlV6WdLfHdLuDqhzHO_nBdITdMIx_0 2024-09-12T18:19:18.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.273+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.273+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:19:18.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.277+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.277+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.277+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:19:18.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.277+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13078921586649419169', time=2024-09-12T20:14:22.953256+0000, chain.objs.size()=5 2024-09-12T18:19:18.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.277+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~sC3Cjim3ApijDOuF6ejsOkbwZpA0mWQ.1 2024-09-12T18:19:18.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.277+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__shadow_key1.2~sC3Cjim3ApijDOuF6ejsOkbwZpA0mWQ.1_1 2024-09-12T18:19:18.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.277+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~sC3Cjim3ApijDOuF6ejsOkbwZpA0mWQ.2 2024-09-12T18:19:18.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.277+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__shadow_key1.2~sC3Cjim3ApijDOuF6ejsOkbwZpA0mWQ.2_1 2024-09-12T18:19:18.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.277+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~sC3Cjim3ApijDOuF6ejsOkbwZpA0mWQ.3 2024-09-12T18:19:18.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.277+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10411306767346592047', time=2024-09-12T20:16:48.103226+0000, chain.objs.size()=5 2024-09-12T18:19:18.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.277+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~fRkyMcJlxwrgnbMJ-kjl_wiiP9dtI6r.1 2024-09-12T18:19:18.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.277+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__shadow_key1.2~fRkyMcJlxwrgnbMJ-kjl_wiiP9dtI6r.1_1 2024-09-12T18:19:18.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.277+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~fRkyMcJlxwrgnbMJ-kjl_wiiP9dtI6r.2 2024-09-12T18:19:18.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.277+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__shadow_key1.2~fRkyMcJlxwrgnbMJ-kjl_wiiP9dtI6r.2_1 2024-09-12T18:19:18.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.277+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.102__multipart_key1.2~fRkyMcJlxwrgnbMJ-kjl_wiiP9dtI6r.3 2024-09-12T18:19:18.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.277+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.484467286737119831', time=2024-09-12T20:17:11.334301+0000, chain.objs.size()=1 2024-09-12T18:19:18.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.277+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.103__shadow_.5BUpewT9Q6BGPRR7BW2JyTMtazyZDwb_0 2024-09-12T18:19:18.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.277+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10957793089774969242', time=2024-09-12T20:18:10.068737+0000, chain.objs.size()=1 2024-09-12T18:19:18.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.277+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.113__shadow_.xoziiqzgGiFkh8YawEJqZgduSHNT7sl_0 2024-09-12T18:19:18.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.281+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13280544943100289600', time=2024-09-12T20:18:20.971971+0000, chain.objs.size()=1 2024-09-12T18:19:18.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.281+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.120__shadow_.6x-L2lmjIoD0WA-1fFIzDUzdCQb0wgG_0 2024-09-12T18:19:18.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.281+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18036389329730753916', time=2024-09-12T20:18:24.028107+0000, chain.objs.size()=1 2024-09-12T18:19:18.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.281+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.122__shadow_.lxCx-He7TDHE3BxpehVnFJJadIuANnH_0 2024-09-12T18:19:18.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.285+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14339886341428237374', time=2024-09-12T20:18:38.729715+0000, chain.objs.size()=1 2024-09-12T18:19:18.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.285+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.132__shadow_.2A9s9a286CqKkib61GmwWP7p-xXPGiq_0 2024-09-12T18:19:18.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.293+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.297+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:19:18.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.297+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.301+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.301+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:19:18.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.301+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4928352640612945607', time=2024-09-12T20:14:18.546522+0000, chain.objs.size()=5 2024-09-12T18:19:18.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.301+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~72NGMIwoFivozjfZgFl5WqqNJ-sOQEb.1 2024-09-12T18:19:18.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.301+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~72NGMIwoFivozjfZgFl5WqqNJ-sOQEb.2 2024-09-12T18:19:18.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.301+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~72NGMIwoFivozjfZgFl5WqqNJ-sOQEb.3 2024-09-12T18:19:18.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.301+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~72NGMIwoFivozjfZgFl5WqqNJ-sOQEb.4 2024-09-12T18:19:18.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.301+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~72NGMIwoFivozjfZgFl5WqqNJ-sOQEb.5 2024-09-12T18:19:18.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.301+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13659397543367252757', time=2024-09-12T20:15:41.422666+0000, chain.objs.size()=1 2024-09-12T18:19:18.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.301+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.100__shadow_.mOGPh6vIn9jGZGJzWKgzxDGh5LW0A3n_0 2024-09-12T18:19:18.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.301+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7331446271933185150', time=2024-09-12T20:18:16.186765+0000, chain.objs.size()=1 2024-09-12T18:19:18.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.301+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.117__shadow_.xRVj09ldBwaahZGFYRIhCgYLE8JYYLU_0 2024-09-12T18:19:18.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.301+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1505238127364012183', time=2024-09-12T20:18:31.393511+0000, chain.objs.size()=1 2024-09-12T18:19:18.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.301+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.127__shadow_.ZUH-OlTgSnvrcyq3-3aniCkh7RaXmQd_0 2024-09-12T18:19:18.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.305+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.309+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:19:18.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.309+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.309+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.309+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:19:18.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.309+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.66977365127517936', time=2024-09-12T20:13:46.251442+0000, chain.objs.size()=5 2024-09-12T18:19:18.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.309+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.91__multipart_key1.2~aeiL8OIbusNNfdqeVQOoWSP5PLrDAeW.1 2024-09-12T18:19:18.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.309+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.91__multipart_key1.2~aeiL8OIbusNNfdqeVQOoWSP5PLrDAeW.2 2024-09-12T18:19:18.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.309+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.91__multipart_key1.2~aeiL8OIbusNNfdqeVQOoWSP5PLrDAeW.3 2024-09-12T18:19:18.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.309+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.91__multipart_key1.2~aeiL8OIbusNNfdqeVQOoWSP5PLrDAeW.4 2024-09-12T18:19:18.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.309+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.91__multipart_key1.2~aeiL8OIbusNNfdqeVQOoWSP5PLrDAeW.5 2024-09-12T18:19:18.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.309+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4264136267388005231', time=2024-09-12T20:14:28.230899+0000, chain.objs.size()=5 2024-09-12T18:19:18.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.309+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~Ki98GJz_pOW63o_cZFJ2E-qfKtX-g-K.1 2024-09-12T18:19:18.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.309+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__shadow_key1.2~Ki98GJz_pOW63o_cZFJ2E-qfKtX-g-K.1_1 2024-09-12T18:19:18.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.309+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~Ki98GJz_pOW63o_cZFJ2E-qfKtX-g-K.2 2024-09-12T18:19:18.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.309+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__shadow_key1.2~Ki98GJz_pOW63o_cZFJ2E-qfKtX-g-K.2_1 2024-09-12T18:19:18.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.309+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~Ki98GJz_pOW63o_cZFJ2E-qfKtX-g-K.3 2024-09-12T18:19:18.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.309+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2435177489955085233', time=2024-09-12T20:18:32.992768+0000, chain.objs.size()=1 2024-09-12T18:19:18.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.309+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.128__shadow_.-7RC15rCQ_GcK7Hv8T1Ujh5N-gkytiQ_0 2024-09-12T18:19:18.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.309+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10634835450912063651', time=2024-09-12T20:18:43.236110+0000, chain.objs.size()=1 2024-09-12T18:19:18.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.309+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.136__shadow_.7QO0pVZNx6hGc5_c9xiTRnfKFoOAvKa_0 2024-09-12T18:19:18.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.321+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.321+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:19:18.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.325+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.325+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.325+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:19:18.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.325+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5537666798943258062', time=2024-09-12T20:14:27.950200+0000, chain.objs.size()=5 2024-09-12T18:19:18.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.325+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~jsTzGDdDlyBNGup_hUSs7oyflMfzOxQ.1 2024-09-12T18:19:18.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.325+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__shadow_key1.2~jsTzGDdDlyBNGup_hUSs7oyflMfzOxQ.1_1 2024-09-12T18:19:18.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.325+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~jsTzGDdDlyBNGup_hUSs7oyflMfzOxQ.2 2024-09-12T18:19:18.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.325+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__shadow_key1.2~jsTzGDdDlyBNGup_hUSs7oyflMfzOxQ.2_1 2024-09-12T18:19:18.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.325+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.94__multipart_key1.2~jsTzGDdDlyBNGup_hUSs7oyflMfzOxQ.3 2024-09-12T18:19:18.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.325+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e', time=2024-09-12T20:17:50.679433+0000, chain.objs.size()=1 2024-09-12T18:19:18.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.325+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.20 2024-09-12T18:19:18.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.325+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e', time=2024-09-12T20:17:50.965552+0000, chain.objs.size()=55 2024-09-12T18:19:18.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.325+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.1 2024-09-12T18:19:18.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.325+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.2 2024-09-12T18:19:18.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.325+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.3 2024-09-12T18:19:18.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.325+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.4 2024-09-12T18:19:18.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.325+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.5 2024-09-12T18:19:18.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.325+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.6 2024-09-12T18:19:18.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.329+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.7 2024-09-12T18:19:18.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.329+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.8 2024-09-12T18:19:18.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.329+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.9 2024-09-12T18:19:18.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.329+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.10 2024-09-12T18:19:18.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.329+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.11 2024-09-12T18:19:18.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.329+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.12 2024-09-12T18:19:18.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.333+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.13 2024-09-12T18:19:18.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.333+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.14 2024-09-12T18:19:18.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.333+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.15 2024-09-12T18:19:18.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.333+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.16 2024-09-12T18:19:18.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.333+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.17 2024-09-12T18:19:18.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.337+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.18 2024-09-12T18:19:18.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.341+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.19 2024-09-12T18:19:18.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.341+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.roEHKKq7EDBXVjRMZgi7xDTBXkqz3TOR.20 2024-09-12T18:19:18.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.341+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.21 2024-09-12T18:19:18.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.341+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.22 2024-09-12T18:19:18.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.341+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.23 2024-09-12T18:19:18.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.341+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.24 2024-09-12T18:19:18.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.341+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.25 2024-09-12T18:19:18.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.341+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.26 2024-09-12T18:19:18.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.341+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.27 2024-09-12T18:19:18.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.341+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.28 2024-09-12T18:19:18.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.341+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.29 2024-09-12T18:19:18.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.345+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.30 2024-09-12T18:19:18.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.345+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.31 2024-09-12T18:19:18.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.349+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.32 2024-09-12T18:19:18.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.349+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.33 2024-09-12T18:19:18.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.349+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.34 2024-09-12T18:19:18.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.349+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.35 2024-09-12T18:19:18.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.349+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.36 2024-09-12T18:19:18.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.349+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.37 2024-09-12T18:19:18.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.349+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.38 2024-09-12T18:19:18.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.349+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.39 2024-09-12T18:19:18.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.349+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.40 2024-09-12T18:19:18.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.349+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.41 2024-09-12T18:19:18.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.353+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.42 2024-09-12T18:19:18.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.353+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.43 2024-09-12T18:19:18.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.353+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.44 2024-09-12T18:19:18.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.353+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.45 2024-09-12T18:19:18.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.353+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.46 2024-09-12T18:19:18.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.353+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.47 2024-09-12T18:19:18.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.353+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.48 2024-09-12T18:19:18.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.353+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.49 2024-09-12T18:19:18.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.357+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.50 2024-09-12T18:19:18.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.357+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.51 2024-09-12T18:19:18.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.357+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.52 2024-09-12T18:19:18.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.357+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.53 2024-09-12T18:19:18.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.361+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.55 2024-09-12T18:19:18.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.361+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.105__multipart_key1.2~0S057yqbDLhL4rpqbUAK_7n8OEmmy2e.57 2024-09-12T18:19:18.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.361+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7404580671184855528', time=2024-09-12T20:18:14.763800+0000, chain.objs.size()=1 2024-09-12T18:19:18.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.361+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.116__shadow_.Jgfq8RUNjpY25KJJztKdemlr2-VPUXZ_0 2024-09-12T18:19:18.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.361+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3989925237383342751', time=2024-09-12T20:18:21.044466+0000, chain.objs.size()=1 2024-09-12T18:19:18.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.361+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.120__shadow_.oCiwEY8fO9mBRQPnQrno8A79_bcEkrw_0 2024-09-12T18:19:18.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.361+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15311357389965179727', time=2024-09-12T20:18:22.455693+0000, chain.objs.size()=1 2024-09-12T18:19:18.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.361+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.121__shadow_.4Er3pAw4AvMNviKUsFobAdBE2pWAqU-_0 2024-09-12T18:19:18.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.361+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8813577852771623409', time=2024-09-12T20:18:45.190969+0000, chain.objs.size()=1 2024-09-12T18:19:18.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.361+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.138__shadow_.UcA2twhlxhbvAUlmgUQDWGBquY3ocnx_0 2024-09-12T18:19:18.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.365+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.369+0000 7f948646c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:19:18.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.369+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.373+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.373+0000 7f948646c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:19:18.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.373+0000 7f948646c9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4649448980665603592', time=2024-09-12T20:18:24.176623+0000, chain.objs.size()=1 2024-09-12T18:19:18.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.373+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.122__shadow_.rfZLKy2zKJeXjkKN6MsSnPhAd6yIHLZ_0 2024-09-12T18:19:18.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.373+0000 7f948646c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:19:18.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.377+0000 7f9339fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:18.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.377+0000 7f948646c9c0 20 remove_watcher() i=0 2024-09-12T18:19:18.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.377+0000 7f948646c9c0 2 removed watcher, disabling cache 2024-09-12T18:19:18.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.381+0000 7f948646c9c0 20 remove_watcher() i=1 2024-09-12T18:19:18.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.381+0000 7f948646c9c0 20 remove_watcher() i=2 2024-09-12T18:19:18.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.381+0000 7f948646c9c0 20 remove_watcher() i=3 2024-09-12T18:19:18.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.385+0000 7f948646c9c0 20 remove_watcher() i=4 2024-09-12T18:19:18.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.385+0000 7f948646c9c0 20 remove_watcher() i=5 2024-09-12T18:19:18.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.385+0000 7f948646c9c0 20 remove_watcher() i=6 2024-09-12T18:19:18.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.385+0000 7f948646c9c0 20 remove_watcher() i=7 2024-09-12T18:19:18.405 DEBUG:teuthology.orchestra.run.smithi098:> radosgw-admin gc process --include-all 2024-09-12T18:19:18.473 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:18.474 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:18.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.513+0000 7fc977d139c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:18.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.513+0000 7fc977d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:18.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.513+0000 7fc977d139c0 20 realm 2024-09-12T18:19:18.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.513+0000 7fc977d139c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:18.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.513+0000 7fc977d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:18.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.513+0000 7fc977d139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:18.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.513+0000 7fc977d139c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:18.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.513+0000 7fc977d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:18.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.513+0000 7fc977d139c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:18.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.513+0000 7fc977d139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:18.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.513+0000 7fc977d139c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:18.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.517+0000 7fc977d139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:18.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.517+0000 7fc977d139c0 20 searching for the correct realm 2024-09-12T18:19:18.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.521+0000 7fc97601a640 0 -- 172.21.15.98:0/4040398457 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x5644dd87f390 msgr2=0x5644dd8817b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:18.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.529+0000 7fc975018640 0 -- 172.21.15.98:0/4040398457 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fc9680e9950 msgr2=0x7fc9680d3420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:18.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.533+0000 7fc977d139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:18.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.533+0000 7fc977d139c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:19:18.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.533+0000 7fc977d139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:18.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.533+0000 7fc977d139c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:19:18.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.533+0000 7fc977d139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:18.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.533+0000 7fc977d139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:18.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.533+0000 7fc977d139c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:18.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.533+0000 7fc977d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:18.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.533+0000 7fc977d139c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:18.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.537+0000 7fc977d139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:18.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.537+0000 7fc977d139c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:18.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.537+0000 7fc977d139c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:18.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.537+0000 7fc977d139c0 20 zone default found 2024-09-12T18:19:18.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.537+0000 7fc977d139c0 4 Realm: () 2024-09-12T18:19:18.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.537+0000 7fc977d139c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:19:18.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.537+0000 7fc977d139c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:19:18.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.537+0000 7fc977d139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:18.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.537+0000 7fc977d139c0 20 zonegroup default 2024-09-12T18:19:18.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.537+0000 7fc977d139c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:18.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.537+0000 7fc977d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:18.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.537+0000 7fc977d139c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:18.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.537+0000 7fc977d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:18.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.537+0000 7fc977d139c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:18.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.537+0000 7fc977d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:18.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.537+0000 7fc977d139c0 20 started sync module instance, tier type = 2024-09-12T18:19:18.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.537+0000 7fc977d139c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:19:18.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.553+0000 7fc977d139c0 20 add_watcher() i=0 2024-09-12T18:19:18.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.553+0000 7fc977d139c0 20 add_watcher() i=1 2024-09-12T18:19:18.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.553+0000 7fc977d139c0 20 add_watcher() i=2 2024-09-12T18:19:18.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.553+0000 7fc977d139c0 20 add_watcher() i=3 2024-09-12T18:19:18.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.553+0000 7fc977d139c0 20 add_watcher() i=4 2024-09-12T18:19:18.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.553+0000 7fc977d139c0 20 add_watcher() i=5 2024-09-12T18:19:18.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.553+0000 7fc977d139c0 20 add_watcher() i=6 2024-09-12T18:19:18.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.553+0000 7fc977d139c0 20 add_watcher() i=7 2024-09-12T18:19:18.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.553+0000 7fc977d139c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:18.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.557+0000 7fc8277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:18.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.557+0000 7fc977d139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:18.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.557+0000 7fc977d139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:18.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.629+0000 7fc8267fc640 20 reqs_thread_entry: start 2024-09-12T18:19:18.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.629+0000 7fc977d139c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:18.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.629+0000 7fc977d139c0 20 Filter name: none 2024-09-12T18:19:18.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.629+0000 7fc797fff640 20 reqs_thread_entry: start 2024-09-12T18:19:18.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.629+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:19:18.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.633+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.633+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.633+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.633+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:19:18.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.637+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.641+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.641+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.641+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:19:18.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.645+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.649+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.649+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.653+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:19:18.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.653+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.653+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.657+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.657+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:19:18.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.661+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.661+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.661+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.665+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:19:18.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.665+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.669+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.669+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.669+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:19:18.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.673+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.673+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.673+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.677+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:19:18.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.681+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.681+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.681+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.681+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:19:18.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.685+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.689+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.689+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.693+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:19:18.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.693+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.697+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.697+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.697+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:19:18.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.701+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.701+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.705+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.705+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:19:18.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.705+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.709+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.709+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.709+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:19:18.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.713+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.713+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.713+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.713+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:19:18.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.717+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.717+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:18.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.717+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.721+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:19:18.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.721+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:18.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.725+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:19.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.725+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.725+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:19:19.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.729+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.729+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:19.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.729+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.733+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:19:19.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.737+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.737+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:19.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.741+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.741+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:19:19.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.745+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.749+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:19.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.749+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.753+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:19:19.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.757+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.757+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:19.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.757+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.761+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:19:19.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.765+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.765+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:19.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.765+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.769+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:19:19.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.773+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.773+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:19.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.773+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.777+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:19:19.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.781+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.781+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:19.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.785+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.785+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:19:19.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.789+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.793+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:19.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.793+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.797+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:19:19.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.801+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.801+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:19.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.805+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.805+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:19:19.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.809+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.809+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:19.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.813+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.813+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:19:19.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.817+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.821+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:19.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.821+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.825+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:19:19.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.825+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.825+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:19.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.829+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.829+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:19:19.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.833+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.833+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:19.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.833+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.833+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:19:19.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.837+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.837+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:19.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.841+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.841+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:19:19.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.845+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.845+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:19.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.849+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.849+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:19:19.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.853+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.853+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:19.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.853+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.857+0000 7fc977d139c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:19:19.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.861+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.861+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:19:19.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.861+0000 7fc977d139c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:19:19.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.865+0000 7fc8277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:19.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.869+0000 7fc977d139c0 20 remove_watcher() i=0 2024-09-12T18:19:19.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.869+0000 7fc977d139c0 2 removed watcher, disabling cache 2024-09-12T18:19:19.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.873+0000 7fc977d139c0 20 remove_watcher() i=1 2024-09-12T18:19:19.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.877+0000 7fc977d139c0 20 remove_watcher() i=2 2024-09-12T18:19:19.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.877+0000 7fc977d139c0 20 remove_watcher() i=3 2024-09-12T18:19:19.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.881+0000 7fc977d139c0 20 remove_watcher() i=4 2024-09-12T18:19:19.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.881+0000 7fc977d139c0 20 remove_watcher() i=5 2024-09-12T18:19:19.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.885+0000 7fc977d139c0 20 remove_watcher() i=6 2024-09-12T18:19:19.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:18.885+0000 7fc977d139c0 20 remove_watcher() i=7 2024-09-12T18:19:19.025 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T18:19:19.042 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T18:19:19.043 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T18:19:19.043 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T18:19:19.043 DEBUG:teuthology.orchestra.run.smithi098:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T18:19:19.065 INFO:teuthology.orchestra.run.smithi098.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T18:19:20.112 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T18:19:20.113 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-12T18:19:20.196 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:20.196 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:20.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.233+0000 7fcbeea5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.233+0000 7fcbeea5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.233+0000 7fcbeea5a9c0 20 realm 2024-09-12T18:19:20.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.233+0000 7fcbeea5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.233+0000 7fcbeea5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.233+0000 7fcbeea5a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:20.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.233+0000 7fcbeea5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.233+0000 7fcbeea5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.233+0000 7fcbeea5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.237+0000 7fcbeea5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:20.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.237+0000 7fcbeea5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.237+0000 7fcbeea5a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:20.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.237+0000 7fcbeea5a9c0 20 searching for the correct realm 2024-09-12T18:19:20.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.245+0000 7fcbecd61640 0 -- 172.21.15.98:0/671924720 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7fcbe00478e0 msgr2=0x7fcbe0033400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:19:20.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.461+0000 7fcbec560640 0 -- 172.21.15.98:0/671924720 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x555751341920 msgr2=0x555751343d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:20.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.469+0000 7fcbeea5a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:20.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.469+0000 7fcbeea5a9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:19:20.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.469+0000 7fcbeea5a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:20.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.469+0000 7fcbeea5a9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:19:20.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.469+0000 7fcbeea5a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:20.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.469+0000 7fcbeea5a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:20.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.469+0000 7fcbeea5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.469+0000 7fcbeea5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.469+0000 7fcbeea5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.469+0000 7fcbeea5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:20.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.469+0000 7fcbeea5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.469+0000 7fcbeea5a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:20.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.469+0000 7fcbeea5a9c0 20 zone default found 2024-09-12T18:19:20.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.469+0000 7fcbeea5a9c0 4 Realm: () 2024-09-12T18:19:20.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.469+0000 7fcbeea5a9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:19:20.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.469+0000 7fcbeea5a9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:19:20.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.469+0000 7fcbeea5a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:20.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.469+0000 7fcbeea5a9c0 20 zonegroup default 2024-09-12T18:19:20.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.469+0000 7fcbeea5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.473+0000 7fcbeea5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.473+0000 7fcbeea5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.473+0000 7fcbeea5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.473+0000 7fcbeea5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.473+0000 7fcbeea5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.473+0000 7fcbeea5a9c0 20 started sync module instance, tier type = 2024-09-12T18:19:20.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.473+0000 7fcbeea5a9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:19:20.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.497+0000 7fcbeea5a9c0 20 add_watcher() i=0 2024-09-12T18:19:20.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.497+0000 7fcbeea5a9c0 20 add_watcher() i=1 2024-09-12T18:19:20.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.497+0000 7fcbeea5a9c0 20 add_watcher() i=2 2024-09-12T18:19:20.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.497+0000 7fcbeea5a9c0 20 add_watcher() i=3 2024-09-12T18:19:20.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.497+0000 7fcbeea5a9c0 20 add_watcher() i=4 2024-09-12T18:19:20.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.497+0000 7fcbeea5a9c0 20 add_watcher() i=5 2024-09-12T18:19:20.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.497+0000 7fcbeea5a9c0 20 add_watcher() i=6 2024-09-12T18:19:20.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.497+0000 7fcbeea5a9c0 20 add_watcher() i=7 2024-09-12T18:19:20.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.497+0000 7fcbeea5a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:20.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.501+0000 7fcaa2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:20.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.501+0000 7fcbeea5a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:20.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.501+0000 7fcbeea5a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:20.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.501+0000 7fcbeea5a9c0 5 note: GC not initialized 2024-09-12T18:19:20.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.501+0000 7fcaa1fe3640 20 reqs_thread_entry: start 2024-09-12T18:19:20.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.505+0000 7fcbeea5a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:20.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.505+0000 7fcbeea5a9c0 20 Filter name: none 2024-09-12T18:19:20.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.505+0000 7fca9b7fe640 20 reqs_thread_entry: start 2024-09-12T18:19:20.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.505+0000 7fcbeea5a9c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-12T18:19:20.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.505+0000 7fcbeea5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.505+0000 7fcbeea5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.505+0000 7fcbeea5a9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-12T18:19:20.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.505+0000 7fcbeea5a9c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T18:19:20.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.505+0000 7fcbeea5a9c0 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-12T18:19:20.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.505+0000 7fcbeea5a9c0 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-12T18:19:20.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.505+0000 7fcbeea5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.505+0000 7fcbeea5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.505+0000 7fcbeea5a9c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-12T18:19:20.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.505+0000 7fcbeea5a9c0 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T18:19:20.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.505+0000 7fcbeea5a9c0 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-12T18:19:20.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.509+0000 7fcbeea5a9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T18:19:20.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.509+0000 7fcbeea5a9c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T18:19:20.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.509+0000 7fcbeea5a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-12T18:19:20.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.509+0000 7fcacb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366325 cookie 93833512892608 notifier 8390 bl.length()=384 2024-09-12T18:19:20.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.509+0000 7fcacb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T18:19:20.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.509+0000 7fcacb7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T18:19:20.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.513+0000 7fcbeea5a9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T18:19:20.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.513+0000 7fcbeea5a9c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T18:19:20.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.513+0000 7fcbeea5a9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-12T18:19:20.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.513+0000 7fcacb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366328 cookie 93833512930400 notifier 8390 bl.length()=225 2024-09-12T18:19:20.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.513+0000 7fcacb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T18:19:20.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.513+0000 7fcacb7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T18:19:20.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.517+0000 7fcbeea5a9c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T18:19:20.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.517+0000 7fcbeea5a9c0 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T18:19:20.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.517+0000 7fcbeea5a9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-12T18:19:20.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.517+0000 7fcacaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366253 cookie 93833512925600 notifier 8390 bl.length()=234 2024-09-12T18:19:20.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.517+0000 7fcacaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T18:19:20.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.517+0000 7fcacaffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T18:19:20.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.521+0000 7fcaa2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:20.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.525+0000 7fcbeea5a9c0 20 remove_watcher() i=0 2024-09-12T18:19:20.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.525+0000 7fcbeea5a9c0 2 removed watcher, disabling cache 2024-09-12T18:19:20.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.529+0000 7fcbeea5a9c0 20 remove_watcher() i=1 2024-09-12T18:19:20.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.529+0000 7fcbeea5a9c0 20 remove_watcher() i=2 2024-09-12T18:19:20.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.533+0000 7fcbeea5a9c0 20 remove_watcher() i=3 2024-09-12T18:19:20.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.533+0000 7fcbeea5a9c0 20 remove_watcher() i=4 2024-09-12T18:19:20.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.537+0000 7fcbeea5a9c0 20 remove_watcher() i=5 2024-09-12T18:19:20.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.537+0000 7fcbeea5a9c0 20 remove_watcher() i=6 2024-09-12T18:19:20.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.537+0000 7fcbeea5a9c0 20 remove_watcher() i=7 2024-09-12T18:19:20.557 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T18:19:20.557 INFO:teuthology.orchestra.run.smithi098.stdout: "id": "RGW11111111111111111", 2024-09-12T18:19:20.557 INFO:teuthology.orchestra.run.smithi098.stdout: "tenant": "", 2024-09-12T18:19:20.557 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "Mr.RGW11111111111111111", 2024-09-12T18:19:20.557 INFO:teuthology.orchestra.run.smithi098.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-12T18:19:20.557 INFO:teuthology.orchestra.run.smithi098.stdout: "quota": { 2024-09-12T18:19:20.557 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:19:20.557 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:19:20.557 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:19:20.557 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:19:20.557 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:19:20.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:20.558 INFO:teuthology.orchestra.run.smithi098.stdout: "bucket_quota": { 2024-09-12T18:19:20.558 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:19:20.558 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:19:20.558 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:19:20.558 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:19:20.558 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:19:20.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:20.558 INFO:teuthology.orchestra.run.smithi098.stdout: "max_users": 1000, 2024-09-12T18:19:20.558 INFO:teuthology.orchestra.run.smithi098.stdout: "max_roles": 1000, 2024-09-12T18:19:20.558 INFO:teuthology.orchestra.run.smithi098.stdout: "max_groups": 1000, 2024-09-12T18:19:20.558 INFO:teuthology.orchestra.run.smithi098.stdout: "max_buckets": 1000, 2024-09-12T18:19:20.558 INFO:teuthology.orchestra.run.smithi098.stdout: "max_access_keys": 4 2024-09-12T18:19:20.559 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T18:19:20.560 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-12T18:19:20.560 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key UBOOVGDWFREEIVSMWAOX --secret qJbTWNceCCPt4hBkwXnGgWmOjQYGF1NcNSnPfFDUG/Y+FJYllyv+ew== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-12T18:19:20.647 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:20.648 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:20.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.685+0000 7f9ed85249c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.685+0000 7f9ed85249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.685+0000 7f9ed85249c0 20 realm 2024-09-12T18:19:20.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.685+0000 7f9ed85249c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.685+0000 7f9ed85249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.685+0000 7f9ed85249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:20.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.685+0000 7f9ed85249c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.685+0000 7f9ed85249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.685+0000 7f9ed85249c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.689+0000 7f9ed85249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:20.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.689+0000 7f9ed85249c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.689+0000 7f9ed85249c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:20.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.689+0000 7f9ed85249c0 20 searching for the correct realm 2024-09-12T18:19:20.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.693+0000 7f9ecffff640 0 -- 172.21.15.98:0/1439597606 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f9ed012b020 msgr2=0x7f9ed0102a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:20.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.701+0000 7f9ecffff640 0 -- 172.21.15.98:0/1439597606 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f9da0081180 msgr2=0x7f9da00835b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:19:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:19:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:20.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:20.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 zone default found 2024-09-12T18:19:20.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 4 Realm: () 2024-09-12T18:19:20.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:19:20.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:19:20.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:20.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 zonegroup default 2024-09-12T18:19:20.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 started sync module instance, tier type = 2024-09-12T18:19:20.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.709+0000 7f9ed85249c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:19:20.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.725+0000 7f9ed85249c0 20 add_watcher() i=0 2024-09-12T18:19:20.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.725+0000 7f9ed85249c0 20 add_watcher() i=1 2024-09-12T18:19:20.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.725+0000 7f9ed85249c0 20 add_watcher() i=2 2024-09-12T18:19:20.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.725+0000 7f9ed85249c0 20 add_watcher() i=3 2024-09-12T18:19:20.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.725+0000 7f9ed85249c0 20 add_watcher() i=4 2024-09-12T18:19:20.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.725+0000 7f9ed85249c0 20 add_watcher() i=5 2024-09-12T18:19:20.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.725+0000 7f9ed85249c0 20 add_watcher() i=6 2024-09-12T18:19:20.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.729+0000 7f9ed85249c0 20 add_watcher() i=7 2024-09-12T18:19:20.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.729+0000 7f9ed85249c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:20.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.729+0000 7f9d8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:20.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.729+0000 7f9ed85249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:20.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.729+0000 7f9ed85249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:20.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.729+0000 7f9ed85249c0 5 note: GC not initialized 2024-09-12T18:19:20.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.729+0000 7f9d077fe640 20 reqs_thread_entry: start 2024-09-12T18:19:20.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.729+0000 7f9ed85249c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:20.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.729+0000 7f9ed85249c0 20 Filter name: none 2024-09-12T18:19:20.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.729+0000 7f9d057fa640 20 reqs_thread_entry: start 2024-09-12T18:19:20.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.729+0000 7f9ed85249c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T18:19:20.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.729+0000 7f9ed85249c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.729+0000 7f9ed85249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.729+0000 7f9ed85249c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T18:19:20.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.729+0000 7f9ed85249c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:19:20.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.729+0000 7f9ed85249c0 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T18:19:20.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.729+0000 7f9ed85249c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.733+0000 7f9ed85249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.733+0000 7f9ed85249c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T18:19:20.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.733+0000 7f9ed85249c0 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T18:19:20.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.733+0000 7f9ed85249c0 10 cache get: name=default.rgw.meta+users.keys+UBOOVGDWFREEIVSMWAOX : miss 2024-09-12T18:19:20.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.733+0000 7f9ed85249c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.733+0000 7f9ed85249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.733+0000 7f9ed85249c0 10 cache put: name=default.rgw.meta+users.keys+UBOOVGDWFREEIVSMWAOX info.flags=0x0 2024-09-12T18:19:20.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.733+0000 7f9ed85249c0 10 adding default.rgw.meta+users.keys+UBOOVGDWFREEIVSMWAOX to cache LRU end 2024-09-12T18:19:20.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.733+0000 7f9ed85249c0 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-12T18:19:20.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.733+0000 7f9ed85249c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.733+0000 7f9ed85249c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T18:19:20.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.733+0000 7f9ed85249c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T18:19:20.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.733+0000 7f9ed85249c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T18:19:20.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.733+0000 7f9ed85249c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:19:20.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.733+0000 7f9ed85249c0 10 cache get: name=default.rgw.meta+users.keys+UBOOVGDWFREEIVSMWAOX : hit (negative entry) 2024-09-12T18:19:20.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.733+0000 7f9ed85249c0 10 cache get: name=default.rgw.meta+users.keys+UBOOVGDWFREEIVSMWAOX : hit (negative entry) 2024-09-12T18:19:20.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.733+0000 7f9ed85249c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T18:19:20.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.733+0000 7f9ed85249c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:19:20.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.733+0000 7f9ed85249c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T18:19:20.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.737+0000 7f9db9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366329 cookie 93903388942848 notifier 8405 bl.length()=673 2024-09-12T18:19:20.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.737+0000 7f9db9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T18:19:20.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.737+0000 7f9db9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:19:20.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.737+0000 7f9ed85249c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T18:19:20.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.737+0000 7f9ed85249c0 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T18:19:20.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.737+0000 7f9ed85249c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T18:19:20.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.741+0000 7f9db97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366330 cookie 93903388948944 notifier 8405 bl.length()=185 2024-09-12T18:19:20.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.741+0000 7f9db97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T18:19:20.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.741+0000 7f9db97fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T18:19:20.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.745+0000 7f9ed85249c0 10 cache put: name=default.rgw.meta+users.keys+UBOOVGDWFREEIVSMWAOX info.flags=0x7 2024-09-12T18:19:20.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.745+0000 7f9ed85249c0 10 moving default.rgw.meta+users.keys+UBOOVGDWFREEIVSMWAOX to cache LRU end 2024-09-12T18:19:20.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.745+0000 7f9ed85249c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:UBOOVGDWFREEIVSMWAOX, ofs0, ns] 2024-09-12T18:19:20.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.745+0000 7f9db97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366281 cookie 93903388957728 notifier 8405 bl.length()=186 2024-09-12T18:19:20.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.745+0000 7f9db97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+UBOOVGDWFREEIVSMWAOX info.flags=0x7 2024-09-12T18:19:20.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.745+0000 7f9db97fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+UBOOVGDWFREEIVSMWAOX to cache LRU end 2024-09-12T18:19:20.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.745+0000 7f9ed85249c0 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-12T18:19:20.752 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T18:19:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "user_id": "foo.client.0", 2024-09-12T18:19:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-12T18:19:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "email": "foo+test@test.test", 2024-09-12T18:19:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "suspended": 0, 2024-09-12T18:19:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "max_buckets": 1000, 2024-09-12T18:19:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "subusers": [], 2024-09-12T18:19:20.753 INFO:teuthology.orchestra.run.smithi098.stdout: "keys": [ 2024-09-12T18:19:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-12T18:19:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "user": "foo.client.0", 2024-09-12T18:19:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "access_key": "UBOOVGDWFREEIVSMWAOX", 2024-09-12T18:19:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "secret_key": "qJbTWNceCCPt4hBkwXnGgWmOjQYGF1NcNSnPfFDUG/Y+FJYllyv+ew==", 2024-09-12T18:19:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "active": true, 2024-09-12T18:19:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "create_date": "2024-09-12T18:19:20.737923Z" 2024-09-12T18:19:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-12T18:19:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-12T18:19:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "swift_keys": [], 2024-09-12T18:19:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": [], 2024-09-12T18:19:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "op_mask": "read, write, delete", 2024-09-12T18:19:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "default_placement": "", 2024-09-12T18:19:20.754 INFO:teuthology.orchestra.run.smithi098.stdout: "default_storage_class": "", 2024-09-12T18:19:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "placement_tags": [], 2024-09-12T18:19:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "bucket_quota": { 2024-09-12T18:19:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:19:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:19:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:19:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:19:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:19:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "user_quota": { 2024-09-12T18:19:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:19:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:19:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:19:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:19:20.755 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:19:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "temp_url_keys": [], 2024-09-12T18:19:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "root", 2024-09-12T18:19:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "mfa_ids": [], 2024-09-12T18:19:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "account_id": "RGW11111111111111111", 2024-09-12T18:19:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/", 2024-09-12T18:19:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "create_date": "2024-09-12T18:19:20.737906Z", 2024-09-12T18:19:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-12T18:19:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: "group_ids": [] 2024-09-12T18:19:20.756 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T18:19:20.756 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:19:20.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.749+0000 7f9d8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:20.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.753+0000 7f9ed85249c0 20 remove_watcher() i=0 2024-09-12T18:19:20.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.753+0000 7f9ed85249c0 2 removed watcher, disabling cache 2024-09-12T18:19:20.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.757+0000 7f9ed85249c0 20 remove_watcher() i=1 2024-09-12T18:19:20.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.757+0000 7f9ed85249c0 20 remove_watcher() i=2 2024-09-12T18:19:20.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.757+0000 7f9ed85249c0 20 remove_watcher() i=3 2024-09-12T18:19:20.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.761+0000 7f9ed85249c0 20 remove_watcher() i=4 2024-09-12T18:19:20.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.761+0000 7f9ed85249c0 20 remove_watcher() i=5 2024-09-12T18:19:20.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.765+0000 7f9ed85249c0 20 remove_watcher() i=6 2024-09-12T18:19:20.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.765+0000 7f9ed85249c0 20 remove_watcher() i=7 2024-09-12T18:19:20.785 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 5775340489 --totp-seed KX3MX3APFBD5PAKFL5BN3HE6S44VZV7DPX5RKMD6GWVXQPYLDKDSICTFFYX52CVO --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:19:20.825 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:20.826 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:20.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.865+0000 7fc35c1fa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.865+0000 7fc35c1fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.865+0000 7fc35c1fa9c0 20 realm 2024-09-12T18:19:20.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.865+0000 7fc35c1fa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.865+0000 7fc35c1fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.865+0000 7fc35c1fa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:20.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.865+0000 7fc35c1fa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.865+0000 7fc35c1fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.865+0000 7fc35c1fa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.869+0000 7fc35c1fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:20.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.869+0000 7fc35c1fa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.869+0000 7fc35c1fa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:20.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.869+0000 7fc35c1fa9c0 20 searching for the correct realm 2024-09-12T18:19:20.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.873+0000 7fc3594ff640 0 -- 172.21.15.98:0/2997002431 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fc34c0db060 msgr2=0x7fc34c0fdfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:20.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.881+0000 7fc3594ff640 0 -- 172.21.15.98:0/2997002431 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fc224081100 msgr2=0x7fc224083530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:20.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.885+0000 7fc35c1fa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:20.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.885+0000 7fc35c1fa9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:19:20.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.885+0000 7fc35c1fa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:20.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.885+0000 7fc35c1fa9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:19:20.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.885+0000 7fc35c1fa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:20.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.885+0000 7fc35c1fa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:20.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.885+0000 7fc35c1fa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.889+0000 7fc35c1fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.889+0000 7fc35c1fa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.889+0000 7fc35c1fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:20.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.889+0000 7fc35c1fa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.889+0000 7fc35c1fa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:20.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.889+0000 7fc35c1fa9c0 20 zone default found 2024-09-12T18:19:20.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.889+0000 7fc35c1fa9c0 4 Realm: () 2024-09-12T18:19:20.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.889+0000 7fc35c1fa9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:19:20.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.889+0000 7fc35c1fa9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:19:20.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.889+0000 7fc35c1fa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:20.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.889+0000 7fc35c1fa9c0 20 zonegroup default 2024-09-12T18:19:20.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.889+0000 7fc35c1fa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.889+0000 7fc35c1fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.889+0000 7fc35c1fa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.889+0000 7fc35c1fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.889+0000 7fc35c1fa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.889+0000 7fc35c1fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:20.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.889+0000 7fc35c1fa9c0 20 started sync module instance, tier type = 2024-09-12T18:19:20.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.889+0000 7fc35c1fa9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:19:20.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.905+0000 7fc35c1fa9c0 20 add_watcher() i=0 2024-09-12T18:19:20.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.905+0000 7fc35c1fa9c0 20 add_watcher() i=1 2024-09-12T18:19:20.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.905+0000 7fc35c1fa9c0 20 add_watcher() i=2 2024-09-12T18:19:20.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.905+0000 7fc35c1fa9c0 20 add_watcher() i=3 2024-09-12T18:19:20.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.905+0000 7fc35c1fa9c0 20 add_watcher() i=4 2024-09-12T18:19:20.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.905+0000 7fc35c1fa9c0 20 add_watcher() i=5 2024-09-12T18:19:20.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.905+0000 7fc35c1fa9c0 20 add_watcher() i=6 2024-09-12T18:19:20.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.909+0000 7fc35c1fa9c0 20 add_watcher() i=7 2024-09-12T18:19:20.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.909+0000 7fc35c1fa9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:20.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.909+0000 7fc20b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:20.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.909+0000 7fc35c1fa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:20.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.909+0000 7fc35c1fa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:20.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.909+0000 7fc35c1fa9c0 5 note: GC not initialized 2024-09-12T18:19:20.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.909+0000 7fc20a7fc640 20 reqs_thread_entry: start 2024-09-12T18:19:20.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.909+0000 7fc35c1fa9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:20.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.909+0000 7fc35c1fa9c0 20 Filter name: none 2024-09-12T18:19:20.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.909+0000 7fc17bfff640 20 reqs_thread_entry: start 2024-09-12T18:19:20.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.909+0000 7fc35c1fa9c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T18:19:20.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.909+0000 7fc35c1fa9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:20.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.913+0000 7fc35c1fa9c0 20 rados_obj.operate() r=0 bl.length=488 2024-09-12T18:19:20.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.913+0000 7fc35c1fa9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T18:19:20.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.913+0000 7fc35c1fa9c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:19:20.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:20.913+0000 7fc35c1fa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:19:22.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.669+0000 7fc35c1fa9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T18:19:22.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.669+0000 7fc35c1fa9c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:19:22.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.669+0000 7fc35c1fa9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T18:19:22.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.669+0000 7fc23cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300923 cookie 94821843226496 notifier 8423 bl.length()=687 2024-09-12T18:19:22.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.669+0000 7fc23cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T18:19:22.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.669+0000 7fc23cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:19:22.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.677+0000 7fc20b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:22.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.681+0000 7fc35c1fa9c0 20 remove_watcher() i=0 2024-09-12T18:19:22.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.681+0000 7fc35c1fa9c0 2 removed watcher, disabling cache 2024-09-12T18:19:22.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.685+0000 7fc35c1fa9c0 20 remove_watcher() i=1 2024-09-12T18:19:22.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.685+0000 7fc35c1fa9c0 20 remove_watcher() i=2 2024-09-12T18:19:22.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.689+0000 7fc35c1fa9c0 20 remove_watcher() i=3 2024-09-12T18:19:22.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.693+0000 7fc35c1fa9c0 20 remove_watcher() i=4 2024-09-12T18:19:22.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.693+0000 7fc35c1fa9c0 20 remove_watcher() i=5 2024-09-12T18:19:22.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.697+0000 7fc35c1fa9c0 20 remove_watcher() i=6 2024-09-12T18:19:22.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.697+0000 7fc35c1fa9c0 20 remove_watcher() i=7 2024-09-12T18:19:22.722 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T18:19:22.723 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key NPAFIWBASJYVOSLXCNXF --secret L+59e8BhFYICNWj2pKytg6K+PbYM0FSZ0KbgzAiGGda60I9dPnMq7w== --cluster ceph 2024-09-12T18:19:22.805 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:22.805 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:22.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.841+0000 7fdf098759c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:22.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.841+0000 7fdf098759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:22.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.841+0000 7fdf098759c0 20 realm 2024-09-12T18:19:22.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.841+0000 7fdf098759c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:22.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.845+0000 7fdf098759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:22.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.845+0000 7fdf098759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:22.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.845+0000 7fdf098759c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:22.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.845+0000 7fdf098759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:22.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.845+0000 7fdf098759c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:22.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.845+0000 7fdf098759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:22.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.845+0000 7fdf098759c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:22.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.845+0000 7fdf098759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:22.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.845+0000 7fdf098759c0 20 searching for the correct realm 2024-09-12T18:19:22.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.853+0000 7fdf06b7a640 0 -- 172.21.15.98:0/144857333 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x55ad0360e9d0 msgr2=0x55ad03610e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:22.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.857+0000 7fdf0737b640 0 -- 172.21.15.98:0/144857333 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fdefc008030 msgr2=0x7fdefc0383c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:19:22.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.865+0000 7fdf098759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:22.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.865+0000 7fdf098759c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:19:22.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.865+0000 7fdf098759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:22.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.865+0000 7fdf098759c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:19:22.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.865+0000 7fdf098759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:22.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.865+0000 7fdf098759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:22.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.865+0000 7fdf098759c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:22.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.865+0000 7fdf098759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:22.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.865+0000 7fdf098759c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:22.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.865+0000 7fdf098759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:22.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.865+0000 7fdf098759c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:22.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.869+0000 7fdf098759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:22.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.869+0000 7fdf098759c0 20 zone default found 2024-09-12T18:19:22.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.869+0000 7fdf098759c0 4 Realm: () 2024-09-12T18:19:22.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.869+0000 7fdf098759c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:19:22.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.869+0000 7fdf098759c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:19:22.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.869+0000 7fdf098759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:22.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.869+0000 7fdf098759c0 20 zonegroup default 2024-09-12T18:19:22.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.869+0000 7fdf098759c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:22.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.869+0000 7fdf098759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:22.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.869+0000 7fdf098759c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:22.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.869+0000 7fdf098759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:22.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.869+0000 7fdf098759c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:22.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.869+0000 7fdf098759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:22.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.869+0000 7fdf098759c0 20 started sync module instance, tier type = 2024-09-12T18:19:22.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.869+0000 7fdf098759c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:19:22.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.885+0000 7fdf098759c0 20 add_watcher() i=0 2024-09-12T18:19:22.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.885+0000 7fdf098759c0 20 add_watcher() i=1 2024-09-12T18:19:22.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.885+0000 7fdf098759c0 20 add_watcher() i=2 2024-09-12T18:19:22.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.885+0000 7fdf098759c0 20 add_watcher() i=3 2024-09-12T18:19:22.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.885+0000 7fdf098759c0 20 add_watcher() i=4 2024-09-12T18:19:22.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.885+0000 7fdf098759c0 20 add_watcher() i=5 2024-09-12T18:19:22.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.885+0000 7fdf098759c0 20 add_watcher() i=6 2024-09-12T18:19:22.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.885+0000 7fdf098759c0 20 add_watcher() i=7 2024-09-12T18:19:22.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.885+0000 7fdf098759c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:22.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fddbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:22.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:22.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:22.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 5 note: GC not initialized 2024-09-12T18:19:22.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fddbcfe1640 20 reqs_thread_entry: start 2024-09-12T18:19:22.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:22.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 20 Filter name: none 2024-09-12T18:19:22.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdd367fc640 20 reqs_thread_entry: start 2024-09-12T18:19:22.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T18:19:22.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:22.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:22.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T18:19:22.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:19:22.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T18:19:22.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:22.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:22.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T18:19:22.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T18:19:22.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 10 cache get: name=default.rgw.meta+users.keys+NPAFIWBASJYVOSLXCNXF : miss 2024-09-12T18:19:22.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:22.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:22.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 10 cache put: name=default.rgw.meta+users.keys+NPAFIWBASJYVOSLXCNXF info.flags=0x0 2024-09-12T18:19:22.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 10 adding default.rgw.meta+users.keys+NPAFIWBASJYVOSLXCNXF to cache LRU end 2024-09-12T18:19:22.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 10 cache get: name=default.rgw.meta+users.keys+NPAFIWBASJYVOSLXCNXF : hit (negative entry) 2024-09-12T18:19:22.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.889+0000 7fdf098759c0 10 cache get: name=default.rgw.meta+users.keys+NPAFIWBASJYVOSLXCNXF : hit (negative entry) 2024-09-12T18:19:22.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.893+0000 7fdf098759c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T18:19:22.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.893+0000 7fdf098759c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:19:22.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.893+0000 7fdf098759c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T18:19:22.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.893+0000 7fddeaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300918 cookie 94201574398288 notifier 9195 bl.length()=645 2024-09-12T18:19:22.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.893+0000 7fddeaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T18:19:22.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.893+0000 7fddeaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:19:22.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.897+0000 7fdf098759c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T18:19:22.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.897+0000 7fdf098759c0 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T18:19:22.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.897+0000 7fdf098759c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T18:19:22.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.897+0000 7fddeaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300874 cookie 94201574412704 notifier 9195 bl.length()=185 2024-09-12T18:19:22.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.897+0000 7fddeaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T18:19:22.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.897+0000 7fddeaffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T18:19:22.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.901+0000 7fdf098759c0 10 cache put: name=default.rgw.meta+users.keys+NPAFIWBASJYVOSLXCNXF info.flags=0x7 2024-09-12T18:19:22.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.901+0000 7fdf098759c0 10 moving default.rgw.meta+users.keys+NPAFIWBASJYVOSLXCNXF to cache LRU end 2024-09-12T18:19:22.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.901+0000 7fdf098759c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:NPAFIWBASJYVOSLXCNXF, ofs0, ns] 2024-09-12T18:19:22.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.901+0000 7fddeaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300828 cookie 94201574413760 notifier 9195 bl.length()=186 2024-09-12T18:19:22.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.901+0000 7fddeaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NPAFIWBASJYVOSLXCNXF info.flags=0x7 2024-09-12T18:19:22.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.901+0000 7fddeaffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NPAFIWBASJYVOSLXCNXF to cache LRU end 2024-09-12T18:19:22.909 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T18:19:22.909 INFO:teuthology.orchestra.run.smithi098.stdout: "user_id": "bar.client.0", 2024-09-12T18:19:22.909 INFO:teuthology.orchestra.run.smithi098.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T18:19:22.910 INFO:teuthology.orchestra.run.smithi098.stdout: "email": "bar+test@test.test", 2024-09-12T18:19:22.910 INFO:teuthology.orchestra.run.smithi098.stdout: "suspended": 0, 2024-09-12T18:19:22.910 INFO:teuthology.orchestra.run.smithi098.stdout: "max_buckets": 1000, 2024-09-12T18:19:22.910 INFO:teuthology.orchestra.run.smithi098.stdout: "subusers": [], 2024-09-12T18:19:22.910 INFO:teuthology.orchestra.run.smithi098.stdout: "keys": [ 2024-09-12T18:19:22.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-12T18:19:22.910 INFO:teuthology.orchestra.run.smithi098.stdout: "user": "bar.client.0", 2024-09-12T18:19:22.910 INFO:teuthology.orchestra.run.smithi098.stdout: "access_key": "NPAFIWBASJYVOSLXCNXF", 2024-09-12T18:19:22.910 INFO:teuthology.orchestra.run.smithi098.stdout: "secret_key": "L+59e8BhFYICNWj2pKytg6K+PbYM0FSZ0KbgzAiGGda60I9dPnMq7w==", 2024-09-12T18:19:22.910 INFO:teuthology.orchestra.run.smithi098.stdout: "active": true, 2024-09-12T18:19:22.910 INFO:teuthology.orchestra.run.smithi098.stdout: "create_date": "2024-09-12T18:19:22.896264Z" 2024-09-12T18:19:22.910 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-12T18:19:22.910 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-12T18:19:22.910 INFO:teuthology.orchestra.run.smithi098.stdout: "swift_keys": [], 2024-09-12T18:19:22.911 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": [], 2024-09-12T18:19:22.911 INFO:teuthology.orchestra.run.smithi098.stdout: "op_mask": "read, write, delete", 2024-09-12T18:19:22.911 INFO:teuthology.orchestra.run.smithi098.stdout: "default_placement": "", 2024-09-12T18:19:22.911 INFO:teuthology.orchestra.run.smithi098.stdout: "default_storage_class": "", 2024-09-12T18:19:22.911 INFO:teuthology.orchestra.run.smithi098.stdout: "placement_tags": [], 2024-09-12T18:19:22.911 INFO:teuthology.orchestra.run.smithi098.stdout: "bucket_quota": { 2024-09-12T18:19:22.911 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:19:22.911 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:19:22.911 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:19:22.911 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:19:22.911 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:19:22.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:22.911 INFO:teuthology.orchestra.run.smithi098.stdout: "user_quota": { 2024-09-12T18:19:22.911 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:19:22.912 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:19:22.912 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:19:22.912 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:19:22.912 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:19:22.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:22.912 INFO:teuthology.orchestra.run.smithi098.stdout: "temp_url_keys": [], 2024-09-12T18:19:22.912 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "rgw", 2024-09-12T18:19:22.912 INFO:teuthology.orchestra.run.smithi098.stdout: "mfa_ids": [], 2024-09-12T18:19:22.912 INFO:teuthology.orchestra.run.smithi098.stdout: "account_id": "", 2024-09-12T18:19:22.912 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/", 2024-09-12T18:19:22.912 INFO:teuthology.orchestra.run.smithi098.stdout: "create_date": "2024-09-12T18:19:22.896247Z", 2024-09-12T18:19:22.912 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-12T18:19:22.912 INFO:teuthology.orchestra.run.smithi098.stdout: "group_ids": [] 2024-09-12T18:19:22.912 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T18:19:22.913 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:19:22.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.905+0000 7fddbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:22.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.909+0000 7fdf098759c0 20 remove_watcher() i=0 2024-09-12T18:19:22.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.909+0000 7fdf098759c0 2 removed watcher, disabling cache 2024-09-12T18:19:22.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.913+0000 7fdf098759c0 20 remove_watcher() i=1 2024-09-12T18:19:22.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.913+0000 7fdf098759c0 20 remove_watcher() i=2 2024-09-12T18:19:22.921 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.917+0000 7fdf098759c0 20 remove_watcher() i=3 2024-09-12T18:19:22.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.917+0000 7fdf098759c0 20 remove_watcher() i=4 2024-09-12T18:19:22.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.921+0000 7fdf098759c0 20 remove_watcher() i=5 2024-09-12T18:19:22.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.921+0000 7fdf098759c0 20 remove_watcher() i=6 2024-09-12T18:19:22.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:22.921+0000 7fdf098759c0 20 remove_watcher() i=7 2024-09-12T18:19:22.942 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 2284903080 --totp-seed WY6H5WCS6M5GTYYX7K4Y2A3XXDROG4JFUVVT7VIZ5UEQUJVEJXUTRYGQRHYKKYHN --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:19:23.027 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:23.027 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:23.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.061+0000 7f3200e569c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.065+0000 7f3200e569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.065+0000 7f3200e569c0 20 realm 2024-09-12T18:19:23.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.065+0000 7f3200e569c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.065+0000 7f3200e569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.065+0000 7f3200e569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:23.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.065+0000 7f3200e569c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.065+0000 7f3200e569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.065+0000 7f3200e569c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.065+0000 7f3200e569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:23.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.065+0000 7f3200e569c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.069+0000 7f3200e569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:23.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.069+0000 7f3200e569c0 20 searching for the correct realm 2024-09-12T18:19:23.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.073+0000 7f31fe15b640 0 -- 172.21.15.98:0/636301471 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x558fcab53e70 msgr2=0x558fcab56260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:23.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.077+0000 7f31fe95c640 0 -- 172.21.15.98:0/636301471 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f31f40fbba0 msgr2=0x7f31f410e990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:23.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.085+0000 7f3200e569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:23.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.085+0000 7f3200e569c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:19:23.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.085+0000 7f3200e569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:23.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.085+0000 7f3200e569c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:19:23.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.085+0000 7f3200e569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:23.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.085+0000 7f3200e569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:23.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.085+0000 7f3200e569c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.085+0000 7f3200e569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.085+0000 7f3200e569c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.089+0000 7f3200e569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:23.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.089+0000 7f3200e569c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.089+0000 7f3200e569c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:23.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.089+0000 7f3200e569c0 20 zone default found 2024-09-12T18:19:23.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.089+0000 7f3200e569c0 4 Realm: () 2024-09-12T18:19:23.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.089+0000 7f3200e569c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:19:23.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.089+0000 7f3200e569c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:19:23.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.089+0000 7f3200e569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:23.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.089+0000 7f3200e569c0 20 zonegroup default 2024-09-12T18:19:23.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.089+0000 7f3200e569c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.089+0000 7f3200e569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.089+0000 7f3200e569c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.089+0000 7f3200e569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.089+0000 7f3200e569c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.089+0000 7f3200e569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.089+0000 7f3200e569c0 20 started sync module instance, tier type = 2024-09-12T18:19:23.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.089+0000 7f3200e569c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:19:23.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.105+0000 7f3200e569c0 20 add_watcher() i=0 2024-09-12T18:19:23.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.105+0000 7f3200e569c0 20 add_watcher() i=1 2024-09-12T18:19:23.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.105+0000 7f3200e569c0 20 add_watcher() i=2 2024-09-12T18:19:23.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.105+0000 7f3200e569c0 20 add_watcher() i=3 2024-09-12T18:19:23.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.105+0000 7f3200e569c0 20 add_watcher() i=4 2024-09-12T18:19:23.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.105+0000 7f3200e569c0 20 add_watcher() i=5 2024-09-12T18:19:23.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.105+0000 7f3200e569c0 20 add_watcher() i=6 2024-09-12T18:19:23.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.105+0000 7f3200e569c0 20 add_watcher() i=7 2024-09-12T18:19:23.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.105+0000 7f3200e569c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:23.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.109+0000 7f30b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:23.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.109+0000 7f3200e569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:23.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.109+0000 7f3200e569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:23.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.109+0000 7f3200e569c0 5 note: GC not initialized 2024-09-12T18:19:23.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.109+0000 7f302ffff640 20 reqs_thread_entry: start 2024-09-12T18:19:23.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.109+0000 7f3200e569c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:23.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.109+0000 7f3200e569c0 20 Filter name: none 2024-09-12T18:19:23.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.109+0000 7f302dffb640 20 reqs_thread_entry: start 2024-09-12T18:19:23.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.109+0000 7f3200e569c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T18:19:23.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.109+0000 7f3200e569c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.113+0000 7f3200e569c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T18:19:23.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.113+0000 7f3200e569c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T18:19:23.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.113+0000 7f3200e569c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:19:23.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.113+0000 7f3200e569c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:19:23.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.117+0000 7f3200e569c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T18:19:23.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.117+0000 7f3200e569c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:19:23.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.117+0000 7f3200e569c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T18:19:23.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.117+0000 7f30e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300919 cookie 94076069574064 notifier 9213 bl.length()=659 2024-09-12T18:19:23.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.117+0000 7f30e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T18:19:23.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.117+0000 7f30e27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:19:23.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.121+0000 7f30b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:23.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.125+0000 7f3200e569c0 20 remove_watcher() i=0 2024-09-12T18:19:23.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.125+0000 7f3200e569c0 2 removed watcher, disabling cache 2024-09-12T18:19:23.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.129+0000 7f3200e569c0 20 remove_watcher() i=1 2024-09-12T18:19:23.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.133+0000 7f3200e569c0 20 remove_watcher() i=2 2024-09-12T18:19:23.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.133+0000 7f3200e569c0 20 remove_watcher() i=3 2024-09-12T18:19:23.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.137+0000 7f3200e569c0 20 remove_watcher() i=4 2024-09-12T18:19:23.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.137+0000 7f3200e569c0 20 remove_watcher() i=5 2024-09-12T18:19:23.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.137+0000 7f3200e569c0 20 remove_watcher() i=6 2024-09-12T18:19:23.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.141+0000 7f3200e569c0 20 remove_watcher() i=7 2024-09-12T18:19:23.159 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-09-12T18:19:23.159 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key ZOVCXBZQWWQBTJGVMOSB --secret 3ZZT7fnFFqZt6WupG3p2pTMzULnzIvZX+a1+NRRgQo64wi/ebATdlA== --cluster ceph 2024-09-12T18:19:23.245 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:23.246 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:23.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.281+0000 7fec488a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.285+0000 7fec488a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.285+0000 7fec488a19c0 20 realm 2024-09-12T18:19:23.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.285+0000 7fec488a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.285+0000 7fec488a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.285+0000 7fec488a19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:23.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.285+0000 7fec488a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.285+0000 7fec488a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.285+0000 7fec488a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.285+0000 7fec488a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:23.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.285+0000 7fec488a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.285+0000 7fec488a19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:23.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.285+0000 7fec488a19c0 20 searching for the correct realm 2024-09-12T18:19:23.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.293+0000 7fec45ba6640 0 -- 172.21.15.98:0/2101026527 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fec400bf040 msgr2=0x7fec400df410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:23.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.297+0000 7fec45ba6640 0 -- 172.21.15.98:0/2101026527 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7feb10081e90 msgr2=0x7feb100842c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:23.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.305+0000 7fec488a19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:23.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.305+0000 7fec488a19c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:19:23.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.305+0000 7fec488a19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:23.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.305+0000 7fec488a19c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:19:23.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.305+0000 7fec488a19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:23.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.305+0000 7fec488a19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:23.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.305+0000 7fec488a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.305+0000 7fec488a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.305+0000 7fec488a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.305+0000 7fec488a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:23.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.305+0000 7fec488a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.305+0000 7fec488a19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:23.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.305+0000 7fec488a19c0 20 zone default found 2024-09-12T18:19:23.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.305+0000 7fec488a19c0 4 Realm: () 2024-09-12T18:19:23.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.305+0000 7fec488a19c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:19:23.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.305+0000 7fec488a19c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:19:23.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.305+0000 7fec488a19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:23.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.305+0000 7fec488a19c0 20 zonegroup default 2024-09-12T18:19:23.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.305+0000 7fec488a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.309+0000 7fec488a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.309+0000 7fec488a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.309+0000 7fec488a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.309+0000 7fec488a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.309+0000 7fec488a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.309+0000 7fec488a19c0 20 started sync module instance, tier type = 2024-09-12T18:19:23.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.309+0000 7fec488a19c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:19:23.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.325+0000 7fec488a19c0 20 add_watcher() i=0 2024-09-12T18:19:23.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.325+0000 7fec488a19c0 20 add_watcher() i=1 2024-09-12T18:19:23.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.325+0000 7fec488a19c0 20 add_watcher() i=2 2024-09-12T18:19:23.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.325+0000 7fec488a19c0 20 add_watcher() i=3 2024-09-12T18:19:23.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.325+0000 7fec488a19c0 20 add_watcher() i=4 2024-09-12T18:19:23.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.325+0000 7fec488a19c0 20 add_watcher() i=5 2024-09-12T18:19:23.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.325+0000 7fec488a19c0 20 add_watcher() i=6 2024-09-12T18:19:23.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.325+0000 7fec488a19c0 20 add_watcher() i=7 2024-09-12T18:19:23.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.325+0000 7fec488a19c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:23.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7feafcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:23.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:23.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:23.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 5 note: GC not initialized 2024-09-12T18:19:23.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fea777fe640 20 reqs_thread_entry: start 2024-09-12T18:19:23.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:23.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 20 Filter name: none 2024-09-12T18:19:23.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fea757fa640 20 reqs_thread_entry: start 2024-09-12T18:19:23.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T18:19:23.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T18:19:23.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:19:23.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T18:19:23.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T18:19:23.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T18:19:23.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 10 cache get: name=default.rgw.meta+users.keys+ZOVCXBZQWWQBTJGVMOSB : miss 2024-09-12T18:19:23.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 10 cache put: name=default.rgw.meta+users.keys+ZOVCXBZQWWQBTJGVMOSB info.flags=0x0 2024-09-12T18:19:23.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 10 adding default.rgw.meta+users.keys+ZOVCXBZQWWQBTJGVMOSB to cache LRU end 2024-09-12T18:19:23.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 10 cache get: name=default.rgw.meta+users.keys+ZOVCXBZQWWQBTJGVMOSB : hit (negative entry) 2024-09-12T18:19:23.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.329+0000 7fec488a19c0 10 cache get: name=default.rgw.meta+users.keys+ZOVCXBZQWWQBTJGVMOSB : hit (negative entry) 2024-09-12T18:19:23.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.333+0000 7fec488a19c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T18:19:23.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.333+0000 7fec488a19c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:19:23.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.333+0000 7fec488a19c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T18:19:23.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.333+0000 7feb29ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300875 cookie 94197994678176 notifier 9234 bl.length()=719 2024-09-12T18:19:23.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.333+0000 7feb29ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T18:19:23.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.333+0000 7feb29ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:19:23.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.337+0000 7fec488a19c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T18:19:23.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.337+0000 7fec488a19c0 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T18:19:23.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.337+0000 7fec488a19c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T18:19:23.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.337+0000 7feb29ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300829 cookie 94197994676976 notifier 9234 bl.length()=215 2024-09-12T18:19:23.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.337+0000 7feb29ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T18:19:23.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.337+0000 7feb29ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T18:19:23.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.341+0000 7fec488a19c0 10 cache put: name=default.rgw.meta+users.keys+ZOVCXBZQWWQBTJGVMOSB info.flags=0x7 2024-09-12T18:19:23.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.341+0000 7fec488a19c0 10 moving default.rgw.meta+users.keys+ZOVCXBZQWWQBTJGVMOSB to cache LRU end 2024-09-12T18:19:23.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.341+0000 7fec488a19c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:ZOVCXBZQWWQBTJGVMOSB, ofs0, ns] 2024-09-12T18:19:23.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.341+0000 7feb297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300876 cookie 94197994681728 notifier 9234 bl.length()=201 2024-09-12T18:19:23.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.341+0000 7feb297fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZOVCXBZQWWQBTJGVMOSB info.flags=0x7 2024-09-12T18:19:23.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.341+0000 7feb297fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZOVCXBZQWWQBTJGVMOSB to cache LRU end 2024-09-12T18:19:23.348 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T18:19:23.348 INFO:teuthology.orchestra.run.smithi098.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T18:19:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-09-12T18:19:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T18:19:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: "suspended": 0, 2024-09-12T18:19:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: "max_buckets": 1000, 2024-09-12T18:19:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: "subusers": [], 2024-09-12T18:19:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: "keys": [ 2024-09-12T18:19:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-12T18:19:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T18:19:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: "access_key": "ZOVCXBZQWWQBTJGVMOSB", 2024-09-12T18:19:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: "secret_key": "3ZZT7fnFFqZt6WupG3p2pTMzULnzIvZX+a1+NRRgQo64wi/ebATdlA==", 2024-09-12T18:19:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: "active": true, 2024-09-12T18:19:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: "create_date": "2024-09-12T18:19:23.335787Z" 2024-09-12T18:19:23.349 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-12T18:19:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-12T18:19:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: "swift_keys": [], 2024-09-12T18:19:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": [], 2024-09-12T18:19:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: "op_mask": "read, write, delete", 2024-09-12T18:19:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: "default_placement": "", 2024-09-12T18:19:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: "default_storage_class": "", 2024-09-12T18:19:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: "placement_tags": [], 2024-09-12T18:19:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: "bucket_quota": { 2024-09-12T18:19:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:19:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:19:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:19:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:19:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:19:23.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: "user_quota": { 2024-09-12T18:19:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:19:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:19:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:19:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:19:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:19:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: "temp_url_keys": [], 2024-09-12T18:19:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "rgw", 2024-09-12T18:19:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: "mfa_ids": [], 2024-09-12T18:19:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: "account_id": "", 2024-09-12T18:19:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/", 2024-09-12T18:19:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: "create_date": "2024-09-12T18:19:23.335770Z", 2024-09-12T18:19:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-12T18:19:23.351 INFO:teuthology.orchestra.run.smithi098.stdout: "group_ids": [] 2024-09-12T18:19:23.352 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T18:19:23.352 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:19:23.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.345+0000 7feafcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:23.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.349+0000 7fec488a19c0 20 remove_watcher() i=0 2024-09-12T18:19:23.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.349+0000 7fec488a19c0 2 removed watcher, disabling cache 2024-09-12T18:19:23.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.353+0000 7fec488a19c0 20 remove_watcher() i=1 2024-09-12T18:19:23.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.353+0000 7fec488a19c0 20 remove_watcher() i=2 2024-09-12T18:19:23.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.357+0000 7fec488a19c0 20 remove_watcher() i=3 2024-09-12T18:19:23.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.357+0000 7fec488a19c0 20 remove_watcher() i=4 2024-09-12T18:19:23.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.357+0000 7fec488a19c0 20 remove_watcher() i=5 2024-09-12T18:19:23.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.361+0000 7fec488a19c0 20 remove_watcher() i=6 2024-09-12T18:19:23.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.361+0000 7fec488a19c0 20 remove_watcher() i=7 2024-09-12T18:19:23.381 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 1769181100 --totp-seed UUVNNV7EU774N756N4RKOULLVOERD4ONT2BMLATHO7WVICSFQG5MI5VX7XOY6J6K --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:19:23.470 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:23.470 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:23.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.505+0000 7f73946ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.505+0000 7f73946ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.505+0000 7f73946ec9c0 20 realm 2024-09-12T18:19:23.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.505+0000 7f73946ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.505+0000 7f73946ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.505+0000 7f73946ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:23.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.505+0000 7f73946ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.505+0000 7f73946ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.505+0000 7f73946ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.509+0000 7f73946ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:23.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.509+0000 7f73946ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.509+0000 7f73946ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:23.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.509+0000 7f73946ec9c0 20 searching for the correct realm 2024-09-12T18:19:23.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.513+0000 7f73919f1640 0 -- 172.21.15.98:0/2368578772 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x558f08afee90 msgr2=0x558f08b01350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:23.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.521+0000 7f73921f2640 0 -- 172.21.15.98:0/2368578772 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f738805bea0 msgr2=0x7f73880776f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:23.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:23.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:19:23.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:23.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:19:23.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:23.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:23.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:23.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:23.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 20 zone default found 2024-09-12T18:19:23.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 4 Realm: () 2024-09-12T18:19:23.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:19:23.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:19:23.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:23.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 20 zonegroup default 2024-09-12T18:19:23.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.529+0000 7f73946ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.533+0000 7f73946ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.533+0000 7f73946ec9c0 20 started sync module instance, tier type = 2024-09-12T18:19:23.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.533+0000 7f73946ec9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:19:23.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.549+0000 7f73946ec9c0 20 add_watcher() i=0 2024-09-12T18:19:23.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.549+0000 7f73946ec9c0 20 add_watcher() i=1 2024-09-12T18:19:23.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.549+0000 7f73946ec9c0 20 add_watcher() i=2 2024-09-12T18:19:23.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.549+0000 7f73946ec9c0 20 add_watcher() i=3 2024-09-12T18:19:23.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.549+0000 7f73946ec9c0 20 add_watcher() i=4 2024-09-12T18:19:23.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.549+0000 7f73946ec9c0 20 add_watcher() i=5 2024-09-12T18:19:23.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.549+0000 7f73946ec9c0 20 add_watcher() i=6 2024-09-12T18:19:23.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.549+0000 7f73946ec9c0 20 add_watcher() i=7 2024-09-12T18:19:23.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.549+0000 7f73946ec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:23.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.549+0000 7f72497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:23.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.549+0000 7f73946ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:23.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.549+0000 7f73946ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:23.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.553+0000 7f73946ec9c0 5 note: GC not initialized 2024-09-12T18:19:23.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.553+0000 7f72437fe640 20 reqs_thread_entry: start 2024-09-12T18:19:23.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.553+0000 7f73946ec9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:23.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.553+0000 7f73946ec9c0 20 Filter name: none 2024-09-12T18:19:23.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.553+0000 7f73946ec9c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T18:19:23.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.553+0000 7f72417fa640 20 reqs_thread_entry: start 2024-09-12T18:19:23.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.553+0000 7f73946ec9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.553+0000 7f73946ec9c0 20 rados_obj.operate() r=0 bl.length=519 2024-09-12T18:19:23.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.553+0000 7f73946ec9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T18:19:23.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.553+0000 7f73946ec9c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:19:23.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.553+0000 7f73946ec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:19:23.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.557+0000 7f73946ec9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T18:19:23.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.557+0000 7f73946ec9c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:19:23.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.557+0000 7f73946ec9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T18:19:23.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.557+0000 7f7275ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300877 cookie 94072814456848 notifier 9252 bl.length()=733 2024-09-12T18:19:23.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.557+0000 7f7275ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T18:19:23.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.557+0000 7f7275ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:19:23.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.561+0000 7f72497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:23.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.565+0000 7f73946ec9c0 20 remove_watcher() i=0 2024-09-12T18:19:23.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.565+0000 7f73946ec9c0 2 removed watcher, disabling cache 2024-09-12T18:19:23.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.565+0000 7f73946ec9c0 20 remove_watcher() i=1 2024-09-12T18:19:23.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.569+0000 7f73946ec9c0 20 remove_watcher() i=2 2024-09-12T18:19:23.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.569+0000 7f73946ec9c0 20 remove_watcher() i=3 2024-09-12T18:19:23.578 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.573+0000 7f73946ec9c0 20 remove_watcher() i=4 2024-09-12T18:19:23.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.573+0000 7f73946ec9c0 20 remove_watcher() i=5 2024-09-12T18:19:23.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.577+0000 7f73946ec9c0 20 remove_watcher() i=6 2024-09-12T18:19:23.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.577+0000 7f73946ec9c0 20 remove_watcher() i=7 2024-09-12T18:19:23.595 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T18:19:23.596 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key ODWIXXANMPQECJLYDOWA --secret c+Qpd3taG6mCtUJNciV1BvDxJsiMoxyykuOPNXk+EEJo/BVnM1OjYA== --cluster ceph 2024-09-12T18:19:23.639 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:23.640 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:23.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.697+0000 7fb7eb8889c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.697+0000 7fb7eb8889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.697+0000 7fb7eb8889c0 20 realm 2024-09-12T18:19:23.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.697+0000 7fb7eb8889c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.697+0000 7fb7eb8889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.697+0000 7fb7eb8889c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:23.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.697+0000 7fb7eb8889c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.697+0000 7fb7eb8889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.697+0000 7fb7eb8889c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.697+0000 7fb7eb8889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:23.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.697+0000 7fb7eb8889c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.701+0000 7fb7eb8889c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:23.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.701+0000 7fb7eb8889c0 20 searching for the correct realm 2024-09-12T18:19:23.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.717+0000 7fb7e8b8d640 0 -- 172.21.15.98:0/1865612500 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fb7dc017070 msgr2=0x7fb7dc078e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:23.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.925+0000 7fb7e938e640 0 -- 172.21.15.98:0/1865612500 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fb7e012a130 msgr2=0x7fb7e00da9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:23.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.937+0000 7fb7eb8889c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:23.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.937+0000 7fb7eb8889c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:19:23.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.937+0000 7fb7eb8889c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:23.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.937+0000 7fb7eb8889c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:19:23.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.937+0000 7fb7eb8889c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:23.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.937+0000 7fb7eb8889c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:23.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.937+0000 7fb7eb8889c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.941+0000 7fb7eb8889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.941+0000 7fb7eb8889c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.941+0000 7fb7eb8889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:23.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.941+0000 7fb7eb8889c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.941+0000 7fb7eb8889c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:23.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.941+0000 7fb7eb8889c0 20 zone default found 2024-09-12T18:19:23.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.941+0000 7fb7eb8889c0 4 Realm: () 2024-09-12T18:19:23.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.941+0000 7fb7eb8889c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:19:23.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.941+0000 7fb7eb8889c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:19:23.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.941+0000 7fb7eb8889c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:23.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.941+0000 7fb7eb8889c0 20 zonegroup default 2024-09-12T18:19:23.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.941+0000 7fb7eb8889c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.941+0000 7fb7eb8889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.941+0000 7fb7eb8889c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.945+0000 7fb7eb8889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.945+0000 7fb7eb8889c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.945+0000 7fb7eb8889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.945+0000 7fb7eb8889c0 20 started sync module instance, tier type = 2024-09-12T18:19:23.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.945+0000 7fb7eb8889c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:19:23.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.969+0000 7fb7eb8889c0 20 add_watcher() i=0 2024-09-12T18:19:23.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.969+0000 7fb7eb8889c0 20 add_watcher() i=1 2024-09-12T18:19:23.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.969+0000 7fb7eb8889c0 20 add_watcher() i=2 2024-09-12T18:19:23.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.969+0000 7fb7eb8889c0 20 add_watcher() i=3 2024-09-12T18:19:23.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.969+0000 7fb7eb8889c0 20 add_watcher() i=4 2024-09-12T18:19:23.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.969+0000 7fb7eb8889c0 20 add_watcher() i=5 2024-09-12T18:19:23.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.969+0000 7fb7eb8889c0 20 add_watcher() i=6 2024-09-12T18:19:23.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.973+0000 7fb7eb8889c0 20 add_watcher() i=7 2024-09-12T18:19:23.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.973+0000 7fb7eb8889c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:23.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb69f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:23.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:23.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:23.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 5 note: GC not initialized 2024-09-12T18:19:23.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb69e7e4640 20 reqs_thread_entry: start 2024-09-12T18:19:23.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:23.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 20 Filter name: none 2024-09-12T18:19:23.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb60ffff640 20 reqs_thread_entry: start 2024-09-12T18:19:23.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T18:19:23.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T18:19:23.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:19:23.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T18:19:23.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T18:19:23.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T18:19:23.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 10 cache get: name=default.rgw.meta+users.keys+ODWIXXANMPQECJLYDOWA : miss 2024-09-12T18:19:23.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:23.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:23.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 10 cache put: name=default.rgw.meta+users.keys+ODWIXXANMPQECJLYDOWA info.flags=0x0 2024-09-12T18:19:23.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 10 adding default.rgw.meta+users.keys+ODWIXXANMPQECJLYDOWA to cache LRU end 2024-09-12T18:19:23.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 10 cache get: name=default.rgw.meta+users.keys+ODWIXXANMPQECJLYDOWA : hit (negative entry) 2024-09-12T18:19:23.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.977+0000 7fb7eb8889c0 10 cache get: name=default.rgw.meta+users.keys+ODWIXXANMPQECJLYDOWA : hit (negative entry) 2024-09-12T18:19:23.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.981+0000 7fb7eb8889c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:19:23.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.981+0000 7fb7eb8889c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:19:23.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.981+0000 7fb7eb8889c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T18:19:23.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.981+0000 7fb6ccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268126 cookie 93899183409632 notifier 9273 bl.length()=660 2024-09-12T18:19:23.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.981+0000 7fb6ccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:19:23.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.981+0000 7fb6ccff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:19:23.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.985+0000 7fb7eb8889c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T18:19:23.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.985+0000 7fb7eb8889c0 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T18:19:23.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.985+0000 7fb7eb8889c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T18:19:23.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.985+0000 7fb6ccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268216 cookie 93899183392896 notifier 9273 bl.length()=191 2024-09-12T18:19:23.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.985+0000 7fb6ccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T18:19:23.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.985+0000 7fb6ccff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T18:19:23.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.989+0000 7fb7eb8889c0 10 cache put: name=default.rgw.meta+users.keys+ODWIXXANMPQECJLYDOWA info.flags=0x7 2024-09-12T18:19:23.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.989+0000 7fb7eb8889c0 10 moving default.rgw.meta+users.keys+ODWIXXANMPQECJLYDOWA to cache LRU end 2024-09-12T18:19:23.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.989+0000 7fb7eb8889c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:ODWIXXANMPQECJLYDOWA, ofs0, ns] 2024-09-12T18:19:23.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.989+0000 7fb6ccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268180 cookie 93899183395472 notifier 9273 bl.length()=189 2024-09-12T18:19:23.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.989+0000 7fb6ccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ODWIXXANMPQECJLYDOWA info.flags=0x7 2024-09-12T18:19:23.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.989+0000 7fb6ccff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ODWIXXANMPQECJLYDOWA to cache LRU end 2024-09-12T18:19:23.998 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T18:19:23.998 INFO:teuthology.orchestra.run.smithi098.stdout: "user_id": "foobar.client.0", 2024-09-12T18:19:23.998 INFO:teuthology.orchestra.run.smithi098.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T18:19:23.998 INFO:teuthology.orchestra.run.smithi098.stdout: "email": "foobar+test@test.test", 2024-09-12T18:19:23.998 INFO:teuthology.orchestra.run.smithi098.stdout: "suspended": 0, 2024-09-12T18:19:23.998 INFO:teuthology.orchestra.run.smithi098.stdout: "max_buckets": 1000, 2024-09-12T18:19:23.998 INFO:teuthology.orchestra.run.smithi098.stdout: "subusers": [], 2024-09-12T18:19:23.998 INFO:teuthology.orchestra.run.smithi098.stdout: "keys": [ 2024-09-12T18:19:23.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-12T18:19:23.998 INFO:teuthology.orchestra.run.smithi098.stdout: "user": "foobar.client.0", 2024-09-12T18:19:23.998 INFO:teuthology.orchestra.run.smithi098.stdout: "access_key": "ODWIXXANMPQECJLYDOWA", 2024-09-12T18:19:23.998 INFO:teuthology.orchestra.run.smithi098.stdout: "secret_key": "c+Qpd3taG6mCtUJNciV1BvDxJsiMoxyykuOPNXk+EEJo/BVnM1OjYA==", 2024-09-12T18:19:23.999 INFO:teuthology.orchestra.run.smithi098.stdout: "active": true, 2024-09-12T18:19:23.999 INFO:teuthology.orchestra.run.smithi098.stdout: "create_date": "2024-09-12T18:19:23.983873Z" 2024-09-12T18:19:23.999 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-12T18:19:23.999 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-12T18:19:23.999 INFO:teuthology.orchestra.run.smithi098.stdout: "swift_keys": [], 2024-09-12T18:19:23.999 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": [], 2024-09-12T18:19:23.999 INFO:teuthology.orchestra.run.smithi098.stdout: "op_mask": "read, write, delete", 2024-09-12T18:19:23.999 INFO:teuthology.orchestra.run.smithi098.stdout: "default_placement": "", 2024-09-12T18:19:23.999 INFO:teuthology.orchestra.run.smithi098.stdout: "default_storage_class": "", 2024-09-12T18:19:23.999 INFO:teuthology.orchestra.run.smithi098.stdout: "placement_tags": [], 2024-09-12T18:19:23.999 INFO:teuthology.orchestra.run.smithi098.stdout: "bucket_quota": { 2024-09-12T18:19:23.999 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:19:23.999 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:19:24.000 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:19:24.000 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:19:24.000 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:19:24.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:24.000 INFO:teuthology.orchestra.run.smithi098.stdout: "user_quota": { 2024-09-12T18:19:24.000 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:19:24.000 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:19:24.000 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:19:24.000 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:19:24.000 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:19:24.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:24.000 INFO:teuthology.orchestra.run.smithi098.stdout: "temp_url_keys": [], 2024-09-12T18:19:24.000 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "rgw", 2024-09-12T18:19:24.000 INFO:teuthology.orchestra.run.smithi098.stdout: "mfa_ids": [], 2024-09-12T18:19:24.001 INFO:teuthology.orchestra.run.smithi098.stdout: "account_id": "", 2024-09-12T18:19:24.001 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/", 2024-09-12T18:19:24.001 INFO:teuthology.orchestra.run.smithi098.stdout: "create_date": "2024-09-12T18:19:23.983850Z", 2024-09-12T18:19:24.001 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-12T18:19:24.001 INFO:teuthology.orchestra.run.smithi098.stdout: "group_ids": [] 2024-09-12T18:19:24.001 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T18:19:24.001 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:19:24.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.993+0000 7fb69f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:24.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.997+0000 7fb7eb8889c0 20 remove_watcher() i=0 2024-09-12T18:19:24.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:23.997+0000 7fb7eb8889c0 2 removed watcher, disabling cache 2024-09-12T18:19:24.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.001+0000 7fb7eb8889c0 20 remove_watcher() i=1 2024-09-12T18:19:24.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.005+0000 7fb7eb8889c0 20 remove_watcher() i=2 2024-09-12T18:19:24.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.005+0000 7fb7eb8889c0 20 remove_watcher() i=3 2024-09-12T18:19:24.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.009+0000 7fb7eb8889c0 20 remove_watcher() i=4 2024-09-12T18:19:24.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.009+0000 7fb7eb8889c0 20 remove_watcher() i=5 2024-09-12T18:19:24.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.009+0000 7fb7eb8889c0 20 remove_watcher() i=6 2024-09-12T18:19:24.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.013+0000 7fb7eb8889c0 20 remove_watcher() i=7 2024-09-12T18:19:24.034 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 0560312300 --totp-seed S26TDMDHNQZ2TZURVRIPN3E62XSANDYVDXZXU7L76CBU4AYTNEDPDGXQLTQVG56G --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:19:24.127 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:24.128 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:24.168 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.165+0000 7f92911a79c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.165+0000 7f92911a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:24.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.165+0000 7f92911a79c0 20 realm 2024-09-12T18:19:24.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.165+0000 7f92911a79c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.165+0000 7f92911a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:24.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.165+0000 7f92911a79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:24.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.165+0000 7f92911a79c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.165+0000 7f92911a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:24.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.165+0000 7f92911a79c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.169+0000 7f92911a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:24.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.169+0000 7f92911a79c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.169+0000 7f92911a79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:24.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.169+0000 7f92911a79c0 20 searching for the correct realm 2024-09-12T18:19:24.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.173+0000 7f928f4ae640 0 -- 172.21.15.98:0/3246183833 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f9278008040 msgr2=0x7f9278091970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:19:24.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.389+0000 7f928ecad640 0 -- 172.21.15.98:0/3246183833 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x55684a8d0b30 msgr2=0x55684a8d2fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:24.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.397+0000 7f92911a79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:24.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.397+0000 7f92911a79c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:19:24.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.397+0000 7f92911a79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:24.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.397+0000 7f92911a79c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:19:24.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.397+0000 7f92911a79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:24.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.397+0000 7f92911a79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:24.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.397+0000 7f92911a79c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.397+0000 7f92911a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:24.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.397+0000 7f92911a79c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.397+0000 7f92911a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:24.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.397+0000 7f92911a79c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.401+0000 7f92911a79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:24.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.401+0000 7f92911a79c0 20 zone default found 2024-09-12T18:19:24.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.401+0000 7f92911a79c0 4 Realm: () 2024-09-12T18:19:24.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.401+0000 7f92911a79c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:19:24.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.401+0000 7f92911a79c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:19:24.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.401+0000 7f92911a79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:24.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.401+0000 7f92911a79c0 20 zonegroup default 2024-09-12T18:19:24.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.401+0000 7f92911a79c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.401+0000 7f92911a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:24.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.401+0000 7f92911a79c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.401+0000 7f92911a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:24.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.401+0000 7f92911a79c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.401+0000 7f92911a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:24.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.401+0000 7f92911a79c0 20 started sync module instance, tier type = 2024-09-12T18:19:24.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.401+0000 7f92911a79c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:19:24.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.421+0000 7f92911a79c0 20 add_watcher() i=0 2024-09-12T18:19:24.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.421+0000 7f92911a79c0 20 add_watcher() i=1 2024-09-12T18:19:24.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.421+0000 7f92911a79c0 20 add_watcher() i=2 2024-09-12T18:19:24.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.421+0000 7f92911a79c0 20 add_watcher() i=3 2024-09-12T18:19:24.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.421+0000 7f92911a79c0 20 add_watcher() i=4 2024-09-12T18:19:24.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.421+0000 7f92911a79c0 20 add_watcher() i=5 2024-09-12T18:19:24.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.425+0000 7f92911a79c0 20 add_watcher() i=6 2024-09-12T18:19:24.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.425+0000 7f92911a79c0 20 add_watcher() i=7 2024-09-12T18:19:24.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.425+0000 7f92911a79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:24.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.429+0000 7f91457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:24.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.429+0000 7f92911a79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:24.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.429+0000 7f92911a79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:24.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.429+0000 7f92911a79c0 5 note: GC not initialized 2024-09-12T18:19:24.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.429+0000 7f90bffff640 20 reqs_thread_entry: start 2024-09-12T18:19:24.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.429+0000 7f92911a79c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:24.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.429+0000 7f92911a79c0 20 Filter name: none 2024-09-12T18:19:24.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.429+0000 7f90bdffb640 20 reqs_thread_entry: start 2024-09-12T18:19:24.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.429+0000 7f92911a79c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T18:19:24.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.429+0000 7f92911a79c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.429+0000 7f92911a79c0 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T18:19:24.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.429+0000 7f92911a79c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T18:19:24.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.429+0000 7f92911a79c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:19:24.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.429+0000 7f92911a79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:19:24.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.437+0000 7f92911a79c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:19:24.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.437+0000 7f92911a79c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:19:24.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.437+0000 7f92911a79c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T18:19:24.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.437+0000 7f91727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268127 cookie 93906415773600 notifier 8522 bl.length()=674 2024-09-12T18:19:24.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.437+0000 7f91727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:19:24.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.437+0000 7f91727fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:19:24.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.441+0000 7f91457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:24.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.445+0000 7f92911a79c0 20 remove_watcher() i=0 2024-09-12T18:19:24.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.445+0000 7f92911a79c0 2 removed watcher, disabling cache 2024-09-12T18:19:24.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.449+0000 7f92911a79c0 20 remove_watcher() i=1 2024-09-12T18:19:24.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.449+0000 7f92911a79c0 20 remove_watcher() i=2 2024-09-12T18:19:24.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.453+0000 7f92911a79c0 20 remove_watcher() i=3 2024-09-12T18:19:24.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.453+0000 7f92911a79c0 20 remove_watcher() i=4 2024-09-12T18:19:24.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.457+0000 7f92911a79c0 20 remove_watcher() i=5 2024-09-12T18:19:24.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.457+0000 7f92911a79c0 20 remove_watcher() i=6 2024-09-12T18:19:24.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.457+0000 7f92911a79c0 20 remove_watcher() i=7 2024-09-12T18:19:24.481 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T18:19:24.519 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:24.519 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:24.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.553+0000 7f01982f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.553+0000 7f01982f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:24.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.553+0000 7f01982f99c0 20 realm 2024-09-12T18:19:24.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.553+0000 7f01982f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.557+0000 7f01982f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:24.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.557+0000 7f01982f99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:24.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.557+0000 7f01982f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.557+0000 7f01982f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:24.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.557+0000 7f01982f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.557+0000 7f01982f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:24.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.557+0000 7f01982f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.557+0000 7f01982f99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:24.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.557+0000 7f01982f99c0 20 searching for the correct realm 2024-09-12T18:19:24.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.565+0000 7f01955fe640 0 -- 172.21.15.98:0/4069048161 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f01880bf040 msgr2=0x7f01881131d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:24.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.569+0000 7f0196600640 0 -- 172.21.15.98:0/4069048161 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f018c00af60 msgr2=0x7f018c073040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:19:24.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.577+0000 7f01982f99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:24.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.577+0000 7f01982f99c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:19:24.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.577+0000 7f01982f99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:24.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.577+0000 7f01982f99c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:19:24.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.577+0000 7f01982f99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:24.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.577+0000 7f01982f99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:24.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.577+0000 7f01982f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.577+0000 7f01982f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:24.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.577+0000 7f01982f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.577+0000 7f01982f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:24.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.577+0000 7f01982f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.577+0000 7f01982f99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:24.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.577+0000 7f01982f99c0 20 zone default found 2024-09-12T18:19:24.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.577+0000 7f01982f99c0 4 Realm: () 2024-09-12T18:19:24.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.577+0000 7f01982f99c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:19:24.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.577+0000 7f01982f99c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:19:24.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.577+0000 7f01982f99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:24.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.577+0000 7f01982f99c0 20 zonegroup default 2024-09-12T18:19:24.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.577+0000 7f01982f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.581+0000 7f01982f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:24.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.581+0000 7f01982f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.581+0000 7f01982f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:24.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.581+0000 7f01982f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.581+0000 7f01982f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:24.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.581+0000 7f01982f99c0 20 started sync module instance, tier type = 2024-09-12T18:19:24.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.581+0000 7f01982f99c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:19:24.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.597+0000 7f01982f99c0 20 add_watcher() i=0 2024-09-12T18:19:24.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.597+0000 7f01982f99c0 20 add_watcher() i=1 2024-09-12T18:19:24.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.597+0000 7f01982f99c0 20 add_watcher() i=2 2024-09-12T18:19:24.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.597+0000 7f01982f99c0 20 add_watcher() i=3 2024-09-12T18:19:24.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.597+0000 7f01982f99c0 20 add_watcher() i=4 2024-09-12T18:19:24.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.597+0000 7f01982f99c0 20 add_watcher() i=5 2024-09-12T18:19:24.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.597+0000 7f01982f99c0 20 add_watcher() i=6 2024-09-12T18:19:24.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.597+0000 7f01982f99c0 20 add_watcher() i=7 2024-09-12T18:19:24.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.597+0000 7f01982f99c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:24.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.601+0000 7f004bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:24.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.601+0000 7f01982f99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:24.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.601+0000 7f01982f99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:24.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.601+0000 7f01982f99c0 5 note: GC not initialized 2024-09-12T18:19:24.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.601+0000 7f004afe5640 20 reqs_thread_entry: start 2024-09-12T18:19:24.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.601+0000 7f01982f99c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:24.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.601+0000 7f01982f99c0 20 Filter name: none 2024-09-12T18:19:24.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.601+0000 7f01982f99c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T18:19:24.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.601+0000 7f0048fe1640 20 reqs_thread_entry: start 2024-09-12T18:19:24.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.601+0000 7f01982f99c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.601+0000 7f01982f99c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T18:19:24.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.601+0000 7f01982f99c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T18:19:24.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.601+0000 7f01982f99c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:19:24.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.601+0000 7f01982f99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:19:24.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.601+0000 7f01982f99c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:19:24.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.601+0000 7f01982f99c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:19:24.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.601+0000 7f01982f99c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T18:19:24.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.605+0000 7f00797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268128 cookie 94872804616464 notifier 9306 bl.length()=727 2024-09-12T18:19:24.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.605+0000 7f00797fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:19:24.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.605+0000 7f00797fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:19:24.610 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T18:19:24.610 INFO:teuthology.orchestra.run.smithi098.stdout: "user_id": "foobar.client.0", 2024-09-12T18:19:24.610 INFO:teuthology.orchestra.run.smithi098.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T18:19:24.610 INFO:teuthology.orchestra.run.smithi098.stdout: "email": "foobar+test@test.test", 2024-09-12T18:19:24.610 INFO:teuthology.orchestra.run.smithi098.stdout: "suspended": 0, 2024-09-12T18:19:24.610 INFO:teuthology.orchestra.run.smithi098.stdout: "max_buckets": 1000, 2024-09-12T18:19:24.610 INFO:teuthology.orchestra.run.smithi098.stdout: "subusers": [], 2024-09-12T18:19:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: "keys": [ 2024-09-12T18:19:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-12T18:19:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: "user": "foobar.client.0", 2024-09-12T18:19:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: "access_key": "ODWIXXANMPQECJLYDOWA", 2024-09-12T18:19:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: "secret_key": "c+Qpd3taG6mCtUJNciV1BvDxJsiMoxyykuOPNXk+EEJo/BVnM1OjYA==", 2024-09-12T18:19:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: "active": true, 2024-09-12T18:19:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: "create_date": "2024-09-12T18:19:23.983873Z" 2024-09-12T18:19:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-12T18:19:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-12T18:19:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: "swift_keys": [], 2024-09-12T18:19:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": [ 2024-09-12T18:19:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-12T18:19:24.611 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "oidc-provider", 2024-09-12T18:19:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: "perm": "*" 2024-09-12T18:19:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-12T18:19:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "roles", 2024-09-12T18:19:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: "perm": "*" 2024-09-12T18:19:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-12T18:19:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "user-policy", 2024-09-12T18:19:24.612 INFO:teuthology.orchestra.run.smithi098.stdout: "perm": "*" 2024-09-12T18:19:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-12T18:19:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-12T18:19:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: "op_mask": "read, write, delete", 2024-09-12T18:19:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: "default_placement": "", 2024-09-12T18:19:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: "default_storage_class": "", 2024-09-12T18:19:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: "placement_tags": [], 2024-09-12T18:19:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: "bucket_quota": { 2024-09-12T18:19:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:19:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:19:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:19:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:19:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:19:24.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: "user_quota": { 2024-09-12T18:19:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:19:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:19:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:19:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:19:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:19:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: "temp_url_keys": [], 2024-09-12T18:19:24.614 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "rgw", 2024-09-12T18:19:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: "mfa_ids": [ 2024-09-12T18:19:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: "0560312300" 2024-09-12T18:19:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-12T18:19:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: "account_id": "", 2024-09-12T18:19:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/", 2024-09-12T18:19:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: "create_date": "2024-09-12T18:19:23.983850Z", 2024-09-12T18:19:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-12T18:19:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: "group_ids": [] 2024-09-12T18:19:24.615 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T18:19:24.615 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:19:24.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.605+0000 7f004bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:24.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.609+0000 7f01982f99c0 20 remove_watcher() i=0 2024-09-12T18:19:24.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.609+0000 7f01982f99c0 2 removed watcher, disabling cache 2024-09-12T18:19:24.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.613+0000 7f01982f99c0 20 remove_watcher() i=1 2024-09-12T18:19:24.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.613+0000 7f01982f99c0 20 remove_watcher() i=2 2024-09-12T18:19:24.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.617+0000 7f01982f99c0 20 remove_watcher() i=3 2024-09-12T18:19:24.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.617+0000 7f01982f99c0 20 remove_watcher() i=4 2024-09-12T18:19:24.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.621+0000 7f01982f99c0 20 remove_watcher() i=5 2024-09-12T18:19:24.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.621+0000 7f01982f99c0 20 remove_watcher() i=6 2024-09-12T18:19:24.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.621+0000 7f01982f99c0 20 remove_watcher() i=7 2024-09-12T18:19:24.643 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T18:19:24.721 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:24.721 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:24.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.757+0000 7fb19892c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.757+0000 7fb19892c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:24.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.757+0000 7fb19892c9c0 20 realm 2024-09-12T18:19:24.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.757+0000 7fb19892c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.757+0000 7fb19892c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:24.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.757+0000 7fb19892c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:24.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.757+0000 7fb19892c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.761+0000 7fb19892c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:24.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.761+0000 7fb19892c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.761+0000 7fb19892c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:24.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.761+0000 7fb19892c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.761+0000 7fb19892c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:24.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.761+0000 7fb19892c9c0 20 searching for the correct realm 2024-09-12T18:19:24.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.769+0000 7fb196c33640 0 -- 172.21.15.98:0/4284285877 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7fb1800d2430 msgr2=0x7fb1800d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:24.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.985+0000 7fb196432640 0 -- 172.21.15.98:0/4284285877 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x560c229b52e0 msgr2=0x560c229b7730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:24.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:24.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:19:24.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:24.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:19:24.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:24.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:24.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:24.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:24.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:24.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:24.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 20 zone default found 2024-09-12T18:19:24.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 4 Realm: () 2024-09-12T18:19:25.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:19:25.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:19:25.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:25.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 20 zonegroup default 2024-09-12T18:19:25.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.993+0000 7fb19892c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.997+0000 7fb19892c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.997+0000 7fb19892c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.997+0000 7fb19892c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.997+0000 7fb19892c9c0 20 started sync module instance, tier type = 2024-09-12T18:19:25.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:24.997+0000 7fb19892c9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:19:25.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.021+0000 7fb19892c9c0 20 add_watcher() i=0 2024-09-12T18:19:25.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.021+0000 7fb19892c9c0 20 add_watcher() i=1 2024-09-12T18:19:25.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.021+0000 7fb19892c9c0 20 add_watcher() i=2 2024-09-12T18:19:25.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.021+0000 7fb19892c9c0 20 add_watcher() i=3 2024-09-12T18:19:25.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.021+0000 7fb19892c9c0 20 add_watcher() i=4 2024-09-12T18:19:25.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.021+0000 7fb19892c9c0 20 add_watcher() i=5 2024-09-12T18:19:25.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.021+0000 7fb19892c9c0 20 add_watcher() i=6 2024-09-12T18:19:25.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.025+0000 7fb19892c9c0 20 add_watcher() i=7 2024-09-12T18:19:25.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.025+0000 7fb19892c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:25.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.029+0000 7fb04cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:25.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.029+0000 7fb19892c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:25.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.029+0000 7fb19892c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:25.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.029+0000 7fb19892c9c0 5 note: GC not initialized 2024-09-12T18:19:25.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.029+0000 7fafc77fe640 20 reqs_thread_entry: start 2024-09-12T18:19:25.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.029+0000 7fb19892c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:25.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.029+0000 7fb19892c9c0 20 Filter name: none 2024-09-12T18:19:25.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.029+0000 7fafc57fa640 20 reqs_thread_entry: start 2024-09-12T18:19:25.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.029+0000 7fb19892c9c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T18:19:25.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.029+0000 7fb19892c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.029+0000 7fb19892c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.029+0000 7fb19892c9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T18:19:25.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.029+0000 7fb19892c9c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T18:19:25.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.029+0000 7fb19892c9c0 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T18:19:25.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.029+0000 7fb19892c9c0 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T18:19:25.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.029+0000 7fb19892c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.029+0000 7fb19892c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.029+0000 7fb19892c9c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T18:19:25.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.029+0000 7fb19892c9c0 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T18:19:25.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.029+0000 7fb19892c9c0 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T18:19:25.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.033+0000 7fb19892c9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T18:19:25.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.033+0000 7fb19892c9c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T18:19:25.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.033+0000 7fb19892c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T18:19:25.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.033+0000 7fb079ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268217 cookie 94610120235456 notifier 8558 bl.length()=384 2024-09-12T18:19:25.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.033+0000 7fb079ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T18:19:25.040 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.033+0000 7fb079ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T18:19:25.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.041+0000 7fb19892c9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T18:19:25.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.041+0000 7fb19892c9c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T18:19:25.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.041+0000 7fb19892c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T18:19:25.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.041+0000 7fb079ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268220 cookie 94610120244192 notifier 8558 bl.length()=225 2024-09-12T18:19:25.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.041+0000 7fb079ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T18:19:25.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.041+0000 7fb079ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T18:19:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.045+0000 7fb19892c9c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T18:19:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.045+0000 7fb19892c9c0 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T18:19:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.045+0000 7fb19892c9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T18:19:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.045+0000 7fb079ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268142 cookie 94610120246320 notifier 8558 bl.length()=234 2024-09-12T18:19:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.045+0000 7fb079ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T18:19:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.045+0000 7fb079ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T18:19:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.049+0000 7fb04cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.053+0000 7fb19892c9c0 20 remove_watcher() i=0 2024-09-12T18:19:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.053+0000 7fb19892c9c0 2 removed watcher, disabling cache 2024-09-12T18:19:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.057+0000 7fb19892c9c0 20 remove_watcher() i=1 2024-09-12T18:19:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.057+0000 7fb19892c9c0 20 remove_watcher() i=2 2024-09-12T18:19:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.061+0000 7fb19892c9c0 20 remove_watcher() i=3 2024-09-12T18:19:25.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.061+0000 7fb19892c9c0 20 remove_watcher() i=4 2024-09-12T18:19:25.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.065+0000 7fb19892c9c0 20 remove_watcher() i=5 2024-09-12T18:19:25.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.065+0000 7fb19892c9c0 20 remove_watcher() i=6 2024-09-12T18:19:25.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.065+0000 7fb19892c9c0 20 remove_watcher() i=7 2024-09-12T18:19:25.095 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T18:19:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "id": "RGW88888888888888888", 2024-09-12T18:19:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "tenant": "", 2024-09-12T18:19:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T18:19:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T18:19:25.095 INFO:teuthology.orchestra.run.smithi098.stdout: "quota": { 2024-09-12T18:19:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:19:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:19:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:19:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:19:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:19:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "bucket_quota": { 2024-09-12T18:19:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:19:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:19:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:19:25.096 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:19:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:19:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "max_users": 1000, 2024-09-12T18:19:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "max_roles": 1000, 2024-09-12T18:19:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "max_groups": 1000, 2024-09-12T18:19:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "max_buckets": 1000, 2024-09-12T18:19:25.097 INFO:teuthology.orchestra.run.smithi098.stdout: "max_access_keys": 4 2024-09-12T18:19:25.097 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T18:19:25.098 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T18:19:25.098 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key QDPTFXNOVHKPVFJMZDXF --secret VaEY8qhjoeg2m9r729T9tL06CVFJAJrWOf/jyZbipWBvkl2xbJTe9g== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T18:19:25.189 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:25.189 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:25.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.225+0000 7f525bd4e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.225+0000 7f525bd4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.225+0000 7f525bd4e9c0 20 realm 2024-09-12T18:19:25.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.225+0000 7f525bd4e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.225+0000 7f525bd4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.225+0000 7f525bd4e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:25.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.225+0000 7f525bd4e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.225+0000 7f525bd4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.225+0000 7f525bd4e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.229+0000 7f525bd4e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:25.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.229+0000 7f525bd4e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.229+0000 7f525bd4e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:25.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.229+0000 7f525bd4e9c0 20 searching for the correct realm 2024-09-12T18:19:25.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.237+0000 7f525a055640 0 -- 172.21.15.98:0/1142406649 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f52440adc40 msgr2=0x7f52440f83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:19:25.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.453+0000 7f5259854640 0 -- 172.21.15.98:0/1142406649 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x55ec42f0b4d0 msgr2=0x55ec42f0d8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:25.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.461+0000 7f525bd4e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:25.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.461+0000 7f525bd4e9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:19:25.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.461+0000 7f525bd4e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:25.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.461+0000 7f525bd4e9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:19:25.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.461+0000 7f525bd4e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:25.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.461+0000 7f525bd4e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:25.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.461+0000 7f525bd4e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.461+0000 7f525bd4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.461+0000 7f525bd4e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.465+0000 7f525bd4e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:25.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.465+0000 7f525bd4e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.465+0000 7f525bd4e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:25.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.465+0000 7f525bd4e9c0 20 zone default found 2024-09-12T18:19:25.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.465+0000 7f525bd4e9c0 4 Realm: () 2024-09-12T18:19:25.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.465+0000 7f525bd4e9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:19:25.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.465+0000 7f525bd4e9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:19:25.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.465+0000 7f525bd4e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:25.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.465+0000 7f525bd4e9c0 20 zonegroup default 2024-09-12T18:19:25.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.465+0000 7f525bd4e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.465+0000 7f525bd4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.465+0000 7f525bd4e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.465+0000 7f525bd4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.465+0000 7f525bd4e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.465+0000 7f525bd4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.469+0000 7f525bd4e9c0 20 started sync module instance, tier type = 2024-09-12T18:19:25.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.469+0000 7f525bd4e9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:19:25.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.489+0000 7f525bd4e9c0 20 add_watcher() i=0 2024-09-12T18:19:25.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.489+0000 7f525bd4e9c0 20 add_watcher() i=1 2024-09-12T18:19:25.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.489+0000 7f525bd4e9c0 20 add_watcher() i=2 2024-09-12T18:19:25.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.489+0000 7f525bd4e9c0 20 add_watcher() i=3 2024-09-12T18:19:25.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.489+0000 7f525bd4e9c0 20 add_watcher() i=4 2024-09-12T18:19:25.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.489+0000 7f525bd4e9c0 20 add_watcher() i=5 2024-09-12T18:19:25.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.489+0000 7f525bd4e9c0 20 add_watcher() i=6 2024-09-12T18:19:25.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.493+0000 7f525bd4e9c0 20 add_watcher() i=7 2024-09-12T18:19:25.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.493+0000 7f525bd4e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:25.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.497+0000 7f510ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:25.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.497+0000 7f525bd4e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:25.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.497+0000 7f525bd4e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:25.502 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.497+0000 7f525bd4e9c0 5 note: GC not initialized 2024-09-12T18:19:25.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.497+0000 7f510efe5640 20 reqs_thread_entry: start 2024-09-12T18:19:25.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.497+0000 7f525bd4e9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:25.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.497+0000 7f525bd4e9c0 20 Filter name: none 2024-09-12T18:19:25.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.497+0000 7f510cfe1640 20 reqs_thread_entry: start 2024-09-12T18:19:25.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.497+0000 7f525bd4e9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T18:19:25.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.497+0000 7f525bd4e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.497+0000 7f525bd4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.501+0000 7f525bd4e9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T18:19:25.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.501+0000 7f525bd4e9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:19:25.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.501+0000 7f525bd4e9c0 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T18:19:25.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.501+0000 7f525bd4e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.501+0000 7f525bd4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.501+0000 7f525bd4e9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T18:19:25.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.501+0000 7f525bd4e9c0 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T18:19:25.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.501+0000 7f525bd4e9c0 10 cache get: name=default.rgw.meta+users.keys+QDPTFXNOVHKPVFJMZDXF : miss 2024-09-12T18:19:25.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.501+0000 7f525bd4e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.501+0000 7f525bd4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.501+0000 7f525bd4e9c0 10 cache put: name=default.rgw.meta+users.keys+QDPTFXNOVHKPVFJMZDXF info.flags=0x0 2024-09-12T18:19:25.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.501+0000 7f525bd4e9c0 10 adding default.rgw.meta+users.keys+QDPTFXNOVHKPVFJMZDXF to cache LRU end 2024-09-12T18:19:25.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.501+0000 7f525bd4e9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T18:19:25.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.501+0000 7f525bd4e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.501+0000 7f525bd4e9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T18:19:25.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.501+0000 7f525bd4e9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T18:19:25.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.501+0000 7f525bd4e9c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T18:19:25.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.501+0000 7f525bd4e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:19:25.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.501+0000 7f525bd4e9c0 10 cache get: name=default.rgw.meta+users.keys+QDPTFXNOVHKPVFJMZDXF : hit (negative entry) 2024-09-12T18:19:25.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.501+0000 7f525bd4e9c0 10 cache get: name=default.rgw.meta+users.keys+QDPTFXNOVHKPVFJMZDXF : hit (negative entry) 2024-09-12T18:19:25.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.505+0000 7f525bd4e9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T18:19:25.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.505+0000 7f525bd4e9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:19:25.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.505+0000 7f525bd4e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T18:19:25.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.505+0000 7f513d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268218 cookie 94473223748944 notifier 9342 bl.length()=681 2024-09-12T18:19:25.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.505+0000 7f513d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T18:19:25.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.505+0000 7f513d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:19:25.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.509+0000 7f525bd4e9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T18:19:25.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.509+0000 7f525bd4e9c0 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T18:19:25.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.509+0000 7f525bd4e9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T18:19:25.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.509+0000 7f513cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268174 cookie 94473223756624 notifier 9342 bl.length()=189 2024-09-12T18:19:25.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.509+0000 7f513cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T18:19:25.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.509+0000 7f513cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T18:19:25.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.513+0000 7f525bd4e9c0 10 cache put: name=default.rgw.meta+users.keys+QDPTFXNOVHKPVFJMZDXF info.flags=0x7 2024-09-12T18:19:25.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.513+0000 7f525bd4e9c0 10 moving default.rgw.meta+users.keys+QDPTFXNOVHKPVFJMZDXF to cache LRU end 2024-09-12T18:19:25.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.513+0000 7f525bd4e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:QDPTFXNOVHKPVFJMZDXF, ofs0, ns] 2024-09-12T18:19:25.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.517+0000 7f513cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268221 cookie 94473223755056 notifier 9342 bl.length()=188 2024-09-12T18:19:25.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.517+0000 7f513cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+QDPTFXNOVHKPVFJMZDXF info.flags=0x7 2024-09-12T18:19:25.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.517+0000 7f513cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+QDPTFXNOVHKPVFJMZDXF to cache LRU end 2024-09-12T18:19:25.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.521+0000 7f525bd4e9c0 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T18:19:25.525 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T18:19:25.526 INFO:teuthology.orchestra.run.smithi098.stdout: "user_id": "root1.client.0", 2024-09-12T18:19:25.526 INFO:teuthology.orchestra.run.smithi098.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T18:19:25.526 INFO:teuthology.orchestra.run.smithi098.stdout: "email": "root1+test@test.test", 2024-09-12T18:19:25.526 INFO:teuthology.orchestra.run.smithi098.stdout: "suspended": 0, 2024-09-12T18:19:25.526 INFO:teuthology.orchestra.run.smithi098.stdout: "max_buckets": 1000, 2024-09-12T18:19:25.526 INFO:teuthology.orchestra.run.smithi098.stdout: "subusers": [], 2024-09-12T18:19:25.526 INFO:teuthology.orchestra.run.smithi098.stdout: "keys": [ 2024-09-12T18:19:25.526 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-12T18:19:25.526 INFO:teuthology.orchestra.run.smithi098.stdout: "user": "root1.client.0", 2024-09-12T18:19:25.527 INFO:teuthology.orchestra.run.smithi098.stdout: "access_key": "QDPTFXNOVHKPVFJMZDXF", 2024-09-12T18:19:25.527 INFO:teuthology.orchestra.run.smithi098.stdout: "secret_key": "VaEY8qhjoeg2m9r729T9tL06CVFJAJrWOf/jyZbipWBvkl2xbJTe9g==", 2024-09-12T18:19:25.527 INFO:teuthology.orchestra.run.smithi098.stdout: "active": true, 2024-09-12T18:19:25.527 INFO:teuthology.orchestra.run.smithi098.stdout: "create_date": "2024-09-12T18:19:25.507324Z" 2024-09-12T18:19:25.527 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-12T18:19:25.527 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-12T18:19:25.528 INFO:teuthology.orchestra.run.smithi098.stdout: "swift_keys": [], 2024-09-12T18:19:25.528 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": [], 2024-09-12T18:19:25.528 INFO:teuthology.orchestra.run.smithi098.stdout: "op_mask": "read, write, delete", 2024-09-12T18:19:25.528 INFO:teuthology.orchestra.run.smithi098.stdout: "default_placement": "", 2024-09-12T18:19:25.528 INFO:teuthology.orchestra.run.smithi098.stdout: "default_storage_class": "", 2024-09-12T18:19:25.528 INFO:teuthology.orchestra.run.smithi098.stdout: "placement_tags": [], 2024-09-12T18:19:25.528 INFO:teuthology.orchestra.run.smithi098.stdout: "bucket_quota": { 2024-09-12T18:19:25.528 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:19:25.528 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:19:25.528 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:19:25.528 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:19:25.528 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:19:25.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:25.529 INFO:teuthology.orchestra.run.smithi098.stdout: "user_quota": { 2024-09-12T18:19:25.529 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:19:25.529 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:19:25.529 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:19:25.529 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:19:25.529 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:19:25.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:25.530 INFO:teuthology.orchestra.run.smithi098.stdout: "temp_url_keys": [], 2024-09-12T18:19:25.530 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "root", 2024-09-12T18:19:25.530 INFO:teuthology.orchestra.run.smithi098.stdout: "mfa_ids": [], 2024-09-12T18:19:25.530 INFO:teuthology.orchestra.run.smithi098.stdout: "account_id": "RGW88888888888888888", 2024-09-12T18:19:25.530 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/", 2024-09-12T18:19:25.530 INFO:teuthology.orchestra.run.smithi098.stdout: "create_date": "2024-09-12T18:19:25.507290Z", 2024-09-12T18:19:25.530 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-12T18:19:25.530 INFO:teuthology.orchestra.run.smithi098.stdout: "group_ids": [] 2024-09-12T18:19:25.530 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T18:19:25.530 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:19:25.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.521+0000 7f510ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:25.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.525+0000 7f525bd4e9c0 20 remove_watcher() i=0 2024-09-12T18:19:25.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.525+0000 7f525bd4e9c0 2 removed watcher, disabling cache 2024-09-12T18:19:25.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.529+0000 7f525bd4e9c0 20 remove_watcher() i=1 2024-09-12T18:19:25.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.533+0000 7f525bd4e9c0 20 remove_watcher() i=2 2024-09-12T18:19:25.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.533+0000 7f525bd4e9c0 20 remove_watcher() i=3 2024-09-12T18:19:25.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.537+0000 7f525bd4e9c0 20 remove_watcher() i=4 2024-09-12T18:19:25.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.537+0000 7f525bd4e9c0 20 remove_watcher() i=5 2024-09-12T18:19:25.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.541+0000 7f525bd4e9c0 20 remove_watcher() i=6 2024-09-12T18:19:25.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.541+0000 7f525bd4e9c0 20 remove_watcher() i=7 2024-09-12T18:19:25.567 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 8492652048 --totp-seed F6S3MFWFE4XTPO2LBN7JVMDYY4ZQ3THELALOITXIYOF23ID4LUSQ3LTYDTFTWZFN --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:19:25.614 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:25.614 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:25.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.653+0000 7fd012d539c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.653+0000 7fd012d539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.653+0000 7fd012d539c0 20 realm 2024-09-12T18:19:25.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.653+0000 7fd012d539c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.653+0000 7fd012d539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.653+0000 7fd012d539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:25.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.653+0000 7fd012d539c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.653+0000 7fd012d539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.653+0000 7fd012d539c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.657+0000 7fd012d539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:25.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.657+0000 7fd012d539c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.657+0000 7fd012d539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:25.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.657+0000 7fd012d539c0 20 searching for the correct realm 2024-09-12T18:19:25.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.661+0000 7fd010058640 0 -- 172.21.15.98:0/557193408 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x555ffbc19630 msgr2=0x555ffbc1baf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:25.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.669+0000 7fd010859640 0 -- 172.21.15.98:0/557193408 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fcff80731c0 msgr2=0x7fcff804b1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:25.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:25.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:19:25.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:25.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:19:25.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:25.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:25.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:25.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:25.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 20 zone default found 2024-09-12T18:19:25.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 4 Realm: () 2024-09-12T18:19:25.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:19:25.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:19:25.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:25.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 20 zonegroup default 2024-09-12T18:19:25.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.677+0000 7fd012d539c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.681+0000 7fd012d539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.681+0000 7fd012d539c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.681+0000 7fd012d539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.681+0000 7fd012d539c0 20 started sync module instance, tier type = 2024-09-12T18:19:25.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.681+0000 7fd012d539c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:19:25.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.693+0000 7fd012d539c0 20 add_watcher() i=0 2024-09-12T18:19:25.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.693+0000 7fd012d539c0 20 add_watcher() i=1 2024-09-12T18:19:25.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.693+0000 7fd012d539c0 20 add_watcher() i=2 2024-09-12T18:19:25.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.693+0000 7fd012d539c0 20 add_watcher() i=3 2024-09-12T18:19:25.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.693+0000 7fd012d539c0 20 add_watcher() i=4 2024-09-12T18:19:25.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.693+0000 7fd012d539c0 20 add_watcher() i=5 2024-09-12T18:19:25.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.693+0000 7fd012d539c0 20 add_watcher() i=6 2024-09-12T18:19:25.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.697+0000 7fd012d539c0 20 add_watcher() i=7 2024-09-12T18:19:25.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.697+0000 7fd012d539c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:25.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.697+0000 7fcec6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:25.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.697+0000 7fd012d539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:25.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.697+0000 7fd012d539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:25.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.697+0000 7fd012d539c0 5 note: GC not initialized 2024-09-12T18:19:25.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.697+0000 7fcec5fe3640 20 reqs_thread_entry: start 2024-09-12T18:19:25.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.697+0000 7fd012d539c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:25.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.701+0000 7fd012d539c0 20 Filter name: none 2024-09-12T18:19:25.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.701+0000 7fce377fe640 20 reqs_thread_entry: start 2024-09-12T18:19:25.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.701+0000 7fd012d539c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T18:19:25.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.701+0000 7fd012d539c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.701+0000 7fd012d539c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T18:19:25.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.701+0000 7fd012d539c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T18:19:25.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.701+0000 7fd012d539c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:19:25.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.701+0000 7fd012d539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:19:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.701+0000 7fd012d539c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T18:19:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.701+0000 7fd012d539c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:19:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.701+0000 7fd012d539c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T18:19:25.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.705+0000 7fcee7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268219 cookie 93870734036576 notifier 8588 bl.length()=695 2024-09-12T18:19:25.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.705+0000 7fcee7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T18:19:25.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.705+0000 7fcee7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:19:25.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.705+0000 7fcec6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:25.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.713+0000 7fd012d539c0 20 remove_watcher() i=0 2024-09-12T18:19:25.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.713+0000 7fd012d539c0 2 removed watcher, disabling cache 2024-09-12T18:19:25.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.713+0000 7fd012d539c0 20 remove_watcher() i=1 2024-09-12T18:19:25.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.717+0000 7fd012d539c0 20 remove_watcher() i=2 2024-09-12T18:19:25.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.717+0000 7fd012d539c0 20 remove_watcher() i=3 2024-09-12T18:19:25.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.721+0000 7fd012d539c0 20 remove_watcher() i=4 2024-09-12T18:19:25.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.721+0000 7fd012d539c0 20 remove_watcher() i=5 2024-09-12T18:19:25.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.721+0000 7fd012d539c0 20 remove_watcher() i=6 2024-09-12T18:19:25.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.725+0000 7fd012d539c0 20 remove_watcher() i=7 2024-09-12T18:19:25.743 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T18:19:25.776 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:25.777 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:25.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.813+0000 7fcc063ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.813+0000 7fcc063ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.813+0000 7fcc063ff9c0 20 realm 2024-09-12T18:19:25.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.813+0000 7fcc063ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.813+0000 7fcc063ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.813+0000 7fcc063ff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:25.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.813+0000 7fcc063ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.813+0000 7fcc063ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.813+0000 7fcc063ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.817+0000 7fcc063ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:25.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.817+0000 7fcc063ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.817+0000 7fcc063ff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:25.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.817+0000 7fcc063ff9c0 20 searching for the correct realm 2024-09-12T18:19:25.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.821+0000 7fcc03704640 0 -- 172.21.15.98:0/2165889349 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x55d5e984c310 msgr2=0x55d5e984e7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:25.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.829+0000 7fcc03f05640 0 -- 172.21.15.98:0/2165889349 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fcbec018070 msgr2=0x7fcbec08f7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:25.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:25.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:19:25.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:25.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:19:25.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:25.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:25.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:25.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:25.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 20 zone default found 2024-09-12T18:19:25.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 4 Realm: () 2024-09-12T18:19:25.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:19:25.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:19:25.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:25.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 20 zonegroup default 2024-09-12T18:19:25.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.837+0000 7fcc063ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.841+0000 7fcc063ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.841+0000 7fcc063ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.841+0000 7fcc063ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.841+0000 7fcc063ff9c0 20 started sync module instance, tier type = 2024-09-12T18:19:25.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.841+0000 7fcc063ff9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:19:25.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.857+0000 7fcc063ff9c0 20 add_watcher() i=0 2024-09-12T18:19:25.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.857+0000 7fcc063ff9c0 20 add_watcher() i=1 2024-09-12T18:19:25.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.857+0000 7fcc063ff9c0 20 add_watcher() i=2 2024-09-12T18:19:25.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.857+0000 7fcc063ff9c0 20 add_watcher() i=3 2024-09-12T18:19:25.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.857+0000 7fcc063ff9c0 20 add_watcher() i=4 2024-09-12T18:19:25.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.857+0000 7fcc063ff9c0 20 add_watcher() i=5 2024-09-12T18:19:25.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.857+0000 7fcc063ff9c0 20 add_watcher() i=6 2024-09-12T18:19:25.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.857+0000 7fcc063ff9c0 20 add_watcher() i=7 2024-09-12T18:19:25.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.857+0000 7fcc063ff9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:25.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.861+0000 7fcab9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:25.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.861+0000 7fcc063ff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.861+0000 7fcc063ff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.861+0000 7fcc063ff9c0 5 note: GC not initialized 2024-09-12T18:19:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.861+0000 7fcab8fe1640 20 reqs_thread_entry: start 2024-09-12T18:19:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.861+0000 7fcc063ff9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.861+0000 7fcc063ff9c0 20 Filter name: none 2024-09-12T18:19:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.861+0000 7fca327fc640 20 reqs_thread_entry: start 2024-09-12T18:19:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.861+0000 7fcc063ff9c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T18:19:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.861+0000 7fcc063ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.861+0000 7fcc063ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.861+0000 7fcc063ff9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T18:19:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.861+0000 7fcc063ff9c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T18:19:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.861+0000 7fcc063ff9c0 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T18:19:25.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.861+0000 7fcc063ff9c0 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T18:19:25.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.861+0000 7fcc063ff9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:25.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.861+0000 7fcc063ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:25.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.861+0000 7fcc063ff9c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T18:19:25.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.861+0000 7fcc063ff9c0 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T18:19:25.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.861+0000 7fcc063ff9c0 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T18:19:25.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.865+0000 7fcc063ff9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T18:19:25.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.865+0000 7fcc063ff9c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T18:19:25.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.865+0000 7fcc063ff9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T18:19:25.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.865+0000 7fcae2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268220 cookie 94377234201408 notifier 8603 bl.length()=384 2024-09-12T18:19:25.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.865+0000 7fcae2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T18:19:25.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.865+0000 7fcae2ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T18:19:25.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.869+0000 7fcc063ff9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T18:19:25.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.869+0000 7fcc063ff9c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T18:19:25.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.869+0000 7fcc063ff9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T18:19:25.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.869+0000 7fcae2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268222 cookie 94377234208240 notifier 8603 bl.length()=225 2024-09-12T18:19:25.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.869+0000 7fcae2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T18:19:25.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.869+0000 7fcae2ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T18:19:25.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.873+0000 7fcc063ff9c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T18:19:25.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.873+0000 7fcc063ff9c0 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T18:19:25.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.873+0000 7fcc063ff9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T18:19:25.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.877+0000 7fcae27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268143 cookie 94377234203536 notifier 8603 bl.length()=234 2024-09-12T18:19:25.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.877+0000 7fcae27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T18:19:25.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.877+0000 7fcae27fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T18:19:25.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.877+0000 7fcab9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:25.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.885+0000 7fcc063ff9c0 20 remove_watcher() i=0 2024-09-12T18:19:25.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.885+0000 7fcc063ff9c0 2 removed watcher, disabling cache 2024-09-12T18:19:25.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.885+0000 7fcc063ff9c0 20 remove_watcher() i=1 2024-09-12T18:19:25.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.889+0000 7fcc063ff9c0 20 remove_watcher() i=2 2024-09-12T18:19:25.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.889+0000 7fcc063ff9c0 20 remove_watcher() i=3 2024-09-12T18:19:25.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.893+0000 7fcc063ff9c0 20 remove_watcher() i=4 2024-09-12T18:19:25.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.893+0000 7fcc063ff9c0 20 remove_watcher() i=5 2024-09-12T18:19:25.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.893+0000 7fcc063ff9c0 20 remove_watcher() i=6 2024-09-12T18:19:25.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:25.897+0000 7fcc063ff9c0 20 remove_watcher() i=7 2024-09-12T18:19:25.912 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T18:19:25.912 INFO:teuthology.orchestra.run.smithi098.stdout: "id": "RGW99999999999999999", 2024-09-12T18:19:25.912 INFO:teuthology.orchestra.run.smithi098.stdout: "tenant": "", 2024-09-12T18:19:25.912 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T18:19:25.912 INFO:teuthology.orchestra.run.smithi098.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T18:19:25.912 INFO:teuthology.orchestra.run.smithi098.stdout: "quota": { 2024-09-12T18:19:25.912 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:19:25.913 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:19:25.913 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:19:25.913 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:19:25.913 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:19:25.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:25.913 INFO:teuthology.orchestra.run.smithi098.stdout: "bucket_quota": { 2024-09-12T18:19:25.913 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:19:25.913 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:19:25.913 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:19:25.913 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:19:25.913 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:19:25.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:25.914 INFO:teuthology.orchestra.run.smithi098.stdout: "max_users": 1000, 2024-09-12T18:19:25.914 INFO:teuthology.orchestra.run.smithi098.stdout: "max_roles": 1000, 2024-09-12T18:19:25.914 INFO:teuthology.orchestra.run.smithi098.stdout: "max_groups": 1000, 2024-09-12T18:19:25.914 INFO:teuthology.orchestra.run.smithi098.stdout: "max_buckets": 1000, 2024-09-12T18:19:25.914 INFO:teuthology.orchestra.run.smithi098.stdout: "max_access_keys": 4 2024-09-12T18:19:25.914 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T18:19:25.915 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T18:19:25.915 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key YWCHXSIJSXVFDWLBZXDK --secret d7XpQdmIBkYjvQOFJByBqBynd8za5NLKJmTtXnKrHEFVZlIys3fJaA== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T18:19:26.002 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:26.002 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:26.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.037+0000 7f985572e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.037+0000 7f985572e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:26.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.037+0000 7f985572e9c0 20 realm 2024-09-12T18:19:26.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.037+0000 7f985572e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.037+0000 7f985572e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:26.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.037+0000 7f985572e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:26.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.041+0000 7f985572e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.041+0000 7f985572e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:26.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.041+0000 7f985572e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.041+0000 7f985572e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:26.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.041+0000 7f985572e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.041+0000 7f985572e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:26.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.041+0000 7f985572e9c0 20 searching for the correct realm 2024-09-12T18:19:26.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.049+0000 7f9853a35640 0 -- 172.21.15.98:0/2400266235 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x55888bbc9ff0 msgr2=0x55888bbcc4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:26.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.053+0000 7f9852a33640 0 -- 172.21.15.98:0/2400266235 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f984406b7d0 msgr2=0x7f984407d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:26.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:26.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:19:26.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:26.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:19:26.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:26.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:26.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:26.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:26.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:26.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 20 zone default found 2024-09-12T18:19:26.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 4 Realm: () 2024-09-12T18:19:26.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:19:26.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:19:26.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:26.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 20 zonegroup default 2024-09-12T18:19:26.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:26.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.061+0000 7f985572e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.065+0000 7f985572e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:26.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.065+0000 7f985572e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.065+0000 7f985572e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:26.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.065+0000 7f985572e9c0 20 started sync module instance, tier type = 2024-09-12T18:19:26.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.065+0000 7f985572e9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:19:26.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.081+0000 7f985572e9c0 20 add_watcher() i=0 2024-09-12T18:19:26.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.081+0000 7f985572e9c0 20 add_watcher() i=1 2024-09-12T18:19:26.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.081+0000 7f985572e9c0 20 add_watcher() i=2 2024-09-12T18:19:26.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.081+0000 7f985572e9c0 20 add_watcher() i=3 2024-09-12T18:19:26.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.081+0000 7f985572e9c0 20 add_watcher() i=4 2024-09-12T18:19:26.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.081+0000 7f985572e9c0 20 add_watcher() i=5 2024-09-12T18:19:26.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.081+0000 7f985572e9c0 20 add_watcher() i=6 2024-09-12T18:19:26.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.081+0000 7f985572e9c0 20 add_watcher() i=7 2024-09-12T18:19:26.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.081+0000 7f985572e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:26.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f9709fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:26.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:26.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:26.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 5 note: GC not initialized 2024-09-12T18:19:26.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f9708fe1640 20 reqs_thread_entry: start 2024-09-12T18:19:26.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:26.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 20 Filter name: none 2024-09-12T18:19:26.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f96827fc640 20 reqs_thread_entry: start 2024-09-12T18:19:26.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T18:19:26.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:26.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T18:19:26.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:19:26.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T18:19:26.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:26.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T18:19:26.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T18:19:26.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 10 cache get: name=default.rgw.meta+users.keys+YWCHXSIJSXVFDWLBZXDK : miss 2024-09-12T18:19:26.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:26.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 10 cache put: name=default.rgw.meta+users.keys+YWCHXSIJSXVFDWLBZXDK info.flags=0x0 2024-09-12T18:19:26.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 10 adding default.rgw.meta+users.keys+YWCHXSIJSXVFDWLBZXDK to cache LRU end 2024-09-12T18:19:26.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T18:19:26.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T18:19:26.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T18:19:26.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T18:19:26.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:19:26.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 10 cache get: name=default.rgw.meta+users.keys+YWCHXSIJSXVFDWLBZXDK : hit (negative entry) 2024-09-12T18:19:26.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.085+0000 7f985572e9c0 10 cache get: name=default.rgw.meta+users.keys+YWCHXSIJSXVFDWLBZXDK : hit (negative entry) 2024-09-12T18:19:26.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.089+0000 7f985572e9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T18:19:26.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.089+0000 7f985572e9c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:19:26.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.089+0000 7f985572e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T18:19:26.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.089+0000 7f9736ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268221 cookie 94044948359440 notifier 9402 bl.length()=681 2024-09-12T18:19:26.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.089+0000 7f9736ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T18:19:26.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.089+0000 7f9736ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:19:26.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.093+0000 7f985572e9c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T18:19:26.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.093+0000 7f985572e9c0 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T18:19:26.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.093+0000 7f985572e9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T18:19:26.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.093+0000 7f9736ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268175 cookie 94044948370016 notifier 9402 bl.length()=189 2024-09-12T18:19:26.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.093+0000 7f9736ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T18:19:26.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.093+0000 7f9736ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T18:19:26.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.097+0000 7f985572e9c0 10 cache put: name=default.rgw.meta+users.keys+YWCHXSIJSXVFDWLBZXDK info.flags=0x7 2024-09-12T18:19:26.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.097+0000 7f985572e9c0 10 moving default.rgw.meta+users.keys+YWCHXSIJSXVFDWLBZXDK to cache LRU end 2024-09-12T18:19:26.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.097+0000 7f985572e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:YWCHXSIJSXVFDWLBZXDK, ofs0, ns] 2024-09-12T18:19:26.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.097+0000 7f97367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268222 cookie 94044948359440 notifier 9402 bl.length()=188 2024-09-12T18:19:26.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.097+0000 7f97367fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YWCHXSIJSXVFDWLBZXDK info.flags=0x7 2024-09-12T18:19:26.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.097+0000 7f97367fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YWCHXSIJSXVFDWLBZXDK to cache LRU end 2024-09-12T18:19:26.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.105+0000 7f985572e9c0 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T18:19:26.109 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T18:19:26.109 INFO:teuthology.orchestra.run.smithi098.stdout: "user_id": "root2.client.0", 2024-09-12T18:19:26.109 INFO:teuthology.orchestra.run.smithi098.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T18:19:26.109 INFO:teuthology.orchestra.run.smithi098.stdout: "email": "root2+test@test.test", 2024-09-12T18:19:26.109 INFO:teuthology.orchestra.run.smithi098.stdout: "suspended": 0, 2024-09-12T18:19:26.109 INFO:teuthology.orchestra.run.smithi098.stdout: "max_buckets": 1000, 2024-09-12T18:19:26.109 INFO:teuthology.orchestra.run.smithi098.stdout: "subusers": [], 2024-09-12T18:19:26.109 INFO:teuthology.orchestra.run.smithi098.stdout: "keys": [ 2024-09-12T18:19:26.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-12T18:19:26.109 INFO:teuthology.orchestra.run.smithi098.stdout: "user": "root2.client.0", 2024-09-12T18:19:26.109 INFO:teuthology.orchestra.run.smithi098.stdout: "access_key": "YWCHXSIJSXVFDWLBZXDK", 2024-09-12T18:19:26.109 INFO:teuthology.orchestra.run.smithi098.stdout: "secret_key": "d7XpQdmIBkYjvQOFJByBqBynd8za5NLKJmTtXnKrHEFVZlIys3fJaA==", 2024-09-12T18:19:26.110 INFO:teuthology.orchestra.run.smithi098.stdout: "active": true, 2024-09-12T18:19:26.110 INFO:teuthology.orchestra.run.smithi098.stdout: "create_date": "2024-09-12T18:19:26.091568Z" 2024-09-12T18:19:26.110 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-12T18:19:26.110 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-12T18:19:26.110 INFO:teuthology.orchestra.run.smithi098.stdout: "swift_keys": [], 2024-09-12T18:19:26.110 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": [], 2024-09-12T18:19:26.110 INFO:teuthology.orchestra.run.smithi098.stdout: "op_mask": "read, write, delete", 2024-09-12T18:19:26.110 INFO:teuthology.orchestra.run.smithi098.stdout: "default_placement": "", 2024-09-12T18:19:26.110 INFO:teuthology.orchestra.run.smithi098.stdout: "default_storage_class": "", 2024-09-12T18:19:26.110 INFO:teuthology.orchestra.run.smithi098.stdout: "placement_tags": [], 2024-09-12T18:19:26.110 INFO:teuthology.orchestra.run.smithi098.stdout: "bucket_quota": { 2024-09-12T18:19:26.110 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:19:26.110 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:19:26.110 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:19:26.111 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:19:26.111 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:19:26.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:26.111 INFO:teuthology.orchestra.run.smithi098.stdout: "user_quota": { 2024-09-12T18:19:26.111 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": false, 2024-09-12T18:19:26.111 INFO:teuthology.orchestra.run.smithi098.stdout: "check_on_raw": false, 2024-09-12T18:19:26.111 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size": -1, 2024-09-12T18:19:26.111 INFO:teuthology.orchestra.run.smithi098.stdout: "max_size_kb": 0, 2024-09-12T18:19:26.111 INFO:teuthology.orchestra.run.smithi098.stdout: "max_objects": -1 2024-09-12T18:19:26.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-12T18:19:26.111 INFO:teuthology.orchestra.run.smithi098.stdout: "temp_url_keys": [], 2024-09-12T18:19:26.111 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "root", 2024-09-12T18:19:26.111 INFO:teuthology.orchestra.run.smithi098.stdout: "mfa_ids": [], 2024-09-12T18:19:26.111 INFO:teuthology.orchestra.run.smithi098.stdout: "account_id": "RGW99999999999999999", 2024-09-12T18:19:26.111 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/", 2024-09-12T18:19:26.112 INFO:teuthology.orchestra.run.smithi098.stdout: "create_date": "2024-09-12T18:19:26.091549Z", 2024-09-12T18:19:26.112 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-12T18:19:26.112 INFO:teuthology.orchestra.run.smithi098.stdout: "group_ids": [] 2024-09-12T18:19:26.112 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T18:19:26.112 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:19:26.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.105+0000 7f9709fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:26.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.109+0000 7f985572e9c0 20 remove_watcher() i=0 2024-09-12T18:19:26.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.109+0000 7f985572e9c0 2 removed watcher, disabling cache 2024-09-12T18:19:26.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.113+0000 7f985572e9c0 20 remove_watcher() i=1 2024-09-12T18:19:26.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.113+0000 7f985572e9c0 20 remove_watcher() i=2 2024-09-12T18:19:26.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.117+0000 7f985572e9c0 20 remove_watcher() i=3 2024-09-12T18:19:26.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.117+0000 7f985572e9c0 20 remove_watcher() i=4 2024-09-12T18:19:26.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.121+0000 7f985572e9c0 20 remove_watcher() i=5 2024-09-12T18:19:26.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.121+0000 7f985572e9c0 20 remove_watcher() i=6 2024-09-12T18:19:26.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.121+0000 7f985572e9c0 20 remove_watcher() i=7 2024-09-12T18:19:26.147 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 8757618268 --totp-seed 3OKGF5XWDLKX3HOMV2TP3JIYLJ76MYRKCVX2AU326IXXTFGOITT4KBUHOEY5RF2Q --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:19:26.193 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:19:26.193 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:19:26.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.229+0000 7f020896b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.229+0000 7f020896b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:26.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.229+0000 7f020896b9c0 20 realm 2024-09-12T18:19:26.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.229+0000 7f020896b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.229+0000 7f020896b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:26.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.229+0000 7f020896b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:19:26.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.229+0000 7f020896b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.229+0000 7f020896b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:26.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.229+0000 7f020896b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.233+0000 7f020896b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:26.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.233+0000 7f020896b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.233+0000 7f020896b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:19:26.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.233+0000 7f020896b9c0 20 searching for the correct realm 2024-09-12T18:19:26.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.237+0000 7f0205c70640 0 -- 172.21.15.98:0/1763190801 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x563fbcc71b40 msgr2=0x563fbcc73fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:19:26.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.245+0000 7f0205c70640 0 -- 172.21.15.98:0/1763190801 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7f0200030040 msgr2=0x7f0200030420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:19:26.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:19:26.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T18:19:26.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:19:26.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T18:19:26.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:19:26.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:19:26.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:26.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:19:26.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:19:26.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 zone default found 2024-09-12T18:19:26.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 4 Realm: () 2024-09-12T18:19:26.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T18:19:26.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T18:19:26.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:19:26.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 zonegroup default 2024-09-12T18:19:26.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:26.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:26.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:19:26.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 started sync module instance, tier type = 2024-09-12T18:19:26.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.253+0000 7f020896b9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T18:19:26.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.269+0000 7f020896b9c0 20 add_watcher() i=0 2024-09-12T18:19:26.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.269+0000 7f020896b9c0 20 add_watcher() i=1 2024-09-12T18:19:26.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.269+0000 7f020896b9c0 20 add_watcher() i=2 2024-09-12T18:19:26.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.269+0000 7f020896b9c0 20 add_watcher() i=3 2024-09-12T18:19:26.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.269+0000 7f020896b9c0 20 add_watcher() i=4 2024-09-12T18:19:26.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.269+0000 7f020896b9c0 20 add_watcher() i=5 2024-09-12T18:19:26.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.269+0000 7f020896b9c0 20 add_watcher() i=6 2024-09-12T18:19:26.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.273+0000 7f020896b9c0 20 add_watcher() i=7 2024-09-12T18:19:26.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.273+0000 7f020896b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:19:26.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.273+0000 7f00bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:26.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.273+0000 7f020896b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:19:26.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.273+0000 7f020896b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:19:26.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.273+0000 7f020896b9c0 5 note: GC not initialized 2024-09-12T18:19:26.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.273+0000 7f00377fe640 20 reqs_thread_entry: start 2024-09-12T18:19:26.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.273+0000 7f020896b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:19:26.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.273+0000 7f020896b9c0 20 Filter name: none 2024-09-12T18:19:26.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.273+0000 7f00357fa640 20 reqs_thread_entry: start 2024-09-12T18:19:26.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.273+0000 7f020896b9c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T18:19:26.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.273+0000 7f020896b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:19:26.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.277+0000 7f020896b9c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T18:19:26.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.277+0000 7f020896b9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T18:19:26.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.277+0000 7f020896b9c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:19:26.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.277+0000 7f020896b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:19:26.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.281+0000 7f020896b9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T18:19:26.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.281+0000 7f020896b9c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:19:26.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.281+0000 7f020896b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T18:19:26.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.281+0000 7f00e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268223 cookie 94831750145152 notifier 9420 bl.length()=695 2024-09-12T18:19:26.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.281+0000 7f00e9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T18:19:26.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.281+0000 7f00e9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:19:26.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.285+0000 7f00bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:19:26.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.289+0000 7f020896b9c0 20 remove_watcher() i=0 2024-09-12T18:19:26.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.289+0000 7f020896b9c0 2 removed watcher, disabling cache 2024-09-12T18:19:26.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.289+0000 7f020896b9c0 20 remove_watcher() i=1 2024-09-12T18:19:26.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.293+0000 7f020896b9c0 20 remove_watcher() i=2 2024-09-12T18:19:26.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.293+0000 7f020896b9c0 20 remove_watcher() i=3 2024-09-12T18:19:26.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.297+0000 7f020896b9c0 20 remove_watcher() i=4 2024-09-12T18:19:26.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.301+0000 7f020896b9c0 20 remove_watcher() i=5 2024-09-12T18:19:26.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.301+0000 7f020896b9c0 20 remove_watcher() i=6 2024-09-12T18:19:26.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T18:19:26.301+0000 7f020896b9c0 20 remove_watcher() i=7 2024-09-12T18:19:26.322 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T18:19:26.322 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T18:19:26.322 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T18:19:26.327 INFO:tasks.s3tests:Configuring boto... 2024-09-12T18:19:26.327 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T18:19:26.328 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T18:19:26.379 DEBUG:teuthology.orchestra.run.smithi098:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T18:19:26.552 INFO:teuthology.orchestra.run.smithi098.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T18:19:26.747 INFO:teuthology.orchestra.run.smithi098.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T18:19:27.075 INFO:teuthology.orchestra.run.smithi098.stdout:py installdeps: -rrequirements.txt 2024-09-12T18:21:20.116 INFO:teuthology.orchestra.run.smithi098.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T18:21:22.035 INFO:teuthology.orchestra.run.smithi098.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=840a0257db096bb6758c9492d1151fa3ebff12ab0ba0f5465fde82f29664e0b0,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T18:21:22.036 INFO:teuthology.orchestra.run.smithi098.stdout:py run-test-pre: PYTHONHASHSEED='679846686' 2024-09-12T18:21:22.036 INFO:teuthology.orchestra.run.smithi098.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T18:21:22.231 INFO:teuthology.orchestra.run.smithi098.stdout:============================= test session starts ============================== 2024-09-12T18:21:22.231 INFO:teuthology.orchestra.run.smithi098.stdout:platform linux -- Python 3.10.6, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T18:21:22.231 INFO:teuthology.orchestra.run.smithi098.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T18:21:22.231 INFO:teuthology.orchestra.run.smithi098.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T18:21:22.231 INFO:teuthology.orchestra.run.smithi098.stdout:configfile: pytest.ini 2024-09-12T18:21:24.037 INFO:teuthology.orchestra.run.smithi098.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T18:21:24.037 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T18:21:25.509 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T18:21:26.394 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T18:21:27.261 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T18:21:28.146 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T18:21:29.043 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T18:21:29.768 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T18:21:30.806 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T18:21:31.514 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T18:21:31.692 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T18:21:31.864 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T18:21:32.718 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T18:21:33.599 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T18:21:34.486 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T18:21:35.358 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T18:21:35.541 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T18:21:35.714 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T18:21:35.840 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T18:21:35.966 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T18:21:36.096 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T18:21:36.226 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T18:21:36.354 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T18:21:36.481 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T18:21:36.607 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T18:21:36.734 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T18:21:36.870 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T18:21:36.996 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T18:21:37.121 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T18:21:37.248 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T18:21:37.380 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T18:21:37.513 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T18:21:37.640 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T18:21:37.768 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T18:21:37.896 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T18:21:38.024 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T18:21:38.152 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T18:21:38.288 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T18:21:38.415 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T18:21:38.543 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T18:21:38.687 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T18:21:38.816 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T18:21:38.944 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T18:21:39.070 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T18:21:39.197 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T18:21:39.347 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T18:21:39.475 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T18:21:39.601 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T18:21:39.728 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T18:21:39.855 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T18:21:39.982 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T18:21:40.111 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T18:21:40.240 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T18:21:40.374 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T18:21:40.503 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T18:21:42.235 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T18:21:59.255 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T18:22:16.921 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T18:22:43.671 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T18:23:17.757 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T18:23:27.265 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T18:23:38.064 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T18:23:41.562 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T18:23:42.659 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T18:23:45.535 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T18:23:48.336 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T18:23:50.387 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T18:23:51.683 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T18:23:52.680 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T18:23:52.682 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T18:23:52.684 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T18:23:52.686 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T18:23:52.692 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T18:23:52.695 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T18:23:52.697 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T18:23:52.699 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T18:23:52.701 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T18:23:52.704 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T18:23:52.706 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T18:23:52.708 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T18:23:52.711 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T18:23:52.713 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T18:23:52.715 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T18:23:52.717 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T18:23:52.719 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T18:23:52.721 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T18:23:52.722 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T18:23:52.724 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T18:23:52.726 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T18:23:52.728 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T18:23:52.729 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T18:23:52.731 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T18:23:52.733 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T18:23:52.735 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T18:23:52.736 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T18:23:52.737 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T18:23:52.839 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T18:23:52.850 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T18:23:55.307 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T18:24:03.297 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T18:24:04.957 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T18:24:07.043 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T18:24:09.038 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T18:24:11.029 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T18:24:13.115 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T18:24:14.848 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T18:24:16.948 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T18:24:18.803 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T18:24:20.617 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T18:24:22.284 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T18:24:23.740 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T18:24:25.221 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T18:24:26.201 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T18:24:27.887 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T18:24:29.873 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T18:24:31.638 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T18:24:33.300 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T18:24:34.952 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T18:24:36.537 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T18:24:38.146 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T18:24:39.789 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T18:24:41.399 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T18:24:42.888 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T18:24:43.844 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T18:24:44.834 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T18:24:45.784 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T18:24:46.749 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T18:24:47.667 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T18:24:49.430 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T18:24:50.395 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T18:24:51.492 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T18:24:52.794 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T18:24:54.026 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T18:24:55.030 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T18:24:56.306 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T18:24:57.571 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T18:24:59.142 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T18:25:00.279 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T18:25:01.516 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T18:25:02.762 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T18:25:04.620 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T18:25:06.878 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T18:25:08.776 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T18:25:11.034 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:25:13.401 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:25:18.023 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:25:22.413 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:25:24.940 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:25:27.326 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:25:29.261 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T18:25:31.497 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T18:25:33.024 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T18:25:35.947 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T18:25:37.906 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T18:25:40.174 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T18:25:44.382 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T18:25:49.784 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T18:25:53.075 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T18:25:56.061 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T18:25:58.455 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T18:26:00.131 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T18:26:02.920 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T18:26:04.932 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T18:26:07.552 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T18:26:09.467 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T18:26:12.788 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T18:26:15.945 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T18:26:19.504 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T18:26:23.068 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T18:26:25.772 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T18:26:28.198 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T18:26:30.167 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T18:26:34.441 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T18:26:37.723 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T18:26:41.327 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T18:26:44.706 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T18:26:48.112 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T18:26:51.395 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T18:26:54.280 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T18:26:56.370 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T18:26:58.663 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T18:27:02.674 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T18:27:07.613 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T18:27:09.921 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T18:27:13.227 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T18:27:16.551 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T18:27:20.001 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T18:27:23.812 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T18:27:27.957 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T18:27:31.751 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T18:27:35.360 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T18:27:37.725 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T18:27:39.622 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T18:27:41.552 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T18:27:43.556 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T18:27:47.331 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T18:27:51.103 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T18:27:54.834 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T18:27:58.577 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T18:28:02.311 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T18:28:06.139 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T18:28:09.943 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T18:28:13.713 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T18:28:17.445 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T18:28:21.214 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T18:28:25.038 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T18:28:28.811 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T18:28:31.476 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T18:28:34.222 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T18:28:36.896 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T18:28:39.568 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T18:28:41.804 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T18:28:44.330 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T18:28:46.658 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T18:28:48.943 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T18:28:51.159 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T18:28:53.497 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T18:28:55.781 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T18:28:58.096 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T18:29:00.414 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T18:29:04.269 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T18:29:08.083 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T18:29:10.084 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T18:29:11.957 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T18:29:14.237 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T18:29:16.493 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T18:29:20.371 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T18:29:24.290 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T18:29:26.520 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T18:29:28.870 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T18:29:31.129 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T18:29:33.453 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T18:29:35.704 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T18:29:38.033 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T18:29:40.343 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T18:29:42.652 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T18:29:44.980 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T18:29:47.308 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T18:29:49.635 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T18:29:51.841 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T18:29:54.134 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T18:29:56.287 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T18:29:58.474 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T18:30:00.787 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T18:30:03.083 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T18:32:14.937 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T18:32:17.201 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T18:32:19.387 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T18:32:21.596 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T18:32:23.798 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T18:32:25.994 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T18:32:28.142 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T18:32:30.280 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T18:32:32.509 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T18:32:34.659 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T18:32:36.864 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T18:32:39.060 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T18:32:41.223 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T18:32:43.517 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T18:32:45.903 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T18:32:48.188 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T18:32:50.492 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T18:32:52.874 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T18:32:55.142 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T18:32:57.429 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:32:59.693 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:33:01.952 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:33:04.286 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T18:33:06.773 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T18:33:09.139 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T18:33:11.466 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T18:33:13.685 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T18:33:15.967 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T18:33:18.207 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T18:33:19.256 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T18:33:21.176 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T18:33:26.776 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T18:33:32.578 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T18:33:34.835 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T18:33:37.196 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T18:33:39.501 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T18:33:41.796 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T18:33:44.314 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T18:33:46.723 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T18:33:48.970 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T18:33:51.266 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T18:33:53.571 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T18:33:55.865 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T18:33:58.153 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T18:34:00.314 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T18:34:03.014 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T18:34:06.590 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T18:34:08.502 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T18:34:10.410 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T18:34:12.125 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T18:34:13.803 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T18:34:14.741 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T18:34:15.708 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T18:34:16.637 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T18:34:18.695 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T18:34:28.109 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T18:34:29.043 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T18:34:30.891 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T18:34:32.501 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T18:34:34.144 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T18:34:35.747 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T18:34:41.477 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T18:34:44.024 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T18:34:46.430 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T18:36:57.361 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T18:39:08.999 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T18:39:10.956 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T18:39:12.757 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T18:39:14.713 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T18:39:16.644 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T18:39:18.786 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T18:39:20.769 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T18:39:22.655 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T18:39:24.816 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T18:39:26.885 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T18:39:28.804 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T18:39:30.839 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T18:39:32.975 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T18:39:34.805 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T18:39:36.475 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T18:39:38.390 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T18:39:40.188 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T18:39:44.027 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T18:39:46.157 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T18:39:47.962 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T18:39:49.830 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T18:39:51.891 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T18:39:53.886 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T18:39:55.509 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T18:39:57.237 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T18:39:58.910 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T18:40:00.583 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T18:40:02.276 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T18:40:03.929 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T18:40:05.986 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T18:40:07.689 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T18:40:09.302 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T18:40:10.943 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T18:40:12.639 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T18:40:15.018 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T18:40:16.767 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T18:40:18.447 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T18:40:20.130 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T18:40:21.973 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T18:40:23.665 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T18:40:25.310 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T18:40:27.061 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T18:40:30.693 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T18:40:32.477 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T18:40:34.684 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T18:40:36.877 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T18:40:39.057 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T18:40:41.041 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T18:40:43.037 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T18:40:46.134 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T18:40:48.327 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T18:40:50.277 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T18:40:52.531 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T18:40:54.685 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T18:40:56.871 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T18:40:58.802 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T18:41:01.004 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T18:41:03.211 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T18:41:05.177 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T18:41:07.433 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T18:41:09.283 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T18:41:11.076 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T18:41:12.843 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T18:41:14.844 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T18:41:16.520 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T18:41:17.535 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T18:41:19.919 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T18:41:21.776 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T18:41:23.599 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T18:41:28.580 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T18:41:30.495 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T18:41:32.493 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T18:41:34.348 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T18:41:36.174 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T18:41:37.961 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T18:41:39.846 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T18:41:41.916 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T18:41:44.015 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T18:41:45.869 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T18:41:47.860 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T18:41:49.732 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T18:41:51.723 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T18:41:53.803 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T18:41:55.543 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T18:41:57.628 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T18:41:59.626 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T18:42:01.549 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T18:42:02.530 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T18:42:03.557 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T18:42:04.520 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T18:42:06.032 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T18:42:07.497 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T18:42:09.035 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T18:42:10.511 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T18:42:12.118 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T18:42:13.078 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T18:42:13.988 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T18:42:15.412 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T18:42:16.424 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T18:42:17.394 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T18:42:18.402 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T18:42:19.353 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T18:42:20.980 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T18:42:22.442 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T18:42:24.189 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T18:42:25.816 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T18:42:27.458 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T18:42:29.167 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T18:42:30.720 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T18:42:32.521 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T18:42:34.126 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T18:42:35.715 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T18:42:37.649 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T18:42:39.600 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T18:42:41.668 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T18:42:43.625 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T18:42:45.678 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T18:42:47.864 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T18:42:49.987 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T18:42:52.178 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T18:42:54.475 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T18:42:56.148 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T18:42:58.270 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T18:43:00.413 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T18:43:02.552 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T18:43:04.842 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T18:43:06.962 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T18:43:09.949 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T18:43:12.613 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T18:43:15.305 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T18:43:18.087 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T18:43:20.853 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T18:43:22.687 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T18:43:24.660 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T18:43:26.638 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T18:43:28.537 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T18:43:30.511 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T18:43:32.694 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T18:43:35.730 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T18:43:38.642 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T18:43:41.655 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T18:43:44.677 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T18:43:47.592 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T18:43:50.649 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T18:43:53.632 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T18:43:56.580 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T18:43:59.579 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T18:44:02.446 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T18:44:05.363 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T18:44:08.349 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T18:44:12.617 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T18:44:16.732 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T18:44:17.665 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T18:44:18.658 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T18:44:19.611 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T18:44:21.507 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T18:44:23.320 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T18:44:24.800 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T18:44:26.344 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T18:44:28.890 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T18:44:34.709 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T18:44:37.442 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T18:44:39.560 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T18:44:47.916 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T18:44:50.076 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T18:44:52.294 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T18:44:54.376 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T18:44:56.501 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T18:44:59.400 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T18:45:01.969 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T18:45:04.683 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T18:45:07.251 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T18:45:11.303 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T18:45:15.177 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T18:45:16.831 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T18:45:18.480 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T18:45:24.474 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T18:45:27.014 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T18:46:08.806 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T18:46:10.682 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T18:46:13.172 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T18:46:20.753 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T18:46:23.013 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T18:46:26.754 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T18:46:49.686 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T18:47:26.459 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T18:48:16.193 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T18:51:38.684 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T18:52:05.313 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T18:52:41.881 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T18:52:45.164 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T18:52:59.265 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T18:53:09.776 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T18:53:16.271 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T18:53:18.233 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T18:53:28.259 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T18:53:30.643 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T18:53:32.741 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T18:53:34.789 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T18:54:02.429 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T18:54:08.625 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T18:54:10.765 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T18:54:12.929 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T18:54:15.058 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T18:54:25.275 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T18:54:30.437 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T18:54:35.368 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T18:54:37.795 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T18:54:39.887 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T18:54:42.010 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T18:54:44.161 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T18:54:46.325 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T18:54:48.348 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T18:54:50.321 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T18:54:54.503 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T18:55:01.998 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T18:55:13.906 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T18:55:18.779 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T18:55:28.367 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T18:55:43.738 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T18:55:48.147 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T18:55:56.786 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T18:56:10.722 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T18:56:15.041 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T18:56:17.343 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T18:56:20.476 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T18:56:22.545 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T18:56:32.534 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T18:56:34.536 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T18:56:36.497 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T18:56:38.449 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T18:56:40.353 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T18:56:43.139 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T18:57:07.462 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T18:57:10.980 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T18:57:13.571 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T18:57:16.632 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T18:57:19.863 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T18:57:30.629 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T18:57:33.943 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T18:57:46.116 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T18:58:29.260 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T18:59:25.052 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T18:59:30.969 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T18:59:36.705 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T18:59:39.482 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T18:59:42.494 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T18:59:44.781 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T18:59:48.240 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T18:59:51.457 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T18:59:57.211 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T18:59:59.000 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T19:00:00.902 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T19:00:02.654 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T19:00:04.336 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T19:00:06.104 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T19:00:07.984 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T19:00:09.725 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T19:00:11.434 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T19:00:13.462 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T19:00:15.251 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T19:00:17.038 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T19:00:18.683 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T19:00:20.426 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T19:00:22.279 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T19:00:24.278 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T19:00:26.293 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T19:00:29.052 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T19:00:31.090 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T19:00:33.163 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T19:00:35.262 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T19:00:37.459 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T19:00:39.379 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T19:00:41.261 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T19:00:42.945 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T19:00:44.619 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T19:01:50.926 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T19:02:57.598 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T19:03:16.792 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T19:03:18.847 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T19:04:21.768 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T19:05:24.976 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T19:05:27.032 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T19:05:28.962 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T19:05:30.722 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T19:05:32.396 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T19:06:21.431 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T19:06:39.236 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T19:06:57.104 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T19:06:59.286 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T19:07:01.260 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T19:07:03.310 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T19:07:06.134 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T19:07:08.120 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T19:07:10.048 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T19:07:12.218 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T19:07:14.403 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T19:07:16.763 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T19:07:19.106 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T19:07:21.204 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T19:07:23.304 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T19:07:26.778 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T19:07:30.166 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T19:07:35.278 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T19:07:40.932 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T19:07:46.381 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T19:07:51.700 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T19:07:56.782 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T19:08:02.067 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T19:08:07.283 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T19:08:12.804 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T19:08:18.443 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T19:08:20.555 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T19:08:22.594 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T19:08:24.667 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T19:08:29.771 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T19:08:35.176 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T19:08:40.697 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T19:08:45.323 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T19:09:34.087 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T19:09:37.184 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T19:09:40.205 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T19:09:43.252 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T19:09:47.274 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T19:09:50.790 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T19:09:53.008 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T19:09:56.676 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T19:09:58.334 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T19:10:00.006 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T19:10:01.710 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T19:10:03.390 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T19:10:05.451 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T19:10:07.307 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T19:10:10.229 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T19:10:12.063 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T19:10:13.638 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T19:10:15.248 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T19:10:16.926 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T19:10:18.488 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T19:10:20.203 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T19:10:21.897 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T19:10:23.588 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T19:10:25.222 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T19:10:26.887 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T19:10:28.913 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T19:10:30.680 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T19:10:32.798 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T19:10:34.804 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T19:10:37.135 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T19:10:39.224 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T19:10:41.758 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T19:10:43.952 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T19:10:46.117 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T19:10:48.134 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T19:10:50.229 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T19:10:52.269 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T19:10:54.504 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T19:10:56.840 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T19:10:59.046 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T19:11:01.037 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T19:11:02.930 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T19:11:04.944 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T19:11:07.188 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T19:11:09.088 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T19:11:11.183 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T19:11:13.526 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T19:11:15.392 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T19:11:17.615 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T19:11:19.544 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T19:11:30.962 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T19:11:33.020 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T19:11:44.208 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T19:11:46.316 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T19:11:48.509 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T19:11:50.173 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T19:11:51.997 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T19:11:53.843 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T19:11:55.649 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T19:11:57.542 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T19:11:59.460 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T19:12:01.101 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T19:12:02.891 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T19:12:04.931 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T19:12:06.713 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T19:12:08.827 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T19:12:10.784 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T19:12:12.613 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T19:12:14.429 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T19:12:16.987 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T19:12:45.971 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T19:12:47.717 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T19:12:49.663 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T19:12:51.574 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T19:12:53.758 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T19:12:59.469 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T19:13:01.550 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T19:13:04.795 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T19:13:15.526 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T19:13:19.385 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T19:13:43.540 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T19:14:05.451 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T19:14:07.066 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T19:14:09.597 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T19:14:27.394 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T19:15:08.969 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T19:15:15.428 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T19:15:19.496 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T19:15:23.698 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T19:15:27.261 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T19:15:29.088 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T19:15:35.900 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T19:15:57.676 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T19:18:37.652 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T19:18:44.287 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T19:18:47.995 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T19:18:51.393 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T19:18:53.717 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T19:19:02.716 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T19:19:08.286 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T19:19:11.000 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T19:19:13.750 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T19:19:22.900 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T19:19:28.411 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T19:19:35.632 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T19:19:39.221 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T19:19:40.013 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T19:19:46.642 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T19:19:53.211 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T19:20:03.357 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T19:20:14.264 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T19:20:19.283 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T19:21:12.837 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T19:21:13.638 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T19:21:15.917 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T19:21:17.754 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T19:21:19.789 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T19:21:22.280 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T19:21:22.334 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T19:21:22.334 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.334 INFO:teuthology.orchestra.run.smithi098.stdout:=============================== warnings summary =============================== 2024-09-12T19:21:22.335 INFO:teuthology.orchestra.run.smithi098.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T19:21:22.335 INFO:teuthology.orchestra.run.smithi098.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T19:21:22.335 INFO:teuthology.orchestra.run.smithi098.stdout: import imp 2024-09-12T19:21:22.335 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.335 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py:120 2024-09-12T19:21:22.335 INFO:teuthology.orchestra.run.smithi098.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T19:21:22.335 INFO:teuthology.orchestra.run.smithi098.stdout: if boto_type is 'S3Connection': 2024-09-12T19:21:22.335 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.336 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_headers.py:124 2024-09-12T19:21:22.336 INFO:teuthology.orchestra.run.smithi098.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T19:21:22.336 INFO:teuthology.orchestra.run.smithi098.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T19:21:22.336 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.336 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3.py:359 2024-09-12T19:21:22.336 INFO:teuthology.orchestra.run.smithi098.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-09-12T19:21:22.336 INFO:teuthology.orchestra.run.smithi098.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T19:21:22.336 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.336 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T19:21:22.337 INFO:teuthology.orchestra.run.smithi098.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T19:21:22.337 INFO:teuthology.orchestra.run.smithi098.stdout: if k is 'BucketName': 2024-09-12T19:21:22.337 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.337 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T19:21:22.337 INFO:teuthology.orchestra.run.smithi098.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T19:21:22.337 INFO:teuthology.orchestra.run.smithi098.stdout: @pytest.mark.timeout(10) 2024-09-12T19:21:22.337 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.337 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T19:21:22.337 INFO:teuthology.orchestra.run.smithi098.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T19:21:22.337 INFO:teuthology.orchestra.run.smithi098.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T19:21:22.337 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.338 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T19:21:22.338 INFO:teuthology.orchestra.run.smithi098.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:21:22.338 INFO:teuthology.orchestra.run.smithi098.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T19:21:22.338 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.338 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T19:21:22.338 INFO:teuthology.orchestra.run.smithi098.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:21:22.338 INFO:teuthology.orchestra.run.smithi098.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T19:21:22.338 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.338 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T19:21:22.338 INFO:teuthology.orchestra.run.smithi098.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:21:22.338 INFO:teuthology.orchestra.run.smithi098.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T19:21:22.339 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.339 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T19:21:22.339 INFO:teuthology.orchestra.run.smithi098.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:21:22.339 INFO:teuthology.orchestra.run.smithi098.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T19:21:22.339 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.339 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T19:21:22.339 INFO:teuthology.orchestra.run.smithi098.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:21:22.339 INFO:teuthology.orchestra.run.smithi098.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T19:21:22.339 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.339 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T19:21:22.339 INFO:teuthology.orchestra.run.smithi098.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:21:22.340 INFO:teuthology.orchestra.run.smithi098.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T19:21:22.340 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.340 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T19:21:22.340 INFO:teuthology.orchestra.run.smithi098.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:21:22.340 INFO:teuthology.orchestra.run.smithi098.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T19:21:22.340 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.340 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T19:21:22.340 INFO:teuthology.orchestra.run.smithi098.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:21:22.340 INFO:teuthology.orchestra.run.smithi098.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T19:21:22.341 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.341 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T19:21:22.341 INFO:teuthology.orchestra.run.smithi098.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:21:22.341 INFO:teuthology.orchestra.run.smithi098.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T19:21:22.341 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.341 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T19:21:22.341 INFO:teuthology.orchestra.run.smithi098.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:21:22.341 INFO:teuthology.orchestra.run.smithi098.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T19:21:22.341 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.341 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T19:21:22.341 INFO:teuthology.orchestra.run.smithi098.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:21:22.342 INFO:teuthology.orchestra.run.smithi098.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T19:21:22.342 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.342 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-12T19:21:22.342 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-12T19:21:22.342 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-12T19:21:22.342 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-12T19:21:22.342 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-12T19:21:22.342 INFO:teuthology.orchestra.run.smithi098.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi098.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T19:21:22.342 INFO:teuthology.orchestra.run.smithi098.stdout: warnings.warn( 2024-09-12T19:21:22.342 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.342 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T19:21:22.343 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T19:21:22.343 INFO:teuthology.orchestra.run.smithi098.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:6540: DeprecationWarning: ssl.wrap_socket() is deprecated, use SSLContext.wrap_socket() 2024-09-12T19:21:22.343 INFO:teuthology.orchestra.run.smithi098.stdout: s = ssl.wrap_socket(s); 2024-09-12T19:21:22.343 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.343 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T19:21:22.343 INFO:teuthology.orchestra.run.smithi098.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T19:21:22.343 INFO:teuthology.orchestra.run.smithi098.stdout: /usr/lib/python3.10/ssl.py:1434: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated 2024-09-12T19:21:22.343 INFO:teuthology.orchestra.run.smithi098.stdout: context = SSLContext(ssl_version) 2024-09-12T19:21:22.343 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:21:22.343 INFO:teuthology.orchestra.run.smithi098.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T19:21:22.343 INFO:teuthology.orchestra.run.smithi098.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 666 warnings in 3600.10s (1:00:00) = 2024-09-12T19:21:22.529 INFO:teuthology.orchestra.run.smithi098.stdout:___________________________________ summary ____________________________________ 2024-09-12T19:21:22.529 INFO:teuthology.orchestra.run.smithi098.stdout: py: commands succeeded 2024-09-12T19:21:22.529 INFO:teuthology.orchestra.run.smithi098.stdout: congratulations :) 2024-09-12T19:21:22.567 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T19:21:22.568 DEBUG:teuthology.orchestra.run.smithi098:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T19:21:22.659 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T19:21:22.660 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T19:21:22.660 DEBUG:teuthology.orchestra.run.smithi098:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T19:21:22.666 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T19:21:22.666 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T19:21:22.853 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T19:21:22.867 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T19:21:22.867 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T19:21:22.868 DEBUG:teuthology.orchestra.run.smithi098:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T19:21:22.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T19:21:22.873 INFO:teuthology.orchestra.run.smithi098.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T19:21:22.873 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T19:21:22.919 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T19:21:22.919 DEBUG:teuthology.orchestra.run.smithi098:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T19:21:22.971 INFO:tasks.workunit:timeout=3h 2024-09-12T19:21:22.971 INFO:tasks.workunit:cleanup=True 2024-09-12T19:21:22.972 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T19:21:23.022 INFO:tasks.workunit.client.0.smithi098.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T19:22:23.363 INFO:tasks.workunit.client.0.smithi098.stderr:Updating files: 98% (12480/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T19:22:23.995 INFO:tasks.workunit.client.0.smithi098.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T19:22:23.995 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T19:22:23.995 INFO:tasks.workunit.client.0.smithi098.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T19:22:23.995 INFO:tasks.workunit.client.0.smithi098.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T19:22:23.995 INFO:tasks.workunit.client.0.smithi098.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T19:22:23.995 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T19:22:23.995 INFO:tasks.workunit.client.0.smithi098.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T19:22:23.996 INFO:tasks.workunit.client.0.smithi098.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T19:22:23.996 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T19:22:23.996 INFO:tasks.workunit.client.0.smithi098.stderr: git switch -c 2024-09-12T19:22:23.996 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T19:22:23.996 INFO:tasks.workunit.client.0.smithi098.stderr:Or undo this operation with: 2024-09-12T19:22:23.996 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T19:22:23.996 INFO:tasks.workunit.client.0.smithi098.stderr: git switch - 2024-09-12T19:22:23.996 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T19:22:23.996 INFO:tasks.workunit.client.0.smithi098.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T19:22:23.996 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T19:22:23.997 INFO:tasks.workunit.client.0.smithi098.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T19:22:24.003 DEBUG:teuthology.orchestra.run.smithi098:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T19:22:24.051 INFO:tasks.workunit.client.0.smithi098.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T19:22:24.054 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T19:22:24.054 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T19:22:24.104 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T19:22:24.155 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T19:22:24.194 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T19:22:24.195 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T19:22:24.195 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T19:22:24.235 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T19:22:24.239 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-12T19:22:24.239 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T19:22:24.287 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T19:22:24.288 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T19:22:24.288 DEBUG:teuthology.orchestra.run.smithi098:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T19:22:24.339 INFO:tasks.workunit.client.0.smithi098.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T19:22:24.340 INFO:tasks.workunit.client.0.smithi098.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T19:22:24.340 INFO:tasks.workunit.client.0.smithi098.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T19:22:27.615 INFO:tasks.workunit.client.0.smithi098.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T19:22:27.615 INFO:tasks.workunit.client.0.smithi098.stderr:++ deactivate nondestructive 2024-09-12T19:22:27.615 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -n '' ']' 2024-09-12T19:22:27.616 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -n '' ']' 2024-09-12T19:22:27.616 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T19:22:27.616 INFO:tasks.workunit.client.0.smithi098.stderr:++ hash -r 2024-09-12T19:22:27.616 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -n '' ']' 2024-09-12T19:22:27.616 INFO:tasks.workunit.client.0.smithi098.stderr:++ unset VIRTUAL_ENV 2024-09-12T19:22:27.616 INFO:tasks.workunit.client.0.smithi098.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T19:22:27.616 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T19:22:27.616 INFO:tasks.workunit.client.0.smithi098.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T19:22:27.616 INFO:tasks.workunit.client.0.smithi098.stderr:++ export VIRTUAL_ENV 2024-09-12T19:22:27.616 INFO:tasks.workunit.client.0.smithi098.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T19:22:27.616 INFO:tasks.workunit.client.0.smithi098.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T19:22:27.616 INFO:tasks.workunit.client.0.smithi098.stderr:++ export PATH 2024-09-12T19:22:27.616 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -n '' ']' 2024-09-12T19:22:27.617 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -z '' ']' 2024-09-12T19:22:27.617 INFO:tasks.workunit.client.0.smithi098.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T19:22:27.617 INFO:tasks.workunit.client.0.smithi098.stderr:++ PS1='(rgw) ' 2024-09-12T19:22:27.617 INFO:tasks.workunit.client.0.smithi098.stderr:++ export PS1 2024-09-12T19:22:27.617 INFO:tasks.workunit.client.0.smithi098.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T19:22:27.617 INFO:tasks.workunit.client.0.smithi098.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T19:22:27.617 INFO:tasks.workunit.client.0.smithi098.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T19:22:27.617 INFO:tasks.workunit.client.0.smithi098.stderr:++ hash -r 2024-09-12T19:22:27.617 INFO:tasks.workunit.client.0.smithi098.stderr:+ pip install pip --upgrade 2024-09-12T19:22:27.985 INFO:tasks.workunit.client.0.smithi098.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T19:22:28.178 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting pip 2024-09-12T19:22:28.183 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T19:22:28.217 INFO:tasks.workunit.client.0.smithi098.stdout:Installing collected packages: pip 2024-09-12T19:22:28.217 INFO:tasks.workunit.client.0.smithi098.stdout: Attempting uninstall: pip 2024-09-12T19:22:28.217 INFO:tasks.workunit.client.0.smithi098.stdout: Found existing installation: pip 22.0.2 2024-09-12T19:22:28.477 INFO:tasks.workunit.client.0.smithi098.stdout: Uninstalling pip-22.0.2: 2024-09-12T19:22:28.483 INFO:tasks.workunit.client.0.smithi098.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T19:22:29.229 INFO:tasks.workunit.client.0.smithi098.stdout:Successfully installed pip-24.2 2024-09-12T19:22:29.289 INFO:tasks.workunit.client.0.smithi098.stderr:+ pip install boto3 2024-09-12T19:22:30.261 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting boto3 2024-09-12T19:22:30.262 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T19:22:30.773 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T19:22:30.774 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T19:22:30.821 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T19:22:30.822 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T19:22:30.860 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T19:22:30.861 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T19:22:30.903 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T19:22:30.904 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T19:22:30.981 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T19:22:30.982 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T19:22:31.124 INFO:tasks.workunit.client.0.smithi098.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T19:22:31.125 INFO:tasks.workunit.client.0.smithi098.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T19:22:31.128 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T19:22:31.129 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T19:22:31.139 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T19:22:31.140 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T19:22:31.141 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T19:22:31.143 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T19:22:31.144 INFO:tasks.workunit.client.0.smithi098.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T19:22:31.214 INFO:tasks.workunit.client.0.smithi098.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T19:22:32.306 INFO:tasks.workunit.client.0.smithi098.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T19:22:32.524 INFO:tasks.workunit.client.0.smithi098.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T19:22:32.666 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T19:22:32.704 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:22:32.705 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:22:32.747 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.743+0000 7f4ad9e479c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:32.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.743+0000 7f4ad9e479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:32.749 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.743+0000 7f4ad9e479c0 20 realm 2024-09-12T19:22:32.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.743+0000 7f4ad9e479c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:32.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.743+0000 7f4ad9e479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:32.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.743+0000 7f4ad9e479c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T19:22:32.750 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.743+0000 7f4ad9e479c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:32.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.743+0000 7f4ad9e479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:32.751 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.743+0000 7f4ad9e479c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:32.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.747+0000 7f4ad9e479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:22:32.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.747+0000 7f4ad9e479c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:32.752 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.747+0000 7f4ad9e479c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T19:22:32.753 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.747+0000 7f4ad9e479c0 20 searching for the correct realm 2024-09-12T19:22:32.756 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.751+0000 7f4ad814e640 0 -- 172.21.15.98:0/749420859 >> [v2:172.21.15.98:6808/2797286459,v1:172.21.15.98:6809/2797286459] conn(0x557c91f97380 msgr2=0x557c91f99810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:22:32.762 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.759+0000 7f4ad794d640 0 -- 172.21.15.98:0/749420859 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f4acc01f3f0 msgr2=0x7f4acc01f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:22:32.770 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.763+0000 7f4ad9e479c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T19:22:32.770 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.763+0000 7f4ad9e479c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T19:22:32.770 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.763+0000 7f4ad9e479c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T19:22:32.770 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.763+0000 7f4ad9e479c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T19:22:32.770 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.763+0000 7f4ad9e479c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T19:22:32.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.763+0000 7f4ad9e479c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T19:22:32.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.763+0000 7f4ad9e479c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:32.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.763+0000 7f4ad9e479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:32.771 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.763+0000 7f4ad9e479c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:32.772 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.767+0000 7f4ad9e479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:22:32.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.767+0000 7f4ad9e479c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:32.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.767+0000 7f4ad9e479c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T19:22:32.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.767+0000 7f4ad9e479c0 20 zone default found 2024-09-12T19:22:32.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.767+0000 7f4ad9e479c0 4 Realm: () 2024-09-12T19:22:32.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.767+0000 7f4ad9e479c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T19:22:32.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.767+0000 7f4ad9e479c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T19:22:32.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.767+0000 7f4ad9e479c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T19:22:32.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.767+0000 7f4ad9e479c0 20 zonegroup default 2024-09-12T19:22:32.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.767+0000 7f4ad9e479c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:32.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.767+0000 7f4ad9e479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:32.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.767+0000 7f4ad9e479c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:32.773 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.767+0000 7f4ad9e479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:32.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.767+0000 7f4ad9e479c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:32.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.767+0000 7f4ad9e479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:32.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.767+0000 7f4ad9e479c0 20 started sync module instance, tier type = 2024-09-12T19:22:32.774 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.767+0000 7f4ad9e479c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T19:22:32.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.783+0000 7f4ad9e479c0 20 add_watcher() i=0 2024-09-12T19:22:32.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.783+0000 7f4ad9e479c0 20 add_watcher() i=1 2024-09-12T19:22:32.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.783+0000 7f4ad9e479c0 20 add_watcher() i=2 2024-09-12T19:22:32.788 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.783+0000 7f4ad9e479c0 20 add_watcher() i=3 2024-09-12T19:22:32.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.783+0000 7f4ad9e479c0 20 add_watcher() i=4 2024-09-12T19:22:32.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.783+0000 7f4ad9e479c0 20 add_watcher() i=5 2024-09-12T19:22:32.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.783+0000 7f4ad9e479c0 20 add_watcher() i=6 2024-09-12T19:22:32.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.783+0000 7f4ad9e479c0 20 add_watcher() i=7 2024-09-12T19:22:32.789 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.783+0000 7f4ad9e479c0 2 all 8 watchers are set, enabling cache 2024-09-12T19:22:32.792 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.787+0000 7f498dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:22:32.792 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.787+0000 7f4ad9e479c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T19:22:32.792 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.787+0000 7f4ad9e479c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T19:22:32.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.787+0000 7f4ad9e479c0 5 note: GC not initialized 2024-09-12T19:22:32.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.787+0000 7f498cfe1640 20 reqs_thread_entry: start 2024-09-12T19:22:32.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.787+0000 7f4ad9e479c0 20 init_complete bucket index max shards: 11 2024-09-12T19:22:32.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.787+0000 7f4ad9e479c0 20 Filter name: none 2024-09-12T19:22:32.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.787+0000 7f49067fc640 20 reqs_thread_entry: start 2024-09-12T19:22:32.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.787+0000 7f4ad9e479c0 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T19:22:32.793 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.787+0000 7f4ad9e479c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:32.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.787+0000 7f4ad9e479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:32.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.787+0000 7f4ad9e479c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T19:22:32.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.787+0000 7f4ad9e479c0 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T19:22:32.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.787+0000 7f4ad9e479c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T19:22:32.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.787+0000 7f4ad9e479c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:32.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.787+0000 7f4ad9e479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:32.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.787+0000 7f4ad9e479c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T19:22:32.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.787+0000 7f4ad9e479c0 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T19:22:32.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.787+0000 7f4ad9e479c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T19:22:32.794 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.787+0000 7f4ad9e479c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T19:22:32.796 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.791+0000 7f4ad9e479c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T19:22:32.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.791+0000 7f4ad9e479c0 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T19:22:32.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.791+0000 7f4ad9e479c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T19:22:32.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.791+0000 7f49b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268294 cookie 93993513416080 notifier 8657 bl.length()=613 2024-09-12T19:22:32.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.791+0000 7f49b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T19:22:32.797 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.791+0000 7f49b6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T19:22:32.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.795+0000 7f4ad9e479c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T19:22:32.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.795+0000 7f4ad9e479c0 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T19:22:32.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.795+0000 7f4ad9e479c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T19:22:32.801 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.795+0000 7f49b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756269355 cookie 93993513413408 notifier 8657 bl.length()=191 2024-09-12T19:22:32.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.795+0000 7f49b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T19:22:32.802 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.795+0000 7f49b6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T19:22:32.803 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.799+0000 7f498dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:22:32.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.803+0000 7f4ad9e479c0 20 remove_watcher() i=0 2024-09-12T19:22:32.809 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.803+0000 7f4ad9e479c0 2 removed watcher, disabling cache 2024-09-12T19:22:32.811 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.807+0000 7f4ad9e479c0 20 remove_watcher() i=1 2024-09-12T19:22:32.813 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.807+0000 7f4ad9e479c0 20 remove_watcher() i=2 2024-09-12T19:22:32.815 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.811+0000 7f4ad9e479c0 20 remove_watcher() i=3 2024-09-12T19:22:32.817 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.811+0000 7f4ad9e479c0 20 remove_watcher() i=4 2024-09-12T19:22:32.818 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.815+0000 7f4ad9e479c0 20 remove_watcher() i=5 2024-09-12T19:22:32.820 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.815+0000 7f4ad9e479c0 20 remove_watcher() i=6 2024-09-12T19:22:32.821 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:32.815+0000 7f4ad9e479c0 20 remove_watcher() i=7 2024-09-12T19:22:33.053 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:33.053 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:33.123 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:33.123 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:33.220 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:33.221 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:33.341 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:33.341 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:33.419 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T19:22:33.419 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T19:22:33.428 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:33.429 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:33.533 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:33.533 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:33.632 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:33.632 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:33.748 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T19:22:33.780 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:22:33.781 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:22:33.828 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:33.823+0000 7f52d873a9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:33.830 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:33.827+0000 7f52d873a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:33.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:33.827+0000 7f52d873a9c0 20 realm 2024-09-12T19:22:33.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:33.827+0000 7f52d873a9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:33.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:33.827+0000 7f52d873a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:33.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:33.827+0000 7f52d873a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T19:22:33.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:33.827+0000 7f52d873a9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:33.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:33.827+0000 7f52d873a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:33.831 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:33.827+0000 7f52d873a9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:33.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:33.827+0000 7f52d873a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:22:33.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:33.827+0000 7f52d873a9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:33.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:33.827+0000 7f52d873a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T19:22:33.833 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:33.827+0000 7f52d873a9c0 20 searching for the correct realm 2024-09-12T19:22:33.838 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:33.835+0000 7f52d6a41640 0 -- 172.21.15.98:0/1307673899 >> [v2:172.21.15.187:6808/1025052779,v1:172.21.15.187:6809/1025052779] conn(0x7f52cc0911e0 msgr2=0x7f52cc062220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:22:33.844 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:33.839+0000 7f52d6240640 0 -- 172.21.15.98:0/1307673899 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f52cc08ae60 msgr2=0x7f52cc061920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:22:34.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.055+0000 7f52d873a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T19:22:34.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.055+0000 7f52d873a9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T19:22:34.061 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.055+0000 7f52d873a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T19:22:34.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.055+0000 7f52d873a9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T19:22:34.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.055+0000 7f52d873a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T19:22:34.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.055+0000 7f52d873a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T19:22:34.062 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.055+0000 7f52d873a9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:34.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.059+0000 7f52d873a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:34.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.059+0000 7f52d873a9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:34.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.059+0000 7f52d873a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:22:34.063 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.059+0000 7f52d873a9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:34.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.059+0000 7f52d873a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T19:22:34.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.059+0000 7f52d873a9c0 20 zone default found 2024-09-12T19:22:34.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.059+0000 7f52d873a9c0 4 Realm: () 2024-09-12T19:22:34.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.059+0000 7f52d873a9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T19:22:34.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.059+0000 7f52d873a9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T19:22:34.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.059+0000 7f52d873a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T19:22:34.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.059+0000 7f52d873a9c0 20 zonegroup default 2024-09-12T19:22:34.064 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.059+0000 7f52d873a9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:34.065 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.059+0000 7f52d873a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:34.065 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.059+0000 7f52d873a9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:34.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.063+0000 7f52d873a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:34.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.063+0000 7f52d873a9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:34.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.063+0000 7f52d873a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:34.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.063+0000 7f52d873a9c0 20 started sync module instance, tier type = 2024-09-12T19:22:34.066 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.063+0000 7f52d873a9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T19:22:34.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.083+0000 7f52d873a9c0 20 add_watcher() i=0 2024-09-12T19:22:34.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.083+0000 7f52d873a9c0 20 add_watcher() i=1 2024-09-12T19:22:34.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.083+0000 7f52d873a9c0 20 add_watcher() i=2 2024-09-12T19:22:34.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.083+0000 7f52d873a9c0 20 add_watcher() i=3 2024-09-12T19:22:34.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.083+0000 7f52d873a9c0 20 add_watcher() i=4 2024-09-12T19:22:34.090 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.083+0000 7f52d873a9c0 20 add_watcher() i=5 2024-09-12T19:22:34.091 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.083+0000 7f52d873a9c0 20 add_watcher() i=6 2024-09-12T19:22:34.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.087+0000 7f52d873a9c0 20 add_watcher() i=7 2024-09-12T19:22:34.092 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.087+0000 7f52d873a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T19:22:34.096 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.091+0000 7f518cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:22:34.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.091+0000 7f52d873a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T19:22:34.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.091+0000 7f52d873a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T19:22:34.097 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.091+0000 7f52d873a9c0 5 note: GC not initialized 2024-09-12T19:22:34.098 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.091+0000 7f51077fe640 20 reqs_thread_entry: start 2024-09-12T19:22:34.098 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.091+0000 7f52d873a9c0 20 init_complete bucket index max shards: 11 2024-09-12T19:22:34.098 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.095+0000 7f52d873a9c0 20 Filter name: none 2024-09-12T19:22:34.098 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.095+0000 7f51057fa640 20 reqs_thread_entry: start 2024-09-12T19:22:34.098 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.095+0000 7f52d873a9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:34.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.095+0000 7f52d873a9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T19:22:34.099 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.095+0000 7f52d873a9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:34.100 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.095+0000 7f52d873a9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T19:22:34.100 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.095+0000 7f52d873a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T19:22:34.101 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.095+0000 7f52d873a9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T19:22:34.101 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.095+0000 7f52d873a9c0 20 INFO: main: starting shard=0 2024-09-12T19:22:34.101 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.095+0000 7f52d873a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.0 2024-09-12T19:22:34.102 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.095+0000 7f52d873a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:34.102 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.095+0000 7f52d873a9c0 20 INFO: main: starting shard=1 2024-09-12T19:22:34.102 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.095+0000 7f52d873a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.1 2024-09-12T19:22:34.102 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.099+0000 7f52d873a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:34.102 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.099+0000 7f52d873a9c0 20 INFO: main: starting shard=2 2024-09-12T19:22:34.103 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.099+0000 7f52d873a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.2 2024-09-12T19:22:34.103 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.099+0000 7f52d873a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:34.103 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.099+0000 7f52d873a9c0 20 INFO: main: starting shard=3 2024-09-12T19:22:34.104 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.099+0000 7f52d873a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.3 2024-09-12T19:22:34.104 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.099+0000 7f52d873a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:34.104 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.099+0000 7f52d873a9c0 20 INFO: main: starting shard=4 2024-09-12T19:22:34.104 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.099+0000 7f52d873a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.4 2024-09-12T19:22:34.105 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.099+0000 7f52d873a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:34.105 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.099+0000 7f52d873a9c0 20 INFO: main: starting shard=5 2024-09-12T19:22:34.105 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.099+0000 7f52d873a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.5 2024-09-12T19:22:34.106 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.103+0000 7f52d873a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:34.106 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.103+0000 7f52d873a9c0 20 INFO: main: starting shard=6 2024-09-12T19:22:34.107 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.103+0000 7f52d873a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.6 2024-09-12T19:22:34.107 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.103+0000 7f52d873a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:34.107 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.103+0000 7f52d873a9c0 20 INFO: main: starting shard=7 2024-09-12T19:22:34.108 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.103+0000 7f52d873a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.7 2024-09-12T19:22:34.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.103+0000 7f52d873a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:34.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.103+0000 7f52d873a9c0 20 INFO: main: starting shard=8 2024-09-12T19:22:34.109 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.103+0000 7f52d873a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.8 2024-09-12T19:22:34.110 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.107+0000 7f52d873a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:34.110 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.107+0000 7f52d873a9c0 20 INFO: main: starting shard=9 2024-09-12T19:22:34.110 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.107+0000 7f52d873a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.9 2024-09-12T19:22:34.111 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.107+0000 7f52d873a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:34.111 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.107+0000 7f52d873a9c0 20 INFO: main: starting shard=10 2024-09-12T19:22:34.111 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.107+0000 7f52d873a9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.10 2024-09-12T19:22:34.112 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.107+0000 7f52d873a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:34.112 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.107+0000 7f52d873a9c0 20 INFO: main: done 2024-09-12T19:22:34.114 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.111+0000 7f518cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:22:34.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.115+0000 7f52d873a9c0 20 remove_watcher() i=0 2024-09-12T19:22:34.118 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.115+0000 7f52d873a9c0 2 removed watcher, disabling cache 2024-09-12T19:22:34.121 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.115+0000 7f52d873a9c0 20 remove_watcher() i=1 2024-09-12T19:22:34.123 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.119+0000 7f52d873a9c0 20 remove_watcher() i=2 2024-09-12T19:22:34.125 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.119+0000 7f52d873a9c0 20 remove_watcher() i=3 2024-09-12T19:22:34.127 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.123+0000 7f52d873a9c0 20 remove_watcher() i=4 2024-09-12T19:22:34.128 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.123+0000 7f52d873a9c0 20 remove_watcher() i=5 2024-09-12T19:22:34.130 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.127+0000 7f52d873a9c0 20 remove_watcher() i=6 2024-09-12T19:22:34.131 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.127+0000 7f52d873a9c0 20 remove_watcher() i=7 2024-09-12T19:22:34.148 INFO:tasks.workunit.client.0.smithi098.stderr:rados -p default.rgw.buckets.data ls | grep 1c85e3f5-8786-44ad-8b18-66ae76b7d27f 2024-09-12T19:22:34.176 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:22:34.176 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:22:34.320 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:34.315+0000 7f5cf562e640 0 -- 172.21.15.98:0/3401154087 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f5ce0004050 msgr2=0x7f5ce001d6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T19:22:34.373 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T19:22:34.373 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T19:22:34.373 INFO:tasks.workunit.client.0.smithi098.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T19:22:35.815 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:35.815 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:35.892 INFO:tasks.workunit.client.0.smithi098.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T19:22:36.352 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T19:22:36.382 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:22:36.382 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:22:36.425 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.419+0000 7fe1d029d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:36.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.423+0000 7fe1d029d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:36.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.423+0000 7fe1d029d9c0 20 realm 2024-09-12T19:22:36.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.423+0000 7fe1d029d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:36.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.423+0000 7fe1d029d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:36.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.423+0000 7fe1d029d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T19:22:36.427 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.423+0000 7fe1d029d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:36.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.423+0000 7fe1d029d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:36.428 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.423+0000 7fe1d029d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:36.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.423+0000 7fe1d029d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:22:36.429 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.423+0000 7fe1d029d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:36.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.423+0000 7fe1d029d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T19:22:36.430 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.423+0000 7fe1d029d9c0 20 searching for the correct realm 2024-09-12T19:22:36.433 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.427+0000 7fe1c55a2640 0 -- 172.21.15.98:0/4087630622 >> [v2:172.21.15.187:6800/2100658905,v1:172.21.15.187:6801/2100658905] conn(0x7fe1c0113030 msgr2=0x7fe1c00f63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:22:36.647 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.643+0000 7fe1cdda3640 0 -- 172.21.15.98:0/4087630622 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fe1b800d350 msgr2=0x7fe1b80917a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T19:22:36.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.863+0000 7fe1d029d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T19:22:36.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.863+0000 7fe1d029d9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T19:22:36.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.863+0000 7fe1d029d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T19:22:36.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.863+0000 7fe1d029d9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T19:22:36.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.863+0000 7fe1d029d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T19:22:36.868 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.863+0000 7fe1d029d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T19:22:36.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.863+0000 7fe1d029d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:36.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.863+0000 7fe1d029d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:36.869 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.863+0000 7fe1d029d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:36.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.863+0000 7fe1d029d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:22:36.870 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.863+0000 7fe1d029d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:36.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.867+0000 7fe1d029d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T19:22:36.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.867+0000 7fe1d029d9c0 20 zone default found 2024-09-12T19:22:36.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.867+0000 7fe1d029d9c0 4 Realm: () 2024-09-12T19:22:36.871 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.867+0000 7fe1d029d9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T19:22:36.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.867+0000 7fe1d029d9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T19:22:36.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.867+0000 7fe1d029d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T19:22:36.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.867+0000 7fe1d029d9c0 20 zonegroup default 2024-09-12T19:22:36.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.867+0000 7fe1d029d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:36.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.867+0000 7fe1d029d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:36.872 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.867+0000 7fe1d029d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:36.873 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.867+0000 7fe1d029d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:36.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.867+0000 7fe1d029d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:36.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.867+0000 7fe1d029d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:36.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.867+0000 7fe1d029d9c0 20 started sync module instance, tier type = 2024-09-12T19:22:36.874 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.867+0000 7fe1d029d9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T19:22:36.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.891+0000 7fe1d029d9c0 20 add_watcher() i=0 2024-09-12T19:22:36.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.891+0000 7fe1d029d9c0 20 add_watcher() i=1 2024-09-12T19:22:36.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.891+0000 7fe1d029d9c0 20 add_watcher() i=2 2024-09-12T19:22:36.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.891+0000 7fe1d029d9c0 20 add_watcher() i=3 2024-09-12T19:22:36.898 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.891+0000 7fe1d029d9c0 20 add_watcher() i=4 2024-09-12T19:22:36.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.891+0000 7fe1d029d9c0 20 add_watcher() i=5 2024-09-12T19:22:36.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.891+0000 7fe1d029d9c0 20 add_watcher() i=6 2024-09-12T19:22:36.899 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.895+0000 7fe1d029d9c0 20 add_watcher() i=7 2024-09-12T19:22:36.900 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.895+0000 7fe1d029d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T19:22:36.904 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.899+0000 7fe07f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:22:36.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.899+0000 7fe1d029d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T19:22:36.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.899+0000 7fe1d029d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T19:22:36.905 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.899+0000 7fe1d029d9c0 5 note: GC not initialized 2024-09-12T19:22:36.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.899+0000 7fe07e7fc640 20 reqs_thread_entry: start 2024-09-12T19:22:36.906 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.899+0000 7fe1d029d9c0 20 init_complete bucket index max shards: 11 2024-09-12T19:22:36.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.899+0000 7fe1d029d9c0 20 Filter name: none 2024-09-12T19:22:36.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.899+0000 7fdfeffff640 20 reqs_thread_entry: start 2024-09-12T19:22:36.907 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.903+0000 7fe1d029d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:36.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.903+0000 7fe1d029d9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T19:22:36.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.903+0000 7fe1d029d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:36.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.903+0000 7fe1d029d9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T19:22:36.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.903+0000 7fe1d029d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T19:22:36.909 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.903+0000 7fe1d029d9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T19:22:36.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.903+0000 7fe1d029d9c0 20 INFO: main: starting shard=0 2024-09-12T19:22:36.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.903+0000 7fe1d029d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.0 2024-09-12T19:22:36.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.903+0000 7fe1d029d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:36.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.903+0000 7fe1d029d9c0 20 INFO: main: starting shard=1 2024-09-12T19:22:36.910 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.903+0000 7fe1d029d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.1 2024-09-12T19:22:36.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.907+0000 7fe1d029d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:36.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.907+0000 7fe1d029d9c0 20 INFO: main: starting shard=2 2024-09-12T19:22:36.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.907+0000 7fe1d029d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.2 2024-09-12T19:22:36.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.907+0000 7fe1d029d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:36.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.907+0000 7fe1d029d9c0 20 INFO: main: starting shard=3 2024-09-12T19:22:36.911 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.907+0000 7fe1d029d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.3 2024-09-12T19:22:36.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.907+0000 7fe1d029d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:36.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.907+0000 7fe1d029d9c0 20 INFO: main: starting shard=4 2024-09-12T19:22:36.912 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.907+0000 7fe1d029d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.4 2024-09-12T19:22:36.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.907+0000 7fe1d029d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:36.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.907+0000 7fe1d029d9c0 20 INFO: main: starting shard=5 2024-09-12T19:22:36.913 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.907+0000 7fe1d029d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.5 2024-09-12T19:22:36.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.911+0000 7fe1d029d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:36.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.911+0000 7fe1d029d9c0 20 INFO: main: starting shard=6 2024-09-12T19:22:36.915 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.911+0000 7fe1d029d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.6 2024-09-12T19:22:36.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.911+0000 7fe1d029d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:36.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.911+0000 7fe1d029d9c0 20 INFO: main: starting shard=7 2024-09-12T19:22:36.916 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.911+0000 7fe1d029d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.7 2024-09-12T19:22:36.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.911+0000 7fe1d029d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:36.917 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.911+0000 7fe1d029d9c0 20 INFO: main: starting shard=8 2024-09-12T19:22:36.918 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.911+0000 7fe1d029d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.8 2024-09-12T19:22:36.919 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.915+0000 7fe1d029d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:36.919 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.915+0000 7fe1d029d9c0 20 INFO: main: starting shard=9 2024-09-12T19:22:36.919 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.915+0000 7fe1d029d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.9 2024-09-12T19:22:36.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.915+0000 7fe1d029d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:36.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.915+0000 7fe1d029d9c0 20 INFO: main: starting shard=10 2024-09-12T19:22:36.920 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.915+0000 7fe1d029d9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.10 2024-09-12T19:22:36.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.915+0000 7fe1d029d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:22:36.921 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.915+0000 7fe1d029d9c0 20 INFO: main: done 2024-09-12T19:22:36.923 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.919+0000 7fe07f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:22:36.928 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.923+0000 7fe1d029d9c0 20 remove_watcher() i=0 2024-09-12T19:22:36.928 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.923+0000 7fe1d029d9c0 2 removed watcher, disabling cache 2024-09-12T19:22:36.930 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.927+0000 7fe1d029d9c0 20 remove_watcher() i=1 2024-09-12T19:22:36.932 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.927+0000 7fe1d029d9c0 20 remove_watcher() i=2 2024-09-12T19:22:36.934 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.931+0000 7fe1d029d9c0 20 remove_watcher() i=3 2024-09-12T19:22:36.936 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.931+0000 7fe1d029d9c0 20 remove_watcher() i=4 2024-09-12T19:22:36.938 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.935+0000 7fe1d029d9c0 20 remove_watcher() i=5 2024-09-12T19:22:36.940 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.935+0000 7fe1d029d9c0 20 remove_watcher() i=6 2024-09-12T19:22:36.941 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:36.935+0000 7fe1d029d9c0 20 remove_watcher() i=7 2024-09-12T19:22:36.957 INFO:tasks.workunit.client.0.smithi098.stderr:rados -p default.rgw.buckets.data ls | grep 6d507045-0a25-475d-a8fd-0ac7538ed78d 2024-09-12T19:22:36.984 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:22:36.984 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:22:37.112 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:37.107+0000 7fe342dd5640 0 -- 172.21.15.98:0/2626818179 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7fe338006340 msgr2=0x7fe338006720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:22:37.156 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T19:22:37.156 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T19:22:37.159 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:37.159 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:37.237 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:37.237 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:37.326 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:37.326 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:37.404 INFO:tasks.workunit.client.0.smithi098.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T19:22:38.851 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:38.851 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:39.031 INFO:tasks.workunit.client.0.smithi098.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T19:22:39.031 INFO:tasks.workunit.client.0.smithi098.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T19:22:39.470 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:39.470 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:39.637 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:39.637 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:39.712 INFO:tasks.workunit.client.0.smithi098.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T19:22:39.712 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-12T19:22:39.716 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:39.716 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:39.846 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:39.846 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:40.019 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:40.019 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:40.117 INFO:tasks.workunit.client.0.smithi098.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T19:22:41.560 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:41.560 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:41.694 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:41.695 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:43.856 INFO:tasks.workunit.client.0.smithi098.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T19:22:44.299 INFO:tasks.workunit.client.0.smithi098.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T19:22:44.330 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:22:44.331 INFO:tasks.workunit.client.0.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:22:44.374 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.366+0000 7f15396ff9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:44.374 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.370+0000 7f15396ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:44.374 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.370+0000 7f15396ff9c0 20 realm 2024-09-12T19:22:44.374 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.370+0000 7f15396ff9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:44.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.370+0000 7f15396ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:44.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.370+0000 7f15396ff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T19:22:44.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.370+0000 7f15396ff9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:44.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.370+0000 7f15396ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:44.375 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.370+0000 7f15396ff9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:44.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.370+0000 7f15396ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:22:44.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.370+0000 7f15396ff9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:44.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.370+0000 7f15396ff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T19:22:44.377 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.370+0000 7f15396ff9c0 20 searching for the correct realm 2024-09-12T19:22:44.384 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.378+0000 7f1537a06640 0 -- 172.21.15.98:0/3013621950 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f152c1242d0 msgr2=0x7f152c1017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:22:44.600 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.594+0000 7f1537205640 0 -- 172.21.15.98:0/3013621950 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x55e199d61980 msgr2=0x55e199d63d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:22:44.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.602+0000 7f15396ff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T19:22:44.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.602+0000 7f15396ff9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T19:22:44.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.602+0000 7f15396ff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T19:22:44.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.602+0000 7f15396ff9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T19:22:44.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.602+0000 7f15396ff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T19:22:44.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.602+0000 7f15396ff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T19:22:44.608 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.602+0000 7f15396ff9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:44.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.602+0000 7f15396ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:44.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.602+0000 7f15396ff9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:44.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.602+0000 7f15396ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:22:44.609 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.602+0000 7f15396ff9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:44.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.606+0000 7f15396ff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T19:22:44.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.606+0000 7f15396ff9c0 20 zone default found 2024-09-12T19:22:44.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.606+0000 7f15396ff9c0 4 Realm: () 2024-09-12T19:22:44.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.606+0000 7f15396ff9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T19:22:44.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.606+0000 7f15396ff9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T19:22:44.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.606+0000 7f15396ff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T19:22:44.610 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.606+0000 7f15396ff9c0 20 zonegroup default 2024-09-12T19:22:44.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.606+0000 7f15396ff9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:44.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.606+0000 7f15396ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:44.611 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.606+0000 7f15396ff9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:44.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.606+0000 7f15396ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:44.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.606+0000 7f15396ff9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:44.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.606+0000 7f15396ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:44.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.606+0000 7f15396ff9c0 20 started sync module instance, tier type = 2024-09-12T19:22:44.612 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.606+0000 7f15396ff9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T19:22:44.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.626+0000 7f15396ff9c0 20 add_watcher() i=0 2024-09-12T19:22:44.633 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.626+0000 7f15396ff9c0 20 add_watcher() i=1 2024-09-12T19:22:44.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.626+0000 7f15396ff9c0 20 add_watcher() i=2 2024-09-12T19:22:44.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.626+0000 7f15396ff9c0 20 add_watcher() i=3 2024-09-12T19:22:44.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.626+0000 7f15396ff9c0 20 add_watcher() i=4 2024-09-12T19:22:44.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.626+0000 7f15396ff9c0 20 add_watcher() i=5 2024-09-12T19:22:44.634 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.626+0000 7f15396ff9c0 20 add_watcher() i=6 2024-09-12T19:22:44.635 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.630+0000 7f15396ff9c0 20 add_watcher() i=7 2024-09-12T19:22:44.636 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.630+0000 7f15396ff9c0 2 all 8 watchers are set, enabling cache 2024-09-12T19:22:44.641 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.634+0000 7f13edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:22:44.641 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.634+0000 7f15396ff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T19:22:44.641 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.634+0000 7f15396ff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T19:22:44.641 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.634+0000 7f15396ff9c0 5 note: GC not initialized 2024-09-12T19:22:44.642 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.634+0000 7f13ecfe1640 20 reqs_thread_entry: start 2024-09-12T19:22:44.642 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.634+0000 7f15396ff9c0 20 init_complete bucket index max shards: 11 2024-09-12T19:22:44.642 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.638+0000 7f15396ff9c0 20 Filter name: none 2024-09-12T19:22:44.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.638+0000 7f13667fc640 20 reqs_thread_entry: start 2024-09-12T19:22:44.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.638+0000 7f15396ff9c0 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T19:22:44.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.638+0000 7f15396ff9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:44.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.638+0000 7f15396ff9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T19:22:44.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.638+0000 7f15396ff9c0 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T19:22:44.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.638+0000 7f15396ff9c0 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T19:22:44.643 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.638+0000 7f15396ff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.782 : miss 2024-09-12T19:22:44.644 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.638+0000 7f15396ff9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:44.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.638+0000 7f15396ff9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T19:22:44.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.638+0000 7f15396ff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.782 info.flags=0x17 2024-09-12T19:22:44.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.638+0000 7f15396ff9c0 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.782 to cache LRU end 2024-09-12T19:22:44.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.638+0000 7f15396ff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T19:22:44.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.638+0000 7f15396ff9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T19:22:44.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.638+0000 7f15396ff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:a01e4849-e968-46ce-97f1-a673c26b3735.4529.782 2024-09-12T19:22:44.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.638+0000 7f15396ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.0 2024-09-12T19:22:44.645 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.638+0000 7f15396ff9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T19:22:44.646 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.638+0000 7f15396ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.1 2024-09-12T19:22:44.647 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.642+0000 7f15396ff9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T19:22:44.647 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.642+0000 7f15396ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.2 2024-09-12T19:22:44.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.642+0000 7f15396ff9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T19:22:44.648 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.642+0000 7f15396ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.3 2024-09-12T19:22:44.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.642+0000 7f15396ff9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T19:22:44.649 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.642+0000 7f15396ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.4 2024-09-12T19:22:44.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.646+0000 7f15396ff9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T19:22:44.650 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.646+0000 7f15396ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.5 2024-09-12T19:22:44.651 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.646+0000 7f15396ff9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T19:22:44.652 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.646+0000 7f15396ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.6 2024-09-12T19:22:44.652 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.646+0000 7f15396ff9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T19:22:44.652 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.646+0000 7f15396ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.7 2024-09-12T19:22:44.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.646+0000 7f15396ff9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T19:22:44.653 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.646+0000 7f15396ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.8 2024-09-12T19:22:44.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.650+0000 7f15396ff9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T19:22:44.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.650+0000 7f15396ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.9 2024-09-12T19:22:44.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.650+0000 7f15396ff9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T19:22:44.655 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.650+0000 7f15396ff9c0 20 bucket index object: :.dir.a01e4849-e968-46ce-97f1-a673c26b3735.4529.782.10 2024-09-12T19:22:44.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.650+0000 7f15396ff9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T19:22:44.657 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.650+0000 7f15396ff9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T19:22:44.659 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.654+0000 7f13edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:22:44.663 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.658+0000 7f15396ff9c0 20 remove_watcher() i=0 2024-09-12T19:22:44.664 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.658+0000 7f15396ff9c0 2 removed watcher, disabling cache 2024-09-12T19:22:44.666 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.662+0000 7f15396ff9c0 20 remove_watcher() i=1 2024-09-12T19:22:44.668 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.662+0000 7f15396ff9c0 20 remove_watcher() i=2 2024-09-12T19:22:44.670 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.666+0000 7f15396ff9c0 20 remove_watcher() i=3 2024-09-12T19:22:44.672 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.666+0000 7f15396ff9c0 20 remove_watcher() i=4 2024-09-12T19:22:44.674 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.670+0000 7f15396ff9c0 20 remove_watcher() i=5 2024-09-12T19:22:44.676 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.670+0000 7f15396ff9c0 20 remove_watcher() i=6 2024-09-12T19:22:44.677 INFO:tasks.workunit.client.0.smithi098.stderr:2024-09-12T19:22:44.670+0000 7f15396ff9c0 20 remove_watcher() i=7 2024-09-12T19:22:44.693 INFO:tasks.workunit.client.0.smithi098.stderr:Deleting bucket versioning-bucket 2024-09-12T19:22:44.696 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:44.696 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:44.750 INFO:tasks.workunit.client.0.smithi098.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:22:44.750 INFO:tasks.workunit.client.0.smithi098.stderr: warnings.warn( 2024-09-12T19:22:45.115 INFO:tasks.workunit.client.0.smithi098.stderr:Completed bucket versioning tests 2024-09-12T19:22:45.116 INFO:tasks.workunit.client.0.smithi098.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T19:22:45.116 INFO:tasks.workunit.client.0.smithi098.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T19:22:45.116 INFO:tasks.workunit.client.0.smithi098.stdout:connected to https://localhost:443 2024-09-12T19:22:45.206 INFO:tasks.workunit.client.0.smithi098.stderr:+ deactivate 2024-09-12T19:22:45.206 INFO:tasks.workunit.client.0.smithi098.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T19:22:45.206 INFO:tasks.workunit.client.0.smithi098.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T19:22:45.206 INFO:tasks.workunit.client.0.smithi098.stderr:+ export PATH 2024-09-12T19:22:45.206 INFO:tasks.workunit.client.0.smithi098.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T19:22:45.206 INFO:tasks.workunit.client.0.smithi098.stderr:+ '[' -n '' ']' 2024-09-12T19:22:45.207 INFO:tasks.workunit.client.0.smithi098.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T19:22:45.207 INFO:tasks.workunit.client.0.smithi098.stderr:+ hash -r 2024-09-12T19:22:45.207 INFO:tasks.workunit.client.0.smithi098.stderr:+ '[' -n '' ']' 2024-09-12T19:22:45.207 INFO:tasks.workunit.client.0.smithi098.stderr:+ unset VIRTUAL_ENV 2024-09-12T19:22:45.207 INFO:tasks.workunit.client.0.smithi098.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T19:22:45.207 INFO:tasks.workunit.client.0.smithi098.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T19:22:45.207 INFO:tasks.workunit.client.0.smithi098.stderr:+ unset -f deactivate 2024-09-12T19:22:45.207 INFO:tasks.workunit.client.0.smithi098.stderr:+ echo OK. 2024-09-12T19:22:45.208 INFO:tasks.workunit.client.0.smithi098.stdout:OK. 2024-09-12T19:22:45.208 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T19:22:45.209 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T19:22:45.264 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T19:22:45.264 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T19:22:45.656 DEBUG:teuthology.parallel:result is None 2024-09-12T19:22:45.657 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T19:22:45.669 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T19:22:45.669 DEBUG:teuthology.orchestra.run.smithi098:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T19:22:45.714 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T19:22:45.714 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T19:22:45.725 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T19:22:45.734 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T19:22:45.734 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T19:22:45.735 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T19:22:45.811 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T19:22:45.812 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T19:22:45.842 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:22:45.842 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:22:45.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:45.878+0000 7fc1567639c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:45.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:45.878+0000 7fc1567639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:45.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:45.878+0000 7fc1567639c0 20 realm 2024-09-12T19:22:45.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:45.878+0000 7fc1567639c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:45.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:45.878+0000 7fc1567639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:45.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:45.878+0000 7fc1567639c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T19:22:45.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:45.878+0000 7fc1567639c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:45.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:45.878+0000 7fc1567639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:45.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:45.878+0000 7fc1567639c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:45.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:45.878+0000 7fc1567639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:22:45.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:45.878+0000 7fc1567639c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:45.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:45.878+0000 7fc1567639c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T19:22:45.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:45.878+0000 7fc1567639c0 20 searching for the correct realm 2024-09-12T19:22:45.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:45.886+0000 7fc154a6a640 0 -- 172.21.15.98:0/1278685871 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7fc13c043910 msgr2=0x7fc13c0273d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T19:22:46.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.102+0000 7fc154269640 0 -- 172.21.15.98:0/1278685871 >> [v2:172.21.15.187:6824/2426426364,v1:172.21.15.187:6825/2426426364] conn(0x5636df70e5a0 msgr2=0x5636df7109b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:22:46.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T19:22:46.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T19:22:46.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T19:22:46.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T19:22:46.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T19:22:46.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T19:22:46.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:46.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:46.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:46.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:22:46.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:46.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T19:22:46.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 20 zone default found 2024-09-12T19:22:46.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 4 Realm: () 2024-09-12T19:22:46.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T19:22:46.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T19:22:46.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T19:22:46.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 20 zonegroup default 2024-09-12T19:22:46.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:46.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:46.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.114+0000 7fc1567639c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:46.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.118+0000 7fc1567639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:46.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.118+0000 7fc1567639c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:46.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.118+0000 7fc1567639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:46.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.118+0000 7fc1567639c0 20 started sync module instance, tier type = 2024-09-12T19:22:46.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.118+0000 7fc1567639c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T19:22:46.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.146+0000 7fc1567639c0 20 add_watcher() i=0 2024-09-12T19:22:46.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.146+0000 7fc1567639c0 20 add_watcher() i=1 2024-09-12T19:22:46.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.146+0000 7fc1567639c0 20 add_watcher() i=2 2024-09-12T19:22:46.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.146+0000 7fc1567639c0 20 add_watcher() i=3 2024-09-12T19:22:46.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.146+0000 7fc1567639c0 20 add_watcher() i=4 2024-09-12T19:22:46.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.146+0000 7fc1567639c0 20 add_watcher() i=5 2024-09-12T19:22:46.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.146+0000 7fc1567639c0 20 add_watcher() i=6 2024-09-12T19:22:46.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.146+0000 7fc1567639c0 20 add_watcher() i=7 2024-09-12T19:22:46.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.146+0000 7fc1567639c0 2 all 8 watchers are set, enabling cache 2024-09-12T19:22:46.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.154+0000 7fc00afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:22:46.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.154+0000 7fc1567639c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T19:22:46.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.154+0000 7fc1567639c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T19:22:46.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.246+0000 7fc009fdb640 20 reqs_thread_entry: start 2024-09-12T19:22:46.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.246+0000 7fc1567639c0 20 init_complete bucket index max shards: 11 2024-09-12T19:22:46.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.246+0000 7fc1567639c0 20 Filter name: none 2024-09-12T19:22:46.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.246+0000 7fbf7b7fe640 20 reqs_thread_entry: start 2024-09-12T19:22:46.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.246+0000 7fc1567639c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T19:22:46.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.246+0000 7fc1567639c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:46.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.246+0000 7fc1567639c0 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T19:22:46.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.246+0000 7fc1567639c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T19:22:46.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.246+0000 7fc1567639c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T19:22:46.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.246+0000 7fc1567639c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T19:22:46.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.250+0000 7fc1567639c0 10 removing key index: WEMGIJJQYUXWFNNOXISF 2024-09-12T19:22:46.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.254+0000 7fc1567639c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:WEMGIJJQYUXWFNNOXISF, ofs0, ns] 2024-09-12T19:22:46.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.254+0000 7fc02b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756269333 cookie 94793676968016 notifier 8759 bl.length()=170 2024-09-12T19:22:46.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.254+0000 7fc1567639c0 10 removing email index: tester.client.0_test@test.test 2024-09-12T19:22:46.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.258+0000 7fc1567639c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T19:22:46.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.258+0000 7fc02b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756269334 cookie 94793676968016 notifier 8759 bl.length()=181 2024-09-12T19:22:46.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.258+0000 7fc1567639c0 10 removing user buckets index 2024-09-12T19:22:46.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.262+0000 7fc1567639c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T19:22:46.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.262+0000 7fc02affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268295 cookie 94793676983312 notifier 8759 bl.length()=172 2024-09-12T19:22:46.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.266+0000 7fc1567639c0 10 removing user index: tester.client.0 2024-09-12T19:22:46.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.270+0000 7fc1567639c0 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T19:22:46.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.270+0000 7fc1567639c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T19:22:46.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.270+0000 7fc02affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756269358 cookie 94793676981776 notifier 8759 bl.length()=164 2024-09-12T19:22:46.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.274+0000 7fc00afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:22:46.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.278+0000 7fc1567639c0 20 remove_watcher() i=0 2024-09-12T19:22:46.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.278+0000 7fc1567639c0 2 removed watcher, disabling cache 2024-09-12T19:22:46.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.282+0000 7fc1567639c0 20 remove_watcher() i=1 2024-09-12T19:22:46.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.282+0000 7fc1567639c0 20 remove_watcher() i=2 2024-09-12T19:22:46.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.286+0000 7fc1567639c0 20 remove_watcher() i=3 2024-09-12T19:22:46.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.286+0000 7fc1567639c0 20 remove_watcher() i=4 2024-09-12T19:22:46.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.290+0000 7fc1567639c0 20 remove_watcher() i=5 2024-09-12T19:22:46.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.290+0000 7fc1567639c0 20 remove_watcher() i=6 2024-09-12T19:22:46.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:46.294+0000 7fc1567639c0 20 remove_watcher() i=7 2024-09-12T19:22:46.314 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T19:22:46.324 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T19:22:46.334 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T19:22:46.406 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T19:22:46.416 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T19:22:46.416 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:22:46.467 INFO:tasks.rgw.client.0.smithi098.stdout:2024-09-12T19:22:46.454+0000 e571640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 39263) UID: 0 2024-09-12T19:22:46.469 INFO:tasks.rgw.client.0.smithi098.stdout:2024-09-12T19:22:46.462+0000 8ed9f80 -1 shutting down 2024-09-12T19:22:55.716 INFO:tasks.rgw.client.0.smithi098.stderr:==00:01:52:49.202 39267== could not unlink /tmp/vgdb-pipe-from-vgdb-to-39267-by-root-on-??? 2024-09-12T19:22:55.716 INFO:tasks.rgw.client.0.smithi098.stderr:==00:01:52:49.202 39267== could not unlink /tmp/vgdb-pipe-to-vgdb-from-39267-by-root-on-??? 2024-09-12T19:22:55.716 INFO:tasks.rgw.client.0.smithi098.stderr:==00:01:52:49.202 39267== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-39267-by-root-on-??? 2024-09-12T19:22:58.618 INFO:tasks.rgw.client.0:Stopped 2024-09-12T19:22:58.619 DEBUG:teuthology.orchestra.run.smithi098:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T19:22:58.625 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T19:22:58.679 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T19:22:58.733 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T19:22:58.733 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T19:22:58.733 DEBUG:teuthology.orchestra.run.smithi098:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T19:22:58.810 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:22:58.810 INFO:teuthology.orchestra.run.smithi098.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:22:58.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.842+0000 7f775ecbe9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:58.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.846+0000 7f775ecbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:58.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.846+0000 7f775ecbe9c0 20 realm 2024-09-12T19:22:58.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.846+0000 7f775ecbe9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:58.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.846+0000 7f775ecbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:58.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.846+0000 7f775ecbe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T19:22:58.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.846+0000 7f775ecbe9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:58.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.846+0000 7f775ecbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:58.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.846+0000 7f775ecbe9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:58.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.846+0000 7f775ecbe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:22:58.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.846+0000 7f775ecbe9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:58.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.846+0000 7f775ecbe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T19:22:58.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.846+0000 7f775ecbe9c0 20 searching for the correct realm 2024-09-12T19:22:58.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.854+0000 7f775bfc3640 0 -- 172.21.15.98:0/1511992613 >> [v2:172.21.15.98:6800/3702628629,v1:172.21.15.98:6801/3702628629] conn(0x5556802bdcd0 msgr2=0x5556802c00c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:22:58.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.858+0000 7f775c7c4640 0 -- 172.21.15.98:0/1511992613 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x7f7744052040 msgr2=0x7f774400c970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:22:58.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.866+0000 7f775ecbe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T19:22:58.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.866+0000 7f775ecbe9c0 20 RGWRados::pool_iterate: got zonegroup_info.32f1170b-6532-4163-be78-27315b30dcb1 2024-09-12T19:22:58.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.866+0000 7f775ecbe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T19:22:58.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.866+0000 7f775ecbe9c0 20 RGWRados::pool_iterate: got zone_info.a01e4849-e968-46ce-97f1-a673c26b3735 2024-09-12T19:22:58.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.866+0000 7f775ecbe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T19:22:58.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.866+0000 7f775ecbe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T19:22:58.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.866+0000 7f775ecbe9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:58.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.866+0000 7f775ecbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:58.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.866+0000 7f775ecbe9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:58.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.870+0000 7f775ecbe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:22:58.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.870+0000 7f775ecbe9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:58.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.870+0000 7f775ecbe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T19:22:58.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.870+0000 7f775ecbe9c0 20 zone default found 2024-09-12T19:22:58.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.870+0000 7f775ecbe9c0 4 Realm: () 2024-09-12T19:22:58.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.870+0000 7f775ecbe9c0 4 ZoneGroup: default (32f1170b-6532-4163-be78-27315b30dcb1) 2024-09-12T19:22:58.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.870+0000 7f775ecbe9c0 4 Zone: default (a01e4849-e968-46ce-97f1-a673c26b3735) 2024-09-12T19:22:58.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.870+0000 7f775ecbe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T19:22:58.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.870+0000 7f775ecbe9c0 20 zonegroup default 2024-09-12T19:22:58.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.870+0000 7f775ecbe9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:58.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.870+0000 7f775ecbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:58.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.870+0000 7f775ecbe9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:58.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.870+0000 7f775ecbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:58.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.870+0000 7f775ecbe9c0 20 rados->read ofs=0 len=0 2024-09-12T19:22:58.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.870+0000 7f775ecbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:22:58.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.870+0000 7f775ecbe9c0 20 started sync module instance, tier type = 2024-09-12T19:22:58.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.870+0000 7f775ecbe9c0 20 started zone id=a01e4849-e968-46ce-97f1-a673c26b3735 (name=default) with tier type = 2024-09-12T19:22:58.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.890+0000 7f775ecbe9c0 20 add_watcher() i=0 2024-09-12T19:22:58.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.890+0000 7f775ecbe9c0 20 add_watcher() i=1 2024-09-12T19:22:58.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.890+0000 7f775ecbe9c0 20 add_watcher() i=2 2024-09-12T19:22:58.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.890+0000 7f775ecbe9c0 20 add_watcher() i=3 2024-09-12T19:22:58.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.890+0000 7f775ecbe9c0 20 add_watcher() i=4 2024-09-12T19:22:58.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.890+0000 7f775ecbe9c0 20 add_watcher() i=5 2024-09-12T19:22:58.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.890+0000 7f775ecbe9c0 20 add_watcher() i=6 2024-09-12T19:22:58.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.894+0000 7f775ecbe9c0 20 add_watcher() i=7 2024-09-12T19:22:58.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.894+0000 7f775ecbe9c0 2 all 8 watchers are set, enabling cache 2024-09-12T19:22:58.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.898+0000 7f7612fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:22:58.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.898+0000 7f775ecbe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T19:22:58.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.898+0000 7f775ecbe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T19:22:58.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.970+0000 7f7611fdb640 20 reqs_thread_entry: start 2024-09-12T19:22:58.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.970+0000 7f775ecbe9c0 20 init_complete bucket index max shards: 11 2024-09-12T19:22:58.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.970+0000 7f775ecbe9c0 20 Filter name: none 2024-09-12T19:22:58.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.970+0000 7f75837fe640 20 reqs_thread_entry: start 2024-09-12T19:22:58.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T19:22:58.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.974+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:22:58.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.974+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:22:58.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51416' 2024-09-12T19:22:58.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15624439047909212124', time=2024-09-12T20:21:58.674355+0000, chain.objs.size()=2 2024-09-12T19:22:58.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.158__shadow_.-MW3RTCrn6gCATTL4MJ7hXN-DUk0Nvg_0 2024-09-12T19:22:58.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.158__shadow_.-MW3RTCrn6gCATTL4MJ7hXN-DUk0Nvg_1 2024-09-12T19:22:58.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6156590012476137623', time=2024-09-12T20:22:16.418633+0000, chain.objs.size()=3 2024-09-12T19:22:58.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.159__multipart_mymultipart-LUKEWARM.2~J5ai8gNQeV6NQvdHvhsSSXTNOfIPXda.1 2024-09-12T19:22:58.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.159__multipart_mymultipart-LUKEWARM.2~J5ai8gNQeV6NQvdHvhsSSXTNOfIPXda.2 2024-09-12T19:22:58.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.159__multipart_mymultipart-LUKEWARM.2~J5ai8gNQeV6NQvdHvhsSSXTNOfIPXda.3 2024-09-12T19:22:58.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14101054273278684120', time=2024-09-12T20:28:47.948032+0000, chain.objs.size()=1 2024-09-12T19:22:58.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.231__shadow_.sIUAJW8L9-k8amArIDtxtOFomBw6jdF_0 2024-09-12T19:22:58.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15238285223129136836', time=2024-09-12T20:28:54.849799+0000, chain.objs.size()=1 2024-09-12T19:22:58.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.234__shadow_.g02K3B-IT2wLdhisntQhKApYZHh8rwC_0 2024-09-12T19:22:58.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15905094024541082817', time=2024-09-12T20:29:39.394164+0000, chain.objs.size()=1 2024-09-12T19:22:58.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.251__shadow_.OT-whf_8B8Hqo-JYpXF9qlLZC4TNzjw_0 2024-09-12T19:22:58.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11369325286777478431', time=2024-09-12T20:29:50.865562+0000, chain.objs.size()=1 2024-09-12T19:22:58.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.256__shadow_.YwgCqQP-RVESswxcXYrgEnIlQtv3o1I_0 2024-09-12T19:22:58.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12642486628644819701', time=2024-09-12T20:29:53.078103+0000, chain.objs.size()=1 2024-09-12T19:22:58.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.257__shadow_.2amUsvn5is9XPqCCm2I41FEYGK7_BtO_0 2024-09-12T19:22:58.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10580248873486584442', time=2024-09-12T20:31:45.638511+0000, chain.objs.size()=1 2024-09-12T19:22:58.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.6bVaTyW9DYGMKaOzG--FmcRMyDjbVXw_0 2024-09-12T19:22:58.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17938873947662109087', time=2024-09-12T20:31:47.252695+0000, chain.objs.size()=1 2024-09-12T19:22:58.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.SEAUsrzEtuRnq5yeI8kizX1pd4hXE-R_0 2024-09-12T19:22:58.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.346698980079935374', time=2024-09-12T20:31:47.367305+0000, chain.objs.size()=1 2024-09-12T19:22:58.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.WWe1y1e2Bw1ZBlaxRG0vdJZns0PVDkt_0 2024-09-12T19:22:58.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6193785557849543103', time=2024-09-12T20:31:49.306535+0000, chain.objs.size()=1 2024-09-12T19:22:58.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.a3ex3yLYeKSgc3a4K0wqKZVZmXImv_b_0 2024-09-12T19:22:58.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.104683090036075785', time=2024-09-12T20:31:50.877595+0000, chain.objs.size()=1 2024-09-12T19:22:58.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.-rLERvMrL0B4FyJ_m_HrXqFTkxhFtX7_0 2024-09-12T19:22:58.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3628289064496604899', time=2024-09-12T20:31:51.530501+0000, chain.objs.size()=1 2024-09-12T19:22:58.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.nodiekk7JukOOgz1z5fIv5XOggNwGux_0 2024-09-12T19:22:58.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6063950508711310466', time=2024-09-12T20:31:51.728662+0000, chain.objs.size()=1 2024-09-12T19:22:58.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ujspH-tBtLuAMnTV6256ir3riHKgBI4_0 2024-09-12T19:22:58.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10725894055038310398', time=2024-09-12T20:31:53.485918+0000, chain.objs.size()=1 2024-09-12T19:22:58.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.GxO7y4ZRHhHFpNIrFzE-ukO8yJynOmf_0 2024-09-12T19:22:58.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17708834289685273428', time=2024-09-12T20:31:55.808277+0000, chain.objs.size()=1 2024-09-12T19:22:58.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.4hno0Lrp17nmARirjs4mqBFYN1WiPSV_0 2024-09-12T19:22:58.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13931950022264488413', time=2024-09-12T20:31:57.257388+0000, chain.objs.size()=1 2024-09-12T19:22:58.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ICNlWJJTQmB-zATqVT1Vmx8iP92tbnp_0 2024-09-12T19:22:58.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13201496381288215621', time=2024-09-12T20:31:57.805266+0000, chain.objs.size()=1 2024-09-12T19:22:58.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.inIBfldDLPfPHP6EbmpYWj7hHeQ_h_m_0 2024-09-12T19:22:58.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1705823852398434397', time=2024-09-12T20:31:57.992784+0000, chain.objs.size()=1 2024-09-12T19:22:58.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.TJ7USWZH15Hjrj7042RdDtHSTHM2iHR_0 2024-09-12T19:22:58.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17178150935608878344', time=2024-09-12T20:31:59.499627+0000, chain.objs.size()=1 2024-09-12T19:22:58.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:58.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.xgWA_6gwxzqiwHTN89dMiltWwU_xy7U_0 2024-09-12T19:22:59.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.002+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11311694921667232111', time=2024-09-12T20:32:00.689342+0000, chain.objs.size()=1 2024-09-12T19:22:59.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.002+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.fvnG5U7cTsqBWsHEcGbk7I_lWeN4wjB_0 2024-09-12T19:22:59.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.002+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17908650902464906445', time=2024-09-12T20:32:00.900091+0000, chain.objs.size()=1 2024-09-12T19:22:59.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.002+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.59c_F3NAnAnwAPaJDRQ6apU9kANO8od_0 2024-09-12T19:22:59.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.002+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1471983163717079773', time=2024-09-12T20:32:01.936019+0000, chain.objs.size()=1 2024-09-12T19:22:59.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.002+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.JxiyKKQTwwfT4dRnP_i7Ix1fR843QnF_0 2024-09-12T19:22:59.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.002+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5917470308115875937', time=2024-09-12T20:32:04.427769+0000, chain.objs.size()=1 2024-09-12T19:22:59.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.002+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.WepunGpSzpBqhzmyytU0J4g_kF-NGA1_0 2024-09-12T19:22:59.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.002+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16975355759028253538', time=2024-09-12T20:32:04.429292+0000, chain.objs.size()=1 2024-09-12T19:22:59.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.002+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.zQqQD2OcCcR6sj2lSv6qZhNxxypdkK2_0 2024-09-12T19:22:59.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.002+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1240158926421198919', time=2024-09-12T20:32:05.394701+0000, chain.objs.size()=1 2024-09-12T19:22:59.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.002+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.7spAm88qH39u36PeCm8TqI0I-zW7Zei_0 2024-09-12T19:22:59.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.002+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1732881756807771351', time=2024-09-12T20:32:06.633958+0000, chain.objs.size()=1 2024-09-12T19:22:59.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.002+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.gLitjJIuxuTr1_ACfoJs8UROnfQ35qK_0 2024-09-12T19:22:59.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.002+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17235309930812175717', time=2024-09-12T20:32:06.814048+0000, chain.objs.size()=1 2024-09-12T19:22:59.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.002+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.yrql_6I1BYQU9EGDc_IrgL7l06iRUsF_0 2024-09-12T19:22:59.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.002+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2984172314105281147', time=2024-09-12T20:32:09.192143+0000, chain.objs.size()=1 2024-09-12T19:22:59.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.002+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.fFTWsT_Nf8hr6JZ2km4yBO64_LrR8Qa_0 2024-09-12T19:22:59.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.002+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5238567449877051728', time=2024-09-12T20:32:09.340054+0000, chain.objs.size()=1 2024-09-12T19:22:59.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.002+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.JLqv-1J-myE0ak82oUcU2GcfCSK5oI9_0 2024-09-12T19:22:59.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.010+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3152955028466634170', time=2024-09-12T20:32:09.396197+0000, chain.objs.size()=1 2024-09-12T19:22:59.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.010+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.UhifPsLqW4GyOSIihUOqOBx5Jcxo2An_0 2024-09-12T19:22:59.020 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.014+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9832181478891239580', time=2024-09-12T20:32:10.779635+0000, chain.objs.size()=1 2024-09-12T19:22:59.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.014+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.pt78dIRH8fidA8OnVxV9wblcp-9aN9n_0 2024-09-12T19:22:59.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.014+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1566883203768885486', time=2024-09-12T20:32:11.670330+0000, chain.objs.size()=1 2024-09-12T19:22:59.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.014+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.q431mKmGz-yS1j_5TyfXuqk5v8ElqoB_0 2024-09-12T19:22:59.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.014+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3091519039148383112', time=2024-09-12T20:32:13.094305+0000, chain.objs.size()=1 2024-09-12T19:22:59.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.014+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.YPvb5AFbLbBRBiqXUD8uM9BrqSlfpwW_0 2024-09-12T19:22:59.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.014+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9971508306084783734', time=2024-09-12T20:32:27.151448+0000, chain.objs.size()=1 2024-09-12T19:22:59.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.014+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.268__shadow_.aWegQPuRH-3EbUX9XvArB1EHpj67vT__0 2024-09-12T19:22:59.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.014+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4302225072017404644', time=2024-09-12T20:32:35.888523+0000, chain.objs.size()=1 2024-09-12T19:22:59.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.014+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.272__shadow_.0Kp1331krnEw6RJvHUfqoxF9cHdSt-q_0 2024-09-12T19:22:59.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.014+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12380981315136111139', time=2024-09-12T20:32:58.707733+0000, chain.objs.size()=1 2024-09-12T19:22:59.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.014+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.282__shadow_.0yAvKKrpetCns91rzgSHKFe2vJVwkdO_0 2024-09-12T19:22:59.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.014+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2435363981041941012', time=2024-09-12T20:33:03.296091+0000, chain.objs.size()=1 2024-09-12T19:22:59.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.014+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.284__shadow_.zUA5MgS_7-n4D4rAuAk_rYTvKWdcFRS_0 2024-09-12T19:22:59.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.014+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15012566980314158779', time=2024-09-12T20:33:12.730490+0000, chain.objs.size()=1 2024-09-12T19:22:59.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.014+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.288__shadow_.ykV3D172zz_faxW2kC2wZc9j6FEZq1o_0 2024-09-12T19:22:59.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.018+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7771213210035843876', time=2024-09-12T20:33:45.712843+0000, chain.objs.size()=1 2024-09-12T19:22:59.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.018+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.299__shadow_.wREg4M4rf-UhtpkpCYwAvR5VvktvR1C_0 2024-09-12T19:22:59.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.018+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13343583103049091227', time=2024-09-12T20:36:27.974537+0000, chain.objs.size()=1 2024-09-12T19:22:59.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.018+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.bLipq0z21HBdM0dN2pNnw6lvuOnptc5_0 2024-09-12T19:22:59.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.022+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14341473318493099774', time=2024-09-12T20:36:28.113009+0000, chain.objs.size()=1 2024-09-12T19:22:59.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.022+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.KOh0ceQ3ouFSzEldXF5aBbcHZfeXW3P_0 2024-09-12T19:22:59.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.030+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4940717926747071347', time=2024-09-12T20:36:28.212021+0000, chain.objs.size()=1 2024-09-12T19:22:59.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.030+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.270Rn_FUBZAv4M0Mc6L-ZpMo1k8xTpe_0 2024-09-12T19:22:59.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.030+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13089547487611533099', time=2024-09-12T20:36:29.119622+0000, chain.objs.size()=1 2024-09-12T19:22:59.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.030+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.gQTAulUcMuHpnlnKfnkWCEzh0gcRgxs_0 2024-09-12T19:22:59.037 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.030+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4296486648009071845', time=2024-09-12T20:36:30.370505+0000, chain.objs.size()=1 2024-09-12T19:22:59.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.030+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.tjf65PIA9886Fkjjl666W8s5jcRwulu_0 2024-09-12T19:22:59.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.030+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16098353998459735993', time=2024-09-12T20:36:31.941007+0000, chain.objs.size()=1 2024-09-12T19:22:59.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.030+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.j27RgtTfdX0qufgrcGDZMmxU2cpHuzj_0 2024-09-12T19:22:59.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.030+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10690248760177003306', time=2024-09-12T20:36:32.780392+0000, chain.objs.size()=1 2024-09-12T19:22:59.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.030+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.T4XN_6KTXHd7etkH4CPFEXCEAc280qT_0 2024-09-12T19:22:59.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.030+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7100168118232547178', time=2024-09-12T20:36:33.076462+0000, chain.objs.size()=1 2024-09-12T19:22:59.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.030+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.DFNxKXFlfPCoBeCPbL0V2RzW9UM1zZV_0 2024-09-12T19:22:59.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.030+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16328464639916545114', time=2024-09-12T20:36:33.724413+0000, chain.objs.size()=1 2024-09-12T19:22:59.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.030+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.kV0RjARkZU4wSYuOOS_zTnv79oeqCRd_0 2024-09-12T19:22:59.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.030+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6736883996448085350', time=2024-09-12T20:36:34.102604+0000, chain.objs.size()=1 2024-09-12T19:22:59.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.030+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.JD7LWcMz5j-CfYDCOvbz6EmwTsyzjCm_0 2024-09-12T19:22:59.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.030+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7003579079811858394', time=2024-09-12T20:36:34.452157+0000, chain.objs.size()=1 2024-09-12T19:22:59.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.030+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.1fZSJCKkksoZ-FFB6D_99X8dwYpwE0G_0 2024-09-12T19:22:59.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.030+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10626339967036997360', time=2024-09-12T20:36:36.722895+0000, chain.objs.size()=1 2024-09-12T19:22:59.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.030+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ymCynHn1Qgm_3NZ1o9laV4-Ng9LiJI1_0 2024-09-12T19:22:59.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.034+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14121765220771272153', time=2024-09-12T20:36:37.330859+0000, chain.objs.size()=1 2024-09-12T19:22:59.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.034+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.xLBH-ohKzpasGgrhBI5fZF2oKZx-l9R_0 2024-09-12T19:22:59.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3911218209748329792', time=2024-09-12T20:36:37.758798+0000, chain.objs.size()=1 2024-09-12T19:22:59.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.n-d1e73h21WElAXDaSL84B7qzhI7cXX_0 2024-09-12T19:22:59.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13951670763740632281', time=2024-09-12T20:36:38.470459+0000, chain.objs.size()=1 2024-09-12T19:22:59.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.yeGMSswShl_zuBAx5AvV3D3eJZDUN88_0 2024-09-12T19:22:59.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10648212123859601495', time=2024-09-12T20:36:38.472696+0000, chain.objs.size()=1 2024-09-12T19:22:59.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.iHyr4Lsz2qw6ivhAJX2LXmG1nIgTWp7_0 2024-09-12T19:22:59.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6394278394899371255', time=2024-09-12T20:36:39.585745+0000, chain.objs.size()=1 2024-09-12T19:22:59.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.6sTXWCyIMV42GqJsI4r3QODsrgtHAqb_0 2024-09-12T19:22:59.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10238578368797672820', time=2024-09-12T20:36:39.818078+0000, chain.objs.size()=1 2024-09-12T19:22:59.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.PxQYWnhM-bDeH6Cdk9VSkFYfxnvW20A_0 2024-09-12T19:22:59.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5164761121356109021', time=2024-09-12T20:36:40.512855+0000, chain.objs.size()=1 2024-09-12T19:22:59.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.A_w9eI85bzEa5Ngw84e-4nNPt6HX2UA_0 2024-09-12T19:22:59.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17210272684741699960', time=2024-09-12T20:36:41.813285+0000, chain.objs.size()=1 2024-09-12T19:22:59.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.F4xCMIZQTI_fngV-TWMP9vjfhcqXpua_0 2024-09-12T19:22:59.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16601541534129402463', time=2024-09-12T20:36:42.345812+0000, chain.objs.size()=1 2024-09-12T19:22:59.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.SoFqGJ-2h3jMBvBudFbieLSdIv_PT1F_0 2024-09-12T19:22:59.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13280335505971093516', time=2024-09-12T20:36:43.218514+0000, chain.objs.size()=1 2024-09-12T19:22:59.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.sflMd8okwadkI4ZdLwj70Os1MF4HECx_0 2024-09-12T19:22:59.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1054384428259507562', time=2024-09-12T20:36:43.220629+0000, chain.objs.size()=1 2024-09-12T19:22:59.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.W-4gCBNX73tV0SyE0PghAjYfyTTGISG_0 2024-09-12T19:22:59.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5328690553413410838', time=2024-09-12T20:36:43.222142+0000, chain.objs.size()=1 2024-09-12T19:22:59.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.OkWSiSZeOVrUa3qhYRJAlDh1Tp06cWm_0 2024-09-12T19:22:59.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.050+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5504869308727860042', time=2024-09-12T20:36:43.627743+0000, chain.objs.size()=1 2024-09-12T19:22:59.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.050+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ohRUGgdvokAYspt4pEcO5v-Cy1Ruxwe_0 2024-09-12T19:22:59.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.054+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4381385168560506084', time=2024-09-12T20:36:43.890490+0000, chain.objs.size()=1 2024-09-12T19:22:59.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.054+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.EE4zHWzjQrg2ZW-ZtVk1PncZb2HIwJH_0 2024-09-12T19:22:59.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.054+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13368619170141818287', time=2024-09-12T20:36:44.353358+0000, chain.objs.size()=1 2024-09-12T19:22:59.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.054+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.7je5fcnBCVC3OVNbx7tCrc_uDbKunIV_0 2024-09-12T19:22:59.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.054+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2683100180927812345', time=2024-09-12T20:36:44.788834+0000, chain.objs.size()=1 2024-09-12T19:22:59.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.054+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.vmLjUCPzsPXfEYPfQHP5WQwyhjwxhiP_0 2024-09-12T19:22:59.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.054+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8414757387413853797', time=2024-09-12T20:36:45.261492+0000, chain.objs.size()=1 2024-09-12T19:22:59.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.054+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.cNyPvDeyjCTDvjOdsLgggOeHgNeP14g_0 2024-09-12T19:22:59.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.054+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14310908736971352465', time=2024-09-12T20:36:45.474422+0000, chain.objs.size()=1 2024-09-12T19:22:59.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.054+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.MZBQd5TeS4WBc8hAD4E8y7_R4XjaHw3_0 2024-09-12T19:22:59.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.054+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8654290202141274993', time=2024-09-12T20:36:45.719502+0000, chain.objs.size()=1 2024-09-12T19:22:59.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.054+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.u3c8PPdiGm9sTXyYuDagwSR9UlPlG5B_0 2024-09-12T19:22:59.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.054+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15625597115446065487', time=2024-09-12T20:36:46.116015+0000, chain.objs.size()=1 2024-09-12T19:22:59.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.054+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.E29pwxU7qdvP8hIlxrOaTXMMWXNC1YW_0 2024-09-12T19:22:59.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.054+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14776122172453315611', time=2024-09-12T20:36:46.863498+0000, chain.objs.size()=1 2024-09-12T19:22:59.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.054+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.IdvKva7FrhUZkGrSM4d65T7idTpPStC_0 2024-09-12T19:22:59.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.054+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2762217426246874623', time=2024-09-12T20:36:47.671648+0000, chain.objs.size()=1 2024-09-12T19:22:59.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.054+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.OIdmlHJjsLku7rKbQVBWFf50Hzf_k0m_0 2024-09-12T19:22:59.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.054+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16437165316750337643', time=2024-09-12T20:36:47.868978+0000, chain.objs.size()=1 2024-09-12T19:22:59.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.054+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.5JLutd-LA30h_cmUWXu6OI7kRtK_QWy_0 2024-09-12T19:22:59.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.058+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8279887542790747423', time=2024-09-12T20:36:48.735123+0000, chain.objs.size()=1 2024-09-12T19:22:59.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.058+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.sZ9tikf97FlQ3dAvMMLXjku9nIALxuK_0 2024-09-12T19:22:59.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.058+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15866428053394900606', time=2024-09-12T20:36:48.876628+0000, chain.objs.size()=1 2024-09-12T19:22:59.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.058+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.SFvW5x4Vz1N5TWSicv4S0-EaiQff9nP_0 2024-09-12T19:22:59.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.062+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9768211466955803157', time=2024-09-12T20:36:49.481632+0000, chain.objs.size()=1 2024-09-12T19:22:59.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.062+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.JsTtacwwqLWcEm_twcpeF4tJnPGf-mx_0 2024-09-12T19:22:59.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.062+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9080702745466095297', time=2024-09-12T20:36:49.483990+0000, chain.objs.size()=1 2024-09-12T19:22:59.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.062+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Ut1M6r5kGCzjWVbL8iSliTL4YTGf8UL_0 2024-09-12T19:22:59.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.062+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10747812894225778653', time=2024-09-12T20:36:50.555394+0000, chain.objs.size()=1 2024-09-12T19:22:59.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.062+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.iekkzzgJGhk8U9fkXp-gfzv9dkLH74u_0 2024-09-12T19:22:59.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.062+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3327198587370249765', time=2024-09-12T20:36:50.708418+0000, chain.objs.size()=1 2024-09-12T19:22:59.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.062+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.tQSHvTRyCgKszGat32QjksL-xbTzl_W_0 2024-09-12T19:22:59.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.062+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10881490532497313517', time=2024-09-12T20:36:51.702522+0000, chain.objs.size()=1 2024-09-12T19:22:59.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.062+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.YaZ2utsFYx4I-KOZmXmuJCjZ6G1b68X_0 2024-09-12T19:22:59.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.062+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6548807605435674757', time=2024-09-12T20:36:52.329916+0000, chain.objs.size()=1 2024-09-12T19:22:59.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.062+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.rljCUUW-lf-UJqMdWbxaJ_tMatmzQWf_0 2024-09-12T19:22:59.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.062+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5591204788404994654', time=2024-09-12T20:36:52.454732+0000, chain.objs.size()=1 2024-09-12T19:22:59.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.062+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.jgXPCUwtRPYhA_38uVoR_pkXf_NE5Aq_0 2024-09-12T19:22:59.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.062+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4062003803004708478', time=2024-09-12T20:36:54.085845+0000, chain.objs.size()=1 2024-09-12T19:22:59.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.066+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.rodkRldeOT1vWCmmhX8gjUo3Z4yf9-S_0 2024-09-12T19:22:59.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.066+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3643716112894272554', time=2024-09-12T20:36:56.312097+0000, chain.objs.size()=1 2024-09-12T19:22:59.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.066+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.zHfQTgVHMPSf0pnRatZMcvebSjS4Zj3_0 2024-09-12T19:22:59.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.066+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.355592223988939937', time=2024-09-12T20:38:39.979735+0000, chain.objs.size()=1 2024-09-12T19:22:59.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.066+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.O17pEXHhBo6kN386czxMNoMziQUfRv9_0 2024-09-12T19:22:59.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.066+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1674778887910320094', time=2024-09-12T20:38:40.292863+0000, chain.objs.size()=1 2024-09-12T19:22:59.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.066+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.XJdL2DlvWcJYBKGLlYrqpjEXrrVYe3G_0 2024-09-12T19:22:59.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.066+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6910141171886063120', time=2024-09-12T20:38:41.299234+0000, chain.objs.size()=1 2024-09-12T19:22:59.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.066+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.LzX3imnFa-sC4s2SofLKOu-fuc5XmFb_0 2024-09-12T19:22:59.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.066+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12644532956056612413', time=2024-09-12T20:38:42.009736+0000, chain.objs.size()=1 2024-09-12T19:22:59.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.066+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.oEVQidJbWt1cu43lQQFt314Ceiqh0Xa_0 2024-09-12T19:22:59.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.070+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6283627886439157922', time=2024-09-12T20:38:42.111902+0000, chain.objs.size()=1 2024-09-12T19:22:59.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.070+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.dRPE9sU1cIYoTdNzGZ90HDLJLTa2j0j_0 2024-09-12T19:22:59.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.070+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5385246620684474419', time=2024-09-12T20:38:43.721448+0000, chain.objs.size()=1 2024-09-12T19:22:59.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.070+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.5qViqnH4UaA55ObUJLWCNBOEg1F1BrL_0 2024-09-12T19:22:59.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.070+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16649641573551205916', time=2024-09-12T20:38:43.723327+0000, chain.objs.size()=1 2024-09-12T19:22:59.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.070+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_._vWV_Po0e4nSGEXpWIelbNFPvKm5xJp_0 2024-09-12T19:22:59.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.070+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12375851647376241574', time=2024-09-12T20:38:45.350854+0000, chain.objs.size()=1 2024-09-12T19:22:59.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.070+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.84Eg8WIB_f_hl0gMk9Y0VqvO8flTSna_0 2024-09-12T19:22:59.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.070+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1281366588908684158', time=2024-09-12T20:38:45.810506+0000, chain.objs.size()=1 2024-09-12T19:22:59.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.070+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.qkCYvYeTavWhllW9_4ZzTkD5awcOtIH_0 2024-09-12T19:22:59.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.070+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6102213174977401565', time=2024-09-12T20:38:46.068578+0000, chain.objs.size()=1 2024-09-12T19:22:59.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.070+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.hNpuv_Ot1YrSAxm3EYdgi_ddKRp3d1r_0 2024-09-12T19:22:59.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.070+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1001089220166500785', time=2024-09-12T20:38:47.934819+0000, chain.objs.size()=1 2024-09-12T19:22:59.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.070+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.qcALdrYNH-Bo0BbmeS7BymnAbJxhJNb_0 2024-09-12T19:22:59.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.070+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16208558346520818146', time=2024-09-12T20:38:49.090745+0000, chain.objs.size()=1 2024-09-12T19:22:59.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.070+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.9wP4YjFWbyZR9FqPVILpmpB33_RwNjr_0 2024-09-12T19:22:59.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.074+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5053363529700753365', time=2024-09-12T20:38:49.445160+0000, chain.objs.size()=1 2024-09-12T19:22:59.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.074+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.MZ6ZrJlFIBCmdkO0EqFkjKtVWIpqDc0_0 2024-09-12T19:22:59.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.074+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12318529435696014842', time=2024-09-12T20:38:49.659771+0000, chain.objs.size()=1 2024-09-12T19:22:59.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.074+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.XOV1trHwVpl6glIqTqfpdNcuWL1OFAi_0 2024-09-12T19:22:59.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51416 2024-09-12T19:22:59.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-12T19:22:59.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14933883996094217608', time=2024-09-12T20:38:49.949079+0000, chain.objs.size()=1 2024-09-12T19:22:59.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.pjlVYnixFe7RYf-Rgpg_2lGEamabNSd_0 2024-09-12T19:22:59.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6841395088877862653', time=2024-09-12T20:38:50.322978+0000, chain.objs.size()=1 2024-09-12T19:22:59.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.AMmLsiQQGuvBeK5BcAne8iWc_r1fRSx_0 2024-09-12T19:22:59.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14373443097608864392', time=2024-09-12T20:38:52.664426+0000, chain.objs.size()=1 2024-09-12T19:22:59.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.LKnTXIuXE5lHxHp9FGoBbtswoOVd4ha_0 2024-09-12T19:22:59.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7177233096153563746', time=2024-09-12T20:38:56.523537+0000, chain.objs.size()=1 2024-09-12T19:22:59.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.gJYii1IFbXSjEtpbAHbdYm44_CPlv5D_0 2024-09-12T19:22:59.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15091890409299230846', time=2024-09-12T20:38:57.363435+0000, chain.objs.size()=1 2024-09-12T19:22:59.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.I2ULI0HnSbqjOYXXQLbHVtEtQApyrNI_0 2024-09-12T19:22:59.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7544767303872319975', time=2024-09-12T20:38:59.641349+0000, chain.objs.size()=1 2024-09-12T19:22:59.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.KMqExkAHoUuhlKj0Sals7ftyNf0DPF__0 2024-09-12T19:22:59.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2585603469228105898', time=2024-09-12T20:38:59.741939+0000, chain.objs.size()=1 2024-09-12T19:22:59.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.MgLuyueeubzDJ66tGXG9zighktqqMc-_0 2024-09-12T19:22:59.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2433276780254026351', time=2024-09-12T20:39:00.669139+0000, chain.objs.size()=1 2024-09-12T19:22:59.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.gUasSmf3o-eyhXa3ZUZjmHO6-kX5iuz_0 2024-09-12T19:22:59.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6685761536971022136', time=2024-09-12T20:39:03.738047+0000, chain.objs.size()=1 2024-09-12T19:22:59.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Lxa40cFtbnu_325j5cxunP40TbHg8pf_0 2024-09-12T19:22:59.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1986895714703277780', time=2024-09-12T20:39:06.105475+0000, chain.objs.size()=1 2024-09-12T19:22:59.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.gcs7ku2vM7G0Al7A1-JS0dhfw4d6LMP_0 2024-09-12T19:22:59.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18012118769239572272', time=2024-09-12T20:39:06.351742+0000, chain.objs.size()=1 2024-09-12T19:22:59.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.QuZMmSV17c8esBIR_d4fJ199JJ1HSaj_0 2024-09-12T19:22:59.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2183458980261438587', time=2024-09-12T20:39:07.725644+0000, chain.objs.size()=1 2024-09-12T19:22:59.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.082+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.c0OsLmZQn8V3rlWETPgyGNuB-794wxk_0 2024-09-12T19:22:59.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11426967684332762910', time=2024-09-12T20:39:07.954834+0000, chain.objs.size()=1 2024-09-12T19:22:59.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.D-IgVwTRFR1C7gCM4O_fiP8d-KZKRp9_0 2024-09-12T19:22:59.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5642018860374472097', time=2024-09-12T20:40:29.735116+0000, chain.objs.size()=1 2024-09-12T19:22:59.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.367__shadow_.-nV30mFzFJQtvx5xVAlWzB0GFJL9mOh_0 2024-09-12T19:22:59.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15601969424248026176', time=2024-09-12T20:42:48.526033+0000, chain.objs.size()=1 2024-09-12T19:22:59.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.435__shadow_.g9xAMmNFLIBCASU9lfDZfvLoqp-Kk14_0 2024-09-12T19:22:59.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5976818033633504905', time=2024-09-12T20:45:22.948703+0000, chain.objs.size()=1 2024-09-12T19:22:59.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.503__shadow:tE2u4PreZ1ptztujaTdnj2An4nygGJX_.ADvFvlMdDhiFGZmRgRvM9GmBz7MDjzE_0 2024-09-12T19:22:59.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17957867496092323124', time=2024-09-12T20:46:19.200598+0000, chain.objs.size()=1 2024-09-12T19:22:59.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.512__shadow_.epnY-NEVkkSSnlRIeEFvmUOkyXVfWSK_0 2024-09-12T19:22:59.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13032266716247547908', time=2024-09-12T20:46:48.142787+0000, chain.objs.size()=1 2024-09-12T19:22:59.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.517__shadow_.JeoZyK79s8FSbFVd0yB46pO7pV-JDv3_0 2024-09-12T19:22:59.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3157605513712906774', time=2024-09-12T20:51:44.206232+0000, chain.objs.size()=1 2024-09-12T19:22:59.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.523__multipart_mymultipart.2~Y6CXRTATc364ehUA5NvjZszubmW2Nww.1 2024-09-12T19:22:59.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15068569177153353706', time=2024-09-12T20:57:00.360542+0000, chain.objs.size()=1 2024-09-12T19:22:59.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:3E3VD59wI31K7FMDiDAievAVstM62b9_.9U2FQBraRH6X0FiItvbSsE8bEQuQhtC_0 2024-09-12T19:22:59.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4877779189626725455', time=2024-09-12T20:57:05.466269+0000, chain.objs.size()=1 2024-09-12T19:22:59.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:cmbyyzvoiXelRsNvkbS3fsFLwugi7VC_.FOQGidDxki1KA_6Lx9W2svfgycZNIsi_0 2024-09-12T19:22:59.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2073013272476926505', time=2024-09-12T20:57:37.595638+0000, chain.objs.size()=1 2024-09-12T19:22:59.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.576__shadow:so00R7yhuKlEp6owiAjpQPW67Cf7lr5_.v1X5zofuQD5UrPV9OSpx0z0fP_1wTUx_0 2024-09-12T19:22:59.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1148673485104897086', time=2024-09-12T20:57:44.262754+0000, chain.objs.size()=1 2024-09-12T19:22:59.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.090+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.576__shadow:OwvAU2p3xco-BZ0-djFHVfpepnec39p_.XoOYbxMw8r4gc1L533arhDhRLKMO7Uo_0 2024-09-12T19:22:59.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.094+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7597474730353804775', time=2024-09-12T20:59:29.279503+0000, chain.objs.size()=1 2024-09-12T19:22:59.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.094+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.579__shadow:zcS0bVBLbfuNBhLOoED7OmC5uwcxIVD_.fxjOi2t_8BPD8X9vccGRWr523LSoh35_0 2024-09-12T19:22:59.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.094+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4792790574988786507', time=2024-09-12T20:59:34.864221+0000, chain.objs.size()=1 2024-09-12T19:22:59.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.094+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.580__shadow:Hv2wbbedeP.N6cSgFCL9WFR6ss5nrbB_._r7qX5j0nVaUDxA_vCiIKc8n4TpCjPr_0 2024-09-12T19:22:59.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.098+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14353535948798365606', time=2024-09-12T20:59:47.241675+0000, chain.objs.size()=1 2024-09-12T19:22:59.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.098+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.585__shadow:9sQjlVnXCdCrk8rrcLTunh2teIOx8wq_.y4Vlz_D8sHLFOJXwYZmrb5UZVTnWLrN_0 2024-09-12T19:22:59.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.098+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15691565700825704455', time=2024-09-12T21:07:11.243352+0000, chain.objs.size()=1 2024-09-12T19:22:59.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.098+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.632__shadow_.PbhVnO4R9JaMJnfO9yh_N_XIs_By6Ac_0 2024-09-12T19:22:59.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.098+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6454639392735793255', time=2024-09-12T21:10:29.786497+0000, chain.objs.size()=1 2024-09-12T19:22:59.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.098+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.691__shadow_.eQcfMZoB9TMk28ug8rN9i0WB37j2HkQ_0 2024-09-12T19:22:59.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.098+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14823258684256819324', time=2024-09-12T21:10:44.837993+0000, chain.objs.size()=1 2024-09-12T19:22:59.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.098+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.698__shadow:2NXpebiO7r3dw-CPJfTTs9BcSVr5f1L_.Sa2aM8tme2h0Wrim6m0idwFL3tMDWbt_0 2024-09-12T19:22:59.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.098+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9948269383336269178', time=2024-09-12T21:11:31.996689+0000, chain.objs.size()=1 2024-09-12T19:22:59.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.098+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.716__shadow:207ovLpHXlbfcV8lHFdo7PpjnhYNSRR_.V28reYJz9RoAUrg9Hpxz_poHtpZQBQG_0 2024-09-12T19:22:59.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.106+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:22:59.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T19:22:59.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:22:59.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:22:59.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50317' 2024-09-12T19:22:59.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='_1JAiL_thobMJFzmKJYvvR7ERkcNokb9', time=2024-09-12T20:22:52.377218+0000, chain.objs.size()=1 2024-09-12T19:22:59.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.161__shadow_.ZHw5Ty4vqOMMK7VIfjC4Fvc-uAOMHNI_0 2024-09-12T19:22:59.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~V-GpSKhlMv6xyNwTVEtdEaVu2_dEpr-', time=2024-09-12T20:25:16.707579+0000, chain.objs.size()=1 2024-09-12T19:22:59.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.201__multipart_mymultipart.2~V-GpSKhlMv6xyNwTVEtdEaVu2_dEpr-.1 2024-09-12T19:22:59.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12517855885792217903', time=2024-09-12T20:29:23.266949+0000, chain.objs.size()=1 2024-09-12T19:22:59.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.244__shadow_.vCdiocnRnxccr1BI2G6W7k7OJbEowE3_0 2024-09-12T19:22:59.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1428211748616137837', time=2024-09-12T20:29:25.573387+0000, chain.objs.size()=1 2024-09-12T19:22:59.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.245__shadow_.nTImtIE_vgs2MiIVmGrfUaRVYc2S9bY_0 2024-09-12T19:22:59.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14564189694979687345', time=2024-09-12T20:31:45.668033+0000, chain.objs.size()=1 2024-09-12T19:22:59.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.J7PRj9tB64rU0ilKJnaVwaf1Q9or6Wy_0 2024-09-12T19:22:59.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3053340724552602206', time=2024-09-12T20:31:47.413815+0000, chain.objs.size()=1 2024-09-12T19:22:59.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ZBRng_YzGb3E4bvT_MS2N3FR_C5--2l_0 2024-09-12T19:22:59.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3434008302007556385', time=2024-09-12T20:31:49.655508+0000, chain.objs.size()=1 2024-09-12T19:22:59.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.bmg269RIDRMqcwBTMMk01jVCrmm7GhZ_0 2024-09-12T19:22:59.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6674010998611623500', time=2024-09-12T20:31:49.767454+0000, chain.objs.size()=1 2024-09-12T19:22:59.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.AJKYCncL4UYQuSaJqIQqgP0D9VdvAm9_0 2024-09-12T19:22:59.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13559236114320275012', time=2024-09-12T20:31:49.929716+0000, chain.objs.size()=1 2024-09-12T19:22:59.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.6gSD-C_O05g7TA-P6hoF8PbDQ5WSol7_0 2024-09-12T19:22:59.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11785129643871438408', time=2024-09-12T20:31:50.166979+0000, chain.objs.size()=1 2024-09-12T19:22:59.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.LE9OcW5CMe260hiFt9ZWLCMqE9UfQx6_0 2024-09-12T19:22:59.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6212297707545692683', time=2024-09-12T20:31:51.199436+0000, chain.objs.size()=1 2024-09-12T19:22:59.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.-BpCuVD7BBckI1ZqqNqT38HrJqGBCm6_0 2024-09-12T19:22:59.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1434613675101965393', time=2024-09-12T20:31:51.205794+0000, chain.objs.size()=1 2024-09-12T19:22:59.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.tZKH9wZX1mu8Qxoa9jH5V6FnnCdsjLJ_0 2024-09-12T19:22:59.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.118+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12942034579818189082', time=2024-09-12T20:31:51.367587+0000, chain.objs.size()=1 2024-09-12T19:22:59.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.118+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.mOYP4HfBq2MQI1BLaTtiWsbXnFpXQmq_0 2024-09-12T19:22:59.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.122+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17999616556329045993', time=2024-09-12T20:31:53.073599+0000, chain.objs.size()=1 2024-09-12T19:22:59.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.122+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.prK31Qm70L-tsw0qDVPvPpUwppaIeT0_0 2024-09-12T19:22:59.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.122+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2144384367696539559', time=2024-09-12T20:31:53.485501+0000, chain.objs.size()=1 2024-09-12T19:22:59.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.122+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.4qUa2WxUGOADniw4WmpfaxPiS_2YoP2_0 2024-09-12T19:22:59.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.122+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3649460889208945327', time=2024-09-12T20:31:54.197185+0000, chain.objs.size()=1 2024-09-12T19:22:59.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.122+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ZizC2-s79kDUibbGrClHvgLfGQFabHz_0 2024-09-12T19:22:59.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16547347412411709004', time=2024-09-12T20:31:54.520699+0000, chain.objs.size()=1 2024-09-12T19:22:59.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.MRuDaqg3sRt0xl7kfbTLWL_FbhRLihu_0 2024-09-12T19:22:59.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16927913881250318231', time=2024-09-12T20:31:54.639968+0000, chain.objs.size()=1 2024-09-12T19:22:59.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.g5_6NGjfjstMOz5OIgNoiaov1vAOO5V_0 2024-09-12T19:22:59.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15055264582911020354', time=2024-09-12T20:31:55.063553+0000, chain.objs.size()=1 2024-09-12T19:22:59.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.YT05gDAMt1rSGEfCCEC-jyGoc4Lc_6J_0 2024-09-12T19:22:59.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10031676080420429800', time=2024-09-12T20:31:55.210666+0000, chain.objs.size()=1 2024-09-12T19:22:59.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.O7CIcH7eYCrbH0059kVDrC4SKNI3MKN_0 2024-09-12T19:22:59.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15055034723052533046', time=2024-09-12T20:31:55.708002+0000, chain.objs.size()=1 2024-09-12T19:22:59.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Qach2WowharpsLKApWwa8RQp2PUXi1v_0 2024-09-12T19:22:59.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8915012358742231738', time=2024-09-12T20:31:57.253509+0000, chain.objs.size()=1 2024-09-12T19:22:59.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.7E9h_odBIjsRAyrIsqkvR_dIlEpKLBL_0 2024-09-12T19:22:59.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8920698297839476411', time=2024-09-12T20:31:57.802537+0000, chain.objs.size()=1 2024-09-12T19:22:59.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.TFuOAltAxrypq2ypcY2WPereukfW_ZZ_0 2024-09-12T19:22:59.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7399668465763358102', time=2024-09-12T20:31:58.571532+0000, chain.objs.size()=1 2024-09-12T19:22:59.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.hmNc5lgaNLn85rQV8duek5EDI91BllO_0 2024-09-12T19:22:59.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9968379118749518978', time=2024-09-12T20:31:59.023594+0000, chain.objs.size()=1 2024-09-12T19:22:59.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.prgce1vF_qZs7pJ3cLaHh0TgjBAEu4s_0 2024-09-12T19:22:59.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12711096710449331678', time=2024-09-12T20:32:01.498465+0000, chain.objs.size()=1 2024-09-12T19:22:59.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.0l9Zi2hge8RbeLJvH6EoEh6qXP-Yfw6_0 2024-09-12T19:22:59.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11718289579185399833', time=2024-09-12T20:32:01.864670+0000, chain.objs.size()=1 2024-09-12T19:22:59.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.lnrzZqm6SXHieENmgKqW65IvcoorMG5_0 2024-09-12T19:22:59.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.130+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2112971993798389233', time=2024-09-12T20:32:02.199758+0000, chain.objs.size()=1 2024-09-12T19:22:59.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.130+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Eu0KuHgTYlzv3stxSWIgG2IewyE0f7W_0 2024-09-12T19:22:59.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.130+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4508987753537681781', time=2024-09-12T20:32:02.343685+0000, chain.objs.size()=1 2024-09-12T19:22:59.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.130+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.miBFCZKBB4nNj4T3FScvadR-MYnKRjr_0 2024-09-12T19:22:59.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.130+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8082841345183181911', time=2024-09-12T20:32:03.424000+0000, chain.objs.size()=1 2024-09-12T19:22:59.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.130+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.fUTiPcKBOpWqp07wT8HmxM94ljzPL_5_0 2024-09-12T19:22:59.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.130+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11686254264798311014', time=2024-09-12T20:32:04.651584+0000, chain.objs.size()=1 2024-09-12T19:22:59.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.130+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.GmPU2efjVrfB3VB0xK71Rt2jE132bfs_0 2024-09-12T19:22:59.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.130+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5747346353019013657', time=2024-09-12T20:32:04.847484+0000, chain.objs.size()=1 2024-09-12T19:22:59.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.130+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.lvdWFjPtvu8yJ15wMdptuULm4jHwun4_0 2024-09-12T19:22:59.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.134+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14693749423822326311', time=2024-09-12T20:32:05.301774+0000, chain.objs.size()=1 2024-09-12T19:22:59.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.134+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.wP3oTcW3XqVyurJ09JvRHxlEAfYXcgF_0 2024-09-12T19:22:59.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.134+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.498501921610983692', time=2024-09-12T20:32:08.465534+0000, chain.objs.size()=1 2024-09-12T19:22:59.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.134+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.g-yhMEE-g-rO5P9dCtKlY3vmKEL46W3_0 2024-09-12T19:22:59.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.134+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11403783926575901824', time=2024-09-12T20:32:08.556245+0000, chain.objs.size()=1 2024-09-12T19:22:59.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.134+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ZdxwUOzZbEYOQS_jfEySsbffMaGOYRi_0 2024-09-12T19:22:59.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.134+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6210675807828463597', time=2024-09-12T20:32:10.188495+0000, chain.objs.size()=1 2024-09-12T19:22:59.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.134+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.aU7YwamXCUgl3Qpfli0IIx-7ior_Huo_0 2024-09-12T19:22:59.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.134+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4568731377206339464', time=2024-09-12T20:32:12.536199+0000, chain.objs.size()=1 2024-09-12T19:22:59.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.134+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.-4JRoyNDvSni_Z7z_6HfNkvqjUptx-Y_0 2024-09-12T19:22:59.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.134+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18336967378888965584', time=2024-09-12T20:32:12.537778+0000, chain.objs.size()=1 2024-09-12T19:22:59.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.134+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ksSPj2dXjz_nw1Y9UfMegX61TCJdFId_0 2024-09-12T19:22:59.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.138+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.361755064954334097', time=2024-09-12T20:32:33.738966+0000, chain.objs.size()=1 2024-09-12T19:22:59.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.138+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.271__shadow_.cly5G1sIl-ro0mi_cLCX26ySjn62j06_0 2024-09-12T19:22:59.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.138+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18420483250601172626', time=2024-09-12T20:32:40.238081+0000, chain.objs.size()=1 2024-09-12T19:22:59.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.138+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.274__shadow_.ebudbJwGuOurbQ3OFvBXsDO4A40Y_q9_0 2024-09-12T19:22:59.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.138+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15051376969283220529', time=2024-09-12T20:32:44.875426+0000, chain.objs.size()=1 2024-09-12T19:22:59.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.138+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.276__shadow_.Xbf9yQ7KxB2Y-EKMIQ4NyMRgsnrlAOR_0 2024-09-12T19:22:59.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.138+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13297280214414001637', time=2024-09-12T20:32:56.449245+0000, chain.objs.size()=1 2024-09-12T19:22:59.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.138+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.281__shadow_.QV6jPQd4e1QYRqm7iWEzG2tmWiFKQHd_0 2024-09-12T19:22:59.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.138+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1982691308251119142', time=2024-09-12T20:33:05.715098+0000, chain.objs.size()=1 2024-09-12T19:22:59.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.138+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.285__shadow_.O3UJXWoC32ZrRNY_ZFEseYwyDYNyJg0_0 2024-09-12T19:22:59.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.138+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13649102585109982457', time=2024-09-12T20:33:08.161314+0000, chain.objs.size()=1 2024-09-12T19:22:59.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.138+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.286__shadow_.cVxsPGjpUhKjqro9TrQjInZskz83Tf5_0 2024-09-12T19:22:59.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.142+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8651499847427484577', time=2024-09-12T20:33:17.301318+0000, chain.objs.size()=1 2024-09-12T19:22:59.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.142+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.290__shadow_.v35PaQ-zlFG9ulyaFoaMAxH4L3nXdG1_0 2024-09-12T19:22:59.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.142+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8150678730554648634', time=2024-09-12T20:33:25.341145+0000, chain.objs.size()=1 2024-09-12T19:22:59.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.142+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.abPPwY_sUbKOndDoqoD7Lx1ZKIal6cf_0 2024-09-12T19:22:59.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.142+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12494703709177018635', time=2024-09-12T20:33:30.984460+0000, chain.objs.size()=1 2024-09-12T19:22:59.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.142+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.FZP49Wscswon-nMENGrCQcDccXC3ewf_0 2024-09-12T19:22:59.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.142+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2640481440990086289', time=2024-09-12T20:33:31.598412+0000, chain.objs.size()=1 2024-09-12T19:22:59.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.142+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.Xb7gas3CuDzhk2YRUp_QD0wadsXb2zz_0 2024-09-12T19:22:59.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.142+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7201277136149462497', time=2024-09-12T20:33:33.874456+0000, chain.objs.size()=1 2024-09-12T19:22:59.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.142+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.294__shadow_.4gQRHve4ZtDPzfMP3cl0U919r2K4MiQ_0 2024-09-12T19:22:59.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11615916909724342147', time=2024-09-12T20:33:38.557157+0000, chain.objs.size()=1 2024-09-12T19:22:59.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.296__shadow_.q-AMnxiMcWk-xEkVAkzzeKS8coTQZF3_0 2024-09-12T19:22:59.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.971146930588555163', time=2024-09-12T20:33:52.560353+0000, chain.objs.size()=1 2024-09-12T19:22:59.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.302__shadow_.Eud3fsZTlDYkOrBm5_5bZQwZt1egX_W_0 2024-09-12T19:22:59.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15312494336835077835', time=2024-09-12T20:33:54.890977+0000, chain.objs.size()=1 2024-09-12T19:22:59.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.303__shadow_.vO_0cnBDP3kMO-4bs-mL7f8KRltt9iz_0 2024-09-12T19:22:59.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5365099845183411275', time=2024-09-12T20:36:28.108153+0000, chain.objs.size()=1 2024-09-12T19:22:59.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.iAgmqU6iLvba67fxhwvbQmDuQze034E_0 2024-09-12T19:22:59.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2412714779097857492', time=2024-09-12T20:36:28.682066+0000, chain.objs.size()=1 2024-09-12T19:22:59.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ea8zOC_EmjCSbXsB7oXCVU5IKNKidGe_0 2024-09-12T19:22:59.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9553424439537342946', time=2024-09-12T20:36:28.942435+0000, chain.objs.size()=1 2024-09-12T19:22:59.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.UTsU3HAGejZCLGU2qc_-mzKhynutrO-_0 2024-09-12T19:22:59.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16887967207406413639', time=2024-09-12T20:36:29.282541+0000, chain.objs.size()=1 2024-09-12T19:22:59.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.WBr9bkWQFwfzwuCqGn2bWwYcThNSXMW_0 2024-09-12T19:22:59.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5545919479974606814', time=2024-09-12T20:36:29.690715+0000, chain.objs.size()=1 2024-09-12T19:22:59.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.s8MxweyDiYZZiwjBOuNXJ-cF4p94_no_0 2024-09-12T19:22:59.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.150+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10910966576104391050', time=2024-09-12T20:36:30.132130+0000, chain.objs.size()=1 2024-09-12T19:22:59.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.150+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.SjVFHNfC7Fy1bH8krzhaV3tJkVHLw8Z_0 2024-09-12T19:22:59.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.150+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18226135855468068428', time=2024-09-12T20:36:31.958334+0000, chain.objs.size()=1 2024-09-12T19:22:59.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.150+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.6FGFmzztRWallCLwVpckuwewfKIvzfH_0 2024-09-12T19:22:59.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11701045094711739277', time=2024-09-12T20:36:32.720673+0000, chain.objs.size()=1 2024-09-12T19:22:59.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.pXoc8G7rk9V5sUwFhe-pv5ZjufkX657_0 2024-09-12T19:22:59.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5315917328093199606', time=2024-09-12T20:36:33.069314+0000, chain.objs.size()=1 2024-09-12T19:22:59.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.LSefXutKvDvtUyYYfQgpJuWj_9cXFV9_0 2024-09-12T19:22:59.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13686161643944597069', time=2024-09-12T20:36:33.154000+0000, chain.objs.size()=1 2024-09-12T19:22:59.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.HsyQS4zpBWkHbYsoIYlJ4UjKeE42KDX_0 2024-09-12T19:22:59.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14161316211214210136', time=2024-09-12T20:36:34.409942+0000, chain.objs.size()=1 2024-09-12T19:22:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.q6vUYVR12P8AFHn5MXzDCZKUO2DGH02_0 2024-09-12T19:22:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13911388227268363042', time=2024-09-12T20:36:34.603699+0000, chain.objs.size()=1 2024-09-12T19:22:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.q2i6OpknRd3TQoQP_P0luwcGl69iVuJ_0 2024-09-12T19:22:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6234119595677692994', time=2024-09-12T20:36:40.711576+0000, chain.objs.size()=1 2024-09-12T19:22:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.DB0C7zscdNc1oi1MfDGctlMGvfMs5q2_0 2024-09-12T19:22:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11814960976395961620', time=2024-09-12T20:36:40.825070+0000, chain.objs.size()=1 2024-09-12T19:22:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.twdWXVJjA4ZQpoS0Ci4mD5hhYsW5vWw_0 2024-09-12T19:22:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18138876591963484135', time=2024-09-12T20:36:40.968925+0000, chain.objs.size()=1 2024-09-12T19:22:59.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.3mQjrtbZGPmAzj3m3KHN8eXRUDxcmtt_0 2024-09-12T19:22:59.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14446340814393074669', time=2024-09-12T20:36:41.724394+0000, chain.objs.size()=1 2024-09-12T19:22:59.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.UD5KVpQ7ZmTLyPJo8GyyVhHLkygL_T1_0 2024-09-12T19:22:59.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4167780093178954308', time=2024-09-12T20:36:41.893459+0000, chain.objs.size()=1 2024-09-12T19:22:59.160 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.h1N4Km2cIZjfddmAIBZ_9FYa7hHYJ2Z_0 2024-09-12T19:22:59.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13550216659662130380', time=2024-09-12T20:36:42.023971+0000, chain.objs.size()=1 2024-09-12T19:22:59.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.154+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.0BHSgdqtIW2KbgGEnG8RT95g3TYImnp_0 2024-09-12T19:22:59.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.158+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.424108850868738260', time=2024-09-12T20:36:43.552480+0000, chain.objs.size()=1 2024-09-12T19:22:59.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.158+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Ma84sPnlnKMmivadANGeyeOaZlZzwUN_0 2024-09-12T19:22:59.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.158+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5142123855219560081', time=2024-09-12T20:36:44.223209+0000, chain.objs.size()=1 2024-09-12T19:22:59.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.158+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.4jvSlCFVjZBb2D73oT6GbPuPOm9s7Jn_0 2024-09-12T19:22:59.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.158+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1077372454235080416', time=2024-09-12T20:36:44.866648+0000, chain.objs.size()=1 2024-09-12T19:22:59.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.158+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.g55mqYJu3lUqw3HAWPImqm4vvHGDdRK_0 2024-09-12T19:22:59.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.158+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16918082289165808547', time=2024-09-12T20:36:45.700769+0000, chain.objs.size()=1 2024-09-12T19:22:59.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.158+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.G51iCFUUxJ28Qvf6MGSYkZrpkaC3BXe_0 2024-09-12T19:22:59.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.162+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13720281893506605828', time=2024-09-12T20:36:46.066625+0000, chain.objs.size()=1 2024-09-12T19:22:59.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.162+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.tkoMQTs76yGlxHelZ2G1gWgur4UkaI1_0 2024-09-12T19:22:59.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.162+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1508272530471782878', time=2024-09-12T20:36:47.295233+0000, chain.objs.size()=1 2024-09-12T19:22:59.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.162+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.hI2XDLM15m0DhDTVpRr1rH29dqa8rm6_0 2024-09-12T19:22:59.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.162+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14359421934005342200', time=2024-09-12T20:36:47.762609+0000, chain.objs.size()=1 2024-09-12T19:22:59.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.162+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ZjnE3TJMLTvA7PCBzzToZA4TbDtevla_0 2024-09-12T19:22:59.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.162+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13288536030658940257', time=2024-09-12T20:36:48.316789+0000, chain.objs.size()=1 2024-09-12T19:22:59.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.162+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.XR-nkDuQ2ncOqMKS23TZiBaZey_XHeh_0 2024-09-12T19:22:59.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.162+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14516249006533997851', time=2024-09-12T20:36:49.681337+0000, chain.objs.size()=1 2024-09-12T19:22:59.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.162+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.m5X-xJZeQGRkdeykL1IW2E2BqD-JgXh_0 2024-09-12T19:22:59.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.162+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2036244590063581547', time=2024-09-12T20:36:50.574897+0000, chain.objs.size()=1 2024-09-12T19:22:59.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.162+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.TQ5Qs0PeH4Z-POdC7ByCeboFS3MijIa_0 2024-09-12T19:22:59.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.162+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14835308341511848583', time=2024-09-12T20:36:52.211741+0000, chain.objs.size()=1 2024-09-12T19:22:59.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.162+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.QiqxBtlR-QPsBR2sERHwvtLw4fLFzil_0 2024-09-12T19:22:59.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12475025700812372208', time=2024-09-12T20:36:56.271875+0000, chain.objs.size()=1 2024-09-12T19:22:59.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.nwTXd8O3A_n8t0T84Ug3cWs_7B96Q4x_0 2024-09-12T19:22:59.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1723593456567898843', time=2024-09-12T20:38:39.872776+0000, chain.objs.size()=1 2024-09-12T19:22:59.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.5bwAvpGqvIomA-Rtp3K7aWEuWMcT9b3_0 2024-09-12T19:22:59.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9805390210285681171', time=2024-09-12T20:38:40.335493+0000, chain.objs.size()=1 2024-09-12T19:22:59.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.zjw_RvU50ULx6BlmtN5ep--FkOrHeht_0 2024-09-12T19:22:59.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8988410754519590312', time=2024-09-12T20:38:40.965029+0000, chain.objs.size()=1 2024-09-12T19:22:59.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.zDLpDRX0gX0l0hOUU5bJmEQv4WNDeCe_0 2024-09-12T19:22:59.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8677770705805749331', time=2024-09-12T20:38:41.200764+0000, chain.objs.size()=1 2024-09-12T19:22:59.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.wM-IBYQdTG4VYZNTrF_eFliHHavDXce_0 2024-09-12T19:22:59.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7788639832612941980', time=2024-09-12T20:38:41.464876+0000, chain.objs.size()=1 2024-09-12T19:22:59.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.tVSyLYhx4B54NAUvy5wzo-ljS9qecrD_0 2024-09-12T19:22:59.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18326804537007064297', time=2024-09-12T20:38:42.576546+0000, chain.objs.size()=1 2024-09-12T19:22:59.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.nvCw34xX-20HzYRz5licJjBpci-xDAX_0 2024-09-12T19:22:59.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5820865006674256584', time=2024-09-12T20:38:42.674722+0000, chain.objs.size()=1 2024-09-12T19:22:59.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.vbTN8SXFEk7l-5za5dwoo6OnYukVZ7-_0 2024-09-12T19:22:59.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.170+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7121943895234820673', time=2024-09-12T20:38:44.024135+0000, chain.objs.size()=1 2024-09-12T19:22:59.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.170+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.8brImdFjwzfWD0FIp6yVsh3ewfmv2Qn_0 2024-09-12T19:22:59.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.170+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14339736259064078563', time=2024-09-12T20:38:44.523467+0000, chain.objs.size()=1 2024-09-12T19:22:59.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.170+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.XyR-YBj7PBCCH1h4P0afOtY6d4DR0NJ_0 2024-09-12T19:22:59.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.170+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10490917978572386544', time=2024-09-12T20:38:45.762166+0000, chain.objs.size()=1 2024-09-12T19:22:59.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.170+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.v5Sp7pWXhZRTXyzJQVi60jDAMxwXNfw_0 2024-09-12T19:22:59.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4124245538787976460', time=2024-09-12T20:38:45.935958+0000, chain.objs.size()=1 2024-09-12T19:22:59.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.FzIII-EEMfg8Z3zcVCJKnY9GwwrLI5t_0 2024-09-12T19:22:59.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3434934271990433608', time=2024-09-12T20:38:47.584638+0000, chain.objs.size()=1 2024-09-12T19:22:59.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.J6uYlgYOjD3JB3c513kE42rC9N1Ib7U_0 2024-09-12T19:22:59.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7552946390063144417', time=2024-09-12T20:38:47.876833+0000, chain.objs.size()=1 2024-09-12T19:22:59.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.UGOrlWhwwsAmyX_jwYAAqDj2IHWFwvR_0 2024-09-12T19:22:59.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.498234231384499530', time=2024-09-12T20:38:48.530300+0000, chain.objs.size()=1 2024-09-12T19:22:59.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.K01ORueSI8RKaNu6gxMUMQ9L8JsInUE_0 2024-09-12T19:22:59.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9894838891304725213', time=2024-09-12T20:38:48.676158+0000, chain.objs.size()=1 2024-09-12T19:22:59.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_._1xYirmQK7lCkWb76Ske1763KmmoiWm_0 2024-09-12T19:22:59.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12677768925062038038', time=2024-09-12T20:38:50.186036+0000, chain.objs.size()=1 2024-09-12T19:22:59.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ph7Cb_FSMrm2cUxC-y0fJi8WR1HfCMW_0 2024-09-12T19:22:59.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8567680276201214275', time=2024-09-12T20:38:51.726814+0000, chain.objs.size()=1 2024-09-12T19:22:59.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.8gfUf9-e5Iiay3kz45ssFdASACt8Fvv_0 2024-09-12T19:22:59.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16463170312424986932', time=2024-09-12T20:38:51.770201+0000, chain.objs.size()=1 2024-09-12T19:22:59.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_._aFFWGP4qbuhyhv6EMmsbAHQ60M_R3z_0 2024-09-12T19:22:59.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.182+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50317 2024-09-12T19:22:59.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=36, truncated=0, next_marker='' 2024-09-12T19:22:59.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11615635617229988683', time=2024-09-12T20:38:52.070921+0000, chain.objs.size()=1 2024-09-12T19:22:59.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Y3EtAIeYuIotTAcgBWtjKVmkFxaFo69_0 2024-09-12T19:22:59.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3702061460362872947', time=2024-09-12T20:38:54.049438+0000, chain.objs.size()=1 2024-09-12T19:22:59.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.9lbTA2WKD5htXSedxHMbGyvO_r7vKX5_0 2024-09-12T19:22:59.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7972378775225112873', time=2024-09-12T20:38:55.473959+0000, chain.objs.size()=1 2024-09-12T19:22:59.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Zj8MpINw-RvLc-kAK7T0Ah4gUsxYcPS_0 2024-09-12T19:22:59.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16143417459355809862', time=2024-09-12T20:38:56.088400+0000, chain.objs.size()=1 2024-09-12T19:22:59.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.kPlK4WD0anB01ZbJjYD8ZjGsozzlTjA_0 2024-09-12T19:22:59.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6122534495020283643', time=2024-09-12T20:38:56.669531+0000, chain.objs.size()=1 2024-09-12T19:22:59.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.IPKixcw1RTLxzgiWUTZiFNEkkwB-LJ__0 2024-09-12T19:22:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16522905945244459002', time=2024-09-12T20:38:56.671136+0000, chain.objs.size()=1 2024-09-12T19:22:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.rpBBzrFALVJDYE-lt5ExgP28pjmlOKC_0 2024-09-12T19:22:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18418538654580856236', time=2024-09-12T20:38:57.819089+0000, chain.objs.size()=1 2024-09-12T19:22:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.R8RD8ElZucWVLISZ7nlhBLh1GFr5RwL_0 2024-09-12T19:22:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7723216300028294842', time=2024-09-12T20:38:58.595512+0000, chain.objs.size()=1 2024-09-12T19:22:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.0XmZKG-xulApS9NG-LrsDrv8g8EnYT9_0 2024-09-12T19:22:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14656841918389680815', time=2024-09-12T20:38:58.950273+0000, chain.objs.size()=1 2024-09-12T19:22:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.hFUQo0H-3ORT7ldstk9rHB5iHPaulzk_0 2024-09-12T19:22:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15306905799768379430', time=2024-09-12T20:38:59.828460+0000, chain.objs.size()=1 2024-09-12T19:22:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.53RNptkP072JthNmyBQhF-DAC5eu-fI_0 2024-09-12T19:22:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.71855081691723376', time=2024-09-12T20:39:00.097383+0000, chain.objs.size()=1 2024-09-12T19:22:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.XeN4rbf1o9NWf08NvSrg1klSUHD32Wm_0 2024-09-12T19:22:59.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10301355929566502897', time=2024-09-12T20:39:00.103803+0000, chain.objs.size()=1 2024-09-12T19:22:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.186+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.sSaBHqoCC6Vh-J9Do1l0zFt3IFMLwkr_0 2024-09-12T19:22:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.43945461422689386', time=2024-09-12T20:39:00.295038+0000, chain.objs.size()=1 2024-09-12T19:22:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.oCcKFkZigCOTs8sVcyY5DzzYcPngBMv_0 2024-09-12T19:22:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10080237819554659147', time=2024-09-12T20:39:00.756058+0000, chain.objs.size()=1 2024-09-12T19:22:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.MlrOw2Scoa_6jVK_xSmfKx0J46ajHju_0 2024-09-12T19:22:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.682208664601379109', time=2024-09-12T20:39:02.225965+0000, chain.objs.size()=1 2024-09-12T19:22:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.4UrQr7M9Oa5mqytdNjBZHPLxicPdp_Z_0 2024-09-12T19:22:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2664467354591206883', time=2024-09-12T20:39:03.077907+0000, chain.objs.size()=1 2024-09-12T19:22:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.K3yWiblL8nvVbMef-lmuBv-a4OQM8B3_0 2024-09-12T19:22:59.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17726359572728183258', time=2024-09-12T20:39:03.104218+0000, chain.objs.size()=1 2024-09-12T19:22:59.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.C9XA9OgVlcNwM17LjS2hDrXJVEShRXf_0 2024-09-12T19:22:59.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8944362646870265238', time=2024-09-12T20:39:03.670112+0000, chain.objs.size()=1 2024-09-12T19:22:59.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.356MJ1zPpH-YUzvFM-ur-SXCg3GCKtu_0 2024-09-12T19:22:59.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16999396889161038474', time=2024-09-12T20:39:05.008390+0000, chain.objs.size()=1 2024-09-12T19:22:59.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.XPJSnqq6Eosbg49JP0Z_bSoaFDL7f30_0 2024-09-12T19:22:59.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9159949669747512433', time=2024-09-12T20:39:07.036089+0000, chain.objs.size()=1 2024-09-12T19:22:59.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.wDXNXp44YV6LLiwAUDVZFz8F0_Ttffp_0 2024-09-12T19:22:59.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6188862986443359046', time=2024-09-12T20:39:07.505639+0000, chain.objs.size()=1 2024-09-12T19:22:59.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.RiRzEUDX5UDlD-z0QwlSzad58USFcXH_0 2024-09-12T19:22:59.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12791443919472930112', time=2024-09-12T20:39:07.577994+0000, chain.objs.size()=1 2024-09-12T19:22:59.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.CYREK3a-Ddf_Mgr1DNgfKY6YGJXh5ab_0 2024-09-12T19:22:59.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17536064515245143056', time=2024-09-12T20:39:13.753143+0000, chain.objs.size()=1 2024-09-12T19:22:59.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.327__shadow_.C1AgrCu8c6QEpLYUawBDq1hrFq45jQC_0 2024-09-12T19:22:59.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.198+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13844564195820706565', time=2024-09-12T20:40:35.699660+0000, chain.objs.size()=1 2024-09-12T19:22:59.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.198+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.370__shadow_.qv8I9bvkrHdd5rl_ulOtJ9MlU3HnrYy_0 2024-09-12T19:22:59.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.198+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6719525937117950177', time=2024-09-12T20:42:38.644639+0000, chain.objs.size()=1 2024-09-12T19:22:59.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.198+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.430__shadow_.WhMGstDxSJowaiGfarm9vB0rzsAWSPU_0 2024-09-12T19:22:59.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.202+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1255237757620395818', time=2024-09-12T20:43:49.680250+0000, chain.objs.size()=1 2024-09-12T19:22:59.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.460__shadow_.ylB8zsL_Lb4dccXjNqxFNwTuc_r0mCd_0 2024-09-12T19:22:59.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.202+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11796542642404618604', time=2024-09-12T20:44:04.384708+0000, chain.objs.size()=1 2024-09-12T19:22:59.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.465__shadow_.3456ewoj8wU4Hig7KwAxTh2UxHqPitI_0 2024-09-12T19:22:59.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.202+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8517706866906619083', time=2024-09-12T20:48:00.009385+0000, chain.objs.size()=3 2024-09-12T19:22:59.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.521__multipart_mymultipart.2~nOruLCSv8TfM4ATVQcwlTnd_WTSimMo.1 2024-09-12T19:22:59.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.521__multipart_mymultipart.2~nOruLCSv8TfM4ATVQcwlTnd_WTSimMo.2 2024-09-12T19:22:59.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.521__multipart_mymultipart.2~nOruLCSv8TfM4ATVQcwlTnd_WTSimMo.3 2024-09-12T19:22:59.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.202+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15260762077424348035', time=2024-09-12T20:55:54.643079+0000, chain.objs.size()=1 2024-09-12T19:22:59.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.557__shadow_.r8pRihyzjyXPDsym7BPl6Y43ddQTDOz_0 2024-09-12T19:22:59.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.202+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8784980364484938118', time=2024-09-12T20:57:01.062132+0000, chain.objs.size()=1 2024-09-12T19:22:59.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:fs4hiuexRwsjthN6lhJOi60Qcc9tWp8_.ioPahu-u7xPyMPI4yfTvHecFAzQRg8L_0 2024-09-12T19:22:59.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.206+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9060198089014522897', time=2024-09-12T20:57:14.868190+0000, chain.objs.size()=1 2024-09-12T19:22:59.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.206+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.572__shadow:S7yxCtXmoj1SvbEpX3LttAOBaat.hlW_.5rXIw0MvsrPi-o5qaFHew1Ya3KLJ3dF_0 2024-09-12T19:22:59.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.206+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3838115284263298582', time=2024-09-12T20:57:15.122831+0000, chain.objs.size()=1 2024-09-12T19:22:59.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.206+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.572__shadow_.vO_ZA3HwZ18TNByjELGNilvL2vJiH4f_0 2024-09-12T19:22:59.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.206+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10803668180558983850', time=2024-09-12T20:57:32.588198+0000, chain.objs.size()=1 2024-09-12T19:22:59.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.206+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.575__shadow:yT.AAaPSk.C5NlvnEfyP.LGCFYH93Yj_.ODV0eG-148O8e0IrvAb8jrsgIhvI8Il_0 2024-09-12T19:22:59.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.206+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11506597774235056536', time=2024-09-12T20:59:55.461573+0000, chain.objs.size()=1 2024-09-12T19:22:59.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.206+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.587__shadow:xC1TWgbGi6uuQLHAZfy171kCuSL1nCe_.yZQkh7AIefH87zBRp3zenoo6J4LikxN_0 2024-09-12T19:22:59.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.206+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16170527421323627989', time=2024-09-12T21:00:23.275172+0000, chain.objs.size()=1 2024-09-12T19:22:59.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.206+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.602__shadow_.TrR3t_JVbV_lNejoV3J03KMOt55H7fv_0 2024-09-12T19:22:59.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.206+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15265303723052661693', time=2024-09-12T21:07:50.752686+0000, chain.objs.size()=2 2024-09-12T19:22:59.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.206+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.645__shadow_.a5Y_6ejc_T5cR0PrFpJk2y4wce-g4zw_0 2024-09-12T19:22:59.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.206+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.645__shadow_.a5Y_6ejc_T5cR0PrFpJk2y4wce-g4zw_1 2024-09-12T19:22:59.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.214+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:22:59.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T19:22:59.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:22:59.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:22:59.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/60505' 2024-09-12T19:22:59.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15247986025993557461', time=2024-09-12T20:23:13.134505+0000, chain.objs.size()=3 2024-09-12T19:22:59.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.161__multipart_foo-FROZEN.2~InXn5W1xsO91DCUpU0ddRNnRy8bNzHp.1 2024-09-12T19:22:59.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.161__multipart_foo-FROZEN.2~InXn5W1xsO91DCUpU0ddRNnRy8bNzHp.2 2024-09-12T19:22:59.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.161__multipart_foo-FROZEN.2~InXn5W1xsO91DCUpU0ddRNnRy8bNzHp.3 2024-09-12T19:22:59.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13086262909290972910', time=2024-09-12T20:25:09.677110+0000, chain.objs.size()=1 2024-09-12T19:22:59.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.199__shadow_.6xCjIJWD462oU1h6JXT_nIVwf9Gb49V_0 2024-09-12T19:22:59.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4380564958679938205', time=2024-09-12T20:29:07.119420+0000, chain.objs.size()=1 2024-09-12T19:22:59.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.238__shadow_.DlopPuNB67iygktEjNng6LL2auEStiS_0 2024-09-12T19:22:59.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17837764090072499839', time=2024-09-12T20:29:07.128161+0000, chain.objs.size()=1 2024-09-12T19:22:59.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.238__shadow_.S6_RH3fhVGoLRdb1nm28qSCYdHrfSOz_0 2024-09-12T19:22:59.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18326895502978769730', time=2024-09-12T20:29:15.540253+0000, chain.objs.size()=1 2024-09-12T19:22:59.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.242__shadow_.fVzXy-8sVJOoGTtvzlqYVFYaP9Qhvur_0 2024-09-12T19:22:59.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3826694101605892003', time=2024-09-12T20:31:45.788097+0000, chain.objs.size()=1 2024-09-12T19:22:59.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.DPcJM5SxatEC_WlSH_MG9PXQoEdI8hf_0 2024-09-12T19:22:59.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7314851694111668214', time=2024-09-12T20:31:46.814289+0000, chain.objs.size()=1 2024-09-12T19:22:59.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.uH0TXY1PGTJ826ql6Oznq3od5pexE1s_0 2024-09-12T19:22:59.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9563563474229222275', time=2024-09-12T20:31:46.818689+0000, chain.objs.size()=1 2024-09-12T19:22:59.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Uan86K96HReoeBo9bXlsXRKGy1lPC1X_0 2024-09-12T19:22:59.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2064704277541198734', time=2024-09-12T20:31:47.238710+0000, chain.objs.size()=1 2024-09-12T19:22:59.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.RHHteaPJ-lC1G-GRqk7YGpoICAaFcjG_0 2024-09-12T19:22:59.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1712032160243419473', time=2024-09-12T20:31:47.713733+0000, chain.objs.size()=1 2024-09-12T19:22:59.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.222+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.qRiXMINI_wVqQeaksDQxL2ZVbW69mge_0 2024-09-12T19:22:59.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9603973247955864923', time=2024-09-12T20:31:48.199691+0000, chain.objs.size()=1 2024-09-12T19:22:59.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Jepb5E62wcJbH6LMeseLuoHqV1eUMx6_0 2024-09-12T19:22:59.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7519822645136391666', time=2024-09-12T20:31:50.137018+0000, chain.objs.size()=1 2024-09-12T19:22:59.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.sCXjG2bXnKRoebm6nljJhNQ_JfkfuUB_0 2024-09-12T19:22:59.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1818928294593938913', time=2024-09-12T20:31:50.372807+0000, chain.objs.size()=1 2024-09-12T19:22:59.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.otpWOrMFoHPrAU6w0A8H6Ek62nvXhdw_0 2024-09-12T19:22:59.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5121861449704105605', time=2024-09-12T20:31:50.532248+0000, chain.objs.size()=1 2024-09-12T19:22:59.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.hm8jjEBoT2C5aHYUOXRY7Gjzn-gCrwP_0 2024-09-12T19:22:59.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14290350152488404329', time=2024-09-12T20:31:51.237219+0000, chain.objs.size()=1 2024-09-12T19:22:59.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.lX2fNXHVE7VkNqjzvPDkoz8-hjSuS9m_0 2024-09-12T19:22:59.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8856272723747925574', time=2024-09-12T20:31:51.661170+0000, chain.objs.size()=1 2024-09-12T19:22:59.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.AE3gDlXDV5nU4onEUIGERMkcFqKcHYx_0 2024-09-12T19:22:59.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9312426924273369523', time=2024-09-12T20:31:51.959237+0000, chain.objs.size()=1 2024-09-12T19:22:59.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ZHM0sB1zZgC0ia1wUlLgXpHHHlD-nCm_0 2024-09-12T19:22:59.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16897873977039281494', time=2024-09-12T20:31:51.977452+0000, chain.objs.size()=1 2024-09-12T19:22:59.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.1I-NYb22bpuSYo0RhjqJWpIkkSH9YYo_0 2024-09-12T19:22:59.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3438680848525982658', time=2024-09-12T20:31:52.055662+0000, chain.objs.size()=1 2024-09-12T19:22:59.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.r-wCH3Fc8vqBCTPnTXrFy5VCxfPT22k_0 2024-09-12T19:22:59.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2156157265830654831', time=2024-09-12T20:31:52.057528+0000, chain.objs.size()=1 2024-09-12T19:22:59.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.rTV9eZ4aCypkKpkausxK8sOQ7oNdWhe_0 2024-09-12T19:22:59.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7866251628574356356', time=2024-09-12T20:31:54.000803+0000, chain.objs.size()=1 2024-09-12T19:22:59.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.8JEO6-GYozOGavTXbamFu3djGWdyX2y_0 2024-09-12T19:22:59.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.234+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4280174573872147059', time=2024-09-12T20:31:54.248598+0000, chain.objs.size()=1 2024-09-12T19:22:59.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.234+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.4HBI_IuZb-FEM_ssvdY9ZJBoYd59Ly9_0 2024-09-12T19:22:59.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.234+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2243842743750162840', time=2024-09-12T20:31:54.833064+0000, chain.objs.size()=1 2024-09-12T19:22:59.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.234+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.KijosCMm3zwk5dQP6IUmgFJ64Kvt6Bk_0 2024-09-12T19:22:59.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.234+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10295823712846684870', time=2024-09-12T20:31:54.835296+0000, chain.objs.size()=1 2024-09-12T19:22:59.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.234+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.LEvj1jIWbiVnzOgiEHmnqNeLxDBMQgN_0 2024-09-12T19:22:59.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.234+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3166028160815125470', time=2024-09-12T20:31:57.578309+0000, chain.objs.size()=1 2024-09-12T19:22:59.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.234+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Z4QfEEAwa5Bm2s5xJrdCwMzv0g4rCbp_0 2024-09-12T19:22:59.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.238+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15005060422545249859', time=2024-09-12T20:31:58.855780+0000, chain.objs.size()=1 2024-09-12T19:22:59.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.238+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.5cQ6TfC_8RH8CV4sij7RTNurYFHvAv6_0 2024-09-12T19:22:59.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.238+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14043842584856771486', time=2024-09-12T20:31:59.348799+0000, chain.objs.size()=1 2024-09-12T19:22:59.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.238+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.G5D0ig3EpSI69PrCq5iNeJDR8G0vECq_0 2024-09-12T19:22:59.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.238+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12509084909821504895', time=2024-09-12T20:31:59.493033+0000, chain.objs.size()=1 2024-09-12T19:22:59.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.238+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ptWzlAZVAf2JveFJHVc5mIO2qMGc2lA_0 2024-09-12T19:22:59.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.238+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3954685104990018616', time=2024-09-12T20:31:59.693744+0000, chain.objs.size()=1 2024-09-12T19:22:59.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.238+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.BQW5umbXO6qHETCprhtI8PjXsiicBqk_0 2024-09-12T19:22:59.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.238+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14043747233689157833', time=2024-09-12T20:32:00.728202+0000, chain.objs.size()=1 2024-09-12T19:22:59.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.238+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.mTXa-XG_ByA5ZsqYViU-4mohY8K48ae_0 2024-09-12T19:22:59.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.238+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4598286850412672108', time=2024-09-12T20:32:00.839862+0000, chain.objs.size()=1 2024-09-12T19:22:59.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.238+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.386BtBOmB0bIgIVZiTNl2VPJrH9dBT0_0 2024-09-12T19:22:59.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.238+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17026263496377505835', time=2024-09-12T20:32:02.392462+0000, chain.objs.size()=1 2024-09-12T19:22:59.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.238+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.UQmMF1848NUqgM6yAlyC8Wo0KePHJrS_0 2024-09-12T19:22:59.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4460231485222417882', time=2024-09-12T20:32:05.301737+0000, chain.objs.size()=1 2024-09-12T19:22:59.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.11ACzXq8-JDQJ_m7WdCisKbevo1FAEY_0 2024-09-12T19:22:59.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3498668310133576226', time=2024-09-12T20:32:08.792235+0000, chain.objs.size()=1 2024-09-12T19:22:59.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.rCa7NiflEXOczY3K-J1MdEOScwckZmd_0 2024-09-12T19:22:59.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4609682308162152200', time=2024-09-12T20:32:08.857535+0000, chain.objs.size()=1 2024-09-12T19:22:59.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.NFA6q2VRzePr3emgwj-_P0U9-AIQHpF_0 2024-09-12T19:22:59.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14113779944348847314', time=2024-09-12T20:32:09.326631+0000, chain.objs.size()=1 2024-09-12T19:22:59.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.fqkwbJJ8tVr8JDl0gxmsSyMfBKu-Fx0_0 2024-09-12T19:22:59.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12838186491645801440', time=2024-09-12T20:32:10.064580+0000, chain.objs.size()=1 2024-09-12T19:22:59.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Xk2ny86pxKcyxLF0ASoLKEd7p18PyTe_0 2024-09-12T19:22:59.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5131495516844431996', time=2024-09-12T20:32:11.968124+0000, chain.objs.size()=1 2024-09-12T19:22:59.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.t78x2rfV4KV6PKi-LpLeL2-6wqZee6R_0 2024-09-12T19:22:59.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4476101996758647749', time=2024-09-12T20:32:12.841139+0000, chain.objs.size()=1 2024-09-12T19:22:59.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.UkuzZNzVYzGoektvnlxNt6603W037l1_0 2024-09-12T19:22:59.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2697575646104699846', time=2024-09-12T20:32:13.011013+0000, chain.objs.size()=1 2024-09-12T19:22:59.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.IWvvOTecHIxyst1OHL8VZNi6pBZyAUL_0 2024-09-12T19:22:59.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9432582488784195272', time=2024-09-12T20:32:13.179753+0000, chain.objs.size()=1 2024-09-12T19:22:59.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.uu4TSaQFJB0uzdkHd-P2BdtD7fdhhlu_0 2024-09-12T19:22:59.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7011135371543758341', time=2024-09-12T20:32:13.474746+0000, chain.objs.size()=1 2024-09-12T19:22:59.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.C04TXLD8dxRG9IcJaQ0j6JAt_KJxlBX_0 2024-09-12T19:22:59.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2240941154955408383', time=2024-09-12T20:32:13.578539+0000, chain.objs.size()=1 2024-09-12T19:22:59.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Ol-S1YIU8c3EX6ln-un1hGzYmNNwFfd_0 2024-09-12T19:22:59.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4722030561760627286', time=2024-09-12T20:33:25.704363+0000, chain.objs.size()=1 2024-09-12T19:22:59.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.NfjOhwhxk8-sPcNhUQIyYYmo0dCFY1m_0 2024-09-12T19:22:59.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13718489173013343310', time=2024-09-12T20:33:31.341781+0000, chain.objs.size()=1 2024-09-12T19:22:59.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.pBEf3lUAxdZClIwYGMx8dBDm7Tfc2uB_0 2024-09-12T19:22:59.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11220275855294931602', time=2024-09-12T20:33:54.921573+0000, chain.objs.size()=1 2024-09-12T19:22:59.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.246+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.303__shadow_.8gEoDwykAlqgn_uIGpZJQKU85hnHCeQ_0 2024-09-12T19:22:59.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3501579131032778130', time=2024-09-12T20:34:44.821519+0000, chain.objs.size()=1 2024-09-12T19:22:59.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.322__shadow_.S-9dKV4c80Q3Sxpgbbjdcr8PVZVZGxD_0 2024-09-12T19:22:59.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3324519793157525858', time=2024-09-12T20:36:27.911893+0000, chain.objs.size()=1 2024-09-12T19:22:59.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ZvgDZrC6p9dW7PweUrCOl_rm35SSXRK_0 2024-09-12T19:22:59.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8122481753249965102', time=2024-09-12T20:36:28.485271+0000, chain.objs.size()=1 2024-09-12T19:22:59.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.MjYbFf-__hBc9NReVbvo-cCdyr4y4k9_0 2024-09-12T19:22:59.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10915747545625688387', time=2024-09-12T20:36:28.682082+0000, chain.objs.size()=1 2024-09-12T19:22:59.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Ja9NqdHco5FD3me7TMWHaVchnFr1CeH_0 2024-09-12T19:22:59.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3225813918442671013', time=2024-09-12T20:36:29.208379+0000, chain.objs.size()=1 2024-09-12T19:22:59.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.XET8rXyIP16rc7idYo1easnqkbk-6GL_0 2024-09-12T19:22:59.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14064737665480734710', time=2024-09-12T20:36:30.846230+0000, chain.objs.size()=1 2024-09-12T19:22:59.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.v4I13i9-Qs7Ck_YY-CxdApKgO9ZRKkQ_0 2024-09-12T19:22:59.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.254+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2886419418486517712', time=2024-09-12T20:36:30.873001+0000, chain.objs.size()=1 2024-09-12T19:22:59.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.254+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.g1mmMsOC5H1bUhAG9KIoOPCac7qRCv2_0 2024-09-12T19:22:59.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.254+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11167579033170683716', time=2024-09-12T20:36:33.325672+0000, chain.objs.size()=1 2024-09-12T19:22:59.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.254+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.-ZA06Ca8XlMLuaUNXEovwaiouC_LVZl_0 2024-09-12T19:22:59.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.254+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15895991489532896168', time=2024-09-12T20:36:33.903038+0000, chain.objs.size()=1 2024-09-12T19:22:59.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.254+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.vSn6YTC1nKnvi1rfc5gnaC-NgUhRqJr_0 2024-09-12T19:22:59.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.254+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11734263398378438524', time=2024-09-12T20:36:35.783219+0000, chain.objs.size()=1 2024-09-12T19:22:59.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.254+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.hwnu-9HsOfoVTw0ahSQv1thRIaDEiyv_0 2024-09-12T19:22:59.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.254+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4441448490621618683', time=2024-09-12T20:36:36.058750+0000, chain.objs.size()=1 2024-09-12T19:22:59.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.254+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.m-7ILXgRAMOwe6r3EEkq8pDW-2TzfdT_0 2024-09-12T19:22:59.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11874340293792754671', time=2024-09-12T20:36:36.060772+0000, chain.objs.size()=1 2024-09-12T19:22:59.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.0bO1oYyZqbPi0XQEGGN0sP34BOF405S_0 2024-09-12T19:22:59.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.530191617275149885', time=2024-09-12T20:36:36.439761+0000, chain.objs.size()=1 2024-09-12T19:22:59.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.F76bKLsqYCVw2kXDjnzqOjZ8Welzjsp_0 2024-09-12T19:22:59.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5166475103745262294', time=2024-09-12T20:36:36.982409+0000, chain.objs.size()=1 2024-09-12T19:22:59.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.2jCHyjNQEWAvtNlJTJM56E_k-JI6sIk_0 2024-09-12T19:22:59.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16408857622912299243', time=2024-09-12T20:36:37.223537+0000, chain.objs.size()=1 2024-09-12T19:22:59.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ZWoCE9shr0sHmUvhNeVkLj2pCkr3hod_0 2024-09-12T19:22:59.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15095373859046758359', time=2024-09-12T20:36:37.309334+0000, chain.objs.size()=1 2024-09-12T19:22:59.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.d5PvLgIeFrmb4aX2Q8Fv1WGP87xLcVm_0 2024-09-12T19:22:59.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11285223899066744133', time=2024-09-12T20:36:37.519022+0000, chain.objs.size()=1 2024-09-12T19:22:59.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.N2pyVta3HU363czprJq7lV-0kq60QGL_0 2024-09-12T19:22:59.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2986735867001195715', time=2024-09-12T20:36:41.191754+0000, chain.objs.size()=1 2024-09-12T19:22:59.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Kdy94uxFlFZLYbQ6ELAxhl7oKAiCryl_0 2024-09-12T19:22:59.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7133323886686038259', time=2024-09-12T20:36:51.019581+0000, chain.objs.size()=1 2024-09-12T19:22:59.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.vMvbS0ZrAbvJyFTF2C5vsB85ilCU3_F_0 2024-09-12T19:22:59.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11504514331572934625', time=2024-09-12T20:36:51.021261+0000, chain.objs.size()=1 2024-09-12T19:22:59.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.IHr85f6C-InBjipyF9qHYzYU5QEH_Vl_0 2024-09-12T19:22:59.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.262+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5681877113034741673', time=2024-09-12T20:36:51.210523+0000, chain.objs.size()=1 2024-09-12T19:22:59.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.262+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.u7Tj4bNKQ1zZjmEg2cDNbMyUpdNM2wx_0 2024-09-12T19:22:59.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.262+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2878013901995412597', time=2024-09-12T20:36:52.320566+0000, chain.objs.size()=1 2024-09-12T19:22:59.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.262+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.tbJKL2md_zmkQzdRiyQ2OurtBf6yto0_0 2024-09-12T19:22:59.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.266+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17151089986043915842', time=2024-09-12T20:36:53.034412+0000, chain.objs.size()=1 2024-09-12T19:22:59.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.266+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.-kH6oKotDegXfOVqyOcmU5jobkXF4Bg_0 2024-09-12T19:22:59.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.266+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3885696122500563419', time=2024-09-12T20:36:54.615315+0000, chain.objs.size()=1 2024-09-12T19:22:59.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.266+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.o3I5ak8FG0ZqP3MuRKQNUqTz4XY5t8W_0 2024-09-12T19:22:59.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.266+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2830405708897394252', time=2024-09-12T20:36:54.892942+0000, chain.objs.size()=1 2024-09-12T19:22:59.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.266+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.kQw91soTvsIV1V5Ec10HcjIhf5rh-uL_0 2024-09-12T19:22:59.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.266+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7782471045218793463', time=2024-09-12T20:36:55.940713+0000, chain.objs.size()=1 2024-09-12T19:22:59.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.266+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.YdW6CcfFArKs8wXukvYfV7o-2qoRmi8_0 2024-09-12T19:22:59.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.266+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2823698167327065748', time=2024-09-12T20:38:39.661051+0000, chain.objs.size()=1 2024-09-12T19:22:59.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.266+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.WAz2OmmP_J10iayFm5L2YEzUmZV0aX6_0 2024-09-12T19:22:59.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.266+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6351941353333584280', time=2024-09-12T20:38:40.211095+0000, chain.objs.size()=1 2024-09-12T19:22:59.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.266+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.i5K61rEIIyq2n8pBiiyiBgw15GFPM3I_0 2024-09-12T19:22:59.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.266+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4649277356724383932', time=2024-09-12T20:38:40.541901+0000, chain.objs.size()=1 2024-09-12T19:22:59.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.266+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.0w5RY9uTxT2a6rWgrHbzS2y-HKXmVzi_0 2024-09-12T19:22:59.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.266+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4277047020784727036', time=2024-09-12T20:38:41.282527+0000, chain.objs.size()=1 2024-09-12T19:22:59.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.266+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.6N51knAI0Q-IqF4QMq0rnzMekVn9Hq0_0 2024-09-12T19:22:59.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.266+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11503593049583546301', time=2024-09-12T20:38:42.076073+0000, chain.objs.size()=1 2024-09-12T19:22:59.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.266+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.lh_93kkKY9P8j_J0ouhmqysEF-mNvMk_0 2024-09-12T19:22:59.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.266+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3286963128402911192', time=2024-09-12T20:38:44.468494+0000, chain.objs.size()=1 2024-09-12T19:22:59.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.266+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.qmPuHRfit5hS-ip0C_Iczm5rWlNpJiV_0 2024-09-12T19:22:59.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10215377568477216726', time=2024-09-12T20:38:45.410757+0000, chain.objs.size()=1 2024-09-12T19:22:59.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.270+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.vay5F7IF4r8ptKz1H6zvJWdlvxcCFBh_0 2024-09-12T19:22:59.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5708046806961649697', time=2024-09-12T20:38:46.175880+0000, chain.objs.size()=1 2024-09-12T19:22:59.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.270+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.v1qleD6PB_YuT5-PvX1japp-yU__MNW_0 2024-09-12T19:22:59.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10867269833889200830', time=2024-09-12T20:38:46.225824+0000, chain.objs.size()=1 2024-09-12T19:22:59.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.270+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.pDucS0mbWwOWyrs83ziFRY8I8vajBUe_0 2024-09-12T19:22:59.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17449406695749979532', time=2024-09-12T20:38:46.361867+0000, chain.objs.size()=1 2024-09-12T19:22:59.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.270+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ZLKJ6hbbikhCjryN9Sh9BvODQzeCT6i_0 2024-09-12T19:22:59.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8352575326373173779', time=2024-09-12T20:38:52.556266+0000, chain.objs.size()=1 2024-09-12T19:22:59.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.270+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.yYvg-Y6cwFmzFltMRs_6l4r9tpwnn_d_0 2024-09-12T19:22:59.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.274+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11383433314626840826', time=2024-09-12T20:38:53.379728+0000, chain.objs.size()=1 2024-09-12T19:22:59.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.274+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.b1nxDrTkUMXuNXhok9MfIW0e84vezPQ_0 2024-09-12T19:22:59.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.274+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3957332741118686752', time=2024-09-12T20:38:53.663209+0000, chain.objs.size()=1 2024-09-12T19:22:59.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.274+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.4WIcHDP79FRM630bgE80IRoGcH9pXSJ_0 2024-09-12T19:22:59.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.274+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2111714331633027089', time=2024-09-12T20:38:53.929235+0000, chain.objs.size()=1 2024-09-12T19:22:59.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.274+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ItJBqAvwrvthipz622I_iyJpXQ5ZhMG_0 2024-09-12T19:22:59.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.274+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10776693964242300306', time=2024-09-12T20:38:54.068019+0000, chain.objs.size()=1 2024-09-12T19:22:59.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.274+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.79umviXlh3xRIiHGGyjrCifdayL9fGr_0 2024-09-12T19:22:59.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.274+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1910366963350391212', time=2024-09-12T20:38:55.474000+0000, chain.objs.size()=1 2024-09-12T19:22:59.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.274+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.MqRy_0uqT9L7yOglqiYpIdmD1fNa4Af_0 2024-09-12T19:22:59.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.274+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11813156124672640105', time=2024-09-12T20:38:56.349924+0000, chain.objs.size()=1 2024-09-12T19:22:59.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.274+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.uRXEj3RXk5_wUyixA_KXZbf9iBfU18N_0 2024-09-12T19:22:59.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.274+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16150972307967422199', time=2024-09-12T20:38:56.794094+0000, chain.objs.size()=1 2024-09-12T19:22:59.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.274+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.1MZ8eJHJgkwjz-8u9bJ1hs4bDKoSba0_0 2024-09-12T19:22:59.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6047804715534478276', time=2024-09-12T20:38:57.242054+0000, chain.objs.size()=1 2024-09-12T19:22:59.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.cDVW6jtJf_jDrZEcGOUoC8zc-wfyOp6_0 2024-09-12T19:22:59.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15054325236147821394', time=2024-09-12T20:38:57.521569+0000, chain.objs.size()=1 2024-09-12T19:22:59.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.cdWxNkaXTTW9H2Qg4iwDva4OodSUGxP_0 2024-09-12T19:22:59.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17463589100130014323', time=2024-09-12T20:38:57.760004+0000, chain.objs.size()=1 2024-09-12T19:22:59.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.CjGdtyBHTB077SYbrpw-MHbNj2odct__0 2024-09-12T19:22:59.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11675128331240701946', time=2024-09-12T20:39:00.907251+0000, chain.objs.size()=1 2024-09-12T19:22:59.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.2Xpu0niNeGscYc-stAQGZs4GJi7ab9K_0 2024-09-12T19:22:59.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12866866899219994773', time=2024-09-12T20:39:01.033049+0000, chain.objs.size()=1 2024-09-12T19:22:59.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.pATmZ0icfQYdGzFtlkLzdUjK8i_2vfZ_0 2024-09-12T19:22:59.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7398550973100063721', time=2024-09-12T20:39:03.299803+0000, chain.objs.size()=1 2024-09-12T19:22:59.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.oxm_WVAq1Y9kfUzjc2dyfrUdf_VzyVp_0 2024-09-12T19:22:59.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17846512195163388397', time=2024-09-12T20:39:03.523281+0000, chain.objs.size()=1 2024-09-12T19:22:59.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.q4asg8xrrmIsKpQSVigFoPGfL97ouZT_0 2024-09-12T19:22:59.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.282+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12711269075278207623', time=2024-09-12T20:39:04.436258+0000, chain.objs.size()=1 2024-09-12T19:22:59.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.282+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.UgSawNpI6G2dn6hq6tHALEkHwwh5xvT_0 2024-09-12T19:22:59.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.282+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9247249417930653489', time=2024-09-12T20:39:04.657147+0000, chain.objs.size()=1 2024-09-12T19:22:59.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.282+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.BN5_N9FiBKewc2Gi-38wTmBOukLFNBX_0 2024-09-12T19:22:59.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.282+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17348359691203645494', time=2024-09-12T20:39:04.729308+0000, chain.objs.size()=1 2024-09-12T19:22:59.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.282+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.1bEtQUC7ULN1i-u6bRzjb-MlvNoqZVt_0 2024-09-12T19:22:59.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.286+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/60505 2024-09-12T19:22:59.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T19:22:59.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13078509612309982490', time=2024-09-12T20:39:04.926680+0000, chain.objs.size()=1 2024-09-12T19:22:59.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.c2EL7XTY5wxcHRrW0o1qbtnoMlGGCVt_0 2024-09-12T19:22:59.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3898377447686372163', time=2024-09-12T20:39:07.979643+0000, chain.objs.size()=1 2024-09-12T19:22:59.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.dKGLA7bAPPXUaspibX1PoYc6b8MvAOc_0 2024-09-12T19:22:59.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16659253100526777619', time=2024-09-12T20:42:42.598869+0000, chain.objs.size()=1 2024-09-12T19:22:59.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.432__shadow_.dY5EwgweqybnE-oDGDNeQqtJ8IueHKC_0 2024-09-12T19:22:59.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9799899272824310', time=2024-09-12T20:43:37.686900+0000, chain.objs.size()=1 2024-09-12T19:22:59.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.456__shadow_.ysZu-mv4orkM4MuqZodINmq8TTx_LpH_0 2024-09-12T19:22:59.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10126816140155382770', time=2024-09-12T20:44:01.471366+0000, chain.objs.size()=1 2024-09-12T19:22:59.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.464__shadow_.Ow3mmxVGSkazZt2FAI8PMCYDRAgFbvK_0 2024-09-12T19:22:59.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3960527139452707306', time=2024-09-12T20:44:06.468278+0000, chain.objs.size()=1 2024-09-12T19:22:59.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.466__shadow_.DRNORi3mQAoqRo4sL0OUG4rTqfv5Pqk_0 2024-09-12T19:22:59.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16333302722212389986', time=2024-09-12T20:44:33.740741+0000, chain.objs.size()=1 2024-09-12T19:22:59.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.483__shadow_.oywZMDzFNx3-FWkIc_06GiDzNjv2UrE_0 2024-09-12T19:22:59.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11519998842787723654', time=2024-09-12T20:48:14.610237+0000, chain.objs.size()=1 2024-09-12T19:22:59.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.520__shadow:IKyHQwP-fM99mAYp6c5wrUrtkpmW6C5_.VX0XMi-bG0WI1YedtfbqdYbaUBBqkAL_0 2024-09-12T19:22:59.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14017932147922068693', time=2024-09-12T20:55:17.835384+0000, chain.objs.size()=1 2024-09-12T19:22:59.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.553__shadow_.LPk0hmELPY_QLdbIcRFwHmYxS7ouJXZ_0 2024-09-12T19:22:59.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17236163596602300883', time=2024-09-12T20:56:33.555036+0000, chain.objs.size()=1 2024-09-12T19:22:59.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.564__shadow_.RKzPNoYm1eusb-h60gW3EzNOeGyxNWl_0 2024-09-12T19:22:59.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2786132064307960147', time=2024-09-12T20:57:04.868312+0000, chain.objs.size()=1 2024-09-12T19:22:59.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:JgnyVfVxH8pT6PXtFvQ8CmEULUgBH-s_.wt68XXYSBxeAkr_CXChgmuwhRCpvK0V_0 2024-09-12T19:22:59.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14040945681908022281', time=2024-09-12T20:57:18.325212+0000, chain.objs.size()=1 2024-09-12T19:22:59.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.573__shadow_.CiNiM8C3UhGMII3Q4igIYj3CqQ4AUaY_0 2024-09-12T19:22:59.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.298+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4315976606201533615', time=2024-09-12T20:58:01.461418+0000, chain.objs.size()=1 2024-09-12T19:22:59.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.298+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:sJE3E1h6p-CPNN21kPnhtF-9cWJjvg3_.96oY3fQrTVbXnjCJj0CZsT3BNbDsuj3_0 2024-09-12T19:22:59.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.302+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17069443064648568265', time=2024-09-12T20:58:06.854506+0000, chain.objs.size()=1 2024-09-12T19:22:59.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.302+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:G5y.YO9PLqwL5LGw9N1Srntl-HqddL._.sKjYEZPNSrcl6uGBU_19LKO614BOi7q_0 2024-09-12T19:22:59.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.302+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5597670865024371032', time=2024-09-12T21:07:09.105691+0000, chain.objs.size()=1 2024-09-12T19:22:59.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.302+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.631__shadow_.TXcQh3RuZlHcfKlFVaDfZHjeontBy9y_0 2024-09-12T19:22:59.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.302+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3610253500986021409', time=2024-09-12T21:12:52.786266+0000, chain.objs.size()=1 2024-09-12T19:22:59.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.302+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.739__shadow_.IHu6LgtJmpQWskZfKv4XngrpMXSIYkd_0 2024-09-12T19:22:59.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:22:59.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T19:22:59.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:22:59.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:22:59.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47243' 2024-09-12T19:22:59.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15992862443223069786', time=2024-09-12T20:21:30.376764+0000, chain.objs.size()=1 2024-09-12T19:22:59.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.151__shadow_.lQWGtJWAUuRhIAUC5h1myGsXKWO6FX5_0 2024-09-12T19:22:59.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6820265273569383811', time=2024-09-12T20:24:19.672833+0000, chain.objs.size()=1 2024-09-12T19:22:59.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.183__shadow_.07AeXN3DwzAxFg0_5Usj9gqQTQs9Ztj_0 2024-09-12T19:22:59.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10474501933201029763', time=2024-09-12T20:28:42.920626+0000, chain.objs.size()=1 2024-09-12T19:22:59.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.228__shadow_.7dME2VRZkivkm1d5jG-ZIlfeKlz7Y6r_0 2024-09-12T19:22:59.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17275058611556798262', time=2024-09-12T20:28:52.469306+0000, chain.objs.size()=1 2024-09-12T19:22:59.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.233__shadow_.a7BCgHdNK_oXzIPn31Y17SttcDP2K-2_0 2024-09-12T19:22:59.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16068184043768749223', time=2024-09-12T20:29:30.203142+0000, chain.objs.size()=1 2024-09-12T19:22:59.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.247__shadow_.RguqxSlbQ9bMO5_khJ_0Mdyeswcg76w_0 2024-09-12T19:22:59.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7501108151505059067', time=2024-09-12T20:29:34.781905+0000, chain.objs.size()=1 2024-09-12T19:22:59.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.249__shadow_.xD0RYkMK72mjzW0jkP2V9ijD_yixyuH_0 2024-09-12T19:22:59.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4821462706096217172', time=2024-09-12T20:29:41.680905+0000, chain.objs.size()=1 2024-09-12T19:22:59.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.252__shadow_.901wP4AhBeTDSKdWq6MxOylLk1-vnrK_0 2024-09-12T19:22:59.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3636984422681350065', time=2024-09-12T20:31:46.245399+0000, chain.objs.size()=1 2024-09-12T19:22:59.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_._ZVPlD3woQ5bKkb_gOi2Scqh_IOlAuw_0 2024-09-12T19:22:59.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17825815315946267967', time=2024-09-12T20:31:47.282129+0000, chain.objs.size()=1 2024-09-12T19:22:59.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.rxkt-u5w6HkiuE72Gu_8Pae6m1LO-G2_0 2024-09-12T19:22:59.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10381209490513436156', time=2024-09-12T20:31:49.727535+0000, chain.objs.size()=1 2024-09-12T19:22:59.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.l3JQlmaxXcFNgBJpxb_P3Ia1Wml64kR_0 2024-09-12T19:22:59.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15384918338641844489', time=2024-09-12T20:31:50.388876+0000, chain.objs.size()=1 2024-09-12T19:22:59.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.vE_24uGZfxfYLoewZfENH2CfjYibmti_0 2024-09-12T19:22:59.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16888059309405841903', time=2024-09-12T20:31:54.923852+0000, chain.objs.size()=1 2024-09-12T19:22:59.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.M_yx6nU5C3yCfi6QU4MSvSU8R-0PTtD_0 2024-09-12T19:22:59.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.318+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12785002296441228851', time=2024-09-12T20:31:55.057237+0000, chain.objs.size()=1 2024-09-12T19:22:59.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.318+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.vVgNlwv2jd-GNND9pn0okOnq7aollr0_0 2024-09-12T19:22:59.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.318+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.952748276291363439', time=2024-09-12T20:31:56.902059+0000, chain.objs.size()=1 2024-09-12T19:22:59.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.318+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ABBsl3Tfz8xU58GUIVIT77wBBNHhCYT_0 2024-09-12T19:22:59.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.318+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5967264991685270204', time=2024-09-12T20:31:57.288592+0000, chain.objs.size()=1 2024-09-12T19:22:59.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.318+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.MA7uqDk4odGDFT3kA7ObU01w4C4rV93_0 2024-09-12T19:22:59.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.318+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6691157116827017585', time=2024-09-12T20:31:57.698897+0000, chain.objs.size()=1 2024-09-12T19:22:59.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.318+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.I1QCSM3gxZytVGc9rqlMYGO4wKlWy-R_0 2024-09-12T19:22:59.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10678719369266754157', time=2024-09-12T20:31:58.152325+0000, chain.objs.size()=1 2024-09-12T19:22:59.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.j9uWWshpj2NSealRingQ7Xf0ydkxQNz_0 2024-09-12T19:22:59.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14711739125313235533', time=2024-09-12T20:32:01.155618+0000, chain.objs.size()=1 2024-09-12T19:22:59.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ZNAGDVQkVLbkp51sF2qYUgshLPxN58u_0 2024-09-12T19:22:59.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2445820427038292812', time=2024-09-12T20:32:04.499829+0000, chain.objs.size()=1 2024-09-12T19:22:59.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.dYM2kzn9fmHNBqhrg5WpHhFbnXjATwx_0 2024-09-12T19:22:59.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8924381291181613037', time=2024-09-12T20:32:04.695077+0000, chain.objs.size()=1 2024-09-12T19:22:59.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Sl8MHBHNH5NVWo6erFwJATg9aa52EwL_0 2024-09-12T19:22:59.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14254834225201886410', time=2024-09-12T20:32:06.132501+0000, chain.objs.size()=1 2024-09-12T19:22:59.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.aN-1qRteM5pjzGaZzinr4bbhvyqKfsH_0 2024-09-12T19:22:59.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1833186909470066574', time=2024-09-12T20:32:08.288992+0000, chain.objs.size()=1 2024-09-12T19:22:59.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Hk8PB7XI3uRcj6zKmnxSohJcDPR04pk_0 2024-09-12T19:22:59.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14796205281008431858', time=2024-09-12T20:32:09.343779+0000, chain.objs.size()=1 2024-09-12T19:22:59.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.0V2JjdJV1uq99c3SlydR8hIusTIq7Mj_0 2024-09-12T19:22:59.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6073167675146177802', time=2024-09-12T20:32:09.491169+0000, chain.objs.size()=1 2024-09-12T19:22:59.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.zvl4pGT7QnJ8ritQmu1avu1khMDnhME_0 2024-09-12T19:22:59.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.326+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13577888826511075254', time=2024-09-12T20:32:13.096707+0000, chain.objs.size()=1 2024-09-12T19:22:59.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.326+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.heC90VlvDez13iphNgIwExyTRQQZxIX_0 2024-09-12T19:22:59.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.326+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9015890539687936828', time=2024-09-12T20:32:13.485464+0000, chain.objs.size()=1 2024-09-12T19:22:59.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.326+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.4RAQoKqkrfWOC424KodFGi415aIzIN6_0 2024-09-12T19:22:59.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.326+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16138528698196757837', time=2024-09-12T20:32:13.742278+0000, chain.objs.size()=1 2024-09-12T19:22:59.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.326+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.lFcYLH3wr1TaxqhNzWkHKpGP81hejvD_0 2024-09-12T19:22:59.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.326+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1342582556068006295', time=2024-09-12T20:32:13.905793+0000, chain.objs.size()=1 2024-09-12T19:22:59.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.326+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.sM1L7oYB8UFK42Gu61BFhIhfbV098W0_0 2024-09-12T19:22:59.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.326+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13466568263549485061', time=2024-09-12T20:32:20.656021+0000, chain.objs.size()=1 2024-09-12T19:22:59.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.326+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.265__shadow_.x1CP5bBuA49fnOTnsjEV17tAupopx99_0 2024-09-12T19:22:59.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.326+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10796010543985689121', time=2024-09-12T20:32:49.481758+0000, chain.objs.size()=1 2024-09-12T19:22:59.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.326+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.278__shadow_.Rtef_jP7yrWBoh5qm1HDUFvyHiamXWO_0 2024-09-12T19:22:59.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.326+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10451524217375131762', time=2024-09-12T20:32:54.192768+0000, chain.objs.size()=1 2024-09-12T19:22:59.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.326+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.280__shadow_.wNAncML8BKjIqdpvaOa7PoJOthRTNRf_0 2024-09-12T19:22:59.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.326+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9871742365016248181', time=2024-09-12T20:33:08.147149+0000, chain.objs.size()=1 2024-09-12T19:22:59.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.326+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.286__shadow_.M7Zgk5EyeF2ulf35WIN18apP5DsiuX2_0 2024-09-12T19:22:59.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.326+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13976737144949753889', time=2024-09-12T20:33:30.989823+0000, chain.objs.size()=1 2024-09-12T19:22:59.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.326+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.4NLHT2WWHelKTvY-zHnJC2V9gaDBBeM_0 2024-09-12T19:22:59.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.326+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5082821570811533399', time=2024-09-12T20:33:43.367551+0000, chain.objs.size()=1 2024-09-12T19:22:59.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.326+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.298__shadow_.8aeheL3D_2kXSfpalnbI38p3w3Kfvnj_0 2024-09-12T19:22:59.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.330+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15680777038656757202', time=2024-09-12T20:33:48.029491+0000, chain.objs.size()=1 2024-09-12T19:22:59.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.330+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.300__shadow_.qb695CQgLQMXHAQ3bHu5dmY8fxiMNEM_0 2024-09-12T19:22:59.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.330+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16023647083411270523', time=2024-09-12T20:34:02.094415+0000, chain.objs.size()=1 2024-09-12T19:22:59.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.330+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.306__shadow_.l2zHohnWn5gVHJ_gYniGVAxtlNVZFCe_0 2024-09-12T19:22:59.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.330+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1539254160876537305', time=2024-09-12T20:36:28.391135+0000, chain.objs.size()=1 2024-09-12T19:22:59.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.330+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.BPb9Bd6k823yeaOos7Ww5Q-Bf4vh-9x_0 2024-09-12T19:22:59.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.330+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11972298711647388371', time=2024-09-12T20:36:28.501680+0000, chain.objs.size()=1 2024-09-12T19:22:59.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.330+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_._7HgXXaCUXmhDx8_G1FEhBVEC1LjcCT_0 2024-09-12T19:22:59.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.334+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1012957080770664523', time=2024-09-12T20:36:29.691574+0000, chain.objs.size()=1 2024-09-12T19:22:59.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.334+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.z2VS5mcOyxYlH82kW33psD1mAIhbKk5_0 2024-09-12T19:22:59.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.334+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16908007320854960373', time=2024-09-12T20:36:29.710234+0000, chain.objs.size()=1 2024-09-12T19:22:59.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.334+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.evaoYiCAUDk_Fh-ylgKoflQvrcfAng3_0 2024-09-12T19:22:59.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.334+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1062764181187678036', time=2024-09-12T20:36:29.951258+0000, chain.objs.size()=1 2024-09-12T19:22:59.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.334+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.tyEIftlvOu7rXxA2GJS08WNrNaRqNpk_0 2024-09-12T19:22:59.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.334+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8351925668831099513', time=2024-09-12T20:36:30.545127+0000, chain.objs.size()=1 2024-09-12T19:22:59.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.334+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.KvThSGPpC5JLZ_TIbYSBg7OL5yNv8mx_0 2024-09-12T19:22:59.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.334+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4036401145834946451', time=2024-09-12T20:36:30.746797+0000, chain.objs.size()=1 2024-09-12T19:22:59.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.334+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.mOJXwlZ4-JC8MQFACOWIvHqGn3BgZHz_0 2024-09-12T19:22:59.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.334+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4552439566883705992', time=2024-09-12T20:36:31.969151+0000, chain.objs.size()=1 2024-09-12T19:22:59.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.334+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.p9Bcz-bzjprBHGzytjECJG94AIOTimh_0 2024-09-12T19:22:59.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.334+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7053151872896912824', time=2024-09-12T20:36:33.040477+0000, chain.objs.size()=1 2024-09-12T19:22:59.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.334+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.xdE74Y2QJVSNb9p5qZc02XOAEr_z8nx_0 2024-09-12T19:22:59.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.334+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15645078258149167692', time=2024-09-12T20:36:33.241258+0000, chain.objs.size()=1 2024-09-12T19:22:59.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.334+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.jmXzi9FHzD0WifPfH1Y2K6A_9QRWsT-_0 2024-09-12T19:22:59.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.334+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7661128870742593528', time=2024-09-12T20:36:33.657793+0000, chain.objs.size()=1 2024-09-12T19:22:59.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.334+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.KdOCeh3FdOH8kpqIpeteV7s6HcpyMH__0 2024-09-12T19:22:59.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7305133558771108232', time=2024-09-12T20:36:34.309277+0000, chain.objs.size()=1 2024-09-12T19:22:59.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.338+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.a4VmXQtANJAgCuQw30akxpG5XcDRPXt_0 2024-09-12T19:22:59.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12337644285689316584', time=2024-09-12T20:36:34.685516+0000, chain.objs.size()=1 2024-09-12T19:22:59.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.338+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.LtmWZ6wictmbbHK6F_RYepz6U2Db7y-_0 2024-09-12T19:22:59.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9674783031654522872', time=2024-09-12T20:36:36.667429+0000, chain.objs.size()=1 2024-09-12T19:22:59.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.338+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.wGevBWVkajBZTO9Ci1JRGSpIK8tiVLa_0 2024-09-12T19:22:59.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3605718643606639684', time=2024-09-12T20:36:37.257835+0000, chain.objs.size()=1 2024-09-12T19:22:59.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.jahSiGLKiSzxeGjyoBKMZo74uA2gdOA_0 2024-09-12T19:22:59.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15441420041938940375', time=2024-09-12T20:36:38.170317+0000, chain.objs.size()=1 2024-09-12T19:22:59.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.JvcsXKq4Nlm5BYF4k4pkSbSaPBmmjD3_0 2024-09-12T19:22:59.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4775902019387723430', time=2024-09-12T20:36:40.885714+0000, chain.objs.size()=1 2024-09-12T19:22:59.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.vpsfw-gdkx75ILPDNHR3HcWTp--qvfA_0 2024-09-12T19:22:59.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.407485079926063242', time=2024-09-12T20:36:47.478704+0000, chain.objs.size()=1 2024-09-12T19:22:59.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.M_0GIMIUT_2OFLPSx1Pjk-1LFc4fyk5_0 2024-09-12T19:22:59.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11657332308520664694', time=2024-09-12T20:36:47.574645+0000, chain.objs.size()=1 2024-09-12T19:22:59.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.VEJUhilYnDdKONUXw-SQpXoPbx_lObh_0 2024-09-12T19:22:59.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4937445827551643541', time=2024-09-12T20:36:48.144608+0000, chain.objs.size()=1 2024-09-12T19:22:59.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.FqBmWdlX1aXaF4Dmq5mtS-Ulc-tcpYj_0 2024-09-12T19:22:59.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8327199868308837793', time=2024-09-12T20:36:48.466111+0000, chain.objs.size()=1 2024-09-12T19:22:59.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.fgEdRLZFKqCL9CSOlgfwq6VcKCLNJZb_0 2024-09-12T19:22:59.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13822801842843747966', time=2024-09-12T20:36:48.753503+0000, chain.objs.size()=1 2024-09-12T19:22:59.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.6fvV5w8LQgbEj1r3j4kpO2uiY0P7xFL_0 2024-09-12T19:22:59.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6295597274422238141', time=2024-09-12T20:36:48.860564+0000, chain.objs.size()=1 2024-09-12T19:22:59.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ZW85-UWXbYkvl1i-m4kUut-hPsJzOug_0 2024-09-12T19:22:59.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.346+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5454766858278527727', time=2024-09-12T20:36:49.570377+0000, chain.objs.size()=1 2024-09-12T19:22:59.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.346+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.jSUo3pHVBAHUXaEwBE9gUv5quO1SljA_0 2024-09-12T19:22:59.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.346+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8932532051841462409', time=2024-09-12T20:36:51.147092+0000, chain.objs.size()=1 2024-09-12T19:22:59.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.346+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.QuyGUGzFSsW_Qcbpgcm_lFQGvTxbvcZ_0 2024-09-12T19:22:59.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.346+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1305365335972528686', time=2024-09-12T20:36:53.065800+0000, chain.objs.size()=1 2024-09-12T19:22:59.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.346+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.vxHeyl0vxXHoZ-i45UDZ8OSsXayBwjn_0 2024-09-12T19:22:59.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.346+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18044228887509940440', time=2024-09-12T20:36:53.067335+0000, chain.objs.size()=1 2024-09-12T19:22:59.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.346+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Zs6hNwxaIEuWO8hizs41Ig98cb4sEoJ_0 2024-09-12T19:22:59.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.346+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3233117535271254174', time=2024-09-12T20:36:54.741824+0000, chain.objs.size()=1 2024-09-12T19:22:59.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.346+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.fWMcwvgeoXxjqM_aXQDmYDtyfqdIj-P_0 2024-09-12T19:22:59.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.346+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.354357507865918098', time=2024-09-12T20:36:55.754406+0000, chain.objs.size()=1 2024-09-12T19:22:59.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.346+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ohV_y1dMqmkjAOhaeCM6D__EXOi4uPp_0 2024-09-12T19:22:59.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.346+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13744944559663032995', time=2024-09-12T20:38:40.130926+0000, chain.objs.size()=1 2024-09-12T19:22:59.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.346+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.lZDeZMftQIwjHyo5MvIW75APJNN5fGj_0 2024-09-12T19:22:59.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8757212977465907224', time=2024-09-12T20:38:40.262957+0000, chain.objs.size()=1 2024-09-12T19:22:59.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.b5nx1_VuOXeZReEA7E2z6GOQqd-wvVw_0 2024-09-12T19:22:59.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8807211458828291191', time=2024-09-12T20:38:42.480599+0000, chain.objs.size()=1 2024-09-12T19:22:59.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.X2VSTORZ7wIFW_6JEUqnuqOFYxFWPMz_0 2024-09-12T19:22:59.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16237672622201549687', time=2024-09-12T20:38:42.560600+0000, chain.objs.size()=1 2024-09-12T19:22:59.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Qke6FpEDE2K376I_xX5aiY4JFAVtaaJ_0 2024-09-12T19:22:59.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2559783953167565413', time=2024-09-12T20:38:46.069272+0000, chain.objs.size()=1 2024-09-12T19:22:59.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.sWX8ibEOqkb-TnLu2QPHY66aNhUpyxk_0 2024-09-12T19:22:59.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1499031007086794422', time=2024-09-12T20:38:47.510587+0000, chain.objs.size()=1 2024-09-12T19:22:59.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.iEL3FPJSFU9Y_jthbf5AAMYLIYRYhV6_0 2024-09-12T19:22:59.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17671040266000572772', time=2024-09-12T20:38:47.517017+0000, chain.objs.size()=1 2024-09-12T19:22:59.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-84ywNtBe2W2iR_M7b4fnZSAKqFELtJ_0 2024-09-12T19:22:59.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9097556462167292549', time=2024-09-12T20:38:47.607822+0000, chain.objs.size()=1 2024-09-12T19:22:59.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.6Ht_sn2NMHrcfM4FOIklCdr3pNhuiMk_0 2024-09-12T19:22:59.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7758795479793155423', time=2024-09-12T20:38:48.328781+0000, chain.objs.size()=1 2024-09-12T19:22:59.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_._qMI9zyXcUAugKyn7rY3gP_GEBtDgd-_0 2024-09-12T19:22:59.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17442892308960412466', time=2024-09-12T20:38:48.517924+0000, chain.objs.size()=1 2024-09-12T19:22:59.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.A7FVRaXp07bMF4MuHOOdOr29ByZSI0f_0 2024-09-12T19:22:59.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12925256171662877634', time=2024-09-12T20:38:49.665235+0000, chain.objs.size()=1 2024-09-12T19:22:59.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.DxK8-vvHeTisM0XL4X6QLZCLNaVuYKg_0 2024-09-12T19:22:59.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17331561873939223026', time=2024-09-12T20:38:51.341948+0000, chain.objs.size()=1 2024-09-12T19:22:59.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.mQxE6khVzeSiLYLv2AeOp7DmLhw1wMs_0 2024-09-12T19:22:59.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.208245367373140045', time=2024-09-12T20:38:51.647271+0000, chain.objs.size()=1 2024-09-12T19:22:59.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.aPF5kA-nQtF5HRGct-1mF2VfS7kQF-M_0 2024-09-12T19:22:59.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12663054675014763755', time=2024-09-12T20:38:51.691902+0000, chain.objs.size()=1 2024-09-12T19:22:59.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.m3YBY5DX7m4G2yjfoBEHsD-Xzr6aCQ0_0 2024-09-12T19:22:59.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2554290653450956652', time=2024-09-12T20:38:52.842901+0000, chain.objs.size()=1 2024-09-12T19:22:59.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Yev6yUx4DyvxdQfXAthdPJpqKJYgsXb_0 2024-09-12T19:22:59.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10293570216066191248', time=2024-09-12T20:38:53.216651+0000, chain.objs.size()=1 2024-09-12T19:22:59.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.pky7zJQrScILP8A-Mn1Pu6_fjjp7lR2_0 2024-09-12T19:22:59.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.358+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15677842928115142513', time=2024-09-12T20:38:55.486304+0000, chain.objs.size()=1 2024-09-12T19:22:59.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.358+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.kkeN6mJBkovLoo8wTxsId60aeHiBWPD_0 2024-09-12T19:22:59.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.358+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7015711763729401539', time=2024-09-12T20:38:55.488221+0000, chain.objs.size()=1 2024-09-12T19:22:59.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.358+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ftF3_rHBtfYmohl_eRF8bhwQ54mCblU_0 2024-09-12T19:22:59.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.358+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10096102064684583966', time=2024-09-12T20:38:56.928561+0000, chain.objs.size()=1 2024-09-12T19:22:59.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.358+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.h0EHkOy2TgFJuOAMnL-ULl-8TTXGa0Z_0 2024-09-12T19:22:59.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.358+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7906212858176331382', time=2024-09-12T20:38:57.718919+0000, chain.objs.size()=1 2024-09-12T19:22:59.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.358+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.L8Fcjfm5jVTr0ny3Wlzmb801KMq7Qva_0 2024-09-12T19:22:59.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.358+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8226001428473059554', time=2024-09-12T20:38:59.343348+0000, chain.objs.size()=1 2024-09-12T19:22:59.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.358+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.mXwTC8pvz79v1anV5NGC1PsYUD-LJmQ_0 2024-09-12T19:22:59.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.358+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17280306069716531683', time=2024-09-12T20:38:59.719252+0000, chain.objs.size()=1 2024-09-12T19:22:59.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.358+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.1W7Nf2mxW7rpyqVPhI0lwW8514JLZv4_0 2024-09-12T19:22:59.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.358+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6762433780009194064', time=2024-09-12T20:39:00.116880+0000, chain.objs.size()=1 2024-09-12T19:22:59.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.358+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Wel5bp461E_Tvld7Lu7ItJWORAQyXW-_0 2024-09-12T19:22:59.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.362+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3082913085702497242', time=2024-09-12T20:39:00.551878+0000, chain.objs.size()=1 2024-09-12T19:22:59.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.362+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Fr-Rfs3VkLYBMXRE1G0zSvrfk_gymgQ_0 2024-09-12T19:22:59.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.362+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16831280402455255065', time=2024-09-12T20:39:00.661576+0000, chain.objs.size()=1 2024-09-12T19:22:59.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.362+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.pcRnmT6amgvCDXntFQEjzO_79QBf2tu_0 2024-09-12T19:22:59.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.362+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11410219622506352805', time=2024-09-12T20:39:01.046203+0000, chain.objs.size()=1 2024-09-12T19:22:59.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.362+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.m8m77whTzbRCDcIUrjKBJ0ywoTJJmlf_0 2024-09-12T19:22:59.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.362+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9614056868546038234', time=2024-09-12T20:39:02.657016+0000, chain.objs.size()=1 2024-09-12T19:22:59.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.362+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.kAGPGbgc2uGyMprOpdVtjM9-unl2iVi_0 2024-09-12T19:22:59.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.370+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11505382153686045967', time=2024-09-12T20:39:03.441035+0000, chain.objs.size()=1 2024-09-12T19:22:59.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.370+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.SYZbeXxjDsEwaDgsVS51_EVdoihTfvy_0 2024-09-12T19:22:59.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.370+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8413013466720868445', time=2024-09-12T20:39:03.443400+0000, chain.objs.size()=1 2024-09-12T19:22:59.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.370+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.QlVEdTqDPgrESx8Ij4ngVZWWSBUKzlR_0 2024-09-12T19:22:59.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.370+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9692621156120941189', time=2024-09-12T20:39:04.978343+0000, chain.objs.size()=1 2024-09-12T19:22:59.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.370+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.XiGZFydzc6PPmaOANYmYYyEWPoPc_L7_0 2024-09-12T19:22:59.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.370+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1686629686623384747', time=2024-09-12T20:39:06.221970+0000, chain.objs.size()=1 2024-09-12T19:22:59.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.370+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.y6--2p0VxQj3VlxCik3Kri8WDbXwgFo_0 2024-09-12T19:22:59.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.370+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3255830968953886924', time=2024-09-12T20:39:07.314770+0000, chain.objs.size()=1 2024-09-12T19:22:59.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.370+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.uRe5raypS9Xukwbrdn3IsiHX8YmqiBQ_0 2024-09-12T19:22:59.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.370+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6659102165695786534', time=2024-09-12T20:40:05.024946+0000, chain.objs.size()=1 2024-09-12T19:22:59.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.370+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.353__shadow_.xB4_lGV-6eMIrSEMXPYlkOiKyeK_ux9_0 2024-09-12T19:22:59.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.370+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14696859721743606479', time=2024-09-12T20:40:51.524316+0000, chain.objs.size()=1 2024-09-12T19:22:59.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.370+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.377__shadow_.U0TG0k9ubRGR83ueRvSGPKpopGcgY0-_0 2024-09-12T19:22:59.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.370+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1960235467247840548', time=2024-09-12T20:43:03.892324+0000, chain.objs.size()=1 2024-09-12T19:22:59.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.370+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.442__shadow_.YCvszqDF_phJ3Wgvdi0zqDytDmqHXGW_0 2024-09-12T19:22:59.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47243 2024-09-12T19:22:59.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.378+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T19:22:59.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.378+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4764486978581595625', time=2024-09-12T20:44:38.000506+0000, chain.objs.size()=1 2024-09-12T19:22:59.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.378+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.485__shadow_.YAoPTnk2yr8etT9p-kusYj_DiTKekjL_0 2024-09-12T19:22:59.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.378+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3626427744248854943', time=2024-09-12T20:46:22.049221+0000, chain.objs.size()=1 2024-09-12T19:22:59.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.378+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.514__shadow_._5m74ZBeS_ZuSmo77PYXHsOzDvlcW4W_0 2024-09-12T19:22:59.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.378+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1504397739569187916', time=2024-09-12T20:46:41.309851+0000, chain.objs.size()=1 2024-09-12T19:22:59.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.378+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.518__multipart_mymultipart.2~HZLJvhI64VTq0X5NGeOcGjneQf9TJXj.1 2024-09-12T19:22:59.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.378+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16405489390859076086', time=2024-09-12T20:56:54.159548+0000, chain.objs.size()=1 2024-09-12T19:22:59.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.378+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:3uspvDRp90r6YpwliNMVmbq9hP1fJPZ_.Mqcb0a5fDTZ-hzH8r3XhyQ-jcGvdf62_0 2024-09-12T19:22:59.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.378+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10507333749063685341', time=2024-09-12T20:58:11.776043+0000, chain.objs.size()=1 2024-09-12T19:22:59.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.378+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:Wzgsmil8dFyQLxScVZoLjjyvzD2PKzl_.gedgyhYbrro9DLg80tPcnUBqDvv3w2o_0 2024-09-12T19:22:59.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.378+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2669487203472910934', time=2024-09-12T21:02:56.642730+0000, chain.objs.size()=6 2024-09-12T19:22:59.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.378+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.614__multipart_multipart_enc.2~sbP2nSqJc19DIzMgE_KT8wlSZNbY2Jq.1 2024-09-12T19:22:59.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.378+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.614__multipart_multipart_enc.2~sbP2nSqJc19DIzMgE_KT8wlSZNbY2Jq.2 2024-09-12T19:22:59.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.378+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.614__multipart_multipart_enc.2~sbP2nSqJc19DIzMgE_KT8wlSZNbY2Jq.3 2024-09-12T19:22:59.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.378+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.614__multipart_multipart_enc.2~sbP2nSqJc19DIzMgE_KT8wlSZNbY2Jq.4 2024-09-12T19:22:59.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.378+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.614__multipart_multipart_enc.2~sbP2nSqJc19DIzMgE_KT8wlSZNbY2Jq.5 2024-09-12T19:22:59.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.378+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.614__multipart_multipart_enc.2~sbP2nSqJc19DIzMgE_KT8wlSZNbY2Jq.6 2024-09-12T19:22:59.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.378+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~aGCnApHLWDbJmiOWxBXu59Vgvm1fzIK', time=2024-09-12T21:13:03.933567+0000, chain.objs.size()=1 2024-09-12T19:22:59.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.378+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.742__multipart_mymultipart2.2~aGCnApHLWDbJmiOWxBXu59Vgvm1fzIK.1 2024-09-12T19:22:59.391 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.386+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:22:59.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T19:22:59.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:22:59.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:22:59.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50732' 2024-09-12T19:22:59.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16841660436090488219', time=2024-09-12T20:24:17.829166+0000, chain.objs.size()=1 2024-09-12T19:22:59.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.182__shadow_.lWw5qjM8_57B152RGchT3UWXS4XaAz__0 2024-09-12T19:22:59.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4773613202667279317', time=2024-09-12T20:28:57.120523+0000, chain.objs.size()=1 2024-09-12T19:22:59.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.235__shadow_.ytU4lnteMLMMo_xu3hTuBCyzJxqouOh_0 2024-09-12T19:22:59.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2092284840610820440', time=2024-09-12T20:29:39.406297+0000, chain.objs.size()=1 2024-09-12T19:22:59.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.251__shadow_.svVAo8lpjjJVaqIjjJCbDJX-80f4Hm2_0 2024-09-12T19:22:59.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10423644904779990961', time=2024-09-12T20:29:44.020336+0000, chain.objs.size()=1 2024-09-12T19:22:59.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.253__shadow_.meNH39AHe77rUglP-_ZR9QjDaysDz3f_0 2024-09-12T19:22:59.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5670894535869872620', time=2024-09-12T20:29:48.642634+0000, chain.objs.size()=1 2024-09-12T19:22:59.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.255__shadow_.9o6TmucrT3G0vpDR1BwA8wv15CiPBjB_0 2024-09-12T19:22:59.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2337307675821658666', time=2024-09-12T20:29:57.530289+0000, chain.objs.size()=1 2024-09-12T19:22:59.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.259__shadow_.DC5-ERXIOtkhGEEzWcldjpedjO6VA0Z_0 2024-09-12T19:22:59.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14039122823393385555', time=2024-09-12T20:29:59.830481+0000, chain.objs.size()=1 2024-09-12T19:22:59.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.260__shadow_.e3UC5NeC2eOhsgrTV9vt_AM5KNQXOiY_0 2024-09-12T19:22:59.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8459027361924996919', time=2024-09-12T20:31:45.229765+0000, chain.objs.size()=1 2024-09-12T19:22:59.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.A0ZTiwZmzkwzz2642xBIlUMvlwXkXU8_0 2024-09-12T19:22:59.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8855602914061583550', time=2024-09-12T20:31:45.231874+0000, chain.objs.size()=1 2024-09-12T19:22:59.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.AdCCuyxLfKx4GYR42nWJdMkzLzD_p-R_0 2024-09-12T19:22:59.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7802150786616305461', time=2024-09-12T20:31:45.540382+0000, chain.objs.size()=1 2024-09-12T19:22:59.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.-GFbdp2MsKNdkVMLec4QBxP0kDRBnG9_0 2024-09-12T19:22:59.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7233885777322524150', time=2024-09-12T20:31:45.958375+0000, chain.objs.size()=1 2024-09-12T19:22:59.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.BI_nH32pUlu9pexXCB7XoEd3HsmPm1d_0 2024-09-12T19:22:59.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10658319766389858870', time=2024-09-12T20:31:46.655540+0000, chain.objs.size()=1 2024-09-12T19:22:59.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.rUi2HyLCatm8FJhr1t_jLZsHxf2Umxj_0 2024-09-12T19:22:59.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9051666333856788630', time=2024-09-12T20:31:46.946403+0000, chain.objs.size()=1 2024-09-12T19:22:59.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.4nkaOEPY_dCGFENcx4Xt_eiOC8hRBoL_0 2024-09-12T19:22:59.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17018568531951337060', time=2024-09-12T20:31:49.684087+0000, chain.objs.size()=1 2024-09-12T19:22:59.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.V7-Ex7ZVXyPCwaFOGphUSbY_AuXBnYd_0 2024-09-12T19:22:59.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6506342126162777952', time=2024-09-12T20:31:49.689392+0000, chain.objs.size()=1 2024-09-12T19:22:59.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.VBeWj_URiR4DfueTvRTp5HPls5kJujp_0 2024-09-12T19:22:59.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14608400548803359377', time=2024-09-12T20:31:50.092910+0000, chain.objs.size()=1 2024-09-12T19:22:59.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.9inCEup83rdc-zFTOqUHFlHmRIHSVRP_0 2024-09-12T19:22:59.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13609083497550785899', time=2024-09-12T20:31:50.533478+0000, chain.objs.size()=1 2024-09-12T19:22:59.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.gGGC2sEKgB_GMgYfAvm5Sgi2e8RJpaj_0 2024-09-12T19:22:59.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13602277800177252124', time=2024-09-12T20:31:51.446667+0000, chain.objs.size()=1 2024-09-12T19:22:59.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Ni7D6pDo1N65jAVDoxtSHldVwLtF73W_0 2024-09-12T19:22:59.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12650451969820539341', time=2024-09-12T20:31:51.471257+0000, chain.objs.size()=1 2024-09-12T19:22:59.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Cbm7AH6f3_dDxCplSZl7bqfjE_53xoS_0 2024-09-12T19:22:59.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1634301843732004027', time=2024-09-12T20:31:51.604013+0000, chain.objs.size()=1 2024-09-12T19:22:59.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.dcEjnPhXrC79ss2ai-g1L_l1kaSmXRc_0 2024-09-12T19:22:59.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7696979750117284022', time=2024-09-12T20:31:51.952017+0000, chain.objs.size()=1 2024-09-12T19:22:59.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.uRUVNB75SzqZpqFUyo--jCMTSuEfrWB_0 2024-09-12T19:22:59.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4320888175962896953', time=2024-09-12T20:31:52.086770+0000, chain.objs.size()=1 2024-09-12T19:22:59.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.LYmnQ4Vt6TGeLECfJrj-_CD_6jYOWJB_0 2024-09-12T19:22:59.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2757440459666421678', time=2024-09-12T20:31:52.136612+0000, chain.objs.size()=1 2024-09-12T19:22:59.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Gsm7Q1xt3eoHHSq1XwNjP-emUPlH_Pi_0 2024-09-12T19:22:59.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.259401845404879232', time=2024-09-12T20:31:53.191894+0000, chain.objs.size()=1 2024-09-12T19:22:59.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.402+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.E7GOvnnbEA4iD9WV8DRkqYM8zQHrtUK_0 2024-09-12T19:22:59.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14898743333774392786', time=2024-09-12T20:31:53.496651+0000, chain.objs.size()=1 2024-09-12T19:22:59.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.402+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.qT_zbgXfx5emiHuNJjxqKmdZFzEzpue_0 2024-09-12T19:22:59.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.537573577067775745', time=2024-09-12T20:31:53.531077+0000, chain.objs.size()=1 2024-09-12T19:22:59.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.gVOLJqhRyYB-bXpQcWgtwOQquMBvUCU_0 2024-09-12T19:22:59.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9871571181312638192', time=2024-09-12T20:31:57.072168+0000, chain.objs.size()=1 2024-09-12T19:22:59.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.85zxF7yDxYqHUlMajIxSvnw6N3iYloV_0 2024-09-12T19:22:59.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3909745632180099155', time=2024-09-12T20:31:58.169991+0000, chain.objs.size()=1 2024-09-12T19:22:59.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.pWqMsgnTduIlfoxLRXmeiatZMOhVr8Y_0 2024-09-12T19:22:59.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.562920119038495280', time=2024-09-12T20:31:58.909422+0000, chain.objs.size()=1 2024-09-12T19:22:59.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.60K6acEulJXKFvs7CEKsm0usgzfonwx_0 2024-09-12T19:22:59.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11626195261360609398', time=2024-09-12T20:31:59.044558+0000, chain.objs.size()=1 2024-09-12T19:22:59.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_._XOU4_RKm3DbdM5szRnrjxIrcpqOsZo_0 2024-09-12T19:22:59.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9937621887109616686', time=2024-09-12T20:31:59.223086+0000, chain.objs.size()=1 2024-09-12T19:22:59.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.iYsFlXAPLLiEeisrn-nTatAlrx9Rfa9_0 2024-09-12T19:22:59.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14742882681547147066', time=2024-09-12T20:31:59.362355+0000, chain.objs.size()=1 2024-09-12T19:22:59.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Zx0opILSKkuUuL012zg3ksEweVfgO8Y_0 2024-09-12T19:22:59.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7809987720149938419', time=2024-09-12T20:32:00.833115+0000, chain.objs.size()=1 2024-09-12T19:22:59.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.AUmDyTr_Hkf-iMTIcTu-qwt0syPmynK_0 2024-09-12T19:22:59.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1958879587001759996', time=2024-09-12T20:32:01.105610+0000, chain.objs.size()=1 2024-09-12T19:22:59.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.3_sizl7IZHTjugmgNSa85ADEcL7dQgT_0 2024-09-12T19:22:59.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10938416053598844377', time=2024-09-12T20:32:01.176966+0000, chain.objs.size()=1 2024-09-12T19:22:59.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.DZkkOsc48Hh6GTzTHTozA911fonLsDl_0 2024-09-12T19:22:59.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15229894764911224963', time=2024-09-12T20:32:01.251708+0000, chain.objs.size()=1 2024-09-12T19:22:59.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.406+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.usLAryd5koPSmjYNv8Mfv1D167XXnkV_0 2024-09-12T19:22:59.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3258080383336019393', time=2024-09-12T20:32:02.039053+0000, chain.objs.size()=1 2024-09-12T19:22:59.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.sFxojTx--GByDc8DQ3Pj3wURWDoTln0_0 2024-09-12T19:22:59.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1349686221276911079', time=2024-09-12T20:32:02.040642+0000, chain.objs.size()=1 2024-09-12T19:22:59.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.fja8-tuvmvM-Ww5rrjn5flwmntDjCww_0 2024-09-12T19:22:59.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5982308857282091357', time=2024-09-12T20:32:02.828387+0000, chain.objs.size()=1 2024-09-12T19:22:59.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.UnFRI9AVORiF2-6sgrij10BlzdcZITV_0 2024-09-12T19:22:59.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.670008061686992127', time=2024-09-12T20:32:02.945933+0000, chain.objs.size()=1 2024-09-12T19:22:59.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.9p9ImvTYHuQCG1b0wQ_BVWYV-_RcZQc_0 2024-09-12T19:22:59.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.290790875973088642', time=2024-09-12T20:32:03.281873+0000, chain.objs.size()=1 2024-09-12T19:22:59.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.hkA_fuX1if20HdepEBqCcllXiLwuGj3_0 2024-09-12T19:22:59.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11773597783335668309', time=2024-09-12T20:32:05.295543+0000, chain.objs.size()=1 2024-09-12T19:22:59.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ZG07BQVt2pF9lV62wH0tx3gK9mJcsVN_0 2024-09-12T19:22:59.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5426922043130663918', time=2024-09-12T20:32:06.048715+0000, chain.objs.size()=1 2024-09-12T19:22:59.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.T3CQofte4Ly-muzv-lJLxBpkLuzpMPz_0 2024-09-12T19:22:59.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4135226445197493079', time=2024-09-12T20:32:06.385817+0000, chain.objs.size()=1 2024-09-12T19:22:59.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.CFPBGVNf3QJenE0rmiESGz2WI8RLrCh_0 2024-09-12T19:22:59.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6749177858864627957', time=2024-09-12T20:32:07.228963+0000, chain.objs.size()=1 2024-09-12T19:22:59.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.2nWPpCGFSayqVZvubdGkevuh-tEyhXA_0 2024-09-12T19:22:59.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4379930984333672198', time=2024-09-12T20:32:08.783149+0000, chain.objs.size()=1 2024-09-12T19:22:59.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.UInwJR9r5JLRDXknm7pA2t9a1IfJ6HF_0 2024-09-12T19:22:59.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9281871997913658902', time=2024-09-12T20:32:10.030823+0000, chain.objs.size()=1 2024-09-12T19:22:59.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.WhpemrHW05Y0Qt_AEoLuQI_J6PThexV_0 2024-09-12T19:22:59.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15146691738917544120', time=2024-09-12T20:32:10.834096+0000, chain.objs.size()=1 2024-09-12T19:22:59.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_._5YaW1GJCMUE_s_Ar1ri2l5wLpa1812_0 2024-09-12T19:22:59.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7659783652836245315', time=2024-09-12T20:32:12.041404+0000, chain.objs.size()=1 2024-09-12T19:22:59.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.EjpsZfi67i7Grm_dcwJzRx0X3iIDYWQ_0 2024-09-12T19:22:59.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2860547436842426790', time=2024-09-12T20:32:12.925394+0000, chain.objs.size()=1 2024-09-12T19:22:59.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.jbHKt1fiEY6sg3gvDSsVXNc395h_kYe_0 2024-09-12T19:22:59.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2021561474477891664', time=2024-09-12T20:32:25.005713+0000, chain.objs.size()=1 2024-09-12T19:22:59.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.267__shadow_.YTf0Lo-5L-fLZZiAgGTxJjRC4U5AkoB_0 2024-09-12T19:22:59.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14451365067798224629', time=2024-09-12T20:33:14.977117+0000, chain.objs.size()=1 2024-09-12T19:22:59.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.289__shadow_.lEQ7UrohYn06_jGsFay_7HjEGNreg1d_0 2024-09-12T19:22:59.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7390276761229173191', time=2024-09-12T20:33:25.744533+0000, chain.objs.size()=1 2024-09-12T19:22:59.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.tQhfVmn3glwoD_KEgGUKrPURFYCuzU6_0 2024-09-12T19:22:59.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9037776794851031714', time=2024-09-12T20:33:31.000839+0000, chain.objs.size()=1 2024-09-12T19:22:59.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.c2mf1PKJtwMcMgh-5t-V86Xjj2awRHB_0 2024-09-12T19:22:59.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3942930928764835792', time=2024-09-12T20:33:31.277690+0000, chain.objs.size()=1 2024-09-12T19:22:59.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.0YLVN6W9Ql2PpoiJtyU7ZcLiz-oqlbG_0 2024-09-12T19:22:59.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8640436163465506620', time=2024-09-12T20:33:31.279831+0000, chain.objs.size()=1 2024-09-12T19:22:59.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.fw7LaGG9u7ohSg3D8voY0E05pL44Qoj_0 2024-09-12T19:22:59.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5448689947396276715', time=2024-09-12T20:33:57.195439+0000, chain.objs.size()=1 2024-09-12T19:22:59.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.304__shadow_.jkI6A_u1YbP9dvb0_RFHVIZtkfbmJyE_0 2024-09-12T19:22:59.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9108805408845867169', time=2024-09-12T20:34:05.553573+0000, chain.objs.size()=1 2024-09-12T19:22:59.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.307__shadow:mcHzQrQIStogVKpAkDHT-x4feyImnVe_.ggHk9PkWfZneTr09glyPVeST0chRZdy_0 2024-09-12T19:22:59.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.426+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16311340404730750293', time=2024-09-12T20:34:38.762470+0000, chain.objs.size()=1 2024-09-12T19:22:59.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.426+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.319__shadow:jGG9cSmWT3msgxFdke7gsbt13Eu4nzL_.XbeQQ15bjRNk9USmQ8q7K-RcTP0pJrq_0 2024-09-12T19:22:59.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17728451412117076399', time=2024-09-12T20:36:32.885172+0000, chain.objs.size()=1 2024-09-12T19:22:59.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.iVWUP46yZ8QeuxmrO4EnXffMwffe_D-_0 2024-09-12T19:22:59.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2363161691476959790', time=2024-09-12T20:36:33.651291+0000, chain.objs.size()=1 2024-09-12T19:22:59.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.-GVOa6XPbnUSDeuVmJz6hGrAz4sv77n_0 2024-09-12T19:22:59.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9089220249810823456', time=2024-09-12T20:36:34.040970+0000, chain.objs.size()=1 2024-09-12T19:22:59.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.g0_mQnpZv5s1Uuu7WrPWJRj0PCZBYbY_0 2024-09-12T19:22:59.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12238636042910662533', time=2024-09-12T20:36:34.690903+0000, chain.objs.size()=1 2024-09-12T19:22:59.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.5sakIdA9CLCuQVxB82uzPq3UsPvVCwK_0 2024-09-12T19:22:59.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2792889612573837209', time=2024-09-12T20:36:34.719098+0000, chain.objs.size()=1 2024-09-12T19:22:59.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ZMVIXQIKWrWCzfr9wLDwEsSRMe01ilz_0 2024-09-12T19:22:59.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15802170738111342772', time=2024-09-12T20:36:36.089187+0000, chain.objs.size()=1 2024-09-12T19:22:59.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.IXasAtAat_jvgx4ojBseBuMQoZOvmON_0 2024-09-12T19:22:59.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5625689342091384398', time=2024-09-12T20:36:36.987484+0000, chain.objs.size()=1 2024-09-12T19:22:59.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.tvzXbmK3ernwIu0Ul-9VJdT3FcuJHFF_0 2024-09-12T19:22:59.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12545132248980137188', time=2024-09-12T20:36:37.594306+0000, chain.objs.size()=1 2024-09-12T19:22:59.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.6l3QS43l8TSVnr4u8BsiPmwtlhfZ15k_0 2024-09-12T19:22:59.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1398010957966129634', time=2024-09-12T20:36:37.952145+0000, chain.objs.size()=1 2024-09-12T19:22:59.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.214q4IPXC_cJ_umUVKCrUwJni8_pT-N_0 2024-09-12T19:22:59.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17633741784487953643', time=2024-09-12T20:36:38.491798+0000, chain.objs.size()=1 2024-09-12T19:22:59.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.JtGDezRt-tgm-513YowBZscQg6aI4bh_0 2024-09-12T19:22:59.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12086583001329340576', time=2024-09-12T20:36:39.512830+0000, chain.objs.size()=1 2024-09-12T19:22:59.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.cPRTDvV720BeK8TeZMLxb-uh9viNbIL_0 2024-09-12T19:22:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17871674039210147214', time=2024-09-12T20:36:40.122699+0000, chain.objs.size()=1 2024-09-12T19:22:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.SrPlA3aH-AmCXRbU0o1YPeEU5llpGmI_0 2024-09-12T19:22:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18013557985388248748', time=2024-09-12T20:36:42.215843+0000, chain.objs.size()=1 2024-09-12T19:22:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.66589KyoI-7oBd6-AqmSM0IRWujtra2_0 2024-09-12T19:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.32154062572154713', time=2024-09-12T20:36:42.276294+0000, chain.objs.size()=1 2024-09-12T19:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.x-XdV_LMKPmNIBj36rrFU2nVwMwN8-V_0 2024-09-12T19:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2749498749585686850', time=2024-09-12T20:36:43.180242+0000, chain.objs.size()=1 2024-09-12T19:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.5L0MiDG7o-y2u9gWSi7WFzasq49MBpi_0 2024-09-12T19:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10605005101942747913', time=2024-09-12T20:36:44.103471+0000, chain.objs.size()=1 2024-09-12T19:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.gJUfVreYaQcb2dsTZzFq1ukH6BBVRRU_0 2024-09-12T19:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15397023968348680740', time=2024-09-12T20:36:44.105182+0000, chain.objs.size()=1 2024-09-12T19:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ew64zFLWV9S-7JVv3eU4Km3mCOANQYO_0 2024-09-12T19:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11501705635057791942', time=2024-09-12T20:36:44.469077+0000, chain.objs.size()=1 2024-09-12T19:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.wTU-SGXEA2rLKzlMVVH9RbEtViyPn_n_0 2024-09-12T19:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11903756589642212032', time=2024-09-12T20:36:45.233971+0000, chain.objs.size()=1 2024-09-12T19:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_._8Z0p97o35vuW8mrkHJhzLsww6lk27w_0 2024-09-12T19:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4325931632317080833', time=2024-09-12T20:36:46.969717+0000, chain.objs.size()=1 2024-09-12T19:22:59.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Xmtiq3J_D_MisBeEWR_qyurVrQayW3T_0 2024-09-12T19:22:59.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1017381590986752490', time=2024-09-12T20:36:46.977598+0000, chain.objs.size()=1 2024-09-12T19:22:59.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.HtieM_IdR1UamLr1O6A2DGTUWeYpJgm_0 2024-09-12T19:22:59.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3436128986622517416', time=2024-09-12T20:36:50.570625+0000, chain.objs.size()=1 2024-09-12T19:22:59.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.1BD5yYeaVwWE3ZSuPPvxQoxyBqYKcyh_0 2024-09-12T19:22:59.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.442+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10467979441744753075', time=2024-09-12T20:36:50.680393+0000, chain.objs.size()=1 2024-09-12T19:22:59.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.442+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.2aPFpuMj9DV7gpycc2VRhJRZgZN2Z5b_0 2024-09-12T19:22:59.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7065539014143148745', time=2024-09-12T20:36:51.286144+0000, chain.objs.size()=1 2024-09-12T19:22:59.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.eI-N785idkW-xjNlL5-B92SN9mtu_Pd_0 2024-09-12T19:22:59.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8009004863608378631', time=2024-09-12T20:36:51.520697+0000, chain.objs.size()=1 2024-09-12T19:22:59.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.rheAAtZmKM4ikHvFN_QQF9TAucbeq1s_0 2024-09-12T19:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5523540360572528904', time=2024-09-12T20:36:51.903888+0000, chain.objs.size()=1 2024-09-12T19:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.rsLs3jQwyJrR7mcx8ZsR4lFlDPofmf9_0 2024-09-12T19:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12200365475990421653', time=2024-09-12T20:36:51.986972+0000, chain.objs.size()=1 2024-09-12T19:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Gct-h-nTmQ3p2plPOEOGIBB1C8PXHeT_0 2024-09-12T19:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1948705002587364899', time=2024-09-12T20:36:52.713059+0000, chain.objs.size()=1 2024-09-12T19:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.vFXM1yBAXxxgiyldKHTTLhgoI1qYGzq_0 2024-09-12T19:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6249108723635467630', time=2024-09-12T20:36:52.971316+0000, chain.objs.size()=1 2024-09-12T19:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.rju8k0-9CWXqQLMfwMxmpxgTChesNQT_0 2024-09-12T19:22:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8207104339320692918', time=2024-09-12T20:36:53.344438+0000, chain.objs.size()=1 2024-09-12T19:22:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.rhSxvE-p3qPTpBIPlvRmmGXgvWJ4fay_0 2024-09-12T19:22:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18300106287383627583', time=2024-09-12T20:36:54.259119+0000, chain.objs.size()=1 2024-09-12T19:22:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.G3VJosKJTo7odPdr5w11jzqsWKWJu6s_0 2024-09-12T19:22:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10316152476126137046', time=2024-09-12T20:36:55.023312+0000, chain.objs.size()=1 2024-09-12T19:22:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.XbW4hQTZQDrwNedncfhYCJv8HMCWSCp_0 2024-09-12T19:22:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13275597187956293212', time=2024-09-12T20:36:55.110009+0000, chain.objs.size()=1 2024-09-12T19:22:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.-ecJ19ebw3SjqC6Pge0Zof-8tCvcqgl_0 2024-09-12T19:22:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8009336218633292431', time=2024-09-12T20:36:56.313795+0000, chain.objs.size()=1 2024-09-12T19:22:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.qKG77oH9NbUadMQsiPiL8jnwUAghcLZ_0 2024-09-12T19:22:59.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.450+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17488226745758663587', time=2024-09-12T20:38:39.769824+0000, chain.objs.size()=1 2024-09-12T19:22:59.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.450+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.pGt2QlFDZ9VtOaALj7cYYA4xDVOCAxv_0 2024-09-12T19:22:59.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10213550453616682154', time=2024-09-12T20:38:40.337114+0000, chain.objs.size()=1 2024-09-12T19:22:59.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.kqXRsUlg9aPGOUF05UZVJ_dLAFHm9qk_0 2024-09-12T19:22:59.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18137875480939756442', time=2024-09-12T20:38:42.297894+0000, chain.objs.size()=1 2024-09-12T19:22:59.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.RvhGVjrNnP3RGJmT5NAPSoY9-0crnOB_0 2024-09-12T19:22:59.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8059513954006005567', time=2024-09-12T20:38:42.415693+0000, chain.objs.size()=1 2024-09-12T19:22:59.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.cErWG2d7cwQ5rrnqqpohU-g0A-QUQXd_0 2024-09-12T19:22:59.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12839629745095346362', time=2024-09-12T20:38:44.068001+0000, chain.objs.size()=1 2024-09-12T19:22:59.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.eK0wXmSXG3RIAlfP9r6mUIgkxsU8XfH_0 2024-09-12T19:22:59.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15665415929260498912', time=2024-09-12T20:38:44.176596+0000, chain.objs.size()=1 2024-09-12T19:22:59.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.O1fo5ftRf5NWa8IHoDB3gZYBLOzHFtv_0 2024-09-12T19:22:59.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5979846919812611843', time=2024-09-12T20:38:44.528472+0000, chain.objs.size()=1 2024-09-12T19:22:59.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.OB57odYn_Ni8I7k4HqILnkrQuU-BAfq_0 2024-09-12T19:22:59.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.462+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50732 2024-09-12T19:22:59.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-09-12T19:22:59.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4567682181499951842', time=2024-09-12T20:38:44.531537+0000, chain.objs.size()=1 2024-09-12T19:22:59.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.62g0EnggyRNolud1-C7OPnUJNM-igq__0 2024-09-12T19:22:59.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18332430331059138605', time=2024-09-12T20:38:44.845699+0000, chain.objs.size()=1 2024-09-12T19:22:59.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.51CBCd2r0Gql6ZC29rL7eLcqkyZ9_dr_0 2024-09-12T19:22:59.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7545337974200232448', time=2024-09-12T20:38:44.870033+0000, chain.objs.size()=1 2024-09-12T19:22:59.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Aj9q3jszLUGNna4a4Z0iJ1km_PxgGyV_0 2024-09-12T19:22:59.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10747110753920133520', time=2024-09-12T20:38:45.959244+0000, chain.objs.size()=1 2024-09-12T19:22:59.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.47J3T_5W6Y4s8yFvcwk2euam1ILMpX0_0 2024-09-12T19:22:59.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1661281804612382540', time=2024-09-12T20:38:45.989238+0000, chain.objs.size()=1 2024-09-12T19:22:59.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_._vFDax8Qr7rdTSIiTAqiN5OGV3ltMib_0 2024-09-12T19:22:59.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.64770183489294165', time=2024-09-12T20:38:46.130672+0000, chain.objs.size()=1 2024-09-12T19:22:59.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.yoNpMUEMZEcJ9x74nBpAm039-eR5hDJ_0 2024-09-12T19:22:59.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12368338644958456395', time=2024-09-12T20:38:47.887175+0000, chain.objs.size()=1 2024-09-12T19:22:59.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.4NN6oP2cG0kncdYNpwZoBHIk6hC_B-M_0 2024-09-12T19:22:59.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7678344623807693397', time=2024-09-12T20:38:52.064619+0000, chain.objs.size()=1 2024-09-12T19:22:59.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.HA6Jma3lXlJXwesb0vH_0TU6jrmPnbm_0 2024-09-12T19:22:59.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11040528997912598078', time=2024-09-12T20:38:55.053749+0000, chain.objs.size()=1 2024-09-12T19:22:59.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.sn1aSkWlTuLTr9dfA5lUNsnNUzUiNH7_0 2024-09-12T19:22:59.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4660269632001315539', time=2024-09-12T20:38:55.948176+0000, chain.objs.size()=1 2024-09-12T19:22:59.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.KJEl1QJt7jxJnHIWqfOHco1s10sjby1_0 2024-09-12T19:22:59.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5191978432576571712', time=2024-09-12T20:38:56.325981+0000, chain.objs.size()=1 2024-09-12T19:22:59.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.maWhI1TkljWPRnPV4mrbfM8sDZfwV1U_0 2024-09-12T19:22:59.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1183304367324653797', time=2024-09-12T20:38:56.898382+0000, chain.objs.size()=1 2024-09-12T19:22:59.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.audLVdZOvEv6sbYaYALRRQnsYozXK8j_0 2024-09-12T19:22:59.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2123168628747418928', time=2024-09-12T20:38:57.111500+0000, chain.objs.size()=1 2024-09-12T19:22:59.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Z4B9O2-376OT-vu5Fm9Fs7WFiPP6qAX_0 2024-09-12T19:22:59.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7967446834274452377', time=2024-09-12T20:38:58.950712+0000, chain.objs.size()=1 2024-09-12T19:22:59.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.QfYOvl4TrohxcCc9jmE39g7lV5xhIBW_0 2024-09-12T19:22:59.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1366290939595583887', time=2024-09-12T20:38:59.340897+0000, chain.objs.size()=1 2024-09-12T19:22:59.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.vbthrSESsh12Be2LOUPTANw146kYyjc_0 2024-09-12T19:22:59.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1984092318219236295', time=2024-09-12T20:39:00.055840+0000, chain.objs.size()=1 2024-09-12T19:22:59.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-Xs703u7Zh_U2OYQwM53SfxAWoNK6kO_0 2024-09-12T19:22:59.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2305887104914279239', time=2024-09-12T20:39:00.120951+0000, chain.objs.size()=1 2024-09-12T19:22:59.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.0dw9I-PEZlDGB3yNQ3GqG2QtOt66mJC_0 2024-09-12T19:22:59.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.179896843108988756', time=2024-09-12T20:39:01.491457+0000, chain.objs.size()=1 2024-09-12T19:22:59.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.kSkEw0Zh_t5ol2XMcFFfjN-PpQF-vGn_0 2024-09-12T19:22:59.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4210551157471328913', time=2024-09-12T20:39:02.705001+0000, chain.objs.size()=1 2024-09-12T19:22:59.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.hJP1aLWN1sLhT9FKxgWhSdW3TljtBAz_0 2024-09-12T19:22:59.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4652177405761313588', time=2024-09-12T20:39:02.992059+0000, chain.objs.size()=1 2024-09-12T19:22:59.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.wZFhZyBh38gXDmaaS92bxI99CaYP5HR_0 2024-09-12T19:22:59.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9173869636687187906', time=2024-09-12T20:39:03.425501+0000, chain.objs.size()=1 2024-09-12T19:22:59.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.qfvUfG3LlBA7G13pFivsXa_YZ4QVp9y_0 2024-09-12T19:22:59.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7111063326488969573', time=2024-09-12T20:39:03.665236+0000, chain.objs.size()=1 2024-09-12T19:22:59.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.6N3ENSQc3Y3Wp-voihooYEU61a1zHhI_0 2024-09-12T19:22:59.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.237941851901734834', time=2024-09-12T20:39:03.744444+0000, chain.objs.size()=1 2024-09-12T19:22:59.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.478+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.nohq1FBxWFEaGO-xPlhmSijhE0AMD3K_0 2024-09-12T19:22:59.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8786590749304738218', time=2024-09-12T20:39:03.748199+0000, chain.objs.size()=1 2024-09-12T19:22:59.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.WyK_2m6KEgNk7Alss736aOPKsSM9ndu_0 2024-09-12T19:22:59.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2824092686782820443', time=2024-09-12T20:39:06.157605+0000, chain.objs.size()=1 2024-09-12T19:22:59.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.gMCy45GYphCtrKY28EEUQXJb3sCivxQ_0 2024-09-12T19:22:59.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15132108980323023833', time=2024-09-12T20:39:06.160886+0000, chain.objs.size()=1 2024-09-12T19:22:59.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ZATEcgHRqDm0h0BT4G_YwLna_kQiXY2_0 2024-09-12T19:22:59.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10950663534300619896', time=2024-09-12T20:39:07.644434+0000, chain.objs.size()=1 2024-09-12T19:22:59.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_._0fBN2InA-sAmCDYvoPuowqFFZw8S4K_0 2024-09-12T19:22:59.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17782364125375375126', time=2024-09-12T20:39:07.823000+0000, chain.objs.size()=1 2024-09-12T19:22:59.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.pXPCXm-KoPV-7-UJ-NHG17dW2LAdjGx_0 2024-09-12T19:22:59.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14573834527539784625', time=2024-09-12T20:39:27.828655+0000, chain.objs.size()=1 2024-09-12T19:22:59.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.334__shadow_.XVs9L5KVqt67GjDb2YtVLTt4yAjYUOC_0 2024-09-12T19:22:59.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.100384062566457514', time=2024-09-12T20:41:02.261827+0000, chain.objs.size()=1 2024-09-12T19:22:59.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.382__shadow_.dWxwkrCzgJGhxPRiiESZpH-UyftMqYw_0 2024-09-12T19:22:59.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12974377847917755360', time=2024-09-12T20:45:09.717193+0000, chain.objs.size()=1 2024-09-12T19:22:59.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.497__shadow_.u6mxkZ7pujZUQoNVGiKyRuD-ynR8WuX_0 2024-09-12T19:22:59.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18227374548761929223', time=2024-09-12T20:46:19.784235+0000, chain.objs.size()=1 2024-09-12T19:22:59.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.513__multipart_mymultipart.2~qYad-yDIbT66WV__Zali3ssi0SO1QzF.1 2024-09-12T19:22:59.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3132078266021551842', time=2024-09-12T20:56:21.526822+0000, chain.objs.size()=1 2024-09-12T19:22:59.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.562__shadow_.e_0MZEgTaLAak5RIEN4PPZBbAaDXrlD_0 2024-09-12T19:22:59.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5093721716171497241', time=2024-09-12T20:57:05.954618+0000, chain.objs.size()=1 2024-09-12T19:22:59.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:LVH8THBEXf-vWW1-a3d8MNw4YP6TqFI_.LX5hMdbBVE6SYg6QSk2tzd80SvSBSCx_0 2024-09-12T19:22:59.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.490+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15465312438337834178', time=2024-09-12T20:57:44.748157+0000, chain.objs.size()=1 2024-09-12T19:22:59.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.490+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.576__shadow:mA3p-T4baHUWGeGsUxkFBr4hENWjehL_.fs6rgNEtV4pn-2cvPRo3ldBtX-Nrfax_0 2024-09-12T19:22:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.490+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12265762386011936144', time=2024-09-12T20:58:00.193830+0000, chain.objs.size()=1 2024-09-12T19:22:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.490+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:AEfSvVmlgutfftOCoIJevWl.CB2ImwA_.C22qJDDau01eftl1bXdQJfgCvy3o5EG_0 2024-09-12T19:22:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.494+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3780746669393283426', time=2024-09-12T21:09:45.592164+0000, chain.objs.size()=1 2024-09-12T19:22:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.494+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.666__shadow_.LIZFub7GEWh5lZ1Bn-xoKki93FNJtaI_0 2024-09-12T19:22:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.494+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.221522265302131056', time=2024-09-12T21:10:09.319958+0000, chain.objs.size()=1 2024-09-12T19:22:59.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.494+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.679__shadow_.Dhhv5l3x8JXwIbyrll9BUjjC1kpDaJE_0 2024-09-12T19:22:59.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.498+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:22:59.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T19:22:59.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:22:59.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:22:59.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44259' 2024-09-12T19:22:59.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16087692360942583690', time=2024-09-12T20:29:25.550648+0000, chain.objs.size()=1 2024-09-12T19:22:59.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.245__shadow_.tVk9CwzJRRZ2Tn5Btf-5XXkyaOzTQMm_0 2024-09-12T19:22:59.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1122071301766724874', time=2024-09-12T20:29:48.638125+0000, chain.objs.size()=1 2024-09-12T19:22:59.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.255__shadow_.94ym_rT8t6yjmScnTBqvJTPRwWmEUjs_0 2024-09-12T19:22:59.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12554401069243400533', time=2024-09-12T20:31:45.582231+0000, chain.objs.size()=1 2024-09-12T19:22:59.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Dx_YeeJr0JveraAJRTSUEv3tTp19z4l_0 2024-09-12T19:22:59.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4252761719850419194', time=2024-09-12T20:31:49.263142+0000, chain.objs.size()=1 2024-09-12T19:22:59.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.MgOFIx9o-WNKuEFSAhDZ8QmjyM1LyB8_0 2024-09-12T19:22:59.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9537197090735807175', time=2024-09-12T20:31:50.026530+0000, chain.objs.size()=1 2024-09-12T19:22:59.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.JRyCy-wtIROkkaf-oV1z0qHNLGTOKgg_0 2024-09-12T19:22:59.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1027166711161459254', time=2024-09-12T20:31:50.388794+0000, chain.objs.size()=1 2024-09-12T19:22:59.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.97PzQ-B3Jqqb4fQ2P_1p-NfsIbkq_GP_0 2024-09-12T19:22:59.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12564924051246304438', time=2024-09-12T20:31:50.390689+0000, chain.objs.size()=1 2024-09-12T19:22:59.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.oUkG7gx_1-nwShko1A7c1ywwgp_Q4W9_0 2024-09-12T19:22:59.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11665105461290826746', time=2024-09-12T20:31:50.550664+0000, chain.objs.size()=1 2024-09-12T19:22:59.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.kh9HausKAIuMK7jgGwtR62M0MCnHvoH_0 2024-09-12T19:22:59.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13227924284227107812', time=2024-09-12T20:31:51.095236+0000, chain.objs.size()=1 2024-09-12T19:22:59.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.iPhZnxJ7ZLMtxNqnZG-RCFjVfLjfDOL_0 2024-09-12T19:22:59.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18158156419384120308', time=2024-09-12T20:31:53.139713+0000, chain.objs.size()=1 2024-09-12T19:22:59.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.JERGwl8LxaEHG_Sp6040bcvBl5sLhnu_0 2024-09-12T19:22:59.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17804178112853225656', time=2024-09-12T20:31:53.871759+0000, chain.objs.size()=1 2024-09-12T19:22:59.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.znUqF6T7Fw1u127LjQId08Tqv1VaUhe_0 2024-09-12T19:22:59.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9411465320105884147', time=2024-09-12T20:31:54.322686+0000, chain.objs.size()=1 2024-09-12T19:22:59.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.aeq9RtdX7irJ44s32JZc5jFSAfigsnw_0 2024-09-12T19:22:59.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.510+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7417490694431423313', time=2024-09-12T20:31:55.057358+0000, chain.objs.size()=1 2024-09-12T19:22:59.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.510+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.hwO89tTTflE4Lpc3wjMdGwmaNBPQsa6_0 2024-09-12T19:22:59.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.510+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1140515536761031523', time=2024-09-12T20:31:58.476414+0000, chain.objs.size()=1 2024-09-12T19:22:59.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.510+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.fL2ElLsE-MoK5B6z2WsV40G1xlGr2Ch_0 2024-09-12T19:22:59.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16430482791412786136', time=2024-09-12T20:31:59.357507+0000, chain.objs.size()=1 2024-09-12T19:22:59.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.qkGsExMaoDh68WwzLIW4ZhUCuXjM7rf_0 2024-09-12T19:22:59.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17120233404590539605', time=2024-09-12T20:32:00.857855+0000, chain.objs.size()=1 2024-09-12T19:22:59.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.QwonL-LIYJDsPK_OOzg84RhXw6phV-B_0 2024-09-12T19:22:59.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16634352819887710555', time=2024-09-12T20:32:01.544823+0000, chain.objs.size()=1 2024-09-12T19:22:59.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.RT46qhDB-YCgXfQ5xMl2fTYvDu96bv3_0 2024-09-12T19:22:59.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14306145510098781008', time=2024-09-12T20:32:02.349967+0000, chain.objs.size()=1 2024-09-12T19:22:59.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.2MMnU2aJgJzaIXrA9bhkATKSrIrbVlT_0 2024-09-12T19:22:59.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2097490512706739387', time=2024-09-12T20:32:03.164480+0000, chain.objs.size()=1 2024-09-12T19:22:59.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.kvGqLlKTkWtEMleqxA-I6bxm5idXSnc_0 2024-09-12T19:22:59.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10679149084107433069', time=2024-09-12T20:32:03.222258+0000, chain.objs.size()=1 2024-09-12T19:22:59.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.QE0hQ0iiI7An9vGs8Zy5n5WZ7P8KTu__0 2024-09-12T19:22:59.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1517806397388472742', time=2024-09-12T20:32:03.450553+0000, chain.objs.size()=1 2024-09-12T19:22:59.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.-VdU-TjspbY9m5RM46SNjfNOCxneK3q_0 2024-09-12T19:22:59.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.862147798436788794', time=2024-09-12T20:32:04.565722+0000, chain.objs.size()=1 2024-09-12T19:22:59.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ohk0SMvjmN8DFsN_QY40yzdPYS7XTPq_0 2024-09-12T19:22:59.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12203456113545054606', time=2024-09-12T20:32:04.969778+0000, chain.objs.size()=1 2024-09-12T19:22:59.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.MGnyVQIR9r6MSLSULvFCUGqNOQuO_M8_0 2024-09-12T19:22:59.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.518+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11249920713912619465', time=2024-09-12T20:32:05.054755+0000, chain.objs.size()=1 2024-09-12T19:22:59.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.518+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.WeQz7gwX8s5SjQPo4newQs0OiVC1eK7_0 2024-09-12T19:22:59.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.518+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3448049332137769280', time=2024-09-12T20:32:07.151221+0000, chain.objs.size()=1 2024-09-12T19:22:59.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.518+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.vzZ1bJWIqP_gvVkJ8OwlUsJdw2UvcXH_0 2024-09-12T19:22:59.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5424604533656650466', time=2024-09-12T20:32:08.968955+0000, chain.objs.size()=1 2024-09-12T19:22:59.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.uORZ8qIRQR6pVnO7XoAu6zXHy4jAQgF_0 2024-09-12T19:22:59.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16572369361836441236', time=2024-09-12T20:32:09.772100+0000, chain.objs.size()=1 2024-09-12T19:22:59.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.e9rTtrBTmgQINBnmiajRovARrXt56Mg_0 2024-09-12T19:22:59.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11263678538125575273', time=2024-09-12T20:32:10.084631+0000, chain.objs.size()=1 2024-09-12T19:22:59.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.xfIC4VwdjKh5HhqKiB-nuvLsrTsebuu_0 2024-09-12T19:22:59.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4720289245985691423', time=2024-09-12T20:32:10.795186+0000, chain.objs.size()=1 2024-09-12T19:22:59.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.pRLtMELx9LlSGE1_o5rQYjKPvj4Xczr_0 2024-09-12T19:22:59.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12678987240724100316', time=2024-09-12T20:32:12.346482+0000, chain.objs.size()=1 2024-09-12T19:22:59.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.BzwioH9A0LNC8cOAHz8-J6yLQ1F_3Bl_0 2024-09-12T19:22:59.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.337792614943162981', time=2024-09-12T20:32:51.914532+0000, chain.objs.size()=1 2024-09-12T19:22:59.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.279__shadow_.dHKs4V7TpCjbhfiCJA7fD8JYG81Nshs_0 2024-09-12T19:22:59.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13305749241083486968', time=2024-09-12T20:33:10.467328+0000, chain.objs.size()=1 2024-09-12T19:22:59.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.287__shadow_.YbMs47hu69wVeQtcENc8LpiwL1njnoC_0 2024-09-12T19:22:59.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5952913469497044404', time=2024-09-12T20:33:25.691225+0000, chain.objs.size()=1 2024-09-12T19:22:59.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.cC1vIDrXjtAcR1O02ilcCBwqHUExMlQ_0 2024-09-12T19:22:59.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16383644183019656648', time=2024-09-12T20:34:38.569605+0000, chain.objs.size()=1 2024-09-12T19:22:59.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.319__shadow:GkRN-u1pfT.zFJmgkdbvmSZN4bl4Vag_.IM-J_uDNWAb1JT1wDaFktNfh_SyP7Ac_0 2024-09-12T19:22:59.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9756906204225349065', time=2024-09-12T20:34:42.368553+0000, chain.objs.size()=1 2024-09-12T19:22:59.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.321__shadow_.UQQOb3LY6RMvflEDPluseXBGPygKDpB_0 2024-09-12T19:22:59.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.113732478703034784', time=2024-09-12T20:36:28.394819+0000, chain.objs.size()=1 2024-09-12T19:22:59.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.BuGESIHQvgjqL01WDEovkPGvvQkbPeX_0 2024-09-12T19:22:59.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6905363724265508703', time=2024-09-12T20:36:28.593063+0000, chain.objs.size()=1 2024-09-12T19:22:59.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.qXfgnpIP2CSsfp05VcB1eIjcdSFvuzu_0 2024-09-12T19:22:59.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1266600360760462269', time=2024-09-12T20:36:32.323239+0000, chain.objs.size()=1 2024-09-12T19:22:59.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.vNtkXopwk4ETN17xFpYJaIklAdMsSiQ_0 2024-09-12T19:22:59.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11148574405785632652', time=2024-09-12T20:36:32.325308+0000, chain.objs.size()=1 2024-09-12T19:22:59.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.BgRavvbsTEZJwkrgQ35yJttH9RfVWd3_0 2024-09-12T19:22:59.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2236082924810313465', time=2024-09-12T20:36:32.379057+0000, chain.objs.size()=1 2024-09-12T19:22:59.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.TVkLi3uwJz1PQ0Wg0HkkUJkKCYdEQFe_0 2024-09-12T19:22:59.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4133810555198737089', time=2024-09-12T20:36:32.380897+0000, chain.objs.size()=1 2024-09-12T19:22:59.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.dO2tPVTTsTjDp69YqWrwQFm8tdv3egm_0 2024-09-12T19:22:59.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5374594457939320752', time=2024-09-12T20:36:37.207402+0000, chain.objs.size()=1 2024-09-12T19:22:59.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.OgGDRxCluQFvGwVrZLjguTyZLHFGMN__0 2024-09-12T19:22:59.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7091111447391552056', time=2024-09-12T20:36:37.848870+0000, chain.objs.size()=1 2024-09-12T19:22:59.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.r1bl6-grRMVFHezhVoR5g09wlxgNRvZ_0 2024-09-12T19:22:59.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.775460326255370246', time=2024-09-12T20:36:38.440199+0000, chain.objs.size()=1 2024-09-12T19:22:59.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.mkEBkJ29CXM8H8Q_MORqLvh2p5LQZfo_0 2024-09-12T19:22:59.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15773612841142992183', time=2024-09-12T20:36:39.594625+0000, chain.objs.size()=1 2024-09-12T19:22:59.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Y6bdsKuR00k68OgB-_m5f2Rjzq39Uas_0 2024-09-12T19:22:59.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13215519975862250609', time=2024-09-12T20:36:40.619860+0000, chain.objs.size()=1 2024-09-12T19:22:59.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.iv1WGq9Ap2HmFFG0uHvdtQo9Wno038I_0 2024-09-12T19:22:59.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10051117148617578572', time=2024-09-12T20:36:40.709189+0000, chain.objs.size()=1 2024-09-12T19:22:59.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.534+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.JVYHN-y1W098024aumvcOoQBTskop85_0 2024-09-12T19:22:59.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.538+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1934741692646063333', time=2024-09-12T20:36:41.233622+0000, chain.objs.size()=1 2024-09-12T19:22:59.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.rJXsldAbQBdBRzuGCrgsaRHuvkpttc7_0 2024-09-12T19:22:59.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.538+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15367170278196924539', time=2024-09-12T20:36:43.633359+0000, chain.objs.size()=1 2024-09-12T19:22:59.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.w5NA8WEipmHm2oY9mJdyFGwEoqtI5Oq_0 2024-09-12T19:22:59.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17296591113265254558', time=2024-09-12T20:36:44.425060+0000, chain.objs.size()=1 2024-09-12T19:22:59.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.NtIc-JQMzufe6PqQYYhzhWr5yKwctXG_0 2024-09-12T19:22:59.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16967217722308588191', time=2024-09-12T20:36:44.620433+0000, chain.objs.size()=1 2024-09-12T19:22:59.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.BX2fJgjztn4fktGsQUDbbOMWx9B10Kx_0 2024-09-12T19:22:59.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15845727336594453859', time=2024-09-12T20:36:45.734249+0000, chain.objs.size()=1 2024-09-12T19:22:59.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.8JpyOBidVwraK9qIYBYTA_r-y0VTijV_0 2024-09-12T19:22:59.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11897803280296033888', time=2024-09-12T20:36:45.736401+0000, chain.objs.size()=1 2024-09-12T19:22:59.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.cqLmuO6R5FRY8VyRpDKgDuAARoILfd8_0 2024-09-12T19:22:59.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14398482944302371926', time=2024-09-12T20:36:45.995338+0000, chain.objs.size()=1 2024-09-12T19:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.LWPEsJmjDEm1NktFYaaNJZfAzDpQxv7_0 2024-09-12T19:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15444942969187295387', time=2024-09-12T20:36:47.787610+0000, chain.objs.size()=1 2024-09-12T19:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ORGzWsyXP4j5y1-TIuY8DVhDkvVAIJW_0 2024-09-12T19:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11026778148781113614', time=2024-09-12T20:36:49.782979+0000, chain.objs.size()=1 2024-09-12T19:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.IqWs2YxzecHincmyHnntV6Emxolzrhi_0 2024-09-12T19:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.920710786486315731', time=2024-09-12T20:36:50.985689+0000, chain.objs.size()=1 2024-09-12T19:22:59.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.oFURiOf8oVFt8MXQD8A4esD7WaaPzhP_0 2024-09-12T19:22:59.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5880735081612088266', time=2024-09-12T20:36:53.159036+0000, chain.objs.size()=1 2024-09-12T19:22:59.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.mmfrnoBpySWtQp5NyJ5qkDKTBU64zjA_0 2024-09-12T19:22:59.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12657348802818297530', time=2024-09-12T20:36:54.124837+0000, chain.objs.size()=1 2024-09-12T19:22:59.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.542+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.PsqAakhNtzbCtcd3J2KkyXskzU31yYH_0 2024-09-12T19:22:59.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.546+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8140728143322537767', time=2024-09-12T20:36:54.260735+0000, chain.objs.size()=1 2024-09-12T19:22:59.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.546+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.KD5K345Bx0bKDega9hsecBqhagH_XUV_0 2024-09-12T19:22:59.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.546+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.691709421356067813', time=2024-09-12T20:36:55.003226+0000, chain.objs.size()=1 2024-09-12T19:22:59.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.546+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.i0MkDxTytUiQIWmae9TGU9D0uUoPKe-_0 2024-09-12T19:22:59.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.546+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14906984669560848339', time=2024-09-12T20:38:40.261285+0000, chain.objs.size()=1 2024-09-12T19:22:59.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.546+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.oOlSgdxg4YGJoh1VnXEr4UYLC8zEBpK_0 2024-09-12T19:22:59.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.546+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16722263405247220189', time=2024-09-12T20:38:40.713553+0000, chain.objs.size()=1 2024-09-12T19:22:59.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.546+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.6ouQOn8PJmhsPPnUGSJ400eDozNkCC8_0 2024-09-12T19:22:59.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.546+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2441520166903414519', time=2024-09-12T20:38:44.836886+0000, chain.objs.size()=1 2024-09-12T19:22:59.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.546+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ZBs0rVjWSSKHdGbQKTxOX8kv64P3Jgz_0 2024-09-12T19:22:59.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9620660041594334132', time=2024-09-12T20:38:44.838839+0000, chain.objs.size()=1 2024-09-12T19:22:59.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.o_d7IENeZ4CaHanybpK24IU04ieAr4z_0 2024-09-12T19:22:59.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9304832821500976799', time=2024-09-12T20:38:45.001078+0000, chain.objs.size()=1 2024-09-12T19:22:59.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.7PsxhaixLa-8B465j0jfyJKZPa7qfGD_0 2024-09-12T19:22:59.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11349991063170384574', time=2024-09-12T20:38:45.234117+0000, chain.objs.size()=1 2024-09-12T19:22:59.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.vHV7NlM5f5N7L-Vr-hFkqYH-jIVRaRV_0 2024-09-12T19:22:59.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7610927903709979838', time=2024-09-12T20:38:46.444367+0000, chain.objs.size()=1 2024-09-12T19:22:59.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.11vICZzQPC9nsfGcvhq9X68mE_pcJNj_0 2024-09-12T19:22:59.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15641300856392116280', time=2024-09-12T20:38:47.607835+0000, chain.objs.size()=1 2024-09-12T19:22:59.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.dhUZdlKeUJ8T-nefJMP61_cojWzBqZC_0 2024-09-12T19:22:59.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10799547148664429290', time=2024-09-12T20:38:47.609033+0000, chain.objs.size()=1 2024-09-12T19:22:59.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.EP8W9vN-xyTG93gjK1ELk2KL7Ai4d2D_0 2024-09-12T19:22:59.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14598206832307445309', time=2024-09-12T20:38:48.954899+0000, chain.objs.size()=1 2024-09-12T19:22:59.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.eMGaxnPuytpj79uKZC7TplO6gpKz7b5_0 2024-09-12T19:22:59.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10565963150712221756', time=2024-09-12T20:38:48.957262+0000, chain.objs.size()=1 2024-09-12T19:22:59.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.cjZ_LH1X3ISnqBeiQkNCnDevJ-KgvPi_0 2024-09-12T19:22:59.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10276389845218555007', time=2024-09-12T20:38:49.893382+0000, chain.objs.size()=1 2024-09-12T19:22:59.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.4ITD4ft1yXFgXNa6GWgWERe6OBotj4-_0 2024-09-12T19:22:59.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4356510655779391373', time=2024-09-12T20:38:50.137641+0000, chain.objs.size()=1 2024-09-12T19:22:59.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.7kkB4XNwlBm3RqViaZaQFLEBPg4vXIB_0 2024-09-12T19:22:59.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5567512062303236691', time=2024-09-12T20:38:52.348287+0000, chain.objs.size()=1 2024-09-12T19:22:59.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.4qDqKvPMI9JMB9zbCeqyhmLF0KHkogQ_0 2024-09-12T19:22:59.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11725634460235204195', time=2024-09-12T20:38:53.986889+0000, chain.objs.size()=1 2024-09-12T19:22:59.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.4A5_OL2dmN5wgD4oUMGlhZs3sHiRxWj_0 2024-09-12T19:22:59.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16958387245542823912', time=2024-09-12T20:38:55.038507+0000, chain.objs.size()=1 2024-09-12T19:22:59.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.yStcNLLOPXB78DEFcozp3lwQeKlzxJQ_0 2024-09-12T19:22:59.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18211660690941244347', time=2024-09-12T20:38:56.758619+0000, chain.objs.size()=1 2024-09-12T19:22:59.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.htzcD8S1zWRTFpFutM4YSVb_5RgYR7X_0 2024-09-12T19:22:59.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5805237671646823078', time=2024-09-12T20:38:56.783732+0000, chain.objs.size()=1 2024-09-12T19:22:59.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.mJ5Ms2x_QBvTn-qwOSZaAbr-d8l8aK2_0 2024-09-12T19:22:59.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3181859016608007045', time=2024-09-12T20:38:57.118968+0000, chain.objs.size()=1 2024-09-12T19:22:59.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.UHH2wn7S35XRzUVU_XCN9TTnDjRecRz_0 2024-09-12T19:22:59.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9606467513897163899', time=2024-09-12T20:38:57.565180+0000, chain.objs.size()=1 2024-09-12T19:22:59.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.oeLsYOk4iI5Nc53FweCV_iWF30F7lZe_0 2024-09-12T19:22:59.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.882361290334408483', time=2024-09-12T20:38:57.676619+0000, chain.objs.size()=1 2024-09-12T19:22:59.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.a60ojlG6-jKTrijSFFxtN_V0Y3qYigT_0 2024-09-12T19:22:59.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5416026119756573868', time=2024-09-12T20:38:58.851428+0000, chain.objs.size()=1 2024-09-12T19:22:59.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.mSydQzc5biHRXdzGBX-GIPhBb_Xhv2d_0 2024-09-12T19:22:59.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11127579419145594962', time=2024-09-12T20:38:59.413136+0000, chain.objs.size()=1 2024-09-12T19:22:59.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.spX85YTjiD5wjLgxWfmfG8GhAQeSUBZ_0 2024-09-12T19:22:59.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5410215316392973157', time=2024-09-12T20:39:00.661469+0000, chain.objs.size()=1 2024-09-12T19:22:59.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.XiLKK1ZPJvYhuYPqV4BFuzbUwMHHD5B_0 2024-09-12T19:22:59.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15178442451512064596', time=2024-09-12T20:39:02.226625+0000, chain.objs.size()=1 2024-09-12T19:22:59.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.xhzvvwlucsZo-90Dgkz-rHcnDm5dxXs_0 2024-09-12T19:22:59.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.562+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10498738219584981527', time=2024-09-12T20:39:02.332519+0000, chain.objs.size()=1 2024-09-12T19:22:59.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.k1Y8OXAC9lzR-RlNHvZx4jkl1Ixaf6Z_0 2024-09-12T19:22:59.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.562+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11477369449100250265', time=2024-09-12T20:39:02.572155+0000, chain.objs.size()=1 2024-09-12T19:22:59.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Hi-64WD2qslLIjopO0G1nPB2-HD0FJN_0 2024-09-12T19:22:59.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.562+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15428079324591487110', time=2024-09-12T20:39:03.077566+0000, chain.objs.size()=1 2024-09-12T19:22:59.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.UeKC4fmCkAVBs-pxltIIVgcCOyjwA7t_0 2024-09-12T19:22:59.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.562+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6308798451485256372', time=2024-09-12T20:39:03.815671+0000, chain.objs.size()=1 2024-09-12T19:22:59.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.nbGMzkupkEGWQKcVnSM1FxdaqyzEKcC_0 2024-09-12T19:22:59.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.562+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12147098979978471486', time=2024-09-12T20:39:03.947634+0000, chain.objs.size()=1 2024-09-12T19:22:59.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Hp1YOSpom6t5DzOMakMbXtaoUKQL-FD_0 2024-09-12T19:22:59.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.562+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4572221159932702874', time=2024-09-12T20:39:04.831716+0000, chain.objs.size()=1 2024-09-12T19:22:59.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.eJp0g2s2meDk7FNMSIrgVzhpD_EHWu5_0 2024-09-12T19:22:59.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.562+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4076639196835348601', time=2024-09-12T20:41:54.615299+0000, chain.objs.size()=1 2024-09-12T19:22:59.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.408__shadow_.J8TJDR_N7wkCZ8reS-S-D7dD1dTwdbo_0 2024-09-12T19:22:59.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.562+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1871981167998326905', time=2024-09-12T20:41:56.623587+0000, chain.objs.size()=1 2024-09-12T19:22:59.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.409__shadow_.Z6C4bq0gNASpCwBpFJX6IeGXSw6JTq9_0 2024-09-12T19:22:59.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.566+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15357769734550875080', time=2024-09-12T20:43:52.667284+0000, chain.objs.size()=1 2024-09-12T19:22:59.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.461__shadow_.6bL5Ving9NQzfgtm3BmZaJebQqVBrmy_0 2024-09-12T19:22:59.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.566+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.743108884769079850', time=2024-09-12T20:44:36.439524+0000, chain.objs.size()=1 2024-09-12T19:22:59.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.484__shadow_.RXrRLs_gwQitJR8E0AWiUtvLLSz_YfB_0 2024-09-12T19:22:59.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.566+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10548398931338598583', time=2024-09-12T20:53:06.768595+0000, chain.objs.size()=1 2024-09-12T19:22:59.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.528__shadow_.CfIyRhYlEYSgPC8M-lDn0SHsyQLtWef_0 2024-09-12T19:22:59.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.566+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5803901355129852550', time=2024-09-12T20:54:59.895735+0000, chain.objs.size()=1 2024-09-12T19:22:59.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.551__shadow_.05m-MIRMzoW_IlszbLxTweSqqjUcYnG_0 2024-09-12T19:22:59.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.570+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7012690219854343408', time=2024-09-12T20:55:42.686600+0000, chain.objs.size()=1 2024-09-12T19:22:59.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.570+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.555__shadow_.YaNxosv7Cqi3ooQDSfwryr1SLJx2Tl0_0 2024-09-12T19:22:59.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.570+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4221874334650561931', time=2024-09-12T20:56:18.170112+0000, chain.objs.size()=1 2024-09-12T19:22:59.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.570+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.561__multipart_mymultipart.2~crnXwwXjIt4N69OAR9UXEbLSKNX4xw8.1 2024-09-12T19:22:59.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.574+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44259 2024-09-12T19:22:59.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.578+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T19:22:59.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.578+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Hc7PMMaHYgae1tAHFFLt-2oi6L8KrlI', time=2024-09-12T20:56:18.732139+0000, chain.objs.size()=1 2024-09-12T19:22:59.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.578+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.561__multipart_mymultipart.2~Hc7PMMaHYgae1tAHFFLt-2oi6L8KrlI.1 2024-09-12T19:22:59.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.578+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16781463807938738839', time=2024-09-12T20:56:19.519459+0000, chain.objs.size()=1 2024-09-12T19:22:59.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.578+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.561__multipart_mymultipart.fQr3Jbyd-eXFvGejgkkXOMunSD9tlOif.1 2024-09-12T19:22:59.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.578+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7128280642934399226', time=2024-09-12T20:56:31.527387+0000, chain.objs.size()=2 2024-09-12T19:22:59.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.578+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.563__shadow_.Bb0SOMAFhhqo0DTxUkjb0en8gYse5Xk_0 2024-09-12T19:22:59.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.578+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.563__shadow_.Bb0SOMAFhhqo0DTxUkjb0en8gYse5Xk_1 2024-09-12T19:22:59.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.578+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6762866570070504866', time=2024-09-12T20:56:57.329558+0000, chain.objs.size()=1 2024-09-12T19:22:59.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.578+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:2obRaWTeBehiT9tVMOqNeV3WSpld4GE_.8P1rEVVuGC3U7TwCReuF401POIABj8F_0 2024-09-12T19:22:59.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.578+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8923258189247135420', time=2024-09-12T20:59:35.020993+0000, chain.objs.size()=1 2024-09-12T19:22:59.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.578+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.580__shadow:Hv2wbbedeP.N6cSgFCL9WFR6ss5nrbB_._r7qX5j0nVaUDxA_vCiIKc8n4TpCjPr_0 2024-09-12T19:22:59.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.578+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11215731046398467481', time=2024-09-12T20:59:37.771560+0000, chain.objs.size()=1 2024-09-12T19:22:59.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.578+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.582__shadow:cxmRMI5U7YVoqBBV1TmhxR9YbUVgqeh_.ONYLlQob1pUHW0qB2sm9V7OiSM15OnN_0 2024-09-12T19:22:59.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.578+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5518113008447331320', time=2024-09-12T21:05:28.005513+0000, chain.objs.size()=1 2024-09-12T19:22:59.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.578+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.620__shadow_.lthQL2k3cK-GrDp4n6sRfRTe8IKnuDP_0 2024-09-12T19:22:59.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.578+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2444159786412891606', time=2024-09-12T21:10:09.303792+0000, chain.objs.size()=1 2024-09-12T19:22:59.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.578+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.679__shadow_.oEYdh1ABR6YvH0xfcgPRv_AKSSwBFCn_0 2024-09-12T19:22:59.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.578+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10491890948750194931', time=2024-09-12T21:11:06.207188+0000, chain.objs.size()=1 2024-09-12T19:22:59.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.578+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.708__shadow:twUDWWfbdk5xjsoJ3yQTPqtWT-zm5zm_.Tf1QgWsQqVfWeGMUt7ADxGWQkisPNkT_0 2024-09-12T19:22:59.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:22:59.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T19:22:59.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:22:59.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:22:59.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47760' 2024-09-12T19:22:59.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4037582775746770130', time=2024-09-12T20:23:51.251725+0000, chain.objs.size()=1 2024-09-12T19:22:59.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.171__shadow_.XBk0j63dc0La0mtjdNSSJK_xsUjEOTr_0 2024-09-12T19:22:59.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13155933078924153319', time=2024-09-12T20:28:54.832505+0000, chain.objs.size()=1 2024-09-12T19:22:59.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.234__shadow_.D8jOeW7SZuxFWnsZULIQy0US-XnpO0F_0 2024-09-12T19:22:59.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17579038898437906342', time=2024-09-12T20:29:13.225308+0000, chain.objs.size()=1 2024-09-12T19:22:59.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.241__shadow_.PLClDekK6M29s8YPkNZvW74r1HN7a5e_0 2024-09-12T19:22:59.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4711000211300663989', time=2024-09-12T20:29:50.885614+0000, chain.objs.size()=1 2024-09-12T19:22:59.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.256__shadow_.VwlrK78ORXdI4SKjYb-sWdEY6DWerx__0 2024-09-12T19:22:59.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12736779748561066301', time=2024-09-12T20:29:59.825309+0000, chain.objs.size()=1 2024-09-12T19:22:59.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.260__shadow_.9V71tgbMZGLXQLmGVvCWmzK44Hncgxh_0 2024-09-12T19:22:59.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13110769168694390375', time=2024-09-12T20:31:45.192807+0000, chain.objs.size()=1 2024-09-12T19:22:59.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.7LcW1zJB5eUO60v46ihIyNPku4rVivx_0 2024-09-12T19:22:59.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9679473999431834979', time=2024-09-12T20:31:45.649335+0000, chain.objs.size()=1 2024-09-12T19:22:59.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.8WiMU0-Nf2Y-p7TJvAmKYoUACX47GUX_0 2024-09-12T19:22:59.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8529923075706781210', time=2024-09-12T20:31:45.756708+0000, chain.objs.size()=1 2024-09-12T19:22:59.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.pSPAlXfO0zwio2-lfzAIOp2olXeHlU3_0 2024-09-12T19:22:59.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1480691722587126336', time=2024-09-12T20:31:45.962532+0000, chain.objs.size()=1 2024-09-12T19:22:59.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.uzDi0uLtJqtxhsUO8fkXo4dCpDgnYj3_0 2024-09-12T19:22:59.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6868389861068865507', time=2024-09-12T20:31:46.584570+0000, chain.objs.size()=1 2024-09-12T19:22:59.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.K-v55tPxTCjeUCEzQ8g39v7aejwSAwe_0 2024-09-12T19:22:59.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7121871784317109386', time=2024-09-12T20:31:46.945850+0000, chain.objs.size()=1 2024-09-12T19:22:59.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.2dJ4RmeiQyYueR4ivgGpH6b57OXuHbJ_0 2024-09-12T19:22:59.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14667171303226729964', time=2024-09-12T20:31:48.154558+0000, chain.objs.size()=1 2024-09-12T19:22:59.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.iA4oDcJrdJcqAiA-LuwVbZhBtN3KUZs_0 2024-09-12T19:22:59.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9773843780819252773', time=2024-09-12T20:31:50.270890+0000, chain.objs.size()=1 2024-09-12T19:22:59.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.fRMOQ2ISJcFekvVyBnfhozHspFh4O9f_0 2024-09-12T19:22:59.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12908777938973402879', time=2024-09-12T20:31:50.992420+0000, chain.objs.size()=1 2024-09-12T19:22:59.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.TRfB8HSTCL2Y53RWvHFYW108GNUg8WX_0 2024-09-12T19:22:59.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17918445448019101426', time=2024-09-12T20:31:51.291257+0000, chain.objs.size()=1 2024-09-12T19:22:59.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.sN5wvwe39ij3zWeLjzwd1vketT9Dp7S_0 2024-09-12T19:22:59.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.812256262596964227', time=2024-09-12T20:31:51.612663+0000, chain.objs.size()=1 2024-09-12T19:22:59.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.FbjaO7LZjr23FKcoqARlpnnzz6-YW6A_0 2024-09-12T19:22:59.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15233094010153784744', time=2024-09-12T20:31:52.147450+0000, chain.objs.size()=1 2024-09-12T19:22:59.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.y_FTCNvtLDdL7PEVNU1VwkEeFz1RWRM_0 2024-09-12T19:22:59.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4863676738836056307', time=2024-09-12T20:31:53.894789+0000, chain.objs.size()=1 2024-09-12T19:22:59.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.-MNKmu4Ja7et2_1KQordaIQ49bVx8fR_0 2024-09-12T19:22:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14253624974139236245', time=2024-09-12T20:31:54.262936+0000, chain.objs.size()=1 2024-09-12T19:22:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.vQ1Zw4kKskERyaS7gn0CyZVz6l4rF7W_0 2024-09-12T19:22:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8353883205689145681', time=2024-09-12T20:31:55.546304+0000, chain.objs.size()=1 2024-09-12T19:22:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.1oqun9Tv_ueQ1V6h3-bSzJmiUrocYec_0 2024-09-12T19:22:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3081437632631176844', time=2024-09-12T20:31:57.357984+0000, chain.objs.size()=1 2024-09-12T19:22:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.op3wq6zh1GsiD6uk_uI_aXSOpsOxvwx_0 2024-09-12T19:22:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16050233525571122245', time=2024-09-12T20:31:58.426030+0000, chain.objs.size()=1 2024-09-12T19:22:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.HKrcRSTPlIbeEEs0__zCL8vdKGZ-y9J_0 2024-09-12T19:22:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4980589770937691154', time=2024-09-12T20:31:59.237882+0000, chain.objs.size()=1 2024-09-12T19:22:59.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.fuNrKXyY7qEscbbrWZLmeB5MR4LTNfj_0 2024-09-12T19:22:59.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.602+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14616050286869987972', time=2024-09-12T20:32:00.722562+0000, chain.objs.size()=1 2024-09-12T19:22:59.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.602+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.OUqX8gkHVlT4dozvzv4x-4-7aUNKe9J_0 2024-09-12T19:22:59.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5093404897577149798', time=2024-09-12T20:32:01.398531+0000, chain.objs.size()=1 2024-09-12T19:22:59.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.dVNwrJJVJ4ldkZqXZJXDNxsljZFfeJd_0 2024-09-12T19:22:59.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7069065151904680992', time=2024-09-12T20:32:01.538002+0000, chain.objs.size()=1 2024-09-12T19:22:59.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.qNeKD4HoL8krBI3WDpQnBstLqV6YAKf_0 2024-09-12T19:22:59.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3163397492087536487', time=2024-09-12T20:32:01.608973+0000, chain.objs.size()=1 2024-09-12T19:22:59.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.tZ8sGo7soVJuowQ9Rrqse0ePDdayJ6P_0 2024-09-12T19:22:59.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6720899394655255340', time=2024-09-12T20:32:02.472154+0000, chain.objs.size()=1 2024-09-12T19:22:59.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.w9DhvVAE0V216FUd03p364y68K-eHdS_0 2024-09-12T19:22:59.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1957262849875619922', time=2024-09-12T20:32:03.474203+0000, chain.objs.size()=1 2024-09-12T19:22:59.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_._DAivAtytznZo537xuYtSHlO2MRJ18v_0 2024-09-12T19:22:59.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8368816543732635024', time=2024-09-12T20:32:04.390013+0000, chain.objs.size()=1 2024-09-12T19:22:59.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.klVukC8otND8MSgVJt4wy8ge8CT4JiP_0 2024-09-12T19:22:59.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13553328426473737206', time=2024-09-12T20:32:04.889226+0000, chain.objs.size()=1 2024-09-12T19:22:59.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.MJvzeGZJ9zzK9YJJ0iAhE2iEf3nLn1K_0 2024-09-12T19:22:59.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5211949589785572616', time=2024-09-12T20:32:09.485116+0000, chain.objs.size()=1 2024-09-12T19:22:59.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.bRm2Jvir1c4BvK5j2Eu9hJW0jzTQhpY_0 2024-09-12T19:22:59.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7069462151723458902', time=2024-09-12T20:32:09.707997+0000, chain.objs.size()=1 2024-09-12T19:22:59.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.5EL3kQTDwTsswd5jbHx-NSb6be85Axv_0 2024-09-12T19:22:59.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4654719109987619334', time=2024-09-12T20:32:10.066711+0000, chain.objs.size()=1 2024-09-12T19:22:59.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ef70XFB4EGD-tidy-2DuW0SZbFhhCpu_0 2024-09-12T19:22:59.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5201605612682945332', time=2024-09-12T20:32:11.570142+0000, chain.objs.size()=1 2024-09-12T19:22:59.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.AjKNsQ7yb02AGN-FDXIzOYazS_llMUQ_0 2024-09-12T19:22:59.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2488775776934557965', time=2024-09-12T20:32:12.700239+0000, chain.objs.size()=1 2024-09-12T19:22:59.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.JJZHkIuV7asQJ3whe8IbV3WQJhYbX7t_0 2024-09-12T19:22:59.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1978498545546433476', time=2024-09-12T20:32:13.569338+0000, chain.objs.size()=1 2024-09-12T19:22:59.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.g50-e0Nf-0bfR2UivvKPXKEKD6-A9g3_0 2024-09-12T19:22:59.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6050130061237644725', time=2024-09-12T20:32:13.877291+0000, chain.objs.size()=1 2024-09-12T19:22:59.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.kKcJ_3i8mFyUBE6iMijGRbbWoY6MNYX_0 2024-09-12T19:22:59.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5712697841968038269', time=2024-09-12T20:32:13.944194+0000, chain.objs.size()=1 2024-09-12T19:22:59.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.FOqJawehxtqNig8VTEwEz8YoyCtvEtE_0 2024-09-12T19:22:59.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3823324585347397952', time=2024-09-12T20:32:16.212988+0000, chain.objs.size()=1 2024-09-12T19:22:59.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.263__shadow_.Mq7NzOUnLFtgV8lGT09EbMU05a8nw9o_0 2024-09-12T19:22:59.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3207293148679703091', time=2024-09-12T20:32:44.852291+0000, chain.objs.size()=1 2024-09-12T19:22:59.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.276__shadow_.0OMxGyQoKj-rgU9VtshO8S_YmwuLKLK_0 2024-09-12T19:22:59.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17267639418401318288', time=2024-09-12T20:33:31.360788+0000, chain.objs.size()=1 2024-09-12T19:22:59.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.pVCubwzhkwfHbyqyDu6PYbSZu17NuOQ_0 2024-09-12T19:22:59.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14514084345404743480', time=2024-09-12T20:33:45.703523+0000, chain.objs.size()=1 2024-09-12T19:22:59.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.299__shadow_.1_RY5ijmaXlQSbdb9Zjt5M0qURSJ3R3_0 2024-09-12T19:22:59.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8637321738048355786', time=2024-09-12T20:36:29.093418+0000, chain.objs.size()=1 2024-09-12T19:22:59.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.onyNso7xBl3_TPCcl2ARtPHKMu1Hb4K_0 2024-09-12T19:22:59.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2726401933384665469', time=2024-09-12T20:36:29.522625+0000, chain.objs.size()=1 2024-09-12T19:22:59.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.610+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.JBJ99YUhQIkAxdN_DBtw9RIeNC9H4Nt_0 2024-09-12T19:22:59.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13894244823493524743', time=2024-09-12T20:36:29.627979+0000, chain.objs.size()=1 2024-09-12T19:22:59.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.jt3a4VFlXyCCEoj02LlQh--Ei77dshO_0 2024-09-12T19:22:59.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8637286218390863166', time=2024-09-12T20:36:29.923611+0000, chain.objs.size()=1 2024-09-12T19:22:59.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.dwWWM7xAkQZA0Xd5o9VmHfJPBCsQ8-u_0 2024-09-12T19:22:59.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17289395208616892518', time=2024-09-12T20:36:29.925291+0000, chain.objs.size()=1 2024-09-12T19:22:59.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.l1fBjZ5m6hovNn8n-x5YN_hGqe1ZuB6_0 2024-09-12T19:22:59.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7965683349852357001', time=2024-09-12T20:36:30.125376+0000, chain.objs.size()=1 2024-09-12T19:22:59.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.2a0c_G4E-xE1Rmeo07vPhEdXAuJlA19_0 2024-09-12T19:22:59.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.907478457781743088', time=2024-09-12T20:36:30.548130+0000, chain.objs.size()=1 2024-09-12T19:22:59.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.l4fWgGOFgSPWQIo6dWFzYLeCT3eDkZ4_0 2024-09-12T19:22:59.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2033598858767832028', time=2024-09-12T20:36:30.844105+0000, chain.objs.size()=1 2024-09-12T19:22:59.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.YNlog058zk7y3CE_GKTQrIB7zK1TFYj_0 2024-09-12T19:22:59.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18286147547323273195', time=2024-09-12T20:36:30.868970+0000, chain.objs.size()=1 2024-09-12T19:22:59.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ZrT_qiGo4JVO_tZ03osJxXmukPmLPeA_0 2024-09-12T19:22:59.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.618+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1206338540937461168', time=2024-09-12T20:36:31.958470+0000, chain.objs.size()=1 2024-09-12T19:22:59.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.618+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.YROfRY8FHqaEsab2Y4kLtU3IHW8sYkE_0 2024-09-12T19:22:59.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.618+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17193935630879522684', time=2024-09-12T20:36:36.306040+0000, chain.objs.size()=1 2024-09-12T19:22:59.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.618+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.EuThGipzv39tqWJGsWL_zhoVct-mWLn_0 2024-09-12T19:22:59.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.618+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17348716822676496653', time=2024-09-12T20:36:37.850066+0000, chain.objs.size()=1 2024-09-12T19:22:59.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.618+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.CJk7AOZvl44qcFBJ1YMS2xFOyzQ-LmV_0 2024-09-12T19:22:59.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.618+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7563037874799993420', time=2024-09-12T20:36:39.952768+0000, chain.objs.size()=1 2024-09-12T19:22:59.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.618+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.km-123Mby5ckVIA4OuhnCkYuaDDW6QK_0 2024-09-12T19:22:59.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.618+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.798207084850032650', time=2024-09-12T20:36:40.531081+0000, chain.objs.size()=1 2024-09-12T19:22:59.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.618+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.I52ZDLAShPU3y60qOsu8DArbTM_IHPb_0 2024-09-12T19:22:59.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15278173515025742976', time=2024-09-12T20:36:40.902975+0000, chain.objs.size()=1 2024-09-12T19:22:59.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.LfGQTCLYRNH5mPpMZygO96_gUOCwGLm_0 2024-09-12T19:22:59.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10862680419260810640', time=2024-09-12T20:36:42.275705+0000, chain.objs.size()=1 2024-09-12T19:22:59.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.xHKQi_eqesLZwCws2P0eJmI6L5S915J_0 2024-09-12T19:22:59.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12745301928014280641', time=2024-09-12T20:36:42.354695+0000, chain.objs.size()=1 2024-09-12T19:22:59.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.CTjSR4jyhh0lTUnuS1hTycPEa-h-FBo_0 2024-09-12T19:22:59.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11776966178598909088', time=2024-09-12T20:36:43.691980+0000, chain.objs.size()=1 2024-09-12T19:22:59.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.wrCdV0cZDglRPxSEhWRxX0OqjgTK--O_0 2024-09-12T19:22:59.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4146093014387891072', time=2024-09-12T20:36:44.152199+0000, chain.objs.size()=1 2024-09-12T19:22:59.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Ogsh0Znmg-Nj1f7je1KaD31ev1Cecpk_0 2024-09-12T19:22:59.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2307293301095990387', time=2024-09-12T20:36:45.929751+0000, chain.objs.size()=1 2024-09-12T19:22:59.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ylMrsVIuH35pB_9dATJAQ8Sm_qGifZk_0 2024-09-12T19:22:59.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.626+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13623148938318648045', time=2024-09-12T20:36:47.674622+0000, chain.objs.size()=1 2024-09-12T19:22:59.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.626+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.fOU9RjzC2rd9NA5nVToG_SCr4-qG9QC_0 2024-09-12T19:22:59.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.626+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9269643548360897869', time=2024-09-12T20:36:47.977037+0000, chain.objs.size()=1 2024-09-12T19:22:59.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.626+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.STuo-kral7TiEMfEExb6oeAy9_QBtjH_0 2024-09-12T19:22:59.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.626+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10856534148408911828', time=2024-09-12T20:36:48.494518+0000, chain.objs.size()=1 2024-09-12T19:22:59.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.626+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.c8JhcwptHawxw4hJ1J2jAYx_UhVj5NX_0 2024-09-12T19:22:59.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.626+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7583683735848851929', time=2024-09-12T20:36:49.663672+0000, chain.objs.size()=1 2024-09-12T19:22:59.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.626+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Lqd5NJw3ivNU-YL7u2uCIUFLWhXxRve_0 2024-09-12T19:22:59.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.626+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1742657507438001676', time=2024-09-12T20:36:49.816262+0000, chain.objs.size()=1 2024-09-12T19:22:59.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.626+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.JZy4VV_08WkloXHCzD4iys0zccaltta_0 2024-09-12T19:22:59.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.626+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7814718171870579384', time=2024-09-12T20:36:51.430409+0000, chain.objs.size()=1 2024-09-12T19:22:59.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.626+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.LC8LPz-KxsVHElz5kP5SpKNOOnCbtEd_0 2024-09-12T19:22:59.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.630+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14326973842113647280', time=2024-09-12T20:36:51.840501+0000, chain.objs.size()=1 2024-09-12T19:22:59.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.630+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.EiJs4M-FQnZPTDQUcVevEHRUQLLplqz_0 2024-09-12T19:22:59.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.630+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1862583162697812892', time=2024-09-12T20:36:54.822218+0000, chain.objs.size()=1 2024-09-12T19:22:59.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.630+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.xzKkWWVdJY4BQUy0UCcOSc6G8ClIoFJ_0 2024-09-12T19:22:59.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.630+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9999253395606611129', time=2024-09-12T20:36:55.539991+0000, chain.objs.size()=1 2024-09-12T19:22:59.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.630+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.JEgP2ROn4FPDe2-tU7Cu49IOrqqwM_I_0 2024-09-12T19:22:59.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.630+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10604106332200591582', time=2024-09-12T20:38:40.706799+0000, chain.objs.size()=1 2024-09-12T19:22:59.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.630+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.SbilQc6l7HtmpLpNcFG0JLWLkswqfaR_0 2024-09-12T19:22:59.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.630+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17967315359910854438', time=2024-09-12T20:38:41.365840+0000, chain.objs.size()=1 2024-09-12T19:22:59.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.630+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.PBxLuRw0sbMiZH48pue_DwmP9e14PUR_0 2024-09-12T19:22:59.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.630+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15990392446184390163', time=2024-09-12T20:38:41.525586+0000, chain.objs.size()=1 2024-09-12T19:22:59.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.630+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-1iHYY1G4jqSiWUAAvQmLOap13WVbkf_0 2024-09-12T19:22:59.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.634+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6373854961209949027', time=2024-09-12T20:38:42.065212+0000, chain.objs.size()=1 2024-09-12T19:22:59.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.634+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.TJsVmlTd73dgnoVtqhOlDM3yw4L0bDk_0 2024-09-12T19:22:59.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.634+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6913085379974807815', time=2024-09-12T20:38:42.283531+0000, chain.objs.size()=1 2024-09-12T19:22:59.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.634+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.zaXKhc5uypxkGsFxwvHG4-QKcJlRs3w_0 2024-09-12T19:22:59.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.634+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13183286470805838067', time=2024-09-12T20:38:43.743666+0000, chain.objs.size()=1 2024-09-12T19:22:59.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.634+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.iNdktnoKnsY8n99iR146dypx-9Zieb6_0 2024-09-12T19:22:59.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.634+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3939621714319078787', time=2024-09-12T20:38:44.062855+0000, chain.objs.size()=1 2024-09-12T19:22:59.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.634+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.dFsFvjB1Qk-BjRjp3yMs2krt6yIR4kT_0 2024-09-12T19:22:59.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.634+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10016318456417406729', time=2024-09-12T20:38:44.940693+0000, chain.objs.size()=1 2024-09-12T19:22:59.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.634+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.YIEtEnBtdY4Uv2LuxbZqc1Ep5bYDN3g_0 2024-09-12T19:22:59.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.634+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17376507142852865134', time=2024-09-12T20:38:45.271779+0000, chain.objs.size()=1 2024-09-12T19:22:59.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.634+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.AI4QOuDfQF7g5P2wtIH3tfV_SxDI652_0 2024-09-12T19:22:59.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.634+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14625223813948133089', time=2024-09-12T20:38:45.551938+0000, chain.objs.size()=1 2024-09-12T19:22:59.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.634+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.av9bRlM1MBBPLZXLHmPZYMkOy34YFTO_0 2024-09-12T19:22:59.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.634+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7609970496467971148', time=2024-09-12T20:38:46.210856+0000, chain.objs.size()=1 2024-09-12T19:22:59.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.634+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.mbXrjnbHR5V4u2rtYA5MstuO_UmdKnw_0 2024-09-12T19:22:59.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.634+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17575374989932312333', time=2024-09-12T20:38:46.543101+0000, chain.objs.size()=1 2024-09-12T19:22:59.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.634+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.4bQFZNkDuptaVnp2AWgBHY7ADbyEJlu_0 2024-09-12T19:22:59.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.634+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8603526149752348826', time=2024-09-12T20:38:46.576253+0000, chain.objs.size()=1 2024-09-12T19:22:59.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.634+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.QB0MT_5DoAmQYMITeLIlEdlFv7rzIpu_0 2024-09-12T19:22:59.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.638+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8387756035281446145', time=2024-09-12T20:38:47.949465+0000, chain.objs.size()=1 2024-09-12T19:22:59.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.638+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.RMwjc4L06qwWT6flA-Itg3_J7USsbeA_0 2024-09-12T19:22:59.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.642+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11723157200349992526', time=2024-09-12T20:38:48.886698+0000, chain.objs.size()=1 2024-09-12T19:22:59.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.642+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.fhiBRGSLHJF1BDKo5IxKCeyn9ZkmEY6_0 2024-09-12T19:22:59.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.642+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8751600592406661448', time=2024-09-12T20:38:50.245040+0000, chain.objs.size()=1 2024-09-12T19:22:59.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.642+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Nr2Bm0oOTGlqNCKTX8EBYiW0JnDn62K_0 2024-09-12T19:22:59.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.642+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13173145277876003473', time=2024-09-12T20:38:50.290779+0000, chain.objs.size()=1 2024-09-12T19:22:59.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.642+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_._atLDPZ6wUp6yub_TQ0kE3LmrLF-7VM_0 2024-09-12T19:22:59.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.642+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3256881878365636040', time=2024-09-12T20:38:51.387568+0000, chain.objs.size()=1 2024-09-12T19:22:59.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.642+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.UBgTzcfcBmym11B2d8M3xYlsaWRD1SU_0 2024-09-12T19:22:59.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.642+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8973980120562176445', time=2024-09-12T20:38:52.685360+0000, chain.objs.size()=1 2024-09-12T19:22:59.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.642+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.8CtI-ZZW_47xOEdX1TTOse9p-CO1NsC_0 2024-09-12T19:22:59.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.642+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11981352109697693121', time=2024-09-12T20:38:52.687755+0000, chain.objs.size()=1 2024-09-12T19:22:59.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.642+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.tgL5tgRkgomzPU8LP_av-Pknp6RYBrJ_0 2024-09-12T19:22:59.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.642+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5199577403732491387', time=2024-09-12T20:38:52.928213+0000, chain.objs.size()=1 2024-09-12T19:22:59.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.642+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.1F4e9d73iGsWQ9PaP5SNSeS4G1KCtjE_0 2024-09-12T19:22:59.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.642+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1297596920588365952', time=2024-09-12T20:38:52.966649+0000, chain.objs.size()=1 2024-09-12T19:22:59.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.642+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.RbdiweQFSeMKwsfvkx19CHeb6GJ3bXh_0 2024-09-12T19:22:59.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.642+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5975507405516953163', time=2024-09-12T20:38:55.867550+0000, chain.objs.size()=1 2024-09-12T19:22:59.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.642+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.BkzRQgwOoTXqIsDRS6bl_64_a_B-myj_0 2024-09-12T19:22:59.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.642+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10061111686593977343', time=2024-09-12T20:38:56.125174+0000, chain.objs.size()=1 2024-09-12T19:22:59.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.642+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.kgayWynN8yJkEtpgaw3t1RZ0CeRoP-9_0 2024-09-12T19:22:59.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1003944906139055561', time=2024-09-12T20:38:56.273282+0000, chain.objs.size()=1 2024-09-12T19:22:59.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.PvmN6ceVHk74xU_GcAqh3vQmLRdCztC_0 2024-09-12T19:22:59.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17634318570897156260', time=2024-09-12T20:38:57.152023+0000, chain.objs.size()=1 2024-09-12T19:22:59.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.MTEkFHoW-yapxCy4HO7_2rWE8ZAD8A8_0 2024-09-12T19:22:59.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1266387706675587591', time=2024-09-12T20:39:00.259690+0000, chain.objs.size()=1 2024-09-12T19:22:59.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.YhwET-2PIkhDYS6cErFtb70HjP-XhmV_0 2024-09-12T19:22:59.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4790046483877271876', time=2024-09-12T20:39:01.303255+0000, chain.objs.size()=1 2024-09-12T19:22:59.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.uHXQUktc5Rkj7_OMkSF03yncuo4s-SZ_0 2024-09-12T19:22:59.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.654+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47760 2024-09-12T19:22:59.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.654+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T19:22:59.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.654+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18171226929634541689', time=2024-09-12T20:39:02.160733+0000, chain.objs.size()=1 2024-09-12T19:22:59.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.654+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.2_oZa-yzhYG8yNvCFBIAuYgRBeV3j_m_0 2024-09-12T19:22:59.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9633980331917478461', time=2024-09-12T20:39:02.479984+0000, chain.objs.size()=1 2024-09-12T19:22:59.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.1c719xjO13949ut4nXp4VzzH6bdHXMX_0 2024-09-12T19:22:59.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5358064000186329490', time=2024-09-12T20:39:03.315654+0000, chain.objs.size()=1 2024-09-12T19:22:59.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.kWupK9w2AzuuvnY4YI1gyHtkyhm2XyA_0 2024-09-12T19:22:59.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8697103095447473132', time=2024-09-12T20:39:03.447996+0000, chain.objs.size()=1 2024-09-12T19:22:59.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.HdwCdm3pJxZ3dhqqIeajz43sJK9mUs-_0 2024-09-12T19:22:59.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12727738088748237649', time=2024-09-12T20:39:04.692466+0000, chain.objs.size()=1 2024-09-12T19:22:59.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.mqvSqwKmm5MxmuSnMF0m7q9rcEbZyI0_0 2024-09-12T19:22:59.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15846543101149084028', time=2024-09-12T20:39:04.841739+0000, chain.objs.size()=1 2024-09-12T19:22:59.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.OpVybrDXJTsD-_yVu0wlJUD778owYrA_0 2024-09-12T19:22:59.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3625281621109521166', time=2024-09-12T20:39:05.007497+0000, chain.objs.size()=1 2024-09-12T19:22:59.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.jbZiWGD4jR0vXDIkEAQn0zvJZlbDlK8_0 2024-09-12T19:22:59.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3968240514400276456', time=2024-09-12T20:39:05.751495+0000, chain.objs.size()=1 2024-09-12T19:22:59.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.X9iro2XT6Y_o970DJXqIRsIkAULGGC0_0 2024-09-12T19:22:59.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8951074659536520082', time=2024-09-12T20:39:07.020608+0000, chain.objs.size()=1 2024-09-12T19:22:59.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.UcRET_M4iFbeMXpluS0QVWEOy_ajLIw_0 2024-09-12T19:22:59.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8379955628583035070', time=2024-09-12T20:41:27.600106+0000, chain.objs.size()=1 2024-09-12T19:22:59.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.394__shadow:cjpRkVfjsuUEtHmHNFpZJvQIeUAGuxm_.WbYbIkzjnMsCEgpfA-8mW1eC1jo7X_0_0 2024-09-12T19:22:59.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6678691849514301524', time=2024-09-12T20:45:22.274402+0000, chain.objs.size()=1 2024-09-12T19:22:59.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.503__shadow:tE2u4PreZ1ptztujaTdnj2An4nygGJX_.ADvFvlMdDhiFGZmRgRvM9GmBz7MDjzE_0 2024-09-12T19:22:59.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14703126939821018251', time=2024-09-12T20:46:25.800114+0000, chain.objs.size()=1 2024-09-12T19:22:59.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.516__multipart_mymultipartcopy.2~M_K2t2kpGfAPVT7t-9jokmGE_4Jmayn.1 2024-09-12T19:22:59.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12738121893394266271', time=2024-09-12T20:54:53.512328+0000, chain.objs.size()=1 2024-09-12T19:22:59.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.550__shadow_.ls2ux2jdfZji8ipzM_LYttddRax40G6_0 2024-09-12T19:22:59.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.662+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15772760472443140629', time=2024-09-12T20:58:16.532097+0000, chain.objs.size()=1 2024-09-12T19:22:59.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:J6rFtRsgLfZYmKwGZUu038RFzwnV5qt_.oFzKIrTRbpeTGmeMeKaPIWR8Qo3GBYL_0 2024-09-12T19:22:59.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.662+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18412625166335578071', time=2024-09-12T20:58:27.900121+0000, chain.objs.size()=1 2024-09-12T19:22:59.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:.pwwsKTCbgIEpH5CNdJbLgzNZfPDPxh_.ukrbETy1NK332Hsnkxqf887QRATguhJ_0 2024-09-12T19:22:59.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.662+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16994102662736422813', time=2024-09-12T20:59:34.883512+0000, chain.objs.size()=1 2024-09-12T19:22:59.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.580__shadow:5sC2Adaitf0usoMb8hLTKYcZQiru7s9_.OxurRxCCCxu-05c_B6XfK8BrquQ6HF2_0 2024-09-12T19:22:59.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.662+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12330425602503649573', time=2024-09-12T20:59:55.202367+0000, chain.objs.size()=1 2024-09-12T19:22:59.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.587__shadow:ygHnAmnIU6nJ7dfCQH.F2KH1ExuBLlD_.rTDeLiCrsg5VzWs3ukQFCI5IVnrfr3m_0 2024-09-12T19:22:59.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.662+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.824385169061210545', time=2024-09-12T21:00:30.045937+0000, chain.objs.size()=1 2024-09-12T19:22:59.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.605__shadow_.vxVJgUo7gVN9trPx7MUdmspLqR1EY5j_0 2024-09-12T19:22:59.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.662+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~6XqyVwy88RoMkigObITxKG06G2910H8', time=2024-09-12T21:06:56.316623+0000, chain.objs.size()=6 2024-09-12T19:22:59.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.625__multipart_multipart_enc.2~6XqyVwy88RoMkigObITxKG06G2910H8.1 2024-09-12T19:22:59.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.625__multipart_multipart_enc.2~6XqyVwy88RoMkigObITxKG06G2910H8.2 2024-09-12T19:22:59.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.625__multipart_multipart_enc.2~6XqyVwy88RoMkigObITxKG06G2910H8.3 2024-09-12T19:22:59.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.625__multipart_multipart_enc.2~6XqyVwy88RoMkigObITxKG06G2910H8.4 2024-09-12T19:22:59.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.625__multipart_multipart_enc.2~6XqyVwy88RoMkigObITxKG06G2910H8.5 2024-09-12T19:22:59.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.666+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.625__multipart_multipart_enc.2~6XqyVwy88RoMkigObITxKG06G2910H8.6 2024-09-12T19:22:59.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.666+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.534144317346679234', time=2024-09-12T21:09:33.095079+0000, chain.objs.size()=6 2024-09-12T19:22:59.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.666+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.662__multipart_foo.2~leHqMbW2R2FbOxgCc3YPUn1_TgCdWbS.1 2024-09-12T19:22:59.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.666+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.662__multipart_foo.2~leHqMbW2R2FbOxgCc3YPUn1_TgCdWbS.2 2024-09-12T19:22:59.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.666+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.662__multipart_foo.2~leHqMbW2R2FbOxgCc3YPUn1_TgCdWbS.3 2024-09-12T19:22:59.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.666+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.662__multipart_foo.2~leHqMbW2R2FbOxgCc3YPUn1_TgCdWbS.4 2024-09-12T19:22:59.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.666+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.662__multipart_foo.2~leHqMbW2R2FbOxgCc3YPUn1_TgCdWbS.5 2024-09-12T19:22:59.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.666+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.662__multipart_foo.2~leHqMbW2R2FbOxgCc3YPUn1_TgCdWbS.6 2024-09-12T19:22:59.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7977963539133532163', time=2024-09-12T21:09:36.187158+0000, chain.objs.size()=1 2024-09-12T19:22:59.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.663__shadow_.V9B9fzaw-z4zH29KMAW19pLAo19LauP_0 2024-09-12T19:22:59.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.678+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:22:59.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.682+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T19:22:59.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:22:59.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:22:59.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49155' 2024-09-12T19:22:59.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='_Ju8Nd_w_I9si1Y6RzChTHTEpnJLgv3h', time=2024-09-12T20:23:26.764142+0000, chain.objs.size()=1 2024-09-12T19:22:59.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.163__shadow_.eJjSgqcUaWSOECvCu1JvBKBHEsXQrp0_0 2024-09-12T19:22:59.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5259704491524554915', time=2024-09-12T20:28:47.949421+0000, chain.objs.size()=1 2024-09-12T19:22:59.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.231__shadow_.8-YvsYnZVAc1Z2707SDhEBYx4kYnAtx_0 2024-09-12T19:22:59.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4399068623601797982', time=2024-09-12T20:28:59.438543+0000, chain.objs.size()=1 2024-09-12T19:22:59.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.236__shadow_.HyfJfQv5yEcSasvD9hWJsB7l726gHrx_0 2024-09-12T19:22:59.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9219208044213776624', time=2024-09-12T20:29:03.311805+0000, chain.objs.size()=1 2024-09-12T19:22:59.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.237__shadow_.xz_ICRG6gLHIIDZes8_rot7kutxAUHg_0 2024-09-12T19:22:59.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3415543983588996474', time=2024-09-12T20:29:32.495947+0000, chain.objs.size()=1 2024-09-12T19:22:59.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.248__shadow_.2XJJZC3IPS-nM7PHUnISaAQnnmWGxoW_0 2024-09-12T19:22:59.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14747836677327459872', time=2024-09-12T20:31:46.306739+0000, chain.objs.size()=1 2024-09-12T19:22:59.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.OpoLD3WSyMOpEYKG_87b-sg5El0Nt_y_0 2024-09-12T19:22:59.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11866349238446610809', time=2024-09-12T20:31:46.687373+0000, chain.objs.size()=1 2024-09-12T19:22:59.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.b1aBffnitenyC0cd6QBQBMD2_yY-6sm_0 2024-09-12T19:22:59.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13787865667664575063', time=2024-09-12T20:31:47.163633+0000, chain.objs.size()=1 2024-09-12T19:22:59.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.QN4Jgn1q1odpb3ci3BOfW9CAlJCoU7-_0 2024-09-12T19:22:59.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6394820801973821795', time=2024-09-12T20:31:47.589173+0000, chain.objs.size()=1 2024-09-12T19:22:59.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.GHAsNrO5pd2SgbBMhkmYR659JGJgaVx_0 2024-09-12T19:22:59.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12160908262597282080', time=2024-09-12T20:31:47.854407+0000, chain.objs.size()=1 2024-09-12T19:22:59.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Mm221UvmISKDZIUQTrw87Rd_0KZbdXZ_0 2024-09-12T19:22:59.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8994460037808513479', time=2024-09-12T20:31:48.126670+0000, chain.objs.size()=1 2024-09-12T19:22:59.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.jxJBkydSnvHDRkqS5d4vhnyHVUhgqd0_0 2024-09-12T19:22:59.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16089339611902660441', time=2024-09-12T20:31:51.723903+0000, chain.objs.size()=1 2024-09-12T19:22:59.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.8QSHOLGKwZ2YqNntvMaL-6Kighf-gnK_0 2024-09-12T19:22:59.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.690+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13196441781554164318', time=2024-09-12T20:31:51.725615+0000, chain.objs.size()=1 2024-09-12T19:22:59.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.690+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.T2FiN-BpUGwUkUB0wdLLB-pSwQuBvHt_0 2024-09-12T19:22:59.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13318951421029216750', time=2024-09-12T20:31:53.977193+0000, chain.objs.size()=1 2024-09-12T19:22:59.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ph7ss79jdm9RKd-hsbij60SgQbxVPVS_0 2024-09-12T19:22:59.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14835822934160431867', time=2024-09-12T20:31:54.651254+0000, chain.objs.size()=1 2024-09-12T19:22:59.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.QHqBAc0W-psHqf1lyxk1xy2i2SrWx0T_0 2024-09-12T19:22:59.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14605061544231318356', time=2024-09-12T20:31:55.338340+0000, chain.objs.size()=1 2024-09-12T19:22:59.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.X1vQjv20a6ohpyCeGy7vLLr1uNvxdBI_0 2024-09-12T19:22:59.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8497681440213670416', time=2024-09-12T20:31:55.529576+0000, chain.objs.size()=1 2024-09-12T19:22:59.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.yPBxZPHkMJwMYDBDlalD5QZzONNNxXp_0 2024-09-12T19:22:59.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6372673788715705031', time=2024-09-12T20:31:57.013086+0000, chain.objs.size()=1 2024-09-12T19:22:59.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.4itL90Mq-CH9nTfXVNuKGVA6y-3_JNd_0 2024-09-12T19:22:59.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3156493327523231756', time=2024-09-12T20:31:58.820775+0000, chain.objs.size()=1 2024-09-12T19:22:59.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.PC0dr9PZwQ44cypF7jcFL6t-DGEB9B1_0 2024-09-12T19:22:59.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9838520913113884836', time=2024-09-12T20:31:59.740953+0000, chain.objs.size()=1 2024-09-12T19:22:59.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.PaOh3OYNZimnmRmi2FeH5rsPrP7miV8_0 2024-09-12T19:22:59.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16074652108973545079', time=2024-09-12T20:32:00.742226+0000, chain.objs.size()=1 2024-09-12T19:22:59.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.N9O4k5iJzfqgjQ_S6heh9Z4rsI5_zcd_0 2024-09-12T19:22:59.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5236069887522557397', time=2024-09-12T20:32:02.915883+0000, chain.objs.size()=1 2024-09-12T19:22:59.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.0asNBJeRmyeWpwfk3ApQJUehvXdSXuK_0 2024-09-12T19:22:59.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1421544283699263219', time=2024-09-12T20:32:04.370312+0000, chain.objs.size()=1 2024-09-12T19:22:59.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.jJZ1muzjTgrdhG90-kK1WGG0b2BwPhv_0 2024-09-12T19:22:59.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10076779197059885573', time=2024-09-12T20:32:04.372435+0000, chain.objs.size()=1 2024-09-12T19:22:59.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.694+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.bFBh8G3r6g9a6DkFDJr15oaHshn5C6d_0 2024-09-12T19:22:59.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.698+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5659862443787058746', time=2024-09-12T20:32:05.054755+0000, chain.objs.size()=1 2024-09-12T19:22:59.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.698+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.zFEUBm2xpgWLRsDQT-SJENTKL_PFnYS_0 2024-09-12T19:22:59.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.698+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1731673802835377992', time=2024-09-12T20:32:06.026808+0000, chain.objs.size()=1 2024-09-12T19:22:59.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.698+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.tiJ3tXXPudW77XjsAxn0KPcTCJCjaJt_0 2024-09-12T19:22:59.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8992794503029579886', time=2024-09-12T20:32:07.973807+0000, chain.objs.size()=1 2024-09-12T19:22:59.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.yiLh5jPM_4R1FxIjRMo9G9vxEfDnPrz_0 2024-09-12T19:22:59.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1962630748450759395', time=2024-09-12T20:32:08.968906+0000, chain.objs.size()=1 2024-09-12T19:22:59.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.xX_vqUTipCPX4Wbg3VseMCDS01Yb9fi_0 2024-09-12T19:22:59.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5058395632220059040', time=2024-09-12T20:32:08.971002+0000, chain.objs.size()=1 2024-09-12T19:22:59.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ups2TQ2h2xcIL5wDLTTCc6b2mmffCpO_0 2024-09-12T19:22:59.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4745666692635446887', time=2024-09-12T20:32:09.806165+0000, chain.objs.size()=1 2024-09-12T19:22:59.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.8DZSxPy_pFr833PLFgeeZPgkB8dzlnm_0 2024-09-12T19:22:59.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2746849685369217469', time=2024-09-12T20:32:12.269431+0000, chain.objs.size()=1 2024-09-12T19:22:59.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.x3pH6UO79x4WI3DeEqisD0QLjOXRbFB_0 2024-09-12T19:22:59.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12239897549101852353', time=2024-09-12T20:32:12.346572+0000, chain.objs.size()=1 2024-09-12T19:22:59.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.SrxDZPpgJR4zuiCD7W9-vbNUaSTLP7C_0 2024-09-12T19:22:59.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15141637381851044006', time=2024-09-12T20:32:13.546812+0000, chain.objs.size()=1 2024-09-12T19:22:59.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.2b1FxIwN7jeNExQkonMAVBeAOa5d6uH_0 2024-09-12T19:22:59.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11231984856700585118', time=2024-09-12T20:32:13.861676+0000, chain.objs.size()=1 2024-09-12T19:22:59.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.FUTiw9gE54ShU6-yj_WSssvOIfzGUn0_0 2024-09-12T19:22:59.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12517693300680404920', time=2024-09-12T20:32:33.728596+0000, chain.objs.size()=1 2024-09-12T19:22:59.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.271__shadow_.TfP_wVz0fn4qZTyKcn9wFCzSb4wreIu_0 2024-09-12T19:22:59.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.706+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6670585466951313397', time=2024-09-12T20:33:05.712195+0000, chain.objs.size()=1 2024-09-12T19:22:59.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.706+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.285__shadow_.69ehn5qqZ9bM3sqY5KLteWOMFRospD4_0 2024-09-12T19:22:59.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.706+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15833802562933284715', time=2024-09-12T20:33:14.960137+0000, chain.objs.size()=1 2024-09-12T19:22:59.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.706+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.289__shadow_.4lNKaR--tO_joZDhV7J06oMOuLx-8x1_0 2024-09-12T19:22:59.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.706+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4339806933394834359', time=2024-09-12T20:33:25.429355+0000, chain.objs.size()=1 2024-09-12T19:22:59.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.706+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.inQfBkDDadF7OLKNZdm4XqLAFt63oPQ_0 2024-09-12T19:22:59.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.706+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10431185274943532366', time=2024-09-12T20:33:25.615212+0000, chain.objs.size()=1 2024-09-12T19:22:59.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.706+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.4_QfDN4QEPzXOCOmGHOBL7S82gVvocV_0 2024-09-12T19:22:59.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.706+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13960787755721868526', time=2024-09-12T20:33:31.588541+0000, chain.objs.size()=1 2024-09-12T19:22:59.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.706+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.VYS1L98dTnF7S3WOUS_tn7nnSTPygPT_0 2024-09-12T19:22:59.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.706+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.803615695738760097', time=2024-09-12T20:33:45.690942+0000, chain.objs.size()=1 2024-09-12T19:22:59.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.299__shadow_.40Iw4uUhYLKEYpHbz2OGt6uAg5IlW1l_0 2024-09-12T19:22:59.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15672940407920704923', time=2024-09-12T20:34:38.798476+0000, chain.objs.size()=1 2024-09-12T19:22:59.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.319__shadow:h9LC7fEoDk-hx8t0uBWDx1E8LRHMPbk_.b5p5GqIBf2bQw4V_ihallOOTnfkfIde_0 2024-09-12T19:22:59.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9647550118843252330', time=2024-09-12T20:36:28.390327+0000, chain.objs.size()=1 2024-09-12T19:22:59.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.5ucq_JLSxibuo_D6VI2INFDG8KaXBuo_0 2024-09-12T19:22:59.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12351759907100280787', time=2024-09-12T20:36:28.433063+0000, chain.objs.size()=1 2024-09-12T19:22:59.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.mkjCKe0Mfg29hEWgf0e0jFzV_aB9J-Z_0 2024-09-12T19:22:59.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11729819775408318857', time=2024-09-12T20:36:29.543576+0000, chain.objs.size()=1 2024-09-12T19:22:59.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ck8anngsG1LgBTaEq5_hbwaSjDqOEsE_0 2024-09-12T19:22:59.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5331726915041594669', time=2024-09-12T20:36:30.619544+0000, chain.objs.size()=1 2024-09-12T19:22:59.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.b68YBmZzrhYvlrJkmBpL6BjKlwEqaFe_0 2024-09-12T19:22:59.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3685718732804498845', time=2024-09-12T20:36:33.957102+0000, chain.objs.size()=1 2024-09-12T19:22:59.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.nZPo01pqf6jvBGA4NJ_2En-VXxeLQkI_0 2024-09-12T19:22:59.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10646563968801834031', time=2024-09-12T20:36:34.509822+0000, chain.objs.size()=1 2024-09-12T19:22:59.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.nLvHQ6pBupuyq24DDJHEMfSA5yA2o___0 2024-09-12T19:22:59.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11252063781924818921', time=2024-09-12T20:36:36.602295+0000, chain.objs.size()=1 2024-09-12T19:22:59.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Q5dW-mghJjrt-dBZybhybHHrlfZ1wt3_0 2024-09-12T19:22:59.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.714+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13810009423164487820', time=2024-09-12T20:36:38.440139+0000, chain.objs.size()=1 2024-09-12T19:22:59.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.714+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.H4MNK3a91I33xLYrJ0_qM8pKrIhm9GP_0 2024-09-12T19:22:59.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.714+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16669561459186891445', time=2024-09-12T20:36:38.600651+0000, chain.objs.size()=1 2024-09-12T19:22:59.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.714+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.tUU5zh2zOyHhyt0VYciFCRwu5Z9AQFP_0 2024-09-12T19:22:59.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.714+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12450889215216972713', time=2024-09-12T20:36:40.177157+0000, chain.objs.size()=1 2024-09-12T19:22:59.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.714+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ELjXQ6XXYSX6J8S3Uws7nNHWxLuSuOn_0 2024-09-12T19:22:59.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.714+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3312613335527703545', time=2024-09-12T20:36:42.112599+0000, chain.objs.size()=1 2024-09-12T19:22:59.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.714+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.j37M9lsaCQ_qgR6yCBZjZ0LRIf1R9JJ_0 2024-09-12T19:22:59.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.714+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8399681878397857689', time=2024-09-12T20:36:43.265525+0000, chain.objs.size()=1 2024-09-12T19:22:59.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.714+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.By2YNLBEPnp4-Yi1SnBKMgfVEKNUg1T_0 2024-09-12T19:22:59.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.714+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17080458674665405364', time=2024-09-12T20:36:43.702610+0000, chain.objs.size()=1 2024-09-12T19:22:59.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.714+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.YuND3kbzV3XQVKfHyIwebJAGJ0Xvl0Y_0 2024-09-12T19:22:59.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.714+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6353704880705688716', time=2024-09-12T20:36:44.496989+0000, chain.objs.size()=1 2024-09-12T19:22:59.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.714+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.WnmP2ykBWVfYgCqzi700KK7wwQWcHFS_0 2024-09-12T19:22:59.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.714+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4423249873844140262', time=2024-09-12T20:36:44.620520+0000, chain.objs.size()=1 2024-09-12T19:22:59.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.714+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.qpgIOy2YtW3LAZbePtMSUgmxJLXgHDO_0 2024-09-12T19:22:59.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16732924707754301824', time=2024-09-12T20:36:45.280855+0000, chain.objs.size()=1 2024-09-12T19:22:59.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.IQ0P6R7y7R-3Bmu7nojbIEPbFwVSI5O_0 2024-09-12T19:22:59.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6917901632928547942', time=2024-09-12T20:36:46.106714+0000, chain.objs.size()=1 2024-09-12T19:22:59.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.66ZkWTSzDf5K1dTuOIblV3XWqVAJMyY_0 2024-09-12T19:22:59.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13706757730227955944', time=2024-09-12T20:36:47.244900+0000, chain.objs.size()=1 2024-09-12T19:22:59.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.jtPlZdXNb0w7VgDZDXlUSKYqXePOImb_0 2024-09-12T19:22:59.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8382807163437214197', time=2024-09-12T20:36:47.574622+0000, chain.objs.size()=1 2024-09-12T19:22:59.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.huo-u-joRm-IPMYlmHbpqDP3a4arHPR_0 2024-09-12T19:22:59.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2934758393103739657', time=2024-09-12T20:36:48.145050+0000, chain.objs.size()=1 2024-09-12T19:22:59.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.m_-QHBQdE_oOOjNapLT5oxfQAusBvBC_0 2024-09-12T19:22:59.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8807699220606214693', time=2024-09-12T20:36:48.147065+0000, chain.objs.size()=1 2024-09-12T19:22:59.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.iGkVVW1Sn9euZFaVUlIv-scNXtR0SA7_0 2024-09-12T19:22:59.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2679964295538617876', time=2024-09-12T20:36:49.401584+0000, chain.objs.size()=1 2024-09-12T19:22:59.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.TpFectaT5KDZyFfHDWnLItInacvi9O0_0 2024-09-12T19:22:59.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17404915608149677365', time=2024-09-12T20:36:49.831313+0000, chain.objs.size()=1 2024-09-12T19:22:59.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.rfvNyP6mxR8EmkwT-xLrbvLm8aUZ53a_0 2024-09-12T19:22:59.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17774719186972258986', time=2024-09-12T20:36:51.899028+0000, chain.objs.size()=1 2024-09-12T19:22:59.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.WT-Zu5S9f_OWsj2OEB81x9R_VYpbf_q_0 2024-09-12T19:22:59.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16592926200401521083', time=2024-09-12T20:36:52.765939+0000, chain.objs.size()=1 2024-09-12T19:22:59.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.5K3e-WCkO8TnuqgI5hjOKW0yKfpqUyg_0 2024-09-12T19:22:59.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15799866843790201340', time=2024-09-12T20:36:53.159264+0000, chain.objs.size()=1 2024-09-12T19:22:59.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.NSW0cYFu01k8CLzQaPjqEMp10tzgOcD_0 2024-09-12T19:22:59.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3845548760444291459', time=2024-09-12T20:36:53.213721+0000, chain.objs.size()=1 2024-09-12T19:22:59.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.6uW7D7IWt0klOUSadNgdzHs3Dd8HeOP_0 2024-09-12T19:22:59.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3170458407004923400', time=2024-09-12T20:38:42.190330+0000, chain.objs.size()=1 2024-09-12T19:22:59.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.dvq9RIiczs2K1EUVF1IsF_3PA25Jdyx_0 2024-09-12T19:22:59.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6778146117399558216', time=2024-09-12T20:38:43.705100+0000, chain.objs.size()=1 2024-09-12T19:22:59.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.czhhF5CvpRUhVDFKCssurfifdyg6WDS_0 2024-09-12T19:22:59.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.64480371860626844', time=2024-09-12T20:38:43.787297+0000, chain.objs.size()=1 2024-09-12T19:22:59.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.eHnSr1k5RBBjs0xkow_QwRQEXfl3Ypa_0 2024-09-12T19:22:59.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5870288765375373267', time=2024-09-12T20:38:44.164279+0000, chain.objs.size()=1 2024-09-12T19:22:59.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.kNNKB0J9SLybrQ5kbP8y3fePBArn7T4_0 2024-09-12T19:22:59.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5418758528465624179', time=2024-09-12T20:38:44.407839+0000, chain.objs.size()=1 2024-09-12T19:22:59.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.2Yr0hixlRIqyj34JLKozss6qSE7DqNj_0 2024-09-12T19:22:59.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13142598000912906438', time=2024-09-12T20:38:46.444254+0000, chain.objs.size()=1 2024-09-12T19:22:59.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_._cypqh2t4XhgoFmR0FSJux01plgtk3b_0 2024-09-12T19:22:59.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8080000408243738339', time=2024-09-12T20:38:46.446413+0000, chain.objs.size()=1 2024-09-12T19:22:59.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.f8GD2fBgYfN91foU2VtdTZb3crE5AoQ_0 2024-09-12T19:22:59.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8792114487692767801', time=2024-09-12T20:38:49.427731+0000, chain.objs.size()=1 2024-09-12T19:22:59.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.gfdTJ3mCRBlb9xAz4U5HtIeB0a5sWld_0 2024-09-12T19:22:59.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7143250690350648957', time=2024-09-12T20:38:49.833424+0000, chain.objs.size()=1 2024-09-12T19:22:59.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.NrCoiwIRtmT05p0Z4I_WjFXGK5Sjb4n_0 2024-09-12T19:22:59.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2546009260338551290', time=2024-09-12T20:38:55.371268+0000, chain.objs.size()=1 2024-09-12T19:22:59.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.eyLWSpkEo8-bJ9PcKjTun8TB-et1x9L_0 2024-09-12T19:22:59.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1090353579074146578', time=2024-09-12T20:38:55.402187+0000, chain.objs.size()=1 2024-09-12T19:22:59.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.fvemP_SWBK4lCeP-sL7oTVi0lWzW_-d_0 2024-09-12T19:22:59.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3755457832907236454', time=2024-09-12T20:38:55.767596+0000, chain.objs.size()=1 2024-09-12T19:22:59.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.jj-w4a6MuKT-GI2r4-M2K1FRJr1TvQk_0 2024-09-12T19:22:59.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1964396380373324577', time=2024-09-12T20:38:55.975955+0000, chain.objs.size()=1 2024-09-12T19:22:59.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.PF5lysWMXS7v0Ks0dFp53F9phy3g_2J_0 2024-09-12T19:22:59.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.730+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10454259138659712083', time=2024-09-12T20:38:57.676700+0000, chain.objs.size()=1 2024-09-12T19:22:59.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.730+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.8BjJa4Fnwr4mDN19rLIf0XJX3k3sJyD_0 2024-09-12T19:22:59.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.730+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8679994854845052255', time=2024-09-12T20:38:58.664937+0000, chain.objs.size()=1 2024-09-12T19:22:59.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.730+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.P9anqCutmIvjEkCMmD6EhVv3MhGElPJ_0 2024-09-12T19:22:59.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.730+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11366470816290180053', time=2024-09-12T20:38:58.948181+0000, chain.objs.size()=1 2024-09-12T19:22:59.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.730+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.kFIXqsvVXN3y-7M-dd0b6XQsM3RcJNU_0 2024-09-12T19:22:59.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.730+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2986483022445359948', time=2024-09-12T20:38:59.208595+0000, chain.objs.size()=1 2024-09-12T19:22:59.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.730+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.t4GzVIvwbTqdPFWORZS-_rav1BrP90d_0 2024-09-12T19:22:59.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.730+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6994785331746341774', time=2024-09-12T20:39:03.077414+0000, chain.objs.size()=1 2024-09-12T19:22:59.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.AZZ95_s4Yqb9ycvC0pUvyKM-Lu2fe6a_0 2024-09-12T19:22:59.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6598557910908207779', time=2024-09-12T20:39:04.091680+0000, chain.objs.size()=1 2024-09-12T19:22:59.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.F66ufKln9FTk4orwxV9s-1FvVtm4yqB_0 2024-09-12T19:22:59.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8741331771377404611', time=2024-09-12T20:39:05.835608+0000, chain.objs.size()=1 2024-09-12T19:22:59.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.g7NM2eZp8bUgaAeus2ErFXz22NRKu_Z_0 2024-09-12T19:22:59.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8783181237997807495', time=2024-09-12T20:39:06.014478+0000, chain.objs.size()=1 2024-09-12T19:22:59.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.KVILkYGIKAFyfCI9_RtY3l3cDKJwMQO_0 2024-09-12T19:22:59.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5550495255827620001', time=2024-09-12T20:39:06.593186+0000, chain.objs.size()=1 2024-09-12T19:22:59.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.OXQoBgrl2AHja-Wb7QvaNhTBrd_GwiE_0 2024-09-12T19:22:59.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6537132886727269739', time=2024-09-12T20:39:06.706402+0000, chain.objs.size()=1 2024-09-12T19:22:59.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.QOVaP3DgJbqrYhV5azv1iVXcVm8swkz_0 2024-09-12T19:22:59.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3895455045317227230', time=2024-09-12T20:39:06.911176+0000, chain.objs.size()=1 2024-09-12T19:22:59.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.eDQFkRo0enhRrLDwtkBj5WTI8F5vIa6_0 2024-09-12T19:22:59.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4230287736763330462', time=2024-09-12T20:40:50.960982+0000, chain.objs.size()=1 2024-09-12T19:22:59.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.377__shadow_.BLUlrLNOov80XpoNMnRkc3eJoe5KAJ5_0 2024-09-12T19:22:59.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3147345501730508143', time=2024-09-12T20:43:46.646010+0000, chain.objs.size()=1 2024-09-12T19:22:59.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.459__shadow_.25Tlpdrdal446yjiumhNPHeIdHc9LOi_0 2024-09-12T19:22:59.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8486548271727018385', time=2024-09-12T20:44:33.647921+0000, chain.objs.size()=1 2024-09-12T19:22:59.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.483__shadow_.LU37jINIdg0AND3asVYz5RCb2qK2ZP6_0 2024-09-12T19:22:59.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12954254559629146677', time=2024-09-12T20:47:25.526047+0000, chain.objs.size()=6 2024-09-12T19:22:59.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.519__multipart_mymultipart.2~jyImiDO0KZXTAYbyvBVcBBJHVIFSdH5.1 2024-09-12T19:22:59.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.519__multipart_mymultipart.2~jyImiDO0KZXTAYbyvBVcBBJHVIFSdH5.2 2024-09-12T19:22:59.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.738+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.519__multipart_mymultipart.2~jyImiDO0KZXTAYbyvBVcBBJHVIFSdH5.3 2024-09-12T19:22:59.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.738+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.519__multipart_mymultipart.2~jyImiDO0KZXTAYbyvBVcBBJHVIFSdH5.4 2024-09-12T19:22:59.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.738+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.519__multipart_mymultipart.2~jyImiDO0KZXTAYbyvBVcBBJHVIFSdH5.5 2024-09-12T19:22:59.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.738+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.519__multipart_mymultipart.2~jyImiDO0KZXTAYbyvBVcBBJHVIFSdH5.6 2024-09-12T19:22:59.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.738+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~QIgny2CV9LHnGHzrz-ShmU928XRNmkk', time=2024-09-12T20:53:45.555406+0000, chain.objs.size()=1 2024-09-12T19:22:59.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.738+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.535__multipart_mymultipart.2~QIgny2CV9LHnGHzrz-ShmU928XRNmkk.3 2024-09-12T19:22:59.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.738+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6144059686637181121', time=2024-09-12T20:54:01.476700+0000, chain.objs.size()=4 2024-09-12T19:22:59.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.738+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.535__multipart_mymultipart.2~QIgny2CV9LHnGHzrz-ShmU928XRNmkk.1 2024-09-12T19:22:59.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.742+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.535__multipart_mymultipart.2~QIgny2CV9LHnGHzrz-ShmU928XRNmkk.2 2024-09-12T19:22:59.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.742+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.535__multipart_mymultipart.hNPpVYqfzwmL4LIs-dLRfVmn9PQolgC6.3 2024-09-12T19:22:59.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.742+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.535__multipart_mymultipart.2~QIgny2CV9LHnGHzrz-ShmU928XRNmkk.4 2024-09-12T19:22:59.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.742+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4424184639988872973', time=2024-09-12T20:56:46.073287+0000, chain.objs.size()=1 2024-09-12T19:22:59.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.742+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:QIetVAX.e504l5KnQwx7RLVD-0VRtJ4_.Z9qcb7HZ3UXsIw3IbWKf-Venr5v-y3u_0 2024-09-12T19:22:59.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.746+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49155 2024-09-12T19:22:59.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T19:22:59.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17843927989755617328', time=2024-09-12T20:56:48.261113+0000, chain.objs.size()=1 2024-09-12T19:22:59.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:PGvGnKT1Iye0jn17T1bgzRc2BX4eqr5_.mdEB5LvIWOP5Ig3DXpx048lTB3HJSXv_0 2024-09-12T19:22:59.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11526840570923857863', time=2024-09-12T20:56:59.537345+0000, chain.objs.size()=1 2024-09-12T19:22:59.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:1-IjLZ5d8UWYeRoJBqzsfcWSHr7bCz1_.DnOvE9W6bTM4UFEvOHHqItvlsZExW1-_0 2024-09-12T19:22:59.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3385119322459264380', time=2024-09-12T20:57:09.277475+0000, chain.objs.size()=1 2024-09-12T19:22:59.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.570__shadow:btqUPEY9QF0SlAbT-BlpHTFk5FTioea_.rUKC0wvPpC1OjtDSOQEj6aolo_fhZa2_0 2024-09-12T19:22:59.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16670690851150195899', time=2024-09-12T20:57:09.574383+0000, chain.objs.size()=1 2024-09-12T19:22:59.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.570__shadow:B4HNl2VE8p-Jt5PiDmw1XFetYLsPwky_.c-I1Q2GJx9NtScdBcUSOqExoZ1tfUJi_0 2024-09-12T19:22:59.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5080253551114659785', time=2024-09-12T20:57:48.489853+0000, chain.objs.size()=1 2024-09-12T19:22:59.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:88pMNZZB5JqyLXEFVi8pNECDXpjkZik_.l83FtKNWgdTfZEsJtl7u1h1r_ZCr9yI_0 2024-09-12T19:22:59.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5689371797273645956', time=2024-09-12T20:59:54.898983+0000, chain.objs.size()=1 2024-09-12T19:22:59.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.587__shadow:o6FZtboWs.0IwuDD.LLT8GxdDoIUj5s_.5wjb5lD0Rrz8HuooC4_PG1vOw9657zQ_0 2024-09-12T19:22:59.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6204791955089436832', time=2024-09-12T21:07:55.820184+0000, chain.objs.size()=1 2024-09-12T19:22:59.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.646__shadow_.DQvEGFVZH1gF77sf2TKPqcUqo0pHlrx_0 2024-09-12T19:22:59.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17302479170810151491', time=2024-09-12T21:09:32.464293+0000, chain.objs.size()=6 2024-09-12T19:22:59.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.661__multipart_baz.2~cjlN1kpW9X1JmMAsYzWX5Kx4LXsWlVD.1 2024-09-12T19:22:59.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.661__multipart_baz.2~cjlN1kpW9X1JmMAsYzWX5Kx4LXsWlVD.2 2024-09-12T19:22:59.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.661__multipart_baz.2~cjlN1kpW9X1JmMAsYzWX5Kx4LXsWlVD.3 2024-09-12T19:22:59.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.661__multipart_baz.2~cjlN1kpW9X1JmMAsYzWX5Kx4LXsWlVD.4 2024-09-12T19:22:59.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.661__multipart_baz.2~cjlN1kpW9X1JmMAsYzWX5Kx4LXsWlVD.5 2024-09-12T19:22:59.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.661__multipart_baz.2~cjlN1kpW9X1JmMAsYzWX5Kx4LXsWlVD.6 2024-09-12T19:22:59.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.758+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:22:59.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.766+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T19:22:59.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:22:59.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:22:59.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46003' 2024-09-12T19:22:59.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.566163854047939862', time=2024-09-12T20:24:06.085612+0000, chain.objs.size()=1 2024-09-12T19:22:59.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.176__shadow_.Cvih7CmtvkmpemLp-ljKwaJVMTXxDxM_0 2024-09-12T19:22:59.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3852416189865847172', time=2024-09-12T20:29:11.006538+0000, chain.objs.size()=1 2024-09-12T19:22:59.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.240__shadow_.1fCuIVUpMIGEnAX9z-AwrX3QBLZnQJh_0 2024-09-12T19:22:59.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12243528487032991453', time=2024-09-12T20:29:34.773814+0000, chain.objs.size()=1 2024-09-12T19:22:59.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.249__shadow_.Bh36qbawH_m3yvl1YwX_U9N0-6WEQSg_0 2024-09-12T19:22:59.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16455902857356531838', time=2024-09-12T20:30:02.144009+0000, chain.objs.size()=1 2024-09-12T19:22:59.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.261__shadow_.iwklc7nPGnCza2eontVAMKBFc5CW8A1_0 2024-09-12T19:22:59.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15125881982781596298', time=2024-09-12T20:31:45.210960+0000, chain.objs.size()=1 2024-09-12T19:22:59.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.z2kNzW5NVc_qGqpTyu-8SyO4Z9lCpb6_0 2024-09-12T19:22:59.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12914665448905684297', time=2024-09-12T20:31:45.949265+0000, chain.objs.size()=1 2024-09-12T19:22:59.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.hrl5anQuNX993RYfvANK4VtQTAIl-nz_0 2024-09-12T19:22:59.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10405670188547242773', time=2024-09-12T20:31:46.151115+0000, chain.objs.size()=1 2024-09-12T19:22:59.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.XzEwJRSbtbwJjJY1vu2kATr7r0WjO8l_0 2024-09-12T19:22:59.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1777377961901653017', time=2024-09-12T20:31:46.548062+0000, chain.objs.size()=1 2024-09-12T19:22:59.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.TlPPwIU0Imqq1bHWbytca756BaZt74N_0 2024-09-12T19:22:59.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13415628229940920097', time=2024-09-12T20:31:46.920486+0000, chain.objs.size()=1 2024-09-12T19:22:59.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.5nwBFVQY1HHDh3l40wiTr6HSJ_N2q2-_0 2024-09-12T19:22:59.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2540981774945236371', time=2024-09-12T20:31:47.263354+0000, chain.objs.size()=1 2024-09-12T19:22:59.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.DTCFwnLo8wtehS6fKxlenMo5C3xkHOB_0 2024-09-12T19:22:59.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1437207037451668054', time=2024-09-12T20:31:49.650598+0000, chain.objs.size()=1 2024-09-12T19:22:59.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Gey9DBFwcNuJYXRDsx5CM51rIPb9sDf_0 2024-09-12T19:22:59.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9501700155943312394', time=2024-09-12T20:31:51.438758+0000, chain.objs.size()=1 2024-09-12T19:22:59.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.V9i3UBSWWNoa2l5VAAh3hSNsQ3SBbD__0 2024-09-12T19:22:59.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.778+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6105440954058463551', time=2024-09-12T20:31:52.083081+0000, chain.objs.size()=1 2024-09-12T19:22:59.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.778+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Vwo5OXYJwq4VcB17br-ImPSeLf5nH2q_0 2024-09-12T19:22:59.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.778+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1872213813164918560', time=2024-09-12T20:31:54.736349+0000, chain.objs.size()=1 2024-09-12T19:22:59.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.778+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.gOmY09esdnelXkTni-VcWMQAwTVAQk4_0 2024-09-12T19:22:59.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.778+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10869240504860017546', time=2024-09-12T20:31:55.541953+0000, chain.objs.size()=1 2024-09-12T19:22:59.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.778+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.r6uATUUIDBlDYgWq1G0hMF3C_m-gUwZ_0 2024-09-12T19:22:59.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.778+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3833866499714295505', time=2024-09-12T20:31:57.775063+0000, chain.objs.size()=1 2024-09-12T19:22:59.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.778+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.h5JVFfw0kpxD_AZT27QH7fh_tYnqZJr_0 2024-09-12T19:22:59.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17756326891423908595', time=2024-09-12T20:31:57.777937+0000, chain.objs.size()=1 2024-09-12T19:22:59.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.AbfrbULefT_Jil5iiaz4uaeD1LWyp_A_0 2024-09-12T19:22:59.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13784413910728732924', time=2024-09-12T20:31:58.616897+0000, chain.objs.size()=1 2024-09-12T19:22:59.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.n8_40XCCO662LfmzHCYrrJN-BwPAHpn_0 2024-09-12T19:22:59.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10435102292147551473', time=2024-09-12T20:31:59.721086+0000, chain.objs.size()=1 2024-09-12T19:22:59.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.XeN0x8TkebNTV8riKmLOtWPknJmM46Q_0 2024-09-12T19:22:59.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2146945987842046427', time=2024-09-12T20:32:01.870831+0000, chain.objs.size()=1 2024-09-12T19:22:59.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ApvZXqGQeD7hXaXpcYuuPqmsLIsjA4S_0 2024-09-12T19:22:59.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17257784693441928888', time=2024-09-12T20:32:02.732835+0000, chain.objs.size()=1 2024-09-12T19:22:59.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.-Hd_q4hGOql2HwTeNowVMKXXWv3eT0Y_0 2024-09-12T19:22:59.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18383659031678612635', time=2024-09-12T20:32:05.299864+0000, chain.objs.size()=1 2024-09-12T19:22:59.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.J5thk30yXnQIYgGBbPUNv7j29nNlLA-_0 2024-09-12T19:22:59.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10647950111624315065', time=2024-09-12T20:32:05.603240+0000, chain.objs.size()=1 2024-09-12T19:22:59.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.GGbyogBhKy0unKzWVtO60OSOcUfSwjz_0 2024-09-12T19:22:59.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11673367784599209468', time=2024-09-12T20:32:06.298100+0000, chain.objs.size()=1 2024-09-12T19:22:59.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.u1Q1is_aMrlKiH_xMagiNTYGq_Yf6Qp_0 2024-09-12T19:22:59.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.786+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9551455662661925776', time=2024-09-12T20:32:08.091845+0000, chain.objs.size()=1 2024-09-12T19:22:59.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.786+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.sr5A3MiMaiJ-ggPmaxjgrs5aETcN7zz_0 2024-09-12T19:22:59.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.786+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14454894093947849355', time=2024-09-12T20:32:08.471709+0000, chain.objs.size()=1 2024-09-12T19:22:59.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.786+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.44FDwZCG09eXS9J7uIxhb0tjlaS0KWo_0 2024-09-12T19:22:59.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.786+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3515891729775293305', time=2024-09-12T20:32:08.957859+0000, chain.objs.size()=1 2024-09-12T19:22:59.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.786+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.2sI5rP50z1ARAQDeCIKJ74P_BKWSi7C_0 2024-09-12T19:22:59.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12187032749492154001', time=2024-09-12T20:32:09.359527+0000, chain.objs.size()=1 2024-09-12T19:22:59.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.AfU-gtbHvhHRVqZwWf62KEmhuOJMeQI_0 2024-09-12T19:22:59.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1355842110783338878', time=2024-09-12T20:32:09.773671+0000, chain.objs.size()=1 2024-09-12T19:22:59.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.foXgu0R_H7AasuPPX1Jd7mMgkOPR2kB_0 2024-09-12T19:22:59.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7524680368471396482', time=2024-09-12T20:32:09.782413+0000, chain.objs.size()=1 2024-09-12T19:22:59.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Al9lhBPa8NfdHXX9e92K2_l8zBYumcP_0 2024-09-12T19:22:59.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1992649922839940129', time=2024-09-12T20:32:09.833838+0000, chain.objs.size()=1 2024-09-12T19:22:59.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Rmo5Bl8Sg83tN2haxG63Mnm5jj2A1Xe_0 2024-09-12T19:22:59.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14061839572816717737', time=2024-09-12T20:32:10.121508+0000, chain.objs.size()=1 2024-09-12T19:22:59.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Zk9mdGmsRnUDenLzKxXtHBD7N5Umd7B_0 2024-09-12T19:22:59.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8918465414915831136', time=2024-09-12T20:32:10.827101+0000, chain.objs.size()=1 2024-09-12T19:22:59.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ex6IXdmdndqrvddmJLp_BsRBVh80iPD_0 2024-09-12T19:22:59.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16818792781810323727', time=2024-09-12T20:32:33.748424+0000, chain.objs.size()=1 2024-09-12T19:22:59.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.271__shadow_.ZZAjdWxl8xsdCIAy_GHgltosFuVukNB_0 2024-09-12T19:22:59.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12607674104394230085', time=2024-09-12T20:32:42.529842+0000, chain.objs.size()=1 2024-09-12T19:22:59.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.275__shadow_.mplUcBmMcc1NRYcG7auBZdYZiarnFf6_0 2024-09-12T19:22:59.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4474156539590649706', time=2024-09-12T20:33:03.279731+0000, chain.objs.size()=1 2024-09-12T19:22:59.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.284__shadow_.t18tGRq84aUR41b6DOtXEj3OjOzEdZf_0 2024-09-12T19:22:59.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5129536358623543813', time=2024-09-12T20:33:20.164658+0000, chain.objs.size()=1 2024-09-12T19:22:59.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.291__shadow_.xI9p6NnfgSg2CRrY_-xqjq30DF5tGwY_0 2024-09-12T19:22:59.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4512743182070098097', time=2024-09-12T20:33:36.203221+0000, chain.objs.size()=1 2024-09-12T19:22:59.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.295__shadow_.o1fsGCXFefIpJyO0R_gaNPQ_9aqnjG9_0 2024-09-12T19:22:59.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9642550142930740341', time=2024-09-12T20:33:50.308401+0000, chain.objs.size()=1 2024-09-12T19:22:59.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.301__shadow_.GKCsvR6nERQ2LARTOASpVR5t4cQcDYd_0 2024-09-12T19:22:59.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2276494072937229227', time=2024-09-12T20:36:28.927663+0000, chain.objs.size()=1 2024-09-12T19:22:59.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.X8YrG4n_XE-Ip8E_tM7w7CpGYNqqG1a_0 2024-09-12T19:22:59.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13296452430299336027', time=2024-09-12T20:36:29.291975+0000, chain.objs.size()=1 2024-09-12T19:22:59.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.GK4qlFZgAYgx1U7Yu4VP_3BsMfYdHs-_0 2024-09-12T19:22:59.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15256569475782196344', time=2024-09-12T20:36:30.222677+0000, chain.objs.size()=1 2024-09-12T19:22:59.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.5PvKExpJDEa7cU_pCga726rmS9C8ydm_0 2024-09-12T19:22:59.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4982891111880777163', time=2024-09-12T20:36:31.962768+0000, chain.objs.size()=1 2024-09-12T19:22:59.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.HlxyENNepQU9ye6Z_ppSx1IhSzwLlaX_0 2024-09-12T19:22:59.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10903495630335494229', time=2024-09-12T20:36:31.965436+0000, chain.objs.size()=1 2024-09-12T19:22:59.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.LXB98M_UmP6t8KKYH8GcAfil21FB6km_0 2024-09-12T19:22:59.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18399940561916577596', time=2024-09-12T20:36:31.967543+0000, chain.objs.size()=1 2024-09-12T19:22:59.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.HAdlBkD1Du9mm6DTBM0qb0czAq0nMBv_0 2024-09-12T19:22:59.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.257930756054479330', time=2024-09-12T20:36:32.211207+0000, chain.objs.size()=1 2024-09-12T19:22:59.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.MsqMdxoTayHLDrcFFGg80qjRHC4c6Bu_0 2024-09-12T19:22:59.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15035116950557293269', time=2024-09-12T20:36:33.792494+0000, chain.objs.size()=1 2024-09-12T19:22:59.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.gc7Q0LnsTKqAfc1MgU7sbWy6i-scpIg_0 2024-09-12T19:22:59.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12770967277164767097', time=2024-09-12T20:36:34.778671+0000, chain.objs.size()=1 2024-09-12T19:22:59.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.yyhS6PweZ-TiSHfl2yGFTmhbg-fvoRT_0 2024-09-12T19:22:59.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.802+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11733821556602718327', time=2024-09-12T20:36:36.633530+0000, chain.objs.size()=1 2024-09-12T19:22:59.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.802+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.iN1AgJuKt7QOfO4q3GJtlWr2FF0JP0e_0 2024-09-12T19:22:59.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8937983898356810105', time=2024-09-12T20:36:36.668275+0000, chain.objs.size()=1 2024-09-12T19:22:59.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.eGnILy3ZE8hLc3Sd_dtZVlldrE1Axje_0 2024-09-12T19:22:59.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5102929538831893574', time=2024-09-12T20:36:38.087080+0000, chain.objs.size()=1 2024-09-12T19:22:59.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Ns3y0-0y739C6Lkjo4rdJ2qn2KOf38b_0 2024-09-12T19:22:59.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6997327340917711846', time=2024-09-12T20:36:39.653226+0000, chain.objs.size()=1 2024-09-12T19:22:59.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.9rApds8T28OhgVbxUFs1VjrvY0cDC03_0 2024-09-12T19:22:59.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12122928538105909155', time=2024-09-12T20:36:42.327453+0000, chain.objs.size()=1 2024-09-12T19:22:59.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.p9CjovS65dZ0r7B996qTzx_94nOS5gE_0 2024-09-12T19:22:59.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16400636565972621369', time=2024-09-12T20:36:45.326323+0000, chain.objs.size()=1 2024-09-12T19:22:59.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.-HPwAe3mfCTTZD20Qv0dryL4DeFaeRx_0 2024-09-12T19:22:59.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4317585002435914237', time=2024-09-12T20:36:46.149429+0000, chain.objs.size()=1 2024-09-12T19:22:59.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.CykfPnBXWWYUhBcaAM-jWRCbp7RACB3_0 2024-09-12T19:22:59.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11786509303390051835', time=2024-09-12T20:36:46.878833+0000, chain.objs.size()=1 2024-09-12T19:22:59.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.8rI21fRcRsPmYEhvwVsKWDTjHaZBWm5_0 2024-09-12T19:22:59.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5932113656288193972', time=2024-09-12T20:36:48.625074+0000, chain.objs.size()=1 2024-09-12T19:22:59.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.LiA3bfM5NqDTrrmIE3kOtnmNCINRkZw_0 2024-09-12T19:22:59.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8605405045143789328', time=2024-09-12T20:36:49.036917+0000, chain.objs.size()=1 2024-09-12T19:22:59.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.W0c8mEKupkZ1NJDNA3LnEbk_ekV6oFM_0 2024-09-12T19:22:59.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7186056844800425582', time=2024-09-12T20:36:49.339001+0000, chain.objs.size()=1 2024-09-12T19:22:59.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.00N2aLmq21EiQCyTMoJziUN7obgCvWb_0 2024-09-12T19:22:59.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3767019496454293287', time=2024-09-12T20:36:51.215179+0000, chain.objs.size()=1 2024-09-12T19:22:59.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.i5b8fGcJgqhf_BeATYe1JHYGUwRxaeD_0 2024-09-12T19:22:59.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6158951135536834246', time=2024-09-12T20:36:52.359826+0000, chain.objs.size()=1 2024-09-12T19:22:59.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.HVuhMMYZp_maOZicfEM_7bsiT1D-Ye6_0 2024-09-12T19:22:59.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12783314852862656946', time=2024-09-12T20:36:53.305795+0000, chain.objs.size()=1 2024-09-12T19:22:59.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.pfGhYROgDFTLH3B8pzt-kOuaz3e--S-_0 2024-09-12T19:22:59.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7559965441606683742', time=2024-09-12T20:36:54.139837+0000, chain.objs.size()=1 2024-09-12T19:22:59.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.jvCqiG43b_voS9pFNagH-VruwxoL1b__0 2024-09-12T19:22:59.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3707309363055216945', time=2024-09-12T20:36:55.358602+0000, chain.objs.size()=1 2024-09-12T19:22:59.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Vhf22G9LdKSFHx2VQVJldAU2xDpgBvp_0 2024-09-12T19:22:59.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4213200079952751590', time=2024-09-12T20:36:56.143524+0000, chain.objs.size()=1 2024-09-12T19:22:59.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.iXnwC3Bx_3FfT-GjBBcEsJKkV19i98i_0 2024-09-12T19:22:59.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16237152201236736961', time=2024-09-12T20:38:39.751427+0000, chain.objs.size()=1 2024-09-12T19:22:59.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.nAhawdLJR5nWAQhCEBAPYAxFoNvSUtZ_0 2024-09-12T19:22:59.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11422936701427220352', time=2024-09-12T20:38:40.610147+0000, chain.objs.size()=1 2024-09-12T19:22:59.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.8MRQMJx7nqggswlrqc75JPH3WhYwLje_0 2024-09-12T19:22:59.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7447220244024476137', time=2024-09-12T20:38:40.780217+0000, chain.objs.size()=1 2024-09-12T19:22:59.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.KK4tD0v0FsxOSaiwQEwqBqy2GTgL-IT_0 2024-09-12T19:22:59.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8528731079810270900', time=2024-09-12T20:38:42.028919+0000, chain.objs.size()=1 2024-09-12T19:22:59.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.so6DxHWNtw0E2tv0SmOc_xHxV1bLZD2_0 2024-09-12T19:22:59.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4378885798010630327', time=2024-09-12T20:38:42.078935+0000, chain.objs.size()=1 2024-09-12T19:22:59.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.XdTgX0ZickK9UJXIR-tFJ3WoJCuGUG9_0 2024-09-12T19:22:59.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5238132572445300610', time=2024-09-12T20:38:42.145085+0000, chain.objs.size()=1 2024-09-12T19:22:59.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.RsMkiQIoV4l_jEqyWmi2QfN4bQUqVMF_0 2024-09-12T19:22:59.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.818+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9478601127816824423', time=2024-09-12T20:38:43.844200+0000, chain.objs.size()=1 2024-09-12T19:22:59.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.818+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.H91IDLQ8vbgVn7z-CxiK230DL1SlTOA_0 2024-09-12T19:22:59.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.818+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5465373079546490365', time=2024-09-12T20:38:44.051712+0000, chain.objs.size()=1 2024-09-12T19:22:59.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.818+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.6mNtpuad_jJr1vNZsTIWJi1nMZVBJsb_0 2024-09-12T19:22:59.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.822+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6871042204518526619', time=2024-09-12T20:38:44.333524+0000, chain.objs.size()=1 2024-09-12T19:22:59.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.822+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.rqoBmGg61wxZ9qHEDOPAa1OY9ZmzbFx_0 2024-09-12T19:22:59.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.822+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12081172764782770208', time=2024-09-12T20:38:45.945490+0000, chain.objs.size()=1 2024-09-12T19:22:59.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.822+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.N5NFG8kvI0TOi-ndsg-XnILCEMDJoip_0 2024-09-12T19:22:59.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.822+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15258106154091448578', time=2024-09-12T20:38:48.014391+0000, chain.objs.size()=1 2024-09-12T19:22:59.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.822+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Hl8qLZdZhSSabqyJESgS5ukzpdbQaKA_0 2024-09-12T19:22:59.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.822+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5838255493261232057', time=2024-09-12T20:38:48.873913+0000, chain.objs.size()=1 2024-09-12T19:22:59.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.822+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.gvuUXDEvN5wDJCFIovgiYLwiKBn0uhB_0 2024-09-12T19:22:59.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.822+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.187105914082628139', time=2024-09-12T20:38:49.818954+0000, chain.objs.size()=1 2024-09-12T19:22:59.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.822+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.mUnREARRkHwLVaUTHfTeq94bpdd3QaE_0 2024-09-12T19:22:59.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.822+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5859648443947734248', time=2024-09-12T20:38:50.296500+0000, chain.objs.size()=1 2024-09-12T19:22:59.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.822+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.1Dbo3Bl7m1cbyqNsTyQMuKsbDdesLUT_0 2024-09-12T19:22:59.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.822+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7682962557242099427', time=2024-09-12T20:38:51.356345+0000, chain.objs.size()=1 2024-09-12T19:22:59.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.822+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.px0OFJlSXAeNQw2TnR6OXH8_mSV8hiT_0 2024-09-12T19:22:59.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.822+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9100287193678489067', time=2024-09-12T20:38:52.764257+0000, chain.objs.size()=1 2024-09-12T19:22:59.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.822+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.r0hWVxIwkQlrli0mcY0WPt7S_yFV43u_0 2024-09-12T19:22:59.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.822+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16373085150926648232', time=2024-09-12T20:38:53.342083+0000, chain.objs.size()=1 2024-09-12T19:22:59.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.822+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ScHJcFXJwaSEIpOd1Djd_xxvHVVKCiC_0 2024-09-12T19:22:59.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11752337260412100816', time=2024-09-12T20:38:53.461003+0000, chain.objs.size()=1 2024-09-12T19:22:59.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.019GpwiIXzmpGkAlmB9mYOs-ki5x4f0_0 2024-09-12T19:22:59.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.914931070339272648', time=2024-09-12T20:38:56.796298+0000, chain.objs.size()=1 2024-09-12T19:22:59.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-omF9_w00cnjpQCkCMjoH1_vKzPkxIi_0 2024-09-12T19:22:59.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17065672867755536668', time=2024-09-12T20:38:57.114520+0000, chain.objs.size()=1 2024-09-12T19:22:59.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.zyv43lQT1JceU1fz034S55JQhoNcFaD_0 2024-09-12T19:22:59.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10670475832292334279', time=2024-09-12T20:39:01.099697+0000, chain.objs.size()=1 2024-09-12T19:22:59.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.EvsDxoTv0wZ2ldDkFwsTLQN0jxBOEHN_0 2024-09-12T19:22:59.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3593272469720451246', time=2024-09-12T20:39:02.268015+0000, chain.objs.size()=1 2024-09-12T19:22:59.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Vxwa9riKN08EvvVuSPrCsWCVtD-HhMy_0 2024-09-12T19:22:59.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2578588976828011486', time=2024-09-12T20:39:03.404156+0000, chain.objs.size()=1 2024-09-12T19:22:59.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.JTQ_b78OmYOvEKTzeWzzqPwYeBubhsz_0 2024-09-12T19:22:59.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10649881354486814701', time=2024-09-12T20:39:05.765249+0000, chain.objs.size()=1 2024-09-12T19:22:59.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.wakkxPkOS1bNKCU3eps8lA4IohjRnjz_0 2024-09-12T19:22:59.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16543004275282786113', time=2024-09-12T20:39:06.170972+0000, chain.objs.size()=1 2024-09-12T19:22:59.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Ayo3GWv3zYccBd2R1ik1yJuogmg9gQG_0 2024-09-12T19:22:59.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3521000923265860774', time=2024-09-12T20:39:06.212946+0000, chain.objs.size()=1 2024-09-12T19:22:59.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.kujscc3bbCmtRkazhRV4cDSXWoEGhKp_0 2024-09-12T19:22:59.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16753137675661810981', time=2024-09-12T20:39:06.217382+0000, chain.objs.size()=1 2024-09-12T19:22:59.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.UjycEOUHEiURQrPnXtcseY7ZE48P57T_0 2024-09-12T19:22:59.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.668079548297568254', time=2024-09-12T20:39:07.498387+0000, chain.objs.size()=1 2024-09-12T19:22:59.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.po_hV-oZ-DYj0dGCjyeRGfBKwQFdLmN_0 2024-09-12T19:22:59.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6039942127960450586', time=2024-09-12T20:39:52.950465+0000, chain.objs.size()=1 2024-09-12T19:22:59.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.346__shadow_.3YBpVaNP3Umu4j9qY967qVXGVG95adb_0 2024-09-12T19:22:59.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4908011898575949791', time=2024-09-12T20:45:06.327843+0000, chain.objs.size()=1 2024-09-12T19:22:59.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.496__shadow_.iWrpHAH4zOEuIIQ8qdR4qnwdNhI1WJz_0 2024-09-12T19:22:59.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13666754312979564927', time=2024-09-12T20:45:10.311223+0000, chain.objs.size()=1 2024-09-12T19:22:59.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.498__shadow_.eqcFQ41oKQAJLuIB9Tt1XBNEZ_AV0-K_0 2024-09-12T19:22:59.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.834+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7694002060348976604', time=2024-09-12T20:51:47.667654+0000, chain.objs.size()=2 2024-09-12T19:22:59.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.834+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.523__multipart_mymultipart.2~jse9iCAFGxq0NqjXVupAWMVh-Y8lnMv.1 2024-09-12T19:22:59.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.834+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.523__multipart_mymultipart.2~jse9iCAFGxq0NqjXVupAWMVh-Y8lnMv.2 2024-09-12T19:22:59.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.834+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2887055705690771600', time=2024-09-12T20:56:37.497232+0000, chain.objs.size()=1 2024-09-12T19:22:59.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.834+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.566__shadow_.uADsNUh2_dX0-1rrJcuF0gcEmRWUDvO_0 2024-09-12T19:22:59.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.834+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11785465250947249148', time=2024-09-12T20:56:45.373132+0000, chain.objs.size()=1 2024-09-12T19:22:59.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.834+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:FCU3P3iJBr6asWzwh35bUFpceu4ZkPs_.hWT-ZNJONu4rwkvuOAZnYke7Zb_CPA7_0 2024-09-12T19:22:59.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.834+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18105325449349058065', time=2024-09-12T20:57:51.167925+0000, chain.objs.size()=1 2024-09-12T19:22:59.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.834+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:duii14MbEOEuY99YjacjHnEqKg1T51l_.2wB7llVZR48p_TxVoF-7l9wD6ESaJFn_0 2024-09-12T19:22:59.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46003 2024-09-12T19:22:59.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T19:22:59.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9036265759844705559', time=2024-09-12T20:57:56.565381+0000, chain.objs.size()=1 2024-09-12T19:22:59.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:qyYqnnxxCvsi9NHx5vqxJa0ONCZlbRO_.8pD6VPK3PSm-EJzmXRG5DH9HRRKwEB__0 2024-09-12T19:22:59.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13462837370209744270', time=2024-09-12T20:58:07.338016+0000, chain.objs.size()=1 2024-09-12T19:22:59.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:qL5NgeyziTBv47ZRZTekyDsG7S64xlo_.KKsiV011qKWkgCJoREDDL0xaHgCmVls_0 2024-09-12T19:22:59.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10911227310576907945', time=2024-09-12T20:58:22.052811+0000, chain.objs.size()=1 2024-09-12T19:22:59.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:TYKu6po9vtk2X6QOv9BoRPX2co-tH.L_.O-zmzXcfdwdx2O6s518A7rrkUtqTbzd_0 2024-09-12T19:22:59.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9476110701606335411', time=2024-09-12T20:58:25.277159+0000, chain.objs.size()=1 2024-09-12T19:22:59.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:TVR7dauyD2Xc4AYvB7XcXE1OPbw4YNY_.7qKt4aalTfqxbwKnp6CblI56QBE_cOa_0 2024-09-12T19:22:59.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8136954873356357927', time=2024-09-12T20:58:26.825592+0000, chain.objs.size()=1 2024-09-12T19:22:59.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:-ND.0LMM97Hv7c6XkOaPIHr6TkCuf.f_.zH4J4jK5WalCSR4t5NxwPOR-9qvEv9X_0 2024-09-12T19:22:59.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5506794280889036918', time=2024-09-12T20:59:55.709571+0000, chain.objs.size()=1 2024-09-12T19:22:59.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.587__shadow:xGirLLNywGxzyIuclDMP7dksVh.g6h7_.DxhOzj7vkR9FB7gYAUeV9WRDGP1agnq_0 2024-09-12T19:22:59.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13778845689016319899', time=2024-09-12T21:00:36.385626+0000, chain.objs.size()=1 2024-09-12T19:22:59.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.608__shadow_.SQ3jSkl42Rw269GDcTAXsQI0aDd-iYd_0 2024-09-12T19:22:59.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14852274256521730079', time=2024-09-12T21:07:18.111941+0000, chain.objs.size()=1 2024-09-12T19:22:59.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.635__shadow_.-iopSqMPtjowUV8MZijhtL-pYpCqbwz_0 2024-09-12T19:22:59.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2746404963795389799', time=2024-09-12T21:09:45.592777+0000, chain.objs.size()=1 2024-09-12T19:22:59.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.666__shadow_.jjnn7PZH_PlaZf8ZUwCM0yqFYcCbx1o_0 2024-09-12T19:22:59.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10636395878428825612', time=2024-09-12T21:11:14.121934+0000, chain.objs.size()=1 2024-09-12T19:22:59.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.712__shadow:9z7yYZLfiRsUtAHufoN4Dj5ccHOvYQh_.-UoV1Q6db2cmm4fDxXS6Elez6BRjG_J_0 2024-09-12T19:22:59.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14532720775247109076', time=2024-09-12T21:13:00.599329+0000, chain.objs.size()=1 2024-09-12T19:22:59.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.741__shadow_.Z6N2PvWOggxhwvf0Dlf8GyjpWaNiDAx_0 2024-09-12T19:22:59.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4468089054087886911', time=2024-09-12T21:13:03.660552+0000, chain.objs.size()=1 2024-09-12T19:22:59.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.842+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.742__multipart_mymultipart3.2~Sv0NqP1FQj7zBSlOLLlSuJnDQuX1JTg.1 2024-09-12T19:22:59.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.850+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:22:59.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T19:22:59.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:22:59.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:22:59.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50566' 2024-09-12T19:22:59.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1125671725863927297', time=2024-09-12T20:21:58.753480+0000, chain.objs.size()=2 2024-09-12T19:22:59.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.158__shadow_.rtek1zHZDCEhKCr2rZNQI7RXJFwvV6c_0 2024-09-12T19:22:59.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.158__shadow_.rtek1zHZDCEhKCr2rZNQI7RXJFwvV6c_1 2024-09-12T19:22:59.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='_RcdExlvoafoIaE0cHLdksWyqSrwAzCA', time=2024-09-12T20:22:32.157102+0000, chain.objs.size()=2 2024-09-12T19:22:59.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.160__shadow_.CfY7esZ7ylCsMOnGkeDrhJIdpvssks5_0 2024-09-12T19:22:59.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.160__shadow_.CfY7esZ7ylCsMOnGkeDrhJIdpvssks5_1 2024-09-12T19:22:59.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='_WltMm_fXu2yB2wAHN6bYPXScLMz9_y7', time=2024-09-12T20:23:15.304263+0000, chain.objs.size()=2 2024-09-12T19:22:59.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.161__shadow_.8uP0lN6jf_y4T7kaiXwr2o3vpRJqVHz_0 2024-09-12T19:22:59.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.161__shadow_.8uP0lN6jf_y4T7kaiXwr2o3vpRJqVHz_1 2024-09-12T19:22:59.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1937857563331019036', time=2024-09-12T20:23:26.256619+0000, chain.objs.size()=1 2024-09-12T19:22:59.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.162__shadow_.Cj4eVoa92_GJFOHHmRaACN8nH4yUkS8_0 2024-09-12T19:22:59.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5095814777488148139', time=2024-09-12T20:29:27.836731+0000, chain.objs.size()=1 2024-09-12T19:22:59.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.246__shadow_.sFqn8p4lpm7BVmPSeDXagEWNBDePOZK_0 2024-09-12T19:22:59.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10264777751918360375', time=2024-09-12T20:29:37.071019+0000, chain.objs.size()=1 2024-09-12T19:22:59.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.250__shadow_.dNaAP76WjaX2qnyDDd4SRSSItHTkhNI_0 2024-09-12T19:22:59.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6563298098820732352', time=2024-09-12T20:31:45.285062+0000, chain.objs.size()=1 2024-09-12T19:22:59.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.SpvOXPZcP6LQB8kA94KXVicWQ5qzcnm_0 2024-09-12T19:22:59.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7312009348411927474', time=2024-09-12T20:31:47.652455+0000, chain.objs.size()=1 2024-09-12T19:22:59.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.RDR1tnDoust5U31lC82faKriCEkHC-R_0 2024-09-12T19:22:59.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5840698704526761411', time=2024-09-12T20:31:47.801530+0000, chain.objs.size()=1 2024-09-12T19:22:59.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.rOFId6Hmc4XbhocVFaw0lK6m8b0KtnT_0 2024-09-12T19:22:59.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18138503152372192894', time=2024-09-12T20:31:48.162822+0000, chain.objs.size()=1 2024-09-12T19:22:59.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.SI9jQYI1hT9SSwPHF6Ecy32Vra5rMJ1_0 2024-09-12T19:22:59.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5035198306555319094', time=2024-09-12T20:31:49.264606+0000, chain.objs.size()=1 2024-09-12T19:22:59.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.qJdMgaM2N7YgSUFKgcRRkXvUUVJS0AN_0 2024-09-12T19:22:59.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10610311517579917996', time=2024-09-12T20:31:49.624661+0000, chain.objs.size()=1 2024-09-12T19:22:59.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Qejve-u5X9K-YkcLzar3JrOHfuJRI8u_0 2024-09-12T19:22:59.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17254107307223491851', time=2024-09-12T20:31:50.028103+0000, chain.objs.size()=1 2024-09-12T19:22:59.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.KOrMPJS0BeiK5_wwFaQFKqA-ag5PJlp_0 2024-09-12T19:22:59.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6407101452967594352', time=2024-09-12T20:31:50.439335+0000, chain.objs.size()=1 2024-09-12T19:22:59.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.tyx3tMuFYs5GRlb2U-qTlbA8g2fFdBA_0 2024-09-12T19:22:59.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13966607535637362777', time=2024-09-12T20:31:51.636566+0000, chain.objs.size()=1 2024-09-12T19:22:59.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.KmgcR_GKM1m1xhNcFBdtminQc7Haw6g_0 2024-09-12T19:22:59.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14009931473921395844', time=2024-09-12T20:31:53.775458+0000, chain.objs.size()=1 2024-09-12T19:22:59.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.hyw6by-VHDPgW7C6BjsTrqaHfdfBjHm_0 2024-09-12T19:22:59.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17135730435732986430', time=2024-09-12T20:31:54.517951+0000, chain.objs.size()=1 2024-09-12T19:22:59.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.qdb7phCGVLoGXcNpw4rGWsNA6DFfpc3_0 2024-09-12T19:22:59.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14229615025713028869', time=2024-09-12T20:31:54.958762+0000, chain.objs.size()=1 2024-09-12T19:22:59.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ZwQyT197ynWLdsnykL-t47r0Zy3ex7B_0 2024-09-12T19:22:59.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1116342545805431481', time=2024-09-12T20:31:55.620743+0000, chain.objs.size()=1 2024-09-12T19:22:59.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.4PjLfyoKGfxTs86vPRPm3iX489jupUH_0 2024-09-12T19:22:59.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4906661079988436960', time=2024-09-12T20:31:56.916431+0000, chain.objs.size()=1 2024-09-12T19:22:59.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.xYH_7enINIBKBeqKghD88oNnbYxOn9d_0 2024-09-12T19:22:59.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5965392008362560005', time=2024-09-12T20:31:58.227367+0000, chain.objs.size()=1 2024-09-12T19:22:59.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.rdyd9KNPrlkC5sWqyqSlRvfnSmNx84V_0 2024-09-12T19:22:59.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1156977611657097906', time=2024-09-12T20:31:59.167251+0000, chain.objs.size()=1 2024-09-12T19:22:59.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.0z8IRKHuCWA1iDXSPSn2Q9ywq_RfRTN_0 2024-09-12T19:22:59.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13240880955478515663', time=2024-09-12T20:31:59.553068+0000, chain.objs.size()=1 2024-09-12T19:22:59.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.OBKrr0QIE2VlO8zIojlJn1wR4N-QSzw_0 2024-09-12T19:22:59.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9110194631183997805', time=2024-09-12T20:31:59.645599+0000, chain.objs.size()=1 2024-09-12T19:22:59.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.vks6kVBFzq7m0GLV4wOvDjmhsFPUC29_0 2024-09-12T19:22:59.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14872270410636003903', time=2024-09-12T20:32:01.069770+0000, chain.objs.size()=1 2024-09-12T19:22:59.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Hpn2TJg8YpTCRji_M_5CNIL6bX3BO3Q_0 2024-09-12T19:22:59.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4175136063921097962', time=2024-09-12T20:32:01.574284+0000, chain.objs.size()=1 2024-09-12T19:22:59.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Hrc7I0WTnWQBJsOnzYzL59vOV5LK5cq_0 2024-09-12T19:22:59.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10278015054233982166', time=2024-09-12T20:32:01.710111+0000, chain.objs.size()=1 2024-09-12T19:22:59.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.uBei3b5RYbvWmaUIpRxc0U1OQdQUxlN_0 2024-09-12T19:22:59.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11000848109462259031', time=2024-09-12T20:32:01.877656+0000, chain.objs.size()=1 2024-09-12T19:22:59.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.h432jSo3QLdwHJO1fff7QvJrhXAPKyt_0 2024-09-12T19:22:59.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4796242982617249099', time=2024-09-12T20:32:03.224376+0000, chain.objs.size()=1 2024-09-12T19:22:59.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.f1rGeMV4xR9Fue0vpcCGCa025ly61gU_0 2024-09-12T19:22:59.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7783737439121014311', time=2024-09-12T20:32:03.589773+0000, chain.objs.size()=1 2024-09-12T19:22:59.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.KUTzmqW-CbOJy9E7_OMhvuyZpkC9uz7_0 2024-09-12T19:22:59.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17711869122293134723', time=2024-09-12T20:32:04.843256+0000, chain.objs.size()=1 2024-09-12T19:22:59.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.6oS1W3lUNeEvFMoBn5A7tSmbSDMqqdu_0 2024-09-12T19:22:59.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1402091185204576741', time=2024-09-12T20:32:06.493183+0000, chain.objs.size()=1 2024-09-12T19:22:59.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.uiJaMdXzUSQ8l_CTGH9g2T32n1EEy4Z_0 2024-09-12T19:22:59.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2783378043154350844', time=2024-09-12T20:32:08.067592+0000, chain.objs.size()=1 2024-09-12T19:22:59.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.N3CrHWnYaAsioNa8H8xgh3Z1YeHl9uq_0 2024-09-12T19:22:59.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9389103202464875832', time=2024-09-12T20:32:08.165081+0000, chain.objs.size()=1 2024-09-12T19:22:59.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.nLGWeAvagfVMu_oJ0nI4vvWnXw3cPd7_0 2024-09-12T19:22:59.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.878+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14425802918929490735', time=2024-09-12T20:32:08.283759+0000, chain.objs.size()=1 2024-09-12T19:22:59.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.878+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.sqkWQjcNFaM4qJGjrpITLU6pbx3xrar_0 2024-09-12T19:22:59.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.878+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10556100505771178498', time=2024-09-12T20:32:08.623752+0000, chain.objs.size()=1 2024-09-12T19:22:59.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.878+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.t0_nlZj2HF1ZwU03nmXa708warSXk33_0 2024-09-12T19:22:59.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.878+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3671843736671809645', time=2024-09-12T20:32:09.618380+0000, chain.objs.size()=1 2024-09-12T19:22:59.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.878+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.1Daqd6fZjf_bqraxdeAiVrBlnAD0KGO_0 2024-09-12T19:22:59.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.878+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18151145648602310945', time=2024-09-12T20:32:10.495710+0000, chain.objs.size()=1 2024-09-12T19:22:59.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.878+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Eaz3p-1vrKEh0yXAzmUy1JTlKz1O4At_0 2024-09-12T19:22:59.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.878+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1336775729875244540', time=2024-09-12T20:32:10.779847+0000, chain.objs.size()=1 2024-09-12T19:22:59.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.878+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.1IHqTQb7dVDvNFZiivuEhha11iO6nMS_0 2024-09-12T19:22:59.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.882+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3535145458622907363', time=2024-09-12T20:32:11.763940+0000, chain.objs.size()=1 2024-09-12T19:22:59.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.882+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.0rcI0FjX5T32rcX-2SMLEkWgwOdOmpk_0 2024-09-12T19:22:59.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.882+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7165435357881691817', time=2024-09-12T20:32:12.566082+0000, chain.objs.size()=1 2024-09-12T19:22:59.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.882+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.0DaRVm01uMAC4WLimOsuQB9UMGDBMwk_0 2024-09-12T19:22:59.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.882+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9192118955950378463', time=2024-09-12T20:32:12.892613+0000, chain.objs.size()=1 2024-09-12T19:22:59.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.882+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.aNMW-c2MsMOTy7TrH7l5rp0CguNFT4X_0 2024-09-12T19:22:59.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.882+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10659400616252923712', time=2024-09-12T20:32:13.922886+0000, chain.objs.size()=1 2024-09-12T19:22:59.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.882+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ltMqbzMddl2DqlYyaGxnIKkl4x2_x4y_0 2024-09-12T19:22:59.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.882+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11561156268797111864', time=2024-09-12T20:32:42.504786+0000, chain.objs.size()=1 2024-09-12T19:22:59.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.882+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.275__shadow_._-YmqLY9EymWgfF38kgOwqCzVOKxFs8_0 2024-09-12T19:22:59.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.882+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12865738467189392810', time=2024-09-12T20:32:58.723053+0000, chain.objs.size()=1 2024-09-12T19:22:59.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.882+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.282__shadow_.w7NZ4V9aUOcIrffbXabjXVzhG_pI8pS_0 2024-09-12T19:22:59.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3518534192575370164', time=2024-09-12T20:33:00.970937+0000, chain.objs.size()=1 2024-09-12T19:22:59.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.283__shadow_.EPda2xJv4dKms9rrfr-ybD9DB8DX1Xl_0 2024-09-12T19:22:59.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1989798639243297197', time=2024-09-12T20:33:05.711371+0000, chain.objs.size()=1 2024-09-12T19:22:59.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.285__shadow_.5QWZ7vqpEtRO776dqoG_CYAVZ8gs2qN_0 2024-09-12T19:22:59.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3637811575430882493', time=2024-09-12T20:33:10.451685+0000, chain.objs.size()=1 2024-09-12T19:22:59.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.287__shadow_.q9grUiy-69H77mxIpr-k5D3W8wwFC2e_0 2024-09-12T19:22:59.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13969464230935130463', time=2024-09-12T20:33:59.356546+0000, chain.objs.size()=1 2024-09-12T19:22:59.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.305__shadow_.za4631WJtovRL5tvMH2BkWd-TYTLX3A_0 2024-09-12T19:22:59.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17884756317763051035', time=2024-09-12T20:36:28.686317+0000, chain.objs.size()=1 2024-09-12T19:22:59.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.BYEDGqmdIM0KtGN1JVJpSDy2g7M6J3H_0 2024-09-12T19:22:59.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13057810141059815289', time=2024-09-12T20:36:28.926456+0000, chain.objs.size()=1 2024-09-12T19:22:59.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.YxSSLK_WDitPfXwa9fkISkJwh_4b4Id_0 2024-09-12T19:22:59.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4193887138075146963', time=2024-09-12T20:36:29.533368+0000, chain.objs.size()=1 2024-09-12T19:22:59.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.-W9fl5QpWA9F67VjQpT9TPx0ewi3pC0_0 2024-09-12T19:22:59.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12791148470655590472', time=2024-09-12T20:36:30.135402+0000, chain.objs.size()=1 2024-09-12T19:22:59.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.R2N1o0xQupo2-3iNaeNvnlgsTcbWu6N_0 2024-09-12T19:22:59.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14058427641276793289', time=2024-09-12T20:36:30.634971+0000, chain.objs.size()=1 2024-09-12T19:22:59.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.g6wkmM9sTPS8AVEPo4zwg_R7sxY5HJ7_0 2024-09-12T19:22:59.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2712431038471747101', time=2024-09-12T20:36:30.694273+0000, chain.objs.size()=1 2024-09-12T19:22:59.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.JtyGBe9_lS2GV6OtZS823g_aYyqOqm0_0 2024-09-12T19:22:59.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.890+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14143439345839602893', time=2024-09-12T20:36:30.696015+0000, chain.objs.size()=1 2024-09-12T19:22:59.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.890+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.FA1hJw70aW2Hfm8TgxJOxBYPil3vXmf_0 2024-09-12T19:22:59.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.890+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13034865228303336863', time=2024-09-12T20:36:31.893787+0000, chain.objs.size()=1 2024-09-12T19:22:59.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.890+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.fjnhXzyFagvIAjmemRRo8W9Qw2Be0nE_0 2024-09-12T19:22:59.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.890+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11782537443319464014', time=2024-09-12T20:36:32.334546+0000, chain.objs.size()=1 2024-09-12T19:22:59.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.890+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.5G_FJczI7dSFew9q8_SK9GSmLXqOda9_0 2024-09-12T19:22:59.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.890+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11148212096689172504', time=2024-09-12T20:36:32.336340+0000, chain.objs.size()=1 2024-09-12T19:22:59.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.890+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.xsbz6DYyB4zjs1zByYMkjZb2O9F4OS6_0 2024-09-12T19:22:59.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.890+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5030889175096069458', time=2024-09-12T20:36:33.360053+0000, chain.objs.size()=1 2024-09-12T19:22:59.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.890+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.rMqcfbkxaOL7Bb4Hte_lBLaDAmYLX-p_0 2024-09-12T19:22:59.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.890+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2392823324220686036', time=2024-09-12T20:36:39.586229+0000, chain.objs.size()=1 2024-09-12T19:22:59.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.890+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.bZqU5M9CqFrMk0IaFCviRcQEQMo21ez_0 2024-09-12T19:22:59.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15598795300465765589', time=2024-09-12T20:36:40.611573+0000, chain.objs.size()=1 2024-09-12T19:22:59.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.l-PqmJrAoI_b-PSBOE0YfNT2qeeT9Ih_0 2024-09-12T19:22:59.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11511678002239497135', time=2024-09-12T20:36:41.328937+0000, chain.objs.size()=1 2024-09-12T19:22:59.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.7JxKrbti3Qd-zF_ycqi0Z2KYV0cGMfe_0 2024-09-12T19:22:59.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4435787595674640090', time=2024-09-12T20:36:44.098196+0000, chain.objs.size()=1 2024-09-12T19:22:59.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.dMCIRLz6Oh_Sa8Z9IDYna6Cei9_OgIZ_0 2024-09-12T19:22:59.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13305009319802372206', time=2024-09-12T20:36:44.959435+0000, chain.objs.size()=1 2024-09-12T19:22:59.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Bp5s3AjkgGhn4Esj3ScTpUEJqoagIIK_0 2024-09-12T19:22:59.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14746568163842291913', time=2024-09-12T20:36:45.261635+0000, chain.objs.size()=1 2024-09-12T19:22:59.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.dDj8uUSfK3dCpGixizTHY82loet1a15_0 2024-09-12T19:22:59.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4938405753811683600', time=2024-09-12T20:36:45.354368+0000, chain.objs.size()=1 2024-09-12T19:22:59.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.NnRtjfJsakygEQpZtEr2Ihzxp5110si_0 2024-09-12T19:22:59.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.898+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14802846327374733670', time=2024-09-12T20:36:45.608940+0000, chain.objs.size()=1 2024-09-12T19:22:59.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.898+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.S4YCSVKaq34UGNo4stoJa_lbnPJL06p_0 2024-09-12T19:22:59.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.898+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.680651889982887701', time=2024-09-12T20:36:47.337469+0000, chain.objs.size()=1 2024-09-12T19:22:59.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.898+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.fUEZWg9GG53gPyh7W4ah8CqY7g4ebT2_0 2024-09-12T19:22:59.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.898+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9057134922285684720', time=2024-09-12T20:36:47.467900+0000, chain.objs.size()=1 2024-09-12T19:22:59.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.898+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.FKfC-P64tT0OYEa6KHbUfEmflEg_iz8_0 2024-09-12T19:22:59.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.898+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18377477415116757896', time=2024-09-12T20:36:47.867203+0000, chain.objs.size()=1 2024-09-12T19:22:59.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.898+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ADj87cRe0wGsAJnTipkvpwhYjNW_6nT_0 2024-09-12T19:22:59.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.898+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6924354543222646977', time=2024-09-12T20:36:49.190433+0000, chain.objs.size()=1 2024-09-12T19:22:59.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.898+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.CvNSwgKaEk1Mfncw-wsX0FNIgFiDVdE_0 2024-09-12T19:22:59.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.898+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5874349025154608380', time=2024-09-12T20:36:49.712413+0000, chain.objs.size()=1 2024-09-12T19:22:59.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.898+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Kt5Ufzb57gNEH29WYm-BdMe_hpuY6Nu_0 2024-09-12T19:22:59.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.898+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13720137439741134330', time=2024-09-12T20:36:51.464491+0000, chain.objs.size()=1 2024-09-12T19:22:59.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.898+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.9_seAJAXB-Fbo08ECKGFDhiTsLZz_sy_0 2024-09-12T19:22:59.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.902+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5184920670189866609', time=2024-09-12T20:36:51.525375+0000, chain.objs.size()=1 2024-09-12T19:22:59.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.902+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ssYatwAKygObZGWXNddsysKBm-_ERiw_0 2024-09-12T19:22:59.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.902+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1498924493211809269', time=2024-09-12T20:36:53.174178+0000, chain.objs.size()=1 2024-09-12T19:22:59.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.902+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.yc6knQeHNp3Ao1Ipn6HdFPN_AxtzYr5_0 2024-09-12T19:22:59.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.902+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6995487502116993249', time=2024-09-12T20:36:55.160556+0000, chain.objs.size()=1 2024-09-12T19:22:59.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.902+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.LR0E4K7kzNTwOx9NCDXKXLTD0Hv4RRA_0 2024-09-12T19:22:59.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.902+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6599699794881647334', time=2024-09-12T20:36:55.249287+0000, chain.objs.size()=1 2024-09-12T19:22:59.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.902+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.VcZOVtfnKuIe9uupUalYXSua_jxnsUL_0 2024-09-12T19:22:59.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.902+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11619195024068538806', time=2024-09-12T20:36:55.251629+0000, chain.objs.size()=1 2024-09-12T19:22:59.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.902+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.oWXXwRr74FeJnGOF3PL8y0xB4mWXMEe_0 2024-09-12T19:22:59.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15613722054272882840', time=2024-09-12T20:36:55.632719+0000, chain.objs.size()=1 2024-09-12T19:22:59.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Te1CT8BGcCm5H7cwLWs03fkOTwiZzoW_0 2024-09-12T19:22:59.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12315123053297244140', time=2024-09-12T20:36:55.676438+0000, chain.objs.size()=1 2024-09-12T19:22:59.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.6P5czuEDhPWP4LIaQ4uIjUr3w9xaciM_0 2024-09-12T19:22:59.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1191902853911464586', time=2024-09-12T20:38:40.288527+0000, chain.objs.size()=1 2024-09-12T19:22:59.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ZKvAkBPmyIfvEgubt-NPGh-aProBiVh_0 2024-09-12T19:22:59.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12117591374557236212', time=2024-09-12T20:38:40.718998+0000, chain.objs.size()=1 2024-09-12T19:22:59.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.YAwxVluiUlSYrqLjeZJd_fFl9e7aWix_0 2024-09-12T19:22:59.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11493368546521121219', time=2024-09-12T20:38:41.768685+0000, chain.objs.size()=1 2024-09-12T19:22:59.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_._WJDG4DoT3oWjbxTSLUD5P9NosxBnWv_0 2024-09-12T19:22:59.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5409411083915775598', time=2024-09-12T20:38:42.072828+0000, chain.objs.size()=1 2024-09-12T19:22:59.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.JsDtaSjmwatWXMfzKopL6boY9XKsM0a_0 2024-09-12T19:22:59.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16033127155441595931', time=2024-09-12T20:38:42.395375+0000, chain.objs.size()=1 2024-09-12T19:22:59.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Pbzx3-jqtLzhOiJZXIVvUUP4Y_zQGwx_0 2024-09-12T19:22:59.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6491570374643390947', time=2024-09-12T20:38:42.400851+0000, chain.objs.size()=1 2024-09-12T19:22:59.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.hV75YgJySSMEAowuEUotjDstQ4y09Hn_0 2024-09-12T19:22:59.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7346474716329253310', time=2024-09-12T20:38:42.650858+0000, chain.objs.size()=1 2024-09-12T19:22:59.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Fmn_6G_FnEd8-y9HEYzET23DNjWwotL_0 2024-09-12T19:22:59.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12996157185475779929', time=2024-09-12T20:38:44.195761+0000, chain.objs.size()=1 2024-09-12T19:22:59.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.QWtpcQq4MQzbtZvdN8cqOc6XCHTSxtY_0 2024-09-12T19:22:59.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.910+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8689097473605739765', time=2024-09-12T20:38:48.835125+0000, chain.objs.size()=1 2024-09-12T19:22:59.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.910+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.y3yqVUQvZ190xhz7vkc_3VZA6_IoKx5_0 2024-09-12T19:22:59.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.910+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7322382812843258095', time=2024-09-12T20:38:49.010848+0000, chain.objs.size()=1 2024-09-12T19:22:59.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.910+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.v_jS7pCq2PXW8xSe55_HUjUlAVCn4lK_0 2024-09-12T19:22:59.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.910+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6771459767363716722', time=2024-09-12T20:38:50.309625+0000, chain.objs.size()=1 2024-09-12T19:22:59.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.910+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.l1Y_l9YWtDwgYLywIzl_G_5ta0L6SPB_0 2024-09-12T19:22:59.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.910+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7389969636451870590', time=2024-09-12T20:38:51.763059+0000, chain.objs.size()=1 2024-09-12T19:22:59.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.910+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.nyAr9yi46N-JdKbM_Qjq3DkgMIgbNg7_0 2024-09-12T19:22:59.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.910+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7923723679951190710', time=2024-09-12T20:38:53.138989+0000, chain.objs.size()=1 2024-09-12T19:22:59.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.910+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.vyoHD1S_gDAM2vmb3ObFkMrSXY2s_np_0 2024-09-12T19:22:59.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.914+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16263959080023088227', time=2024-09-12T20:38:53.442113+0000, chain.objs.size()=1 2024-09-12T19:22:59.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.914+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.XwDRBUMtPFXB9Gl7jMpG7Zr8Mo94MMQ_0 2024-09-12T19:22:59.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.914+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8567790887507046946', time=2024-09-12T20:38:53.660154+0000, chain.objs.size()=1 2024-09-12T19:22:59.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.914+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Jk2mKEgWrpI8A2VJuyD0j9oE3BjPrab_0 2024-09-12T19:22:59.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.914+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3338837178678550770', time=2024-09-12T20:38:54.039570+0000, chain.objs.size()=1 2024-09-12T19:22:59.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.914+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.8bSLLNqmUa0LJObX8WNM3cWRgTULMup_0 2024-09-12T19:22:59.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.914+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13177583602962505589', time=2024-09-12T20:38:55.051852+0000, chain.objs.size()=1 2024-09-12T19:22:59.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.914+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.KNfN0Nx1pic6GyA9tyE_D7fhKvMsLPG_0 2024-09-12T19:22:59.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.914+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11325118384354639919', time=2024-09-12T20:38:55.475727+0000, chain.objs.size()=1 2024-09-12T19:22:59.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.914+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.cko19OT2YTF55zBNuCFKwTjxBjmo8ut_0 2024-09-12T19:22:59.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.914+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3320206858474973959', time=2024-09-12T20:38:56.252518+0000, chain.objs.size()=1 2024-09-12T19:22:59.919 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.914+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.229QkgMQXN2xQfuIZwrIoteUzxdkRE1_0 2024-09-12T19:22:59.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.918+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50566 2024-09-12T19:22:59.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T19:22:59.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5723482071696050530', time=2024-09-12T20:38:56.552478+0000, chain.objs.size()=1 2024-09-12T19:22:59.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.tAI7xVxA3FnvwsKQVD0H3Bs5ishwfAp_0 2024-09-12T19:22:59.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15220515846594737214', time=2024-09-12T20:38:57.419502+0000, chain.objs.size()=1 2024-09-12T19:22:59.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Cx1AuY8lbrBt2trkzUrlkS8bwBuFHg-_0 2024-09-12T19:22:59.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4770818913732659005', time=2024-09-12T20:38:59.371508+0000, chain.objs.size()=1 2024-09-12T19:22:59.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.TrGPpdR8Py3SYf_fuLAxwuZoYSPqXA6_0 2024-09-12T19:22:59.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11733347482992682247', time=2024-09-12T20:39:00.455638+0000, chain.objs.size()=1 2024-09-12T19:22:59.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.5V2eyf8fWuWS_pzq8Xzt0IfIKSF9y-f_0 2024-09-12T19:22:59.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11589578621979353646', time=2024-09-12T20:39:02.287290+0000, chain.objs.size()=1 2024-09-12T19:22:59.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.3C10GnDfv5l4JJmHZWvZ4pJG-8Z9WlF_0 2024-09-12T19:22:59.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.969243433431908287', time=2024-09-12T20:39:02.663078+0000, chain.objs.size()=1 2024-09-12T19:22:59.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Z9-Lit5Et-qUuGDX_LkJ4Tvmu_6wxAW_0 2024-09-12T19:22:59.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7087380392989277290', time=2024-09-12T20:39:02.702418+0000, chain.objs.size()=1 2024-09-12T19:22:59.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.7lmSLe5dzbCVxVFXI9moZ6xbBPpNlaD_0 2024-09-12T19:22:59.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12807628335445409507', time=2024-09-12T20:39:03.098200+0000, chain.objs.size()=1 2024-09-12T19:22:59.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.jCbUYW7-mvvPihqObgpWf4igmxJOamm_0 2024-09-12T19:22:59.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9784021558566804675', time=2024-09-12T20:39:03.634470+0000, chain.objs.size()=1 2024-09-12T19:22:59.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.bGkGc8PVBxYyJB6Y-zwWvrqudyCzvT1_0 2024-09-12T19:22:59.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12403570642620064566', time=2024-09-12T20:39:03.738304+0000, chain.objs.size()=1 2024-09-12T19:22:59.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.IdQChWDfL094pC24HZNSbQxmLDBOQXu_0 2024-09-12T19:22:59.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.879363802759424858', time=2024-09-12T20:39:04.205510+0000, chain.objs.size()=1 2024-09-12T19:22:59.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.69p6vCvjGUfu9SE90WnbRAvlDT_RYDs_0 2024-09-12T19:22:59.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16964026042710141135', time=2024-09-12T20:39:04.440549+0000, chain.objs.size()=1 2024-09-12T19:22:59.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.922+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.c5SLtPoIjZIqKqLIwZTJjw5RQFQpAdp_0 2024-09-12T19:22:59.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.926+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9320153529971212800', time=2024-09-12T20:39:05.745379+0000, chain.objs.size()=1 2024-09-12T19:22:59.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.926+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.JTAF48MFjTRjeqhVCjrQeiNy1U0zD-O_0 2024-09-12T19:22:59.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.926+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12465285993829745035', time=2024-09-12T20:39:06.951309+0000, chain.objs.size()=1 2024-09-12T19:22:59.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:22:59.926+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.6bXB_k7HAaKEQFbhIRyCRBpsjSlmge5_0 2024-09-12T19:23:00.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.130+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3043597156364177345', time=2024-09-12T20:39:07.031236+0000, chain.objs.size()=1 2024-09-12T19:23:00.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.130+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.shE4YsFt6vroOYGV3U_H9ZZVY2Izmj5_0 2024-09-12T19:23:00.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.134+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7887670149548752418', time=2024-09-12T20:39:07.892767+0000, chain.objs.size()=1 2024-09-12T19:23:00.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.134+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.K4dVSZM-nZN9dOIVeloIcXwSsxIrQjW_0 2024-09-12T19:23:00.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.134+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4561188178784684652', time=2024-09-12T20:39:07.942357+0000, chain.objs.size()=1 2024-09-12T19:23:00.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.134+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ErSKn6xIP3S3gMG3NjWjrtJfPHy-mKk_0 2024-09-12T19:23:00.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.134+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4207242997448294331', time=2024-09-12T20:40:33.558179+0000, chain.objs.size()=1 2024-09-12T19:23:00.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.134+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.369__shadow_.HsGGoSCPdL9dL-FK_aqfk4ozg6GbD2p_0 2024-09-12T19:23:00.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.134+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16620754993048521865', time=2024-09-12T20:44:51.318027+0000, chain.objs.size()=1 2024-09-12T19:23:00.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.134+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.488__shadow_.chscM7RH7-UA4Y5tzFi7QFkpPycgqsH_0 2024-09-12T19:23:00.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.134+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11134875472477599463', time=2024-09-12T20:45:13.610639+0000, chain.objs.size()=1 2024-09-12T19:23:00.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.134+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.499__shadow_.-SmzZnJr3gF3K9Ow2QHQB-ctgxb9HEK_0 2024-09-12T19:23:00.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.134+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17567091271076916372', time=2024-09-12T20:46:07.876394+0000, chain.objs.size()=6 2024-09-12T19:23:00.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.134+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.1 2024-09-12T19:23:00.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.134+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.2 2024-09-12T19:23:00.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.134+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.3 2024-09-12T19:23:00.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.134+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.4 2024-09-12T19:23:00.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.134+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.5 2024-09-12T19:23:00.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.138+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.6 2024-09-12T19:23:00.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.138+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.805435524130257640', time=2024-09-12T20:46:12.245014+0000, chain.objs.size()=1 2024-09-12T19:23:00.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.138+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.511__multipart_mymultipart.2~8-URkUIIKsPKPPCjoEmTm_ZzMaJl_R9.1 2024-09-12T19:23:00.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~oHkxTh4sRV4O_OiXuxFCjYn3Cnw6qZs', time=2024-09-12T20:50:23.564725+0000, chain.objs.size()=1 2024-09-12T19:23:00.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~oHkxTh4sRV4O_OiXuxFCjYn3Cnw6qZs.2 2024-09-12T19:23:00.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~oHkxTh4sRV4O_OiXuxFCjYn3Cnw6qZs', time=2024-09-12T20:50:23.574070+0000, chain.objs.size()=1 2024-09-12T19:23:00.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~oHkxTh4sRV4O_OiXuxFCjYn3Cnw6qZs.3 2024-09-12T19:23:00.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4123221284151849980', time=2024-09-12T20:54:09.794728+0000, chain.objs.size()=1 2024-09-12T19:23:00.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.537__shadow_.Iew5BKx-YO0sdH9tA9W5HKWg-l7JrfM_0 2024-09-12T19:23:00.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7581400569202082853', time=2024-09-12T20:57:52.383165+0000, chain.objs.size()=1 2024-09-12T19:23:00.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:UkmUNBUANU0RMlAI8LMaSIeiH1EW8JN_.j4lQ-UGvSRHIN6g8fKn3N2lBV-bwNPI_0 2024-09-12T19:23:00.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13703105304407284126', time=2024-09-12T20:58:17.125329+0000, chain.objs.size()=1 2024-09-12T19:23:00.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:.kTEImeXjfh5-foDWjttIh.s9bxEoMf_.Jh8IoFEUBoavLOoHKuz2ukpwGMdZq3K_0 2024-09-12T19:23:00.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.142904174250878639', time=2024-09-12T20:59:34.904778+0000, chain.objs.size()=1 2024-09-12T19:23:00.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.580__shadow:wEWrzO73pA5IgZwDnEbm0JuTeUX0ASu_.MO7S4CRxEG2GOQtjqOJicjRzNwnoSGc_0 2024-09-12T19:23:00.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.390335736164971945', time=2024-09-12T20:59:55.302916+0000, chain.objs.size()=1 2024-09-12T19:23:00.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.587__shadow:XyRFmNDl3W1DLWnoNlbejPzacQOdCT-_.s_AZIjEM01dA3xW2GFuoGtDGmVkaQT9_0 2024-09-12T19:23:00.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16531107528650029072', time=2024-09-12T21:09:39.255320+0000, chain.objs.size()=1 2024-09-12T19:23:00.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.664__shadow_.JQdFq9kqnF8olvsd5GaSgWVhTbgxvll_0 2024-09-12T19:23:00.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16802346183950022115', time=2024-09-12T21:09:46.284455+0000, chain.objs.size()=1 2024-09-12T19:23:00.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.666__shadow_.jjnn7PZH_PlaZf8ZUwCM0yqFYcCbx1o_0 2024-09-12T19:23:00.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11991563081359747044', time=2024-09-12T21:10:57.618084+0000, chain.objs.size()=1 2024-09-12T19:23:00.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.704__shadow:U50AGYavOWRl4kT0dbCMP5nFz07ERXN_.KlsnuDqh56U14JPvBeJ1GhCTATzBdkZ_0 2024-09-12T19:23:00.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.162+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:00.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T19:23:00.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.170+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:00.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:00.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/59759' 2024-09-12T19:23:00.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14888414752102513059', time=2024-09-12T20:21:58.824081+0000, chain.objs.size()=1 2024-09-12T19:23:00.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.158__shadow_.4gEz7HCcLKPOtiYsGNQcfIpro-OcS--_0 2024-09-12T19:23:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='_Aadk0kVelIWllzDMDJheK8Z9RVb7LI8', time=2024-09-12T20:22:43.104366+0000, chain.objs.size()=2 2024-09-12T19:23:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.160__shadow_.WBNowiPIvP1LGiaaiCriYh9JkQpG_0L_0 2024-09-12T19:23:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.160__shadow_.WBNowiPIvP1LGiaaiCriYh9JkQpG_0L_1 2024-09-12T19:23:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3757193627458490848', time=2024-09-12T20:22:50.855949+0000, chain.objs.size()=3 2024-09-12T19:23:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.161__multipart_foo-STANDARD.2~H3ybYAjkoewmVL6FmupddmeZL-tJBTF.1 2024-09-12T19:23:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.161__multipart_foo-STANDARD.2~H3ybYAjkoewmVL6FmupddmeZL-tJBTF.2 2024-09-12T19:23:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.161__multipart_foo-STANDARD.2~H3ybYAjkoewmVL6FmupddmeZL-tJBTF.3 2024-09-12T19:23:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14673183789095390976', time=2024-09-12T20:24:30.698484+0000, chain.objs.size()=1 2024-09-12T19:23:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.189__shadow_.HO6KO0oGQQSyKXhWJhwY6fOjq4f6Qot_0 2024-09-12T19:23:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8123605516621187', time=2024-09-12T20:25:12.619018+0000, chain.objs.size()=1 2024-09-12T19:23:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.200__shadow_.RqbNfp_XbM62KWOSLq3pasDCMtFH3Wq_0 2024-09-12T19:23:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~cpsX2d10YHW2rMFy2PUQxcLaKbPsQ1Z', time=2024-09-12T20:25:21.334652+0000, chain.objs.size()=1 2024-09-12T19:23:00.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.202__multipart_mymultipart.2~cpsX2d10YHW2rMFy2PUQxcLaKbPsQ1Z.1 2024-09-12T19:23:00.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.658540404972282175', time=2024-09-12T20:29:07.128313+0000, chain.objs.size()=1 2024-09-12T19:23:00.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.238__shadow_.c2q0SSMzyLm4MFvPS-QDfMfTYs90U_i_0 2024-09-12T19:23:00.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10103393941128207382', time=2024-09-12T20:29:13.224903+0000, chain.objs.size()=1 2024-09-12T19:23:00.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.241__shadow_.b7Agu1YA2Yep7rgQrcK2s4rGWjmmaCc_0 2024-09-12T19:23:00.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15976203309390435217', time=2024-09-12T20:29:27.850333+0000, chain.objs.size()=1 2024-09-12T19:23:00.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.246__shadow_.v9YJ92651Q1BOveOPgvelnsblwShgC2_0 2024-09-12T19:23:00.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.186+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10315300599203889229', time=2024-09-12T20:29:32.477418+0000, chain.objs.size()=1 2024-09-12T19:23:00.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.186+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.248__shadow_.RgeLQDhOAFGQpVQlLa2BkFHcczhGKsx_0 2024-09-12T19:23:00.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.186+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4874831844039835733', time=2024-09-12T20:29:50.880542+0000, chain.objs.size()=1 2024-09-12T19:23:00.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.186+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.256__shadow_.Q7Kz6tzMZZuKGbu5x38Im22dQYuYem0_0 2024-09-12T19:23:00.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.186+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6847962838906169510', time=2024-09-12T20:29:53.070507+0000, chain.objs.size()=1 2024-09-12T19:23:00.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.186+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.257__shadow_.Q3NMRm8tsWmrG3iPuEVDysRBvkQaxFh_0 2024-09-12T19:23:00.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1422330855132735306', time=2024-09-12T20:30:02.151456+0000, chain.objs.size()=1 2024-09-12T19:23:00.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.261__shadow_.JeiK4VObNZNrou_qYf38VcULFOt7I0Z_0 2024-09-12T19:23:00.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3183191832699222377', time=2024-09-12T20:31:45.547170+0000, chain.objs.size()=1 2024-09-12T19:23:00.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_._LK8Xba6yKGJgaIyTcYeW3dHEyxNe-V_0 2024-09-12T19:23:00.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1091587981662119085', time=2024-09-12T20:31:46.109435+0000, chain.objs.size()=1 2024-09-12T19:23:00.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.OVAITKmpqZs2eZIin5N5PM5VvJ9U10O_0 2024-09-12T19:23:00.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16043942345683655899', time=2024-09-12T20:31:46.369571+0000, chain.objs.size()=1 2024-09-12T19:23:00.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.I91lQhtsCX8K-6TgLsFpgGQJGzxM_KY_0 2024-09-12T19:23:00.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13062591005353590429', time=2024-09-12T20:31:46.637007+0000, chain.objs.size()=1 2024-09-12T19:23:00.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.UrUGx5KtRBPOCHwBOawGk29MOLbToNV_0 2024-09-12T19:23:00.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17879846264137007515', time=2024-09-12T20:31:46.827237+0000, chain.objs.size()=1 2024-09-12T19:23:00.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.7lyYLT1sy2pl8UJeddPRoMaQzSNha9w_0 2024-09-12T19:23:00.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5549456900703519123', time=2024-09-12T20:31:50.052258+0000, chain.objs.size()=1 2024-09-12T19:23:00.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.8ekF18ctngRjOykYCHRvH4q5AbTSZyT_0 2024-09-12T19:23:00.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15309511536015692277', time=2024-09-12T20:31:53.211115+0000, chain.objs.size()=1 2024-09-12T19:23:00.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.er77eFZPeh5gbp3Lk_ozMeRokz0UDUC_0 2024-09-12T19:23:00.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3758414608168632105', time=2024-09-12T20:31:53.684379+0000, chain.objs.size()=1 2024-09-12T19:23:00.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.lN5bjbuw3zKz6rhErAybcS5rISO_IXl_0 2024-09-12T19:23:00.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13316428208929294981', time=2024-09-12T20:31:54.000816+0000, chain.objs.size()=1 2024-09-12T19:23:00.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.aev-YU1p4E-6NCGIp53sl1ULvEX8V5A_0 2024-09-12T19:23:00.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11162421235302363498', time=2024-09-12T20:31:54.386130+0000, chain.objs.size()=1 2024-09-12T19:23:00.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ZpXAwqe2Af5xm_3i9Ld2V6zbpzQiKNr_0 2024-09-12T19:23:00.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11673598192070329097', time=2024-09-12T20:31:54.634909+0000, chain.objs.size()=1 2024-09-12T19:23:00.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.EmdIPwmRPUhVMXVkj1eoRkF4zXiWHf8_0 2024-09-12T19:23:00.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6442092509668344123', time=2024-09-12T20:31:58.656445+0000, chain.objs.size()=1 2024-09-12T19:23:00.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.tQhPCVKpuyGqB9smuxNnQVu9aq3IyW9_0 2024-09-12T19:23:00.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12580244182038901776', time=2024-09-12T20:31:58.904453+0000, chain.objs.size()=1 2024-09-12T19:23:00.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.3fAjVGg4uNcKJtgqknrWGi9fg-ZXE9B_0 2024-09-12T19:23:00.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11720248043763641697', time=2024-09-12T20:32:01.091985+0000, chain.objs.size()=1 2024-09-12T19:23:00.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.GwEjLA-bZlveywtP0kB59KD-cWG0iXR_0 2024-09-12T19:23:00.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.274565809964534410', time=2024-09-12T20:32:02.588910+0000, chain.objs.size()=1 2024-09-12T19:23:00.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.NuOGUOWTbCHtZczYWghjSXKcVyerGia_0 2024-09-12T19:23:00.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15312083803468445119', time=2024-09-12T20:32:05.704579+0000, chain.objs.size()=1 2024-09-12T19:23:00.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.W8flnlyaMN5YadEGs0Xrgf7R-tPfvJ2_0 2024-09-12T19:23:00.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10683993205174568583', time=2024-09-12T20:32:09.191384+0000, chain.objs.size()=1 2024-09-12T19:23:00.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Sv1kYWp4mxk4bkI5LYEDKr0SpJ3kylT_0 2024-09-12T19:23:00.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8880745769909336941', time=2024-09-12T20:32:09.549555+0000, chain.objs.size()=1 2024-09-12T19:23:00.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.N2uFlRJV6H3VbE6HCFX3oppqazw0fVT_0 2024-09-12T19:23:00.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.210+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18139555047486649937', time=2024-09-12T20:32:09.972046+0000, chain.objs.size()=1 2024-09-12T19:23:00.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.210+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.JSIt_xrygqVzqN9SDkd9sIUIDEXiuCx_0 2024-09-12T19:23:00.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.210+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13474882326586281912', time=2024-09-12T20:32:10.394509+0000, chain.objs.size()=1 2024-09-12T19:23:00.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.210+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.wXZ_KNi8FA4229BP4P4Z30TTFM-_uO6_0 2024-09-12T19:23:00.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.214+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5767580351398475849', time=2024-09-12T20:32:11.875304+0000, chain.objs.size()=1 2024-09-12T19:23:00.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.214+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.sxBfOoHkjnJx2hgMe-5oIQF4xoTwSLZ_0 2024-09-12T19:23:00.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.218+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17505253694878919796', time=2024-09-12T20:32:12.615435+0000, chain.objs.size()=1 2024-09-12T19:23:00.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.218+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.bhGQd8kQ-q_noHTjBf-YHweiodZPwMG_0 2024-09-12T19:23:00.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.218+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8809910785292863037', time=2024-09-12T20:32:12.686863+0000, chain.objs.size()=1 2024-09-12T19:23:00.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.218+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.uTkYycNOpaPgT6OY4L9VhDkX5JFKSjX_0 2024-09-12T19:23:00.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.218+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11017349548041645710', time=2024-09-12T20:32:12.878739+0000, chain.objs.size()=1 2024-09-12T19:23:00.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.218+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.9HcvdcTw5LKCoM_1tHJDnGS43bgKJqs_0 2024-09-12T19:23:00.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.218+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11739045125967412576', time=2024-09-12T20:32:18.419935+0000, chain.objs.size()=1 2024-09-12T19:23:00.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.218+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.264__shadow_.QApv2cjY40jzh8SJ4koWO_EhQFPoTf1_0 2024-09-12T19:23:00.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.218+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14231693400274081700', time=2024-09-12T20:32:31.524957+0000, chain.objs.size()=1 2024-09-12T19:23:00.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.218+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.270__shadow_.qL6A4pMhJF1ZFsDnDjyFcdeB9m8Fj-d_0 2024-09-12T19:23:00.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.218+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7783039827893807749', time=2024-09-12T20:32:35.899373+0000, chain.objs.size()=1 2024-09-12T19:23:00.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.218+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.272__shadow_.E8khMUh5KoUrsr1mbkP5OmT4056PBCV_0 2024-09-12T19:23:00.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.218+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2332147827090405833', time=2024-09-12T20:33:00.993002+0000, chain.objs.size()=1 2024-09-12T19:23:00.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.218+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.283__shadow_.x9ckXT6H377gYhRkJC2biqpyXvlh7aW_0 2024-09-12T19:23:00.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.218+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.136497396561527756', time=2024-09-12T20:33:01.001597+0000, chain.objs.size()=1 2024-09-12T19:23:00.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.218+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.283__shadow_.PeL7H6lePpmSroEFt8Hwhh9ZG4jszTl_0 2024-09-12T19:23:00.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.218+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5660009266245529903', time=2024-09-12T20:33:10.468434+0000, chain.objs.size()=1 2024-09-12T19:23:00.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.218+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.287__shadow_.BWJBNmpolitoatuYzZgR2UKw1EAVUwA_0 2024-09-12T19:23:00.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.218+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10360196011747014489', time=2024-09-12T20:33:25.748871+0000, chain.objs.size()=1 2024-09-12T19:23:00.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.218+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.pJLYX5DECQOE3WIKUiZgiulbZUud1tI_0 2024-09-12T19:23:00.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.226+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11874245232537685367', time=2024-09-12T20:33:31.001823+0000, chain.objs.size()=1 2024-09-12T19:23:00.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.226+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.hz1DM-P7vmYJte9O219ma2Leyvt68c5_0 2024-09-12T19:23:00.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.226+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14830566108603722460', time=2024-09-12T20:34:42.361890+0000, chain.objs.size()=1 2024-09-12T19:23:00.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.226+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.321__shadow_.AzaPcaABNGcE93FmehMAQUqqfZbC1rD_0 2024-09-12T19:23:00.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5824406784681588030', time=2024-09-12T20:36:27.937118+0000, chain.objs.size()=1 2024-09-12T19:23:00.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Mm__fU4pwf3u1mjFSmHYTjSx09nS059_0 2024-09-12T19:23:00.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8729737994108556810', time=2024-09-12T20:36:28.944022+0000, chain.objs.size()=1 2024-09-12T19:23:00.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.nn1Vt_TS2H9eqqV0J4DbXovDhzgsUd5_0 2024-09-12T19:23:00.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2663301433645196899', time=2024-09-12T20:36:29.082703+0000, chain.objs.size()=1 2024-09-12T19:23:00.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.yFnNQra531M0Fd-HVlSsWEw26ExeMkb_0 2024-09-12T19:23:00.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9757232703751738632', time=2024-09-12T20:36:30.227608+0000, chain.objs.size()=1 2024-09-12T19:23:00.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.1-NOSKwMJXNB5PXqJucVYV-ZwHbgArI_0 2024-09-12T19:23:00.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1031900455000294668', time=2024-09-12T20:36:31.998388+0000, chain.objs.size()=1 2024-09-12T19:23:00.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.9BCZ3sC-N1Y13L426c2OaId9Df4m0nj_0 2024-09-12T19:23:00.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5775019125463086277', time=2024-09-12T20:36:32.306445+0000, chain.objs.size()=1 2024-09-12T19:23:00.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.RaXrmu7pJg3bOox08p8BXdxg7N1aila_0 2024-09-12T19:23:00.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18294793512997616167', time=2024-09-12T20:36:32.776131+0000, chain.objs.size()=1 2024-09-12T19:23:00.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.b12f6PCtgb-Qzw8MHBRNnyvCYGjlDml_0 2024-09-12T19:23:00.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6023507493825172637', time=2024-09-12T20:36:33.000508+0000, chain.objs.size()=1 2024-09-12T19:23:00.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.l_IR91mxXi62D49yeVUyRMRATS5Y1LE_0 2024-09-12T19:23:00.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.234+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9566458910435178887', time=2024-09-12T20:36:36.302687+0000, chain.objs.size()=1 2024-09-12T19:23:00.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.234+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.s04_u7Az21l_bFdSEKRUuuDaCMONZah_0 2024-09-12T19:23:00.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.234+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12364972749385742908', time=2024-09-12T20:36:37.171160+0000, chain.objs.size()=1 2024-09-12T19:23:00.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.234+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.cw5JdKIZAal4RuWXC9uUIAQQwSKfjRv_0 2024-09-12T19:23:00.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.234+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12916993186924355388', time=2024-09-12T20:36:37.878224+0000, chain.objs.size()=1 2024-09-12T19:23:00.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.234+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.x5XoxzDLf1p39LT1akOBIxwbGUsh8Ba_0 2024-09-12T19:23:00.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.238+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11282692661757646309', time=2024-09-12T20:36:39.862435+0000, chain.objs.size()=1 2024-09-12T19:23:00.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.238+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.nYty_3GNQ2wKvAiiULxELMNCMvRSGBm_0 2024-09-12T19:23:00.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.238+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12653175326815180257', time=2024-09-12T20:36:40.174064+0000, chain.objs.size()=1 2024-09-12T19:23:00.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.238+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.DxtLqyS715VI7pBY_hqeFJk7BKNifbX_0 2024-09-12T19:23:00.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2405400540732033793', time=2024-09-12T20:36:40.293008+0000, chain.objs.size()=1 2024-09-12T19:23:00.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.xDN1AgksKUV7S_DJXjBq6XZ-ZU066p8_0 2024-09-12T19:23:00.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16902942230581196165', time=2024-09-12T20:36:41.265317+0000, chain.objs.size()=1 2024-09-12T19:23:00.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.8tSkuJeQHPdG9WVHzPgB47lYKkH9gRR_0 2024-09-12T19:23:00.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11447628747537345012', time=2024-09-12T20:36:41.428138+0000, chain.objs.size()=1 2024-09-12T19:23:00.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.6HfNHydH5wr0G_SbJHQP5-0T77M3IPC_0 2024-09-12T19:23:00.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15579056925863385332', time=2024-09-12T20:36:41.726250+0000, chain.objs.size()=1 2024-09-12T19:23:00.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.8amgzEk9KWRn57oZuiuYcLwWhNGlSHr_0 2024-09-12T19:23:00.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4429121505158072198', time=2024-09-12T20:36:44.127366+0000, chain.objs.size()=1 2024-09-12T19:23:00.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.kXzTgAb7gPHYkJny5kBHtqNn3FjneAh_0 2024-09-12T19:23:00.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7605020658248535350', time=2024-09-12T20:36:45.610255+0000, chain.objs.size()=1 2024-09-12T19:23:00.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.faoJoluVWRYPt0B6rtxV73_QexKd0fh_0 2024-09-12T19:23:00.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7843528159622106737', time=2024-09-12T20:36:46.146843+0000, chain.objs.size()=1 2024-09-12T19:23:00.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.63BRFwF62L7lGoElhuYTdu2xtAXRpOI_0 2024-09-12T19:23:00.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7749261363766413011', time=2024-09-12T20:36:47.416184+0000, chain.objs.size()=1 2024-09-12T19:23:00.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.DDjlVpxu1mV18ELCKVW5auSS60SwcA0_0 2024-09-12T19:23:00.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.246+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6364722417030432156', time=2024-09-12T20:36:47.955108+0000, chain.objs.size()=1 2024-09-12T19:23:00.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.246+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Vy7w-08Ak7N0jHeeUkSaTXQTn5vn2EO_0 2024-09-12T19:23:00.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.246+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10699708864748133526', time=2024-09-12T20:36:49.469958+0000, chain.objs.size()=1 2024-09-12T19:23:00.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.246+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.N90JFXFb-4fX4byKpr4Psk4m75RWsGh_0 2024-09-12T19:23:00.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.246+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16670476221364904461', time=2024-09-12T20:36:49.693972+0000, chain.objs.size()=1 2024-09-12T19:23:00.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.246+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.awbJF0YTBBGyIrmUo2Y9dvu2ppPMaeB_0 2024-09-12T19:23:00.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.246+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13577067600862793106', time=2024-09-12T20:36:50.569198+0000, chain.objs.size()=1 2024-09-12T19:23:00.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.246+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.tVbcLVO5i_Re9rCBCRRk-d7uiXhQhlh_0 2024-09-12T19:23:00.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.246+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13282856626405557257', time=2024-09-12T20:36:50.572855+0000, chain.objs.size()=1 2024-09-12T19:23:00.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.246+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.EstLVRWwGH1Fl0Dnh703x5Cj8ZBxz5l_0 2024-09-12T19:23:00.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4334230379380646888', time=2024-09-12T20:36:50.579599+0000, chain.objs.size()=1 2024-09-12T19:23:00.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.AZUCwHN24gSkIh-LNxWiYB8VFmMtsxE_0 2024-09-12T19:23:00.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7804162150573206074', time=2024-09-12T20:36:51.121051+0000, chain.objs.size()=1 2024-09-12T19:23:00.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.NECQp2wYYy5rz7L9G2AUCyoEbDvlKlZ_0 2024-09-12T19:23:00.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5687447503722612228', time=2024-09-12T20:36:51.560479+0000, chain.objs.size()=1 2024-09-12T19:23:00.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.l7elAbE47adyZSdTqsD9gtSa8MYnJ1o_0 2024-09-12T19:23:00.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14094732268169715412', time=2024-09-12T20:36:51.564400+0000, chain.objs.size()=1 2024-09-12T19:23:00.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.oTh9h-4vQg9V5OEN1qIQCiMA3KXFBSh_0 2024-09-12T19:23:00.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13060549668732867295', time=2024-09-12T20:36:51.641338+0000, chain.objs.size()=1 2024-09-12T19:23:00.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.BJFyYIkRzn6o4wh4O_YxgAqPxgJ3IAy_0 2024-09-12T19:23:00.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.254+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8735767466705801052', time=2024-09-12T20:36:52.213851+0000, chain.objs.size()=1 2024-09-12T19:23:00.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.254+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.E81R-Jl0azeexQPnBgVKf7TcO7pgjzQ_0 2024-09-12T19:23:00.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.254+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9856072496594842557', time=2024-09-12T20:36:52.751194+0000, chain.objs.size()=1 2024-09-12T19:23:00.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.254+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.WqtakMh3VWSN7Yeg0_e1jScwzZnqaA3_0 2024-09-12T19:23:00.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.254+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13986922509816406240', time=2024-09-12T20:36:53.249642+0000, chain.objs.size()=1 2024-09-12T19:23:00.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.254+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.UAiuGUhMiPh67XbYuZIaS5apTaH1yRg_0 2024-09-12T19:23:00.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12887556814093146124', time=2024-09-12T20:36:54.438536+0000, chain.objs.size()=1 2024-09-12T19:23:00.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.PZkNG53rvu_88WlgyrjPqKNOuVWT7JJ_0 2024-09-12T19:23:00.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6483370698218223141', time=2024-09-12T20:38:39.754259+0000, chain.objs.size()=1 2024-09-12T19:23:00.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.nRs4tgb1bOjaoqzyNaFMPFj_Ql6jEbp_0 2024-09-12T19:23:00.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3022379248439599184', time=2024-09-12T20:38:41.785953+0000, chain.objs.size()=1 2024-09-12T19:23:00.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.EcNR32KbhjkJB_SzPlphfYGw0_Ad7jg_0 2024-09-12T19:23:00.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8358285867235624826', time=2024-09-12T20:38:41.842699+0000, chain.objs.size()=1 2024-09-12T19:23:00.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.kfg2GzqlJKR9xxTpmeiCREEWkIR1n1i_0 2024-09-12T19:23:00.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11746785969593259243', time=2024-09-12T20:38:41.908116+0000, chain.objs.size()=1 2024-09-12T19:23:00.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.MDFKADp3REiHJ4srU9mF3QnkJd06SHQ_0 2024-09-12T19:23:00.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9417737531121849144', time=2024-09-12T20:38:42.075982+0000, chain.objs.size()=1 2024-09-12T19:23:00.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Puh-gDxZME8Fd8pkgDFlkqK6gr3KmnO_0 2024-09-12T19:23:00.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.238700699104341885', time=2024-09-12T20:38:42.572265+0000, chain.objs.size()=1 2024-09-12T19:23:00.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.PUmYz_6n5xo7RDhrKQqro4pL8PH3pOF_0 2024-09-12T19:23:00.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4421967951366143771', time=2024-09-12T20:38:43.681453+0000, chain.objs.size()=1 2024-09-12T19:23:00.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.zo6aC8lcZcPX35c6WtyjJnWVmc4EnlB_0 2024-09-12T19:23:00.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.262+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9892107131140811708', time=2024-09-12T20:38:43.783905+0000, chain.objs.size()=1 2024-09-12T19:23:00.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.262+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.O70HS6rpRD5hhAgqRanwoHdKNRiFD1v_0 2024-09-12T19:23:00.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.262+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7686935317115360249', time=2024-09-12T20:38:44.150421+0000, chain.objs.size()=1 2024-09-12T19:23:00.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.262+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ddLK9u1-FiL6wnvTsGWiTRTAtFl7f1V_0 2024-09-12T19:23:00.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.262+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4892396879463631046', time=2024-09-12T20:38:44.260780+0000, chain.objs.size()=1 2024-09-12T19:23:00.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.262+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.EHS1Q-HNM55uEjTdqXt_IVfM4DVKJCy_0 2024-09-12T19:23:00.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.262+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4260598004838915346', time=2024-09-12T20:38:44.775965+0000, chain.objs.size()=1 2024-09-12T19:23:00.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.262+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.NfBEro8y79uvid2nulG1fUgXbF-ucni_0 2024-09-12T19:23:00.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.266+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14159810508451491974', time=2024-09-12T20:38:44.779760+0000, chain.objs.size()=1 2024-09-12T19:23:00.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.266+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.UAtqQERjPf4BXEs6dRPEBSeGkzjzA-5_0 2024-09-12T19:23:00.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.266+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7082831871064513126', time=2024-09-12T20:38:46.538954+0000, chain.objs.size()=1 2024-09-12T19:23:00.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.266+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ARoD7Bd_40AYSDLqpD_T_08q8Cn0uMG_0 2024-09-12T19:23:00.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.266+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11661696495449027891', time=2024-09-12T20:38:48.195222+0000, chain.objs.size()=1 2024-09-12T19:23:00.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.266+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.VBsnsJXyM-8m0WPgh7xfnfIhNS4RQ9S_0 2024-09-12T19:23:00.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.266+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1579963910351474517', time=2024-09-12T20:38:51.324683+0000, chain.objs.size()=1 2024-09-12T19:23:00.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.266+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.CQcZWtNVVHT0T2gNkwcXmePWr8CchWY_0 2024-09-12T19:23:00.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.266+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15434971295648219707', time=2024-09-12T20:38:52.180706+0000, chain.objs.size()=1 2024-09-12T19:23:00.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.266+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.QywLi25m3GpQiNOE7nKmk7q9nT_Kuuj_0 2024-09-12T19:23:00.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.266+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15911508357137027354', time=2024-09-12T20:38:55.045970+0000, chain.objs.size()=1 2024-09-12T19:23:00.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.266+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.aHa6YINuFyjbJncifpVOfiqH4PxD7z4_0 2024-09-12T19:23:00.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.266+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.419844793296513447', time=2024-09-12T20:38:55.054228+0000, chain.objs.size()=1 2024-09-12T19:23:00.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.266+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.5KZHLJsBQycJkDySx8hCsGolezdOFT5_0 2024-09-12T19:23:00.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.266+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11137373676934729241', time=2024-09-12T20:38:55.055680+0000, chain.objs.size()=1 2024-09-12T19:23:00.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.270+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.mrZ9VZFt2Jy7uG-tEUkfcLsc7LvNmHn_0 2024-09-12T19:23:00.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.274+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/59759 2024-09-12T19:23:00.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-12T19:23:00.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.311887435089552326', time=2024-09-12T20:38:55.818463+0000, chain.objs.size()=1 2024-09-12T19:23:00.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.jQVQddPFiLPkVwbyuxHDqoMw2Pn2Lhj_0 2024-09-12T19:23:00.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14124241514281279972', time=2024-09-12T20:38:55.820787+0000, chain.objs.size()=1 2024-09-12T19:23:00.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.mkezNpbQPGS1yyXin_BTgedd_4c87Nk_0 2024-09-12T19:23:00.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11488374929357450563', time=2024-09-12T20:38:56.905999+0000, chain.objs.size()=1 2024-09-12T19:23:00.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.dOhAP5HB1Nn4i6ti89scp5mVFYjBdN5_0 2024-09-12T19:23:00.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6943033212251422630', time=2024-09-12T20:38:58.665462+0000, chain.objs.size()=1 2024-09-12T19:23:00.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.3MW6wkk9kaDNN0RHtnmotoXCr-0PCeZ_0 2024-09-12T19:23:00.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7324001957317405982', time=2024-09-12T20:38:59.830330+0000, chain.objs.size()=1 2024-09-12T19:23:00.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.H2eCZRhsOQlqPA6kQPYw6o5_fcYQFfP_0 2024-09-12T19:23:00.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8353003267378461707', time=2024-09-12T20:39:00.197938+0000, chain.objs.size()=1 2024-09-12T19:23:00.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.CPT_ATHsK1gArNXE0Q2fCwW1BfXhfeR_0 2024-09-12T19:23:00.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6508730531069246293', time=2024-09-12T20:39:00.767916+0000, chain.objs.size()=1 2024-09-12T19:23:00.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ersAPMAKfj5GFqPqc_VBMiHY7zm-o_K_0 2024-09-12T19:23:00.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7080413405446720497', time=2024-09-12T20:39:01.453786+0000, chain.objs.size()=1 2024-09-12T19:23:00.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.yVDKJd1PQg6EpP_8AS5NwIHQUqvKAwZ_0 2024-09-12T19:23:00.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5875926926882556402', time=2024-09-12T20:39:03.404286+0000, chain.objs.size()=1 2024-09-12T19:23:00.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.PGWYRhA-F4PNe9ki0dkUaezAjRAyymL_0 2024-09-12T19:23:00.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6710076971631686474', time=2024-09-12T20:39:04.194443+0000, chain.objs.size()=1 2024-09-12T19:23:00.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.rTvxBEBgisWopMhHBBbeDKVeA9Il8qm_0 2024-09-12T19:23:00.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17292284500824036291', time=2024-09-12T20:39:04.729041+0000, chain.objs.size()=1 2024-09-12T19:23:00.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.hGjLwgUqn31R8FHvozOR84bxDva7aaR_0 2024-09-12T19:23:00.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13575880411072296610', time=2024-09-12T20:39:05.010323+0000, chain.objs.size()=1 2024-09-12T19:23:00.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-nscnoc2Yk2todF4lGzfA9wQhviKAQ1_0 2024-09-12T19:23:00.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.282+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13147627661724180246', time=2024-09-12T20:39:06.567996+0000, chain.objs.size()=1 2024-09-12T19:23:00.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.282+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.NtvG0lyisos_jCv1mwm6WxtVQYAgefG_0 2024-09-12T19:23:00.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.282+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4340303394697076158', time=2024-09-12T20:39:07.411058+0000, chain.objs.size()=1 2024-09-12T19:23:00.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.282+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.s7tc-sV3kB_0fGFNb15q-eHxc_MZ_6l_0 2024-09-12T19:23:00.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.282+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.295904738129640933', time=2024-09-12T20:39:07.819440+0000, chain.objs.size()=1 2024-09-12T19:23:00.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.282+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.odcussYb5u5nFJNlMXjN7J6QI2AZ4k6_0 2024-09-12T19:23:00.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.282+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16504640745215435316', time=2024-09-12T20:39:23.872784+0000, chain.objs.size()=1 2024-09-12T19:23:00.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.282+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.332__shadow_.SQiYIqO3Xol9HbTmneDRdj6EE08_TaD_0 2024-09-12T19:23:00.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.286+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2253694077806336953', time=2024-09-12T20:44:27.969847+0000, chain.objs.size()=1 2024-09-12T19:23:00.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.286+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.481__shadow_.fi9xIQ97Sd6CH84A00q2v7_MlGhKfU4_0 2024-09-12T19:23:00.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.286+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.885973115511515883', time=2024-09-12T20:44:58.479085+0000, chain.objs.size()=1 2024-09-12T19:23:00.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.286+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.491__shadow_.XC73dW9RmPpK69cfIhJ6_xLP0wTpX3g_0 2024-09-12T19:23:00.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.286+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6912537593411722510', time=2024-09-12T20:45:22.295310+0000, chain.objs.size()=1 2024-09-12T19:23:00.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.286+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.503__shadow:tE2u4PreZ1ptztujaTdnj2An4nygGJX_.ADvFvlMdDhiFGZmRgRvM9GmBz7MDjzE_0 2024-09-12T19:23:00.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.286+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14455088470656368550', time=2024-09-12T20:46:48.124311+0000, chain.objs.size()=1 2024-09-12T19:23:00.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.286+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.517__shadow_._1Rv7Ri289V9Sq8SSTuz9UGOcOAeQrg_0 2024-09-12T19:23:00.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.286+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4412746434095358657', time=2024-09-12T20:52:03.904070+0000, chain.objs.size()=3 2024-09-12T19:23:00.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.286+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.523__multipart_mymultipart.2~GvMPiGatES-CEw3Nw7JAOCES9e31SHd.1 2024-09-12T19:23:00.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.286+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.523__multipart_mymultipart.2~GvMPiGatES-CEw3Nw7JAOCES9e31SHd.2 2024-09-12T19:23:00.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.286+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.523__multipart_mymultipart.2~GvMPiGatES-CEw3Nw7JAOCES9e31SHd.3 2024-09-12T19:23:00.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.290+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8674391837182799271', time=2024-09-12T20:52:04.362128+0000, chain.objs.size()=2 2024-09-12T19:23:00.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.290+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.523__multipart_mymultipart.2~sqY9tp429kVa6jYCimcxGI0Z0A_CQoO.1 2024-09-12T19:23:00.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.290+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.523__multipart_mymultipart.2~sqY9tp429kVa6jYCimcxGI0Z0A_CQoO.2 2024-09-12T19:23:00.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.290+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9205581904728615582', time=2024-09-12T20:57:42.960329+0000, chain.objs.size()=1 2024-09-12T19:23:00.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.290+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.576__shadow:rbPBD-MLgqzfCRovsHj40Me80OHbtn8_.oI1plxICR5Qm2q6wYkqH49rgqV3Qbi3_0 2024-09-12T19:23:00.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.290+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1697109256904631257', time=2024-09-12T20:57:57.055323+0000, chain.objs.size()=1 2024-09-12T19:23:00.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.290+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:P3REUe24Om-7f5QxANPZ5CrAsb.6gAJ_.tbMX0vUjj3fHRXeXyap4_F8J3ctvGB4_0 2024-09-12T19:23:00.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.290+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3267884111602151402', time=2024-09-12T20:59:34.867361+0000, chain.objs.size()=1 2024-09-12T19:23:00.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.290+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.580__shadow:5sC2Adaitf0usoMb8hLTKYcZQiru7s9_.OxurRxCCCxu-05c_B6XfK8BrquQ6HF2_0 2024-09-12T19:23:00.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.290+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11610194256959336180', time=2024-09-12T20:59:35.769217+0000, chain.objs.size()=1 2024-09-12T19:23:00.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.290+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.580__shadow:wEWrzO73pA5IgZwDnEbm0JuTeUX0ASu_.MO7S4CRxEG2GOQtjqOJicjRzNwnoSGc_0 2024-09-12T19:23:00.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.290+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8862661260568428675', time=2024-09-12T20:59:54.137098+0000, chain.objs.size()=1 2024-09-12T19:23:00.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.290+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.587__shadow:7pNSVPoTRt4Tbm9ELKTPyiNn8o-bp32_.hzzyprHPxUWuQkMbnVXabsvWN8JlroI_0 2024-09-12T19:23:00.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.290+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.177325823353999107', time=2024-09-12T21:07:34.310416+0000, chain.objs.size()=1 2024-09-12T19:23:00.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.290+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.642__shadow_.gRNeCGL0p2flCkw37WTITG9TlEU_oHG_0 2024-09-12T19:23:00.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.290+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5579248042757081246', time=2024-09-12T21:10:40.188085+0000, chain.objs.size()=1 2024-09-12T19:23:00.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.290+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.696__shadow:hci1IF3I6CgNnhwQVkeMD6xHs8fJU1u_.84TsAVyYGf2-xkVKkWQkdK9wzC0ng5R_0 2024-09-12T19:23:00.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.298+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:00.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T19:23:00.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:00.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:00.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43206' 2024-09-12T19:23:00.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8670738391299395472', time=2024-09-12T20:22:30.266252+0000, chain.objs.size()=2 2024-09-12T19:23:00.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.160__shadow_.9_G9pY6YPVAfzFY3fpl5waA5ObEZilt_0 2024-09-12T19:23:00.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.160__shadow_.9_G9pY6YPVAfzFY3fpl5waA5ObEZilt_1 2024-09-12T19:23:00.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7106735378630767557', time=2024-09-12T20:28:52.495495+0000, chain.objs.size()=1 2024-09-12T19:23:00.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.233__shadow_.0NLyLpzOP2pBXBa0FGVCLGmmJlI-ewv_0 2024-09-12T19:23:00.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4921540721930599491', time=2024-09-12T20:29:03.300655+0000, chain.objs.size()=1 2024-09-12T19:23:00.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.237__shadow_.3R8_3tBm79oYFea-QOzP55CAJsl_fXA_0 2024-09-12T19:23:00.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3033279198377038609', time=2024-09-12T20:29:32.472457+0000, chain.objs.size()=1 2024-09-12T19:23:00.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.248__shadow_._sfUzKFHJRBDj73Km5d24S7GcFFupps_0 2024-09-12T19:23:00.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6405969050208654792', time=2024-09-12T20:29:39.407425+0000, chain.objs.size()=1 2024-09-12T19:23:00.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.251__shadow_.DggtzF0KpJZeGaRbojvpjZnlF2vTrYW_0 2024-09-12T19:23:00.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10819497567461538767', time=2024-09-12T20:31:45.848829+0000, chain.objs.size()=1 2024-09-12T19:23:00.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.vL387ayzYcbqaIGjHjtUy8CZ2t0kBoP_0 2024-09-12T19:23:00.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8923617833295516589', time=2024-09-12T20:31:45.993530+0000, chain.objs.size()=1 2024-09-12T19:23:00.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.0OnxZZzw7keptFDZIWLQd-JA_x4Bg9c_0 2024-09-12T19:23:00.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17947237207786783715', time=2024-09-12T20:31:47.356704+0000, chain.objs.size()=1 2024-09-12T19:23:00.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.tCN_BnsMhNvU12MOwd1eZB0zBTfR0aW_0 2024-09-12T19:23:00.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6756584441897447915', time=2024-09-12T20:31:47.489394+0000, chain.objs.size()=1 2024-09-12T19:23:00.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.z5pe_OQUSjaHs2xg4-Ffof8iwQW-R2V_0 2024-09-12T19:23:00.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6503325407721237712', time=2024-09-12T20:31:50.085979+0000, chain.objs.size()=1 2024-09-12T19:23:00.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.I8c4l67YfdGXLPGw5pZOGWPcRnT8tH1_0 2024-09-12T19:23:00.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17843673302644376081', time=2024-09-12T20:31:50.720826+0000, chain.objs.size()=1 2024-09-12T19:23:00.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.A_C8J12rU-SUFSnvk1n4t0oqGP0PL2-_0 2024-09-12T19:23:00.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15145139164809938780', time=2024-09-12T20:31:53.896968+0000, chain.objs.size()=1 2024-09-12T19:23:00.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.RIjLaXczOi1YHK4ABZ6cETb1x8ldvfV_0 2024-09-12T19:23:00.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3764355608042196847', time=2024-09-12T20:31:53.968037+0000, chain.objs.size()=1 2024-09-12T19:23:00.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ZgfrJvNGKjiTcqBoJ0sYEu0dmeR2d1K_0 2024-09-12T19:23:00.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13039320376908387781', time=2024-09-12T20:31:55.820747+0000, chain.objs.size()=1 2024-09-12T19:23:00.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.aPmoRhdxYt1SBCamWpLXwl3UUOI7s58_0 2024-09-12T19:23:00.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14626804339921634677', time=2024-09-12T20:31:55.953120+0000, chain.objs.size()=1 2024-09-12T19:23:00.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Z-IwOQ8xp7MHKITa6FaFj_0JGROSWuE_0 2024-09-12T19:23:00.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.280480569530080751', time=2024-09-12T20:31:56.922773+0000, chain.objs.size()=1 2024-09-12T19:23:00.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.QIVX-ufx7jlOowonTOVKwHa1cG8mnjU_0 2024-09-12T19:23:00.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9368628428482123733', time=2024-09-12T20:31:57.286673+0000, chain.objs.size()=1 2024-09-12T19:23:00.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.JyX_7UJpVSHzYLyf2Y0ko0NDPLRbQNk_0 2024-09-12T19:23:00.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.751598014190322520', time=2024-09-12T20:31:57.720410+0000, chain.objs.size()=1 2024-09-12T19:23:00.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.qqJNkHebdto6ErFD1sNZw2jVes0cyqQ_0 2024-09-12T19:23:00.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2778805226556978697', time=2024-09-12T20:31:57.722341+0000, chain.objs.size()=1 2024-09-12T19:23:00.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.npKt7FfJhH4ZCXNQxP29pZG_ycSzKXm_0 2024-09-12T19:23:00.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15893437293296455321', time=2024-09-12T20:31:58.916553+0000, chain.objs.size()=1 2024-09-12T19:23:00.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.y136kwXnUuku1Wjkr3u9rO9l1S-CM6r_0 2024-09-12T19:23:00.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7206998710869241058', time=2024-09-12T20:31:59.140680+0000, chain.objs.size()=1 2024-09-12T19:23:00.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.sbGDkLZuespS244HbuIuRcF5jEJU_2p_0 2024-09-12T19:23:00.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15026097732124198467', time=2024-09-12T20:31:59.628968+0000, chain.objs.size()=1 2024-09-12T19:23:00.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.rEPOpUR8UDDUzgd89Q9hJkdRMQYeV-3_0 2024-09-12T19:23:00.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.318+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17829733999610621796', time=2024-09-12T20:32:00.670176+0000, chain.objs.size()=1 2024-09-12T19:23:00.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.318+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ZWS63NOJ008-FlYhv1HjhBFiUn0JPgF_0 2024-09-12T19:23:00.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.318+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11296447288342427600', time=2024-09-12T20:32:00.860512+0000, chain.objs.size()=1 2024-09-12T19:23:00.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.318+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.NvURTqSImIApD_wEqYfD71LAgcDbGK__0 2024-09-12T19:23:00.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.318+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3628987244811414700', time=2024-09-12T20:32:01.696940+0000, chain.objs.size()=1 2024-09-12T19:23:00.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.318+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.vgMqsgRTBbhD4WcikId77v2dpF77dAa_0 2024-09-12T19:23:00.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15188999308187114123', time=2024-09-12T20:32:01.909572+0000, chain.objs.size()=1 2024-09-12T19:23:00.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.NgSsiiAzRY2iiFCBCVnuVb-0Jxg13D9_0 2024-09-12T19:23:00.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15262233089464748435', time=2024-09-12T20:32:01.981171+0000, chain.objs.size()=1 2024-09-12T19:23:00.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.E43Ceee5ZwW25YCw9mPgSCFHVbU1t_Z_0 2024-09-12T19:23:00.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5212567406338430251', time=2024-09-12T20:32:02.678157+0000, chain.objs.size()=1 2024-09-12T19:23:00.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.arhrATz-FQj85Gz7BpW4b9g6FqG6UO2_0 2024-09-12T19:23:00.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6593472299120114703', time=2024-09-12T20:32:02.735170+0000, chain.objs.size()=1 2024-09-12T19:23:00.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.5b36TCYCRv4qJIXOqLZG5U8dD1lE_Ua_0 2024-09-12T19:23:00.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11869366910378352181', time=2024-09-12T20:32:02.971929+0000, chain.objs.size()=1 2024-09-12T19:23:00.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.OnDhaUgvXwtSFUFgKkFRR5Pd3EemZK8_0 2024-09-12T19:23:00.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7493778878488547109', time=2024-09-12T20:32:03.546105+0000, chain.objs.size()=1 2024-09-12T19:23:00.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.0VyNmvY-TO1Ali3pcrCmEo5KS3aLbYD_0 2024-09-12T19:23:00.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16725960982264916332', time=2024-09-12T20:32:04.888845+0000, chain.objs.size()=1 2024-09-12T19:23:00.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.KuOupsq2tZ57ghAg8XjtOIMCabgAAEV_0 2024-09-12T19:23:00.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9445174271791115728', time=2024-09-12T20:32:04.891431+0000, chain.objs.size()=1 2024-09-12T19:23:00.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.yscM1zF9Vq1PG7OpTa9VJ5CLB7d-nlQ_0 2024-09-12T19:23:00.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.326+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10450183141997174192', time=2024-09-12T20:32:05.365793+0000, chain.objs.size()=1 2024-09-12T19:23:00.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.326+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.w7AQHPtw9fIK12AUBJq58Enri9QmF_F_0 2024-09-12T19:23:00.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.326+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4057422602565567819', time=2024-09-12T20:32:06.388552+0000, chain.objs.size()=1 2024-09-12T19:23:00.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.326+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.a0mlRVSBMGCaa0RiH_G_7gGWJ9bfEgA_0 2024-09-12T19:23:00.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.326+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15724895640155969260', time=2024-09-12T20:32:06.491400+0000, chain.objs.size()=1 2024-09-12T19:23:00.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.326+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.l8FhQ8IlFzd3nqsA91GZfsFer8dITlE_0 2024-09-12T19:23:00.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.326+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.520098798940519569', time=2024-09-12T20:32:06.804618+0000, chain.objs.size()=1 2024-09-12T19:23:00.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.326+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.LuYmW49uk-KqVrf3jS0A-X19epabhiR_0 2024-09-12T19:23:00.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.326+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10623495641341822148', time=2024-09-12T20:32:06.806909+0000, chain.objs.size()=1 2024-09-12T19:23:00.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.326+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.v1Q1xqdktYYne3wnqolUH65dRHtM6Q6_0 2024-09-12T19:23:00.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.326+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2559892547970489523', time=2024-09-12T20:32:08.136153+0000, chain.objs.size()=1 2024-09-12T19:23:00.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.326+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.2_AxxhJVzPEDUvI-39aNvWnlsClvsM3_0 2024-09-12T19:23:00.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.330+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1161721560418085976', time=2024-09-12T20:32:08.986722+0000, chain.objs.size()=1 2024-09-12T19:23:00.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.330+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.QNgI2RCx69YjiWeKdc11CcOakYbgtYB_0 2024-09-12T19:23:00.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.330+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9208686554723704360', time=2024-09-12T20:32:09.280947+0000, chain.objs.size()=1 2024-09-12T19:23:00.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.330+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.PNh-4zVcDPQvhfEXDxQYAwkwiQDN0W1_0 2024-09-12T19:23:00.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.330+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16888948874961039870', time=2024-09-12T20:32:09.334878+0000, chain.objs.size()=1 2024-09-12T19:23:00.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.330+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.JLgQZhGF9RlcAUB7Y-ene9T9fuIrWFl_0 2024-09-12T19:23:00.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.330+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14796606975263200026', time=2024-09-12T20:32:09.729557+0000, chain.objs.size()=1 2024-09-12T19:23:00.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.330+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.gLkCQcb3oZ-3e8wWkQdxa0r7ddq8-Kh_0 2024-09-12T19:23:00.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.330+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10379834967815906305', time=2024-09-12T20:32:10.560584+0000, chain.objs.size()=1 2024-09-12T19:23:00.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.330+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.vTzmEmIuSPiCpRumvA0yZa5-QZJnkZm_0 2024-09-12T19:23:00.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.330+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17445529130276799294', time=2024-09-12T20:32:11.756501+0000, chain.objs.size()=1 2024-09-12T19:23:00.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.330+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.qLAi3yS5pMcHzpSLTfmC2-IWbqELZh5_0 2024-09-12T19:23:00.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.330+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14833869492585749570', time=2024-09-12T20:32:12.095155+0000, chain.objs.size()=1 2024-09-12T19:23:00.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.330+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.zSpwQUzkOmN4-cw4vD7ffMQ0e-rZepo_0 2024-09-12T19:23:00.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.334+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3782128641769884734', time=2024-09-12T20:32:12.152105+0000, chain.objs.size()=1 2024-09-12T19:23:00.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.334+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.FrTvx8UooACfdnbz48rxUI_cuRrj0oT_0 2024-09-12T19:23:00.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.334+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16090244617986115478', time=2024-09-12T20:32:12.351795+0000, chain.objs.size()=1 2024-09-12T19:23:00.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.334+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Qq7cAq6roV_cOOhyG2QkCqVzwFstXW-_0 2024-09-12T19:23:00.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.334+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5288509205014969700', time=2024-09-12T20:32:12.486119+0000, chain.objs.size()=1 2024-09-12T19:23:00.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.334+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.TeWaMN03kn350c9hnoTKbSGmoOXu7tN_0 2024-09-12T19:23:00.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.334+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3945830191816599650', time=2024-09-12T20:32:12.621174+0000, chain.objs.size()=1 2024-09-12T19:23:00.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.334+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.n-nNI_OKXHzhJoKtxdyVF_s13j0hgjy_0 2024-09-12T19:23:00.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.334+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11769932835439838242', time=2024-09-12T20:32:13.624680+0000, chain.objs.size()=1 2024-09-12T19:23:00.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.334+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.-Y1maoAsQ9ijml0GnZa5zVck8QUH0Ba_0 2024-09-12T19:23:00.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.334+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1770166404122489060', time=2024-09-12T20:32:13.810676+0000, chain.objs.size()=1 2024-09-12T19:23:00.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.334+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.6eui6ocqghmUgYOIDBMpBwiX3uZesru_0 2024-09-12T19:23:00.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.334+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9379855893713666994', time=2024-09-12T20:32:16.201113+0000, chain.objs.size()=1 2024-09-12T19:23:00.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.334+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.263__shadow_._hUkGrD7g_n-v-YSiDZKww3WEzD5nja_0 2024-09-12T19:23:00.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.334+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6497518830638528505', time=2024-09-12T20:32:27.173287+0000, chain.objs.size()=1 2024-09-12T19:23:00.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.334+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.268__shadow_.cmH4kT9KbStUQKRZL897rEIsHg3jSoc_0 2024-09-12T19:23:00.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18403584329015422918', time=2024-09-12T20:32:56.456978+0000, chain.objs.size()=1 2024-09-12T19:23:00.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.338+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.281__shadow_.neq5PwYs9K7LTdooaPptEDbtDI-XBB8_0 2024-09-12T19:23:00.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17444665923142144643', time=2024-09-12T20:33:25.448163+0000, chain.objs.size()=1 2024-09-12T19:23:00.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.338+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.yWQrYvW1_rq7RzPSZY1q8qElesafzS-_0 2024-09-12T19:23:00.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12592990310198397054', time=2024-09-12T20:33:31.323417+0000, chain.objs.size()=1 2024-09-12T19:23:00.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.338+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.HseeyJjoD9q341MpXwn9jgbM9Dvpq3X_0 2024-09-12T19:23:00.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17635940032524292934', time=2024-09-12T20:33:31.325893+0000, chain.objs.size()=1 2024-09-12T19:23:00.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.d4H-xn52_pq6hZHLMoGjvv0kt8DIFDX_0 2024-09-12T19:23:00.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18253169158112199008', time=2024-09-12T20:33:36.192610+0000, chain.objs.size()=1 2024-09-12T19:23:00.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.295__shadow_.wUy4RMdQOfSE9C3K-u3pWm3cA7FAhh7_0 2024-09-12T19:23:00.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.290500974149419101', time=2024-09-12T20:33:50.310393+0000, chain.objs.size()=1 2024-09-12T19:23:00.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.301__shadow_.2PDaINSO1acRV_7T1y8xB5cHEsFEtcK_0 2024-09-12T19:23:00.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6094052958873057634', time=2024-09-12T20:33:57.223971+0000, chain.objs.size()=1 2024-09-12T19:23:00.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.304__shadow_.2SbJ8MkPzYSrJ0HPL7MA1jwWXSXXoUa_0 2024-09-12T19:23:00.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10325545389703076996', time=2024-09-12T20:36:28.275473+0000, chain.objs.size()=1 2024-09-12T19:23:00.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.I60DTZ9EAUg-nwg1dweyUX_fCYVm4wx_0 2024-09-12T19:23:00.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9311659564378949974', time=2024-09-12T20:36:28.737048+0000, chain.objs.size()=1 2024-09-12T19:23:00.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.j0E8qly6Do5AjrwZa9x9Jp_R6UviZzB_0 2024-09-12T19:23:00.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16647340513930679250', time=2024-09-12T20:36:29.093394+0000, chain.objs.size()=1 2024-09-12T19:23:00.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.qalR82KAGewZMQr9JsLv6nAgbst0QL0_0 2024-09-12T19:23:00.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11582767862947252150', time=2024-09-12T20:36:30.282139+0000, chain.objs.size()=1 2024-09-12T19:23:00.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.t1CUbVt2ECKstW_kJkP2nwhigYL6zH6_0 2024-09-12T19:23:00.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7074769900958410298', time=2024-09-12T20:36:30.753911+0000, chain.objs.size()=1 2024-09-12T19:23:00.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.eDsoLCEfEXSalcY7zSkQP7TFzop5XOZ_0 2024-09-12T19:23:00.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.346+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16114690828981866157', time=2024-09-12T20:36:31.956874+0000, chain.objs.size()=1 2024-09-12T19:23:00.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.346+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.BaJVSnIVGIiAbz0iOAQVvLEuplIVSZP_0 2024-09-12T19:23:00.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.346+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9904457006811686720', time=2024-09-12T20:36:33.471111+0000, chain.objs.size()=1 2024-09-12T19:23:00.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.346+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.pL3TobgsAyVlebBmJxqIxhZSYVdH40v_0 2024-09-12T19:23:00.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.346+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8004754676741562939', time=2024-09-12T20:36:33.643318+0000, chain.objs.size()=1 2024-09-12T19:23:00.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.346+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.3vWEYrwCOWXlxpHuGf1SRF2Sri1xNfa_0 2024-09-12T19:23:00.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.346+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3636687575841215522', time=2024-09-12T20:36:35.834404+0000, chain.objs.size()=1 2024-09-12T19:23:00.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.346+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.EHHAgrWcJfpEEvUQdfFGIClIFn7NfrJ_0 2024-09-12T19:23:00.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.346+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.45085144208164616', time=2024-09-12T20:36:35.836777+0000, chain.objs.size()=1 2024-09-12T19:23:00.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.346+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.VLGU7P0-gDWD5nS45nrs5RA1PG-Z9B5_0 2024-09-12T19:23:00.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.346+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14137349487677120744', time=2024-09-12T20:36:36.305889+0000, chain.objs.size()=1 2024-09-12T19:23:00.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.346+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.6fqQVCPOxA-iXqz-FK-NC8GTkSc8BFi_0 2024-09-12T19:23:00.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15514391076536133331', time=2024-09-12T20:36:36.435734+0000, chain.objs.size()=1 2024-09-12T19:23:00.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.cAyKF27abmLiS5pjNeu0M7VzDZMJo1t_0 2024-09-12T19:23:00.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1441303982981141766', time=2024-09-12T20:36:38.585054+0000, chain.objs.size()=1 2024-09-12T19:23:00.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.wyQgmnJqBTQpntfbjxQ-RlHh2H825qk_0 2024-09-12T19:23:00.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8061643793415414543', time=2024-09-12T20:36:39.518219+0000, chain.objs.size()=1 2024-09-12T19:23:00.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.fHd2UhsXCchzevCNMP30nzUWXl_YnNc_0 2024-09-12T19:23:00.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10310849097054607505', time=2024-09-12T20:36:40.134711+0000, chain.objs.size()=1 2024-09-12T19:23:00.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.lL24uSJ4KyhQCZKychkEnK4NmZISZn8_0 2024-09-12T19:23:00.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17207185987850398262', time=2024-09-12T20:36:40.283973+0000, chain.objs.size()=1 2024-09-12T19:23:00.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.LkkVWBMsMo-hyIGIzAb0O0t6qknhMRu_0 2024-09-12T19:23:00.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.762534941938062152', time=2024-09-12T20:36:40.464017+0000, chain.objs.size()=1 2024-09-12T19:23:00.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.9JyFQcHlnUIpGv-C6ifwph_OhRiEv6G_0 2024-09-12T19:23:00.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3037756595086782607', time=2024-09-12T20:36:41.339614+0000, chain.objs.size()=1 2024-09-12T19:23:00.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.W9FGQpJXmMOjqH2Z3BaBz6fK_6UMooS_0 2024-09-12T19:23:00.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14690205663672076746', time=2024-09-12T20:36:43.693253+0000, chain.objs.size()=1 2024-09-12T19:23:00.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.LZ5PV4pM2yqGn3sXJ8gOP9JG0-2Wfz9_0 2024-09-12T19:23:00.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5258966728481378612', time=2024-09-12T20:36:44.152126+0000, chain.objs.size()=1 2024-09-12T19:23:00.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.K6YYZ0LWQ3nzccKZAhbuYYowKKZnWG7_0 2024-09-12T19:23:00.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6276362658328655783', time=2024-09-12T20:36:44.603191+0000, chain.objs.size()=1 2024-09-12T19:23:00.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.MNNDAVPZXTIkOoILfuDOfCnxwqDTTSI_0 2024-09-12T19:23:00.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8496555638871123378', time=2024-09-12T20:36:44.903524+0000, chain.objs.size()=1 2024-09-12T19:23:00.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.94R_yB_j5o0I3l0fAf4nnbM77JmQ4Mf_0 2024-09-12T19:23:00.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15512664479729302330', time=2024-09-12T20:36:44.974336+0000, chain.objs.size()=1 2024-09-12T19:23:00.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.PWmHnsQfk9ZWFAFRFSTdxze57OZciiW_0 2024-09-12T19:23:00.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6505674745299465077', time=2024-09-12T20:36:45.715776+0000, chain.objs.size()=1 2024-09-12T19:23:00.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.bwZEx-KotrP76-AMiwbBkFwZkaUzENO_0 2024-09-12T19:23:00.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4869075211375161947', time=2024-09-12T20:36:46.064083+0000, chain.objs.size()=1 2024-09-12T19:23:00.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.jRuZOvwkrLy8bN074yvx9mSCI1qbSFP_0 2024-09-12T19:23:00.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4402629832193228172', time=2024-09-12T20:36:47.524124+0000, chain.objs.size()=1 2024-09-12T19:23:00.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.a07rPoFxHrpN4Gzmg1j_WvBf5P_rd2Z_0 2024-09-12T19:23:00.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3253826043203344405', time=2024-09-12T20:36:48.217155+0000, chain.objs.size()=1 2024-09-12T19:23:00.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.33GDjDRt4lr1-1alnLxx4hgPd02pgT6_0 2024-09-12T19:23:00.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17004683107556448092', time=2024-09-12T20:36:48.680258+0000, chain.objs.size()=1 2024-09-12T19:23:00.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.cazm9VLf7lUis_-fWe5wRyKje02F3nZ_0 2024-09-12T19:23:00.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18014798735987543517', time=2024-09-12T20:36:48.743878+0000, chain.objs.size()=1 2024-09-12T19:23:00.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.AMu7cfZb4Npvo6bpTwZrbNK2ZlOLPW3_0 2024-09-12T19:23:00.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9018670317961979413', time=2024-09-12T20:36:50.703084+0000, chain.objs.size()=1 2024-09-12T19:23:00.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.2vXLHsLuUMckXEX6oVUCoN2Fgdfnz-A_0 2024-09-12T19:23:00.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.358+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8588073526771769588', time=2024-09-12T20:36:51.782803+0000, chain.objs.size()=1 2024-09-12T19:23:00.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.358+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.g0tw2A-L5hejEafk11YyXpYtxBUrTis_0 2024-09-12T19:23:00.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.362+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16022466121372070921', time=2024-09-12T20:36:51.840427+0000, chain.objs.size()=1 2024-09-12T19:23:00.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.362+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.f5XQJg7A3KbqS1m2sp-gtm4aog1ykZi_0 2024-09-12T19:23:00.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.362+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8778019636906185014', time=2024-09-12T20:36:52.715834+0000, chain.objs.size()=1 2024-09-12T19:23:00.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.362+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.c8-t9xL84hVGTdMjZPIhi3r-kabTWTX_0 2024-09-12T19:23:00.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.362+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9128329870928107290', time=2024-09-12T20:36:54.049927+0000, chain.objs.size()=1 2024-09-12T19:23:00.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.362+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.QDnN3Nto8qbOpXELpJLYmE4CIdwgIq-_0 2024-09-12T19:23:00.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.362+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7302189475237389811', time=2024-09-12T20:36:54.604172+0000, chain.objs.size()=1 2024-09-12T19:23:00.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.362+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Qitmboik5Q_k4uuIAcPqXp0oy_4UabM_0 2024-09-12T19:23:00.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.362+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11483990175817248985', time=2024-09-12T20:36:55.359656+0000, chain.objs.size()=1 2024-09-12T19:23:00.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.362+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.bTTIvu0m5C7rFqWL5bmYia7p3huf3_w_0 2024-09-12T19:23:00.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.362+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5651970398949300449', time=2024-09-12T20:36:55.540152+0000, chain.objs.size()=1 2024-09-12T19:23:00.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.362+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.C4szuVfblz2dqZ_UYXcAIIzigCS_OcT_0 2024-09-12T19:23:00.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.362+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12364796830443617248', time=2024-09-12T20:36:55.907481+0000, chain.objs.size()=1 2024-09-12T19:23:00.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.362+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.7Jrp71Ox79jQhcbVQSBz9wcpqxTsnBs_0 2024-09-12T19:23:00.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.362+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1750909988751808299', time=2024-09-12T20:38:41.793382+0000, chain.objs.size()=1 2024-09-12T19:23:00.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.362+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ymtDPrbU6hioyIRiejsepmMCdlKBFWh_0 2024-09-12T19:23:00.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.370+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43206 2024-09-12T19:23:00.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=55, truncated=0, next_marker='' 2024-09-12T19:23:00.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5494645834318151947', time=2024-09-12T20:38:42.473904+0000, chain.objs.size()=1 2024-09-12T19:23:00.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.R6fuT58N_xO3_pXTruUBE-SrBjjemyY_0 2024-09-12T19:23:00.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12324787771711536200', time=2024-09-12T20:38:43.634384+0000, chain.objs.size()=1 2024-09-12T19:23:00.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.CdVNEWufhlF8gltdTXo01Qec3ImMboq_0 2024-09-12T19:23:00.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14947747024206882239', time=2024-09-12T20:38:44.201108+0000, chain.objs.size()=1 2024-09-12T19:23:00.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.PZ2X3ER2DEBXV4qErZBJFMoOvhJ9G2p_0 2024-09-12T19:23:00.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9615250945370504307', time=2024-09-12T20:38:44.737504+0000, chain.objs.size()=1 2024-09-12T19:23:00.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.or3Rwv56fQHPrq5liAdUzU4yzpDij1L_0 2024-09-12T19:23:00.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.402831875944217140', time=2024-09-12T20:38:45.421780+0000, chain.objs.size()=1 2024-09-12T19:23:00.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ba5Hn9mtssPDdn_qBwaUACCZ-RSU88V_0 2024-09-12T19:23:00.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.802399873324723752', time=2024-09-12T20:38:45.423559+0000, chain.objs.size()=1 2024-09-12T19:23:00.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.7qV3MxvVOWFuyctZdzhCXADNKxDuQ8V_0 2024-09-12T19:23:00.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15175382514623907731', time=2024-09-12T20:38:45.653096+0000, chain.objs.size()=1 2024-09-12T19:23:00.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.wGKNd4-81ZHZG8wlBBSGJe1Vn1AH-y7_0 2024-09-12T19:23:00.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13131604078503144186', time=2024-09-12T20:38:46.346990+0000, chain.objs.size()=1 2024-09-12T19:23:00.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.FXBLU5JEGE6xIhS-k7zMAzbm9DSEdSt_0 2024-09-12T19:23:00.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10768012326437949357', time=2024-09-12T20:38:47.504731+0000, chain.objs.size()=1 2024-09-12T19:23:00.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.RUlONYNLBNMykcdgoEWZXwr_NZs8XdY_0 2024-09-12T19:23:00.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6124755963979021223', time=2024-09-12T20:38:47.572780+0000, chain.objs.size()=1 2024-09-12T19:23:00.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.OhX9DLTDkPYIwXRjWI43lvTgQDRX-OR_0 2024-09-12T19:23:00.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2110203623046752984', time=2024-09-12T20:38:48.261656+0000, chain.objs.size()=1 2024-09-12T19:23:00.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_._A4omNDB-8lSV0d8XUdf_byCRcC8e_H_0 2024-09-12T19:23:00.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10264242569035433727', time=2024-09-12T20:38:48.263406+0000, chain.objs.size()=1 2024-09-12T19:23:00.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.EZ_d2AR1Ur4_MTssAf1_bS5_XnaysIh_0 2024-09-12T19:23:00.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.378+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15125978847937029316', time=2024-09-12T20:38:48.516997+0000, chain.objs.size()=1 2024-09-12T19:23:00.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.378+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.yO7FbOHH_5VYASYTg7nHHmo0nlxjHo0_0 2024-09-12T19:23:00.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.378+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.705091624117272132', time=2024-09-12T20:38:48.596588+0000, chain.objs.size()=1 2024-09-12T19:23:00.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.378+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-1kAG05m99y7y-BEvUiUrRLSiRH8ULA_0 2024-09-12T19:23:00.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.378+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1163664640303082548', time=2024-09-12T20:38:49.425007+0000, chain.objs.size()=1 2024-09-12T19:23:00.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.378+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.l74jMR0EoIZsdxbWJBENhQeIKkCnIuy_0 2024-09-12T19:23:00.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.378+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12524461453303518896', time=2024-09-12T20:38:51.796284+0000, chain.objs.size()=1 2024-09-12T19:23:00.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.378+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.uFsZZDvCJcGm7OTmATljefMNri3KOmU_0 2024-09-12T19:23:00.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.382+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9511726575711419597', time=2024-09-12T20:38:51.995725+0000, chain.objs.size()=1 2024-09-12T19:23:00.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.382+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-68JOvBH6eVMhJYfr7q8KsOycTkIgXm_0 2024-09-12T19:23:00.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.382+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14363451259040535042', time=2024-09-12T20:38:52.235723+0000, chain.objs.size()=1 2024-09-12T19:23:00.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.382+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.5zJ4icHV_4PfwZzi00FCfaeqDHhkJYh_0 2024-09-12T19:23:00.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.382+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16005702183074811787', time=2024-09-12T20:38:52.285316+0000, chain.objs.size()=1 2024-09-12T19:23:00.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.382+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.nPUQVt8DtgcWv41cnbslPJnc_h0ubE5_0 2024-09-12T19:23:00.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.382+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6262453342991243996', time=2024-09-12T20:38:53.334720+0000, chain.objs.size()=1 2024-09-12T19:23:00.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.382+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.hbQWVMwJ9Ie-K9YmIHbKUxunAT3vj4e_0 2024-09-12T19:23:00.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.382+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10784645011655004778', time=2024-09-12T20:38:53.636391+0000, chain.objs.size()=1 2024-09-12T19:23:00.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.382+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-v9zp6JVJIXqFJ0Jno9kEkNWbO0Cv7a_0 2024-09-12T19:23:00.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.382+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3317966558084764022', time=2024-09-12T20:38:53.799386+0000, chain.objs.size()=1 2024-09-12T19:23:00.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.382+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.wX_eEKhUpvX8XMNd_mEtvmFKWacbPGz_0 2024-09-12T19:23:00.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.382+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.580339579701582629', time=2024-09-12T20:38:55.055306+0000, chain.objs.size()=1 2024-09-12T19:23:00.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.382+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.dYgr9R3mPvtXBom137MdO7Z9xiK4LA6_0 2024-09-12T19:23:00.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.382+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7305050422586054437', time=2024-09-12T20:38:55.383949+0000, chain.objs.size()=1 2024-09-12T19:23:00.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.382+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.JD8ltVK-ablkdBzfm0vghy9aRgazZap_0 2024-09-12T19:23:00.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.382+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6898207395902995000', time=2024-09-12T20:38:56.221722+0000, chain.objs.size()=1 2024-09-12T19:23:00.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.382+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.SzL9MXcnV-Vw71LXY8S3BJ0AOXYKrD1_0 2024-09-12T19:23:00.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.382+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14054312424813465453', time=2024-09-12T20:39:00.259289+0000, chain.objs.size()=1 2024-09-12T19:23:00.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.382+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.DzEm_X8qs6_iSQRJgMSWZg3XYngoRV3_0 2024-09-12T19:23:00.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.386+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3429827283982831370', time=2024-09-12T20:39:01.384162+0000, chain.objs.size()=1 2024-09-12T19:23:00.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.386+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Wih4xCbFqL12pVfshZvcLAYQnRsKTF6_0 2024-09-12T19:23:00.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.386+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16939199494351627373', time=2024-09-12T20:39:04.692795+0000, chain.objs.size()=1 2024-09-12T19:23:00.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.386+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.hgBFMQUWZZnhcNT7Yi-1BVutqTp-BPx_0 2024-09-12T19:23:00.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.386+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.840967834697714690', time=2024-09-12T20:39:04.870366+0000, chain.objs.size()=1 2024-09-12T19:23:00.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.386+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.lyxgeH0nnCJtH0lALT8fJoOGJESjvSB_0 2024-09-12T19:23:00.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5529703396960447481', time=2024-09-12T20:39:06.936687+0000, chain.objs.size()=1 2024-09-12T19:23:00.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.9yLTh9Hu_zzzcDa60O4T8kPE0Xv5psu_0 2024-09-12T19:23:00.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1717751310435186597', time=2024-09-12T20:39:07.020893+0000, chain.objs.size()=1 2024-09-12T19:23:00.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.KmrZO7wBqKahzQ1Om5I5Z7Zt7i7lyfC_0 2024-09-12T19:23:00.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18000948534895101461', time=2024-09-12T20:39:07.023561+0000, chain.objs.size()=1 2024-09-12T19:23:00.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Dmw36OI3F38QXlRgFs0wqvGnk_6oV7x_0 2024-09-12T19:23:00.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15800558633143679819', time=2024-09-12T20:39:07.324834+0000, chain.objs.size()=1 2024-09-12T19:23:00.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.IQjL5ATFRjPS1UmlZ-B0zZHqm-fq2q0_0 2024-09-12T19:23:00.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7253368934381051269', time=2024-09-12T20:39:07.805525+0000, chain.objs.size()=1 2024-09-12T19:23:00.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.tTaKFdF1RZb-jr__WNFap0_YzMcODbk_0 2024-09-12T19:23:00.406 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14665291518770085114', time=2024-09-12T20:39:07.807320+0000, chain.objs.size()=1 2024-09-12T19:23:00.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.asG4ei8gx2drD2Dd9F53UtkPe9eQVxE_0 2024-09-12T19:23:00.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15622163872111628661', time=2024-09-12T20:41:18.996590+0000, chain.objs.size()=1 2024-09-12T19:23:00.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.390__shadow_.j0Ax-sAlatvDLih8mJKBwZjclls11Un_0 2024-09-12T19:23:00.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15108754691702656858', time=2024-09-12T20:46:25.236090+0000, chain.objs.size()=1 2024-09-12T19:23:00.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.515__shadow_.GrVTbtPaV-d7JWhPkZqr7kkJS3U9BU6_0 2024-09-12T19:23:00.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11336188886630572957', time=2024-09-12T20:46:46.411545+0000, chain.objs.size()=1 2024-09-12T19:23:00.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.518__multipart_mymultipart.2~0JKhbMApuQlWsjaUrxyBiniOMeHBFse.1 2024-09-12T19:23:00.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4483593292241854004', time=2024-09-12T20:46:48.737052+0000, chain.objs.size()=1 2024-09-12T19:23:00.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.518__multipart_mymultipart.2~aL8eGnfj9O06RSVKv9QzNMAcEPXDiX8.1 2024-09-12T19:23:00.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10156457607869855346', time=2024-09-12T20:49:09.716241+0000, chain.objs.size()=6 2024-09-12T19:23:00.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.Z5_0_UPWCEM575g7oXshZf4CmVzFjW54.1 2024-09-12T19:23:00.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.394+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~T01q1pVPbDlXq4kiP21XlkOrrywjtrp.2 2024-09-12T19:23:00.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~T01q1pVPbDlXq4kiP21XlkOrrywjtrp.3 2024-09-12T19:23:00.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~T01q1pVPbDlXq4kiP21XlkOrrywjtrp.4 2024-09-12T19:23:00.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~T01q1pVPbDlXq4kiP21XlkOrrywjtrp.5 2024-09-12T19:23:00.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~T01q1pVPbDlXq4kiP21XlkOrrywjtrp.6 2024-09-12T19:23:00.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.398+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7289373984960763086', time=2024-09-12T20:52:40.367551+0000, chain.objs.size()=1 2024-09-12T19:23:00.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.524__shadow_.CFRZb2Uw5V2CC4YOK9dwn-p-S3qOHR2_0 2024-09-12T19:23:00.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.398+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8184243986542051820', time=2024-09-12T20:54:52.509094+0000, chain.objs.size()=1 2024-09-12T19:23:00.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.550__shadow_.5SNPHANA0pZkvFPJ6jeIYCXvGVaPEg__0 2024-09-12T19:23:00.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.398+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.966865063795056815', time=2024-09-12T20:55:11.273223+0000, chain.objs.size()=1 2024-09-12T19:23:00.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.552__shadow_.Ufe5-rCZrR2IUvNZDlTQs3ZxfYg8YbF_0 2024-09-12T19:23:00.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.398+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.329168229500872206', time=2024-09-12T20:56:16.323804+0000, chain.objs.size()=1 2024-09-12T19:23:00.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.560__shadow_.yTQdehcqnp-Y4Yfer1fii8WS6jG4VEN_0 2024-09-12T19:23:00.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.398+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6130486296205647118', time=2024-09-12T20:56:51.972082+0000, chain.objs.size()=1 2024-09-12T19:23:00.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:Yt7GoJohGUHzZGOQS5JZGJNICk54bfc_.JiyH6L7jzQoNeKM5VYHGztzTmvB0pnp_0 2024-09-12T19:23:00.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.398+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18051246130858098339', time=2024-09-12T20:56:58.399724+0000, chain.objs.size()=1 2024-09-12T19:23:00.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:4-1ypefLBn4SRDG.jcMH6Ps0j.lQigp_.-SpkU3O0CIV85K46ltK-2AebkcNOJRI_0 2024-09-12T19:23:00.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2895576008228590018', time=2024-09-12T20:57:24.515527+0000, chain.objs.size()=1 2024-09-12T19:23:00.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.402+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.574__shadow:8uozz86si7ZFKO7HElHTE6naS1BGVvX_.KquL-Fr5oWo1rJChDGMRoOfS_halcfu_0 2024-09-12T19:23:00.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7521306095499399036', time=2024-09-12T20:58:24.318766+0000, chain.objs.size()=1 2024-09-12T19:23:00.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.402+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:Ofa1ppxhEpGES0YpgtHwPW4BUtDO9jp_.8z1ccJl3AhhSBnz3-6-lHFJAfZ_Vmpl_0 2024-09-12T19:23:00.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9554475598059144610', time=2024-09-12T20:59:29.511846+0000, chain.objs.size()=1 2024-09-12T19:23:00.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.402+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.579__shadow:CSn3Ym8sEP8ZN.btsCuiZcp.ssUvS7W_.ciZMZxmM7Oa8TGSpX-80PV0wW4x9De2_0 2024-09-12T19:23:00.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1129316671940521316', time=2024-09-12T20:59:35.762562+0000, chain.objs.size()=1 2024-09-12T19:23:00.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.402+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.580__shadow:5sC2Adaitf0usoMb8hLTKYcZQiru7s9_.OxurRxCCCxu-05c_B6XfK8BrquQ6HF2_0 2024-09-12T19:23:00.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15151197025215671229', time=2024-09-12T21:04:20.802499+0000, chain.objs.size()=1 2024-09-12T19:23:00.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.402+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.617__shadow_.8EurFzrv2eI8Xx9Fw3R8zh03Q5c3E17_0 2024-09-12T19:23:00.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5613854750564238536', time=2024-09-12T21:07:28.637849+0000, chain.objs.size()=1 2024-09-12T19:23:00.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.402+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.640__shadow_.N0oFA3pu8asUp2VPfwveA-9FxECcGiN_0 2024-09-12T19:23:00.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.406+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8189339790367294834', time=2024-09-12T21:08:19.543142+0000, chain.objs.size()=1 2024-09-12T19:23:00.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.406+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.651__shadow_.VM62SjOe8oRuwGZCjmpeQZTWcbKMScg_0 2024-09-12T19:23:00.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.406+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10340787789569294352', time=2024-09-12T21:09:52.066530+0000, chain.objs.size()=1 2024-09-12T19:23:00.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.406+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.670__shadow_.vj5JDQVaRLLwOrxRlCABs765vPN7Hkw_0 2024-09-12T19:23:00.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.406+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5513643514539254362', time=2024-09-12T21:11:16.235648+0000, chain.objs.size()=1 2024-09-12T19:23:00.412 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.406+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.713__shadow:QmwZyTfcp-aeuUidGIG4x2Ca0D.ECK9_.QCTa6cz2Kg0xBjQAJswFTnX3Pvu9zBt_0 2024-09-12T19:23:00.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.410+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:00.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T19:23:00.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:00.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:00.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43575' 2024-09-12T19:23:00.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8127982408155625388', time=2024-09-12T20:21:26.836584+0000, chain.objs.size()=1 2024-09-12T19:23:00.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.147__shadow_.WSUbYwIVtl624VSWUYgTfKIAAz5nE1H_0 2024-09-12T19:23:00.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='_1PH4TWj1Hyv3EIeHV-5Qy2Lyqg8L974', time=2024-09-12T20:23:37.637625+0000, chain.objs.size()=1 2024-09-12T19:23:00.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.165__shadow_.Skx63mbGbTSnisz9HytQNNaMJNV6cKK_0 2024-09-12T19:23:00.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16811754439270198297', time=2024-09-12T20:29:15.514885+0000, chain.objs.size()=1 2024-09-12T19:23:00.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.242__shadow_.VnA9RjzXiLPVysBcYjiau-qeHw86Pcx_0 2024-09-12T19:23:00.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12073140170335347161', time=2024-09-12T20:31:45.311676+0000, chain.objs.size()=1 2024-09-12T19:23:00.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.KQIOTgFE61f7GTe3pZlVx7ZAYViomR__0 2024-09-12T19:23:00.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17557499718003058022', time=2024-09-12T20:31:45.625891+0000, chain.objs.size()=1 2024-09-12T19:23:00.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.e4wB9qXhiCZ8hbooen4rv5vPTLryotr_0 2024-09-12T19:23:00.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8358702188115961571', time=2024-09-12T20:31:45.627610+0000, chain.objs.size()=1 2024-09-12T19:23:00.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.zUeFFLTqcNuRKwT7lJe69Yockk8Lj7V_0 2024-09-12T19:23:00.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2763661585941593905', time=2024-09-12T20:31:46.807887+0000, chain.objs.size()=1 2024-09-12T19:23:00.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ZrcsOY7y0JAinUdP2Jkenqf7HDZ2Whb_0 2024-09-12T19:23:00.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16142418530192542417', time=2024-09-12T20:31:48.001506+0000, chain.objs.size()=1 2024-09-12T19:23:00.423 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.1h6e0UF8xaDtb0OHMSQekuBBb7ahors_0 2024-09-12T19:23:00.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1931573253297501837', time=2024-09-12T20:31:49.215411+0000, chain.objs.size()=1 2024-09-12T19:23:00.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.eaujF3f2gQyKnEFNtKWAJ5zpOe4yTfw_0 2024-09-12T19:23:00.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3306967174581349791', time=2024-09-12T20:31:50.009062+0000, chain.objs.size()=1 2024-09-12T19:23:00.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.xGko4hEM8TbewxhRMN1QDYMzaZ3LzhS_0 2024-09-12T19:23:00.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18092150396629067385', time=2024-09-12T20:31:50.964405+0000, chain.objs.size()=1 2024-09-12T19:23:00.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.KrfjI3V47EdYYhDaLHTNdEGMOLaFvM5_0 2024-09-12T19:23:00.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9448643174370557813', time=2024-09-12T20:31:51.176813+0000, chain.objs.size()=1 2024-09-12T19:23:00.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.GDDHDO74iTnYUnP28rMlAQIhuppUD-b_0 2024-09-12T19:23:00.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14974623905065516752', time=2024-09-12T20:31:52.059365+0000, chain.objs.size()=1 2024-09-12T19:23:00.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.aSQYwyMY4WPgNxGVJ7lv3jqKADxz660_0 2024-09-12T19:23:00.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.200030836687338838', time=2024-09-12T20:31:53.467490+0000, chain.objs.size()=1 2024-09-12T19:23:00.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.0BVubrtfFNoe-Rit0HysiN0h_xVzGSJ_0 2024-09-12T19:23:00.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15288738508579992114', time=2024-09-12T20:31:53.569694+0000, chain.objs.size()=1 2024-09-12T19:23:00.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.bkejAdx1TfejekFfb0Ognm7TkEt92cv_0 2024-09-12T19:23:00.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13963912940116288890', time=2024-09-12T20:31:55.354428+0000, chain.objs.size()=1 2024-09-12T19:23:00.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.f0PdaDbe4W6EZ-kZsz-Qr_jW7tVNXWH_0 2024-09-12T19:23:00.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3791271197596513491', time=2024-09-12T20:31:56.863527+0000, chain.objs.size()=1 2024-09-12T19:23:00.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.zGuU7ZJ8p7xBA0-dKS9oGpYclkvov49_0 2024-09-12T19:23:00.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11999273686031715018', time=2024-09-12T20:31:56.928528+0000, chain.objs.size()=1 2024-09-12T19:23:00.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.aMY6ZAI6AtdMlW3BkRO5rSmDglZR6Qk_0 2024-09-12T19:23:00.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1381089880618223131', time=2024-09-12T20:31:56.930503+0000, chain.objs.size()=1 2024-09-12T19:23:00.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.C06bhm2rVlGovm8C5mUrDb0vxTGMe7-_0 2024-09-12T19:23:00.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6765015777786499449', time=2024-09-12T20:31:57.639733+0000, chain.objs.size()=1 2024-09-12T19:23:00.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.QPravYPDnE9Z3EtiHn0finohfkX0XQD_0 2024-09-12T19:23:00.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9169683692296440515', time=2024-09-12T20:31:59.457890+0000, chain.objs.size()=1 2024-09-12T19:23:00.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.c-o2RAn6pu0PLm8Qg_zqtAo4YXvrKRA_0 2024-09-12T19:23:00.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.426+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7007909258923031077', time=2024-09-12T20:31:59.540498+0000, chain.objs.size()=1 2024-09-12T19:23:00.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.426+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.QPgXRyb0TkXJcfi32V-aPQnWNh9Pnjg_0 2024-09-12T19:23:00.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.426+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14461889542313926563', time=2024-09-12T20:32:00.829716+0000, chain.objs.size()=1 2024-09-12T19:23:00.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.426+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.M8D02za67-yKPlUPqQflabNPNhtlKlE_0 2024-09-12T19:23:00.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.426+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15327577325595151742', time=2024-09-12T20:32:02.102796+0000, chain.objs.size()=1 2024-09-12T19:23:00.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.426+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.51igo_yhIHE4ivjzRTJQv3BXl0SwVTP_0 2024-09-12T19:23:00.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.426+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2999035804696536665', time=2024-09-12T20:32:02.385096+0000, chain.objs.size()=1 2024-09-12T19:23:00.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.426+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.NHGYDtS9QN9gWt7wm1UeaLuZaLaXie-_0 2024-09-12T19:23:00.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.426+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14006146266000197777', time=2024-09-12T20:32:02.945582+0000, chain.objs.size()=1 2024-09-12T19:23:00.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.426+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.oh7i7mLQH-7RqdffyzI5DJC8wJYe_nN_0 2024-09-12T19:23:00.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10977338146386570439', time=2024-09-12T20:32:04.372170+0000, chain.objs.size()=1 2024-09-12T19:23:00.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.mPYQokhtnIV_--hAavhPB2lXVywL6AZ_0 2024-09-12T19:23:00.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16230541971501952505', time=2024-09-12T20:32:05.502746+0000, chain.objs.size()=1 2024-09-12T19:23:00.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.gcsTPlizBbBeZuWwf0GqQhq8gDBhjym_0 2024-09-12T19:23:00.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7490840878823612037', time=2024-09-12T20:32:05.596350+0000, chain.objs.size()=1 2024-09-12T19:23:00.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.uWuzkwyXXXk7HKJDYjEGkNjzjBhyLIQ_0 2024-09-12T19:23:00.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6093730342027487091', time=2024-09-12T20:32:05.835648+0000, chain.objs.size()=1 2024-09-12T19:23:00.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.YUART4Jt-jzNvHPQFQn3tPzL-nJowSt_0 2024-09-12T19:23:00.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3621684725355563022', time=2024-09-12T20:32:05.955260+0000, chain.objs.size()=1 2024-09-12T19:23:00.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ehRhadzJ4USWd1Tmhrk3vRmyltaca2o_0 2024-09-12T19:23:00.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11433177725210613557', time=2024-09-12T20:32:06.393267+0000, chain.objs.size()=1 2024-09-12T19:23:00.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.haE920gXzGBmUdpVRuupHyit17HFiAu_0 2024-09-12T19:23:00.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16479524769630852126', time=2024-09-12T20:32:06.638837+0000, chain.objs.size()=1 2024-09-12T19:23:00.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.PxcMa0cjlLbSkekrYXmJNjL5Il6Swqg_0 2024-09-12T19:23:00.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4904064584435556566', time=2024-09-12T20:32:08.368176+0000, chain.objs.size()=1 2024-09-12T19:23:00.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.knDERtYlZJ5fdEhEzoKYUsPzpy3tVpJ_0 2024-09-12T19:23:00.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16838835863104496507', time=2024-09-12T20:32:13.158995+0000, chain.objs.size()=1 2024-09-12T19:23:00.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.lOVJZxvjvz_cJsg_Bt8FbDjFHNMCJ2S_0 2024-09-12T19:23:00.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14579030911696244347', time=2024-09-12T20:32:18.435184+0000, chain.objs.size()=1 2024-09-12T19:23:00.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.264__shadow_.uiVf4uSAfeR-JC1nZZy5xYXZ37Ryc5j_0 2024-09-12T19:23:00.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7550749911567178398', time=2024-09-12T20:33:08.154555+0000, chain.objs.size()=1 2024-09-12T19:23:00.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.286__shadow_.nOhS8fwy5H63zaWX_S12sLSYzly8_vs_0 2024-09-12T19:23:00.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.527618067764609796', time=2024-09-12T20:33:25.400138+0000, chain.objs.size()=1 2024-09-12T19:23:00.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.tioezTFk5NdZ9keONMsdcmvhUHVRkNn_0 2024-09-12T19:23:00.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6587412106528890296', time=2024-09-12T20:33:25.456084+0000, chain.objs.size()=1 2024-09-12T19:23:00.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.h_11TOkHkru2pwRfMd7jXuFOxpmEd13_0 2024-09-12T19:23:00.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2447813571601350173', time=2024-09-12T20:33:25.684834+0000, chain.objs.size()=1 2024-09-12T19:23:00.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.aCZslkCrm77IfJBu2Lo4P_gh8HQvOCo_0 2024-09-12T19:23:00.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7865077748991650748', time=2024-09-12T20:33:31.019973+0000, chain.objs.size()=1 2024-09-12T19:23:00.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.A-56m5w0QxVwV1TwUaDsRsYrEjMTi_U_0 2024-09-12T19:23:00.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6169966779913695399', time=2024-09-12T20:33:48.036697+0000, chain.objs.size()=1 2024-09-12T19:23:00.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.300__shadow_.TEyO5JCtY5HJQyEnPHqPMRmSJs4ou7K_0 2024-09-12T19:23:00.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5063514315515111510', time=2024-09-12T20:33:52.595706+0000, chain.objs.size()=1 2024-09-12T19:23:00.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.302__shadow_.PxWBJMcaRaI46I4biJpUOf2yH9OIxQR_0 2024-09-12T19:23:00.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.948505670101146837', time=2024-09-12T20:34:05.556551+0000, chain.objs.size()=1 2024-09-12T19:23:00.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.307__shadow:p87js-Sbt8jMCr88IHEUzjLMjDiM2xZ_._Pv99gaxZ735H1cnL4_8ZhdStNmHAdh_0 2024-09-12T19:23:00.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6402129703801036595', time=2024-09-12T20:34:38.565176+0000, chain.objs.size()=1 2024-09-12T19:23:00.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.319__shadow:2AozJMjLF4v.8.DuxvmogJnX7pwINLH_.cIz2yACFfYHZUIRPhNO6qDTbmIfwj0Y_0 2024-09-12T19:23:00.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12954451249195653753', time=2024-09-12T20:36:27.918249+0000, chain.objs.size()=1 2024-09-12T19:23:00.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.m18DS3NI0VMGzo3-0uOImhx1PZ95DKw_0 2024-09-12T19:23:00.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4055253296392833609', time=2024-09-12T20:36:29.108567+0000, chain.objs.size()=1 2024-09-12T19:23:00.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.nqHPZCgjFT4AoG0h7O03o786UoZyLqv_0 2024-09-12T19:23:00.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14574021130296663960', time=2024-09-12T20:36:32.637012+0000, chain.objs.size()=1 2024-09-12T19:23:00.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.3yGWnJfsLN2tN4HRso_7vrkbzwW48io_0 2024-09-12T19:23:00.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15510964136115526060', time=2024-09-12T20:36:32.714518+0000, chain.objs.size()=1 2024-09-12T19:23:00.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.jU_snBwEGcXTZQ_gsIvm6A3FoD--A7L_0 2024-09-12T19:23:00.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11974197228750484740', time=2024-09-12T20:36:32.843250+0000, chain.objs.size()=1 2024-09-12T19:23:00.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ASVpxMX9DG7SLZzjqUf5wKIGf4-fkN1_0 2024-09-12T19:23:00.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7575034166668748823', time=2024-09-12T20:36:33.425391+0000, chain.objs.size()=1 2024-09-12T19:23:00.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.E-NLxTKzUIgyiVj3_NHJ-Rukb2sN3vo_0 2024-09-12T19:23:00.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6341295461289753373', time=2024-09-12T20:36:33.661623+0000, chain.objs.size()=1 2024-09-12T19:23:00.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.WgC87Er3RC0hnJkTosEiSzW7BiK8kAx_0 2024-09-12T19:23:00.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.442+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13408278205627530800', time=2024-09-12T20:36:35.800068+0000, chain.objs.size()=1 2024-09-12T19:23:00.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.442+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.yNwgxyQytPQGuS6AOdT8XlDdvunNG7O_0 2024-09-12T19:23:00.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.442+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.922870847669599776', time=2024-09-12T20:36:35.892480+0000, chain.objs.size()=1 2024-09-12T19:23:00.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.442+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.aVtxlJV48gCacq8RNvmNYUZHo0HKfmx_0 2024-09-12T19:23:00.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.442+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.570864827029862496', time=2024-09-12T20:36:36.147264+0000, chain.objs.size()=1 2024-09-12T19:23:00.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.442+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.MkZfTqkW-UwYx4U6jwOArg8Lt2bVPbC_0 2024-09-12T19:23:00.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.442+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2546258237246088010', time=2024-09-12T20:36:36.750988+0000, chain.objs.size()=1 2024-09-12T19:23:00.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.442+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.1dBhu8EcD3qZZPoVfvHWE33zMxBceSl_0 2024-09-12T19:23:00.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4912116280899492242', time=2024-09-12T20:36:36.852498+0000, chain.objs.size()=1 2024-09-12T19:23:00.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.i4GNsmR3Q4wJ0dETaOFyNLptLcFku22_0 2024-09-12T19:23:00.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10012141140683479492', time=2024-09-12T20:36:36.982817+0000, chain.objs.size()=1 2024-09-12T19:23:00.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.pj5bD5xEb3hesd50MVRc7mW8GWrP_W2_0 2024-09-12T19:23:00.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7357916237963467058', time=2024-09-12T20:36:37.973060+0000, chain.objs.size()=1 2024-09-12T19:23:00.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.gf1JIXNaEuSmd3516pOftmYeDUSKsZz_0 2024-09-12T19:23:00.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16149593054326394389', time=2024-09-12T20:36:38.332385+0000, chain.objs.size()=1 2024-09-12T19:23:00.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.IScVre7LNAxOjYefN_tqa2sLOznHAwI_0 2024-09-12T19:23:00.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15468465774315692919', time=2024-09-12T20:36:39.836512+0000, chain.objs.size()=1 2024-09-12T19:23:00.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.L2SeV6ZOdQWZqLKcc-KLUUKdKj5pdGh_0 2024-09-12T19:23:00.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11470878214513066992', time=2024-09-12T20:36:40.011126+0000, chain.objs.size()=1 2024-09-12T19:23:00.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.hmj17GIokmhuFpaSvbK-hGp4ziv92Dx_0 2024-09-12T19:23:00.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5430587540786593147', time=2024-09-12T20:36:42.326783+0000, chain.objs.size()=1 2024-09-12T19:23:00.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.WTzrVR03lMJgpUgfvLRMsOQ5I9MStbJ_0 2024-09-12T19:23:00.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18049729093588006049', time=2024-09-12T20:36:43.212350+0000, chain.objs.size()=1 2024-09-12T19:23:00.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.zjtYQEXIKTQvSCvJ1vofNUYJYs9dA5T_0 2024-09-12T19:23:00.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2250624528706152460', time=2024-09-12T20:36:44.084850+0000, chain.objs.size()=1 2024-09-12T19:23:00.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.A4z0tQ0xT18WdElW2ADA4DidCFCcFMl_0 2024-09-12T19:23:00.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8387591921149327432', time=2024-09-12T20:36:45.017097+0000, chain.objs.size()=1 2024-09-12T19:23:00.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.5yHrAzLTuKRk7fLFt0KFh7XyZvGV_gP_0 2024-09-12T19:23:00.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8677631195586320639', time=2024-09-12T20:36:45.603412+0000, chain.objs.size()=1 2024-09-12T19:23:00.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.iE--n__ue--mQHutY4x-e8YZswVduMj_0 2024-09-12T19:23:00.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.450+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1728360718593804681', time=2024-09-12T20:36:49.265728+0000, chain.objs.size()=1 2024-09-12T19:23:00.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.450+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.6bHaNlh1dJvJA2L9eLEnqtKbYXHxP3-_0 2024-09-12T19:23:00.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.450+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7426956545713765761', time=2024-09-12T20:36:51.161236+0000, chain.objs.size()=1 2024-09-12T19:23:00.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.450+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.vM3KvW5Q8qC33IkDIU58TEvyy0H5qVy_0 2024-09-12T19:23:00.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.450+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14281358636811153227', time=2024-09-12T20:36:52.342530+0000, chain.objs.size()=1 2024-09-12T19:23:00.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.450+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.L_y9btjwAFNVe4mMhXqoM9L8bEMBKuB_0 2024-09-12T19:23:00.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.450+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.631146968649650336', time=2024-09-12T20:36:52.833804+0000, chain.objs.size()=1 2024-09-12T19:23:00.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.450+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.cVRjooIzOoT8M6b3uArFbyCBUl0JvEc_0 2024-09-12T19:23:00.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.450+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11749196261824344560', time=2024-09-12T20:36:56.088796+0000, chain.objs.size()=1 2024-09-12T19:23:00.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.450+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.x1B_ddRoerFizNV2mU_SYCO6xRDnRvL_0 2024-09-12T19:23:00.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16264747128936871978', time=2024-09-12T20:38:39.872328+0000, chain.objs.size()=1 2024-09-12T19:23:00.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.nPeFgfJRg1yc7lO5WCek9Bf3I2KIAL-_0 2024-09-12T19:23:00.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11350484728427053373', time=2024-09-12T20:38:40.235352+0000, chain.objs.size()=1 2024-09-12T19:23:00.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.KLOaxsklgAg1yKdQhmj8IwdjVWcuW8k_0 2024-09-12T19:23:00.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16255762032138491699', time=2024-09-12T20:38:40.290843+0000, chain.objs.size()=1 2024-09-12T19:23:00.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.HkdvA92_oiqMtRwHZguB-MMz7X75Xqm_0 2024-09-12T19:23:00.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9271146856660610936', time=2024-09-12T20:38:40.557795+0000, chain.objs.size()=1 2024-09-12T19:23:00.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.r5eJv3CF64z-HG7_fhR9ReM-xbNmVjo_0 2024-09-12T19:23:00.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14152485831085949436', time=2024-09-12T20:38:40.859793+0000, chain.objs.size()=1 2024-09-12T19:23:00.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.NpMdZm2P0bjvh_MihFcEBJkjRGmeu10_0 2024-09-12T19:23:00.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11811750327926013215', time=2024-09-12T20:38:41.459807+0000, chain.objs.size()=1 2024-09-12T19:23:00.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.UggPE60JyE2QxbnF4QkY4TyiJSF6WQR_0 2024-09-12T19:23:00.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14219802125472478903', time=2024-09-12T20:38:41.461771+0000, chain.objs.size()=1 2024-09-12T19:23:00.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.XTWGF2Vg7BhkNbhYu0SDJqzGa5yUthk_0 2024-09-12T19:23:00.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16927316684996810302', time=2024-09-12T20:38:41.463925+0000, chain.objs.size()=1 2024-09-12T19:23:00.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.p4lDu6fK0E8IoMxQwepc0L-ZKQmOeGj_0 2024-09-12T19:23:00.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1896893897697520010', time=2024-09-12T20:38:41.712356+0000, chain.objs.size()=1 2024-09-12T19:23:00.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.PMSyeqpIX6YBKg21eCJbCuOivfy2Q5R_0 2024-09-12T19:23:00.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10901884852523111230', time=2024-09-12T20:38:42.342668+0000, chain.objs.size()=1 2024-09-12T19:23:00.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.E247lmBaUnW2MCkWoUaYjE6Fpt2cSo8_0 2024-09-12T19:23:00.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17912612776658387816', time=2024-09-12T20:38:44.517127+0000, chain.objs.size()=1 2024-09-12T19:23:00.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.8vV9tgHLJ114zUuDFCZgcp9DzqFDh6r_0 2024-09-12T19:23:00.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2936621751329419510', time=2024-09-12T20:38:44.518623+0000, chain.objs.size()=1 2024-09-12T19:23:00.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Lao5m5ajg6DCgoywUkZe0kp9GBNhJ2L_0 2024-09-12T19:23:00.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.458+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1227544489431999766', time=2024-09-12T20:38:45.223797+0000, chain.objs.size()=1 2024-09-12T19:23:00.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.458+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Krw_lOEkOHcDr9hfsfy1NIUoxlwU1qG_0 2024-09-12T19:23:00.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.458+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16241805100273518737', time=2024-09-12T20:38:45.880394+0000, chain.objs.size()=1 2024-09-12T19:23:00.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.458+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.nJF9H56wcqmx4ZxeC1N5pv27zNW74xn_0 2024-09-12T19:23:00.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.458+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9927314438989694932', time=2024-09-12T20:38:45.882343+0000, chain.objs.size()=1 2024-09-12T19:23:00.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.458+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.1-vP7116dTuTz_BBXpjmdj7X0BnGKz6_0 2024-09-12T19:23:00.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.458+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7584638898952887234', time=2024-09-12T20:38:46.306096+0000, chain.objs.size()=1 2024-09-12T19:23:00.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.458+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.4WtnRuk9Pkw9A9ay83tQfAze_2BiY8K_0 2024-09-12T19:23:00.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.458+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10305189939435495389', time=2024-09-12T20:38:47.555967+0000, chain.objs.size()=1 2024-09-12T19:23:00.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.458+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.hmz2IKgbmrd2eDxmjSs74KNZLuP3cEV_0 2024-09-12T19:23:00.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.462+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9442368212406529329', time=2024-09-12T20:38:49.177326+0000, chain.objs.size()=1 2024-09-12T19:23:00.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.462+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.tmwDDQJNXjzsfAYJRELJc3UllDK22of_0 2024-09-12T19:23:00.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.462+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17495335466183634733', time=2024-09-12T20:38:49.518344+0000, chain.objs.size()=1 2024-09-12T19:23:00.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.462+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.8LQzCZgDthp56SygM-0QAITt5evid0f_0 2024-09-12T19:23:00.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.462+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14520665089958308246', time=2024-09-12T20:38:50.210124+0000, chain.objs.size()=1 2024-09-12T19:23:00.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.462+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.iH_9oomW0ltpeLC5cKABoJI-CbVGmvs_0 2024-09-12T19:23:00.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.462+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13912913195257628261', time=2024-09-12T20:38:52.558743+0000, chain.objs.size()=1 2024-09-12T19:23:00.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.462+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.6g2PpL8tBQY3mM73-CcISRcYjYusAw5_0 2024-09-12T19:23:00.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.462+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6734135036953043768', time=2024-09-12T20:38:52.927723+0000, chain.objs.size()=1 2024-09-12T19:23:00.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.462+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.UkI4FqdyB639zwaz6NzP4jblaIlFuWn_0 2024-09-12T19:23:00.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.462+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4261327515037850770', time=2024-09-12T20:38:53.337329+0000, chain.objs.size()=1 2024-09-12T19:23:00.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.462+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.y8lyIeBG6U3ewXKKCyt_vo0BmlQi2Pu_0 2024-09-12T19:23:00.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.462+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4152656759327869890', time=2024-09-12T20:38:53.760549+0000, chain.objs.size()=1 2024-09-12T19:23:00.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.462+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.8Zco2d0ht_EDMbECxbM-SUREFdjPCa2_0 2024-09-12T19:23:00.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.462+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4172309504497170419', time=2024-09-12T20:38:55.474197+0000, chain.objs.size()=1 2024-09-12T19:23:00.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.462+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.qVQIW17edP2YnvpvzKQPXvtfFOvWLho_0 2024-09-12T19:23:00.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.462+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16233926730718645144', time=2024-09-12T20:38:56.734190+0000, chain.objs.size()=1 2024-09-12T19:23:00.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.462+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.lJNjlNrVzo-WY4SZP2sW5mYVD6_etbJ_0 2024-09-12T19:23:00.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.466+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16506078715813849052', time=2024-09-12T20:38:57.286818+0000, chain.objs.size()=1 2024-09-12T19:23:00.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.466+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.V_WopKaOtBbn86wAZ4EmxHti38m5bU0_0 2024-09-12T19:23:00.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.466+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15850311047461640881', time=2024-09-12T20:38:59.596350+0000, chain.objs.size()=1 2024-09-12T19:23:00.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.466+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.AryMLBjBc0rZgMga_wf0S4MKJUsM94K_0 2024-09-12T19:23:00.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43575 2024-09-12T19:23:00.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T19:23:00.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.974367893503196133', time=2024-09-12T20:38:59.699705+0000, chain.objs.size()=1 2024-09-12T19:23:00.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.eTACTzzPzta4eQlVSSjxbDSIt06KcR5_0 2024-09-12T19:23:00.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10411378959869320548', time=2024-09-12T20:39:01.376614+0000, chain.objs.size()=1 2024-09-12T19:23:00.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.IyxZXHbwbzgtc4bGKTcDGHE-SG7y3H-_0 2024-09-12T19:23:00.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8597624399744546759', time=2024-09-12T20:39:05.842125+0000, chain.objs.size()=1 2024-09-12T19:23:00.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.jzlOBmd4eRz_Zl2izGyV3krukDqNaKT_0 2024-09-12T19:23:00.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9112783256147701148', time=2024-09-12T20:39:06.583530+0000, chain.objs.size()=1 2024-09-12T19:23:00.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.4l8rHTFcGAfZLo0bk17EBxQ2yzD81MA_0 2024-09-12T19:23:00.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3966853757392649058', time=2024-09-12T20:39:07.695071+0000, chain.objs.size()=1 2024-09-12T19:23:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.AKNxXQTUsyH6eBBBOzMYzqSRmV92j42_0 2024-09-12T19:23:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6401095961507908761', time=2024-09-12T20:39:23.402761+0000, chain.objs.size()=1 2024-09-12T19:23:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.332__shadow_.cQAG68sFc5MUUyU5vrRh6v6yvLTOb9V_0 2024-09-12T19:23:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.494027634481895638', time=2024-09-12T20:39:37.264934+0000, chain.objs.size()=1 2024-09-12T19:23:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.339__shadow_.ddrR73zVggGFBnOEHt6SRwutRYJeJ6i_0 2024-09-12T19:23:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14142173548942524785', time=2024-09-12T20:40:55.875481+0000, chain.objs.size()=1 2024-09-12T19:23:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.379__shadow_.diASythBm40na-6Lje8UaXxIxU7jTtS_0 2024-09-12T19:23:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8978273669758122307', time=2024-09-12T20:44:07.383454+0000, chain.objs.size()=1 2024-09-12T19:23:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.466__shadow_.pShnPl27pdUvUei0JYn1La_XctHPly7_0 2024-09-12T19:23:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12183352489918110850', time=2024-09-12T20:44:33.731287+0000, chain.objs.size()=1 2024-09-12T19:23:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.483__shadow_.dQVFGWbB1AuCCspEVxgsvXrAEfAwyd-_0 2024-09-12T19:23:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.940966695812899882', time=2024-09-12T20:44:36.443370+0000, chain.objs.size()=1 2024-09-12T19:23:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.484__shadow_.NSP9_XdGXOa1jpHgxabLGstZiuOxYkB_0 2024-09-12T19:23:00.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15677682286491256301', time=2024-09-12T20:46:06.593635+0000, chain.objs.size()=6 2024-09-12T19:23:00.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.474+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.1 2024-09-12T19:23:00.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.478+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.2 2024-09-12T19:23:00.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.482+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.3 2024-09-12T19:23:00.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.482+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.4 2024-09-12T19:23:00.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.482+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.5 2024-09-12T19:23:00.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.6 2024-09-12T19:23:00.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1706346137393640327', time=2024-09-12T20:48:14.544111+0000, chain.objs.size()=1 2024-09-12T19:23:00.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.520__shadow:UmHhz9arZyjoWuLU2C.6HUewDO24Yj9_.AiBXvQIRCiHvdHMcxPg5oRCVrJesSHq_0 2024-09-12T19:23:00.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3497096586764431485', time=2024-09-12T20:52:19.762933+0000, chain.objs.size()=2 2024-09-12T19:23:00.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.525__multipart_mymultipart.2~L1PKgkq5QQMc6PVQw-qQFmAlOQQz8zU.1 2024-09-12T19:23:00.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.525__multipart_mymultipart.2~L1PKgkq5QQMc6PVQw-qQFmAlOQQz8zU.2 2024-09-12T19:23:00.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6932663357768336696', time=2024-09-12T20:52:30.204981+0000, chain.objs.size()=3 2024-09-12T19:23:00.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.525__multipart_mymultipart.2~SUv0yLRz_c5JVj01_4rYmke4gE1sVst.1 2024-09-12T19:23:00.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.525__multipart_mymultipart.2~SUv0yLRz_c5JVj01_4rYmke4gE1sVst.2 2024-09-12T19:23:00.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.525__multipart_mymultipart.2~SUv0yLRz_c5JVj01_4rYmke4gE1sVst.3 2024-09-12T19:23:00.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~-XH-GRCZz6NEtgVnyitHAqHpu6-p5jV', time=2024-09-12T20:53:26.952263+0000, chain.objs.size()=1 2024-09-12T19:23:00.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.531__multipart_mymultipart2.2~-XH-GRCZz6NEtgVnyitHAqHpu6-p5jV.1 2024-09-12T19:23:00.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9695330936617718239', time=2024-09-12T20:55:47.137791+0000, chain.objs.size()=1 2024-09-12T19:23:00.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.556__shadow_.W_47KAPDFpChBzaeAidE1C1X8F25uGh_0 2024-09-12T19:23:00.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10786322954691572611', time=2024-09-12T20:57:54.420093+0000, chain.objs.size()=1 2024-09-12T19:23:00.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:L9lUMexn2D32RctWtCw5QwsNwHPNNLs_.NLNfVrQyZPsNvsyGdq9dex9HrYZqser_0 2024-09-12T19:23:00.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2664258284684588262', time=2024-09-12T20:58:03.779610+0000, chain.objs.size()=1 2024-09-12T19:23:00.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:UfAoImOm0WyCqcshKZcSc.b9iymZMTi_.lwP3bEjQEk3hW_eViegBTlqgftxKKKg_0 2024-09-12T19:23:00.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.490+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7269341413533807288', time=2024-09-12T20:58:15.816450+0000, chain.objs.size()=1 2024-09-12T19:23:00.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.490+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:LS1YjVErRcWZP8n51USFZUghkJKVIJX_.7DSt-ubOlVg8F_SxiUQoWlbMm5vsU5d_0 2024-09-12T19:23:00.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.490+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2788988003685585183', time=2024-09-12T20:59:40.784178+0000, chain.objs.size()=1 2024-09-12T19:23:00.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.490+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.583__shadow:2FvofSSmjEHB2wsoNcnLdwck49U5ST5_.WyA0tUQnSV1VdX4wIZ-CI8Qoc-50ZPR_0 2024-09-12T19:23:00.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.490+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10493225577331792595', time=2024-09-12T21:09:39.254446+0000, chain.objs.size()=1 2024-09-12T19:23:00.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.490+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.664__shadow_.UE_kyqk9sFaNhUatf796_l9elr1Bw5u_0 2024-09-12T19:23:00.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.494+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:00.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.498+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T19:23:00.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:00.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:00.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46902' 2024-09-12T19:23:00.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12811952802205394016', time=2024-09-12T20:24:12.112966+0000, chain.objs.size()=1 2024-09-12T19:23:00.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.179__shadow_.7Ir_XZRE6gwQ5XkCy5Gymq0i2WDaHsr_0 2024-09-12T19:23:00.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2474395394487727492', time=2024-09-12T20:29:09.132195+0000, chain.objs.size()=1 2024-09-12T19:23:00.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.239__shadow_.0sBKgmUf6VDRHH6xB33O2HNB8KeyWhN_0 2024-09-12T19:23:00.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5862344611439122925', time=2024-09-12T20:29:13.237825+0000, chain.objs.size()=1 2024-09-12T19:23:00.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.241__shadow_.KWj16ACLJjl9SAGXSy89vtkJo4x6qzz_0 2024-09-12T19:23:00.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10520132329921728338', time=2024-09-12T20:29:19.435506+0000, chain.objs.size()=1 2024-09-12T19:23:00.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.243__shadow_.SGlilsV-R7cm0z6sG55gGRHlcwfZ47i_0 2024-09-12T19:23:00.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7575693167985310898', time=2024-09-12T20:31:45.883188+0000, chain.objs.size()=1 2024-09-12T19:23:00.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.5jSkPGdUCUPV5NxI-OZKe4kZEIBCIs8_0 2024-09-12T19:23:00.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10342942451936439555', time=2024-09-12T20:31:46.429014+0000, chain.objs.size()=1 2024-09-12T19:23:00.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.v0JvKtX270EEdXS0-OKh0K79w8YWlku_0 2024-09-12T19:23:00.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7296012222396455568', time=2024-09-12T20:31:50.529230+0000, chain.objs.size()=1 2024-09-12T19:23:00.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.BgwpCTjl1hyge5kT1051VUOoOSrdS_B_0 2024-09-12T19:23:00.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4467771282003338336', time=2024-09-12T20:31:53.648813+0000, chain.objs.size()=1 2024-09-12T19:23:00.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.RMFGuEUJTyYEk-rdyBGw7tl4kJuEnaw_0 2024-09-12T19:23:00.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16996681329740542401', time=2024-09-12T20:31:55.515436+0000, chain.objs.size()=1 2024-09-12T19:23:00.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.aAAxp0O4Ui1vVwpg_s2zMSTrllSloCZ_0 2024-09-12T19:23:00.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17044867750220567326', time=2024-09-12T20:31:55.779665+0000, chain.objs.size()=1 2024-09-12T19:23:00.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ryg0PptRNpVlzf-KWPwt89H-P3uKSgR_0 2024-09-12T19:23:00.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10349478507005577391', time=2024-09-12T20:31:57.385131+0000, chain.objs.size()=1 2024-09-12T19:23:00.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.xtv7VF1hxzHw98WmyCFnvz4UAVnGnZO_0 2024-09-12T19:23:00.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10991423679168670853', time=2024-09-12T20:31:57.932275+0000, chain.objs.size()=1 2024-09-12T19:23:00.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.me0gJ2VJEIL64xzQRItBQaoE8vEb_Pr_0 2024-09-12T19:23:00.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13602346077806654806', time=2024-09-12T20:32:01.149261+0000, chain.objs.size()=1 2024-09-12T19:23:00.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.zbFATPMRAyzS2hY17XnV4hvuG_Wwlp__0 2024-09-12T19:23:00.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8231971982247858482', time=2024-09-12T20:32:01.285775+0000, chain.objs.size()=1 2024-09-12T19:23:00.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.nOIiVqX2SSjg51ComxJdUnfOUYUBU2a_0 2024-09-12T19:23:00.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8288485361504917329', time=2024-09-12T20:32:02.025803+0000, chain.objs.size()=1 2024-09-12T19:23:00.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ZEDzBDW4LfIUfv-5o7l4ZP0-KFBEjr-_0 2024-09-12T19:23:00.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6220054060419810916', time=2024-09-12T20:32:02.928829+0000, chain.objs.size()=1 2024-09-12T19:23:00.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.SScwF7Xe2S6-H6r_lPwN_rwady5jMRw_0 2024-09-12T19:23:00.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6948965875528245632', time=2024-09-12T20:32:06.581702+0000, chain.objs.size()=1 2024-09-12T19:23:00.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.j7DIV0si35hH193o3ploBqutnZ91wSe_0 2024-09-12T19:23:00.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6580074355180589894', time=2024-09-12T20:32:06.636562+0000, chain.objs.size()=1 2024-09-12T19:23:00.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.q6QI_Ap72T4bY5TWaHf5wQ5wlWBexbv_0 2024-09-12T19:23:00.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18048087939381715365', time=2024-09-12T20:32:08.949261+0000, chain.objs.size()=1 2024-09-12T19:23:00.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.64DVh9kGMsPXSIcNRE2w7jIe-Q1jgNY_0 2024-09-12T19:23:00.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16828641873876008102', time=2024-09-12T20:32:11.758033+0000, chain.objs.size()=1 2024-09-12T19:23:00.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.4lok-RIR2lpK4-3Q1WGa3CgmMM_paOq_0 2024-09-12T19:23:00.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.586334264938971918', time=2024-09-12T20:32:12.534475+0000, chain.objs.size()=1 2024-09-12T19:23:00.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.7zMUf9iZjM1Qli19TEdxSQn5QSsijf0_0 2024-09-12T19:23:00.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3268236555081513662', time=2024-09-12T20:32:12.793534+0000, chain.objs.size()=1 2024-09-12T19:23:00.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.9j6zfi_jQPziMSKwDo1x7fI9IR08BB-_0 2024-09-12T19:23:00.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1170129855774777273', time=2024-09-12T20:32:13.010828+0000, chain.objs.size()=1 2024-09-12T19:23:00.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Bz-ms1bdpK8Hy9_9LJE4HJ2y2BfTX_-_0 2024-09-12T19:23:00.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9887255517444595677', time=2024-09-12T20:32:13.234177+0000, chain.objs.size()=1 2024-09-12T19:23:00.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.510+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.FFRedh9q0E4mJEZoqmndJmV69ZTeSKW_0 2024-09-12T19:23:00.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12305049914656765116', time=2024-09-12T20:32:13.378201+0000, chain.objs.size()=1 2024-09-12T19:23:00.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.b3em8lYfCjAve_FwRGJH57VzqcI2esH_0 2024-09-12T19:23:00.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6138529215835231383', time=2024-09-12T20:33:38.537577+0000, chain.objs.size()=1 2024-09-12T19:23:00.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.296__shadow_.mLZiME_TojiVdjbr4WLmpchTHFWbwAy_0 2024-09-12T19:23:00.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18040920025254240921', time=2024-09-12T20:34:02.103207+0000, chain.objs.size()=1 2024-09-12T19:23:00.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.306__shadow_.nb6zPuDGBlwt3wStJzV7kgq2ZxJNrZC_0 2024-09-12T19:23:00.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.384120277143478379', time=2024-09-12T20:36:29.475030+0000, chain.objs.size()=1 2024-09-12T19:23:00.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.xfs9KjLjb2hgzRW6JMkzeuVRYI5b_uK_0 2024-09-12T19:23:00.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15917394675206557357', time=2024-09-12T20:36:29.843942+0000, chain.objs.size()=1 2024-09-12T19:23:00.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.tHkCZR0k-7QH2-NDyqsgUhrFYM-zv1M_0 2024-09-12T19:23:00.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9735200936105448919', time=2024-09-12T20:36:32.718606+0000, chain.objs.size()=1 2024-09-12T19:23:00.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.EAzR1WqDjQ0vj5chzFgtQvdcu4SZz6Q_0 2024-09-12T19:23:00.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5218171968053525748', time=2024-09-12T20:36:33.936307+0000, chain.objs.size()=1 2024-09-12T19:23:00.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Q03BA7cPd_SBKe7O4ow2XwqIq-NQ9Xp_0 2024-09-12T19:23:00.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8767640554613669345', time=2024-09-12T20:36:36.268612+0000, chain.objs.size()=1 2024-09-12T19:23:00.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.4mg-sulcn310qnrtR-X_annNwfPntdP_0 2024-09-12T19:23:00.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12845187656658084534', time=2024-09-12T20:36:37.692282+0000, chain.objs.size()=1 2024-09-12T19:23:00.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.EwUsIC2U9hOimQLc65W99VsY4pafyFM_0 2024-09-12T19:23:00.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13278973294893660714', time=2024-09-12T20:36:37.964908+0000, chain.objs.size()=1 2024-09-12T19:23:00.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.IDxh9LoCMGvBUdFHVQczipbNax8eRxj_0 2024-09-12T19:23:00.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11197279769750158639', time=2024-09-12T20:36:38.058065+0000, chain.objs.size()=1 2024-09-12T19:23:00.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.JNPCXu_7Ha6IoIPCxbNmhxEFXQtrmjV_0 2024-09-12T19:23:00.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.518+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13671234172872328516', time=2024-09-12T20:36:38.247745+0000, chain.objs.size()=1 2024-09-12T19:23:00.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.518+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.UPpLNXDgB3kirQ9haL5Gl9UV7N5VrQ5_0 2024-09-12T19:23:00.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.518+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7035961097409598604', time=2024-09-12T20:36:40.717191+0000, chain.objs.size()=1 2024-09-12T19:23:00.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.518+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.f8_wGAM3vmoakwOmIRWigf0wy9Y7q4T_0 2024-09-12T19:23:00.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.518+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3697788842853842476', time=2024-09-12T20:36:40.879545+0000, chain.objs.size()=1 2024-09-12T19:23:00.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.518+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.LpWokKpXr_9sSbc5N3vNeAYhqkLafGU_0 2024-09-12T19:23:00.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.522+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11242304887025644193', time=2024-09-12T20:36:41.428248+0000, chain.objs.size()=1 2024-09-12T19:23:00.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.522+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Ayqgz-_9iGDFRQRr13DbdM8HcA8I_s9_0 2024-09-12T19:23:00.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.522+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8886051543443871577', time=2024-09-12T20:36:42.024058+0000, chain.objs.size()=1 2024-09-12T19:23:00.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.522+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.iiRuX6lfujOukXxc-I6WU0pDpaPj46c_0 2024-09-12T19:23:00.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.522+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9081165931248817861', time=2024-09-12T20:36:44.870577+0000, chain.objs.size()=1 2024-09-12T19:23:00.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.522+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.AAO2Y-aPnJaBWd-GJbhhiSduGTnEmv4_0 2024-09-12T19:23:00.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.522+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1669219960579867653', time=2024-09-12T20:36:48.232315+0000, chain.objs.size()=1 2024-09-12T19:23:00.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.522+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.lruMyvK5N2czsqSH9mXVDthFk9SdCAh_0 2024-09-12T19:23:00.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.522+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6269880385260879685', time=2024-09-12T20:36:48.489511+0000, chain.objs.size()=1 2024-09-12T19:23:00.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.522+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.1YLXshBSkM-Ywlmr-4MWrTH3QAV7snj_0 2024-09-12T19:23:00.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.522+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5428026169751138827', time=2024-09-12T20:36:48.559737+0000, chain.objs.size()=1 2024-09-12T19:23:00.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.522+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.VEPdx3zIpSGoqKmLeAp4YK7UoMS8EVa_0 2024-09-12T19:23:00.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.522+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17046031218721076790', time=2024-09-12T20:36:49.751070+0000, chain.objs.size()=1 2024-09-12T19:23:00.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.522+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.6Qf--m_FAPb3TBFcdk6DULiQL9r6xwx_0 2024-09-12T19:23:00.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.522+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1784280255993063185', time=2024-09-12T20:36:49.790844+0000, chain.objs.size()=1 2024-09-12T19:23:00.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.522+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.kNHeU4yWQDiB1vmPFL3Uuvt5pJaQkNM_0 2024-09-12T19:23:00.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7941205589927451299', time=2024-09-12T20:36:51.210323+0000, chain.objs.size()=1 2024-09-12T19:23:00.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.YQN5xpDrmHuzKazJBGw5-9hbt2kHkBt_0 2024-09-12T19:23:00.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2432765514083661570', time=2024-09-12T20:36:51.318601+0000, chain.objs.size()=1 2024-09-12T19:23:00.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Scs_f6RKJ22-93Yqx94AH3cKjyXAr3E_0 2024-09-12T19:23:00.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17890050419632640422', time=2024-09-12T20:36:51.974899+0000, chain.objs.size()=1 2024-09-12T19:23:00.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.YUFurNyNnfuZkI1UuHS1U-WZ4VQE5Gs_0 2024-09-12T19:23:00.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3323601678731288903', time=2024-09-12T20:36:52.212524+0000, chain.objs.size()=1 2024-09-12T19:23:00.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.V6d_te0NwYVhOvRdHkko4Ct40xIjl06_0 2024-09-12T19:23:00.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.530+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9817002503303417932', time=2024-09-12T20:36:52.595770+0000, chain.objs.size()=1 2024-09-12T19:23:00.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.530+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_._6kIT3MB_ACkhfmHR6gXASze_mFqih-_0 2024-09-12T19:23:00.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.530+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.743620204626972762', time=2024-09-12T20:36:52.755089+0000, chain.objs.size()=1 2024-09-12T19:23:00.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.530+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.K1VmASOOGmCj30e555WbIrpAMGhySCO_0 2024-09-12T19:23:00.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.530+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14040551798112401674', time=2024-09-12T20:36:54.246003+0000, chain.objs.size()=1 2024-09-12T19:23:00.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.530+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.jSDCEOfKvWs4oxADvy3s7XL_Ol5Pp-v_0 2024-09-12T19:23:00.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.530+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6606385021774751909', time=2024-09-12T20:36:55.567038+0000, chain.objs.size()=1 2024-09-12T19:23:00.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.530+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.GEjbBr4Qhzgd9NYnwV9BlQeZ-N4ObPR_0 2024-09-12T19:23:00.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.530+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.629196301645553315', time=2024-09-12T20:36:55.996797+0000, chain.objs.size()=1 2024-09-12T19:23:00.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.530+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.04B0tVkJZyKLu97MN92HC4gA3IJV_FU_0 2024-09-12T19:23:00.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.530+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1926722419143950245', time=2024-09-12T20:38:40.710609+0000, chain.objs.size()=1 2024-09-12T19:23:00.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.530+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.X6W8Dfc6pT4qGvPcMbAVXDuVKFAtVaU_0 2024-09-12T19:23:00.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.530+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9039809569387465543', time=2024-09-12T20:38:41.200828+0000, chain.objs.size()=1 2024-09-12T19:23:00.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.530+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.mNvPQtBCc0q3M1XmIYxmdiRhvedWgj9_0 2024-09-12T19:23:00.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.530+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3558940721428811523', time=2024-09-12T20:38:44.867581+0000, chain.objs.size()=1 2024-09-12T19:23:00.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.530+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.TRmnGzvYGc0jBsm-TOlfLA607tzbY6F_0 2024-09-12T19:23:00.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.530+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9285583961036889692', time=2024-09-12T20:38:46.179677+0000, chain.objs.size()=1 2024-09-12T19:23:00.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.530+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.mLKsn0_Y6E0ruyUlOTSiBD4MVSZ6RF4_0 2024-09-12T19:23:00.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.534+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11150053917632809220', time=2024-09-12T20:38:46.397446+0000, chain.objs.size()=1 2024-09-12T19:23:00.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.534+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.m9ERKwdO-UvoveVXlB4ExKWb_NAMvim_0 2024-09-12T19:23:00.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.534+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17259450969108518766', time=2024-09-12T20:38:47.873598+0000, chain.objs.size()=1 2024-09-12T19:23:00.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.534+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.laLOTyVmDrkS5vUlkCPX41BHpCALu1t_0 2024-09-12T19:23:00.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5744031935179659033', time=2024-09-12T20:38:48.044936+0000, chain.objs.size()=1 2024-09-12T19:23:00.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.JZiKeC6ZLyeWNxCIL0Mr-8lszIOvCXe_0 2024-09-12T19:23:00.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2916971664765662989', time=2024-09-12T20:38:49.516520+0000, chain.objs.size()=1 2024-09-12T19:23:00.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.UkyvKD5V1-HMnfc7hZDy3GkaNx7OXkx_0 2024-09-12T19:23:00.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7690490615785543783', time=2024-09-12T20:38:49.861603+0000, chain.objs.size()=1 2024-09-12T19:23:00.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.oDSFJMQy7nDbqBox-fG1qYJcjdMOgxG_0 2024-09-12T19:23:00.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.376526502938671770', time=2024-09-12T20:38:51.226885+0000, chain.objs.size()=1 2024-09-12T19:23:00.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.TczWgkE6fsu7Vgu_Pw1PkZXUhfah5RG_0 2024-09-12T19:23:00.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5851801374211963130', time=2024-09-12T20:38:51.770356+0000, chain.objs.size()=1 2024-09-12T19:23:00.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.fqJCN4kmKu0FpkFCjSEuu-Yg4vMlm_m_0 2024-09-12T19:23:00.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1799978817168021342', time=2024-09-12T20:38:52.068765+0000, chain.objs.size()=1 2024-09-12T19:23:00.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-tHeqRazkyrJ1UpnZM8uMsQIL2vCLok_0 2024-09-12T19:23:00.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10026625530872249661', time=2024-09-12T20:38:53.226473+0000, chain.objs.size()=1 2024-09-12T19:23:00.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.naLuOlSB05ZEwYeqE8Z-GC83kmcoet7_0 2024-09-12T19:23:00.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14086936040507169069', time=2024-09-12T20:38:53.663254+0000, chain.objs.size()=1 2024-09-12T19:23:00.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.0X5QP-4RWn-vpDkUTGcknQAYak-BZ52_0 2024-09-12T19:23:00.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13250994177214949932', time=2024-09-12T20:38:53.791282+0000, chain.objs.size()=1 2024-09-12T19:23:00.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.e2wiCS-lfD4mF5d88N5yJmTrGJ631xu_0 2024-09-12T19:23:00.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5223690015565354881', time=2024-09-12T20:38:54.079361+0000, chain.objs.size()=1 2024-09-12T19:23:00.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.q8LTDpoiOmwEqssaRTlnmsG1Q-mhEYC_0 2024-09-12T19:23:00.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4420849337707612924', time=2024-09-12T20:38:55.038858+0000, chain.objs.size()=1 2024-09-12T19:23:00.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.UaeJenENJgGbCR7xLWneKQxzjX3_Yjs_0 2024-09-12T19:23:00.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13466702892500384084', time=2024-09-12T20:38:55.042760+0000, chain.objs.size()=1 2024-09-12T19:23:00.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.pKQoqbms7c2oK8OSaojN-rnO7z1HUWj_0 2024-09-12T19:23:00.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.542+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2449257722706084449', time=2024-09-12T20:38:56.904158+0000, chain.objs.size()=1 2024-09-12T19:23:00.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.542+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.0P8LKmvpPSxFdbgXw1_s6bV2tKbKYnK_0 2024-09-12T19:23:00.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3945657309440114532', time=2024-09-12T20:38:56.961681+0000, chain.objs.size()=1 2024-09-12T19:23:00.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Sj8-l_jk2ZhbNd6-hNJsO68t2WMSYbk_0 2024-09-12T19:23:00.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6857743009092332109', time=2024-09-12T20:38:57.532934+0000, chain.objs.size()=1 2024-09-12T19:23:00.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ayrMVPn1YGZoctDZaUoxa0qU5mAfWgx_0 2024-09-12T19:23:00.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16722289020632623573', time=2024-09-12T20:38:57.657177+0000, chain.objs.size()=1 2024-09-12T19:23:00.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.z8SH0v1ViViv8TLN2EWyOeCmDHmEbJp_0 2024-09-12T19:23:00.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7685541475503755210', time=2024-09-12T20:38:57.805950+0000, chain.objs.size()=1 2024-09-12T19:23:00.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.xqVTnpLAeufiPgQjelEQ9BW4_PAufw1_0 2024-09-12T19:23:00.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.382283509268424378', time=2024-09-12T20:38:58.595580+0000, chain.objs.size()=1 2024-09-12T19:23:00.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.QPmcIggq62i8rW7FL8RiTiwRsxvRp-4_0 2024-09-12T19:23:00.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8766280263401641525', time=2024-09-12T20:38:58.663546+0000, chain.objs.size()=1 2024-09-12T19:23:00.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ng4aQXAvJNuZoZntYzsOgj0rDZfSWlL_0 2024-09-12T19:23:00.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16250111503176199737', time=2024-09-12T20:38:58.665470+0000, chain.objs.size()=1 2024-09-12T19:23:00.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.onOYYeldY6pIvvtbGnLzH4ypv6Kj3A6_0 2024-09-12T19:23:00.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16877725898005443379', time=2024-09-12T20:38:59.134926+0000, chain.objs.size()=1 2024-09-12T19:23:00.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.wEsUo552IlG8qeamV6xKL3OzgusJzjF_0 2024-09-12T19:23:00.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8397913422512196812', time=2024-09-12T20:38:59.399470+0000, chain.objs.size()=1 2024-09-12T19:23:00.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Rpv8ng4VAUD4jSzLpo3s7hX-sbDG6Ho_0 2024-09-12T19:23:00.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12466271623522723857', time=2024-09-12T20:39:00.096256+0000, chain.objs.size()=1 2024-09-12T19:23:00.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.PZ-d7lyjoZCKXQIFlnr95NwySZKjko9_0 2024-09-12T19:23:00.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17669108649472994314', time=2024-09-12T20:39:02.256192+0000, chain.objs.size()=1 2024-09-12T19:23:00.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.546+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.zKkRxPTwcU0L5-kIEvWqlwpKIkiV1NX_0 2024-09-12T19:23:00.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14284930073947241056', time=2024-09-12T20:39:02.565255+0000, chain.objs.size()=1 2024-09-12T19:23:00.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.HWbF8w9KNbgII7ZbBZfsAxNc692k6VG_0 2024-09-12T19:23:00.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2116212456017143443', time=2024-09-12T20:39:04.012202+0000, chain.objs.size()=1 2024-09-12T19:23:00.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.2VJczHrD7l3lL5Pz9K-aOkQ9agTXprx_0 2024-09-12T19:23:00.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12479490824557027311', time=2024-09-12T20:39:04.310194+0000, chain.objs.size()=1 2024-09-12T19:23:00.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.qhOPvtpSMiUtj1w6F5DLdMR69Rr-ZEY_0 2024-09-12T19:23:00.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.88910790138062967', time=2024-09-12T20:39:04.312380+0000, chain.objs.size()=1 2024-09-12T19:23:00.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.5XExqlbkvcQOD-VYnRFlSezlufUGfz-_0 2024-09-12T19:23:00.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11205510084564289396', time=2024-09-12T20:39:04.436193+0000, chain.objs.size()=1 2024-09-12T19:23:00.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.0LHs6xID8cP4TmfghwuXQWZaP1yonsy_0 2024-09-12T19:23:00.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10525872617960454341', time=2024-09-12T20:39:04.585531+0000, chain.objs.size()=1 2024-09-12T19:23:00.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.t2X_ScNSedv0-wne-DuW8JMuuYptkJm_0 2024-09-12T19:23:00.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9513301385038715299', time=2024-09-12T20:39:06.567926+0000, chain.objs.size()=1 2024-09-12T19:23:00.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.LGehd6P4p792gys3ZMRbRf9y8mUcNdg_0 2024-09-12T19:23:00.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4313372811294613474', time=2024-09-12T20:39:07.227484+0000, chain.objs.size()=1 2024-09-12T19:23:00.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.P8a5IK06ASVQ_jz7mnTvfZQfo4Bnbn1_0 2024-09-12T19:23:00.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16326002109736940572', time=2024-09-12T20:39:07.819491+0000, chain.objs.size()=1 2024-09-12T19:23:00.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.zEdtyhXDTcleYGKcs8NGoEUoLToUk8x_0 2024-09-12T19:23:00.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.554+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8700832612239406744', time=2024-09-12T20:42:53.517406+0000, chain.objs.size()=1 2024-09-12T19:23:00.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.554+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.437__shadow_.k64hOEV4KJ5-UDRDDUQxga4NEHMTrzE_0 2024-09-12T19:23:00.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.554+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5317741127213034746', time=2024-09-12T20:43:23.664447+0000, chain.objs.size()=1 2024-09-12T19:23:00.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.554+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.450__shadow_.8Xn3X5ArFtKKBm3x5pIjJFNTVvqZ0Q2_0 2024-09-12T19:23:00.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.554+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5669521333885121364', time=2024-09-12T20:43:46.653494+0000, chain.objs.size()=1 2024-09-12T19:23:00.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.554+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.459__shadow_.080Sl_p_e3NAN6-XEtDpUdTk16Dt-HX_0 2024-09-12T19:23:00.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.554+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11262228131352038214', time=2024-09-12T20:43:49.692022+0000, chain.objs.size()=1 2024-09-12T19:23:00.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.554+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.460__shadow_.bMueWNDqV4HKr33mS07FLRbJ1d2KizA_0 2024-09-12T19:23:00.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.751255139972962022', time=2024-09-12T20:43:58.563769+0000, chain.objs.size()=1 2024-09-12T19:23:00.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.463__shadow_.05hq-SD32X4sBbNcSrbunhV3xGP75Hn_0 2024-09-12T19:23:00.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12233991993723264376', time=2024-09-12T20:44:01.465706+0000, chain.objs.size()=1 2024-09-12T19:23:00.562 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.464__shadow_.zprpwE7Ksb6jiK18YSUK01P_yXQlHMb_0 2024-09-12T19:23:00.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46902 2024-09-12T19:23:00.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.562+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T19:23:00.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.562+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9441477708393616595', time=2024-09-12T20:44:01.488397+0000, chain.objs.size()=1 2024-09-12T19:23:00.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.464__shadow_.VJypGWpX--muak1h6hzh_SxFr0L4vDm_0 2024-09-12T19:23:00.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.562+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7650424974711527091', time=2024-09-12T20:44:33.668721+0000, chain.objs.size()=1 2024-09-12T19:23:00.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.483__shadow_.RtGZOS-Qsfn82RqDdQViU2j2Zdn6X5g_0 2024-09-12T19:23:00.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.562+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9561084343871116043', time=2024-09-12T20:44:33.741641+0000, chain.objs.size()=1 2024-09-12T19:23:00.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.483__shadow_.gvfGNxZx5FiBHfd9H6vXv4VygUp2lz__0 2024-09-12T19:23:00.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.562+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7644382728781588405', time=2024-09-12T20:46:06.560454+0000, chain.objs.size()=6 2024-09-12T19:23:00.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.1 2024-09-12T19:23:00.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.2 2024-09-12T19:23:00.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.3 2024-09-12T19:23:00.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.4 2024-09-12T19:23:00.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.5 2024-09-12T19:23:00.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.6 2024-09-12T19:23:00.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.562+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~CWZAFyJ6_vS5Fi4RKPavPn4oNrBGtOf', time=2024-09-12T20:53:31.896882+0000, chain.objs.size()=1 2024-09-12T19:23:00.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.533__multipart_mymultipart.2~CWZAFyJ6_vS5Fi4RKPavPn4oNrBGtOf.1 2024-09-12T19:23:00.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.562+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6247566079569956962', time=2024-09-12T20:56:49.796044+0000, chain.objs.size()=1 2024-09-12T19:23:00.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:YarS.-9H2D497sN6EkYgYqy1rIbphMq_.w457fAuUhTH6-e-m9NJD9_gUJmBEYQf_0 2024-09-12T19:23:00.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.562+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2090610634225057633', time=2024-09-12T20:57:02.153605+0000, chain.objs.size()=1 2024-09-12T19:23:00.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:sDydewISuY1HS-zVZJiNe2PV0Ih2gmJ_.gtMbbwm00xpN9zI74Se8Uus234AmuS0_0 2024-09-12T19:23:00.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.566+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13372199658992315511', time=2024-09-12T20:58:23.223285+0000, chain.objs.size()=1 2024-09-12T19:23:00.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:5ht9qpL3kI2bcompeTlXs6GCpIhmVnm_.Lp4B3X35kjzkK8elP_HY5x90hbMY8LQ_0 2024-09-12T19:23:00.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.566+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16042531332658411866', time=2024-09-12T20:59:29.138486+0000, chain.objs.size()=1 2024-09-12T19:23:00.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.579__shadow:5szhl.SwL3Ot6A7j8wBBZHW9u3edQX0_.nkEvjGzQAIB8zqA6RxOrw6UIGP-D_Ch_0 2024-09-12T19:23:00.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.566+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17150171412052581945', time=2024-09-12T21:01:50.000432+0000, chain.objs.size()=6 2024-09-12T19:23:00.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.613__multipart_multipart_enc.2~NFL7cwwfzckhG_sc8nUUsTUHb-1w100.1 2024-09-12T19:23:00.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.613__multipart_multipart_enc.2~NFL7cwwfzckhG_sc8nUUsTUHb-1w100.2 2024-09-12T19:23:00.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.613__multipart_multipart_enc.2~NFL7cwwfzckhG_sc8nUUsTUHb-1w100.3 2024-09-12T19:23:00.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.613__multipart_multipart_enc.2~NFL7cwwfzckhG_sc8nUUsTUHb-1w100.4 2024-09-12T19:23:00.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.613__multipart_multipart_enc.2~NFL7cwwfzckhG_sc8nUUsTUHb-1w100.5 2024-09-12T19:23:00.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.613__multipart_multipart_enc.2~NFL7cwwfzckhG_sc8nUUsTUHb-1w100.6 2024-09-12T19:23:00.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.566+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1264274480329683023', time=2024-09-12T21:04:20.407232+0000, chain.objs.size()=1 2024-09-12T19:23:00.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.617__shadow_.vTdwh9WtyMMnX8WP6v6QgM_e-gqjwkt_0 2024-09-12T19:23:00.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.566+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7969798373040644067', time=2024-09-12T21:08:23.695113+0000, chain.objs.size()=1 2024-09-12T19:23:00.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.653__shadow_.XEI_Qc-xs-inTimcnATIyVbM4mo7VgW_0 2024-09-12T19:23:00.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.566+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7988574094057392149', time=2024-09-12T21:09:42.313447+0000, chain.objs.size()=1 2024-09-12T19:23:00.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.665__shadow_.0uqzmMmfeZxJm_8AHfpfm5fvhGAUaVI_0 2024-09-12T19:23:00.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.570+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13551500201355468433', time=2024-09-12T21:13:14.516773+0000, chain.objs.size()=3 2024-09-12T19:23:00.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.570+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.743__multipart_mymultipart3.2~5Xf60bKBmSoxoLOtznB99SFArv8lx1W.1 2024-09-12T19:23:00.577 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.570+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.743__multipart_mymultipart3.2~5Xf60bKBmSoxoLOtznB99SFArv8lx1W.2 2024-09-12T19:23:00.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.574+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.743__multipart_mymultipart3.2~5Xf60bKBmSoxoLOtznB99SFArv8lx1W.3 2024-09-12T19:23:00.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.578+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:00.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.582+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T19:23:00.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:00.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:00.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50641' 2024-09-12T19:23:00.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3677528488201320615', time=2024-09-12T20:23:01.559172+0000, chain.objs.size()=3 2024-09-12T19:23:00.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.161__multipart_foo-LUKEWARM.2~muiCX9k3eicjP8kog-npro9uBnX5zEz.1 2024-09-12T19:23:00.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.161__multipart_foo-LUKEWARM.2~muiCX9k3eicjP8kog-npro9uBnX5zEz.2 2024-09-12T19:23:00.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.161__multipart_foo-LUKEWARM.2~muiCX9k3eicjP8kog-npro9uBnX5zEz.3 2024-09-12T19:23:00.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6942680356451973394', time=2024-09-12T20:28:59.421818+0000, chain.objs.size()=1 2024-09-12T19:23:00.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.236__shadow_.2rAHY5o8RsTR0hVg5TKcKO05RzmEsiY_0 2024-09-12T19:23:00.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1045411570066192124', time=2024-09-12T20:29:25.570362+0000, chain.objs.size()=1 2024-09-12T19:23:00.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.245__shadow_.N1TE-JOLbfzynA8wejo0A9A6OzfuqPJ_0 2024-09-12T19:23:00.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5544388054451479424', time=2024-09-12T20:29:30.165413+0000, chain.objs.size()=1 2024-09-12T19:23:00.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.247__shadow_.lPrCuq8mBw1-X-bGg3bgzRFTnC6haix_0 2024-09-12T19:23:00.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3448698311069700398', time=2024-09-12T20:29:30.198282+0000, chain.objs.size()=1 2024-09-12T19:23:00.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.247__shadow_.YmKzAZGzJKlYVV_2getn1hS0ELyyUW7_0 2024-09-12T19:23:00.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2966611442684864201', time=2024-09-12T20:31:46.761801+0000, chain.objs.size()=1 2024-09-12T19:23:00.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.dAAtDJVGP4WYK_BubAT1GhdUrWq_dC4_0 2024-09-12T19:23:00.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4021488067310730710', time=2024-09-12T20:31:46.945548+0000, chain.objs.size()=1 2024-09-12T19:23:00.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.1DAsyzCHf7JeqFkUciJPIshKxrx1Z4v_0 2024-09-12T19:23:00.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17554373756213456866', time=2024-09-12T20:31:47.045541+0000, chain.objs.size()=1 2024-09-12T19:23:00.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.zZEC_7lb-kPw6LBN-b5ornZiEk6JfFP_0 2024-09-12T19:23:00.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13144777978015391605', time=2024-09-12T20:31:49.307645+0000, chain.objs.size()=1 2024-09-12T19:23:00.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.UQW9VskKj0sUxJlA1pcmEEyOpotKLAs_0 2024-09-12T19:23:00.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16811555698840758606', time=2024-09-12T20:31:49.309535+0000, chain.objs.size()=1 2024-09-12T19:23:00.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.I1EebEt80UPrB-8fDaKTlWDqEsyPIgE_0 2024-09-12T19:23:00.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14811630070235639763', time=2024-09-12T20:31:50.720696+0000, chain.objs.size()=1 2024-09-12T19:23:00.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.590+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.8QhoaYUUZH_o2GaiN1XSABdpZiu-cux_0 2024-09-12T19:23:00.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5252469656987980891', time=2024-09-12T20:31:50.768723+0000, chain.objs.size()=1 2024-09-12T19:23:00.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.590+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.U5_qJsBJy1lUS8BCYRJrGHc-NugYTzG_0 2024-09-12T19:23:00.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3115374232249429143', time=2024-09-12T20:31:50.866374+0000, chain.objs.size()=1 2024-09-12T19:23:00.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.590+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.IuXJlY6flhWIRfNERp4IOCt3zQHxz4Y_0 2024-09-12T19:23:00.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10467593398473303177', time=2024-09-12T20:31:50.868319+0000, chain.objs.size()=1 2024-09-12T19:23:00.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.590+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.yNTYZPFWnYuFqJC6SHdkbxLDz4j5tS5_0 2024-09-12T19:23:00.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15564637525480841108', time=2024-09-12T20:31:50.992506+0000, chain.objs.size()=1 2024-09-12T19:23:00.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.590+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.lFo2WAlrXwlXdDJWVY0FZajy3vBM-hV_0 2024-09-12T19:23:00.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1497628100875777270', time=2024-09-12T20:31:52.056957+0000, chain.objs.size()=1 2024-09-12T19:23:00.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.590+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.16w3Bwl6UHsQrXmlADjhoySrXlrWsPb_0 2024-09-12T19:23:00.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9698540071099847279', time=2024-09-12T20:31:53.107027+0000, chain.objs.size()=1 2024-09-12T19:23:00.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.590+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.6fJ-7IMrl2FtBcIi_ci6Ngj3zx5fbRJ_0 2024-09-12T19:23:00.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3868142281996629595', time=2024-09-12T20:31:53.509347+0000, chain.objs.size()=1 2024-09-12T19:23:00.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.590+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.iN2e26s73KEU2ytzeC3HcX5V9R1Aapn_0 2024-09-12T19:23:00.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.69708932016390671', time=2024-09-12T20:31:55.076587+0000, chain.objs.size()=1 2024-09-12T19:23:00.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.lZeVQPXrhUokEKV1EXuLGyq_fZdlEKk_0 2024-09-12T19:23:00.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12897098392683962711', time=2024-09-12T20:31:55.079013+0000, chain.objs.size()=1 2024-09-12T19:23:00.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.JogEiWy-9qu8InPQOcOxHTRtMZqAk64_0 2024-09-12T19:23:00.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14055950394276584338', time=2024-09-12T20:31:55.433269+0000, chain.objs.size()=1 2024-09-12T19:23:00.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.6Bizbx1o5Zpt8soCWvLh1LvZTIGFuoF_0 2024-09-12T19:23:00.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.32600461343836176', time=2024-09-12T20:31:55.738000+0000, chain.objs.size()=1 2024-09-12T19:23:00.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.0t9Ti3dPbQ3fR4ogQb8z0iAbHw9Kqjv_0 2024-09-12T19:23:00.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5038013847154405488', time=2024-09-12T20:31:55.906468+0000, chain.objs.size()=1 2024-09-12T19:23:00.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.RQEmDU8WHyD7-DeySeuXZhXnyzrBrsL_0 2024-09-12T19:23:00.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1955548139483796276', time=2024-09-12T20:31:58.021830+0000, chain.objs.size()=1 2024-09-12T19:23:00.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.tevfrMsUYdTqYNn-o1K5MXvBZFGFjqm_0 2024-09-12T19:23:00.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17190326466455476551', time=2024-09-12T20:31:59.323690+0000, chain.objs.size()=1 2024-09-12T19:23:00.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.gxRtuTOvr9CPBQCPfvLJOUnfQuREr0T_0 2024-09-12T19:23:00.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4368357221769063163', time=2024-09-12T20:32:00.860370+0000, chain.objs.size()=1 2024-09-12T19:23:00.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.uWDY060EAIPx9I3gAqJ67PntuENquoH_0 2024-09-12T19:23:00.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1094532909163498729', time=2024-09-12T20:32:01.333879+0000, chain.objs.size()=1 2024-09-12T19:23:00.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.-ATD3dloYUFGRX_16laAWT4VNd6ziiS_0 2024-09-12T19:23:00.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6001803310193001256', time=2024-09-12T20:32:01.537966+0000, chain.objs.size()=1 2024-09-12T19:23:00.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.FeGm4LwmB8MBc9zCkomCmMRro_1DDwc_0 2024-09-12T19:23:00.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4173977133089045687', time=2024-09-12T20:32:03.307762+0000, chain.objs.size()=1 2024-09-12T19:23:00.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.G8FuprsBbNJg_HyJSVptc8EC08Bn0yZ_0 2024-09-12T19:23:00.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.602+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7887322900872969159', time=2024-09-12T20:32:04.889034+0000, chain.objs.size()=1 2024-09-12T19:23:00.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.602+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.y2HP7m45ZNEYQB7RYuaDvCt24LdeFUA_0 2024-09-12T19:23:00.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.602+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13025230050905276271', time=2024-09-12T20:32:04.891023+0000, chain.objs.size()=1 2024-09-12T19:23:00.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.602+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.W8Ig1xcMKXIaM94eoormDjDkBHESeHA_0 2024-09-12T19:23:00.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.602+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12337679893394327777', time=2024-09-12T20:32:05.319464+0000, chain.objs.size()=1 2024-09-12T19:23:00.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.602+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.9cxN6jYEUv88n6e6O8nQFATikODRyEU_0 2024-09-12T19:23:00.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.602+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2380874633846955025', time=2024-09-12T20:32:05.363384+0000, chain.objs.size()=1 2024-09-12T19:23:00.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.602+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.qpaSYiFDov5FuKTYOhlEcdZL_nGoAjU_0 2024-09-12T19:23:00.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.602+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7515254462844980287', time=2024-09-12T20:32:06.191172+0000, chain.objs.size()=1 2024-09-12T19:23:00.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.602+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.P1i8uXYQ20Bm4lVAisxnYtjEy5p8GZQ_0 2024-09-12T19:23:00.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.602+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7331902778989515690', time=2024-09-12T20:32:09.860246+0000, chain.objs.size()=1 2024-09-12T19:23:00.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.602+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ACJOA_oWMR1FL_XINJI58Sb93a7c_9f_0 2024-09-12T19:23:00.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.602+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4713202324837818680', time=2024-09-12T20:32:10.192613+0000, chain.objs.size()=1 2024-09-12T19:23:00.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.602+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ghy9loFLCdH78L3EpyTGIFnplqAryIy_0 2024-09-12T19:23:00.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.602+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13109372666329724069', time=2024-09-12T20:32:10.194958+0000, chain.objs.size()=1 2024-09-12T19:23:00.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.602+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.F2d4oA-eiWSKZLOykjHCiwsXIJOEWrd_0 2024-09-12T19:23:00.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.602+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17572964031976086586', time=2024-09-12T20:32:10.480133+0000, chain.objs.size()=1 2024-09-12T19:23:00.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.602+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.YITw0HE5NmxqRrz0Ya3li_Zzme_ZtoY_0 2024-09-12T19:23:00.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5416670803687598986', time=2024-09-12T20:32:10.833579+0000, chain.objs.size()=1 2024-09-12T19:23:00.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.JjC55fG2dRFPReTmyWtnmy0x56haRx8_0 2024-09-12T19:23:00.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15902152646857935176', time=2024-09-12T20:32:11.570280+0000, chain.objs.size()=1 2024-09-12T19:23:00.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.AQ5prJNxbntRf6HYecGhnzsiKyDZvZT_0 2024-09-12T19:23:00.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14160479877900224327', time=2024-09-12T20:32:11.616459+0000, chain.objs.size()=1 2024-09-12T19:23:00.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.dSopPP3Qhg_nDafGxd_oiIWqMSGIeQN_0 2024-09-12T19:23:00.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.179303780793852852', time=2024-09-12T20:32:11.756519+0000, chain.objs.size()=1 2024-09-12T19:23:00.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.mQHeKSUhsT3ZsYosBz9CgSc-qY104AL_0 2024-09-12T19:23:00.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16545044531710798194', time=2024-09-12T20:32:11.821424+0000, chain.objs.size()=1 2024-09-12T19:23:00.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.A8YO0GqEOW9mQILduCOSJB9pKYSuxBP_0 2024-09-12T19:23:00.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8852790833085726939', time=2024-09-12T20:32:12.227489+0000, chain.objs.size()=1 2024-09-12T19:23:00.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.aP01fYDTYewMBrIvEyy-ERi0aigUkZ2_0 2024-09-12T19:23:00.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11249659668052536885', time=2024-09-12T20:32:12.621176+0000, chain.objs.size()=1 2024-09-12T19:23:00.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.EqGxIcrAs3Zq4PiLBvQ-NLCy8sHl9Wz_0 2024-09-12T19:23:00.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4057021337810890251', time=2024-09-12T20:32:35.896994+0000, chain.objs.size()=1 2024-09-12T19:23:00.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.272__shadow_.cayAYuIaxzK4-tmLat_OSWnTODAKHqR_0 2024-09-12T19:23:00.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2858090593244021792', time=2024-09-12T20:32:42.541015+0000, chain.objs.size()=1 2024-09-12T19:23:00.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.275__shadow_.f-eM3JE9wmUzqNMuJGyn6CgBMVOquqo_0 2024-09-12T19:23:00.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17393439071520577452', time=2024-09-12T20:33:12.714274+0000, chain.objs.size()=1 2024-09-12T19:23:00.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.288__shadow_.9s_2w_sXsX-DcZEqxj6Uo6H8oR30Ztp_0 2024-09-12T19:23:00.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5776911326767350373', time=2024-09-12T20:33:25.420770+0000, chain.objs.size()=1 2024-09-12T19:23:00.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.oZo7vx0E_DkUCmL3w7vtCivqB9Yf8V8_0 2024-09-12T19:23:00.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2152538658847116857', time=2024-09-12T20:33:40.814527+0000, chain.objs.size()=1 2024-09-12T19:23:00.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.297__shadow_.dF9oLLp5Zr948Yb8AoFkC4_xOnsnKq1_0 2024-09-12T19:23:00.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6866915037215177838', time=2024-09-12T20:36:28.275340+0000, chain.objs.size()=1 2024-09-12T19:23:00.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.C94tLvj4CE1rcc5vM-U8-YhQTTTEwyi_0 2024-09-12T19:23:00.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.610+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.616667702396961025', time=2024-09-12T20:36:28.822698+0000, chain.objs.size()=1 2024-09-12T19:23:00.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.610+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.-xldKaYRlwxu5uWUdGwe7bF1neKv-5X_0 2024-09-12T19:23:00.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11279461962075951437', time=2024-09-12T20:36:29.522863+0000, chain.objs.size()=1 2024-09-12T19:23:00.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.eYZEbOerzgucRQMYILLBPjzWHnhGETm_0 2024-09-12T19:23:00.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9156005746510334495', time=2024-09-12T20:36:29.709476+0000, chain.objs.size()=1 2024-09-12T19:23:00.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ZHhSX7e-QEq9dQJo7Aqwk5erv3aDeJ4_0 2024-09-12T19:23:00.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6607648404881337651', time=2024-09-12T20:36:29.923751+0000, chain.objs.size()=1 2024-09-12T19:23:00.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.EGWzhjjxeBxO2Y7LOkD9m61c4-8a2el_0 2024-09-12T19:23:00.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4667214702154249014', time=2024-09-12T20:36:32.541951+0000, chain.objs.size()=1 2024-09-12T19:23:00.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.9C8M4qOuQti7YHY1yAjQfwlfr_6cbGb_0 2024-09-12T19:23:00.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2800540752958261613', time=2024-09-12T20:36:33.077622+0000, chain.objs.size()=1 2024-09-12T19:23:00.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.W76hNPq3q1CcQ0lVOBKX0mIFKWmkj5-_0 2024-09-12T19:23:00.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7278741557744772489', time=2024-09-12T20:36:33.577419+0000, chain.objs.size()=1 2024-09-12T19:23:00.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.7DVrAxC2fByUcssDUXlw-GGhSQejLUv_0 2024-09-12T19:23:00.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14279278123339649208', time=2024-09-12T20:36:34.203196+0000, chain.objs.size()=1 2024-09-12T19:23:00.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.nYl3PMXLXI6KBTzbsjyV64--NvYV4Eq_0 2024-09-12T19:23:00.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2071118824887205377', time=2024-09-12T20:36:34.759389+0000, chain.objs.size()=1 2024-09-12T19:23:00.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ZfVj5tYdYE_QYSfDmUdln_zx78Upvtr_0 2024-09-12T19:23:00.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.591313523914630622', time=2024-09-12T20:36:35.834358+0000, chain.objs.size()=1 2024-09-12T19:23:00.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.NIMwCBK85qhIhEElBUXzMnzFVU1y_i7_0 2024-09-12T19:23:00.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12580296797947517535', time=2024-09-12T20:36:36.616669+0000, chain.objs.size()=1 2024-09-12T19:23:00.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.q5IaKW8K-dOdz4WgJxNRLePOEknk6SQ_0 2024-09-12T19:23:00.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10357754658069376980', time=2024-09-12T20:36:36.887856+0000, chain.objs.size()=1 2024-09-12T19:23:00.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.RPDqzFjTHoQtgVE-sNBaNJugC-6HDCm_0 2024-09-12T19:23:00.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16615626830686453047', time=2024-09-12T20:36:38.068345+0000, chain.objs.size()=1 2024-09-12T19:23:00.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.OgIpiMBM0t02R0-ghNJO_rHPttqgXM3_0 2024-09-12T19:23:00.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5903653339592944056', time=2024-09-12T20:36:38.409015+0000, chain.objs.size()=1 2024-09-12T19:23:00.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.8p6NelYAQHi4hrvzPanqx2b6V0u1S0w_0 2024-09-12T19:23:00.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7102027370437344089', time=2024-09-12T20:36:38.535128+0000, chain.objs.size()=1 2024-09-12T19:23:00.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.cAd16kLWXpNS3zgw6K6nTQ0Fk109ER2_0 2024-09-12T19:23:00.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12968337423068200818', time=2024-09-12T20:36:39.884718+0000, chain.objs.size()=1 2024-09-12T19:23:00.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Yq95914jFcJGfa9FP1W4ffZlFQ35F-X_0 2024-09-12T19:23:00.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1219848378240589089', time=2024-09-12T20:36:41.457865+0000, chain.objs.size()=1 2024-09-12T19:23:00.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.pKrIxs1Exm-8XL94xcCDmbcIBxQwDfo_0 2024-09-12T19:23:00.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18250442751666914832', time=2024-09-12T20:36:43.691881+0000, chain.objs.size()=1 2024-09-12T19:23:00.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.12DXlDZVUKEi0qIp94c6EtJ_54Z9rIu_0 2024-09-12T19:23:00.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6654934593171414558', time=2024-09-12T20:36:44.116943+0000, chain.objs.size()=1 2024-09-12T19:23:00.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.o92ET8PdFdtkZ5kT6ncSFfktW0UIbxg_0 2024-09-12T19:23:00.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16067193650919765647', time=2024-09-12T20:36:44.913528+0000, chain.objs.size()=1 2024-09-12T19:23:00.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.X2dTl9sKsnhr_j0f8OqRMiN7yhF6fsz_0 2024-09-12T19:23:00.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1435470315180217964', time=2024-09-12T20:36:45.715789+0000, chain.objs.size()=1 2024-09-12T19:23:00.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.qNvr8bPbikPJ6qhqhrfVgEeR9hm2S08_0 2024-09-12T19:23:00.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.174276907438167038', time=2024-09-12T20:36:47.233749+0000, chain.objs.size()=1 2024-09-12T19:23:00.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.aJeyu6K4RqfFkhUR4SeFq6Mx5cjnx_N_0 2024-09-12T19:23:00.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11571827194253723392', time=2024-09-12T20:36:48.068607+0000, chain.objs.size()=1 2024-09-12T19:23:00.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.8jw8q2YKeN9DTG9rttEEpPNGNi9yKk1_0 2024-09-12T19:23:00.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3495757113421811853', time=2024-09-12T20:36:49.124883+0000, chain.objs.size()=1 2024-09-12T19:23:00.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.9-xYyowvAR7lIb_F0rwIuihCsazXSVQ_0 2024-09-12T19:23:00.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12450762776832801432', time=2024-09-12T20:36:50.588383+0000, chain.objs.size()=1 2024-09-12T19:23:00.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.DNLsSWdJ6GeyPBEY-TTlyOyQ9_cz_qj_0 2024-09-12T19:23:00.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7271272138848697751', time=2024-09-12T20:36:52.417371+0000, chain.objs.size()=1 2024-09-12T19:23:00.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.0XiKgjPYfbLQMV5Dgzjk6CLTY2xDQmT_0 2024-09-12T19:23:00.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15471788981874401672', time=2024-09-12T20:36:52.459393+0000, chain.objs.size()=1 2024-09-12T19:23:00.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.krFjAeSXSYk4DZ_lHW_ErgnCu8cz9Tx_0 2024-09-12T19:23:00.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5142539720829800790', time=2024-09-12T20:36:54.134107+0000, chain.objs.size()=1 2024-09-12T19:23:00.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.WaMk5-PeT49IXiJzivbVpDkVO_3CfuO_0 2024-09-12T19:23:00.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11727391991786043855', time=2024-09-12T20:36:54.271904+0000, chain.objs.size()=1 2024-09-12T19:23:00.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.w_dkzTrLAAsl7pVQn2bgs5IweGngedP_0 2024-09-12T19:23:00.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16797112553545705561', time=2024-09-12T20:36:54.863184+0000, chain.objs.size()=1 2024-09-12T19:23:00.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.PRLIIQlDEVZBHc6Fxs_tvejjKMEVvYP_0 2024-09-12T19:23:00.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3476239392343476893', time=2024-09-12T20:36:54.950123+0000, chain.objs.size()=1 2024-09-12T19:23:00.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.PEoZq6iaQV7xqCMpMiiih-FGe7Nzbfj_0 2024-09-12T19:23:00.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16299971820801939043', time=2024-09-12T20:36:56.068771+0000, chain.objs.size()=1 2024-09-12T19:23:00.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.TzeyznoQ2xaAsBv0ade8zfHJrk3R_M5_0 2024-09-12T19:23:00.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9432729927575296440', time=2024-09-12T20:36:56.070540+0000, chain.objs.size()=1 2024-09-12T19:23:00.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.5PxlA1nsH7a2M4_kotifHKU9uc-fPYh_0 2024-09-12T19:23:00.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1727898194241221641', time=2024-09-12T20:36:56.337119+0000, chain.objs.size()=1 2024-09-12T19:23:00.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.626+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Aovb50f-HNKp62xPIyzr8Y4bhLz7jNH_0 2024-09-12T19:23:00.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.630+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15384127197327408418', time=2024-09-12T20:38:40.706701+0000, chain.objs.size()=1 2024-09-12T19:23:00.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.630+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-riDvITiGPK75-uf4nxaGNng5QcUOc6_0 2024-09-12T19:23:00.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.630+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2730103337248168858', time=2024-09-12T20:38:44.062855+0000, chain.objs.size()=1 2024-09-12T19:23:00.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.630+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.5KGG9C8QiKd7v_4JttkeaU4jK9ssgeH_0 2024-09-12T19:23:00.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.630+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4011402610607653278', time=2024-09-12T20:38:44.584831+0000, chain.objs.size()=1 2024-09-12T19:23:00.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.630+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.4ujgDKivUsH2pzdVnhbSvVeiE5f6nYo_0 2024-09-12T19:23:00.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.634+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9092167801557756666', time=2024-09-12T20:38:44.940399+0000, chain.objs.size()=1 2024-09-12T19:23:00.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.634+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.xuqpWFAzhi4k5Hk2wWyEnh6av2GcGH7_0 2024-09-12T19:23:00.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.634+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12523378346417477951', time=2024-09-12T20:38:44.942243+0000, chain.objs.size()=1 2024-09-12T19:23:00.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.634+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.skYgstZv6TExMcjqxJ04s0S0di6kurw_0 2024-09-12T19:23:00.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.634+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.416523606535714161', time=2024-09-12T20:38:46.509182+0000, chain.objs.size()=1 2024-09-12T19:23:00.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.634+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-YakMmi3-j1e5z1es5nlN7_YQhj0Xgz_0 2024-09-12T19:23:00.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.634+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6476221390034690295', time=2024-09-12T20:38:47.479664+0000, chain.objs.size()=1 2024-09-12T19:23:00.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.634+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.SjvRJeEUV7lnpBvxf5HiuKtSdy6vGz5_0 2024-09-12T19:23:00.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.638+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18267957743887653886', time=2024-09-12T20:38:48.782784+0000, chain.objs.size()=1 2024-09-12T19:23:00.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.638+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.QNaZA7iPxm56R8NCP9Cb_iCO4-M8VyJ_0 2024-09-12T19:23:00.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.638+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10651807237188183649', time=2024-09-12T20:38:48.886319+0000, chain.objs.size()=1 2024-09-12T19:23:00.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.638+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.PTeDyyNJ2Zbvcm8uqV9kC8ESWepSWns_0 2024-09-12T19:23:00.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.638+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5693023885936746653', time=2024-09-12T20:38:49.586109+0000, chain.objs.size()=1 2024-09-12T19:23:00.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.638+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.nhUs68IoiAI1am94F5BmiH3G-K4moP1_0 2024-09-12T19:23:00.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.638+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8007898610962455252', time=2024-09-12T20:38:49.880317+0000, chain.objs.size()=1 2024-09-12T19:23:00.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.638+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.bbqAH3HrQIs30LJUR9nLII9_0k76HB1_0 2024-09-12T19:23:00.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.638+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9399849616857428022', time=2024-09-12T20:38:50.022357+0000, chain.objs.size()=1 2024-09-12T19:23:00.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.638+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.mG43VjqOO_2bQdo2UqejiFPYN9im--v_0 2024-09-12T19:23:00.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.638+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6538924971560398169', time=2024-09-12T20:38:50.245391+0000, chain.objs.size()=1 2024-09-12T19:23:00.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.638+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.BLQjFJr3vhfJxLQvtb8YcxZreIsBC33_0 2024-09-12T19:23:00.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.642+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4677902116119338676', time=2024-09-12T20:38:51.994553+0000, chain.objs.size()=1 2024-09-12T19:23:00.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.642+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.YCkd8Px-ME0j47m_yatm3xYl258j5w7_0 2024-09-12T19:23:00.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.642+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11547794553190245971', time=2024-09-12T20:38:52.122574+0000, chain.objs.size()=1 2024-09-12T19:23:00.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.642+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.tZz2pvkW4tK9l-9KGbDO8lFfqfyNXbF_0 2024-09-12T19:23:00.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50641 2024-09-12T19:23:00.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T19:23:00.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17573843877944234275', time=2024-09-12T20:38:52.549554+0000, chain.objs.size()=1 2024-09-12T19:23:00.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.1qPylkCCWV2qSnxNu8dXd3VxjAnHiJZ_0 2024-09-12T19:23:00.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7404648916601751415', time=2024-09-12T20:38:57.186165+0000, chain.objs.size()=1 2024-09-12T19:23:00.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.pOpUKbSksl6pa_pc925EFd8OaQ9MknX_0 2024-09-12T19:23:00.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8795351801675857913', time=2024-09-12T20:38:57.663080+0000, chain.objs.size()=1 2024-09-12T19:23:00.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.kx0nShZ6al7PF69NSRSoXdgmOnxlYDj_0 2024-09-12T19:23:00.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14422978719608577845', time=2024-09-12T20:38:59.768382+0000, chain.objs.size()=1 2024-09-12T19:23:00.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.cdvBiifwljjTAtI2gWtwJ_vvjJeBZjv_0 2024-09-12T19:23:00.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.394239501143678783', time=2024-09-12T20:39:00.700774+0000, chain.objs.size()=1 2024-09-12T19:23:00.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.pnXBJ4pRr4HIqg0NRgxVLQbpZnSG3Sn_0 2024-09-12T19:23:00.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7513233585461072884', time=2024-09-12T20:39:01.007749+0000, chain.objs.size()=1 2024-09-12T19:23:00.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.x3UdJZhMaHCcx0HlLh07HI1naZh2QZi_0 2024-09-12T19:23:00.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6824413634554703249', time=2024-09-12T20:39:01.507529+0000, chain.objs.size()=1 2024-09-12T19:23:00.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.I2irNZxTfWGxy4lI01TtzUkqdVNcA9e_0 2024-09-12T19:23:00.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6925317291298282278', time=2024-09-12T20:39:01.527417+0000, chain.objs.size()=1 2024-09-12T19:23:00.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ktSAIk07i9uUIIqR4Fhb-SUJYhcoiyl_0 2024-09-12T19:23:00.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5690160943560161190', time=2024-09-12T20:39:04.362717+0000, chain.objs.size()=1 2024-09-12T19:23:00.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.wKRmSD7hEuHsia3VrC6Xy09jjK89RgG_0 2024-09-12T19:23:00.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4584549000101429653', time=2024-09-12T20:39:04.693407+0000, chain.objs.size()=1 2024-09-12T19:23:00.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.kWhuYgvoF41lqqsos3qTFhTL9UBVTLE_0 2024-09-12T19:23:00.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6324416275233166735', time=2024-09-12T20:39:04.976583+0000, chain.objs.size()=1 2024-09-12T19:23:00.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ci1mmmEnPYzWTV7JmXgAhqSEKzrkayU_0 2024-09-12T19:23:00.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8058730086275603807', time=2024-09-12T20:39:07.324575+0000, chain.objs.size()=1 2024-09-12T19:23:00.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Req4mwW5uTRQ3Aj5trcZ1A-ekZKbw7L_0 2024-09-12T19:23:00.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.650+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15474049621241418778', time=2024-09-12T20:41:06.447292+0000, chain.objs.size()=1 2024-09-12T19:23:00.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.650+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.384__shadow_.0jcI1j7rJ1VwczMxZoMc2QpwTTkViCt_0 2024-09-12T19:23:00.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.650+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5421517493165276288', time=2024-09-12T20:43:05.991249+0000, chain.objs.size()=1 2024-09-12T19:23:00.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.650+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.443__shadow_.Ku-mFjHT1YCJ1AYBDCrZx7J2vdLi9U8_0 2024-09-12T19:23:00.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.650+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10934720398594036863', time=2024-09-12T20:43:34.777030+0000, chain.objs.size()=1 2024-09-12T19:23:00.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.650+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.455__shadow_.Kdiy9CRcYvIKjj4YVxbU9HbvkgmNjwc_0 2024-09-12T19:23:00.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.650+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11180741643273049714', time=2024-09-12T20:43:40.708975+0000, chain.objs.size()=1 2024-09-12T19:23:00.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.650+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.457__shadow_.KFu8NYwZv3oJ9D5J-7cx-BLWJ4n8SSU_0 2024-09-12T19:23:00.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.650+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16619633381479358630', time=2024-09-12T20:43:55.656813+0000, chain.objs.size()=1 2024-09-12T19:23:00.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.650+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.462__shadow_.keXAmfc1pES_BDf7uOkrIhQHxttFORM_0 2024-09-12T19:23:00.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.654+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1732569737876936363', time=2024-09-12T20:44:33.717721+0000, chain.objs.size()=1 2024-09-12T19:23:00.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.654+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.483__shadow_.-i79orq9nR8c6YqYZd5GsjOWrWqMkrH_0 2024-09-12T19:23:00.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.654+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~T01q1pVPbDlXq4kiP21XlkOrrywjtrp', time=2024-09-12T20:48:32.955298+0000, chain.objs.size()=1 2024-09-12T19:23:00.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.654+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~T01q1pVPbDlXq4kiP21XlkOrrywjtrp.1 2024-09-12T19:23:00.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.654+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Dqkm-EgZA-2h0TnewiGI34Q3c8r7yKL', time=2024-09-12T20:53:14.865266+0000, chain.objs.size()=2 2024-09-12T19:23:00.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.654+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.529__multipart_mymultipart.2~Dqkm-EgZA-2h0TnewiGI34Q3c8r7yKL.1 2024-09-12T19:23:00.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.654+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.529__multipart_mymultipart.2~Dqkm-EgZA-2h0TnewiGI34Q3c8r7yKL.2 2024-09-12T19:23:00.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.654+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7486986446225311515', time=2024-09-12T20:56:35.535609+0000, chain.objs.size()=1 2024-09-12T19:23:00.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.654+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.565__shadow_.xkNvZ945zfHxVxyaSqtbflX3iIk8j5e_0 2024-09-12T19:23:00.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.654+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12081123982162463054', time=2024-09-12T20:57:09.719775+0000, chain.objs.size()=1 2024-09-12T19:23:00.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.654+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.570__shadow:Bapv.bs85ba-uuscJeOa5b5vgmCA6GT_.2RotuRr6m9RpS6vQzYfwxZrylgUEeIh_0 2024-09-12T19:23:00.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.654+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4467292251962256732', time=2024-09-12T20:57:58.793187+0000, chain.objs.size()=1 2024-09-12T19:23:00.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.654+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:p-ZERC1w4jo-hEE4sfFQYZ472Fb.gtw_.KgQPJxrvu-lpR7tmFn2rVq1EhLDKM71_0 2024-09-12T19:23:00.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13244282838863820524', time=2024-09-12T20:59:40.816569+0000, chain.objs.size()=1 2024-09-12T19:23:00.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.583__shadow:CcQou.-aHXjauibvMvsjs0CAICy2m98_.9MNtn55vt9Gw3iC8PiO_4P7oLdbIAys_0 2024-09-12T19:23:00.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17585937782298597146', time=2024-09-12T21:08:28.800476+0000, chain.objs.size()=1 2024-09-12T19:23:00.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.654__shadow_.Fb6vq4uu34DQDSkJNT2djYiwpRUwDC3_0 2024-09-12T19:23:00.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4590223886013842735', time=2024-09-12T21:10:35.568008+0000, chain.objs.size()=1 2024-09-12T19:23:00.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.694__shadow:EPfeEEachn9o0DykFp6gojDh2YsbAHT_.RUoBK1RSkDu8jcMkQmQFLPqev5BdWFG_0 2024-09-12T19:23:00.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.666+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:00.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.666+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T19:23:00.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.666+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:00.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:00.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47390' 2024-09-12T19:23:00.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13431690612052640508', time=2024-09-12T20:28:45.682678+0000, chain.objs.size()=1 2024-09-12T19:23:00.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.230__shadow_.1Rk6k-V7HxmRJGsAnA_0xuxC02NobKu_0 2024-09-12T19:23:00.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6894139617724673934', time=2024-09-12T20:29:41.654293+0000, chain.objs.size()=1 2024-09-12T19:23:00.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.252__shadow_.V_1SPO7cBgfEg7ABzW8_5_SNiSp1w_l_0 2024-09-12T19:23:00.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4896328068023122694', time=2024-09-12T20:29:59.841062+0000, chain.objs.size()=1 2024-09-12T19:23:00.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.260__shadow_.Xjq2k-QuTQo9q1hkQlLZP-XAFdSJIna_0 2024-09-12T19:23:00.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12236843011029834330', time=2024-09-12T20:31:47.655861+0000, chain.objs.size()=1 2024-09-12T19:23:00.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Y5rmW1s89rjrjOVe0QAcACpEiUyE_oe_0 2024-09-12T19:23:00.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17522919190373923255', time=2024-09-12T20:31:47.792602+0000, chain.objs.size()=1 2024-09-12T19:23:00.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.UcYqvPGNtFTj3fA_kZT2YLOGD91UWUu_0 2024-09-12T19:23:00.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11313699639110247495', time=2024-09-12T20:31:48.126491+0000, chain.objs.size()=1 2024-09-12T19:23:00.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.k-iZ1GAeo5MdIVGeYSwdBkAPhrZnR14_0 2024-09-12T19:23:00.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17987201800381930', time=2024-09-12T20:31:53.531778+0000, chain.objs.size()=1 2024-09-12T19:23:00.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Oyuxmq1HhbzDsTbI5zRPKxR9HeixTMt_0 2024-09-12T19:23:00.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1332274562482986285', time=2024-09-12T20:31:54.322475+0000, chain.objs.size()=1 2024-09-12T19:23:00.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.jgO-RF25Yz_HSO_OiFfpYxfMWE05VxM_0 2024-09-12T19:23:00.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2224305970047825670', time=2024-09-12T20:31:54.555773+0000, chain.objs.size()=1 2024-09-12T19:23:00.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.QlH7jptJaM-ELBeHxQfzY9NPb1QdIds_0 2024-09-12T19:23:00.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.43474012058206872', time=2024-09-12T20:31:54.557598+0000, chain.objs.size()=1 2024-09-12T19:23:00.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.P970rGlfzvC6ZfLfaaGM11idon6kqBn_0 2024-09-12T19:23:00.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17703786394447653197', time=2024-09-12T20:31:54.830775+0000, chain.objs.size()=1 2024-09-12T19:23:00.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.v-Rv9XKhf1Ou9yNIjY9ZbOCNgf6DqoG_0 2024-09-12T19:23:00.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6231257426401270611', time=2024-09-12T20:31:57.288591+0000, chain.objs.size()=1 2024-09-12T19:23:00.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.PYWEdVtZUf_HdiysWLI3PTp4wFvSI37_0 2024-09-12T19:23:00.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.674+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13124554066445557154', time=2024-09-12T20:31:57.291084+0000, chain.objs.size()=1 2024-09-12T19:23:00.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.674+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.4nOs-9CxwvlrHEf7EU_8UdDfpD4qii0_0 2024-09-12T19:23:00.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.678+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15495191855545017319', time=2024-09-12T20:31:57.698751+0000, chain.objs.size()=1 2024-09-12T19:23:00.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.678+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.F7fRKEivjtJMnC66Ek0fvTc7veh95g-_0 2024-09-12T19:23:00.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.678+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13220104006706988322', time=2024-09-12T20:32:02.417018+0000, chain.objs.size()=1 2024-09-12T19:23:00.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.678+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.kV0KnCfNLzxXN7qo5tl4eMTl0zkitVi_0 2024-09-12T19:23:00.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.678+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5651333409512381624', time=2024-09-12T20:32:03.287342+0000, chain.objs.size()=1 2024-09-12T19:23:00.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.678+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.QsFOGdSZxl13iHPTf6vBqjjfp1Y-dWr_0 2024-09-12T19:23:00.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.678+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4525959415258775505', time=2024-09-12T20:32:06.068220+0000, chain.objs.size()=1 2024-09-12T19:23:00.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.678+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.pAFsOUDOcAv7dx4Yea-ijB6l3j--Xw9_0 2024-09-12T19:23:00.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.678+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4698710575165012886', time=2024-09-12T20:32:07.184040+0000, chain.objs.size()=1 2024-09-12T19:23:00.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.678+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.rKVJpm-i8uHzpVAmyZvmV5gEgLKX8JS_0 2024-09-12T19:23:00.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.678+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10710547838557693663', time=2024-09-12T20:32:08.549451+0000, chain.objs.size()=1 2024-09-12T19:23:00.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.678+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.NHntTFyAXLQlZDyr6dp-v0F9YRkuch1_0 2024-09-12T19:23:00.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.678+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12797580704815311217', time=2024-09-12T20:32:08.776517+0000, chain.objs.size()=1 2024-09-12T19:23:00.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.678+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.c9sDsB8k-_qM4ffEDINVV7OTsW_ZKWs_0 2024-09-12T19:23:00.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.678+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3679172335373179361', time=2024-09-12T20:32:09.400420+0000, chain.objs.size()=1 2024-09-12T19:23:00.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.678+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.cprg4U0NXxsZ_-gtJBTtdiBxWq25dLy_0 2024-09-12T19:23:00.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.678+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17273107040455010528', time=2024-09-12T20:32:12.688742+0000, chain.objs.size()=1 2024-09-12T19:23:00.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.678+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Yi4t2WRK-op9kPknaXnGrHTbzOpmDTA_0 2024-09-12T19:23:00.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.678+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8639382541760685365', time=2024-09-12T20:32:13.546739+0000, chain.objs.size()=1 2024-09-12T19:23:00.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.678+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.pUUEQ2s-gAh4SBhby6g9wnGwj2fGbh7_0 2024-09-12T19:23:00.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.682+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11040786951372028338', time=2024-09-12T20:32:22.822619+0000, chain.objs.size()=1 2024-09-12T19:23:00.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.682+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.266__shadow_.527ypgLp4R1DZpc22RBAgcxfyBsThkN_0 2024-09-12T19:23:00.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.682+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5831963123658514749', time=2024-09-12T20:32:40.227618+0000, chain.objs.size()=1 2024-09-12T19:23:00.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.682+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.274__shadow_.JDVvdtSoHAnQpOx_yTYj2bOX72VMuKQ_0 2024-09-12T19:23:00.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.682+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13482411233392405203', time=2024-09-12T20:32:49.503247+0000, chain.objs.size()=1 2024-09-12T19:23:00.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.682+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.278__shadow_.qM732XZOpZlzdYbAC1x6_04uf_lDygE_0 2024-09-12T19:23:00.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.682+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10015086370982439815', time=2024-09-12T20:32:54.192902+0000, chain.objs.size()=1 2024-09-12T19:23:00.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.682+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.280__shadow_.XjALpU8EocYCvlVdGnzo7ZYdDwD3ZY8_0 2024-09-12T19:23:00.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8617004719448881067', time=2024-09-12T20:33:00.987267+0000, chain.objs.size()=1 2024-09-12T19:23:00.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.283__shadow_.Jj5Fv72sNWHJEtILBKVnRgp6j4JRI6W_0 2024-09-12T19:23:00.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14823999133823062330', time=2024-09-12T20:33:17.315698+0000, chain.objs.size()=1 2024-09-12T19:23:00.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.290__shadow_.jO5VvDXbdunoIEyCKepddrqBA5xOXDz_0 2024-09-12T19:23:00.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17187606388694027366', time=2024-09-12T20:33:38.562861+0000, chain.objs.size()=1 2024-09-12T19:23:00.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.296__shadow_.Y2d_aQ36OHCBW7awFOeOmkhuzFmFE2u_0 2024-09-12T19:23:00.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13643380138505019978', time=2024-09-12T20:33:40.798151+0000, chain.objs.size()=1 2024-09-12T19:23:00.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.297__shadow_.ROBm1jqabYdXt7vlzEgdDmpq4Ah9xvy_0 2024-09-12T19:23:00.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6743564872505272147', time=2024-09-12T20:34:17.708787+0000, chain.objs.size()=1 2024-09-12T19:23:00.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.313__shadow_.Tsn_xWR2RBcv24GOijp8YmYOvcMTVsw_0 2024-09-12T19:23:00.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4025828799239129435', time=2024-09-12T20:36:27.926750+0000, chain.objs.size()=1 2024-09-12T19:23:00.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.oCtN0-3VlUBwxdiNtjZ9vdeio0ELWUi_0 2024-09-12T19:23:00.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15834340881166872743', time=2024-09-12T20:36:28.026453+0000, chain.objs.size()=1 2024-09-12T19:23:00.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ji_OI-dxX0iuZzntv3OTjwwewyo-9l7_0 2024-09-12T19:23:00.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.576573572581934835', time=2024-09-12T20:36:28.502028+0000, chain.objs.size()=1 2024-09-12T19:23:00.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.45rWqksiLo5368Tk9it9rmOsrKGSUD-_0 2024-09-12T19:23:00.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.690+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11551777187270589687', time=2024-09-12T20:36:29.135863+0000, chain.objs.size()=1 2024-09-12T19:23:00.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.690+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.GiFW9Qi2y0qZU7JhXPRLPn22WJTjxlH_0 2024-09-12T19:23:00.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.690+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2778978454681019942', time=2024-09-12T20:36:29.284649+0000, chain.objs.size()=1 2024-09-12T19:23:00.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.690+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.W9vp4Q3WVFHkCUsjPKlwye23U-09Pnb_0 2024-09-12T19:23:00.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.690+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14908444244013819255', time=2024-09-12T20:36:29.892949+0000, chain.objs.size()=1 2024-09-12T19:23:00.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.690+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.m-UY8XT5det-29yyQJmLfCrVn3ECQQE_0 2024-09-12T19:23:00.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.694+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12713352580217842671', time=2024-09-12T20:36:30.165300+0000, chain.objs.size()=1 2024-09-12T19:23:00.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.694+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.uyr72N9Vf0tduHxj5_7QwbsLSFjxmvy_0 2024-09-12T19:23:00.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.694+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3250006582649920988', time=2024-09-12T20:36:32.324805+0000, chain.objs.size()=1 2024-09-12T19:23:00.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.694+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.d2x5GADEtLqhBizIRw8rGnCjXFoQlro_0 2024-09-12T19:23:00.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.694+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6658608176166549332', time=2024-09-12T20:36:32.880480+0000, chain.objs.size()=1 2024-09-12T19:23:00.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.694+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ClrFle-Ya2UraG8sbPIN565vPlP8MuF_0 2024-09-12T19:23:00.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.694+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.718614271260602198', time=2024-09-12T20:36:33.716981+0000, chain.objs.size()=1 2024-09-12T19:23:00.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.694+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.zbW9DVJgo86lqFMVsr8HMZnuOsgkYrQ_0 2024-09-12T19:23:00.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.694+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15451191755268302254', time=2024-09-12T20:36:35.966850+0000, chain.objs.size()=1 2024-09-12T19:23:00.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.694+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Ik0IIZQySo2ehgNcqN-3WTV6i8mTeYU_0 2024-09-12T19:23:00.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.694+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16406629361409612018', time=2024-09-12T20:36:36.431001+0000, chain.objs.size()=1 2024-09-12T19:23:00.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.694+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.nE0RnxYjDZ1xEvMpXVjDLjersjS0Pky_0 2024-09-12T19:23:00.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.694+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7247907589471183148', time=2024-09-12T20:36:37.042684+0000, chain.objs.size()=1 2024-09-12T19:23:00.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.694+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.4j3ldCmiY49M3fVEBNLwcShrIkY3hIV_0 2024-09-12T19:23:00.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.694+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13408983951586453326', time=2024-09-12T20:36:37.044608+0000, chain.objs.size()=1 2024-09-12T19:23:00.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.694+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.QJMv-vIwYBtS7WTZxtQsG8lx8zNqCFB_0 2024-09-12T19:23:00.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.698+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16759180482089367900', time=2024-09-12T20:36:37.465459+0000, chain.objs.size()=1 2024-09-12T19:23:00.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.698+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.p6sCne-SFxcLk3i7YKw7_VA96pUdmvv_0 2024-09-12T19:23:00.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.698+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3784870469415921903', time=2024-09-12T20:36:37.765996+0000, chain.objs.size()=1 2024-09-12T19:23:00.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.698+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ciNC6tcjMxKlAMhMggIMC3k0WYBhqxj_0 2024-09-12T19:23:00.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.698+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11967831880639873133', time=2024-09-12T20:36:38.096360+0000, chain.objs.size()=1 2024-09-12T19:23:00.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.698+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.6ti7unM_VccOXsV-ijw2P0VpfQ8zxwd_0 2024-09-12T19:23:00.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.698+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7467442130501383409', time=2024-09-12T20:36:40.266307+0000, chain.objs.size()=1 2024-09-12T19:23:00.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.698+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.y69skgFtJBhlHLgPXV3UBxkWn8vS1gz_0 2024-09-12T19:23:00.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.698+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6089854702862213194', time=2024-09-12T20:36:40.618216+0000, chain.objs.size()=1 2024-09-12T19:23:00.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.698+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.I1_npwaP1JNThHP2MkD_3RvXvtHbP50_0 2024-09-12T19:23:00.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10208177063882884360', time=2024-09-12T20:36:40.998531+0000, chain.objs.size()=1 2024-09-12T19:23:00.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.SqsJO8JoRHPpN8DW4fEo8MDIBki9Ocl_0 2024-09-12T19:23:00.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6058306448020399746', time=2024-09-12T20:36:41.751565+0000, chain.objs.size()=1 2024-09-12T19:23:00.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Nst4DSSRTOSw-uql_R9UVHXLqCbwJ5H_0 2024-09-12T19:23:00.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15760744137952657377', time=2024-09-12T20:36:42.113197+0000, chain.objs.size()=1 2024-09-12T19:23:00.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.YXPiJn0RcKn0YRYsmQTDxzCRGERmY76_0 2024-09-12T19:23:00.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9862632365296503710', time=2024-09-12T20:36:42.283657+0000, chain.objs.size()=1 2024-09-12T19:23:00.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.1Hb4KpWBjqL0x3AsfxYFoXsS7hblUod_0 2024-09-12T19:23:00.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5369848939355501539', time=2024-09-12T20:36:44.301206+0000, chain.objs.size()=1 2024-09-12T19:23:00.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.AcQUtsX1DDRcpL4oYc-c7wfB66dtIZj_0 2024-09-12T19:23:00.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4536903580083041747', time=2024-09-12T20:36:45.785226+0000, chain.objs.size()=1 2024-09-12T19:23:00.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.fGv2umRdzifbsq-dQUTOlONNYd_4HmK_0 2024-09-12T19:23:00.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7116741483044589380', time=2024-09-12T20:36:46.996205+0000, chain.objs.size()=1 2024-09-12T19:23:00.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.9fRvDTh75ruWYj0sBGAt2cOlVtlIJ4F_0 2024-09-12T19:23:00.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1124557787313882631', time=2024-09-12T20:36:47.787544+0000, chain.objs.size()=1 2024-09-12T19:23:00.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.QDIhNOzoL8JvDJ-SZ9R-XURnA0b0Zgk_0 2024-09-12T19:23:00.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.706+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4875018206276647526', time=2024-09-12T20:36:48.034144+0000, chain.objs.size()=1 2024-09-12T19:23:00.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.706+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.CTBwYFho9pYJ3TnyaDXqjOybJYWhsUV_0 2024-09-12T19:23:00.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.706+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16157565688413652417', time=2024-09-12T20:36:48.145358+0000, chain.objs.size()=1 2024-09-12T19:23:00.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.706+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.0bKFgYJ89Bms6UcP8cCJ7vgxqEOHxUH_0 2024-09-12T19:23:00.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.706+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13856747532831451427', time=2024-09-12T20:36:48.229365+0000, chain.objs.size()=1 2024-09-12T19:23:00.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.706+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.1HLjlVhtIkiWA7GHcLgIp8nwKliSKUV_0 2024-09-12T19:23:00.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.706+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5342799444557938533', time=2024-09-12T20:36:48.347960+0000, chain.objs.size()=1 2024-09-12T19:23:00.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.706+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.X-O7wQcSi6cBYpI2atUNN_v83lfFEAi_0 2024-09-12T19:23:00.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.706+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2637941248604082649', time=2024-09-12T20:36:49.049752+0000, chain.objs.size()=1 2024-09-12T19:23:00.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.706+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Kt1iEJEn5ZFmozJrcHgbVNhp69RJnfh_0 2024-09-12T19:23:00.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8934270644585807062', time=2024-09-12T20:36:49.727466+0000, chain.objs.size()=1 2024-09-12T19:23:00.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.I28qhTdVKH_yHIJOBpl7HVX9fP1J_EZ_0 2024-09-12T19:23:00.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4075920147111119740', time=2024-09-12T20:36:50.559042+0000, chain.objs.size()=1 2024-09-12T19:23:00.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.wfvtzXEo5aOh_QzZ1f5e5m_arPWRiDs_0 2024-09-12T19:23:00.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4479555680002396229', time=2024-09-12T20:36:50.899967+0000, chain.objs.size()=1 2024-09-12T19:23:00.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.JZMiQe3tZgXJEihOoldssPHp0Y9BJjE_0 2024-09-12T19:23:00.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16944055327886233549', time=2024-09-12T20:36:53.358615+0000, chain.objs.size()=1 2024-09-12T19:23:00.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.BEaKGX4QGn2bxHu6tTMYu5dJDBrYr-d_0 2024-09-12T19:23:00.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6519804149368336634', time=2024-09-12T20:36:53.360579+0000, chain.objs.size()=1 2024-09-12T19:23:00.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.suBblnsR4pDty1brJMq5G27mtvR3XyJ_0 2024-09-12T19:23:00.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.589291944298058282', time=2024-09-12T20:36:53.915401+0000, chain.objs.size()=1 2024-09-12T19:23:00.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.l_AN0CHtMPTtp_sYFlGtglOkSoWnydP_0 2024-09-12T19:23:00.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.171142280484238027', time=2024-09-12T20:36:55.174477+0000, chain.objs.size()=1 2024-09-12T19:23:00.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.S2ypRub4xg_XdIh0f_4BmqMCh1_ryF7_0 2024-09-12T19:23:00.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7180040617985975444', time=2024-09-12T20:36:56.079031+0000, chain.objs.size()=1 2024-09-12T19:23:00.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.WYtKXKURiQxTZBwDmiR3_VAgLnidZXR_0 2024-09-12T19:23:00.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12152740253213794212', time=2024-09-12T20:36:56.309410+0000, chain.objs.size()=1 2024-09-12T19:23:00.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.PEaOkr0-GpEKm0o6luzhtmY40LQx0oa_0 2024-09-12T19:23:00.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16893952185941755368', time=2024-09-12T20:38:40.877925+0000, chain.objs.size()=1 2024-09-12T19:23:00.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.x0p4FlufUCMhT-vtmKsr49NU-_0yfW-_0 2024-09-12T19:23:00.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.714+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8084989580081471285', time=2024-09-12T20:38:41.084617+0000, chain.objs.size()=1 2024-09-12T19:23:00.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.714+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.YPStxl0M3QMq0QyCtQO025SKIRQE7qC_0 2024-09-12T19:23:00.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.714+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6460601835401398008', time=2024-09-12T20:38:41.843925+0000, chain.objs.size()=1 2024-09-12T19:23:00.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.714+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.z9m6Ucw2eqMY0AsFVeNN4ewE3QzaIP1_0 2024-09-12T19:23:00.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.714+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8866131507483171144', time=2024-09-12T20:38:42.560511+0000, chain.objs.size()=1 2024-09-12T19:23:00.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.714+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ptyRad0GKO9voNDlHr2ypcUc5uBsvG5_0 2024-09-12T19:23:00.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2006868662927639680', time=2024-09-12T20:38:44.164454+0000, chain.objs.size()=1 2024-09-12T19:23:00.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.TcoqfQnWKp7kB91t_WH2zTGPzYrmBru_0 2024-09-12T19:23:00.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1035403477066950823', time=2024-09-12T20:38:46.560139+0000, chain.objs.size()=1 2024-09-12T19:23:00.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.P38uciv1mhW5GA_pxu0-mJtYpVdkjRq_0 2024-09-12T19:23:00.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2417379478649628503', time=2024-09-12T20:38:49.196556+0000, chain.objs.size()=1 2024-09-12T19:23:00.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.j7y5GUz-Vox5nFVZ-7N9KnhnQJ0KLzh_0 2024-09-12T19:23:00.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7013182053293125798', time=2024-09-12T20:38:49.834793+0000, chain.objs.size()=1 2024-09-12T19:23:00.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.2N27FFBOZyACWaxqtEinPLkDY8KaLmv_0 2024-09-12T19:23:00.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12836450840977077397', time=2024-09-12T20:38:52.647887+0000, chain.objs.size()=1 2024-09-12T19:23:00.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.E-afISfOIInqeGQMRSS0FGJWTtHl-5p_0 2024-09-12T19:23:00.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16363040417274677845', time=2024-09-12T20:38:53.795180+0000, chain.objs.size()=1 2024-09-12T19:23:00.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.atkOTJvEo-5YkpHvZL1RdRV3IvFYidJ_0 2024-09-12T19:23:00.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13598322636922703184', time=2024-09-12T20:38:55.037101+0000, chain.objs.size()=1 2024-09-12T19:23:00.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.wPBAwl-WLytLkug6hRoHFmalA7nrpvc_0 2024-09-12T19:23:00.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1243410622214822772', time=2024-09-12T20:38:55.039018+0000, chain.objs.size()=1 2024-09-12T19:23:00.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.vQ2k_9ATzeH5_dHn1NQe1P4yFVy7vvP_0 2024-09-12T19:23:00.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14473604533098343496', time=2024-09-12T20:38:55.813826+0000, chain.objs.size()=1 2024-09-12T19:23:00.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ayfjCLCkGPGkbDymFSoBJbT4cA5TBVD_0 2024-09-12T19:23:00.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15544220489195251561', time=2024-09-12T20:38:57.676467+0000, chain.objs.size()=1 2024-09-12T19:23:00.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.n_8VFgYH-cbVnIYBQV7Ol1582pwA0sJ_0 2024-09-12T19:23:00.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7743273812525511782', time=2024-09-12T20:38:58.664602+0000, chain.objs.size()=1 2024-09-12T19:23:00.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.IkftLqW2MEqwQjuge_Ix158cGz7CpFB_0 2024-09-12T19:23:00.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15363353590066585945', time=2024-09-12T20:38:59.066847+0000, chain.objs.size()=1 2024-09-12T19:23:00.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.4MJyOLeRS36eA4RZWQeiBw-vTcZ7Xra_0 2024-09-12T19:23:00.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11633490255974890570', time=2024-09-12T20:38:59.807680+0000, chain.objs.size()=1 2024-09-12T19:23:00.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.GaaCbmT2tTtX85lYyI1oFhZe5-3CUr8_0 2024-09-12T19:23:00.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9713212505018300746', time=2024-09-12T20:39:00.506986+0000, chain.objs.size()=1 2024-09-12T19:23:00.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.gZivyCCTbkmF9uXwNL2aCbXIlvPFkVu_0 2024-09-12T19:23:00.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4413069927121130830', time=2024-09-12T20:39:02.226838+0000, chain.objs.size()=1 2024-09-12T19:23:00.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.oq0OBrAOmxwrUMHpk0FUAObWRAB7PIW_0 2024-09-12T19:23:00.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7408610921792760419', time=2024-09-12T20:39:02.332539+0000, chain.objs.size()=1 2024-09-12T19:23:00.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.2tBUR7eNOHL2NHN0GE9_KfvvkyC9swB_0 2024-09-12T19:23:00.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2009896110281443108', time=2024-09-12T20:39:02.657316+0000, chain.objs.size()=1 2024-09-12T19:23:00.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.xfDpD6Q8VkLFMuh9AieqCDnAkIg94Q1_0 2024-09-12T19:23:00.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10666074530113641883', time=2024-09-12T20:39:02.799379+0000, chain.objs.size()=1 2024-09-12T19:23:00.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.61uFxxXtzChqZhSKJnZ7QVn2BkRNaLa_0 2024-09-12T19:23:00.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4806358117776586991', time=2024-09-12T20:39:04.217751+0000, chain.objs.size()=1 2024-09-12T19:23:00.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.bkdxEBokbX6V5LEZ0RXJ9kWpYT9ptRk_0 2024-09-12T19:23:00.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3249221879541843011', time=2024-09-12T20:39:04.288599+0000, chain.objs.size()=1 2024-09-12T19:23:00.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.YP-75G6iOjd2nNKrYQZeaodG58O6jod_0 2024-09-12T19:23:00.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9935960226421483499', time=2024-09-12T20:39:07.314568+0000, chain.objs.size()=1 2024-09-12T19:23:00.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.1ASUDY4IzoHWJ9ahxJkXE6rz_8MPBSS_0 2024-09-12T19:23:00.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16967219337228928847', time=2024-09-12T20:39:07.383715+0000, chain.objs.size()=1 2024-09-12T19:23:00.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.xkb9L88xTvTF0yHvlI-En8PulwLJ8R9_0 2024-09-12T19:23:00.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8720474901229018422', time=2024-09-12T20:39:07.576968+0000, chain.objs.size()=1 2024-09-12T19:23:00.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Gx_FO6lkyL_UYJ4ZfXcfF9895P4KM3n_0 2024-09-12T19:23:00.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.730+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47390 2024-09-12T19:23:00.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T19:23:00.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2121774800020816607', time=2024-09-12T20:39:07.830439+0000, chain.objs.size()=1 2024-09-12T19:23:00.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.B4K3jWvBzFQ7oFM3J2awCayEJTS3wrg_0 2024-09-12T19:23:00.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8931628387945773691', time=2024-09-12T20:39:17.534714+0000, chain.objs.size()=1 2024-09-12T19:23:00.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.329__shadow_.TR1tEKbZBfMVsP7Pd6yHf-YCK4CKR2S_0 2024-09-12T19:23:00.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16691691002528806248', time=2024-09-12T20:45:10.315247+0000, chain.objs.size()=1 2024-09-12T19:23:00.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.498__shadow_.eqcFQ41oKQAJLuIB9Tt1XBNEZ_AV0-K_0 2024-09-12T19:23:00.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15584501752199768977', time=2024-09-12T20:49:44.177557+0000, chain.objs.size()=6 2024-09-12T19:23:00.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~vH3tAeQLifh1X84Rw9mc3FzlQlxaMjj.1 2024-09-12T19:23:00.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.4bq2vXtJ4tqT5sT9DZgn1RLo36p0ihyH.2 2024-09-12T19:23:00.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~vH3tAeQLifh1X84Rw9mc3FzlQlxaMjj.3 2024-09-12T19:23:00.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~vH3tAeQLifh1X84Rw9mc3FzlQlxaMjj.4 2024-09-12T19:23:00.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~vH3tAeQLifh1X84Rw9mc3FzlQlxaMjj.5 2024-09-12T19:23:00.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~vH3tAeQLifh1X84Rw9mc3FzlQlxaMjj.6 2024-09-12T19:23:00.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10508818964672065077', time=2024-09-12T20:50:23.626897+0000, chain.objs.size()=6 2024-09-12T19:23:00.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~ao3RgPkgQzpf515S__C1WsHZzggrFls.1 2024-09-12T19:23:00.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~ao3RgPkgQzpf515S__C1WsHZzggrFls.2 2024-09-12T19:23:00.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.Qjznw3KxkoUpOPLnrN2eNE0ibss4WQSQ.3 2024-09-12T19:23:00.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.738+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~ao3RgPkgQzpf515S__C1WsHZzggrFls.4 2024-09-12T19:23:00.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.738+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~ao3RgPkgQzpf515S__C1WsHZzggrFls.5 2024-09-12T19:23:00.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.738+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~ao3RgPkgQzpf515S__C1WsHZzggrFls.6 2024-09-12T19:23:00.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.738+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15803257207983076309', time=2024-09-12T20:56:07.800559+0000, chain.objs.size()=1 2024-09-12T19:23:00.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.738+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.558__shadow_.NlFd3GQi7HrPxKm_RFpZapbrfnP7ZUV_0 2024-09-12T19:23:00.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.738+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17390912404092443612', time=2024-09-12T20:56:49.085020+0000, chain.objs.size()=1 2024-09-12T19:23:00.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.738+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:H22K9TdM-hiUC1WPWzSI5dche3rp.an_.CVWsuQrtj3eXmYK4KRLsORGJui_UhwQ_0 2024-09-12T19:23:00.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.738+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2330251803235335397', time=2024-09-12T20:56:53.556795+0000, chain.objs.size()=1 2024-09-12T19:23:00.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.738+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:qMxVaQMWsUMo8m1ZhAfCZgbsxSkMdU7_.7w3jQXhzbcMBZhLrV_jJEXohWy6-5CI_0 2024-09-12T19:23:00.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.738+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6919907988914408965', time=2024-09-12T20:57:11.996823+0000, chain.objs.size()=1 2024-09-12T19:23:00.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.738+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.571__shadow_.BaaRQgRd0zgjq3At3_trFHTSwS-7prA_0 2024-09-12T19:23:00.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.738+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12274272198010041657', time=2024-09-12T20:57:26.512615+0000, chain.objs.size()=1 2024-09-12T19:23:00.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.738+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.574__shadow:UVjTiN2-Vmn3CCzhmRol9CxMmxv7mz8_.ICKNDWNEYbiC8m9qbEbgO4eTi6sJ7xO_0 2024-09-12T19:23:00.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.738+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.419114791319974286', time=2024-09-12T20:57:55.970959+0000, chain.objs.size()=1 2024-09-12T19:23:00.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.738+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:Z0ZZH3rtms8Dnhg4lpNRc3wvw5UOP-D_.HQLgxu7e6Ai2yD5ybM8s5EOVL672bly_0 2024-09-12T19:23:00.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.738+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7343072744896429876', time=2024-09-12T20:58:04.714280+0000, chain.objs.size()=1 2024-09-12T19:23:00.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.738+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:o19aPQUNGoN4rZmDJ5pXeEIRdW2dUKV_.ZlxcR35IWT4FTSEa4CyMnZRLrwKc2Gb_0 2024-09-12T19:23:00.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.738+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8228883127118601519', time=2024-09-12T20:58:12.920862+0000, chain.objs.size()=1 2024-09-12T19:23:00.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.738+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:L4ZcBzWYUTdEpZTPweb-YBKkkZ8MkX4_.rkKBjLVEN-wiTqfECBVaS7uwo7RHiEt_0 2024-09-12T19:23:00.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.742+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9715596859738897923', time=2024-09-12T20:59:35.744325+0000, chain.objs.size()=1 2024-09-12T19:23:00.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.742+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.580__shadow:5sC2Adaitf0usoMb8hLTKYcZQiru7s9_.OxurRxCCCxu-05c_B6XfK8BrquQ6HF2_0 2024-09-12T19:23:00.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.742+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7831221040685250955', time=2024-09-12T20:59:47.084122+0000, chain.objs.size()=1 2024-09-12T19:23:00.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.742+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.585__shadow:btKTlBFeIZMeQk87U4wHCx8O84enR8S_.gX-0iGn9qcFSsbKnTj9SA0MUsy7gwmR_0 2024-09-12T19:23:00.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.742+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14862528564742925542', time=2024-09-12T21:08:01.077854+0000, chain.objs.size()=1 2024-09-12T19:23:00.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.742+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.647__shadow_.qoc-qu3w4S4i8Hi9uIZu9e4JYJGLWjx_0 2024-09-12T19:23:00.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.742+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16281509952681396005', time=2024-09-12T21:09:42.306608+0000, chain.objs.size()=1 2024-09-12T19:23:00.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.742+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.665__shadow_.Uou4ZAQrTI_YSHCkAWhSIZ5z2U2MeyA_0 2024-09-12T19:23:00.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.742+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11100713522751777544', time=2024-09-12T21:10:40.715478+0000, chain.objs.size()=1 2024-09-12T19:23:00.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.742+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.696__shadow:mXs11ZYHAi1r0Dod08c7Vs-xGWdqGk5_.aEopyXwZV5wFBH7Frvt38BpwfdictS8_0 2024-09-12T19:23:00.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.746+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:00.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T19:23:00.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:00.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:00.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48239' 2024-09-12T19:23:00.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15129177133246886606', time=2024-09-12T20:22:16.344118+0000, chain.objs.size()=3 2024-09-12T19:23:00.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.159__multipart_mymultipart-FROZEN.2~11sO_snJStiFXVViDcEsvFIY-aQbHzq.1 2024-09-12T19:23:00.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.159__multipart_mymultipart-FROZEN.2~11sO_snJStiFXVViDcEsvFIY-aQbHzq.2 2024-09-12T19:23:00.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.159__multipart_mymultipart-FROZEN.2~11sO_snJStiFXVViDcEsvFIY-aQbHzq.3 2024-09-12T19:23:00.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='_4wJGbHZNcdZHClfJ0hGarkkbRpUfvPc', time=2024-09-12T20:22:41.375202+0000, chain.objs.size()=2 2024-09-12T19:23:00.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.160__shadow_.ytbMnvwWOpsCO8le9Ycxl_BPjadM6uo_0 2024-09-12T19:23:00.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.160__shadow_.ytbMnvwWOpsCO8le9Ycxl_BPjadM6uo_1 2024-09-12T19:23:00.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1402786807846363825', time=2024-09-12T20:23:41.129173+0000, chain.objs.size()=1 2024-09-12T19:23:00.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.166__shadow_.CLVCB6WASDWjVAE-nZHEFX-HCnrqEse_0 2024-09-12T19:23:00.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6358222446411422885', time=2024-09-12T20:29:23.298667+0000, chain.objs.size()=1 2024-09-12T19:23:00.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.244__shadow_.OeuAB39wQigiu2IYBG_z6zZDJWllION_0 2024-09-12T19:23:00.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17180977185792723849', time=2024-09-12T20:29:23.300224+0000, chain.objs.size()=1 2024-09-12T19:23:00.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.244__shadow_.9bHh7jJo29Yb52Jy8vYch2BCSfCXGzS_0 2024-09-12T19:23:00.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3639221974270980162', time=2024-09-12T20:29:44.038073+0000, chain.objs.size()=1 2024-09-12T19:23:00.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.253__shadow_.vOWUeEw9F-6i7t_Zruk9OE_gZYmWD-I_0 2024-09-12T19:23:00.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4242530108561511488', time=2024-09-12T20:29:57.511380+0000, chain.objs.size()=1 2024-09-12T19:23:00.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.259__shadow_.LaO4RmOM4AoKgLVJKHYv4kwaxW0cIUg_0 2024-09-12T19:23:00.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2551706100148112197', time=2024-09-12T20:31:45.200210+0000, chain.objs.size()=1 2024-09-12T19:23:00.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.-8OjSe6uyvh0YPfdre14fCdCrq2YnWM_0 2024-09-12T19:23:00.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1823904742491504640', time=2024-09-12T20:31:45.581811+0000, chain.objs.size()=1 2024-09-12T19:23:00.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.aKJgk9ySAd3gGgwwkXBhkxA1lF1D5hk_0 2024-09-12T19:23:00.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8763033910589144736', time=2024-09-12T20:31:46.168048+0000, chain.objs.size()=1 2024-09-12T19:23:00.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.wcS81DV_r0GffyeRoawpJciaAVgOAGp_0 2024-09-12T19:23:00.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.758+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17083722151646514375', time=2024-09-12T20:31:46.646985+0000, chain.objs.size()=1 2024-09-12T19:23:00.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.758+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.oH-KvDdre7LZ0vzu0SW_Gu6aQrcE2NF_0 2024-09-12T19:23:00.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.758+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17829122447316585562', time=2024-09-12T20:31:46.737977+0000, chain.objs.size()=1 2024-09-12T19:23:00.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.758+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.4xjv9Ep-rIgus0ZZcaboUDZFYAhUhTC_0 2024-09-12T19:23:00.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.758+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7395048337583489106', time=2024-09-12T20:31:46.940728+0000, chain.objs.size()=1 2024-09-12T19:23:00.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.758+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.tkHmSIassfOXSiBJtXQaQE9ROR6TGsj_0 2024-09-12T19:23:00.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.758+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9595978410861406522', time=2024-09-12T20:31:47.940943+0000, chain.objs.size()=1 2024-09-12T19:23:00.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.758+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.CXr3Xbb9-djt2wct_g8B20EnPOhzcYE_0 2024-09-12T19:23:00.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.758+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12099757394766692185', time=2024-09-12T20:31:48.011948+0000, chain.objs.size()=1 2024-09-12T19:23:00.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.758+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.xl15m_SpREO-wIlkLzE6qbiHLLcisrh_0 2024-09-12T19:23:00.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.758+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8868343856007484833', time=2024-09-12T20:31:49.263922+0000, chain.objs.size()=1 2024-09-12T19:23:00.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.758+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.dc_loVlFarH-QisL-udxI8iX8vAOEQw_0 2024-09-12T19:23:00.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.758+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18442164039363409025', time=2024-09-12T20:31:49.628422+0000, chain.objs.size()=1 2024-09-12T19:23:00.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.758+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ghtWLPjmaaIJOvPe_sJg_yPIETXVvEk_0 2024-09-12T19:23:00.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.758+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2219858930404485280', time=2024-09-12T20:31:49.645704+0000, chain.objs.size()=1 2024-09-12T19:23:00.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.758+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.TXEC12xsuJBnLUPrdNAgKAwGurU62YJ_0 2024-09-12T19:23:00.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.762+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14926162995372556661', time=2024-09-12T20:31:55.442422+0000, chain.objs.size()=1 2024-09-12T19:23:00.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.762+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.xudSj8O0bnGZ_E806oDE7DAAs331B9M_0 2024-09-12T19:23:00.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.762+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17810317984153757722', time=2024-09-12T20:31:55.907289+0000, chain.objs.size()=1 2024-09-12T19:23:00.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.762+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.jNLFJB46KKE8-wOcDU4-X6aU7TWpeVl_0 2024-09-12T19:23:00.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.762+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18132930055833751559', time=2024-09-12T20:31:57.259592+0000, chain.objs.size()=1 2024-09-12T19:23:00.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.762+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.BRg0BpV9lC74iTjhfIAKB3xwA4dsTLa_0 2024-09-12T19:23:00.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.762+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6753029978604940598', time=2024-09-12T20:31:57.363392+0000, chain.objs.size()=1 2024-09-12T19:23:00.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.762+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.7CSbCyGuGflqxu7vxyQ369VtAEqIUO0_0 2024-09-12T19:23:00.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.762+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7305277252321419368', time=2024-09-12T20:31:57.721633+0000, chain.objs.size()=1 2024-09-12T19:23:00.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.762+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.E0HFy3hVPOLFlQ4SmBdAIfX7BGJ4kUT_0 2024-09-12T19:23:00.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.766+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9939213223600381870', time=2024-09-12T20:31:58.081562+0000, chain.objs.size()=1 2024-09-12T19:23:00.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.766+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_._5kUcWIZBkVHi_GWVFdZQtpiO4b0PD7_0 2024-09-12T19:23:00.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.766+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9189863666006989780', time=2024-09-12T20:31:58.978096+0000, chain.objs.size()=1 2024-09-12T19:23:00.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.766+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.zaEPzwNryKsW9fKbS-py_Q2LBw8MbLW_0 2024-09-12T19:23:00.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.766+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14718229064957628841', time=2024-09-12T20:31:59.055831+0000, chain.objs.size()=1 2024-09-12T19:23:00.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.766+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Ajc8JZ-f-3QzeYpm6Oet5JQdwusj4cX_0 2024-09-12T19:23:00.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.766+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3697936101254905592', time=2024-09-12T20:31:59.058496+0000, chain.objs.size()=1 2024-09-12T19:23:00.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.766+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Zpla8UjeQutVxzdIqDb5i_N2_ePRo-4_0 2024-09-12T19:23:00.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.766+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13494608844838661156', time=2024-09-12T20:32:01.273042+0000, chain.objs.size()=1 2024-09-12T19:23:00.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.766+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ku44VMFwADlFElqLblcXtavG2H98YoL_0 2024-09-12T19:23:00.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.766+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7898303283292375246', time=2024-09-12T20:32:01.546318+0000, chain.objs.size()=1 2024-09-12T19:23:00.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.766+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.iwZhqkMQuA4_SpL-vUg4DTsMEtW9Zef_0 2024-09-12T19:23:00.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17678529955153440183', time=2024-09-12T20:32:01.636457+0000, chain.objs.size()=1 2024-09-12T19:23:00.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.V89qx_Is6ITiB6TW0wUqCTP78DH8LDY_0 2024-09-12T19:23:00.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4117514656035241105', time=2024-09-12T20:32:01.934323+0000, chain.objs.size()=1 2024-09-12T19:23:00.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.FkBxJF-cMz82jpYQ1iNs0RyEP7p50ri_0 2024-09-12T19:23:00.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4959890748515118630', time=2024-09-12T20:32:02.033106+0000, chain.objs.size()=1 2024-09-12T19:23:00.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.y60DdOh6n0K0P0CAjvEhcywwVADxVjT_0 2024-09-12T19:23:00.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16920963543278773547', time=2024-09-12T20:32:02.520658+0000, chain.objs.size()=1 2024-09-12T19:23:00.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.sNnHSjFlkEOuDVQFDtR9yqXXhmiDl0i_0 2024-09-12T19:23:00.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15153133404899254441', time=2024-09-12T20:32:02.926505+0000, chain.objs.size()=1 2024-09-12T19:23:00.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.T-83OCvl4clyB-3Z7QKSU4TE_Aq8BJi_0 2024-09-12T19:23:00.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9603494250127290114', time=2024-09-12T20:32:03.444761+0000, chain.objs.size()=1 2024-09-12T19:23:00.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.zU_3_qpz_PbnvkCqhybNE5GmQh8Utm8_0 2024-09-12T19:23:00.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14169746346650491637', time=2024-09-12T20:32:04.690349+0000, chain.objs.size()=1 2024-09-12T19:23:00.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.7cjWhLUZSrFVxR5AAq5O5rUF8XDxzMV_0 2024-09-12T19:23:00.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16971248827621673376', time=2024-09-12T20:32:04.761121+0000, chain.objs.size()=1 2024-09-12T19:23:00.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.KzJ_73bax4s24dGyj404BfB4k7tk4zV_0 2024-09-12T19:23:00.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.774+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16723631614293418220', time=2024-09-12T20:32:05.305526+0000, chain.objs.size()=1 2024-09-12T19:23:00.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.774+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.6lFV2gGWpDwmD4tmIA4PvmVsLRVMtIu_0 2024-09-12T19:23:00.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.774+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11485494663094710749', time=2024-09-12T20:32:05.375715+0000, chain.objs.size()=1 2024-09-12T19:23:00.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.774+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.vSDkEdVNAgRQqs0LMjDxRwDrcPV5Yyf_0 2024-09-12T19:23:00.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.774+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.449558608153747140', time=2024-09-12T20:32:06.911845+0000, chain.objs.size()=1 2024-09-12T19:23:00.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.774+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.FxD0I2xMJhD6_uLS_dQ_nYzYqxbf8Dd_0 2024-09-12T19:23:00.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.774+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7066704159841512002', time=2024-09-12T20:32:07.069925+0000, chain.objs.size()=1 2024-09-12T19:23:00.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.774+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Drp7jF3kDxRc8dNTBAwWNvURZUwl7Rl_0 2024-09-12T19:23:00.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.774+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5946236939980757673', time=2024-09-12T20:32:07.243308+0000, chain.objs.size()=1 2024-09-12T19:23:00.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.774+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.8tV908bHFTc3jHYzCfCoJ4CI6EkSi-N_0 2024-09-12T19:23:00.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.778+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10162979598958526485', time=2024-09-12T20:32:08.027444+0000, chain.objs.size()=1 2024-09-12T19:23:00.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.778+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.YC2aHmryy8X6h3eQT0EV_R1zrt6LLn4_0 2024-09-12T19:23:00.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.778+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11098121667947392889', time=2024-09-12T20:32:08.453463+0000, chain.objs.size()=1 2024-09-12T19:23:00.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.778+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.EaKbx99u6G3v0qKvU0zd6kBDeNVKOH3_0 2024-09-12T19:23:00.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.778+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13684907119277379952', time=2024-09-12T20:32:08.952185+0000, chain.objs.size()=1 2024-09-12T19:23:00.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.778+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Q-3RyrT1-2wSJGCauXCTFSxaaoQ5VbW_0 2024-09-12T19:23:00.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.778+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12526659969777414812', time=2024-09-12T20:32:08.954225+0000, chain.objs.size()=1 2024-09-12T19:23:00.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.778+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.k_FUGxLiaZvvXmfgCVar7_S_F8djpMc_0 2024-09-12T19:23:00.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.778+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11387982955399324197', time=2024-09-12T20:32:09.540528+0000, chain.objs.size()=1 2024-09-12T19:23:00.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.778+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.FFrbKgPwe9RDJ1fSRR4M1BHvqP33qCE_0 2024-09-12T19:23:00.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.778+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8834258000812714516', time=2024-09-12T20:32:09.542064+0000, chain.objs.size()=1 2024-09-12T19:23:00.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.778+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.DoI-Ns_pkTWizphtgl9BcUY_UxAavT5_0 2024-09-12T19:23:00.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.311173414811401197', time=2024-09-12T20:32:10.781716+0000, chain.objs.size()=1 2024-09-12T19:23:00.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.MqixXwL0aI2zkAFcXhDS63ogrbsNERX_0 2024-09-12T19:23:00.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8491665786781841229', time=2024-09-12T20:32:10.783318+0000, chain.objs.size()=1 2024-09-12T19:23:00.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.A-Fwz0YOIsB-gFLwLLt4BFN-kIn-fsk_0 2024-09-12T19:23:00.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1672920067353097430', time=2024-09-12T20:32:10.785194+0000, chain.objs.size()=1 2024-09-12T19:23:00.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.MF0y1MFryzqKOSTIRQV5StWoAYIe2vn_0 2024-09-12T19:23:00.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8515821791008858041', time=2024-09-12T20:32:10.913151+0000, chain.objs.size()=1 2024-09-12T19:23:00.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.bi27IW4IvVmijHkLODvNUZdVZU3wQu0_0 2024-09-12T19:23:00.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2855751982430557162', time=2024-09-12T20:32:11.763904+0000, chain.objs.size()=1 2024-09-12T19:23:00.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.mq-IqNNvpN33pWbm9ez2pV2R_F3AiY-_0 2024-09-12T19:23:00.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3690210206379712258', time=2024-09-12T20:32:12.029019+0000, chain.objs.size()=1 2024-09-12T19:23:00.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.md3v-oUUXTU6E_iQ46DTl1O32en252W_0 2024-09-12T19:23:00.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14802265772102219232', time=2024-09-12T20:32:12.425872+0000, chain.objs.size()=1 2024-09-12T19:23:00.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.jkiuH32gLyRh9u2QxqXhoD7JPNJKlPo_0 2024-09-12T19:23:00.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5663114191120676665', time=2024-09-12T20:32:13.800762+0000, chain.objs.size()=1 2024-09-12T19:23:00.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.sLmxD8HjFXJczLfI6qIfErQ5WHZhWGO_0 2024-09-12T19:23:00.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7426324319432851690', time=2024-09-12T20:32:22.821377+0000, chain.objs.size()=1 2024-09-12T19:23:00.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.266__shadow_.H6Oc2DEkWqJkpz4Uipqc0DCzn-Uz-n__0 2024-09-12T19:23:00.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8021097077879884991', time=2024-09-12T20:32:29.324107+0000, chain.objs.size()=1 2024-09-12T19:23:00.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.269__shadow_.HSgy1tp6Ip1kczMLSIsgYrNqbjmBoot_0 2024-09-12T19:23:00.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15559851290288416209', time=2024-09-12T20:32:42.527486+0000, chain.objs.size()=1 2024-09-12T19:23:00.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.275__shadow_.m_vOYXfFYlfoZ9pG3KKEhfSwPa7WDWL_0 2024-09-12T19:23:00.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12925612998190664467', time=2024-09-12T20:32:47.222079+0000, chain.objs.size()=1 2024-09-12T19:23:00.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.277__shadow_.WqWJ_7qgsXNDoWi6FeZnU8shmreZ784_0 2024-09-12T19:23:00.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13224042561193050566', time=2024-09-12T20:32:47.235196+0000, chain.objs.size()=1 2024-09-12T19:23:00.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.277__shadow_.SWIQebacRXsqO2zQMVeEubOHee2YeDE_0 2024-09-12T19:23:00.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13396516573280775160', time=2024-09-12T20:33:43.373540+0000, chain.objs.size()=1 2024-09-12T19:23:00.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.298__shadow_.GHQPChPdDR1LlSq_EPOQ2SgiEGWsOmC_0 2024-09-12T19:23:00.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4088568832437543337', time=2024-09-12T20:33:43.374967+0000, chain.objs.size()=1 2024-09-12T19:23:00.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.298__shadow_.fTxLgdiIwDJBwZG209nfi9depXmKCle_0 2024-09-12T19:23:00.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7888929445961959295', time=2024-09-12T20:34:38.556339+0000, chain.objs.size()=1 2024-09-12T19:23:00.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.319__shadow:ALSVO1n.5WGcJ93p5ReR9dm3ptjnVx1_.k3ybYukM0ig6NvWAeK3D5EKHuKBuj94_0 2024-09-12T19:23:00.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9399452335716090769', time=2024-09-12T20:34:44.822495+0000, chain.objs.size()=1 2024-09-12T19:23:00.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.786+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.322__shadow_.D6H23RI2UvkeY80bDu2h71BtkvHsl4x_0 2024-09-12T19:23:00.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7771379746548490379', time=2024-09-12T20:36:28.290216+0000, chain.objs.size()=1 2024-09-12T19:23:00.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.3w7ffoCdfM4-IIXJLVjVmPY3d95rvjC_0 2024-09-12T19:23:00.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6551138815962578349', time=2024-09-12T20:36:29.237693+0000, chain.objs.size()=1 2024-09-12T19:23:00.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.sEM_aqXwyr0CyICfRj4o-fPnk5oR5TK_0 2024-09-12T19:23:00.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15332598003412030651', time=2024-09-12T20:36:29.449707+0000, chain.objs.size()=1 2024-09-12T19:23:00.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.MegajpvWVc92OkYY4wVBWgqR54i47FY_0 2024-09-12T19:23:00.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3349648799774841046', time=2024-09-12T20:36:29.829129+0000, chain.objs.size()=1 2024-09-12T19:23:00.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.xYwA-rDmEGpqFFv3Zx5R7lfuBIMxh0t_0 2024-09-12T19:23:00.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1239395736972659096', time=2024-09-12T20:36:32.447662+0000, chain.objs.size()=1 2024-09-12T19:23:00.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_._qyTYzLXeylJYJmAbtH4IfTbE1D-P6q_0 2024-09-12T19:23:00.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6566632670951838381', time=2024-09-12T20:36:32.644288+0000, chain.objs.size()=1 2024-09-12T19:23:00.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.qWjeK7Y4evXATcab4Mvpa4kZQ4vUbFA_0 2024-09-12T19:23:00.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17865107201869516076', time=2024-09-12T20:36:33.147306+0000, chain.objs.size()=1 2024-09-12T19:23:00.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.2A9lTb82DhA7uj-TcIVUSjLjyCHPK9i_0 2024-09-12T19:23:00.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13748540452534279588', time=2024-09-12T20:36:34.740027+0000, chain.objs.size()=1 2024-09-12T19:23:00.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.hqthD7wa8CHNvVbSFDP-G72ya2IOmP5_0 2024-09-12T19:23:00.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10427961823075883175', time=2024-09-12T20:36:35.822999+0000, chain.objs.size()=1 2024-09-12T19:23:00.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Zh1idLpXbkGzazOcdBcj7d5XDtUM9hE_0 2024-09-12T19:23:00.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12695335850286231991', time=2024-09-12T20:36:37.332485+0000, chain.objs.size()=1 2024-09-12T19:23:00.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.RlvdkYs8fMaPSDiysI1HtVBiycFNDZR_0 2024-09-12T19:23:00.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5966852918560812687', time=2024-09-12T20:36:37.547988+0000, chain.objs.size()=1 2024-09-12T19:23:00.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.DKXx5RtlNwRo8MyE2i71r2xysS3B9AZ_0 2024-09-12T19:23:00.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7314109380515032004', time=2024-09-12T20:36:37.760444+0000, chain.objs.size()=1 2024-09-12T19:23:00.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.g3ls3NqXWtshnzrgte2ett7rZGOPecJ_0 2024-09-12T19:23:00.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7278847534744644392', time=2024-09-12T20:36:38.168652+0000, chain.objs.size()=1 2024-09-12T19:23:00.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.3fxVMhs3cuTen6RRWJebReQ5hFg3Fn1_0 2024-09-12T19:23:00.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6184703217935633272', time=2024-09-12T20:36:39.582713+0000, chain.objs.size()=1 2024-09-12T19:23:00.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.3APD7E41GRuUKrESvUWfR3D9HpDeVoT_0 2024-09-12T19:23:00.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15342335105476608335', time=2024-09-12T20:36:40.020996+0000, chain.objs.size()=1 2024-09-12T19:23:00.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.blXFW0fcE9i0iawwNdK50zMOBeW1ZbC_0 2024-09-12T19:23:00.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6550952561100772400', time=2024-09-12T20:36:40.872350+0000, chain.objs.size()=1 2024-09-12T19:23:00.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Cp3f48cbJQSF6EWAjvb4pem8wtVQv-g_0 2024-09-12T19:23:00.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2152005831772187150', time=2024-09-12T20:36:41.811716+0000, chain.objs.size()=1 2024-09-12T19:23:00.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.FnDiI6RGsIGDhMOCbnmqAD5abDOKadm_0 2024-09-12T19:23:00.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10040719604263651656', time=2024-09-12T20:36:42.125484+0000, chain.objs.size()=1 2024-09-12T19:23:00.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.GX2KvFKfMWdI8m77h8OOyZvUPQa5l6C_0 2024-09-12T19:23:00.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17620703503924314080', time=2024-09-12T20:36:44.222292+0000, chain.objs.size()=1 2024-09-12T19:23:00.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.OroaOupQLF0cIu1U0KavF2pyl--Z_Wa_0 2024-09-12T19:23:00.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14325164203611816028', time=2024-09-12T20:36:44.355823+0000, chain.objs.size()=1 2024-09-12T19:23:00.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.gYibqkGGvOH8FER1LJLXSZE7sW0CQhz_0 2024-09-12T19:23:00.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13902010910987213231', time=2024-09-12T20:36:44.477685+0000, chain.objs.size()=1 2024-09-12T19:23:00.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.8rV15uW-hSEfUwY178O7KHSdcvQHhEb_0 2024-09-12T19:23:00.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.802+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9482611252050466992', time=2024-09-12T20:36:47.867207+0000, chain.objs.size()=1 2024-09-12T19:23:00.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.802+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.KnxVR82vkSTao3w6JxRHfGWAkv631g2_0 2024-09-12T19:23:00.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.802+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14730819540136773420', time=2024-09-12T20:36:49.136757+0000, chain.objs.size()=1 2024-09-12T19:23:00.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.802+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Z-N2JAZFmIw6O0P84WiUEUaKGIr2XM9_0 2024-09-12T19:23:00.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.802+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8216784648588273758', time=2024-09-12T20:36:53.115223+0000, chain.objs.size()=1 2024-09-12T19:23:00.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.802+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.XIlJ4u4z6f8_sJkwMmakU5Y8n_WxpRt_0 2024-09-12T19:23:00.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.802+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12692375832299152310', time=2024-09-12T20:36:54.087632+0000, chain.objs.size()=1 2024-09-12T19:23:00.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.802+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.7_PLiaziVf8-6Z7Ptamu3avAgXuu8oj_0 2024-09-12T19:23:00.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.802+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2807036937533989051', time=2024-09-12T20:36:54.503166+0000, chain.objs.size()=1 2024-09-12T19:23:00.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.802+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.vHgVg7grt3fJ_f-mNpULsjd9QCfSnx2_0 2024-09-12T19:23:00.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14100220375230228819', time=2024-09-12T20:36:54.721939+0000, chain.objs.size()=1 2024-09-12T19:23:00.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.J64u88cZu7-F3BtH4cIe3qGcuU0Ilna_0 2024-09-12T19:23:00.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13709335521051873902', time=2024-09-12T20:36:54.805550+0000, chain.objs.size()=1 2024-09-12T19:23:00.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.cbs6Q7mXpjmOrPwJlkvQkdXSHHR0wo2_0 2024-09-12T19:23:00.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17360584945275715657', time=2024-09-12T20:36:55.015499+0000, chain.objs.size()=1 2024-09-12T19:23:00.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Z1FDxZO_BSg9k0vOjsXQvXc5D8wvnpP_0 2024-09-12T19:23:00.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14120018667242748229', time=2024-09-12T20:38:41.354711+0000, chain.objs.size()=1 2024-09-12T19:23:00.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ytEzJPmj69KohIMNVcPTVNWFaGe0ol4_0 2024-09-12T19:23:00.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12292106328125617394', time=2024-09-12T20:38:41.932907+0000, chain.objs.size()=1 2024-09-12T19:23:00.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.cofY5vNnp3r_svZcy-dqZQvHeby_qh7_0 2024-09-12T19:23:00.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8409802371570809010', time=2024-09-12T20:38:44.934416+0000, chain.objs.size()=1 2024-09-12T19:23:00.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.GM2Lfp6SEGrVWlbKSPGFGynesURn8MY_0 2024-09-12T19:23:00.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6047211616711834671', time=2024-09-12T20:38:45.953177+0000, chain.objs.size()=1 2024-09-12T19:23:00.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.GXSVP7T0EPkKGvIsKDnrW_befdWL5xK_0 2024-09-12T19:23:00.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8198454701420575316', time=2024-09-12T20:38:46.430813+0000, chain.objs.size()=1 2024-09-12T19:23:00.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.XwKi1b0OS5LVRxwmA4YBeV7hRYo24T4_0 2024-09-12T19:23:00.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1793645161869095109', time=2024-09-12T20:38:47.519368+0000, chain.objs.size()=1 2024-09-12T19:23:00.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Le2P-N8CFDRYZCA4QP9BEBdLNBV7XXo_0 2024-09-12T19:23:00.818 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48239 2024-09-12T19:23:00.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=43, truncated=0, next_marker='' 2024-09-12T19:23:00.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13153082667212711111', time=2024-09-12T20:38:49.442495+0000, chain.objs.size()=1 2024-09-12T19:23:00.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.aAFvAGjv8gf65CKaCH8wnfRKlo8TI9A_0 2024-09-12T19:23:00.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1614802859595138298', time=2024-09-12T20:38:49.577596+0000, chain.objs.size()=1 2024-09-12T19:23:00.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.7QCOg-Z121oLP-zq_Zi5s20RwaE_Kw2_0 2024-09-12T19:23:00.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9561547976333949637', time=2024-09-12T20:38:51.382867+0000, chain.objs.size()=1 2024-09-12T19:23:00.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ErDacKwGp2GSe4BRgw1Kf2bEK-X04Pc_0 2024-09-12T19:23:00.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2122451123076032580', time=2024-09-12T20:38:52.666616+0000, chain.objs.size()=1 2024-09-12T19:23:00.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.hmwCulWPxcYRFAx3xwoLXEU3fWBNnGE_0 2024-09-12T19:23:00.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11560782580095768075', time=2024-09-12T20:38:55.475622+0000, chain.objs.size()=1 2024-09-12T19:23:00.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.LBBmPRsyDnBYUAZFdphATXSguOofAUN_0 2024-09-12T19:23:00.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3633005609004312236', time=2024-09-12T20:38:55.477289+0000, chain.objs.size()=1 2024-09-12T19:23:00.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.g_E14VC_ns96cYl_pMSMl-rIk5CMEr0_0 2024-09-12T19:23:00.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12000040210548458350', time=2024-09-12T20:38:55.816486+0000, chain.objs.size()=1 2024-09-12T19:23:00.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.n7-KhiSyVlM4ddNKDMdbZPoEOzpOy90_0 2024-09-12T19:23:00.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15387644601204598314', time=2024-09-12T20:38:55.910634+0000, chain.objs.size()=1 2024-09-12T19:23:00.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.km7a1SupYdbBI7egdUj1nJf9IADOkd5_0 2024-09-12T19:23:00.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4753715764853828997', time=2024-09-12T20:38:56.144220+0000, chain.objs.size()=1 2024-09-12T19:23:00.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.sqFBCRQ2WYnB9ZgR611LZHXUbt0KO8p_0 2024-09-12T19:23:00.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16617553024775387680', time=2024-09-12T20:38:57.212276+0000, chain.objs.size()=1 2024-09-12T19:23:00.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.wOlfJSXG6DjM9gC5FrEer0xT4OUFpTv_0 2024-09-12T19:23:00.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5642060330755736786', time=2024-09-12T20:38:57.545049+0000, chain.objs.size()=1 2024-09-12T19:23:00.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.CVAtw_vGvp1pn9vT101t_tg6gGt3dmP_0 2024-09-12T19:23:00.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10215454829101014307', time=2024-09-12T20:38:57.821445+0000, chain.objs.size()=1 2024-09-12T19:23:00.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.57JgSgssqwKefF5ppwhUMBBxp6YzShV_0 2024-09-12T19:23:00.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.818+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12136397489147912409', time=2024-09-12T20:38:58.947316+0000, chain.objs.size()=1 2024-09-12T19:23:00.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.818+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ujlGHuTyAYPtAKa-d-Bgw_BBsDbh46v_0 2024-09-12T19:23:00.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.818+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16876483876085880434', time=2024-09-12T20:38:59.247998+0000, chain.objs.size()=1 2024-09-12T19:23:00.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.818+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.xriH5L2yasmEg0FOr5Zu8-fBYM5DfT0_0 2024-09-12T19:23:00.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.818+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7690697166674131035', time=2024-09-12T20:38:59.249614+0000, chain.objs.size()=1 2024-09-12T19:23:00.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.818+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ciDBa0TEuSufj4hhmmfnfFQcr_1fE-p_0 2024-09-12T19:23:00.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.818+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10462656694366637927', time=2024-09-12T20:38:59.643867+0000, chain.objs.size()=1 2024-09-12T19:23:00.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.818+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.7ixYhZobOY1E-1PxHpMgHkR3ATHf9me_0 2024-09-12T19:23:00.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.818+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12126908809935754571', time=2024-09-12T20:38:59.744319+0000, chain.objs.size()=1 2024-09-12T19:23:00.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.818+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-k0inlNiAiy-D5zWbLky0zp4MYuH6BN_0 2024-09-12T19:23:00.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.818+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16444145451290667702', time=2024-09-12T20:39:00.261071+0000, chain.objs.size()=1 2024-09-12T19:23:00.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.818+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_._NRCisWYgL3ufBZXjQoVC89dfor5Obk_0 2024-09-12T19:23:00.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.818+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2586997628669777981', time=2024-09-12T20:39:00.900342+0000, chain.objs.size()=1 2024-09-12T19:23:00.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.818+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.o934qe3Da6nQW5k8ppfpwNuXUqhSF0I_0 2024-09-12T19:23:00.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.818+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4764971650106367260', time=2024-09-12T20:39:00.902675+0000, chain.objs.size()=1 2024-09-12T19:23:00.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.818+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.fItQGuY9jXeE-tBx0p4ocPQcShzWmHK_0 2024-09-12T19:23:00.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.818+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17727282662912953008', time=2024-09-12T20:39:01.001688+0000, chain.objs.size()=1 2024-09-12T19:23:00.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.818+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.n6K43KgVJpIbVHpvmR_HveQNf90E8OT_0 2024-09-12T19:23:00.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.822+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17284508966475871862', time=2024-09-12T20:39:03.870724+0000, chain.objs.size()=1 2024-09-12T19:23:00.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.822+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.hEBrSbQ-80-KDtN6wUSVQeK95xwmA2H_0 2024-09-12T19:23:00.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.822+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15891836245808624865', time=2024-09-12T20:39:04.440567+0000, chain.objs.size()=1 2024-09-12T19:23:00.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.822+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.NNtGgGZvfcJIUfe-PTStROUy01-lvoB_0 2024-09-12T19:23:00.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.822+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15920698458623668725', time=2024-09-12T20:39:05.843866+0000, chain.objs.size()=1 2024-09-12T19:23:00.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.822+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Sj7jDk7GJ-U3phUmMnOo9uUe6hZIyM7_0 2024-09-12T19:23:00.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11341649205035207738', time=2024-09-12T20:39:07.107391+0000, chain.objs.size()=1 2024-09-12T19:23:00.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.K6YNDm1hCHNuaucMi_KlRi57yYBMTLj_0 2024-09-12T19:23:00.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3428760403610213293', time=2024-09-12T20:41:19.006016+0000, chain.objs.size()=1 2024-09-12T19:23:00.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.390__shadow_.wSY8wNyMrtfydaDZjkqMJxKvjdMs10x_0 2024-09-12T19:23:00.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13643041320916032003', time=2024-09-12T20:42:59.471137+0000, chain.objs.size()=1 2024-09-12T19:23:00.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.440__shadow_.aj0uHE0QuiFs930xYN-dfB1_GjSLDjH_0 2024-09-12T19:23:00.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17895716404155675819', time=2024-09-12T20:43:43.646801+0000, chain.objs.size()=1 2024-09-12T19:23:00.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.458__shadow_.nFnHB04Ww8i9gvWKEnKSARh13n91ndg_0 2024-09-12T19:23:00.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2599624652159132167', time=2024-09-12T20:44:33.672640+0000, chain.objs.size()=1 2024-09-12T19:23:00.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.483__shadow_.YGaXGc1byIltzAn5kW9nVk8Cc6YsLXS_0 2024-09-12T19:23:00.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~SGAZ5VGhAlG2YFn6TsqE4Yu2psXLOoP', time=2024-09-12T20:53:26.760375+0000, chain.objs.size()=1 2024-09-12T19:23:00.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.531__multipart_mymultipart.2~SGAZ5VGhAlG2YFn6TsqE4Yu2psXLOoP.1 2024-09-12T19:23:00.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14137024059753457224', time=2024-09-12T20:55:12.927347+0000, chain.objs.size()=1 2024-09-12T19:23:00.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.552__shadow_.XfXHvkPnSQWR1hIaf5clrhVTnn4a2fS_0 2024-09-12T19:23:00.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9009301447800111251', time=2024-09-12T20:55:55.797728+0000, chain.objs.size()=1 2024-09-12T19:23:00.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.557__shadow_.E1bpLzyIU3SZyCZPLPL4KtAl03IMr0i_0 2024-09-12T19:23:00.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15035695837221938920', time=2024-09-12T20:56:13.178938+0000, chain.objs.size()=1 2024-09-12T19:23:00.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.559__shadow_.HgkiDO1fo-7uDQPA8norHcnVW5ioMx4_0 2024-09-12T19:23:00.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4332992285239412480', time=2024-09-12T20:56:52.846231+0000, chain.objs.size()=1 2024-09-12T19:23:00.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:IuWuJpepEdn7UsRFXT1Zsmd1bxZO-fV_.uVHX5NepL6J-xroQKdJW_ASw6J_qi3j_0 2024-09-12T19:23:00.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6036409289997504979', time=2024-09-12T20:59:55.577784+0000, chain.objs.size()=1 2024-09-12T19:23:00.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.587__shadow:dp4UR0nNWvyFsYMkp9crSnoywnNDx3o_.lTZSM3g30o2K9lFZzyniLJEBbjDhWcQ_0 2024-09-12T19:23:00.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10254057279331297231', time=2024-09-12T21:00:12.481753+0000, chain.objs.size()=1 2024-09-12T19:23:00.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.596__shadow_.oIjHYMOzt5TH0Vm6mUeE0GqgYdjYWcY_0 2024-09-12T19:23:00.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16309855955780032278', time=2024-09-12T21:05:23.436016+0000, chain.objs.size()=1 2024-09-12T19:23:00.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.618__shadow_.ku5J_9lI6-wo_XNdOiLM4jtOw5pGFRs_0 2024-09-12T19:23:00.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16375916804221650291', time=2024-09-12T21:08:06.301945+0000, chain.objs.size()=1 2024-09-12T19:23:00.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.648__shadow_.WOY7DAqIuEUXpjsjbJ71Uz0AfEy_8Xj_0 2024-09-12T19:23:00.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10282164961419627764', time=2024-09-12T21:09:42.288947+0000, chain.objs.size()=1 2024-09-12T19:23:00.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.665__shadow_.8x8JHWYCLo5W5AFSZKpOfooqXO87ZPB_0 2024-09-12T19:23:00.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9005787520726171568', time=2024-09-12T21:10:31.742993+0000, chain.objs.size()=1 2024-09-12T19:23:00.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.692__shadow:optqivvNzkHBCGQ-CjGB3awZzswoS65_.AtisTrCTjjTDmwdqr-mVpM6X-k9Kd80_0 2024-09-12T19:23:00.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13168308142627858374', time=2024-09-12T21:11:45.364235+0000, chain.objs.size()=1 2024-09-12T19:23:00.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.718__shadow_.zbKjduQK4Ld2L5RNzk6qEDAfnWQorUI_0 2024-09-12T19:23:00.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3749796450477655030', time=2024-09-12T21:12:44.993524+0000, chain.objs.size()=10 2024-09-12T19:23:00.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.735__multipart_foo.2~UiDNMamb_CojOSuPze476PLarjcYWmX.1 2024-09-12T19:23:00.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.735__multipart_foo.2~UiDNMamb_CojOSuPze476PLarjcYWmX.2 2024-09-12T19:23:00.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.735__multipart_foo.2~UiDNMamb_CojOSuPze476PLarjcYWmX.3 2024-09-12T19:23:00.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.735__multipart_foo.2~UiDNMamb_CojOSuPze476PLarjcYWmX.4 2024-09-12T19:23:00.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.834+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.735__multipart_foo.2~UiDNMamb_CojOSuPze476PLarjcYWmX.5 2024-09-12T19:23:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.838+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.735__multipart_foo.2~UiDNMamb_CojOSuPze476PLarjcYWmX.6 2024-09-12T19:23:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.838+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.735__multipart_foo.2~UiDNMamb_CojOSuPze476PLarjcYWmX.7 2024-09-12T19:23:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.838+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.735__multipart_foo.2~UiDNMamb_CojOSuPze476PLarjcYWmX.8 2024-09-12T19:23:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.838+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.735__multipart_foo.2~UiDNMamb_CojOSuPze476PLarjcYWmX.9 2024-09-12T19:23:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.838+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.735__multipart_foo.2~UiDNMamb_CojOSuPze476PLarjcYWmX.10 2024-09-12T19:23:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.838+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13949833454695464124', time=2024-09-12T21:22:39.975085+0000, chain.objs.size()=1 2024-09-12T19:23:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.838+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.782__shadow_.OAN5sIVyWrNaJEVn_0Sr41_IawqLC-8_0 2024-09-12T19:23:00.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.842+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:00.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.850+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T19:23:00.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:00.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:00.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46809' 2024-09-12T19:23:00.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7251043539285374401', time=2024-09-12T20:24:28.849071+0000, chain.objs.size()=1 2024-09-12T19:23:00.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.188__shadow_.43MorfOzOOR-238L_SBwCwr1qIXZUem_0 2024-09-12T19:23:00.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10700116383024113424', time=2024-09-12T20:29:07.116133+0000, chain.objs.size()=1 2024-09-12T19:23:00.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.238__shadow_.g0PWEcX169wJeCqtW68bgVGKvaeqIuG_0 2024-09-12T19:23:00.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.790132100891167836', time=2024-09-12T20:29:19.434343+0000, chain.objs.size()=1 2024-09-12T19:23:00.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.243__shadow_.vLf8gc7Y6bSTH7DX3ot88cXZ5OZffK8_0 2024-09-12T19:23:00.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18335527612980173140', time=2024-09-12T20:30:02.129595+0000, chain.objs.size()=1 2024-09-12T19:23:00.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.261__shadow_.qoauzjhH3mAQP6d8cFfr5kQwPdcWXGy_0 2024-09-12T19:23:00.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14544449132074345481', time=2024-09-12T20:31:45.658686+0000, chain.objs.size()=1 2024-09-12T19:23:00.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.3SNybm9x_FWzr60J_xb2A6QzPQR69Rp_0 2024-09-12T19:23:00.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.362487871566464876', time=2024-09-12T20:31:46.549568+0000, chain.objs.size()=1 2024-09-12T19:23:00.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.OTcERpO6y79GBxEAx0s8GtK01tfhaio_0 2024-09-12T19:23:00.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11384276345994722736', time=2024-09-12T20:31:47.412535+0000, chain.objs.size()=1 2024-09-12T19:23:00.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.cBy8L7bTddcTqETzgk6-mU4uO8LyAT5_0 2024-09-12T19:23:00.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18096007447030420114', time=2024-09-12T20:31:48.014208+0000, chain.objs.size()=1 2024-09-12T19:23:00.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.KhU01A7Hnhwq3ACauvOxG7nBQTlq06O_0 2024-09-12T19:23:00.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2504698809889383659', time=2024-09-12T20:31:48.195100+0000, chain.objs.size()=1 2024-09-12T19:23:00.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.iYikFJcVfqYAg2VTEQcF1vJ5bpTWXkU_0 2024-09-12T19:23:00.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11609363855041618363', time=2024-09-12T20:31:49.718988+0000, chain.objs.size()=1 2024-09-12T19:23:00.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.bkzw9rRPJF3CxkNC_Q1mgvQqL0clcor_0 2024-09-12T19:23:00.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14236925222483016828', time=2024-09-12T20:31:51.851024+0000, chain.objs.size()=1 2024-09-12T19:23:00.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.bRFmaIlAid9NUImoshyUwulQzvD3yX3_0 2024-09-12T19:23:00.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13748647507579378897', time=2024-09-12T20:31:53.192477+0000, chain.objs.size()=1 2024-09-12T19:23:00.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.PHStqWNn86zx1IHiQl4Hl-X7zlUqkIg_0 2024-09-12T19:23:00.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.858+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11615783842006255649', time=2024-09-12T20:31:55.438951+0000, chain.objs.size()=1 2024-09-12T19:23:00.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.858+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.3BqdcRqA8PzBjKY710H7veHbgJtxL4G_0 2024-09-12T19:23:00.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11090175314970678675', time=2024-09-12T20:31:55.708784+0000, chain.objs.size()=1 2024-09-12T19:23:00.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.UYcAl9oKin9WEma7Pn2eXJZfI0JwGLm_0 2024-09-12T19:23:00.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16479625985622202922', time=2024-09-12T20:31:56.847500+0000, chain.objs.size()=1 2024-09-12T19:23:00.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.MlEU8ERMihY1gq-EgnX2V0j0h-hrQl__0 2024-09-12T19:23:00.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10295337029113988774', time=2024-09-12T20:31:57.369396+0000, chain.objs.size()=1 2024-09-12T19:23:00.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.mwiLZJ3McgdXCx3EZq9NoR8oIwZIH-5_0 2024-09-12T19:23:00.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9318846954188015869', time=2024-09-12T20:31:57.625882+0000, chain.objs.size()=1 2024-09-12T19:23:00.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.uOpH-_Vv7GzLAeSkMsbF-5zlzBRtvXj_0 2024-09-12T19:23:00.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10340434229389696532', time=2024-09-12T20:31:57.996212+0000, chain.objs.size()=1 2024-09-12T19:23:00.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.VmUWHMycNOFi7OHSquWvabQ5Gh2zmSd_0 2024-09-12T19:23:00.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17981102020759893130', time=2024-09-12T20:32:01.176460+0000, chain.objs.size()=1 2024-09-12T19:23:00.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.gh14Yuj2fSrvU_IYg_fLZetQ5K_tHuU_0 2024-09-12T19:23:00.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13486759095022324694', time=2024-09-12T20:32:01.248315+0000, chain.objs.size()=1 2024-09-12T19:23:00.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.zzVwLtniCLeWx3m0I9iFCDT8KmbYML4_0 2024-09-12T19:23:00.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7623418719835602046', time=2024-09-12T20:32:02.373968+0000, chain.objs.size()=1 2024-09-12T19:23:00.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.6vDhZvpsE19byBrgyfMn9I4w0-xRsMb_0 2024-09-12T19:23:00.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2479512218047404470', time=2024-09-12T20:32:02.375742+0000, chain.objs.size()=1 2024-09-12T19:23:00.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.hkoMlNpr1cpimv8mInZ604swF3Y4s2l_0 2024-09-12T19:23:00.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18053034098932875174', time=2024-09-12T20:32:07.136083+0000, chain.objs.size()=1 2024-09-12T19:23:00.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.n5hSAkNSR9AaO872gEF6oUGmaEEmbKK_0 2024-09-12T19:23:00.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.866+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7977824106224102973', time=2024-09-12T20:32:08.660951+0000, chain.objs.size()=1 2024-09-12T19:23:00.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.866+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.nSsYgF1BE2evz__-yIA8dTJL5V8Tybb_0 2024-09-12T19:23:00.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9610718637074160293', time=2024-09-12T20:32:10.488525+0000, chain.objs.size()=1 2024-09-12T19:23:00.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.l1t4C6m2SCE9JB2GtAd9AHLlGriVQx6_0 2024-09-12T19:23:00.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15142890379645439040', time=2024-09-12T20:32:10.770033+0000, chain.objs.size()=1 2024-09-12T19:23:00.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Na_xHM_jwZReHKnwf3avwJGiNjiH-sP_0 2024-09-12T19:23:00.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10010777501518245445', time=2024-09-12T20:32:13.864852+0000, chain.objs.size()=1 2024-09-12T19:23:00.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.CNRGfpi2U_mxgJndqxTdK8riGeX12eX_0 2024-09-12T19:23:00.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13361114944558384519', time=2024-09-12T20:32:29.335334+0000, chain.objs.size()=1 2024-09-12T19:23:00.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.269__shadow_.ydG86NsNXH3JkQJGpj38YM11PxcMT4J_0 2024-09-12T19:23:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4314494330521257230', time=2024-09-12T20:32:38.070181+0000, chain.objs.size()=1 2024-09-12T19:23:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.273__shadow_.AiIY4wiaNmvgHGs7t8jECex_u9S-t_M_0 2024-09-12T19:23:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9578890797000853516', time=2024-09-12T20:32:38.079751+0000, chain.objs.size()=1 2024-09-12T19:23:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.273__shadow_.YStdTFmixQhmt-iU2UwxQKZAR76h-LB_0 2024-09-12T19:23:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17050049061071347441', time=2024-09-12T20:32:47.206328+0000, chain.objs.size()=1 2024-09-12T19:23:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.277__shadow_.NJOUxVPEbCUd7Gmj9l54LHYIxngaWhy_0 2024-09-12T19:23:00.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6808205922497309710', time=2024-09-12T20:33:12.709095+0000, chain.objs.size()=1 2024-09-12T19:23:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.288__shadow_.-6pc9GdaZFjHkGy9S9V4T-dQYUKeU8Z_0 2024-09-12T19:23:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6466527886524309417', time=2024-09-12T20:33:25.744499+0000, chain.objs.size()=1 2024-09-12T19:23:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.wdl0TqkC6bZjA-bCzpGTSJVbl8PKCWI_0 2024-09-12T19:23:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6369334590868623240', time=2024-09-12T20:33:31.278315+0000, chain.objs.size()=1 2024-09-12T19:23:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.spdSfMp5LQsqv39W7edmX9gYjG8P34F_0 2024-09-12T19:23:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9846866368312320447', time=2024-09-12T20:33:31.566915+0000, chain.objs.size()=1 2024-09-12T19:23:00.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.aRUAMthPMgXFJMJHMju45LYwB64QP-F_0 2024-09-12T19:23:00.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3648955990377406885', time=2024-09-12T20:33:36.196237+0000, chain.objs.size()=1 2024-09-12T19:23:00.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.295__shadow_.7Tt2igng2BYiuJJ-ky2acZPoLQDCICQ_0 2024-09-12T19:23:00.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2379197685103113737', time=2024-09-12T20:33:45.716467+0000, chain.objs.size()=1 2024-09-12T19:23:00.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.299__shadow_.Ioz2sz8_-DdSwYOFLI5K3uiv2OKY-VX_0 2024-09-12T19:23:00.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7935192481283658917', time=2024-09-12T20:36:29.759210+0000, chain.objs.size()=1 2024-09-12T19:23:00.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.aOEgnIwa8kBQfYiaC1lFNGbertQqeaO_0 2024-09-12T19:23:00.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.878+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5782100866839866384', time=2024-09-12T20:36:30.303612+0000, chain.objs.size()=1 2024-09-12T19:23:00.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.878+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.4ubit8BbcgJYMaRdXEBA2pF7MZtfqQk_0 2024-09-12T19:23:00.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.878+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10682145985414793025', time=2024-09-12T20:36:32.299318+0000, chain.objs.size()=1 2024-09-12T19:23:00.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.878+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.gdQn5G7EsIq2pbHzCozIHh3XUf2ur_L_0 2024-09-12T19:23:00.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.878+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2316770684455765445', time=2024-09-12T20:36:33.468226+0000, chain.objs.size()=1 2024-09-12T19:23:00.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.878+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.zyGbYg6j9HGLek_3JsvSfLvBpfOhnlF_0 2024-09-12T19:23:00.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.878+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15685489455668593873', time=2024-09-12T20:36:34.611362+0000, chain.objs.size()=1 2024-09-12T19:23:00.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.878+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.D0E6pRBS__lMEFw-VgKi89ixWTdM8NT_0 2024-09-12T19:23:00.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.878+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14837540644610371548', time=2024-09-12T20:36:36.285038+0000, chain.objs.size()=1 2024-09-12T19:23:00.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.878+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.oktHwq_9P3ZNMvG7iM9Zm6Gygq9RCUZ_0 2024-09-12T19:23:00.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.878+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16072901007039044895', time=2024-09-12T20:36:37.342522+0000, chain.objs.size()=1 2024-09-12T19:23:00.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.878+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.CB444GiBi8-vAHO4HOARVN4-VtFnpLu_0 2024-09-12T19:23:00.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.878+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3865931037287548748', time=2024-09-12T20:36:38.281526+0000, chain.objs.size()=1 2024-09-12T19:23:00.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.878+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.6BHH-iqdkWNkcjeiMfiHFQe-Xyt8v2N_0 2024-09-12T19:23:00.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.878+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14093353113313708440', time=2024-09-12T20:36:38.491327+0000, chain.objs.size()=1 2024-09-12T19:23:00.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.878+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.CqaTprt-TdPIBGeQCGGVtQ_XA-5PnoI_0 2024-09-12T19:23:00.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.882+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16835880028448299270', time=2024-09-12T20:36:39.506731+0000, chain.objs.size()=1 2024-09-12T19:23:00.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.882+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.945r84TkCZbms6EpZ6K6lT0ngRH2h6S_0 2024-09-12T19:23:00.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.882+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10740768901611978186', time=2024-09-12T20:36:39.886697+0000, chain.objs.size()=1 2024-09-12T19:23:00.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.882+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.YnfazRGyqL7a2TV0Js-pCcpLt4zI1Ey_0 2024-09-12T19:23:00.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.882+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4008584138670448539', time=2024-09-12T20:36:40.026061+0000, chain.objs.size()=1 2024-09-12T19:23:00.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.882+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Kps88DqDuww8H6OTZepCxsz61NWK7dn_0 2024-09-12T19:23:00.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.882+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18405662585463950834', time=2024-09-12T20:36:40.028058+0000, chain.objs.size()=1 2024-09-12T19:23:00.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.882+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.KjrRl6wq-AajGmIxnZPHmKRKWG3i-eZ_0 2024-09-12T19:23:00.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.882+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6654105501228973071', time=2024-09-12T20:36:40.405112+0000, chain.objs.size()=1 2024-09-12T19:23:00.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.882+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Vd4QRAqKSYGFUwo4Om5ypfZo5OymoSp_0 2024-09-12T19:23:00.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16862160037325994257', time=2024-09-12T20:36:40.887906+0000, chain.objs.size()=1 2024-09-12T19:23:00.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.qiaCQcViUaoH7lzlJFZAqsT36pPzKwC_0 2024-09-12T19:23:00.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8543495205555566108', time=2024-09-12T20:36:41.057613+0000, chain.objs.size()=1 2024-09-12T19:23:00.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.X2b1ZcotGhQW4sA8nfy6U_msygLvERC_0 2024-09-12T19:23:00.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8597099346621256912', time=2024-09-12T20:36:41.816844+0000, chain.objs.size()=1 2024-09-12T19:23:00.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.exiiai-n5hBkx3Sp1qFCfWhM36wrC9s_0 2024-09-12T19:23:00.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1174611730022965776', time=2024-09-12T20:36:44.035973+0000, chain.objs.size()=1 2024-09-12T19:23:00.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.u7m-aIw4FjhlPE__qJxU8Nlk2QEJQnI_0 2024-09-12T19:23:00.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14776475215085304258', time=2024-09-12T20:36:44.559488+0000, chain.objs.size()=1 2024-09-12T19:23:00.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ul8pHSD-xz0quBrfcYn3r75GXnk738k_0 2024-09-12T19:23:00.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5882680147935020669', time=2024-09-12T20:36:46.975492+0000, chain.objs.size()=1 2024-09-12T19:23:00.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.CTZbH1PaB4rh_75BJGC-Iwcj7RbwSq9_0 2024-09-12T19:23:00.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16500191296076569854', time=2024-09-12T20:36:47.856682+0000, chain.objs.size()=1 2024-09-12T19:23:00.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.KY3vfINbonZocSrl5tGvfymvvkBrcjk_0 2024-09-12T19:23:00.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13549686139002687195', time=2024-09-12T20:36:49.746964+0000, chain.objs.size()=1 2024-09-12T19:23:00.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.bVWGyUYtvSmPL3YP9Q_QKPg4yZT97Hl_0 2024-09-12T19:23:00.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4374255314583576965', time=2024-09-12T20:36:50.676928+0000, chain.objs.size()=1 2024-09-12T19:23:00.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.7VgoC1PzWxDtPPymu9miOrkss8TtFMt_0 2024-09-12T19:23:00.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.890+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17768619647877734713', time=2024-09-12T20:36:51.719687+0000, chain.objs.size()=1 2024-09-12T19:23:00.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.890+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Vubw8SQ6_IjiyFEXi0Rpq701d_CZzU7_0 2024-09-12T19:23:00.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.890+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2548320368113714349', time=2024-09-12T20:36:51.987107+0000, chain.objs.size()=1 2024-09-12T19:23:00.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.890+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.GwIO5L7VF14SgwTsRTnB12zCi-qrO2-_0 2024-09-12T19:23:00.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.890+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11317891261492192618', time=2024-09-12T20:36:52.600191+0000, chain.objs.size()=1 2024-09-12T19:23:00.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.890+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.lmq50T-89MbgfS0OTL2CcFQ76_LOYWv_0 2024-09-12T19:23:00.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.890+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10498989105620420964', time=2024-09-12T20:36:53.103739+0000, chain.objs.size()=1 2024-09-12T19:23:00.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.890+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.LXUc8T6qmRR5n5Ku1onU_q4IeZQz4N9_0 2024-09-12T19:23:00.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.890+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12997810775857193936', time=2024-09-12T20:36:54.055251+0000, chain.objs.size()=1 2024-09-12T19:23:00.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.890+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.juzaNhmBGd8vlbKWCwahNC3LD-avwOS_0 2024-09-12T19:23:00.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8674745640029948280', time=2024-09-12T20:36:54.171995+0000, chain.objs.size()=1 2024-09-12T19:23:00.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.WdnQbrwIAbG6yCAlVWTuil04cvFDAkm_0 2024-09-12T19:23:00.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4376809459280023746', time=2024-09-12T20:36:54.386129+0000, chain.objs.size()=1 2024-09-12T19:23:00.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.kiCbECgpaPPWwTqUqw8rXj8u4le9sme_0 2024-09-12T19:23:00.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9221115381101233464', time=2024-09-12T20:36:54.508646+0000, chain.objs.size()=1 2024-09-12T19:23:00.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.tPG3EFzF4S8ARmV-lc6vSC8YKgGR7ij_0 2024-09-12T19:23:00.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.153874957343259816', time=2024-09-12T20:36:54.540013+0000, chain.objs.size()=1 2024-09-12T19:23:00.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.YzgGQTMrzJ6t4r5OA2AYVyK5pE-goIq_0 2024-09-12T19:23:00.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7800182104230908223', time=2024-09-12T20:38:40.986839+0000, chain.objs.size()=1 2024-09-12T19:23:00.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.FtiDZXIHUi_BUhj5y7wJcJPY-UlZNAi_0 2024-09-12T19:23:00.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2698954027860543738', time=2024-09-12T20:38:44.393471+0000, chain.objs.size()=1 2024-09-12T19:23:00.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.sz-rUaemMCH0-hHH18HpAgEL55dv5_9_0 2024-09-12T19:23:00.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6981191342490445789', time=2024-09-12T20:38:44.676482+0000, chain.objs.size()=1 2024-09-12T19:23:00.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.V_DRtlRyP_q5rF9UP4l8QYx5jbfPDWz_0 2024-09-12T19:23:00.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6242068841337517399', time=2024-09-12T20:38:44.870183+0000, chain.objs.size()=1 2024-09-12T19:23:00.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.cyIG34DYG0mYJnzHD2udr6FKyAF8abi_0 2024-09-12T19:23:00.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17800442812842555309', time=2024-09-12T20:38:45.679078+0000, chain.objs.size()=1 2024-09-12T19:23:00.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.g21_UxU_vDnjJ_kd4B8U1ijCrXrsq1y_0 2024-09-12T19:23:00.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.898+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1596203781228151731', time=2024-09-12T20:38:45.681839+0000, chain.objs.size()=1 2024-09-12T19:23:00.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.898+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.fg-_oWO1xaKZm3O8HZIzCw7bVfM3dEy_0 2024-09-12T19:23:00.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.898+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9468270383611988525', time=2024-09-12T20:38:47.820090+0000, chain.objs.size()=1 2024-09-12T19:23:00.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.898+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Q0_sb4Dzs64lNHocZ8sqbbmAubTRn8p_0 2024-09-12T19:23:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.898+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3961493987106724190', time=2024-09-12T20:38:47.879877+0000, chain.objs.size()=1 2024-09-12T19:23:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.898+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.w2x1_s9TAqYni91dwT8z49Zi6FU17h7_0 2024-09-12T19:23:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.898+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4983665603624201125', time=2024-09-12T20:38:48.163201+0000, chain.objs.size()=1 2024-09-12T19:23:00.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.898+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.rDqYRbLzrxR22gG1m8GHJbtZoaVdNsS_0 2024-09-12T19:23:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.898+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12198993545325938573', time=2024-09-12T20:38:48.253169+0000, chain.objs.size()=1 2024-09-12T19:23:00.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.898+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.jbvNjYeb6cr9KZ3No57StNIVvuSh6bX_0 2024-09-12T19:23:00.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.898+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2722556490223261205', time=2024-09-12T20:38:49.269733+0000, chain.objs.size()=1 2024-09-12T19:23:00.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.898+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Dea839DCNDrAhNwDJyN3WHL5zIH5pIq_0 2024-09-12T19:23:00.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.898+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6868433689405610784', time=2024-09-12T20:38:51.731835+0000, chain.objs.size()=1 2024-09-12T19:23:00.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.898+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.s9UnQmoBSFiqxIgF03lGoUid0SCnyxl_0 2024-09-12T19:23:00.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.898+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16501040864435847502', time=2024-09-12T20:38:52.030764+0000, chain.objs.size()=1 2024-09-12T19:23:00.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.902+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.RqphlkSWZQF3VKtS1HEqVdEzT2IW0W-_0 2024-09-12T19:23:00.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.902+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5339632078959603537', time=2024-09-12T20:38:52.569198+0000, chain.objs.size()=1 2024-09-12T19:23:00.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.902+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ilJSfJmXP8Zj0DQ5m1QLagEZnFTPPIv_0 2024-09-12T19:23:00.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.902+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18057508317341948732', time=2024-09-12T20:38:52.661148+0000, chain.objs.size()=1 2024-09-12T19:23:00.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.902+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.WmAQumnrDaCS6NcVknBjiEQMdGS-xZ5_0 2024-09-12T19:23:00.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.902+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11491219179890109920', time=2024-09-12T20:38:53.047294+0000, chain.objs.size()=1 2024-09-12T19:23:00.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.902+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ApfQTxkCzUFR2xR_25EPDEHm0SOFg99_0 2024-09-12T19:23:00.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.902+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3378633091548153403', time=2024-09-12T20:38:53.458818+0000, chain.objs.size()=1 2024-09-12T19:23:00.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.902+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.rfprrHV263uIR2NEuUueR6uo2h7J572_0 2024-09-12T19:23:00.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.902+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10560923796083903106', time=2024-09-12T20:38:54.014816+0000, chain.objs.size()=1 2024-09-12T19:23:00.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.902+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.9BkPvfKIVQI4GnKstXIiNCX9TCORHCW_0 2024-09-12T19:23:00.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.902+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4664009310765392747', time=2024-09-12T20:38:54.018125+0000, chain.objs.size()=1 2024-09-12T19:23:00.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.902+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.FGt91mRP_YvJolFlbjveKYOcTBsthr__0 2024-09-12T19:23:00.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.902+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9825797149024123906', time=2024-09-12T20:38:55.482224+0000, chain.objs.size()=1 2024-09-12T19:23:00.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.902+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.n82FUF6kANbWzJArZnLyTbc7wfN4pv8_0 2024-09-12T19:23:00.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5910799624095839078', time=2024-09-12T20:38:56.247452+0000, chain.objs.size()=1 2024-09-12T19:23:00.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.t4oppT_ZYJ3bokXuLf7Z_kGRZq4CBFa_0 2024-09-12T19:23:00.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1679749110204055768', time=2024-09-12T20:38:56.249686+0000, chain.objs.size()=1 2024-09-12T19:23:00.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.bB78KqLUn_sBv5wUpJ9MI1GsK028H6I_0 2024-09-12T19:23:00.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11470044870519728565', time=2024-09-12T20:38:57.058685+0000, chain.objs.size()=1 2024-09-12T19:23:00.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.TFql0cDfzbCTV7dKcNBz5kZ_rG_rvM2_0 2024-09-12T19:23:00.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10336957033163488155', time=2024-09-12T20:38:58.676406+0000, chain.objs.size()=1 2024-09-12T19:23:00.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.OFJXlwBiXd9iPCRALNjNzdElOATdlXd_0 2024-09-12T19:23:00.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3859960653165268801', time=2024-09-12T20:38:58.680130+0000, chain.objs.size()=1 2024-09-12T19:23:00.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.qX-lRP-rusovNNr48es2UNQOWMVLPD-_0 2024-09-12T19:23:00.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13603137624998676494', time=2024-09-12T20:38:59.121587+0000, chain.objs.size()=1 2024-09-12T19:23:00.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.iF76A-2YohNnGz_641T3qM5WSyWYFWg_0 2024-09-12T19:23:00.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12636154274731167986', time=2024-09-12T20:38:59.123359+0000, chain.objs.size()=1 2024-09-12T19:23:00.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.1ohWG0oFuhElot1-xpw5ARlyetzIvBn_0 2024-09-12T19:23:00.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14733972438024556555', time=2024-09-12T20:39:01.224631+0000, chain.objs.size()=1 2024-09-12T19:23:00.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.0zg_AE6Lf0E2vRiwe3uzq45_LVIKm7c_0 2024-09-12T19:23:00.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11239888858820865719', time=2024-09-12T20:39:01.386727+0000, chain.objs.size()=1 2024-09-12T19:23:00.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.XCm2xiSItK5QXBNJnnSmudLwCUKLuZI_0 2024-09-12T19:23:00.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16162851133708898955', time=2024-09-12T20:39:01.388318+0000, chain.objs.size()=1 2024-09-12T19:23:00.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.rBXzztRntk1BnItovZEc1XjsT2mn9hn_0 2024-09-12T19:23:00.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7674711933516184649', time=2024-09-12T20:39:01.493909+0000, chain.objs.size()=1 2024-09-12T19:23:00.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.8iGz2fXbWpns8g2qw4YFvhjcLnU6XsH_0 2024-09-12T19:23:00.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.914+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46809 2024-09-12T19:23:00.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T19:23:00.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10531759320432582237', time=2024-09-12T20:39:03.814917+0000, chain.objs.size()=1 2024-09-12T19:23:00.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Xgj63NGZpbJ42Aj-7PDjH-gkgsQYd7h_0 2024-09-12T19:23:00.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7816394010356686471', time=2024-09-12T20:39:04.589171+0000, chain.objs.size()=1 2024-09-12T19:23:00.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.DvUse5wrF_y0XByjKEivqSv3s4DtHgJ_0 2024-09-12T19:23:00.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4194764054852676760', time=2024-09-12T20:39:05.756681+0000, chain.objs.size()=1 2024-09-12T19:23:00.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.yiOkBriUoN2V5CUNB5pbqjJ6xTWHF_s_0 2024-09-12T19:23:00.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7487538078961708143', time=2024-09-12T20:39:05.759993+0000, chain.objs.size()=1 2024-09-12T19:23:00.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.lgH3Ae2nLnPxTTUpuP5JptF9_CE4P2S_0 2024-09-12T19:23:00.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6770123886789338153', time=2024-09-12T20:39:06.082871+0000, chain.objs.size()=1 2024-09-12T19:23:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.IAbDOPWNNLFUJuhvTkS-RznPcT6FDFv_0 2024-09-12T19:23:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1514654732165966435', time=2024-09-12T20:39:06.270701+0000, chain.objs.size()=1 2024-09-12T19:23:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.xt8XXg3z4jxLFKVrev2aPVlqOowUqvY_0 2024-09-12T19:23:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18421465373425894893', time=2024-09-12T20:39:06.313804+0000, chain.objs.size()=1 2024-09-12T19:23:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.pvQY9iAadqg4LMWGPA6YhIKTP6QncWe_0 2024-09-12T19:23:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5436174606815481247', time=2024-09-12T20:39:06.855525+0000, chain.objs.size()=1 2024-09-12T19:23:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.IASBvjIsBHCdB4znoIo9BDnM01Gc4jQ_0 2024-09-12T19:23:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18033639154750455936', time=2024-09-12T20:39:07.894162+0000, chain.objs.size()=1 2024-09-12T19:23:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.zjpYKmnVsM9SuanQomsYPYt0iIlGSLV_0 2024-09-12T19:23:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17702014584166284734', time=2024-09-12T20:39:19.728248+0000, chain.objs.size()=1 2024-09-12T19:23:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.330__shadow_.ntreO7lo25qoiM_CIArNuhCVGsLK6nT_0 2024-09-12T19:23:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10358964377287125899', time=2024-09-12T20:39:43.085866+0000, chain.objs.size()=1 2024-09-12T19:23:00.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.341__shadow_.vs8o_j_r2Z8igoi1MxoGPf_77sXw4-c_0 2024-09-12T19:23:00.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5101297279572479216', time=2024-09-12T20:40:37.903879+0000, chain.objs.size()=1 2024-09-12T19:23:00.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.371__shadow_.m8uIlsiKCaogRp_EcbLEuewM6WJ2abH_0 2024-09-12T19:23:00.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14202992769688122466', time=2024-09-12T20:42:44.577286+0000, chain.objs.size()=1 2024-09-12T19:23:00.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.918+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.433__shadow_.2eR5Yhkjhm3bgXzpmYpHLhZ2YpOeoFs_0 2024-09-12T19:23:00.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.922+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13579068229464945978', time=2024-09-12T20:44:04.383190+0000, chain.objs.size()=1 2024-09-12T19:23:00.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.922+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.465__shadow_.sPerbaTRxZ8tlJ1o2sL52at2v2_noYf_0 2024-09-12T19:23:00.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.926+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6643599091487081773', time=2024-09-12T20:44:27.962089+0000, chain.objs.size()=1 2024-09-12T19:23:00.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.926+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.481__shadow_._fEupFlBcOCJRRVqCM9s44i30XX2f5W_0 2024-09-12T19:23:00.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.926+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15918758426041814960', time=2024-09-12T20:46:07.232565+0000, chain.objs.size()=6 2024-09-12T19:23:00.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.926+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.1 2024-09-12T19:23:00.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.926+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.2 2024-09-12T19:23:00.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.926+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.3 2024-09-12T19:23:00.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.926+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.4 2024-09-12T19:23:00.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.926+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.5 2024-09-12T19:23:00.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.926+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.6 2024-09-12T19:23:00.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.926+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10245008313721927473', time=2024-09-12T20:48:08.484471+0000, chain.objs.size()=3 2024-09-12T19:23:00.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.926+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.521__multipart_mymultipart.2~NSCeSz2HT0m2A-xjTlrQvQ-wo9kVXb-.1 2024-09-12T19:23:00.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.926+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.521__multipart_mymultipart.2~NSCeSz2HT0m2A-xjTlrQvQ-wo9kVXb-.2 2024-09-12T19:23:00.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.926+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.521__multipart_mymultipart.2~NSCeSz2HT0m2A-xjTlrQvQ-wo9kVXb-.3 2024-09-12T19:23:00.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.926+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~UQVFhNQlejjbbFEKHWDqUDxl9woejob', time=2024-09-12T20:52:44.381370+0000, chain.objs.size()=10 2024-09-12T19:23:00.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.926+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.526__multipart_mymultipart.2~UQVFhNQlejjbbFEKHWDqUDxl9woejob.1 2024-09-12T19:23:00.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.930+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.526__multipart_mymultipart.2~UQVFhNQlejjbbFEKHWDqUDxl9woejob.2 2024-09-12T19:23:00.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.930+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.526__multipart_mymultipart.2~UQVFhNQlejjbbFEKHWDqUDxl9woejob.3 2024-09-12T19:23:00.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.930+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.526__multipart_mymultipart.2~UQVFhNQlejjbbFEKHWDqUDxl9woejob.4 2024-09-12T19:23:00.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.930+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.526__multipart_mymultipart.2~UQVFhNQlejjbbFEKHWDqUDxl9woejob.5 2024-09-12T19:23:00.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.930+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.526__multipart_mymultipart.2~UQVFhNQlejjbbFEKHWDqUDxl9woejob.6 2024-09-12T19:23:00.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.930+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.526__multipart_mymultipart.2~UQVFhNQlejjbbFEKHWDqUDxl9woejob.7 2024-09-12T19:23:00.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.934+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.526__multipart_mymultipart.2~UQVFhNQlejjbbFEKHWDqUDxl9woejob.8 2024-09-12T19:23:00.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.934+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.526__multipart_mymultipart.2~UQVFhNQlejjbbFEKHWDqUDxl9woejob.9 2024-09-12T19:23:00.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.934+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.526__multipart_mymultipart.2~UQVFhNQlejjbbFEKHWDqUDxl9woejob.10 2024-09-12T19:23:00.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.934+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17437703292878006987', time=2024-09-12T20:53:08.810134+0000, chain.objs.size()=2 2024-09-12T19:23:00.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.934+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.528__multipart_mymultipart.2~iYEWHUePpXx1EFR3W9N9UpRENTCBaFZ.1 2024-09-12T19:23:00.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.934+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.528__multipart_mymultipart.2~iYEWHUePpXx1EFR3W9N9UpRENTCBaFZ.2 2024-09-12T19:23:00.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18164891902082825989', time=2024-09-12T20:56:47.174986+0000, chain.objs.size()=1 2024-09-12T19:23:00.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:-ZG3s-cG7ZXR4AkBlBhaVPG72Trp1yf_.Rp3ySxURTWjhAQvKnFtiLkNO2BUzn91_0 2024-09-12T19:23:00.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16834775845992812583', time=2024-09-12T20:57:08.773391+0000, chain.objs.size()=1 2024-09-12T19:23:00.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.570__shadow:S8ZOZlmMxjKjx1TV9nsAGRoOZi-fKew_.biE7IdPkpZwPa7ASXViYJoYzQlOtvlr_0 2024-09-12T19:23:00.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3387781988943603063', time=2024-09-12T20:57:22.068623+0000, chain.objs.size()=1 2024-09-12T19:23:00.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.574__shadow_.uuoGLYcJVTx9x3BNKr--EYM9wO2DHaI_0 2024-09-12T19:23:00.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5828882330245941542', time=2024-09-12T20:57:28.688482+0000, chain.objs.size()=1 2024-09-12T19:23:00.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.574__shadow:n1Uy58YuKNynCDCNgsp0dV-ramKGHIw_.h1mlz3ruPs0eBYdlADv4SXX7RAg3_0q_0 2024-09-12T19:23:00.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6422475889751663960', time=2024-09-12T20:57:43.664399+0000, chain.objs.size()=1 2024-09-12T19:23:00.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.576__shadow:Mzd7W2uTVqa1nvkdeJnCMQ4EFSMS4DZ_.cLE8MPiRd8HmJ_2VSJgDr0TGYIBoVlu_0 2024-09-12T19:23:00.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13802249279952070042', time=2024-09-12T20:59:50.462785+0000, chain.objs.size()=1 2024-09-12T19:23:00.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.586__shadow:WZj9IqpDCRse5GsldSEImgPRWyB6mBJ_.0sl9ZfFACJD5Cr75_mhQ3aIR1aweEN-_0 2024-09-12T19:23:00.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12726832303122118173', time=2024-09-12T21:07:00.304501+0000, chain.objs.size()=1 2024-09-12T19:23:00.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.627__shadow_.AkNK2aBBjX_TkIO-PbtKtn3S_eYjMxH_0 2024-09-12T19:23:00.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7386498236329384860', time=2024-09-12T21:07:02.261179+0000, chain.objs.size()=1 2024-09-12T19:23:00.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.628__shadow_.jeL9iCpK_g6WfTm_-x_BrNANsSh_iPz_0 2024-09-12T19:23:00.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5600380108646034832', time=2024-09-12T21:07:15.835586+0000, chain.objs.size()=1 2024-09-12T19:23:00.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.634__shadow_.edoBvSiPMC9xImFxVfDfgBX6raaL6cj_0 2024-09-12T19:23:00.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2118665766977303256', time=2024-09-12T21:07:22.601712+0000, chain.objs.size()=1 2024-09-12T19:23:00.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.637__shadow_.O7bNPCSIADA1-tYwXLFM8H9zz7y6gAQ_0 2024-09-12T19:23:00.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.942+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9829916722765870879', time=2024-09-12T21:08:21.630785+0000, chain.objs.size()=1 2024-09-12T19:23:00.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.942+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.652__shadow_.h-cu6L-8GrxQkNn5wjvB7iHZTNSPudO_0 2024-09-12T19:23:00.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.942+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1875163130157224136', time=2024-09-12T21:09:49.225871+0000, chain.objs.size()=1 2024-09-12T19:23:00.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.942+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.668__shadow_.O1Zyx2WL0qBRLb6Fh0j8nWNeTJblcW__0 2024-09-12T19:23:00.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.942+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4568986738632722953', time=2024-09-12T21:09:49.830247+0000, chain.objs.size()=1 2024-09-12T19:23:00.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.942+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.668__shadow_.O1Zyx2WL0qBRLb6Fh0j8nWNeTJblcW__0 2024-09-12T19:23:00.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.946+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7885068349669753114', time=2024-09-12T21:10:33.479569+0000, chain.objs.size()=1 2024-09-12T19:23:00.953 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.946+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.693__shadow:fMsdGn6oxvx0A9pEezSGUsnG2bXvEvQ_.XzKBvP5AMWIPmmHDxLnTay6Zuhk_xEQ_0 2024-09-12T19:23:00.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.950+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:00.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.958+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T19:23:00.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:00.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:00.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46758' 2024-09-12T19:23:00.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='_QlpIdAAXAvOcMI5N1XTj_0q_YSosnTR', time=2024-09-12T20:23:03.760586+0000, chain.objs.size()=2 2024-09-12T19:23:00.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.161__shadow_.IR_5DA8r9BboGgSnZ6iKxLI3fG71b8f_0 2024-09-12T19:23:00.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.161__shadow_.IR_5DA8r9BboGgSnZ6iKxLI3fG71b8f_1 2024-09-12T19:23:00.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1735099029550623769', time=2024-09-12T20:23:49.957850+0000, chain.objs.size()=1 2024-09-12T19:23:00.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.170__shadow_.Sn_2C3Bzsrr8N8uFGnTbRd6HeIZxnxF_0 2024-09-12T19:23:00.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.444277575971931517', time=2024-09-12T20:24:10.039218+0000, chain.objs.size()=1 2024-09-12T19:23:00.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.178__shadow_.iyC--hR-aA5gHb0bJHDqS_1vFLaExHH_0 2024-09-12T19:23:00.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11906682614844621176', time=2024-09-12T20:29:44.011158+0000, chain.objs.size()=1 2024-09-12T19:23:00.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.253__shadow_.EdDJdg9ttDUNXci2z3AiULnmBg9PA3W_0 2024-09-12T19:23:00.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11248530593919299475', time=2024-09-12T20:29:50.887358+0000, chain.objs.size()=1 2024-09-12T19:23:00.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.256__shadow_.B8bB_InSgYcshQ2j9xR6ZZ2ymcJSbKN_0 2024-09-12T19:23:00.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15719537899257955671', time=2024-09-12T20:31:46.512085+0000, chain.objs.size()=1 2024-09-12T19:23:00.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.hH6mMMokvigcDL0bno8lwIU_zIicaYi_0 2024-09-12T19:23:00.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16268013249491038632', time=2024-09-12T20:31:49.653164+0000, chain.objs.size()=1 2024-09-12T19:23:00.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.eqv2szwQjKfsLPLZolo5ndXnnXqoBwM_0 2024-09-12T19:23:00.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12358753680415987849', time=2024-09-12T20:31:50.540219+0000, chain.objs.size()=1 2024-09-12T19:23:00.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.CgQbxw8m5aamUYmZ14u9po1Qp7nNbq4_0 2024-09-12T19:23:00.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1415245005587588610', time=2024-09-12T20:31:51.753220+0000, chain.objs.size()=1 2024-09-12T19:23:00.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.0O7blgSX6KuuSN-jEgE2LoE-KBYqSK7_0 2024-09-12T19:23:00.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9766648183263438706', time=2024-09-12T20:31:55.396246+0000, chain.objs.size()=1 2024-09-12T19:23:00.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.qTEdTsomVOGzxrxUQjsTv0U8z9SDNuN_0 2024-09-12T19:23:00.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7105414571362068595', time=2024-09-12T20:31:58.218828+0000, chain.objs.size()=1 2024-09-12T19:23:00.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.962+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.4fpbtSBHKDfA40jAzEj_apCxXdFzScO_0 2024-09-12T19:23:00.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4903053289964663941', time=2024-09-12T20:32:01.607580+0000, chain.objs.size()=1 2024-09-12T19:23:00.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.2jYvsZLyHI66xTsxc8u2H8-NF_QU2n9_0 2024-09-12T19:23:00.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5792661634113224018', time=2024-09-12T20:32:02.354194+0000, chain.objs.size()=1 2024-09-12T19:23:00.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Fln8uwwHQEVnJZIDVJFCxyGuGP4_AOD_0 2024-09-12T19:23:00.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11010698919528322612', time=2024-09-12T20:32:03.024902+0000, chain.objs.size()=1 2024-09-12T19:23:00.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.A8nNXZ9gi3tHnQSTUGchRg6d7H2-nQB_0 2024-09-12T19:23:00.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7006322279710685030', time=2024-09-12T20:32:04.891657+0000, chain.objs.size()=1 2024-09-12T19:23:00.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.gLWIL3EqVuBDV6qESvP7yHci6wyccBq_0 2024-09-12T19:23:00.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8637533496625524757', time=2024-09-12T20:32:06.012117+0000, chain.objs.size()=1 2024-09-12T19:23:00.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.fdPXazgrKMYRweS-m924NcK1RozeKwu_0 2024-09-12T19:23:00.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11947130603341808153', time=2024-09-12T20:32:07.130846+0000, chain.objs.size()=1 2024-09-12T19:23:00.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.PYwfbdswyi3vw_Nc0YhtYmM_PUai3vZ_0 2024-09-12T19:23:00.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18358584047582676309', time=2024-09-12T20:32:08.134623+0000, chain.objs.size()=1 2024-09-12T19:23:00.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.a5ZQ72GM0ksUHw3NklYLYC28EcVCSOi_0 2024-09-12T19:23:00.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1291425777386220494', time=2024-09-12T20:32:08.629208+0000, chain.objs.size()=1 2024-09-12T19:23:00.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.aUmn5Uy8hKcHNiaX9JMyyPtwSfEtNmF_0 2024-09-12T19:23:00.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13904519189368968032', time=2024-09-12T20:32:10.242384+0000, chain.objs.size()=1 2024-09-12T19:23:00.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.3J6BqC92ksjheyMkDfURvSfhmLC_l4G_0 2024-09-12T19:23:00.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16048493936386550594', time=2024-09-12T20:32:10.480503+0000, chain.objs.size()=1 2024-09-12T19:23:00.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ykbPChz27rl5cWAxUxmnP-dYOFiPzdX_0 2024-09-12T19:23:00.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.974+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13565347507617316651', time=2024-09-12T20:32:11.616389+0000, chain.objs.size()=1 2024-09-12T19:23:00.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.974+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.dYLju8Uvs24mirmQs3ITNwBBA3aWOBI_0 2024-09-12T19:23:00.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12488213870465129812', time=2024-09-12T20:32:12.095348+0000, chain.objs.size()=1 2024-09-12T19:23:00.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.EXuSrEOoLYlIiPE2soTID35etepDCua_0 2024-09-12T19:23:00.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3220824789554947127', time=2024-09-12T20:32:12.152363+0000, chain.objs.size()=1 2024-09-12T19:23:00.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.SyANx26D98OdWsMOAqy97Pej1BYlT4l_0 2024-09-12T19:23:00.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4241679509402033206', time=2024-09-12T20:32:12.484665+0000, chain.objs.size()=1 2024-09-12T19:23:00.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Rw050pfXVjf2GuzoPLU-O1ZLMjCpNEq_0 2024-09-12T19:23:00.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3824348397598431114', time=2024-09-12T20:32:13.007459+0000, chain.objs.size()=1 2024-09-12T19:23:00.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.qt-YtEKFlcFd_jFwlB4S7oFGBbMzsrC_0 2024-09-12T19:23:00.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11667540567889646478', time=2024-09-12T20:32:13.232360+0000, chain.objs.size()=1 2024-09-12T19:23:00.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.kOScPQhIBalYP-WpeSNVLV4yuGI2o06_0 2024-09-12T19:23:00.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3176131184071908442', time=2024-09-12T20:32:13.372957+0000, chain.objs.size()=1 2024-09-12T19:23:00.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.VrKhgOarDijKo2UfVUaYN7Y060TCj-8_0 2024-09-12T19:23:00.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18099956921556285863', time=2024-09-12T20:32:13.571034+0000, chain.objs.size()=1 2024-09-12T19:23:00.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.s7Y9JbjN6Dthjt0HV0SdLotnNTY35dT_0 2024-09-12T19:23:00.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18112774814885902689', time=2024-09-12T20:33:25.420793+0000, chain.objs.size()=1 2024-09-12T19:23:00.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.PZxfEhEWckA0nz1JI05sbX4JZ3ZcawV_0 2024-09-12T19:23:00.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.711878015461733437', time=2024-09-12T20:33:31.499056+0000, chain.objs.size()=1 2024-09-12T19:23:00.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.Lkkx1dhzNVGqNQQ1KpDGF4k3GpxoeOQ_0 2024-09-12T19:23:00.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4902371205165749375', time=2024-09-12T20:33:52.573126+0000, chain.objs.size()=1 2024-09-12T19:23:00.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.302__shadow_.4PHflRmYE7JBadbOShh86re2CadbtNk_0 2024-09-12T19:23:00.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14750844238827068520', time=2024-09-12T20:33:54.904440+0000, chain.objs.size()=1 2024-09-12T19:23:00.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.303__shadow_.wdXgiLgoQFe_-4rpNcCMIO_7J1fui2T_0 2024-09-12T19:23:00.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2447729722446162788', time=2024-09-12T20:36:28.063560+0000, chain.objs.size()=1 2024-09-12T19:23:00.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.oCl5zsOGSu-5OcHTr9x5ghFEWZ4SS6p_0 2024-09-12T19:23:00.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11324536418174344666', time=2024-09-12T20:36:29.210013+0000, chain.objs.size()=1 2024-09-12T19:23:00.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.hH15kkcAq_Jyj_zDtXxpP9II0AqH2Nt_0 2024-09-12T19:23:00.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.230581141626091409', time=2024-09-12T20:36:31.956386+0000, chain.objs.size()=1 2024-09-12T19:23:00.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.nKEjKKLR2g7spQ9mo8iwgGQqayLSv4h_0 2024-09-12T19:23:00.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2486918994355265198', time=2024-09-12T20:36:32.317000+0000, chain.objs.size()=1 2024-09-12T19:23:00.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.3SPwJ4eGu2fgjVe4ETxWVgxTqYqAPuU_0 2024-09-12T19:23:00.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.202158981718890397', time=2024-09-12T20:36:34.408228+0000, chain.objs.size()=1 2024-09-12T19:23:00.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.qFmgBRejoHR2cKJ44YG9tx9vXmQUJB-_0 2024-09-12T19:23:00.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1773518486972288851', time=2024-09-12T20:36:37.091225+0000, chain.objs.size()=1 2024-09-12T19:23:00.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.1f9810JLMPR_bu2c9pemaIu-_Qs2Olv_0 2024-09-12T19:23:00.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16216170902764586693', time=2024-09-12T20:36:37.365482+0000, chain.objs.size()=1 2024-09-12T19:23:00.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.KQGZEwDtvcAYZN9Ym-CiZPjGFmZdflQ_0 2024-09-12T19:23:00.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7982357030853076998', time=2024-09-12T20:36:37.958666+0000, chain.objs.size()=1 2024-09-12T19:23:00.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.wC1znzitpXMwPNr-TlkWPsUTqMXlB0b_0 2024-09-12T19:23:00.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15345474665239061081', time=2024-09-12T20:36:38.573491+0000, chain.objs.size()=1 2024-09-12T19:23:00.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.N_5gwzVetNnw2h6-WCH6ix87D6Z22z3_0 2024-09-12T19:23:00.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3379567539862819070', time=2024-09-12T20:36:40.377273+0000, chain.objs.size()=1 2024-09-12T19:23:00.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.dBK2bldMqB30FRhpxkiLalPijFV1-gt_0 2024-09-12T19:23:00.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9698447114395238721', time=2024-09-12T20:36:40.379308+0000, chain.objs.size()=1 2024-09-12T19:23:00.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.CaxH6GwG6gThbLfRMIhASL6Dmm9gPQE_0 2024-09-12T19:23:00.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.990+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12278735904404414586', time=2024-09-12T20:36:41.237694+0000, chain.objs.size()=1 2024-09-12T19:23:00.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.990+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.imNt6cMd2yZ1sRN8-cR_t4_mxWV9sYN_0 2024-09-12T19:23:00.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.990+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.257527889264463824', time=2024-09-12T20:36:42.019114+0000, chain.objs.size()=1 2024-09-12T19:23:00.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.990+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.7mEoRLJSzbAs_4QbhttHflrbXB6HRo1_0 2024-09-12T19:23:00.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.990+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5305460177716699222', time=2024-09-12T20:36:43.131159+0000, chain.objs.size()=1 2024-09-12T19:23:00.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.990+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.UMmZfdjVRcd-05lRG2rrqrxC5ZGyS-U_0 2024-09-12T19:23:00.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.990+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16732203220617058808', time=2024-09-12T20:36:43.195157+0000, chain.objs.size()=1 2024-09-12T19:23:00.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.990+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.w8lTS7ZekUlGBsatZ7ykTTsxcB_QesC_0 2024-09-12T19:23:00.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.994+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1093850293931972272', time=2024-09-12T20:36:43.201361+0000, chain.objs.size()=1 2024-09-12T19:23:00.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.994+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.XqOTmN5IxOWLcy_gXoimbgtwNOHeO8P_0 2024-09-12T19:23:00.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.994+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10425127139657741933', time=2024-09-12T20:36:44.028329+0000, chain.objs.size()=1 2024-09-12T19:23:00.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.994+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Jek7o1l7nnwMWstme0RfqHhutWPkjQ5_0 2024-09-12T19:23:00.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.994+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12538642090290697674', time=2024-09-12T20:36:45.927556+0000, chain.objs.size()=1 2024-09-12T19:23:00.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.994+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.BH8ba8sp85FQ8LqiOUmRRSHP3QagzJH_0 2024-09-12T19:23:00.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.994+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11702500947546441950', time=2024-09-12T20:36:46.903159+0000, chain.objs.size()=1 2024-09-12T19:23:01.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.994+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.pGBgjMn4uy9ZGfG14a_Nj4710_vw-hb_0 2024-09-12T19:23:01.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.994+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9654190224604355728', time=2024-09-12T20:36:47.452853+0000, chain.objs.size()=1 2024-09-12T19:23:01.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.994+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.MDnbRypUusoEimWeklJDYklspqh35hL_0 2024-09-12T19:23:01.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.994+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3299436599167357713', time=2024-09-12T20:36:49.546086+0000, chain.objs.size()=1 2024-09-12T19:23:01.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.994+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.CHMu5O9jnhn3G459MyZ9tA8BXSq5HgL_0 2024-09-12T19:23:01.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.994+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8956006364262130748', time=2024-09-12T20:36:49.641846+0000, chain.objs.size()=1 2024-09-12T19:23:01.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.994+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.dzgzUm7QxAdF6Xcd0RpKZwj-eHOttM-_0 2024-09-12T19:23:01.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.998+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16003603976347092307', time=2024-09-12T20:36:50.899037+0000, chain.objs.size()=1 2024-09-12T19:23:01.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.998+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.TqQ4xOeDJaIwhUdopx_j9vd9h2xNqnX_0 2024-09-12T19:23:01.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.998+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18268254191292704171', time=2024-09-12T20:36:52.043323+0000, chain.objs.size()=1 2024-09-12T19:23:01.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.998+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.i-EpJKeNtTTIBdWLuzjQ0ZJg-d1iPfy_0 2024-09-12T19:23:01.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.998+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17968655440996119075', time=2024-09-12T20:36:52.756933+0000, chain.objs.size()=1 2024-09-12T19:23:01.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.998+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.pG0ACl0ZpxbzOqrvHU1iNZjsQ30fRvW_0 2024-09-12T19:23:01.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.998+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3205835337324604088', time=2024-09-12T20:36:55.056512+0000, chain.objs.size()=1 2024-09-12T19:23:01.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.998+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.FKcv-n13J7HPXBKD0LXrDU5KuVwm5p8_0 2024-09-12T19:23:01.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.998+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12211364503008760686', time=2024-09-12T20:38:39.782654+0000, chain.objs.size()=1 2024-09-12T19:23:01.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.998+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.VraTVKVBYAKc8_OZLCF9cjqapda_Z6J_0 2024-09-12T19:23:01.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.998+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10418133304064521734', time=2024-09-12T20:38:39.899681+0000, chain.objs.size()=1 2024-09-12T19:23:01.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.998+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.8PoY7EPyWkGQC8LRUH92vK252Jl0pFn_0 2024-09-12T19:23:01.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.998+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9666005340449893333', time=2024-09-12T20:38:41.202370+0000, chain.objs.size()=1 2024-09-12T19:23:01.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.998+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.eRqguYjxgX55l3fxXaBJQwmOIRs218I_0 2024-09-12T19:23:01.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.998+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5264648868650338734', time=2024-09-12T20:38:42.586219+0000, chain.objs.size()=1 2024-09-12T19:23:01.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.998+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.JP3uZztw0tTjnKf7ZIxPxL8d8g3YBn5_0 2024-09-12T19:23:01.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.998+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15502496370028789834', time=2024-09-12T20:38:42.645389+0000, chain.objs.size()=1 2024-09-12T19:23:01.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:00.998+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-m7YOfAGAIHnllNryk9cDZISqoESOb8_0 2024-09-12T19:23:01.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.002+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18145745247607815317', time=2024-09-12T20:38:44.007024+0000, chain.objs.size()=1 2024-09-12T19:23:01.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.002+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.OYpEDAzI0klwLJV88DxWDXFncxbING9_0 2024-09-12T19:23:01.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.002+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3694503579480637780', time=2024-09-12T20:38:45.765239+0000, chain.objs.size()=1 2024-09-12T19:23:01.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.002+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.7NRLO5QaD3TklZ-oLhDtdU1XAEU9avz_0 2024-09-12T19:23:01.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.002+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9683521563188375150', time=2024-09-12T20:38:47.504575+0000, chain.objs.size()=1 2024-09-12T19:23:01.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.002+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.88nQ00rxWfi4ls9Ex_KPbZK39gTPFqg_0 2024-09-12T19:23:01.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.002+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9304939240885942020', time=2024-09-12T20:38:48.144640+0000, chain.objs.size()=1 2024-09-12T19:23:01.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.002+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.bnFgw1BkJXfhzYR7KFCVFYj-EOOZKqq_0 2024-09-12T19:23:01.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.002+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5191199600734749043', time=2024-09-12T20:38:49.586370+0000, chain.objs.size()=1 2024-09-12T19:23:01.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.002+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.M9kCOCok_hlZ8xtfvYBfkZG5tS4E3_I_0 2024-09-12T19:23:01.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.006+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1790530255411842803', time=2024-09-12T20:38:49.944506+0000, chain.objs.size()=1 2024-09-12T19:23:01.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.006+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.6z5nCOIjvC0ME3Z0iHMCs5dQ6vgAM6Z_0 2024-09-12T19:23:01.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.006+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6767325837581441444', time=2024-09-12T20:38:51.312040+0000, chain.objs.size()=1 2024-09-12T19:23:01.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.006+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.xMQkL2RymRAJ_ws--OG1aY7fg_7DTnA_0 2024-09-12T19:23:01.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.006+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6110981264707505741', time=2024-09-12T20:38:51.390722+0000, chain.objs.size()=1 2024-09-12T19:23:01.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.006+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.HCbBJXzgT7_1Ywv2vTNSGzK9Dyzo6Vm_0 2024-09-12T19:23:01.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.006+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16389210678141705461', time=2024-09-12T20:38:52.235575+0000, chain.objs.size()=1 2024-09-12T19:23:01.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.006+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.pTHeP_uVsfFwrFovP1H3yfvvQsyuw7r_0 2024-09-12T19:23:01.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.006+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14840629562017141648', time=2024-09-12T20:38:53.689978+0000, chain.objs.size()=1 2024-09-12T19:23:01.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.006+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.QNReQ4uG7DPxCtXM-Byf00QBjtb5v-S_0 2024-09-12T19:23:01.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.006+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17861575877894389834', time=2024-09-12T20:38:55.055153+0000, chain.objs.size()=1 2024-09-12T19:23:01.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.006+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Sb4R83IN9HLlntyXMlnLLIeX7xnM7XW_0 2024-09-12T19:23:01.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.006+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4192797292332684504', time=2024-09-12T20:38:55.869827+0000, chain.objs.size()=1 2024-09-12T19:23:01.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.006+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.aYzPBxKM1xxBRyFIlAwQfg4S4StQglc_0 2024-09-12T19:23:01.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.006+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18017197955706293166', time=2024-09-12T20:38:56.466459+0000, chain.objs.size()=1 2024-09-12T19:23:01.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.006+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.dTx2MAmghb8TCXBDt9wLZgHNB_-bk6m_0 2024-09-12T19:23:01.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.010+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1812312547930490700', time=2024-09-12T20:38:58.663950+0000, chain.objs.size()=1 2024-09-12T19:23:01.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.010+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.YhvKYt9f1w1B-InyFSlpJYRP1T-paok_0 2024-09-12T19:23:01.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.010+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6514248739643609401', time=2024-09-12T20:38:58.666760+0000, chain.objs.size()=1 2024-09-12T19:23:01.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.010+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.umP8wNxlpSEC8Atfa3JqM1ZHBuIg4fu_0 2024-09-12T19:23:01.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.010+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14478409165927132440', time=2024-09-12T20:38:59.948546+0000, chain.objs.size()=1 2024-09-12T19:23:01.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.010+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.SyQMGOnzXjmqdT7MqZqk9bS33vQBGwp_0 2024-09-12T19:23:01.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.010+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2607874663847417840', time=2024-09-12T20:39:00.445595+0000, chain.objs.size()=1 2024-09-12T19:23:01.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.010+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.utEC8YdShYRYXSlHW8Ki5Ih40Nvctku_0 2024-09-12T19:23:01.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.010+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17918625193807034332', time=2024-09-12T20:39:00.755870+0000, chain.objs.size()=1 2024-09-12T19:23:01.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.010+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.iGMuZ6wM4-vFUhRQOSRQ2GE54hMtyLz_0 2024-09-12T19:23:01.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.014+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6463826083991732068', time=2024-09-12T20:39:01.384514+0000, chain.objs.size()=1 2024-09-12T19:23:01.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.014+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.YQ-zqEkx9bzdnscUhVhKnuUoZienm9P_0 2024-09-12T19:23:01.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.014+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17944348282802217405', time=2024-09-12T20:39:02.669397+0000, chain.objs.size()=1 2024-09-12T19:23:01.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.014+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.QXXEkNLinNUn0KfaVpnxEV1qvtv3mdB_0 2024-09-12T19:23:01.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.014+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10753006722856699305', time=2024-09-12T20:39:03.520081+0000, chain.objs.size()=1 2024-09-12T19:23:01.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.014+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.fBVCdo1wFaN9C5SQQ1iwKjNaBHUBjhC_0 2024-09-12T19:23:01.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.014+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15700686500325243869', time=2024-09-12T20:39:04.839797+0000, chain.objs.size()=1 2024-09-12T19:23:01.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.014+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.W-s_716TO-rU0gN4cKWaGYJ3ox-gBAT_0 2024-09-12T19:23:01.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.014+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11476796178149289209', time=2024-09-12T20:39:05.857994+0000, chain.objs.size()=1 2024-09-12T19:23:01.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.014+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.1x4mRogLZIDmL7vBbu8ts-twoNZxjhb_0 2024-09-12T19:23:01.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.014+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.804607091470455224', time=2024-09-12T20:39:06.578665+0000, chain.objs.size()=1 2024-09-12T19:23:01.021 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.014+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.EgIArPWdOg4NBmvmfMnAm2gWLD7kW5E_0 2024-09-12T19:23:01.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.014+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12970077231297801869', time=2024-09-12T20:39:07.346012+0000, chain.objs.size()=1 2024-09-12T19:23:01.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.014+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.u4Zqyqlbxrc7iV_E-xdb9yyvdh0TzRm_0 2024-09-12T19:23:01.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.014+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13283759064078470506', time=2024-09-12T20:44:36.405909+0000, chain.objs.size()=1 2024-09-12T19:23:01.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.014+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.484__shadow_.FsItw0mPlo-H584jG18xmP_Nzd9DPeP_0 2024-09-12T19:23:01.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.018+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13185864875814902389', time=2024-09-12T20:44:49.120414+0000, chain.objs.size()=1 2024-09-12T19:23:01.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.018+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.487__shadow_.6zsBI_-8Wsdto09f3XJnOimOa6L1tpJ_0 2024-09-12T19:23:01.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.018+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18143763276489598109', time=2024-09-12T20:44:49.128434+0000, chain.objs.size()=1 2024-09-12T19:23:01.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.018+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.487__shadow_.6zsBI_-8Wsdto09f3XJnOimOa6L1tpJ_0 2024-09-12T19:23:01.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.018+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4096487852028491767', time=2024-09-12T20:44:57.914190+0000, chain.objs.size()=1 2024-09-12T19:23:01.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.018+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.491__shadow_.XC73dW9RmPpK69cfIhJ6_xLP0wTpX3g_0 2024-09-12T19:23:01.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.018+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2882498205066630249', time=2024-09-12T20:45:22.257237+0000, chain.objs.size()=1 2024-09-12T19:23:01.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.018+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.503__shadow:tE2u4PreZ1ptztujaTdnj2An4nygGJX_.ADvFvlMdDhiFGZmRgRvM9GmBz7MDjzE_0 2024-09-12T19:23:01.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.018+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13624777482402278713', time=2024-09-12T20:46:36.440787+0000, chain.objs.size()=1 2024-09-12T19:23:01.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.018+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.518__multipart_mymultipart.2~ZTqde5vgm8o9zZahSHDHsmXBH2EBuRN.1 2024-09-12T19:23:01.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.018+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ao3RgPkgQzpf515S__C1WsHZzggrFls', time=2024-09-12T20:49:44.124261+0000, chain.objs.size()=1 2024-09-12T19:23:01.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.018+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~ao3RgPkgQzpf515S__C1WsHZzggrFls.3 2024-09-12T19:23:01.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.018+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15574636248935605970', time=2024-09-12T20:56:08.150246+0000, chain.objs.size()=1 2024-09-12T19:23:01.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.018+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.558__shadow_.qshWTquq-jZYuYfHfJyfAzgu8xcb6qt_0 2024-09-12T19:23:01.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.018+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10097414836006587802', time=2024-09-12T20:56:46.662839+0000, chain.objs.size()=1 2024-09-12T19:23:01.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.018+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:nciLSSibq9UUvHj0XaHtDr9ajxbGEmY_.e3Oo1Kg-4Kadf7hRIkEvY9OJKov0Lk7_0 2024-09-12T19:23:01.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.018+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13564902414525893806', time=2024-09-12T20:56:50.400006+0000, chain.objs.size()=1 2024-09-12T19:23:01.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.018+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:EydnEORI1uPagQ-e78RFRrI-xqQKVxn_.nSIa2FCXaPpKbSTUk3jGkZ2XlOtr9hz_0 2024-09-12T19:23:01.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.018+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.918143973684713509', time=2024-09-12T20:57:01.672931+0000, chain.objs.size()=1 2024-09-12T19:23:01.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.018+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:ffNIRiC2PojJpWlzR-zC6JwU9kqKFt6_.TremhjJjQNHAIg0j_dPxsJpsqCsByip_0 2024-09-12T19:23:01.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.026+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46758 2024-09-12T19:23:01.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.026+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T19:23:01.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.026+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7150202555195015724', time=2024-09-12T20:57:22.347737+0000, chain.objs.size()=1 2024-09-12T19:23:01.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.026+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.574__shadow_.0C6JVUjfmisW4C3Cd1sHNX4YovJ8hdx_0 2024-09-12T19:23:01.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.026+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.305711202311350064', time=2024-09-12T20:58:09.104932+0000, chain.objs.size()=1 2024-09-12T19:23:01.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.026+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:QJurkalqWYGioEpYcsq71hbPkNhyAHm_.7_67iiYwBYSig7-2Ci1nde3QkFiKru1_0 2024-09-12T19:23:01.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.026+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5750364493105853783', time=2024-09-12T20:59:55.090656+0000, chain.objs.size()=1 2024-09-12T19:23:01.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.026+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.587__shadow:fmcec66TxhZ.Wlyx.Z0Kp9QbqYD89aA_._x55eX29_ze8IfptiUruJ3_oAwltODT_0 2024-09-12T19:23:01.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.026+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9967709901773301982', time=2024-09-12T21:00:28.112370+0000, chain.objs.size()=1 2024-09-12T19:23:01.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.026+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.604__shadow_.T_tcxyzd8nQcwCvrMAfvZ4aMV54Uc8I_0 2024-09-12T19:23:01.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.030+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:01.041 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.034+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T19:23:01.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:01.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:01.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47005' 2024-09-12T19:23:01.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='_qus44SZYDhJHNuWyu1Ewi0RnAAUHWsK', time=2024-09-12T20:23:17.189630+0000, chain.objs.size()=2 2024-09-12T19:23:01.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.161__shadow_.je1EKGJdgwNVHQEuzHHZSARm4pVNOqb_0 2024-09-12T19:23:01.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.161__shadow_.je1EKGJdgwNVHQEuzHHZSARm4pVNOqb_1 2024-09-12T19:23:01.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15363484488809214913', time=2024-09-12T20:23:39.428613+0000, chain.objs.size()=1 2024-09-12T19:23:01.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.166__shadow_.W0n2UjGPWbeCZQXluFzClxnUqfHXCE0_0 2024-09-12T19:23:01.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15091893763694938432', time=2024-09-12T20:28:52.494641+0000, chain.objs.size()=1 2024-09-12T19:23:01.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.233__shadow_.o71Y0CNxgWfql4EnZOqriaS7-0OkWlK_0 2024-09-12T19:23:01.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13641998726626036903', time=2024-09-12T20:29:19.392394+0000, chain.objs.size()=1 2024-09-12T19:23:01.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.243__shadow_.feCaeSZJbTLixeVsCWaJG2CAe0kP1q5_0 2024-09-12T19:23:01.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7427100675206668856', time=2024-09-12T20:29:23.252673+0000, chain.objs.size()=1 2024-09-12T19:23:01.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.244__shadow_.P5TzqvF-xO7EvBuq5N36FoCoPGD0aim_0 2024-09-12T19:23:01.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6420256134498287874', time=2024-09-12T20:29:34.757032+0000, chain.objs.size()=1 2024-09-12T19:23:01.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.249__shadow_.anqZeRxkyOlT6RoVbsz-OiKTGaqIWrA_0 2024-09-12T19:23:01.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18184193391340531573', time=2024-09-12T20:29:46.319048+0000, chain.objs.size()=1 2024-09-12T19:23:01.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.254__shadow_.RuT0zMcrj2qNTIB42ju6WEOgVZxjEVn_0 2024-09-12T19:23:01.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3660891729175889047', time=2024-09-12T20:31:45.290098+0000, chain.objs.size()=1 2024-09-12T19:23:01.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.k_fSSrv4_CNsevcCsVy29OOURV3tqn1_0 2024-09-12T19:23:01.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6912823417132031804', time=2024-09-12T20:31:47.465689+0000, chain.objs.size()=1 2024-09-12T19:23:01.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.46Xrcs9ZCsw-352QE1PCKKkyRXG3mhz_0 2024-09-12T19:23:01.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14061274786640046484', time=2024-09-12T20:31:47.613968+0000, chain.objs.size()=1 2024-09-12T19:23:01.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.R00svz-27Py3dOOB3K7bH_BH6srp32k_0 2024-09-12T19:23:01.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17831668233941252461', time=2024-09-12T20:31:48.181861+0000, chain.objs.size()=1 2024-09-12T19:23:01.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.038+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Z7p_kSD6PI8kvQeB1QcLDXbiiBrf-PL_0 2024-09-12T19:23:01.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1763184034034170622', time=2024-09-12T20:31:49.272767+0000, chain.objs.size()=1 2024-09-12T19:23:01.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.VUR4__REWKFFyiRXjkCxIdKXDyIidBm_0 2024-09-12T19:23:01.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6010399215484267539', time=2024-09-12T20:31:49.610931+0000, chain.objs.size()=1 2024-09-12T19:23:01.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.MBprYVT-qHgi9luxrV9DgKIGoLhfM9z_0 2024-09-12T19:23:01.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7073172401141328198', time=2024-09-12T20:31:50.249908+0000, chain.objs.size()=1 2024-09-12T19:23:01.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.hVNj56my1jUq9g-HuQeD9EKmDCiDjsR_0 2024-09-12T19:23:01.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13885478434583779343', time=2024-09-12T20:31:50.703036+0000, chain.objs.size()=1 2024-09-12T19:23:01.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.b7Gk7Im5s4XH9eBjEA1xQuhlHYU-GVt_0 2024-09-12T19:23:01.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3799225242919850351', time=2024-09-12T20:31:51.916217+0000, chain.objs.size()=1 2024-09-12T19:23:01.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Zj3wgBP64bCA3TxlMzIIaRdb50cboWi_0 2024-09-12T19:23:01.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12833566679148515841', time=2024-09-12T20:31:53.220496+0000, chain.objs.size()=1 2024-09-12T19:23:01.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.79jRfZxl9iIR1psWYj3M3gV3SMigASa_0 2024-09-12T19:23:01.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9757583341183219919', time=2024-09-12T20:31:54.529970+0000, chain.objs.size()=1 2024-09-12T19:23:01.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.mrY3NiAHu4I3Asyh6Rsf8p46X5kHXOm_0 2024-09-12T19:23:01.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1681836716869556046', time=2024-09-12T20:32:00.721323+0000, chain.objs.size()=1 2024-09-12T19:23:01.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.qlNQ3S56uTxVzj2Rt_R9LA7pMlygUZ-_0 2024-09-12T19:23:01.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10687066843115615588', time=2024-09-12T20:32:02.935937+0000, chain.objs.size()=1 2024-09-12T19:23:01.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ztarhpjPc1uT9_vms3qQmBFVUrKpj_E_0 2024-09-12T19:23:01.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5621450062379386299', time=2024-09-12T20:32:03.268370+0000, chain.objs.size()=1 2024-09-12T19:23:01.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.dIgqfTr8-EgczfyfJFUmh87-dtP3GtL_0 2024-09-12T19:23:01.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8092227176303627867', time=2024-09-12T20:32:05.064815+0000, chain.objs.size()=1 2024-09-12T19:23:01.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.042+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.4whMN1nf9D5V5Yofc71QdocYkuDZ3K2_0 2024-09-12T19:23:01.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.046+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1480795543496526621', time=2024-09-12T20:32:05.635848+0000, chain.objs.size()=1 2024-09-12T19:23:01.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.046+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.mrr7v8ncyLc8pacj7d4ehoepegPZzHe_0 2024-09-12T19:23:01.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.046+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13469736790945548324', time=2024-09-12T20:32:05.696222+0000, chain.objs.size()=1 2024-09-12T19:23:01.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.046+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.MXHdrycZ3VMy9LFW0sN6590yN21avnQ_0 2024-09-12T19:23:01.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9928899371634126076', time=2024-09-12T20:32:07.982489+0000, chain.objs.size()=1 2024-09-12T19:23:01.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.LpDJSaryF3XPJjHr2TB50YkWVy8G2vY_0 2024-09-12T19:23:01.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11351642671408880462', time=2024-09-12T20:32:07.990606+0000, chain.objs.size()=1 2024-09-12T19:23:01.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Gqi2sDm3F2YMlCiy4zxL15S8gcT531Z_0 2024-09-12T19:23:01.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18135991339204692455', time=2024-09-12T20:32:08.167445+0000, chain.objs.size()=1 2024-09-12T19:23:01.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.b5kQANSKam-VcveGbQrpSAomEhAxttb_0 2024-09-12T19:23:01.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2034992468449388143', time=2024-09-12T20:32:08.551650+0000, chain.objs.size()=1 2024-09-12T19:23:01.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.KBCHxqISSZNaC_BNoxszF5Pk2jl-Qg5_0 2024-09-12T19:23:01.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10884135986765521405', time=2024-09-12T20:32:08.574072+0000, chain.objs.size()=1 2024-09-12T19:23:01.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Hk7YyfF1EsKVDgWL0tWRSeq0V_StGgq_0 2024-09-12T19:23:01.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8555814691947530717', time=2024-09-12T20:32:12.264458+0000, chain.objs.size()=1 2024-09-12T19:23:01.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.t6KiUlZpHgqOaeXHEtIsa2izCvJZ3gT_0 2024-09-12T19:23:01.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15203520558073659584', time=2024-09-12T20:32:12.800888+0000, chain.objs.size()=1 2024-09-12T19:23:01.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.9Qfo5u-yFTlB-UZN2xtmgYjbKcBGsO7_0 2024-09-12T19:23:01.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17848881474430822320', time=2024-09-12T20:32:13.905448+0000, chain.objs.size()=1 2024-09-12T19:23:01.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.AKodqQl9rJExlHgLno01x4TQHwu9oKF_0 2024-09-12T19:23:01.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1307657513531181744', time=2024-09-12T20:32:20.663919+0000, chain.objs.size()=1 2024-09-12T19:23:01.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.265__shadow_.I44xmgwxjdrrcpjeST6GoSudBzOPLMX_0 2024-09-12T19:23:01.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7017850044963091258', time=2024-09-12T20:32:29.320810+0000, chain.objs.size()=1 2024-09-12T19:23:01.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.269__shadow_.1vzWWPVtc86n9IsHgUL8g1bHpaLjIIi_0 2024-09-12T19:23:01.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14551204114077164402', time=2024-09-12T20:32:56.455341+0000, chain.objs.size()=1 2024-09-12T19:23:01.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.050+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.281__shadow_.tW5ymRUgQ3ca999SzTjphKX4J1PepZl_0 2024-09-12T19:23:01.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.054+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7959550155130733312', time=2024-09-12T20:33:33.873389+0000, chain.objs.size()=1 2024-09-12T19:23:01.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.054+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.294__shadow_.Wiq8cmiB3ZSvplsEpiHvM7meI3OXlhv_0 2024-09-12T19:23:01.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.054+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.337835122567129663', time=2024-09-12T20:36:27.917679+0000, chain.objs.size()=1 2024-09-12T19:23:01.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.054+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.iIrAXYodcdIH2Q69C9iYmi2thKcUgCC_0 2024-09-12T19:23:01.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.054+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6727593920225338211', time=2024-09-12T20:36:29.559044+0000, chain.objs.size()=1 2024-09-12T19:23:01.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.054+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.LvhV8W4flseG4IKlqgnojTvbRwebuc7_0 2024-09-12T19:23:01.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.054+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3010343552085031684', time=2024-09-12T20:36:29.901379+0000, chain.objs.size()=1 2024-09-12T19:23:01.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.054+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.4bsMOtW3ZqFLslGv33SsTUYRc_be8BB_0 2024-09-12T19:23:01.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.054+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13493065410492983784', time=2024-09-12T20:36:30.603979+0000, chain.objs.size()=1 2024-09-12T19:23:01.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.054+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Tl6OyjJ99kyKgmNX8HEjLL-LcyGfX-4_0 2024-09-12T19:23:01.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.054+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16426670902945959997', time=2024-09-12T20:36:32.680279+0000, chain.objs.size()=1 2024-09-12T19:23:01.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.054+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.jpYE1_97we969xxPw2OStjB34Hhlawt_0 2024-09-12T19:23:01.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.054+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14930760725122700867', time=2024-09-12T20:36:34.197721+0000, chain.objs.size()=1 2024-09-12T19:23:01.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.054+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Bzle7fOz-48aLQMs4fGt8mUFQqRo45S_0 2024-09-12T19:23:01.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.054+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5318398165714165973', time=2024-09-12T20:36:34.540250+0000, chain.objs.size()=1 2024-09-12T19:23:01.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.054+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.yImAoqJaMSSgD2H_Cmfi0RUEvNmZBRd_0 2024-09-12T19:23:01.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.054+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13038195810378601218', time=2024-09-12T20:36:35.792898+0000, chain.objs.size()=1 2024-09-12T19:23:01.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.054+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.dCKsfLjXysUrFA4xwNqX18NWwyK_YSk_0 2024-09-12T19:23:01.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.058+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3255612892430368421', time=2024-09-12T20:36:39.647873+0000, chain.objs.size()=1 2024-09-12T19:23:01.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.058+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.P6iU5TwZ4VtFIkbrKFIQmjfakfWLs-r_0 2024-09-12T19:23:01.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.058+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8045029518719725885', time=2024-09-12T20:36:41.054649+0000, chain.objs.size()=1 2024-09-12T19:23:01.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.058+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.pry_uQdzk-RcsLAKW_FUNPbZmaKWLq2_0 2024-09-12T19:23:01.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1944983695689663106', time=2024-09-12T20:36:41.151036+0000, chain.objs.size()=1 2024-09-12T19:23:01.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.N8K8H6kiZu7t_Ho1q_sHf1aqLmb2tQU_0 2024-09-12T19:23:01.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14079987012510900715', time=2024-09-12T20:36:41.495901+0000, chain.objs.size()=1 2024-09-12T19:23:01.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.X5CtkR0XQGt8No3sRVr8i3YDBBPeUQb_0 2024-09-12T19:23:01.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5433201038100543136', time=2024-09-12T20:36:41.586204+0000, chain.objs.size()=1 2024-09-12T19:23:01.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.nhIWJS5ZQQu0Q0AruTGGufFIcyDGypV_0 2024-09-12T19:23:01.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11558295813226050975', time=2024-09-12T20:36:41.624423+0000, chain.objs.size()=1 2024-09-12T19:23:01.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.38TcheIHseQq3kDRqQ-cok5CowYeS1U_0 2024-09-12T19:23:01.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2897953018497654741', time=2024-09-12T20:36:41.754232+0000, chain.objs.size()=1 2024-09-12T19:23:01.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.iMtQ32NtnQ-kmJhu4ZW7qaTGkFmAXVf_0 2024-09-12T19:23:01.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14562824260504074590', time=2024-09-12T20:36:43.705597+0000, chain.objs.size()=1 2024-09-12T19:23:01.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.XBBsUQNF_yvbBqPFicei0MMfMomgqj2_0 2024-09-12T19:23:01.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8070074495791815636', time=2024-09-12T20:36:44.608068+0000, chain.objs.size()=1 2024-09-12T19:23:01.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.31NiH0oKGtz_EJITrrzfLweiioZYnGw_0 2024-09-12T19:23:01.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10513831862094802767', time=2024-09-12T20:36:45.236227+0000, chain.objs.size()=1 2024-09-12T19:23:01.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.6C8Xken-ugq7_D-t2RiKBHr42zxRgc0_0 2024-09-12T19:23:01.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7529902735235837051', time=2024-09-12T20:36:45.259142+0000, chain.objs.size()=1 2024-09-12T19:23:01.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.NNrMUwNggG38WSCK_R8kY0ekUnx7Puq_0 2024-09-12T19:23:01.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16505774500899660266', time=2024-09-12T20:36:45.900970+0000, chain.objs.size()=1 2024-09-12T19:23:01.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.UURDywzKuw622yUv1VbIpaFPJTcEPwx_0 2024-09-12T19:23:01.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18041460463070776060', time=2024-09-12T20:36:46.982435+0000, chain.objs.size()=1 2024-09-12T19:23:01.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.062+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.vcuOmgYVcUI3Fu2Rq4jkZ5LTj_rkE_H_0 2024-09-12T19:23:01.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.066+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2012797349033623726', time=2024-09-12T20:36:48.228035+0000, chain.objs.size()=1 2024-09-12T19:23:01.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.066+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.O0IP5rI0RhL0L1TYlJK7WBgItVnsxaX_0 2024-09-12T19:23:01.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.066+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.321540602098907699', time=2024-09-12T20:36:48.945550+0000, chain.objs.size()=1 2024-09-12T19:23:01.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.066+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.sv1WCReN2IbS3K7BvOjrY1AJI0ZVn_D_0 2024-09-12T19:23:01.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.066+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3943638214481583119', time=2024-09-12T20:36:49.113916+0000, chain.objs.size()=1 2024-09-12T19:23:01.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.066+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.8kh6ySo9m1JpGPaRbKJWCL5Mi0YBVl3_0 2024-09-12T19:23:01.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.066+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.503420105673742270', time=2024-09-12T20:36:49.335623+0000, chain.objs.size()=1 2024-09-12T19:23:01.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.066+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Q89dpx50xr0nsXphaX26goMvGKYpJI6_0 2024-09-12T19:23:01.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.066+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16371594008217018216', time=2024-09-12T20:36:49.505441+0000, chain.objs.size()=1 2024-09-12T19:23:01.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.066+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.t_a7lVZphpZT-9dMRzPdJcneIEdw_cu_0 2024-09-12T19:23:01.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.070+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17797063164676940810', time=2024-09-12T20:36:50.580330+0000, chain.objs.size()=1 2024-09-12T19:23:01.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.070+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.s2gufa-sfGuHiPkvHsl0lm3Yb9YiIq7_0 2024-09-12T19:23:01.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.070+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16861241693117208831', time=2024-09-12T20:36:51.569120+0000, chain.objs.size()=1 2024-09-12T19:23:01.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.070+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.scQphkx3o51n_9bI_jGN7i5qbvBcvSE_0 2024-09-12T19:23:01.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.070+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11102310754131303019', time=2024-09-12T20:36:52.638344+0000, chain.objs.size()=1 2024-09-12T19:23:01.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.070+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.AwBFnoZqWwm4M6-IXQPW370JAiB6N3F_0 2024-09-12T19:23:01.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.070+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10050637220921307614', time=2024-09-12T20:36:53.997875+0000, chain.objs.size()=1 2024-09-12T19:23:01.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.070+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.4j7DaVXy8VrFUAusoQsKGZLMRXMasxQ_0 2024-09-12T19:23:01.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.070+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11524987389702841583', time=2024-09-12T20:36:54.139969+0000, chain.objs.size()=1 2024-09-12T19:23:01.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.070+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.QPswUbjMVLh3l83W7lnl7ZMoajoLrOi_0 2024-09-12T19:23:01.075 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.070+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14419757756693936875', time=2024-09-12T20:36:55.505435+0000, chain.objs.size()=1 2024-09-12T19:23:01.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.070+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.R1F5zifqk0xlC7rZtNrk9AU7VmPt-kb_0 2024-09-12T19:23:01.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.070+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15749165309434462909', time=2024-09-12T20:36:55.579227+0000, chain.objs.size()=1 2024-09-12T19:23:01.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.070+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.qPgGkLShGcCuPUJeP7fioY-VJY-9oRI_0 2024-09-12T19:23:01.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.070+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8695250607869086365', time=2024-09-12T20:36:55.804208+0000, chain.objs.size()=1 2024-09-12T19:23:01.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.070+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.lYXXiOhEMr2Z3NMqrNWhpwboo2BG8VQ_0 2024-09-12T19:23:01.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12587337524213128989', time=2024-09-12T20:36:56.148123+0000, chain.objs.size()=1 2024-09-12T19:23:01.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.zwrar3PSSuqQM8i8h426mdngKTBxoV3_0 2024-09-12T19:23:01.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3300282841048416858', time=2024-09-12T20:36:56.201350+0000, chain.objs.size()=1 2024-09-12T19:23:01.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.qL2pQZcfhaTCgTUzijOpVCRTBfneuwd_0 2024-09-12T19:23:01.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5115312509632249769', time=2024-09-12T20:36:56.332984+0000, chain.objs.size()=1 2024-09-12T19:23:01.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.LtuaXqDk19uOn60ZWTIjkienDLWyWRI_0 2024-09-12T19:23:01.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.738438182953542704', time=2024-09-12T20:38:39.750682+0000, chain.objs.size()=1 2024-09-12T19:23:01.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.VWiWxR1aV5M-KFRyRR8CcuAF3eqiCtb_0 2024-09-12T19:23:01.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2227538958965003440', time=2024-09-12T20:38:39.896576+0000, chain.objs.size()=1 2024-09-12T19:23:01.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.7mgK0jx_T8Cp2Nov6DV05fmBkeMJumK_0 2024-09-12T19:23:01.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2652839526555193120', time=2024-09-12T20:38:40.134822+0000, chain.objs.size()=1 2024-09-12T19:23:01.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Zx4X1q9Ly_dy_-cEv5OylLOVZQiUm9I_0 2024-09-12T19:23:01.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9229180031287935249', time=2024-09-12T20:38:40.565836+0000, chain.objs.size()=1 2024-09-12T19:23:01.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-5Zyh-LnXvEPcS6YReW_WqtKdsaVdd1_0 2024-09-12T19:23:01.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7177852362269243962', time=2024-09-12T20:38:41.089362+0000, chain.objs.size()=1 2024-09-12T19:23:01.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.RJIKb3yF9ThZWoTHo5WiaF5Lcrp-5YE_0 2024-09-12T19:23:01.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17050102276132589587', time=2024-09-12T20:38:41.638372+0000, chain.objs.size()=1 2024-09-12T19:23:01.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.tcXFrCbCAzarnsV4Ad9DmUskDaTSJ8P_0 2024-09-12T19:23:01.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12225616224408434217', time=2024-09-12T20:38:48.240851+0000, chain.objs.size()=1 2024-09-12T19:23:01.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.3kmQ0WRKx2jaHDEyDoIcvtfQnTbiz2w_0 2024-09-12T19:23:01.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15118488458699031033', time=2024-09-12T20:38:48.403366+0000, chain.objs.size()=1 2024-09-12T19:23:01.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.074+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.HOcoLkWkPlyL5x1qzi3lZedaKixwI9N_0 2024-09-12T19:23:01.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.078+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17707683970330054489', time=2024-09-12T20:38:48.873942+0000, chain.objs.size()=1 2024-09-12T19:23:01.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.078+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Y9WrIjXv4AvGEizc295DnU7TlO_lcLx_0 2024-09-12T19:23:01.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.078+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7046453885556116523', time=2024-09-12T20:38:49.052182+0000, chain.objs.size()=1 2024-09-12T19:23:01.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.078+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.jum5Vv0WUw2xKbjSKuRVPn0kfrMc32Q_0 2024-09-12T19:23:01.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.078+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12532924443349247650', time=2024-09-12T20:38:49.328230+0000, chain.objs.size()=1 2024-09-12T19:23:01.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.078+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.1OO8A86bftdv1oTr8r7EKmzaJZGU6YS_0 2024-09-12T19:23:01.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.078+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16330515769139333928', time=2024-09-12T20:38:50.247669+0000, chain.objs.size()=1 2024-09-12T19:23:01.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.078+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.JnqGvoXdDaUmUpI99nJFzMNvRDSTQV2_0 2024-09-12T19:23:01.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.078+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7979955622831365742', time=2024-09-12T20:38:51.806267+0000, chain.objs.size()=1 2024-09-12T19:23:01.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.078+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.vH21VOyP554sJ-PZNjL7lVltd26gg6u_0 2024-09-12T19:23:01.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.078+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10840846090658669294', time=2024-09-12T20:38:51.814753+0000, chain.objs.size()=1 2024-09-12T19:23:01.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.078+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.YmgVFzuEAYuTmLmLUnOTQQGeKmUNK8-_0 2024-09-12T19:23:01.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.078+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6254220796924142572', time=2024-09-12T20:38:52.067183+0000, chain.objs.size()=1 2024-09-12T19:23:01.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.078+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.09eTs9zFOMWsJXFRy6ORMmghp6-7WaW_0 2024-09-12T19:23:01.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.082+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13514623544766847088', time=2024-09-12T20:38:52.121869+0000, chain.objs.size()=1 2024-09-12T19:23:01.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.082+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.LqyetHLYzXEGf80_XqlmSf-657DPNDw_0 2024-09-12T19:23:01.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.082+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8421939915281894100', time=2024-09-12T20:38:53.049954+0000, chain.objs.size()=1 2024-09-12T19:23:01.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.082+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.vewa2L865SgEOKi-Ky47aYIUMPZcldM_0 2024-09-12T19:23:01.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.082+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6462679108294701644', time=2024-09-12T20:38:55.479464+0000, chain.objs.size()=1 2024-09-12T19:23:01.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.082+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.9-Fr2zaoL-XEwytoLilf2A_No3BbKb4_0 2024-09-12T19:23:01.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.082+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13920702297513671550', time=2024-09-12T20:38:56.470452+0000, chain.objs.size()=1 2024-09-12T19:23:01.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.086+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.QJ0Q8SfjfQ0FREpnMVhJN2MH2FX6RRl_0 2024-09-12T19:23:01.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.086+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3643822403429193789', time=2024-09-12T20:38:56.628847+0000, chain.objs.size()=1 2024-09-12T19:23:01.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.086+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.C6rEXANyGU-hf4-zFMOVAzLV1Bltl3k_0 2024-09-12T19:23:01.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.086+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15280308910018823863', time=2024-09-12T20:38:57.254013+0000, chain.objs.size()=1 2024-09-12T19:23:01.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.086+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.xoyPHwkCi3aEDLq0E5ewHAe_WNTR4_f_0 2024-09-12T19:23:01.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.086+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1470525339476978052', time=2024-09-12T20:38:58.697055+0000, chain.objs.size()=1 2024-09-12T19:23:01.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.086+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.KqnxmNQcnSoo9wcOo4g19EVSaGX_7a3_0 2024-09-12T19:23:01.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.086+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14778063227245385004', time=2024-09-12T20:38:59.264336+0000, chain.objs.size()=1 2024-09-12T19:23:01.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.086+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.VT2JwI5zGHIZc3mdn91d50UZKIgLl_G_0 2024-09-12T19:23:01.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.086+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9616763936749743145', time=2024-09-12T20:39:00.671186+0000, chain.objs.size()=1 2024-09-12T19:23:01.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.086+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.KcubedNIVU6tglxIOi55TKQCbxRja1W_0 2024-09-12T19:23:01.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.086+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3544942228987571652', time=2024-09-12T20:39:01.049273+0000, chain.objs.size()=1 2024-09-12T19:23:01.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.086+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.k5KWD06OYwtWXk5LsL9-vqIBR7yKSyO_0 2024-09-12T19:23:01.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.086+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10202983291086975486', time=2024-09-12T20:39:01.185205+0000, chain.objs.size()=1 2024-09-12T19:23:01.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.086+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.UyJZNESZMGOx0sHhfMNdrbCnj3ci1it_0 2024-09-12T19:23:01.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.090+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17979168658314446383', time=2024-09-12T20:39:01.194209+0000, chain.objs.size()=1 2024-09-12T19:23:01.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.090+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.nvLyH9FEkJUkTjUtU5ZCBCKt2zu95Hi_0 2024-09-12T19:23:01.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.090+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47005 2024-09-12T19:23:01.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T19:23:01.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16748730038356782235', time=2024-09-12T20:39:04.355383+0000, chain.objs.size()=1 2024-09-12T19:23:01.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.hejBa-ScwHr_wXjc0fEiodUgqnlYBAC_0 2024-09-12T19:23:01.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9490935693956969998', time=2024-09-12T20:39:05.761689+0000, chain.objs.size()=1 2024-09-12T19:23:01.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.kI7-Vzg6Q1bJ3fg4_HkSQQCuZVtwa_9_0 2024-09-12T19:23:01.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14158679222392787974', time=2024-09-12T20:39:06.596198+0000, chain.objs.size()=1 2024-09-12T19:23:01.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.tgCApHLGRf73zbuonMH-glwGFv_2CRx_0 2024-09-12T19:23:01.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6879445335136611645', time=2024-09-12T20:39:25.944569+0000, chain.objs.size()=1 2024-09-12T19:23:01.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.333__shadow_.sN8AW1SSeQ9gjeeq3MDhXcMdlwAUe1B_0 2024-09-12T19:23:01.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2667654618928739377', time=2024-09-12T20:46:48.133861+0000, chain.objs.size()=1 2024-09-12T19:23:01.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.517__shadow_.IWHKqgHyUJURFPNjaUHnj_cL0t5rli3_0 2024-09-12T19:23:01.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3668605179285974052', time=2024-09-12T20:51:58.903907+0000, chain.objs.size()=3 2024-09-12T19:23:01.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.523__multipart_mymultipart.2~0Tl3gC0VMTkvQd9njbPMm0riHpFI08u.1 2024-09-12T19:23:01.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.523__multipart_mymultipart.2~0Tl3gC0VMTkvQd9njbPMm0riHpFI08u.2 2024-09-12T19:23:01.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.523__multipart_mymultipart.2~0Tl3gC0VMTkvQd9njbPMm0riHpFI08u.3 2024-09-12T19:23:01.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12348882473390621674', time=2024-09-12T20:52:24.513104+0000, chain.objs.size()=2 2024-09-12T19:23:01.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.525__multipart_mymultipart.2~gb5hZwwmnguWHkpzOwSb2NTAK3yFfXI.1 2024-09-12T19:23:01.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.525__multipart_mymultipart.2~gb5hZwwmnguWHkpzOwSb2NTAK3yFfXI.2 2024-09-12T19:23:01.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7941895287615471750', time=2024-09-12T20:57:32.339678+0000, chain.objs.size()=1 2024-09-12T19:23:01.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.575__shadow_.Asepz5M8vYJmI0Bt584FKYiFjVOzEnG_0 2024-09-12T19:23:01.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4841033745315782410', time=2024-09-12T21:07:05.141321+0000, chain.objs.size()=1 2024-09-12T19:23:01.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.094+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.629__shadow_.JzWIElAIrpsWHMgUM7FCCDJtbW7y2vV_0 2024-09-12T19:23:01.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.098+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12545559552177807381', time=2024-09-12T21:08:39.676645+0000, chain.objs.size()=1 2024-09-12T19:23:01.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.098+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.656__shadow_.qZXwTBmQk0_gyNiYVPw8igRl-ylBn4C_0 2024-09-12T19:23:01.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.098+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14068667868337518431', time=2024-09-12T21:09:39.253298+0000, chain.objs.size()=1 2024-09-12T19:23:01.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.098+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.664__shadow_.P5dHiAMdxKOr6u1yU8OUEaXA_22Y7Zi_0 2024-09-12T19:23:01.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.098+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5449684572968653154', time=2024-09-12T21:09:55.621363+0000, chain.objs.size()=1 2024-09-12T19:23:01.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.098+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.672__shadow_.Ec9056zm4IKpsTwrMlFQE3uw-ycCKDt_0 2024-09-12T19:23:01.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.098+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10444088224323607969', time=2024-09-12T21:10:48.965307+0000, chain.objs.size()=1 2024-09-12T19:23:01.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.098+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.700__shadow:0sKfPuXzKrZvR57wQc7Vpvu-VXPLCy5_.KxvHu-LT0E0_KShbABVprm1VPM8xQRs_0 2024-09-12T19:23:01.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.098+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5723077282893146395', time=2024-09-12T21:11:00.092453+0000, chain.objs.size()=1 2024-09-12T19:23:01.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.098+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.705__shadow:uVBMPdPGMfgMnAdW3UcogNzJ9MNOMZv_.HS24DDh0s-1yqjQEmdltJpMAdN6r72t_0 2024-09-12T19:23:01.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.098+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1049092138880317313', time=2024-09-12T21:11:47.496048+0000, chain.objs.size()=1 2024-09-12T19:23:01.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.098+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.719__shadow_.k5dGKHFYFHfDmb5ua5Vz0mnqJbTx_ho_0 2024-09-12T19:23:01.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.102+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:01.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.106+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T19:23:01.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.106+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:01.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.106+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:01.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44227' 2024-09-12T19:23:01.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14987560428467674557', time=2024-09-12T20:21:41.772246+0000, chain.objs.size()=1 2024-09-12T19:23:01.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.157__shadow:igQDODvT2c3MXo8hsKQqodyqR88Chml_.UyaG3VlERwgfM2nImBk5XhVm-cO2Rfg_0 2024-09-12T19:23:01.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='_aDfn9RlNSoKM-v7tESK5nfgZJcf31Ay', time=2024-09-12T20:23:17.258334+0000, chain.objs.size()=2 2024-09-12T19:23:01.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.161__shadow_.fiF1PV1inAthKy7TrBHMPRWCpSE8y_G_0 2024-09-12T19:23:01.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.161__shadow_.fiF1PV1inAthKy7TrBHMPRWCpSE8y_G_1 2024-09-12T19:23:01.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2019596968980875511', time=2024-09-12T20:28:59.451690+0000, chain.objs.size()=1 2024-09-12T19:23:01.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.236__shadow_.ltfIg2EscJWDsEjLKrLLw17dTIlMN9Q_0 2024-09-12T19:23:01.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4674765893572573086', time=2024-09-12T20:29:03.290381+0000, chain.objs.size()=1 2024-09-12T19:23:01.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.237__shadow_.s3JLQvxislCaaQ2l9dm34tdLAz6ooDu_0 2024-09-12T19:23:01.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5374347014347107474', time=2024-09-12T20:29:03.292679+0000, chain.objs.size()=1 2024-09-12T19:23:01.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.237__shadow_.wzn0_LcNfKzxxrAzKTBwb0qf_Tu7fgJ_0 2024-09-12T19:23:01.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2662585519271629418', time=2024-09-12T20:29:37.093216+0000, chain.objs.size()=1 2024-09-12T19:23:01.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.250__shadow_.-Gf6F-72WU-ABkIO3ETOWVYc7BOC-5S_0 2024-09-12T19:23:01.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3918587995360887595', time=2024-09-12T20:29:46.300866+0000, chain.objs.size()=1 2024-09-12T19:23:01.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.254__shadow_.ts8KqtIUHBymXbigNQTx_J_w-1ilk-C_0 2024-09-12T19:23:01.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.362881164799444102', time=2024-09-12T20:31:45.200356+0000, chain.objs.size()=1 2024-09-12T19:23:01.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ZSlTDk0gHbYokQEmRfwZU_AW0eL1b8x_0 2024-09-12T19:23:01.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17940688304222435580', time=2024-09-12T20:31:45.755868+0000, chain.objs.size()=1 2024-09-12T19:23:01.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.zGllot5Ujwi9URfK8UaIuk5qlXapMYl_0 2024-09-12T19:23:01.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10577009321808022304', time=2024-09-12T20:31:46.940904+0000, chain.objs.size()=1 2024-09-12T19:23:01.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.L7ICwwnIetdn1L_Rtk6cj7ooo8SJ1wD_0 2024-09-12T19:23:01.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9724287652337696817', time=2024-09-12T20:31:47.803283+0000, chain.objs.size()=1 2024-09-12T19:23:01.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.110+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.As_f8PB02m1qAmtVJhB7efr568dUTBp_0 2024-09-12T19:23:01.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14410077765256423079', time=2024-09-12T20:31:48.011960+0000, chain.objs.size()=1 2024-09-12T19:23:01.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.GYRsnCeC51MEZUy3iCw0UGQmQoJbNaE_0 2024-09-12T19:23:01.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6896790803671574073', time=2024-09-12T20:31:49.261880+0000, chain.objs.size()=1 2024-09-12T19:23:01.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.eGnHGv_lPrMaXahNeG5e3DEcMK2IDkt_0 2024-09-12T19:23:01.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6842705096366766672', time=2024-09-12T20:31:50.199286+0000, chain.objs.size()=1 2024-09-12T19:23:01.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.2iyoV3L3Wfc48qSDmOo2G6PuJroSKOa_0 2024-09-12T19:23:01.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4778244731927053290', time=2024-09-12T20:31:51.076227+0000, chain.objs.size()=1 2024-09-12T19:23:01.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.hVHfnyhYxpaqDCpD-ldhNpWwfM9p3xV_0 2024-09-12T19:23:01.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4993314232965099309', time=2024-09-12T20:31:51.194814+0000, chain.objs.size()=1 2024-09-12T19:23:01.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.rzU5idkwRgB_AWiUYkrdSEIhXFIP97x_0 2024-09-12T19:23:01.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6867028590596631119', time=2024-09-12T20:31:51.236168+0000, chain.objs.size()=1 2024-09-12T19:23:01.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.RsMfwlbw71LQFpfmlaaJtx-dRd01zqT_0 2024-09-12T19:23:01.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1593888541662117100', time=2024-09-12T20:31:51.370638+0000, chain.objs.size()=1 2024-09-12T19:23:01.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.33RAnENfKsPRTbEc2xUBYVYeimP5dke_0 2024-09-12T19:23:01.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1090176704494336139', time=2024-09-12T20:31:51.989749+0000, chain.objs.size()=1 2024-09-12T19:23:01.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.SB3fkSMKhaK2sqDNo7aqN1ijnV72lJP_0 2024-09-12T19:23:01.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10106592235028049678', time=2024-09-12T20:31:53.861169+0000, chain.objs.size()=1 2024-09-12T19:23:01.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.eoWvmxSk7yHDZBVElDThwjHO1w2A2zn_0 2024-09-12T19:23:01.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3877373246121890650', time=2024-09-12T20:31:53.965532+0000, chain.objs.size()=1 2024-09-12T19:23:01.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.DC2Hk6YP-lJpCbkfS8OjndZPADUvdwm_0 2024-09-12T19:23:01.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3291833601448088663', time=2024-09-12T20:31:54.077242+0000, chain.objs.size()=1 2024-09-12T19:23:01.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.114+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.pqx-G_NfgqD4xHhlJpTJom18s7mPpdY_0 2024-09-12T19:23:01.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10283623475007391704', time=2024-09-12T20:31:57.257848+0000, chain.objs.size()=1 2024-09-12T19:23:01.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.P2kq7VR4n-HBi5H2qhtFe8tmr7UqRJe_0 2024-09-12T19:23:01.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8423882565666800072', time=2024-09-12T20:31:58.382550+0000, chain.objs.size()=1 2024-09-12T19:23:01.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.BvHVJQbFQ3M-bfozYQjgu-YYPTQayIb_0 2024-09-12T19:23:01.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2247603397151181305', time=2024-09-12T20:31:58.532943+0000, chain.objs.size()=1 2024-09-12T19:23:01.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.F5Jg3LUhCt9vbDe_VVIZ9Eiewq1v8ed_0 2024-09-12T19:23:01.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11441736934014138976', time=2024-09-12T20:31:58.902563+0000, chain.objs.size()=1 2024-09-12T19:23:01.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.GOxPdrBXoXW9Ix5lbOCaoZq093CV7Mn_0 2024-09-12T19:23:01.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.723467519204662962', time=2024-09-12T20:32:02.348281+0000, chain.objs.size()=1 2024-09-12T19:23:01.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.WFBzV1Ag654eu-FSWS640BfZVsUo9zd_0 2024-09-12T19:23:01.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12718665915101472320', time=2024-09-12T20:32:03.102399+0000, chain.objs.size()=1 2024-09-12T19:23:01.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.0K2GO3G2BjZQ83bMyrww_PSu0sm7SFe_0 2024-09-12T19:23:01.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4171470443857626106', time=2024-09-12T20:32:04.690572+0000, chain.objs.size()=1 2024-09-12T19:23:01.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.0V7IVqBg_mIGLZwhPmKPooFH10-jFxq_0 2024-09-12T19:23:01.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5408245343359803666', time=2024-09-12T20:32:04.899137+0000, chain.objs.size()=1 2024-09-12T19:23:01.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.UgJDw1o3CpjQR69PPwn7AePjsmIl5q9_0 2024-09-12T19:23:01.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15204493592676464755', time=2024-09-12T20:32:06.306260+0000, chain.objs.size()=1 2024-09-12T19:23:01.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.c8d1ZhKf0SWnR9uosm8vr2arch9Euiq_0 2024-09-12T19:23:01.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4527521608020909832', time=2024-09-12T20:32:06.491002+0000, chain.objs.size()=1 2024-09-12T19:23:01.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.cNDhLCBdEmD9UTtLsFtcXG1VAje2PBd_0 2024-09-12T19:23:01.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14453928496139112923', time=2024-09-12T20:32:06.741765+0000, chain.objs.size()=1 2024-09-12T19:23:01.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.118+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ZMgBYIGqbxfM2J-aLuFfjwS0ggVfsDJ_0 2024-09-12T19:23:01.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6121393046989436047', time=2024-09-12T20:32:07.225996+0000, chain.objs.size()=1 2024-09-12T19:23:01.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.yADDXAoqS2Ks7LFJBrcrgQzPcrm83uI_0 2024-09-12T19:23:01.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14056477536917798148', time=2024-09-12T20:32:08.051547+0000, chain.objs.size()=1 2024-09-12T19:23:01.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.YfyiLdrov8gxzOopAwEueaWdwzkuSlF_0 2024-09-12T19:23:01.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4530557052666400232', time=2024-09-12T20:32:08.953709+0000, chain.objs.size()=1 2024-09-12T19:23:01.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.iQf4C7313JRm1Vvq2f20xrfWkYqfIJO_0 2024-09-12T19:23:01.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.987875935495945346', time=2024-09-12T20:32:09.340075+0000, chain.objs.size()=1 2024-09-12T19:23:01.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.trAZk2EgzWvVLjX2ZoW7H7iw81RXOnF_0 2024-09-12T19:23:01.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5823175964124387933', time=2024-09-12T20:32:11.669363+0000, chain.objs.size()=1 2024-09-12T19:23:01.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.8W59V_1IlORb5_20bUHb11HBxEvslNR_0 2024-09-12T19:23:01.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12653106020533060588', time=2024-09-12T20:32:11.765592+0000, chain.objs.size()=1 2024-09-12T19:23:01.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.WJ-pEBaF4RMyhZCBeuTyyi2mhvQpNnS_0 2024-09-12T19:23:01.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15184272932422332952', time=2024-09-12T20:32:11.882576+0000, chain.objs.size()=1 2024-09-12T19:23:01.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.eib-_IA-bYDhTdIgbbWbs1JKmEPxAIk_0 2024-09-12T19:23:01.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7878468704964701495', time=2024-09-12T20:32:12.216158+0000, chain.objs.size()=1 2024-09-12T19:23:01.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.la8xzc4U69AaVhm5qluUW_lB4wMrKaZ_0 2024-09-12T19:23:01.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10745142086567222647', time=2024-09-12T20:32:13.268118+0000, chain.objs.size()=1 2024-09-12T19:23:01.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.bMVrS34UJUnlTLcav-rbXduqdgwDAm2_0 2024-09-12T19:23:01.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13357502732831195579', time=2024-09-12T20:32:13.397614+0000, chain.objs.size()=1 2024-09-12T19:23:01.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.2WEd7E87EGsSk6xzmGc6mcZeg6aCrel_0 2024-09-12T19:23:01.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3002258949471637883', time=2024-09-12T20:32:13.399399+0000, chain.objs.size()=1 2024-09-12T19:23:01.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.126+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.33Qsih8mBKpZxO9iFCjT0coWZKhdbh__0 2024-09-12T19:23:01.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.130+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4874207222058025735', time=2024-09-12T20:33:12.730511+0000, chain.objs.size()=1 2024-09-12T19:23:01.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.130+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.288__shadow_.k0FDkMV4HBXcKjcWetM72NHW5SF3ef4_0 2024-09-12T19:23:01.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.130+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3648207586469485967', time=2024-09-12T20:33:17.288604+0000, chain.objs.size()=1 2024-09-12T19:23:01.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.130+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.290__shadow_.Npl2199NzJIMLF8UOPw0qW-oX0y14NV_0 2024-09-12T19:23:01.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.130+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10056472134272510962', time=2024-09-12T20:33:25.649733+0000, chain.objs.size()=1 2024-09-12T19:23:01.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.130+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.kFJ3ExS4o3u6b0CpP358v2UUZ2FAz0p_0 2024-09-12T19:23:01.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.130+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14703051455180095301', time=2024-09-12T20:33:33.853911+0000, chain.objs.size()=1 2024-09-12T19:23:01.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.130+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.294__shadow_.2EEFacqUqGPqFQx3jzvmp8DJbybs1Ho_0 2024-09-12T19:23:01.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.130+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12076142925728941995', time=2024-09-12T20:33:38.547257+0000, chain.objs.size()=1 2024-09-12T19:23:01.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.130+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.296__shadow_.E1P972FFMggwcWMsjAo2j09bJcLCbPL_0 2024-09-12T19:23:01.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.130+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.486497606680535881', time=2024-09-12T20:34:44.829476+0000, chain.objs.size()=1 2024-09-12T19:23:01.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.130+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.322__shadow_.Zc_l80SkvUpgSjHUu4fEUoE9ko6Y_QZ_0 2024-09-12T19:23:01.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.130+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9345185347160526567', time=2024-09-12T20:36:27.974430+0000, chain.objs.size()=1 2024-09-12T19:23:01.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.130+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.GW76UNHo13daO8U66VmOiEXGXl7efA6_0 2024-09-12T19:23:01.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.134+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4987016975651350973', time=2024-09-12T20:36:28.482418+0000, chain.objs.size()=1 2024-09-12T19:23:01.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.134+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.bkB7MLCGMj6XwVPUK8KC6rKMphniEq5_0 2024-09-12T19:23:01.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.134+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12120472684505212990', time=2024-09-12T20:36:29.450037+0000, chain.objs.size()=1 2024-09-12T19:23:01.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.134+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.plKdkzhO_QLShHYKWAwDDirLC2gR48l_0 2024-09-12T19:23:01.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.134+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.91789566035488399', time=2024-09-12T20:36:29.916431+0000, chain.objs.size()=1 2024-09-12T19:23:01.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.134+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.3w7vW2BBsq8olLC-CaIZSl9LbsI-Srq_0 2024-09-12T19:23:01.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.134+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12149643325630334422', time=2024-09-12T20:36:30.536151+0000, chain.objs.size()=1 2024-09-12T19:23:01.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.134+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.1xySLdezdjid68EaVLq1TUrFoKPcpAq_0 2024-09-12T19:23:01.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12929974337533426986', time=2024-09-12T20:36:30.756490+0000, chain.objs.size()=1 2024-09-12T19:23:01.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_._O7Jsnv01h1sOeUr3dtj2onvAbF4622_0 2024-09-12T19:23:01.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4527780714688083353', time=2024-09-12T20:36:30.778832+0000, chain.objs.size()=1 2024-09-12T19:23:01.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.nkb7CnkyOPrCO-HoAZfF12lNHhE6WVz_0 2024-09-12T19:23:01.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2418773754056341854', time=2024-09-12T20:36:30.820466+0000, chain.objs.size()=1 2024-09-12T19:23:01.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ke5yxkocG4symtCyDi7BF7G8goOMZli_0 2024-09-12T19:23:01.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12995095029604158452', time=2024-09-12T20:36:30.822663+0000, chain.objs.size()=1 2024-09-12T19:23:01.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.VC33mwghbJ1NP2XINGxdPsjEfQygbKg_0 2024-09-12T19:23:01.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18029329686133635179', time=2024-09-12T20:36:32.249265+0000, chain.objs.size()=1 2024-09-12T19:23:01.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.LBdmX_phrGc76WI4gnDpsgetqkv9WqF_0 2024-09-12T19:23:01.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13130665573560105996', time=2024-09-12T20:36:33.147327+0000, chain.objs.size()=1 2024-09-12T19:23:01.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ZdB-2cpAbpHfJJn0ZWJ0OKkdwAkmrgM_0 2024-09-12T19:23:01.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17196696358677046706', time=2024-09-12T20:36:33.149408+0000, chain.objs.size()=1 2024-09-12T19:23:01.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.xWlRBOJl-0oNvzbjrGLPX1YEehWaDYA_0 2024-09-12T19:23:01.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14877476986829613563', time=2024-09-12T20:36:33.588656+0000, chain.objs.size()=1 2024-09-12T19:23:01.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.VJ4-ikz1Jk8NE1js5jCUvfth5vcptN1_0 2024-09-12T19:23:01.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11822924397706276278', time=2024-09-12T20:36:34.102771+0000, chain.objs.size()=1 2024-09-12T19:23:01.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.AOsfN4QHDlm-9Tt8N0CM2HtVMz6TvIf_0 2024-09-12T19:23:01.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5431790894812999374', time=2024-09-12T20:36:34.452294+0000, chain.objs.size()=1 2024-09-12T19:23:01.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.aTqd5bRII9BzJ0W3jFIWbH_W6k0AVWG_0 2024-09-12T19:23:01.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7396103011563532331', time=2024-09-12T20:36:35.823350+0000, chain.objs.size()=1 2024-09-12T19:23:01.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.138+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.4_zZCYqmH6EWrvZMRnBfdwbxUN-oCpe_0 2024-09-12T19:23:01.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.142+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11029602491984556855', time=2024-09-12T20:36:35.940501+0000, chain.objs.size()=1 2024-09-12T19:23:01.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.142+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.lJ9xWoZ_o6zl1u6fPoMZT5C2GKkTQP9_0 2024-09-12T19:23:01.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.142+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11810332125069269344', time=2024-09-12T20:36:36.525834+0000, chain.objs.size()=1 2024-09-12T19:23:01.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.142+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.wwhUjhQY8xvVfg-taXMVNmtTSSmtYns_0 2024-09-12T19:23:01.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.142+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14399097962662139302', time=2024-09-12T20:36:36.840583+0000, chain.objs.size()=1 2024-09-12T19:23:01.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.142+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.p4w81oV40-oZwa1PcFktjT4m6MgX08v_0 2024-09-12T19:23:01.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.142+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.53106726273247873', time=2024-09-12T20:36:37.198882+0000, chain.objs.size()=1 2024-09-12T19:23:01.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.142+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.fIpm5r6ZISviqlfBtWaV5DXUVtqQ_qb_0 2024-09-12T19:23:01.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.142+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12123939866936792222', time=2024-09-12T20:36:39.582804+0000, chain.objs.size()=1 2024-09-12T19:23:01.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.142+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.vx99jW44EMfx5VikHkrXvkVU3eIX6mI_0 2024-09-12T19:23:01.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.142+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8367148672473208567', time=2024-09-12T20:36:39.584725+0000, chain.objs.size()=1 2024-09-12T19:23:01.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.142+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.PE4f26oVPmT8MKFFHHYUskWxaiNJ3-O_0 2024-09-12T19:23:01.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14181106039927444273', time=2024-09-12T20:36:40.135011+0000, chain.objs.size()=1 2024-09-12T19:23:01.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.v1brqGoy5ZrMk0fMCSuC3P5kB7nL2IP_0 2024-09-12T19:23:01.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17971769692465733216', time=2024-09-12T20:36:40.327552+0000, chain.objs.size()=1 2024-09-12T19:23:01.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.82ydS8K97bOvAuhmFlnf1ky_AmBw6zw_0 2024-09-12T19:23:01.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1072008852808330590', time=2024-09-12T20:36:41.002739+0000, chain.objs.size()=1 2024-09-12T19:23:01.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_._BUALuWbf2Ysf7OETNhDsfquiih16Th_0 2024-09-12T19:23:01.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15525240972532997426', time=2024-09-12T20:36:41.594107+0000, chain.objs.size()=1 2024-09-12T19:23:01.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.YZ4N5-qpzk5n836-dG0xJ2SCS0o_yFr_0 2024-09-12T19:23:01.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7191673065295463610', time=2024-09-12T20:36:42.321740+0000, chain.objs.size()=1 2024-09-12T19:23:01.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.rzx1fVKMHj9XZB4YIaRY57ohB1R_kFe_0 2024-09-12T19:23:01.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5037709615060213078', time=2024-09-12T20:36:43.218524+0000, chain.objs.size()=1 2024-09-12T19:23:01.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.6XhmxcGsLcBP-6Kgd8bQGc0QyOvSnAx_0 2024-09-12T19:23:01.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2685852494818561513', time=2024-09-12T20:36:43.627831+0000, chain.objs.size()=1 2024-09-12T19:23:01.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.VBIzDcK3cXLcjV4TzicErPmMoJKlpF2_0 2024-09-12T19:23:01.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5654096033552805645', time=2024-09-12T20:36:43.697301+0000, chain.objs.size()=1 2024-09-12T19:23:01.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.nwNooJ_Y15XP_C1Lf69Rg1Bm5KuhfF5_0 2024-09-12T19:23:01.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6258000047679067211', time=2024-09-12T20:36:44.788834+0000, chain.objs.size()=1 2024-09-12T19:23:01.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.atxEvAR2VzwZI3Hgg4WC4JEdvNcEi0L_0 2024-09-12T19:23:01.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11632023206072842761', time=2024-09-12T20:36:46.980790+0000, chain.objs.size()=1 2024-09-12T19:23:01.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.u_T5o8fg8mdCbOezFr6LwdQPdIc5APx_0 2024-09-12T19:23:01.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4701340728492476343', time=2024-09-12T20:36:47.469291+0000, chain.objs.size()=1 2024-09-12T19:23:01.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.146+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.CE27NrtJELBS5kqv6Ri0GSWulehQ5a1_0 2024-09-12T19:23:01.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.897314705359649729', time=2024-09-12T20:36:49.642916+0000, chain.objs.size()=1 2024-09-12T19:23:01.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.XL_10mP9q4PvRoVduMZa3NAWiSdyE5C_0 2024-09-12T19:23:01.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10538103885033809710', time=2024-09-12T20:36:50.624980+0000, chain.objs.size()=1 2024-09-12T19:23:01.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.T2PPvVNi8z6iwI-tJvV8YADPCp361Va_0 2024-09-12T19:23:01.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9330453174074488352', time=2024-09-12T20:36:51.597847+0000, chain.objs.size()=1 2024-09-12T19:23:01.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.YzeibrH_9dY8Bf7ggDF0hgiCnjioQm3_0 2024-09-12T19:23:01.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10138568684280221314', time=2024-09-12T20:36:51.702760+0000, chain.objs.size()=1 2024-09-12T19:23:01.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.EfVuepI77uNpEXd-UVHyIBDtpeXi0_F_0 2024-09-12T19:23:01.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10776005875032119152', time=2024-09-12T20:36:52.653097+0000, chain.objs.size()=1 2024-09-12T19:23:01.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.zAn2B-Q6Gv600tku0Az9B7BHPNHwBQ4_0 2024-09-12T19:23:01.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14778979677358770884', time=2024-09-12T20:36:52.835897+0000, chain.objs.size()=1 2024-09-12T19:23:01.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ooFJAlb1YowGRZ4v5WOYuknvi_sAL9X_0 2024-09-12T19:23:01.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2901335615181391209', time=2024-09-12T20:36:54.503307+0000, chain.objs.size()=1 2024-09-12T19:23:01.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.orWmDlwY-1MIXTjZVmKJ5l9l0IPUWcU_0 2024-09-12T19:23:01.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12173603151395951972', time=2024-09-12T20:36:55.015576+0000, chain.objs.size()=1 2024-09-12T19:23:01.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.NKZG84jmAa6a4neITSp0NGxgpimNdoC_0 2024-09-12T19:23:01.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17442088800190867568', time=2024-09-12T20:36:56.312383+0000, chain.objs.size()=1 2024-09-12T19:23:01.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.N8PJ47siDExImJDbxe3WUMnCsnCANuM_0 2024-09-12T19:23:01.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3033458040067280802', time=2024-09-12T20:38:39.781429+0000, chain.objs.size()=1 2024-09-12T19:23:01.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.oM7D3__PahzMy2CDqzYyeM_IE5BQa7i_0 2024-09-12T19:23:01.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4877239144802773215', time=2024-09-12T20:38:41.004708+0000, chain.objs.size()=1 2024-09-12T19:23:01.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.150+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.a8OSj4v7dISxGV7YZYpfPLsVNEhmb7H_0 2024-09-12T19:23:01.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.158+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7902226377922676343', time=2024-09-12T20:38:41.611996+0000, chain.objs.size()=1 2024-09-12T19:23:01.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.158+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ZMYyFqlzaKRrr1sdEBZye-78IBRUeKu_0 2024-09-12T19:23:01.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.158+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15327352628327736640', time=2024-09-12T20:38:41.668671+0000, chain.objs.size()=1 2024-09-12T19:23:01.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.158+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ly0wVYIzWhrlLAiOs0GPsCOK0Yjj7f2_0 2024-09-12T19:23:01.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.158+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15722791102596897530', time=2024-09-12T20:38:42.660445+0000, chain.objs.size()=1 2024-09-12T19:23:01.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.158+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.RlpDSiLmIwL6pw668I8NzfsjALtkSGY_0 2024-09-12T19:23:01.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.158+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5037003978623830461', time=2024-09-12T20:38:43.720046+0000, chain.objs.size()=1 2024-09-12T19:23:01.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.158+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.yB2bV0dYkTX4aaMSBscP1gZsVHu5AOr_0 2024-09-12T19:23:01.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.158+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8483287779771539044', time=2024-09-12T20:38:44.098760+0000, chain.objs.size()=1 2024-09-12T19:23:01.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.158+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.PTSUjKYo3Yx6HRQPWqFdc10HIuWB99y_0 2024-09-12T19:23:01.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.158+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7655786125840260044', time=2024-09-12T20:38:44.897931+0000, chain.objs.size()=1 2024-09-12T19:23:01.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.158+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.coS1PTsCOAlNAF-dabY3TqLsMgwbH4d_0 2024-09-12T19:23:01.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.162+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44227 2024-09-12T19:23:01.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-09-12T19:23:01.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11888659032239064973', time=2024-09-12T20:38:45.373663+0000, chain.objs.size()=1 2024-09-12T19:23:01.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ROWFTOB2esj1phjWgqZHdCwhdEBwis0_0 2024-09-12T19:23:01.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15133232574035105187', time=2024-09-12T20:38:46.068475+0000, chain.objs.size()=1 2024-09-12T19:23:01.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.4lxS590BIRHL0Grt1vLgMAGSOlegFpd_0 2024-09-12T19:23:01.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12171251541762262139', time=2024-09-12T20:38:46.407877+0000, chain.objs.size()=1 2024-09-12T19:23:01.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.x9zf2-HYMs19sFRKCUhk-ZXBMHlXd51_0 2024-09-12T19:23:01.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7961943610958250303', time=2024-09-12T20:38:48.152203+0000, chain.objs.size()=1 2024-09-12T19:23:01.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.HyRCb4dvjQLyK4wcDbyMXZsBt6I1azq_0 2024-09-12T19:23:01.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6757289696078766704', time=2024-09-12T20:38:48.247428+0000, chain.objs.size()=1 2024-09-12T19:23:01.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.s-b9OvC-hPna7psHshKNwbA5EMgGVrf_0 2024-09-12T19:23:01.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7422412026729845989', time=2024-09-12T20:38:48.476220+0000, chain.objs.size()=1 2024-09-12T19:23:01.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.HTZo7g8TuBSN6BcnYIrI3aNBG9lp2rt_0 2024-09-12T19:23:01.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13700668170568036762', time=2024-09-12T20:38:51.382816+0000, chain.objs.size()=1 2024-09-12T19:23:01.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.pONBHcdzPtSYG2V5wjhW-ST6dndWTGD_0 2024-09-12T19:23:01.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2736757384582196326', time=2024-09-12T20:38:51.385209+0000, chain.objs.size()=1 2024-09-12T19:23:01.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.xXkufuZcQxokeTPFtxzUTpISFNyV_Gk_0 2024-09-12T19:23:01.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2516202007736607567', time=2024-09-12T20:38:52.310506+0000, chain.objs.size()=1 2024-09-12T19:23:01.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.gRdxtM2FFZ4suCaTtl7NARmOzHAhGid_0 2024-09-12T19:23:01.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7812526855965702377', time=2024-09-12T20:38:52.935446+0000, chain.objs.size()=1 2024-09-12T19:23:01.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.PIiJam8lYYCRfD0ZUkDLSqFHpMTg4aF_0 2024-09-12T19:23:01.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.924033184437353703', time=2024-09-12T20:38:53.137454+0000, chain.objs.size()=1 2024-09-12T19:23:01.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.DBVTt8gpl0dEQ4DkBdjE43kCB-bptSi_0 2024-09-12T19:23:01.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17683532168761424198', time=2024-09-12T20:38:53.535732+0000, chain.objs.size()=1 2024-09-12T19:23:01.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.lxPB1ZE8U4puDqwJ1sCmCXQ5ra3HECp_0 2024-09-12T19:23:01.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8009767361561772588', time=2024-09-12T20:38:53.662594+0000, chain.objs.size()=1 2024-09-12T19:23:01.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.166+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.XFpUvQazoqbG3gFhyKVbQWZxUnS4sDe_0 2024-09-12T19:23:01.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.170+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16592418544179417795', time=2024-09-12T20:38:56.251186+0000, chain.objs.size()=1 2024-09-12T19:23:01.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.170+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Lr22W8Ts8CGQcml8kHWcg_N_p1SAuKz_0 2024-09-12T19:23:01.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.170+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13537496990855733321', time=2024-09-12T20:38:57.545025+0000, chain.objs.size()=1 2024-09-12T19:23:01.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.170+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.KADqt1o5_zexInROFQeHBtI6S2weMI3_0 2024-09-12T19:23:01.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.170+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9500748735932549862', time=2024-09-12T20:38:57.810509+0000, chain.objs.size()=1 2024-09-12T19:23:01.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.170+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.5BQcbXfQL6mqq7bLn5jFsIOX0ohKbD-_0 2024-09-12T19:23:01.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.170+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17792631859769419551', time=2024-09-12T20:39:00.209688+0000, chain.objs.size()=1 2024-09-12T19:23:01.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.170+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.gT_fJT5nF9SLe23hB6txTzl7NQzCfGL_0 2024-09-12T19:23:01.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.170+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11412317028216420122', time=2024-09-12T20:39:00.479979+0000, chain.objs.size()=1 2024-09-12T19:23:01.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.170+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Qb9ULRqhZ4eyhvWu6DUJ07sY-Wd-emE_0 2024-09-12T19:23:01.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.170+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6991432061328774668', time=2024-09-12T20:39:01.001690+0000, chain.objs.size()=1 2024-09-12T19:23:01.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.170+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.KTb5snvi255VnL3nC-pzHL2wPEYGCBk_0 2024-09-12T19:23:01.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.170+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15268893987325220973', time=2024-09-12T20:39:02.970423+0000, chain.objs.size()=1 2024-09-12T19:23:01.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.170+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.HP8GynCiYihuwgpa-FcIFsZNSJA_9CZ_0 2024-09-12T19:23:01.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.170+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1011985261653115750', time=2024-09-12T20:39:03.099641+0000, chain.objs.size()=1 2024-09-12T19:23:01.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.170+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.6bz2hhrHhmBP0RYy9SEOcvsxWJ7UNR5_0 2024-09-12T19:23:01.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.170+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14358330381000019606', time=2024-09-12T20:39:04.354778+0000, chain.objs.size()=1 2024-09-12T19:23:01.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.170+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.XdEWICIxWKG-2yE5qJ4RbIF_XT672CA_0 2024-09-12T19:23:01.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.170+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14190248784734096088', time=2024-09-12T20:39:04.743359+0000, chain.objs.size()=1 2024-09-12T19:23:01.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.170+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.v-OKctVQL4daqSMlsZaeHJqLdNflgD8_0 2024-09-12T19:23:01.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2757617901186351709', time=2024-09-12T20:39:06.754379+0000, chain.objs.size()=1 2024-09-12T19:23:01.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.7RiZivNN4BODPUDLxDQu6eawObLdTXS_0 2024-09-12T19:23:01.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17493756823568030426', time=2024-09-12T20:39:07.348890+0000, chain.objs.size()=1 2024-09-12T19:23:01.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.tIxmqr2XcFHOi-kn25zpq3G4npuH3DR_0 2024-09-12T19:23:01.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3034684889896143302', time=2024-09-12T20:39:07.350397+0000, chain.objs.size()=1 2024-09-12T19:23:01.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.R-x3PdAX2PAW_vMOMRgtVUICrWdYFQI_0 2024-09-12T19:23:01.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13020815015461186940', time=2024-09-12T20:39:07.836514+0000, chain.objs.size()=1 2024-09-12T19:23:01.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.MT1T8gH4igGQ_p5xTyOQ0PNDeg5DXee_0 2024-09-12T19:23:01.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11057307891403011904', time=2024-09-12T20:40:47.144205+0000, chain.objs.size()=1 2024-09-12T19:23:01.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.375__shadow_.U0f4aHfzRcxHvPomUQssqop7KpD-z46_0 2024-09-12T19:23:01.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9734314200955848006', time=2024-09-12T20:42:40.679478+0000, chain.objs.size()=1 2024-09-12T19:23:01.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.431__shadow_.AD-C3x-WaK1xvEA4GZOMqg8XYEzzTrX_0 2024-09-12T19:23:01.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4826646978350121974', time=2024-09-12T20:44:07.375723+0000, chain.objs.size()=1 2024-09-12T19:23:01.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.466__shadow_.wBYwJ7KecDAQ5yAmGggq8P4THhGFQIt_0 2024-09-12T19:23:01.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17595764718602124726', time=2024-09-12T20:45:22.292428+0000, chain.objs.size()=1 2024-09-12T19:23:01.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.503__shadow:tE2u4PreZ1ptztujaTdnj2An4nygGJX_.ADvFvlMdDhiFGZmRgRvM9GmBz7MDjzE_0 2024-09-12T19:23:01.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15369928905739005527', time=2024-09-12T20:45:23.547345+0000, chain.objs.size()=1 2024-09-12T19:23:01.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.503__shadow:tE2u4PreZ1ptztujaTdnj2An4nygGJX_.ADvFvlMdDhiFGZmRgRvM9GmBz7MDjzE_0 2024-09-12T19:23:01.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17026066476095928997', time=2024-09-12T20:55:41.103792+0000, chain.objs.size()=1 2024-09-12T19:23:01.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.555__shadow_.ynlRW1ruRiQCHVEyytx7s16Kl4po7R5_0 2024-09-12T19:23:01.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13653989082803557020', time=2024-09-12T20:56:55.740554+0000, chain.objs.size()=1 2024-09-12T19:23:01.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.174+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:WnRI8jKz33V6xPSzaYPWgw88QMieUfW_.WuuqKoU_3NNRVxqCUueqeYk2VhO31GM_0 2024-09-12T19:23:01.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.178+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15184863190101877238', time=2024-09-12T20:57:17.967818+0000, chain.objs.size()=1 2024-09-12T19:23:01.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.178+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.573__shadow_.7Dk_VQtdclh0SJw3prjuNOb0kAoWnS9_0 2024-09-12T19:23:01.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.178+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.930299348092043052', time=2024-09-12T20:57:49.897105+0000, chain.objs.size()=1 2024-09-12T19:23:01.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.178+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:wvPPVZwxt0aet1Gre.3pSo.3JQugixH_.pZd19AbWrN2cjuu7B9_Gmh6k3uOo2Xl_0 2024-09-12T19:23:01.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.178+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11109543030994854326', time=2024-09-12T20:58:14.033728+0000, chain.objs.size()=1 2024-09-12T19:23:01.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.178+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:qG3SodmhhADUoIJCUb4MkGMPHItVQgJ_.rBmnsmfrQmqOI2SW-N9g1hAg02-hhPX_0 2024-09-12T19:23:01.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.178+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11007183978834152307', time=2024-09-12T20:58:26.105313+0000, chain.objs.size()=1 2024-09-12T19:23:01.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.178+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:LNOZTpgrvIsXQ9-4RBBfjxg7wL38WIe_.wreBIVyhKFP1WMfMFWhzEqXwQm3D9Hb_0 2024-09-12T19:23:01.190 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.186+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:01.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.186+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T19:23:01.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.186+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:01.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:01.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47374' 2024-09-12T19:23:01.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='_v_ul5AZUrXqOfSVPWbFx524Epf6f6LO', time=2024-09-12T20:22:23.298619+0000, chain.objs.size()=1 2024-09-12T19:23:01.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.160__shadow_.FOQBx8dck12EdyrkwxR9_D4y6XmoJ6Z_0 2024-09-12T19:23:01.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10137169188299923526', time=2024-09-12T20:23:37.057970+0000, chain.objs.size()=2 2024-09-12T19:23:01.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.164__multipart_foo.2~H0dS-KpPn6dEaS3AeNk44gCk-rymL-7.1 2024-09-12T19:23:01.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.164__multipart_foo.2~H0dS-KpPn6dEaS3AeNk44gCk-rymL-7.2 2024-09-12T19:23:01.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6817195962841732795', time=2024-09-12T20:28:52.463377+0000, chain.objs.size()=1 2024-09-12T19:23:01.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.233__shadow_.njr156P560QMMxX_Hcg7rV5-7Uev8yb_0 2024-09-12T19:23:01.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1986193739755150722', time=2024-09-12T20:29:03.285815+0000, chain.objs.size()=1 2024-09-12T19:23:01.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.237__shadow_.gJkLwPGE4mMzKZRyuu70TOsz3RGOowQ_0 2024-09-12T19:23:01.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5267258947143584353', time=2024-09-12T20:29:55.353073+0000, chain.objs.size()=1 2024-09-12T19:23:01.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.258__shadow_.NgMr8jD16hwczDGMk_Bf9UWjw0lVFb5_0 2024-09-12T19:23:01.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11888166107870052459', time=2024-09-12T20:29:59.830702+0000, chain.objs.size()=1 2024-09-12T19:23:01.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.260__shadow_.xQG8F-_aUi4OGSgGYyUyh8BAkOiqYFJ_0 2024-09-12T19:23:01.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4241408733217398083', time=2024-09-12T20:31:45.315729+0000, chain.objs.size()=1 2024-09-12T19:23:01.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.YHEa2xAOsvlhaZ1BIbsGBdIGhCKpMpi_0 2024-09-12T19:23:01.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17608233181395531657', time=2024-09-12T20:31:45.644854+0000, chain.objs.size()=1 2024-09-12T19:23:01.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.jyG-khhwxmRFEtM2-mLJjEbARHITnev_0 2024-09-12T19:23:01.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10646762080013640993', time=2024-09-12T20:31:46.152329+0000, chain.objs.size()=1 2024-09-12T19:23:01.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.KZCH9Be9jUScpL1Wx19qltF5bkzSFEq_0 2024-09-12T19:23:01.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1419931373418930391', time=2024-09-12T20:31:47.090519+0000, chain.objs.size()=1 2024-09-12T19:23:01.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.iPmt1vK9vBH9GMtphy8HZkpcE_azbkh_0 2024-09-12T19:23:01.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1511419773990873264', time=2024-09-12T20:31:47.199895+0000, chain.objs.size()=1 2024-09-12T19:23:01.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.t7rX6o81Yr3FPzkOtSBzhLxBIZoKcI8_0 2024-09-12T19:23:01.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11724225047097814453', time=2024-09-12T20:31:48.120869+0000, chain.objs.size()=1 2024-09-12T19:23:01.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.190+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.oZ6c3DN2Rj5kx19RLUINAldu6sY8i32_0 2024-09-12T19:23:01.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7875020704007168459', time=2024-09-12T20:31:49.687445+0000, chain.objs.size()=1 2024-09-12T19:23:01.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.EJg1ye56ms3IIDcaSgNsOkq-hu-g53y_0 2024-09-12T19:23:01.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9145120191268431529', time=2024-09-12T20:31:49.942501+0000, chain.objs.size()=1 2024-09-12T19:23:01.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.9a1rY3aZ7UFqGyQ5JSe85f7sA6sGY7-_0 2024-09-12T19:23:01.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15589202843294216526', time=2024-09-12T20:31:51.197462+0000, chain.objs.size()=1 2024-09-12T19:23:01.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.1KtxmYIPQkTKITB-_8Pz6Trchq2lf91_0 2024-09-12T19:23:01.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13365327279582215633', time=2024-09-12T20:31:51.800386+0000, chain.objs.size()=1 2024-09-12T19:23:01.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.aL3fyRYrIjieJJ85U8ZDdRj1-UqC9OB_0 2024-09-12T19:23:01.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3797885067344565782', time=2024-09-12T20:31:53.100850+0000, chain.objs.size()=1 2024-09-12T19:23:01.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.wQY0Kn7rgqfvndOoON7q5mtdskVNw7s_0 2024-09-12T19:23:01.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2854604712525981483', time=2024-09-12T20:31:53.102126+0000, chain.objs.size()=1 2024-09-12T19:23:01.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.G47PJ24S-Ib-zYlHv01gYzaXNut-kxH_0 2024-09-12T19:23:01.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4723002380878176059', time=2024-09-12T20:31:53.192506+0000, chain.objs.size()=1 2024-09-12T19:23:01.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.twRKhKJJHq1pYOW-5V94iX5Oxe2zcy-_0 2024-09-12T19:23:01.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17963889974280591945', time=2024-09-12T20:31:54.280161+0000, chain.objs.size()=1 2024-09-12T19:23:01.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.l3TeVngW68QIvFLZTCw74HWTg9Xl4Qb_0 2024-09-12T19:23:01.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10676847006571691681', time=2024-09-12T20:31:55.800356+0000, chain.objs.size()=1 2024-09-12T19:23:01.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.C8HXFu1gue_AGyYi4r_SiXmf5PGoVFT_0 2024-09-12T19:23:01.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.194+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16391081778106518379', time=2024-09-12T20:31:55.803927+0000, chain.objs.size()=1 2024-09-12T19:23:01.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.194+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.vFIrj6SjPnevIet2-3d-zN6ulFh-RjC_0 2024-09-12T19:23:01.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14504147373325504633', time=2024-09-12T20:31:55.860608+0000, chain.objs.size()=1 2024-09-12T19:23:01.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.rJWKZ0spimuCsTqoL-fVTR9alx4T6ui_0 2024-09-12T19:23:01.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18006748716721461634', time=2024-09-12T20:31:57.291360+0000, chain.objs.size()=1 2024-09-12T19:23:01.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.kAUkexw_mo58OGeEcktqcqjFARrwKjp_0 2024-09-12T19:23:01.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11331418167128920983', time=2024-09-12T20:31:57.666679+0000, chain.objs.size()=1 2024-09-12T19:23:01.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.KC01q09o3HAsJaywZSSV-ndslVxpY2N_0 2024-09-12T19:23:01.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1433814792048396257', time=2024-09-12T20:31:58.909302+0000, chain.objs.size()=1 2024-09-12T19:23:01.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.eqHYbMoigkMkAzOXmXxO3wf62DYuhDJ_0 2024-09-12T19:23:01.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7134770576136307981', time=2024-09-12T20:31:59.431567+0000, chain.objs.size()=1 2024-09-12T19:23:01.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.MCH7Luy491_1ZLLVKlaTNsvmpZXQ7xm_0 2024-09-12T19:23:01.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11387541038461088145', time=2024-09-12T20:32:02.655515+0000, chain.objs.size()=1 2024-09-12T19:23:01.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.QhZg-V2LyODXYRReWh15b-xGUnQC97l_0 2024-09-12T19:23:01.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10313607911429227904', time=2024-09-12T20:32:03.536025+0000, chain.objs.size()=1 2024-09-12T19:23:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.zLe-sOiyYLD0pv4mYebNmTg_Q_Pw4Jd_0 2024-09-12T19:23:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17301052515391624612', time=2024-09-12T20:32:04.417304+0000, chain.objs.size()=1 2024-09-12T19:23:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.B50WVl7PDgttUSQ-sFXUSo-HZI8zepc_0 2024-09-12T19:23:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14214952133139104887', time=2024-09-12T20:32:04.995964+0000, chain.objs.size()=1 2024-09-12T19:23:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.au6fkFtD-r5Yxr7FV59BrhNrm1vXCQM_0 2024-09-12T19:23:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17175740312662723265', time=2024-09-12T20:32:05.557067+0000, chain.objs.size()=1 2024-09-12T19:23:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.SfeBGG94YMG3Sxu8-LJl45ZjgF71Ei2_0 2024-09-12T19:23:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4319090340123538583', time=2024-09-12T20:32:05.761287+0000, chain.objs.size()=1 2024-09-12T19:23:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.RSSqd5Y1HmcFoVFBwDbkhjqWA3YtHmG_0 2024-09-12T19:23:01.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.980583423392187842', time=2024-09-12T20:32:06.042525+0000, chain.objs.size()=1 2024-09-12T19:23:01.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.198+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.7PxAflFOM31htxHfbTZcxV4XvulsBVE_0 2024-09-12T19:23:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.202+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4958806144821261944', time=2024-09-12T20:32:06.278140+0000, chain.objs.size()=1 2024-09-12T19:23:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.zVibOWoq9uaw7wZWcT_mAHNrcd-7FdF_0 2024-09-12T19:23:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.202+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16448370422207164268', time=2024-09-12T20:32:07.194361+0000, chain.objs.size()=1 2024-09-12T19:23:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.LXxi4Un20hx2YJ7WqW1NIZo3enQ0mC8_0 2024-09-12T19:23:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.202+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12888656583435201896', time=2024-09-12T20:32:07.977603+0000, chain.objs.size()=1 2024-09-12T19:23:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.202+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.pTymYvZJknLRNaJQ20vdmdFzn9mTRYs_0 2024-09-12T19:23:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.206+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12566049092373691114', time=2024-09-12T20:32:08.454564+0000, chain.objs.size()=1 2024-09-12T19:23:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.206+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.84A8hYplDNNi1nQlKyf1QTm1jPYimmD_0 2024-09-12T19:23:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.206+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16319163680161502171', time=2024-09-12T20:32:09.805382+0000, chain.objs.size()=1 2024-09-12T19:23:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.206+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.lckDTGnHwWKGK8D7q7m0jk-8T4GEeFx_0 2024-09-12T19:23:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.206+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11488004045291698392', time=2024-09-12T20:32:10.110484+0000, chain.objs.size()=1 2024-09-12T19:23:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.206+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.0Nerm6MPVoEMu_PaWx1jPDyDiHr8GAd_0 2024-09-12T19:23:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.206+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3406327332554254664', time=2024-09-12T20:32:10.399845+0000, chain.objs.size()=1 2024-09-12T19:23:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.206+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.DLSmf5bjIw14J41gHrgsON1tIR2uavN_0 2024-09-12T19:23:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.206+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1709369525971587585', time=2024-09-12T20:32:10.573967+0000, chain.objs.size()=1 2024-09-12T19:23:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.206+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.TCMWzML52U8Nr5wUfmUQijhrrS-7f_W_0 2024-09-12T19:23:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.206+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9812532667942768947', time=2024-09-12T20:32:12.155344+0000, chain.objs.size()=1 2024-09-12T19:23:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.206+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.nxxvazv7WIJ7YrHN1NAlYkIVYYfokgt_0 2024-09-12T19:23:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.206+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2629313719221145488', time=2024-09-12T20:32:12.725047+0000, chain.objs.size()=1 2024-09-12T19:23:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.206+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.MaonBm8MCge4xAnhkK12aA5wuIwsFKT_0 2024-09-12T19:23:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.206+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1686553199099750246', time=2024-09-12T20:32:13.754131+0000, chain.objs.size()=1 2024-09-12T19:23:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.206+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.K9wmiU3jHFgPRu6ZRUYKou7NifGSZao_0 2024-09-12T19:23:01.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5028981376496015223', time=2024-09-12T20:32:13.795741+0000, chain.objs.size()=1 2024-09-12T19:23:01.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.sw3DyHsLO0uzsk9P0k-3lR2j80aT9Av_0 2024-09-12T19:23:01.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17096672139876512490', time=2024-09-12T20:32:13.941850+0000, chain.objs.size()=1 2024-09-12T19:23:01.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.PzdnrwwvuBGyHyzu8Tbety3vQiiaAk4_0 2024-09-12T19:23:01.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3768582685656637806', time=2024-09-12T20:32:18.436006+0000, chain.objs.size()=1 2024-09-12T19:23:01.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.264__shadow_.tDevD5c5zoOTaPYW57atBHxX9-rXJ9v_0 2024-09-12T19:23:01.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1426872139980972860', time=2024-09-12T20:32:24.982285+0000, chain.objs.size()=1 2024-09-12T19:23:01.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.267__shadow_.necsgZM7CDRdFiqWrTBV9W0LciTKjw2_0 2024-09-12T19:23:01.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14584502592525792757', time=2024-09-12T20:32:44.892624+0000, chain.objs.size()=1 2024-09-12T19:23:01.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.276__shadow_.QDN1AwshwMllVeJIPf1idxnsJjOfy1W_0 2024-09-12T19:23:01.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8604147357208421748', time=2024-09-12T20:33:03.257979+0000, chain.objs.size()=1 2024-09-12T19:23:01.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.284__shadow_.vcrowyz1jzouyiFCBCy0IeBlpYXsfOB_0 2024-09-12T19:23:01.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1198163612307513734', time=2024-09-12T20:33:25.424332+0000, chain.objs.size()=1 2024-09-12T19:23:01.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.GAcGSh7f9yDVPQnPeMw8fNDWFs8wHUy_0 2024-09-12T19:23:01.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7360198685197567573', time=2024-09-12T20:33:25.517634+0000, chain.objs.size()=1 2024-09-12T19:23:01.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.8ML07s3B8Hb_S9seIbJeZTz9zyHvyi2_0 2024-09-12T19:23:01.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1436996402017236002', time=2024-09-12T20:33:40.825459+0000, chain.objs.size()=1 2024-09-12T19:23:01.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.297__shadow_.EMhHnRNQWptqNAQxvKlDYTJXibQ5Tuo_0 2024-09-12T19:23:01.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17669788015536352188', time=2024-09-12T20:33:57.208678+0000, chain.objs.size()=1 2024-09-12T19:23:01.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.304__shadow_.QU99VDDPs9XAgG4X4yD0W5X09aYC2Fq_0 2024-09-12T19:23:01.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9955546903739364289', time=2024-09-12T20:36:28.486476+0000, chain.objs.size()=1 2024-09-12T19:23:01.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.210+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.UyDcCwmC7M4LkyWtln-rZpH4Af1MzD0_0 2024-09-12T19:23:01.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.214+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3280664393608851192', time=2024-09-12T20:36:32.312996+0000, chain.objs.size()=1 2024-09-12T19:23:01.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.214+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.xmjfBGA6NiYbDSNXoVbLlU-zzkrdGOo_0 2024-09-12T19:23:01.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.214+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13247278095185833482', time=2024-09-12T20:36:33.471787+0000, chain.objs.size()=1 2024-09-12T19:23:01.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.214+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.NMguTtbr6-nPefMP9At-WzUoWla9sv6_0 2024-09-12T19:23:01.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.214+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13285938094133255900', time=2024-09-12T20:36:34.221692+0000, chain.objs.size()=1 2024-09-12T19:23:01.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.214+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.L_bUrQXFcF-tTrVQxfl4RSxPOHhejRD_0 2024-09-12T19:23:01.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.214+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13794496966526303902', time=2024-09-12T20:36:35.771147+0000, chain.objs.size()=1 2024-09-12T19:23:01.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.214+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.1V3e62OkOCm0im_SUqz7AUQUFfq1LJo_0 2024-09-12T19:23:01.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.214+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9693664063945985621', time=2024-09-12T20:36:36.702319+0000, chain.objs.size()=1 2024-09-12T19:23:01.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.214+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.gwv2pLclBbr6TE8VB3DoCyzXuSEKx5f_0 2024-09-12T19:23:01.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.218+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1409130406072387448', time=2024-09-12T20:36:37.060651+0000, chain.objs.size()=1 2024-09-12T19:23:01.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.218+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.itwO-TfzlFeM79J4ucKSkG0esEYER6O_0 2024-09-12T19:23:01.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.218+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1225889926232880550', time=2024-09-12T20:36:37.511225+0000, chain.objs.size()=1 2024-09-12T19:23:01.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.218+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.TLNjopaIC1cyrwcibYLy47MOsvI_WEe_0 2024-09-12T19:23:01.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.218+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12416224209215017832', time=2024-09-12T20:36:37.738141+0000, chain.objs.size()=1 2024-09-12T19:23:01.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.218+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ipdA2_9JMNjt_a4Lp2VEVyoUkgbdWhj_0 2024-09-12T19:23:01.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.218+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10083248342457392482', time=2024-09-12T20:36:38.451644+0000, chain.objs.size()=1 2024-09-12T19:23:01.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.218+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ARlBamlLUNkt2CH8UVpFydAkpDPjCXM_0 2024-09-12T19:23:01.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.218+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15205324293096745539', time=2024-09-12T20:36:39.632850+0000, chain.objs.size()=1 2024-09-12T19:23:01.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.218+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.MA-l3-jIDy6YNbUsRxSFvyJRR2BwZvd_0 2024-09-12T19:23:01.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.218+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12750911392472893531', time=2024-09-12T20:36:40.522170+0000, chain.objs.size()=1 2024-09-12T19:23:01.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.218+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.bvOXk8YkeWg8nzGSzhK761iNzaJ-fOG_0 2024-09-12T19:23:01.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.218+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10588193843473006924', time=2024-09-12T20:36:41.264795+0000, chain.objs.size()=1 2024-09-12T19:23:01.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.218+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.opFC1fa6A_-UlVbsA04HJL5WM_bcD-__0 2024-09-12T19:23:01.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.218+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1083353011067006224', time=2024-09-12T20:36:41.338699+0000, chain.objs.size()=1 2024-09-12T19:23:01.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.218+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.aAW2Gqa0alII5BEqDobQ-4tN3bYYp7B_0 2024-09-12T19:23:01.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.218+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18432533562843840050', time=2024-09-12T20:36:43.522483+0000, chain.objs.size()=1 2024-09-12T19:23:01.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.218+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.5MOCLL_4ISQMpMGYBkDoUPMkCiuZxK1_0 2024-09-12T19:23:01.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.222+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1771567407648104854', time=2024-09-12T20:36:45.605724+0000, chain.objs.size()=1 2024-09-12T19:23:01.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.222+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.vyXzxZgrhy4_LRqweiHTRrficVY4314_0 2024-09-12T19:23:01.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.222+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4883494723427729727', time=2024-09-12T20:36:47.347813+0000, chain.objs.size()=1 2024-09-12T19:23:01.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.222+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Z5CJkMaOfUhmpCL7BR5DymYiK0Qkgm6_0 2024-09-12T19:23:01.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.222+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14465658547344206745', time=2024-09-12T20:36:47.513744+0000, chain.objs.size()=1 2024-09-12T19:23:01.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.222+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.hIlebsOafXAC91UBui_XZHpcby3Nuhw_0 2024-09-12T19:23:01.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.222+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2285367555547065284', time=2024-09-12T20:36:48.490195+0000, chain.objs.size()=1 2024-09-12T19:23:01.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.222+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.LEuTb-8PBz-F2Al5Ozij-9q8QSuckMA_0 2024-09-12T19:23:01.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.222+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.517362144623073677', time=2024-09-12T20:36:49.350674+0000, chain.objs.size()=1 2024-09-12T19:23:01.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.222+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.TjVKqzJ8UVOHnRw2Eg_DqJcf9iJsa2Y_0 2024-09-12T19:23:01.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.222+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9198327442037884332', time=2024-09-12T20:36:50.858891+0000, chain.objs.size()=1 2024-09-12T19:23:01.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.222+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.y-kMqN2-iy2bf5ptDc2D3wacRsu97QH_0 2024-09-12T19:23:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.226+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6436012096212854268', time=2024-09-12T20:36:51.201553+0000, chain.objs.size()=1 2024-09-12T19:23:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.226+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.mflImZevg-UqW2nUbyWyID0URpf8AQu_0 2024-09-12T19:23:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.226+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3141896792713305474', time=2024-09-12T20:36:51.203730+0000, chain.objs.size()=1 2024-09-12T19:23:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.226+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.p0GQswZuMFdy6az8PbaRPERQPP3jxJ3_0 2024-09-12T19:23:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.226+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13440528392467462246', time=2024-09-12T20:36:51.290666+0000, chain.objs.size()=1 2024-09-12T19:23:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.226+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.sY3mDdVlChTvLm1RSnaRykmOx3-kkg2_0 2024-09-12T19:23:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.226+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7162188541209113986', time=2024-09-12T20:36:51.727167+0000, chain.objs.size()=1 2024-09-12T19:23:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.226+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.R68fLo5E_uY5tlg7rLENyJdzSajgO7D_0 2024-09-12T19:23:01.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.226+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4235377982857384306', time=2024-09-12T20:36:52.083601+0000, chain.objs.size()=1 2024-09-12T19:23:01.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.226+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.gqbYL0TzxE2yahHWSEbIvD3o_lUDjQA_0 2024-09-12T19:23:01.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.226+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16412492600291790436', time=2024-09-12T20:36:54.458518+0000, chain.objs.size()=1 2024-09-12T19:23:01.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.226+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.HV67tcE_mbo0Ih7BaeSnFBHFaQVKPXI_0 2024-09-12T19:23:01.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.226+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7122584919825073879', time=2024-09-12T20:36:54.941604+0000, chain.objs.size()=1 2024-09-12T19:23:01.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.226+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.45H6tLxQ1rgr__2Fj7xKGG4CILh2U8H_0 2024-09-12T19:23:01.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.226+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6700606307800828853', time=2024-09-12T20:36:55.371026+0000, chain.objs.size()=1 2024-09-12T19:23:01.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.226+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.pGZCZRCkBIZ3l_EdrwnbMYCC7Zsty4Q_0 2024-09-12T19:23:01.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.226+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3527401067326312340', time=2024-09-12T20:38:39.763786+0000, chain.objs.size()=1 2024-09-12T19:23:01.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.226+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.M5HX3n5Nk7yLO4vKgHcKNTszOxk87NB_0 2024-09-12T19:23:01.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.226+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7927048017095137741', time=2024-09-12T20:38:40.223461+0000, chain.objs.size()=1 2024-09-12T19:23:01.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.226+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.mY_cj31s5cJo-V8r-WpSzN4Ywzp5nhp_0 2024-09-12T19:23:01.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2424811698542873181', time=2024-09-12T20:38:40.986841+0000, chain.objs.size()=1 2024-09-12T19:23:01.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.iZwddhMqSgl7H40U-ITtLOKEt80QkLl_0 2024-09-12T19:23:01.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8104730286869343500', time=2024-09-12T20:38:42.600459+0000, chain.objs.size()=1 2024-09-12T19:23:01.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.mtZCY600Th09sOPSkJQZibcfXFMxuYq_0 2024-09-12T19:23:01.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18090173740574488158', time=2024-09-12T20:38:44.546634+0000, chain.objs.size()=1 2024-09-12T19:23:01.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.UWnYTv84jlcs73SwFHe37baybICgwC__0 2024-09-12T19:23:01.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12338621321085482500', time=2024-09-12T20:38:45.518200+0000, chain.objs.size()=1 2024-09-12T19:23:01.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.FaJbkcOlAJljtYmmIA0GzGO47csWTrq_0 2024-09-12T19:23:01.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13078734522179942439', time=2024-09-12T20:38:46.294676+0000, chain.objs.size()=1 2024-09-12T19:23:01.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.jjbtWNYpQ78D9W7YEiDG8ziOQlC-AmD_0 2024-09-12T19:23:01.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.230+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16763642455450875258', time=2024-09-12T20:38:46.351192+0000, chain.objs.size()=1 2024-09-12T19:23:01.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.230+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.4vUBIEhfSEiCxe2VmCgQheLWNnf67UZ_0 2024-09-12T19:23:01.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.234+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12209516230973763158', time=2024-09-12T20:38:46.476012+0000, chain.objs.size()=1 2024-09-12T19:23:01.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.234+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ePS0tTMkbXvbrerNY37LN5R9PI_g40m_0 2024-09-12T19:23:01.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.234+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12685712217850606727', time=2024-09-12T20:38:48.162927+0000, chain.objs.size()=1 2024-09-12T19:23:01.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.234+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.zB2oyUNCBeWGAeS3DWGqvgV5LIpZ0qh_0 2024-09-12T19:23:01.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.234+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9103502521551941365', time=2024-09-12T20:38:48.555686+0000, chain.objs.size()=1 2024-09-12T19:23:01.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.234+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.cuQUeSqPdIWjFA0w0OMF8HUFpFwk_uS_0 2024-09-12T19:23:01.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.234+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13422181097791104470', time=2024-09-12T20:38:48.685472+0000, chain.objs.size()=1 2024-09-12T19:23:01.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.234+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.8agJIYjH3NA7h8x1st2vGA_TLg7mHXm_0 2024-09-12T19:23:01.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.234+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9900217542414632857', time=2024-09-12T20:38:48.781879+0000, chain.objs.size()=1 2024-09-12T19:23:01.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.234+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.AjHSZMZEJycvgVijgmvxgVvtGpGYvt4_0 2024-09-12T19:23:01.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.234+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9065700545673063250', time=2024-09-12T20:38:49.749215+0000, chain.objs.size()=1 2024-09-12T19:23:01.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.234+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.TKnX3-1wY3FAQq_vgXooxuTEoRbNNs2_0 2024-09-12T19:23:01.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.234+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1958115480570526742', time=2024-09-12T20:38:51.392050+0000, chain.objs.size()=1 2024-09-12T19:23:01.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.234+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.bdouj-fXixv9MMr9T-GzW0pOz6jXIZO_0 2024-09-12T19:23:01.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.234+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.484926493201519792', time=2024-09-12T20:38:51.397800+0000, chain.objs.size()=1 2024-09-12T19:23:01.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.234+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.PSLy6Pkbmv2uBu4VL2MmwkMjHzkrwcx_0 2024-09-12T19:23:01.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.238+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47374 2024-09-12T19:23:01.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T19:23:01.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2593891699981953612', time=2024-09-12T20:38:51.668056+0000, chain.objs.size()=1 2024-09-12T19:23:01.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.CXtRvpiw5AUbclRxfECjSiPJWzlh92K_0 2024-09-12T19:23:01.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13102843766732095629', time=2024-09-12T20:38:52.197849+0000, chain.objs.size()=1 2024-09-12T19:23:01.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.msrHakcJI_amAuWv2eUDc4RWUJCRkq-_0 2024-09-12T19:23:01.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15571435219120186552', time=2024-09-12T20:38:52.310138+0000, chain.objs.size()=1 2024-09-12T19:23:01.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.o8JUYX-uw43Vic425qfMKmh3cSsr9yn_0 2024-09-12T19:23:01.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13789919925795523898', time=2024-09-12T20:38:52.660142+0000, chain.objs.size()=1 2024-09-12T19:23:01.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.VmeheRH6iE9ugoiIeQlHT8QD1cHQ3FM_0 2024-09-12T19:23:01.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12434443646009388088', time=2024-09-12T20:38:55.058321+0000, chain.objs.size()=1 2024-09-12T19:23:01.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.90Mktirigj9e0JmxoamaUuT8XYlOtTL_0 2024-09-12T19:23:01.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6262613037567430435', time=2024-09-12T20:38:56.729207+0000, chain.objs.size()=1 2024-09-12T19:23:01.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.eXRchtKHyQxW0KruBrHLBANZqrGxtoP_0 2024-09-12T19:23:01.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6501825511799761268', time=2024-09-12T20:38:59.278381+0000, chain.objs.size()=1 2024-09-12T19:23:01.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.4JXsl_4UKZO_-WwbwIY_RsV6OuzOUOT_0 2024-09-12T19:23:01.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7480251337191684656', time=2024-09-12T20:38:59.806059+0000, chain.objs.size()=1 2024-09-12T19:23:01.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.l-DcmDTPkefxqtdLdfKTY9VnW6yphcw_0 2024-09-12T19:23:01.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13781406286951611139', time=2024-09-12T20:38:59.861579+0000, chain.objs.size()=1 2024-09-12T19:23:01.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-rY17IKbMC-MfKWx1mMAnGgFFk12ql-_0 2024-09-12T19:23:01.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10685188237636719435', time=2024-09-12T20:39:00.061693+0000, chain.objs.size()=1 2024-09-12T19:23:01.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.9NV98IRb1ckODkgAUUwUxyN4oig3awF_0 2024-09-12T19:23:01.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5511396788827672243', time=2024-09-12T20:39:00.751107+0000, chain.objs.size()=1 2024-09-12T19:23:01.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.eL5Q9706E4WdFk74dhqL_EmBc1cS5jB_0 2024-09-12T19:23:01.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15874271315612351749', time=2024-09-12T20:39:01.493909+0000, chain.objs.size()=1 2024-09-12T19:23:01.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.242+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.a9-Pbs8C1DQxR9Q8kxcfQj5FvOh50u4_0 2024-09-12T19:23:01.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.246+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15546085780171339114', time=2024-09-12T20:39:02.292909+0000, chain.objs.size()=1 2024-09-12T19:23:01.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.246+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.41IU4zbDzCZo72gznFabCFeOqCa83c4_0 2024-09-12T19:23:01.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14634785688565730979', time=2024-09-12T20:39:02.532781+0000, chain.objs.size()=1 2024-09-12T19:23:01.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Lu5GfT39McNK2RvRBTvcamhUONCZmU2_0 2024-09-12T19:23:01.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12050801445416790181', time=2024-09-12T20:39:03.090543+0000, chain.objs.size()=1 2024-09-12T19:23:01.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.wnZb8IAF8THYtpSHTImX26TQsnDp3Jj_0 2024-09-12T19:23:01.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5855491806495652142', time=2024-09-12T20:39:03.422101+0000, chain.objs.size()=1 2024-09-12T19:23:01.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Ud0S3tbhCTFE9JStxYNKPG4H4f14HTB_0 2024-09-12T19:23:01.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17955048813700073991', time=2024-09-12T20:39:03.985126+0000, chain.objs.size()=1 2024-09-12T19:23:01.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.GYGbaLcbszliu2UJZEStnaof-w8k1V4_0 2024-09-12T19:23:01.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5122263762438987431', time=2024-09-12T20:39:07.100081+0000, chain.objs.size()=1 2024-09-12T19:23:01.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.5BlRkglILOPP4HITN1BSmr1zEshK6uk_0 2024-09-12T19:23:01.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7539075033943723052', time=2024-09-12T20:39:07.822911+0000, chain.objs.size()=1 2024-09-12T19:23:01.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.HRng_T5nx00mloQ_z8rhcZclPo3iHRn_0 2024-09-12T19:23:01.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12318756765798968516', time=2024-09-12T20:39:48.868067+0000, chain.objs.size()=1 2024-09-12T19:23:01.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.344__shadow_.tgoJe3IxwcGm7UbK-gejJJqoVUXig3J_0 2024-09-12T19:23:01.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13939548746457839187', time=2024-09-12T20:41:00.022981+0000, chain.objs.size()=1 2024-09-12T19:23:01.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.381__shadow_.l1qubHrHZvM0KryGJlYEJRlVHEZUzp9_0 2024-09-12T19:23:01.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6947111805242025004', time=2024-09-12T20:41:59.003813+0000, chain.objs.size()=1 2024-09-12T19:23:01.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.410__shadow_.WiXIHeSPB32HSlRJ04k8-6xLy6gGHFl_0 2024-09-12T19:23:01.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9416255322014086802', time=2024-09-12T20:44:03.479724+0000, chain.objs.size()=1 2024-09-12T19:23:01.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.465__shadow_.jEyasV7RAoVqDgoBZwhICG_JixD20wG_0 2024-09-12T19:23:01.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10603072476089956545', time=2024-09-12T20:46:07.857027+0000, chain.objs.size()=6 2024-09-12T19:23:01.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.1 2024-09-12T19:23:01.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.250+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.2 2024-09-12T19:23:01.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.254+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.3 2024-09-12T19:23:01.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.254+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.4 2024-09-12T19:23:01.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.254+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.5 2024-09-12T19:23:01.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.254+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.6 2024-09-12T19:23:01.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.254+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9394345702046080082', time=2024-09-12T20:55:45.913625+0000, chain.objs.size()=1 2024-09-12T19:23:01.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.254+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.556__shadow_.qTppmDaAsOJcJlMko92OkGbpaT6hfxW_0 2024-09-12T19:23:01.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.254+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9858408931990348298', time=2024-09-12T20:56:50.878741+0000, chain.objs.size()=1 2024-09-12T19:23:01.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.254+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:6HxTfBUJQoK97QYsyqWW.xHyezjK-22_.RgXSzv93TVcmWaid-8rpLFlJErCDr0f_0 2024-09-12T19:23:01.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.254+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15369829528008042499', time=2024-09-12T20:58:02.626093+0000, chain.objs.size()=1 2024-09-12T19:23:01.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.254+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:n1a3PVLJFjZnBQA31MBdmjcEaxYTy15_.uha9ZpQhr6_Rnd2IRUSaTQNBeMUUUJu_0 2024-09-12T19:23:01.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.254+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.803151474860819187', time=2024-09-12T21:06:20.502288+0000, chain.objs.size()=6 2024-09-12T19:23:01.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.254+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.623__multipart_multipart_enc.2~2MJM1b2TOpIuRxa5MnD9krFVVAHnLnT.1 2024-09-12T19:23:01.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.254+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.623__multipart_multipart_enc.2~2MJM1b2TOpIuRxa5MnD9krFVVAHnLnT.2 2024-09-12T19:23:01.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.254+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.623__multipart_multipart_enc.2~2MJM1b2TOpIuRxa5MnD9krFVVAHnLnT.3 2024-09-12T19:23:01.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.623__multipart_multipart_enc.2~2MJM1b2TOpIuRxa5MnD9krFVVAHnLnT.4 2024-09-12T19:23:01.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.623__multipart_multipart_enc.2~2MJM1b2TOpIuRxa5MnD9krFVVAHnLnT.5 2024-09-12T19:23:01.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.623__multipart_multipart_enc.2~2MJM1b2TOpIuRxa5MnD9krFVVAHnLnT.6 2024-09-12T19:23:01.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14076693726076003611', time=2024-09-12T21:07:13.435953+0000, chain.objs.size()=1 2024-09-12T19:23:01.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.633__shadow_.RB9lEmzILDKEamfNKnMsnTDo8mgh_Fd_0 2024-09-12T19:23:01.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.503801671406764469', time=2024-09-12T21:07:25.802356+0000, chain.objs.size()=1 2024-09-12T19:23:01.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.639__shadow_.AHptrY2tdQ4uHuza_02AySmAu6WW0GP_0 2024-09-12T19:23:01.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9213391111883883051', time=2024-09-12T21:07:29.215050+0000, chain.objs.size()=1 2024-09-12T19:23:01.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.641__shadow_.hoGAQykdY_gMnUyvObnEP-qU4TjQS68_0 2024-09-12T19:23:01.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.258+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12353075384272855403', time=2024-09-12T21:09:45.592310+0000, chain.objs.size()=1 2024-09-12T19:23:01.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.258+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.666__shadow_.Le_n_A56niyPfbzsXQh-5xdjzIs2BlB_0 2024-09-12T19:23:01.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.262+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16912777069686390785', time=2024-09-12T21:10:57.751297+0000, chain.objs.size()=1 2024-09-12T19:23:01.267 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.262+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.704__shadow:5yVDi-x7eEMbHl08dNfjBwlXU3TKHYn_.jdcW0N3jpuqr6EWqvryEmtMySgCQeSL_0 2024-09-12T19:23:01.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.266+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:01.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T19:23:01.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:01.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:01.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51217' 2024-09-12T19:23:01.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='_sZYn71g-1ouVNIcynluixK0v0ovq_nI', time=2024-09-12T20:23:17.331679+0000, chain.objs.size()=1 2024-09-12T19:23:01.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.161__shadow_.5HqkSKxl-2Po5l1uhiizXt7uGXh4s1Y_0 2024-09-12T19:23:01.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='_d5Ba_lMeZ5Le0a1x4GdlCLjzJOlhd19', time=2024-09-12T20:23:37.570051+0000, chain.objs.size()=1 2024-09-12T19:23:01.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.165__shadow_.QjTAMsXz_JmXTrFetKaGMz62fsIdMm0_0 2024-09-12T19:23:01.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1194380113796676255', time=2024-09-12T20:28:47.966892+0000, chain.objs.size()=1 2024-09-12T19:23:01.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.231__shadow_.0hEtsj8pmjTXguf2TMWyrjHCRrM76Vd_0 2024-09-12T19:23:01.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2398707735309813775', time=2024-09-12T20:29:27.863984+0000, chain.objs.size()=1 2024-09-12T19:23:01.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.246__shadow_.JF3gGNplhTn95h5S63R5lSFy7Ncxit2_0 2024-09-12T19:23:01.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3157922295799746516', time=2024-09-12T20:29:32.492172+0000, chain.objs.size()=1 2024-09-12T19:23:01.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.248__shadow_.fu2UNjUmuLEiE54QgCftOpJkemgxMql_0 2024-09-12T19:23:01.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7134803439335740240', time=2024-09-12T20:29:48.607727+0000, chain.objs.size()=1 2024-09-12T19:23:01.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.255__shadow_.GyApjBqbQRyC-wW5bOJ2yu0u-60rOjY_0 2024-09-12T19:23:01.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11173718773473688149', time=2024-09-12T20:29:53.069106+0000, chain.objs.size()=1 2024-09-12T19:23:01.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.257__shadow_.B7hA6e4ShPSEmAzESjTPMGqTOVJTCKy_0 2024-09-12T19:23:01.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14835706135905777297', time=2024-09-12T20:31:45.223440+0000, chain.objs.size()=1 2024-09-12T19:23:01.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Kz1NCL_b0mmtoYsKfqxPapQ0Jjdqu5g_0 2024-09-12T19:23:01.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3808777339967868926', time=2024-09-12T20:31:46.335817+0000, chain.objs.size()=1 2024-09-12T19:23:01.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.icYZv1RieCB858ovXHfkRryEerMUfuX_0 2024-09-12T19:23:01.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7291172836567835725', time=2024-09-12T20:31:46.464266+0000, chain.objs.size()=1 2024-09-12T19:23:01.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ipjJTu7BBC_SrJg4WkmFNbbxzFU0-Zn_0 2024-09-12T19:23:01.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14652821488301364299', time=2024-09-12T20:31:47.359026+0000, chain.objs.size()=1 2024-09-12T19:23:01.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ON49fYOvPrUl6E1I1idtvlmXX6Tmo_w_0 2024-09-12T19:23:01.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16422905155673883822', time=2024-09-12T20:31:47.602185+0000, chain.objs.size()=1 2024-09-12T19:23:01.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.270+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.CpmkOQfCQ8tFA-EDbGZZaSD47hnXfcd_0 2024-09-12T19:23:01.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16318230773752144952', time=2024-09-12T20:31:49.301064+0000, chain.objs.size()=1 2024-09-12T19:23:01.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.HAaRRbV5a2gtxbU2NrLBdsVv3cjS9xQ_0 2024-09-12T19:23:01.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14961777888069950632', time=2024-09-12T20:31:49.302772+0000, chain.objs.size()=1 2024-09-12T19:23:01.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Tzexp-v6Q0ZgG5ZaBLa5gvA8a8IcfkQ_0 2024-09-12T19:23:01.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14520702847311272892', time=2024-09-12T20:31:50.410332+0000, chain.objs.size()=1 2024-09-12T19:23:01.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ywvgCi-L_GKBL670QZi2Z19rH-e-pto_0 2024-09-12T19:23:01.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1281195450302583682', time=2024-09-12T20:31:54.250904+0000, chain.objs.size()=1 2024-09-12T19:23:01.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Q-xgeepYbbAzYQFp5-8BQSl78h25LU3_0 2024-09-12T19:23:01.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2777214596593845744', time=2024-09-12T20:31:54.934172+0000, chain.objs.size()=1 2024-09-12T19:23:01.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.g72CUd80uIupxF4HhbC6pAPQUJE0jEV_0 2024-09-12T19:23:01.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3565276683143224278', time=2024-09-12T20:31:57.065945+0000, chain.objs.size()=1 2024-09-12T19:23:01.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Rq2szLE7XymPwSWKMViKxkSbrPaShap_0 2024-09-12T19:23:01.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5709543077902378283', time=2024-09-12T20:31:57.996199+0000, chain.objs.size()=1 2024-09-12T19:23:01.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.QgZEe0oKlZ7QGd4vFxCNK-takjKxebB_0 2024-09-12T19:23:01.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7578171755025802521', time=2024-09-12T20:31:58.653137+0000, chain.objs.size()=1 2024-09-12T19:23:01.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.wSzYp4K1qdgmd2-2nxtspnhp-AvlOb9_0 2024-09-12T19:23:01.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14875071683242080565', time=2024-09-12T20:32:01.641654+0000, chain.objs.size()=1 2024-09-12T19:23:01.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.quw3iNbPv4aqffLxM1Dtu-5whAfYtXE_0 2024-09-12T19:23:01.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1243619528911406965', time=2024-09-12T20:32:01.985201+0000, chain.objs.size()=1 2024-09-12T19:23:01.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.mdBMduxxT8OPtCCi-CZlaHKQcPeAZKN_0 2024-09-12T19:23:01.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12155760188611013046', time=2024-09-12T20:32:02.161691+0000, chain.objs.size()=1 2024-09-12T19:23:01.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.274+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_._LsBrtKC3DPtYE17i7hskcsoZWWQKbi_0 2024-09-12T19:23:01.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11103119861434528888', time=2024-09-12T20:32:02.655494+0000, chain.objs.size()=1 2024-09-12T19:23:01.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.nRDZBIxswbME-FGEqEMpmxoxh1TXhm6_0 2024-09-12T19:23:01.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12476673282487518721', time=2024-09-12T20:32:04.416925+0000, chain.objs.size()=1 2024-09-12T19:23:01.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.vrWLIEBgbQaHr0W028Lgb1CUNP5wuCo_0 2024-09-12T19:23:01.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.278+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3011598596447341621', time=2024-09-12T20:32:05.665141+0000, chain.objs.size()=1 2024-09-12T19:23:01.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.278+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.VDEvKN58OniexrR3TwROu3oEArMQ8ZG_0 2024-09-12T19:23:01.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.282+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3118239161063950437', time=2024-09-12T20:32:06.042805+0000, chain.objs.size()=1 2024-09-12T19:23:01.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.282+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.wiw1UmnuAHI7pjRhLtJuAxZuJJhzA6o_0 2024-09-12T19:23:01.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.282+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5083992461073591625', time=2024-09-12T20:32:06.334976+0000, chain.objs.size()=1 2024-09-12T19:23:01.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.282+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.sEFBw5TMOJu8z3mmix1GTzCJ91hrVMg_0 2024-09-12T19:23:01.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.282+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.271733761529465805', time=2024-09-12T20:32:09.372518+0000, chain.objs.size()=1 2024-09-12T19:23:01.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.282+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.hI_JE6ek9wVUZfbq145jJY5G79lcBrx_0 2024-09-12T19:23:01.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.282+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9401927911960947286', time=2024-09-12T20:32:49.505607+0000, chain.objs.size()=1 2024-09-12T19:23:01.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.282+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.278__shadow_.pECzIUvnm7R6TBXObzvMCeHJO3D2RsJ_0 2024-09-12T19:23:01.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.282+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4119800438337545129', time=2024-09-12T20:32:56.446207+0000, chain.objs.size()=1 2024-09-12T19:23:01.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.282+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.281__shadow_.TaEOItyzgfWLDDRmaGY3GGh2WYsk8Tm_0 2024-09-12T19:23:01.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.282+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.23552898052262227', time=2024-09-12T20:33:03.276311+0000, chain.objs.size()=1 2024-09-12T19:23:01.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.282+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.284__shadow_.qsmIIKU1F2MRDp8HMTVRpjK3CvY_wB1_0 2024-09-12T19:23:01.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.282+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11616757291076665055', time=2024-09-12T20:33:14.959714+0000, chain.objs.size()=1 2024-09-12T19:23:01.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.282+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.289__shadow_.WR7gh__jp5bYqg73dddaPbjdjhTgmE1_0 2024-09-12T19:23:01.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.282+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11276180158325976524', time=2024-09-12T20:33:25.321352+0000, chain.objs.size()=1 2024-09-12T19:23:01.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.282+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.m3MVZkwHqhE79gdQq-SXZnDuV3ZCBiM_0 2024-09-12T19:23:01.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.282+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.877641485921013492', time=2024-09-12T20:33:31.278108+0000, chain.objs.size()=1 2024-09-12T19:23:01.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.282+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.UAi7GQy1_ZQoZeFziw4CTT1HCTWUfVg_0 2024-09-12T19:23:01.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.46338193542553716', time=2024-09-12T20:33:50.307465+0000, chain.objs.size()=1 2024-09-12T19:23:01.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.301__shadow_.DtiPG1rvVztQmXm69RrpSkXCCnXRaik_0 2024-09-12T19:23:01.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2475190961800597196', time=2024-09-12T20:33:52.589357+0000, chain.objs.size()=1 2024-09-12T19:23:01.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.302__shadow_.Qovw2QGIMJBAjVxT_-y729fJVse_hlx_0 2024-09-12T19:23:01.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17158981871966623811', time=2024-09-12T20:36:28.316478+0000, chain.objs.size()=1 2024-09-12T19:23:01.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.40ZsdVVm7RSJqz9yYpVQs2UXvjci3sx_0 2024-09-12T19:23:01.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7756260415638250353', time=2024-09-12T20:36:28.817923+0000, chain.objs.size()=1 2024-09-12T19:23:01.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.UDai0eOEiMEtMyAcZS-jsp4i84YaITq_0 2024-09-12T19:23:01.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14365798676753357425', time=2024-09-12T20:36:30.123443+0000, chain.objs.size()=1 2024-09-12T19:23:01.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Cbubw5f_NdHrfo00Rvv7dotKb7zHVB-_0 2024-09-12T19:23:01.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16100311915425362342', time=2024-09-12T20:36:30.648195+0000, chain.objs.size()=1 2024-09-12T19:23:01.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.SKubn-Uh5i8eFYsDzskhcIqc2szdh11_0 2024-09-12T19:23:01.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15105556541685344913', time=2024-09-12T20:36:30.892975+0000, chain.objs.size()=1 2024-09-12T19:23:01.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.7sw4AzF8Y_hUDnJyQgdz1dP4w88Bfar_0 2024-09-12T19:23:01.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13519377653352478301', time=2024-09-12T20:36:33.291650+0000, chain.objs.size()=1 2024-09-12T19:23:01.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.rl1aA8EwG40TIO5n6SMAccXyPun0GVd_0 2024-09-12T19:23:01.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4592278079719794786', time=2024-09-12T20:36:34.013355+0000, chain.objs.size()=1 2024-09-12T19:23:01.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Ge_V7SnODALd22T4r_E1cgH4i3Pyduy_0 2024-09-12T19:23:01.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8927608937117663743', time=2024-09-12T20:36:34.507710+0000, chain.objs.size()=1 2024-09-12T19:23:01.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.c1Gi-CJiUs5vxFQIakmZALS9MAOnYMX_0 2024-09-12T19:23:01.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13591035779187638429', time=2024-09-12T20:36:35.771211+0000, chain.objs.size()=1 2024-09-12T19:23:01.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.286+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.QS3XC7lGkFiYvU7ktLUrxihbdMSVU-f_0 2024-09-12T19:23:01.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.290+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15207940238561228754', time=2024-09-12T20:36:40.126282+0000, chain.objs.size()=1 2024-09-12T19:23:01.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.290+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.8hLB1hNF_nwTTfQ4qw70GLMc8LxG3-P_0 2024-09-12T19:23:01.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.290+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5542912249190067928', time=2024-09-12T20:36:41.446764+0000, chain.objs.size()=1 2024-09-12T19:23:01.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.290+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.yFe2E70mPq1cz1Artq-oeKc1KqjdftA_0 2024-09-12T19:23:01.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.290+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7177729162315738999', time=2024-09-12T20:36:41.643675+0000, chain.objs.size()=1 2024-09-12T19:23:01.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.290+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.xV4-SixgnPlXmTGjkmYnPM0jZYlkQ4a_0 2024-09-12T19:23:01.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11036845042490275314', time=2024-09-12T20:36:43.177814+0000, chain.objs.size()=1 2024-09-12T19:23:01.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.4yeXNGvLD8LZX5CEaW07qRfi_p7cVAq_0 2024-09-12T19:23:01.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13395830728208567391', time=2024-09-12T20:36:44.954674+0000, chain.objs.size()=1 2024-09-12T19:23:01.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.OR-a7YGcMAjQxgmPvAa2IlZz6dvjnH-_0 2024-09-12T19:23:01.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12381077542483926422', time=2024-09-12T20:36:45.711819+0000, chain.objs.size()=1 2024-09-12T19:23:01.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.yoNh-GVpLzC6l0a-YAf_gEn8FRVa8Rn_0 2024-09-12T19:23:01.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11973485179877732659', time=2024-09-12T20:36:47.233898+0000, chain.objs.size()=1 2024-09-12T19:23:01.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.eR1sJWfFD7T6Xf6RZqfNes_U0pRRLQj_0 2024-09-12T19:23:01.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775c7c4640 0 -- 172.21.15.98:0/1511992613 >> [v2:172.21.15.98:6816/1225764258,v1:172.21.15.98:6817/1225764258] conn(0x7f7754028020 msgr2=0x7f775408fff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:23:01.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17218579023219384176', time=2024-09-12T20:36:47.354618+0000, chain.objs.size()=1 2024-09-12T19:23:01.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.MqRxP-4NY1ryr90mf3u_YNWBxdGWyKs_0 2024-09-12T19:23:01.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6986666732053276530', time=2024-09-12T20:36:47.856900+0000, chain.objs.size()=1 2024-09-12T19:23:01.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.TKLBOQVC96LXQXl_9cexb0TLuhDkiVc_0 2024-09-12T19:23:01.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9651920327362885739', time=2024-09-12T20:36:47.970442+0000, chain.objs.size()=1 2024-09-12T19:23:01.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.KRQIjG-Z4hOFFfymR5KuPo2OcxEodXP_0 2024-09-12T19:23:01.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3403004878768204914', time=2024-09-12T20:36:49.188068+0000, chain.objs.size()=1 2024-09-12T19:23:01.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.MTgef-aPJxssAubi3POm97rjNlvx32k_0 2024-09-12T19:23:01.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9236470376563718870', time=2024-09-12T20:36:51.203882+0000, chain.objs.size()=1 2024-09-12T19:23:01.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.cD1ei_H2nUXx479XPfO9lBQTocc6nOG_0 2024-09-12T19:23:01.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3626243435022459412', time=2024-09-12T20:36:51.372112+0000, chain.objs.size()=1 2024-09-12T19:23:01.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.yYoOLyE5uHsDih1wd-tq7YsBmk3ELgI_0 2024-09-12T19:23:01.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16075198735886385764', time=2024-09-12T20:36:53.392457+0000, chain.objs.size()=1 2024-09-12T19:23:01.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.294+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.TVOog6HUTTLsK0kStzQ1Hfj8ETvS6y3_0 2024-09-12T19:23:01.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.298+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4104130776076182993', time=2024-09-12T20:36:54.043120+0000, chain.objs.size()=1 2024-09-12T19:23:01.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.298+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.7h4xQ2Ebm98gUJwLpGZyZzTgY51PiwM_0 2024-09-12T19:23:01.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.298+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6395531822193856889', time=2024-09-12T20:36:55.376765+0000, chain.objs.size()=1 2024-09-12T19:23:01.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.298+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.5D6TAPP7NiGNiqNCaStGjjiIzyypFem_0 2024-09-12T19:23:01.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.298+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4338853767466203538', time=2024-09-12T20:38:41.177970+0000, chain.objs.size()=1 2024-09-12T19:23:01.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.298+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.7gmSem1ukTcArjaGoU3EMVAwjfQHLgG_0 2024-09-12T19:23:01.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.298+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15227344401963092721', time=2024-09-12T20:38:44.393426+0000, chain.objs.size()=1 2024-09-12T19:23:01.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.298+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.hzBNM7-ka63tgAaBYhSbSnGz22nbx8L_0 2024-09-12T19:23:01.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.298+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6264258692934670607', time=2024-09-12T20:38:45.597906+0000, chain.objs.size()=1 2024-09-12T19:23:01.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.298+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.QfiB_j2KVP2iesdPSEe3g3oa1sqcuhq_0 2024-09-12T19:23:01.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.298+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8631284579546990257', time=2024-09-12T20:38:47.883754+0000, chain.objs.size()=1 2024-09-12T19:23:01.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.298+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.MNJ4Kke0EM834x9zvRTnRbzAmpUtwGD_0 2024-09-12T19:23:01.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.302+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14706463500537543758', time=2024-09-12T20:38:49.101553+0000, chain.objs.size()=1 2024-09-12T19:23:01.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.302+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.u2jlJNDZHBmxXoue4aGtECfvF3mKB7t_0 2024-09-12T19:23:01.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.302+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5007350718984353656', time=2024-09-12T20:38:50.238728+0000, chain.objs.size()=1 2024-09-12T19:23:01.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.302+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.HPlBzpI88BWW4qyBR0WE3uHEiJnG7gB_0 2024-09-12T19:23:01.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.302+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9616313530742216384', time=2024-09-12T20:38:51.386896+0000, chain.objs.size()=1 2024-09-12T19:23:01.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.302+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.3ZFPyO8A5lkulokZH27ZPagT9-UwuQj_0 2024-09-12T19:23:01.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.302+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11735186941685820663', time=2024-09-12T20:38:52.351808+0000, chain.objs.size()=1 2024-09-12T19:23:01.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.302+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-Irm4ri8aERCGvh4CgsxJ9nRRZ6lmjB_0 2024-09-12T19:23:01.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.302+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11775952122442433905', time=2024-09-12T20:38:52.584299+0000, chain.objs.size()=1 2024-09-12T19:23:01.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.302+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.xuzOn14H8nr9AoiqMhqJF2lEWQXUCjv_0 2024-09-12T19:23:01.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4632003423577028193', time=2024-09-12T20:38:53.348702+0000, chain.objs.size()=1 2024-09-12T19:23:01.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.K1fi5fwerzgmf6OVYiTbWvbV2_O4rjh_0 2024-09-12T19:23:01.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6612155237379790920', time=2024-09-12T20:38:53.846635+0000, chain.objs.size()=1 2024-09-12T19:23:01.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.lGsqFocVt1rPJt1g48dI1nmrmNp-SeL_0 2024-09-12T19:23:01.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5931914018203564927', time=2024-09-12T20:38:56.420327+0000, chain.objs.size()=1 2024-09-12T19:23:01.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.B2fuG7ajbCHuMP9BFQudTbCy98nYPkR_0 2024-09-12T19:23:01.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12814900744797426478', time=2024-09-12T20:38:56.421766+0000, chain.objs.size()=1 2024-09-12T19:23:01.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.givv1pHyecWOendzNjyntBB17ujYzH6_0 2024-09-12T19:23:01.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13057356563194102641', time=2024-09-12T20:38:56.562245+0000, chain.objs.size()=1 2024-09-12T19:23:01.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.kln55KSOwY4YtRyXFXyc5-Odx1j0sHx_0 2024-09-12T19:23:01.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3359280242669613871', time=2024-09-12T20:38:56.994722+0000, chain.objs.size()=1 2024-09-12T19:23:01.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.JELeLY_6RfJasQp-HG2ajROZkbCY15e_0 2024-09-12T19:23:01.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5934941403279855218', time=2024-09-12T20:38:57.111694+0000, chain.objs.size()=1 2024-09-12T19:23:01.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.mQzSBkPlZy_1UmX9Mt1QTjVAEuVJKJr_0 2024-09-12T19:23:01.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3189767876374295526', time=2024-09-12T20:38:57.550346+0000, chain.objs.size()=1 2024-09-12T19:23:01.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.SgIZ65kWPf-5mQu24iuMIH6tpxK0juM_0 2024-09-12T19:23:01.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9571532356633188912', time=2024-09-12T20:38:57.552285+0000, chain.objs.size()=1 2024-09-12T19:23:01.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.NJyRhasf9w7jV-5ulu3ezIiGoEwAZEV_0 2024-09-12T19:23:01.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5416149298235057495', time=2024-09-12T20:38:57.660338+0000, chain.objs.size()=1 2024-09-12T19:23:01.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.a1jpe5siq5TQ_jjzrqoa5zgbct3c3r2_0 2024-09-12T19:23:01.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17485413249580008449', time=2024-09-12T20:38:59.450873+0000, chain.objs.size()=1 2024-09-12T19:23:01.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.306+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.r4Gcsr93NLyrxtGTNFUYo7SZ_vQ5T3N_0 2024-09-12T19:23:01.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.310+0000 7f775c7c4640 0 -- 172.21.15.98:0/1511992613 >> [v2:172.21.15.98:6824/4243656823,v1:172.21.15.98:6825/4243656823] conn(0x5556802bdcd0 msgr2=0x7f7624086c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:23:01.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.310+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5055150786952880257', time=2024-09-12T20:39:01.454534+0000, chain.objs.size()=1 2024-09-12T19:23:01.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.310+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.N5esXfeGBmJCLCe8CE5pL0K20_OvPAf_0 2024-09-12T19:23:01.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.310+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.129211168044095730', time=2024-09-12T20:39:02.292324+0000, chain.objs.size()=1 2024-09-12T19:23:01.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.310+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.amMLS1edACD8HhKeRJyd1Cp9XNhAMoz_0 2024-09-12T19:23:01.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.310+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8787288991897061156', time=2024-09-12T20:39:03.298743+0000, chain.objs.size()=1 2024-09-12T19:23:01.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.310+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.8zcK1u7ngRUqOFY-HOJbrk6sCzgAzb9_0 2024-09-12T19:23:01.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.310+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12838424254305972594', time=2024-09-12T20:39:03.317993+0000, chain.objs.size()=1 2024-09-12T19:23:01.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.310+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.jFr0itQ9nkcmbR4gfpLOCM_Fah0rTQm_0 2024-09-12T19:23:01.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.310+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16278701898268888769', time=2024-09-12T20:39:05.030719+0000, chain.objs.size()=1 2024-09-12T19:23:01.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.310+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.t4JMdK7XtJg1lvTz8PRN9i4aPXdlZzv_0 2024-09-12T19:23:01.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.310+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13286510211876473695', time=2024-09-12T20:39:06.313541+0000, chain.objs.size()=1 2024-09-12T19:23:01.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.310+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.1wsq25ReHMcq53xg0JDzDyqc1ya_uUA_0 2024-09-12T19:23:01.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18081240965477127965', time=2024-09-12T20:39:06.791692+0000, chain.objs.size()=1 2024-09-12T19:23:01.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.KMnVEftuE8TRqIEY1gb8Dv0UOaWIYI9_0 2024-09-12T19:23:01.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5289599791645088444', time=2024-09-12T20:39:07.458157+0000, chain.objs.size()=1 2024-09-12T19:23:01.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ZROUVjy8HxGHp_vWOsAtRVFiMcn9C_C_0 2024-09-12T19:23:01.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10706862474375073731', time=2024-09-12T20:39:07.459728+0000, chain.objs.size()=1 2024-09-12T19:23:01.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Ryy5EeXgXXktmIrs6BGVevW8v_fkWqV_0 2024-09-12T19:23:01.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10382267357826652992', time=2024-09-12T20:39:07.581619+0000, chain.objs.size()=1 2024-09-12T19:23:01.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.zvVhrglI_SmNVq-jz4C7aTqwpRiER7Z_0 2024-09-12T19:23:01.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2145309115751659025', time=2024-09-12T20:39:29.812657+0000, chain.objs.size()=1 2024-09-12T19:23:01.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.335__shadow_.VH1mAR1pL9eettfjaNJNSIpubp8l4Y__0 2024-09-12T19:23:01.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12605259534342259198', time=2024-09-12T20:41:19.021385+0000, chain.objs.size()=1 2024-09-12T19:23:01.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.390__shadow_.HE5hsPILx93qwaQgQhOgfRn08Xah89Y_0 2024-09-12T19:23:01.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.314+0000 7f775cfc5640 0 -- 172.21.15.98:0/1511992613 >> [v2:172.21.15.187:6816/1254463716,v1:172.21.15.187:6817/1254463716] conn(0x7f7744052040 msgr2=0x7f76240891c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:23:01.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17421037871164029228', time=2024-09-12T20:42:36.706758+0000, chain.objs.size()=1 2024-09-12T19:23:01.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.429__shadow_.YpVBIc_l-c19dEvUvrzbdi9avOklhUT_0 2024-09-12T19:23:01.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14089731456879527206', time=2024-09-12T20:43:17.174568+0000, chain.objs.size()=1 2024-09-12T19:23:01.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.447__shadow_.gxS4ilFZ6Fvse3bcrlOqZ67uCy5zFdq_0 2024-09-12T19:23:01.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.314+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10327226476680291215', time=2024-09-12T20:43:40.705100+0000, chain.objs.size()=1 2024-09-12T19:23:01.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.314+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.457__shadow_.YlVPEl3sPpng52aYegQ1j2BAOVk4iqb_0 2024-09-12T19:23:01.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.318+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15717895716398948000', time=2024-09-12T20:44:33.715420+0000, chain.objs.size()=1 2024-09-12T19:23:01.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.318+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.483__shadow_.8rWkZ03r5k82nFtkCcEGZnfC6LyLZZK_0 2024-09-12T19:23:01.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.318+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6521652298995791535', time=2024-09-12T20:45:06.326141+0000, chain.objs.size()=1 2024-09-12T19:23:01.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.318+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.496__shadow_.iWrpHAH4zOEuIIQ8qdR4qnwdNhI1WJz_0 2024-09-12T19:23:01.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.318+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14674637030569525995', time=2024-09-12T20:45:14.205002+0000, chain.objs.size()=1 2024-09-12T19:23:01.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.318+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.500__shadow_.MzwQG1FxQrgQ_K-hGAmGQp5CHvsvKnv_0 2024-09-12T19:23:01.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51217 2024-09-12T19:23:01.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T19:23:01.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vH3tAeQLifh1X84Rw9mc3FzlQlxaMjj', time=2024-09-12T20:49:09.663960+0000, chain.objs.size()=1 2024-09-12T19:23:01.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~vH3tAeQLifh1X84Rw9mc3FzlQlxaMjj.2 2024-09-12T19:23:01.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2501776768300314830', time=2024-09-12T20:57:27.338405+0000, chain.objs.size()=1 2024-09-12T19:23:01.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.574__shadow:47EYyN27IJdToiqPalc.LznBDizTohG_.IRa7SJjby6uGt2qBF0ZjcFsFNJrj_LA_0 2024-09-12T19:23:01.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5522014522845563414', time=2024-09-12T20:59:12.372424+0000, chain.objs.size()=4 2024-09-12T19:23:01.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.578__multipart_testobj.2~rD3GHilYOmtQ-KoEWeLVJp3VMARsk6e.1 2024-09-12T19:23:01.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.578__multipart_testobj.2~rD3GHilYOmtQ-KoEWeLVJp3VMARsk6e.2 2024-09-12T19:23:01.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.578__multipart_testobj.2~rD3GHilYOmtQ-KoEWeLVJp3VMARsk6e.3 2024-09-12T19:23:01.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.578__multipart_testobj.2~rD3GHilYOmtQ-KoEWeLVJp3VMARsk6e.4 2024-09-12T19:23:01.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11895013608487404332', time=2024-09-12T20:59:29.634054+0000, chain.objs.size()=1 2024-09-12T19:23:01.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.579__shadow:xx4-v9qabG4FD5m6rpC0OLZpFWjRWMV_.LC_05gbocsVJNR8IIqjqYiG-hhDxIlY_0 2024-09-12T19:23:01.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2439066362018167322', time=2024-09-12T20:59:29.755774+0000, chain.objs.size()=1 2024-09-12T19:23:01.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.579__shadow:UsiPppfej3ia9iJ2uXi8bbd9cD-Z8k6_.vh7B7bTdKTtDRCKMRZwvc04OYKbYSMn_0 2024-09-12T19:23:01.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15939194618031445267', time=2024-09-12T20:59:34.967488+0000, chain.objs.size()=1 2024-09-12T19:23:01.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.580__shadow:wEWrzO73pA5IgZwDnEbm0JuTeUX0ASu_.MO7S4CRxEG2GOQtjqOJicjRzNwnoSGc_0 2024-09-12T19:23:01.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16663070735704815986', time=2024-09-12T21:00:34.166427+0000, chain.objs.size()=1 2024-09-12T19:23:01.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.607__shadow_.ZgwTVx2wUkr234YUZaW2_6dAgodzWyW_0 2024-09-12T19:23:01.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6840564532340112220', time=2024-09-12T21:07:20.276386+0000, chain.objs.size()=1 2024-09-12T19:23:01.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.636__shadow_.Cu2-UENqxOrYK4AZ4zcWT6XvLEWcOlR_0 2024-09-12T19:23:01.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15616296971741194684', time=2024-09-12T21:08:11.859424+0000, chain.objs.size()=2 2024-09-12T19:23:01.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.322+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.649__shadow_.nxDT1TU9NKBTIlXxZQz0XcVrBX0suA3_0 2024-09-12T19:23:01.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.326+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.649__shadow_.nxDT1TU9NKBTIlXxZQz0XcVrBX0suA3_1 2024-09-12T19:23:01.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.330+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12395444455807898873', time=2024-09-12T21:10:46.864056+0000, chain.objs.size()=1 2024-09-12T19:23:01.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.330+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.699__shadow:waWqoiDGkPEdJJecODVwVeTa8jpmvxw_.AHHeiQQPdqNOnz1rGNpk0-oDRirurfv_0 2024-09-12T19:23:01.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.330+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14687813419034798441', time=2024-09-12T21:10:53.201554+0000, chain.objs.size()=1 2024-09-12T19:23:01.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.330+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.702__multipart_file1.2~BmvUxAmgzBHX3lBOTBNL1kKcaO6NxV0.1 2024-09-12T19:23:01.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.330+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12439593203918470145', time=2024-09-12T21:12:58.424163+0000, chain.objs.size()=1 2024-09-12T19:23:01.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.330+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.740__shadow_.Fhh-lumvdlPk0Q8NQdaHjR3AeQXUjvR_0 2024-09-12T19:23:01.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.334+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:01.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T19:23:01.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:01.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:01.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42956' 2024-09-12T19:23:01.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2946773490633978787', time=2024-09-12T20:21:27.698710+0000, chain.objs.size()=1 2024-09-12T19:23:01.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.148__shadow_.Zcy3rwpfdQjXDZIgSr_lkjtbNGQTik2_0 2024-09-12T19:23:01.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='_vsJIfJ327t3F2QLi3_nzGA8-HleBw95', time=2024-09-12T20:22:43.245138+0000, chain.objs.size()=1 2024-09-12T19:23:01.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.160__shadow_.CwX2xyNhRL8Iu8Z6S10QjzopDjsrXXp_0 2024-09-12T19:23:01.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17083560189309832762', time=2024-09-12T20:28:45.707010+0000, chain.objs.size()=1 2024-09-12T19:23:01.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.230__shadow_.SeqKCk1BpA_0CKoMCP76q_GZr8cl5IX_0 2024-09-12T19:23:01.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10735319668604664985', time=2024-09-12T20:28:59.440724+0000, chain.objs.size()=1 2024-09-12T19:23:01.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.236__shadow_.0eOmZtmTg9e54QVV7Et8EJz49WdWEGq_0 2024-09-12T19:23:01.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1283581076343449035', time=2024-09-12T20:29:15.528326+0000, chain.objs.size()=1 2024-09-12T19:23:01.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.242__shadow_.QxdmOiJnYu5kCNm7sSKUO8Fy_LcvA9h_0 2024-09-12T19:23:01.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14343917234138777712', time=2024-09-12T20:29:27.870046+0000, chain.objs.size()=1 2024-09-12T19:23:01.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.246__shadow_.6oOopZdFFf6_99S8sfoH6u1np7eb2f6_0 2024-09-12T19:23:01.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13772907221045772438', time=2024-09-12T20:29:46.316393+0000, chain.objs.size()=1 2024-09-12T19:23:01.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.254__shadow_.CLK-xfO84W_wwFC1yHtZsvo9t-0oFkm_0 2024-09-12T19:23:01.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3420134433312605010', time=2024-09-12T20:29:46.328827+0000, chain.objs.size()=1 2024-09-12T19:23:01.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.254__shadow_.Y9f6wd8LjywLpyFu2Ml5kHLZz9pTZwv_0 2024-09-12T19:23:01.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9309145955901070827', time=2024-09-12T20:29:48.623845+0000, chain.objs.size()=1 2024-09-12T19:23:01.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.255__shadow_.XcmANYOo31aK4gvbRpL-VbbhB7-Cag1_0 2024-09-12T19:23:01.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15333205260705160885', time=2024-09-12T20:30:02.165573+0000, chain.objs.size()=1 2024-09-12T19:23:01.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.261__shadow_.nYYD4YQ2N6Fod1ESnAC6YACa2i9Tbou_0 2024-09-12T19:23:01.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.814732712874505115', time=2024-09-12T20:31:45.641406+0000, chain.objs.size()=1 2024-09-12T19:23:01.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.UArAFEbSNfLDqgjNOIckhqdZVYE-BE8_0 2024-09-12T19:23:01.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13925341345172531476', time=2024-09-12T20:31:45.958233+0000, chain.objs.size()=1 2024-09-12T19:23:01.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.338+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.xaJVd7Qee3_xYChsI_fOya6fqYSLojn_0 2024-09-12T19:23:01.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18186576101075781752', time=2024-09-12T20:31:46.335793+0000, chain.objs.size()=1 2024-09-12T19:23:01.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.cukVfx6bUf4znIsflPkuh16lxUPPyHo_0 2024-09-12T19:23:01.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16461727050385457004', time=2024-09-12T20:31:46.821969+0000, chain.objs.size()=1 2024-09-12T19:23:01.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.wB3-baUejoas7EW2_jbyjySB04DS4g0_0 2024-09-12T19:23:01.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16708360064256051842', time=2024-09-12T20:31:50.092909+0000, chain.objs.size()=1 2024-09-12T19:23:01.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.J89tvJcajEYq8leCGjPbRPgnHiN2gdd_0 2024-09-12T19:23:01.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5845890608997259369', time=2024-09-12T20:31:50.206893+0000, chain.objs.size()=1 2024-09-12T19:23:01.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_._jPnzJRSKl4woHwQO9YX547RJyRjk4M_0 2024-09-12T19:23:01.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16844928987615167669', time=2024-09-12T20:31:51.428396+0000, chain.objs.size()=1 2024-09-12T19:23:01.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.dGDOWcMwapQtfuvsfYn-A9Q4wdqLRYN_0 2024-09-12T19:23:01.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5982441946475165579', time=2024-09-12T20:31:51.727623+0000, chain.objs.size()=1 2024-09-12T19:23:01.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.yV5GisoXW24yZIaK5riyT-8DP2schPX_0 2024-09-12T19:23:01.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10644524191266439775', time=2024-09-12T20:31:52.071955+0000, chain.objs.size()=1 2024-09-12T19:23:01.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.8zmhH5kzWP3lghlCrDFKVb9exy8dGQw_0 2024-09-12T19:23:01.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9438272108697233193', time=2024-09-12T20:31:53.869122+0000, chain.objs.size()=1 2024-09-12T19:23:01.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.zf8PDXgB3poqn3rOwycqpHcj-H65V3Z_0 2024-09-12T19:23:01.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13203932600292253201', time=2024-09-12T20:31:54.221367+0000, chain.objs.size()=1 2024-09-12T19:23:01.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.eEYuI3rRjP_yQ-JQRF0UCTP27e3TcAr_0 2024-09-12T19:23:01.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3145807552100987733', time=2024-09-12T20:31:54.822149+0000, chain.objs.size()=1 2024-09-12T19:23:01.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.tbvjrx70D5MBiqQFFrGikmlRRfWBUMm_0 2024-09-12T19:23:01.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15501282561970178403', time=2024-09-12T20:31:55.899780+0000, chain.objs.size()=1 2024-09-12T19:23:01.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.342+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.q5sM2FYK_JAemQSvtMoHyqOvnplusGD_0 2024-09-12T19:23:01.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14434822979182763113', time=2024-09-12T20:31:55.934914+0000, chain.objs.size()=1 2024-09-12T19:23:01.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.-LtpOnY6U-1tHVaXtQuXKUBZr4pfrie_0 2024-09-12T19:23:01.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1938511685526535089', time=2024-09-12T20:31:56.916988+0000, chain.objs.size()=1 2024-09-12T19:23:01.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Zjuhfyl3LA-vPRWy3x6TQaO8MPp-eUx_0 2024-09-12T19:23:01.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9810820650516513363', time=2024-09-12T20:31:57.624166+0000, chain.objs.size()=1 2024-09-12T19:23:01.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.CYf6Qo_8-uBwW4018Jz9Kjw0x0WsGVt_0 2024-09-12T19:23:01.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2492666519470517811', time=2024-09-12T20:31:58.466440+0000, chain.objs.size()=1 2024-09-12T19:23:01.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.IfFg5_kCO-woPulHHMCv0xQCLxC3Xnj_0 2024-09-12T19:23:01.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6437832504429474121', time=2024-09-12T20:31:58.532050+0000, chain.objs.size()=1 2024-09-12T19:23:01.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.KyqrZcd6nsIJnAW7-FAakqEYKOITWGX_0 2024-09-12T19:23:01.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2540032599072447224', time=2024-09-12T20:31:59.050726+0000, chain.objs.size()=1 2024-09-12T19:23:01.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.As3F60laoHWAA7ZDvuTPQcaIpCbuJFn_0 2024-09-12T19:23:01.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9317869762024333690', time=2024-09-12T20:32:00.777801+0000, chain.objs.size()=1 2024-09-12T19:23:01.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.kOQwNKDoR-BcthRLoNA1D9WLjlem08N_0 2024-09-12T19:23:01.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11303308490012669613', time=2024-09-12T20:32:00.833004+0000, chain.objs.size()=1 2024-09-12T19:23:01.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.YN0R2csZfZnIm4AsH1nJUYN728qkE9C_0 2024-09-12T19:23:01.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7277369951352857812', time=2024-09-12T20:32:04.413112+0000, chain.objs.size()=1 2024-09-12T19:23:01.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.-dVjT3twDYEzzc-JNTJtMXFcqxiKxcx_0 2024-09-12T19:23:01.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2523602775338200801', time=2024-09-12T20:32:05.865641+0000, chain.objs.size()=1 2024-09-12T19:23:01.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.5kUekGeMl-kkxzC6bNsZzBL-7WAtSQJ_0 2024-09-12T19:23:01.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1866822472474817333', time=2024-09-12T20:32:06.039890+0000, chain.objs.size()=1 2024-09-12T19:23:01.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.350+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.D_plMl7I7Ar3CBLJ0NBgKycTyI3-6L__0 2024-09-12T19:23:01.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7951484770498893408', time=2024-09-12T20:32:06.761440+0000, chain.objs.size()=1 2024-09-12T19:23:01.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.3PLCJF1ROY33N2lSpCgL7xc2jfIoHvG_0 2024-09-12T19:23:01.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14964037163774163277', time=2024-09-12T20:32:06.762711+0000, chain.objs.size()=1 2024-09-12T19:23:01.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.t3eyPnWq5sJv6VkCU-rFeVPtldCeyT2_0 2024-09-12T19:23:01.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10098718338716636490', time=2024-09-12T20:32:07.133976+0000, chain.objs.size()=1 2024-09-12T19:23:01.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.CG44pTxzNWJ_nhQNgr6tgLjDxGeB33-_0 2024-09-12T19:23:01.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11825706155975753335', time=2024-09-12T20:32:09.368114+0000, chain.objs.size()=1 2024-09-12T19:23:01.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.47f4rWZ7ndCHzSvtMnox88J30sZ2pJA_0 2024-09-12T19:23:01.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11052986012381073260', time=2024-09-12T20:32:11.631806+0000, chain.objs.size()=1 2024-09-12T19:23:01.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.yiq6rEg70WtJW-G44P4097YH1fS8xPN_0 2024-09-12T19:23:01.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12731128633331150670', time=2024-09-12T20:32:11.891981+0000, chain.objs.size()=1 2024-09-12T19:23:01.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.hosD5mN6cK58I2lpmvB__bYoiRYpMOa_0 2024-09-12T19:23:01.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17452166744937360406', time=2024-09-12T20:32:12.568857+0000, chain.objs.size()=1 2024-09-12T19:23:01.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.OL-4zAN-g0ADECFP1e3Q9Ikyx0t0IWa_0 2024-09-12T19:23:01.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1152998256809945921', time=2024-09-12T20:32:31.542891+0000, chain.objs.size()=1 2024-09-12T19:23:01.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.270__shadow_.HItAO59jFGZv1wuXFembsw6qZvKMyco_0 2024-09-12T19:23:01.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11690360131044666488', time=2024-09-12T20:32:58.742063+0000, chain.objs.size()=1 2024-09-12T19:23:01.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.282__shadow_.5rskkumrRPJoNr64exydNAXoKZaoI7l_0 2024-09-12T19:23:01.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4516037739825263377', time=2024-09-12T20:33:10.454498+0000, chain.objs.size()=1 2024-09-12T19:23:01.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.287__shadow_.jXxQSNvGS86F1gV74LZp_PlsNm2ohno_0 2024-09-12T19:23:01.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2356767562565277077', time=2024-09-12T20:33:40.819487+0000, chain.objs.size()=1 2024-09-12T19:23:01.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.354+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.297__shadow_.rWruIxZWGCI6kpblCULb4BT-64Xlg0E_0 2024-09-12T19:23:01.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11991334625966539192', time=2024-09-12T20:34:42.374095+0000, chain.objs.size()=1 2024-09-12T19:23:01.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.321__shadow_.Q5BQHt7UxWD2XI0fgnPLmW0D419RuFv_0 2024-09-12T19:23:01.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13636314846981709851', time=2024-09-12T20:36:28.803912+0000, chain.objs.size()=1 2024-09-12T19:23:01.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.YG2_Khyyg9X2FRIWJFompBx1CBoa0oB_0 2024-09-12T19:23:01.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18020080532679537214', time=2024-09-12T20:36:28.807112+0000, chain.objs.size()=1 2024-09-12T19:23:01.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_._PkQvBgLTRu178mP6n5rq1aQS2dsKey_0 2024-09-12T19:23:01.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1571024819455282051', time=2024-09-12T20:36:30.551127+0000, chain.objs.size()=1 2024-09-12T19:23:01.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.vyWiq_oeBjxaUWrKtUGHln1WwD6sXXa_0 2024-09-12T19:23:01.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.676986909874567645', time=2024-09-12T20:36:31.960879+0000, chain.objs.size()=1 2024-09-12T19:23:01.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.7Ti3JXAuRqzhPibN4dUZO1AIx8aakqK_0 2024-09-12T19:23:01.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13489322897028291810', time=2024-09-12T20:36:33.163264+0000, chain.objs.size()=1 2024-09-12T19:23:01.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.xQxvGiqIVoiosScJWFWJLftTnSPlYEH_0 2024-09-12T19:23:01.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5202532222620974355', time=2024-09-12T20:36:34.054552+0000, chain.objs.size()=1 2024-09-12T19:23:01.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Wt7USmDk6ucY1RjSpTTmOP7meeebnXC_0 2024-09-12T19:23:01.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9581168723746500466', time=2024-09-12T20:36:34.222678+0000, chain.objs.size()=1 2024-09-12T19:23:01.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.l9iYmGB2ZCMTaH1mtrrdDTGkp_ZCKxW_0 2024-09-12T19:23:01.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4388233927613123415', time=2024-09-12T20:36:36.297948+0000, chain.objs.size()=1 2024-09-12T19:23:01.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.6zjmwfhzK0F2LC6bFhlkA32K5ewaS6B_0 2024-09-12T19:23:01.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17476626495923467250', time=2024-09-12T20:36:37.075363+0000, chain.objs.size()=1 2024-09-12T19:23:01.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.gxTXcTXzvhR_4iOdEVALik5z4H1lCQb_0 2024-09-12T19:23:01.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1041463482825635819', time=2024-09-12T20:36:37.594326+0000, chain.objs.size()=1 2024-09-12T19:23:01.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.358+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.vgXseBmRK3K-AVk7nYLuHHkhWxgf-Dw_0 2024-09-12T19:23:01.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.362+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17242493468005428930', time=2024-09-12T20:36:37.727271+0000, chain.objs.size()=1 2024-09-12T19:23:01.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.362+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.VyBHAhgDxpX64djpkl_Ucr7wS-vD18f_0 2024-09-12T19:23:01.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.362+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9683674162423081683', time=2024-09-12T20:36:38.285557+0000, chain.objs.size()=1 2024-09-12T19:23:01.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.362+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.J3NvTjkgcZJnEbj3AMmQivHW8SUoKtH_0 2024-09-12T19:23:01.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.362+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7470862843170676980', time=2024-09-12T20:36:38.325402+0000, chain.objs.size()=1 2024-09-12T19:23:01.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.362+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.tzWcsCj9NX0_t3fjJNuxmtiAUS9CBPj_0 2024-09-12T19:23:01.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.366+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13346446217225729736', time=2024-09-12T20:36:39.504653+0000, chain.objs.size()=1 2024-09-12T19:23:01.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.366+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.M7WE-Xugu5k3ZdYPyElUDtnSEL6Qbg8_0 2024-09-12T19:23:01.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.366+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11430228474790805218', time=2024-09-12T20:36:40.401974+0000, chain.objs.size()=1 2024-09-12T19:23:01.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.366+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.RLvSMzrN2TYmCkj1NzwTYrENEob1nT3_0 2024-09-12T19:23:01.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.366+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14486750057687105426', time=2024-09-12T20:36:40.413649+0000, chain.objs.size()=1 2024-09-12T19:23:01.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.366+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ygOOS6neaVAPcSXxM_y-LVXszf92gdP_0 2024-09-12T19:23:01.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.366+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10375310218721173657', time=2024-09-12T20:36:41.706257+0000, chain.objs.size()=1 2024-09-12T19:23:01.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.366+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.zIOXPwJEXB2ddwt8jJn2W9Iy7lqcne7_0 2024-09-12T19:23:01.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.366+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12141163915796142030', time=2024-09-12T20:36:41.708165+0000, chain.objs.size()=1 2024-09-12T19:23:01.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.366+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.wCeC_u4RP_Y6Zsh3s--kwwKeQgrzgI0_0 2024-09-12T19:23:01.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.366+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16956985020089450361', time=2024-09-12T20:36:43.180173+0000, chain.objs.size()=1 2024-09-12T19:23:01.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.366+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.VMU6lCz2R4fFuIdTWRTM8uL2dkdZF53_0 2024-09-12T19:23:01.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.366+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7019961422311088987', time=2024-09-12T20:36:43.522505+0000, chain.objs.size()=1 2024-09-12T19:23:01.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.366+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.YtPkQMEPb75l_ctv6Z5xwV6kcmvcFS6_0 2024-09-12T19:23:01.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.366+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2552438176610088956', time=2024-09-12T20:36:44.100180+0000, chain.objs.size()=1 2024-09-12T19:23:01.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.366+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.D_kvHGH6wHYlViZdGIC3ZAsNclgj6xW_0 2024-09-12T19:23:01.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4160115829419261621', time=2024-09-12T20:36:46.023727+0000, chain.objs.size()=1 2024-09-12T19:23:01.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.RD_2rcYnZSw0pbs-WeLeUkLe3QgCU3u_0 2024-09-12T19:23:01.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11088296696606779804', time=2024-09-12T20:36:46.091315+0000, chain.objs.size()=1 2024-09-12T19:23:01.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.q3bqRebSjYzCrSarPgBq4I3hmjIoiCc_0 2024-09-12T19:23:01.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4817966976941099405', time=2024-09-12T20:36:46.970864+0000, chain.objs.size()=1 2024-09-12T19:23:01.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.YfuOE3jgud4EB-BtEQycR0b2jqNpYEK_0 2024-09-12T19:23:01.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7510395433829716853', time=2024-09-12T20:36:46.973312+0000, chain.objs.size()=1 2024-09-12T19:23:01.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Z068xCHuQs8AJw0DfKnHOFs3mX6IeWc_0 2024-09-12T19:23:01.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4293213745648474617', time=2024-09-12T20:36:48.260141+0000, chain.objs.size()=1 2024-09-12T19:23:01.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.-uUW0Y_jlG0g5NzptCd91zMWBfyb42V_0 2024-09-12T19:23:01.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17203632651995628770', time=2024-09-12T20:36:48.372149+0000, chain.objs.size()=1 2024-09-12T19:23:01.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_._VMBCyxaBAoLO-K_7S9Mu41KUGvdDu2_0 2024-09-12T19:23:01.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2972808431054961514', time=2024-09-12T20:36:48.650896+0000, chain.objs.size()=1 2024-09-12T19:23:01.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.hbv7XuOrqPeZAGlR6wPkm1-BS0SV4qc_0 2024-09-12T19:23:01.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4507574038956884680', time=2024-09-12T20:36:48.730883+0000, chain.objs.size()=1 2024-09-12T19:23:01.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.xhVC95H2mcFHi6wsdAOR_mY75H6xxra_0 2024-09-12T19:23:01.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2319924613143749214', time=2024-09-12T20:36:49.188612+0000, chain.objs.size()=1 2024-09-12T19:23:01.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.G8OZYe-uHLk6lng7CmiieG8c-rkBBdB_0 2024-09-12T19:23:01.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.723104022540469111', time=2024-09-12T20:36:52.272905+0000, chain.objs.size()=1 2024-09-12T19:23:01.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.p_0KCPaxwOd1Oggj-DwD7u7DMNtx6BR_0 2024-09-12T19:23:01.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10100787869870807061', time=2024-09-12T20:36:54.510335+0000, chain.objs.size()=1 2024-09-12T19:23:01.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.370+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.CRDFQWqs1vZ7DXhFBARXjyI_gno7STX_0 2024-09-12T19:23:01.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9222403997338141956', time=2024-09-12T20:36:56.003113+0000, chain.objs.size()=1 2024-09-12T19:23:01.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.xVl46taLflLQgeJ14W-A3jVAdCR-tiy_0 2024-09-12T19:23:01.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16157626542133989078', time=2024-09-12T20:36:56.269161+0000, chain.objs.size()=1 2024-09-12T19:23:01.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.F0TWnW1289Q16BiprcKS2y2DsfV_q9Z_0 2024-09-12T19:23:01.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16274265417885275780', time=2024-09-12T20:38:40.220487+0000, chain.objs.size()=1 2024-09-12T19:23:01.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.qQfARcKD3RtAcFFJvyc-1xcb2FrRSpT_0 2024-09-12T19:23:01.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7014080047787601790', time=2024-09-12T20:38:41.177992+0000, chain.objs.size()=1 2024-09-12T19:23:01.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.M8iw5VeNX2r1dm4UyWvVp4UNX3r0aNY_0 2024-09-12T19:23:01.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4397388621112312528', time=2024-09-12T20:38:41.618358+0000, chain.objs.size()=1 2024-09-12T19:23:01.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.diGdrCi9zekFOx15ruDTbQbWLA2yUJO_0 2024-09-12T19:23:01.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8607611614744383994', time=2024-09-12T20:38:41.643609+0000, chain.objs.size()=1 2024-09-12T19:23:01.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.BHtK4f298KmJ0cOkSEag50TmMfytNIX_0 2024-09-12T19:23:01.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5537317291097015053', time=2024-09-12T20:38:44.461377+0000, chain.objs.size()=1 2024-09-12T19:23:01.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.XnPJCqbuf-cbxnLYAcOMfxf6kEga847_0 2024-09-12T19:23:01.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16768895267329238008', time=2024-09-12T20:38:45.347652+0000, chain.objs.size()=1 2024-09-12T19:23:01.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.9fmjP4Xuf5NxlvfHHBly40uzJ3R3FmP_0 2024-09-12T19:23:01.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18352776890674844792', time=2024-09-12T20:38:49.437442+0000, chain.objs.size()=1 2024-09-12T19:23:01.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.3WRLpxm0Q_3u1zk6wtngiSRRZUCOXIr_0 2024-09-12T19:23:01.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7621075378082404', time=2024-09-12T20:38:49.890400+0000, chain.objs.size()=1 2024-09-12T19:23:01.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.guxl1BQGTZVsy-9QYfgIpstEl6BED7s_0 2024-09-12T19:23:01.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17912682325608058674', time=2024-09-12T20:38:53.045177+0000, chain.objs.size()=1 2024-09-12T19:23:01.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.374+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.GnS9BEEoGhsrJr6ri4a-THpwoneAC-H_0 2024-09-12T19:23:01.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.378+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17133221667721111539', time=2024-09-12T20:38:54.056065+0000, chain.objs.size()=1 2024-09-12T19:23:01.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.378+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.acma8wCbqKGBjKfGywiAp2abLQaDrq9_0 2024-09-12T19:23:01.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.378+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15245272399323469088', time=2024-09-12T20:38:54.935324+0000, chain.objs.size()=1 2024-09-12T19:23:01.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.378+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_._4ckCPojMYM0f58_LyX6DomH2yHjetM_0 2024-09-12T19:23:01.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.378+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4456185905756279477', time=2024-09-12T20:38:55.063152+0000, chain.objs.size()=1 2024-09-12T19:23:01.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.378+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.YckJQg1oiIQdOm8uhdFDmRkHkCAH9CA_0 2024-09-12T19:23:01.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.378+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5164231897786939448', time=2024-09-12T20:38:55.815575+0000, chain.objs.size()=1 2024-09-12T19:23:01.385 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.378+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.hdgJyRHC5BBR5TXXD1k_T9aTvr1mc9J_0 2024-09-12T19:23:01.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.382+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15818637376445871780', time=2024-09-12T20:38:56.732823+0000, chain.objs.size()=1 2024-09-12T19:23:01.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.382+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.38SFACDA0oxzz8BFIZOb00TlYcmOKOH_0 2024-09-12T19:23:01.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.382+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8929356431251386081', time=2024-09-12T20:38:58.683990+0000, chain.objs.size()=1 2024-09-12T19:23:01.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.382+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.1c9EbIilc12YdrSAvPfOlZ-QGqbCS4H_0 2024-09-12T19:23:01.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.382+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12336859483796217769', time=2024-09-12T20:38:58.686969+0000, chain.objs.size()=1 2024-09-12T19:23:01.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.382+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.M8PUa8ntmwhvjU7lNTbA8P9krl3db_u_0 2024-09-12T19:23:01.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.382+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11710761003094346304', time=2024-09-12T20:38:59.125092+0000, chain.objs.size()=1 2024-09-12T19:23:01.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.382+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.uxryxL6b8oz6mhhT9QBfV4niTfDOHJR_0 2024-09-12T19:23:01.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.382+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3613028187536489931', time=2024-09-12T20:39:02.993277+0000, chain.objs.size()=1 2024-09-12T19:23:01.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.382+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.p4FMprIEL_irYExugWQY3xV470GwuTk_0 2024-09-12T19:23:01.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.382+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5992874237386422035', time=2024-09-12T20:39:06.166604+0000, chain.objs.size()=1 2024-09-12T19:23:01.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.382+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.U-D35qErc6Aa7vvOQnXB9UerCHor25v_0 2024-09-12T19:23:01.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.382+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14498792155740523319', time=2024-09-12T20:39:07.036911+0000, chain.objs.size()=1 2024-09-12T19:23:01.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.382+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.EMUwq0NVJXSnZkoR9HIzLosBlfSWD-p_0 2024-09-12T19:23:01.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.386+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/42956 2024-09-12T19:23:01.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T19:23:01.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16393960036456334638', time=2024-09-12T20:39:17.332430+0000, chain.objs.size()=1 2024-09-12T19:23:01.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.329__shadow_.2LeiP2XYf79-rGtyZCaju_pGXhxouC1_0 2024-09-12T19:23:01.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15981447256386927983', time=2024-09-12T20:39:33.870451+0000, chain.objs.size()=1 2024-09-12T19:23:01.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.337__shadow_.ajGG-QHRt7bACNO61dBLdlrSwrRa11t_0 2024-09-12T19:23:01.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7047595090919412930', time=2024-09-12T20:39:39.223063+0000, chain.objs.size()=1 2024-09-12T19:23:01.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.340__shadow_.01KY6avZeOulrtAqBPRYpLabLUZ4PtT_0 2024-09-12T19:23:01.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9142931959174205030', time=2024-09-12T20:40:45.130874+0000, chain.objs.size()=1 2024-09-12T19:23:01.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.374__shadow_.FX1KwL4VYEpDQNu2wO8joGijsuiMGnL_0 2024-09-12T19:23:01.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14108822806775371769', time=2024-09-12T20:40:49.312094+0000, chain.objs.size()=1 2024-09-12T19:23:01.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.376__shadow_.HOkIhc2VMjmNbFf9-5q_h3JqZTQNfPg_0 2024-09-12T19:23:01.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9802829077622760328', time=2024-09-12T20:43:25.682487+0000, chain.objs.size()=1 2024-09-12T19:23:01.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.451__shadow_.fmWmzlYMIlbT47HcMs9bhzIYtmM3H23_0 2024-09-12T19:23:01.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16083927313755638387', time=2024-09-12T20:44:03.703902+0000, chain.objs.size()=1 2024-09-12T19:23:01.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.465__shadow_.Ros6OFgg5kQHLB03Bklt9kmGjKxlXpc_0 2024-09-12T19:23:01.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12173164152910831547', time=2024-09-12T20:45:05.686489+0000, chain.objs.size()=1 2024-09-12T19:23:01.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.496__shadow_.iWrpHAH4zOEuIIQ8qdR4qnwdNhI1WJz_0 2024-09-12T19:23:01.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16785897019826679168', time=2024-09-12T20:55:01.051083+0000, chain.objs.size()=1 2024-09-12T19:23:01.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.551__shadow_.XRw8Ga3gVROo5_pXDBtrUbOmEjzAsIf_0 2024-09-12T19:23:01.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17412615864016962332', time=2024-09-12T20:56:14.074074+0000, chain.objs.size()=1 2024-09-12T19:23:01.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.559__shadow_.CG31Ri1TVhYo1CNzbEkDDVNR7dpXZ-t_0 2024-09-12T19:23:01.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2423511412788503087', time=2024-09-12T20:57:36.186551+0000, chain.objs.size()=1 2024-09-12T19:23:01.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.576__shadow:0qUSOVjZ0WYegMQ62vdPB5fW6W.e93S_.s-yCA0ekrpuBeeApbTYA11F5ugFH8Ny_0 2024-09-12T19:23:01.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17789241179893961185', time=2024-09-12T20:58:14.998805+0000, chain.objs.size()=1 2024-09-12T19:23:01.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.390+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:qxmsludlrGL3MpSTKui7fiXqI9-RLP6_.1OWaA9wunI3x5Rkv22oiKgPfaN13dWB_0 2024-09-12T19:23:01.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.394+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4320120803183474686', time=2024-09-12T21:00:32.229807+0000, chain.objs.size()=1 2024-09-12T19:23:01.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.394+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.606__shadow_.bI8tqfPvE_WPZ8bCETvd7ugikM5tVQa_0 2024-09-12T19:23:01.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.394+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11041919167298428487', time=2024-09-12T21:07:39.965969+0000, chain.objs.size()=1 2024-09-12T19:23:01.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.394+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.643__shadow_.d_5RQ29PA4gT_oQZ-26KiyElKt2wU1K_0 2024-09-12T19:23:01.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.394+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8529825119621118068', time=2024-09-12T21:11:03.947412+0000, chain.objs.size()=1 2024-09-12T19:23:01.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.394+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.707__shadow:SF3tDp8wuZl1HflRITiJqxVJR4PdrhN_.qM0ouowsP-u7dIilzcyWelsJQZiisFY_0 2024-09-12T19:23:01.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.394+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7767730911348575977', time=2024-09-12T21:11:47.496658+0000, chain.objs.size()=1 2024-09-12T19:23:01.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.394+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.719__shadow_.k5dGKHFYFHfDmb5ua5Vz0mnqJbTx_ho_0 2024-09-12T19:23:01.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.398+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:01.407 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T19:23:01.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:01.408 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:01.409 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44606' 2024-09-12T19:23:01.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9812197780279593156', time=2024-09-12T20:25:23.693513+0000, chain.objs.size()=1 2024-09-12T19:23:01.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.203__shadow_.pnVlzoT-5_W16AXSrbxiyyGU6OXRb3Z_0 2024-09-12T19:23:01.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3325192740342012909', time=2024-09-12T20:29:34.781823+0000, chain.objs.size()=1 2024-09-12T19:23:01.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.249__shadow_.FgzcUJnrBitrcn0qeiGTtMBm-RirKZR_0 2024-09-12T19:23:01.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8802212305408452701', time=2024-09-12T20:31:45.281475+0000, chain.objs.size()=1 2024-09-12T19:23:01.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.92WbwBKs4ZJ7Z9duDekJZOv3UFNoXlS_0 2024-09-12T19:23:01.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6102929976268639329', time=2024-09-12T20:31:46.187200+0000, chain.objs.size()=1 2024-09-12T19:23:01.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.c9fQNPDK0H2OWByAqyUFlRXYDRO9diY_0 2024-09-12T19:23:01.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.297396492876900054', time=2024-09-12T20:31:46.306647+0000, chain.objs.size()=1 2024-09-12T19:23:01.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.AkmOtF3SRJCD7GzhOH4W4VfGZtRnfAw_0 2024-09-12T19:23:01.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17973303471649373900', time=2024-09-12T20:31:46.465074+0000, chain.objs.size()=1 2024-09-12T19:23:01.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.jSmhMra4kjovu0d7T5rsdZdz6vOy9mt_0 2024-09-12T19:23:01.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16296336315137319606', time=2024-09-12T20:31:47.282273+0000, chain.objs.size()=1 2024-09-12T19:23:01.410 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.eL9sQhxTdaHbZS2l05TN-zfPS9PKywp_0 2024-09-12T19:23:01.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13606436097647167593', time=2024-09-12T20:31:47.792437+0000, chain.objs.size()=1 2024-09-12T19:23:01.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Mj4Jxe1JypYb9V9JwJAuI2beTja9epz_0 2024-09-12T19:23:01.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7592528257267578828', time=2024-09-12T20:31:49.727638+0000, chain.objs.size()=1 2024-09-12T19:23:01.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.pDiB_VbLC14xS0Xnfse1gMeugwRDttm_0 2024-09-12T19:23:01.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12004231858700408909', time=2024-09-12T20:31:50.864170+0000, chain.objs.size()=1 2024-09-12T19:23:01.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.5TV5eA-S_cOuHHtfLase7djgZXPugQx_0 2024-09-12T19:23:01.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7542206431056970751', time=2024-09-12T20:31:51.724079+0000, chain.objs.size()=1 2024-09-12T19:23:01.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.FPsHddNYsDvC0l82uVtjkiqzJ-y9Cr__0 2024-09-12T19:23:01.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9248748478474453716', time=2024-09-12T20:31:53.139657+0000, chain.objs.size()=1 2024-09-12T19:23:01.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.402+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ASNiy-wBVgctnBCD4WSI_8H1vjsGvBa_0 2024-09-12T19:23:01.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.406+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15389573226264045743', time=2024-09-12T20:31:53.596536+0000, chain.objs.size()=1 2024-09-12T19:23:01.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.406+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.NBkQbmun6oJ7Xmgg7-HGPXMNdFWlgCq_0 2024-09-12T19:23:01.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.406+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13416815632333961440', time=2024-09-12T20:31:55.209101+0000, chain.objs.size()=1 2024-09-12T19:23:01.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.406+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.l6m9NZ3VLooOLrLidJ7UO6xirtBML9g_0 2024-09-12T19:23:01.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.406+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.866369374155052361', time=2024-09-12T20:31:55.424713+0000, chain.objs.size()=1 2024-09-12T19:23:01.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.406+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.8WStIGa3Pcjw6YIZLqRhAvI7kwTEiRM_0 2024-09-12T19:23:01.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.406+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7434762014070744557', time=2024-09-12T20:31:55.529413+0000, chain.objs.size()=1 2024-09-12T19:23:01.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.406+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.CriZrzDEa9N0rTEdpHU7uCTiFjHjBgp_0 2024-09-12T19:23:01.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.410+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.389544798863078909', time=2024-09-12T20:31:56.902059+0000, chain.objs.size()=1 2024-09-12T19:23:01.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.410+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ZoeGZcGAXLOJciy4BiziOdeYMrVLwti_0 2024-09-12T19:23:01.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.410+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10184733920283774057', time=2024-09-12T20:31:57.503984+0000, chain.objs.size()=1 2024-09-12T19:23:01.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.410+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.AkJsOq0nm4VA0JwoxRGYLu4ovaSpbjf_0 2024-09-12T19:23:01.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.410+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1127540981125851088', time=2024-09-12T20:31:58.152244+0000, chain.objs.size()=1 2024-09-12T19:23:01.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.410+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.pp1EtciQLpWlUWADZs1b3yUocXuSZAl_0 2024-09-12T19:23:01.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.410+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2586524839265012795', time=2024-09-12T20:31:58.578291+0000, chain.objs.size()=1 2024-09-12T19:23:01.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.410+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.UZ-E9evv_TqYK1d9uys2yzA48gLGSeC_0 2024-09-12T19:23:01.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.410+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3490350126043410068', time=2024-09-12T20:31:58.580242+0000, chain.objs.size()=1 2024-09-12T19:23:01.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.410+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.A0Y2MIUdf3e0_H6BgnfnFCYpANP2UJs_0 2024-09-12T19:23:01.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.410+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12410944201390901484', time=2024-09-12T20:31:59.184858+0000, chain.objs.size()=1 2024-09-12T19:23:01.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.410+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.WfF_VQSJv1uFpq1LIhQ3N4HWkgAlfgh_0 2024-09-12T19:23:01.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.410+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9468354488319729817', time=2024-09-12T20:31:59.444461+0000, chain.objs.size()=1 2024-09-12T19:23:01.415 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.410+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.-zf9SLrD8djG1RRiJg5ELKQzZEOD2eg_0 2024-09-12T19:23:01.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.410+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3123731412800338134', time=2024-09-12T20:31:59.446722+0000, chain.objs.size()=1 2024-09-12T19:23:01.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.410+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.m3SmXTIlB0NQ4LI9s72kHcjZ9jr85uX_0 2024-09-12T19:23:01.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.410+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15581836272489853670', time=2024-09-12T20:32:01.544991+0000, chain.objs.size()=1 2024-09-12T19:23:01.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.410+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Tk0CbUsvJSdIvFA_EOYPs8_JMR03tUC_0 2024-09-12T19:23:01.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6289806268865313637', time=2024-09-12T20:32:02.838248+0000, chain.objs.size()=1 2024-09-12T19:23:01.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ycnOx2a2zYn-k4AVCk_T2DRnBl_cGL7_0 2024-09-12T19:23:01.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.576111610874453675', time=2024-09-12T20:32:02.916109+0000, chain.objs.size()=1 2024-09-12T19:23:01.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.EHXIh1TqSuVZ6ZN1_n6d-liRzd1ys_O_0 2024-09-12T19:23:01.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2108196466043239798', time=2024-09-12T20:32:04.499530+0000, chain.objs.size()=1 2024-09-12T19:23:01.418 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.E6R8yh06EUnKaqEOHOMKhIvvYWe0nsE_0 2024-09-12T19:23:01.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.762084381310485969', time=2024-09-12T20:32:04.770816+0000, chain.objs.size()=1 2024-09-12T19:23:01.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.sEcvoMo_iWjfYMaDArt11Qfl0OQ0BJT_0 2024-09-12T19:23:01.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16035775472327907668', time=2024-09-12T20:32:06.781679+0000, chain.objs.size()=1 2024-09-12T19:23:01.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.tBboqfOdVP5egggWVcGDUAWcnrNi2if_0 2024-09-12T19:23:01.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12429953669241990416', time=2024-09-12T20:32:08.362266+0000, chain.objs.size()=1 2024-09-12T19:23:01.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.H5iINorCw1YUiVUJ2GywN6OSVX2WYF__0 2024-09-12T19:23:01.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8459377780311432000', time=2024-09-12T20:32:08.457580+0000, chain.objs.size()=1 2024-09-12T19:23:01.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.lxWszNUYmKLpiSld4xOikUpOPO7_soZ_0 2024-09-12T19:23:01.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2361495377155361758', time=2024-09-12T20:32:08.624182+0000, chain.objs.size()=1 2024-09-12T19:23:01.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.F3K21K67Iy1v6TJ0LZjnkVNPnkNQ0Rt_0 2024-09-12T19:23:01.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16299857011132703951', time=2024-09-12T20:32:08.968955+0000, chain.objs.size()=1 2024-09-12T19:23:01.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.5bggAt3O3XyKAT6fNcAm7rbcDvqopmv_0 2024-09-12T19:23:01.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2272737321544533863', time=2024-09-12T20:32:09.772079+0000, chain.objs.size()=1 2024-09-12T19:23:01.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.WPPZWbuVs4mNM86fw5W7hSA1L1Evbp0_0 2024-09-12T19:23:01.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16626556514915164710', time=2024-09-12T20:32:10.084673+0000, chain.objs.size()=1 2024-09-12T19:23:01.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.414+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.LMp5qg4EStGMGaO3EGhBtkY3o_gL4Tl_0 2024-09-12T19:23:01.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.418+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8170609224842571983', time=2024-09-12T20:32:13.546491+0000, chain.objs.size()=1 2024-09-12T19:23:01.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.418+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.9V74vPcQshxdULT0UbCAPPg77FxAAWq_0 2024-09-12T19:23:01.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.418+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10036901576093030390', time=2024-09-12T20:32:16.207503+0000, chain.objs.size()=1 2024-09-12T19:23:01.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.418+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.263__shadow_.zhlv7iTtYUUJLqJuHJF4lCpacWCb-KM_0 2024-09-12T19:23:01.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.418+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3898464009134631687', time=2024-09-12T20:32:24.994143+0000, chain.objs.size()=1 2024-09-12T19:23:01.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.418+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.267__shadow_.JQ2kyAUA2zjQ-eHDr6xuEnnhpo3DYhA_0 2024-09-12T19:23:01.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15937444486767166645', time=2024-09-12T20:32:40.227675+0000, chain.objs.size()=1 2024-09-12T19:23:01.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.274__shadow_.-4cT3HEjYm4Nqi5jucsbbItQM0ht0tX_0 2024-09-12T19:23:01.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16109575467870014478', time=2024-09-12T20:33:50.320641+0000, chain.objs.size()=1 2024-09-12T19:23:01.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.301__shadow_.KQrnbvtqOrOaReFy4nRiFzosrabIRjf_0 2024-09-12T19:23:01.427 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14322579102696339252', time=2024-09-12T20:36:27.928602+0000, chain.objs.size()=1 2024-09-12T19:23:01.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.HhSB29jeh6NZNCJEyw-uFJt3aP9S9tI_0 2024-09-12T19:23:01.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14004399544966638519', time=2024-09-12T20:36:29.134675+0000, chain.objs.size()=1 2024-09-12T19:23:01.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.st7mx_YhDqigWKnPteFlIDT-i7fAcwW_0 2024-09-12T19:23:01.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5408978233724435306', time=2024-09-12T20:36:32.323503+0000, chain.objs.size()=1 2024-09-12T19:23:01.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.h7unul_rFqqasc8EoalioYGxQaKtyhD_0 2024-09-12T19:23:01.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4268330271347952731', time=2024-09-12T20:36:32.687449+0000, chain.objs.size()=1 2024-09-12T19:23:01.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.vyhdSSaXAB-Km_5ZZAkwXbuqEp3Zrnw_0 2024-09-12T19:23:01.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5681802173858916979', time=2024-09-12T20:36:33.063542+0000, chain.objs.size()=1 2024-09-12T19:23:01.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.eLjzC8OmphcaBM96pJUNICQ-ku6um5S_0 2024-09-12T19:23:01.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6917442742146731378', time=2024-09-12T20:36:33.787441+0000, chain.objs.size()=1 2024-09-12T19:23:01.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.tkD3R6JglL4wwdcJPc-i9Sv0wAKiyoI_0 2024-09-12T19:23:01.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8197902482416555019', time=2024-09-12T20:36:35.773613+0000, chain.objs.size()=1 2024-09-12T19:23:01.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.-U50RwfU-r_2R3r0iwnGuHl3vhvpyTd_0 2024-09-12T19:23:01.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15624510480216780263', time=2024-09-12T20:36:36.253603+0000, chain.objs.size()=1 2024-09-12T19:23:01.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.oC5pfY0H9M32_onekz-WqrkA5i5Vb5J_0 2024-09-12T19:23:01.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9128105658995794566', time=2024-09-12T20:36:37.518495+0000, chain.objs.size()=1 2024-09-12T19:23:01.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.nCvtOsxBx_nNYWLKe9-VrfcJEJGYjm6_0 2024-09-12T19:23:01.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.193545952259011892', time=2024-09-12T20:36:38.280349+0000, chain.objs.size()=1 2024-09-12T19:23:01.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.422+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.d5Wx42MakGwQG1Al-OoAy5MEWOIozG5_0 2024-09-12T19:23:01.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.426+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12087959158274715160', time=2024-09-12T20:36:40.618457+0000, chain.objs.size()=1 2024-09-12T19:23:01.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.426+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.kTqK3LG8YQcvH3x4InQ5WcktR8HXeoS_0 2024-09-12T19:23:01.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.426+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17412322253460010460', time=2024-09-12T20:36:41.233370+0000, chain.objs.size()=1 2024-09-12T19:23:01.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.426+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.V8LGpbpbQppDLMB2VTfis7T13b3S0kj_0 2024-09-12T19:23:01.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.426+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1731019133027246424', time=2024-09-12T20:36:42.224431+0000, chain.objs.size()=1 2024-09-12T19:23:01.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.426+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.j-s22N7cv5j0bXbH5XUn8eelsoFRHRH_0 2024-09-12T19:23:01.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.426+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10468933168171002129', time=2024-09-12T20:36:43.265580+0000, chain.objs.size()=1 2024-09-12T19:23:01.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.426+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ho2q2RyFPG3yfrK5rdlPjgG4M5HwHJC_0 2024-09-12T19:23:01.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.426+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5490423193439663692', time=2024-09-12T20:36:43.910674+0000, chain.objs.size()=1 2024-09-12T19:23:01.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.426+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ds7Um9IQkdGaRsIqK9bwEpmjkaFDd7D_0 2024-09-12T19:23:01.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.426+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6006388464180475888', time=2024-09-12T20:36:43.971485+0000, chain.objs.size()=1 2024-09-12T19:23:01.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.426+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.2_jIJ9eq9yCVKvGqwStaShuKTy_PnMv_0 2024-09-12T19:23:01.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.426+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11735718976333083213', time=2024-09-12T20:36:45.280622+0000, chain.objs.size()=1 2024-09-12T19:23:01.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.426+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.qBCPPyPZci2-GGMEvseD49H_l_6ppGD_0 2024-09-12T19:23:01.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11422525044917850717', time=2024-09-12T20:36:45.378053+0000, chain.objs.size()=1 2024-09-12T19:23:01.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ogzkzWnlgRlKlRSD2ckUkbGL-GQBVnE_0 2024-09-12T19:23:01.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15384517404602236683', time=2024-09-12T20:36:47.478647+0000, chain.objs.size()=1 2024-09-12T19:23:01.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.kChsCv2UhBlnEAqbYtZbiVkjjDD02R-_0 2024-09-12T19:23:01.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11809970563302966840', time=2024-09-12T20:36:48.648177+0000, chain.objs.size()=1 2024-09-12T19:23:01.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ohU4jaGvWR3zykW2NVS3Y0ymbDPQzPR_0 2024-09-12T19:23:01.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.430+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18409252624248962549', time=2024-09-12T20:36:49.049912+0000, chain.objs.size()=1 2024-09-12T19:23:01.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.430+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.VWC67mbDItcoX7RqRiWwxuu6q4NJSRN_0 2024-09-12T19:23:01.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5608660092998143026', time=2024-09-12T20:36:50.723876+0000, chain.objs.size()=1 2024-09-12T19:23:01.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.FUm5dF0KceH2EYv4W2XBl9nOeLyrkk6_0 2024-09-12T19:23:01.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14544916741708018031', time=2024-09-12T20:36:50.899923+0000, chain.objs.size()=1 2024-09-12T19:23:01.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.qO5swKgLyw5AkJk6qZy_PmZC667ZtrV_0 2024-09-12T19:23:01.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10192604266776955242', time=2024-09-12T20:36:51.388694+0000, chain.objs.size()=1 2024-09-12T19:23:01.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.7hS9lB_MpzH31fr9Uo16i6vVAMhQ658_0 2024-09-12T19:23:01.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2680157843311962213', time=2024-09-12T20:36:53.066027+0000, chain.objs.size()=1 2024-09-12T19:23:01.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.m50eCZLV5oqzbhZtY8JtjtwPKAkwoqO_0 2024-09-12T19:23:01.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3937338251317264003', time=2024-09-12T20:36:53.358874+0000, chain.objs.size()=1 2024-09-12T19:23:01.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.EXn9A6d01gqGULOkqNllCIXtATZ5HSD_0 2024-09-12T19:23:01.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11369256317652929883', time=2024-09-12T20:36:54.124445+0000, chain.objs.size()=1 2024-09-12T19:23:01.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.OZh4XwDw8pK0YUuTvnqGVQz5hnmw-iI_0 2024-09-12T19:23:01.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15008034566790292568', time=2024-09-12T20:36:54.474561+0000, chain.objs.size()=1 2024-09-12T19:23:01.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.5OeqSHmOD1H667U3M67eJTc6-EgL9Ov_0 2024-09-12T19:23:01.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10877935139337110051', time=2024-09-12T20:36:54.741483+0000, chain.objs.size()=1 2024-09-12T19:23:01.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.-bs9eFfmyPSfezK3IVHRV-AErrLbOyL_0 2024-09-12T19:23:01.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17907709472626268075', time=2024-09-12T20:36:55.468679+0000, chain.objs.size()=1 2024-09-12T19:23:01.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.F3UHiGJLbskJ3K6HltKi2SqPGGOqALS_0 2024-09-12T19:23:01.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.434+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1579632581096549347', time=2024-09-12T20:36:55.754647+0000, chain.objs.size()=1 2024-09-12T19:23:01.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.434+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.q15IhNKhEbVKrB1m8bhidrhGbyRoiXZ_0 2024-09-12T19:23:01.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1245302679636556517', time=2024-09-12T20:38:39.752434+0000, chain.objs.size()=1 2024-09-12T19:23:01.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.IzH1X_-lii3sOfbu20WLrThZph4OqCC_0 2024-09-12T19:23:01.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17007867404048354540', time=2024-09-12T20:38:39.840984+0000, chain.objs.size()=1 2024-09-12T19:23:01.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.jk5NRZVDMepxArmevazZoIS4t4et9pC_0 2024-09-12T19:23:01.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8230558922654699546', time=2024-09-12T20:38:41.170065+0000, chain.objs.size()=1 2024-09-12T19:23:01.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.k0ehysCofhNA0QFbaeUjk7vUfQaObUy_0 2024-09-12T19:23:01.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2915106859124677814', time=2024-09-12T20:38:42.245125+0000, chain.objs.size()=1 2024-09-12T19:23:01.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.kY37ScNf-f3rrYUGRMOgpxEO2NzWwrk_0 2024-09-12T19:23:01.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2350419995758399504', time=2024-09-12T20:38:45.233591+0000, chain.objs.size()=1 2024-09-12T19:23:01.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.oq9NJwJl3P4JjCEHL5_4CKg_zBo7sfA_0 2024-09-12T19:23:01.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7313723848348689920', time=2024-09-12T20:38:45.533845+0000, chain.objs.size()=1 2024-09-12T19:23:01.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.FxDl17QCP-j4dolUu7qXmmEViq4MIKQ_0 2024-09-12T19:23:01.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17328452460788129494', time=2024-09-12T20:38:47.510562+0000, chain.objs.size()=1 2024-09-12T19:23:01.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.SmfNbbHuzVoctL2S_bZhKNlE2KotRQS_0 2024-09-12T19:23:01.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.438+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5556104881348766866', time=2024-09-12T20:38:49.472665+0000, chain.objs.size()=1 2024-09-12T19:23:01.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.438+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.srHYs_oUi64KzgRngu5aJ8u2hH_zA5P_0 2024-09-12T19:23:01.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16092304390898244423', time=2024-09-12T20:38:49.743377+0000, chain.objs.size()=1 2024-09-12T19:23:01.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.UWq_myW14fqILVThjnNJRLIT7V5A9ap_0 2024-09-12T19:23:01.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11825369155172131792', time=2024-09-12T20:38:51.759917+0000, chain.objs.size()=1 2024-09-12T19:23:01.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.u49Yq-86_FcbGojCGsjdF5ZhmlkAygt_0 2024-09-12T19:23:01.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.751152888886392880', time=2024-09-12T20:38:52.648150+0000, chain.objs.size()=1 2024-09-12T19:23:01.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ObnM66xnCA0kUI68KRKYgZ9zsIGdgj1_0 2024-09-12T19:23:01.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14548243097502390882', time=2024-09-12T20:38:52.929577+0000, chain.objs.size()=1 2024-09-12T19:23:01.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.5z_OQHhi5J_XN7YUNaILWBE4JVtchyB_0 2024-09-12T19:23:01.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10925619538636220360', time=2024-09-12T20:38:53.029681+0000, chain.objs.size()=1 2024-09-12T19:23:01.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Kh_wWzbiEjIVPNAGKeY3HSestb58zMu_0 2024-09-12T19:23:01.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2298568341764984263', time=2024-09-12T20:38:55.037063+0000, chain.objs.size()=1 2024-09-12T19:23:01.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.WhpWMGY1r9bNHsHRMn31cvJgcDOLO3v_0 2024-09-12T19:23:01.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1990959144193164715', time=2024-09-12T20:39:00.507304+0000, chain.objs.size()=1 2024-09-12T19:23:01.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.yfBCMNOSsauaRI0u_mfumL3_tb_c5e6_0 2024-09-12T19:23:01.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5060473429103473208', time=2024-09-12T20:39:02.187805+0000, chain.objs.size()=1 2024-09-12T19:23:01.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.F4KEJHEreMV10___gKM9Jti1eljkLku_0 2024-09-12T19:23:01.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8751535830235500327', time=2024-09-12T20:39:03.337706+0000, chain.objs.size()=1 2024-09-12T19:23:01.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.fO_KX1tjJnGH0NfcGJQvx9wpnxRtvLq_0 2024-09-12T19:23:01.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.953271308616727013', time=2024-09-12T20:39:04.091694+0000, chain.objs.size()=1 2024-09-12T19:23:01.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.BiYEzvie1bTXdTMr3YuaRAEBvNKpBqr_0 2024-09-12T19:23:01.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4363487317811488931', time=2024-09-12T20:39:04.587000+0000, chain.objs.size()=1 2024-09-12T19:23:01.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.442+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.lPEXA6KA7LBhn8NJwmP9ylYUI_cz81L_0 2024-09-12T19:23:01.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9512661582376219850', time=2024-09-12T20:39:05.046676+0000, chain.objs.size()=1 2024-09-12T19:23:01.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.PFsquhWxo7hDfW_iPsTbVO-iy8T43Yw_0 2024-09-12T19:23:01.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14473585308674288240', time=2024-09-12T20:39:05.048602+0000, chain.objs.size()=1 2024-09-12T19:23:01.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.c4I4TDujdai3tmwPkBbocMgxx41PPyG_0 2024-09-12T19:23:01.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3690592918877976359', time=2024-09-12T20:39:06.086117+0000, chain.objs.size()=1 2024-09-12T19:23:01.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.yxB2s1_jEAD4aO_8pnTxha0VweA5v2i_0 2024-09-12T19:23:01.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13046512652281001057', time=2024-09-12T20:39:06.706413+0000, chain.objs.size()=1 2024-09-12T19:23:01.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.AbeVcXDmR1q7KCMHeHHUUGX3Kr_jAIY_0 2024-09-12T19:23:01.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.446+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17675316360312853456', time=2024-09-12T20:39:06.911138+0000, chain.objs.size()=1 2024-09-12T19:23:01.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.446+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.VFeBZ6tEHIhhy43nVGNPjDVMZjhWEgl_0 2024-09-12T19:23:01.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.450+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5626751796465568842', time=2024-09-12T20:39:06.960794+0000, chain.objs.size()=1 2024-09-12T19:23:01.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.450+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.WMrwctUbAZGZFzW_sTskvuhqW0HlUUp_0 2024-09-12T19:23:01.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.450+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13377623137026679077', time=2024-09-12T20:39:07.830509+0000, chain.objs.size()=1 2024-09-12T19:23:01.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.450+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.sePiGOLI7X8dqiJ_HpdSz_nf-N1k_Ni_0 2024-09-12T19:23:01.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.450+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11475705847071724372', time=2024-09-12T20:40:42.056806+0000, chain.objs.size()=1 2024-09-12T19:23:01.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.450+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.373__shadow_.Bs_MWp7yQOketObuC0ailjXjiAaH9hK_0 2024-09-12T19:23:01.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.450+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13654344363131017693', time=2024-09-12T20:40:55.342622+0000, chain.objs.size()=1 2024-09-12T19:23:01.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.450+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.379__shadow_.vd7Zz2KXDJslhccg0JwwkP7UQGsGGBF_0 2024-09-12T19:23:01.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44606 2024-09-12T19:23:01.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T19:23:01.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9944247583142663648', time=2024-09-12T20:44:06.700759+0000, chain.objs.size()=1 2024-09-12T19:23:01.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.466__shadow_.5BvTZX-nenXG7UZfOs6odtbRQ_7-Pan_0 2024-09-12T19:23:01.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9714010660069216315', time=2024-09-12T20:46:48.159815+0000, chain.objs.size()=1 2024-09-12T19:23:01.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.517__shadow_.rJfCtvFAlI9y5Di0GgZE239-WPttwD0_0 2024-09-12T19:23:01.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~kLVYMm_udyc_r4beeZ9M7SM7D3Nycef', time=2024-09-12T20:53:33.984274+0000, chain.objs.size()=1 2024-09-12T19:23:01.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.534__multipart_mymultipart.2~kLVYMm_udyc_r4beeZ9M7SM7D3Nycef.1 2024-09-12T19:23:01.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5047065842886914429', time=2024-09-12T20:56:56.560270+0000, chain.objs.size()=1 2024-09-12T19:23:01.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:db5BYaB1K4E6p.2mHy6Ns7n1DjYEf9N_.eUHFpaD4xubow7kC-t9nfg7XImd71bG_0 2024-09-12T19:23:01.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10945977711934376371', time=2024-09-12T20:57:38.942222+0000, chain.objs.size()=1 2024-09-12T19:23:01.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.576__shadow:nzIA9OSy3pbsmVjCVcl0809adSN1Ypb_.mziaI4xJPwzOA23tkV51x81r7os0F5K_0 2024-09-12T19:23:01.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16005227851764738153', time=2024-09-12T20:57:41.132860+0000, chain.objs.size()=1 2024-09-12T19:23:01.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.576__shadow:s91m30sq9pLd1t5ZJhYk-tmWo5I9yWF_.K1aTNqjZCr04b7ZDIZ6e9xKJ9ASw74q_0 2024-09-12T19:23:01.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6840193463589304285', time=2024-09-12T20:58:06.253980+0000, chain.objs.size()=1 2024-09-12T19:23:01.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:DHSf8FplJ-PI8WIAWGAWZWGbdOsgTXf_.bKAFnXqDenCPuSV1IrkoC9jNfoc4PHD_0 2024-09-12T19:23:01.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17994356432211640778', time=2024-09-12T20:59:29.639995+0000, chain.objs.size()=1 2024-09-12T19:23:01.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.579__shadow:kPSF0zCnIm-BSgnKdDXIQ0XecgKgyr6_.rv3en7-rVdgckmuoKK28KNcWLCMhTMH_0 2024-09-12T19:23:01.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16115139761804098966', time=2024-09-12T21:06:58.316578+0000, chain.objs.size()=1 2024-09-12T19:23:01.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.626__shadow_.MNvzE8QCsD6QiV1Mj986by2AFCcCyqP_0 2024-09-12T19:23:01.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2251774760013852826', time=2024-09-12T21:09:55.040341+0000, chain.objs.size()=1 2024-09-12T19:23:01.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.671__shadow_.koZvdNu5t6FyTmV-WiLKcI5KY7qaYfp_0 2024-09-12T19:23:01.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7768424871824995633', time=2024-09-12T21:10:09.315231+0000, chain.objs.size()=1 2024-09-12T19:23:01.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.679__shadow_.Rzmvgik9WW3KMuQLbXz6qjD6BFgkxZI_0 2024-09-12T19:23:01.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3652055778431470071', time=2024-09-12T21:10:38.053247+0000, chain.objs.size()=1 2024-09-12T19:23:01.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.454+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.695__shadow_.MSImSK40EJhU0NxZjHz3fajYycbAbX9_0 2024-09-12T19:23:01.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.458+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~-CL0LC5FXaWygH4Df1gFSU5hBP28RaE', time=2024-09-12T21:13:03.893533+0000, chain.objs.size()=1 2024-09-12T19:23:01.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.458+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.742__multipart_mymultipart.2~-CL0LC5FXaWygH4Df1gFSU5hBP28RaE.1 2024-09-12T19:23:01.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.466+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:01.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.466+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T19:23:01.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:01.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:01.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49018' 2024-09-12T19:23:01.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9924596034145014', time=2024-09-12T20:22:16.491650+0000, chain.objs.size()=3 2024-09-12T19:23:01.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.159__multipart_mymultipart-STANDARD.2~p7tHPy-J6RBBaBh-5entZdY1QftIJyf.1 2024-09-12T19:23:01.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.159__multipart_mymultipart-STANDARD.2~p7tHPy-J6RBBaBh-5entZdY1QftIJyf.2 2024-09-12T19:23:01.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.159__multipart_mymultipart-STANDARD.2~p7tHPy-J6RBBaBh-5entZdY1QftIJyf.3 2024-09-12T19:23:01.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11800092306033613466', time=2024-09-12T20:22:22.058547+0000, chain.objs.size()=1 2024-09-12T19:23:01.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.160__shadow_.MjC8MCxABUKlzG0PUTG16YuyZ7y-Zmf_0 2024-09-12T19:23:01.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3924716252978969837', time=2024-09-12T20:28:57.109756+0000, chain.objs.size()=1 2024-09-12T19:23:01.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.235__shadow_.Uty3QHtG2drkDmY_Hu1FS3RmDzphGWf_0 2024-09-12T19:23:01.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10725400872969260330', time=2024-09-12T20:28:57.130071+0000, chain.objs.size()=1 2024-09-12T19:23:01.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.235__shadow_.rb7PfuHs5zBI8WvZ_sDo53-pOT0UzGn_0 2024-09-12T19:23:01.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15132787785888746668', time=2024-09-12T20:29:07.148792+0000, chain.objs.size()=1 2024-09-12T19:23:01.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.238__shadow_.prcftDuzYaJtVP5P1AVnjQbtCbPRbOq_0 2024-09-12T19:23:01.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13906213885056552912', time=2024-09-12T20:29:15.551266+0000, chain.objs.size()=1 2024-09-12T19:23:01.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.242__shadow_.zeSMpSzvgm40bnpIE3TqPj8aCQ7REcz_0 2024-09-12T19:23:01.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11646391171672037182', time=2024-09-12T20:29:30.183980+0000, chain.objs.size()=1 2024-09-12T19:23:01.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.247__shadow_.iku_QeyVh5HOhYlVFzUCBdwrccAe0Pn_0 2024-09-12T19:23:01.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13016339313129300359', time=2024-09-12T20:29:44.020206+0000, chain.objs.size()=1 2024-09-12T19:23:01.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.253__shadow_.0WJJYbKzJZUGm-HDgZMMhiPAIn5vZTb_0 2024-09-12T19:23:01.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3260078001142537159', time=2024-09-12T20:29:55.353030+0000, chain.objs.size()=1 2024-09-12T19:23:01.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.258__shadow_.ZIFPW7xOOcUpFgDJnoIwgpki7fC6dc9_0 2024-09-12T19:23:01.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10001864801255136702', time=2024-09-12T20:31:47.262109+0000, chain.objs.size()=1 2024-09-12T19:23:01.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.470+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.tgwn4ry1vBkynltpjMQdcfj5goK6K7x_0 2024-09-12T19:23:01.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.474+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8313165171157460795', time=2024-09-12T20:31:47.358408+0000, chain.objs.size()=1 2024-09-12T19:23:01.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.474+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Vy7JTBcdElyVrS5Yiy1o4pQKpx9Wenv_0 2024-09-12T19:23:01.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.474+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15943986447462533425', time=2024-09-12T20:31:47.812105+0000, chain.objs.size()=1 2024-09-12T19:23:01.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.474+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.fYMzQ-xP1vwi0fRr1LepI_g-wEyxkMs_0 2024-09-12T19:23:01.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.474+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7008362050803577927', time=2024-09-12T20:31:49.297058+0000, chain.objs.size()=1 2024-09-12T19:23:01.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.474+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.8mVQ8PMx0LFvJtzISycTF5FJxQ-IwzI_0 2024-09-12T19:23:01.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.474+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11852042897520415676', time=2024-09-12T20:31:50.206200+0000, chain.objs.size()=1 2024-09-12T19:23:01.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.474+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.CfGJlG7IwNWXYKWIV89qnHnfKZEw08q_0 2024-09-12T19:23:01.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.478+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16402003651876082481', time=2024-09-12T20:31:50.207872+0000, chain.objs.size()=1 2024-09-12T19:23:01.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.478+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.gxuAnWclEUQTCmARU9GWE_PPGLLn0Ca_0 2024-09-12T19:23:01.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.478+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12579427556336589954', time=2024-09-12T20:31:50.410358+0000, chain.objs.size()=1 2024-09-12T19:23:01.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.478+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.9aLTBYi3AZ1G-lh76QqEnNA4aHDw6Od_0 2024-09-12T19:23:01.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.478+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7245254161533793271', time=2024-09-12T20:31:53.192456+0000, chain.objs.size()=1 2024-09-12T19:23:01.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.478+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.qOiidbGBjzUpJfgWwseUcfvGRSg3qo3_0 2024-09-12T19:23:01.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.478+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8133424397643910620', time=2024-09-12T20:31:53.496880+0000, chain.objs.size()=1 2024-09-12T19:23:01.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.478+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.rhpsudiS56nKZ-No-Cofj2GYom-Mi6C_0 2024-09-12T19:23:01.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.478+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7537181541991686703', time=2024-09-12T20:31:54.178317+0000, chain.objs.size()=1 2024-09-12T19:23:01.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.478+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.aR_4opdIAeVu2xoeLRVBvn9gV6dG995_0 2024-09-12T19:23:01.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.478+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10107104875598721185', time=2024-09-12T20:31:54.251164+0000, chain.objs.size()=1 2024-09-12T19:23:01.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.478+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.gTkSi0DrRqg5uqwXmIu0UtbSaBYl6zF_0 2024-09-12T19:23:01.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.478+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4771832645616565785', time=2024-09-12T20:31:54.934250+0000, chain.objs.size()=1 2024-09-12T19:23:01.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.478+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ocpc8-zqVgozOxaerHXzzR9rArVR10n_0 2024-09-12T19:23:01.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.478+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9823676174496584914', time=2024-09-12T20:31:55.216754+0000, chain.objs.size()=1 2024-09-12T19:23:01.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.478+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_._3ov_D3ehMMn_rDyHFq4UshOC4aFDky_0 2024-09-12T19:23:01.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17913962869390764339', time=2024-09-12T20:31:55.355219+0000, chain.objs.size()=1 2024-09-12T19:23:01.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.NLDjZzFclxDuOQq0QW-MfV1bYd67L1S_0 2024-09-12T19:23:01.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3633022103955291729', time=2024-09-12T20:31:55.524691+0000, chain.objs.size()=1 2024-09-12T19:23:01.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.rNdkHDSL-l3gDRBzMRIbWp1EeMiSKKe_0 2024-09-12T19:23:01.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13342194011708488224', time=2024-09-12T20:31:55.806244+0000, chain.objs.size()=1 2024-09-12T19:23:01.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.lBAkOC97OuDzmafhzbLTL4gbQwXPr-T_0 2024-09-12T19:23:01.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13859657700890498813', time=2024-09-12T20:31:55.898277+0000, chain.objs.size()=1 2024-09-12T19:23:01.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.u99Fm7D0yA5uQ_PJMYHDk22fynuKImf_0 2024-09-12T19:23:01.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9901266787513530898', time=2024-09-12T20:31:57.318945+0000, chain.objs.size()=1 2024-09-12T19:23:01.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.XWFuSQ6WsOYH6_rWkMvVZ42nGHKQkE1_0 2024-09-12T19:23:01.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10062222047408267311', time=2024-09-12T20:31:58.338884+0000, chain.objs.size()=1 2024-09-12T19:23:01.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.bH_tE3frFlKGtkqllyHu5o8c0yZ2vAS_0 2024-09-12T19:23:01.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8070453948384392083', time=2024-09-12T20:31:58.532040+0000, chain.objs.size()=1 2024-09-12T19:23:01.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.RgnroObloCO9ntxincQc2OGjOVyRxif_0 2024-09-12T19:23:01.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2867721649588713077', time=2024-09-12T20:32:01.119627+0000, chain.objs.size()=1 2024-09-12T19:23:01.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.MsmnqGsvCMBoCatN36oVOPH7-BNyxXK_0 2024-09-12T19:23:01.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11702261862025991748', time=2024-09-12T20:32:02.036746+0000, chain.objs.size()=1 2024-09-12T19:23:01.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.CHKj_TIiAUWetAQ3IKNBBWuWU3dKDVW_0 2024-09-12T19:23:01.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7898462745938529567', time=2024-09-12T20:32:02.571567+0000, chain.objs.size()=1 2024-09-12T19:23:01.488 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.YW0jrDJt3i6hr3J0rk4GePkYtl72h33_0 2024-09-12T19:23:01.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15976463058160244185', time=2024-09-12T20:32:02.573464+0000, chain.objs.size()=1 2024-09-12T19:23:01.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.482+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Als83CCtALSsukgi7Xn3HURZHHGBkO9_0 2024-09-12T19:23:01.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9028410374987180425', time=2024-09-12T20:32:03.472708+0000, chain.objs.size()=1 2024-09-12T19:23:01.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.b_-tOLQ1gkBLGUZ7CpzCfIa9lbCuDt3_0 2024-09-12T19:23:01.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2814222607195192093', time=2024-09-12T20:32:06.492784+0000, chain.objs.size()=1 2024-09-12T19:23:01.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.J_9xUsUmMFt8ASu7QLm_x5GrlpRzZfZ_0 2024-09-12T19:23:01.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7867766142531416371', time=2024-09-12T20:32:06.576300+0000, chain.objs.size()=1 2024-09-12T19:23:01.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.FI0CxPpdny6-mNKAp2q5t2eW9ZXjNzY_0 2024-09-12T19:23:01.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2281631355733721936', time=2024-09-12T20:32:06.991577+0000, chain.objs.size()=1 2024-09-12T19:23:01.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.mwbMBLRTopn6LzhWri9yS4t35sO2S56_0 2024-09-12T19:23:01.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7315014440286015172', time=2024-09-12T20:32:09.053174+0000, chain.objs.size()=1 2024-09-12T19:23:01.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.6p_As0zWzL95CKG_VdOz-zgKpH4LtXp_0 2024-09-12T19:23:01.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3700652034340480487', time=2024-09-12T20:32:11.634297+0000, chain.objs.size()=1 2024-09-12T19:23:01.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.RgTeCFC8IvBdKNcXEX7aTXO42SAz881_0 2024-09-12T19:23:01.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14075849404060349448', time=2024-09-12T20:32:13.425787+0000, chain.objs.size()=1 2024-09-12T19:23:01.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.nWyuuycaDJIv0QdPJNa7foNNQ1RzwxE_0 2024-09-12T19:23:01.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9137720982752167173', time=2024-09-12T20:32:13.754285+0000, chain.objs.size()=1 2024-09-12T19:23:01.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.XDlpsoiqRTFm7aCuk2lWe0dxSpp73Jl_0 2024-09-12T19:23:01.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14189434484774774865', time=2024-09-12T20:32:51.924581+0000, chain.objs.size()=1 2024-09-12T19:23:01.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.279__shadow_.kQOmDtGeFyOuI949aS_Jp1ebRYYfain_0 2024-09-12T19:23:01.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2524564395976098277', time=2024-09-12T20:33:25.415337+0000, chain.objs.size()=1 2024-09-12T19:23:01.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.JnGcxkr6f9ynxMKt-ZLtOvYyg6nqaeC_0 2024-09-12T19:23:01.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.891370428400376903', time=2024-09-12T20:33:25.417621+0000, chain.objs.size()=1 2024-09-12T19:23:01.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.486+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.ZARINNx1IdQcqqju_UthaLXCdnZ_r4x_0 2024-09-12T19:23:01.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16554535618270947039', time=2024-09-12T20:33:25.420124+0000, chain.objs.size()=1 2024-09-12T19:23:01.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.4UylwOE0qkBIHyzbqTuq6zS1l0ZeZmM_0 2024-09-12T19:23:01.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11327021376848680340', time=2024-09-12T20:33:31.275371+0000, chain.objs.size()=1 2024-09-12T19:23:01.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.GfIgbakPkKR6xrfOjyMwYszjCF1hszG_0 2024-09-12T19:23:01.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12889207911226534198', time=2024-09-12T20:33:31.566982+0000, chain.objs.size()=1 2024-09-12T19:23:01.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.LyfgoRdpTwXvNK633wF727jKE2WxwrR_0 2024-09-12T19:23:01.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4480224712293557461', time=2024-09-12T20:33:48.018526+0000, chain.objs.size()=1 2024-09-12T19:23:01.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.300__shadow_.VJy8UhMjdlpI21K204yJo5ceVyS-Zm9_0 2024-09-12T19:23:01.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.494497619251069206', time=2024-09-12T20:36:27.967493+0000, chain.objs.size()=1 2024-09-12T19:23:01.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_._XerB9RdaSYUhwblF-2KD3H6BudrVy5_0 2024-09-12T19:23:01.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5436106653458646968', time=2024-09-12T20:36:30.303612+0000, chain.objs.size()=1 2024-09-12T19:23:01.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.g2sD7UNYY8BdpYSrzF2txnLaoj2hM3Y_0 2024-09-12T19:23:01.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775c7c4640 0 -- 172.21.15.98:0/1511992613 >> [v2:172.21.15.98:6816/1225764258,v1:172.21.15.98:6817/1225764258] conn(0x7f7744008040 msgr2=0x7f762408a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T19:23:01.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9607744220096543247', time=2024-09-12T20:36:30.898842+0000, chain.objs.size()=1 2024-09-12T19:23:01.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.mXk92stvAL-HdmINvDC4PJeJY3_xFVf_0 2024-09-12T19:23:01.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18351263873525600518', time=2024-09-12T20:36:31.899231+0000, chain.objs.size()=1 2024-09-12T19:23:01.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.wKHVLrGTc33FtOGTh_mP_H6QA-2-pn6_0 2024-09-12T19:23:01.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9804846456728446600', time=2024-09-12T20:36:31.961617+0000, chain.objs.size()=1 2024-09-12T19:23:01.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.bF18cztwE_TXI346SSBqYD9ZyLP30hk_0 2024-09-12T19:23:01.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14714580367197743431', time=2024-09-12T20:36:33.557776+0000, chain.objs.size()=1 2024-09-12T19:23:01.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.HuBNkjCpI4OV_K6MocieYBl3f3kg9Z__0 2024-09-12T19:23:01.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6448221944116691415', time=2024-09-12T20:36:34.221165+0000, chain.objs.size()=1 2024-09-12T19:23:01.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.494+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.bBF2z2YhSPcDEeScAKW0-EOnwJrE9tb_0 2024-09-12T19:23:01.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.498+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4827441461175262913', time=2024-09-12T20:36:34.463204+0000, chain.objs.size()=1 2024-09-12T19:23:01.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.498+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.xBPlffqQraxyTM2m8vC-rKTH2ZMkGKy_0 2024-09-12T19:23:01.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.498+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11167139880065513869', time=2024-09-12T20:36:34.465448+0000, chain.objs.size()=1 2024-09-12T19:23:01.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.498+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.E-t0-WaB9gxVA1jgWl5e9n1L8BhYwlP_0 2024-09-12T19:23:01.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.498+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18117476034830394224', time=2024-09-12T20:36:34.595478+0000, chain.objs.size()=1 2024-09-12T19:23:01.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.498+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.gBeXD1qf57qKWHUiJN4hnjRHJtrEAJR_0 2024-09-12T19:23:01.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.498+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3538069394307375738', time=2024-09-12T20:36:38.006567+0000, chain.objs.size()=1 2024-09-12T19:23:01.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.498+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.38M2fp7A7BBrJidRIveq0al7nJ3Ag2B_0 2024-09-12T19:23:01.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.498+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2284726868114383199', time=2024-09-12T20:36:38.491903+0000, chain.objs.size()=1 2024-09-12T19:23:01.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.498+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Zmu-s7YWFAGXlRSlkg9XDkSS3JaEJsK_0 2024-09-12T19:23:01.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.498+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8804013628788529937', time=2024-09-12T20:36:39.501362+0000, chain.objs.size()=1 2024-09-12T19:23:01.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.498+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.-boqxEaaPNWWBoIx69wuThK_QE8uUT__0 2024-09-12T19:23:01.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4617704852307455208', time=2024-09-12T20:36:40.625252+0000, chain.objs.size()=1 2024-09-12T19:23:01.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.75Zx7UPI6H5Wq98doPDr5yaeimRC6e7_0 2024-09-12T19:23:01.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12471433168779334560', time=2024-09-12T20:36:41.817450+0000, chain.objs.size()=1 2024-09-12T19:23:01.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.solPsS5QoqlsqjJ_XCEeM-ouh2rbml__0 2024-09-12T19:23:01.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1971733167493904776', time=2024-09-12T20:36:42.090774+0000, chain.objs.size()=1 2024-09-12T19:23:01.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.E6HayR12Onn75YWyV4Bmtev4V__l6My_0 2024-09-12T19:23:01.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14885289685820617610', time=2024-09-12T20:36:42.215648+0000, chain.objs.size()=1 2024-09-12T19:23:01.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.VVrPfQ2b7f-TyB983Wgt2-y8l9GzBrm_0 2024-09-12T19:23:01.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3923766061338466421', time=2024-09-12T20:36:44.463072+0000, chain.objs.size()=1 2024-09-12T19:23:01.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.mE1TfTkWiwSfUUbIyIP9imJokjpMXr7_0 2024-09-12T19:23:01.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3477705978385443660', time=2024-09-12T20:36:44.854884+0000, chain.objs.size()=1 2024-09-12T19:23:01.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.XgjGYz-S4PZx8VMk8FXnWd4Wt1RLiVG_0 2024-09-12T19:23:01.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14830452986869843426', time=2024-09-12T20:36:46.087314+0000, chain.objs.size()=1 2024-09-12T19:23:01.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.UZHR6emwnnukISW4uk58BZrxPhdjpz1_0 2024-09-12T19:23:01.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17014257293794143031', time=2024-09-12T20:36:49.188134+0000, chain.objs.size()=1 2024-09-12T19:23:01.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.zO9mTIwlc2-fZiD9yijsTD_4l9Bhmni_0 2024-09-12T19:23:01.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14213368003659843165', time=2024-09-12T20:36:51.520739+0000, chain.objs.size()=1 2024-09-12T19:23:01.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.DKY0UJYVMj-FNorKdfMaq5AcQAv3cMP_0 2024-09-12T19:23:01.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.502+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3835421163339824808', time=2024-09-12T20:36:51.901213+0000, chain.objs.size()=1 2024-09-12T19:23:01.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.502+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.8RPd_gg1Z3ooZGqTca-yhmocJCcyH_k_0 2024-09-12T19:23:01.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4257310435050224128', time=2024-09-12T20:36:52.083173+0000, chain.objs.size()=1 2024-09-12T19:23:01.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.hZjP0uWGMGoojpoFxdjI2hbC2kiwkUC_0 2024-09-12T19:23:01.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7633545883144960385', time=2024-09-12T20:36:52.308171+0000, chain.objs.size()=1 2024-09-12T19:23:01.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.0g0ouIkc-Z13GcjUknMBXBXlYcEntu6_0 2024-09-12T19:23:01.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6287901631385926218', time=2024-09-12T20:36:55.020641+0000, chain.objs.size()=1 2024-09-12T19:23:01.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.wnVZx0ExE3s1Rj_c0N_j4UFzlk571C9_0 2024-09-12T19:23:01.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13306565012080618496', time=2024-09-12T20:36:55.022901+0000, chain.objs.size()=1 2024-09-12T19:23:01.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.a8VAgOViWtEd3CWq54k2ikhSm2PryTf_0 2024-09-12T19:23:01.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1355779238412576397', time=2024-09-12T20:36:55.560913+0000, chain.objs.size()=1 2024-09-12T19:23:01.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.4zfExgrAupDEbwZcgYZ6Uw7S1VAWbHw_0 2024-09-12T19:23:01.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6719531329491587660', time=2024-09-12T20:36:56.006304+0000, chain.objs.size()=1 2024-09-12T19:23:01.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.i1YXQ6xF2Ueu3UZFeH5uQ1Yr_7a1e8D_0 2024-09-12T19:23:01.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9593315810949598688', time=2024-09-12T20:36:56.212632+0000, chain.objs.size()=1 2024-09-12T19:23:01.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.HTun2QP18PZDWYtrjiY6kHheObGNWbb_0 2024-09-12T19:23:01.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8368644428013811627', time=2024-09-12T20:38:39.671700+0000, chain.objs.size()=1 2024-09-12T19:23:01.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.tzPFNAtcQ2Mmb8Vxm2VhtzgobFoTAnz_0 2024-09-12T19:23:01.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16669683825910203838', time=2024-09-12T20:38:39.767037+0000, chain.objs.size()=1 2024-09-12T19:23:01.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.TNbmB1lDlQpm3GkM3cj-IUP45kFbgSz_0 2024-09-12T19:23:01.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11814102641939851632', time=2024-09-12T20:38:40.235708+0000, chain.objs.size()=1 2024-09-12T19:23:01.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.LZIzouq61dAjjLJfAbAvE8a0xKXUs5N_0 2024-09-12T19:23:01.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9519643905219511516', time=2024-09-12T20:38:40.583656+0000, chain.objs.size()=1 2024-09-12T19:23:01.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.506+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.LV45NTHXXV3B6-gVCJ-I3OyottHtl8n_0 2024-09-12T19:23:01.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.510+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1322749042900557232', time=2024-09-12T20:38:41.845572+0000, chain.objs.size()=1 2024-09-12T19:23:01.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.510+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.5hQi2JSE87GmZOETpFkbCdkc7CMBIuE_0 2024-09-12T19:23:01.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.510+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5004937396630145962', time=2024-09-12T20:38:42.571194+0000, chain.objs.size()=1 2024-09-12T19:23:01.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.510+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.13cEaECK5U_cX3Pg-tHL81GmeyZzmkl_0 2024-09-12T19:23:01.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.510+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13188139437427339488', time=2024-09-12T20:38:43.673809+0000, chain.objs.size()=1 2024-09-12T19:23:01.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.510+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.zV0i_yyW2Gpchw4o79unXorDiAoJCH9_0 2024-09-12T19:23:01.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.510+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12612249162982091970', time=2024-09-12T20:38:43.732907+0000, chain.objs.size()=1 2024-09-12T19:23:01.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.510+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.8jEGY5AQEG-iZTpCya1TTfkybafOSG-_0 2024-09-12T19:23:01.518 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13010841276026692280', time=2024-09-12T20:38:45.598066+0000, chain.objs.size()=1 2024-09-12T19:23:01.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.gK9QDHG96HB-oVYWlUGEeZIkpqTDb48_0 2024-09-12T19:23:01.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2142399329947675467', time=2024-09-12T20:38:48.884597+0000, chain.objs.size()=1 2024-09-12T19:23:01.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.a9h7zBjC7v_DKR8rDIkmfFnN4GP26JN_0 2024-09-12T19:23:01.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17661477940407896558', time=2024-09-12T20:38:49.890309+0000, chain.objs.size()=1 2024-09-12T19:23:01.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.rMlYIF2lRXyly14MGhqFrewNpCMJSJ7_0 2024-09-12T19:23:01.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7474453045165723123', time=2024-09-12T20:38:50.110090+0000, chain.objs.size()=1 2024-09-12T19:23:01.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.gbk0r8wqYjWI-oaaI28rbyp3Xht0_kX_0 2024-09-12T19:23:01.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7095686265459346399', time=2024-09-12T20:38:51.578821+0000, chain.objs.size()=1 2024-09-12T19:23:01.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.nD3aWz11bgVTanUfoBdmf9kLkm1yWOd_0 2024-09-12T19:23:01.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16839414661721623585', time=2024-09-12T20:38:51.657682+0000, chain.objs.size()=1 2024-09-12T19:23:01.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.vcyFXXex38C8In4f6-kHnzljB3bXG0j_0 2024-09-12T19:23:01.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11034319947032456264', time=2024-09-12T20:38:53.912893+0000, chain.objs.size()=1 2024-09-12T19:23:01.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ViPDdrCwMNFUBoT2vr9u2aUEqt8Qm0E_0 2024-09-12T19:23:01.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3624683456333292128', time=2024-09-12T20:38:55.723531+0000, chain.objs.size()=1 2024-09-12T19:23:01.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.xpdftKuYunm9h6PIAeAMkc0ULxCorvt_0 2024-09-12T19:23:01.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.514+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4745602261179355528', time=2024-09-12T20:38:55.766919+0000, chain.objs.size()=1 2024-09-12T19:23:01.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.514+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.W0_j2fmxaMbtwgq9AMf_-MQHQzgbDkW_0 2024-09-12T19:23:01.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.518+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14034447420699356792', time=2024-09-12T20:38:55.946081+0000, chain.objs.size()=1 2024-09-12T19:23:01.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.518+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.N5pcBtWvVPHRk_dyfKAoymLhOk5vNxD_0 2024-09-12T19:23:01.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.518+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.126453405944697301', time=2024-09-12T20:38:56.732641+0000, chain.objs.size()=1 2024-09-12T19:23:01.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.518+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.KUnRlWnjc1hWAaEmt0mqXkyRC7FbyJt_0 2024-09-12T19:23:01.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.518+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7165323445190584628', time=2024-09-12T20:38:59.615694+0000, chain.objs.size()=1 2024-09-12T19:23:01.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.518+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.6p6OnIJbHX9FI9Rq3y6R8JPoAd4sU5X_0 2024-09-12T19:23:01.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.518+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11912515535315387334', time=2024-09-12T20:38:59.861624+0000, chain.objs.size()=1 2024-09-12T19:23:01.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.518+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.bb8cdMCQm0QSsaQuxHaQah6wPHH5PPK_0 2024-09-12T19:23:01.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.518+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17467775055258280785', time=2024-09-12T20:39:00.751267+0000, chain.objs.size()=1 2024-09-12T19:23:01.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.518+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.hALFQsj0Gp-UqdNz9PFxLgX4l_ytgcW_0 2024-09-12T19:23:01.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.522+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49018 2024-09-12T19:23:01.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T19:23:01.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6590409014278751611', time=2024-09-12T20:39:01.382062+0000, chain.objs.size()=1 2024-09-12T19:23:01.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.X-44QDRtZa2aCpyUsCXAFqJQEjkVjQU_0 2024-09-12T19:23:01.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15299105077387384958', time=2024-09-12T20:39:01.457811+0000, chain.objs.size()=1 2024-09-12T19:23:01.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.OaYdn_u6OWuyxQ6u5IKyMUKFzNhEq_6_0 2024-09-12T19:23:01.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12422325268739862829', time=2024-09-12T20:39:03.090439+0000, chain.objs.size()=1 2024-09-12T19:23:01.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.DKjT_kcLaRBHwqAlEF-wZ3nxt3YBhm5_0 2024-09-12T19:23:01.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.933759924812245662', time=2024-09-12T20:39:03.748098+0000, chain.objs.size()=1 2024-09-12T19:23:01.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.dSJOEipnZpR4NqvdttHKQY7LfWdZR1-_0 2024-09-12T19:23:01.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.613956493812382730', time=2024-09-12T20:39:04.932304+0000, chain.objs.size()=1 2024-09-12T19:23:01.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.0jZeZmBV0snhIBjkSVhriT44_1Istrh_0 2024-09-12T19:23:01.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7457064403281636777', time=2024-09-12T20:39:06.791677+0000, chain.objs.size()=1 2024-09-12T19:23:01.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.kL_GU2Fs7JXShY3ZZKfz2ZN_3sF4rpi_0 2024-09-12T19:23:01.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8314540922225249762', time=2024-09-12T20:39:07.894207+0000, chain.objs.size()=1 2024-09-12T19:23:01.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.GL66N1Eu13k0MPEfSV-CrQNkfy_Ygbv_0 2024-09-12T19:23:01.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1979416511795122368', time=2024-09-12T20:40:40.057782+0000, chain.objs.size()=1 2024-09-12T19:23:01.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.372__shadow_.DrG8gkNo5BGvL15SwycvV4dQVGNRcT0_0 2024-09-12T19:23:01.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2335940950698273658', time=2024-09-12T20:43:31.717012+0000, chain.objs.size()=1 2024-09-12T19:23:01.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.454__shadow_.AdQcP_XLd5BeaISkh8LeOOY6l3cg3iH_0 2024-09-12T19:23:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17975213072002308202', time=2024-09-12T20:43:43.649662+0000, chain.objs.size()=1 2024-09-12T19:23:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.458__shadow_.F4g-nO75GdVhLa7pzKBM7yFrBq5gXqa_0 2024-09-12T19:23:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6421618876008332567', time=2024-09-12T20:44:04.364368+0000, chain.objs.size()=1 2024-09-12T19:23:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.465__shadow_.fa04RqGOBg41cK6oeXSXBTGWIUOZWpo_0 2024-09-12T19:23:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3451072901105754590', time=2024-09-12T20:44:33.715352+0000, chain.objs.size()=1 2024-09-12T19:23:01.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.526+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.483__shadow_.ZtdvglTezHWYYwsIsW-4mFRmy6smEWw_0 2024-09-12T19:23:01.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.530+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11082339098702197019', time=2024-09-12T20:44:54.974969+0000, chain.objs.size()=1 2024-09-12T19:23:01.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.530+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.490__shadow_.xeSs1LrJYen0Bk3wTy2WRnDy7XfFrSn_0 2024-09-12T19:23:01.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.530+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11082339098702197019', time=2024-09-12T20:44:55.536418+0000, chain.objs.size()=1 2024-09-12T19:23:01.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.530+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.490__shadow_.xeSs1LrJYen0Bk3wTy2WRnDy7XfFrSn_0 2024-09-12T19:23:01.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.530+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10185824414571373322', time=2024-09-12T20:45:03.741482+0000, chain.objs.size()=1 2024-09-12T19:23:01.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.530+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.495__shadow_.KuCJ4cD3X7UtYhC3jmmsV56NSrIS0w9_0 2024-09-12T19:23:01.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.530+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13461215384592497064', time=2024-09-12T20:45:13.600355+0000, chain.objs.size()=1 2024-09-12T19:23:01.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.530+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.499__shadow_.-SmzZnJr3gF3K9Ow2QHQB-ctgxb9HEK_0 2024-09-12T19:23:01.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.530+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10585657684092854018', time=2024-09-12T20:48:15.292099+0000, chain.objs.size()=3 2024-09-12T19:23:01.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.530+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.521__multipart_mymultipart.2~GO8bC6kGccmMnAwdIv7QtKQx3iL-wd5.1 2024-09-12T19:23:01.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.530+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.521__multipart_mymultipart.2~GO8bC6kGccmMnAwdIv7QtKQx3iL-wd5.2 2024-09-12T19:23:01.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.530+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.521__multipart_mymultipart.2~GO8bC6kGccmMnAwdIv7QtKQx3iL-wd5.3 2024-09-12T19:23:01.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.530+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~p39j8qdmP2XpGlwZaA5R9fvSB3O7y1h', time=2024-09-12T20:51:16.621594+0000, chain.objs.size()=1 2024-09-12T19:23:01.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.530+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~p39j8qdmP2XpGlwZaA5R9fvSB3O7y1h.1 2024-09-12T19:23:01.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.530+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~p39j8qdmP2XpGlwZaA5R9fvSB3O7y1h', time=2024-09-12T20:51:16.631577+0000, chain.objs.size()=1 2024-09-12T19:23:01.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.530+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~p39j8qdmP2XpGlwZaA5R9fvSB3O7y1h.2 2024-09-12T19:23:01.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.530+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~p39j8qdmP2XpGlwZaA5R9fvSB3O7y1h', time=2024-09-12T20:51:16.641752+0000, chain.objs.size()=1 2024-09-12T19:23:01.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.530+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~p39j8qdmP2XpGlwZaA5R9fvSB3O7y1h.3 2024-09-12T19:23:01.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.530+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~p39j8qdmP2XpGlwZaA5R9fvSB3O7y1h', time=2024-09-12T20:51:16.651503+0000, chain.objs.size()=1 2024-09-12T19:23:01.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.530+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~p39j8qdmP2XpGlwZaA5R9fvSB3O7y1h.4 2024-09-12T19:23:01.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.534+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~p39j8qdmP2XpGlwZaA5R9fvSB3O7y1h', time=2024-09-12T20:51:16.661119+0000, chain.objs.size()=1 2024-09-12T19:23:01.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.534+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~p39j8qdmP2XpGlwZaA5R9fvSB3O7y1h.5 2024-09-12T19:23:01.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.534+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~p39j8qdmP2XpGlwZaA5R9fvSB3O7y1h', time=2024-09-12T20:51:16.670675+0000, chain.objs.size()=1 2024-09-12T19:23:01.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.534+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~p39j8qdmP2XpGlwZaA5R9fvSB3O7y1h.6 2024-09-12T19:23:01.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.534+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11512728288876114881', time=2024-09-12T20:52:16.160600+0000, chain.objs.size()=1 2024-09-12T19:23:01.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.534+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.525__multipart_mymultipart.2~f_9C-3uMp0m1oBjmCD5nsJWtfIGaoQz.1 2024-09-12T19:23:01.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.534+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9771459421803637884', time=2024-09-12T20:52:58.250949+0000, chain.objs.size()=4 2024-09-12T19:23:01.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.534+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.527__multipart_mymultipart.2~YPSR6Flha9WilvXDyqPxJZ4XSgiPvuo.1 2024-09-12T19:23:01.541 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.534+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.527__multipart_mymultipart.2~YPSR6Flha9WilvXDyqPxJZ4XSgiPvuo.2 2024-09-12T19:23:01.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.527__multipart_mymultipart.2~YPSR6Flha9WilvXDyqPxJZ4XSgiPvuo.3 2024-09-12T19:23:01.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.527__multipart_mymultipart.2~YPSR6Flha9WilvXDyqPxJZ4XSgiPvuo.4 2024-09-12T19:23:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.538+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~kxwg1ugZvRjQCWRCRSMU6nTJN2xbgpz', time=2024-09-12T20:53:26.855743+0000, chain.objs.size()=2 2024-09-12T19:23:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.531__multipart_mymultipart.2~kxwg1ugZvRjQCWRCRSMU6nTJN2xbgpz.1 2024-09-12T19:23:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.531__multipart_mymultipart.2~kxwg1ugZvRjQCWRCRSMU6nTJN2xbgpz.2 2024-09-12T19:23:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.538+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13244727302737610640', time=2024-09-12T20:56:09.763877+0000, chain.objs.size()=1 2024-09-12T19:23:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.558__shadow_.5CMBio-Q2zrEwA9EVRz-1YixXm36uCF_0 2024-09-12T19:23:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.538+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8454886519338763434', time=2024-09-12T20:59:29.136998+0000, chain.objs.size()=1 2024-09-12T19:23:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.579__shadow:vbVYtjMo-YnONCFSVnspx-fFVI4ZT9q_.qLQkdsGmVMsMK5nyw3QGPSzVGsUAlSb_0 2024-09-12T19:23:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.538+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17819058940215638243', time=2024-09-12T21:09:31.863062+0000, chain.objs.size()=6 2024-09-12T19:23:01.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.660__multipart_bar.2~q8RpJtnc66z11Nr9Q4xTK77LaY4Zndl.1 2024-09-12T19:23:01.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.660__multipart_bar.2~q8RpJtnc66z11Nr9Q4xTK77LaY4Zndl.2 2024-09-12T19:23:01.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.660__multipart_bar.2~q8RpJtnc66z11Nr9Q4xTK77LaY4Zndl.3 2024-09-12T19:23:01.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.538+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.660__multipart_bar.2~q8RpJtnc66z11Nr9Q4xTK77LaY4Zndl.4 2024-09-12T19:23:01.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.542+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.660__multipart_bar.2~q8RpJtnc66z11Nr9Q4xTK77LaY4Zndl.5 2024-09-12T19:23:01.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.542+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.660__multipart_bar.2~q8RpJtnc66z11Nr9Q4xTK77LaY4Zndl.6 2024-09-12T19:23:01.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.542+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2379153021388692243', time=2024-09-12T21:11:12.586591+0000, chain.objs.size()=1 2024-09-12T19:23:01.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.542+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.711__multipart_file1.2~Qf8x9GWxE3GrLs-RXjbgNA2P0muDa8I.1 2024-09-12T19:23:01.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.542+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17950664977142565844', time=2024-09-12T21:11:29.989217+0000, chain.objs.size()=1 2024-09-12T19:23:01.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.542+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.715__shadow:txyNr1AJ0LNbko5yAEY-jQAZAQ0B5kn_.owXarhP2oXnaWLVNzztieDg2tUCml5e_0 2024-09-12T19:23:01.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.542+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1269136554500605617', time=2024-09-12T21:11:45.374209+0000, chain.objs.size()=1 2024-09-12T19:23:01.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.542+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.718__shadow_.zbKjduQK4Ld2L5RNzk6qEDAfnWQorUI_0 2024-09-12T19:23:01.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.550+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:01.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T19:23:01.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.550+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:01.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:01.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45240' 2024-09-12T19:23:01.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10101161107597072526', time=2024-09-12T20:31:45.281760+0000, chain.objs.size()=1 2024-09-12T19:23:01.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.5fsSxTtib2kCXpLp4HXcvmLERu4uAwn_0 2024-09-12T19:23:01.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14029720808709525791', time=2024-09-12T20:31:46.945726+0000, chain.objs.size()=1 2024-09-12T19:23:01.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.DDPJ5YIztiieM59hOyiEwIZFryynCCB_0 2024-09-12T19:23:01.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7129867989369339542', time=2024-09-12T20:31:47.716596+0000, chain.objs.size()=1 2024-09-12T19:23:01.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.RD92XUpwUg_NCCPB8D09e97L-uWNAKQ_0 2024-09-12T19:23:01.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5953690194640922680', time=2024-09-12T20:31:47.755816+0000, chain.objs.size()=1 2024-09-12T19:23:01.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.rjOXQmxrtlNFKkyo3DjI65AZhHlqd3o_0 2024-09-12T19:23:01.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6809134379285711507', time=2024-09-12T20:31:48.089916+0000, chain.objs.size()=1 2024-09-12T19:23:01.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Gc4nnAlAwoNu6L96m35_X9Mjd2gHuqt_0 2024-09-12T19:23:01.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8662104329220080285', time=2024-09-12T20:31:48.092170+0000, chain.objs.size()=1 2024-09-12T19:23:01.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.M-Nmp61Xe2yKzzRI3TaBUexL8oXXosO_0 2024-09-12T19:23:01.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9018318684090287934', time=2024-09-12T20:31:48.154750+0000, chain.objs.size()=1 2024-09-12T19:23:01.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.XQh22RxK_rUgpUe9oZSw4DBvd70Etzw_0 2024-09-12T19:23:01.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3689989778343197720', time=2024-09-12T20:31:49.307755+0000, chain.objs.size()=1 2024-09-12T19:23:01.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.bJnlJe2y6PopVGUgZ6pVMEI2W91ixhv_0 2024-09-12T19:23:01.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17522463561645277992', time=2024-09-12T20:31:50.540269+0000, chain.objs.size()=1 2024-09-12T19:23:01.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.UJZYBw6Pd-VZ16aVUd8_vTzftktPeX-_0 2024-09-12T19:23:01.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6125861437082280163', time=2024-09-12T20:31:50.865229+0000, chain.objs.size()=1 2024-09-12T19:23:01.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.QTmgO2-ft1nleIiEdZL0z1PrZuR69IK_0 2024-09-12T19:23:01.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4584627712435533462', time=2024-09-12T20:31:50.993031+0000, chain.objs.size()=1 2024-09-12T19:23:01.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.AfsbkEynrymCvRiyhvckb5FZQ2NOx2b_0 2024-09-12T19:23:01.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11081698329664497720', time=2024-09-12T20:31:51.752978+0000, chain.objs.size()=1 2024-09-12T19:23:01.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.a8zw29O2oPrGaJjhTtV1_n5J6x5xL8q_0 2024-09-12T19:23:01.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7163934272244964411', time=2024-09-12T20:31:53.107245+0000, chain.objs.size()=1 2024-09-12T19:23:01.561 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.554+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.r-CnXh-7mgYUvpy0FtetZk_bgUpIbjm_0 2024-09-12T19:23:01.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10393406056126971498', time=2024-09-12T20:31:53.509656+0000, chain.objs.size()=1 2024-09-12T19:23:01.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.LeXnvzfySwerfS4h9RBuPqikWwgcNA9_0 2024-09-12T19:23:01.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17625590001617888643', time=2024-09-12T20:31:53.894940+0000, chain.objs.size()=1 2024-09-12T19:23:01.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.0do0JGDxbsJIJ93-o9dpGFt3RAPZ2oX_0 2024-09-12T19:23:01.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6239379842202640836', time=2024-09-12T20:31:54.262506+0000, chain.objs.size()=1 2024-09-12T19:23:01.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.RY4Tz3Oy1BIvcnfefXYlF5RI47HJwSX_0 2024-09-12T19:23:01.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17097201032730612301', time=2024-09-12T20:31:58.157184+0000, chain.objs.size()=1 2024-09-12T19:23:01.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.RM9XpsE2c1Vf_ITnPXudssC4A-oZ3Zn_0 2024-09-12T19:23:01.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15027890532074994552', time=2024-09-12T20:31:58.483480+0000, chain.objs.size()=1 2024-09-12T19:23:01.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.4-X5l7_d0gA1DzaUSJkRvfRAxqz7kJo_0 2024-09-12T19:23:01.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.258492095492923518', time=2024-09-12T20:31:59.661039+0000, chain.objs.size()=1 2024-09-12T19:23:01.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.-D7XScrDH1vSkOcafXCMMEOqqj9SflQ_0 2024-09-12T19:23:01.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3861375115076223546', time=2024-09-12T20:32:00.862495+0000, chain.objs.size()=1 2024-09-12T19:23:01.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.GLySd2ioNYMsdNBEjfFEHJ3PthucoHq_0 2024-09-12T19:23:01.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4681082532077909747', time=2024-09-12T20:32:02.164909+0000, chain.objs.size()=1 2024-09-12T19:23:01.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.fc3LbB7QUk1LTe7dT1OLpIovvAL4Sdm_0 2024-09-12T19:23:01.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7030608205567607889', time=2024-09-12T20:32:02.969492+0000, chain.objs.size()=1 2024-09-12T19:23:01.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.y7P8treT895TcF0D9R2VsWapngiCfeI_0 2024-09-12T19:23:01.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11909141571583471926', time=2024-09-12T20:32:03.308003+0000, chain.objs.size()=1 2024-09-12T19:23:01.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.zxjKe0x_zybPMu3YudLE_ZDVe_WtwXr_0 2024-09-12T19:23:01.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7366146146900012198', time=2024-09-12T20:32:03.474084+0000, chain.objs.size()=1 2024-09-12T19:23:01.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.558+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.xROLtG8IsDhuzLhRBYnmwvRIwZ0J9MT_0 2024-09-12T19:23:01.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.562+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2827935636696198774', time=2024-09-12T20:32:03.476188+0000, chain.objs.size()=1 2024-09-12T19:23:01.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.t_3Ftp7nmryrGj6FretHqOv82rvMXrX_0 2024-09-12T19:23:01.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.562+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1791143783406295797', time=2024-09-12T20:32:04.390013+0000, chain.objs.size()=1 2024-09-12T19:23:01.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.axk5uz4ajpz-RN33UTCN5Dw50Tvxrjn_0 2024-09-12T19:23:01.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.562+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16420836979592482288', time=2024-09-12T20:32:04.408723+0000, chain.objs.size()=1 2024-09-12T19:23:01.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.562+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.FWk6jDVc-t725YqvsGs6avwP3HaHQ44_0 2024-09-12T19:23:01.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.566+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18200528357832268533', time=2024-09-12T20:32:05.182136+0000, chain.objs.size()=1 2024-09-12T19:23:01.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.T2nMYWANVtC7MZE_C7Q_WVqTv10ZSNu_0 2024-09-12T19:23:01.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.566+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7816457095329993799', time=2024-09-12T20:32:05.363641+0000, chain.objs.size()=1 2024-09-12T19:23:01.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.xUkH8S8QMHg__fnCPS98SEhlBMLNjcV_0 2024-09-12T19:23:01.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.566+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17056467673635711613', time=2024-09-12T20:32:05.690224+0000, chain.objs.size()=1 2024-09-12T19:23:01.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.aCZx1zMOrJuNOA4tL2LRsUx1lvFg8ta_0 2024-09-12T19:23:01.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.566+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3232755391532345713', time=2024-09-12T20:32:06.191172+0000, chain.objs.size()=1 2024-09-12T19:23:01.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.KvQ049a9sc37d0lxk7Mi3y_f6y-FsOo_0 2024-09-12T19:23:01.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.566+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12158906809354972062', time=2024-09-12T20:32:06.489587+0000, chain.objs.size()=1 2024-09-12T19:23:01.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.CKvZ8jkpLPc8oWCJ3vJYrtJbFGCiG4W_0 2024-09-12T19:23:01.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.566+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11726157406660549649', time=2024-09-12T20:32:06.493358+0000, chain.objs.size()=1 2024-09-12T19:23:01.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ayyCe6E7oLDB1mHZHs85LiP2wjeUKKw_0 2024-09-12T19:23:01.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.566+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15325913736451628567', time=2024-09-12T20:32:08.134452+0000, chain.objs.size()=1 2024-09-12T19:23:01.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.DrqCbmROMgyiqBQ_Cj7qc-fZd0n2J_H_0 2024-09-12T19:23:01.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.566+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16741998582221425929', time=2024-09-12T20:32:10.357686+0000, chain.objs.size()=1 2024-09-12T19:23:01.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Aj3w9vxf7PTDDq1Od-TdEw4S5T2OP5z_0 2024-09-12T19:23:01.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.566+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1384448470394395512', time=2024-09-12T20:32:10.481335+0000, chain.objs.size()=1 2024-09-12T19:23:01.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.LAinCxGqWBIABQXGyof2XhxexvPYfdY_0 2024-09-12T19:23:01.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.566+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14525817426732976485', time=2024-09-12T20:32:13.299124+0000, chain.objs.size()=1 2024-09-12T19:23:01.573 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.566+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Em4u6lCaQvH9PqHX6cADmO83CHifi2__0 2024-09-12T19:23:01.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.570+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15329567377757556783', time=2024-09-12T20:32:13.372889+0000, chain.objs.size()=1 2024-09-12T19:23:01.574 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.570+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.-Zor_MwKQ_M5LCw1OlcX9RvgzMjBbXR_0 2024-09-12T19:23:01.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.570+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3049089008665480784', time=2024-09-12T20:32:13.808765+0000, chain.objs.size()=1 2024-09-12T19:23:01.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.570+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.oZlqpGnwtfs22cokxLGv9_TRiG3ber1_0 2024-09-12T19:23:01.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.570+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.264189092070000688', time=2024-09-12T20:32:13.812854+0000, chain.objs.size()=1 2024-09-12T19:23:01.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.570+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.E3kKTROCDuys2Hz8tFzv-EiZkGefzjo_0 2024-09-12T19:23:01.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.570+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16774754537630562476', time=2024-09-12T20:32:13.815497+0000, chain.objs.size()=1 2024-09-12T19:23:01.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.570+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.9neKM77bmsO9XwRj37Dk5jSOcc0J68J_0 2024-09-12T19:23:01.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.570+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3844142482657563097', time=2024-09-12T20:32:20.664835+0000, chain.objs.size()=1 2024-09-12T19:23:01.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.570+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.265__shadow_.2c5RzT1yUb8RQqYj9OW6SML0nAO-Hz8_0 2024-09-12T19:23:01.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.570+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4158890789933264194', time=2024-09-12T20:32:47.208683+0000, chain.objs.size()=1 2024-09-12T19:23:01.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.570+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.277__shadow_.p1ZAI7HXpJmvr79OCZ1-h3k7pdJQi50_0 2024-09-12T19:23:01.578 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12669693442883068128', time=2024-09-12T20:33:25.650472+0000, chain.objs.size()=1 2024-09-12T19:23:01.578 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.poOLTga-OTug9GJvGrofg6JwTlmduhZ_0 2024-09-12T19:23:01.578 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11401851206233090524', time=2024-09-12T20:33:31.327920+0000, chain.objs.size()=1 2024-09-12T19:23:01.578 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.7WTNBlYeH7InkHsqmpnEt8AdgMyoDdA_0 2024-09-12T19:23:01.578 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11003647584610473338', time=2024-09-12T20:33:31.520381+0000, chain.objs.size()=1 2024-09-12T19:23:01.578 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.AzK-VDbGqYNKp6cBZr_D6Tu6g6h-4d2_0 2024-09-12T19:23:01.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16278717158407107787', time=2024-09-12T20:33:57.226072+0000, chain.objs.size()=1 2024-09-12T19:23:01.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.304__shadow_.PxSQEOp2vpG8PZASvmP0PmDCpIeAFzy_0 2024-09-12T19:23:01.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15699857464217814160', time=2024-09-12T20:33:59.342950+0000, chain.objs.size()=1 2024-09-12T19:23:01.579 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.305__shadow_.qGV0mQYPX9QiscZVXI3hRYUuwOsu114_0 2024-09-12T19:23:01.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.171603170588993140', time=2024-09-12T20:36:27.923590+0000, chain.objs.size()=1 2024-09-12T19:23:01.580 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.mBtaQ1b3bQqRA664Cw-p2H5jUIMOtsE_0 2024-09-12T19:23:01.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7526042592433832002', time=2024-09-12T20:36:28.012596+0000, chain.objs.size()=1 2024-09-12T19:23:01.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.frHtOtfJTNvp8Ff1_HcWth3bkmFufRc_0 2024-09-12T19:23:01.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2106808235850318448', time=2024-09-12T20:36:28.822628+0000, chain.objs.size()=1 2024-09-12T19:23:01.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ui1US1oBGCmRscIzw9uzDlse1El4CMW_0 2024-09-12T19:23:01.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13182190983579685577', time=2024-09-12T20:36:30.027377+0000, chain.objs.size()=1 2024-09-12T19:23:01.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.hPTUxRSDenKtrfjsFGoGMaQBym9hNTI_0 2024-09-12T19:23:01.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8361458466292546977', time=2024-09-12T20:36:30.427728+0000, chain.objs.size()=1 2024-09-12T19:23:01.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.8tVp0269kvvziRkCOTinVYyYDM8iKc7_0 2024-09-12T19:23:01.581 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5089864466052602383', time=2024-09-12T20:36:32.579848+0000, chain.objs.size()=1 2024-09-12T19:23:01.582 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.574+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.qTNhcVd-M1HGumoQacAK3rfIScfYoY8_0 2024-09-12T19:23:01.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.578+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4973959618841204217', time=2024-09-12T20:36:33.148604+0000, chain.objs.size()=1 2024-09-12T19:23:01.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.578+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.wewmfjemP4NgD5n96CqCdQw2d_S2kBV_0 2024-09-12T19:23:01.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.578+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11087045118310201009', time=2024-09-12T20:36:34.554572+0000, chain.objs.size()=1 2024-09-12T19:23:01.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.578+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.PILWXjlls01h3N1Fi5lPCNoD3Bltk8M_0 2024-09-12T19:23:01.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.578+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9787545645465404307', time=2024-09-12T20:36:34.742380+0000, chain.objs.size()=1 2024-09-12T19:23:01.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.578+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.8YT6lF8GFZJeZGWzN7sFFZmZWZGY6Nk_0 2024-09-12T19:23:01.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.578+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10093100655773773163', time=2024-09-12T20:36:36.631715+0000, chain.objs.size()=1 2024-09-12T19:23:01.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.578+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.22K1dKPu8AQD4OgU4PHhJ6d-RXn33AY_0 2024-09-12T19:23:01.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.578+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8554770177792130635', time=2024-09-12T20:36:37.365613+0000, chain.objs.size()=1 2024-09-12T19:23:01.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.578+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.rRcAkjrDbvwVqxs9IZEzEFdINoA2KTA_0 2024-09-12T19:23:01.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.578+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10413106550968844482', time=2024-09-12T20:36:37.594630+0000, chain.objs.size()=1 2024-09-12T19:23:01.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.578+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ffmN8FyrnJe40cYp2zJ0OJvXOAzMcZC_0 2024-09-12T19:23:01.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.578+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9461203715540888025', time=2024-09-12T20:36:39.884534+0000, chain.objs.size()=1 2024-09-12T19:23:01.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.578+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.eyYHnSfvH2-wZPWYpt4spMif-KB8M60_0 2024-09-12T19:23:01.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.578+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15844738681073353566', time=2024-09-12T20:36:39.886358+0000, chain.objs.size()=1 2024-09-12T19:23:01.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.578+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.kXtGWNEFhn86I2lgsWZeFnQbKqUO8Qn_0 2024-09-12T19:23:01.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.578+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10693762929918510984', time=2024-09-12T20:36:41.109744+0000, chain.objs.size()=1 2024-09-12T19:23:01.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.578+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.SeqeSHtSW7TqKCfNyWkFMR4DraC3FAf_0 2024-09-12T19:23:01.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.582+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1621088305656378328', time=2024-09-12T20:36:43.478684+0000, chain.objs.size()=1 2024-09-12T19:23:01.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.582+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.9WShyrASY2e2TpVCLnWlduc1PS5onC8_0 2024-09-12T19:23:01.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.582+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.158315563075243018', time=2024-09-12T20:36:45.356008+0000, chain.objs.size()=1 2024-09-12T19:23:01.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.582+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.9_himJQeW7Bupt3rxWNLo4KZ5U4g6nT_0 2024-09-12T19:23:01.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.582+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14498235474230561688', time=2024-09-12T20:36:45.802133+0000, chain.objs.size()=1 2024-09-12T19:23:01.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.582+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.BbZBizqa_HX-M5nLE1D64fXZUN6VImJ_0 2024-09-12T19:23:01.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13755262854807742852', time=2024-09-12T20:36:47.321748+0000, chain.objs.size()=1 2024-09-12T19:23:01.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.AGJorHvZMUf43NQab89Z_XCEaZ67LC7_0 2024-09-12T19:23:01.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12269772533868100502', time=2024-09-12T20:36:47.840706+0000, chain.objs.size()=1 2024-09-12T19:23:01.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.2FK8XZGAhlA42749VbNP1R16YnSkkAG_0 2024-09-12T19:23:01.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10325498007253082004', time=2024-09-12T20:36:48.741770+0000, chain.objs.size()=1 2024-09-12T19:23:01.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.rHh0ryBCrHdej9BmdQ2aoF7opeq-tDq_0 2024-09-12T19:23:01.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.633239995606277180', time=2024-09-12T20:36:49.739633+0000, chain.objs.size()=1 2024-09-12T19:23:01.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.GgLkpA2KgrL1wuHY7a8mXYIiPCffd0f_0 2024-09-12T19:23:01.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1001387630386965112', time=2024-09-12T20:36:52.143266+0000, chain.objs.size()=1 2024-09-12T19:23:01.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.JZN0xr6FxofV6__mRMSKrMrPmNoWtMh_0 2024-09-12T19:23:01.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14872501773744808311', time=2024-09-12T20:36:52.459758+0000, chain.objs.size()=1 2024-09-12T19:23:01.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.lO1-yKWwRzWPXRByL3ytY7aaEmiT97W_0 2024-09-12T19:23:01.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.130533190798051090', time=2024-09-12T20:36:52.462067+0000, chain.objs.size()=1 2024-09-12T19:23:01.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.aStjE7wP-8LKNsOUEHoA-uBASPkz2MB_0 2024-09-12T19:23:01.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4149872819197932585', time=2024-09-12T20:36:53.070145+0000, chain.objs.size()=1 2024-09-12T19:23:01.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.GgDgmCzK9-VsH6V_gNyYcnbLjD3KNAP_0 2024-09-12T19:23:01.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9669873581476106645', time=2024-09-12T20:36:53.273427+0000, chain.objs.size()=1 2024-09-12T19:23:01.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ulEeIawtUX7mBN64Cqh-E1slJpN_fDY_0 2024-09-12T19:23:01.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14310911590999454502', time=2024-09-12T20:36:53.355867+0000, chain.objs.size()=1 2024-09-12T19:23:01.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.FSFSHHINoG5vrTg9GNrTZ5TLALuDIFa_0 2024-09-12T19:23:01.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13852426319534653213', time=2024-09-12T20:36:54.601652+0000, chain.objs.size()=1 2024-09-12T19:23:01.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.586+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Y9k62B19lCbHr7RuvvGXB88BNORKSXZ_0 2024-09-12T19:23:01.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2787100402327291413', time=2024-09-12T20:36:55.905015+0000, chain.objs.size()=1 2024-09-12T19:23:01.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.dWBEw_5D0Co5TE9uKtRin-sPE85AS7d_0 2024-09-12T19:23:01.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.635539532648999475', time=2024-09-12T20:38:41.263598+0000, chain.objs.size()=1 2024-09-12T19:23:01.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.uToazIzmi7nqaVF3XlU9dcQakEogrKl_0 2024-09-12T19:23:01.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5538911518123406781', time=2024-09-12T20:38:44.062927+0000, chain.objs.size()=1 2024-09-12T19:23:01.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.mAJyO7i-8KpmerQU3HFG45gTdBD7wxq_0 2024-09-12T19:23:01.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17600513671039168286', time=2024-09-12T20:38:45.021684+0000, chain.objs.size()=1 2024-09-12T19:23:01.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.n2-95r1FP13dCU6G-HhzrIS0IsbcaJT_0 2024-09-12T19:23:01.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10703634497723953263', time=2024-09-12T20:38:45.656171+0000, chain.objs.size()=1 2024-09-12T19:23:01.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.WnM-Zav4-3H6V5Sf5EI748VBIxNGwrg_0 2024-09-12T19:23:01.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17880598557168248816', time=2024-09-12T20:38:47.797690+0000, chain.objs.size()=1 2024-09-12T19:23:01.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.UHyP-XebizpbjjwiezztKbFLi4sC_Zw_0 2024-09-12T19:23:01.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6856923565869425951', time=2024-09-12T20:38:47.949368+0000, chain.objs.size()=1 2024-09-12T19:23:01.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.xSEHpJrccsM_W8l7zJhKSs-3HvFZ00J_0 2024-09-12T19:23:01.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6634739823182727317', time=2024-09-12T20:38:49.069228+0000, chain.objs.size()=1 2024-09-12T19:23:01.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.g95YQur4OXvSjsQHVQ7mbsOcLXGUUly_0 2024-09-12T19:23:01.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4016142287990240331', time=2024-09-12T20:38:50.247342+0000, chain.objs.size()=1 2024-09-12T19:23:01.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.DY8rXIdxRHlwQj9CGiDTMaOwoRia_wQ_0 2024-09-12T19:23:01.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5361299688511559875', time=2024-09-12T20:38:52.477571+0000, chain.objs.size()=1 2024-09-12T19:23:01.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.1eBa8xLVCUeBr-9AAfvla-s51s1ZTav_0 2024-09-12T19:23:01.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12654504524368149090', time=2024-09-12T20:38:53.061710+0000, chain.objs.size()=1 2024-09-12T19:23:01.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.590+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.qLHJlHJUdAv-V6v-kGveRf0KStJ-I2r_0 2024-09-12T19:23:01.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3169062203142820061', time=2024-09-12T20:38:53.324253+0000, chain.objs.size()=1 2024-09-12T19:23:01.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ATas6ntgYR0Otg_GmvO-LzuURmZv8kA_0 2024-09-12T19:23:01.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.594+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17141631217218067388', time=2024-09-12T20:38:53.689960+0000, chain.objs.size()=1 2024-09-12T19:23:01.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.594+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.T1eYRTlZWrXdCry8mSkUOEEmKNSFyAD_0 2024-09-12T19:23:01.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5394639484868903950', time=2024-09-12T20:38:53.839960+0000, chain.objs.size()=1 2024-09-12T19:23:01.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.uJ-il3eZjAPIxH-bizlJq6uZKwg9DAt_0 2024-09-12T19:23:01.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2862870546997604860', time=2024-09-12T20:38:56.125174+0000, chain.objs.size()=1 2024-09-12T19:23:01.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Nc2lsRAMdDQJod7hrtFs7I2NaOcnoZJ_0 2024-09-12T19:23:01.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13440258861833089863', time=2024-09-12T20:38:56.223839+0000, chain.objs.size()=1 2024-09-12T19:23:01.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.nlrDH22c6uD0FcdmGlZEMsL9Hs_jhsC_0 2024-09-12T19:23:01.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9877465191728790841', time=2024-09-12T20:38:56.849119+0000, chain.objs.size()=1 2024-09-12T19:23:01.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.1pP1G7r0ZYKaLYtj_R77FEeUIKUTRYM_0 2024-09-12T19:23:01.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5380119549252635725', time=2024-09-12T20:38:57.259731+0000, chain.objs.size()=1 2024-09-12T19:23:01.603 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.4aPjlyx4-s8HbUwJUA_JdPsjCp8bsl7_0 2024-09-12T19:23:01.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.173023136543608924', time=2024-09-12T20:38:57.771901+0000, chain.objs.size()=1 2024-09-12T19:23:01.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Y7XcMwAMPOx58HMZor6HUz58J4FrdN6_0 2024-09-12T19:23:01.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3931582797630338914', time=2024-09-12T20:39:01.130619+0000, chain.objs.size()=1 2024-09-12T19:23:01.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.B79q63VMc4nIPEbegSkyUfdipRDXjTJ_0 2024-09-12T19:23:01.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6194033911981948453', time=2024-09-12T20:39:02.300024+0000, chain.objs.size()=1 2024-09-12T19:23:01.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.2Tqqere6p00Z29G4KmKcymVR17Ovuoy_0 2024-09-12T19:23:01.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7052674262353647459', time=2024-09-12T20:39:02.301816+0000, chain.objs.size()=1 2024-09-12T19:23:01.604 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.e3UwMDdw2OWiDcebPf4uQqXn5LvWYnw_0 2024-09-12T19:23:01.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.598+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14515094729335444033', time=2024-09-12T20:39:02.669293+0000, chain.objs.size()=1 2024-09-12T19:23:01.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.598+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.D7fwaMOHvLAU53KghUxX6u0H12qx5HA_0 2024-09-12T19:23:01.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45240 2024-09-12T19:23:01.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T19:23:01.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3737226251997804483', time=2024-09-12T20:39:02.984911+0000, chain.objs.size()=1 2024-09-12T19:23:01.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.UamZ2hwV8WHoZzlBb3pXV0ze17Bp3Vs_0 2024-09-12T19:23:01.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10996086832520115704', time=2024-09-12T20:39:04.173463+0000, chain.objs.size()=1 2024-09-12T19:23:01.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.lbQKcSP_Uyna0oFvy0LDc9teVz-Kceb_0 2024-09-12T19:23:01.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4994225651484923810', time=2024-09-12T20:39:05.751425+0000, chain.objs.size()=1 2024-09-12T19:23:01.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.tUWnzlrwUxQKT2IPR7FMzmfJLQQIfog_0 2024-09-12T19:23:01.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4064494802597818441', time=2024-09-12T20:39:11.811942+0000, chain.objs.size()=1 2024-09-12T19:23:01.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.326__shadow_.6aSy5AqdJ3yBQu4DvHuUvgMpUmYv5fk_0 2024-09-12T19:23:01.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13843262295145995815', time=2024-09-12T20:39:15.681181+0000, chain.objs.size()=1 2024-09-12T19:23:01.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.328__shadow_.TXOFSclBRZwAt1HH_XKLSlxDTd9oMQH_0 2024-09-12T19:23:01.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18399007561017217251', time=2024-09-12T20:42:57.314051+0000, chain.objs.size()=1 2024-09-12T19:23:01.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.439__shadow_.7ydfAeFYUuZwWL9Y5YN8J3q2Hc9Gdhr_0 2024-09-12T19:23:01.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17838813335171397880', time=2024-09-12T20:43:01.584703+0000, chain.objs.size()=1 2024-09-12T19:23:01.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.441__shadow_.2LekYVvWXSL5Lws5_yB_wVFEAsoPeu0_0 2024-09-12T19:23:01.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3683713564386405137', time=2024-09-12T20:44:46.911193+0000, chain.objs.size()=1 2024-09-12T19:23:01.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.486__shadow_.v4oRO8BFYhX-AJsFXWLyeYRAMvtxVFK_0 2024-09-12T19:23:01.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16085469987886155397', time=2024-09-12T20:45:14.205824+0000, chain.objs.size()=1 2024-09-12T19:23:01.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.500__shadow_.MzwQG1FxQrgQ_K-hGAmGQp5CHvsvKnv_0 2024-09-12T19:23:01.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5175744091513560973', time=2024-09-12T20:55:54.295495+0000, chain.objs.size()=1 2024-09-12T19:23:01.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.557__shadow_.IfVN0fKU963isq0wSZmWhXPIma8YS0M_0 2024-09-12T19:23:01.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6161605379524396263', time=2024-09-12T20:57:25.561549+0000, chain.objs.size()=1 2024-09-12T19:23:01.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.574__shadow:T0zzrkiWFC9n5CKh3QVEuFarbXKeMCu_.tusoyi5d-sD_Q4Lno2n8U3YwoL-t1-g_0 2024-09-12T19:23:01.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3349083234055505354', time=2024-09-12T20:58:20.768933+0000, chain.objs.size()=1 2024-09-12T19:23:01.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.606+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:K-BI1fv0jUtUzzgWo5EznnV2OWWPOlD_.kR1KNK0XQYwRp7CfFBH6Arjy62UoKSG_0 2024-09-12T19:23:01.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17642627155660297508', time=2024-09-12T20:59:23.665777+0000, chain.objs.size()=4 2024-09-12T19:23:01.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.578__multipart_testobj.2~MmGTmBVSuipwEilhXxVqY6TW-TCQjE4.1 2024-09-12T19:23:01.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.578__multipart_testobj.2~MmGTmBVSuipwEilhXxVqY6TW-TCQjE4.2 2024-09-12T19:23:01.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.578__multipart_testobj.2~MmGTmBVSuipwEilhXxVqY6TW-TCQjE4.3 2024-09-12T19:23:01.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.578__multipart_testobj.2~MmGTmBVSuipwEilhXxVqY6TW-TCQjE4.4 2024-09-12T19:23:01.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17973353714569972288', time=2024-09-12T21:05:23.871010+0000, chain.objs.size()=1 2024-09-12T19:23:01.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.618__shadow_.-tl6vVgSC2m_aFPZVkMnN6WEMQrf1am_0 2024-09-12T19:23:01.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.614+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16817760255002452291', time=2024-09-12T21:10:50.922749+0000, chain.objs.size()=1 2024-09-12T19:23:01.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.614+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.701__shadow:-sAIaXAWNOHDBTIlg2WDItp7c7ToLd1_.VL5NQhsgJfX2hJh-EjWjHBFMWUyMV8j_0 2024-09-12T19:23:01.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.618+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:01.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T19:23:01.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:01.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:01.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47294' 2024-09-12T19:23:01.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='_g4OElsPKnv860p8qqUb20uqxBV5OrOy', time=2024-09-12T20:22:43.173866+0000, chain.objs.size()=2 2024-09-12T19:23:01.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.160__shadow_.wBInA3W0QCnbJA_W2-P6pKcElhbn_t8_0 2024-09-12T19:23:01.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.160__shadow_.wBInA3W0QCnbJA_W2-P6pKcElhbn_t8_1 2024-09-12T19:23:01.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='_vJsdMM3_309WhP2lrlBKqPDzjrQ2xES', time=2024-09-12T20:23:26.836715+0000, chain.objs.size()=1 2024-09-12T19:23:01.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a01e4849-e968-46ce-97f1-a673c26b3735.4529.163__shadow_.37mqOLt8L7JkUxciXoUd8smyrrJnKt2_0 2024-09-12T19:23:01.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2121798817665882959', time=2024-09-12T20:24:15.969817+0000, chain.objs.size()=1 2024-09-12T19:23:01.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.181__shadow_.Ft_aMLl8OkfnYtJnZHhZ7kRVFGmP3A1_0 2024-09-12T19:23:01.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17297728223345187094', time=2024-09-12T20:29:37.093024+0000, chain.objs.size()=1 2024-09-12T19:23:01.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.250__shadow_.fmrsjhffZFX0NXI4eYYoud4AHRqVz2S_0 2024-09-12T19:23:01.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18295276591077034870', time=2024-09-12T20:31:45.285240+0000, chain.objs.size()=1 2024-09-12T19:23:01.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ZwTQFevbm_6uaGis3189a3vzYdLsgux_0 2024-09-12T19:23:01.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9276282384949216738', time=2024-09-12T20:31:48.228188+0000, chain.objs.size()=1 2024-09-12T19:23:01.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.HU9nP6T9Rdn2MB60d-Qsaa6ndjimSd2_0 2024-09-12T19:23:01.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2425989039896292219', time=2024-09-12T20:31:49.624451+0000, chain.objs.size()=1 2024-09-12T19:23:01.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.gHHCSfI7UQLW9pomeQ2dnjYBy7PVZxz_0 2024-09-12T19:23:01.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1915954216211818723', time=2024-09-12T20:31:50.535767+0000, chain.objs.size()=1 2024-09-12T19:23:01.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.AniXTP_E9nJdu0L4zhhI0zeBM70YRpy_0 2024-09-12T19:23:01.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2054537202935904584', time=2024-09-12T20:31:50.706022+0000, chain.objs.size()=1 2024-09-12T19:23:01.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.TSY175uHLOUUm2oKDVWggpj5hRprAFE_0 2024-09-12T19:23:01.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1231005079037205094', time=2024-09-12T20:31:53.484585+0000, chain.objs.size()=1 2024-09-12T19:23:01.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.r3VVmW6qwjHCLWfB0apNa9XE3fsigKL_0 2024-09-12T19:23:01.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10247793765692166884', time=2024-09-12T20:31:53.485259+0000, chain.objs.size()=1 2024-09-12T19:23:01.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.622+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.GXZvbyJMkZVB4IlZx9q1eTOmJWByiJ9_0 2024-09-12T19:23:01.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.626+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10477145231378782839', time=2024-09-12T20:31:54.644102+0000, chain.objs.size()=1 2024-09-12T19:23:01.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.626+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.RPs33sTY5UVrelUdN7_kcDNgtlXGBq-_0 2024-09-12T19:23:01.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7256095239893814154', time=2024-09-12T20:31:56.916427+0000, chain.objs.size()=1 2024-09-12T19:23:01.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.LAtqJRK2XT1zOnWauKrP6IkAmDvylYa_0 2024-09-12T19:23:01.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13353202489876320910', time=2024-09-12T20:31:58.153013+0000, chain.objs.size()=1 2024-09-12T19:23:01.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.VfMKxYw-fcVDDWq2D8DCIjIMqN1A8n4_0 2024-09-12T19:23:01.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17942763792542879579', time=2024-09-12T20:31:58.902386+0000, chain.objs.size()=1 2024-09-12T19:23:01.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.uKCPBYbrLW8jNLEctNejGHSNhkJEA-l_0 2024-09-12T19:23:01.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2825641571484630723', time=2024-09-12T20:31:59.501544+0000, chain.objs.size()=1 2024-09-12T19:23:01.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.l1gZiD9OJ8nVTDWmknnynbn5xIdZAHQ_0 2024-09-12T19:23:01.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8667625604425090277', time=2024-09-12T20:32:03.540150+0000, chain.objs.size()=1 2024-09-12T19:23:01.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.UExGOC3StPJktHS3n2wOkPfNUMlIOTv_0 2024-09-12T19:23:01.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12222922876585123523', time=2024-09-12T20:32:03.556779+0000, chain.objs.size()=1 2024-09-12T19:23:01.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Ba6uErZtSF_dCVOHR2mP5kx1t3hqsyI_0 2024-09-12T19:23:01.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8363743827684779019', time=2024-09-12T20:32:03.589806+0000, chain.objs.size()=1 2024-09-12T19:23:01.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.FZYM2ycRhL36kWXo2crlF5IjHx11e7-_0 2024-09-12T19:23:01.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2797219914092552519', time=2024-09-12T20:32:05.157594+0000, chain.objs.size()=1 2024-09-12T19:23:01.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.L0FoeMYzrnWzU2yot5Kv-gR5Xd9j4xs_0 2024-09-12T19:23:01.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.144486008052156104', time=2024-09-12T20:32:05.867400+0000, chain.objs.size()=1 2024-09-12T19:23:01.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.xtb3H51zbS-7Q55ausoEAp3DkD995EM_0 2024-09-12T19:23:01.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13049350866189870225', time=2024-09-12T20:32:05.869543+0000, chain.objs.size()=1 2024-09-12T19:23:01.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ouACa2chpK0DyJ-_9wBpTXOHoarV_YV_0 2024-09-12T19:23:01.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1474714045553308001', time=2024-09-12T20:32:06.143222+0000, chain.objs.size()=1 2024-09-12T19:23:01.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.630+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.EBCnVhhvn4Rd3RR1v2g_s1ROOa4EgV5_0 2024-09-12T19:23:01.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.634+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4870836052224199680', time=2024-09-12T20:32:09.811684+0000, chain.objs.size()=1 2024-09-12T19:23:01.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.634+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.cMub07PDLbMSK_35EmeAy8pXKO8h_1t_0 2024-09-12T19:23:01.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.634+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13384689231715158626', time=2024-09-12T20:32:10.050348+0000, chain.objs.size()=1 2024-09-12T19:23:01.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.634+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.gFt0EYZ0NZ5fpYfsHn4_x8INkilQnJP_0 2024-09-12T19:23:01.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.634+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12198029502307513307', time=2024-09-12T20:32:10.384333+0000, chain.objs.size()=1 2024-09-12T19:23:01.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.634+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.SCMQTjnUaEL7PBck9vRMTrkfUeIMe_Q_0 2024-09-12T19:23:01.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.634+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7113969895337274537', time=2024-09-12T20:32:12.027024+0000, chain.objs.size()=1 2024-09-12T19:23:01.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.634+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Cpk_nwo1AJDKTgbYVrv2K7KNLyuC1fb_0 2024-09-12T19:23:01.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.634+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1738111553923779300', time=2024-09-12T20:32:12.118802+0000, chain.objs.size()=1 2024-09-12T19:23:01.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.634+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.SidodLVQoRnBC8sFf60V1TeqxNyanmj_0 2024-09-12T19:23:01.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1089362093147449231', time=2024-09-12T20:32:51.923659+0000, chain.objs.size()=1 2024-09-12T19:23:01.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.279__shadow_.GW0-mhAjxfM7BaopauQa0tNfx3weqE__0 2024-09-12T19:23:01.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6391484309977310784', time=2024-09-12T20:32:54.212865+0000, chain.objs.size()=1 2024-09-12T19:23:01.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.280__shadow_.cdvIB5wfY7qhKQG7JZxyULivbSyWJTn_0 2024-09-12T19:23:01.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3556123172916801574', time=2024-09-12T20:33:17.318253+0000, chain.objs.size()=1 2024-09-12T19:23:01.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.290__shadow_.SWYYqsrARQF1qhqMtuQcNP4TK84IZEI_0 2024-09-12T19:23:01.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9458677726722897333', time=2024-09-12T20:33:31.483005+0000, chain.objs.size()=1 2024-09-12T19:23:01.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.o2mYBRNvrCQSAf45lmX83CMReg8XWf__0 2024-09-12T19:23:01.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15787929191568815555', time=2024-09-12T20:33:36.184963+0000, chain.objs.size()=1 2024-09-12T19:23:01.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.295__shadow_.3-LtV8rdiC29oJtD6qWnay29BF8Dcv3_0 2024-09-12T19:23:01.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6659296093576711052', time=2024-09-12T20:33:59.356427+0000, chain.objs.size()=1 2024-09-12T19:23:01.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.305__shadow_.ENFaZuhEljkPs_Uhh_nDw8NRszEpTZd_0 2024-09-12T19:23:01.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11943884549031874331', time=2024-09-12T20:36:28.482647+0000, chain.objs.size()=1 2024-09-12T19:23:01.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Ms5bxycF1dWYaKQlncLNafuiTEY2o4C_0 2024-09-12T19:23:01.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17903846630416193605', time=2024-09-12T20:36:28.484967+0000, chain.objs.size()=1 2024-09-12T19:23:01.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.rHPZ1OlQY_lRSrfTEc7ueNVyyfE-npM_0 2024-09-12T19:23:01.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5375810660460937278', time=2024-09-12T20:36:31.855534+0000, chain.objs.size()=1 2024-09-12T19:23:01.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.3oHRBVmZehjBvh9mAQd6pRBQvL9neg1_0 2024-09-12T19:23:01.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17060674687153403387', time=2024-09-12T20:36:34.676204+0000, chain.objs.size()=1 2024-09-12T19:23:01.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.QbQVWDWIbQxWbAslLasVNOnzav_Cn_o_0 2024-09-12T19:23:01.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16952392631172932766', time=2024-09-12T20:36:36.100671+0000, chain.objs.size()=1 2024-09-12T19:23:01.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.638+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Yt8WByZ7C1pNUjR93xjvpn5LbgStM3w_0 2024-09-12T19:23:01.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.642+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3764340098793925281', time=2024-09-12T20:36:36.724469+0000, chain.objs.size()=1 2024-09-12T19:23:01.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.642+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.PTYxZmOKbXThG5POgsJ3p_IM5N2h_Bk_0 2024-09-12T19:23:01.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.642+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16523608001797603274', time=2024-09-12T20:36:37.082166+0000, chain.objs.size()=1 2024-09-12T19:23:01.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.642+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.IEdez2AopNjNwOrDaOsizppSd25RAjM_0 2024-09-12T19:23:01.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.642+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14171032695126921761', time=2024-09-12T20:36:37.762290+0000, chain.objs.size()=1 2024-09-12T19:23:01.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.642+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.QmOoxI2_NAt69QiMCZec6vcr7-c7_oz_0 2024-09-12T19:23:01.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.642+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13149555258130910688', time=2024-09-12T20:36:40.054707+0000, chain.objs.size()=1 2024-09-12T19:23:01.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.642+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.FlvGHlPRknXawOTzF8VAKcYnBs19SWF_0 2024-09-12T19:23:01.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.642+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14325261019374738627', time=2024-09-12T20:36:40.425547+0000, chain.objs.size()=1 2024-09-12T19:23:01.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.642+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.sX4rHJKYVX59loi8hKBb8Vtz02ILiBR_0 2024-09-12T19:23:01.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.642+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15139977943825896480', time=2024-09-12T20:36:43.318657+0000, chain.objs.size()=1 2024-09-12T19:23:01.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.642+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.48sSXhE7gtO0PlR8EOnjVrdqVRxHfNf_0 2024-09-12T19:23:01.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16294599953645945620', time=2024-09-12T20:36:43.892422+0000, chain.objs.size()=1 2024-09-12T19:23:01.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.13z4BEmt_F5dK8Qy6RcCkBCGoF3ZiWQ_0 2024-09-12T19:23:01.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17042422535337132129', time=2024-09-12T20:36:44.475470+0000, chain.objs.size()=1 2024-09-12T19:23:01.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.pVpDAqgN5TTIE3do5BK4x2y0sZ52d9d_0 2024-09-12T19:23:01.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5327246552633708272', time=2024-09-12T20:36:44.878639+0000, chain.objs.size()=1 2024-09-12T19:23:01.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.GMs4txqp04VDrSm_8YnE4wE2I_xAQvX_0 2024-09-12T19:23:01.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6331449493837211307', time=2024-09-12T20:36:45.717257+0000, chain.objs.size()=1 2024-09-12T19:23:01.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Ku9ZX01tDzC-jElxPKwl9dVVha1lgA3_0 2024-09-12T19:23:01.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13596308756095254849', time=2024-09-12T20:36:46.114561+0000, chain.objs.size()=1 2024-09-12T19:23:01.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.cACw9d6G0D1ecsPdd29yOfqW8LYGaQb_0 2024-09-12T19:23:01.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.646+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17603886853080935608', time=2024-09-12T20:36:46.980790+0000, chain.objs.size()=1 2024-09-12T19:23:01.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.646+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.S3iJLvRnIg5ioqS-4AUrW3e0USyFeoI_0 2024-09-12T19:23:01.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10168665230963223185', time=2024-09-12T20:36:48.525168+0000, chain.objs.size()=1 2024-09-12T19:23:01.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.6cP-6q7WwoavRIrm2e1vSoDqxfDTp34_0 2024-09-12T19:23:01.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1295787752389117101', time=2024-09-12T20:36:49.341747+0000, chain.objs.size()=1 2024-09-12T19:23:01.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Sr2la9Wp0nSS79rfDnWgJKiTXx9SLgq_0 2024-09-12T19:23:01.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12333154901632043940', time=2024-09-12T20:36:49.814170+0000, chain.objs.size()=1 2024-09-12T19:23:01.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.lYnZVBXwvs65qiAZr_bkdteVU0EWwSp_0 2024-09-12T19:23:01.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9514266538314874766', time=2024-09-12T20:36:51.463977+0000, chain.objs.size()=1 2024-09-12T19:23:01.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.zNE-3qJKFlhE65Tzjqb6P_uikIrdgWy_0 2024-09-12T19:23:01.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17790234259266011464', time=2024-09-12T20:36:52.653097+0000, chain.objs.size()=1 2024-09-12T19:23:01.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.6ol0oI6c9aNVl2SK5dJBf9X0zgICGvB_0 2024-09-12T19:23:01.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10581574714496328430', time=2024-09-12T20:36:53.117372+0000, chain.objs.size()=1 2024-09-12T19:23:01.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.UJcPpQuJWG_SsFtE_XSPBP_4aPKXBla_0 2024-09-12T19:23:01.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7328351932087771225', time=2024-09-12T20:36:54.807484+0000, chain.objs.size()=1 2024-09-12T19:23:01.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.gac2auvpjseApeyIPVQZgRl_xy1odKC_0 2024-09-12T19:23:01.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15302247645797989163', time=2024-09-12T20:36:55.387020+0000, chain.objs.size()=1 2024-09-12T19:23:01.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.H1fLbVuz2T28D4ZL8Osn__Jgy5K6x2d_0 2024-09-12T19:23:01.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3522832616597344336', time=2024-09-12T20:38:40.288451+0000, chain.objs.size()=1 2024-09-12T19:23:01.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.SGN73RmsXvBxCG6t-YzNbhGoSbcF_NO_0 2024-09-12T19:23:01.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6710095111568012965', time=2024-09-12T20:38:40.290567+0000, chain.objs.size()=1 2024-09-12T19:23:01.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-d28PgyDoniRPCJEFRtZNcX61cikdBA_0 2024-09-12T19:23:01.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6499563972630071161', time=2024-09-12T20:38:41.730056+0000, chain.objs.size()=1 2024-09-12T19:23:01.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.650+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.xiSqGltfItFHIieY3nyIaGmM51Z7GS__0 2024-09-12T19:23:01.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.654+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.384978085461994188', time=2024-09-12T20:38:43.720002+0000, chain.objs.size()=1 2024-09-12T19:23:01.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.654+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.IRcAGJqdvPB88Z6oicciB3_dcYwC7VY_0 2024-09-12T19:23:01.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.654+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9130964628496558785', time=2024-09-12T20:38:45.182544+0000, chain.objs.size()=1 2024-09-12T19:23:01.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.654+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.vzO24IiRj64AbNsrZFF0lybs4H6w4XB_0 2024-09-12T19:23:01.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.654+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3831638553894191677', time=2024-09-12T20:38:45.297581+0000, chain.objs.size()=1 2024-09-12T19:23:01.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.654+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Wr3tM9X7OqzAgj5_ssyKilDtGyhtx8c_0 2024-09-12T19:23:01.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.654+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2190704150717692900', time=2024-09-12T20:38:45.299934+0000, chain.objs.size()=1 2024-09-12T19:23:01.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.654+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.fZ2PYjpKfZgxcDPwr6sphi0BEGBkzkc_0 2024-09-12T19:23:01.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.654+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6294880367903478180', time=2024-09-12T20:38:45.955302+0000, chain.objs.size()=1 2024-09-12T19:23:01.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.654+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.MKrDlkQVNuGclonil_ObM-5cvrDrjos_0 2024-09-12T19:23:01.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.654+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14222846671224889117', time=2024-09-12T20:38:46.407918+0000, chain.objs.size()=1 2024-09-12T19:23:01.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.654+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.0KNSLEgpxqbNKShVVnSZxbUrClw4IV5_0 2024-09-12T19:23:01.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8064956491106906314', time=2024-09-12T20:38:47.751226+0000, chain.objs.size()=1 2024-09-12T19:23:01.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.6nG6YXMUAkBiDJUHzwcJ9ujEt0Gj3RX_0 2024-09-12T19:23:01.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17445224573910038481', time=2024-09-12T20:38:48.384656+0000, chain.objs.size()=1 2024-09-12T19:23:01.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.GNGKn0krh7HoIAGunACYcC1_tKgWWkE_0 2024-09-12T19:23:01.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8639106491314937674', time=2024-09-12T20:38:48.476001+0000, chain.objs.size()=1 2024-09-12T19:23:01.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.9c9iW9m35ciNas_OQ2SEUp2hjruSRN7_0 2024-09-12T19:23:01.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8047985851596028218', time=2024-09-12T20:38:48.506439+0000, chain.objs.size()=1 2024-09-12T19:23:01.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.J9AGAAb7UWpn5naH5qLcDXCrOaNPLie_0 2024-09-12T19:23:01.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12282254869514417007', time=2024-09-12T20:38:48.508170+0000, chain.objs.size()=1 2024-09-12T19:23:01.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.jbmJTZrqxo9nxrFCHZbz-m5GmhRZCfe_0 2024-09-12T19:23:01.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5059460270602187379', time=2024-09-12T20:38:49.010694+0000, chain.objs.size()=1 2024-09-12T19:23:01.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.BHUN5zqsDAnzrYi1y3gyJgGwZDPuwhP_0 2024-09-12T19:23:01.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13063283417482200278', time=2024-09-12T20:38:49.158680+0000, chain.objs.size()=1 2024-09-12T19:23:01.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.qw0h7IP4m-pwkkDzjQKvcecX08_0REM_0 2024-09-12T19:23:01.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13743333083913002771', time=2024-09-12T20:38:52.200458+0000, chain.objs.size()=1 2024-09-12T19:23:01.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.kRfg6N1nh9ArZ2H1Ua9lWyGo5wYznGu_0 2024-09-12T19:23:01.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.658+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12465604268429416418', time=2024-09-12T20:38:52.935446+0000, chain.objs.size()=1 2024-09-12T19:23:01.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.658+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ALLiwaLFPpb7XB1VomS6vYKrz-AZV9O_0 2024-09-12T19:23:01.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1741189611420758579', time=2024-09-12T20:38:53.770728+0000, chain.objs.size()=1 2024-09-12T19:23:01.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.SrpjC5qaUZ8x-XtkyPUjkDGziDG9N9B_0 2024-09-12T19:23:01.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3294830509197949978', time=2024-09-12T20:38:55.908264+0000, chain.objs.size()=1 2024-09-12T19:23:01.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.6iGXEcSBkuMsqV7pns7mPjei-RLyJTy_0 2024-09-12T19:23:01.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.690195955379228862', time=2024-09-12T20:38:56.905496+0000, chain.objs.size()=1 2024-09-12T19:23:01.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.H9tfdoBOtjP91p651sk_Mr16W2gjDI2_0 2024-09-12T19:23:01.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.931318721459639863', time=2024-09-12T20:38:58.945138+0000, chain.objs.size()=1 2024-09-12T19:23:01.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.xglNAzsFr1Z3UnZRWe-vln8V5axOH51_0 2024-09-12T19:23:01.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10526173734031489448', time=2024-09-12T20:38:59.371713+0000, chain.objs.size()=1 2024-09-12T19:23:01.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.1Y_qKIfebWtVGSQaESzr8Se0cRQfEKY_0 2024-09-12T19:23:01.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10811017395264702366', time=2024-09-12T20:39:01.228742+0000, chain.objs.size()=1 2024-09-12T19:23:01.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_._uIC0IiffAhcNRRxgOnT5K4po8mvHLU_0 2024-09-12T19:23:01.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11517148169081226180', time=2024-09-12T20:39:02.164194+0000, chain.objs.size()=1 2024-09-12T19:23:01.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.JCBk7PwrOhld39oiPOBSOsQ_s2tPp8x_0 2024-09-12T19:23:01.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.151798425337612465', time=2024-09-12T20:39:03.977662+0000, chain.objs.size()=1 2024-09-12T19:23:01.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.4wPE2bfevyH5lvVVWIWi65q6TcyUJW6_0 2024-09-12T19:23:01.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6148772204581539083', time=2024-09-12T20:39:03.980061+0000, chain.objs.size()=1 2024-09-12T19:23:01.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.7DzRIBR3qIOxrScGX7rYCVOso3CAvXa_0 2024-09-12T19:23:01.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16576817546097539881', time=2024-09-12T20:39:04.205729+0000, chain.objs.size()=1 2024-09-12T19:23:01.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.5M2LFiCMhR05R_tcTTW1329hQ-Mykwg_0 2024-09-12T19:23:01.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11477628257264860819', time=2024-09-12T20:39:04.815033+0000, chain.objs.size()=1 2024-09-12T19:23:01.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.662+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.X9tYdRONxf65sakhZArwt4ZLRKX0Xob_0 2024-09-12T19:23:01.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.666+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2828545217584819154', time=2024-09-12T20:39:06.107324+0000, chain.objs.size()=1 2024-09-12T19:23:01.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.666+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.RFNOntjFQ5OKflRlxBC7gLagszTmmL5_0 2024-09-12T19:23:01.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.666+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9609251954394689947', time=2024-09-12T20:39:06.559202+0000, chain.objs.size()=1 2024-09-12T19:23:01.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.666+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-QeQkdiLjTVAtZnXvRkI9GGvapW2TpB_0 2024-09-12T19:23:01.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.666+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1789312551787409630', time=2024-09-12T20:39:06.561999+0000, chain.objs.size()=1 2024-09-12T19:23:01.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.666+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.TsD2Puxwv-qi6RkBD5Jr3SQa_WaI1Zv_0 2024-09-12T19:23:01.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.666+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13462048067155695967', time=2024-09-12T20:39:21.717689+0000, chain.objs.size()=1 2024-09-12T19:23:01.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.666+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.331__shadow_.RFKwJzbQFSZBk0yyl1NDYDFMcVX_qjG_0 2024-09-12T19:23:01.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2814393866061317937', time=2024-09-12T20:39:45.110576+0000, chain.objs.size()=1 2024-09-12T19:23:01.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.342__shadow_.WWJ1IWCL59VVru89qoDtsXUpNgz2AzS_0 2024-09-12T19:23:01.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8069651917095158849', time=2024-09-12T20:41:04.204709+0000, chain.objs.size()=1 2024-09-12T19:23:01.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.383__shadow_.m4FFybmktAECBIwqtxJuDrHZOgDMW5o_0 2024-09-12T19:23:01.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16531401981027158520', time=2024-09-12T20:42:46.307824+0000, chain.objs.size()=1 2024-09-12T19:23:01.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.434__shadow_.m7_mLyMRD9nAW2GilUMOGTO2F50_WFr_0 2024-09-12T19:23:01.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12007901243332174874', time=2024-09-12T20:44:33.670693+0000, chain.objs.size()=1 2024-09-12T19:23:01.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.483__shadow_.Dmtx8qkeQA7zO4f1vkUpEKyAC2F58ix_0 2024-09-12T19:23:01.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17768459180201385194', time=2024-09-12T20:46:06.559466+0000, chain.objs.size()=6 2024-09-12T19:23:01.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.1 2024-09-12T19:23:01.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.2 2024-09-12T19:23:01.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.3 2024-09-12T19:23:01.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.4 2024-09-12T19:23:01.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.5 2024-09-12T19:23:01.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.507__multipart_srcmultipart.2~S-Q3FHr9llzQtvqePIAAYePqTDj3kU7.6 2024-09-12T19:23:01.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.670+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4272400654444323286', time=2024-09-12T20:48:14.662450+0000, chain.objs.size()=1 2024-09-12T19:23:01.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.670+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.520__shadow:AOmsgF8tB75kUeDaX0sAnPmYTgFY3OH_.eVQ1VsN7iHii-tPfTstxnDjcd42F1R0_0 2024-09-12T19:23:01.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.674+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8844631115201488104', time=2024-09-12T20:56:44.536069+0000, chain.objs.size()=1 2024-09-12T19:23:01.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.674+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:aCuRuqvmm9ZDSwgU8rUDyLmgDvREHQW_.GWFOfWnSsHdMUN5Iznp1zXZ4iBN-rXB_0 2024-09-12T19:23:01.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.674+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11496809531594691110', time=2024-09-12T20:57:09.438436+0000, chain.objs.size()=1 2024-09-12T19:23:01.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.674+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.570__shadow:nMdvcRqEn9V7Uknb9SbUVLeMZ1ThDz7_.D93-cU9L3NWCzsIC2kj_LWlav9QUOgn_0 2024-09-12T19:23:01.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.678+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47294 2024-09-12T19:23:01.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.682+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T19:23:01.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.682+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10271355030406193999', time=2024-09-12T20:58:19.373304+0000, chain.objs.size()=1 2024-09-12T19:23:01.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.682+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:ljUV3EcvHY504X-2vFacd02IBvch8og_.rMsdoLjIyRjMRxrlyxdRLjHfbNgSJlI_0 2024-09-12T19:23:01.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.682+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2403537755888974891', time=2024-09-12T20:59:29.334787+0000, chain.objs.size()=1 2024-09-12T19:23:01.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.682+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.579__shadow:lq3ob-lRPLTw5g5Brp6ahtejYLdpBma_.-0fvvpA9FbHBohYg7yND_AfBWYM3vnt_0 2024-09-12T19:23:01.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.682+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11392525062740235250', time=2024-09-12T20:59:50.330899+0000, chain.objs.size()=1 2024-09-12T19:23:01.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.682+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.586__shadow:y9G2Hqhy5CeP1hxHNAoo33w1wuvzbrV_.U7F8q_8FraT4QsV04nC_Gv9O3RvoUSZ_0 2024-09-12T19:23:01.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.682+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3946189960420007093', time=2024-09-12T20:59:50.410538+0000, chain.objs.size()=1 2024-09-12T19:23:01.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.682+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.586__shadow:I.6rY43giznLQ83vE-86CODlc.bOO8A_.ZMkgQ-LsZ7nBQgd0NsUhKUfMeeU5839_0 2024-09-12T19:23:01.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.682+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7450138302000204651', time=2024-09-12T21:07:45.430015+0000, chain.objs.size()=1 2024-09-12T19:23:01.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.682+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.644__shadow_.bwcBYbJwAeYixlD9NUrzgBea-EK4YRE_0 2024-09-12T19:23:01.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.682+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6615862411577028326', time=2024-09-12T21:09:49.211952+0000, chain.objs.size()=1 2024-09-12T19:23:01.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.682+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.668__shadow_.g3LGgyi2B8EkocTvWc849FY8QV9bte__0 2024-09-12T19:23:01.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.682+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2714987465961158615', time=2024-09-12T21:10:42.633469+0000, chain.objs.size()=1 2024-09-12T19:23:01.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.682+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.697__shadow:LqcVglcBj.svPZas5py347hFImVj0-6_.dXxHNDKLQyX0T9xlbLLs3L-FKxQQIpN_0 2024-09-12T19:23:01.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.682+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2505303947599566782', time=2024-09-12T21:14:08.421073+0000, chain.objs.size()=1 2024-09-12T19:23:01.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.682+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.745__shadow_.i9eYNakcBFppqFUxc5p9KmoYeKZIsT5_0 2024-09-12T19:23:01.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.686+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:01.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.686+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T19:23:01.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:01.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:01.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49822' 2024-09-12T19:23:01.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18237908510934632511', time=2024-09-12T20:22:39.501533+0000, chain.objs.size()=2 2024-09-12T19:23:01.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.160__shadow_.9biPpHg4CAEG5phAQ833HU0vLQWyedk_0 2024-09-12T19:23:01.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a01e4849-e968-46ce-97f1-a673c26b3735.4529.160__shadow_.9biPpHg4CAEG5phAQ833HU0vLQWyedk_1 2024-09-12T19:23:01.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13276202536121520729', time=2024-09-12T20:25:05.527262+0000, chain.objs.size()=1 2024-09-12T19:23:01.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.197__shadow_.iJ77q68T5e0jr0UNf42TTydm8t0ldBK_0 2024-09-12T19:23:01.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8184452719291099320', time=2024-09-12T20:28:45.705840+0000, chain.objs.size()=1 2024-09-12T19:23:01.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.230__shadow_.I4N62LDmHHkL6KygTTVhC9mNo1df9N4_0 2024-09-12T19:23:01.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2700780371768398877', time=2024-09-12T20:28:54.839040+0000, chain.objs.size()=1 2024-09-12T19:23:01.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.234__shadow_.PtThEwLZXw17-KKMEiTJGoy0Nb-CdNn_0 2024-09-12T19:23:01.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11469176311813961844', time=2024-09-12T20:28:57.144778+0000, chain.objs.size()=1 2024-09-12T19:23:01.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.235__shadow_.hBaGWlMlFOkJQdyoPiFSNLUs9Olfspc_0 2024-09-12T19:23:01.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13589171890529346685', time=2024-09-12T20:29:39.376911+0000, chain.objs.size()=1 2024-09-12T19:23:01.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.251__shadow_.uq8C_i0aJ7kYPKdc0v4-Q_IL0lahFCv_0 2024-09-12T19:23:01.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17283191880825457949', time=2024-09-12T20:29:41.671914+0000, chain.objs.size()=1 2024-09-12T19:23:01.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.252__shadow_.YnAiAfTPBrPODLXAHzHmIqR1UC9VhW4_0 2024-09-12T19:23:01.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13003861860898997170', time=2024-09-12T20:29:41.673795+0000, chain.objs.size()=1 2024-09-12T19:23:01.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.252__shadow_.YCTHrGY6a4rtLwr08GeX51N4yRCBUmo_0 2024-09-12T19:23:01.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.373387817208886589', time=2024-09-12T20:29:55.321457+0000, chain.objs.size()=1 2024-09-12T19:23:01.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.258__shadow_.Whyu13nxbBF7trwFhGFUDCvgflLspcQ_0 2024-09-12T19:23:01.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2989337181545092641', time=2024-09-12T20:31:46.137713+0000, chain.objs.size()=1 2024-09-12T19:23:01.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.H4fusocMYHn3Pq4BPxa3JB5EBAf2iPZ_0 2024-09-12T19:23:01.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8774612517914775739', time=2024-09-12T20:31:46.947667+0000, chain.objs.size()=1 2024-09-12T19:23:01.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.690+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.6RSuQjHFeQqFQjQeMrVczy3Dhd3qFU9_0 2024-09-12T19:23:01.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.694+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11977968692668766801', time=2024-09-12T20:31:49.313149+0000, chain.objs.size()=1 2024-09-12T19:23:01.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.694+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.8qtbxypa76Wz46ycnZlR7Bdqe-dJguD_0 2024-09-12T19:23:01.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.698+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.631054980467729275', time=2024-09-12T20:31:51.179028+0000, chain.objs.size()=1 2024-09-12T19:23:01.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.698+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.pbH8vk5aee-1NMIaAbkaH1DjS_j76IG_0 2024-09-12T19:23:01.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.698+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6800002606058874069', time=2024-09-12T20:31:52.056260+0000, chain.objs.size()=1 2024-09-12T19:23:01.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.698+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.mIQ_fMu0nNiaJxFVGAKUCcilRIoaSEO_0 2024-09-12T19:23:01.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.698+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13485679031144425650', time=2024-09-12T20:31:53.107950+0000, chain.objs.size()=1 2024-09-12T19:23:01.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.698+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.m7PUyIoxB_oJkt9R6oA7zCAjz7l_4T6_0 2024-09-12T19:23:01.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.698+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9463459967564462846', time=2024-09-12T20:31:53.212503+0000, chain.objs.size()=1 2024-09-12T19:23:01.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.698+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.58l05r82MxTuyOT9yIt4Oim-1j910Hx_0 2024-09-12T19:23:01.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.698+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10108144864970666796', time=2024-09-12T20:31:53.415602+0000, chain.objs.size()=1 2024-09-12T19:23:01.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.698+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.E-Oj59tDcn1-JABkjf7ljwZWTG6-GLK_0 2024-09-12T19:23:01.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.698+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8406885370165320178', time=2024-09-12T20:31:54.047206+0000, chain.objs.size()=1 2024-09-12T19:23:01.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.698+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ToNrLjl2u3gkZ4oE__H-ThsQS4ZqyR3_0 2024-09-12T19:23:01.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.698+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5216176549287488660', time=2024-09-12T20:31:54.444536+0000, chain.objs.size()=1 2024-09-12T19:23:01.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.698+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.LU9T2hft5YhH4tHuA76pPFtzAc3juy6_0 2024-09-12T19:23:01.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.698+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2461379510206329072', time=2024-09-12T20:31:54.470245+0000, chain.objs.size()=1 2024-09-12T19:23:01.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.698+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.4t9M0JdfsrLHcyKJzQfiOOzI9_ic8dT_0 2024-09-12T19:23:01.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.698+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12237409523796869795', time=2024-09-12T20:31:55.212285+0000, chain.objs.size()=1 2024-09-12T19:23:01.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.698+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Rey6jOPf3sN9I8e0il39f-YbE0Umbse_0 2024-09-12T19:23:01.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.698+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10554580509245445168', time=2024-09-12T20:31:55.865871+0000, chain.objs.size()=1 2024-09-12T19:23:01.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.698+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.vbRtT-O6khuM5-cv0Oe9LMSVLNJFfvn_0 2024-09-12T19:23:01.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15238770547494046183', time=2024-09-12T20:31:56.929848+0000, chain.objs.size()=1 2024-09-12T19:23:01.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.bxphYM7sZy3kvDqwZHyKXf8no-AhTJv_0 2024-09-12T19:23:01.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16707940683187569572', time=2024-09-12T20:31:58.079098+0000, chain.objs.size()=1 2024-09-12T19:23:01.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.cLkf8oH45GuNO7EyhfMA7qOOx0WrBjX_0 2024-09-12T19:23:01.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11836203121010652339', time=2024-09-12T20:31:58.157918+0000, chain.objs.size()=1 2024-09-12T19:23:01.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.a2tgUONP6QgPv1g_gBcmk8x9wRTvW4S_0 2024-09-12T19:23:01.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5822803424335769693', time=2024-09-12T20:31:59.025600+0000, chain.objs.size()=1 2024-09-12T19:23:01.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.5WLWlUYFoNbfhTTYiuHmzxbRZxjLz91_0 2024-09-12T19:23:01.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.125394348916229503', time=2024-09-12T20:32:01.543679+0000, chain.objs.size()=1 2024-09-12T19:23:01.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.7ZpBbyIpil5INqc0luBOdeBiWMvHOBW_0 2024-09-12T19:23:01.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16321217738574908877', time=2024-09-12T20:32:02.467329+0000, chain.objs.size()=1 2024-09-12T19:23:01.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.3Kq4QaTcYjvXofwXEhZjQEJN5daIFVF_0 2024-09-12T19:23:01.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1800828746307375094', time=2024-09-12T20:32:02.468716+0000, chain.objs.size()=1 2024-09-12T19:23:01.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.kT25E646pIh8sSkf4VCLki7TnSVuhEj_0 2024-09-12T19:23:01.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11479941392280434704', time=2024-09-12T20:32:04.376815+0000, chain.objs.size()=1 2024-09-12T19:23:01.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ApYzYJHwnt_rqrwSSqi6liJICInuC2d_0 2024-09-12T19:23:01.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1641872347621901928', time=2024-09-12T20:32:04.425112+0000, chain.objs.size()=1 2024-09-12T19:23:01.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.hNU0SEbAg7XwNsDVUIxHz7Lf7uKBYuL_0 2024-09-12T19:23:01.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5336300292136585049', time=2024-09-12T20:32:05.654350+0000, chain.objs.size()=1 2024-09-12T19:23:01.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.QlNaFvj97E3iZD9xjWAodPNfuWTUZtz_0 2024-09-12T19:23:01.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18022457139218499967', time=2024-09-12T20:32:07.219377+0000, chain.objs.size()=1 2024-09-12T19:23:01.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.702+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.R_sz7MDweHEqA9EfzMdrAycs8s8-Id-_0 2024-09-12T19:23:01.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.706+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13454333766635448380', time=2024-09-12T20:32:08.046459+0000, chain.objs.size()=1 2024-09-12T19:23:01.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.706+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.sv3Fkl22TLrRFZyTQpLBGX8ZNmDu7MM_0 2024-09-12T19:23:01.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.706+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11657833479291416728', time=2024-09-12T20:32:08.049943+0000, chain.objs.size()=1 2024-09-12T19:23:01.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.706+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.B31BqmQuAEiidtDDwwaH5kHBfr-RgDg_0 2024-09-12T19:23:01.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.706+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11045781154803322663', time=2024-09-12T20:32:09.163265+0000, chain.objs.size()=1 2024-09-12T19:23:01.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.706+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.90u92qtD1GMqZ85IsIgTCEu4WoPaHJn_0 2024-09-12T19:23:01.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.706+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4128996761132998841', time=2024-09-12T20:32:10.344897+0000, chain.objs.size()=1 2024-09-12T19:23:01.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.706+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.7yE02aaKZS6UP7--Cs8QiOzaW9uGUc2_0 2024-09-12T19:23:01.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12434400964437884713', time=2024-09-12T20:32:31.542250+0000, chain.objs.size()=1 2024-09-12T19:23:01.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.270__shadow_.Ll3DOcRwTnA7LatV-EJgOXJqp8yMCbP_0 2024-09-12T19:23:01.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15402558416321469434', time=2024-09-12T20:32:44.885686+0000, chain.objs.size()=1 2024-09-12T19:23:01.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.276__shadow_.4vCs7FwYmzmtG1j5WYVC_LIUcWHSldz_0 2024-09-12T19:23:01.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13678951999588336735', time=2024-09-12T20:32:51.922977+0000, chain.objs.size()=1 2024-09-12T19:23:01.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.279__shadow_.YhRm5XgX_pPXE12ILm1tFLwW0aH3Ngk_0 2024-09-12T19:23:01.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1857544377157097481', time=2024-09-12T20:33:08.174508+0000, chain.objs.size()=1 2024-09-12T19:23:01.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.286__shadow_.NvtUvqnbEmXJ5hZH_zIQDv97fdGbk9S_0 2024-09-12T19:23:01.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2514745040349169787', time=2024-09-12T20:33:25.750444+0000, chain.objs.size()=1 2024-09-12T19:23:01.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.Xd60yiJL9YitVolLynM-xg6oiYegWqF_0 2024-09-12T19:23:01.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7781468905542348783', time=2024-09-12T20:33:31.056344+0000, chain.objs.size()=1 2024-09-12T19:23:01.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.dRquPvOT_UvQVoeiBR2F0Kg_sRpBtEj_0 2024-09-12T19:23:01.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1621686882752694342', time=2024-09-12T20:36:29.560506+0000, chain.objs.size()=1 2024-09-12T19:23:01.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.5I9NRznQeivNXD4yO0ROJwF6JVz7Jb1_0 2024-09-12T19:23:01.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.710+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12456223108122438931', time=2024-09-12T20:36:30.133597+0000, chain.objs.size()=1 2024-09-12T19:23:01.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.710+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.-LxoNIQoZdjKrgga7GJQUsMKSQ5CJm3_0 2024-09-12T19:23:01.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.714+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6241536656365223139', time=2024-09-12T20:36:30.262096+0000, chain.objs.size()=1 2024-09-12T19:23:01.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.714+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.KuI_Pc8x6EqgWChZd-356O8RzOHNCX8_0 2024-09-12T19:23:01.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.714+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9732651434304998330', time=2024-09-12T20:36:30.556827+0000, chain.objs.size()=1 2024-09-12T19:23:01.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.714+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.GEWaaiL4UlgZ5Q1bWmxfJd6I18b-v_G_0 2024-09-12T19:23:01.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.714+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16699470554850335046', time=2024-09-12T20:36:33.424041+0000, chain.objs.size()=1 2024-09-12T19:23:01.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.714+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.VTpm2dmvdnF2fIZpCZERvO4rRJJgmfl_0 2024-09-12T19:23:01.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.714+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7432125566419436551', time=2024-09-12T20:36:34.078037+0000, chain.objs.size()=1 2024-09-12T19:23:01.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.714+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.7itPkqYeeV-KCDAjxNyk-dnXXjDTzpn_0 2024-09-12T19:23:01.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.714+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2496909907350882499', time=2024-09-12T20:36:34.522296+0000, chain.objs.size()=1 2024-09-12T19:23:01.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.714+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.-Lemlzo9VDtfQ0ck-JAauKlB1TsiVS4_0 2024-09-12T19:23:01.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16801038330404055649', time=2024-09-12T20:36:35.834405+0000, chain.objs.size()=1 2024-09-12T19:23:01.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.FtcWuTBD8dmUQiKQ0mJJzzfYH63mWt4_0 2024-09-12T19:23:01.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3526149297902176422', time=2024-09-12T20:36:36.156165+0000, chain.objs.size()=1 2024-09-12T19:23:01.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.7iMOcoQdqEhAJPW76mm7SGICnZX2zxB_0 2024-09-12T19:23:01.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14152449911993372558', time=2024-09-12T20:36:36.268553+0000, chain.objs.size()=1 2024-09-12T19:23:01.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.RRN7raHouHgmx-ow-FyOhZtiQfur2hi_0 2024-09-12T19:23:01.724 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14498040178391865415', time=2024-09-12T20:36:36.751364+0000, chain.objs.size()=1 2024-09-12T19:23:01.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.k6o0P_a7FSz-tVhHpI4Nh8lOjBgtwWb_0 2024-09-12T19:23:01.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6497254636542781827', time=2024-09-12T20:36:39.538541+0000, chain.objs.size()=1 2024-09-12T19:23:01.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.IZ69gK-AjlOOrKdEYxZw3h5UcubZZqM_0 2024-09-12T19:23:01.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3826283561796757928', time=2024-09-12T20:36:39.606312+0000, chain.objs.size()=1 2024-09-12T19:23:01.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.nVxUfCJ6u3WH9MhiZFyXt6lSR2pp5uW_0 2024-09-12T19:23:01.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.160901175095827608', time=2024-09-12T20:36:40.879630+0000, chain.objs.size()=1 2024-09-12T19:23:01.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.woOokVVb65LzkcBXJnvBMwaICfdMq02_0 2024-09-12T19:23:01.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3496453580031260160', time=2024-09-12T20:36:43.622400+0000, chain.objs.size()=1 2024-09-12T19:23:01.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.KH3ydys8rV1zMk61UeXjpICW3EkPbjL_0 2024-09-12T19:23:01.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8775615546656424767', time=2024-09-12T20:36:43.658340+0000, chain.objs.size()=1 2024-09-12T19:23:01.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.tVx4k8VSBQFzz4sYuz2MjLEH9uOUqeh_0 2024-09-12T19:23:01.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3084496291756564174', time=2024-09-12T20:36:44.500711+0000, chain.objs.size()=1 2024-09-12T19:23:01.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.NKGROG4hUw-zaYgZIX8PzHheIeRyjw1_0 2024-09-12T19:23:01.727 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2185173149483131271', time=2024-09-12T20:36:44.967645+0000, chain.objs.size()=1 2024-09-12T19:23:01.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.718+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ixxiu7w8saFGqa-oc5UZeRu-UJz62eS_0 2024-09-12T19:23:01.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7165205970473304169', time=2024-09-12T20:36:44.969271+0000, chain.objs.size()=1 2024-09-12T19:23:01.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.yy9aImYy17KX0mzwQXDcqrUPfPfeo5M_0 2024-09-12T19:23:01.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12574246692165920869', time=2024-09-12T20:36:45.015068+0000, chain.objs.size()=1 2024-09-12T19:23:01.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.3eSVUw5bSCuGxs2mdZGM1eLoLFa9UV8_0 2024-09-12T19:23:01.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7096694162584522378', time=2024-09-12T20:36:45.214690+0000, chain.objs.size()=1 2024-09-12T19:23:01.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.JRNDngCUVamtZRwJCcTSygoK7glVuwZ_0 2024-09-12T19:23:01.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.722+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5401403552946156320', time=2024-09-12T20:36:45.407079+0000, chain.objs.size()=1 2024-09-12T19:23:01.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.722+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.-d7ONtm6CDbDR2GUh_NZPKVRkslwm_x_0 2024-09-12T19:23:01.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7099766853477869610', time=2024-09-12T20:36:45.410691+0000, chain.objs.size()=1 2024-09-12T19:23:01.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.3BFHO5b-vwXm9oscMCxIfBRqj32W7xz_0 2024-09-12T19:23:01.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6976199295149606276', time=2024-09-12T20:36:45.756239+0000, chain.objs.size()=1 2024-09-12T19:23:01.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.b4-KCCijstQi-68X3KoVxEXQujv5sPT_0 2024-09-12T19:23:01.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15152325021303681233', time=2024-09-12T20:36:48.374233+0000, chain.objs.size()=1 2024-09-12T19:23:01.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.UrYOOam7UOYgYy2RGnerekbqOIy61J__0 2024-09-12T19:23:01.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7772632546772826931', time=2024-09-12T20:36:48.950513+0000, chain.objs.size()=1 2024-09-12T19:23:01.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.CzJoy7S7AczlXqGhaaGOGApayK0J_N0_0 2024-09-12T19:23:01.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4503890775029707782', time=2024-09-12T20:36:50.849341+0000, chain.objs.size()=1 2024-09-12T19:23:01.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.bXZ6UzeLLHRkdCo7cnyEyXseFDGO7u9_0 2024-09-12T19:23:01.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9048950737928784856', time=2024-09-12T20:36:52.414254+0000, chain.objs.size()=1 2024-09-12T19:23:01.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.HRz3RJs9PyYyx7QExsAHtJFf6-leg-N_0 2024-09-12T19:23:01.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18417986828569418838', time=2024-09-12T20:36:55.177248+0000, chain.objs.size()=1 2024-09-12T19:23:01.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.xx9756G9EcBYdCVe2buFXoDo0cVJzLM_0 2024-09-12T19:23:01.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.726+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10731932654512479890', time=2024-09-12T20:36:55.246196+0000, chain.objs.size()=1 2024-09-12T19:23:01.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.726+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.YtWFHoh70oNOKsLVCaGvTM0u9ODSVhW_0 2024-09-12T19:23:01.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14667373677226936131', time=2024-09-12T20:36:55.664211+0000, chain.objs.size()=1 2024-09-12T19:23:01.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.-x6tcvLA_QTYXzuH9PrVdy5WFO0lurR_0 2024-09-12T19:23:01.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11356075161736651777', time=2024-09-12T20:36:56.314691+0000, chain.objs.size()=1 2024-09-12T19:23:01.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.kDq8rAlLt1_kfHTX92_lec1COX_7IT9_0 2024-09-12T19:23:01.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1797835510783288409', time=2024-09-12T20:38:40.710448+0000, chain.objs.size()=1 2024-09-12T19:23:01.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.zKNgzWEvFSdQEQg1nwIZLWsOI-wdpsd_0 2024-09-12T19:23:01.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7321913755794297029', time=2024-09-12T20:38:40.861382+0000, chain.objs.size()=1 2024-09-12T19:23:01.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-8GdVJPFBQJ1DoRfmCh5o1LAGKqKV23_0 2024-09-12T19:23:01.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13091871244164347522', time=2024-09-12T20:38:41.391318+0000, chain.objs.size()=1 2024-09-12T19:23:01.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.hS2TXu9aRCc734oKKBOo-IN6neMgqAk_0 2024-09-12T19:23:01.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7625720971318880127', time=2024-09-12T20:38:41.617553+0000, chain.objs.size()=1 2024-09-12T19:23:01.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Wy85k7s-jBxjzhnuZdk-ay59r6skCRj_0 2024-09-12T19:23:01.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17101650234906908862', time=2024-09-12T20:38:43.683740+0000, chain.objs.size()=1 2024-09-12T19:23:01.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.eeo4yIXP2wiVk9akdfAjfW4-7Wuaobk_0 2024-09-12T19:23:01.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15798845917779777010', time=2024-09-12T20:38:44.153697+0000, chain.objs.size()=1 2024-09-12T19:23:01.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.KkD1dwBNQwzHWvs2-7yNbmQv79K6hgK_0 2024-09-12T19:23:01.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11945824394781188685', time=2024-09-12T20:38:45.334741+0000, chain.objs.size()=1 2024-09-12T19:23:01.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.przF1kXEXoxBmL4J45xxeHeBXiDl3Gn_0 2024-09-12T19:23:01.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.739868959425438890', time=2024-09-12T20:38:45.584066+0000, chain.objs.size()=1 2024-09-12T19:23:01.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.yibWPkCX9R2-7ydH7duCDnKSqJ_YYDV_0 2024-09-12T19:23:01.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5529652947879805605', time=2024-09-12T20:38:45.760128+0000, chain.objs.size()=1 2024-09-12T19:23:01.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.730+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.SD26a_H_7YlxhuQfRwJXS3c-Sbjyly9_0 2024-09-12T19:23:01.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4989123944180935499', time=2024-09-12T20:38:45.932217+0000, chain.objs.size()=1 2024-09-12T19:23:01.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.gLfw866dfG_YmgqQyFjo5bDKkA-HBGj_0 2024-09-12T19:23:01.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17766145854058254186', time=2024-09-12T20:38:47.516096+0000, chain.objs.size()=1 2024-09-12T19:23:01.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.h0HrylPfS8An7hW2KGxMIAEaVSPbIkc_0 2024-09-12T19:23:01.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4234658608860587042', time=2024-09-12T20:38:47.880498+0000, chain.objs.size()=1 2024-09-12T19:23:01.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.uGnKqrWkOaB2NgZgsEoix-An5Z2SueH_0 2024-09-12T19:23:01.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3364220917504616718', time=2024-09-12T20:38:48.531772+0000, chain.objs.size()=1 2024-09-12T19:23:01.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-T29YbiozPk8KEpCblx3jbRcDFBlmPE_0 2024-09-12T19:23:01.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7750529933086592748', time=2024-09-12T20:38:49.949845+0000, chain.objs.size()=1 2024-09-12T19:23:01.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.t2YvNKTyPjk2dwn920A5aOYXpQzYe7f_0 2024-09-12T19:23:01.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1177329638808957431', time=2024-09-12T20:38:50.237584+0000, chain.objs.size()=1 2024-09-12T19:23:01.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.EF4YXkaMqcrQsUM9OnIEmj6gDEfGfjj_0 2024-09-12T19:23:01.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15687816832907188860', time=2024-09-12T20:38:52.065934+0000, chain.objs.size()=1 2024-09-12T19:23:01.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.RxBrFgeaJLfBcss2psPLcfyt2ZTpzyj_0 2024-09-12T19:23:01.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11158638009524083550', time=2024-09-12T20:38:52.179210+0000, chain.objs.size()=1 2024-09-12T19:23:01.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.W6KRyC584wJnhyDjdz0yihdUSBp2XLG_0 2024-09-12T19:23:01.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11490195885186685931', time=2024-09-12T20:38:53.455446+0000, chain.objs.size()=1 2024-09-12T19:23:01.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.VvL55HjNfTCFP7EeBDXgzCfD8sDyWsN_0 2024-09-12T19:23:01.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10210769391137368675', time=2024-09-12T20:38:55.822276+0000, chain.objs.size()=1 2024-09-12T19:23:01.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.K9e_LdfXxCwNZq-eobGkAvPkEtfq_et_0 2024-09-12T19:23:01.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6082910807392010704', time=2024-09-12T20:38:56.125705+0000, chain.objs.size()=1 2024-09-12T19:23:01.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.734+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.wY-QgjjT2Z-rp4wPON5hMWVeGSmTce8_0 2024-09-12T19:23:01.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.738+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16676418322906218398', time=2024-09-12T20:38:56.349984+0000, chain.objs.size()=1 2024-09-12T19:23:01.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.738+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.lbXoVAGpuGr3RoW6uXDsUJzDg6Dx2rM_0 2024-09-12T19:23:01.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.742+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17207354139283385421', time=2024-09-12T20:38:57.340635+0000, chain.objs.size()=1 2024-09-12T19:23:01.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.742+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.WlsiusdNSTdCpVbMkZENujZwd9wCPz0_0 2024-09-12T19:23:01.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.742+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13736253255959126287', time=2024-09-12T20:38:58.947876+0000, chain.objs.size()=1 2024-09-12T19:23:01.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.742+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Bmkf80yGetgiVXC3w-hyV8OZE_zUbJm_0 2024-09-12T19:23:01.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.742+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11998167414058287562', time=2024-09-12T20:38:59.135044+0000, chain.objs.size()=1 2024-09-12T19:23:01.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.742+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-hlJGseXZ2koT6YAsR11lAWJzK3-6sd_0 2024-09-12T19:23:01.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.742+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18298218299475252273', time=2024-09-12T20:38:59.462705+0000, chain.objs.size()=1 2024-09-12T19:23:01.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.742+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.U29TqdtZuL60PkuvjGPEr3D30h8saun_0 2024-09-12T19:23:01.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.746+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49822 2024-09-12T19:23:01.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-12T19:23:01.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5257089336340255210', time=2024-09-12T20:39:00.749482+0000, chain.objs.size()=1 2024-09-12T19:23:01.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.33ZCpL_hcbrRA9APcO_EJSeC13uHPIb_0 2024-09-12T19:23:01.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15182712341695536563', time=2024-09-12T20:39:00.770090+0000, chain.objs.size()=1 2024-09-12T19:23:01.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.JCVftLBAaQcYvNQhT9sicZkVuqEY6P6_0 2024-09-12T19:23:01.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8919808775234287504', time=2024-09-12T20:39:01.272877+0000, chain.objs.size()=1 2024-09-12T19:23:01.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.4wtIWIAZ8tL3wqhT9Yi8mh0dwcAi319_0 2024-09-12T19:23:01.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6292731396412533427', time=2024-09-12T20:39:02.840659+0000, chain.objs.size()=1 2024-09-12T19:23:01.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.CxpSX_yIzgQliB3j02Op6-QaMr8gA4M_0 2024-09-12T19:23:01.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4067819756074395483', time=2024-09-12T20:39:02.962288+0000, chain.objs.size()=1 2024-09-12T19:23:01.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.92itm-RfZPIqco0cYGIGTiwx6UoF4V2_0 2024-09-12T19:23:01.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6497463700006899089', time=2024-09-12T20:39:02.964196+0000, chain.objs.size()=1 2024-09-12T19:23:01.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.cFhQKkJXIj623lmBN1kNDDHcoSXzYaE_0 2024-09-12T19:23:01.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3232567118020113944', time=2024-09-12T20:39:03.402801+0000, chain.objs.size()=1 2024-09-12T19:23:01.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.l8BhClgYEnoCU27R6-bNCXXsrLGgtK6_0 2024-09-12T19:23:01.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15175649732400292233', time=2024-09-12T20:39:05.733982+0000, chain.objs.size()=1 2024-09-12T19:23:01.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.kuPwUOe52kJG3Wst55u_ztgEcFJWeFz_0 2024-09-12T19:23:01.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16536279676116376236', time=2024-09-12T20:39:05.735669+0000, chain.objs.size()=1 2024-09-12T19:23:01.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.whHqw3GRo2QTENJb8V4WtUcLLx0UhHC_0 2024-09-12T19:23:01.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8214868708814002200', time=2024-09-12T20:39:07.290080+0000, chain.objs.size()=1 2024-09-12T19:23:01.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.iwXYPLcClRn4hVtaZ55UY5WRcOCdbrl_0 2024-09-12T19:23:01.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1471394065687780107', time=2024-09-12T20:41:52.847804+0000, chain.objs.size()=1 2024-09-12T19:23:01.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.407__shadow_.QougIkE7x9sTG7XUoXB6QY0DpJoQmw3_0 2024-09-12T19:23:01.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15797660173257085383', time=2024-09-12T20:43:37.678945+0000, chain.objs.size()=1 2024-09-12T19:23:01.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.456__shadow_.m3p_bx0wrPgx35IRRfaaTpQd6_TOQDM_0 2024-09-12T19:23:01.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18146182699892609582', time=2024-09-12T20:43:58.559422+0000, chain.objs.size()=1 2024-09-12T19:23:01.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.750+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.463__shadow_.-Zpp8e1C1ixTaxKa-Z5oLtP4MJi5746_0 2024-09-12T19:23:01.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.754+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16294720080526302340', time=2024-09-12T20:44:07.399130+0000, chain.objs.size()=1 2024-09-12T19:23:01.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.466__shadow_.zKN1i67zfx5n6Gp7bYHbjf-2HymghOV_0 2024-09-12T19:23:01.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.754+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2415695741656855282', time=2024-09-12T20:44:36.439953+0000, chain.objs.size()=1 2024-09-12T19:23:01.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.484__shadow_.8p34Og4ezJ_bbXZS3SuelndAc-jmOpp_0 2024-09-12T19:23:01.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.754+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.863338218067966602', time=2024-09-12T20:45:03.744946+0000, chain.objs.size()=1 2024-09-12T19:23:01.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.495__shadow_.KuCJ4cD3X7UtYhC3jmmsV56NSrIS0w9_0 2024-09-12T19:23:01.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.754+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4578725668220169334', time=2024-09-12T20:52:36.470485+0000, chain.objs.size()=3 2024-09-12T19:23:01.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.525__multipart_mymultipart.2~9n9zN-bQNKbIYCA7fDVZpjpcVTdgsGt.1 2024-09-12T19:23:01.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.525__multipart_mymultipart.2~9n9zN-bQNKbIYCA7fDVZpjpcVTdgsGt.2 2024-09-12T19:23:01.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.525__multipart_mymultipart.2~9n9zN-bQNKbIYCA7fDVZpjpcVTdgsGt.3 2024-09-12T19:23:01.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.754+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15778770920333871744', time=2024-09-12T20:54:07.679775+0000, chain.objs.size()=1 2024-09-12T19:23:01.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.536__multipart_mymultipart.2~dqb-pwjFCKyxM89z7V4UwfB7oF4GYk-.1 2024-09-12T19:23:01.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.754+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3437535968789394362', time=2024-09-12T20:55:16.894651+0000, chain.objs.size()=1 2024-09-12T19:23:01.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.553__shadow_.BaVPhOWCnk4o95gaaSsszkECOBOXovm_0 2024-09-12T19:23:01.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.754+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16529034930865211617', time=2024-09-12T20:55:27.418277+0000, chain.objs.size()=1 2024-09-12T19:23:01.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.554__shadow_.3gupr6psC6ZHiD7XsTyBvyMqkHRjJ5i_0 2024-09-12T19:23:01.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.754+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10431970718939266628', time=2024-09-12T20:56:57.916845+0000, chain.objs.size()=1 2024-09-12T19:23:01.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:k14vG2sLni8B9MZGLIFD-dAoMJhgarY_.vHjQWkEAVGcVAU5lBtNqH101GxhdWtO_0 2024-09-12T19:23:01.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.754+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1550058542748817324', time=2024-09-12T20:57:32.096623+0000, chain.objs.size()=1 2024-09-12T19:23:01.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.754+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.575__shadow_.Asepz5M8vYJmI0Bt584FKYiFjVOzEnG_0 2024-09-12T19:23:01.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.758+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9154038928155330461', time=2024-09-12T20:57:53.482172+0000, chain.objs.size()=1 2024-09-12T19:23:01.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.758+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:wTGK.n8N5udGf.hFZG4BcxQTpUsiBv0_.bOqHG6Ej5jnOfdpu8IJNfg88rrUpP5g_0 2024-09-12T19:23:01.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.758+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3539626989271023386', time=2024-09-12T20:58:05.540153+0000, chain.objs.size()=1 2024-09-12T19:23:01.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.758+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:WQ-n.UPWA7z3I8Wntk7EW3ohaVREn9s_.MO0iLJQtho_kfRYJ0yh27SQuuHdazbO_0 2024-09-12T19:23:01.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.758+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3248476568034574413', time=2024-09-12T21:07:07.142784+0000, chain.objs.size()=1 2024-09-12T19:23:01.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.758+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.630__shadow_.8aa40iFKSWIxTU5olvOVhb9oVbffwIY_0 2024-09-12T19:23:01.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.758+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11644363836754267608', time=2024-09-12T21:09:36.197333+0000, chain.objs.size()=1 2024-09-12T19:23:01.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.758+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.663__shadow_.j9qZwUeRerfpnNOHZMk3c1kwFOqKMPD_0 2024-09-12T19:23:01.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.758+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5062246579425124343', time=2024-09-12T21:09:46.268815+0000, chain.objs.size()=1 2024-09-12T19:23:01.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.758+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.666__shadow_.Le_n_A56niyPfbzsXQh-5xdjzIs2BlB_0 2024-09-12T19:23:01.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.762+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.439758895713462241', time=2024-09-12T21:11:10.215522+0000, chain.objs.size()=1 2024-09-12T19:23:01.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.762+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.710__shadow:FzhXdUCa92zIZUvxUSVJW4uxe-Zg70Y_.AZQ1dwFP3Mluq2GVN915YdL9c5GwkCp_0 2024-09-12T19:23:01.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.762+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15376955228719095516', time=2024-09-12T21:12:16.019839+0000, chain.objs.size()=1 2024-09-12T19:23:01.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.762+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.734__shadow_.8HbN5iAidxYNe0SglUkv16ajoSQ8i4e_0 2024-09-12T19:23:01.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.762+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3103428389461315616', time=2024-09-12T21:13:18.419448+0000, chain.objs.size()=1 2024-09-12T19:23:01.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.762+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.744__shadow_.jLaJftgKcfnXsYJ0JcolaeDke0R_zWF_0 2024-09-12T19:23:01.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.766+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:01.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.766+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T19:23:01.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:01.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:01.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48554' 2024-09-12T19:23:01.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6042708099954080834', time=2024-09-12T20:25:26.016960+0000, chain.objs.size()=1 2024-09-12T19:23:01.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.204__shadow_.K1-n3KkaqXW4-K64ZcfszpNRfcW2b_n_0 2024-09-12T19:23:01.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9513723587922809617', time=2024-09-12T20:28:54.856191+0000, chain.objs.size()=1 2024-09-12T19:23:01.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.234__shadow_.JrcdmeqaAQR4Q-TBkrDSmzR_JvIEjce_0 2024-09-12T19:23:01.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17812840526233521349', time=2024-09-12T20:29:13.202836+0000, chain.objs.size()=1 2024-09-12T19:23:01.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.241__shadow_.h9ITKFgnACI-ZD0b_y6FgX2CHXY2Sai_0 2024-09-12T19:23:01.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13982150952789594402', time=2024-09-12T20:29:37.082693+0000, chain.objs.size()=1 2024-09-12T19:23:01.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.250__shadow_.fn83FE96Wd2eK-zInlyhtQlkvezS9QK_0 2024-09-12T19:23:01.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14094723603005387557', time=2024-09-12T20:29:57.530297+0000, chain.objs.size()=1 2024-09-12T19:23:01.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.259__shadow_.o2fhQZSIjwqgfNiDPL190wrOllZ50kz_0 2024-09-12T19:23:01.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.675428576170747359', time=2024-09-12T20:31:45.229298+0000, chain.objs.size()=1 2024-09-12T19:23:01.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.IBZxYnW5LFy32RxDm21mH9gNyNz_pxd_0 2024-09-12T19:23:01.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5632865979365682122', time=2024-09-12T20:31:45.316169+0000, chain.objs.size()=1 2024-09-12T19:23:01.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.-MhiDU6cm2jA2SVb2jNAACBm3Zucyig_0 2024-09-12T19:23:01.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2883224667962406060', time=2024-09-12T20:31:49.302979+0000, chain.objs.size()=1 2024-09-12T19:23:01.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.EF-9t0TZjGSIKQIwXfyR7m9mUKIOMJE_0 2024-09-12T19:23:01.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14671806603497299405', time=2024-09-12T20:31:51.078612+0000, chain.objs.size()=1 2024-09-12T19:23:01.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.jv0ADeFFml4AA0nFr-_N7fAeqaerMOc_0 2024-09-12T19:23:01.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7940377052040126686', time=2024-09-12T20:31:51.607504+0000, chain.objs.size()=1 2024-09-12T19:23:01.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_._BIjemtmYPPtHHjYyDssOjj43o5zAwo_0 2024-09-12T19:23:01.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1729646399197593922', time=2024-09-12T20:31:51.667953+0000, chain.objs.size()=1 2024-09-12T19:23:01.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.BF0oCYktHFflDnMtxDXqnUUMRs5LQlV_0 2024-09-12T19:23:01.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6457312270584785953', time=2024-09-12T20:31:54.650094+0000, chain.objs.size()=1 2024-09-12T19:23:01.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.770+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.DTvBOGL29-adcBgcc6wONajsqiSfN4V_0 2024-09-12T19:23:01.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6402300612624588600', time=2024-09-12T20:31:55.355058+0000, chain.objs.size()=1 2024-09-12T19:23:01.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.9lLBQUiku82P66LKhl4zY0K8DC1QhgA_0 2024-09-12T19:23:01.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14346632263126661894', time=2024-09-12T20:31:55.897844+0000, chain.objs.size()=1 2024-09-12T19:23:01.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.k2LAEj2n2FNfIc0G4WKl-orF7tx7ts3_0 2024-09-12T19:23:01.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16272527654076105985', time=2024-09-12T20:31:57.069239+0000, chain.objs.size()=1 2024-09-12T19:23:01.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.MSakAbPQiPSWvBIYff7OZZ32lgHEnzF_0 2024-09-12T19:23:01.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12930570541641725629', time=2024-09-12T20:31:58.092551+0000, chain.objs.size()=1 2024-09-12T19:23:01.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.UVX4FPScGOXysLItQK6Eor8rxaH7Ukl_0 2024-09-12T19:23:01.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5444320024494203555', time=2024-09-12T20:31:58.464401+0000, chain.objs.size()=1 2024-09-12T19:23:01.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.RUpgKorxg1SfWJK39asnqYWNvsodPO6_0 2024-09-12T19:23:01.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16240658796744146908', time=2024-09-12T20:31:59.662205+0000, chain.objs.size()=1 2024-09-12T19:23:01.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.X3UzEY1QaKQXj7dna5PkS04uCCZ6IN7_0 2024-09-12T19:23:01.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5081671148376275910', time=2024-09-12T20:31:59.710306+0000, chain.objs.size()=1 2024-09-12T19:23:01.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.KiwKlXK0MT50bIw83yDbzAsEUZoIvw5_0 2024-09-12T19:23:01.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17624314762161301888', time=2024-09-12T20:32:01.110966+0000, chain.objs.size()=1 2024-09-12T19:23:01.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.zl0jATW33jGTzSm0cKC6h8bS7hcbKxQ_0 2024-09-12T19:23:01.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4266783418181570989', time=2024-09-12T20:32:01.119660+0000, chain.objs.size()=1 2024-09-12T19:23:01.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.5q1IwiFMIE9KQv0OJsh26JfikmLwabu_0 2024-09-12T19:23:01.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.549212501238630159', time=2024-09-12T20:32:02.818688+0000, chain.objs.size()=1 2024-09-12T19:23:01.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.D15gqzsX862is6bvelMLW0yLr7tirQe_0 2024-09-12T19:23:01.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11264529442230117881', time=2024-09-12T20:32:03.272759+0000, chain.objs.size()=1 2024-09-12T19:23:01.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.774+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.BJWqPq9zjKPbiKXn-Q5VoLonUDK59a5_0 2024-09-12T19:23:01.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8036115317353800495', time=2024-09-12T20:32:03.586204+0000, chain.objs.size()=1 2024-09-12T19:23:01.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.9jZaTuVKzOc2290VcJ1JadcaxasxGJt_0 2024-09-12T19:23:01.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4458531523863705440', time=2024-09-12T20:32:04.417099+0000, chain.objs.size()=1 2024-09-12T19:23:01.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.UmuP2hls_qIbQ-Kkd8L1YW0Lb4ffv0m_0 2024-09-12T19:23:01.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1530317649128405698', time=2024-09-12T20:32:05.295519+0000, chain.objs.size()=1 2024-09-12T19:23:01.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.C10TFh8jrNvUtf66QxykY2j9hIXAyAD_0 2024-09-12T19:23:01.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10130187660031782664', time=2024-09-12T20:32:05.708458+0000, chain.objs.size()=1 2024-09-12T19:23:01.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.NrIhTGmE5cCGiTg1apqTNbom9miDFEI_0 2024-09-12T19:23:01.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.181061954447327959', time=2024-09-12T20:32:06.872569+0000, chain.objs.size()=1 2024-09-12T19:23:01.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.MPjbF6-60kbHiVA_4fiED0Q63xgOzMb_0 2024-09-12T19:23:01.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17980456701168733924', time=2024-09-12T20:32:06.991620+0000, chain.objs.size()=1 2024-09-12T19:23:01.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.b-yLb8G4P_GGHE0WvqL69WIIoMdC7uv_0 2024-09-12T19:23:01.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15103970062840587609', time=2024-09-12T20:32:08.454553+0000, chain.objs.size()=1 2024-09-12T19:23:01.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.JxgkHJabLIwPliHd6Npxrt7KSnPbKUp_0 2024-09-12T19:23:01.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8730101407020249800', time=2024-09-12T20:32:09.365167+0000, chain.objs.size()=1 2024-09-12T19:23:01.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.FZI6grx8Kpww08x0E1MpDR6fQ1MJI7F_0 2024-09-12T19:23:01.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16618848062038650642', time=2024-09-12T20:32:09.748114+0000, chain.objs.size()=1 2024-09-12T19:23:01.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.iu8UmVo1-QOVyrqAcblLNopvdVW7Twk_0 2024-09-12T19:23:01.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6624687322021618429', time=2024-09-12T20:32:10.834152+0000, chain.objs.size()=1 2024-09-12T19:23:01.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.VwHJlswu3tZeKlo6KBHFPoc7xwg9G6t_0 2024-09-12T19:23:01.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17882210593415897273', time=2024-09-12T20:32:13.082229+0000, chain.objs.size()=1 2024-09-12T19:23:01.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.782+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Hpg57qEBfHo5Yo6VrGsTPMW7zeIr5tk_0 2024-09-12T19:23:01.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.786+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18343848401988405593', time=2024-09-12T20:32:22.799425+0000, chain.objs.size()=1 2024-09-12T19:23:01.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.786+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.266__shadow_.Jf1jdK4qfK5y6k8zsk322x8NWZeXGm1_0 2024-09-12T19:23:01.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6104226802399779640', time=2024-09-12T20:32:54.189310+0000, chain.objs.size()=1 2024-09-12T19:23:01.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.280__shadow_.wxbthTj4WMmj6IT7-RcP4cY1ozrO-h3_0 2024-09-12T19:23:01.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16285141337292646135', time=2024-09-12T20:33:05.694915+0000, chain.objs.size()=1 2024-09-12T19:23:01.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.285__shadow_.yyIRSZz3rTlXLsQtlJM_KgRN_WO0bQM_0 2024-09-12T19:23:01.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14638274474851884197', time=2024-09-12T20:33:14.959719+0000, chain.objs.size()=1 2024-09-12T19:23:01.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.289__shadow_.bn-ZH0GUQzRXx4tHgOiVflGxiVXjhaC_0 2024-09-12T19:23:01.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10402676628750587685', time=2024-09-12T20:33:25.411831+0000, chain.objs.size()=1 2024-09-12T19:23:01.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.C9BWYLaNchDbdE5CWwLWDQtodtUEkfK_0 2024-09-12T19:23:01.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17236589647807190171', time=2024-09-12T20:33:25.517665+0000, chain.objs.size()=1 2024-09-12T19:23:01.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.x013qDkA_Ta0p30dEvmU4M4QyrIkw1H_0 2024-09-12T19:23:01.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3697008703184227124', time=2024-09-12T20:33:31.587850+0000, chain.objs.size()=1 2024-09-12T19:23:01.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.2TQN6x-AvxS0RephtJrp5dqqiN_oPLv_0 2024-09-12T19:23:01.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13044640966048564470', time=2024-09-12T20:33:33.878489+0000, chain.objs.size()=1 2024-09-12T19:23:01.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.294__shadow_.Z-Q0ZQECJDvvQ-hi-bEOysi8zIhl1A9_0 2024-09-12T19:23:01.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3934204672343556056', time=2024-09-12T20:33:54.881635+0000, chain.objs.size()=1 2024-09-12T19:23:01.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.303__shadow_.rFtrpLCLKrrpr-6_mBBGlc0Oyu8i7nJ_0 2024-09-12T19:23:01.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16698001443347835551', time=2024-09-12T20:34:05.553444+0000, chain.objs.size()=1 2024-09-12T19:23:01.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.307__shadow:1fm3XDQyErM39i-RbualMaYp5.gxtne_.RI8dGnZc1aWbObaR-XdKegyjRRByYrA_0 2024-09-12T19:23:01.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2401747292418688476', time=2024-09-12T20:36:28.915095+0000, chain.objs.size()=1 2024-09-12T19:23:01.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.-JvBykx_GNaW73HZYxo7P2oajQ3V9rP_0 2024-09-12T19:23:01.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13280012783898000776', time=2024-09-12T20:36:32.719361+0000, chain.objs.size()=1 2024-09-12T19:23:01.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.790+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.m1S5oEm6QKwhGTf3xkk8plXrpnuJ6Ww_0 2024-09-12T19:23:01.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13412193764678725514', time=2024-09-12T20:36:32.765714+0000, chain.objs.size()=1 2024-09-12T19:23:01.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.uRKXtMzXDAa__6MXrCu1A0UcK-7p6jH_0 2024-09-12T19:23:01.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2159023721517998208', time=2024-09-12T20:36:33.166736+0000, chain.objs.size()=1 2024-09-12T19:23:01.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Pc8tPQbLBHuUjnkL0dAbY1c_RYs2HnR_0 2024-09-12T19:23:01.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6470178396774593965', time=2024-09-12T20:36:33.652114+0000, chain.objs.size()=1 2024-09-12T19:23:01.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.novThLExri7T59pmfiZj8viHIAsWOgK_0 2024-09-12T19:23:01.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10760862127041728516', time=2024-09-12T20:36:33.868959+0000, chain.objs.size()=1 2024-09-12T19:23:01.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.YdXW0I8hK-IfBLj4C4v-9tGeToXM0ma_0 2024-09-12T19:23:01.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18076753007360156113', time=2024-09-12T20:36:34.009714+0000, chain.objs.size()=1 2024-09-12T19:23:01.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.s_1ITYXaE-eY_18IPSzw-t3vAo9acTf_0 2024-09-12T19:23:01.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8695235983391001435', time=2024-09-12T20:36:34.740771+0000, chain.objs.size()=1 2024-09-12T19:23:01.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.A_MmuP_1ycIm1Wh_OZfPPNZVAxmy1dZ_0 2024-09-12T19:23:01.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1170162757629217686', time=2024-09-12T20:36:35.952371+0000, chain.objs.size()=1 2024-09-12T19:23:01.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.XhY-ya1Xcve-259X2-twugj1jWrs5_5_0 2024-09-12T19:23:01.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5232024625886486036', time=2024-09-12T20:36:37.346314+0000, chain.objs.size()=1 2024-09-12T19:23:01.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.n-ba2PwFncGUDOqi18sMENkkOinywVm_0 2024-09-12T19:23:01.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.794+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.475522689649782679', time=2024-09-12T20:36:37.738261+0000, chain.objs.size()=1 2024-09-12T19:23:01.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.794+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.y1yGBvzRPJ13ewwUfhRHr50xm_sAeHp_0 2024-09-12T19:23:01.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11544910855221765457', time=2024-09-12T20:36:38.534307+0000, chain.objs.size()=1 2024-09-12T19:23:01.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.182x8QVAAvXcQEf09doRc8FVTYpnVxI_0 2024-09-12T19:23:01.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2500289166818931811', time=2024-09-12T20:36:38.537169+0000, chain.objs.size()=1 2024-09-12T19:23:01.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.TpQ1mfv87aF9wc2gSfSMgkDwnDKubQL_0 2024-09-12T19:23:01.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6409348249546674614', time=2024-09-12T20:36:41.338101+0000, chain.objs.size()=1 2024-09-12T19:23:01.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.et4VNVXvgcSvwpZiFjdlHh7sjR_wsD4_0 2024-09-12T19:23:01.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8210376288191089014', time=2024-09-12T20:36:41.458485+0000, chain.objs.size()=1 2024-09-12T19:23:01.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.gU835I10_-RMSgtxXU7qkjBJa_gER3B_0 2024-09-12T19:23:01.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1807472726159278898', time=2024-09-12T20:36:41.542577+0000, chain.objs.size()=1 2024-09-12T19:23:01.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.yGizrpTq4z05DZQFc-D2AFs2ENirU0m_0 2024-09-12T19:23:01.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5681119378237352470', time=2024-09-12T20:36:42.011059+0000, chain.objs.size()=1 2024-09-12T19:23:01.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.3GE6EZhHnqnZ-u9WIr1pwO-ACwNvgVy_0 2024-09-12T19:23:01.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.968058580121904655', time=2024-09-12T20:36:43.311547+0000, chain.objs.size()=1 2024-09-12T19:23:01.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.LrhBzjPiwELiB28I2lLIsffu_fFx2Xa_0 2024-09-12T19:23:01.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16411750001077593977', time=2024-09-12T20:36:44.679597+0000, chain.objs.size()=1 2024-09-12T19:23:01.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.TseOd2By4XfN4hWMHvl1mE6ZqzlN2E6_0 2024-09-12T19:23:01.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15202385157404087636', time=2024-09-12T20:36:46.978308+0000, chain.objs.size()=1 2024-09-12T19:23:01.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.i6mLxyiS4OmtxlrUs4B8uehlj6-MJQc_0 2024-09-12T19:23:01.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.798+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4932564941276752667', time=2024-09-12T20:36:47.666283+0000, chain.objs.size()=1 2024-09-12T19:23:01.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.798+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Ezqmqn9w1WYnJq2tj06eOaLeGd4QD3v_0 2024-09-12T19:23:01.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.802+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4323175946850620455', time=2024-09-12T20:36:48.948980+0000, chain.objs.size()=1 2024-09-12T19:23:01.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.802+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.AbhjTUSna_kkaK9nTegRvdfT7wPPvgN_0 2024-09-12T19:23:01.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.802+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1570798271042476463', time=2024-09-12T20:36:49.350735+0000, chain.objs.size()=1 2024-09-12T19:23:01.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.802+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.eQvjin1Z1qkS44YrCvWsUuPADESYyC0_0 2024-09-12T19:23:01.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.802+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.929903082718420068', time=2024-09-12T20:36:50.513115+0000, chain.objs.size()=1 2024-09-12T19:23:01.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.802+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.8u-V0PWhaynMyIHab1k0Ts8UJO3qHnC_0 2024-09-12T19:23:01.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.802+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18357634289737281205', time=2024-09-12T20:36:51.290805+0000, chain.objs.size()=1 2024-09-12T19:23:01.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.802+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.f-yI7_be9Om_4MzPrK_VNnADM1aJViY_0 2024-09-12T19:23:01.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.802+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11401629483253802827', time=2024-09-12T20:36:52.720479+0000, chain.objs.size()=1 2024-09-12T19:23:01.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.802+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.pTyt5MhoHQAIOKoZH2Oe8sGGZJbqfNr_0 2024-09-12T19:23:01.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.802+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14632091642804773060', time=2024-09-12T20:36:53.392521+0000, chain.objs.size()=1 2024-09-12T19:23:01.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.802+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.-bnx0h4rLw7mN0UoaeysnGcVwxMQykB_0 2024-09-12T19:23:01.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.802+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10726972100265783622', time=2024-09-12T20:36:54.010346+0000, chain.objs.size()=1 2024-09-12T19:23:01.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.802+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.lv2nWZlQYaJ6PmfFIQqte8gRBOaE7_Y_0 2024-09-12T19:23:01.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.518114594421848047', time=2024-09-12T20:36:55.560915+0000, chain.objs.size()=1 2024-09-12T19:23:01.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.mKF3fyrssP4faD8d1P0ZHgdGFAbCeN4_0 2024-09-12T19:23:01.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6485392885577406874', time=2024-09-12T20:36:55.764307+0000, chain.objs.size()=1 2024-09-12T19:23:01.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.xDuCyhDdUNFAfz0rxfTIfrm5oPfCrUH_0 2024-09-12T19:23:01.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15014222080388391245', time=2024-09-12T20:36:55.995299+0000, chain.objs.size()=1 2024-09-12T19:23:01.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.qE2VzmtVubdF_qy03TseHuVws0brwrR_0 2024-09-12T19:23:01.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16830116843759743381', time=2024-09-12T20:36:56.198462+0000, chain.objs.size()=1 2024-09-12T19:23:01.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.euryLmlVoFLTiXbPyr0Ryi4NqMplE4v_0 2024-09-12T19:23:01.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10001743478217027661', time=2024-09-12T20:38:40.503094+0000, chain.objs.size()=1 2024-09-12T19:23:01.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.YP80BW8ZjeRslA2oTCT4vSt5_B6o1KD_0 2024-09-12T19:23:01.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10141041236844440007', time=2024-09-12T20:38:40.579897+0000, chain.objs.size()=1 2024-09-12T19:23:01.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.EaXwhDnmBXROHc371LJYtUqIWhDYMNo_0 2024-09-12T19:23:01.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.806+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8296769582875436098', time=2024-09-12T20:38:40.702360+0000, chain.objs.size()=1 2024-09-12T19:23:01.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.806+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.bs1G08VybWik57wgHEpQEZVP3ly-CgZ_0 2024-09-12T19:23:01.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.810+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.302620959896783657', time=2024-09-12T20:38:41.033573+0000, chain.objs.size()=1 2024-09-12T19:23:01.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.810+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.pm3I-zX6pYe5swLB-JcWHsnOJdd9azz_0 2024-09-12T19:23:01.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.810+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11128609220775391541', time=2024-09-12T20:38:42.639879+0000, chain.objs.size()=1 2024-09-12T19:23:01.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.810+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.BJGvT2Xz6FgjZUILvBIV-AWch9Tqcgy_0 2024-09-12T19:23:01.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.810+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1538452995029986630', time=2024-09-12T20:38:43.673757+0000, chain.objs.size()=1 2024-09-12T19:23:01.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.810+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.uh2uKNzeAfubMIVvhvYfe27g1kWA4Ui_0 2024-09-12T19:23:01.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.810+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.820379178765923195', time=2024-09-12T20:38:46.514644+0000, chain.objs.size()=1 2024-09-12T19:23:01.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.810+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.vV0UWTy1bs9NDj4DxaWoTas7xy6RjIe_0 2024-09-12T19:23:01.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.810+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9717727098583391157', time=2024-09-12T20:38:47.614998+0000, chain.objs.size()=1 2024-09-12T19:23:01.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.810+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.sXSPKHkxO_Ct_h_2eixejHBNL_m11Gs_0 2024-09-12T19:23:01.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.810+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10522848780554912406', time=2024-09-12T20:38:48.611583+0000, chain.objs.size()=1 2024-09-12T19:23:01.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.810+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.2Smks9n8gNECvaudl-v1R6-bp53IuGz_0 2024-09-12T19:23:01.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.810+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7829609433937693098', time=2024-09-12T20:38:48.883289+0000, chain.objs.size()=1 2024-09-12T19:23:01.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.810+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.yhtarCzczVN_ti9gsXc-aH2sBjnh_-6_0 2024-09-12T19:23:01.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.810+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1713777262061637169', time=2024-09-12T20:38:49.198418+0000, chain.objs.size()=1 2024-09-12T19:23:01.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.810+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.eK-on7X66oopyr9Wyrtq2BT6rOQm9Gs_0 2024-09-12T19:23:01.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.810+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12960506111690753814', time=2024-09-12T20:38:49.267787+0000, chain.objs.size()=1 2024-09-12T19:23:01.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.810+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.BI-IkvW1lCAFVL6uPyDJTpvND9eizr4_0 2024-09-12T19:23:01.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17260874804858967662', time=2024-09-12T20:38:49.439679+0000, chain.objs.size()=1 2024-09-12T19:23:01.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.F95SiofU1HufoXJqPq5RYJrrLKXO8cE_0 2024-09-12T19:23:01.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14150026367536991778', time=2024-09-12T20:38:50.054970+0000, chain.objs.size()=1 2024-09-12T19:23:01.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.5WASEZBP5kVr8ocGcP2FEZ4S6fxtlfF_0 2024-09-12T19:23:01.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7505210276805625415', time=2024-09-12T20:38:51.730034+0000, chain.objs.size()=1 2024-09-12T19:23:01.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Z7V2a6SgCZjahxUy2SBCBwrRWEqwH-n_0 2024-09-12T19:23:01.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3614822179350020625', time=2024-09-12T20:38:52.899626+0000, chain.objs.size()=1 2024-09-12T19:23:01.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.2UPZOKPa-hE0eFw_6VvEgQF9EGZ6ytR_0 2024-09-12T19:23:01.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17113371017500047536', time=2024-09-12T20:38:53.227638+0000, chain.objs.size()=1 2024-09-12T19:23:01.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.zs5bQA2JAxvQ9imy1EtWou-yUbcpzde_0 2024-09-12T19:23:01.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11427076197530669806', time=2024-09-12T20:38:53.912982+0000, chain.objs.size()=1 2024-09-12T19:23:01.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.rF-2EjzzoxkAi-ojR0SbtfuhgAaycbl_0 2024-09-12T19:23:01.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11908982285032354751', time=2024-09-12T20:38:56.567651+0000, chain.objs.size()=1 2024-09-12T19:23:01.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.haIutddOp8zYlnrXONhy6R2mJ9bGNZz_0 2024-09-12T19:23:01.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11078392289224410249', time=2024-09-12T20:38:57.660988+0000, chain.objs.size()=1 2024-09-12T19:23:01.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.aL0gKrPvhTrznf2UuBJU6RfRnv0Til4_0 2024-09-12T19:23:01.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5177772465821566605', time=2024-09-12T20:38:57.662826+0000, chain.objs.size()=1 2024-09-12T19:23:01.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.s7W9N77_6CYTtKlZE3yG00-_zDaXrdd_0 2024-09-12T19:23:01.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6556351931295067394', time=2024-09-12T20:38:58.681948+0000, chain.objs.size()=1 2024-09-12T19:23:01.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.8MwhOoMcLToTqLfEk1ORp3AbHaN2U-8_0 2024-09-12T19:23:01.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16357535454483108841', time=2024-09-12T20:38:59.340910+0000, chain.objs.size()=1 2024-09-12T19:23:01.822 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.814+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.EH12p-0qtEhgWCzau8Mdpht8FpG2Yk1_0 2024-09-12T19:23:01.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.818+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9258599556978073922', time=2024-09-12T20:38:59.615612+0000, chain.objs.size()=1 2024-09-12T19:23:01.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.818+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.mb9hrHjIJae06v_Q72yY5iN1Fsv49f-_0 2024-09-12T19:23:01.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.822+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48554 2024-09-12T19:23:01.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T19:23:01.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15288909103868494787', time=2024-09-12T20:39:00.052940+0000, chain.objs.size()=1 2024-09-12T19:23:01.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.gBJriqEl2JxLTZc8tS8pAmFS3y5iO2g_0 2024-09-12T19:23:01.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18421879510298287743', time=2024-09-12T20:39:01.226688+0000, chain.objs.size()=1 2024-09-12T19:23:01.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.uIvAtZxKfaE_NBCwCyBAbdbk8s8QHAv_0 2024-09-12T19:23:01.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10337284063122489613', time=2024-09-12T20:39:02.991318+0000, chain.objs.size()=1 2024-09-12T19:23:01.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.514_shaCAhiAiLgp6SuJwD2k16gLJHA_0 2024-09-12T19:23:01.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9657863028056826063', time=2024-09-12T20:39:03.572550+0000, chain.objs.size()=1 2024-09-12T19:23:01.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.n5ban9CaaoZG7dxU74LGfv9_bMUcrqH_0 2024-09-12T19:23:01.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6348388590861435739', time=2024-09-12T20:39:03.813189+0000, chain.objs.size()=1 2024-09-12T19:23:01.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.v71AO7ZZiUvoFWUOFPwaEpx6zAb9j9L_0 2024-09-12T19:23:01.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11881732052629947570', time=2024-09-12T20:39:04.026168+0000, chain.objs.size()=1 2024-09-12T19:23:01.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Wle0MlWeR0j4cICEZE70hACGYvulhqp_0 2024-09-12T19:23:01.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9059288768602657783', time=2024-09-12T20:39:04.181103+0000, chain.objs.size()=1 2024-09-12T19:23:01.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.FfvrduwPBCvemdg7p15s4lKRLrbWOec_0 2024-09-12T19:23:01.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6165231081849430949', time=2024-09-12T20:39:05.761571+0000, chain.objs.size()=1 2024-09-12T19:23:01.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.HkBShVanU1bZopez-zYdvj23OKKWthq_0 2024-09-12T19:23:01.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17179706550577125132', time=2024-09-12T20:39:05.848519+0000, chain.objs.size()=1 2024-09-12T19:23:01.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.m_nYIvZg7tGIw1ULOK4301TwTVJYoDy_0 2024-09-12T19:23:01.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1348179088278908025', time=2024-09-12T20:39:06.203772+0000, chain.objs.size()=1 2024-09-12T19:23:01.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.O6ioPa4rEBJhvaMAB5XpuUZ8o5PFcfb_0 2024-09-12T19:23:01.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10504221831927046805', time=2024-09-12T20:39:06.463851+0000, chain.objs.size()=1 2024-09-12T19:23:01.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.LQ_0UH3eRBXcW4EkOCtNLyTxgEILYTK_0 2024-09-12T19:23:01.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8913991645334352255', time=2024-09-12T20:39:07.530018+0000, chain.objs.size()=1 2024-09-12T19:23:01.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.826+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.hrgyW0_7TF76gjWgNHv6j8Bmanb8L0R_0 2024-09-12T19:23:01.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5333308471815296891', time=2024-09-12T20:39:07.971698+0000, chain.objs.size()=1 2024-09-12T19:23:01.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.0tZCCTqKpo9pi8q_HBstX59IqQvbNVh_0 2024-09-12T19:23:01.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2273053564608776708', time=2024-09-12T20:42:51.205495+0000, chain.objs.size()=1 2024-09-12T19:23:01.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.436__shadow_.JTQt0fRORTbz0P0TFe7m4gd9-kP6ABx_0 2024-09-12T19:23:01.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11437612541281375471', time=2024-09-12T20:43:34.766547+0000, chain.objs.size()=1 2024-09-12T19:23:01.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.455__shadow_.RzqR58v9vTff1YYXbJ2lni2-mCDMcaB_0 2024-09-12T19:23:01.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16985689582748739038', time=2024-09-12T20:44:33.706886+0000, chain.objs.size()=1 2024-09-12T19:23:01.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.483__shadow_.4V8feek9IiOfulGcWt9AOSnOcpq3JZl_0 2024-09-12T19:23:01.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12729165704099467019', time=2024-09-12T20:45:09.717062+0000, chain.objs.size()=1 2024-09-12T19:23:01.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.497__shadow_.u6mxkZ7pujZUQoNVGiKyRuD-ynR8WuX_0 2024-09-12T19:23:01.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.830+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16372608279123521893', time=2024-09-12T20:51:37.794372+0000, chain.objs.size()=6 2024-09-12T19:23:01.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.xe_i4mEqFpyh4-TW42_B85FOh-pLVlyy.1 2024-09-12T19:23:01.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.iKQpeDNoacCiuXLeZA9mJt6Fsma10wVB.2 2024-09-12T19:23:01.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.GqL3ZmLrCFPFCaDKLeOKED4_3mdvZJb3.3 2024-09-12T19:23:01.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.voyCP2wKzbBTdtgYzXeWa_Si08ChPxrG.4 2024-09-12T19:23:01.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.Ql0tg50dmdKP-KH6uMdYtFaTNBo9GZ5r.5 2024-09-12T19:23:01.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.830+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.hwiauYJMT8MtMWnlq_PYaAf3rQ0Swash.6 2024-09-12T19:23:01.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.834+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17131044667054271036', time=2024-09-12T20:57:21.934703+0000, chain.objs.size()=1 2024-09-12T19:23:01.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.834+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.574__shadow_.8WA5KsgA4Im-ovO228zewZ-JP9yVZIw_0 2024-09-12T19:23:01.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.834+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17678419565040137365', time=2024-09-12T20:57:40.093521+0000, chain.objs.size()=1 2024-09-12T19:23:01.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.834+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.576__shadow:T-kIi5Z9MOAY6RkPVhGX4adfsNRsLig_._M7APasbtVjJ5TJJnTAi23H7TylMCkt_0 2024-09-12T19:23:01.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.834+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8668610899107998431', time=2024-09-12T20:59:18.963491+0000, chain.objs.size()=4 2024-09-12T19:23:01.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.834+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.578__multipart_testobj.2~S0XEMI1KudRl63iFACS4mKtLngzuXz_.1 2024-09-12T19:23:01.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.834+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.578__multipart_testobj.2~S0XEMI1KudRl63iFACS4mKtLngzuXz_.2 2024-09-12T19:23:01.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.834+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.578__multipart_testobj.2~S0XEMI1KudRl63iFACS4mKtLngzuXz_.3 2024-09-12T19:23:01.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.834+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.578__multipart_testobj.2~S0XEMI1KudRl63iFACS4mKtLngzuXz_.4 2024-09-12T19:23:01.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.834+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5506291377085419313', time=2024-09-12T20:59:29.447811+0000, chain.objs.size()=1 2024-09-12T19:23:01.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.834+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.579__shadow:1VwX0pBf9iu-yRB4pxCnUIpHtl8G45o_.b_RcQSVuL6k8iq6u4qZvn5V3Dwk9RzQ_0 2024-09-12T19:23:01.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.834+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9529604656571283238', time=2024-09-12T21:03:15.823946+0000, chain.objs.size()=6 2024-09-12T19:23:01.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.834+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.615__multipart_multipart_enc.2~KRaiO3KlBQ27XUgPTTTzXTitmTCjbyd.1 2024-09-12T19:23:01.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.834+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.615__multipart_multipart_enc.2~KRaiO3KlBQ27XUgPTTTzXTitmTCjbyd.2 2024-09-12T19:23:01.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.834+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.615__multipart_multipart_enc.2~KRaiO3KlBQ27XUgPTTTzXTitmTCjbyd.3 2024-09-12T19:23:01.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.834+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.615__multipart_multipart_enc.2~KRaiO3KlBQ27XUgPTTTzXTitmTCjbyd.4 2024-09-12T19:23:01.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.838+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.615__multipart_multipart_enc.2~KRaiO3KlBQ27XUgPTTTzXTitmTCjbyd.5 2024-09-12T19:23:01.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.838+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.615__multipart_multipart_enc.2~KRaiO3KlBQ27XUgPTTTzXTitmTCjbyd.6 2024-09-12T19:23:01.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.838+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17171930000461246434', time=2024-09-12T21:07:25.190450+0000, chain.objs.size()=1 2024-09-12T19:23:01.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.838+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.638__shadow_.KjZIj1Yf5gkTdKC0t6LOocSYCrfKws2_0 2024-09-12T19:23:01.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.838+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7255652017275285872', time=2024-09-12T21:08:17.498805+0000, chain.objs.size()=1 2024-09-12T19:23:01.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.838+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.650__shadow_.DovYsQtZdciI2yBI7dQYrT4EdUVpW7g_0 2024-09-12T19:23:01.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.842+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3829078020383897221', time=2024-09-12T21:08:34.163900+0000, chain.objs.size()=1 2024-09-12T19:23:01.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.842+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.655__shadow_.zS_bD1Y7DgPxAoLOOYA0kYIE5jQBzzq_0 2024-09-12T19:23:01.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.846+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:01.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T19:23:01.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:01.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:01.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45863' 2024-09-12T19:23:01.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13786602415555516954', time=2024-09-12T20:29:19.406502+0000, chain.objs.size()=1 2024-09-12T19:23:01.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.243__shadow_.V5IMXhxZbOmRJInKSY6IaCpef-KZ5DN_0 2024-09-12T19:23:01.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11696113664866186595', time=2024-09-12T20:29:19.408399+0000, chain.objs.size()=1 2024-09-12T19:23:01.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.243__shadow_.l3uSZrLNFj67ofrEl-Dy7YDJEAOxxUE_0 2024-09-12T19:23:01.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.614117820488930255', time=2024-09-12T20:29:25.570271+0000, chain.objs.size()=1 2024-09-12T19:23:01.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.245__shadow_.3rjaizeOINTzT9HbAWbLZF-u7i-A9Eo_0 2024-09-12T19:23:01.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17503687466963451088', time=2024-09-12T20:31:46.512198+0000, chain.objs.size()=1 2024-09-12T19:23:01.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.o8nsEh7Ikg1Kqh6aBOV_HE9RuOxTgpd_0 2024-09-12T19:23:01.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13752542950993830360', time=2024-09-12T20:31:47.716541+0000, chain.objs.size()=1 2024-09-12T19:23:01.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.T9aC2cp_EeRUkop32H_Op12cu3dhWP0_0 2024-09-12T19:23:01.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1387484164149938460', time=2024-09-12T20:31:47.809004+0000, chain.objs.size()=1 2024-09-12T19:23:01.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.wBzlbikLjFDwIHf1yK1AwDMB3fBPZJ3_0 2024-09-12T19:23:01.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10646938795678434716', time=2024-09-12T20:31:49.717315+0000, chain.objs.size()=1 2024-09-12T19:23:01.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.PWbcC4E1WiBUZt9u7HQaijHr8vl-4O4_0 2024-09-12T19:23:01.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3695473072855195954', time=2024-09-12T20:31:50.720671+0000, chain.objs.size()=1 2024-09-12T19:23:01.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.RrrIfdafWz_fzMJ9YLlzO_qA9voYV8E_0 2024-09-12T19:23:01.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14301997093278449792', time=2024-09-12T20:31:51.080390+0000, chain.objs.size()=1 2024-09-12T19:23:01.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.UE5jp02U_95ymnRfA5TU2QZZbh_ZIej_0 2024-09-12T19:23:01.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11435668849358749794', time=2024-09-12T20:31:53.207131+0000, chain.objs.size()=1 2024-09-12T19:23:01.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.LdTltG8b8Xlmgnv0xhvgKMuZihnv4CI_0 2024-09-12T19:23:01.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.820888915915982246', time=2024-09-12T20:31:53.597198+0000, chain.objs.size()=1 2024-09-12T19:23:01.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.LFUqo-daBMhLfaYhXX4w_D3aCA9ywZ0_0 2024-09-12T19:23:01.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7813981836915204326', time=2024-09-12T20:31:53.894852+0000, chain.objs.size()=1 2024-09-12T19:23:01.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.850+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.XwPno-FoGyVqv5xYaJYFBEqkHhJNCCR_0 2024-09-12T19:23:01.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.938368772172218243', time=2024-09-12T20:31:54.652406+0000, chain.objs.size()=1 2024-09-12T19:23:01.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.nhGt2jrWHwAbB2bBwHCyFSK1tZQ1ksM_0 2024-09-12T19:23:01.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9829877258150046098', time=2024-09-12T20:31:55.076465+0000, chain.objs.size()=1 2024-09-12T19:23:01.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.h5mhhia9Z5jXI9BHjbmM6WyCccNraGD_0 2024-09-12T19:23:01.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.854+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13069898528485514403', time=2024-09-12T20:31:56.922853+0000, chain.objs.size()=1 2024-09-12T19:23:01.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.854+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.mUVPa7Srw7PUo7JN8GL5ZMoyHk1LykI_0 2024-09-12T19:23:01.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.858+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10059103378530204543', time=2024-09-12T20:31:57.720585+0000, chain.objs.size()=1 2024-09-12T19:23:01.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.858+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.7bYTHXGQVvavePXG1n6jHMlP_nzZF51_0 2024-09-12T19:23:01.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.858+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17738025175297182097', time=2024-09-12T20:31:57.994460+0000, chain.objs.size()=1 2024-09-12T19:23:01.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.858+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.78PxD_-flq3JXstA3V_vGJsEB4ajvQ0_0 2024-09-12T19:23:01.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.858+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15321940274345702808', time=2024-09-12T20:31:58.483610+0000, chain.objs.size()=1 2024-09-12T19:23:01.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.858+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.psRg4um4Z56P6iD424r1zcMrweFTBGW_0 2024-09-12T19:23:01.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.858+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17234022635288045820', time=2024-09-12T20:31:58.814959+0000, chain.objs.size()=1 2024-09-12T19:23:01.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.858+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.04P2TI2WvrywIiWU46iqOKzhuaXEPdF_0 2024-09-12T19:23:01.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.858+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16041061858228352620', time=2024-09-12T20:31:59.723079+0000, chain.objs.size()=1 2024-09-12T19:23:01.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.858+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.6G67hbq20ybw8a4fHuvSYmCfpDZOfRy_0 2024-09-12T19:23:01.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.858+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6222424437059976322', time=2024-09-12T20:32:01.537832+0000, chain.objs.size()=1 2024-09-12T19:23:01.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.858+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.tpdODkU7XItpyAtQsJmANiR4PG3FhF0_0 2024-09-12T19:23:01.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.858+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.849139415374455897', time=2024-09-12T20:32:03.024832+0000, chain.objs.size()=1 2024-09-12T19:23:01.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.858+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ic9NN4uqKv40sLpVg0ESn0xC_duVtXq_0 2024-09-12T19:23:01.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.858+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2238834171393337492', time=2024-09-12T20:32:03.474293+0000, chain.objs.size()=1 2024-09-12T19:23:01.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.858+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.3oCpUDFDphntSWDrkgn5WIiIoQjCc-r_0 2024-09-12T19:23:01.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13295350803369388410', time=2024-09-12T20:32:06.921822+0000, chain.objs.size()=1 2024-09-12T19:23:01.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.RVkXWr5xWuIdBuki877oSifC5ztYF5i_0 2024-09-12T19:23:01.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1786589637177862032', time=2024-09-12T20:32:06.923411+0000, chain.objs.size()=1 2024-09-12T19:23:01.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.p0JxkMK02leKBHxmokeLFbUogTvf7GF_0 2024-09-12T19:23:01.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6758485937583672595', time=2024-09-12T20:32:06.989741+0000, chain.objs.size()=1 2024-09-12T19:23:01.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.8-i09iKCOewdEtnXleaH5KzP0SzvytM_0 2024-09-12T19:23:01.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.769654773530360314', time=2024-09-12T20:32:07.130780+0000, chain.objs.size()=1 2024-09-12T19:23:01.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.mMiCjEqLOyFzwwxJkNwNpAHupSLB4au_0 2024-09-12T19:23:01.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6363776249805794468', time=2024-09-12T20:32:08.205384+0000, chain.objs.size()=1 2024-09-12T19:23:01.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.9mdp3QvHXzDZJ80QUbJXch8ryHnj-TL_0 2024-09-12T19:23:01.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.862+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11079756750882317795', time=2024-09-12T20:32:08.986491+0000, chain.objs.size()=1 2024-09-12T19:23:01.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.862+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.wrfdhN2E-Ao9dZ5r3ulIb4i7EP8Hxj5_0 2024-09-12T19:23:01.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.866+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11831392069302992572', time=2024-09-12T20:32:09.860239+0000, chain.objs.size()=1 2024-09-12T19:23:01.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.866+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.mJBG5dR6Wxzo9qfVisOMxftzTi77atx_0 2024-09-12T19:23:01.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.866+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6824496055622089389', time=2024-09-12T20:32:10.192631+0000, chain.objs.size()=1 2024-09-12T19:23:01.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.866+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.hbf1w0v3GqBsiXTXb-8PB6QT90zgp9r_0 2024-09-12T19:23:01.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.866+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12187497721995270267', time=2024-09-12T20:32:10.659148+0000, chain.objs.size()=1 2024-09-12T19:23:01.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.866+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.MWcjxSpJCGtv_l97m33ay-6XozjBmAl_0 2024-09-12T19:23:01.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.866+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7106032014249847408', time=2024-09-12T20:32:10.687312+0000, chain.objs.size()=1 2024-09-12T19:23:01.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.866+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.aNDwMVPtx4YOw20xj_gKZgZW7AzatbL_0 2024-09-12T19:23:01.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.866+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1788765555504491029', time=2024-09-12T20:32:10.901563+0000, chain.objs.size()=1 2024-09-12T19:23:01.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.866+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.rSEyr30DtbeBClRWpgi4BtgWksXqoMZ_0 2024-09-12T19:23:01.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.866+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15643657755319438658', time=2024-09-12T20:32:11.569992+0000, chain.objs.size()=1 2024-09-12T19:23:01.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.866+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.1tnUZnRCeC3UVu1ALBPMnkHmsJffgTm_0 2024-09-12T19:23:01.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.866+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2920161022916137158', time=2024-09-12T20:32:13.007299+0000, chain.objs.size()=1 2024-09-12T19:23:01.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.866+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.IDelln8ZxmnAJ9QFA6Yw16GGYA04RZQ_0 2024-09-12T19:23:01.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.866+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2812691645532145745', time=2024-09-12T20:32:13.042861+0000, chain.objs.size()=1 2024-09-12T19:23:01.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.866+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.VeuQjZiuPc0chSNpPa87NZmttsh9OA9_0 2024-09-12T19:23:01.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14071045413334195951', time=2024-09-12T20:32:13.077674+0000, chain.objs.size()=1 2024-09-12T19:23:01.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.Wzk6Ze3VmhPCs7Ims0ez_Ipb9fkXKeT_0 2024-09-12T19:23:01.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9820883616447346526', time=2024-09-12T20:33:31.520216+0000, chain.objs.size()=1 2024-09-12T19:23:01.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_._Lbvl_W2rYATfIceG87vKnCBsSiNoAR_0 2024-09-12T19:23:01.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6090935048062671581', time=2024-09-12T20:33:31.533443+0000, chain.objs.size()=1 2024-09-12T19:23:01.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.293__shadow_.2sVgaY6zjKo2rcuqUQ8g42ShqEidmKD_0 2024-09-12T19:23:01.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12000002977185604236', time=2024-09-12T20:33:43.338724+0000, chain.objs.size()=1 2024-09-12T19:23:01.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.298__shadow_.jZJ2uEOJtXOuSuiGogLBU3xyUdkRe4r_0 2024-09-12T19:23:01.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14906814067829844307', time=2024-09-12T20:33:59.363748+0000, chain.objs.size()=1 2024-09-12T19:23:01.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.305__shadow_.VXukBOJuAzVZmHHMMvLIzrwbS2QZQOD_0 2024-09-12T19:23:01.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13953122544914476066', time=2024-09-12T20:34:02.088705+0000, chain.objs.size()=1 2024-09-12T19:23:01.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.306__shadow_.MGUUpaKRu10_WS3C3cWlaJ-mM6ROGQi_0 2024-09-12T19:23:01.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17768087855898023352', time=2024-09-12T20:36:29.522662+0000, chain.objs.size()=1 2024-09-12T19:23:01.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.6INv1h2gPdbfWTnKUo_jch-tB5k3twP_0 2024-09-12T19:23:01.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12962493408610077656', time=2024-09-12T20:36:30.344294+0000, chain.objs.size()=1 2024-09-12T19:23:01.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.GSuokONvVdhkLrx18rIKQCpGQ425CRB_0 2024-09-12T19:23:01.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.870+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14110579157200979085', time=2024-09-12T20:36:31.956704+0000, chain.objs.size()=1 2024-09-12T19:23:01.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.870+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.X4cdihq6FhSEPKTiTQG7A9qB2LTnTE8_0 2024-09-12T19:23:01.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18159100660300851655', time=2024-09-12T20:36:32.421967+0000, chain.objs.size()=1 2024-09-12T19:23:01.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.5gQ417a-fL7n388I-jvk2E6SmqZd2wJ_0 2024-09-12T19:23:01.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8911493153112161775', time=2024-09-12T20:36:35.834268+0000, chain.objs.size()=1 2024-09-12T19:23:01.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.PpP654wOZcx3V_Bm0JeXUxydl9JcrPS_0 2024-09-12T19:23:01.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.593859130149259469', time=2024-09-12T20:36:36.267700+0000, chain.objs.size()=1 2024-09-12T19:23:01.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.pAzRYn0fQpLf5GD-NWP00bS8cwNCRQB_0 2024-09-12T19:23:01.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13922804698309775739', time=2024-09-12T20:36:36.848207+0000, chain.objs.size()=1 2024-09-12T19:23:01.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.C4_NZ-eVNm__eFG8XLskmdkOTQqRdOm_0 2024-09-12T19:23:01.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14585649046380196296', time=2024-09-12T20:36:37.055133+0000, chain.objs.size()=1 2024-09-12T19:23:01.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.NuWgjZoug2169vlXFVIldLYFQ_lEzse_0 2024-09-12T19:23:01.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11628561755319955780', time=2024-09-12T20:36:40.756118+0000, chain.objs.size()=1 2024-09-12T19:23:01.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.AFmwVfeZm0aw0J0HY1ekHNs4wqayb0l_0 2024-09-12T19:23:01.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9232314031171715178', time=2024-09-12T20:36:40.874067+0000, chain.objs.size()=1 2024-09-12T19:23:01.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.SS4vOaCpZlaL2MxrbmrUN9wJ95Ey9gC_0 2024-09-12T19:23:01.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17582675396247718259', time=2024-09-12T20:36:42.016889+0000, chain.objs.size()=1 2024-09-12T19:23:01.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.9pTqc9jo1Q9DeCVxMktkTlRIWd27a3Y_0 2024-09-12T19:23:01.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16913890336068793662', time=2024-09-12T20:36:42.209809+0000, chain.objs.size()=1 2024-09-12T19:23:01.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.XT9wRJVK9u8Wsg1z5FpldaVE-m0YXgK_0 2024-09-12T19:23:01.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10819813331633180593', time=2024-09-12T20:36:45.467221+0000, chain.objs.size()=1 2024-09-12T19:23:01.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.IF4zgUtZ5QVQkq93052Ux2_VMWqw4KM_0 2024-09-12T19:23:01.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12659636204335959922', time=2024-09-12T20:36:46.087785+0000, chain.objs.size()=1 2024-09-12T19:23:01.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.eT0WMIk-1dlmqb7l9ACGQlFagpvWD8O_0 2024-09-12T19:23:01.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9800095479198459055', time=2024-09-12T20:36:47.840744+0000, chain.objs.size()=1 2024-09-12T19:23:01.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.FBdfXgMV28B96q0boJP2B189xgYGQ9w_0 2024-09-12T19:23:01.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8563712144191412862', time=2024-09-12T20:36:48.027907+0000, chain.objs.size()=1 2024-09-12T19:23:01.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.874+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.aGNrs3frxeRaR5VJZWsQlw6Rysr6c9b_0 2024-09-12T19:23:01.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.878+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3997986657729329611', time=2024-09-12T20:36:48.216931+0000, chain.objs.size()=1 2024-09-12T19:23:01.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.878+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.3pkUMUXGnLqRtpEwTLOzbVdbaygKTNm_0 2024-09-12T19:23:01.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.878+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8599381070147704766', time=2024-09-12T20:36:48.325017+0000, chain.objs.size()=1 2024-09-12T19:23:01.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.878+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.P5mzcDop9xmW6VX0TOIEl5c7JC9vH1m_0 2024-09-12T19:23:01.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.878+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1266327202997824769', time=2024-09-12T20:36:48.680394+0000, chain.objs.size()=1 2024-09-12T19:23:01.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.878+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Zv6AvNx56enjawOAvDetmkD4hT45BX1_0 2024-09-12T19:23:01.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.882+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1682717355265370892', time=2024-09-12T20:36:50.937213+0000, chain.objs.size()=1 2024-09-12T19:23:01.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.882+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.k0kQReXjZ60gw0-6Q-DS9vsxUi5E7iv_0 2024-09-12T19:23:01.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.882+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12709889733589661240', time=2024-09-12T20:36:51.291498+0000, chain.objs.size()=1 2024-09-12T19:23:01.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.882+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.3aYd4QrNgcvCj4rRfF1IpRvuismIiyc_0 2024-09-12T19:23:01.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.882+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16940627867770533458', time=2024-09-12T20:36:51.430418+0000, chain.objs.size()=1 2024-09-12T19:23:01.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.882+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.4mNnsomCvSnTKRCdct5u5aNFPmKPk5z_0 2024-09-12T19:23:01.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.882+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18062219439411012244', time=2024-09-12T20:36:51.886578+0000, chain.objs.size()=1 2024-09-12T19:23:01.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.882+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.7e-AFfS-pSWnkxxOnRQ3kjKeJZlq1-d_0 2024-09-12T19:23:01.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.882+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5060979562747772125', time=2024-09-12T20:36:52.866818+0000, chain.objs.size()=1 2024-09-12T19:23:01.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.882+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.obVvGVyMcGILSig09nEvE6lpVsNttya_0 2024-09-12T19:23:01.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.882+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14250647602200995871', time=2024-09-12T20:36:53.107345+0000, chain.objs.size()=1 2024-09-12T19:23:01.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.882+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.FwhU9gBuWuEiHwi-kOuVFP6QGWZiJ34_0 2024-09-12T19:23:01.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.882+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9901054539306241837', time=2024-09-12T20:36:54.386546+0000, chain.objs.size()=1 2024-09-12T19:23:01.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.882+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.mMHdwWPm9ADEJRcydPS_88b50O8Bxpr_0 2024-09-12T19:23:01.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.882+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17648901303721671111', time=2024-09-12T20:36:54.553080+0000, chain.objs.size()=1 2024-09-12T19:23:01.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.882+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ONgU1Lxb-7ANRTI2NfvCNbS6U9FnGxd_0 2024-09-12T19:23:01.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.882+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5873718697264111567', time=2024-09-12T20:36:55.940052+0000, chain.objs.size()=1 2024-09-12T19:23:01.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.882+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.vegZvbQGTfqqcNOdDH3_Se6ZkEKDcfF_0 2024-09-12T19:23:01.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.862533107263083766', time=2024-09-12T20:38:40.965588+0000, chain.objs.size()=1 2024-09-12T19:23:01.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.8Dt5pgIkF9HaonU72NosUKXI9tVertb_0 2024-09-12T19:23:01.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13524558659258194090', time=2024-09-12T20:38:41.525584+0000, chain.objs.size()=1 2024-09-12T19:23:01.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ndEldmF5xIo1e16N1Vc6yX10nGtAOGd_0 2024-09-12T19:23:01.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1689762256271879784', time=2024-09-12T20:38:41.984975+0000, chain.objs.size()=1 2024-09-12T19:23:01.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.PtgJuEPpYjljfrFsT_LTkKolpQr1Al1_0 2024-09-12T19:23:01.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5253075043808216562', time=2024-09-12T20:38:42.388627+0000, chain.objs.size()=1 2024-09-12T19:23:01.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.sb99l2fv5n3iu7m1dPxyEvYwLA5NXpT_0 2024-09-12T19:23:01.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17134741022144209422', time=2024-09-12T20:38:44.422158+0000, chain.objs.size()=1 2024-09-12T19:23:01.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.FAca7Q3oeu5Vnd-1MKLJ50_Shav_xuw_0 2024-09-12T19:23:01.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6291052970188380475', time=2024-09-12T20:38:47.949191+0000, chain.objs.size()=1 2024-09-12T19:23:01.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.dRMXYrvRRNBympkEEun9bk2HtmOwmAM_0 2024-09-12T19:23:01.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12966909152729333283', time=2024-09-12T20:38:48.121134+0000, chain.objs.size()=1 2024-09-12T19:23:01.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.jGjArYhE0qopT1LH5_PzNtgWl_MQcN6_0 2024-09-12T19:23:01.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7550537345529822293', time=2024-09-12T20:38:48.700959+0000, chain.objs.size()=1 2024-09-12T19:23:01.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.i8UPq_JYt6LPaqebE8LgBInQ4YTmSRW_0 2024-09-12T19:23:01.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16526147766830999961', time=2024-09-12T20:38:51.269715+0000, chain.objs.size()=1 2024-09-12T19:23:01.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.3jOXE5IlyQSDoilMDyzBaDEIVKwkohE_0 2024-09-12T19:23:01.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.886+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4240745466964953156', time=2024-09-12T20:38:51.673419+0000, chain.objs.size()=1 2024-09-12T19:23:01.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.886+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.eywstAmkGIRf-dvamxfQ8cCbK2frAor_0 2024-09-12T19:23:01.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.890+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13567783453888796700', time=2024-09-12T20:38:52.549741+0000, chain.objs.size()=1 2024-09-12T19:23:01.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.890+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.V-Sb00-zbJgdPmkU-jOi-LLGQmP0Qem_0 2024-09-12T19:23:01.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.890+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11939725366791772226', time=2024-09-12T20:38:52.966666+0000, chain.objs.size()=1 2024-09-12T19:23:01.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.890+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.u1vb59qroXoH4dQNbqGQskqxj_g-obp_0 2024-09-12T19:23:01.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.890+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.875826712745582311', time=2024-09-12T20:38:53.324272+0000, chain.objs.size()=1 2024-09-12T19:23:01.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.890+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.TeD3ULH83Mk6NtFNvUyPFclLKhNt_VG_0 2024-09-12T19:23:01.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.890+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7863613155830121171', time=2024-09-12T20:38:53.477075+0000, chain.objs.size()=1 2024-09-12T19:23:01.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.890+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.uQQEaMW6F3cvABU4S4o5tVA9zKwVgSD_0 2024-09-12T19:23:01.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.890+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1929939804322836517', time=2024-09-12T20:38:54.028818+0000, chain.objs.size()=1 2024-09-12T19:23:01.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.890+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.YM0pQGzODx0aKJKja7YHgaK5f5ec7KU_0 2024-09-12T19:23:01.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.890+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12484152431708146002', time=2024-09-12T20:38:55.559212+0000, chain.objs.size()=1 2024-09-12T19:23:01.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.890+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.-qfrMYE-0KfU-HBr2xddAirxswypeSw_0 2024-09-12T19:23:01.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.890+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9368371402742889169', time=2024-09-12T20:38:55.561523+0000, chain.objs.size()=1 2024-09-12T19:23:01.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.890+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Et-zNFsZ84zKfkEz1l3ewDauoAs1NIQ_0 2024-09-12T19:23:01.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11546804078736245181', time=2024-09-12T20:38:55.563493+0000, chain.objs.size()=1 2024-09-12T19:23:01.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.NNfMN0F-7HGRglsHtQsL94qd1lG9Eig_0 2024-09-12T19:23:01.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10587689767134141981', time=2024-09-12T20:38:57.052211+0000, chain.objs.size()=1 2024-09-12T19:23:01.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.nzmeRinFQf9T4oAxk6BYPb3dd37i97c_0 2024-09-12T19:23:01.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1480220722050238499', time=2024-09-12T20:38:59.047703+0000, chain.objs.size()=1 2024-09-12T19:23:01.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.D3ZHXW6GStfrF8QKAdaY2Xb5Rb1D-TN_0 2024-09-12T19:23:01.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1658972571605131756', time=2024-09-12T20:39:00.259169+0000, chain.objs.size()=1 2024-09-12T19:23:01.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.0dn49ZQBZCe1H4O9WeTJkreK6lvwOCP_0 2024-09-12T19:23:01.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9886158303628078975', time=2024-09-12T20:39:02.300032+0000, chain.objs.size()=1 2024-09-12T19:23:01.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.hZjkiC1kX3vhOmBWMurRkyla6pKhphZ_0 2024-09-12T19:23:01.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7417795744723288316', time=2024-09-12T20:39:02.669254+0000, chain.objs.size()=1 2024-09-12T19:23:01.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.FX7tPjzYdJjPI2RYWHCuHEXt5HdAe_4_0 2024-09-12T19:23:01.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.894+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15055259147587373811', time=2024-09-12T20:39:05.751718+0000, chain.objs.size()=1 2024-09-12T19:23:01.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.894+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ze30CDemROPFcYOVwBmcF6DrG734Chp_0 2024-09-12T19:23:01.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.898+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1573049025464891604', time=2024-09-12T20:39:06.092422+0000, chain.objs.size()=1 2024-09-12T19:23:01.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.898+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.Mr2ZrN8dJhhTjuIDhQsMVDj0Hnuqzma_0 2024-09-12T19:23:01.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.898+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14129090316899403026', time=2024-09-12T20:39:06.444435+0000, chain.objs.size()=1 2024-09-12T19:23:01.904 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.898+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.w9s2k3CuSs7mQptFFyV01RIZJ0rGzUX_0 2024-09-12T19:23:01.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.898+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14995274473435368237', time=2024-09-12T20:39:06.580192+0000, chain.objs.size()=1 2024-09-12T19:23:01.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.898+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.e9tmgfLqEB8ae67hZwfaRq1fJzn8udg_0 2024-09-12T19:23:01.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.898+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4197039969390399249', time=2024-09-12T20:39:06.713118+0000, chain.objs.size()=1 2024-09-12T19:23:01.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.898+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.hqHADobVyr3cA767_3ehDv9aXAmW6kD_0 2024-09-12T19:23:01.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.898+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5316282944340340568', time=2024-09-12T20:39:07.020632+0000, chain.objs.size()=1 2024-09-12T19:23:01.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.898+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.yAz2keAL6c6G4kdZ2PctwOmA3fKIwKl_0 2024-09-12T19:23:01.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.902+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45863 2024-09-12T19:23:01.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T19:23:01.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5258697859277145753', time=2024-09-12T20:39:47.000729+0000, chain.objs.size()=1 2024-09-12T19:23:01.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.343__shadow_.LLSgGlvqKb4BN2d3kSqKrNlxOKfGhrt_0 2024-09-12T19:23:01.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11287946888838807586', time=2024-09-12T20:39:50.933692+0000, chain.objs.size()=1 2024-09-12T19:23:01.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.345__shadow_.vZ9rtXkghtWv59e869dlswgfsqP3pf__0 2024-09-12T19:23:01.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18046637354365623901', time=2024-09-12T20:40:53.763364+0000, chain.objs.size()=1 2024-09-12T19:23:01.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.378__shadow_.Ikh_sjH5f8ztd8J9Wag9123En7u-mwJ_0 2024-09-12T19:23:01.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10507949894861190542', time=2024-09-12T20:40:59.478605+0000, chain.objs.size()=1 2024-09-12T19:23:01.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.381__shadow_.XdZo2ywbZ1OzgcRdffj1sgWlSuILGFr_0 2024-09-12T19:23:01.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10827864834822075499', time=2024-09-12T20:43:08.995362+0000, chain.objs.size()=1 2024-09-12T19:23:01.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.444__shadow_.BqH5tbyzQUJhCLZHBLEeIILAQhLxBrM_0 2024-09-12T19:23:01.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4942775120511139433', time=2024-09-12T20:44:00.800662+0000, chain.objs.size()=1 2024-09-12T19:23:01.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.464__shadow_.b-yuaZPj3pvAGqLUfiOd9URuMgPRdEK_0 2024-09-12T19:23:01.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10302222480359346063', time=2024-09-12T20:44:46.918086+0000, chain.objs.size()=1 2024-09-12T19:23:01.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.486__shadow_.v4oRO8BFYhX-AJsFXWLyeYRAMvtxVFK_0 2024-09-12T19:23:01.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16152740031555411797', time=2024-09-12T20:44:51.327758+0000, chain.objs.size()=1 2024-09-12T19:23:01.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.488__shadow_.chscM7RH7-UA4Y5tzFi7QFkpPycgqsH_0 2024-09-12T19:23:01.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4802924369779543710', time=2024-09-12T20:44:53.412171+0000, chain.objs.size()=1 2024-09-12T19:23:01.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.489__shadow_.H5nSn0N-8VhZqn7tDqkHtZQb4-369PI_0 2024-09-12T19:23:01.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11108682035785666265', time=2024-09-12T20:45:00.467269+0000, chain.objs.size()=1 2024-09-12T19:23:01.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.493__shadow_.MJEb-RE_cVEVX5ILGl-7qbLVv2RfzvF_0 2024-09-12T19:23:01.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13106726207031304177', time=2024-09-12T20:51:16.724966+0000, chain.objs.size()=6 2024-09-12T19:23:01.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~oHkxTh4sRV4O_OiXuxFCjYn3Cnw6qZs.1 2024-09-12T19:23:01.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.906+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.VdVEZ-aYrGj0qmflt1JXjwA8-VuWYdXS.2 2024-09-12T19:23:01.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.910+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.j7bPd3xZLUgb2x4a0t-w6_kWbV78DQ5z.3 2024-09-12T19:23:01.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.910+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~oHkxTh4sRV4O_OiXuxFCjYn3Cnw6qZs.4 2024-09-12T19:23:01.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.910+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~oHkxTh4sRV4O_OiXuxFCjYn3Cnw6qZs.5 2024-09-12T19:23:01.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.910+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.522__multipart_mymultipart.2~oHkxTh4sRV4O_OiXuxFCjYn3Cnw6qZs.6 2024-09-12T19:23:01.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.910+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16477675823280712356', time=2024-09-12T20:51:53.382478+0000, chain.objs.size()=2 2024-09-12T19:23:01.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.910+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.523__multipart_mymultipart.2~d5lDtoVDJtzcOjrRgep9PgkV_zSjdZi.1 2024-09-12T19:23:01.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.910+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.523__multipart_mymultipart.2~d5lDtoVDJtzcOjrRgep9PgkV_zSjdZi.2 2024-09-12T19:23:01.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.910+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4530457689967923569', time=2024-09-12T20:52:40.926746+0000, chain.objs.size()=2 2024-09-12T19:23:01.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.910+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.525__multipart_mymultipart.2~0kmbnjo0fGS1hWNkKI83kpwy2ju2SyB.1 2024-09-12T19:23:01.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.910+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.525__multipart_mymultipart.2~0kmbnjo0fGS1hWNkKI83kpwy2ju2SyB.2 2024-09-12T19:23:01.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.910+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9784619371152942615', time=2024-09-12T20:55:26.197172+0000, chain.objs.size()=1 2024-09-12T19:23:01.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.910+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.554__shadow_.PvS6Vc9aZI3xLYfizvLuVhu0XwecEPL_0 2024-09-12T19:23:01.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.910+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5798457991241294204', time=2024-09-12T20:57:03.318221+0000, chain.objs.size()=1 2024-09-12T19:23:01.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.910+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:lVnm.ad.TzssOSZdNaaVZ64jN3.ELor_.SVtDlfB95et-6Fk-dplZ949bTSIW1JE_0 2024-09-12T19:23:01.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.910+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.961941214626103223', time=2024-09-12T20:57:28.083714+0000, chain.objs.size()=1 2024-09-12T19:23:01.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.910+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.574__shadow:DYzp9Wnt-Q5sN9trc4uuBCF.gESVbKJ_.ORiCOC8NRlRbc-JlNrtri-tsHZfcfIl_0 2024-09-12T19:23:01.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.914+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10369352695979106727', time=2024-09-12T20:57:29.175424+0000, chain.objs.size()=1 2024-09-12T19:23:01.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.914+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.574__shadow:8ji7KgqooiS8T-7JNHqTFK5a01J.M--_.iaWewpkaSASeIfPSi-33E4aBOjiw-OG_0 2024-09-12T19:23:01.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.914+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.604365252126090065', time=2024-09-12T20:57:42.083058+0000, chain.objs.size()=1 2024-09-12T19:23:01.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.914+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.576__shadow:C6-ymZARc3xduIyTIbyNCDK8IFFto7h_.d4KVq7KsdeaITOlC4wR14a5wP245qt1_0 2024-09-12T19:23:01.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.914+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11060972220818711507', time=2024-09-12T20:57:55.260941+0000, chain.objs.size()=1 2024-09-12T19:23:01.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.914+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:2kdhAjNwQz7q4CtrqUp6WmSLJ.ujQca_.ft5arLf_8hswDoQvHEzfJoH4MaK_uZZ_0 2024-09-12T19:23:01.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.918+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16792735281897082235', time=2024-09-12T20:58:10.504173+0000, chain.objs.size()=1 2024-09-12T19:23:01.922 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.918+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:26sXBOOEKTOiOD1WQBxihNlyga1wiAN_.ILuCpLnFWJgmTpyApV_QJRm_7NL9E_c_0 2024-09-12T19:23:01.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.918+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16603726723215487061', time=2024-09-12T20:58:27.423601+0000, chain.objs.size()=1 2024-09-12T19:23:01.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.918+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:VJhW8XLa37WrOX9wkUsgQSnAKtD-ph5_.IoQvQmIsOjlaeZvrYgg_MVFkVvYTevB_0 2024-09-12T19:23:01.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.918+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13664662559490706712', time=2024-09-12T20:59:35.762619+0000, chain.objs.size()=1 2024-09-12T19:23:01.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.918+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.580__shadow:Hv2wbbedeP.N6cSgFCL9WFR6ss5nrbB_._r7qX5j0nVaUDxA_vCiIKc8n4TpCjPr_0 2024-09-12T19:23:01.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.922+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1166180510098955510', time=2024-09-12T20:59:47.166520+0000, chain.objs.size()=1 2024-09-12T19:23:01.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.922+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.585__shadow:iUUMQtsRHVizdFMp6L8dCTB32--pHDh_.CFhtNKOmSkdCaaK7xEjtC8V0XW7XKjT_0 2024-09-12T19:23:01.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.922+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1210448234029623888', time=2024-09-12T20:59:55.006975+0000, chain.objs.size()=1 2024-09-12T19:23:01.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.922+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.587__shadow:-xqWqUyILkZaB6H5-bqcMyIRNBZW7-6_.RraQerduWyHEy4m2IZwATIwyG_R2A3i_0 2024-09-12T19:23:01.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.922+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15937237081173399099', time=2024-09-12T21:10:27.651164+0000, chain.objs.size()=1 2024-09-12T19:23:01.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.922+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.690__shadow:Uw-h7rUN3HpANQjgEWrOfHh85bTU8Z._.wupaFrLUo8wGmAYRK_f_rQjHX3yrdzR_0 2024-09-12T19:23:01.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.922+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4685996831312348848', time=2024-09-12T21:10:55.525217+0000, chain.objs.size()=1 2024-09-12T19:23:01.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.922+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.703__shadow:gDCijD16w9T77sjE24eGiM6Nbp4vVk1_.vndXAX9LTu2wtr86xSC8zauPKxbsXun_0 2024-09-12T19:23:01.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.922+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18381454605283470063', time=2024-09-12T21:11:01.934338+0000, chain.objs.size()=1 2024-09-12T19:23:01.929 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.922+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.706__shadow_.RGWnka-MiEweUwL8T1_az8MIFuXfcRA_0 2024-09-12T19:23:01.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.922+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7816903148354119135', time=2024-09-12T21:11:08.142117+0000, chain.objs.size()=1 2024-09-12T19:23:01.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.922+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.709__shadow_.gLO8bbEtrIBH2R4vcgQ9FLgPvR6hBs__0 2024-09-12T19:23:01.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.930+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:01.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.930+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T19:23:01.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.930+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:23:01.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:23:01.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47722' 2024-09-12T19:23:01.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8365290831176192471', time=2024-09-12T20:24:08.084423+0000, chain.objs.size()=1 2024-09-12T19:23:01.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.177__shadow_.4HOsqUGif67wI-WWiJJTnjnul6eAKjy_0 2024-09-12T19:23:01.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15843683438005690296', time=2024-09-12T20:29:23.279587+0000, chain.objs.size()=1 2024-09-12T19:23:01.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.244__shadow_.PYT3Wo7uGpvOtFmMCpW09X1qRnBZN5d_0 2024-09-12T19:23:01.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17626479324505535421', time=2024-09-12T20:31:49.390974+0000, chain.objs.size()=1 2024-09-12T19:23:01.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.SVGJ1B9-_IvVlgYjfvVErwSg4_v22e5_0 2024-09-12T19:23:01.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1988812090420141297', time=2024-09-12T20:31:53.870454+0000, chain.objs.size()=1 2024-09-12T19:23:01.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.PHcD0zh-CzV3J2COfw-jhxh5GBv1ijY_0 2024-09-12T19:23:01.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15805076780822019945', time=2024-09-12T20:31:55.063668+0000, chain.objs.size()=1 2024-09-12T19:23:01.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.MzWrMJXTthANqjGfz4hGSzFIfoh6ULM_0 2024-09-12T19:23:01.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9453168213377868422', time=2024-09-12T20:31:57.385166+0000, chain.objs.size()=1 2024-09-12T19:23:01.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.wB3ozx6WCuITg7067T7jzhcdsY-EzIM_0 2024-09-12T19:23:01.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2751298720040478696', time=2024-09-12T20:31:58.571613+0000, chain.objs.size()=1 2024-09-12T19:23:01.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.VAE7slovrXBbhYNBALZYO1GeWhJkuvP_0 2024-09-12T19:23:01.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11379081157996015335', time=2024-09-12T20:31:59.328315+0000, chain.objs.size()=1 2024-09-12T19:23:01.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.PE7LlwV1Q_cdozbcAvNdLKClVupUi65_0 2024-09-12T19:23:01.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10188192179850987880', time=2024-09-12T20:31:59.423573+0000, chain.objs.size()=1 2024-09-12T19:23:01.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.LejC51-KzJgCr8b9_6xo8wGWNaaGiyb_0 2024-09-12T19:23:01.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15720321915165888688', time=2024-09-12T20:31:59.693814+0000, chain.objs.size()=1 2024-09-12T19:23:01.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.ot-ouyY-QNEHe6fuQajodmZRhsT2oMf_0 2024-09-12T19:23:01.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5487460488929517308', time=2024-09-12T20:32:01.149257+0000, chain.objs.size()=1 2024-09-12T19:23:01.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.DOxLCSINbnjQRhivSTMDyL_JbcHVaSV_0 2024-09-12T19:23:01.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17769451507948260117', time=2024-09-12T20:32:01.715667+0000, chain.objs.size()=1 2024-09-12T19:23:01.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.934+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.PXszEN1nZj2ZQfjGxNg1zIS67_AiKXK_0 2024-09-12T19:23:01.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6683034756860659138', time=2024-09-12T20:32:01.944521+0000, chain.objs.size()=1 2024-09-12T19:23:01.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.aa5F9fSlRVuc8Ss423FcOWwED-Mf2fr_0 2024-09-12T19:23:01.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5257489031272084829', time=2024-09-12T20:32:03.272150+0000, chain.objs.size()=1 2024-09-12T19:23:01.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.I4-I3ZJ3fHrwhlKW2u2RitMbupWmojc_0 2024-09-12T19:23:01.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6903412215441234106', time=2024-09-12T20:32:05.654353+0000, chain.objs.size()=1 2024-09-12T19:23:01.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.lqkesB7T4WagxMNNMA1z5dNsA3w14Ic_0 2024-09-12T19:23:01.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6039331258571541600', time=2024-09-12T20:32:06.156801+0000, chain.objs.size()=1 2024-09-12T19:23:01.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.vqQEfs8uTYGjE326Xb3wcsNlwLDnQ9i_0 2024-09-12T19:23:01.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12913745294354033798', time=2024-09-12T20:32:06.377882+0000, chain.objs.size()=1 2024-09-12T19:23:01.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.NdpxElAyfx0iLsNjGlC3wwt8SFmC5lO_0 2024-09-12T19:23:01.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14827931786977862924', time=2024-09-12T20:32:06.990740+0000, chain.objs.size()=1 2024-09-12T19:23:01.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.g3OwmBcmnmwPzr5_6z2daK5pGdOxbNQ_0 2024-09-12T19:23:01.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10348731668625486710', time=2024-09-12T20:32:07.163249+0000, chain.objs.size()=1 2024-09-12T19:23:01.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.-m-boDkYoMNM5zQO9J9q7PGoMRHjyHF_0 2024-09-12T19:23:01.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13958880599224449738', time=2024-09-12T20:32:09.060704+0000, chain.objs.size()=1 2024-09-12T19:23:01.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.6z9hJ_aXfKGoBVY-7JBMgmVED2E0Nb0_0 2024-09-12T19:23:01.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11650749581824181809', time=2024-09-12T20:32:10.841358+0000, chain.objs.size()=1 2024-09-12T19:23:01.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.2_RjiGvja5Sc1bY1Gg0mCzLOCoqicQg_0 2024-09-12T19:23:01.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16088730896456722620', time=2024-09-12T20:32:10.885268+0000, chain.objs.size()=1 2024-09-12T19:23:01.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.cpRMrItE-umk2cJhvBMPM7yQiJDXZ1V_0 2024-09-12T19:23:01.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.280709063578296757', time=2024-09-12T20:32:11.545140+0000, chain.objs.size()=1 2024-09-12T19:23:01.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.938+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.gRc_67ekmCD5o9z8kUQY_DiqLSwXf4q_0 2024-09-12T19:23:01.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.942+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12456652560968062577', time=2024-09-12T20:32:11.875124+0000, chain.objs.size()=1 2024-09-12T19:23:01.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.942+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.QZd_CDIpe5cTw9KVBfKAMq_UUkGrCAs_0 2024-09-12T19:23:01.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.942+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9969272874078100748', time=2024-09-12T20:32:12.162341+0000, chain.objs.size()=1 2024-09-12T19:23:01.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.942+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.J_2360bce4A5u2zyWQFSbAMBRoC-u4y_0 2024-09-12T19:23:01.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.946+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5541879864117243196', time=2024-09-12T20:32:12.345465+0000, chain.objs.size()=1 2024-09-12T19:23:01.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.946+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.262__shadow_.b_JINxGiGopn13BEh1keKK1IizNCNa0_0 2024-09-12T19:23:01.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.946+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4616144796308288422', time=2024-09-12T20:32:27.155026+0000, chain.objs.size()=1 2024-09-12T19:23:01.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.946+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.268__shadow_.USOokdHzLUAfoU86MWEeFDx5q7MLC16_0 2024-09-12T19:23:01.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.946+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10293764451039663739', time=2024-09-12T20:32:38.097074+0000, chain.objs.size()=1 2024-09-12T19:23:01.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.946+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.273__shadow_.TJZBW69fIGp52Qwknsq1CL1uGGqzFoU_0 2024-09-12T19:23:01.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.946+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2760961640996908401', time=2024-09-12T20:32:49.508544+0000, chain.objs.size()=1 2024-09-12T19:23:01.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.946+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.278__shadow_.SzoHCPgkW0SdQ9IqUdf6Nu1xFdhc8YM_0 2024-09-12T19:23:01.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.946+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11016990760845928482', time=2024-09-12T20:32:58.722357+0000, chain.objs.size()=1 2024-09-12T19:23:01.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.946+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.282__shadow_.ZwSkwGL5y2Bbznxh_Q-kVXmRgYp8acl_0 2024-09-12T19:23:01.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.946+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11911462873543268570', time=2024-09-12T20:33:25.416493+0000, chain.objs.size()=1 2024-09-12T19:23:01.951 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.946+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.292__shadow_.NEGWVAkuuYCoeEHWSWxcDiC3ZBtlAgf_0 2024-09-12T19:23:01.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.946+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8237325329359945233', time=2024-09-12T20:33:48.029895+0000, chain.objs.size()=1 2024-09-12T19:23:01.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.946+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.300__shadow_.1g1mFKcSAz4OM6WH1u4v7iStOAkL0hi_0 2024-09-12T19:23:01.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.946+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3121160500420354329', time=2024-09-12T20:34:29.951868+0000, chain.objs.size()=1 2024-09-12T19:23:01.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.946+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.315__shadow_.zwMuaO8MswuVeuh7D61d-BrD6WjSU99_0 2024-09-12T19:23:01.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.946+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.538122362218571695', time=2024-09-12T20:36:27.912043+0000, chain.objs.size()=1 2024-09-12T19:23:01.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.946+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Q00bOPUjV5cwsCpHxrB4mXp6CpYVFKX_0 2024-09-12T19:23:01.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5534106064949427985', time=2024-09-12T20:36:29.228555+0000, chain.objs.size()=1 2024-09-12T19:23:01.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ieEUn6wVn-Et7RuW-fUN6_U497OolUO_0 2024-09-12T19:23:01.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4362835708191502888', time=2024-09-12T20:36:29.950045+0000, chain.objs.size()=1 2024-09-12T19:23:01.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Pb3WENtPtNTRvZ2tBBSZW_HmCEdtijX_0 2024-09-12T19:23:01.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.902780882145537100', time=2024-09-12T20:36:30.224308+0000, chain.objs.size()=1 2024-09-12T19:23:01.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.CXURNa9YFEuPficjGBcWPovQHb1jjZC_0 2024-09-12T19:23:01.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1834212379591449452', time=2024-09-12T20:36:30.414576+0000, chain.objs.size()=1 2024-09-12T19:23:01.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Vhj84_pPQzmIGvjLwc47D957rsfDS8F_0 2024-09-12T19:23:01.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7657733968881261370', time=2024-09-12T20:36:32.720742+0000, chain.objs.size()=1 2024-09-12T19:23:01.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.0yTgDel92fQsc6QPGaZR7OVTSEgBdlZ_0 2024-09-12T19:23:01.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.149689979327716275', time=2024-09-12T20:36:33.423471+0000, chain.objs.size()=1 2024-09-12T19:23:01.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.IUDdAkzo_vfqSaAXJQ1MujX-0f4-fww_0 2024-09-12T19:23:01.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15703807458438772729', time=2024-09-12T20:36:33.424889+0000, chain.objs.size()=1 2024-09-12T19:23:01.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.6-8a4jWo07gNsW49VBFPwzQFUOR9lku_0 2024-09-12T19:23:01.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17926769965088103481', time=2024-09-12T20:36:33.726569+0000, chain.objs.size()=1 2024-09-12T19:23:01.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.60_6QZBVXe64ff7Q9INLrFkRfhTURgw_0 2024-09-12T19:23:01.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6500959890874614251', time=2024-09-12T20:36:34.057102+0000, chain.objs.size()=1 2024-09-12T19:23:01.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Mhdke57kYivRGYDgro2tJ6WraQ6VYZS_0 2024-09-12T19:23:01.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1696327528084680685', time=2024-09-12T20:36:34.180209+0000, chain.objs.size()=1 2024-09-12T19:23:01.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.rCjGXDmum9nIPmeVFoItjCb2_Vv5YSW_0 2024-09-12T19:23:01.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10276673083348318889', time=2024-09-12T20:36:36.432629+0000, chain.objs.size()=1 2024-09-12T19:23:01.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.950+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.wGvn6L08w_C3GDZmb48Ab_uWH-eMnUY_0 2024-09-12T19:23:01.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.14024353586597012207', time=2024-09-12T20:36:36.437033+0000, chain.objs.size()=1 2024-09-12T19:23:01.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.O4PwsZRA2EVNjqN9zIKQGZ0Z9JtMaV7_0 2024-09-12T19:23:01.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.212579527950169396', time=2024-09-12T20:36:36.438905+0000, chain.objs.size()=1 2024-09-12T19:23:01.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.6voR56mTNflvfJHlOnVKORJvvF_QnBr_0 2024-09-12T19:23:01.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12779879300965249951', time=2024-09-12T20:36:38.273903+0000, chain.objs.size()=1 2024-09-12T19:23:01.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.4HqTAZY-v9d6shQ5SDScVYzj3YUhC0d_0 2024-09-12T19:23:01.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6853620349392434175', time=2024-09-12T20:36:42.086238+0000, chain.objs.size()=1 2024-09-12T19:23:01.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.4ob71Hjttz-ZmbPWBjh1UewwrS2Ckw8_0 2024-09-12T19:23:01.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.10471755155566448429', time=2024-09-12T20:36:42.212381+0000, chain.objs.size()=1 2024-09-12T19:23:01.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.NnrLsKV2sLCD6hT4CoztVA1qNX2VHuC_0 2024-09-12T19:23:01.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.93242453172048673', time=2024-09-12T20:36:43.194392+0000, chain.objs.size()=1 2024-09-12T19:23:01.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.DaYoP7q2pi6oxbE5pVIJ9_EsZf2QMwM_0 2024-09-12T19:23:01.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2622366080657670225', time=2024-09-12T20:36:44.872297+0000, chain.objs.size()=1 2024-09-12T19:23:01.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.EcQukY_uAcd8_8OCsOtIBP-EQa5PqBM_0 2024-09-12T19:23:01.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12674504232595672629', time=2024-09-12T20:36:45.214690+0000, chain.objs.size()=1 2024-09-12T19:23:01.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.-HIN5jozfk_3ov-8SytaxXhS4W98W2i_0 2024-09-12T19:23:01.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.18319261061557867854', time=2024-09-12T20:36:46.111322+0000, chain.objs.size()=1 2024-09-12T19:23:01.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.QPobSwfVwLSxjCBkYLQYSW29HMp4Nnr_0 2024-09-12T19:23:01.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13691662698285341613', time=2024-09-12T20:36:46.981590+0000, chain.objs.size()=1 2024-09-12T19:23:01.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.PjqYoLS7mPug99uROeOX9U67p0r4vCK_0 2024-09-12T19:23:01.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2588078278815300694', time=2024-09-12T20:36:46.984744+0000, chain.objs.size()=1 2024-09-12T19:23:01.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.954+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.3h1wI3aMeA53CDKxO1yE9pfLwVFcaSN_0 2024-09-12T19:23:01.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.958+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11187777106015067671', time=2024-09-12T20:36:46.986432+0000, chain.objs.size()=1 2024-09-12T19:23:01.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.958+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.THlKv5mrSMONRgovnb-4pAV4zw-zZCA_0 2024-09-12T19:23:01.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.958+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4218311854738863565', time=2024-09-12T20:36:47.241880+0000, chain.objs.size()=1 2024-09-12T19:23:01.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.958+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.1xQLbsEcxwXccaH5xRFZfjK-qYnzWQa_0 2024-09-12T19:23:01.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.958+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5542308346292645280', time=2024-09-12T20:36:51.954962+0000, chain.objs.size()=1 2024-09-12T19:23:01.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.958+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.ROtos6xy6zZ7s8BSQJrdEp65bynVOQ7_0 2024-09-12T19:23:01.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.958+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17742496458073136404', time=2024-09-12T20:36:52.212556+0000, chain.objs.size()=1 2024-09-12T19:23:01.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.958+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.55YYVFTBYNURTC7L7_-CX5N464g8uiQ_0 2024-09-12T19:23:01.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2918850145689532868', time=2024-09-12T20:36:52.754811+0000, chain.objs.size()=1 2024-09-12T19:23:01.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.962+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.1axLP-bYm-4JFqZ31HBo07V2zdlWhrh_0 2024-09-12T19:23:01.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4250767261017084597', time=2024-09-12T20:36:54.850885+0000, chain.objs.size()=1 2024-09-12T19:23:01.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.962+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.Alhyci8l5UKlpaklSGNtulmnBr9oJu__0 2024-09-12T19:23:01.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8648665456069421749', time=2024-09-12T20:36:55.323040+0000, chain.objs.size()=1 2024-09-12T19:23:01.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.962+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.sjcMs_hzE0WaX0TE6gID1xk0T1dmhun_0 2024-09-12T19:23:01.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2277658005297819733', time=2024-09-12T20:36:55.762113+0000, chain.objs.size()=1 2024-09-12T19:23:01.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.962+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.323__shadow_.E_kN05En9NBYsAYnHYWjRgYeSPW0xiE_0 2024-09-12T19:23:01.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16747290173662968953', time=2024-09-12T20:38:42.093645+0000, chain.objs.size()=1 2024-09-12T19:23:01.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.962+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.iv3DVumneDTv9Gr_lOHjo0l3z6hMI_T_0 2024-09-12T19:23:01.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5810496573836470536', time=2024-09-12T20:38:42.516557+0000, chain.objs.size()=1 2024-09-12T19:23:01.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.962+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.sH6KbfuIGeJ95hYpAbdLw5Frl08Tphc_0 2024-09-12T19:23:01.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.13551866446820242124', time=2024-09-12T20:38:43.682151+0000, chain.objs.size()=1 2024-09-12T19:23:01.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.962+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.6wVxUeKcRHMpVZgvmuE91g7_x1jynZf_0 2024-09-12T19:23:01.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.962+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16147715949950314883', time=2024-09-12T20:38:44.523596+0000, chain.objs.size()=1 2024-09-12T19:23:01.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.962+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.M1N_plo7Pm6mqsub-2-wYhYnYDCddgP_0 2024-09-12T19:23:01.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.674241609720297975', time=2024-09-12T20:38:47.563676+0000, chain.objs.size()=1 2024-09-12T19:23:01.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.xJSUP9V5xAfpqt5fBYBajKalTL1vDNS_0 2024-09-12T19:23:01.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17857203953521894478', time=2024-09-12T20:38:49.272838+0000, chain.objs.size()=1 2024-09-12T19:23:01.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ZQX52tlpYE9QOymsyz_gs_ZnLQxqD-w_0 2024-09-12T19:23:01.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17158566392906464642', time=2024-09-12T20:38:49.719574+0000, chain.objs.size()=1 2024-09-12T19:23:01.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.lMc5cUegkGGX5Ij-NsXuhLNHqBGIgge_0 2024-09-12T19:23:01.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.9945086106907094711', time=2024-09-12T20:38:51.257791+0000, chain.objs.size()=1 2024-09-12T19:23:01.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.2nqL0fa4M1I2koH3hOJuzH6EheIEC7u_0 2024-09-12T19:23:01.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5571809013139916911', time=2024-09-12T20:38:51.324701+0000, chain.objs.size()=1 2024-09-12T19:23:01.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.8oJSY16Vv2uzrJByU510JBRgRc_S0q4_0 2024-09-12T19:23:01.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4116286494083585016', time=2024-09-12T20:38:53.794397+0000, chain.objs.size()=1 2024-09-12T19:23:01.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.8oIiwnoEURAQLGI4QG0pZH5kSca0Hou_0 2024-09-12T19:23:01.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4332661802099682598', time=2024-09-12T20:38:59.700039+0000, chain.objs.size()=1 2024-09-12T19:23:01.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.EOqLpTwxNJ-UWKOXPJo4EsWKcDlivxa_0 2024-09-12T19:23:01.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11303565951694496136', time=2024-09-12T20:39:00.100862+0000, chain.objs.size()=1 2024-09-12T19:23:01.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.i4VbeisO95THnzUL4bsAMCBkQFtTKPu_0 2024-09-12T19:23:01.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15386595873653309446', time=2024-09-12T20:39:00.448433+0000, chain.objs.size()=1 2024-09-12T19:23:01.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.PHsKpHhOX_2H_Q1syac37HGYt85DPkP_0 2024-09-12T19:23:01.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1329560100435221695', time=2024-09-12T20:39:02.625382+0000, chain.objs.size()=1 2024-09-12T19:23:01.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.MPkhgcMuG2Nrs8L6eBJVSrLKafYgp6k_0 2024-09-12T19:23:01.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.551018622134736203', time=2024-09-12T20:39:02.666111+0000, chain.objs.size()=1 2024-09-12T19:23:01.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.966+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.gufi-v7HkAvquucusUSb2YnH5uScVZg_0 2024-09-12T19:23:01.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5826779156349674273', time=2024-09-12T20:39:03.982255+0000, chain.objs.size()=1 2024-09-12T19:23:01.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.P1ZqhWi6zBO297dOdUwO884k38hjy-i_0 2024-09-12T19:23:01.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.7157420658555560425', time=2024-09-12T20:39:04.534262+0000, chain.objs.size()=1 2024-09-12T19:23:01.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.qj7jfYHjW3JUcg54d5QxZGlEF_b9z4y_0 2024-09-12T19:23:01.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4035439602507048477', time=2024-09-12T20:39:04.536715+0000, chain.objs.size()=1 2024-09-12T19:23:01.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.B30Gl923xg39__dpp_rUwGAJ3DyYyFY_0 2024-09-12T19:23:01.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15558304168684477842', time=2024-09-12T20:39:04.926709+0000, chain.objs.size()=1 2024-09-12T19:23:01.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.tAojdo2Ho7qeaSULIRw4xtRnAEBIvA0_0 2024-09-12T19:23:01.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.17288510657475235500', time=2024-09-12T20:39:07.934679+0000, chain.objs.size()=1 2024-09-12T19:23:01.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.324__shadow_.ky4XrZ01o_X1AvjKWOm8MplIRJGQybu_0 2024-09-12T19:23:01.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5028513135497226297', time=2024-09-12T20:39:25.382438+0000, chain.objs.size()=1 2024-09-12T19:23:01.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.333__shadow_.xaMe5F6HkpqrSRBDxGYuZVCYGWF1T_M_0 2024-09-12T19:23:01.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.541647260872325755', time=2024-09-12T20:39:32.009583+0000, chain.objs.size()=1 2024-09-12T19:23:01.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.336__shadow_.1JJPLAGlco5-v1ZXL4kGCbkxZrbsvtu_0 2024-09-12T19:23:01.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6160276998021599570', time=2024-09-12T20:43:52.663665+0000, chain.objs.size()=1 2024-09-12T19:23:01.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.461__shadow_.7WWYQaQQ_Qxn6G7tF48yvCu2ZhTT45I_0 2024-09-12T19:23:01.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.2754195041016621944', time=2024-09-12T20:43:55.668073+0000, chain.objs.size()=1 2024-09-12T19:23:01.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.462__shadow_.FUrx2KCleFqlT9oaix7Fq--9gTy_Lm2_0 2024-09-12T19:23:01.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16589313877004308587', time=2024-09-12T20:44:00.576447+0000, chain.objs.size()=1 2024-09-12T19:23:01.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.464__shadow_.dn9ib4uKX6PQV5YFQ3sdVfgeqAc8cb7_0 2024-09-12T19:23:01.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.12343686613224272484', time=2024-09-12T20:44:33.737293+0000, chain.objs.size()=1 2024-09-12T19:23:01.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.970+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.483__shadow_.3fJjRq-0JKM_Gcl5mDWG7OwQNHeOKoy_0 2024-09-12T19:23:01.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1388032225593081749', time=2024-09-12T20:44:36.440111+0000, chain.objs.size()=1 2024-09-12T19:23:01.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.484__shadow_.5WHboffYOk0CLRB572pD06CwlQoAPo0_0 2024-09-12T19:23:01.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.799511051420162380', time=2024-09-12T20:55:46.183683+0000, chain.objs.size()=1 2024-09-12T19:23:01.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.556__shadow_.gt_dYcddrlEPAFixiwPavKhk1qf43p__0 2024-09-12T19:23:01.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.16311971709733953221', time=2024-09-12T20:56:54.648127+0000, chain.objs.size()=1 2024-09-12T19:23:01.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:l-HtcYzjEXdnEYWLiiQI8aUFx5znl84_._bvfJGCcnmSMpNHv1aQ-Y1fejQG2P7d_0 2024-09-12T19:23:01.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.6164554455996667909', time=2024-09-12T20:57:04.138230+0000, chain.objs.size()=1 2024-09-12T19:23:01.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.569__shadow:LUxY2d64kFFSTmeaM8Msf3QQ8Ic43m1_.jipIhnLirApE9-cJdFgLITWYdj00vLy_0 2024-09-12T19:23:01.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.8669427511925307535', time=2024-09-12T20:57:23.372135+0000, chain.objs.size()=1 2024-09-12T19:23:01.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.574__shadow:4kTuK6tU8R4fWa9OSRNcaroJRDNcu0m_.5Q6gpYlSlXiqdBJ-frS68wnUnPsUuOS_0 2024-09-12T19:23:01.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.978+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4055786359692813146', time=2024-09-12T20:58:17.609878+0000, chain.objs.size()=1 2024-09-12T19:23:01.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.978+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.577__shadow:cHaq8bhiF73VNLZ4S3Qwg8SUNn63vxw_.gYVUn7cluxvsaNN3YALI-euCfWac8Mv_0 2024-09-12T19:23:01.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.982+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.15343850435483840490', time=2024-09-12T20:59:29.731371+0000, chain.objs.size()=1 2024-09-12T19:23:01.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.982+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.579__shadow:5bVVmHJYRZMvbrTbV2s96Lx-PggrqCl_.Ua4yklgPifEf3vKtDk1yKv8CX43W7P3_0 2024-09-12T19:23:01.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.982+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5369464955536969262', time=2024-09-12T20:59:37.817150+0000, chain.objs.size()=1 2024-09-12T19:23:01.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.982+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.582__shadow:G9gb5Xp-gUN4V1XnCyWqmmIAVzKoq12_.p-7PNKgcr3deWFPXGYJQn4dimmuBUxB_0 2024-09-12T19:23:01.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.982+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11885875538789238698', time=2024-09-12T21:00:12.484912+0000, chain.objs.size()=1 2024-09-12T19:23:01.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.982+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.596__shadow_.atIsgOMELTx3eLqZEI3LRIjFg1puc8c_0 2024-09-12T19:23:01.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.982+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.714737858995165221', time=2024-09-12T21:00:25.244635+0000, chain.objs.size()=1 2024-09-12T19:23:01.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.982+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.603__shadow_.AyMZci3fq6O5KHdGATvoaEPOt3et_QX_0 2024-09-12T19:23:01.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47722 2024-09-12T19:23:01.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T19:23:01.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.4253286081478563175', time=2024-09-12T21:03:17.823638+0000, chain.objs.size()=1 2024-09-12T19:23:01.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.616__shadow_.9SycSRl4NSDw7MMXRntCuRkUfLQ_2Y4_0 2024-09-12T19:23:01.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.3842805167552881924', time=2024-09-12T21:05:26.113513+0000, chain.objs.size()=1 2024-09-12T19:23:01.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.619__shadow_.jAGUT7lPOXm9q9dWnIye_rRJf8U52KO_0 2024-09-12T19:23:01.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~roAbm7YhBwc6eiFNcAD-CEuZcFJHLT0', time=2024-09-12T21:06:38.452753+0000, chain.objs.size()=6 2024-09-12T19:23:01.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.624__multipart_multipart_enc.2~roAbm7YhBwc6eiFNcAD-CEuZcFJHLT0.1 2024-09-12T19:23:01.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.624__multipart_multipart_enc.2~roAbm7YhBwc6eiFNcAD-CEuZcFJHLT0.2 2024-09-12T19:23:01.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.624__multipart_multipart_enc.2~roAbm7YhBwc6eiFNcAD-CEuZcFJHLT0.3 2024-09-12T19:23:01.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.624__multipart_multipart_enc.2~roAbm7YhBwc6eiFNcAD-CEuZcFJHLT0.4 2024-09-12T19:23:01.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.624__multipart_multipart_enc.2~roAbm7YhBwc6eiFNcAD-CEuZcFJHLT0.5 2024-09-12T19:23:01.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.624__multipart_multipart_enc.2~roAbm7YhBwc6eiFNcAD-CEuZcFJHLT0.6 2024-09-12T19:23:01.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.1170257017866601215', time=2024-09-12T21:09:36.205279+0000, chain.objs.size()=1 2024-09-12T19:23:01.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.663__shadow_.wpDgjdDt-mfoHbG_j6l_fYeT-IQPfER_0 2024-09-12T19:23:01.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.11064810521393609093', time=2024-09-12T21:11:18.292756+0000, chain.objs.size()=1 2024-09-12T19:23:01.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.714__shadow:e1G4qlhx6-0VlLErpIIK7D964U34iK4_.ctTzyVejQF4iWuukcx4z_l_wdHj5-r8_0 2024-09-12T19:23:01.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.986+0000 7f775ecbe9c0 20 garbage collection: RGWGC::process iterating over entry tag='a01e4849-e968-46ce-97f1-a673c26b3735.4529.5706283060544499055', time=2024-09-12T21:11:43.222279+0000, chain.objs.size()=1 2024-09-12T19:23:01.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.986+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a01e4849-e968-46ce-97f1-a673c26b3735.4529.717__shadow:nmz1RzHCSo9xyiBlXLImvT6zpnAlzSy_.cj6jI-x3O1lESpulqr_2HVGT36ssbkr_0 2024-09-12T19:23:02.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.994+0000 7f775ecbe9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:23:02.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:01.998+0000 7f7612fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:23:02.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:02.002+0000 7f775ecbe9c0 20 remove_watcher() i=0 2024-09-12T19:23:02.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:02.002+0000 7f775ecbe9c0 2 removed watcher, disabling cache 2024-09-12T19:23:02.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:02.002+0000 7f775ecbe9c0 20 remove_watcher() i=1 2024-09-12T19:23:02.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:02.002+0000 7f775ecbe9c0 20 remove_watcher() i=2 2024-09-12T19:23:02.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:02.006+0000 7f775ecbe9c0 20 remove_watcher() i=3 2024-09-12T19:23:02.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:02.006+0000 7f775ecbe9c0 20 remove_watcher() i=4 2024-09-12T19:23:02.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:02.006+0000 7f775ecbe9c0 20 remove_watcher() i=5 2024-09-12T19:23:02.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:02.006+0000 7f775ecbe9c0 20 remove_watcher() i=6 2024-09-12T19:23:02.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-12T19:23:02.010+0000 7f775ecbe9c0 20 remove_watcher() i=7 2024-09-12T19:23:02.025 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T19:23:02.037 DEBUG:teuthology.orchestra.run.smithi098:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-12T19:23:02.074 DEBUG:teuthology.orchestra.run.smithi098:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T19:23:02.121 DEBUG:teuthology.orchestra.run.smithi098:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-12T19:23:02.170 DEBUG:teuthology.orchestra.run.smithi098:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T19:23:02.218 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm /usr/local/share/ca-certificates/root.crt 2024-09-12T19:23:02.274 DEBUG:teuthology.orchestra.run.smithi098:> sudo update-ca-certificates 2024-09-12T19:23:02.331 INFO:teuthology.orchestra.run.smithi098.stdout:Updating certificates in /etc/ssl/certs... 2024-09-12T19:23:02.713 INFO:teuthology.orchestra.run.smithi098.stdout:0 added, 0 removed; done. 2024-09-12T19:23:02.713 INFO:teuthology.orchestra.run.smithi098.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-12T19:23:02.715 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:23:02.937 INFO:teuthology.orchestra.run.smithi098.stdout:done. 2024-09-12T19:23:02.938 INFO:teuthology.orchestra.run.smithi098.stdout:done. 2024-09-12T19:23:02.940 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T19:23:02.952 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T19:23:02.952 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:23:03.327 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:23:03.344 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-12T19:23:03.357 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":3666,"stamp":"2024-09-12T19:23:03.254098+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":272880683,"num_objects":2321,"num_object_clones":0,"num_object_copies":8318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2321,"num_whiteouts":0,"num_read":293484,"num_read_kb":2506219,"num_write":161870,"num_write_kb":2385149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13307,"ondisk_log_size":13307,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2258640,"kb_used_data":512044,"kb_used_omap":12,"kb_used_meta":1745715,"kb_avail":752716080,"statfs":{"total":773094113280,"available":770781265920,"internally_reserved":0,"allocated":524333056,"data_stored":508284442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1787612720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,1,4,4],"upper_bound":16},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-424265911,"num_objects":-2569,"num_object_clones":0,"num_object_copies":-10234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2569,"num_whiteouts":0,"num_read":2967,"num_read_kb":3389,"num_write":2772,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007042"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.976722+0000","last_change":"2024-09-12T18:19:22.664402+0000","last_active":"2024-09-12T19:19:22.976722+0000","last_peered":"2024-09-12T19:19:22.976722+0000","last_clean":"2024-09-12T19:19:22.976722+0000","last_became_active":"2024-09-12T18:19:22.658759+0000","last_became_peered":"2024-09-12T18:19:22.658759+0000","last_unstale":"2024-09-12T19:19:22.976722+0000","last_undegraded":"2024-09-12T19:19:22.976722+0000","last_fullsized":"2024-09-12T19:19:22.976722+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:29.891894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:32.979320+0000","last_change":"2024-09-12T17:51:59.970111+0000","last_active":"2024-09-12T19:19:32.979320+0000","last_peered":"2024-09-12T19:19:32.979320+0000","last_clean":"2024-09-12T19:19:32.979320+0000","last_became_active":"2024-09-12T17:51:59.969612+0000","last_became_peered":"2024-09-12T17:51:59.969612+0000","last_unstale":"2024-09-12T19:19:32.979320+0000","last_undegraded":"2024-09-12T19:19:32.979320+0000","last_fullsized":"2024-09-12T19:19:32.979320+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:23.773617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'5","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:23.246751+0000","last_change":"2024-09-12T17:51:52.890790+0000","last_active":"2024-09-12T19:19:23.246751+0000","last_peered":"2024-09-12T19:19:23.246751+0000","last_clean":"2024-09-12T19:19:23.246751+0000","last_became_active":"2024-09-12T17:51:52.890029+0000","last_became_peered":"2024-09-12T17:51:52.890029+0000","last_unstale":"2024-09-12T19:19:23.246751+0000","last_undegraded":"2024-09-12T19:19:23.246751+0000","last_fullsized":"2024-09-12T19:19:23.246751+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:58.035727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'75","reported_seq":374,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:28.176973+0000","last_change":"2024-09-12T17:45:41.586304+0000","last_active":"2024-09-12T19:19:28.176973+0000","last_peered":"2024-09-12T19:19:28.176973+0000","last_clean":"2024-09-12T19:19:28.176973+0000","last_became_active":"2024-09-12T17:45:41.585012+0000","last_became_peered":"2024-09-12T17:45:41.585012+0000","last_unstale":"2024-09-12T19:19:28.176973+0000","last_undegraded":"2024-09-12T19:19:28.176973+0000","last_fullsized":"2024-09-12T19:19:28.176973+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:25.815410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":580,"num_read_kb":395,"num_write":86,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:23.524914+0000","last_change":"2024-09-12T18:19:22.641896+0000","last_active":"2024-09-12T19:19:23.524914+0000","last_peered":"2024-09-12T19:19:23.524914+0000","last_clean":"2024-09-12T19:19:23.524914+0000","last_became_active":"2024-09-12T18:19:22.641172+0000","last_became_peered":"2024-09-12T18:19:22.641172+0000","last_unstale":"2024-09-12T19:19:23.524914+0000","last_undegraded":"2024-09-12T19:19:23.524914+0000","last_fullsized":"2024-09-12T19:19:23.524914+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:53.586176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.189386+0000","last_change":"2024-09-12T17:51:59.957708+0000","last_active":"2024-09-12T19:19:33.189386+0000","last_peered":"2024-09-12T19:19:33.189386+0000","last_clean":"2024-09-12T19:19:33.189386+0000","last_became_active":"2024-09-12T17:51:59.957109+0000","last_became_peered":"2024-09-12T17:51:59.957109+0000","last_unstale":"2024-09-12T19:19:33.189386+0000","last_undegraded":"2024-09-12T19:19:33.189386+0000","last_fullsized":"2024-09-12T19:19:33.189386+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:06.641011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.970297+0000","last_change":"2024-09-12T17:51:52.905930+0000","last_active":"2024-09-12T19:19:22.970297+0000","last_peered":"2024-09-12T19:19:22.970297+0000","last_clean":"2024-09-12T19:19:22.970297+0000","last_became_active":"2024-09-12T17:51:52.905220+0000","last_became_peered":"2024-09-12T17:51:52.905220+0000","last_unstale":"2024-09-12T19:19:22.970297+0000","last_undegraded":"2024-09-12T19:19:22.970297+0000","last_fullsized":"2024-09-12T19:19:22.970297+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:22.520893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'122","reported_seq":487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:53.531273+0000","last_change":"2024-09-12T17:45:41.573549+0000","last_active":"2024-09-12T19:19:53.531273+0000","last_peered":"2024-09-12T19:19:53.531273+0000","last_clean":"2024-09-12T19:19:53.531273+0000","last_became_active":"2024-09-12T17:45:41.572859+0000","last_became_peered":"2024-09-12T17:45:41.572859+0000","last_unstale":"2024-09-12T19:19:53.531273+0000","last_undegraded":"2024-09-12T19:19:53.531273+0000","last_fullsized":"2024-09-12T19:19:53.531273+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:00.082452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":788,"num_read_kb":542,"num_write":175,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.553951+0000","last_change":"2024-09-12T18:19:22.653551+0000","last_active":"2024-09-12T19:19:48.553951+0000","last_peered":"2024-09-12T19:19:48.553951+0000","last_clean":"2024-09-12T19:19:48.553951+0000","last_became_active":"2024-09-12T18:19:22.652800+0000","last_became_peered":"2024-09-12T18:19:22.652800+0000","last_unstale":"2024-09-12T19:19:48.553951+0000","last_undegraded":"2024-09-12T19:19:48.553951+0000","last_fullsized":"2024-09-12T19:19:48.553951+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:00.720225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.178212+0000","last_change":"2024-09-12T17:51:59.955159+0000","last_active":"2024-09-12T19:19:33.178212+0000","last_peered":"2024-09-12T19:19:33.178212+0000","last_clean":"2024-09-12T19:19:33.178212+0000","last_became_active":"2024-09-12T17:51:59.954517+0000","last_became_peered":"2024-09-12T17:51:59.954517+0000","last_unstale":"2024-09-12T19:19:33.178212+0000","last_undegraded":"2024-09-12T19:19:33.178212+0000","last_fullsized":"2024-09-12T19:19:33.178212+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:02.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"267'1","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.533724+0000","last_change":"2024-09-12T17:51:52.886345+0000","last_active":"2024-09-12T19:20:03.533724+0000","last_peered":"2024-09-12T19:20:03.533724+0000","last_clean":"2024-09-12T19:20:03.533724+0000","last_became_active":"2024-09-12T17:51:52.885677+0000","last_became_peered":"2024-09-12T17:51:52.885677+0000","last_unstale":"2024-09-12T19:20:03.533724+0000","last_undegraded":"2024-09-12T19:20:03.533724+0000","last_fullsized":"2024-09-12T19:20:03.533724+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:04.278645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'26","reported_seq":140,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:13.156514+0000","last_change":"2024-09-12T17:45:41.576549+0000","last_active":"2024-09-12T19:18:13.156514+0000","last_peered":"2024-09-12T19:18:13.156514+0000","last_clean":"2024-09-12T19:18:13.156514+0000","last_became_active":"2024-09-12T17:45:41.575793+0000","last_became_peered":"2024-09-12T17:45:41.575793+0000","last_unstale":"2024-09-12T19:18:13.156514+0000","last_undegraded":"2024-09-12T19:18:13.156514+0000","last_fullsized":"2024-09-12T19:18:13.156514+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:35.718641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":83,"num_write":51,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.254703+0000","last_change":"2024-09-12T18:19:22.656103+0000","last_active":"2024-09-12T19:19:58.254703+0000","last_peered":"2024-09-12T19:19:58.254703+0000","last_clean":"2024-09-12T19:19:58.254703+0000","last_became_active":"2024-09-12T18:19:22.655357+0000","last_became_peered":"2024-09-12T18:19:22.655357+0000","last_unstale":"2024-09-12T19:19:58.254703+0000","last_undegraded":"2024-09-12T19:19:58.254703+0000","last_fullsized":"2024-09-12T19:19:58.254703+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:44.884891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"267'1","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262497+0000","last_change":"2024-09-12T17:51:59.941561+0000","last_active":"2024-09-12T19:20:23.262497+0000","last_peered":"2024-09-12T19:20:23.262497+0000","last_clean":"2024-09-12T19:20:23.262497+0000","last_became_active":"2024-09-12T17:51:59.935185+0000","last_became_peered":"2024-09-12T17:51:59.935185+0000","last_unstale":"2024-09-12T19:20:23.262497+0000","last_undegraded":"2024-09-12T19:20:23.262497+0000","last_fullsized":"2024-09-12T19:20:23.262497+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:03.775657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"267'10","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.345477+0000","last_change":"2024-09-12T17:51:52.865694+0000","last_active":"2024-09-12T19:23:01.345477+0000","last_peered":"2024-09-12T19:23:01.345477+0000","last_clean":"2024-09-12T19:23:01.345477+0000","last_became_active":"2024-09-12T17:51:52.864951+0000","last_became_peered":"2024-09-12T17:51:52.864951+0000","last_unstale":"2024-09-12T19:23:01.345477+0000","last_undegraded":"2024-09-12T19:23:01.345477+0000","last_fullsized":"2024-09-12T19:23:01.345477+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:53.129719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32810,"num_write":10,"num_write_kb":11304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'28","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:13.228547+0000","last_change":"2024-09-12T17:45:41.577459+0000","last_active":"2024-09-12T19:18:13.228547+0000","last_peered":"2024-09-12T19:18:13.228547+0000","last_clean":"2024-09-12T19:18:13.228547+0000","last_became_active":"2024-09-12T17:45:41.576714+0000","last_became_peered":"2024-09-12T17:45:41.576714+0000","last_unstale":"2024-09-12T19:18:13.228547+0000","last_undegraded":"2024-09-12T19:18:13.228547+0000","last_fullsized":"2024-09-12T19:18:13.228547+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:46.641068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":94,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.249030+0000","last_change":"2024-09-12T18:19:22.665947+0000","last_active":"2024-09-12T19:19:33.249030+0000","last_peered":"2024-09-12T19:19:33.249030+0000","last_clean":"2024-09-12T19:19:33.249030+0000","last_became_active":"2024-09-12T18:19:22.665152+0000","last_became_peered":"2024-09-12T18:19:22.665152+0000","last_unstale":"2024-09-12T19:19:33.249030+0000","last_undegraded":"2024-09-12T19:19:33.249030+0000","last_fullsized":"2024-09-12T19:19:33.249030+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:24.528404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"267'3","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.011866+0000","last_change":"2024-09-12T17:51:59.951234+0000","last_active":"2024-09-12T19:21:53.011866+0000","last_peered":"2024-09-12T19:21:53.011866+0000","last_clean":"2024-09-12T19:21:53.011866+0000","last_became_active":"2024-09-12T17:51:59.950595+0000","last_became_peered":"2024-09-12T17:51:59.950595+0000","last_unstale":"2024-09-12T19:21:53.011866+0000","last_undegraded":"2024-09-12T19:21:53.011866+0000","last_fullsized":"2024-09-12T19:21:53.011866+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:58.571310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.166933+0000","last_change":"2024-09-12T17:51:52.908434+0000","last_active":"2024-09-12T19:18:53.166933+0000","last_peered":"2024-09-12T19:18:53.166933+0000","last_clean":"2024-09-12T19:18:53.166933+0000","last_became_active":"2024-09-12T17:51:52.907863+0000","last_became_peered":"2024-09-12T17:51:52.907863+0000","last_unstale":"2024-09-12T19:18:53.166933+0000","last_undegraded":"2024-09-12T19:18:53.166933+0000","last_fullsized":"2024-09-12T19:18:53.166933+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:14.608689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'42","reported_seq":186,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:13.228451+0000","last_change":"2024-09-12T17:45:41.596640+0000","last_active":"2024-09-12T19:18:13.228451+0000","last_peered":"2024-09-12T19:18:13.228451+0000","last_clean":"2024-09-12T19:18:13.228451+0000","last_became_active":"2024-09-12T17:45:41.596133+0000","last_became_peered":"2024-09-12T17:45:41.596133+0000","last_unstale":"2024-09-12T19:18:13.228451+0000","last_undegraded":"2024-09-12T19:18:13.228451+0000","last_fullsized":"2024-09-12T19:18:13.228451+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:41.921834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":80,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.975905+0000","last_change":"2024-09-12T18:19:22.652917+0000","last_active":"2024-09-12T19:19:47.975905+0000","last_peered":"2024-09-12T19:19:47.975905+0000","last_clean":"2024-09-12T19:19:47.975905+0000","last_became_active":"2024-09-12T18:19:22.652141+0000","last_became_peered":"2024-09-12T18:19:22.652141+0000","last_unstale":"2024-09-12T19:19:47.975905+0000","last_undegraded":"2024-09-12T19:19:47.975905+0000","last_fullsized":"2024-09-12T19:19:47.975905+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:16.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"267'1","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.544204+0000","last_change":"2024-09-12T17:51:59.937787+0000","last_active":"2024-09-12T19:19:03.544204+0000","last_peered":"2024-09-12T19:19:03.544204+0000","last_clean":"2024-09-12T19:19:03.544204+0000","last_became_active":"2024-09-12T17:51:59.936941+0000","last_became_peered":"2024-09-12T17:51:59.936941+0000","last_unstale":"2024-09-12T19:19:03.544204+0000","last_undegraded":"2024-09-12T19:19:03.544204+0000","last_fullsized":"2024-09-12T19:19:03.544204+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:37.516754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'2","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:38.218337+0000","last_change":"2024-09-12T17:51:52.882882+0000","last_active":"2024-09-12T19:21:38.218337+0000","last_peered":"2024-09-12T19:21:38.218337+0000","last_clean":"2024-09-12T19:21:38.218337+0000","last_became_active":"2024-09-12T17:51:52.882157+0000","last_became_peered":"2024-09-12T17:51:52.882157+0000","last_unstale":"2024-09-12T19:21:38.218337+0000","last_undegraded":"2024-09-12T19:21:38.218337+0000","last_fullsized":"2024-09-12T19:21:38.218337+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:28.059422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'16","reported_seq":113,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:13.533500+0000","last_change":"2024-09-12T17:45:41.587495+0000","last_active":"2024-09-12T19:18:13.533500+0000","last_peered":"2024-09-12T19:18:13.533500+0000","last_clean":"2024-09-12T19:18:13.533500+0000","last_became_active":"2024-09-12T17:45:41.586661+0000","last_became_peered":"2024-09-12T17:45:41.586661+0000","last_unstale":"2024-09-12T19:18:13.533500+0000","last_undegraded":"2024-09-12T19:18:13.533500+0000","last_fullsized":"2024-09-12T19:18:13.533500+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:51.564389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959085+0000","last_change":"2024-09-12T18:19:22.671131+0000","last_active":"2024-09-12T19:19:22.959085+0000","last_peered":"2024-09-12T19:19:22.959085+0000","last_clean":"2024-09-12T19:19:22.959085+0000","last_became_active":"2024-09-12T18:19:22.668945+0000","last_became_peered":"2024-09-12T18:19:22.668945+0000","last_unstale":"2024-09-12T19:19:22.959085+0000","last_undegraded":"2024-09-12T19:19:22.959085+0000","last_fullsized":"2024-09-12T19:19:22.959085+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:51.667065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.550741+0000","last_change":"2024-09-12T17:51:59.937170+0000","last_active":"2024-09-12T19:19:33.550741+0000","last_peered":"2024-09-12T19:19:33.550741+0000","last_clean":"2024-09-12T19:19:33.550741+0000","last_became_active":"2024-09-12T17:51:59.936441+0000","last_became_peered":"2024-09-12T17:51:59.936441+0000","last_unstale":"2024-09-12T19:19:33.550741+0000","last_undegraded":"2024-09-12T19:19:33.550741+0000","last_fullsized":"2024-09-12T19:19:33.550741+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:54.536101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:23.187174+0000","last_change":"2024-09-12T17:51:52.888730+0000","last_active":"2024-09-12T19:19:23.187174+0000","last_peered":"2024-09-12T19:19:23.187174+0000","last_clean":"2024-09-12T19:19:23.187174+0000","last_became_active":"2024-09-12T17:51:52.887962+0000","last_became_peered":"2024-09-12T17:51:52.887962+0000","last_unstale":"2024-09-12T19:19:23.187174+0000","last_undegraded":"2024-09-12T19:19:23.187174+0000","last_fullsized":"2024-09-12T19:19:23.187174+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:25.669346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'25","reported_seq":141,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.188763+0000","last_change":"2024-09-12T17:45:41.566696+0000","last_active":"2024-09-12T19:20:13.188763+0000","last_peered":"2024-09-12T19:20:13.188763+0000","last_clean":"2024-09-12T19:20:13.188763+0000","last_became_active":"2024-09-12T17:45:41.565956+0000","last_became_peered":"2024-09-12T17:45:41.565956+0000","last_unstale":"2024-09-12T19:20:13.188763+0000","last_undegraded":"2024-09-12T19:20:13.188763+0000","last_fullsized":"2024-09-12T19:20:13.188763+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:11.837864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959148+0000","last_change":"2024-09-12T18:19:22.677901+0000","last_active":"2024-09-12T19:19:22.959148+0000","last_peered":"2024-09-12T19:19:22.959148+0000","last_clean":"2024-09-12T19:19:22.959148+0000","last_became_active":"2024-09-12T18:19:22.677111+0000","last_became_peered":"2024-09-12T18:19:22.677111+0000","last_unstale":"2024-09-12T19:19:22.959148+0000","last_undegraded":"2024-09-12T19:19:22.959148+0000","last_fullsized":"2024-09-12T19:19:22.959148+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:39.916282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'1","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.248864+0000","last_change":"2024-09-12T17:51:59.942614+0000","last_active":"2024-09-12T19:19:33.248864+0000","last_peered":"2024-09-12T19:19:33.248864+0000","last_clean":"2024-09-12T19:19:33.248864+0000","last_became_active":"2024-09-12T17:51:59.941825+0000","last_became_peered":"2024-09-12T17:51:59.941825+0000","last_unstale":"2024-09-12T19:19:33.248864+0000","last_undegraded":"2024-09-12T19:19:33.248864+0000","last_fullsized":"2024-09-12T19:19:33.248864+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:10.399861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4960,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":10,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.212609+0000","last_change":"2024-09-12T17:51:52.899944+0000","last_active":"2024-09-12T19:21:53.212609+0000","last_peered":"2024-09-12T19:21:53.212609+0000","last_clean":"2024-09-12T19:21:53.212609+0000","last_became_active":"2024-09-12T17:51:52.899511+0000","last_became_peered":"2024-09-12T17:51:52.899511+0000","last_unstale":"2024-09-12T19:21:53.212609+0000","last_undegraded":"2024-09-12T19:21:53.212609+0000","last_fullsized":"2024-09-12T19:21:53.212609+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:39.682445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'27","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.978150+0000","last_change":"2024-09-12T17:45:41.587067+0000","last_active":"2024-09-12T19:19:57.978150+0000","last_peered":"2024-09-12T19:19:57.978150+0000","last_clean":"2024-09-12T19:19:57.978150+0000","last_became_active":"2024-09-12T17:45:41.578021+0000","last_became_peered":"2024-09-12T17:45:41.578021+0000","last_unstale":"2024-09-12T19:19:57.978150+0000","last_undegraded":"2024-09-12T19:19:57.978150+0000","last_fullsized":"2024-09-12T19:19:57.978150+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:35.349527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":97,"num_write":50,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.979562+0000","last_change":"2024-09-12T18:19:22.669975+0000","last_active":"2024-09-12T19:20:02.979562+0000","last_peered":"2024-09-12T19:20:02.979562+0000","last_clean":"2024-09-12T19:20:02.979562+0000","last_became_active":"2024-09-12T18:19:22.668802+0000","last_became_peered":"2024-09-12T18:19:22.668802+0000","last_unstale":"2024-09-12T19:20:02.979562+0000","last_undegraded":"2024-09-12T19:20:02.979562+0000","last_fullsized":"2024-09-12T19:20:02.979562+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:20.736060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.241946+0000","last_change":"2024-09-12T17:51:59.940440+0000","last_active":"2024-09-12T19:19:03.241946+0000","last_peered":"2024-09-12T19:19:03.241946+0000","last_clean":"2024-09-12T19:19:03.241946+0000","last_became_active":"2024-09-12T17:51:59.939686+0000","last_became_peered":"2024-09-12T17:51:59.939686+0000","last_unstale":"2024-09-12T19:19:03.241946+0000","last_undegraded":"2024-09-12T19:19:03.241946+0000","last_fullsized":"2024-09-12T19:19:03.241946+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:25.031497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:37.964561+0000","last_change":"2024-09-12T17:51:52.894394+0000","last_active":"2024-09-12T19:18:37.964561+0000","last_peered":"2024-09-12T19:18:37.964561+0000","last_clean":"2024-09-12T19:18:37.964561+0000","last_became_active":"2024-09-12T17:51:52.892953+0000","last_became_peered":"2024-09-12T17:51:52.892953+0000","last_unstale":"2024-09-12T19:18:37.964561+0000","last_undegraded":"2024-09-12T19:18:37.964561+0000","last_fullsized":"2024-09-12T19:18:37.964561+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:34.018077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'51","reported_seq":214,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.184846+0000","last_change":"2024-09-12T17:45:41.574719+0000","last_active":"2024-09-12T19:19:58.184846+0000","last_peered":"2024-09-12T19:19:58.184846+0000","last_clean":"2024-09-12T19:19:58.184846+0000","last_became_active":"2024-09-12T17:45:41.572941+0000","last_became_peered":"2024-09-12T17:45:41.572941+0000","last_unstale":"2024-09-12T19:19:58.184846+0000","last_undegraded":"2024-09-12T19:19:58.184846+0000","last_fullsized":"2024-09-12T19:19:58.184846+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:25.447410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":190,"num_write":83,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.533559+0000","last_change":"2024-09-12T18:19:22.652584+0000","last_active":"2024-09-12T19:20:03.533559+0000","last_peered":"2024-09-12T19:20:03.533559+0000","last_clean":"2024-09-12T19:20:03.533559+0000","last_became_active":"2024-09-12T18:19:22.651901+0000","last_became_peered":"2024-09-12T18:19:22.651901+0000","last_unstale":"2024-09-12T19:20:03.533559+0000","last_undegraded":"2024-09-12T19:20:03.533559+0000","last_fullsized":"2024-09-12T19:20:03.533559+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:40.051168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.236632+0000","last_change":"2024-09-12T17:51:59.948536+0000","last_active":"2024-09-12T19:18:43.236632+0000","last_peered":"2024-09-12T19:18:43.236632+0000","last_clean":"2024-09-12T19:18:43.236632+0000","last_became_active":"2024-09-12T17:51:59.947392+0000","last_became_peered":"2024-09-12T17:51:59.947392+0000","last_unstale":"2024-09-12T19:18:43.236632+0000","last_undegraded":"2024-09-12T19:18:43.236632+0000","last_fullsized":"2024-09-12T19:18:43.236632+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:47.397467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'5","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:52.952062+0000","last_change":"2024-09-12T17:51:52.887100+0000","last_active":"2024-09-12T19:18:52.952062+0000","last_peered":"2024-09-12T19:18:52.952062+0000","last_clean":"2024-09-12T19:18:52.952062+0000","last_became_active":"2024-09-12T17:51:52.886123+0000","last_became_peered":"2024-09-12T17:51:52.886123+0000","last_unstale":"2024-09-12T19:18:52.952062+0000","last_undegraded":"2024-09-12T19:18:52.952062+0000","last_fullsized":"2024-09-12T19:18:52.952062+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:11.295668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'32","reported_seq":165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.255039+0000","last_change":"2024-09-12T17:45:41.592562+0000","last_active":"2024-09-12T19:19:58.255039+0000","last_peered":"2024-09-12T19:19:58.255039+0000","last_clean":"2024-09-12T19:19:58.255039+0000","last_became_active":"2024-09-12T17:45:41.591637+0000","last_became_peered":"2024-09-12T17:45:41.591637+0000","last_unstale":"2024-09-12T19:19:58.255039+0000","last_undegraded":"2024-09-12T19:19:58.255039+0000","last_fullsized":"2024-09-12T19:19:58.255039+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:52.032057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":117,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968591+0000","last_change":"2024-09-12T18:19:22.646555+0000","last_active":"2024-09-12T19:20:02.968591+0000","last_peered":"2024-09-12T19:20:02.968591+0000","last_clean":"2024-09-12T19:20:02.968591+0000","last_became_active":"2024-09-12T18:19:22.645829+0000","last_became_peered":"2024-09-12T18:19:22.645829+0000","last_unstale":"2024-09-12T19:20:02.968591+0000","last_undegraded":"2024-09-12T19:20:02.968591+0000","last_fullsized":"2024-09-12T19:20:02.968591+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:14.278527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"267'9","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.986200+0000","last_change":"2024-09-12T17:52:23.472557+0000","last_active":"2024-09-12T19:22:58.986200+0000","last_peered":"2024-09-12T19:22:58.986200+0000","last_clean":"2024-09-12T19:22:58.986200+0000","last_became_active":"2024-09-12T17:52:23.438623+0000","last_became_peered":"2024-09-12T17:52:23.438623+0000","last_unstale":"2024-09-12T19:22:58.986200+0000","last_undegraded":"2024-09-12T19:22:58.986200+0000","last_fullsized":"2024-09-12T19:22:58.986200+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:04.013275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":19,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.16","version":"267'1","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.518185+0000","last_change":"2024-09-12T17:51:52.884671+0000","last_active":"2024-09-12T19:18:53.518185+0000","last_peered":"2024-09-12T19:18:53.518185+0000","last_clean":"2024-09-12T19:18:53.518185+0000","last_became_active":"2024-09-12T17:51:52.876542+0000","last_became_peered":"2024-09-12T17:51:52.876542+0000","last_unstale":"2024-09-12T19:18:53.518185+0000","last_undegraded":"2024-09-12T19:18:53.518185+0000","last_fullsized":"2024-09-12T19:18:53.518185+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:01.214988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"0'0","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.532458+0000","last_change":"2024-09-12T17:45:41.575734+0000","last_active":"2024-09-12T19:19:58.532458+0000","last_peered":"2024-09-12T19:19:58.532458+0000","last_clean":"2024-09-12T19:19:58.532458+0000","last_became_active":"2024-09-12T17:45:41.574953+0000","last_became_peered":"2024-09-12T17:45:41.574953+0000","last_unstale":"2024-09-12T19:19:58.532458+0000","last_undegraded":"2024-09-12T19:19:58.532458+0000","last_fullsized":"2024-09-12T19:19:58.532458+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:53.875702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.986527+0000","last_change":"2024-09-12T18:19:22.658747+0000","last_active":"2024-09-12T19:20:02.986527+0000","last_peered":"2024-09-12T19:20:02.986527+0000","last_clean":"2024-09-12T19:20:02.986527+0000","last_became_active":"2024-09-12T18:19:22.657731+0000","last_became_peered":"2024-09-12T18:19:22.657731+0000","last_unstale":"2024-09-12T19:20:02.986527+0000","last_undegraded":"2024-09-12T19:20:02.986527+0000","last_fullsized":"2024-09-12T19:20:02.986527+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:22.834751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"267'5","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:28.216153+0000","last_change":"2024-09-12T17:51:59.948754+0000","last_active":"2024-09-12T19:21:28.216153+0000","last_peered":"2024-09-12T19:21:28.216153+0000","last_clean":"2024-09-12T19:21:28.216153+0000","last_became_active":"2024-09-12T17:51:59.937650+0000","last_became_peered":"2024-09-12T17:51:59.937650+0000","last_unstale":"2024-09-12T19:21:28.216153+0000","last_undegraded":"2024-09-12T19:21:28.216153+0000","last_fullsized":"2024-09-12T19:21:28.216153+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:52.287318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.167284+0000","last_change":"2024-09-12T17:51:52.888708+0000","last_active":"2024-09-12T19:18:53.167284+0000","last_peered":"2024-09-12T19:18:53.167284+0000","last_clean":"2024-09-12T19:18:53.167284+0000","last_became_active":"2024-09-12T17:51:52.887964+0000","last_became_peered":"2024-09-12T17:51:52.887964+0000","last_unstale":"2024-09-12T19:18:53.167284+0000","last_undegraded":"2024-09-12T19:18:53.167284+0000","last_fullsized":"2024-09-12T19:18:53.167284+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:57.571315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'27","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959037+0000","last_change":"2024-09-12T17:45:41.595246+0000","last_active":"2024-09-12T19:19:22.959037+0000","last_peered":"2024-09-12T19:19:22.959037+0000","last_clean":"2024-09-12T19:19:22.959037+0000","last_became_active":"2024-09-12T17:45:41.594619+0000","last_became_peered":"2024-09-12T17:45:41.594619+0000","last_unstale":"2024-09-12T19:19:22.959037+0000","last_undegraded":"2024-09-12T19:19:22.959037+0000","last_fullsized":"2024-09-12T19:19:22.959037+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:08.142112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252332+0000","last_change":"2024-09-12T18:19:22.646874+0000","last_active":"2024-09-12T19:19:48.252332+0000","last_peered":"2024-09-12T19:19:48.252332+0000","last_clean":"2024-09-12T19:19:48.252332+0000","last_became_active":"2024-09-12T18:19:22.646129+0000","last_became_peered":"2024-09-12T18:19:22.646129+0000","last_unstale":"2024-09-12T19:19:48.252332+0000","last_undegraded":"2024-09-12T19:19:48.252332+0000","last_fullsized":"2024-09-12T19:19:48.252332+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:17.061904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.988325+0000","last_change":"2024-09-12T17:51:59.962952+0000","last_active":"2024-09-12T19:20:42.988325+0000","last_peered":"2024-09-12T19:20:42.988325+0000","last_clean":"2024-09-12T19:20:42.988325+0000","last_became_active":"2024-09-12T17:51:59.961892+0000","last_became_peered":"2024-09-12T17:51:59.961892+0000","last_unstale":"2024-09-12T19:20:42.988325+0000","last_undegraded":"2024-09-12T19:20:42.988325+0000","last_fullsized":"2024-09-12T19:20:42.988325+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:48.287564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'5","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.203445+0000","last_change":"2024-09-12T17:51:52.865750+0000","last_active":"2024-09-12T19:20:33.203445+0000","last_peered":"2024-09-12T19:20:33.203445+0000","last_clean":"2024-09-12T19:20:33.203445+0000","last_became_active":"2024-09-12T17:51:52.865019+0000","last_became_peered":"2024-09-12T17:51:52.865019+0000","last_unstale":"2024-09-12T19:20:33.203445+0000","last_undegraded":"2024-09-12T19:20:33.203445+0000","last_fullsized":"2024-09-12T19:20:33.203445+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:48.706108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'30","reported_seq":153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:02.954345+0000","last_change":"2024-09-12T17:45:41.595661+0000","last_active":"2024-09-12T19:19:02.954345+0000","last_peered":"2024-09-12T19:19:02.954345+0000","last_clean":"2024-09-12T19:19:02.954345+0000","last_became_active":"2024-09-12T17:45:41.594848+0000","last_became_peered":"2024-09-12T17:45:41.594848+0000","last_unstale":"2024-09-12T19:19:02.954345+0000","last_undegraded":"2024-09-12T19:19:02.954345+0000","last_fullsized":"2024-09-12T19:19:02.954345+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:51.035395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":101,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.182427+0000","last_change":"2024-09-12T18:19:22.649527+0000","last_active":"2024-09-12T19:19:48.182427+0000","last_peered":"2024-09-12T19:19:48.182427+0000","last_clean":"2024-09-12T19:19:48.182427+0000","last_became_active":"2024-09-12T18:19:22.648818+0000","last_became_peered":"2024-09-12T18:19:22.648818+0000","last_unstale":"2024-09-12T19:19:48.182427+0000","last_undegraded":"2024-09-12T19:19:48.182427+0000","last_fullsized":"2024-09-12T19:19:48.182427+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:23.776526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.988222+0000","last_change":"2024-09-12T17:51:59.954324+0000","last_active":"2024-09-12T19:20:42.988222+0000","last_peered":"2024-09-12T19:20:42.988222+0000","last_clean":"2024-09-12T19:20:42.988222+0000","last_became_active":"2024-09-12T17:51:59.953480+0000","last_became_peered":"2024-09-12T17:51:59.953480+0000","last_unstale":"2024-09-12T19:20:42.988222+0000","last_undegraded":"2024-09-12T19:20:42.988222+0000","last_fullsized":"2024-09-12T19:20:42.988222+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:03.945523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.264807+0000","last_change":"2024-09-12T17:51:52.886235+0000","last_active":"2024-09-12T19:20:33.264807+0000","last_peered":"2024-09-12T19:20:33.264807+0000","last_clean":"2024-09-12T19:20:33.264807+0000","last_became_active":"2024-09-12T17:51:52.884758+0000","last_became_peered":"2024-09-12T17:51:52.884758+0000","last_unstale":"2024-09-12T19:20:33.264807+0000","last_undegraded":"2024-09-12T19:20:33.264807+0000","last_fullsized":"2024-09-12T19:20:33.264807+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:14.092386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'17","reported_seq":121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.169851+0000","last_change":"2024-09-12T17:45:41.586061+0000","last_active":"2024-09-12T19:19:03.169851+0000","last_peered":"2024-09-12T19:19:03.169851+0000","last_clean":"2024-09-12T19:19:03.169851+0000","last_became_active":"2024-09-12T17:45:41.585259+0000","last_became_peered":"2024-09-12T17:45:41.585259+0000","last_unstale":"2024-09-12T19:19:03.169851+0000","last_undegraded":"2024-09-12T19:19:03.169851+0000","last_fullsized":"2024-09-12T19:19:03.169851+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:41.750928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":55,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.189074+0000","last_change":"2024-09-12T18:19:22.658645+0000","last_active":"2024-09-12T19:20:13.189074+0000","last_peered":"2024-09-12T19:20:13.189074+0000","last_clean":"2024-09-12T19:20:13.189074+0000","last_became_active":"2024-09-12T18:19:22.655117+0000","last_became_peered":"2024-09-12T18:19:22.655117+0000","last_unstale":"2024-09-12T19:20:13.189074+0000","last_undegraded":"2024-09-12T19:20:13.189074+0000","last_fullsized":"2024-09-12T19:20:13.189074+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:32.691865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:23.231264+0000","last_change":"2024-09-12T17:51:59.940572+0000","last_active":"2024-09-12T19:18:23.231264+0000","last_peered":"2024-09-12T19:18:23.231264+0000","last_clean":"2024-09-12T19:18:23.231264+0000","last_became_active":"2024-09-12T17:51:59.939751+0000","last_became_peered":"2024-09-12T17:51:59.939751+0000","last_unstale":"2024-09-12T19:18:23.231264+0000","last_undegraded":"2024-09-12T19:18:23.231264+0000","last_fullsized":"2024-09-12T19:18:23.231264+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:17.997521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.563717+0000","last_change":"2024-09-12T17:51:52.897941+0000","last_active":"2024-09-12T19:20:33.563717+0000","last_peered":"2024-09-12T19:20:33.563717+0000","last_clean":"2024-09-12T19:20:33.563717+0000","last_became_active":"2024-09-12T17:51:52.897168+0000","last_became_peered":"2024-09-12T17:51:52.897168+0000","last_unstale":"2024-09-12T19:20:33.563717+0000","last_undegraded":"2024-09-12T19:20:33.563717+0000","last_fullsized":"2024-09-12T19:20:33.563717+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:25.110112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'29","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.182170+0000","last_change":"2024-09-12T17:45:41.580462+0000","last_active":"2024-09-12T19:19:03.182170+0000","last_peered":"2024-09-12T19:19:03.182170+0000","last_clean":"2024-09-12T19:19:03.182170+0000","last_became_active":"2024-09-12T17:45:41.579765+0000","last_became_peered":"2024-09-12T17:45:41.579765+0000","last_unstale":"2024-09-12T19:19:03.182170+0000","last_undegraded":"2024-09-12T19:19:03.182170+0000","last_fullsized":"2024-09-12T19:19:03.182170+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:03.611178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":115,"num_write":41,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252289+0000","last_change":"2024-09-12T18:19:22.643191+0000","last_active":"2024-09-12T19:19:48.252289+0000","last_peered":"2024-09-12T19:19:48.252289+0000","last_clean":"2024-09-12T19:19:48.252289+0000","last_became_active":"2024-09-12T18:19:22.642415+0000","last_became_peered":"2024-09-12T18:19:22.642415+0000","last_unstale":"2024-09-12T19:19:48.252289+0000","last_undegraded":"2024-09-12T19:19:48.252289+0000","last_fullsized":"2024-09-12T19:19:48.252289+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:16.303449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:23.535948+0000","last_change":"2024-09-12T17:51:59.934455+0000","last_active":"2024-09-12T19:18:23.535948+0000","last_peered":"2024-09-12T19:18:23.535948+0000","last_clean":"2024-09-12T19:18:23.535948+0000","last_became_active":"2024-09-12T17:51:59.933679+0000","last_became_peered":"2024-09-12T17:51:59.933679+0000","last_unstale":"2024-09-12T19:18:23.535948+0000","last_undegraded":"2024-09-12T19:18:23.535948+0000","last_fullsized":"2024-09-12T19:18:23.535948+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:50.876767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"267'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:53.026201+0000","last_change":"2024-09-12T17:51:52.892730+0000","last_active":"2024-09-12T19:22:53.026201+0000","last_peered":"2024-09-12T19:22:53.026201+0000","last_clean":"2024-09-12T19:22:53.026201+0000","last_became_active":"2024-09-12T17:51:52.891977+0000","last_became_peered":"2024-09-12T17:51:52.891977+0000","last_unstale":"2024-09-12T19:22:53.026201+0000","last_undegraded":"2024-09-12T19:22:53.026201+0000","last_fullsized":"2024-09-12T19:22:53.026201+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:36.414562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'38","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.241715+0000","last_change":"2024-09-12T17:45:41.580119+0000","last_active":"2024-09-12T19:19:03.241715+0000","last_peered":"2024-09-12T19:19:03.241715+0000","last_clean":"2024-09-12T19:19:03.241715+0000","last_became_active":"2024-09-12T17:45:41.579275+0000","last_became_peered":"2024-09-12T17:45:41.579275+0000","last_unstale":"2024-09-12T19:19:03.241715+0000","last_undegraded":"2024-09-12T19:19:03.241715+0000","last_fullsized":"2024-09-12T19:19:03.241715+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:25.255989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":125,"num_write":71,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.534755+0000","last_change":"2024-09-12T18:19:22.657572+0000","last_active":"2024-09-12T19:20:08.534755+0000","last_peered":"2024-09-12T19:20:08.534755+0000","last_clean":"2024-09-12T19:20:08.534755+0000","last_became_active":"2024-09-12T18:19:22.656770+0000","last_became_peered":"2024-09-12T18:19:22.656770+0000","last_unstale":"2024-09-12T19:20:08.534755+0000","last_undegraded":"2024-09-12T19:20:08.534755+0000","last_fullsized":"2024-09-12T19:20:08.534755+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:58.749315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"267'4","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252315+0000","last_change":"2024-09-12T17:51:59.941713+0000","last_active":"2024-09-12T19:19:48.252315+0000","last_peered":"2024-09-12T19:19:48.252315+0000","last_clean":"2024-09-12T19:19:48.252315+0000","last_became_active":"2024-09-12T17:51:59.934972+0000","last_became_peered":"2024-09-12T17:51:59.934972+0000","last_unstale":"2024-09-12T19:19:48.252315+0000","last_undegraded":"2024-09-12T19:19:48.252315+0000","last_fullsized":"2024-09-12T19:19:48.252315+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:09.715388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":18432,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.962680+0000","last_change":"2024-09-12T17:51:52.901505+0000","last_active":"2024-09-12T19:19:37.962680+0000","last_peered":"2024-09-12T19:19:37.962680+0000","last_clean":"2024-09-12T19:19:37.962680+0000","last_became_active":"2024-09-12T17:51:52.900002+0000","last_became_peered":"2024-09-12T17:51:52.900002+0000","last_unstale":"2024-09-12T19:19:37.962680+0000","last_undegraded":"2024-09-12T19:19:37.962680+0000","last_fullsized":"2024-09-12T19:19:37.962680+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:16.493687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'34","reported_seq":174,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.265060+0000","last_change":"2024-09-12T17:45:41.581349+0000","last_active":"2024-09-12T19:20:33.265060+0000","last_peered":"2024-09-12T19:20:33.265060+0000","last_clean":"2024-09-12T19:20:33.265060+0000","last_became_active":"2024-09-12T17:45:41.580617+0000","last_became_peered":"2024-09-12T17:45:41.580617+0000","last_unstale":"2024-09-12T19:20:33.265060+0000","last_undegraded":"2024-09-12T19:20:33.265060+0000","last_fullsized":"2024-09-12T19:20:33.265060+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:04.951687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":129,"num_write":59,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:07.970075+0000","last_change":"2024-09-12T18:19:22.665735+0000","last_active":"2024-09-12T19:20:07.970075+0000","last_peered":"2024-09-12T19:20:07.970075+0000","last_clean":"2024-09-12T19:20:07.970075+0000","last_became_active":"2024-09-12T18:19:22.664960+0000","last_became_peered":"2024-09-12T18:19:22.664960+0000","last_unstale":"2024-09-12T19:20:07.970075+0000","last_undegraded":"2024-09-12T19:20:07.970075+0000","last_fullsized":"2024-09-12T19:20:07.970075+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:46.264476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'2","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252248+0000","last_change":"2024-09-12T17:51:59.949566+0000","last_active":"2024-09-12T19:19:48.252248+0000","last_peered":"2024-09-12T19:19:48.252248+0000","last_clean":"2024-09-12T19:19:48.252248+0000","last_became_active":"2024-09-12T17:51:59.948733+0000","last_became_peered":"2024-09-12T17:51:59.948733+0000","last_unstale":"2024-09-12T19:19:48.252248+0000","last_undegraded":"2024-09-12T19:19:48.252248+0000","last_fullsized":"2024-09-12T19:19:48.252248+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:47.852395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.528103+0000","last_change":"2024-09-12T17:51:52.905209+0000","last_active":"2024-09-12T19:19:38.528103+0000","last_peered":"2024-09-12T19:19:38.528103+0000","last_clean":"2024-09-12T19:19:38.528103+0000","last_became_active":"2024-09-12T17:51:52.904092+0000","last_became_peered":"2024-09-12T17:51:52.904092+0000","last_unstale":"2024-09-12T19:19:38.528103+0000","last_undegraded":"2024-09-12T19:19:38.528103+0000","last_fullsized":"2024-09-12T19:19:38.528103+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:00.570363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'87","reported_seq":311,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:12.988906+0000","last_change":"2024-09-12T17:45:41.578591+0000","last_active":"2024-09-12T19:20:12.988906+0000","last_peered":"2024-09-12T19:20:12.988906+0000","last_clean":"2024-09-12T19:20:12.988906+0000","last_became_active":"2024-09-12T17:45:41.574884+0000","last_became_peered":"2024-09-12T17:45:41.574884+0000","last_unstale":"2024-09-12T19:20:12.988906+0000","last_undegraded":"2024-09-12T19:20:12.988906+0000","last_fullsized":"2024-09-12T19:20:12.988906+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:26.324719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":442,"num_read_kb":315,"num_write":154,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.557025+0000","last_change":"2024-09-12T18:19:22.633163+0000","last_active":"2024-09-12T19:20:03.557025+0000","last_peered":"2024-09-12T19:20:03.557025+0000","last_clean":"2024-09-12T19:20:03.557025+0000","last_became_active":"2024-09-12T18:19:22.632360+0000","last_became_peered":"2024-09-12T18:19:22.632360+0000","last_unstale":"2024-09-12T19:20:03.557025+0000","last_undegraded":"2024-09-12T19:20:03.557025+0000","last_fullsized":"2024-09-12T19:20:03.557025+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:12.189773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'7","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:12.981953+0000","last_change":"2024-09-12T17:51:59.946265+0000","last_active":"2024-09-12T19:20:12.981953+0000","last_peered":"2024-09-12T19:20:12.981953+0000","last_clean":"2024-09-12T19:20:12.981953+0000","last_became_active":"2024-09-12T17:51:59.945099+0000","last_became_peered":"2024-09-12T17:51:59.945099+0000","last_unstale":"2024-09-12T19:20:12.981953+0000","last_undegraded":"2024-09-12T19:20:12.981953+0000","last_fullsized":"2024-09-12T19:20:12.981953+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:52.338695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.212670+0000","last_change":"2024-09-12T17:51:52.899779+0000","last_active":"2024-09-12T19:21:53.212670+0000","last_peered":"2024-09-12T19:21:53.212670+0000","last_clean":"2024-09-12T19:21:53.212670+0000","last_became_active":"2024-09-12T17:51:52.889772+0000","last_became_peered":"2024-09-12T17:51:52.889772+0000","last_unstale":"2024-09-12T19:21:53.212670+0000","last_undegraded":"2024-09-12T19:21:53.212670+0000","last_fullsized":"2024-09-12T19:21:53.212670+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:13.521012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'27","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.559281+0000","last_change":"2024-09-12T17:45:41.591605+0000","last_active":"2024-09-12T19:20:13.559281+0000","last_peered":"2024-09-12T19:20:13.559281+0000","last_clean":"2024-09-12T19:20:13.559281+0000","last_became_active":"2024-09-12T17:45:41.590861+0000","last_became_peered":"2024-09-12T17:45:41.590861+0000","last_unstale":"2024-09-12T19:20:13.559281+0000","last_undegraded":"2024-09-12T19:20:13.559281+0000","last_fullsized":"2024-09-12T19:20:13.559281+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:02.020910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":90,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968726+0000","last_change":"2024-09-12T18:19:22.656976+0000","last_active":"2024-09-12T19:20:02.968726+0000","last_peered":"2024-09-12T19:20:02.968726+0000","last_clean":"2024-09-12T19:20:02.968726+0000","last_became_active":"2024-09-12T18:19:22.655979+0000","last_became_peered":"2024-09-12T18:19:22.655979+0000","last_unstale":"2024-09-12T19:20:02.968726+0000","last_undegraded":"2024-09-12T19:20:02.968726+0000","last_fullsized":"2024-09-12T19:20:02.968726+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:36.624661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252347+0000","last_change":"2024-09-12T17:51:59.945983+0000","last_active":"2024-09-12T19:19:48.252347+0000","last_peered":"2024-09-12T19:19:48.252347+0000","last_clean":"2024-09-12T19:19:48.252347+0000","last_became_active":"2024-09-12T17:51:59.942431+0000","last_became_peered":"2024-09-12T17:51:59.942431+0000","last_unstale":"2024-09-12T19:19:48.252347+0000","last_undegraded":"2024-09-12T19:19:48.252347+0000","last_fullsized":"2024-09-12T19:19:48.252347+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:57.343792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5283025,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10320,"num_write":8,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:18.007302+0000","last_change":"2024-09-12T17:51:52.901374+0000","last_active":"2024-09-12T19:22:18.007302+0000","last_peered":"2024-09-12T19:22:18.007302+0000","last_clean":"2024-09-12T19:22:18.007302+0000","last_became_active":"2024-09-12T17:51:52.900785+0000","last_became_peered":"2024-09-12T17:51:52.900785+0000","last_unstale":"2024-09-12T19:22:18.007302+0000","last_undegraded":"2024-09-12T19:22:18.007302+0000","last_fullsized":"2024-09-12T19:22:18.007302+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:43.825575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'9","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.535920+0000","last_change":"2024-09-12T17:45:41.566506+0000","last_active":"2024-09-12T19:20:13.535920+0000","last_peered":"2024-09-12T19:20:13.535920+0000","last_clean":"2024-09-12T19:20:13.535920+0000","last_became_active":"2024-09-12T17:45:41.565793+0000","last_became_peered":"2024-09-12T17:45:41.565793+0000","last_unstale":"2024-09-12T19:20:13.535920+0000","last_undegraded":"2024-09-12T19:20:13.535920+0000","last_fullsized":"2024-09-12T19:20:13.535920+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:00.492098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.257645+0000","last_change":"2024-09-12T18:19:22.664289+0000","last_active":"2024-09-12T19:20:08.257645+0000","last_peered":"2024-09-12T19:20:08.257645+0000","last_clean":"2024-09-12T19:20:08.257645+0000","last_became_active":"2024-09-12T18:19:22.663586+0000","last_became_peered":"2024-09-12T18:19:22.663586+0000","last_unstale":"2024-09-12T19:20:08.257645+0000","last_undegraded":"2024-09-12T19:20:08.257645+0000","last_fullsized":"2024-09-12T19:20:08.257645+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:24.618521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:53.208011+0000","last_change":"2024-09-12T17:51:59.950216+0000","last_active":"2024-09-12T19:20:53.208011+0000","last_peered":"2024-09-12T19:20:53.208011+0000","last_clean":"2024-09-12T19:20:53.208011+0000","last_became_active":"2024-09-12T17:51:59.949437+0000","last_became_peered":"2024-09-12T17:51:59.949437+0000","last_unstale":"2024-09-12T19:20:53.208011+0000","last_undegraded":"2024-09-12T19:20:53.208011+0000","last_fullsized":"2024-09-12T19:20:53.208011+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:26.376958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:53.224729+0000","last_change":"2024-09-12T17:51:52.899343+0000","last_active":"2024-09-12T19:22:53.224729+0000","last_peered":"2024-09-12T19:22:53.224729+0000","last_clean":"2024-09-12T19:22:53.224729+0000","last_became_active":"2024-09-12T17:51:52.898903+0000","last_became_peered":"2024-09-12T17:51:52.898903+0000","last_unstale":"2024-09-12T19:22:53.224729+0000","last_undegraded":"2024-09-12T19:22:53.224729+0000","last_fullsized":"2024-09-12T19:22:53.224729+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:05.020501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'42","reported_seq":194,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.188942+0000","last_change":"2024-09-12T17:45:41.577630+0000","last_active":"2024-09-12T19:20:13.188942+0000","last_peered":"2024-09-12T19:20:13.188942+0000","last_clean":"2024-09-12T19:20:13.188942+0000","last_became_active":"2024-09-12T17:45:41.576921+0000","last_became_peered":"2024-09-12T17:45:41.576921+0000","last_unstale":"2024-09-12T19:20:13.188942+0000","last_undegraded":"2024-09-12T19:20:13.188942+0000","last_fullsized":"2024-09-12T19:20:13.188942+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:39.622331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":172,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:22.973830+0000","last_change":"2024-09-12T18:19:22.670182+0000","last_active":"2024-09-12T19:20:22.973830+0000","last_peered":"2024-09-12T19:20:22.973830+0000","last_clean":"2024-09-12T19:20:22.973830+0000","last_became_active":"2024-09-12T18:19:22.669476+0000","last_became_peered":"2024-09-12T18:19:22.669476+0000","last_unstale":"2024-09-12T19:20:22.973830+0000","last_undegraded":"2024-09-12T19:20:22.973830+0000","last_fullsized":"2024-09-12T19:20:22.973830+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:51.189488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:52.980628+0000","last_change":"2024-09-12T17:51:59.939499+0000","last_active":"2024-09-12T19:20:52.980628+0000","last_peered":"2024-09-12T19:20:52.980628+0000","last_clean":"2024-09-12T19:20:52.980628+0000","last_became_active":"2024-09-12T17:51:59.938736+0000","last_became_peered":"2024-09-12T17:51:59.938736+0000","last_unstale":"2024-09-12T19:20:52.980628+0000","last_undegraded":"2024-09-12T19:20:52.980628+0000","last_fullsized":"2024-09-12T19:20:52.980628+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:10.628111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'2","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:53.014895+0000","last_change":"2024-09-12T17:51:52.901410+0000","last_active":"2024-09-12T19:22:53.014895+0000","last_peered":"2024-09-12T19:22:53.014895+0000","last_clean":"2024-09-12T19:22:53.014895+0000","last_became_active":"2024-09-12T17:51:52.900972+0000","last_became_peered":"2024-09-12T17:51:52.900972+0000","last_unstale":"2024-09-12T19:22:53.014895+0000","last_undegraded":"2024-09-12T19:22:53.014895+0000","last_fullsized":"2024-09-12T19:22:53.014895+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:55.522541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'26","reported_seq":147,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:12.956617+0000","last_change":"2024-09-12T17:45:41.588736+0000","last_active":"2024-09-12T19:19:12.956617+0000","last_peered":"2024-09-12T19:19:12.956617+0000","last_clean":"2024-09-12T19:19:12.956617+0000","last_became_active":"2024-09-12T17:45:41.588013+0000","last_became_peered":"2024-09-12T17:45:41.588013+0000","last_unstale":"2024-09-12T19:19:12.956617+0000","last_undegraded":"2024-09-12T19:19:12.956617+0000","last_fullsized":"2024-09-12T19:19:12.956617+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:46.460159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":89,"num_write":52,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:07.970160+0000","last_change":"2024-09-12T18:19:22.664050+0000","last_active":"2024-09-12T19:20:07.970160+0000","last_peered":"2024-09-12T19:20:07.970160+0000","last_clean":"2024-09-12T19:20:07.970160+0000","last_became_active":"2024-09-12T18:19:22.662685+0000","last_became_peered":"2024-09-12T18:19:22.662685+0000","last_unstale":"2024-09-12T19:20:07.970160+0000","last_undegraded":"2024-09-12T19:20:07.970160+0000","last_fullsized":"2024-09-12T19:20:07.970160+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:20.137876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'10","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.864488+0000","last_change":"2024-09-12T17:51:59.943267+0000","last_active":"2024-09-12T19:22:59.864488+0000","last_peered":"2024-09-12T19:22:59.864488+0000","last_clean":"2024-09-12T19:22:59.864488+0000","last_became_active":"2024-09-12T17:51:59.942597+0000","last_became_peered":"2024-09-12T17:51:59.942597+0000","last_unstale":"2024-09-12T19:22:59.864488+0000","last_undegraded":"2024-09-12T19:22:59.864488+0000","last_fullsized":"2024-09-12T19:22:59.864488+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:04.930513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":29698,"num_write":10,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"267'3","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:58.200287+0000","last_change":"2024-09-12T17:51:52.908849+0000","last_active":"2024-09-12T19:20:58.200287+0000","last_peered":"2024-09-12T19:20:58.200287+0000","last_clean":"2024-09-12T19:20:58.200287+0000","last_became_active":"2024-09-12T17:51:52.908200+0000","last_became_peered":"2024-09-12T17:51:52.908200+0000","last_unstale":"2024-09-12T19:20:58.200287+0000","last_undegraded":"2024-09-12T19:20:58.200287+0000","last_fullsized":"2024-09-12T19:20:58.200287+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:57.469586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'15","reported_seq":118,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.239287+0000","last_change":"2024-09-12T17:45:41.578047+0000","last_active":"2024-09-12T19:18:53.239287+0000","last_peered":"2024-09-12T19:18:53.239287+0000","last_clean":"2024-09-12T19:18:53.239287+0000","last_became_active":"2024-09-12T17:45:41.572067+0000","last_became_peered":"2024-09-12T17:45:41.572067+0000","last_unstale":"2024-09-12T19:18:53.239287+0000","last_undegraded":"2024-09-12T19:18:53.239287+0000","last_fullsized":"2024-09-12T19:18:53.239287+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:00.575546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.187554+0000","last_change":"2024-09-12T18:19:22.653075+0000","last_active":"2024-09-12T19:20:08.187554+0000","last_peered":"2024-09-12T19:20:08.187554+0000","last_clean":"2024-09-12T19:20:08.187554+0000","last_became_active":"2024-09-12T18:19:22.648052+0000","last_became_peered":"2024-09-12T18:19:22.648052+0000","last_unstale":"2024-09-12T19:20:08.187554+0000","last_undegraded":"2024-09-12T19:20:08.187554+0000","last_fullsized":"2024-09-12T19:20:08.187554+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:19.707016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"267'8","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.988426+0000","last_change":"2024-09-12T17:51:59.949619+0000","last_active":"2024-09-12T19:22:58.988426+0000","last_peered":"2024-09-12T19:22:58.988426+0000","last_clean":"2024-09-12T19:22:58.988426+0000","last_became_active":"2024-09-12T17:51:59.948873+0000","last_became_peered":"2024-09-12T17:51:59.948873+0000","last_unstale":"2024-09-12T19:22:58.988426+0000","last_undegraded":"2024-09-12T19:22:58.988426+0000","last_fullsized":"2024-09-12T19:22:58.988426+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:03.402596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.190557+0000","last_change":"2024-09-12T17:51:52.890333+0000","last_active":"2024-09-12T19:19:38.190557+0000","last_peered":"2024-09-12T19:19:38.190557+0000","last_clean":"2024-09-12T19:19:38.190557+0000","last_became_active":"2024-09-12T17:51:52.889529+0000","last_became_peered":"2024-09-12T17:51:52.889529+0000","last_unstale":"2024-09-12T19:19:38.190557+0000","last_undegraded":"2024-09-12T19:19:38.190557+0000","last_fullsized":"2024-09-12T19:19:38.190557+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:16.334887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'21","reported_seq":135,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.542152+0000","last_change":"2024-09-12T17:45:41.580279+0000","last_active":"2024-09-12T19:18:53.542152+0000","last_peered":"2024-09-12T19:18:53.542152+0000","last_clean":"2024-09-12T19:18:53.542152+0000","last_became_active":"2024-09-12T17:45:41.579580+0000","last_became_peered":"2024-09-12T17:45:41.579580+0000","last_unstale":"2024-09-12T19:18:53.542152+0000","last_undegraded":"2024-09-12T19:18:53.542152+0000","last_fullsized":"2024-09-12T19:18:53.542152+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:43.960745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":77,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.964979+0000","last_change":"2024-09-12T18:19:22.669927+0000","last_active":"2024-09-12T19:19:47.964979+0000","last_peered":"2024-09-12T19:19:47.964979+0000","last_clean":"2024-09-12T19:19:47.964979+0000","last_became_active":"2024-09-12T18:19:22.669240+0000","last_became_peered":"2024-09-12T18:19:22.669240+0000","last_unstale":"2024-09-12T19:19:47.964979+0000","last_undegraded":"2024-09-12T19:19:47.964979+0000","last_fullsized":"2024-09-12T19:19:47.964979+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:35.739210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.182370+0000","last_change":"2024-09-12T17:51:59.970451+0000","last_active":"2024-09-12T19:19:48.182370+0000","last_peered":"2024-09-12T19:19:48.182370+0000","last_clean":"2024-09-12T19:19:48.182370+0000","last_became_active":"2024-09-12T17:51:59.969706+0000","last_became_peered":"2024-09-12T17:51:59.969706+0000","last_unstale":"2024-09-12T19:19:48.182370+0000","last_undegraded":"2024-09-12T19:19:48.182370+0000","last_fullsized":"2024-09-12T19:19:48.182370+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:53.849725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'6","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959065+0000","last_change":"2024-09-12T17:51:52.884785+0000","last_active":"2024-09-12T19:19:22.959065+0000","last_peered":"2024-09-12T19:19:22.959065+0000","last_clean":"2024-09-12T19:19:22.959065+0000","last_became_active":"2024-09-12T17:51:52.884061+0000","last_became_peered":"2024-09-12T17:51:52.884061+0000","last_unstale":"2024-09-12T19:19:22.959065+0000","last_undegraded":"2024-09-12T19:19:22.959065+0000","last_fullsized":"2024-09-12T19:19:22.959065+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:17.943043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'29","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.167345+0000","last_change":"2024-09-12T17:45:41.573958+0000","last_active":"2024-09-12T19:18:53.167345+0000","last_peered":"2024-09-12T19:18:53.167345+0000","last_clean":"2024-09-12T19:18:53.167345+0000","last_became_active":"2024-09-12T17:45:41.572130+0000","last_became_peered":"2024-09-12T17:45:41.572130+0000","last_unstale":"2024-09-12T19:18:53.167345+0000","last_undegraded":"2024-09-12T19:18:53.167345+0000","last_fullsized":"2024-09-12T19:18:53.167345+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:19.465432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":63,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.982479+0000","last_change":"2024-09-12T18:19:22.667322+0000","last_active":"2024-09-12T19:19:47.982479+0000","last_peered":"2024-09-12T19:19:47.982479+0000","last_clean":"2024-09-12T19:19:47.982479+0000","last_became_active":"2024-09-12T18:19:22.666608+0000","last_became_peered":"2024-09-12T18:19:22.666608+0000","last_unstale":"2024-09-12T19:19:47.982479+0000","last_undegraded":"2024-09-12T19:19:47.982479+0000","last_fullsized":"2024-09-12T19:19:47.982479+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:35.427234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.178096+0000","last_change":"2024-09-12T17:51:59.956619+0000","last_active":"2024-09-12T19:19:33.178096+0000","last_peered":"2024-09-12T19:19:33.178096+0000","last_clean":"2024-09-12T19:19:33.178096+0000","last_became_active":"2024-09-12T17:51:59.956010+0000","last_became_peered":"2024-09-12T17:51:59.956010+0000","last_unstale":"2024-09-12T19:19:33.178096+0000","last_undegraded":"2024-09-12T19:19:33.178096+0000","last_fullsized":"2024-09-12T19:19:33.178096+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:44.171788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'2","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.527059+0000","last_change":"2024-09-12T17:51:52.904694+0000","last_active":"2024-09-12T19:19:33.527059+0000","last_peered":"2024-09-12T19:19:33.527059+0000","last_clean":"2024-09-12T19:19:33.527059+0000","last_became_active":"2024-09-12T17:51:52.903355+0000","last_became_peered":"2024-09-12T17:51:52.903355+0000","last_unstale":"2024-09-12T19:19:33.527059+0000","last_undegraded":"2024-09-12T19:19:33.527059+0000","last_fullsized":"2024-09-12T19:19:33.527059+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:54.768969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'38","reported_seq":184,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.542289+0000","last_change":"2024-09-12T17:45:41.578036+0000","last_active":"2024-09-12T19:18:53.542289+0000","last_peered":"2024-09-12T19:18:53.542289+0000","last_clean":"2024-09-12T19:18:53.542289+0000","last_became_active":"2024-09-12T17:45:41.577322+0000","last_became_peered":"2024-09-12T17:45:41.577322+0000","last_unstale":"2024-09-12T19:18:53.542289+0000","last_undegraded":"2024-09-12T19:18:53.542289+0000","last_fullsized":"2024-09-12T19:18:53.542289+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:32.631509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":139,"num_write":67,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.973565+0000","last_change":"2024-09-12T18:19:22.652387+0000","last_active":"2024-09-12T19:19:37.973565+0000","last_peered":"2024-09-12T19:19:37.973565+0000","last_clean":"2024-09-12T19:19:37.973565+0000","last_became_active":"2024-09-12T18:19:22.647003+0000","last_became_peered":"2024-09-12T18:19:22.647003+0000","last_unstale":"2024-09-12T19:19:37.973565+0000","last_undegraded":"2024-09-12T19:19:37.973565+0000","last_fullsized":"2024-09-12T19:19:37.973565+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:55.195971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.986890+0000","last_change":"2024-09-12T17:51:59.940082+0000","last_active":"2024-09-12T19:22:58.986890+0000","last_peered":"2024-09-12T19:22:58.986890+0000","last_clean":"2024-09-12T19:22:58.986890+0000","last_became_active":"2024-09-12T17:51:59.939200+0000","last_became_peered":"2024-09-12T17:51:59.939200+0000","last_unstale":"2024-09-12T19:22:58.986890+0000","last_undegraded":"2024-09-12T19:22:58.986890+0000","last_fullsized":"2024-09-12T19:22:58.986890+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:37.667275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"267'6","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.988584+0000","last_change":"2024-09-12T17:51:52.897536+0000","last_active":"2024-09-12T19:22:58.988584+0000","last_peered":"2024-09-12T19:22:58.988584+0000","last_clean":"2024-09-12T19:22:58.988584+0000","last_became_active":"2024-09-12T17:51:52.896708+0000","last_became_peered":"2024-09-12T17:51:52.896708+0000","last_unstale":"2024-09-12T19:22:58.988584+0000","last_undegraded":"2024-09-12T19:22:58.988584+0000","last_fullsized":"2024-09-12T19:22:58.988584+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:36.334907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'29","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.965069+0000","last_change":"2024-09-12T17:45:41.592647+0000","last_active":"2024-09-12T19:19:47.965069+0000","last_peered":"2024-09-12T19:19:47.965069+0000","last_clean":"2024-09-12T19:19:47.965069+0000","last_became_active":"2024-09-12T17:45:41.591866+0000","last_became_peered":"2024-09-12T17:45:41.591866+0000","last_unstale":"2024-09-12T19:19:47.965069+0000","last_undegraded":"2024-09-12T19:19:47.965069+0000","last_fullsized":"2024-09-12T19:19:47.965069+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:29.840636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.192729+0000","last_change":"2024-09-12T18:19:22.661674+0000","last_active":"2024-09-12T19:19:48.192729+0000","last_peered":"2024-09-12T19:19:48.192729+0000","last_clean":"2024-09-12T19:19:48.192729+0000","last_became_active":"2024-09-12T18:19:22.660667+0000","last_became_peered":"2024-09-12T18:19:22.660667+0000","last_unstale":"2024-09-12T19:19:48.192729+0000","last_undegraded":"2024-09-12T19:19:48.192729+0000","last_fullsized":"2024-09-12T19:19:48.192729+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:47.455186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:53.208174+0000","last_change":"2024-09-12T17:51:59.949737+0000","last_active":"2024-09-12T19:20:53.208174+0000","last_peered":"2024-09-12T19:20:53.208174+0000","last_clean":"2024-09-12T19:20:53.208174+0000","last_became_active":"2024-09-12T17:51:59.948786+0000","last_became_peered":"2024-09-12T17:51:59.948786+0000","last_unstale":"2024-09-12T19:20:53.208174+0000","last_undegraded":"2024-09-12T19:20:53.208174+0000","last_fullsized":"2024-09-12T19:20:53.208174+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:33.491621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.978565+0000","last_change":"2024-09-12T17:51:52.896511+0000","last_active":"2024-09-12T19:20:42.978565+0000","last_peered":"2024-09-12T19:20:42.978565+0000","last_clean":"2024-09-12T19:20:42.978565+0000","last_became_active":"2024-09-12T17:51:52.895779+0000","last_became_peered":"2024-09-12T17:51:52.895779+0000","last_unstale":"2024-09-12T19:20:42.978565+0000","last_undegraded":"2024-09-12T19:20:42.978565+0000","last_fullsized":"2024-09-12T19:20:42.978565+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:11.529897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'43","reported_seq":205,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:27.971388+0000","last_change":"2024-09-12T17:45:41.584723+0000","last_active":"2024-09-12T19:19:27.971388+0000","last_peered":"2024-09-12T19:19:27.971388+0000","last_clean":"2024-09-12T19:19:27.971388+0000","last_became_active":"2024-09-12T17:45:41.576707+0000","last_became_peered":"2024-09-12T17:45:41.576707+0000","last_unstale":"2024-09-12T19:19:27.971388+0000","last_undegraded":"2024-09-12T19:19:27.971388+0000","last_fullsized":"2024-09-12T19:19:27.971388+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:31.487354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":167,"num_write":65,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.533665+0000","last_change":"2024-09-12T18:19:22.658620+0000","last_active":"2024-09-12T19:20:03.533665+0000","last_peered":"2024-09-12T19:20:03.533665+0000","last_clean":"2024-09-12T19:20:03.533665+0000","last_became_active":"2024-09-12T18:19:22.657891+0000","last_became_peered":"2024-09-12T18:19:22.657891+0000","last_unstale":"2024-09-12T19:20:03.533665+0000","last_undegraded":"2024-09-12T19:20:03.533665+0000","last_fullsized":"2024-09-12T19:20:03.533665+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:56.867297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:32.972545+0000","last_change":"2024-09-12T17:51:59.963668+0000","last_active":"2024-09-12T19:19:32.972545+0000","last_peered":"2024-09-12T19:19:32.972545+0000","last_clean":"2024-09-12T19:19:32.972545+0000","last_became_active":"2024-09-12T17:51:59.962769+0000","last_became_peered":"2024-09-12T17:51:59.962769+0000","last_unstale":"2024-09-12T19:19:32.972545+0000","last_undegraded":"2024-09-12T19:19:32.972545+0000","last_fullsized":"2024-09-12T19:19:32.972545+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:25.342532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'5","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:12.971293+0000","last_change":"2024-09-12T17:51:52.902253+0000","last_active":"2024-09-12T19:20:12.971293+0000","last_peered":"2024-09-12T19:20:12.971293+0000","last_clean":"2024-09-12T19:20:12.971293+0000","last_became_active":"2024-09-12T17:51:52.899987+0000","last_became_peered":"2024-09-12T17:51:52.899987+0000","last_unstale":"2024-09-12T19:20:12.971293+0000","last_undegraded":"2024-09-12T19:20:12.971293+0000","last_fullsized":"2024-09-12T19:20:12.971293+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:40.914632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'9","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:27.978145+0000","last_change":"2024-09-12T17:45:41.571623+0000","last_active":"2024-09-12T19:19:27.978145+0000","last_peered":"2024-09-12T19:19:27.978145+0000","last_clean":"2024-09-12T19:19:27.978145+0000","last_became_active":"2024-09-12T17:45:41.569871+0000","last_became_peered":"2024-09-12T17:45:41.569871+0000","last_unstale":"2024-09-12T19:19:27.978145+0000","last_undegraded":"2024-09-12T19:19:27.978145+0000","last_fullsized":"2024-09-12T19:19:27.978145+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:49.201478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.186072+0000","last_change":"2024-09-12T18:19:22.663293+0000","last_active":"2024-09-12T19:20:03.186072+0000","last_peered":"2024-09-12T19:20:03.186072+0000","last_clean":"2024-09-12T19:20:03.186072+0000","last_became_active":"2024-09-12T18:19:22.648018+0000","last_became_peered":"2024-09-12T18:19:22.648018+0000","last_unstale":"2024-09-12T19:20:03.186072+0000","last_undegraded":"2024-09-12T19:20:03.186072+0000","last_fullsized":"2024-09-12T19:20:03.186072+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:02.291028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'7","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.992212+0000","last_change":"2024-09-12T17:51:59.944498+0000","last_active":"2024-09-12T19:20:27.992212+0000","last_peered":"2024-09-12T19:20:27.992212+0000","last_clean":"2024-09-12T19:20:27.992212+0000","last_became_active":"2024-09-12T17:51:59.943764+0000","last_became_peered":"2024-09-12T17:51:59.943764+0000","last_unstale":"2024-09-12T19:20:27.992212+0000","last_undegraded":"2024-09-12T19:20:27.992212+0000","last_fullsized":"2024-09-12T19:20:27.992212+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:10.664480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20800,"num_write":12,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.958933+0000","last_change":"2024-09-12T17:51:52.894510+0000","last_active":"2024-09-12T19:19:22.958933+0000","last_peered":"2024-09-12T19:19:22.958933+0000","last_clean":"2024-09-12T19:19:22.958933+0000","last_became_active":"2024-09-12T17:51:52.893764+0000","last_became_peered":"2024-09-12T17:51:52.893764+0000","last_unstale":"2024-09-12T19:19:22.958933+0000","last_undegraded":"2024-09-12T19:19:22.958933+0000","last_fullsized":"2024-09-12T19:19:22.958933+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:33.064325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'85","reported_seq":313,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:28.188253+0000","last_change":"2024-09-12T17:45:41.579106+0000","last_active":"2024-09-12T19:19:28.188253+0000","last_peered":"2024-09-12T19:19:28.188253+0000","last_clean":"2024-09-12T19:19:28.188253+0000","last_became_active":"2024-09-12T17:45:41.576079+0000","last_became_peered":"2024-09-12T17:45:41.576079+0000","last_unstale":"2024-09-12T19:19:28.188253+0000","last_undegraded":"2024-09-12T19:19:28.188253+0000","last_fullsized":"2024-09-12T19:19:28.188253+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:21.619591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":312,"num_write":160,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.182314+0000","last_change":"2024-09-12T18:19:22.663744+0000","last_active":"2024-09-12T19:19:48.182314+0000","last_peered":"2024-09-12T19:19:48.182314+0000","last_clean":"2024-09-12T19:19:48.182314+0000","last_became_active":"2024-09-12T18:19:22.662955+0000","last_became_peered":"2024-09-12T18:19:22.662955+0000","last_unstale":"2024-09-12T19:19:48.182314+0000","last_undegraded":"2024-09-12T19:19:48.182314+0000","last_fullsized":"2024-09-12T19:19:48.182314+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:06.958542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.550710+0000","last_change":"2024-09-12T17:51:59.943709+0000","last_active":"2024-09-12T19:19:33.550710+0000","last_peered":"2024-09-12T19:19:33.550710+0000","last_clean":"2024-09-12T19:19:33.550710+0000","last_became_active":"2024-09-12T17:51:59.942275+0000","last_became_peered":"2024-09-12T17:51:59.942275+0000","last_unstale":"2024-09-12T19:19:33.550710+0000","last_undegraded":"2024-09-12T19:19:33.550710+0000","last_fullsized":"2024-09-12T19:19:33.550710+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:15.298466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.970211+0000","last_change":"2024-09-12T17:51:52.896451+0000","last_active":"2024-09-12T19:19:22.970211+0000","last_peered":"2024-09-12T19:19:22.970211+0000","last_clean":"2024-09-12T19:19:22.970211+0000","last_became_active":"2024-09-12T17:51:52.895913+0000","last_became_peered":"2024-09-12T17:51:52.895913+0000","last_unstale":"2024-09-12T19:19:22.970211+0000","last_undegraded":"2024-09-12T19:19:22.970211+0000","last_fullsized":"2024-09-12T19:19:22.970211+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:21.249149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'8","reported_seq":102,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:28.549494+0000","last_change":"2024-09-12T17:45:41.577598+0000","last_active":"2024-09-12T19:19:28.549494+0000","last_peered":"2024-09-12T19:19:28.549494+0000","last_clean":"2024-09-12T19:19:28.549494+0000","last_became_active":"2024-09-12T17:45:41.576841+0000","last_became_peered":"2024-09-12T17:45:41.576841+0000","last_unstale":"2024-09-12T19:19:28.549494+0000","last_undegraded":"2024-09-12T19:19:28.549494+0000","last_fullsized":"2024-09-12T19:19:28.549494+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:40.378322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968901+0000","last_change":"2024-09-12T18:19:22.663672+0000","last_active":"2024-09-12T19:20:02.968901+0000","last_peered":"2024-09-12T19:20:02.968901+0000","last_clean":"2024-09-12T19:20:02.968901+0000","last_became_active":"2024-09-12T18:19:22.662633+0000","last_became_peered":"2024-09-12T18:19:22.662633+0000","last_unstale":"2024-09-12T19:20:02.968901+0000","last_undegraded":"2024-09-12T19:20:02.968901+0000","last_fullsized":"2024-09-12T19:20:02.968901+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:40.210719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.189287+0000","last_change":"2024-09-12T17:51:59.929795+0000","last_active":"2024-09-12T19:19:33.189287+0000","last_peered":"2024-09-12T19:19:33.189287+0000","last_clean":"2024-09-12T19:19:33.189287+0000","last_became_active":"2024-09-12T17:51:59.929108+0000","last_became_peered":"2024-09-12T17:51:59.929108+0000","last_unstale":"2024-09-12T19:19:33.189287+0000","last_undegraded":"2024-09-12T19:19:33.189287+0000","last_fullsized":"2024-09-12T19:19:33.189287+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:42.206076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"267'1","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:23.548516+0000","last_change":"2024-09-12T17:51:52.883949+0000","last_active":"2024-09-12T19:19:23.548516+0000","last_peered":"2024-09-12T19:19:23.548516+0000","last_clean":"2024-09-12T19:19:23.548516+0000","last_became_active":"2024-09-12T17:51:52.876809+0000","last_became_peered":"2024-09-12T17:51:52.876809+0000","last_unstale":"2024-09-12T19:19:23.548516+0000","last_undegraded":"2024-09-12T19:19:23.548516+0000","last_fullsized":"2024-09-12T19:19:23.548516+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:43.734348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4960,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":5,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'24","reported_seq":146,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968654+0000","last_change":"2024-09-12T17:45:41.588350+0000","last_active":"2024-09-12T19:20:02.968654+0000","last_peered":"2024-09-12T19:20:02.968654+0000","last_clean":"2024-09-12T19:20:02.968654+0000","last_became_active":"2024-09-12T17:45:41.587464+0000","last_became_peered":"2024-09-12T17:45:41.587464+0000","last_unstale":"2024-09-12T19:20:02.968654+0000","last_undegraded":"2024-09-12T19:20:02.968654+0000","last_fullsized":"2024-09-12T19:20:02.968654+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:57.305993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":80,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'298","reported_seq":949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.953141+0000","last_change":"2024-09-12T17:29:52.756359+0000","last_active":"2024-09-12T19:23:01.953141+0000","last_peered":"2024-09-12T19:23:01.953141+0000","last_clean":"2024-09-12T19:23:01.953141+0000","last_became_active":"2024-09-12T17:29:52.754920+0000","last_became_peered":"2024-09-12T17:29:52.754920+0000","last_unstale":"2024-09-12T19:23:01.953141+0000","last_undegraded":"2024-09-12T19:23:01.953141+0000","last_fullsized":"2024-09-12T19:23:01.953141+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:04.557129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262253,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":663,"num_write":1055,"num_write_kb":22160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'506","reported_seq":2205,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.033717+0000","last_change":"2024-09-12T17:29:54.761709+0000","last_active":"2024-09-12T19:22:45.033717+0000","last_peered":"2024-09-12T19:22:45.033717+0000","last_clean":"2024-09-12T19:22:45.033717+0000","last_became_active":"2024-09-12T17:29:54.760892+0000","last_became_peered":"2024-09-12T17:29:54.760892+0000","last_unstale":"2024-09-12T19:22:45.033717+0000","last_undegraded":"2024-09-12T19:22:45.033717+0000","last_fullsized":"2024-09-12T19:22:45.033717+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:41.865266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2904,"num_read_kb":2740,"num_write":620,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'340","reported_seq":1028,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.906791+0000","last_change":"2024-09-12T17:29:52.748073+0000","last_active":"2024-09-12T19:23:01.906791+0000","last_peered":"2024-09-12T19:23:01.906791+0000","last_clean":"2024-09-12T19:23:01.906791+0000","last_became_active":"2024-09-12T17:29:52.747481+0000","last_became_peered":"2024-09-12T17:29:52.747481+0000","last_unstale":"2024-09-12T19:23:01.906791+0000","last_undegraded":"2024-09-12T19:23:01.906791+0000","last_fullsized":"2024-09-12T19:23:01.906791+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:09.939962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306162,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":522,"num_read_kb":19278,"num_write":1123,"num_write_kb":29260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'430","reported_seq":1893,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.967478+0000","last_change":"2024-09-12T17:29:54.754770+0000","last_active":"2024-09-12T19:19:57.967478+0000","last_peered":"2024-09-12T19:19:57.967478+0000","last_clean":"2024-09-12T19:19:57.967478+0000","last_became_active":"2024-09-12T17:29:54.753272+0000","last_became_peered":"2024-09-12T17:29:54.753272+0000","last_unstale":"2024-09-12T19:19:57.967478+0000","last_undegraded":"2024-09-12T19:19:57.967478+0000","last_fullsized":"2024-09-12T19:19:57.967478+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:02.705919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2129,"num_read_kb":2000,"num_write":496,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'342","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.943225+0000","last_change":"2024-09-12T17:29:52.736428+0000","last_active":"2024-09-12T19:23:01.943225+0000","last_peered":"2024-09-12T19:23:01.943225+0000","last_clean":"2024-09-12T19:23:01.943225+0000","last_became_active":"2024-09-12T17:29:52.735978+0000","last_became_peered":"2024-09-12T17:29:52.735978+0000","last_unstale":"2024-09-12T19:23:01.943225+0000","last_undegraded":"2024-09-12T19:23:01.943225+0000","last_fullsized":"2024-09-12T19:23:01.943225+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:58.103754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2553570,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":504,"num_read_kb":35253,"num_write":1107,"num_write_kb":35855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'935","reported_seq":2602,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.437432+0000","last_change":"2024-09-12T17:29:54.771720+0000","last_active":"2024-09-12T19:21:21.437432+0000","last_peered":"2024-09-12T19:21:21.437432+0000","last_clean":"2024-09-12T19:21:21.437432+0000","last_became_active":"2024-09-12T17:29:54.770286+0000","last_became_peered":"2024-09-12T17:29:54.770286+0000","last_unstale":"2024-09-12T19:21:21.437432+0000","last_undegraded":"2024-09-12T19:21:21.437432+0000","last_fullsized":"2024-09-12T19:21:21.437432+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":900,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:38.926608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4498,"num_read_kb":4029,"num_write":1285,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'344","reported_seq":1087,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.957130+0000","last_change":"2024-09-12T17:30:21.690086+0000","last_active":"2024-09-12T19:23:01.957130+0000","last_peered":"2024-09-12T19:23:01.957130+0000","last_clean":"2024-09-12T19:23:01.957130+0000","last_became_active":"2024-09-12T17:30:21.689546+0000","last_became_peered":"2024-09-12T17:30:21.689546+0000","last_unstale":"2024-09-12T19:23:01.957130+0000","last_undegraded":"2024-09-12T19:23:01.957130+0000","last_fullsized":"2024-09-12T19:23:01.957130+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:14.185451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170253,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":648,"num_read_kb":124307,"num_write":1100,"num_write_kb":33866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7,2],"acting":[1,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"267'841","reported_seq":2480,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.726477+0000","last_change":"2024-09-12T17:29:54.760698+0000","last_active":"2024-09-12T19:20:03.726477+0000","last_peered":"2024-09-12T19:20:03.726477+0000","last_clean":"2024-09-12T19:20:03.726477+0000","last_became_active":"2024-09-12T17:29:54.760180+0000","last_became_peered":"2024-09-12T17:29:54.760180+0000","last_unstale":"2024-09-12T19:20:03.726477+0000","last_undegraded":"2024-09-12T19:20:03.726477+0000","last_fullsized":"2024-09-12T19:20:03.726477+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:44.225987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3987,"num_read_kb":3603,"num_write":1097,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'364","reported_seq":1008,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.958299+0000","last_change":"2024-09-12T17:29:52.750742+0000","last_active":"2024-09-12T19:23:01.958299+0000","last_peered":"2024-09-12T19:23:01.958299+0000","last_clean":"2024-09-12T19:23:01.958299+0000","last_became_active":"2024-09-12T17:29:52.744115+0000","last_became_peered":"2024-09-12T17:29:52.744115+0000","last_unstale":"2024-09-12T19:23:01.958299+0000","last_undegraded":"2024-09-12T19:23:01.958299+0000","last_fullsized":"2024-09-12T19:23:01.958299+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:24.050332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262269,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":11709,"num_write":1093,"num_write_kb":63153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'869","reported_seq":2502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.934290+0000","last_change":"2024-09-12T17:29:54.759304+0000","last_active":"2024-09-12T19:20:27.934290+0000","last_peered":"2024-09-12T19:20:27.934290+0000","last_clean":"2024-09-12T19:20:27.934290+0000","last_became_active":"2024-09-12T17:29:54.758552+0000","last_became_peered":"2024-09-12T17:29:54.758552+0000","last_unstale":"2024-09-12T19:20:27.934290+0000","last_undegraded":"2024-09-12T19:20:27.934290+0000","last_fullsized":"2024-09-12T19:20:27.934290+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:33.584027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4049,"num_read_kb":3640,"num_write":1140,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'353","reported_seq":1017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.900610+0000","last_change":"2024-09-12T17:29:52.762266+0000","last_active":"2024-09-12T19:23:01.900610+0000","last_peered":"2024-09-12T19:23:01.900610+0000","last_clean":"2024-09-12T19:23:01.900610+0000","last_became_active":"2024-09-12T17:29:52.756242+0000","last_became_peered":"2024-09-12T17:29:52.756242+0000","last_unstale":"2024-09-12T19:23:01.900610+0000","last_undegraded":"2024-09-12T19:23:01.900610+0000","last_fullsized":"2024-09-12T19:23:01.900610+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:47.783235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311546,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":527,"num_read_kb":10971,"num_write":1015,"num_write_kb":29590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'390","reported_seq":1980,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.933638+0000","last_change":"2024-09-12T17:29:54.770914+0000","last_active":"2024-09-12T19:20:27.933638+0000","last_peered":"2024-09-12T19:20:27.933638+0000","last_clean":"2024-09-12T19:20:27.933638+0000","last_became_active":"2024-09-12T17:29:54.770050+0000","last_became_peered":"2024-09-12T17:29:54.770050+0000","last_unstale":"2024-09-12T19:20:27.933638+0000","last_undegraded":"2024-09-12T19:20:27.933638+0000","last_fullsized":"2024-09-12T19:20:27.933638+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:43.841653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2225,"num_read_kb":2129,"num_write":425,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'366","reported_seq":1019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.985420+0000","last_change":"2024-09-12T17:29:52.767237+0000","last_active":"2024-09-12T19:23:01.985420+0000","last_peered":"2024-09-12T19:23:01.985420+0000","last_clean":"2024-09-12T19:23:01.985420+0000","last_became_active":"2024-09-12T17:29:52.762473+0000","last_became_peered":"2024-09-12T17:29:52.762473+0000","last_unstale":"2024-09-12T19:23:01.985420+0000","last_undegraded":"2024-09-12T19:23:01.985420+0000","last_fullsized":"2024-09-12T19:23:01.985420+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:30.353609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25719,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":480,"num_read_kb":16012,"num_write":1030,"num_write_kb":47372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'480","reported_seq":2013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.021704+0000","last_change":"2024-09-12T17:29:54.746687+0000","last_active":"2024-09-12T19:22:45.021704+0000","last_peered":"2024-09-12T19:22:45.021704+0000","last_clean":"2024-09-12T19:22:45.021704+0000","last_became_active":"2024-09-12T17:29:54.745833+0000","last_became_peered":"2024-09-12T17:29:54.745833+0000","last_unstale":"2024-09-12T19:22:45.021704+0000","last_undegraded":"2024-09-12T19:22:45.021704+0000","last_fullsized":"2024-09-12T19:22:45.021704+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:20.546304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2543,"num_read_kb":2369,"num_write":601,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'273","reported_seq":1051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:53.253193+0000","last_change":"2024-09-12T17:29:52.730557+0000","last_active":"2024-09-12T19:19:53.253193+0000","last_peered":"2024-09-12T19:19:53.253193+0000","last_clean":"2024-09-12T19:19:53.253193+0000","last_became_active":"2024-09-12T17:29:52.730010+0000","last_became_peered":"2024-09-12T17:29:52.730010+0000","last_unstale":"2024-09-12T19:19:53.253193+0000","last_undegraded":"2024-09-12T19:19:53.253193+0000","last_fullsized":"2024-09-12T19:19:53.253193+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:31.862041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6872421,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":547,"num_read_kb":14958,"num_write":1022,"num_write_kb":34324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'422","reported_seq":2021,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.137760+0000","last_change":"2024-09-12T17:29:54.756031+0000","last_active":"2024-09-12T19:21:19.137760+0000","last_peered":"2024-09-12T19:21:19.137760+0000","last_clean":"2024-09-12T19:21:19.137760+0000","last_became_active":"2024-09-12T17:29:54.755721+0000","last_became_peered":"2024-09-12T17:29:54.755721+0000","last_unstale":"2024-09-12T19:21:19.137760+0000","last_undegraded":"2024-09-12T19:21:19.137760+0000","last_fullsized":"2024-09-12T19:21:19.137760+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:26.559449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2342,"num_read_kb":2221,"num_write":470,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'360","reported_seq":1930,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.146565+0000","last_change":"2024-09-12T17:29:54.756918+0000","last_active":"2024-09-12T19:21:19.146565+0000","last_peered":"2024-09-12T19:21:19.146565+0000","last_clean":"2024-09-12T19:21:19.146565+0000","last_became_active":"2024-09-12T17:29:54.753012+0000","last_became_peered":"2024-09-12T17:29:54.753012+0000","last_unstale":"2024-09-12T19:21:19.146565+0000","last_undegraded":"2024-09-12T19:21:19.146565+0000","last_fullsized":"2024-09-12T19:21:19.146565+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:44.419129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2149,"num_read_kb":2071,"num_write":395,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'362","reported_seq":1046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.876903+0000","last_change":"2024-09-12T17:29:52.751176+0000","last_active":"2024-09-12T19:23:01.876903+0000","last_peered":"2024-09-12T19:23:01.876903+0000","last_clean":"2024-09-12T19:23:01.876903+0000","last_became_active":"2024-09-12T17:29:52.747589+0000","last_became_peered":"2024-09-12T17:29:52.747589+0000","last_unstale":"2024-09-12T19:23:01.876903+0000","last_undegraded":"2024-09-12T19:23:01.876903+0000","last_fullsized":"2024-09-12T19:23:01.876903+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:03.234800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":507,"num_read_kb":50487,"num_write":1096,"num_write_kb":29653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'423","reported_seq":1988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.900038+0000","last_change":"2024-09-12T17:29:54.754021+0000","last_active":"2024-09-12T19:21:55.900038+0000","last_peered":"2024-09-12T19:21:55.900038+0000","last_clean":"2024-09-12T19:21:55.900038+0000","last_became_active":"2024-09-12T17:29:54.752373+0000","last_became_peered":"2024-09-12T17:29:54.752373+0000","last_unstale":"2024-09-12T19:21:55.900038+0000","last_undegraded":"2024-09-12T19:21:55.900038+0000","last_fullsized":"2024-09-12T19:21:55.900038+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:55.036481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2327,"num_read_kb":2222,"num_write":465,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'284","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:33.723963+0000","last_change":"2024-09-12T17:30:22.256707+0000","last_active":"2024-09-12T19:22:33.723963+0000","last_peered":"2024-09-12T19:22:33.723963+0000","last_clean":"2024-09-12T19:22:33.723963+0000","last_became_active":"2024-09-12T17:30:22.255773+0000","last_became_peered":"2024-09-12T17:30:22.255773+0000","last_unstale":"2024-09-12T19:22:33.723963+0000","last_undegraded":"2024-09-12T19:22:33.723963+0000","last_fullsized":"2024-09-12T19:22:33.723963+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:57.570475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16120849,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":789,"num_read_kb":51978,"num_write":1091,"num_write_kb":60983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2,1],"acting":[3,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.32","version":"267'526","reported_seq":2179,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.901319+0000","last_change":"2024-09-12T17:29:54.773260+0000","last_active":"2024-09-12T19:21:55.901319+0000","last_peered":"2024-09-12T19:21:55.901319+0000","last_clean":"2024-09-12T19:21:55.901319+0000","last_became_active":"2024-09-12T17:29:54.771786+0000","last_became_peered":"2024-09-12T17:29:54.771786+0000","last_unstale":"2024-09-12T19:21:55.901319+0000","last_undegraded":"2024-09-12T19:21:55.901319+0000","last_fullsized":"2024-09-12T19:21:55.901319+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:21.472732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2657,"num_read_kb":2482,"num_write":638,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'372","reported_seq":1177,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:17.145386+0000","last_change":"2024-09-12T17:29:52.732747+0000","last_active":"2024-09-12T19:20:17.145386+0000","last_peered":"2024-09-12T19:20:17.145386+0000","last_clean":"2024-09-12T19:20:17.145386+0000","last_became_active":"2024-09-12T17:29:52.725473+0000","last_became_peered":"2024-09-12T17:29:52.725473+0000","last_unstale":"2024-09-12T19:20:17.145386+0000","last_undegraded":"2024-09-12T19:20:17.145386+0000","last_fullsized":"2024-09-12T19:20:17.145386+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:09.986286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14900598,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":868,"num_read_kb":41903,"num_write":1346,"num_write_kb":44280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'655","reported_seq":2279,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.719735+0000","last_change":"2024-09-12T17:29:54.754617+0000","last_active":"2024-09-12T19:20:03.719735+0000","last_peered":"2024-09-12T19:20:03.719735+0000","last_clean":"2024-09-12T19:20:03.719735+0000","last_became_active":"2024-09-12T17:29:54.754119+0000","last_became_peered":"2024-09-12T17:29:54.754119+0000","last_unstale":"2024-09-12T19:20:03.719735+0000","last_undegraded":"2024-09-12T19:20:03.719735+0000","last_fullsized":"2024-09-12T19:20:03.719735+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":600,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:21.492662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3376,"num_read_kb":3085,"num_write":861,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'319","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.973912+0000","last_change":"2024-09-12T17:29:52.764999+0000","last_active":"2024-09-12T19:23:01.973912+0000","last_peered":"2024-09-12T19:23:01.973912+0000","last_clean":"2024-09-12T19:23:01.973912+0000","last_became_active":"2024-09-12T17:29:52.764052+0000","last_became_peered":"2024-09-12T17:29:52.764052+0000","last_unstale":"2024-09-12T19:23:01.973912+0000","last_undegraded":"2024-09-12T19:23:01.973912+0000","last_fullsized":"2024-09-12T19:23:01.973912+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:13.155680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":477,"num_read_kb":61037,"num_write":999,"num_write_kb":13603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'891","reported_seq":2453,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.721020+0000","last_change":"2024-09-12T17:29:54.761081+0000","last_active":"2024-09-12T19:20:03.721020+0000","last_peered":"2024-09-12T19:20:03.721020+0000","last_clean":"2024-09-12T19:20:03.721020+0000","last_became_active":"2024-09-12T17:29:54.760746+0000","last_became_peered":"2024-09-12T17:29:54.760746+0000","last_unstale":"2024-09-12T19:20:03.721020+0000","last_undegraded":"2024-09-12T19:20:03.721020+0000","last_fullsized":"2024-09-12T19:20:03.721020+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:53.411177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4106,"num_read_kb":3659,"num_write":1202,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'310","reported_seq":999,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:38.235481+0000","last_change":"2024-09-12T17:29:52.721435+0000","last_active":"2024-09-12T19:18:38.235481+0000","last_peered":"2024-09-12T19:18:38.235481+0000","last_clean":"2024-09-12T19:18:38.235481+0000","last_became_active":"2024-09-12T17:29:52.720974+0000","last_became_peered":"2024-09-12T17:29:52.720974+0000","last_unstale":"2024-09-12T19:18:38.235481+0000","last_undegraded":"2024-09-12T19:18:38.235481+0000","last_fullsized":"2024-09-12T19:18:38.235481+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:05.898096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9129257,"num_objects":89,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":514,"num_read_kb":19633,"num_write":1149,"num_write_kb":34097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'744","reported_seq":2333,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.010273+0000","last_change":"2024-09-12T17:29:54.757481+0000","last_active":"2024-09-12T19:22:45.010273+0000","last_peered":"2024-09-12T19:22:45.010273+0000","last_clean":"2024-09-12T19:22:45.010273+0000","last_became_active":"2024-09-12T17:29:54.756675+0000","last_became_peered":"2024-09-12T17:29:54.756675+0000","last_unstale":"2024-09-12T19:22:45.010273+0000","last_undegraded":"2024-09-12T19:22:45.010273+0000","last_fullsized":"2024-09-12T19:22:45.010273+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:30.640890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3670,"num_read_kb":3349,"num_write":979,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'350","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.946835+0000","last_change":"2024-09-12T17:29:52.767402+0000","last_active":"2024-09-12T19:23:01.946835+0000","last_peered":"2024-09-12T19:23:01.946835+0000","last_clean":"2024-09-12T19:23:01.946835+0000","last_became_active":"2024-09-12T17:29:52.766959+0000","last_became_peered":"2024-09-12T17:29:52.766959+0000","last_unstale":"2024-09-12T19:23:01.946835+0000","last_undegraded":"2024-09-12T19:23:01.946835+0000","last_fullsized":"2024-09-12T19:23:01.946835+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:19.932278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":468,"num_read_kb":494,"num_write":1113,"num_write_kb":20716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'130","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.666477+0000","last_change":"2024-09-12T17:30:02.803588+0000","last_active":"2024-09-12T19:21:21.666477+0000","last_peered":"2024-09-12T19:21:21.666477+0000","last_clean":"2024-09-12T19:21:21.666477+0000","last_became_active":"2024-09-12T17:30:02.802659+0000","last_became_peered":"2024-09-12T17:30:02.802659+0000","last_unstale":"2024-09-12T19:21:21.666477+0000","last_undegraded":"2024-09-12T19:21:21.666477+0000","last_fullsized":"2024-09-12T19:21:21.666477+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:05.775037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":169,"num_write":297,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'432","reported_seq":2018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:14.631110+0000","last_change":"2024-09-12T17:29:54.758798+0000","last_active":"2024-09-12T19:20:14.631110+0000","last_peered":"2024-09-12T19:20:14.631110+0000","last_clean":"2024-09-12T19:20:14.631110+0000","last_became_active":"2024-09-12T17:29:54.758303+0000","last_became_peered":"2024-09-12T17:29:54.758303+0000","last_unstale":"2024-09-12T19:20:14.631110+0000","last_undegraded":"2024-09-12T19:20:14.631110+0000","last_fullsized":"2024-09-12T19:20:14.631110+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:43.384034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2323,"num_read_kb":2196,"num_write":494,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'401","reported_seq":1112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.757287+0000","last_change":"2024-09-12T17:29:52.755910+0000","last_active":"2024-09-12T19:23:01.757287+0000","last_peered":"2024-09-12T19:23:01.757287+0000","last_clean":"2024-09-12T19:23:01.757287+0000","last_became_active":"2024-09-12T17:29:52.755103+0000","last_became_peered":"2024-09-12T17:29:52.755103+0000","last_unstale":"2024-09-12T19:23:01.757287+0000","last_undegraded":"2024-09-12T19:23:01.757287+0000","last_fullsized":"2024-09-12T19:23:01.757287+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:39.921239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524450,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":671,"num_read_kb":34526,"num_write":1327,"num_write_kb":26646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:42.965930+0000","last_change":"2024-09-12T17:29:56.764275+0000","last_active":"2024-09-12T19:18:42.965930+0000","last_peered":"2024-09-12T19:18:42.965930+0000","last_clean":"2024-09-12T19:18:42.965930+0000","last_became_active":"2024-09-12T17:29:56.763547+0000","last_became_peered":"2024-09-12T17:29:56.763547+0000","last_unstale":"2024-09-12T19:18:42.965930+0000","last_undegraded":"2024-09-12T19:18:42.965930+0000","last_fullsized":"2024-09-12T19:18:42.965930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:50.827569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'387","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.933998+0000","last_change":"2024-09-12T17:29:58.780660+0000","last_active":"2024-09-12T19:23:01.933998+0000","last_peered":"2024-09-12T19:23:01.933998+0000","last_clean":"2024-09-12T19:23:01.933998+0000","last_became_active":"2024-09-12T17:29:58.777554+0000","last_became_peered":"2024-09-12T17:29:58.777554+0000","last_unstale":"2024-09-12T19:23:01.933998+0000","last_undegraded":"2024-09-12T19:23:01.933998+0000","last_fullsized":"2024-09-12T19:23:01.933998+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:45.028521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45863,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":1229,"num_write":480,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:47.950949+0000","last_change":"2024-09-12T17:30:00.806462+0000","last_active":"2024-09-12T19:18:47.950949+0000","last_peered":"2024-09-12T19:18:47.950949+0000","last_clean":"2024-09-12T19:18:47.950949+0000","last_became_active":"2024-09-12T17:30:00.805568+0000","last_became_peered":"2024-09-12T17:30:00.805568+0000","last_unstale":"2024-09-12T19:18:47.950949+0000","last_undegraded":"2024-09-12T19:18:47.950949+0000","last_fullsized":"2024-09-12T19:18:47.950949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:19.223415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'145","reported_seq":724,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.098828+0000","last_change":"2024-09-12T17:30:02.786275+0000","last_active":"2024-09-12T19:20:28.098828+0000","last_peered":"2024-09-12T19:20:28.098828+0000","last_clean":"2024-09-12T19:20:28.098828+0000","last_became_active":"2024-09-12T17:30:02.785212+0000","last_became_peered":"2024-09-12T17:30:02.785212+0000","last_unstale":"2024-09-12T19:20:28.098828+0000","last_undegraded":"2024-09-12T19:20:28.098828+0000","last_fullsized":"2024-09-12T19:20:28.098828+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:15.216332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":252,"num_read_kb":243,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'682","reported_seq":2548,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.376127+0000","last_change":"2024-09-12T17:29:54.763192+0000","last_active":"2024-09-12T19:21:21.376127+0000","last_peered":"2024-09-12T19:21:21.376127+0000","last_clean":"2024-09-12T19:21:21.376127+0000","last_became_active":"2024-09-12T17:29:54.761497+0000","last_became_peered":"2024-09-12T17:29:54.761497+0000","last_unstale":"2024-09-12T19:21:21.376127+0000","last_undegraded":"2024-09-12T19:21:21.376127+0000","last_fullsized":"2024-09-12T19:21:21.376127+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":600,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:10.152526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3854,"num_read_kb":3534,"num_write":981,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'373","reported_seq":1046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.969152+0000","last_change":"2024-09-12T17:29:52.714312+0000","last_active":"2024-09-12T19:23:01.969152+0000","last_peered":"2024-09-12T19:23:01.969152+0000","last_clean":"2024-09-12T19:23:01.969152+0000","last_became_active":"2024-09-12T17:29:52.713938+0000","last_became_peered":"2024-09-12T17:29:52.713938+0000","last_unstale":"2024-09-12T19:23:01.969152+0000","last_undegraded":"2024-09-12T19:23:01.969152+0000","last_fullsized":"2024-09-12T19:23:01.969152+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:41.597689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460272,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":10309,"num_write":1260,"num_write_kb":32712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.256354+0000","last_change":"2024-09-12T17:29:56.776910+0000","last_active":"2024-09-12T19:20:03.256354+0000","last_peered":"2024-09-12T19:20:03.256354+0000","last_clean":"2024-09-12T19:20:03.256354+0000","last_became_active":"2024-09-12T17:29:56.776335+0000","last_became_peered":"2024-09-12T17:29:56.776335+0000","last_unstale":"2024-09-12T19:20:03.256354+0000","last_undegraded":"2024-09-12T19:20:03.256354+0000","last_fullsized":"2024-09-12T19:20:03.256354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:54.362260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'120","reported_seq":694,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:50.316180+0000","last_change":"2024-09-12T17:29:58.778467+0000","last_active":"2024-09-12T19:20:50.316180+0000","last_peered":"2024-09-12T19:20:50.316180+0000","last_clean":"2024-09-12T19:20:50.316180+0000","last_became_active":"2024-09-12T17:29:58.777883+0000","last_became_peered":"2024-09-12T17:29:58.777883+0000","last_unstale":"2024-09-12T19:20:50.316180+0000","last_undegraded":"2024-09-12T19:20:50.316180+0000","last_fullsized":"2024-09-12T19:20:50.316180+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:33.007083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:48.179069+0000","last_change":"2024-09-12T17:30:00.782290+0000","last_active":"2024-09-12T19:18:48.179069+0000","last_peered":"2024-09-12T19:18:48.179069+0000","last_clean":"2024-09-12T19:18:48.179069+0000","last_became_active":"2024-09-12T17:30:00.781554+0000","last_became_peered":"2024-09-12T17:30:00.781554+0000","last_unstale":"2024-09-12T19:18:48.179069+0000","last_undegraded":"2024-09-12T19:18:48.179069+0000","last_fullsized":"2024-09-12T19:18:48.179069+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:16.914242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'118","reported_seq":660,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.731504+0000","last_change":"2024-09-12T17:30:02.806243+0000","last_active":"2024-09-12T19:21:21.731504+0000","last_peered":"2024-09-12T19:21:21.731504+0000","last_clean":"2024-09-12T19:21:21.731504+0000","last_became_active":"2024-09-12T17:30:02.805556+0000","last_became_peered":"2024-09-12T17:30:02.805556+0000","last_unstale":"2024-09-12T19:21:21.731504+0000","last_undegraded":"2024-09-12T19:21:21.731504+0000","last_fullsized":"2024-09-12T19:21:21.731504+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:10.526393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":177,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'907","reported_seq":2534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:35.932561+0000","last_change":"2024-09-12T17:29:54.752472+0000","last_active":"2024-09-12T19:19:35.932561+0000","last_peered":"2024-09-12T19:19:35.932561+0000","last_clean":"2024-09-12T19:19:35.932561+0000","last_became_active":"2024-09-12T17:29:54.751997+0000","last_became_peered":"2024-09-12T17:29:54.751997+0000","last_unstale":"2024-09-12T19:19:35.932561+0000","last_undegraded":"2024-09-12T19:19:35.932561+0000","last_fullsized":"2024-09-12T19:19:35.932561+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":800,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:22.947507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4250,"num_read_kb":3802,"num_write":1203,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'368","reported_seq":1085,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.941483+0000","last_change":"2024-09-12T17:29:52.762803+0000","last_active":"2024-09-12T19:23:01.941483+0000","last_peered":"2024-09-12T19:23:01.941483+0000","last_clean":"2024-09-12T19:23:01.941483+0000","last_became_active":"2024-09-12T17:29:52.762149+0000","last_became_peered":"2024-09-12T17:29:52.762149+0000","last_unstale":"2024-09-12T19:23:01.941483+0000","last_undegraded":"2024-09-12T19:23:01.941483+0000","last_fullsized":"2024-09-12T19:23:01.941483+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:00.553936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":626,"num_read_kb":63082,"num_write":1322,"num_write_kb":27819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.236790+0000","last_change":"2024-09-12T17:29:56.762319+0000","last_active":"2024-09-12T19:18:43.236790+0000","last_peered":"2024-09-12T19:18:43.236790+0000","last_clean":"2024-09-12T19:18:43.236790+0000","last_became_active":"2024-09-12T17:29:56.761027+0000","last_became_peered":"2024-09-12T17:29:56.761027+0000","last_unstale":"2024-09-12T19:18:43.236790+0000","last_undegraded":"2024-09-12T19:18:43.236790+0000","last_fullsized":"2024-09-12T19:18:43.236790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:25.029553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'172","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:51.961304+0000","last_change":"2024-09-12T17:29:58.770614+0000","last_active":"2024-09-12T19:20:51.961304+0000","last_peered":"2024-09-12T19:20:51.961304+0000","last_clean":"2024-09-12T19:20:51.961304+0000","last_became_active":"2024-09-12T17:29:58.769889+0000","last_became_peered":"2024-09-12T17:29:58.769889+0000","last_unstale":"2024-09-12T19:20:51.961304+0000","last_undegraded":"2024-09-12T19:20:51.961304+0000","last_fullsized":"2024-09-12T19:20:51.961304+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:01.639009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'756","reported_seq":3324,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.884918+0000","last_change":"2024-09-12T17:30:00.810692+0000","last_active":"2024-09-12T19:22:58.884918+0000","last_peered":"2024-09-12T19:22:58.884918+0000","last_clean":"2024-09-12T19:22:58.884918+0000","last_became_active":"2024-09-12T17:30:00.810030+0000","last_became_peered":"2024-09-12T17:30:00.810030+0000","last_unstale":"2024-09-12T19:22:58.884918+0000","last_undegraded":"2024-09-12T19:22:58.884918+0000","last_fullsized":"2024-09-12T19:22:58.884918+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:18.541833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'206","reported_seq":1064,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.854762+0000","last_change":"2024-09-12T17:30:02.807819+0000","last_active":"2024-09-12T19:21:21.854762+0000","last_peered":"2024-09-12T19:21:21.854762+0000","last_clean":"2024-09-12T19:21:21.854762+0000","last_became_active":"2024-09-12T17:30:02.803144+0000","last_became_peered":"2024-09-12T17:30:02.803144+0000","last_unstale":"2024-09-12T19:21:21.854762+0000","last_undegraded":"2024-09-12T19:21:21.854762+0000","last_fullsized":"2024-09-12T19:21:21.854762+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:22.571499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":674,"num_read_kb":661,"num_write":463,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'413","reported_seq":2070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.356713+0000","last_change":"2024-09-12T17:29:54.762812+0000","last_active":"2024-09-12T19:21:21.356713+0000","last_peered":"2024-09-12T19:21:21.356713+0000","last_clean":"2024-09-12T19:21:21.356713+0000","last_became_active":"2024-09-12T17:29:54.762448+0000","last_became_peered":"2024-09-12T17:29:54.762448+0000","last_unstale":"2024-09-12T19:21:21.356713+0000","last_undegraded":"2024-09-12T19:21:21.356713+0000","last_fullsized":"2024-09-12T19:21:21.356713+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:00.556614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2329,"num_read_kb":2238,"num_write":469,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'277","reported_seq":940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.550601+0000","last_change":"2024-09-12T17:29:52.740127+0000","last_active":"2024-09-12T19:19:33.550601+0000","last_peered":"2024-09-12T19:19:33.550601+0000","last_clean":"2024-09-12T19:19:33.550601+0000","last_became_active":"2024-09-12T17:29:52.738957+0000","last_became_peered":"2024-09-12T17:29:52.738957+0000","last_unstale":"2024-09-12T19:19:33.550601+0000","last_undegraded":"2024-09-12T19:19:33.550601+0000","last_fullsized":"2024-09-12T19:19:33.550601+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:50.808537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6340313,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":453,"num_read_kb":16175,"num_write":1086,"num_write_kb":26946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:42.966023+0000","last_change":"2024-09-12T17:29:56.757650+0000","last_active":"2024-09-12T19:18:42.966023+0000","last_peered":"2024-09-12T19:18:42.966023+0000","last_clean":"2024-09-12T19:18:42.966023+0000","last_became_active":"2024-09-12T17:29:56.755730+0000","last_became_peered":"2024-09-12T17:29:56.755730+0000","last_unstale":"2024-09-12T19:18:42.966023+0000","last_undegraded":"2024-09-12T19:18:42.966023+0000","last_fullsized":"2024-09-12T19:18:42.966023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:23.463400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'322","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.554435+0000","last_change":"2024-09-12T17:29:58.829682+0000","last_active":"2024-09-12T19:23:01.554435+0000","last_peered":"2024-09-12T19:23:01.554435+0000","last_clean":"2024-09-12T19:23:01.554435+0000","last_became_active":"2024-09-12T17:29:58.829021+0000","last_became_peered":"2024-09-12T17:29:58.829021+0000","last_unstale":"2024-09-12T19:23:01.554435+0000","last_undegraded":"2024-09-12T19:23:01.554435+0000","last_fullsized":"2024-09-12T19:23:01.554435+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:56.407873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49018,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":1196,"num_write":438,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'810","reported_seq":3020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.295056+0000","last_change":"2024-09-12T17:30:00.794188+0000","last_active":"2024-09-12T19:22:46.295056+0000","last_peered":"2024-09-12T19:22:46.295056+0000","last_clean":"2024-09-12T19:22:46.295056+0000","last_became_active":"2024-09-12T17:30:00.793067+0000","last_became_peered":"2024-09-12T17:30:00.793067+0000","last_unstale":"2024-09-12T19:22:46.295056+0000","last_undegraded":"2024-09-12T19:22:46.295056+0000","last_fullsized":"2024-09-12T19:22:46.295056+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:26.995446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'523","reported_seq":2063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.442210+0000","last_change":"2024-09-12T17:29:54.766898+0000","last_active":"2024-09-12T19:21:21.442210+0000","last_peered":"2024-09-12T19:21:21.442210+0000","last_clean":"2024-09-12T19:21:21.442210+0000","last_became_active":"2024-09-12T17:29:54.766092+0000","last_became_peered":"2024-09-12T17:29:54.766092+0000","last_unstale":"2024-09-12T19:21:21.442210+0000","last_undegraded":"2024-09-12T19:21:21.442210+0000","last_fullsized":"2024-09-12T19:21:21.442210+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:01.060409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2636,"num_read_kb":2418,"num_write":649,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'353","reported_seq":1039,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.895862+0000","last_change":"2024-09-12T17:29:52.762735+0000","last_active":"2024-09-12T19:23:01.895862+0000","last_peered":"2024-09-12T19:23:01.895862+0000","last_clean":"2024-09-12T19:23:01.895862+0000","last_became_active":"2024-09-12T17:29:52.757326+0000","last_became_peered":"2024-09-12T17:29:52.757326+0000","last_unstale":"2024-09-12T19:23:01.895862+0000","last_undegraded":"2024-09-12T19:23:01.895862+0000","last_fullsized":"2024-09-12T19:23:01.895862+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:34.150960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730145,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":565,"num_read_kb":12520,"num_write":1100,"num_write_kb":32977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.974785+0000","last_change":"2024-09-12T17:29:56.769344+0000","last_active":"2024-09-12T19:20:27.974785+0000","last_peered":"2024-09-12T19:20:27.974785+0000","last_clean":"2024-09-12T19:20:27.974785+0000","last_became_active":"2024-09-12T17:29:56.768267+0000","last_became_peered":"2024-09-12T17:29:56.768267+0000","last_unstale":"2024-09-12T19:20:27.974785+0000","last_undegraded":"2024-09-12T19:20:27.974785+0000","last_fullsized":"2024-09-12T19:20:27.974785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:14.841905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'452","reported_seq":1143,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.315539+0000","last_change":"2024-09-12T17:29:58.834050+0000","last_active":"2024-09-12T19:22:59.315539+0000","last_peered":"2024-09-12T19:22:59.315539+0000","last_clean":"2024-09-12T19:22:59.315539+0000","last_became_active":"2024-09-12T17:29:58.833291+0000","last_became_peered":"2024-09-12T17:29:58.833291+0000","last_unstale":"2024-09-12T19:22:59.315539+0000","last_undegraded":"2024-09-12T19:22:59.315539+0000","last_fullsized":"2024-09-12T19:22:59.315539+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:23.364120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60505,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":721,"num_read_kb":1312,"num_write":540,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:17.982998+0000","last_change":"2024-09-12T17:30:00.810543+0000","last_active":"2024-09-12T19:20:17.982998+0000","last_peered":"2024-09-12T19:20:17.982998+0000","last_clean":"2024-09-12T19:20:17.982998+0000","last_became_active":"2024-09-12T17:30:00.809914+0000","last_became_peered":"2024-09-12T17:30:00.809914+0000","last_unstale":"2024-09-12T19:20:17.982998+0000","last_undegraded":"2024-09-12T19:20:17.982998+0000","last_fullsized":"2024-09-12T19:20:17.982998+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:44.935436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'548","reported_seq":1404,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.253948+0000","last_change":"2024-09-12T17:30:02.797843+0000","last_active":"2024-09-12T19:22:46.253948+0000","last_peered":"2024-09-12T19:22:46.253948+0000","last_clean":"2024-09-12T19:22:46.253948+0000","last_became_active":"2024-09-12T17:30:02.797046+0000","last_became_peered":"2024-09-12T17:30:02.797046+0000","last_unstale":"2024-09-12T19:22:46.253948+0000","last_undegraded":"2024-09-12T19:22:46.253948+0000","last_fullsized":"2024-09-12T19:22:46.253948+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:58.930778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1413,"num_read_kb":1390,"num_write":1179,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'480","reported_seq":2156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.202292+0000","last_change":"2024-09-12T17:29:54.756840+0000","last_active":"2024-09-12T19:20:28.202292+0000","last_peered":"2024-09-12T19:20:28.202292+0000","last_clean":"2024-09-12T19:20:28.202292+0000","last_became_active":"2024-09-12T17:29:54.754517+0000","last_became_peered":"2024-09-12T17:29:54.754517+0000","last_unstale":"2024-09-12T19:20:28.202292+0000","last_undegraded":"2024-09-12T19:20:28.202292+0000","last_fullsized":"2024-09-12T19:20:28.202292+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:21.909735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2565,"num_read_kb":2417,"num_write":558,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'317","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.891150+0000","last_change":"2024-09-12T17:29:52.761247+0000","last_active":"2024-09-12T19:23:01.891150+0000","last_peered":"2024-09-12T19:23:01.891150+0000","last_clean":"2024-09-12T19:23:01.891150+0000","last_became_active":"2024-09-12T17:29:52.760711+0000","last_became_peered":"2024-09-12T17:29:52.760711+0000","last_unstale":"2024-09-12T19:23:01.891150+0000","last_undegraded":"2024-09-12T19:23:01.891150+0000","last_fullsized":"2024-09-12T19:23:01.891150+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:21.789117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759519,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":447,"num_read_kb":40999,"num_write":1044,"num_write_kb":42394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.538942+0000","last_change":"2024-09-12T17:29:56.758473+0000","last_active":"2024-09-12T19:20:28.538942+0000","last_peered":"2024-09-12T19:20:28.538942+0000","last_clean":"2024-09-12T19:20:28.538942+0000","last_became_active":"2024-09-12T17:29:56.757805+0000","last_became_peered":"2024-09-12T17:29:56.757805+0000","last_unstale":"2024-09-12T19:20:28.538942+0000","last_undegraded":"2024-09-12T19:20:28.538942+0000","last_fullsized":"2024-09-12T19:20:28.538942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:32.794119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'299","reported_seq":917,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:33.290790+0000","last_change":"2024-09-12T17:29:58.774261+0000","last_active":"2024-09-12T19:22:33.290790+0000","last_peered":"2024-09-12T19:22:33.290790+0000","last_clean":"2024-09-12T19:22:33.290790+0000","last_became_active":"2024-09-12T17:29:58.773959+0000","last_became_peered":"2024-09-12T17:29:58.773959+0000","last_unstale":"2024-09-12T19:22:33.290790+0000","last_undegraded":"2024-09-12T19:22:33.290790+0000","last_fullsized":"2024-09-12T19:22:33.290790+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:53.591898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56650,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":967,"num_write":394,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:48.237729+0000","last_change":"2024-09-12T17:30:00.792690+0000","last_active":"2024-09-12T19:18:48.237729+0000","last_peered":"2024-09-12T19:18:48.237729+0000","last_clean":"2024-09-12T19:18:48.237729+0000","last_became_active":"2024-09-12T17:30:00.792138+0000","last_became_peered":"2024-09-12T17:30:00.792138+0000","last_unstale":"2024-09-12T19:18:48.237729+0000","last_undegraded":"2024-09-12T19:18:48.237729+0000","last_fullsized":"2024-09-12T19:18:48.237729+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:12.058912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2476","reported_seq":4391,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.257061+0000","last_change":"2024-09-12T17:30:02.801585+0000","last_active":"2024-09-12T19:22:46.257061+0000","last_peered":"2024-09-12T19:22:46.257061+0000","last_clean":"2024-09-12T19:22:46.257061+0000","last_became_active":"2024-09-12T17:30:02.800860+0000","last_became_peered":"2024-09-12T17:30:02.800860+0000","last_unstale":"2024-09-12T19:22:46.257061+0000","last_undegraded":"2024-09-12T19:22:46.257061+0000","last_fullsized":"2024-09-12T19:22:46.257061+0000","mapping_epoch":36,"log_start":"267'2400","ondisk_log_start":"267'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":2400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:23.192552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6373,"num_read_kb":6312,"num_write":5027,"num_write_kb":1835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'430","reported_seq":2068,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.148759+0000","last_change":"2024-09-12T17:29:54.770302+0000","last_active":"2024-09-12T19:21:19.148759+0000","last_peered":"2024-09-12T19:21:19.148759+0000","last_clean":"2024-09-12T19:21:19.148759+0000","last_became_active":"2024-09-12T17:29:54.769541+0000","last_became_peered":"2024-09-12T17:29:54.769541+0000","last_unstale":"2024-09-12T19:21:19.148759+0000","last_undegraded":"2024-09-12T19:21:19.148759+0000","last_fullsized":"2024-09-12T19:21:19.148759+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:46.646360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2445,"num_read_kb":2340,"num_write":496,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'273","reported_seq":948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:59.167804+0000","last_change":"2024-09-12T17:30:21.794660+0000","last_active":"2024-09-12T19:20:59.167804+0000","last_peered":"2024-09-12T19:20:59.167804+0000","last_clean":"2024-09-12T19:20:59.167804+0000","last_became_active":"2024-09-12T17:30:21.793950+0000","last_became_peered":"2024-09-12T17:30:21.793950+0000","last_unstale":"2024-09-12T19:20:59.167804+0000","last_undegraded":"2024-09-12T19:20:59.167804+0000","last_fullsized":"2024-09-12T19:20:59.167804+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:45.690479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17796039,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":466,"num_read_kb":65282,"num_write":1011,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,6],"acting":[2,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.535841+0000","last_change":"2024-09-12T17:29:56.770636+0000","last_active":"2024-09-12T19:20:13.535841+0000","last_peered":"2024-09-12T19:20:13.535841+0000","last_clean":"2024-09-12T19:20:13.535841+0000","last_became_active":"2024-09-12T17:29:56.770222+0000","last_became_peered":"2024-09-12T17:29:56.770222+0000","last_unstale":"2024-09-12T19:20:13.535841+0000","last_undegraded":"2024-09-12T19:20:13.535841+0000","last_fullsized":"2024-09-12T19:20:13.535841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:00.086855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'394","reported_seq":1045,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.505552+0000","last_change":"2024-09-12T17:29:58.755448+0000","last_active":"2024-09-12T19:22:59.505552+0000","last_peered":"2024-09-12T19:22:59.505552+0000","last_clean":"2024-09-12T19:22:59.505552+0000","last_became_active":"2024-09-12T17:29:58.754613+0000","last_became_peered":"2024-09-12T17:29:58.754613+0000","last_unstale":"2024-09-12T19:22:59.505552+0000","last_undegraded":"2024-09-12T19:22:59.505552+0000","last_fullsized":"2024-09-12T19:22:59.505552+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:50.294662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50732,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":653,"num_read_kb":1328,"num_write":512,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'796","reported_seq":3207,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.319657+0000","last_change":"2024-09-12T17:30:00.806110+0000","last_active":"2024-09-12T19:23:01.319657+0000","last_peered":"2024-09-12T19:23:01.319657+0000","last_clean":"2024-09-12T19:23:01.319657+0000","last_became_active":"2024-09-12T17:30:00.805428+0000","last_became_peered":"2024-09-12T17:30:00.805428+0000","last_unstale":"2024-09-12T19:23:01.319657+0000","last_undegraded":"2024-09-12T19:23:01.319657+0000","last_fullsized":"2024-09-12T19:23:01.319657+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:28.577730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'112","reported_seq":659,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.641116+0000","last_change":"2024-09-12T17:30:02.817717+0000","last_active":"2024-09-12T19:22:44.641116+0000","last_peered":"2024-09-12T19:22:44.641116+0000","last_clean":"2024-09-12T19:22:44.641116+0000","last_became_active":"2024-09-12T17:30:02.816983+0000","last_became_peered":"2024-09-12T17:30:02.816983+0000","last_unstale":"2024-09-12T19:22:44.641116+0000","last_undegraded":"2024-09-12T19:22:44.641116+0000","last_fullsized":"2024-09-12T19:22:44.641116+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:16.290296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":194,"num_write":254,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'871","reported_seq":2499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.139491+0000","last_change":"2024-09-12T17:29:54.752312+0000","last_active":"2024-09-12T19:21:19.139491+0000","last_peered":"2024-09-12T19:21:19.139491+0000","last_clean":"2024-09-12T19:21:19.139491+0000","last_became_active":"2024-09-12T17:29:54.744926+0000","last_became_peered":"2024-09-12T17:29:54.744926+0000","last_unstale":"2024-09-12T19:21:19.139491+0000","last_undegraded":"2024-09-12T19:21:19.139491+0000","last_fullsized":"2024-09-12T19:21:19.139491+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:28.330625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4186,"num_read_kb":3781,"num_write":1194,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'377","reported_seq":1067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.981260+0000","last_change":"2024-09-12T17:29:52.749559+0000","last_active":"2024-09-12T19:23:01.981260+0000","last_peered":"2024-09-12T19:23:01.981260+0000","last_clean":"2024-09-12T19:23:01.981260+0000","last_became_active":"2024-09-12T17:29:52.748439+0000","last_became_peered":"2024-09-12T17:29:52.748439+0000","last_unstale":"2024-09-12T19:23:01.981260+0000","last_undegraded":"2024-09-12T19:23:01.981260+0000","last_fullsized":"2024-09-12T19:23:01.981260+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:29.874598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992343,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":628,"num_read_kb":40400,"num_write":1240,"num_write_kb":24508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:43.542396+0000","last_change":"2024-09-12T17:29:56.743345+0000","last_active":"2024-09-12T19:20:43.542396+0000","last_peered":"2024-09-12T19:20:43.542396+0000","last_clean":"2024-09-12T19:20:43.542396+0000","last_became_active":"2024-09-12T17:29:56.742361+0000","last_became_peered":"2024-09-12T17:29:56.742361+0000","last_unstale":"2024-09-12T19:20:43.542396+0000","last_undegraded":"2024-09-12T19:20:43.542396+0000","last_fullsized":"2024-09-12T19:20:43.542396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:08.175418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'514","reported_seq":1198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.038329+0000","last_change":"2024-09-12T17:29:58.782097+0000","last_active":"2024-09-12T19:23:01.038329+0000","last_peered":"2024-09-12T19:23:01.038329+0000","last_clean":"2024-09-12T19:23:01.038329+0000","last_became_active":"2024-09-12T17:29:58.777576+0000","last_became_peered":"2024-09-12T17:29:58.777576+0000","last_unstale":"2024-09-12T19:23:01.038329+0000","last_undegraded":"2024-09-12T19:23:01.038329+0000","last_fullsized":"2024-09-12T19:23:01.038329+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:55.160859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94518,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":881,"num_read_kb":2010,"num_write":710,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.540027+0000","last_change":"2024-09-12T17:30:00.780996+0000","last_active":"2024-09-12T19:20:33.540027+0000","last_peered":"2024-09-12T19:20:33.540027+0000","last_clean":"2024-09-12T19:20:33.540027+0000","last_became_active":"2024-09-12T17:30:00.780193+0000","last_became_peered":"2024-09-12T17:30:00.780193+0000","last_unstale":"2024-09-12T19:20:33.540027+0000","last_undegraded":"2024-09-12T19:20:33.540027+0000","last_fullsized":"2024-09-12T19:20:33.540027+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:54.843536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'166","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.101340+0000","last_change":"2024-09-12T17:30:02.810105+0000","last_active":"2024-09-12T19:21:19.101340+0000","last_peered":"2024-09-12T19:21:19.101340+0000","last_clean":"2024-09-12T19:21:19.101340+0000","last_became_active":"2024-09-12T17:30:02.809357+0000","last_became_peered":"2024-09-12T17:30:02.809357+0000","last_unstale":"2024-09-12T19:21:19.101340+0000","last_undegraded":"2024-09-12T19:21:19.101340+0000","last_fullsized":"2024-09-12T19:21:19.101340+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:26.703985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":287,"num_read_kb":265,"num_write":391,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'1305","reported_seq":2983,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.932579+0000","last_change":"2024-09-12T17:29:54.759425+0000","last_active":"2024-09-12T19:20:27.932579+0000","last_peered":"2024-09-12T19:20:27.932579+0000","last_clean":"2024-09-12T19:20:27.932579+0000","last_became_active":"2024-09-12T17:29:54.758550+0000","last_became_peered":"2024-09-12T17:29:54.758550+0000","last_unstale":"2024-09-12T19:20:27.932579+0000","last_undegraded":"2024-09-12T19:20:27.932579+0000","last_fullsized":"2024-09-12T19:20:27.932579+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:30.793762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6018,"num_read_kb":5333,"num_write":1857,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'258","reported_seq":917,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.257493+0000","last_change":"2024-09-12T17:29:52.767951+0000","last_active":"2024-09-12T19:20:08.257493+0000","last_peered":"2024-09-12T19:20:08.257493+0000","last_clean":"2024-09-12T19:20:08.257493+0000","last_became_active":"2024-09-12T17:29:52.765603+0000","last_became_peered":"2024-09-12T17:29:52.765603+0000","last_unstale":"2024-09-12T19:20:08.257493+0000","last_undegraded":"2024-09-12T19:20:08.257493+0000","last_fullsized":"2024-09-12T19:20:08.257493+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:49.870827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7161968,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":378,"num_read_kb":36052,"num_write":1000,"num_write_kb":37263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.535963+0000","last_change":"2024-09-12T17:29:56.772981+0000","last_active":"2024-09-12T19:20:13.535963+0000","last_peered":"2024-09-12T19:20:13.535963+0000","last_clean":"2024-09-12T19:20:13.535963+0000","last_became_active":"2024-09-12T17:29:56.772580+0000","last_became_peered":"2024-09-12T17:29:56.772580+0000","last_unstale":"2024-09-12T19:20:13.535963+0000","last_undegraded":"2024-09-12T19:20:13.535963+0000","last_fullsized":"2024-09-12T19:20:13.535963+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:40.668767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'332","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.109246+0000","last_change":"2024-09-12T17:29:58.774656+0000","last_active":"2024-09-12T19:23:01.109246+0000","last_peered":"2024-09-12T19:23:01.109246+0000","last_clean":"2024-09-12T19:23:01.109246+0000","last_became_active":"2024-09-12T17:29:58.773869+0000","last_became_peered":"2024-09-12T17:29:58.773869+0000","last_unstale":"2024-09-12T19:23:01.109246+0000","last_undegraded":"2024-09-12T19:23:01.109246+0000","last_fullsized":"2024-09-12T19:23:01.109246+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:05.201058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47005,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":1116,"num_write":486,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:38.195416+0000","last_change":"2024-09-12T17:30:00.779241+0000","last_active":"2024-09-12T19:20:38.195416+0000","last_peered":"2024-09-12T19:20:38.195416+0000","last_clean":"2024-09-12T19:20:38.195416+0000","last_became_active":"2024-09-12T17:30:00.778642+0000","last_became_peered":"2024-09-12T17:30:00.778642+0000","last_unstale":"2024-09-12T19:20:38.195416+0000","last_undegraded":"2024-09-12T19:20:38.195416+0000","last_fullsized":"2024-09-12T19:20:38.195416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:29.538173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'107","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:28.289420+0000","last_change":"2024-09-12T17:30:02.791858+0000","last_active":"2024-09-12T19:22:28.289420+0000","last_peered":"2024-09-12T19:22:28.289420+0000","last_clean":"2024-09-12T19:22:28.289420+0000","last_became_active":"2024-09-12T17:30:02.788612+0000","last_became_peered":"2024-09-12T17:30:02.788612+0000","last_unstale":"2024-09-12T19:22:28.289420+0000","last_undegraded":"2024-09-12T19:22:28.289420+0000","last_fullsized":"2024-09-12T19:22:28.289420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:58.832322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":252,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'362","reported_seq":1817,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.198695+0000","last_change":"2024-09-12T17:29:54.759245+0000","last_active":"2024-09-12T19:20:13.198695+0000","last_peered":"2024-09-12T19:20:13.198695+0000","last_clean":"2024-09-12T19:20:13.198695+0000","last_became_active":"2024-09-12T17:29:54.758311+0000","last_became_peered":"2024-09-12T17:29:54.758311+0000","last_unstale":"2024-09-12T19:20:13.198695+0000","last_undegraded":"2024-09-12T19:20:13.198695+0000","last_fullsized":"2024-09-12T19:20:13.198695+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:22.106256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1918,"num_read_kb":1833,"num_write":390,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'276","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:38.564839+0000","last_change":"2024-09-12T17:29:52.725267+0000","last_active":"2024-09-12T19:20:38.564839+0000","last_peered":"2024-09-12T19:20:38.564839+0000","last_clean":"2024-09-12T19:20:38.564839+0000","last_became_active":"2024-09-12T17:29:52.716965+0000","last_became_peered":"2024-09-12T17:29:52.716965+0000","last_unstale":"2024-09-12T19:20:38.564839+0000","last_undegraded":"2024-09-12T19:20:38.564839+0000","last_fullsized":"2024-09-12T19:20:38.564839+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:28.061496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":941036,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":471,"num_read_kb":1122,"num_write":1043,"num_write_kb":14973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:12.981854+0000","last_change":"2024-09-12T17:29:56.766356+0000","last_active":"2024-09-12T19:20:12.981854+0000","last_peered":"2024-09-12T19:20:12.981854+0000","last_clean":"2024-09-12T19:20:12.981854+0000","last_became_active":"2024-09-12T17:29:56.765057+0000","last_became_peered":"2024-09-12T17:29:56.765057+0000","last_unstale":"2024-09-12T19:20:12.981854+0000","last_undegraded":"2024-09-12T19:20:12.981854+0000","last_fullsized":"2024-09-12T19:20:12.981854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:33.658858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'364","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.249490+0000","last_change":"2024-09-12T17:29:58.772847+0000","last_active":"2024-09-12T19:22:46.249490+0000","last_peered":"2024-09-12T19:22:46.249490+0000","last_clean":"2024-09-12T19:22:46.249490+0000","last_became_active":"2024-09-12T17:29:58.771991+0000","last_became_peered":"2024-09-12T17:29:58.771991+0000","last_unstale":"2024-09-12T19:22:46.249490+0000","last_undegraded":"2024-09-12T19:22:46.249490+0000","last_fullsized":"2024-09-12T19:22:46.249490+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:25.707619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53427,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":587,"num_read_kb":1037,"num_write":454,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'747","reported_seq":5250,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.289539+0000","last_change":"2024-09-12T17:30:00.803339+0000","last_active":"2024-09-12T19:22:46.289539+0000","last_peered":"2024-09-12T19:22:46.289539+0000","last_clean":"2024-09-12T19:22:46.289539+0000","last_became_active":"2024-09-12T17:30:00.802950+0000","last_became_peered":"2024-09-12T17:30:00.802950+0000","last_unstale":"2024-09-12T19:22:46.289539+0000","last_undegraded":"2024-09-12T19:22:46.289539+0000","last_fullsized":"2024-09-12T19:22:46.289539+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":701,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:53.399614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'111","reported_seq":637,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:16.233380+0000","last_change":"2024-09-12T17:30:02.807435+0000","last_active":"2024-09-12T19:21:16.233380+0000","last_peered":"2024-09-12T19:21:16.233380+0000","last_clean":"2024-09-12T19:21:16.233380+0000","last_became_active":"2024-09-12T17:30:02.806621+0000","last_became_peered":"2024-09-12T17:30:02.806621+0000","last_unstale":"2024-09-12T19:21:16.233380+0000","last_undegraded":"2024-09-12T19:21:16.233380+0000","last_fullsized":"2024-09-12T19:21:16.233380+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:28.598520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":276,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'775","reported_seq":2449,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.998604+0000","last_change":"2024-09-12T17:29:54.764077+0000","last_active":"2024-09-12T19:22:44.998604+0000","last_peered":"2024-09-12T19:22:44.998604+0000","last_clean":"2024-09-12T19:22:44.998604+0000","last_became_active":"2024-09-12T17:29:54.763348+0000","last_became_peered":"2024-09-12T17:29:54.763348+0000","last_unstale":"2024-09-12T19:22:44.998604+0000","last_undegraded":"2024-09-12T19:22:44.998604+0000","last_fullsized":"2024-09-12T19:22:44.998604+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:36.252557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4009,"num_read_kb":3654,"num_write":1024,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'307","reported_seq":976,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.868076+0000","last_change":"2024-09-12T17:29:52.752133+0000","last_active":"2024-09-12T19:23:01.868076+0000","last_peered":"2024-09-12T19:23:01.868076+0000","last_clean":"2024-09-12T19:23:01.868076+0000","last_became_active":"2024-09-12T17:29:52.744356+0000","last_became_peered":"2024-09-12T17:29:52.744356+0000","last_unstale":"2024-09-12T19:23:01.868076+0000","last_undegraded":"2024-09-12T19:23:01.868076+0000","last_fullsized":"2024-09-12T19:23:01.868076+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:36.220798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":48689,"num_write":1045,"num_write_kb":32373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1474,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.852068+0000","last_change":"2024-09-12T17:29:56.751658+0000","last_active":"2024-09-12T19:22:58.852068+0000","last_peered":"2024-09-12T19:22:58.852068+0000","last_clean":"2024-09-12T19:22:58.852068+0000","last_became_active":"2024-09-12T17:29:56.750915+0000","last_became_peered":"2024-09-12T17:29:56.750915+0000","last_unstale":"2024-09-12T19:22:58.852068+0000","last_undegraded":"2024-09-12T19:22:58.852068+0000","last_fullsized":"2024-09-12T19:22:58.852068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:54.038362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'146","reported_seq":731,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:49.669036+0000","last_change":"2024-09-12T17:29:58.832618+0000","last_active":"2024-09-12T19:20:49.669036+0000","last_peered":"2024-09-12T19:20:49.669036+0000","last_clean":"2024-09-12T19:20:49.669036+0000","last_became_active":"2024-09-12T17:29:58.831628+0000","last_became_peered":"2024-09-12T17:29:58.831628+0000","last_unstale":"2024-09-12T19:20:49.669036+0000","last_undegraded":"2024-09-12T19:20:49.669036+0000","last_fullsized":"2024-09-12T19:20:49.669036+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:43.249799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'768","reported_seq":3241,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.291879+0000","last_change":"2024-09-12T17:30:00.807629+0000","last_active":"2024-09-12T19:22:46.291879+0000","last_peered":"2024-09-12T19:22:46.291879+0000","last_clean":"2024-09-12T19:22:46.291879+0000","last_became_active":"2024-09-12T17:30:00.806681+0000","last_became_peered":"2024-09-12T17:30:00.806681+0000","last_unstale":"2024-09-12T19:22:46.291879+0000","last_undegraded":"2024-09-12T19:22:46.291879+0000","last_fullsized":"2024-09-12T19:22:46.291879+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":701,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:09.571492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'116","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:14.309491+0000","last_change":"2024-09-12T17:30:02.806772+0000","last_active":"2024-09-12T19:21:14.309491+0000","last_peered":"2024-09-12T19:21:14.309491+0000","last_clean":"2024-09-12T19:21:14.309491+0000","last_became_active":"2024-09-12T17:30:02.805954+0000","last_became_peered":"2024-09-12T17:30:02.805954+0000","last_unstale":"2024-09-12T19:21:14.309491+0000","last_undegraded":"2024-09-12T19:21:14.309491+0000","last_fullsized":"2024-09-12T19:21:14.309491+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:48.506411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":135,"num_write":268,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'519","reported_seq":2056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.988475+0000","last_change":"2024-09-12T17:29:54.755879+0000","last_active":"2024-09-12T19:20:42.988475+0000","last_peered":"2024-09-12T19:20:42.988475+0000","last_clean":"2024-09-12T19:20:42.988475+0000","last_became_active":"2024-09-12T17:29:54.755550+0000","last_became_peered":"2024-09-12T17:29:54.755550+0000","last_unstale":"2024-09-12T19:20:42.988475+0000","last_undegraded":"2024-09-12T19:20:42.988475+0000","last_fullsized":"2024-09-12T19:20:42.988475+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:22.424955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2775,"num_read_kb":2556,"num_write":676,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'313","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262232+0000","last_change":"2024-09-12T17:30:21.696907+0000","last_active":"2024-09-12T19:20:23.262232+0000","last_peered":"2024-09-12T19:20:23.262232+0000","last_clean":"2024-09-12T19:20:23.262232+0000","last_became_active":"2024-09-12T17:30:21.696077+0000","last_became_peered":"2024-09-12T17:30:21.696077+0000","last_unstale":"2024-09-12T19:20:23.262232+0000","last_undegraded":"2024-09-12T19:20:23.262232+0000","last_fullsized":"2024-09-12T19:20:23.262232+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:10.253722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5311480,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":506,"num_read_kb":12866,"num_write":1134,"num_write_kb":34720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.198755+0000","last_change":"2024-09-12T17:29:56.758620+0000","last_active":"2024-09-12T19:20:13.198755+0000","last_peered":"2024-09-12T19:20:13.198755+0000","last_clean":"2024-09-12T19:20:13.198755+0000","last_became_active":"2024-09-12T17:29:56.757728+0000","last_became_peered":"2024-09-12T17:29:56.757728+0000","last_unstale":"2024-09-12T19:20:13.198755+0000","last_undegraded":"2024-09-12T19:20:13.198755+0000","last_fullsized":"2024-09-12T19:20:13.198755+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:39.838154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'417","reported_seq":1095,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:02.001142+0000","last_change":"2024-09-12T17:29:58.776898+0000","last_active":"2024-09-12T19:23:02.001142+0000","last_peered":"2024-09-12T19:23:02.001142+0000","last_clean":"2024-09-12T19:23:02.001142+0000","last_became_active":"2024-09-12T17:29:58.776033+0000","last_became_peered":"2024-09-12T17:29:58.776033+0000","last_unstale":"2024-09-12T19:23:02.001142+0000","last_undegraded":"2024-09-12T19:23:02.001142+0000","last_fullsized":"2024-09-12T19:23:02.001142+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:29.107658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47722,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":665,"num_read_kb":1193,"num_write":496,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:18.560371+0000","last_change":"2024-09-12T17:30:00.793376+0000","last_active":"2024-09-12T19:20:18.560371+0000","last_peered":"2024-09-12T19:20:18.560371+0000","last_clean":"2024-09-12T19:20:18.560371+0000","last_became_active":"2024-09-12T17:30:00.792687+0000","last_became_peered":"2024-09-12T17:30:00.792687+0000","last_unstale":"2024-09-12T19:20:18.560371+0000","last_undegraded":"2024-09-12T19:20:18.560371+0000","last_fullsized":"2024-09-12T19:20:18.560371+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:53.873367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'165","reported_seq":696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.984898+0000","last_change":"2024-09-12T17:30:02.809944+0000","last_active":"2024-09-12T19:20:27.984898+0000","last_peered":"2024-09-12T19:20:27.984898+0000","last_clean":"2024-09-12T19:20:27.984898+0000","last_became_active":"2024-09-12T17:30:02.809252+0000","last_became_peered":"2024-09-12T17:30:02.809252+0000","last_unstale":"2024-09-12T19:20:27.984898+0000","last_undegraded":"2024-09-12T19:20:27.984898+0000","last_fullsized":"2024-09-12T19:20:27.984898+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:42.655346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":242,"num_read_kb":230,"num_write":407,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'457","reported_seq":1883,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:38.564931+0000","last_change":"2024-09-12T17:29:54.773311+0000","last_active":"2024-09-12T19:20:38.564931+0000","last_peered":"2024-09-12T19:20:38.564931+0000","last_clean":"2024-09-12T19:20:38.564931+0000","last_became_active":"2024-09-12T17:29:54.771538+0000","last_became_peered":"2024-09-12T17:29:54.771538+0000","last_unstale":"2024-09-12T19:20:38.564931+0000","last_undegraded":"2024-09-12T19:20:38.564931+0000","last_fullsized":"2024-09-12T19:20:38.564931+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:11.655778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2249,"num_read_kb":2075,"num_write":554,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:52.966096+0000","last_change":"2024-09-12T17:29:30.603974+0000","last_active":"2024-09-12T19:19:52.966096+0000","last_peered":"2024-09-12T19:19:52.966096+0000","last_clean":"2024-09-12T19:19:52.966096+0000","last_became_active":"2024-09-12T17:29:30.601518+0000","last_became_peered":"2024-09-12T17:29:30.601518+0000","last_unstale":"2024-09-12T19:19:52.966096+0000","last_undegraded":"2024-09-12T19:19:52.966096+0000","last_fullsized":"2024-09-12T19:19:52.966096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:29.241459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:29.241459+0000","last_clean_scrub_stamp":"2024-09-12T17:29:29.241459+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:32.039824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":552,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.986642+0000","last_change":"2024-09-12T17:29:37.351871+0000","last_active":"2024-09-12T19:20:02.986642+0000","last_peered":"2024-09-12T19:20:02.986642+0000","last_clean":"2024-09-12T19:20:02.986642+0000","last_became_active":"2024-09-12T17:29:35.340342+0000","last_became_peered":"2024-09-12T17:29:35.340342+0000","last_unstale":"2024-09-12T19:20:02.986642+0000","last_undegraded":"2024-09-12T19:20:02.986642+0000","last_fullsized":"2024-09-12T19:20:02.986642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:04.662413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097602599999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'268","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:18.260770+0000","last_change":"2024-09-12T17:29:52.767042+0000","last_active":"2024-09-12T19:20:18.260770+0000","last_peered":"2024-09-12T19:20:18.260770+0000","last_clean":"2024-09-12T19:20:18.260770+0000","last_became_active":"2024-09-12T17:29:52.765497+0000","last_became_peered":"2024-09-12T17:29:52.765497+0000","last_unstale":"2024-09-12T19:20:18.260770+0000","last_undegraded":"2024-09-12T19:20:18.260770+0000","last_fullsized":"2024-09-12T19:20:18.260770+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:05.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14183958,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":465,"num_read_kb":15769,"num_write":975,"num_write_kb":23964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:22.973720+0000","last_change":"2024-09-12T17:29:56.750663+0000","last_active":"2024-09-12T19:20:22.973720+0000","last_peered":"2024-09-12T19:20:22.973720+0000","last_clean":"2024-09-12T19:20:22.973720+0000","last_became_active":"2024-09-12T17:29:56.749938+0000","last_became_peered":"2024-09-12T17:29:56.749938+0000","last_unstale":"2024-09-12T19:20:22.973720+0000","last_undegraded":"2024-09-12T19:20:22.973720+0000","last_fullsized":"2024-09-12T19:20:22.973720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:42.837901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'798","reported_seq":1542,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.770805+0000","last_change":"2024-09-12T17:29:58.770209+0000","last_active":"2024-09-12T19:23:01.770805+0000","last_peered":"2024-09-12T19:23:01.770805+0000","last_clean":"2024-09-12T19:23:01.770805+0000","last_became_active":"2024-09-12T17:29:58.769277+0000","last_became_peered":"2024-09-12T17:29:58.769277+0000","last_unstale":"2024-09-12T19:23:01.770805+0000","last_undegraded":"2024-09-12T19:23:01.770805+0000","last_fullsized":"2024-09-12T19:23:01.770805+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:07.152072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159898,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1560,"num_read_kb":3538,"num_write":1488,"num_write_kb":1318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.193952+0000","last_change":"2024-09-12T17:30:00.800340+0000","last_active":"2024-09-12T19:20:33.193952+0000","last_peered":"2024-09-12T19:20:33.193952+0000","last_clean":"2024-09-12T19:20:33.193952+0000","last_became_active":"2024-09-12T17:30:00.799883+0000","last_became_peered":"2024-09-12T17:30:00.799883+0000","last_unstale":"2024-09-12T19:20:33.193952+0000","last_undegraded":"2024-09-12T19:20:33.193952+0000","last_fullsized":"2024-09-12T19:20:33.193952+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:44.555994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'197","reported_seq":924,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.519551+0000","last_change":"2024-09-12T17:30:02.800451+0000","last_active":"2024-09-12T19:21:21.519551+0000","last_peered":"2024-09-12T19:21:21.519551+0000","last_clean":"2024-09-12T19:21:21.519551+0000","last_became_active":"2024-09-12T17:30:02.799307+0000","last_became_peered":"2024-09-12T17:30:02.799307+0000","last_unstale":"2024-09-12T19:21:21.519551+0000","last_undegraded":"2024-09-12T19:21:21.519551+0000","last_fullsized":"2024-09-12T19:21:21.519551+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:50.826285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1000,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":467,"num_write":393,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'474","reported_seq":2035,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.192554+0000","last_change":"2024-09-12T17:29:54.758652+0000","last_active":"2024-09-12T19:20:28.192554+0000","last_peered":"2024-09-12T19:20:28.192554+0000","last_clean":"2024-09-12T19:20:28.192554+0000","last_became_active":"2024-09-12T17:29:54.758196+0000","last_became_peered":"2024-09-12T17:29:54.758196+0000","last_unstale":"2024-09-12T19:20:28.192554+0000","last_undegraded":"2024-09-12T19:20:28.192554+0000","last_fullsized":"2024-09-12T19:20:28.192554+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:38.243254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2778,"num_read_kb":2582,"num_write":658,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":552,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.967413+0000","last_change":"2024-09-12T17:29:37.541726+0000","last_active":"2024-09-12T19:19:57.967413+0000","last_peered":"2024-09-12T19:19:57.967413+0000","last_clean":"2024-09-12T19:19:57.967413+0000","last_became_active":"2024-09-12T17:29:35.336475+0000","last_became_peered":"2024-09-12T17:29:35.336475+0000","last_unstale":"2024-09-12T19:19:57.967413+0000","last_undegraded":"2024-09-12T19:19:57.967413+0000","last_fullsized":"2024-09-12T19:19:57.967413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:17.489304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012883599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'346","reported_seq":1071,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.777899+0000","last_change":"2024-09-12T17:29:52.766738+0000","last_active":"2024-09-12T19:23:01.777899+0000","last_peered":"2024-09-12T19:23:01.777899+0000","last_clean":"2024-09-12T19:23:01.777899+0000","last_became_active":"2024-09-12T17:29:52.766251+0000","last_became_peered":"2024-09-12T17:29:52.766251+0000","last_unstale":"2024-09-12T19:23:01.777899+0000","last_undegraded":"2024-09-12T19:23:01.777899+0000","last_fullsized":"2024-09-12T19:23:01.777899+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:37.272387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730134,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":595,"num_read_kb":84420,"num_write":1189,"num_write_kb":23129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.992482+0000","last_change":"2024-09-12T17:29:56.763217+0000","last_active":"2024-09-12T19:20:27.992482+0000","last_peered":"2024-09-12T19:20:27.992482+0000","last_clean":"2024-09-12T19:20:27.992482+0000","last_became_active":"2024-09-12T17:29:56.762451+0000","last_became_peered":"2024-09-12T17:29:56.762451+0000","last_unstale":"2024-09-12T19:20:27.992482+0000","last_undegraded":"2024-09-12T19:20:27.992482+0000","last_fullsized":"2024-09-12T19:20:27.992482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:29.246666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1460","reported_seq":3809,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.692205+0000","last_change":"2024-09-12T17:29:58.772005+0000","last_active":"2024-09-12T19:23:01.692205+0000","last_peered":"2024-09-12T19:23:01.692205+0000","last_clean":"2024-09-12T19:23:01.692205+0000","last_became_active":"2024-09-12T17:29:58.771561+0000","last_became_peered":"2024-09-12T17:29:58.771561+0000","last_unstale":"2024-09-12T19:23:01.692205+0000","last_undegraded":"2024-09-12T19:23:01.692205+0000","last_fullsized":"2024-09-12T19:23:01.692205+0000","mapping_epoch":32,"log_start":"267'1400","ondisk_log_start":"267'1400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:12.774049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146977,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2279,"num_read_kb":4182,"num_write":1388,"num_write_kb":1130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:47.979732+0000","last_change":"2024-09-12T17:30:00.806748+0000","last_active":"2024-09-12T19:20:47.979732+0000","last_peered":"2024-09-12T19:20:47.979732+0000","last_clean":"2024-09-12T19:20:47.979732+0000","last_became_active":"2024-09-12T17:30:00.806030+0000","last_became_peered":"2024-09-12T17:30:00.806030+0000","last_unstale":"2024-09-12T19:20:47.979732+0000","last_undegraded":"2024-09-12T19:20:47.979732+0000","last_fullsized":"2024-09-12T19:20:47.979732+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:16.762914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'217","reported_seq":760,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:18.500162+0000","last_change":"2024-09-12T17:30:02.810034+0000","last_active":"2024-09-12T19:21:18.500162+0000","last_peered":"2024-09-12T19:21:18.500162+0000","last_clean":"2024-09-12T19:21:18.500162+0000","last_became_active":"2024-09-12T17:30:02.809372+0000","last_became_peered":"2024-09-12T17:30:02.809372+0000","last_unstale":"2024-09-12T19:21:18.500162+0000","last_undegraded":"2024-09-12T19:21:18.500162+0000","last_fullsized":"2024-09-12T19:21:18.500162+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:48.796437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":353,"num_read_kb":353,"num_write":469,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'466","reported_seq":2050,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.441742+0000","last_change":"2024-09-12T17:29:54.747544+0000","last_active":"2024-09-12T19:21:21.441742+0000","last_peered":"2024-09-12T19:21:21.441742+0000","last_clean":"2024-09-12T19:21:21.441742+0000","last_became_active":"2024-09-12T17:29:54.747270+0000","last_became_peered":"2024-09-12T17:29:54.747270+0000","last_unstale":"2024-09-12T19:21:21.441742+0000","last_undegraded":"2024-09-12T19:21:21.441742+0000","last_fullsized":"2024-09-12T19:21:21.441742+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:57.930978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2522,"num_read_kb":2358,"num_write":589,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":564,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.533496+0000","last_change":"2024-09-12T17:29:37.348932+0000","last_active":"2024-09-12T19:20:03.533496+0000","last_peered":"2024-09-12T19:20:03.533496+0000","last_clean":"2024-09-12T19:20:03.533496+0000","last_became_active":"2024-09-12T17:29:35.331504+0000","last_became_peered":"2024-09-12T17:29:35.331504+0000","last_unstale":"2024-09-12T19:20:03.533496+0000","last_undegraded":"2024-09-12T19:20:03.533496+0000","last_fullsized":"2024-09-12T19:20:03.533496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:24.198110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001034428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'347","reported_seq":983,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.883682+0000","last_change":"2024-09-12T17:29:52.741712+0000","last_active":"2024-09-12T19:23:01.883682+0000","last_peered":"2024-09-12T19:23:01.883682+0000","last_clean":"2024-09-12T19:23:01.883682+0000","last_became_active":"2024-09-12T17:29:52.741209+0000","last_became_peered":"2024-09-12T17:29:52.741209+0000","last_unstale":"2024-09-12T19:23:01.883682+0000","last_undegraded":"2024-09-12T19:23:01.883682+0000","last_fullsized":"2024-09-12T19:23:01.883682+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:54.967025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":451,"num_read_kb":5499,"num_write":979,"num_write_kb":15070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.539110+0000","last_change":"2024-09-12T17:29:56.753741+0000","last_active":"2024-09-12T19:20:28.539110+0000","last_peered":"2024-09-12T19:20:28.539110+0000","last_clean":"2024-09-12T19:20:28.539110+0000","last_became_active":"2024-09-12T17:29:56.753063+0000","last_became_peered":"2024-09-12T17:29:56.753063+0000","last_unstale":"2024-09-12T19:20:28.539110+0000","last_undegraded":"2024-09-12T19:20:28.539110+0000","last_fullsized":"2024-09-12T19:20:28.539110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:26.088728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'367","reported_seq":2316,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.478760+0000","last_change":"2024-09-12T17:29:58.835335+0000","last_active":"2024-09-12T19:22:46.478760+0000","last_peered":"2024-09-12T19:22:46.478760+0000","last_clean":"2024-09-12T19:22:46.478760+0000","last_became_active":"2024-09-12T17:29:58.834447+0000","last_became_peered":"2024-09-12T17:29:58.834447+0000","last_unstale":"2024-09-12T19:22:46.478760+0000","last_undegraded":"2024-09-12T19:22:46.478760+0000","last_fullsized":"2024-09-12T19:22:46.478760+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:10.184300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":368,"num_read_kb":360,"num_write":359,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.192453+0000","last_change":"2024-09-12T17:30:00.778895+0000","last_active":"2024-09-12T19:20:28.192453+0000","last_peered":"2024-09-12T19:20:28.192453+0000","last_clean":"2024-09-12T19:20:28.192453+0000","last_became_active":"2024-09-12T17:30:00.778134+0000","last_became_peered":"2024-09-12T17:30:00.778134+0000","last_unstale":"2024-09-12T19:20:28.192453+0000","last_undegraded":"2024-09-12T19:20:28.192453+0000","last_fullsized":"2024-09-12T19:20:28.192453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:40.692916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'270","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:22.003400+0000","last_change":"2024-09-12T17:30:02.805738+0000","last_active":"2024-09-12T19:21:22.003400+0000","last_peered":"2024-09-12T19:21:22.003400+0000","last_clean":"2024-09-12T19:21:22.003400+0000","last_became_active":"2024-09-12T17:30:02.805090+0000","last_became_peered":"2024-09-12T17:30:02.805090+0000","last_unstale":"2024-09-12T19:21:22.003400+0000","last_undegraded":"2024-09-12T19:21:22.003400+0000","last_fullsized":"2024-09-12T19:21:22.003400+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:19.612013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":596,"num_read_kb":605,"num_write":610,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'409","reported_seq":1956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.029492+0000","last_change":"2024-09-12T17:29:54.745943+0000","last_active":"2024-09-12T19:22:45.029492+0000","last_peered":"2024-09-12T19:22:45.029492+0000","last_clean":"2024-09-12T19:22:45.029492+0000","last_became_active":"2024-09-12T17:29:54.745423+0000","last_became_peered":"2024-09-12T17:29:54.745423+0000","last_unstale":"2024-09-12T19:22:45.029492+0000","last_undegraded":"2024-09-12T19:22:45.029492+0000","last_fullsized":"2024-09-12T19:22:45.029492+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:49.009438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2154,"num_read_kb":2073,"num_write":474,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":553,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.986585+0000","last_change":"2024-09-12T17:29:37.352917+0000","last_active":"2024-09-12T19:20:02.986585+0000","last_peered":"2024-09-12T19:20:02.986585+0000","last_clean":"2024-09-12T19:20:02.986585+0000","last_became_active":"2024-09-12T17:29:35.340113+0000","last_became_peered":"2024-09-12T17:29:35.340113+0000","last_unstale":"2024-09-12T19:20:02.986585+0000","last_undegraded":"2024-09-12T19:20:02.986585+0000","last_fullsized":"2024-09-12T19:20:02.986585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:23.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020086050000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'366","reported_seq":1114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.974429+0000","last_change":"2024-09-12T17:29:52.760726+0000","last_active":"2024-09-12T19:23:01.974429+0000","last_peered":"2024-09-12T19:23:01.974429+0000","last_clean":"2024-09-12T19:23:01.974429+0000","last_became_active":"2024-09-12T17:29:52.759957+0000","last_became_peered":"2024-09-12T17:29:52.759957+0000","last_unstale":"2024-09-12T19:23:01.974429+0000","last_undegraded":"2024-09-12T19:23:01.974429+0000","last_fullsized":"2024-09-12T19:23:01.974429+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:47.608386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279708,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":651,"num_read_kb":39253,"num_write":1178,"num_write_kb":45869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:43.196821+0000","last_change":"2024-09-12T17:29:56.766428+0000","last_active":"2024-09-12T19:20:43.196821+0000","last_peered":"2024-09-12T19:20:43.196821+0000","last_clean":"2024-09-12T19:20:43.196821+0000","last_became_active":"2024-09-12T17:29:56.765361+0000","last_became_peered":"2024-09-12T17:29:56.765361+0000","last_unstale":"2024-09-12T19:20:43.196821+0000","last_undegraded":"2024-09-12T19:20:43.196821+0000","last_fullsized":"2024-09-12T19:20:43.196821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:24.942838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'210","reported_seq":825,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:43.293295+0000","last_change":"2024-09-12T17:29:58.769020+0000","last_active":"2024-09-12T19:22:43.293295+0000","last_peered":"2024-09-12T19:22:43.293295+0000","last_clean":"2024-09-12T19:22:43.293295+0000","last_became_active":"2024-09-12T17:29:58.768596+0000","last_became_peered":"2024-09-12T17:29:58.768596+0000","last_unstale":"2024-09-12T19:22:43.293295+0000","last_undegraded":"2024-09-12T19:22:43.293295+0000","last_fullsized":"2024-09-12T19:22:43.293295+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:34.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.563828+0000","last_change":"2024-09-12T17:30:00.790648+0000","last_active":"2024-09-12T19:20:33.563828+0000","last_peered":"2024-09-12T19:20:33.563828+0000","last_clean":"2024-09-12T19:20:33.563828+0000","last_became_active":"2024-09-12T17:30:00.788505+0000","last_became_peered":"2024-09-12T17:30:00.788505+0000","last_unstale":"2024-09-12T19:20:33.563828+0000","last_undegraded":"2024-09-12T19:20:33.563828+0000","last_fullsized":"2024-09-12T19:20:33.563828+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:54.847829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'156","reported_seq":736,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.643106+0000","last_change":"2024-09-12T17:30:02.795566+0000","last_active":"2024-09-12T19:22:44.643106+0000","last_peered":"2024-09-12T19:22:44.643106+0000","last_clean":"2024-09-12T19:22:44.643106+0000","last_became_active":"2024-09-12T17:30:02.794703+0000","last_became_peered":"2024-09-12T17:30:02.794703+0000","last_unstale":"2024-09-12T19:22:44.643106+0000","last_undegraded":"2024-09-12T19:22:44.643106+0000","last_fullsized":"2024-09-12T19:22:44.643106+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:19.673266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":268,"num_read_kb":254,"num_write":347,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'419","reported_seq":2016,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:22.983809+0000","last_change":"2024-09-12T17:29:54.766600+0000","last_active":"2024-09-12T19:20:22.983809+0000","last_peered":"2024-09-12T19:20:22.983809+0000","last_clean":"2024-09-12T19:20:22.983809+0000","last_became_active":"2024-09-12T17:29:54.766275+0000","last_became_peered":"2024-09-12T17:29:54.766275+0000","last_unstale":"2024-09-12T19:20:22.983809+0000","last_undegraded":"2024-09-12T19:20:22.983809+0000","last_fullsized":"2024-09-12T19:20:22.983809+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:40.431193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2280,"num_read_kb":2171,"num_write":482,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'349","reported_seq":1026,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.969892+0000","last_change":"2024-09-12T17:29:52.741487+0000","last_active":"2024-09-12T19:23:01.969892+0000","last_peered":"2024-09-12T19:23:01.969892+0000","last_clean":"2024-09-12T19:23:01.969892+0000","last_became_active":"2024-09-12T17:29:52.740544+0000","last_became_peered":"2024-09-12T17:29:52.740544+0000","last_unstale":"2024-09-12T19:23:01.969892+0000","last_undegraded":"2024-09-12T19:23:01.969892+0000","last_fullsized":"2024-09-12T19:23:01.969892+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:29.317350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":6019,"num_write":1130,"num_write_kb":22769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":554,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.979639+0000","last_change":"2024-09-12T17:29:37.346858+0000","last_active":"2024-09-12T19:20:02.979639+0000","last_peered":"2024-09-12T19:20:02.979639+0000","last_clean":"2024-09-12T19:20:02.979639+0000","last_became_active":"2024-09-12T17:29:35.407492+0000","last_became_peered":"2024-09-12T17:29:35.407492+0000","last_unstale":"2024-09-12T19:20:02.979639+0000","last_undegraded":"2024-09-12T19:20:02.979639+0000","last_fullsized":"2024-09-12T19:20:02.979639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:34.824127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098134900000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.191284+0000","last_change":"2024-09-12T17:29:56.769832+0000","last_active":"2024-09-12T19:20:23.191284+0000","last_peered":"2024-09-12T19:20:23.191284+0000","last_clean":"2024-09-12T19:20:23.191284+0000","last_became_active":"2024-09-12T17:29:56.769344+0000","last_became_peered":"2024-09-12T17:29:56.769344+0000","last_unstale":"2024-09-12T19:20:23.191284+0000","last_undegraded":"2024-09-12T19:20:23.191284+0000","last_fullsized":"2024-09-12T19:20:23.191284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:05.381579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'763","reported_seq":1503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.624058+0000","last_change":"2024-09-12T17:29:58.776516+0000","last_active":"2024-09-12T19:23:01.624058+0000","last_peered":"2024-09-12T19:23:01.624058+0000","last_clean":"2024-09-12T19:23:01.624058+0000","last_became_active":"2024-09-12T17:29:58.766353+0000","last_became_peered":"2024-09-12T17:29:58.766353+0000","last_unstale":"2024-09-12T19:23:01.624058+0000","last_undegraded":"2024-09-12T19:23:01.624058+0000","last_fullsized":"2024-09-12T19:23:01.624058+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:35.937627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88446,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1874,"num_read_kb":3148,"num_write":2424,"num_write_kb":2173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.202330+0000","last_change":"2024-09-12T17:30:00.784218+0000","last_active":"2024-09-12T19:20:28.202330+0000","last_peered":"2024-09-12T19:20:28.202330+0000","last_clean":"2024-09-12T19:20:28.202330+0000","last_became_active":"2024-09-12T17:30:00.783385+0000","last_became_peered":"2024-09-12T17:30:00.783385+0000","last_unstale":"2024-09-12T19:20:28.202330+0000","last_undegraded":"2024-09-12T19:20:28.202330+0000","last_fullsized":"2024-09-12T19:20:28.202330+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:44.877583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'143","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:14.315826+0000","last_change":"2024-09-12T17:30:02.806515+0000","last_active":"2024-09-12T19:21:14.315826+0000","last_peered":"2024-09-12T19:21:14.315826+0000","last_clean":"2024-09-12T19:21:14.315826+0000","last_became_active":"2024-09-12T17:30:02.805684+0000","last_became_peered":"2024-09-12T17:30:02.805684+0000","last_unstale":"2024-09-12T19:21:14.315826+0000","last_undegraded":"2024-09-12T19:21:14.315826+0000","last_fullsized":"2024-09-12T19:21:14.315826+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:50.293983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":165,"num_read_kb":163,"num_write":341,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'404","reported_seq":1905,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.896908+0000","last_change":"2024-09-12T17:29:54.758506+0000","last_active":"2024-09-12T19:21:55.896908+0000","last_peered":"2024-09-12T19:21:55.896908+0000","last_clean":"2024-09-12T19:21:55.896908+0000","last_became_active":"2024-09-12T17:29:54.758047+0000","last_became_peered":"2024-09-12T17:29:54.758047+0000","last_unstale":"2024-09-12T19:21:55.896908+0000","last_undegraded":"2024-09-12T19:21:55.896908+0000","last_fullsized":"2024-09-12T19:21:55.896908+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:06.718970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2269,"num_read_kb":2144,"num_write":466,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'307","reported_seq":1185,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.919860+0000","last_change":"2024-09-12T17:29:52.728144+0000","last_active":"2024-09-12T19:23:01.919860+0000","last_peered":"2024-09-12T19:23:01.919860+0000","last_clean":"2024-09-12T19:23:01.919860+0000","last_became_active":"2024-09-12T17:29:52.727635+0000","last_became_peered":"2024-09-12T17:29:52.727635+0000","last_unstale":"2024-09-12T19:23:01.919860+0000","last_undegraded":"2024-09-12T19:23:01.919860+0000","last_fullsized":"2024-09-12T19:23:01.919860+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:03.775561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109709,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":897,"num_read_kb":32569,"num_write":1024,"num_write_kb":39553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":550,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:22.973772+0000","last_change":"2024-09-12T17:29:37.541831+0000","last_active":"2024-09-12T19:20:22.973772+0000","last_peered":"2024-09-12T19:20:22.973772+0000","last_clean":"2024-09-12T19:20:22.973772+0000","last_became_active":"2024-09-12T17:29:35.406653+0000","last_became_peered":"2024-09-12T17:29:35.406653+0000","last_unstale":"2024-09-12T19:20:22.973772+0000","last_undegraded":"2024-09-12T19:20:22.973772+0000","last_fullsized":"2024-09-12T19:20:22.973772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:04.148521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001315566,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.561483+0000","last_change":"2024-09-12T17:29:56.770303+0000","last_active":"2024-09-12T19:20:23.561483+0000","last_peered":"2024-09-12T19:20:23.561483+0000","last_clean":"2024-09-12T19:20:23.561483+0000","last_became_active":"2024-09-12T17:29:56.769576+0000","last_became_peered":"2024-09-12T17:29:56.769576+0000","last_unstale":"2024-09-12T19:20:23.561483+0000","last_undegraded":"2024-09-12T19:20:23.561483+0000","last_fullsized":"2024-09-12T19:20:23.561483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:04.267964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'337","reported_seq":976,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:29.216151+0000","last_change":"2024-09-12T17:29:58.831755+0000","last_active":"2024-09-12T19:21:29.216151+0000","last_peered":"2024-09-12T19:21:29.216151+0000","last_clean":"2024-09-12T19:21:29.216151+0000","last_became_active":"2024-09-12T17:29:58.830993+0000","last_became_peered":"2024-09-12T17:29:58.830993+0000","last_unstale":"2024-09-12T19:21:29.216151+0000","last_undegraded":"2024-09-12T19:21:29.216151+0000","last_fullsized":"2024-09-12T19:21:29.216151+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:47.520303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":439,"num_read_kb":430,"num_write":418,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'791","reported_seq":3373,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.882999+0000","last_change":"2024-09-12T17:30:00.805745+0000","last_active":"2024-09-12T19:22:58.882999+0000","last_peered":"2024-09-12T19:22:58.882999+0000","last_clean":"2024-09-12T19:22:58.882999+0000","last_became_active":"2024-09-12T17:30:00.805059+0000","last_became_peered":"2024-09-12T17:30:00.805059+0000","last_unstale":"2024-09-12T19:22:58.882999+0000","last_undegraded":"2024-09-12T19:22:58.882999+0000","last_fullsized":"2024-09-12T19:22:58.882999+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":701,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:20.515894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'134","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.261254+0000","last_change":"2024-09-12T17:30:02.805558+0000","last_active":"2024-09-12T19:22:46.261254+0000","last_peered":"2024-09-12T19:22:46.261254+0000","last_clean":"2024-09-12T19:22:46.261254+0000","last_became_active":"2024-09-12T17:30:02.803051+0000","last_became_peered":"2024-09-12T17:30:02.803051+0000","last_unstale":"2024-09-12T19:22:46.261254+0000","last_undegraded":"2024-09-12T19:22:46.261254+0000","last_fullsized":"2024-09-12T19:22:46.261254+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:30.608707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":726,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":188,"num_read_kb":177,"num_write":312,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'427","reported_seq":1967,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262257+0000","last_change":"2024-09-12T17:29:54.762856+0000","last_active":"2024-09-12T19:20:23.262257+0000","last_peered":"2024-09-12T19:20:23.262257+0000","last_clean":"2024-09-12T19:20:23.262257+0000","last_became_active":"2024-09-12T17:29:54.762522+0000","last_became_peered":"2024-09-12T17:29:54.762522+0000","last_unstale":"2024-09-12T19:20:23.262257+0000","last_undegraded":"2024-09-12T19:20:23.262257+0000","last_fullsized":"2024-09-12T19:20:23.262257+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:33.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2273,"num_read_kb":2141,"num_write":510,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'241","reported_seq":869,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:38.915328+0000","last_change":"2024-09-12T17:29:52.716685+0000","last_active":"2024-09-12T19:22:38.915328+0000","last_peered":"2024-09-12T19:22:38.915328+0000","last_clean":"2024-09-12T19:22:38.915328+0000","last_became_active":"2024-09-12T17:29:52.716210+0000","last_became_peered":"2024-09-12T17:29:52.716210+0000","last_unstale":"2024-09-12T19:22:38.915328+0000","last_undegraded":"2024-09-12T19:22:38.915328+0000","last_fullsized":"2024-09-12T19:22:38.915328+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:59.907663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243543,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":327,"num_read_kb":381,"num_write":871,"num_write_kb":30307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":552,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:07.980821+0000","last_change":"2024-09-12T17:29:37.346714+0000","last_active":"2024-09-12T19:20:07.980821+0000","last_peered":"2024-09-12T19:20:07.980821+0000","last_clean":"2024-09-12T19:20:07.980821+0000","last_became_active":"2024-09-12T17:29:35.337987+0000","last_became_peered":"2024-09-12T17:29:35.337987+0000","last_unstale":"2024-09-12T19:20:07.980821+0000","last_undegraded":"2024-09-12T19:20:07.980821+0000","last_fullsized":"2024-09-12T19:20:07.980821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:46.254256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011496340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"38'3","reported_seq":1014,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.839940+0000","last_change":"2024-09-12T17:29:56.756687+0000","last_active":"2024-09-12T19:22:58.839940+0000","last_peered":"2024-09-12T19:22:58.839940+0000","last_clean":"2024-09-12T19:22:58.839940+0000","last_became_active":"2024-09-12T17:29:56.754415+0000","last_became_peered":"2024-09-12T17:29:56.754415+0000","last_unstale":"2024-09-12T19:22:58.839940+0000","last_undegraded":"2024-09-12T19:22:58.839940+0000","last_fullsized":"2024-09-12T19:22:58.839940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:14.164674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'175","reported_seq":781,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:52.559741+0000","last_change":"2024-09-12T17:29:58.767652+0000","last_active":"2024-09-12T19:20:52.559741+0000","last_peered":"2024-09-12T19:20:52.559741+0000","last_clean":"2024-09-12T19:20:52.559741+0000","last_became_active":"2024-09-12T17:29:58.766420+0000","last_became_peered":"2024-09-12T17:29:58.766420+0000","last_unstale":"2024-09-12T19:20:52.559741+0000","last_undegraded":"2024-09-12T19:20:52.559741+0000","last_fullsized":"2024-09-12T19:20:52.559741+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:24.045295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":231,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'814","reported_seq":5001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.293341+0000","last_change":"2024-09-12T17:30:00.796740+0000","last_active":"2024-09-12T19:22:46.293341+0000","last_peered":"2024-09-12T19:22:46.293341+0000","last_clean":"2024-09-12T19:22:46.293341+0000","last_became_active":"2024-09-12T17:30:00.793234+0000","last_became_peered":"2024-09-12T17:30:00.793234+0000","last_unstale":"2024-09-12T19:22:46.293341+0000","last_undegraded":"2024-09-12T19:22:46.293341+0000","last_fullsized":"2024-09-12T19:22:46.293341+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:52.398488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'186","reported_seq":723,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:17.279016+0000","last_change":"2024-09-12T17:30:02.800748+0000","last_active":"2024-09-12T19:21:17.279016+0000","last_peered":"2024-09-12T19:21:17.279016+0000","last_clean":"2024-09-12T19:21:17.279016+0000","last_became_active":"2024-09-12T17:30:02.799944+0000","last_became_peered":"2024-09-12T17:30:02.799944+0000","last_unstale":"2024-09-12T19:21:17.279016+0000","last_undegraded":"2024-09-12T19:21:17.279016+0000","last_fullsized":"2024-09-12T19:21:17.279016+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:37.045857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":199,"num_read_kb":188,"num_write":423,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'1235","reported_seq":2851,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.201038+0000","last_change":"2024-09-12T17:29:54.753103+0000","last_active":"2024-09-12T19:20:23.201038+0000","last_peered":"2024-09-12T19:20:23.201038+0000","last_clean":"2024-09-12T19:20:23.201038+0000","last_became_active":"2024-09-12T17:29:54.751931+0000","last_became_peered":"2024-09-12T17:29:54.751931+0000","last_unstale":"2024-09-12T19:20:23.201038+0000","last_undegraded":"2024-09-12T19:20:23.201038+0000","last_fullsized":"2024-09-12T19:20:23.201038+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":1200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:55.642337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5667,"num_read_kb":5016,"num_write":1745,"num_write_kb":765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'270","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.516108+0000","last_change":"2024-09-12T17:30:21.698110+0000","last_active":"2024-09-12T19:18:43.516108+0000","last_peered":"2024-09-12T19:18:43.516108+0000","last_clean":"2024-09-12T19:18:43.516108+0000","last_became_active":"2024-09-12T17:30:21.697470+0000","last_became_peered":"2024-09-12T17:30:21.697470+0000","last_unstale":"2024-09-12T19:18:43.516108+0000","last_undegraded":"2024-09-12T19:18:43.516108+0000","last_fullsized":"2024-09-12T19:18:43.516108+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:17.468181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13170,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":380,"num_read_kb":2583,"num_write":988,"num_write_kb":28824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":552,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.558253+0000","last_change":"2024-09-12T17:29:37.541991+0000","last_active":"2024-09-12T19:20:08.558253+0000","last_peered":"2024-09-12T19:20:08.558253+0000","last_clean":"2024-09-12T19:20:08.558253+0000","last_became_active":"2024-09-12T17:29:35.337998+0000","last_became_peered":"2024-09-12T17:29:35.337998+0000","last_unstale":"2024-09-12T19:20:08.558253+0000","last_undegraded":"2024-09-12T19:20:08.558253+0000","last_fullsized":"2024-09-12T19:20:08.558253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:23.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011850280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262198+0000","last_change":"2024-09-12T17:29:56.761573+0000","last_active":"2024-09-12T19:20:23.262198+0000","last_peered":"2024-09-12T19:20:23.262198+0000","last_clean":"2024-09-12T19:20:23.262198+0000","last_became_active":"2024-09-12T17:29:56.760822+0000","last_became_peered":"2024-09-12T17:29:56.760822+0000","last_unstale":"2024-09-12T19:20:23.262198+0000","last_undegraded":"2024-09-12T19:20:23.262198+0000","last_fullsized":"2024-09-12T19:20:23.262198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:48.200758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'808","reported_seq":1589,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.852202+0000","last_change":"2024-09-12T17:29:58.831322+0000","last_active":"2024-09-12T19:23:01.852202+0000","last_peered":"2024-09-12T19:23:01.852202+0000","last_clean":"2024-09-12T19:23:01.852202+0000","last_became_active":"2024-09-12T17:29:58.830605+0000","last_became_peered":"2024-09-12T17:29:58.830605+0000","last_unstale":"2024-09-12T19:23:01.852202+0000","last_undegraded":"2024-09-12T19:23:01.852202+0000","last_fullsized":"2024-09-12T19:23:01.852202+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:34.715340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138319,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1432,"num_read_kb":3265,"num_write":1150,"num_write_kb":898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.263615+0000","last_change":"2024-09-12T17:30:00.810969+0000","last_active":"2024-09-12T19:20:28.263615+0000","last_peered":"2024-09-12T19:20:28.263615+0000","last_clean":"2024-09-12T19:20:28.263615+0000","last_became_active":"2024-09-12T17:30:00.810341+0000","last_became_peered":"2024-09-12T17:30:00.810341+0000","last_unstale":"2024-09-12T19:20:28.263615+0000","last_undegraded":"2024-09-12T19:20:28.263615+0000","last_fullsized":"2024-09-12T19:20:28.263615+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:02.611552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'162","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:17.990022+0000","last_change":"2024-09-12T17:30:02.787340+0000","last_active":"2024-09-12T19:20:17.990022+0000","last_peered":"2024-09-12T19:20:17.990022+0000","last_clean":"2024-09-12T19:20:17.990022+0000","last_became_active":"2024-09-12T17:30:02.786443+0000","last_became_peered":"2024-09-12T17:30:02.786443+0000","last_unstale":"2024-09-12T19:20:17.990022+0000","last_undegraded":"2024-09-12T19:20:17.990022+0000","last_fullsized":"2024-09-12T19:20:17.990022+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:16.833731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":311,"num_read_kb":271,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'112","reported_seq":698,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.907333+0000","last_change":"2024-09-12T17:30:02.805626+0000","last_active":"2024-09-12T19:21:21.907333+0000","last_peered":"2024-09-12T19:21:21.907333+0000","last_clean":"2024-09-12T19:21:21.907333+0000","last_became_active":"2024-09-12T17:30:02.801038+0000","last_became_peered":"2024-09-12T17:30:02.801038+0000","last_unstale":"2024-09-12T19:21:21.907333+0000","last_undegraded":"2024-09-12T19:21:21.907333+0000","last_fullsized":"2024-09-12T19:21:21.907333+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:20.200364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":212,"num_write":265,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'453","reported_seq":2036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.190526+0000","last_change":"2024-09-12T17:29:54.761528+0000","last_active":"2024-09-12T19:19:38.190526+0000","last_peered":"2024-09-12T19:19:38.190526+0000","last_clean":"2024-09-12T19:19:38.190526+0000","last_became_active":"2024-09-12T17:29:54.760809+0000","last_became_peered":"2024-09-12T17:29:54.760809+0000","last_unstale":"2024-09-12T19:19:38.190526+0000","last_undegraded":"2024-09-12T19:19:38.190526+0000","last_fullsized":"2024-09-12T19:19:38.190526+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:31.018358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2369,"num_read_kb":2229,"num_write":528,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'332","reported_seq":1034,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.885305+0000","last_change":"2024-09-12T17:29:52.761032+0000","last_active":"2024-09-12T19:23:01.885305+0000","last_peered":"2024-09-12T19:23:01.885305+0000","last_clean":"2024-09-12T19:23:01.885305+0000","last_became_active":"2024-09-12T17:29:52.760432+0000","last_became_peered":"2024-09-12T17:29:52.760432+0000","last_unstale":"2024-09-12T19:23:01.885305+0000","last_undegraded":"2024-09-12T19:23:01.885305+0000","last_fullsized":"2024-09-12T19:23:01.885305+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:17.695625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":31499,"num_write":1138,"num_write_kb":37455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.973687+0000","last_change":"2024-09-12T17:29:56.766527+0000","last_active":"2024-09-12T19:19:37.973687+0000","last_peered":"2024-09-12T19:19:37.973687+0000","last_clean":"2024-09-12T19:19:37.973687+0000","last_became_active":"2024-09-12T17:29:56.765656+0000","last_became_peered":"2024-09-12T17:29:56.765656+0000","last_unstale":"2024-09-12T19:19:37.973687+0000","last_undegraded":"2024-09-12T19:19:37.973687+0000","last_fullsized":"2024-09-12T19:19:37.973687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:02.895743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'307","reported_seq":935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:03.285342+0000","last_change":"2024-09-12T17:29:58.778689+0000","last_active":"2024-09-12T19:22:03.285342+0000","last_peered":"2024-09-12T19:22:03.285342+0000","last_clean":"2024-09-12T19:22:03.285342+0000","last_became_active":"2024-09-12T17:29:58.777997+0000","last_became_peered":"2024-09-12T17:29:58.777997+0000","last_unstale":"2024-09-12T19:22:03.285342+0000","last_undegraded":"2024-09-12T19:22:03.285342+0000","last_fullsized":"2024-09-12T19:22:03.285342+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:11.474675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":480,"num_read_kb":893,"num_write":370,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:43.251258+0000","last_change":"2024-09-12T17:30:00.794010+0000","last_active":"2024-09-12T19:19:43.251258+0000","last_peered":"2024-09-12T19:19:43.251258+0000","last_clean":"2024-09-12T19:19:43.251258+0000","last_became_active":"2024-09-12T17:30:00.793204+0000","last_became_peered":"2024-09-12T17:30:00.793204+0000","last_unstale":"2024-09-12T19:19:43.251258+0000","last_undegraded":"2024-09-12T19:19:43.251258+0000","last_fullsized":"2024-09-12T19:19:43.251258+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:53.881334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'108","reported_seq":638,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.263789+0000","last_change":"2024-09-12T17:30:02.790200+0000","last_active":"2024-09-12T19:20:28.263789+0000","last_peered":"2024-09-12T19:20:28.263789+0000","last_clean":"2024-09-12T19:20:28.263789+0000","last_became_active":"2024-09-12T17:30:02.789511+0000","last_became_peered":"2024-09-12T17:30:02.789511+0000","last_unstale":"2024-09-12T19:20:28.263789+0000","last_undegraded":"2024-09-12T19:20:28.263789+0000","last_fullsized":"2024-09-12T19:20:28.263789+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:57.833180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":267,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'1080","reported_seq":2628,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.973714+0000","last_change":"2024-09-12T17:29:54.774595+0000","last_active":"2024-09-12T19:19:37.973714+0000","last_peered":"2024-09-12T19:19:37.973714+0000","last_clean":"2024-09-12T19:19:37.973714+0000","last_became_active":"2024-09-12T17:29:54.774337+0000","last_became_peered":"2024-09-12T17:29:54.774337+0000","last_unstale":"2024-09-12T19:19:37.973714+0000","last_undegraded":"2024-09-12T19:19:37.973714+0000","last_fullsized":"2024-09-12T19:19:37.973714+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":1000,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:59.476733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5006,"num_read_kb":4447,"num_write":1496,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'343","reported_seq":1038,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.907118+0000","last_change":"2024-09-12T17:29:52.763186+0000","last_active":"2024-09-12T19:23:01.907118+0000","last_peered":"2024-09-12T19:23:01.907118+0000","last_clean":"2024-09-12T19:23:01.907118+0000","last_became_active":"2024-09-12T17:29:52.757775+0000","last_became_peered":"2024-09-12T17:29:52.757775+0000","last_unstale":"2024-09-12T19:23:01.907118+0000","last_undegraded":"2024-09-12T19:23:01.907118+0000","last_fullsized":"2024-09-12T19:23:01.907118+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:36.685627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399166,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":510,"num_read_kb":111933,"num_write":1035,"num_write_kb":43950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.250268+0000","last_change":"2024-09-12T17:29:56.771395+0000","last_active":"2024-09-12T19:19:38.250268+0000","last_peered":"2024-09-12T19:19:38.250268+0000","last_clean":"2024-09-12T19:19:38.250268+0000","last_became_active":"2024-09-12T17:29:56.770639+0000","last_became_peered":"2024-09-12T17:29:56.770639+0000","last_unstale":"2024-09-12T19:19:38.250268+0000","last_undegraded":"2024-09-12T19:19:38.250268+0000","last_fullsized":"2024-09-12T19:19:38.250268+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:05.853569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'78","reported_seq":622,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:41.373097+0000","last_change":"2024-09-12T17:29:58.782766+0000","last_active":"2024-09-12T19:20:41.373097+0000","last_peered":"2024-09-12T19:20:41.373097+0000","last_clean":"2024-09-12T19:20:41.373097+0000","last_became_active":"2024-09-12T17:29:58.781731+0000","last_became_peered":"2024-09-12T17:29:58.781731+0000","last_unstale":"2024-09-12T19:20:41.373097+0000","last_undegraded":"2024-09-12T19:20:41.373097+0000","last_fullsized":"2024-09-12T19:20:41.373097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:49.979279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":73,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:42.963782+0000","last_change":"2024-09-12T17:30:00.801153+0000","last_active":"2024-09-12T19:19:42.963782+0000","last_peered":"2024-09-12T19:19:42.963782+0000","last_clean":"2024-09-12T19:19:42.963782+0000","last_became_active":"2024-09-12T17:30:00.799588+0000","last_became_peered":"2024-09-12T17:30:00.799588+0000","last_unstale":"2024-09-12T19:19:42.963782+0000","last_undegraded":"2024-09-12T19:19:42.963782+0000","last_fullsized":"2024-09-12T19:19:42.963782+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:18.930813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'191","reported_seq":733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.175915+0000","last_change":"2024-09-12T17:30:02.814008+0000","last_active":"2024-09-12T19:21:19.175915+0000","last_peered":"2024-09-12T19:21:19.175915+0000","last_clean":"2024-09-12T19:21:19.175915+0000","last_became_active":"2024-09-12T17:30:02.813284+0000","last_became_peered":"2024-09-12T17:30:02.813284+0000","last_unstale":"2024-09-12T19:21:19.175915+0000","last_undegraded":"2024-09-12T19:21:19.175915+0000","last_fullsized":"2024-09-12T19:21:19.175915+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:56.023655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":312,"num_read_kb":310,"num_write":442,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'824","reported_seq":2436,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:53.595775+0000","last_change":"2024-09-12T17:29:54.763134+0000","last_active":"2024-09-12T19:19:53.595775+0000","last_peered":"2024-09-12T19:19:53.595775+0000","last_clean":"2024-09-12T19:19:53.595775+0000","last_became_active":"2024-09-12T17:29:54.762793+0000","last_became_peered":"2024-09-12T17:29:54.762793+0000","last_unstale":"2024-09-12T19:19:53.595775+0000","last_undegraded":"2024-09-12T19:19:53.595775+0000","last_fullsized":"2024-09-12T19:19:53.595775+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:54.833462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3973,"num_read_kb":3581,"num_write":1093,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'282","reported_seq":905,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:00.877399+0000","last_change":"2024-09-12T17:30:21.692800+0000","last_active":"2024-09-12T19:20:00.877399+0000","last_peered":"2024-09-12T19:20:00.877399+0000","last_clean":"2024-09-12T19:20:00.877399+0000","last_became_active":"2024-09-12T17:30:21.692338+0000","last_became_peered":"2024-09-12T17:30:21.692338+0000","last_unstale":"2024-09-12T19:20:00.877399+0000","last_undegraded":"2024-09-12T19:20:00.877399+0000","last_fullsized":"2024-09-12T19:20:00.877399+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:01.217885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2256591,"num_objects":84,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":400,"num_read_kb":2104,"num_write":967,"num_write_kb":33078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.962529+0000","last_change":"2024-09-12T17:29:56.772976+0000","last_active":"2024-09-12T19:19:37.962529+0000","last_peered":"2024-09-12T19:19:37.962529+0000","last_clean":"2024-09-12T19:19:37.962529+0000","last_became_active":"2024-09-12T17:29:56.771923+0000","last_became_peered":"2024-09-12T17:29:56.771923+0000","last_unstale":"2024-09-12T19:19:37.962529+0000","last_undegraded":"2024-09-12T19:19:37.962529+0000","last_fullsized":"2024-09-12T19:19:37.962529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:15.080934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'348","reported_seq":992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:03.285412+0000","last_change":"2024-09-12T17:29:58.782391+0000","last_active":"2024-09-12T19:22:03.285412+0000","last_peered":"2024-09-12T19:22:03.285412+0000","last_clean":"2024-09-12T19:22:03.285412+0000","last_became_active":"2024-09-12T17:29:58.781756+0000","last_became_peered":"2024-09-12T17:29:58.781756+0000","last_unstale":"2024-09-12T19:22:03.285412+0000","last_undegraded":"2024-09-12T19:22:03.285412+0000","last_fullsized":"2024-09-12T19:22:03.285412+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:18.104306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49252,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":561,"num_read_kb":1017,"num_write":436,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:43.552916+0000","last_change":"2024-09-12T17:30:00.788793+0000","last_active":"2024-09-12T19:19:43.552916+0000","last_peered":"2024-09-12T19:19:43.552916+0000","last_clean":"2024-09-12T19:19:43.552916+0000","last_became_active":"2024-09-12T17:30:00.787872+0000","last_became_peered":"2024-09-12T17:30:00.787872+0000","last_unstale":"2024-09-12T19:19:43.552916+0000","last_undegraded":"2024-09-12T19:19:43.552916+0000","last_fullsized":"2024-09-12T19:19:43.552916+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:11.139793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'137","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.416574+0000","last_change":"2024-09-12T17:30:02.790977+0000","last_active":"2024-09-12T19:21:21.416574+0000","last_peered":"2024-09-12T19:21:21.416574+0000","last_clean":"2024-09-12T19:21:21.416574+0000","last_became_active":"2024-09-12T17:30:02.790246+0000","last_became_peered":"2024-09-12T17:30:02.790246+0000","last_unstale":"2024-09-12T19:21:21.416574+0000","last_undegraded":"2024-09-12T19:21:21.416574+0000","last_fullsized":"2024-09-12T19:21:21.416574+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:27.228227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":190,"num_write":334,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'494","reported_seq":2164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.899613+0000","last_change":"2024-09-12T17:30:22.256595+0000","last_active":"2024-09-12T19:21:55.899613+0000","last_peered":"2024-09-12T19:21:55.899613+0000","last_clean":"2024-09-12T19:21:55.899613+0000","last_became_active":"2024-09-12T17:30:22.255871+0000","last_became_peered":"2024-09-12T17:30:22.255871+0000","last_unstale":"2024-09-12T19:21:55.899613+0000","last_undegraded":"2024-09-12T19:21:55.899613+0000","last_fullsized":"2024-09-12T19:21:55.899613+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:37.746895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2849,"num_read_kb":2646,"num_write":616,"num_write_kb":185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'330","reported_seq":1071,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.958227+0000","last_change":"2024-09-12T17:29:52.726203+0000","last_active":"2024-09-12T19:23:01.958227+0000","last_peered":"2024-09-12T19:23:01.958227+0000","last_clean":"2024-09-12T19:23:01.958227+0000","last_became_active":"2024-09-12T17:29:52.725672+0000","last_became_peered":"2024-09-12T17:29:52.725672+0000","last_unstale":"2024-09-12T19:23:01.958227+0000","last_undegraded":"2024-09-12T19:23:01.958227+0000","last_fullsized":"2024-09-12T19:23:01.958227+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:14.245863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524466,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":607,"num_read_kb":120165,"num_write":1109,"num_write_kb":47030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.551750+0000","last_change":"2024-09-12T17:29:56.762247+0000","last_active":"2024-09-12T19:19:38.551750+0000","last_peered":"2024-09-12T19:19:38.551750+0000","last_clean":"2024-09-12T19:19:38.551750+0000","last_became_active":"2024-09-12T17:29:56.761442+0000","last_became_peered":"2024-09-12T17:29:56.761442+0000","last_unstale":"2024-09-12T19:19:38.551750+0000","last_undegraded":"2024-09-12T19:19:38.551750+0000","last_fullsized":"2024-09-12T19:19:38.551750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:29.298860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'324","reported_seq":935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.271936+0000","last_change":"2024-09-12T17:29:58.758717+0000","last_active":"2024-09-12T19:23:01.271936+0000","last_peered":"2024-09-12T19:23:01.271936+0000","last_clean":"2024-09-12T19:23:01.271936+0000","last_became_active":"2024-09-12T17:29:58.758050+0000","last_became_peered":"2024-09-12T17:29:58.758050+0000","last_unstale":"2024-09-12T19:23:01.271936+0000","last_undegraded":"2024-09-12T19:23:01.271936+0000","last_fullsized":"2024-09-12T19:23:01.271936+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:17.764686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47374,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":545,"num_read_kb":1211,"num_write":440,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:43.181010+0000","last_change":"2024-09-12T17:30:00.780831+0000","last_active":"2024-09-12T19:19:43.181010+0000","last_peered":"2024-09-12T19:19:43.181010+0000","last_clean":"2024-09-12T19:19:43.181010+0000","last_became_active":"2024-09-12T17:30:00.780216+0000","last_became_peered":"2024-09-12T17:30:00.780216+0000","last_unstale":"2024-09-12T19:19:43.181010+0000","last_undegraded":"2024-09-12T19:19:43.181010+0000","last_fullsized":"2024-09-12T19:19:43.181010+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:54.040743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'412","reported_seq":1851,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.561608+0000","last_change":"2024-09-12T17:29:54.777350+0000","last_active":"2024-09-12T19:20:23.561608+0000","last_peered":"2024-09-12T19:20:23.561608+0000","last_clean":"2024-09-12T19:20:23.561608+0000","last_became_active":"2024-09-12T17:29:54.776503+0000","last_became_peered":"2024-09-12T17:29:54.776503+0000","last_unstale":"2024-09-12T19:20:23.561608+0000","last_undegraded":"2024-09-12T19:20:23.561608+0000","last_fullsized":"2024-09-12T19:20:23.561608+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:48.613783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2157,"num_read_kb":2011,"num_write":494,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'283","reported_seq":985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:38.235299+0000","last_change":"2024-09-12T17:29:52.716790+0000","last_active":"2024-09-12T19:18:38.235299+0000","last_peered":"2024-09-12T19:18:38.235299+0000","last_clean":"2024-09-12T19:18:38.235299+0000","last_became_active":"2024-09-12T17:29:52.716376+0000","last_became_peered":"2024-09-12T17:29:52.716376+0000","last_unstale":"2024-09-12T19:18:38.235299+0000","last_undegraded":"2024-09-12T19:18:38.235299+0000","last_fullsized":"2024-09-12T19:18:38.235299+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:51.977058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7472771,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":513,"num_read_kb":2666,"num_write":1067,"num_write_kb":45238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:18.190273+0000","last_change":"2024-09-12T17:29:56.773917+0000","last_active":"2024-09-12T19:20:18.190273+0000","last_peered":"2024-09-12T19:20:18.190273+0000","last_clean":"2024-09-12T19:20:18.190273+0000","last_became_active":"2024-09-12T17:29:56.773239+0000","last_became_peered":"2024-09-12T17:29:56.773239+0000","last_unstale":"2024-09-12T19:20:18.190273+0000","last_undegraded":"2024-09-12T19:20:18.190273+0000","last_fullsized":"2024-09-12T19:20:18.190273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:02.813155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'553","reported_seq":1227,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.189986+0000","last_change":"2024-09-12T17:29:58.779631+0000","last_active":"2024-09-12T19:23:01.189986+0000","last_peered":"2024-09-12T19:23:01.189986+0000","last_clean":"2024-09-12T19:23:01.189986+0000","last_became_active":"2024-09-12T17:29:58.778931+0000","last_became_peered":"2024-09-12T17:29:58.778931+0000","last_unstale":"2024-09-12T19:23:01.189986+0000","last_undegraded":"2024-09-12T19:23:01.189986+0000","last_fullsized":"2024-09-12T19:23:01.189986+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:14.544244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":998,"num_read_kb":2327,"num_write":858,"num_write_kb":737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.986697+0000","last_change":"2024-09-12T17:30:00.802806+0000","last_active":"2024-09-12T19:20:02.986697+0000","last_peered":"2024-09-12T19:20:02.986697+0000","last_clean":"2024-09-12T19:20:02.986697+0000","last_became_active":"2024-09-12T17:30:00.802021+0000","last_became_peered":"2024-09-12T17:30:00.802021+0000","last_unstale":"2024-09-12T19:20:02.986697+0000","last_undegraded":"2024-09-12T19:20:02.986697+0000","last_fullsized":"2024-09-12T19:20:02.986697+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:49.504684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'167","reported_seq":710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:43.251407+0000","last_change":"2024-09-12T17:30:02.795603+0000","last_active":"2024-09-12T19:19:43.251407+0000","last_peered":"2024-09-12T19:19:43.251407+0000","last_clean":"2024-09-12T19:19:43.251407+0000","last_became_active":"2024-09-12T17:30:02.794353+0000","last_became_peered":"2024-09-12T17:30:02.794353+0000","last_unstale":"2024-09-12T19:19:43.251407+0000","last_undegraded":"2024-09-12T19:19:43.251407+0000","last_fullsized":"2024-09-12T19:19:43.251407+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:41.683296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":277,"num_read_kb":276,"num_write":376,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'723","reported_seq":2316,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.139310+0000","last_change":"2024-09-12T17:29:54.761432+0000","last_active":"2024-09-12T19:21:19.139310+0000","last_peered":"2024-09-12T19:21:19.139310+0000","last_clean":"2024-09-12T19:21:19.139310+0000","last_became_active":"2024-09-12T17:29:54.761144+0000","last_became_peered":"2024-09-12T17:29:54.761144+0000","last_unstale":"2024-09-12T19:21:19.139310+0000","last_undegraded":"2024-09-12T19:21:19.139310+0000","last_fullsized":"2024-09-12T19:21:19.139310+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":700,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:07.824094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3459,"num_read_kb":3076,"num_write":1006,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'309","reported_seq":927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.848731+0000","last_change":"2024-09-12T17:29:52.742141+0000","last_active":"2024-09-12T19:23:01.848731+0000","last_peered":"2024-09-12T19:23:01.848731+0000","last_clean":"2024-09-12T19:23:01.848731+0000","last_became_active":"2024-09-12T17:29:52.741594+0000","last_became_peered":"2024-09-12T17:29:52.741594+0000","last_unstale":"2024-09-12T19:23:01.848731+0000","last_undegraded":"2024-09-12T19:23:01.848731+0000","last_fullsized":"2024-09-12T19:23:01.848731+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:12.453167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262349,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":376,"num_read_kb":5602,"num_write":913,"num_write_kb":46297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.561587+0000","last_change":"2024-09-12T17:29:56.762091+0000","last_active":"2024-09-12T19:20:23.561587+0000","last_peered":"2024-09-12T19:20:23.561587+0000","last_clean":"2024-09-12T19:20:23.561587+0000","last_became_active":"2024-09-12T17:29:56.761256+0000","last_became_peered":"2024-09-12T17:29:56.761256+0000","last_unstale":"2024-09-12T19:20:23.561587+0000","last_undegraded":"2024-09-12T19:20:23.561587+0000","last_fullsized":"2024-09-12T19:20:23.561587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:38.052214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'389","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.339586+0000","last_change":"2024-09-12T17:29:58.769030+0000","last_active":"2024-09-12T19:23:01.339586+0000","last_peered":"2024-09-12T19:23:01.339586+0000","last_clean":"2024-09-12T19:23:01.339586+0000","last_became_active":"2024-09-12T17:29:58.768310+0000","last_became_peered":"2024-09-12T17:29:58.768310+0000","last_unstale":"2024-09-12T19:23:01.339586+0000","last_undegraded":"2024-09-12T19:23:01.339586+0000","last_fullsized":"2024-09-12T19:23:01.339586+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:31.668084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51217,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":641,"num_read_kb":1226,"num_write":524,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.979690+0000","last_change":"2024-09-12T17:30:00.805417+0000","last_active":"2024-09-12T19:20:02.979690+0000","last_peered":"2024-09-12T19:20:02.979690+0000","last_clean":"2024-09-12T19:20:02.979690+0000","last_became_active":"2024-09-12T17:30:00.804655+0000","last_became_peered":"2024-09-12T17:30:00.804655+0000","last_unstale":"2024-09-12T19:20:02.979690+0000","last_undegraded":"2024-09-12T19:20:02.979690+0000","last_fullsized":"2024-09-12T19:20:02.979690+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:59.390183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'189","reported_seq":1089,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.747208+0000","last_change":"2024-09-12T17:30:02.815235+0000","last_active":"2024-09-12T19:21:21.747208+0000","last_peered":"2024-09-12T19:21:21.747208+0000","last_clean":"2024-09-12T19:21:21.747208+0000","last_became_active":"2024-09-12T17:30:02.813027+0000","last_became_peered":"2024-09-12T17:30:02.813027+0000","last_unstale":"2024-09-12T19:21:21.747208+0000","last_undegraded":"2024-09-12T19:21:21.747208+0000","last_fullsized":"2024-09-12T19:21:21.747208+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:45.419844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2050,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":664,"num_read_kb":654,"num_write":538,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'390","reported_seq":1798,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.254923+0000","last_change":"2024-09-12T17:29:54.757128+0000","last_active":"2024-09-12T19:19:58.254923+0000","last_peered":"2024-09-12T19:19:58.254923+0000","last_clean":"2024-09-12T19:19:58.254923+0000","last_became_active":"2024-09-12T17:29:54.756800+0000","last_became_peered":"2024-09-12T17:29:54.756800+0000","last_unstale":"2024-09-12T19:19:58.254923+0000","last_undegraded":"2024-09-12T19:19:58.254923+0000","last_fullsized":"2024-09-12T19:19:58.254923+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:42.137004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1992,"num_read_kb":1877,"num_write":455,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'311","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.957551+0000","last_change":"2024-09-12T17:29:52.756252+0000","last_active":"2024-09-12T19:23:01.957551+0000","last_peered":"2024-09-12T19:23:01.957551+0000","last_clean":"2024-09-12T19:23:01.957551+0000","last_became_active":"2024-09-12T17:29:52.755401+0000","last_became_peered":"2024-09-12T17:29:52.755401+0000","last_unstale":"2024-09-12T19:23:01.957551+0000","last_undegraded":"2024-09-12T19:23:01.957551+0000","last_fullsized":"2024-09-12T19:23:01.957551+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:19.340127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2036176,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":3663,"num_write":1039,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.195101+0000","last_change":"2024-09-12T17:29:56.759557+0000","last_active":"2024-09-12T19:19:58.195101+0000","last_peered":"2024-09-12T19:19:58.195101+0000","last_clean":"2024-09-12T19:19:58.195101+0000","last_became_active":"2024-09-12T17:29:56.752172+0000","last_became_peered":"2024-09-12T17:29:56.752172+0000","last_unstale":"2024-09-12T19:19:58.195101+0000","last_undegraded":"2024-09-12T19:19:58.195101+0000","last_fullsized":"2024-09-12T19:19:58.195101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:01.184376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'325","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:33.291005+0000","last_change":"2024-09-12T17:29:58.832518+0000","last_active":"2024-09-12T19:22:33.291005+0000","last_peered":"2024-09-12T19:22:33.291005+0000","last_clean":"2024-09-12T19:22:33.291005+0000","last_became_active":"2024-09-12T17:29:58.831574+0000","last_became_peered":"2024-09-12T17:29:58.831574+0000","last_unstale":"2024-09-12T19:22:33.291005+0000","last_undegraded":"2024-09-12T19:22:33.291005+0000","last_fullsized":"2024-09-12T19:22:33.291005+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:45.202085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53455,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":517,"num_read_kb":965,"num_write":408,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:32.986123+0000","last_change":"2024-09-12T17:30:00.805560+0000","last_active":"2024-09-12T19:20:32.986123+0000","last_peered":"2024-09-12T19:20:32.986123+0000","last_clean":"2024-09-12T19:20:32.986123+0000","last_became_active":"2024-09-12T17:30:00.804705+0000","last_became_peered":"2024-09-12T17:30:00.804705+0000","last_unstale":"2024-09-12T19:20:32.986123+0000","last_undegraded":"2024-09-12T19:20:32.986123+0000","last_fullsized":"2024-09-12T19:20:32.986123+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:30.654520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'113","reported_seq":624,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.252350+0000","last_change":"2024-09-12T17:30:02.787761+0000","last_active":"2024-09-12T19:22:46.252350+0000","last_peered":"2024-09-12T19:22:46.252350+0000","last_clean":"2024-09-12T19:22:46.252350+0000","last_became_active":"2024-09-12T17:30:02.787038+0000","last_became_peered":"2024-09-12T17:30:02.787038+0000","last_unstale":"2024-09-12T19:22:46.252350+0000","last_undegraded":"2024-09-12T19:22:46.252350+0000","last_fullsized":"2024-09-12T19:22:46.252350+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:46.467512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":121,"num_write":252,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'360","reported_seq":1890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.436578+0000","last_change":"2024-09-12T17:29:54.742127+0000","last_active":"2024-09-12T19:21:21.436578+0000","last_peered":"2024-09-12T19:21:21.436578+0000","last_clean":"2024-09-12T19:21:21.436578+0000","last_became_active":"2024-09-12T17:29:54.741486+0000","last_became_peered":"2024-09-12T17:29:54.741486+0000","last_unstale":"2024-09-12T19:21:21.436578+0000","last_undegraded":"2024-09-12T19:21:21.436578+0000","last_fullsized":"2024-09-12T19:21:21.436578+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:16.184632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1958,"num_read_kb":1901,"num_write":388,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'318","reported_seq":1029,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.832928+0000","last_change":"2024-09-12T17:29:52.767395+0000","last_active":"2024-09-12T19:23:01.832928+0000","last_peered":"2024-09-12T19:23:01.832928+0000","last_clean":"2024-09-12T19:23:01.832928+0000","last_became_active":"2024-09-12T17:29:52.766141+0000","last_became_peered":"2024-09-12T17:29:52.766141+0000","last_unstale":"2024-09-12T19:23:01.832928+0000","last_undegraded":"2024-09-12T19:23:01.832928+0000","last_fullsized":"2024-09-12T19:23:01.832928+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:32.771937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7320708,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":562,"num_read_kb":101880,"num_write":1008,"num_write_kb":18651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"38'5","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.837339+0000","last_change":"2024-09-12T17:29:56.761300+0000","last_active":"2024-09-12T19:22:58.837339+0000","last_peered":"2024-09-12T19:22:58.837339+0000","last_clean":"2024-09-12T19:22:58.837339+0000","last_became_active":"2024-09-12T17:29:56.760505+0000","last_became_peered":"2024-09-12T17:29:56.760505+0000","last_unstale":"2024-09-12T19:22:58.837339+0000","last_undegraded":"2024-09-12T19:22:58.837339+0000","last_fullsized":"2024-09-12T19:22:58.837339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:19.918382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'170","reported_seq":762,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:53.697797+0000","last_change":"2024-09-12T17:29:58.830103+0000","last_active":"2024-09-12T19:20:53.697797+0000","last_peered":"2024-09-12T19:20:53.697797+0000","last_clean":"2024-09-12T19:20:53.697797+0000","last_became_active":"2024-09-12T17:29:58.829023+0000","last_became_peered":"2024-09-12T17:29:58.829023+0000","last_unstale":"2024-09-12T19:20:53.697797+0000","last_undegraded":"2024-09-12T19:20:53.697797+0000","last_fullsized":"2024-09-12T19:20:53.697797+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:27.778582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":218,"num_write":206,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'770","reported_seq":3287,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.282972+0000","last_change":"2024-09-12T17:30:00.787430+0000","last_active":"2024-09-12T19:22:46.282972+0000","last_peered":"2024-09-12T19:22:46.282972+0000","last_clean":"2024-09-12T19:22:46.282972+0000","last_became_active":"2024-09-12T17:30:00.786102+0000","last_became_peered":"2024-09-12T17:30:00.786102+0000","last_unstale":"2024-09-12T19:22:46.282972+0000","last_undegraded":"2024-09-12T19:22:46.282972+0000","last_fullsized":"2024-09-12T19:22:46.282972+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:58.157521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'148","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.288957+0000","last_change":"2024-09-12T17:30:02.804619+0000","last_active":"2024-09-12T19:21:19.288957+0000","last_peered":"2024-09-12T19:21:19.288957+0000","last_clean":"2024-09-12T19:21:19.288957+0000","last_became_active":"2024-09-12T17:30:02.803612+0000","last_became_peered":"2024-09-12T17:30:02.803612+0000","last_unstale":"2024-09-12T19:21:19.288957+0000","last_undegraded":"2024-09-12T19:21:19.288957+0000","last_fullsized":"2024-09-12T19:21:19.288957+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:34.332012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":232,"num_read_kb":219,"num_write":373,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'827","reported_seq":2550,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.933874+0000","last_change":"2024-09-12T17:30:21.699087+0000","last_active":"2024-09-12T19:20:27.933874+0000","last_peered":"2024-09-12T19:20:27.933874+0000","last_clean":"2024-09-12T19:20:27.933874+0000","last_became_active":"2024-09-12T17:30:21.696952+0000","last_became_peered":"2024-09-12T17:30:21.696952+0000","last_unstale":"2024-09-12T19:20:27.933874+0000","last_undegraded":"2024-09-12T19:20:27.933874+0000","last_fullsized":"2024-09-12T19:20:27.933874+0000","mapping_epoch":39,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:48.294079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3950,"num_read_kb":3589,"num_write":1060,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'353","reported_seq":1072,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.976090+0000","last_change":"2024-09-12T17:29:52.753703+0000","last_active":"2024-09-12T19:23:01.976090+0000","last_peered":"2024-09-12T19:23:01.976090+0000","last_clean":"2024-09-12T19:23:01.976090+0000","last_became_active":"2024-09-12T17:29:52.749735+0000","last_became_peered":"2024-09-12T17:29:52.749735+0000","last_unstale":"2024-09-12T19:23:01.976090+0000","last_undegraded":"2024-09-12T19:23:01.976090+0000","last_fullsized":"2024-09-12T19:23:01.976090+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:40.802637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437125,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":46392,"num_write":1072,"num_write_kb":51525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.967526+0000","last_change":"2024-09-12T17:29:56.766629+0000","last_active":"2024-09-12T19:19:57.967526+0000","last_peered":"2024-09-12T19:19:57.967526+0000","last_clean":"2024-09-12T19:19:57.967526+0000","last_became_active":"2024-09-12T17:29:56.765909+0000","last_became_peered":"2024-09-12T17:29:56.765909+0000","last_unstale":"2024-09-12T19:19:57.967526+0000","last_undegraded":"2024-09-12T19:19:57.967526+0000","last_fullsized":"2024-09-12T19:19:57.967526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:16.737963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'386","reported_seq":1032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.586459+0000","last_change":"2024-09-12T17:29:58.772348+0000","last_active":"2024-09-12T19:23:00.586459+0000","last_peered":"2024-09-12T19:23:00.586459+0000","last_clean":"2024-09-12T19:23:00.586459+0000","last_became_active":"2024-09-12T17:29:58.771522+0000","last_became_peered":"2024-09-12T17:29:58.771522+0000","last_unstale":"2024-09-12T19:23:00.586459+0000","last_undegraded":"2024-09-12T19:23:00.586459+0000","last_fullsized":"2024-09-12T19:23:00.586459+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:37.869319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46902,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":612,"num_read_kb":1188,"num_write":476,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:48.165589+0000","last_change":"2024-09-12T17:30:00.789334+0000","last_active":"2024-09-12T19:18:48.165589+0000","last_peered":"2024-09-12T19:18:48.165589+0000","last_clean":"2024-09-12T19:18:48.165589+0000","last_became_active":"2024-09-12T17:30:00.788559+0000","last_became_peered":"2024-09-12T17:30:00.788559+0000","last_unstale":"2024-09-12T19:18:48.165589+0000","last_undegraded":"2024-09-12T19:18:48.165589+0000","last_fullsized":"2024-09-12T19:18:48.165589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:23.307242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'116","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:12.986237+0000","last_change":"2024-09-12T17:30:02.807855+0000","last_active":"2024-09-12T19:21:12.986237+0000","last_peered":"2024-09-12T19:21:12.986237+0000","last_clean":"2024-09-12T19:21:12.986237+0000","last_became_active":"2024-09-12T17:30:02.807083+0000","last_became_peered":"2024-09-12T17:30:02.807083+0000","last_unstale":"2024-09-12T19:21:12.986237+0000","last_undegraded":"2024-09-12T19:21:12.986237+0000","last_fullsized":"2024-09-12T19:21:12.986237+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:51.993531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":147,"num_write":283,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'825","reported_seq":2498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.437648+0000","last_change":"2024-09-12T17:29:54.774040+0000","last_active":"2024-09-12T19:21:21.437648+0000","last_peered":"2024-09-12T19:21:21.437648+0000","last_clean":"2024-09-12T19:21:21.437648+0000","last_became_active":"2024-09-12T17:29:54.770569+0000","last_became_peered":"2024-09-12T17:29:54.770569+0000","last_unstale":"2024-09-12T19:21:21.437648+0000","last_undegraded":"2024-09-12T19:21:21.437648+0000","last_fullsized":"2024-09-12T19:21:21.437648+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:01.250678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4029,"num_read_kb":3656,"num_write":1088,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'392","reported_seq":1299,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.975417+0000","last_change":"2024-09-12T17:29:52.750235+0000","last_active":"2024-09-12T19:23:01.975417+0000","last_peered":"2024-09-12T19:23:01.975417+0000","last_clean":"2024-09-12T19:23:01.975417+0000","last_became_active":"2024-09-12T17:29:52.749566+0000","last_became_peered":"2024-09-12T17:29:52.749566+0000","last_unstale":"2024-09-12T19:23:01.975417+0000","last_undegraded":"2024-09-12T19:23:01.975417+0000","last_fullsized":"2024-09-12T19:23:01.975417+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:16.632102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174738,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1171,"num_read_kb":8659,"num_write":1266,"num_write_kb":49806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.985406+0000","last_change":"2024-09-12T17:29:56.768011+0000","last_active":"2024-09-12T19:19:57.985406+0000","last_peered":"2024-09-12T19:19:57.985406+0000","last_clean":"2024-09-12T19:19:57.985406+0000","last_became_active":"2024-09-12T17:29:56.766952+0000","last_became_peered":"2024-09-12T17:29:56.766952+0000","last_unstale":"2024-09-12T19:19:57.985406+0000","last_undegraded":"2024-09-12T19:19:57.985406+0000","last_fullsized":"2024-09-12T19:19:57.985406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:54.137260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'322","reported_seq":938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.669796+0000","last_change":"2024-09-12T17:29:58.783690+0000","last_active":"2024-09-12T19:23:00.669796+0000","last_peered":"2024-09-12T19:23:00.669796+0000","last_clean":"2024-09-12T19:23:00.669796+0000","last_became_active":"2024-09-12T17:29:58.783105+0000","last_became_peered":"2024-09-12T17:29:58.783105+0000","last_unstale":"2024-09-12T19:23:00.669796+0000","last_undegraded":"2024-09-12T19:23:00.669796+0000","last_fullsized":"2024-09-12T19:23:00.669796+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:02.161325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50641,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":544,"num_read_kb":1206,"num_write":440,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.544277+0000","last_change":"2024-09-12T17:30:00.800799+0000","last_active":"2024-09-12T19:19:03.544277+0000","last_peered":"2024-09-12T19:19:03.544277+0000","last_clean":"2024-09-12T19:19:03.544277+0000","last_became_active":"2024-09-12T17:30:00.799680+0000","last_became_peered":"2024-09-12T17:30:00.799680+0000","last_unstale":"2024-09-12T19:19:03.544277+0000","last_undegraded":"2024-09-12T19:19:03.544277+0000","last_fullsized":"2024-09-12T19:19:03.544277+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:13.337531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'130","reported_seq":684,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:48.237923+0000","last_change":"2024-09-12T17:30:02.787080+0000","last_active":"2024-09-12T19:18:48.237923+0000","last_peered":"2024-09-12T19:18:48.237923+0000","last_clean":"2024-09-12T19:18:48.237923+0000","last_became_active":"2024-09-12T17:30:02.786478+0000","last_became_peered":"2024-09-12T17:30:02.786478+0000","last_unstale":"2024-09-12T19:18:48.237923+0000","last_undegraded":"2024-09-12T19:18:48.237923+0000","last_fullsized":"2024-09-12T19:18:48.237923+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:32.030701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":240,"num_read_kb":229,"num_write":300,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'976","reported_seq":2759,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.994489+0000","last_change":"2024-09-12T17:29:54.762247+0000","last_active":"2024-09-12T19:22:44.994489+0000","last_peered":"2024-09-12T19:22:44.994489+0000","last_clean":"2024-09-12T19:22:44.994489+0000","last_became_active":"2024-09-12T17:29:54.761902+0000","last_became_peered":"2024-09-12T17:29:54.761902+0000","last_unstale":"2024-09-12T19:22:44.994489+0000","last_undegraded":"2024-09-12T19:22:44.994489+0000","last_fullsized":"2024-09-12T19:22:44.994489+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":900,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:57.000138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4608,"num_read_kb":4133,"num_write":1300,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'269","reported_seq":926,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:18.261132+0000","last_change":"2024-09-12T17:29:52.733633+0000","last_active":"2024-09-12T19:20:18.261132+0000","last_peered":"2024-09-12T19:20:18.261132+0000","last_clean":"2024-09-12T19:20:18.261132+0000","last_became_active":"2024-09-12T17:29:52.733119+0000","last_became_peered":"2024-09-12T17:29:52.733119+0000","last_unstale":"2024-09-12T19:20:18.261132+0000","last_undegraded":"2024-09-12T19:20:18.261132+0000","last_fullsized":"2024-09-12T19:20:18.261132+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:07.270536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5297874,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":406,"num_read_kb":1565,"num_write":1091,"num_write_kb":34702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.177481+0000","last_change":"2024-09-12T17:29:56.761445+0000","last_active":"2024-09-12T19:18:43.177481+0000","last_peered":"2024-09-12T19:18:43.177481+0000","last_clean":"2024-09-12T19:18:43.177481+0000","last_became_active":"2024-09-12T17:29:56.760142+0000","last_became_peered":"2024-09-12T17:29:56.760142+0000","last_unstale":"2024-09-12T19:18:43.177481+0000","last_undegraded":"2024-09-12T19:18:43.177481+0000","last_fullsized":"2024-09-12T19:18:43.177481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:58.137646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'269","reported_seq":858,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:33.290820+0000","last_change":"2024-09-12T17:29:58.775954+0000","last_active":"2024-09-12T19:22:33.290820+0000","last_peered":"2024-09-12T19:22:33.290820+0000","last_clean":"2024-09-12T19:22:33.290820+0000","last_became_active":"2024-09-12T17:29:58.775284+0000","last_became_peered":"2024-09-12T17:29:58.775284+0000","last_unstale":"2024-09-12T19:22:33.290820+0000","last_undegraded":"2024-09-12T19:22:33.290820+0000","last_fullsized":"2024-09-12T19:22:33.290820+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:04.232747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47771,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":415,"num_read_kb":848,"num_write":348,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.196243+0000","last_change":"2024-09-12T17:30:00.791617+0000","last_active":"2024-09-12T19:20:03.196243+0000","last_peered":"2024-09-12T19:20:03.196243+0000","last_clean":"2024-09-12T19:20:03.196243+0000","last_became_active":"2024-09-12T17:30:00.790907+0000","last_became_peered":"2024-09-12T17:30:00.790907+0000","last_unstale":"2024-09-12T19:20:03.196243+0000","last_undegraded":"2024-09-12T19:20:03.196243+0000","last_fullsized":"2024-09-12T19:20:03.196243+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:40.769544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'156","reported_seq":1270,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:13.192105+0000","last_change":"2024-09-12T17:30:02.813564+0000","last_active":"2024-09-12T19:21:13.192105+0000","last_peered":"2024-09-12T19:21:13.192105+0000","last_clean":"2024-09-12T19:21:13.192105+0000","last_became_active":"2024-09-12T17:30:02.812918+0000","last_became_peered":"2024-09-12T17:30:02.812918+0000","last_unstale":"2024-09-12T19:21:13.192105+0000","last_undegraded":"2024-09-12T19:21:13.192105+0000","last_fullsized":"2024-09-12T19:21:13.192105+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:30.419361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":804,"num_write":370,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'756","reported_seq":2286,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.177531+0000","last_change":"2024-09-12T17:29:54.768778+0000","last_active":"2024-09-12T19:18:43.177531+0000","last_peered":"2024-09-12T19:18:43.177531+0000","last_clean":"2024-09-12T19:18:43.177531+0000","last_became_active":"2024-09-12T17:29:54.767573+0000","last_became_peered":"2024-09-12T17:29:54.767573+0000","last_unstale":"2024-09-12T19:18:43.177531+0000","last_undegraded":"2024-09-12T19:18:43.177531+0000","last_fullsized":"2024-09-12T19:18:43.177531+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:31.066680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3552,"num_read_kb":3227,"num_write":976,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'365","reported_seq":1226,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.832859+0000","last_change":"2024-09-12T17:29:52.766538+0000","last_active":"2024-09-12T19:23:01.832859+0000","last_peered":"2024-09-12T19:23:01.832859+0000","last_clean":"2024-09-12T19:23:01.832859+0000","last_became_active":"2024-09-12T17:29:52.765692+0000","last_became_peered":"2024-09-12T17:29:52.765692+0000","last_unstale":"2024-09-12T19:23:01.832859+0000","last_undegraded":"2024-09-12T19:23:01.832859+0000","last_fullsized":"2024-09-12T19:23:01.832859+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:37.762190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110874,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":771,"num_read_kb":82698,"num_write":1110,"num_write_kb":56258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:12.968197+0000","last_change":"2024-09-12T17:29:56.761088+0000","last_active":"2024-09-12T19:19:12.968197+0000","last_peered":"2024-09-12T19:19:12.968197+0000","last_clean":"2024-09-12T19:19:12.968197+0000","last_became_active":"2024-09-12T17:29:56.760345+0000","last_became_peered":"2024-09-12T17:29:56.760345+0000","last_unstale":"2024-09-12T19:19:12.968197+0000","last_undegraded":"2024-09-12T19:19:12.968197+0000","last_fullsized":"2024-09-12T19:19:12.968197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:02.802366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'344","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.856112+0000","last_change":"2024-09-12T17:29:58.769661+0000","last_active":"2024-09-12T19:22:59.856112+0000","last_peered":"2024-09-12T19:22:59.856112+0000","last_clean":"2024-09-12T19:22:59.856112+0000","last_became_active":"2024-09-12T17:29:58.768812+0000","last_became_peered":"2024-09-12T17:29:58.768812+0000","last_unstale":"2024-09-12T19:22:59.856112+0000","last_undegraded":"2024-09-12T19:22:59.856112+0000","last_fullsized":"2024-09-12T19:22:59.856112+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:55.549725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46003,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1072,"num_write":420,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.185932+0000","last_change":"2024-09-12T17:30:00.786938+0000","last_active":"2024-09-12T19:20:03.185932+0000","last_peered":"2024-09-12T19:20:03.185932+0000","last_clean":"2024-09-12T19:20:03.185932+0000","last_became_active":"2024-09-12T17:30:00.786100+0000","last_became_peered":"2024-09-12T17:30:00.786100+0000","last_unstale":"2024-09-12T19:20:03.185932+0000","last_undegraded":"2024-09-12T19:20:03.185932+0000","last_fullsized":"2024-09-12T19:20:03.185932+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:07.158524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'138","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.989412+0000","last_change":"2024-09-12T17:30:02.808784+0000","last_active":"2024-09-12T19:22:44.989412+0000","last_peered":"2024-09-12T19:22:44.989412+0000","last_clean":"2024-09-12T19:22:44.989412+0000","last_became_active":"2024-09-12T17:30:02.807953+0000","last_became_peered":"2024-09-12T17:30:02.807953+0000","last_unstale":"2024-09-12T19:22:44.989412+0000","last_undegraded":"2024-09-12T19:22:44.989412+0000","last_fullsized":"2024-09-12T19:22:44.989412+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:19.588574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216,"num_read_kb":199,"num_write":346,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'852","reported_seq":2464,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.442108+0000","last_change":"2024-09-12T17:29:54.768750+0000","last_active":"2024-09-12T19:21:21.442108+0000","last_peered":"2024-09-12T19:21:21.442108+0000","last_clean":"2024-09-12T19:21:21.442108+0000","last_became_active":"2024-09-12T17:29:54.768439+0000","last_became_peered":"2024-09-12T17:29:54.768439+0000","last_unstale":"2024-09-12T19:21:21.442108+0000","last_undegraded":"2024-09-12T19:21:21.442108+0000","last_fullsized":"2024-09-12T19:21:21.442108+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:29.593777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3940,"num_read_kb":3539,"num_write":1104,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'323","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:18.560246+0000","last_change":"2024-09-12T17:29:52.738990+0000","last_active":"2024-09-12T19:20:18.560246+0000","last_peered":"2024-09-12T19:20:18.560246+0000","last_clean":"2024-09-12T19:20:18.560246+0000","last_became_active":"2024-09-12T17:29:52.732894+0000","last_became_peered":"2024-09-12T17:29:52.732894+0000","last_unstale":"2024-09-12T19:20:18.560246+0000","last_undegraded":"2024-09-12T19:20:18.560246+0000","last_fullsized":"2024-09-12T19:20:18.560246+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:05.898096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10511198,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":522,"num_read_kb":27715,"num_write":1217,"num_write_kb":46649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'495","reported_seq":1986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.006107+0000","last_change":"2024-09-12T17:29:54.747526+0000","last_active":"2024-09-12T19:22:45.006107+0000","last_peered":"2024-09-12T19:22:45.006107+0000","last_clean":"2024-09-12T19:22:45.006107+0000","last_became_active":"2024-09-12T17:29:54.745192+0000","last_became_peered":"2024-09-12T17:29:54.745192+0000","last_unstale":"2024-09-12T19:22:45.006107+0000","last_undegraded":"2024-09-12T19:22:45.006107+0000","last_fullsized":"2024-09-12T19:22:45.006107+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:53.534036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2446,"num_read_kb":2266,"num_write":619,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'340","reported_seq":1074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:43.825981+0000","last_change":"2024-09-12T17:29:52.728474+0000","last_active":"2024-09-12T19:22:43.825981+0000","last_peered":"2024-09-12T19:22:43.825981+0000","last_clean":"2024-09-12T19:22:43.825981+0000","last_became_active":"2024-09-12T17:29:52.727433+0000","last_became_peered":"2024-09-12T17:29:52.727433+0000","last_unstale":"2024-09-12T19:22:43.825981+0000","last_undegraded":"2024-09-12T19:22:43.825981+0000","last_fullsized":"2024-09-12T19:22:43.825981+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:45.539010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11557877,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":623,"num_read_kb":95087,"num_write":1222,"num_write_kb":35037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'393","reported_seq":1964,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.992422+0000","last_change":"2024-09-12T17:29:54.764069+0000","last_active":"2024-09-12T19:20:27.992422+0000","last_peered":"2024-09-12T19:20:27.992422+0000","last_clean":"2024-09-12T19:20:27.992422+0000","last_became_active":"2024-09-12T17:29:54.762400+0000","last_became_peered":"2024-09-12T17:29:54.762400+0000","last_unstale":"2024-09-12T19:20:27.992422+0000","last_undegraded":"2024-09-12T19:20:27.992422+0000","last_fullsized":"2024-09-12T19:20:27.992422+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:34.051350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2164,"num_read_kb":2073,"num_write":429,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'404","reported_seq":1120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.969671+0000","last_change":"2024-09-12T17:29:52.761477+0000","last_active":"2024-09-12T19:23:01.969671+0000","last_peered":"2024-09-12T19:23:01.969671+0000","last_clean":"2024-09-12T19:23:01.969671+0000","last_became_active":"2024-09-12T17:29:52.756626+0000","last_became_peered":"2024-09-12T17:29:52.756626+0000","last_unstale":"2024-09-12T19:23:01.969671+0000","last_undegraded":"2024-09-12T19:23:01.969671+0000","last_fullsized":"2024-09-12T19:23:01.969671+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:06.453259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":688,"num_read_kb":25414,"num_write":1427,"num_write_kb":18603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'782","reported_seq":2452,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.140613+0000","last_change":"2024-09-12T17:29:54.749594+0000","last_active":"2024-09-12T19:21:19.140613+0000","last_peered":"2024-09-12T19:21:19.140613+0000","last_clean":"2024-09-12T19:21:19.140613+0000","last_became_active":"2024-09-12T17:29:54.749249+0000","last_became_peered":"2024-09-12T17:29:54.749249+0000","last_unstale":"2024-09-12T19:21:19.140613+0000","last_undegraded":"2024-09-12T19:21:19.140613+0000","last_fullsized":"2024-09-12T19:21:19.140613+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:55.915159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3916,"num_read_kb":3572,"num_write":1026,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'306","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.958263+0000","last_change":"2024-09-12T17:29:52.767576+0000","last_active":"2024-09-12T19:23:01.958263+0000","last_peered":"2024-09-12T19:23:01.958263+0000","last_clean":"2024-09-12T19:23:01.958263+0000","last_became_active":"2024-09-12T17:29:52.767047+0000","last_became_peered":"2024-09-12T17:29:52.767047+0000","last_unstale":"2024-09-12T19:23:01.958263+0000","last_undegraded":"2024-09-12T19:23:01.958263+0000","last_fullsized":"2024-09-12T19:23:01.958263+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:01.748288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900516,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":422,"num_read_kb":21273,"num_write":1050,"num_write_kb":35522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'491","reported_seq":2152,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:48.268636+0000","last_change":"2024-09-12T17:29:54.763106+0000","last_active":"2024-09-12T19:20:48.268636+0000","last_peered":"2024-09-12T19:20:48.268636+0000","last_clean":"2024-09-12T19:20:48.268636+0000","last_became_active":"2024-09-12T17:29:54.762667+0000","last_became_peered":"2024-09-12T17:29:54.762667+0000","last_unstale":"2024-09-12T19:20:48.268636+0000","last_undegraded":"2024-09-12T19:20:48.268636+0000","last_fullsized":"2024-09-12T19:20:48.268636+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:57.057096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2506,"num_read_kb":2365,"num_write":559,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'282","reported_seq":962,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262415+0000","last_change":"2024-09-12T17:29:52.768451+0000","last_active":"2024-09-12T19:20:23.262415+0000","last_peered":"2024-09-12T19:20:23.262415+0000","last_clean":"2024-09-12T19:20:23.262415+0000","last_became_active":"2024-09-12T17:29:52.765692+0000","last_became_peered":"2024-09-12T17:29:52.765692+0000","last_unstale":"2024-09-12T19:20:23.262415+0000","last_undegraded":"2024-09-12T19:20:23.262415+0000","last_fullsized":"2024-09-12T19:20:23.262415+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:48.428826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13902119,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":465,"num_read_kb":21751,"num_write":939,"num_write_kb":25522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'959","reported_seq":2733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.201114+0000","last_change":"2024-09-12T17:29:54.770999+0000","last_active":"2024-09-12T19:20:23.201114+0000","last_peered":"2024-09-12T19:20:23.201114+0000","last_clean":"2024-09-12T19:20:23.201114+0000","last_became_active":"2024-09-12T17:29:54.769223+0000","last_became_peered":"2024-09-12T17:29:54.769223+0000","last_unstale":"2024-09-12T19:20:23.201114+0000","last_undegraded":"2024-09-12T19:20:23.201114+0000","last_fullsized":"2024-09-12T19:20:23.201114+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":900,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:48.896632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4532,"num_read_kb":4067,"num_write":1265,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'312","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.905057+0000","last_change":"2024-09-12T17:29:52.729350+0000","last_active":"2024-09-12T19:23:01.905057+0000","last_peered":"2024-09-12T19:23:01.905057+0000","last_clean":"2024-09-12T19:23:01.905057+0000","last_became_active":"2024-09-12T17:29:52.728523+0000","last_became_peered":"2024-09-12T17:29:52.728523+0000","last_unstale":"2024-09-12T19:23:01.905057+0000","last_undegraded":"2024-09-12T19:23:01.905057+0000","last_fullsized":"2024-09-12T19:23:01.905057+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:38.562226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":2514,"num_write":1024,"num_write_kb":45573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'964","reported_seq":2656,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.899595+0000","last_change":"2024-09-12T17:29:54.759369+0000","last_active":"2024-09-12T19:21:55.899595+0000","last_peered":"2024-09-12T19:21:55.899595+0000","last_clean":"2024-09-12T19:21:55.899595+0000","last_became_active":"2024-09-12T17:29:54.758687+0000","last_became_peered":"2024-09-12T17:29:54.758687+0000","last_unstale":"2024-09-12T19:21:55.899595+0000","last_undegraded":"2024-09-12T19:21:55.899595+0000","last_fullsized":"2024-09-12T19:21:55.899595+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":900,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:12.470932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4571,"num_read_kb":4077,"num_write":1316,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'281","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.561556+0000","last_change":"2024-09-12T17:29:52.719880+0000","last_active":"2024-09-12T19:20:23.561556+0000","last_peered":"2024-09-12T19:20:23.561556+0000","last_clean":"2024-09-12T19:20:23.561556+0000","last_became_active":"2024-09-12T17:29:52.718689+0000","last_became_peered":"2024-09-12T17:29:52.718689+0000","last_unstale":"2024-09-12T19:20:23.561556+0000","last_undegraded":"2024-09-12T19:20:23.561556+0000","last_fullsized":"2024-09-12T19:20:23.561556+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:01.173987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10242962,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":448,"num_read_kb":13386,"num_write":1024,"num_write_kb":27082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'1290","reported_seq":2901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.561396+0000","last_change":"2024-09-12T17:29:54.765637+0000","last_active":"2024-09-12T19:20:23.561396+0000","last_peered":"2024-09-12T19:20:23.561396+0000","last_clean":"2024-09-12T19:20:23.561396+0000","last_became_active":"2024-09-12T17:29:54.764876+0000","last_became_peered":"2024-09-12T17:29:54.764876+0000","last_unstale":"2024-09-12T19:20:23.561396+0000","last_undegraded":"2024-09-12T19:20:23.561396+0000","last_fullsized":"2024-09-12T19:20:23.561396+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":1200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:13.358482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5917,"num_read_kb":5200,"num_write":1797,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'324","reported_seq":999,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262560+0000","last_change":"2024-09-12T17:29:52.769653+0000","last_active":"2024-09-12T19:20:23.262560+0000","last_peered":"2024-09-12T19:20:23.262560+0000","last_clean":"2024-09-12T19:20:23.262560+0000","last_became_active":"2024-09-12T17:29:52.769086+0000","last_became_peered":"2024-09-12T17:29:52.769086+0000","last_unstale":"2024-09-12T19:20:23.262560+0000","last_undegraded":"2024-09-12T19:20:23.262560+0000","last_fullsized":"2024-09-12T19:20:23.262560+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:03.761062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12345675,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":479,"num_read_kb":7690,"num_write":1160,"num_write_kb":36052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"267'894","reported_seq":2482,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.901241+0000","last_change":"2024-09-12T17:29:54.760165+0000","last_active":"2024-09-12T19:21:55.901241+0000","last_peered":"2024-09-12T19:21:55.901241+0000","last_clean":"2024-09-12T19:21:55.901241+0000","last_became_active":"2024-09-12T17:29:54.759892+0000","last_became_peered":"2024-09-12T17:29:54.759892+0000","last_unstale":"2024-09-12T19:21:55.901241+0000","last_undegraded":"2024-09-12T19:21:55.901241+0000","last_fullsized":"2024-09-12T19:21:55.901241+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":800,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:50.901074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4227,"num_read_kb":3797,"num_write":1212,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'326","reported_seq":966,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.964273+0000","last_change":"2024-09-12T17:29:52.750118+0000","last_active":"2024-09-12T19:23:01.964273+0000","last_peered":"2024-09-12T19:23:01.964273+0000","last_clean":"2024-09-12T19:23:01.964273+0000","last_became_active":"2024-09-12T17:29:52.748790+0000","last_became_peered":"2024-09-12T17:29:52.748790+0000","last_unstale":"2024-09-12T19:23:01.964273+0000","last_undegraded":"2024-09-12T19:23:01.964273+0000","last_fullsized":"2024-09-12T19:23:01.964273+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:59.925499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":434,"num_read_kb":14399,"num_write":1080,"num_write_kb":30402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'1651","reported_seq":3218,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.025784+0000","last_change":"2024-09-12T17:29:54.755458+0000","last_active":"2024-09-12T19:22:45.025784+0000","last_peered":"2024-09-12T19:22:45.025784+0000","last_clean":"2024-09-12T19:22:45.025784+0000","last_became_active":"2024-09-12T17:29:54.754702+0000","last_became_peered":"2024-09-12T17:29:54.754702+0000","last_unstale":"2024-09-12T19:22:45.025784+0000","last_undegraded":"2024-09-12T19:22:45.025784+0000","last_fullsized":"2024-09-12T19:22:45.025784+0000","mapping_epoch":28,"log_start":"267'1600","ondisk_log_start":"267'1600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":1600,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:29.268644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7245,"num_read_kb":6284,"num_write":2371,"num_write_kb":1100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'246","reported_seq":912,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.257391+0000","last_change":"2024-09-12T17:29:52.768556+0000","last_active":"2024-09-12T19:20:08.257391+0000","last_peered":"2024-09-12T19:20:08.257391+0000","last_clean":"2024-09-12T19:20:08.257391+0000","last_became_active":"2024-09-12T17:29:52.767990+0000","last_became_peered":"2024-09-12T17:29:52.767990+0000","last_unstale":"2024-09-12T19:20:08.257391+0000","last_undegraded":"2024-09-12T19:20:08.257391+0000","last_fullsized":"2024-09-12T19:20:08.257391+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:04.577061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23401,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":413,"num_read_kb":642,"num_write":973,"num_write_kb":10844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'933","reported_seq":2506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.017536+0000","last_change":"2024-09-12T17:29:54.759508+0000","last_active":"2024-09-12T19:22:45.017536+0000","last_peered":"2024-09-12T19:22:45.017536+0000","last_clean":"2024-09-12T19:22:45.017536+0000","last_became_active":"2024-09-12T17:29:54.759169+0000","last_became_peered":"2024-09-12T17:29:54.759169+0000","last_unstale":"2024-09-12T19:22:45.017536+0000","last_undegraded":"2024-09-12T19:22:45.017536+0000","last_fullsized":"2024-09-12T19:22:45.017536+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":900,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:45.168551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4504,"num_read_kb":3992,"num_write":1315,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'297","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.954118+0000","last_change":"2024-09-12T17:29:52.757191+0000","last_active":"2024-09-12T19:23:01.954118+0000","last_peered":"2024-09-12T19:23:01.954118+0000","last_clean":"2024-09-12T19:23:01.954118+0000","last_became_active":"2024-09-12T17:29:52.753935+0000","last_became_peered":"2024-09-12T17:29:52.753935+0000","last_unstale":"2024-09-12T19:23:01.954118+0000","last_undegraded":"2024-09-12T19:23:01.954118+0000","last_fullsized":"2024-09-12T19:23:01.954118+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:29.050781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340668,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":430,"num_read_kb":10673,"num_write":974,"num_write_kb":41601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'834","reported_seq":2496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.014092+0000","last_change":"2024-09-12T17:29:54.761668+0000","last_active":"2024-09-12T19:22:45.014092+0000","last_peered":"2024-09-12T19:22:45.014092+0000","last_clean":"2024-09-12T19:22:45.014092+0000","last_became_active":"2024-09-12T17:29:54.760784+0000","last_became_peered":"2024-09-12T17:29:54.760784+0000","last_unstale":"2024-09-12T19:22:45.014092+0000","last_undegraded":"2024-09-12T19:22:45.014092+0000","last_fullsized":"2024-09-12T19:22:45.014092+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:25.364138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4062,"num_read_kb":3682,"num_write":1062,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'490","reported_seq":1212,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.951581+0000","last_change":"2024-09-12T17:29:52.735767+0000","last_active":"2024-09-12T19:23:01.951581+0000","last_peered":"2024-09-12T19:23:01.951581+0000","last_clean":"2024-09-12T19:23:01.951581+0000","last_became_active":"2024-09-12T17:29:52.735333+0000","last_became_peered":"2024-09-12T17:29:52.735333+0000","last_unstale":"2024-09-12T19:23:01.951581+0000","last_undegraded":"2024-09-12T19:23:01.951581+0000","last_fullsized":"2024-09-12T19:23:01.951581+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:56.415475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":869,"num_read_kb":5832,"num_write":1431,"num_write_kb":32355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'864","reported_seq":2443,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.002468+0000","last_change":"2024-09-12T17:29:54.754343+0000","last_active":"2024-09-12T19:22:45.002468+0000","last_peered":"2024-09-12T19:22:45.002468+0000","last_clean":"2024-09-12T19:22:45.002468+0000","last_became_active":"2024-09-12T17:29:54.753635+0000","last_became_peered":"2024-09-12T17:29:54.753635+0000","last_unstale":"2024-09-12T19:22:45.002468+0000","last_undegraded":"2024-09-12T19:22:45.002468+0000","last_fullsized":"2024-09-12T19:22:45.002468+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:06.006688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4079,"num_read_kb":3651,"num_write":1151,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'255","reported_seq":1011,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.558171+0000","last_change":"2024-09-12T17:29:52.745226+0000","last_active":"2024-09-12T19:20:08.558171+0000","last_peered":"2024-09-12T19:20:08.558171+0000","last_clean":"2024-09-12T19:20:08.558171+0000","last_became_active":"2024-09-12T17:29:52.744397+0000","last_became_peered":"2024-09-12T17:29:52.744397+0000","last_unstale":"2024-09-12T19:20:08.558171+0000","last_undegraded":"2024-09-12T19:20:08.558171+0000","last_fullsized":"2024-09-12T19:20:08.558171+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:30.018286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227539,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":707,"num_read_kb":16845,"num_write":984,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'473","reported_seq":2099,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.925933+0000","last_change":"2024-09-12T17:29:54.752376+0000","last_active":"2024-09-12T19:20:27.925933+0000","last_peered":"2024-09-12T19:20:27.925933+0000","last_clean":"2024-09-12T19:20:27.925933+0000","last_became_active":"2024-09-12T17:29:54.751872+0000","last_became_peered":"2024-09-12T17:29:54.751872+0000","last_unstale":"2024-09-12T19:20:27.925933+0000","last_undegraded":"2024-09-12T19:20:27.925933+0000","last_fullsized":"2024-09-12T19:20:27.925933+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:26.641497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2533,"num_read_kb":2381,"num_write":539,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'294","reported_seq":923,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.985448+0000","last_change":"2024-09-12T17:29:52.751477+0000","last_active":"2024-09-12T19:23:01.985448+0000","last_peered":"2024-09-12T19:23:01.985448+0000","last_clean":"2024-09-12T19:23:01.985448+0000","last_became_active":"2024-09-12T17:29:52.747688+0000","last_became_peered":"2024-09-12T17:29:52.747688+0000","last_unstale":"2024-09-12T19:23:01.985448+0000","last_undegraded":"2024-09-12T19:23:01.985448+0000","last_fullsized":"2024-09-12T19:23:01.985448+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:59.598093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262281,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":403,"num_read_kb":6219,"num_write":990,"num_write_kb":21267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'427","reported_seq":1940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.258996+0000","last_change":"2024-09-12T17:29:54.760829+0000","last_active":"2024-09-12T19:20:13.258996+0000","last_peered":"2024-09-12T19:20:13.258996+0000","last_clean":"2024-09-12T19:20:13.258996+0000","last_became_active":"2024-09-12T17:29:54.760373+0000","last_became_peered":"2024-09-12T17:29:54.760373+0000","last_unstale":"2024-09-12T19:20:13.258996+0000","last_undegraded":"2024-09-12T19:20:13.258996+0000","last_fullsized":"2024-09-12T19:20:13.258996+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:05.548951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2333,"num_read_kb":2181,"num_write":522,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'271","reported_seq":966,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.527121+0000","last_change":"2024-09-12T17:29:52.747300+0000","last_active":"2024-09-12T19:19:33.527121+0000","last_peered":"2024-09-12T19:19:33.527121+0000","last_clean":"2024-09-12T19:19:33.527121+0000","last_became_active":"2024-09-12T17:29:52.746880+0000","last_became_peered":"2024-09-12T17:29:52.746880+0000","last_unstale":"2024-09-12T19:19:33.527121+0000","last_undegraded":"2024-09-12T19:19:33.527121+0000","last_fullsized":"2024-09-12T19:19:33.527121+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:38.876679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17178221,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":464,"num_read_kb":70820,"num_write":1029,"num_write_kb":52448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'787","reported_seq":2445,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:47.979536+0000","last_change":"2024-09-12T17:29:54.766132+0000","last_active":"2024-09-12T19:20:47.979536+0000","last_peered":"2024-09-12T19:20:47.979536+0000","last_clean":"2024-09-12T19:20:47.979536+0000","last_became_active":"2024-09-12T17:29:54.765197+0000","last_became_peered":"2024-09-12T17:29:54.765197+0000","last_unstale":"2024-09-12T19:20:47.979536+0000","last_undegraded":"2024-09-12T19:20:47.979536+0000","last_fullsized":"2024-09-12T19:20:47.979536+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:06.211284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3968,"num_read_kb":3617,"num_write":1032,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'309","reported_seq":963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.968746+0000","last_change":"2024-09-12T17:29:52.753447+0000","last_active":"2024-09-12T19:23:01.968746+0000","last_peered":"2024-09-12T19:23:01.968746+0000","last_clean":"2024-09-12T19:23:01.968746+0000","last_became_active":"2024-09-12T17:29:52.749742+0000","last_became_peered":"2024-09-12T17:29:52.749742+0000","last_unstale":"2024-09-12T19:23:01.968746+0000","last_undegraded":"2024-09-12T19:23:01.968746+0000","last_fullsized":"2024-09-12T19:23:01.968746+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:57.718662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":13262,"num_write":1037,"num_write_kb":35239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'334","reported_seq":980,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.906142+0000","last_change":"2024-09-12T17:29:52.722769+0000","last_active":"2024-09-12T19:23:01.906142+0000","last_peered":"2024-09-12T19:23:01.906142+0000","last_clean":"2024-09-12T19:23:01.906142+0000","last_became_active":"2024-09-12T17:29:52.720918+0000","last_became_peered":"2024-09-12T17:29:52.720918+0000","last_unstale":"2024-09-12T19:23:01.906142+0000","last_undegraded":"2024-09-12T19:23:01.906142+0000","last_fullsized":"2024-09-12T19:23:01.906142+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:33.296017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170702,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":3934,"num_write":1046,"num_write_kb":9633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'599","reported_seq":2184,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:28.207331+0000","last_change":"2024-09-12T17:29:54.758143+0000","last_active":"2024-09-12T19:21:28.207331+0000","last_peered":"2024-09-12T19:21:28.207331+0000","last_clean":"2024-09-12T19:21:28.207331+0000","last_became_active":"2024-09-12T17:29:54.752553+0000","last_became_peered":"2024-09-12T17:29:54.752553+0000","last_unstale":"2024-09-12T19:21:28.207331+0000","last_undegraded":"2024-09-12T19:21:28.207331+0000","last_fullsized":"2024-09-12T19:21:28.207331+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:19.216701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3060,"num_read_kb":2784,"num_write":774,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'400","reported_seq":1086,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.952320+0000","last_change":"2024-09-12T17:30:22.255466+0000","last_active":"2024-09-12T19:23:01.952320+0000","last_peered":"2024-09-12T19:23:01.952320+0000","last_clean":"2024-09-12T19:23:01.952320+0000","last_became_active":"2024-09-12T17:30:22.254863+0000","last_became_peered":"2024-09-12T17:30:22.254863+0000","last_unstale":"2024-09-12T19:23:01.952320+0000","last_undegraded":"2024-09-12T19:23:01.952320+0000","last_fullsized":"2024-09-12T19:23:01.952320+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:14.162185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992370,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":655,"num_read_kb":2597,"num_write":1307,"num_write_kb":14489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5,0],"acting":[1,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'444","reported_seq":1944,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:08.001889+0000","last_change":"2024-09-12T17:29:54.764546+0000","last_active":"2024-09-12T19:21:08.001889+0000","last_peered":"2024-09-12T19:21:08.001889+0000","last_clean":"2024-09-12T19:21:08.001889+0000","last_became_active":"2024-09-12T17:29:54.763613+0000","last_became_peered":"2024-09-12T17:29:54.763613+0000","last_unstale":"2024-09-12T19:21:08.001889+0000","last_undegraded":"2024-09-12T19:21:08.001889+0000","last_fullsized":"2024-09-12T19:21:08.001889+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:27.590175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2478,"num_read_kb":2322,"num_write":560,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5989,"num_read_kb":4199,"num_write":1940,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1011,"ondisk_log_size":1011,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16341,"num_read_kb":15997,"num_write":16735,"num_write_kb":4892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1670,"ondisk_log_size":1670,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":549,"ondisk_log_size":549,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1577752,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":20884,"num_read_kb":39593,"num_write":17449,"num_write_kb":12355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1228800,"data_stored":870213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1952,"ondisk_log_size":1952,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212845,"num_read_kb":194484,"num_write":55296,"num_write_kb":18842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3814,"ondisk_log_size":3814,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":229695992,"num_objects":1838,"num_object_clones":0,"num_object_copies":7352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1838,"num_whiteouts":0,"num_read":34697,"num_read_kb":1906077,"num_write":70014,"num_write_kb":2114280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":352837632,"data_stored":352837632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4045,"ondisk_log_size":4045,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":24213981,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":122,"num_read_kb":168420,"num_write":145,"num_write_kb":116143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77750272,"data_stored":77742985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16785383,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":174519,"num_write":148,"num_write_kb":116143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":50438144,"data_stored":50431588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543512,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":323556,"kb_used_data":21480,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94048284,"statfs":{"total":96636764160,"available":96305442816,"internally_reserved":0,"allocated":21995520,"data_stored":19982866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":309131722},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,3,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543517,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444108,"kb_used_data":151932,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":93927732,"statfs":{"total":96636764160,"available":96181997568,"internally_reserved":0,"allocated":155578368,"data_stored":153570661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":299170246},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543511,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177360,"kb_used_data":11368,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94194480,"statfs":{"total":96636764160,"available":96455147520,"internally_reserved":0,"allocated":11640832,"data_stored":9617929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543513,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161488,"kb_used_data":17856,"kb_used_omap":1,"kb_used_meta":143614,"kb_avail":94210352,"statfs":{"total":96636764160,"available":96471400448,"internally_reserved":0,"allocated":18284544,"data_stored":16335473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":147061189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543511,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":426588,"kb_used_data":146892,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":93945252,"statfs":{"total":96636764160,"available":96199938048,"internally_reserved":0,"allocated":150417408,"data_stored":148351516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":286390727},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543513,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229400,"kb_used_data":130184,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94142440,"statfs":{"total":96636764160,"available":96401858560,"internally_reserved":0,"allocated":133308416,"data_stored":131326773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543510,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":196164,"kb_used_data":16420,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94175676,"statfs":{"total":96636764160,"available":96435892224,"internally_reserved":0,"allocated":16814080,"data_stored":14841351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543512,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299976,"kb_used_data":15912,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":94071864,"statfs":{"total":96636764160,"available":96329588736,"internally_reserved":0,"allocated":16293888,"data_stored":14257873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":290585029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11374592,"data_stored":11374592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12550144,"data_stored":12550144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":82669568,"data_stored":82669568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":100405248,"data_stored":100405248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14045184,"data_stored":14045184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7327744,"data_stored":7327744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":114262016,"data_stored":114262016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10203136,"data_stored":10203136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":137128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":466906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":261129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":5848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29405184,"data_stored":29403480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6295552,"data_stored":6294663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14737408,"data_stored":14733445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16826368,"data_stored":16825637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38899712,"data_stored":38894045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":22024192,"data_stored":22023303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:23:03.373 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:23:03.736 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:23:03.748 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-12T19:23:03.756 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":3666,"stamp":"2024-09-12T19:23:03.254098+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":272880683,"num_objects":2321,"num_object_clones":0,"num_object_copies":8318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2321,"num_whiteouts":0,"num_read":293484,"num_read_kb":2506219,"num_write":161870,"num_write_kb":2385149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13307,"ondisk_log_size":13307,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2258640,"kb_used_data":512044,"kb_used_omap":12,"kb_used_meta":1745715,"kb_avail":752716080,"statfs":{"total":773094113280,"available":770781265920,"internally_reserved":0,"allocated":524333056,"data_stored":508284442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1787612720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,1,4,4],"upper_bound":16},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-424265911,"num_objects":-2569,"num_object_clones":0,"num_object_copies":-10234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2569,"num_whiteouts":0,"num_read":2967,"num_read_kb":3389,"num_write":2772,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007042"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.976722+0000","last_change":"2024-09-12T18:19:22.664402+0000","last_active":"2024-09-12T19:19:22.976722+0000","last_peered":"2024-09-12T19:19:22.976722+0000","last_clean":"2024-09-12T19:19:22.976722+0000","last_became_active":"2024-09-12T18:19:22.658759+0000","last_became_peered":"2024-09-12T18:19:22.658759+0000","last_unstale":"2024-09-12T19:19:22.976722+0000","last_undegraded":"2024-09-12T19:19:22.976722+0000","last_fullsized":"2024-09-12T19:19:22.976722+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:29.891894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:32.979320+0000","last_change":"2024-09-12T17:51:59.970111+0000","last_active":"2024-09-12T19:19:32.979320+0000","last_peered":"2024-09-12T19:19:32.979320+0000","last_clean":"2024-09-12T19:19:32.979320+0000","last_became_active":"2024-09-12T17:51:59.969612+0000","last_became_peered":"2024-09-12T17:51:59.969612+0000","last_unstale":"2024-09-12T19:19:32.979320+0000","last_undegraded":"2024-09-12T19:19:32.979320+0000","last_fullsized":"2024-09-12T19:19:32.979320+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:23.773617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'5","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:23.246751+0000","last_change":"2024-09-12T17:51:52.890790+0000","last_active":"2024-09-12T19:19:23.246751+0000","last_peered":"2024-09-12T19:19:23.246751+0000","last_clean":"2024-09-12T19:19:23.246751+0000","last_became_active":"2024-09-12T17:51:52.890029+0000","last_became_peered":"2024-09-12T17:51:52.890029+0000","last_unstale":"2024-09-12T19:19:23.246751+0000","last_undegraded":"2024-09-12T19:19:23.246751+0000","last_fullsized":"2024-09-12T19:19:23.246751+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:58.035727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'75","reported_seq":374,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:28.176973+0000","last_change":"2024-09-12T17:45:41.586304+0000","last_active":"2024-09-12T19:19:28.176973+0000","last_peered":"2024-09-12T19:19:28.176973+0000","last_clean":"2024-09-12T19:19:28.176973+0000","last_became_active":"2024-09-12T17:45:41.585012+0000","last_became_peered":"2024-09-12T17:45:41.585012+0000","last_unstale":"2024-09-12T19:19:28.176973+0000","last_undegraded":"2024-09-12T19:19:28.176973+0000","last_fullsized":"2024-09-12T19:19:28.176973+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:25.815410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":580,"num_read_kb":395,"num_write":86,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:23.524914+0000","last_change":"2024-09-12T18:19:22.641896+0000","last_active":"2024-09-12T19:19:23.524914+0000","last_peered":"2024-09-12T19:19:23.524914+0000","last_clean":"2024-09-12T19:19:23.524914+0000","last_became_active":"2024-09-12T18:19:22.641172+0000","last_became_peered":"2024-09-12T18:19:22.641172+0000","last_unstale":"2024-09-12T19:19:23.524914+0000","last_undegraded":"2024-09-12T19:19:23.524914+0000","last_fullsized":"2024-09-12T19:19:23.524914+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:53.586176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.189386+0000","last_change":"2024-09-12T17:51:59.957708+0000","last_active":"2024-09-12T19:19:33.189386+0000","last_peered":"2024-09-12T19:19:33.189386+0000","last_clean":"2024-09-12T19:19:33.189386+0000","last_became_active":"2024-09-12T17:51:59.957109+0000","last_became_peered":"2024-09-12T17:51:59.957109+0000","last_unstale":"2024-09-12T19:19:33.189386+0000","last_undegraded":"2024-09-12T19:19:33.189386+0000","last_fullsized":"2024-09-12T19:19:33.189386+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:06.641011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.970297+0000","last_change":"2024-09-12T17:51:52.905930+0000","last_active":"2024-09-12T19:19:22.970297+0000","last_peered":"2024-09-12T19:19:22.970297+0000","last_clean":"2024-09-12T19:19:22.970297+0000","last_became_active":"2024-09-12T17:51:52.905220+0000","last_became_peered":"2024-09-12T17:51:52.905220+0000","last_unstale":"2024-09-12T19:19:22.970297+0000","last_undegraded":"2024-09-12T19:19:22.970297+0000","last_fullsized":"2024-09-12T19:19:22.970297+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:22.520893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'122","reported_seq":487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:53.531273+0000","last_change":"2024-09-12T17:45:41.573549+0000","last_active":"2024-09-12T19:19:53.531273+0000","last_peered":"2024-09-12T19:19:53.531273+0000","last_clean":"2024-09-12T19:19:53.531273+0000","last_became_active":"2024-09-12T17:45:41.572859+0000","last_became_peered":"2024-09-12T17:45:41.572859+0000","last_unstale":"2024-09-12T19:19:53.531273+0000","last_undegraded":"2024-09-12T19:19:53.531273+0000","last_fullsized":"2024-09-12T19:19:53.531273+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:00.082452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":788,"num_read_kb":542,"num_write":175,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.553951+0000","last_change":"2024-09-12T18:19:22.653551+0000","last_active":"2024-09-12T19:19:48.553951+0000","last_peered":"2024-09-12T19:19:48.553951+0000","last_clean":"2024-09-12T19:19:48.553951+0000","last_became_active":"2024-09-12T18:19:22.652800+0000","last_became_peered":"2024-09-12T18:19:22.652800+0000","last_unstale":"2024-09-12T19:19:48.553951+0000","last_undegraded":"2024-09-12T19:19:48.553951+0000","last_fullsized":"2024-09-12T19:19:48.553951+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:00.720225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.178212+0000","last_change":"2024-09-12T17:51:59.955159+0000","last_active":"2024-09-12T19:19:33.178212+0000","last_peered":"2024-09-12T19:19:33.178212+0000","last_clean":"2024-09-12T19:19:33.178212+0000","last_became_active":"2024-09-12T17:51:59.954517+0000","last_became_peered":"2024-09-12T17:51:59.954517+0000","last_unstale":"2024-09-12T19:19:33.178212+0000","last_undegraded":"2024-09-12T19:19:33.178212+0000","last_fullsized":"2024-09-12T19:19:33.178212+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:02.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"267'1","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.533724+0000","last_change":"2024-09-12T17:51:52.886345+0000","last_active":"2024-09-12T19:20:03.533724+0000","last_peered":"2024-09-12T19:20:03.533724+0000","last_clean":"2024-09-12T19:20:03.533724+0000","last_became_active":"2024-09-12T17:51:52.885677+0000","last_became_peered":"2024-09-12T17:51:52.885677+0000","last_unstale":"2024-09-12T19:20:03.533724+0000","last_undegraded":"2024-09-12T19:20:03.533724+0000","last_fullsized":"2024-09-12T19:20:03.533724+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:04.278645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'26","reported_seq":140,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:13.156514+0000","last_change":"2024-09-12T17:45:41.576549+0000","last_active":"2024-09-12T19:18:13.156514+0000","last_peered":"2024-09-12T19:18:13.156514+0000","last_clean":"2024-09-12T19:18:13.156514+0000","last_became_active":"2024-09-12T17:45:41.575793+0000","last_became_peered":"2024-09-12T17:45:41.575793+0000","last_unstale":"2024-09-12T19:18:13.156514+0000","last_undegraded":"2024-09-12T19:18:13.156514+0000","last_fullsized":"2024-09-12T19:18:13.156514+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:35.718641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":83,"num_write":51,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.254703+0000","last_change":"2024-09-12T18:19:22.656103+0000","last_active":"2024-09-12T19:19:58.254703+0000","last_peered":"2024-09-12T19:19:58.254703+0000","last_clean":"2024-09-12T19:19:58.254703+0000","last_became_active":"2024-09-12T18:19:22.655357+0000","last_became_peered":"2024-09-12T18:19:22.655357+0000","last_unstale":"2024-09-12T19:19:58.254703+0000","last_undegraded":"2024-09-12T19:19:58.254703+0000","last_fullsized":"2024-09-12T19:19:58.254703+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:44.884891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"267'1","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262497+0000","last_change":"2024-09-12T17:51:59.941561+0000","last_active":"2024-09-12T19:20:23.262497+0000","last_peered":"2024-09-12T19:20:23.262497+0000","last_clean":"2024-09-12T19:20:23.262497+0000","last_became_active":"2024-09-12T17:51:59.935185+0000","last_became_peered":"2024-09-12T17:51:59.935185+0000","last_unstale":"2024-09-12T19:20:23.262497+0000","last_undegraded":"2024-09-12T19:20:23.262497+0000","last_fullsized":"2024-09-12T19:20:23.262497+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:03.775657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"267'10","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.345477+0000","last_change":"2024-09-12T17:51:52.865694+0000","last_active":"2024-09-12T19:23:01.345477+0000","last_peered":"2024-09-12T19:23:01.345477+0000","last_clean":"2024-09-12T19:23:01.345477+0000","last_became_active":"2024-09-12T17:51:52.864951+0000","last_became_peered":"2024-09-12T17:51:52.864951+0000","last_unstale":"2024-09-12T19:23:01.345477+0000","last_undegraded":"2024-09-12T19:23:01.345477+0000","last_fullsized":"2024-09-12T19:23:01.345477+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:53.129719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32810,"num_write":10,"num_write_kb":11304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'28","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:13.228547+0000","last_change":"2024-09-12T17:45:41.577459+0000","last_active":"2024-09-12T19:18:13.228547+0000","last_peered":"2024-09-12T19:18:13.228547+0000","last_clean":"2024-09-12T19:18:13.228547+0000","last_became_active":"2024-09-12T17:45:41.576714+0000","last_became_peered":"2024-09-12T17:45:41.576714+0000","last_unstale":"2024-09-12T19:18:13.228547+0000","last_undegraded":"2024-09-12T19:18:13.228547+0000","last_fullsized":"2024-09-12T19:18:13.228547+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:46.641068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":94,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.249030+0000","last_change":"2024-09-12T18:19:22.665947+0000","last_active":"2024-09-12T19:19:33.249030+0000","last_peered":"2024-09-12T19:19:33.249030+0000","last_clean":"2024-09-12T19:19:33.249030+0000","last_became_active":"2024-09-12T18:19:22.665152+0000","last_became_peered":"2024-09-12T18:19:22.665152+0000","last_unstale":"2024-09-12T19:19:33.249030+0000","last_undegraded":"2024-09-12T19:19:33.249030+0000","last_fullsized":"2024-09-12T19:19:33.249030+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:24.528404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"267'3","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.011866+0000","last_change":"2024-09-12T17:51:59.951234+0000","last_active":"2024-09-12T19:21:53.011866+0000","last_peered":"2024-09-12T19:21:53.011866+0000","last_clean":"2024-09-12T19:21:53.011866+0000","last_became_active":"2024-09-12T17:51:59.950595+0000","last_became_peered":"2024-09-12T17:51:59.950595+0000","last_unstale":"2024-09-12T19:21:53.011866+0000","last_undegraded":"2024-09-12T19:21:53.011866+0000","last_fullsized":"2024-09-12T19:21:53.011866+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:58.571310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.166933+0000","last_change":"2024-09-12T17:51:52.908434+0000","last_active":"2024-09-12T19:18:53.166933+0000","last_peered":"2024-09-12T19:18:53.166933+0000","last_clean":"2024-09-12T19:18:53.166933+0000","last_became_active":"2024-09-12T17:51:52.907863+0000","last_became_peered":"2024-09-12T17:51:52.907863+0000","last_unstale":"2024-09-12T19:18:53.166933+0000","last_undegraded":"2024-09-12T19:18:53.166933+0000","last_fullsized":"2024-09-12T19:18:53.166933+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:14.608689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'42","reported_seq":186,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:13.228451+0000","last_change":"2024-09-12T17:45:41.596640+0000","last_active":"2024-09-12T19:18:13.228451+0000","last_peered":"2024-09-12T19:18:13.228451+0000","last_clean":"2024-09-12T19:18:13.228451+0000","last_became_active":"2024-09-12T17:45:41.596133+0000","last_became_peered":"2024-09-12T17:45:41.596133+0000","last_unstale":"2024-09-12T19:18:13.228451+0000","last_undegraded":"2024-09-12T19:18:13.228451+0000","last_fullsized":"2024-09-12T19:18:13.228451+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:41.921834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":80,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.975905+0000","last_change":"2024-09-12T18:19:22.652917+0000","last_active":"2024-09-12T19:19:47.975905+0000","last_peered":"2024-09-12T19:19:47.975905+0000","last_clean":"2024-09-12T19:19:47.975905+0000","last_became_active":"2024-09-12T18:19:22.652141+0000","last_became_peered":"2024-09-12T18:19:22.652141+0000","last_unstale":"2024-09-12T19:19:47.975905+0000","last_undegraded":"2024-09-12T19:19:47.975905+0000","last_fullsized":"2024-09-12T19:19:47.975905+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:16.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"267'1","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.544204+0000","last_change":"2024-09-12T17:51:59.937787+0000","last_active":"2024-09-12T19:19:03.544204+0000","last_peered":"2024-09-12T19:19:03.544204+0000","last_clean":"2024-09-12T19:19:03.544204+0000","last_became_active":"2024-09-12T17:51:59.936941+0000","last_became_peered":"2024-09-12T17:51:59.936941+0000","last_unstale":"2024-09-12T19:19:03.544204+0000","last_undegraded":"2024-09-12T19:19:03.544204+0000","last_fullsized":"2024-09-12T19:19:03.544204+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:37.516754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'2","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:38.218337+0000","last_change":"2024-09-12T17:51:52.882882+0000","last_active":"2024-09-12T19:21:38.218337+0000","last_peered":"2024-09-12T19:21:38.218337+0000","last_clean":"2024-09-12T19:21:38.218337+0000","last_became_active":"2024-09-12T17:51:52.882157+0000","last_became_peered":"2024-09-12T17:51:52.882157+0000","last_unstale":"2024-09-12T19:21:38.218337+0000","last_undegraded":"2024-09-12T19:21:38.218337+0000","last_fullsized":"2024-09-12T19:21:38.218337+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:28.059422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'16","reported_seq":113,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:13.533500+0000","last_change":"2024-09-12T17:45:41.587495+0000","last_active":"2024-09-12T19:18:13.533500+0000","last_peered":"2024-09-12T19:18:13.533500+0000","last_clean":"2024-09-12T19:18:13.533500+0000","last_became_active":"2024-09-12T17:45:41.586661+0000","last_became_peered":"2024-09-12T17:45:41.586661+0000","last_unstale":"2024-09-12T19:18:13.533500+0000","last_undegraded":"2024-09-12T19:18:13.533500+0000","last_fullsized":"2024-09-12T19:18:13.533500+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:51.564389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959085+0000","last_change":"2024-09-12T18:19:22.671131+0000","last_active":"2024-09-12T19:19:22.959085+0000","last_peered":"2024-09-12T19:19:22.959085+0000","last_clean":"2024-09-12T19:19:22.959085+0000","last_became_active":"2024-09-12T18:19:22.668945+0000","last_became_peered":"2024-09-12T18:19:22.668945+0000","last_unstale":"2024-09-12T19:19:22.959085+0000","last_undegraded":"2024-09-12T19:19:22.959085+0000","last_fullsized":"2024-09-12T19:19:22.959085+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:51.667065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.550741+0000","last_change":"2024-09-12T17:51:59.937170+0000","last_active":"2024-09-12T19:19:33.550741+0000","last_peered":"2024-09-12T19:19:33.550741+0000","last_clean":"2024-09-12T19:19:33.550741+0000","last_became_active":"2024-09-12T17:51:59.936441+0000","last_became_peered":"2024-09-12T17:51:59.936441+0000","last_unstale":"2024-09-12T19:19:33.550741+0000","last_undegraded":"2024-09-12T19:19:33.550741+0000","last_fullsized":"2024-09-12T19:19:33.550741+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:54.536101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:23.187174+0000","last_change":"2024-09-12T17:51:52.888730+0000","last_active":"2024-09-12T19:19:23.187174+0000","last_peered":"2024-09-12T19:19:23.187174+0000","last_clean":"2024-09-12T19:19:23.187174+0000","last_became_active":"2024-09-12T17:51:52.887962+0000","last_became_peered":"2024-09-12T17:51:52.887962+0000","last_unstale":"2024-09-12T19:19:23.187174+0000","last_undegraded":"2024-09-12T19:19:23.187174+0000","last_fullsized":"2024-09-12T19:19:23.187174+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:25.669346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'25","reported_seq":141,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.188763+0000","last_change":"2024-09-12T17:45:41.566696+0000","last_active":"2024-09-12T19:20:13.188763+0000","last_peered":"2024-09-12T19:20:13.188763+0000","last_clean":"2024-09-12T19:20:13.188763+0000","last_became_active":"2024-09-12T17:45:41.565956+0000","last_became_peered":"2024-09-12T17:45:41.565956+0000","last_unstale":"2024-09-12T19:20:13.188763+0000","last_undegraded":"2024-09-12T19:20:13.188763+0000","last_fullsized":"2024-09-12T19:20:13.188763+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:11.837864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959148+0000","last_change":"2024-09-12T18:19:22.677901+0000","last_active":"2024-09-12T19:19:22.959148+0000","last_peered":"2024-09-12T19:19:22.959148+0000","last_clean":"2024-09-12T19:19:22.959148+0000","last_became_active":"2024-09-12T18:19:22.677111+0000","last_became_peered":"2024-09-12T18:19:22.677111+0000","last_unstale":"2024-09-12T19:19:22.959148+0000","last_undegraded":"2024-09-12T19:19:22.959148+0000","last_fullsized":"2024-09-12T19:19:22.959148+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:39.916282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'1","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.248864+0000","last_change":"2024-09-12T17:51:59.942614+0000","last_active":"2024-09-12T19:19:33.248864+0000","last_peered":"2024-09-12T19:19:33.248864+0000","last_clean":"2024-09-12T19:19:33.248864+0000","last_became_active":"2024-09-12T17:51:59.941825+0000","last_became_peered":"2024-09-12T17:51:59.941825+0000","last_unstale":"2024-09-12T19:19:33.248864+0000","last_undegraded":"2024-09-12T19:19:33.248864+0000","last_fullsized":"2024-09-12T19:19:33.248864+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:10.399861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4960,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":10,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.212609+0000","last_change":"2024-09-12T17:51:52.899944+0000","last_active":"2024-09-12T19:21:53.212609+0000","last_peered":"2024-09-12T19:21:53.212609+0000","last_clean":"2024-09-12T19:21:53.212609+0000","last_became_active":"2024-09-12T17:51:52.899511+0000","last_became_peered":"2024-09-12T17:51:52.899511+0000","last_unstale":"2024-09-12T19:21:53.212609+0000","last_undegraded":"2024-09-12T19:21:53.212609+0000","last_fullsized":"2024-09-12T19:21:53.212609+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:39.682445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'27","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.978150+0000","last_change":"2024-09-12T17:45:41.587067+0000","last_active":"2024-09-12T19:19:57.978150+0000","last_peered":"2024-09-12T19:19:57.978150+0000","last_clean":"2024-09-12T19:19:57.978150+0000","last_became_active":"2024-09-12T17:45:41.578021+0000","last_became_peered":"2024-09-12T17:45:41.578021+0000","last_unstale":"2024-09-12T19:19:57.978150+0000","last_undegraded":"2024-09-12T19:19:57.978150+0000","last_fullsized":"2024-09-12T19:19:57.978150+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:35.349527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":97,"num_write":50,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.979562+0000","last_change":"2024-09-12T18:19:22.669975+0000","last_active":"2024-09-12T19:20:02.979562+0000","last_peered":"2024-09-12T19:20:02.979562+0000","last_clean":"2024-09-12T19:20:02.979562+0000","last_became_active":"2024-09-12T18:19:22.668802+0000","last_became_peered":"2024-09-12T18:19:22.668802+0000","last_unstale":"2024-09-12T19:20:02.979562+0000","last_undegraded":"2024-09-12T19:20:02.979562+0000","last_fullsized":"2024-09-12T19:20:02.979562+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:20.736060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.241946+0000","last_change":"2024-09-12T17:51:59.940440+0000","last_active":"2024-09-12T19:19:03.241946+0000","last_peered":"2024-09-12T19:19:03.241946+0000","last_clean":"2024-09-12T19:19:03.241946+0000","last_became_active":"2024-09-12T17:51:59.939686+0000","last_became_peered":"2024-09-12T17:51:59.939686+0000","last_unstale":"2024-09-12T19:19:03.241946+0000","last_undegraded":"2024-09-12T19:19:03.241946+0000","last_fullsized":"2024-09-12T19:19:03.241946+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:25.031497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:37.964561+0000","last_change":"2024-09-12T17:51:52.894394+0000","last_active":"2024-09-12T19:18:37.964561+0000","last_peered":"2024-09-12T19:18:37.964561+0000","last_clean":"2024-09-12T19:18:37.964561+0000","last_became_active":"2024-09-12T17:51:52.892953+0000","last_became_peered":"2024-09-12T17:51:52.892953+0000","last_unstale":"2024-09-12T19:18:37.964561+0000","last_undegraded":"2024-09-12T19:18:37.964561+0000","last_fullsized":"2024-09-12T19:18:37.964561+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:34.018077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'51","reported_seq":214,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.184846+0000","last_change":"2024-09-12T17:45:41.574719+0000","last_active":"2024-09-12T19:19:58.184846+0000","last_peered":"2024-09-12T19:19:58.184846+0000","last_clean":"2024-09-12T19:19:58.184846+0000","last_became_active":"2024-09-12T17:45:41.572941+0000","last_became_peered":"2024-09-12T17:45:41.572941+0000","last_unstale":"2024-09-12T19:19:58.184846+0000","last_undegraded":"2024-09-12T19:19:58.184846+0000","last_fullsized":"2024-09-12T19:19:58.184846+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:25.447410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":190,"num_write":83,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.533559+0000","last_change":"2024-09-12T18:19:22.652584+0000","last_active":"2024-09-12T19:20:03.533559+0000","last_peered":"2024-09-12T19:20:03.533559+0000","last_clean":"2024-09-12T19:20:03.533559+0000","last_became_active":"2024-09-12T18:19:22.651901+0000","last_became_peered":"2024-09-12T18:19:22.651901+0000","last_unstale":"2024-09-12T19:20:03.533559+0000","last_undegraded":"2024-09-12T19:20:03.533559+0000","last_fullsized":"2024-09-12T19:20:03.533559+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:40.051168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.236632+0000","last_change":"2024-09-12T17:51:59.948536+0000","last_active":"2024-09-12T19:18:43.236632+0000","last_peered":"2024-09-12T19:18:43.236632+0000","last_clean":"2024-09-12T19:18:43.236632+0000","last_became_active":"2024-09-12T17:51:59.947392+0000","last_became_peered":"2024-09-12T17:51:59.947392+0000","last_unstale":"2024-09-12T19:18:43.236632+0000","last_undegraded":"2024-09-12T19:18:43.236632+0000","last_fullsized":"2024-09-12T19:18:43.236632+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:47.397467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'5","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:52.952062+0000","last_change":"2024-09-12T17:51:52.887100+0000","last_active":"2024-09-12T19:18:52.952062+0000","last_peered":"2024-09-12T19:18:52.952062+0000","last_clean":"2024-09-12T19:18:52.952062+0000","last_became_active":"2024-09-12T17:51:52.886123+0000","last_became_peered":"2024-09-12T17:51:52.886123+0000","last_unstale":"2024-09-12T19:18:52.952062+0000","last_undegraded":"2024-09-12T19:18:52.952062+0000","last_fullsized":"2024-09-12T19:18:52.952062+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:11.295668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'32","reported_seq":165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.255039+0000","last_change":"2024-09-12T17:45:41.592562+0000","last_active":"2024-09-12T19:19:58.255039+0000","last_peered":"2024-09-12T19:19:58.255039+0000","last_clean":"2024-09-12T19:19:58.255039+0000","last_became_active":"2024-09-12T17:45:41.591637+0000","last_became_peered":"2024-09-12T17:45:41.591637+0000","last_unstale":"2024-09-12T19:19:58.255039+0000","last_undegraded":"2024-09-12T19:19:58.255039+0000","last_fullsized":"2024-09-12T19:19:58.255039+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:52.032057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":117,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968591+0000","last_change":"2024-09-12T18:19:22.646555+0000","last_active":"2024-09-12T19:20:02.968591+0000","last_peered":"2024-09-12T19:20:02.968591+0000","last_clean":"2024-09-12T19:20:02.968591+0000","last_became_active":"2024-09-12T18:19:22.645829+0000","last_became_peered":"2024-09-12T18:19:22.645829+0000","last_unstale":"2024-09-12T19:20:02.968591+0000","last_undegraded":"2024-09-12T19:20:02.968591+0000","last_fullsized":"2024-09-12T19:20:02.968591+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:14.278527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"267'9","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.986200+0000","last_change":"2024-09-12T17:52:23.472557+0000","last_active":"2024-09-12T19:22:58.986200+0000","last_peered":"2024-09-12T19:22:58.986200+0000","last_clean":"2024-09-12T19:22:58.986200+0000","last_became_active":"2024-09-12T17:52:23.438623+0000","last_became_peered":"2024-09-12T17:52:23.438623+0000","last_unstale":"2024-09-12T19:22:58.986200+0000","last_undegraded":"2024-09-12T19:22:58.986200+0000","last_fullsized":"2024-09-12T19:22:58.986200+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:04.013275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":19,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.16","version":"267'1","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.518185+0000","last_change":"2024-09-12T17:51:52.884671+0000","last_active":"2024-09-12T19:18:53.518185+0000","last_peered":"2024-09-12T19:18:53.518185+0000","last_clean":"2024-09-12T19:18:53.518185+0000","last_became_active":"2024-09-12T17:51:52.876542+0000","last_became_peered":"2024-09-12T17:51:52.876542+0000","last_unstale":"2024-09-12T19:18:53.518185+0000","last_undegraded":"2024-09-12T19:18:53.518185+0000","last_fullsized":"2024-09-12T19:18:53.518185+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:01.214988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"0'0","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.532458+0000","last_change":"2024-09-12T17:45:41.575734+0000","last_active":"2024-09-12T19:19:58.532458+0000","last_peered":"2024-09-12T19:19:58.532458+0000","last_clean":"2024-09-12T19:19:58.532458+0000","last_became_active":"2024-09-12T17:45:41.574953+0000","last_became_peered":"2024-09-12T17:45:41.574953+0000","last_unstale":"2024-09-12T19:19:58.532458+0000","last_undegraded":"2024-09-12T19:19:58.532458+0000","last_fullsized":"2024-09-12T19:19:58.532458+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:53.875702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.986527+0000","last_change":"2024-09-12T18:19:22.658747+0000","last_active":"2024-09-12T19:20:02.986527+0000","last_peered":"2024-09-12T19:20:02.986527+0000","last_clean":"2024-09-12T19:20:02.986527+0000","last_became_active":"2024-09-12T18:19:22.657731+0000","last_became_peered":"2024-09-12T18:19:22.657731+0000","last_unstale":"2024-09-12T19:20:02.986527+0000","last_undegraded":"2024-09-12T19:20:02.986527+0000","last_fullsized":"2024-09-12T19:20:02.986527+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:22.834751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"267'5","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:28.216153+0000","last_change":"2024-09-12T17:51:59.948754+0000","last_active":"2024-09-12T19:21:28.216153+0000","last_peered":"2024-09-12T19:21:28.216153+0000","last_clean":"2024-09-12T19:21:28.216153+0000","last_became_active":"2024-09-12T17:51:59.937650+0000","last_became_peered":"2024-09-12T17:51:59.937650+0000","last_unstale":"2024-09-12T19:21:28.216153+0000","last_undegraded":"2024-09-12T19:21:28.216153+0000","last_fullsized":"2024-09-12T19:21:28.216153+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:52.287318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.167284+0000","last_change":"2024-09-12T17:51:52.888708+0000","last_active":"2024-09-12T19:18:53.167284+0000","last_peered":"2024-09-12T19:18:53.167284+0000","last_clean":"2024-09-12T19:18:53.167284+0000","last_became_active":"2024-09-12T17:51:52.887964+0000","last_became_peered":"2024-09-12T17:51:52.887964+0000","last_unstale":"2024-09-12T19:18:53.167284+0000","last_undegraded":"2024-09-12T19:18:53.167284+0000","last_fullsized":"2024-09-12T19:18:53.167284+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:57.571315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'27","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959037+0000","last_change":"2024-09-12T17:45:41.595246+0000","last_active":"2024-09-12T19:19:22.959037+0000","last_peered":"2024-09-12T19:19:22.959037+0000","last_clean":"2024-09-12T19:19:22.959037+0000","last_became_active":"2024-09-12T17:45:41.594619+0000","last_became_peered":"2024-09-12T17:45:41.594619+0000","last_unstale":"2024-09-12T19:19:22.959037+0000","last_undegraded":"2024-09-12T19:19:22.959037+0000","last_fullsized":"2024-09-12T19:19:22.959037+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:08.142112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252332+0000","last_change":"2024-09-12T18:19:22.646874+0000","last_active":"2024-09-12T19:19:48.252332+0000","last_peered":"2024-09-12T19:19:48.252332+0000","last_clean":"2024-09-12T19:19:48.252332+0000","last_became_active":"2024-09-12T18:19:22.646129+0000","last_became_peered":"2024-09-12T18:19:22.646129+0000","last_unstale":"2024-09-12T19:19:48.252332+0000","last_undegraded":"2024-09-12T19:19:48.252332+0000","last_fullsized":"2024-09-12T19:19:48.252332+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:17.061904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.988325+0000","last_change":"2024-09-12T17:51:59.962952+0000","last_active":"2024-09-12T19:20:42.988325+0000","last_peered":"2024-09-12T19:20:42.988325+0000","last_clean":"2024-09-12T19:20:42.988325+0000","last_became_active":"2024-09-12T17:51:59.961892+0000","last_became_peered":"2024-09-12T17:51:59.961892+0000","last_unstale":"2024-09-12T19:20:42.988325+0000","last_undegraded":"2024-09-12T19:20:42.988325+0000","last_fullsized":"2024-09-12T19:20:42.988325+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:48.287564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'5","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.203445+0000","last_change":"2024-09-12T17:51:52.865750+0000","last_active":"2024-09-12T19:20:33.203445+0000","last_peered":"2024-09-12T19:20:33.203445+0000","last_clean":"2024-09-12T19:20:33.203445+0000","last_became_active":"2024-09-12T17:51:52.865019+0000","last_became_peered":"2024-09-12T17:51:52.865019+0000","last_unstale":"2024-09-12T19:20:33.203445+0000","last_undegraded":"2024-09-12T19:20:33.203445+0000","last_fullsized":"2024-09-12T19:20:33.203445+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:48.706108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'30","reported_seq":153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:02.954345+0000","last_change":"2024-09-12T17:45:41.595661+0000","last_active":"2024-09-12T19:19:02.954345+0000","last_peered":"2024-09-12T19:19:02.954345+0000","last_clean":"2024-09-12T19:19:02.954345+0000","last_became_active":"2024-09-12T17:45:41.594848+0000","last_became_peered":"2024-09-12T17:45:41.594848+0000","last_unstale":"2024-09-12T19:19:02.954345+0000","last_undegraded":"2024-09-12T19:19:02.954345+0000","last_fullsized":"2024-09-12T19:19:02.954345+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:51.035395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":101,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.182427+0000","last_change":"2024-09-12T18:19:22.649527+0000","last_active":"2024-09-12T19:19:48.182427+0000","last_peered":"2024-09-12T19:19:48.182427+0000","last_clean":"2024-09-12T19:19:48.182427+0000","last_became_active":"2024-09-12T18:19:22.648818+0000","last_became_peered":"2024-09-12T18:19:22.648818+0000","last_unstale":"2024-09-12T19:19:48.182427+0000","last_undegraded":"2024-09-12T19:19:48.182427+0000","last_fullsized":"2024-09-12T19:19:48.182427+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:23.776526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.988222+0000","last_change":"2024-09-12T17:51:59.954324+0000","last_active":"2024-09-12T19:20:42.988222+0000","last_peered":"2024-09-12T19:20:42.988222+0000","last_clean":"2024-09-12T19:20:42.988222+0000","last_became_active":"2024-09-12T17:51:59.953480+0000","last_became_peered":"2024-09-12T17:51:59.953480+0000","last_unstale":"2024-09-12T19:20:42.988222+0000","last_undegraded":"2024-09-12T19:20:42.988222+0000","last_fullsized":"2024-09-12T19:20:42.988222+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:03.945523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.264807+0000","last_change":"2024-09-12T17:51:52.886235+0000","last_active":"2024-09-12T19:20:33.264807+0000","last_peered":"2024-09-12T19:20:33.264807+0000","last_clean":"2024-09-12T19:20:33.264807+0000","last_became_active":"2024-09-12T17:51:52.884758+0000","last_became_peered":"2024-09-12T17:51:52.884758+0000","last_unstale":"2024-09-12T19:20:33.264807+0000","last_undegraded":"2024-09-12T19:20:33.264807+0000","last_fullsized":"2024-09-12T19:20:33.264807+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:14.092386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'17","reported_seq":121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.169851+0000","last_change":"2024-09-12T17:45:41.586061+0000","last_active":"2024-09-12T19:19:03.169851+0000","last_peered":"2024-09-12T19:19:03.169851+0000","last_clean":"2024-09-12T19:19:03.169851+0000","last_became_active":"2024-09-12T17:45:41.585259+0000","last_became_peered":"2024-09-12T17:45:41.585259+0000","last_unstale":"2024-09-12T19:19:03.169851+0000","last_undegraded":"2024-09-12T19:19:03.169851+0000","last_fullsized":"2024-09-12T19:19:03.169851+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:41.750928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":55,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.189074+0000","last_change":"2024-09-12T18:19:22.658645+0000","last_active":"2024-09-12T19:20:13.189074+0000","last_peered":"2024-09-12T19:20:13.189074+0000","last_clean":"2024-09-12T19:20:13.189074+0000","last_became_active":"2024-09-12T18:19:22.655117+0000","last_became_peered":"2024-09-12T18:19:22.655117+0000","last_unstale":"2024-09-12T19:20:13.189074+0000","last_undegraded":"2024-09-12T19:20:13.189074+0000","last_fullsized":"2024-09-12T19:20:13.189074+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:32.691865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:23.231264+0000","last_change":"2024-09-12T17:51:59.940572+0000","last_active":"2024-09-12T19:18:23.231264+0000","last_peered":"2024-09-12T19:18:23.231264+0000","last_clean":"2024-09-12T19:18:23.231264+0000","last_became_active":"2024-09-12T17:51:59.939751+0000","last_became_peered":"2024-09-12T17:51:59.939751+0000","last_unstale":"2024-09-12T19:18:23.231264+0000","last_undegraded":"2024-09-12T19:18:23.231264+0000","last_fullsized":"2024-09-12T19:18:23.231264+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:17.997521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.563717+0000","last_change":"2024-09-12T17:51:52.897941+0000","last_active":"2024-09-12T19:20:33.563717+0000","last_peered":"2024-09-12T19:20:33.563717+0000","last_clean":"2024-09-12T19:20:33.563717+0000","last_became_active":"2024-09-12T17:51:52.897168+0000","last_became_peered":"2024-09-12T17:51:52.897168+0000","last_unstale":"2024-09-12T19:20:33.563717+0000","last_undegraded":"2024-09-12T19:20:33.563717+0000","last_fullsized":"2024-09-12T19:20:33.563717+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:25.110112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'29","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.182170+0000","last_change":"2024-09-12T17:45:41.580462+0000","last_active":"2024-09-12T19:19:03.182170+0000","last_peered":"2024-09-12T19:19:03.182170+0000","last_clean":"2024-09-12T19:19:03.182170+0000","last_became_active":"2024-09-12T17:45:41.579765+0000","last_became_peered":"2024-09-12T17:45:41.579765+0000","last_unstale":"2024-09-12T19:19:03.182170+0000","last_undegraded":"2024-09-12T19:19:03.182170+0000","last_fullsized":"2024-09-12T19:19:03.182170+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:03.611178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":115,"num_write":41,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252289+0000","last_change":"2024-09-12T18:19:22.643191+0000","last_active":"2024-09-12T19:19:48.252289+0000","last_peered":"2024-09-12T19:19:48.252289+0000","last_clean":"2024-09-12T19:19:48.252289+0000","last_became_active":"2024-09-12T18:19:22.642415+0000","last_became_peered":"2024-09-12T18:19:22.642415+0000","last_unstale":"2024-09-12T19:19:48.252289+0000","last_undegraded":"2024-09-12T19:19:48.252289+0000","last_fullsized":"2024-09-12T19:19:48.252289+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:16.303449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:23.535948+0000","last_change":"2024-09-12T17:51:59.934455+0000","last_active":"2024-09-12T19:18:23.535948+0000","last_peered":"2024-09-12T19:18:23.535948+0000","last_clean":"2024-09-12T19:18:23.535948+0000","last_became_active":"2024-09-12T17:51:59.933679+0000","last_became_peered":"2024-09-12T17:51:59.933679+0000","last_unstale":"2024-09-12T19:18:23.535948+0000","last_undegraded":"2024-09-12T19:18:23.535948+0000","last_fullsized":"2024-09-12T19:18:23.535948+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:50.876767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"267'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:53.026201+0000","last_change":"2024-09-12T17:51:52.892730+0000","last_active":"2024-09-12T19:22:53.026201+0000","last_peered":"2024-09-12T19:22:53.026201+0000","last_clean":"2024-09-12T19:22:53.026201+0000","last_became_active":"2024-09-12T17:51:52.891977+0000","last_became_peered":"2024-09-12T17:51:52.891977+0000","last_unstale":"2024-09-12T19:22:53.026201+0000","last_undegraded":"2024-09-12T19:22:53.026201+0000","last_fullsized":"2024-09-12T19:22:53.026201+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:36.414562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'38","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.241715+0000","last_change":"2024-09-12T17:45:41.580119+0000","last_active":"2024-09-12T19:19:03.241715+0000","last_peered":"2024-09-12T19:19:03.241715+0000","last_clean":"2024-09-12T19:19:03.241715+0000","last_became_active":"2024-09-12T17:45:41.579275+0000","last_became_peered":"2024-09-12T17:45:41.579275+0000","last_unstale":"2024-09-12T19:19:03.241715+0000","last_undegraded":"2024-09-12T19:19:03.241715+0000","last_fullsized":"2024-09-12T19:19:03.241715+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:25.255989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":125,"num_write":71,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.534755+0000","last_change":"2024-09-12T18:19:22.657572+0000","last_active":"2024-09-12T19:20:08.534755+0000","last_peered":"2024-09-12T19:20:08.534755+0000","last_clean":"2024-09-12T19:20:08.534755+0000","last_became_active":"2024-09-12T18:19:22.656770+0000","last_became_peered":"2024-09-12T18:19:22.656770+0000","last_unstale":"2024-09-12T19:20:08.534755+0000","last_undegraded":"2024-09-12T19:20:08.534755+0000","last_fullsized":"2024-09-12T19:20:08.534755+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:58.749315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"267'4","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252315+0000","last_change":"2024-09-12T17:51:59.941713+0000","last_active":"2024-09-12T19:19:48.252315+0000","last_peered":"2024-09-12T19:19:48.252315+0000","last_clean":"2024-09-12T19:19:48.252315+0000","last_became_active":"2024-09-12T17:51:59.934972+0000","last_became_peered":"2024-09-12T17:51:59.934972+0000","last_unstale":"2024-09-12T19:19:48.252315+0000","last_undegraded":"2024-09-12T19:19:48.252315+0000","last_fullsized":"2024-09-12T19:19:48.252315+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:09.715388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":18432,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.962680+0000","last_change":"2024-09-12T17:51:52.901505+0000","last_active":"2024-09-12T19:19:37.962680+0000","last_peered":"2024-09-12T19:19:37.962680+0000","last_clean":"2024-09-12T19:19:37.962680+0000","last_became_active":"2024-09-12T17:51:52.900002+0000","last_became_peered":"2024-09-12T17:51:52.900002+0000","last_unstale":"2024-09-12T19:19:37.962680+0000","last_undegraded":"2024-09-12T19:19:37.962680+0000","last_fullsized":"2024-09-12T19:19:37.962680+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:16.493687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'34","reported_seq":174,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.265060+0000","last_change":"2024-09-12T17:45:41.581349+0000","last_active":"2024-09-12T19:20:33.265060+0000","last_peered":"2024-09-12T19:20:33.265060+0000","last_clean":"2024-09-12T19:20:33.265060+0000","last_became_active":"2024-09-12T17:45:41.580617+0000","last_became_peered":"2024-09-12T17:45:41.580617+0000","last_unstale":"2024-09-12T19:20:33.265060+0000","last_undegraded":"2024-09-12T19:20:33.265060+0000","last_fullsized":"2024-09-12T19:20:33.265060+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:04.951687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":129,"num_write":59,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:07.970075+0000","last_change":"2024-09-12T18:19:22.665735+0000","last_active":"2024-09-12T19:20:07.970075+0000","last_peered":"2024-09-12T19:20:07.970075+0000","last_clean":"2024-09-12T19:20:07.970075+0000","last_became_active":"2024-09-12T18:19:22.664960+0000","last_became_peered":"2024-09-12T18:19:22.664960+0000","last_unstale":"2024-09-12T19:20:07.970075+0000","last_undegraded":"2024-09-12T19:20:07.970075+0000","last_fullsized":"2024-09-12T19:20:07.970075+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:46.264476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'2","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252248+0000","last_change":"2024-09-12T17:51:59.949566+0000","last_active":"2024-09-12T19:19:48.252248+0000","last_peered":"2024-09-12T19:19:48.252248+0000","last_clean":"2024-09-12T19:19:48.252248+0000","last_became_active":"2024-09-12T17:51:59.948733+0000","last_became_peered":"2024-09-12T17:51:59.948733+0000","last_unstale":"2024-09-12T19:19:48.252248+0000","last_undegraded":"2024-09-12T19:19:48.252248+0000","last_fullsized":"2024-09-12T19:19:48.252248+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:47.852395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.528103+0000","last_change":"2024-09-12T17:51:52.905209+0000","last_active":"2024-09-12T19:19:38.528103+0000","last_peered":"2024-09-12T19:19:38.528103+0000","last_clean":"2024-09-12T19:19:38.528103+0000","last_became_active":"2024-09-12T17:51:52.904092+0000","last_became_peered":"2024-09-12T17:51:52.904092+0000","last_unstale":"2024-09-12T19:19:38.528103+0000","last_undegraded":"2024-09-12T19:19:38.528103+0000","last_fullsized":"2024-09-12T19:19:38.528103+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:00.570363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'87","reported_seq":311,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:12.988906+0000","last_change":"2024-09-12T17:45:41.578591+0000","last_active":"2024-09-12T19:20:12.988906+0000","last_peered":"2024-09-12T19:20:12.988906+0000","last_clean":"2024-09-12T19:20:12.988906+0000","last_became_active":"2024-09-12T17:45:41.574884+0000","last_became_peered":"2024-09-12T17:45:41.574884+0000","last_unstale":"2024-09-12T19:20:12.988906+0000","last_undegraded":"2024-09-12T19:20:12.988906+0000","last_fullsized":"2024-09-12T19:20:12.988906+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:26.324719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":442,"num_read_kb":315,"num_write":154,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.557025+0000","last_change":"2024-09-12T18:19:22.633163+0000","last_active":"2024-09-12T19:20:03.557025+0000","last_peered":"2024-09-12T19:20:03.557025+0000","last_clean":"2024-09-12T19:20:03.557025+0000","last_became_active":"2024-09-12T18:19:22.632360+0000","last_became_peered":"2024-09-12T18:19:22.632360+0000","last_unstale":"2024-09-12T19:20:03.557025+0000","last_undegraded":"2024-09-12T19:20:03.557025+0000","last_fullsized":"2024-09-12T19:20:03.557025+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:12.189773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'7","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:12.981953+0000","last_change":"2024-09-12T17:51:59.946265+0000","last_active":"2024-09-12T19:20:12.981953+0000","last_peered":"2024-09-12T19:20:12.981953+0000","last_clean":"2024-09-12T19:20:12.981953+0000","last_became_active":"2024-09-12T17:51:59.945099+0000","last_became_peered":"2024-09-12T17:51:59.945099+0000","last_unstale":"2024-09-12T19:20:12.981953+0000","last_undegraded":"2024-09-12T19:20:12.981953+0000","last_fullsized":"2024-09-12T19:20:12.981953+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:52.338695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.212670+0000","last_change":"2024-09-12T17:51:52.899779+0000","last_active":"2024-09-12T19:21:53.212670+0000","last_peered":"2024-09-12T19:21:53.212670+0000","last_clean":"2024-09-12T19:21:53.212670+0000","last_became_active":"2024-09-12T17:51:52.889772+0000","last_became_peered":"2024-09-12T17:51:52.889772+0000","last_unstale":"2024-09-12T19:21:53.212670+0000","last_undegraded":"2024-09-12T19:21:53.212670+0000","last_fullsized":"2024-09-12T19:21:53.212670+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:13.521012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'27","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.559281+0000","last_change":"2024-09-12T17:45:41.591605+0000","last_active":"2024-09-12T19:20:13.559281+0000","last_peered":"2024-09-12T19:20:13.559281+0000","last_clean":"2024-09-12T19:20:13.559281+0000","last_became_active":"2024-09-12T17:45:41.590861+0000","last_became_peered":"2024-09-12T17:45:41.590861+0000","last_unstale":"2024-09-12T19:20:13.559281+0000","last_undegraded":"2024-09-12T19:20:13.559281+0000","last_fullsized":"2024-09-12T19:20:13.559281+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:02.020910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":90,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968726+0000","last_change":"2024-09-12T18:19:22.656976+0000","last_active":"2024-09-12T19:20:02.968726+0000","last_peered":"2024-09-12T19:20:02.968726+0000","last_clean":"2024-09-12T19:20:02.968726+0000","last_became_active":"2024-09-12T18:19:22.655979+0000","last_became_peered":"2024-09-12T18:19:22.655979+0000","last_unstale":"2024-09-12T19:20:02.968726+0000","last_undegraded":"2024-09-12T19:20:02.968726+0000","last_fullsized":"2024-09-12T19:20:02.968726+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:36.624661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252347+0000","last_change":"2024-09-12T17:51:59.945983+0000","last_active":"2024-09-12T19:19:48.252347+0000","last_peered":"2024-09-12T19:19:48.252347+0000","last_clean":"2024-09-12T19:19:48.252347+0000","last_became_active":"2024-09-12T17:51:59.942431+0000","last_became_peered":"2024-09-12T17:51:59.942431+0000","last_unstale":"2024-09-12T19:19:48.252347+0000","last_undegraded":"2024-09-12T19:19:48.252347+0000","last_fullsized":"2024-09-12T19:19:48.252347+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:57.343792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5283025,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10320,"num_write":8,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:18.007302+0000","last_change":"2024-09-12T17:51:52.901374+0000","last_active":"2024-09-12T19:22:18.007302+0000","last_peered":"2024-09-12T19:22:18.007302+0000","last_clean":"2024-09-12T19:22:18.007302+0000","last_became_active":"2024-09-12T17:51:52.900785+0000","last_became_peered":"2024-09-12T17:51:52.900785+0000","last_unstale":"2024-09-12T19:22:18.007302+0000","last_undegraded":"2024-09-12T19:22:18.007302+0000","last_fullsized":"2024-09-12T19:22:18.007302+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:43.825575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'9","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.535920+0000","last_change":"2024-09-12T17:45:41.566506+0000","last_active":"2024-09-12T19:20:13.535920+0000","last_peered":"2024-09-12T19:20:13.535920+0000","last_clean":"2024-09-12T19:20:13.535920+0000","last_became_active":"2024-09-12T17:45:41.565793+0000","last_became_peered":"2024-09-12T17:45:41.565793+0000","last_unstale":"2024-09-12T19:20:13.535920+0000","last_undegraded":"2024-09-12T19:20:13.535920+0000","last_fullsized":"2024-09-12T19:20:13.535920+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:00.492098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.257645+0000","last_change":"2024-09-12T18:19:22.664289+0000","last_active":"2024-09-12T19:20:08.257645+0000","last_peered":"2024-09-12T19:20:08.257645+0000","last_clean":"2024-09-12T19:20:08.257645+0000","last_became_active":"2024-09-12T18:19:22.663586+0000","last_became_peered":"2024-09-12T18:19:22.663586+0000","last_unstale":"2024-09-12T19:20:08.257645+0000","last_undegraded":"2024-09-12T19:20:08.257645+0000","last_fullsized":"2024-09-12T19:20:08.257645+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:24.618521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:53.208011+0000","last_change":"2024-09-12T17:51:59.950216+0000","last_active":"2024-09-12T19:20:53.208011+0000","last_peered":"2024-09-12T19:20:53.208011+0000","last_clean":"2024-09-12T19:20:53.208011+0000","last_became_active":"2024-09-12T17:51:59.949437+0000","last_became_peered":"2024-09-12T17:51:59.949437+0000","last_unstale":"2024-09-12T19:20:53.208011+0000","last_undegraded":"2024-09-12T19:20:53.208011+0000","last_fullsized":"2024-09-12T19:20:53.208011+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:26.376958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:53.224729+0000","last_change":"2024-09-12T17:51:52.899343+0000","last_active":"2024-09-12T19:22:53.224729+0000","last_peered":"2024-09-12T19:22:53.224729+0000","last_clean":"2024-09-12T19:22:53.224729+0000","last_became_active":"2024-09-12T17:51:52.898903+0000","last_became_peered":"2024-09-12T17:51:52.898903+0000","last_unstale":"2024-09-12T19:22:53.224729+0000","last_undegraded":"2024-09-12T19:22:53.224729+0000","last_fullsized":"2024-09-12T19:22:53.224729+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:05.020501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'42","reported_seq":194,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.188942+0000","last_change":"2024-09-12T17:45:41.577630+0000","last_active":"2024-09-12T19:20:13.188942+0000","last_peered":"2024-09-12T19:20:13.188942+0000","last_clean":"2024-09-12T19:20:13.188942+0000","last_became_active":"2024-09-12T17:45:41.576921+0000","last_became_peered":"2024-09-12T17:45:41.576921+0000","last_unstale":"2024-09-12T19:20:13.188942+0000","last_undegraded":"2024-09-12T19:20:13.188942+0000","last_fullsized":"2024-09-12T19:20:13.188942+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:39.622331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":172,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:22.973830+0000","last_change":"2024-09-12T18:19:22.670182+0000","last_active":"2024-09-12T19:20:22.973830+0000","last_peered":"2024-09-12T19:20:22.973830+0000","last_clean":"2024-09-12T19:20:22.973830+0000","last_became_active":"2024-09-12T18:19:22.669476+0000","last_became_peered":"2024-09-12T18:19:22.669476+0000","last_unstale":"2024-09-12T19:20:22.973830+0000","last_undegraded":"2024-09-12T19:20:22.973830+0000","last_fullsized":"2024-09-12T19:20:22.973830+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:51.189488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:52.980628+0000","last_change":"2024-09-12T17:51:59.939499+0000","last_active":"2024-09-12T19:20:52.980628+0000","last_peered":"2024-09-12T19:20:52.980628+0000","last_clean":"2024-09-12T19:20:52.980628+0000","last_became_active":"2024-09-12T17:51:59.938736+0000","last_became_peered":"2024-09-12T17:51:59.938736+0000","last_unstale":"2024-09-12T19:20:52.980628+0000","last_undegraded":"2024-09-12T19:20:52.980628+0000","last_fullsized":"2024-09-12T19:20:52.980628+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:10.628111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'2","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:53.014895+0000","last_change":"2024-09-12T17:51:52.901410+0000","last_active":"2024-09-12T19:22:53.014895+0000","last_peered":"2024-09-12T19:22:53.014895+0000","last_clean":"2024-09-12T19:22:53.014895+0000","last_became_active":"2024-09-12T17:51:52.900972+0000","last_became_peered":"2024-09-12T17:51:52.900972+0000","last_unstale":"2024-09-12T19:22:53.014895+0000","last_undegraded":"2024-09-12T19:22:53.014895+0000","last_fullsized":"2024-09-12T19:22:53.014895+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:55.522541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'26","reported_seq":147,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:12.956617+0000","last_change":"2024-09-12T17:45:41.588736+0000","last_active":"2024-09-12T19:19:12.956617+0000","last_peered":"2024-09-12T19:19:12.956617+0000","last_clean":"2024-09-12T19:19:12.956617+0000","last_became_active":"2024-09-12T17:45:41.588013+0000","last_became_peered":"2024-09-12T17:45:41.588013+0000","last_unstale":"2024-09-12T19:19:12.956617+0000","last_undegraded":"2024-09-12T19:19:12.956617+0000","last_fullsized":"2024-09-12T19:19:12.956617+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:46.460159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":89,"num_write":52,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:07.970160+0000","last_change":"2024-09-12T18:19:22.664050+0000","last_active":"2024-09-12T19:20:07.970160+0000","last_peered":"2024-09-12T19:20:07.970160+0000","last_clean":"2024-09-12T19:20:07.970160+0000","last_became_active":"2024-09-12T18:19:22.662685+0000","last_became_peered":"2024-09-12T18:19:22.662685+0000","last_unstale":"2024-09-12T19:20:07.970160+0000","last_undegraded":"2024-09-12T19:20:07.970160+0000","last_fullsized":"2024-09-12T19:20:07.970160+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:20.137876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'10","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.864488+0000","last_change":"2024-09-12T17:51:59.943267+0000","last_active":"2024-09-12T19:22:59.864488+0000","last_peered":"2024-09-12T19:22:59.864488+0000","last_clean":"2024-09-12T19:22:59.864488+0000","last_became_active":"2024-09-12T17:51:59.942597+0000","last_became_peered":"2024-09-12T17:51:59.942597+0000","last_unstale":"2024-09-12T19:22:59.864488+0000","last_undegraded":"2024-09-12T19:22:59.864488+0000","last_fullsized":"2024-09-12T19:22:59.864488+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:04.930513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":29698,"num_write":10,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"267'3","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:58.200287+0000","last_change":"2024-09-12T17:51:52.908849+0000","last_active":"2024-09-12T19:20:58.200287+0000","last_peered":"2024-09-12T19:20:58.200287+0000","last_clean":"2024-09-12T19:20:58.200287+0000","last_became_active":"2024-09-12T17:51:52.908200+0000","last_became_peered":"2024-09-12T17:51:52.908200+0000","last_unstale":"2024-09-12T19:20:58.200287+0000","last_undegraded":"2024-09-12T19:20:58.200287+0000","last_fullsized":"2024-09-12T19:20:58.200287+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:57.469586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'15","reported_seq":118,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.239287+0000","last_change":"2024-09-12T17:45:41.578047+0000","last_active":"2024-09-12T19:18:53.239287+0000","last_peered":"2024-09-12T19:18:53.239287+0000","last_clean":"2024-09-12T19:18:53.239287+0000","last_became_active":"2024-09-12T17:45:41.572067+0000","last_became_peered":"2024-09-12T17:45:41.572067+0000","last_unstale":"2024-09-12T19:18:53.239287+0000","last_undegraded":"2024-09-12T19:18:53.239287+0000","last_fullsized":"2024-09-12T19:18:53.239287+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:00.575546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.187554+0000","last_change":"2024-09-12T18:19:22.653075+0000","last_active":"2024-09-12T19:20:08.187554+0000","last_peered":"2024-09-12T19:20:08.187554+0000","last_clean":"2024-09-12T19:20:08.187554+0000","last_became_active":"2024-09-12T18:19:22.648052+0000","last_became_peered":"2024-09-12T18:19:22.648052+0000","last_unstale":"2024-09-12T19:20:08.187554+0000","last_undegraded":"2024-09-12T19:20:08.187554+0000","last_fullsized":"2024-09-12T19:20:08.187554+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:19.707016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"267'8","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.988426+0000","last_change":"2024-09-12T17:51:59.949619+0000","last_active":"2024-09-12T19:22:58.988426+0000","last_peered":"2024-09-12T19:22:58.988426+0000","last_clean":"2024-09-12T19:22:58.988426+0000","last_became_active":"2024-09-12T17:51:59.948873+0000","last_became_peered":"2024-09-12T17:51:59.948873+0000","last_unstale":"2024-09-12T19:22:58.988426+0000","last_undegraded":"2024-09-12T19:22:58.988426+0000","last_fullsized":"2024-09-12T19:22:58.988426+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:03.402596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.190557+0000","last_change":"2024-09-12T17:51:52.890333+0000","last_active":"2024-09-12T19:19:38.190557+0000","last_peered":"2024-09-12T19:19:38.190557+0000","last_clean":"2024-09-12T19:19:38.190557+0000","last_became_active":"2024-09-12T17:51:52.889529+0000","last_became_peered":"2024-09-12T17:51:52.889529+0000","last_unstale":"2024-09-12T19:19:38.190557+0000","last_undegraded":"2024-09-12T19:19:38.190557+0000","last_fullsized":"2024-09-12T19:19:38.190557+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:16.334887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'21","reported_seq":135,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.542152+0000","last_change":"2024-09-12T17:45:41.580279+0000","last_active":"2024-09-12T19:18:53.542152+0000","last_peered":"2024-09-12T19:18:53.542152+0000","last_clean":"2024-09-12T19:18:53.542152+0000","last_became_active":"2024-09-12T17:45:41.579580+0000","last_became_peered":"2024-09-12T17:45:41.579580+0000","last_unstale":"2024-09-12T19:18:53.542152+0000","last_undegraded":"2024-09-12T19:18:53.542152+0000","last_fullsized":"2024-09-12T19:18:53.542152+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:43.960745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":77,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.964979+0000","last_change":"2024-09-12T18:19:22.669927+0000","last_active":"2024-09-12T19:19:47.964979+0000","last_peered":"2024-09-12T19:19:47.964979+0000","last_clean":"2024-09-12T19:19:47.964979+0000","last_became_active":"2024-09-12T18:19:22.669240+0000","last_became_peered":"2024-09-12T18:19:22.669240+0000","last_unstale":"2024-09-12T19:19:47.964979+0000","last_undegraded":"2024-09-12T19:19:47.964979+0000","last_fullsized":"2024-09-12T19:19:47.964979+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:35.739210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.182370+0000","last_change":"2024-09-12T17:51:59.970451+0000","last_active":"2024-09-12T19:19:48.182370+0000","last_peered":"2024-09-12T19:19:48.182370+0000","last_clean":"2024-09-12T19:19:48.182370+0000","last_became_active":"2024-09-12T17:51:59.969706+0000","last_became_peered":"2024-09-12T17:51:59.969706+0000","last_unstale":"2024-09-12T19:19:48.182370+0000","last_undegraded":"2024-09-12T19:19:48.182370+0000","last_fullsized":"2024-09-12T19:19:48.182370+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:53.849725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'6","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959065+0000","last_change":"2024-09-12T17:51:52.884785+0000","last_active":"2024-09-12T19:19:22.959065+0000","last_peered":"2024-09-12T19:19:22.959065+0000","last_clean":"2024-09-12T19:19:22.959065+0000","last_became_active":"2024-09-12T17:51:52.884061+0000","last_became_peered":"2024-09-12T17:51:52.884061+0000","last_unstale":"2024-09-12T19:19:22.959065+0000","last_undegraded":"2024-09-12T19:19:22.959065+0000","last_fullsized":"2024-09-12T19:19:22.959065+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:17.943043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'29","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.167345+0000","last_change":"2024-09-12T17:45:41.573958+0000","last_active":"2024-09-12T19:18:53.167345+0000","last_peered":"2024-09-12T19:18:53.167345+0000","last_clean":"2024-09-12T19:18:53.167345+0000","last_became_active":"2024-09-12T17:45:41.572130+0000","last_became_peered":"2024-09-12T17:45:41.572130+0000","last_unstale":"2024-09-12T19:18:53.167345+0000","last_undegraded":"2024-09-12T19:18:53.167345+0000","last_fullsized":"2024-09-12T19:18:53.167345+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:19.465432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":63,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.982479+0000","last_change":"2024-09-12T18:19:22.667322+0000","last_active":"2024-09-12T19:19:47.982479+0000","last_peered":"2024-09-12T19:19:47.982479+0000","last_clean":"2024-09-12T19:19:47.982479+0000","last_became_active":"2024-09-12T18:19:22.666608+0000","last_became_peered":"2024-09-12T18:19:22.666608+0000","last_unstale":"2024-09-12T19:19:47.982479+0000","last_undegraded":"2024-09-12T19:19:47.982479+0000","last_fullsized":"2024-09-12T19:19:47.982479+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:35.427234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.178096+0000","last_change":"2024-09-12T17:51:59.956619+0000","last_active":"2024-09-12T19:19:33.178096+0000","last_peered":"2024-09-12T19:19:33.178096+0000","last_clean":"2024-09-12T19:19:33.178096+0000","last_became_active":"2024-09-12T17:51:59.956010+0000","last_became_peered":"2024-09-12T17:51:59.956010+0000","last_unstale":"2024-09-12T19:19:33.178096+0000","last_undegraded":"2024-09-12T19:19:33.178096+0000","last_fullsized":"2024-09-12T19:19:33.178096+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:44.171788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'2","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.527059+0000","last_change":"2024-09-12T17:51:52.904694+0000","last_active":"2024-09-12T19:19:33.527059+0000","last_peered":"2024-09-12T19:19:33.527059+0000","last_clean":"2024-09-12T19:19:33.527059+0000","last_became_active":"2024-09-12T17:51:52.903355+0000","last_became_peered":"2024-09-12T17:51:52.903355+0000","last_unstale":"2024-09-12T19:19:33.527059+0000","last_undegraded":"2024-09-12T19:19:33.527059+0000","last_fullsized":"2024-09-12T19:19:33.527059+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:54.768969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'38","reported_seq":184,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.542289+0000","last_change":"2024-09-12T17:45:41.578036+0000","last_active":"2024-09-12T19:18:53.542289+0000","last_peered":"2024-09-12T19:18:53.542289+0000","last_clean":"2024-09-12T19:18:53.542289+0000","last_became_active":"2024-09-12T17:45:41.577322+0000","last_became_peered":"2024-09-12T17:45:41.577322+0000","last_unstale":"2024-09-12T19:18:53.542289+0000","last_undegraded":"2024-09-12T19:18:53.542289+0000","last_fullsized":"2024-09-12T19:18:53.542289+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:32.631509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":139,"num_write":67,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.973565+0000","last_change":"2024-09-12T18:19:22.652387+0000","last_active":"2024-09-12T19:19:37.973565+0000","last_peered":"2024-09-12T19:19:37.973565+0000","last_clean":"2024-09-12T19:19:37.973565+0000","last_became_active":"2024-09-12T18:19:22.647003+0000","last_became_peered":"2024-09-12T18:19:22.647003+0000","last_unstale":"2024-09-12T19:19:37.973565+0000","last_undegraded":"2024-09-12T19:19:37.973565+0000","last_fullsized":"2024-09-12T19:19:37.973565+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:55.195971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.986890+0000","last_change":"2024-09-12T17:51:59.940082+0000","last_active":"2024-09-12T19:22:58.986890+0000","last_peered":"2024-09-12T19:22:58.986890+0000","last_clean":"2024-09-12T19:22:58.986890+0000","last_became_active":"2024-09-12T17:51:59.939200+0000","last_became_peered":"2024-09-12T17:51:59.939200+0000","last_unstale":"2024-09-12T19:22:58.986890+0000","last_undegraded":"2024-09-12T19:22:58.986890+0000","last_fullsized":"2024-09-12T19:22:58.986890+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:37.667275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"267'6","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.988584+0000","last_change":"2024-09-12T17:51:52.897536+0000","last_active":"2024-09-12T19:22:58.988584+0000","last_peered":"2024-09-12T19:22:58.988584+0000","last_clean":"2024-09-12T19:22:58.988584+0000","last_became_active":"2024-09-12T17:51:52.896708+0000","last_became_peered":"2024-09-12T17:51:52.896708+0000","last_unstale":"2024-09-12T19:22:58.988584+0000","last_undegraded":"2024-09-12T19:22:58.988584+0000","last_fullsized":"2024-09-12T19:22:58.988584+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:36.334907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'29","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.965069+0000","last_change":"2024-09-12T17:45:41.592647+0000","last_active":"2024-09-12T19:19:47.965069+0000","last_peered":"2024-09-12T19:19:47.965069+0000","last_clean":"2024-09-12T19:19:47.965069+0000","last_became_active":"2024-09-12T17:45:41.591866+0000","last_became_peered":"2024-09-12T17:45:41.591866+0000","last_unstale":"2024-09-12T19:19:47.965069+0000","last_undegraded":"2024-09-12T19:19:47.965069+0000","last_fullsized":"2024-09-12T19:19:47.965069+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:29.840636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.192729+0000","last_change":"2024-09-12T18:19:22.661674+0000","last_active":"2024-09-12T19:19:48.192729+0000","last_peered":"2024-09-12T19:19:48.192729+0000","last_clean":"2024-09-12T19:19:48.192729+0000","last_became_active":"2024-09-12T18:19:22.660667+0000","last_became_peered":"2024-09-12T18:19:22.660667+0000","last_unstale":"2024-09-12T19:19:48.192729+0000","last_undegraded":"2024-09-12T19:19:48.192729+0000","last_fullsized":"2024-09-12T19:19:48.192729+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:47.455186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:53.208174+0000","last_change":"2024-09-12T17:51:59.949737+0000","last_active":"2024-09-12T19:20:53.208174+0000","last_peered":"2024-09-12T19:20:53.208174+0000","last_clean":"2024-09-12T19:20:53.208174+0000","last_became_active":"2024-09-12T17:51:59.948786+0000","last_became_peered":"2024-09-12T17:51:59.948786+0000","last_unstale":"2024-09-12T19:20:53.208174+0000","last_undegraded":"2024-09-12T19:20:53.208174+0000","last_fullsized":"2024-09-12T19:20:53.208174+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:33.491621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.978565+0000","last_change":"2024-09-12T17:51:52.896511+0000","last_active":"2024-09-12T19:20:42.978565+0000","last_peered":"2024-09-12T19:20:42.978565+0000","last_clean":"2024-09-12T19:20:42.978565+0000","last_became_active":"2024-09-12T17:51:52.895779+0000","last_became_peered":"2024-09-12T17:51:52.895779+0000","last_unstale":"2024-09-12T19:20:42.978565+0000","last_undegraded":"2024-09-12T19:20:42.978565+0000","last_fullsized":"2024-09-12T19:20:42.978565+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:11.529897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'43","reported_seq":205,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:27.971388+0000","last_change":"2024-09-12T17:45:41.584723+0000","last_active":"2024-09-12T19:19:27.971388+0000","last_peered":"2024-09-12T19:19:27.971388+0000","last_clean":"2024-09-12T19:19:27.971388+0000","last_became_active":"2024-09-12T17:45:41.576707+0000","last_became_peered":"2024-09-12T17:45:41.576707+0000","last_unstale":"2024-09-12T19:19:27.971388+0000","last_undegraded":"2024-09-12T19:19:27.971388+0000","last_fullsized":"2024-09-12T19:19:27.971388+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:31.487354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":167,"num_write":65,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.533665+0000","last_change":"2024-09-12T18:19:22.658620+0000","last_active":"2024-09-12T19:20:03.533665+0000","last_peered":"2024-09-12T19:20:03.533665+0000","last_clean":"2024-09-12T19:20:03.533665+0000","last_became_active":"2024-09-12T18:19:22.657891+0000","last_became_peered":"2024-09-12T18:19:22.657891+0000","last_unstale":"2024-09-12T19:20:03.533665+0000","last_undegraded":"2024-09-12T19:20:03.533665+0000","last_fullsized":"2024-09-12T19:20:03.533665+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:56.867297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:32.972545+0000","last_change":"2024-09-12T17:51:59.963668+0000","last_active":"2024-09-12T19:19:32.972545+0000","last_peered":"2024-09-12T19:19:32.972545+0000","last_clean":"2024-09-12T19:19:32.972545+0000","last_became_active":"2024-09-12T17:51:59.962769+0000","last_became_peered":"2024-09-12T17:51:59.962769+0000","last_unstale":"2024-09-12T19:19:32.972545+0000","last_undegraded":"2024-09-12T19:19:32.972545+0000","last_fullsized":"2024-09-12T19:19:32.972545+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:25.342532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'5","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:12.971293+0000","last_change":"2024-09-12T17:51:52.902253+0000","last_active":"2024-09-12T19:20:12.971293+0000","last_peered":"2024-09-12T19:20:12.971293+0000","last_clean":"2024-09-12T19:20:12.971293+0000","last_became_active":"2024-09-12T17:51:52.899987+0000","last_became_peered":"2024-09-12T17:51:52.899987+0000","last_unstale":"2024-09-12T19:20:12.971293+0000","last_undegraded":"2024-09-12T19:20:12.971293+0000","last_fullsized":"2024-09-12T19:20:12.971293+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:40.914632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'9","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:27.978145+0000","last_change":"2024-09-12T17:45:41.571623+0000","last_active":"2024-09-12T19:19:27.978145+0000","last_peered":"2024-09-12T19:19:27.978145+0000","last_clean":"2024-09-12T19:19:27.978145+0000","last_became_active":"2024-09-12T17:45:41.569871+0000","last_became_peered":"2024-09-12T17:45:41.569871+0000","last_unstale":"2024-09-12T19:19:27.978145+0000","last_undegraded":"2024-09-12T19:19:27.978145+0000","last_fullsized":"2024-09-12T19:19:27.978145+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:49.201478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.186072+0000","last_change":"2024-09-12T18:19:22.663293+0000","last_active":"2024-09-12T19:20:03.186072+0000","last_peered":"2024-09-12T19:20:03.186072+0000","last_clean":"2024-09-12T19:20:03.186072+0000","last_became_active":"2024-09-12T18:19:22.648018+0000","last_became_peered":"2024-09-12T18:19:22.648018+0000","last_unstale":"2024-09-12T19:20:03.186072+0000","last_undegraded":"2024-09-12T19:20:03.186072+0000","last_fullsized":"2024-09-12T19:20:03.186072+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:02.291028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'7","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.992212+0000","last_change":"2024-09-12T17:51:59.944498+0000","last_active":"2024-09-12T19:20:27.992212+0000","last_peered":"2024-09-12T19:20:27.992212+0000","last_clean":"2024-09-12T19:20:27.992212+0000","last_became_active":"2024-09-12T17:51:59.943764+0000","last_became_peered":"2024-09-12T17:51:59.943764+0000","last_unstale":"2024-09-12T19:20:27.992212+0000","last_undegraded":"2024-09-12T19:20:27.992212+0000","last_fullsized":"2024-09-12T19:20:27.992212+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:10.664480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20800,"num_write":12,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.958933+0000","last_change":"2024-09-12T17:51:52.894510+0000","last_active":"2024-09-12T19:19:22.958933+0000","last_peered":"2024-09-12T19:19:22.958933+0000","last_clean":"2024-09-12T19:19:22.958933+0000","last_became_active":"2024-09-12T17:51:52.893764+0000","last_became_peered":"2024-09-12T17:51:52.893764+0000","last_unstale":"2024-09-12T19:19:22.958933+0000","last_undegraded":"2024-09-12T19:19:22.958933+0000","last_fullsized":"2024-09-12T19:19:22.958933+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:33.064325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'85","reported_seq":313,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:28.188253+0000","last_change":"2024-09-12T17:45:41.579106+0000","last_active":"2024-09-12T19:19:28.188253+0000","last_peered":"2024-09-12T19:19:28.188253+0000","last_clean":"2024-09-12T19:19:28.188253+0000","last_became_active":"2024-09-12T17:45:41.576079+0000","last_became_peered":"2024-09-12T17:45:41.576079+0000","last_unstale":"2024-09-12T19:19:28.188253+0000","last_undegraded":"2024-09-12T19:19:28.188253+0000","last_fullsized":"2024-09-12T19:19:28.188253+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:21.619591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":312,"num_write":160,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.182314+0000","last_change":"2024-09-12T18:19:22.663744+0000","last_active":"2024-09-12T19:19:48.182314+0000","last_peered":"2024-09-12T19:19:48.182314+0000","last_clean":"2024-09-12T19:19:48.182314+0000","last_became_active":"2024-09-12T18:19:22.662955+0000","last_became_peered":"2024-09-12T18:19:22.662955+0000","last_unstale":"2024-09-12T19:19:48.182314+0000","last_undegraded":"2024-09-12T19:19:48.182314+0000","last_fullsized":"2024-09-12T19:19:48.182314+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:06.958542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.550710+0000","last_change":"2024-09-12T17:51:59.943709+0000","last_active":"2024-09-12T19:19:33.550710+0000","last_peered":"2024-09-12T19:19:33.550710+0000","last_clean":"2024-09-12T19:19:33.550710+0000","last_became_active":"2024-09-12T17:51:59.942275+0000","last_became_peered":"2024-09-12T17:51:59.942275+0000","last_unstale":"2024-09-12T19:19:33.550710+0000","last_undegraded":"2024-09-12T19:19:33.550710+0000","last_fullsized":"2024-09-12T19:19:33.550710+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:15.298466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.970211+0000","last_change":"2024-09-12T17:51:52.896451+0000","last_active":"2024-09-12T19:19:22.970211+0000","last_peered":"2024-09-12T19:19:22.970211+0000","last_clean":"2024-09-12T19:19:22.970211+0000","last_became_active":"2024-09-12T17:51:52.895913+0000","last_became_peered":"2024-09-12T17:51:52.895913+0000","last_unstale":"2024-09-12T19:19:22.970211+0000","last_undegraded":"2024-09-12T19:19:22.970211+0000","last_fullsized":"2024-09-12T19:19:22.970211+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:21.249149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'8","reported_seq":102,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:28.549494+0000","last_change":"2024-09-12T17:45:41.577598+0000","last_active":"2024-09-12T19:19:28.549494+0000","last_peered":"2024-09-12T19:19:28.549494+0000","last_clean":"2024-09-12T19:19:28.549494+0000","last_became_active":"2024-09-12T17:45:41.576841+0000","last_became_peered":"2024-09-12T17:45:41.576841+0000","last_unstale":"2024-09-12T19:19:28.549494+0000","last_undegraded":"2024-09-12T19:19:28.549494+0000","last_fullsized":"2024-09-12T19:19:28.549494+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:40.378322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968901+0000","last_change":"2024-09-12T18:19:22.663672+0000","last_active":"2024-09-12T19:20:02.968901+0000","last_peered":"2024-09-12T19:20:02.968901+0000","last_clean":"2024-09-12T19:20:02.968901+0000","last_became_active":"2024-09-12T18:19:22.662633+0000","last_became_peered":"2024-09-12T18:19:22.662633+0000","last_unstale":"2024-09-12T19:20:02.968901+0000","last_undegraded":"2024-09-12T19:20:02.968901+0000","last_fullsized":"2024-09-12T19:20:02.968901+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:40.210719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.189287+0000","last_change":"2024-09-12T17:51:59.929795+0000","last_active":"2024-09-12T19:19:33.189287+0000","last_peered":"2024-09-12T19:19:33.189287+0000","last_clean":"2024-09-12T19:19:33.189287+0000","last_became_active":"2024-09-12T17:51:59.929108+0000","last_became_peered":"2024-09-12T17:51:59.929108+0000","last_unstale":"2024-09-12T19:19:33.189287+0000","last_undegraded":"2024-09-12T19:19:33.189287+0000","last_fullsized":"2024-09-12T19:19:33.189287+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:42.206076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"267'1","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:23.548516+0000","last_change":"2024-09-12T17:51:52.883949+0000","last_active":"2024-09-12T19:19:23.548516+0000","last_peered":"2024-09-12T19:19:23.548516+0000","last_clean":"2024-09-12T19:19:23.548516+0000","last_became_active":"2024-09-12T17:51:52.876809+0000","last_became_peered":"2024-09-12T17:51:52.876809+0000","last_unstale":"2024-09-12T19:19:23.548516+0000","last_undegraded":"2024-09-12T19:19:23.548516+0000","last_fullsized":"2024-09-12T19:19:23.548516+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:43.734348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4960,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":5,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'24","reported_seq":146,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968654+0000","last_change":"2024-09-12T17:45:41.588350+0000","last_active":"2024-09-12T19:20:02.968654+0000","last_peered":"2024-09-12T19:20:02.968654+0000","last_clean":"2024-09-12T19:20:02.968654+0000","last_became_active":"2024-09-12T17:45:41.587464+0000","last_became_peered":"2024-09-12T17:45:41.587464+0000","last_unstale":"2024-09-12T19:20:02.968654+0000","last_undegraded":"2024-09-12T19:20:02.968654+0000","last_fullsized":"2024-09-12T19:20:02.968654+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:57.305993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":80,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'298","reported_seq":949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.953141+0000","last_change":"2024-09-12T17:29:52.756359+0000","last_active":"2024-09-12T19:23:01.953141+0000","last_peered":"2024-09-12T19:23:01.953141+0000","last_clean":"2024-09-12T19:23:01.953141+0000","last_became_active":"2024-09-12T17:29:52.754920+0000","last_became_peered":"2024-09-12T17:29:52.754920+0000","last_unstale":"2024-09-12T19:23:01.953141+0000","last_undegraded":"2024-09-12T19:23:01.953141+0000","last_fullsized":"2024-09-12T19:23:01.953141+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:04.557129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262253,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":663,"num_write":1055,"num_write_kb":22160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'506","reported_seq":2205,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.033717+0000","last_change":"2024-09-12T17:29:54.761709+0000","last_active":"2024-09-12T19:22:45.033717+0000","last_peered":"2024-09-12T19:22:45.033717+0000","last_clean":"2024-09-12T19:22:45.033717+0000","last_became_active":"2024-09-12T17:29:54.760892+0000","last_became_peered":"2024-09-12T17:29:54.760892+0000","last_unstale":"2024-09-12T19:22:45.033717+0000","last_undegraded":"2024-09-12T19:22:45.033717+0000","last_fullsized":"2024-09-12T19:22:45.033717+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:41.865266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2904,"num_read_kb":2740,"num_write":620,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'340","reported_seq":1028,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.906791+0000","last_change":"2024-09-12T17:29:52.748073+0000","last_active":"2024-09-12T19:23:01.906791+0000","last_peered":"2024-09-12T19:23:01.906791+0000","last_clean":"2024-09-12T19:23:01.906791+0000","last_became_active":"2024-09-12T17:29:52.747481+0000","last_became_peered":"2024-09-12T17:29:52.747481+0000","last_unstale":"2024-09-12T19:23:01.906791+0000","last_undegraded":"2024-09-12T19:23:01.906791+0000","last_fullsized":"2024-09-12T19:23:01.906791+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:09.939962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306162,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":522,"num_read_kb":19278,"num_write":1123,"num_write_kb":29260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'430","reported_seq":1893,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.967478+0000","last_change":"2024-09-12T17:29:54.754770+0000","last_active":"2024-09-12T19:19:57.967478+0000","last_peered":"2024-09-12T19:19:57.967478+0000","last_clean":"2024-09-12T19:19:57.967478+0000","last_became_active":"2024-09-12T17:29:54.753272+0000","last_became_peered":"2024-09-12T17:29:54.753272+0000","last_unstale":"2024-09-12T19:19:57.967478+0000","last_undegraded":"2024-09-12T19:19:57.967478+0000","last_fullsized":"2024-09-12T19:19:57.967478+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:02.705919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2129,"num_read_kb":2000,"num_write":496,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'342","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.943225+0000","last_change":"2024-09-12T17:29:52.736428+0000","last_active":"2024-09-12T19:23:01.943225+0000","last_peered":"2024-09-12T19:23:01.943225+0000","last_clean":"2024-09-12T19:23:01.943225+0000","last_became_active":"2024-09-12T17:29:52.735978+0000","last_became_peered":"2024-09-12T17:29:52.735978+0000","last_unstale":"2024-09-12T19:23:01.943225+0000","last_undegraded":"2024-09-12T19:23:01.943225+0000","last_fullsized":"2024-09-12T19:23:01.943225+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:58.103754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2553570,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":504,"num_read_kb":35253,"num_write":1107,"num_write_kb":35855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'935","reported_seq":2602,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.437432+0000","last_change":"2024-09-12T17:29:54.771720+0000","last_active":"2024-09-12T19:21:21.437432+0000","last_peered":"2024-09-12T19:21:21.437432+0000","last_clean":"2024-09-12T19:21:21.437432+0000","last_became_active":"2024-09-12T17:29:54.770286+0000","last_became_peered":"2024-09-12T17:29:54.770286+0000","last_unstale":"2024-09-12T19:21:21.437432+0000","last_undegraded":"2024-09-12T19:21:21.437432+0000","last_fullsized":"2024-09-12T19:21:21.437432+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":900,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:38.926608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4498,"num_read_kb":4029,"num_write":1285,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'344","reported_seq":1087,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.957130+0000","last_change":"2024-09-12T17:30:21.690086+0000","last_active":"2024-09-12T19:23:01.957130+0000","last_peered":"2024-09-12T19:23:01.957130+0000","last_clean":"2024-09-12T19:23:01.957130+0000","last_became_active":"2024-09-12T17:30:21.689546+0000","last_became_peered":"2024-09-12T17:30:21.689546+0000","last_unstale":"2024-09-12T19:23:01.957130+0000","last_undegraded":"2024-09-12T19:23:01.957130+0000","last_fullsized":"2024-09-12T19:23:01.957130+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:14.185451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170253,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":648,"num_read_kb":124307,"num_write":1100,"num_write_kb":33866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7,2],"acting":[1,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"267'841","reported_seq":2480,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.726477+0000","last_change":"2024-09-12T17:29:54.760698+0000","last_active":"2024-09-12T19:20:03.726477+0000","last_peered":"2024-09-12T19:20:03.726477+0000","last_clean":"2024-09-12T19:20:03.726477+0000","last_became_active":"2024-09-12T17:29:54.760180+0000","last_became_peered":"2024-09-12T17:29:54.760180+0000","last_unstale":"2024-09-12T19:20:03.726477+0000","last_undegraded":"2024-09-12T19:20:03.726477+0000","last_fullsized":"2024-09-12T19:20:03.726477+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:44.225987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3987,"num_read_kb":3603,"num_write":1097,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'364","reported_seq":1008,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.958299+0000","last_change":"2024-09-12T17:29:52.750742+0000","last_active":"2024-09-12T19:23:01.958299+0000","last_peered":"2024-09-12T19:23:01.958299+0000","last_clean":"2024-09-12T19:23:01.958299+0000","last_became_active":"2024-09-12T17:29:52.744115+0000","last_became_peered":"2024-09-12T17:29:52.744115+0000","last_unstale":"2024-09-12T19:23:01.958299+0000","last_undegraded":"2024-09-12T19:23:01.958299+0000","last_fullsized":"2024-09-12T19:23:01.958299+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:24.050332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262269,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":11709,"num_write":1093,"num_write_kb":63153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'869","reported_seq":2502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.934290+0000","last_change":"2024-09-12T17:29:54.759304+0000","last_active":"2024-09-12T19:20:27.934290+0000","last_peered":"2024-09-12T19:20:27.934290+0000","last_clean":"2024-09-12T19:20:27.934290+0000","last_became_active":"2024-09-12T17:29:54.758552+0000","last_became_peered":"2024-09-12T17:29:54.758552+0000","last_unstale":"2024-09-12T19:20:27.934290+0000","last_undegraded":"2024-09-12T19:20:27.934290+0000","last_fullsized":"2024-09-12T19:20:27.934290+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:33.584027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4049,"num_read_kb":3640,"num_write":1140,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'353","reported_seq":1017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.900610+0000","last_change":"2024-09-12T17:29:52.762266+0000","last_active":"2024-09-12T19:23:01.900610+0000","last_peered":"2024-09-12T19:23:01.900610+0000","last_clean":"2024-09-12T19:23:01.900610+0000","last_became_active":"2024-09-12T17:29:52.756242+0000","last_became_peered":"2024-09-12T17:29:52.756242+0000","last_unstale":"2024-09-12T19:23:01.900610+0000","last_undegraded":"2024-09-12T19:23:01.900610+0000","last_fullsized":"2024-09-12T19:23:01.900610+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:47.783235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311546,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":527,"num_read_kb":10971,"num_write":1015,"num_write_kb":29590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'390","reported_seq":1980,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.933638+0000","last_change":"2024-09-12T17:29:54.770914+0000","last_active":"2024-09-12T19:20:27.933638+0000","last_peered":"2024-09-12T19:20:27.933638+0000","last_clean":"2024-09-12T19:20:27.933638+0000","last_became_active":"2024-09-12T17:29:54.770050+0000","last_became_peered":"2024-09-12T17:29:54.770050+0000","last_unstale":"2024-09-12T19:20:27.933638+0000","last_undegraded":"2024-09-12T19:20:27.933638+0000","last_fullsized":"2024-09-12T19:20:27.933638+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:43.841653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2225,"num_read_kb":2129,"num_write":425,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'366","reported_seq":1019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.985420+0000","last_change":"2024-09-12T17:29:52.767237+0000","last_active":"2024-09-12T19:23:01.985420+0000","last_peered":"2024-09-12T19:23:01.985420+0000","last_clean":"2024-09-12T19:23:01.985420+0000","last_became_active":"2024-09-12T17:29:52.762473+0000","last_became_peered":"2024-09-12T17:29:52.762473+0000","last_unstale":"2024-09-12T19:23:01.985420+0000","last_undegraded":"2024-09-12T19:23:01.985420+0000","last_fullsized":"2024-09-12T19:23:01.985420+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:30.353609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25719,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":480,"num_read_kb":16012,"num_write":1030,"num_write_kb":47372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'480","reported_seq":2013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.021704+0000","last_change":"2024-09-12T17:29:54.746687+0000","last_active":"2024-09-12T19:22:45.021704+0000","last_peered":"2024-09-12T19:22:45.021704+0000","last_clean":"2024-09-12T19:22:45.021704+0000","last_became_active":"2024-09-12T17:29:54.745833+0000","last_became_peered":"2024-09-12T17:29:54.745833+0000","last_unstale":"2024-09-12T19:22:45.021704+0000","last_undegraded":"2024-09-12T19:22:45.021704+0000","last_fullsized":"2024-09-12T19:22:45.021704+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:20.546304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2543,"num_read_kb":2369,"num_write":601,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'273","reported_seq":1051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:53.253193+0000","last_change":"2024-09-12T17:29:52.730557+0000","last_active":"2024-09-12T19:19:53.253193+0000","last_peered":"2024-09-12T19:19:53.253193+0000","last_clean":"2024-09-12T19:19:53.253193+0000","last_became_active":"2024-09-12T17:29:52.730010+0000","last_became_peered":"2024-09-12T17:29:52.730010+0000","last_unstale":"2024-09-12T19:19:53.253193+0000","last_undegraded":"2024-09-12T19:19:53.253193+0000","last_fullsized":"2024-09-12T19:19:53.253193+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:31.862041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6872421,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":547,"num_read_kb":14958,"num_write":1022,"num_write_kb":34324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'422","reported_seq":2021,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.137760+0000","last_change":"2024-09-12T17:29:54.756031+0000","last_active":"2024-09-12T19:21:19.137760+0000","last_peered":"2024-09-12T19:21:19.137760+0000","last_clean":"2024-09-12T19:21:19.137760+0000","last_became_active":"2024-09-12T17:29:54.755721+0000","last_became_peered":"2024-09-12T17:29:54.755721+0000","last_unstale":"2024-09-12T19:21:19.137760+0000","last_undegraded":"2024-09-12T19:21:19.137760+0000","last_fullsized":"2024-09-12T19:21:19.137760+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:26.559449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2342,"num_read_kb":2221,"num_write":470,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'360","reported_seq":1930,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.146565+0000","last_change":"2024-09-12T17:29:54.756918+0000","last_active":"2024-09-12T19:21:19.146565+0000","last_peered":"2024-09-12T19:21:19.146565+0000","last_clean":"2024-09-12T19:21:19.146565+0000","last_became_active":"2024-09-12T17:29:54.753012+0000","last_became_peered":"2024-09-12T17:29:54.753012+0000","last_unstale":"2024-09-12T19:21:19.146565+0000","last_undegraded":"2024-09-12T19:21:19.146565+0000","last_fullsized":"2024-09-12T19:21:19.146565+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:44.419129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2149,"num_read_kb":2071,"num_write":395,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'362","reported_seq":1046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.876903+0000","last_change":"2024-09-12T17:29:52.751176+0000","last_active":"2024-09-12T19:23:01.876903+0000","last_peered":"2024-09-12T19:23:01.876903+0000","last_clean":"2024-09-12T19:23:01.876903+0000","last_became_active":"2024-09-12T17:29:52.747589+0000","last_became_peered":"2024-09-12T17:29:52.747589+0000","last_unstale":"2024-09-12T19:23:01.876903+0000","last_undegraded":"2024-09-12T19:23:01.876903+0000","last_fullsized":"2024-09-12T19:23:01.876903+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:03.234800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":507,"num_read_kb":50487,"num_write":1096,"num_write_kb":29653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'423","reported_seq":1988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.900038+0000","last_change":"2024-09-12T17:29:54.754021+0000","last_active":"2024-09-12T19:21:55.900038+0000","last_peered":"2024-09-12T19:21:55.900038+0000","last_clean":"2024-09-12T19:21:55.900038+0000","last_became_active":"2024-09-12T17:29:54.752373+0000","last_became_peered":"2024-09-12T17:29:54.752373+0000","last_unstale":"2024-09-12T19:21:55.900038+0000","last_undegraded":"2024-09-12T19:21:55.900038+0000","last_fullsized":"2024-09-12T19:21:55.900038+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:55.036481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2327,"num_read_kb":2222,"num_write":465,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'284","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:33.723963+0000","last_change":"2024-09-12T17:30:22.256707+0000","last_active":"2024-09-12T19:22:33.723963+0000","last_peered":"2024-09-12T19:22:33.723963+0000","last_clean":"2024-09-12T19:22:33.723963+0000","last_became_active":"2024-09-12T17:30:22.255773+0000","last_became_peered":"2024-09-12T17:30:22.255773+0000","last_unstale":"2024-09-12T19:22:33.723963+0000","last_undegraded":"2024-09-12T19:22:33.723963+0000","last_fullsized":"2024-09-12T19:22:33.723963+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:57.570475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16120849,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":789,"num_read_kb":51978,"num_write":1091,"num_write_kb":60983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2,1],"acting":[3,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.32","version":"267'526","reported_seq":2179,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.901319+0000","last_change":"2024-09-12T17:29:54.773260+0000","last_active":"2024-09-12T19:21:55.901319+0000","last_peered":"2024-09-12T19:21:55.901319+0000","last_clean":"2024-09-12T19:21:55.901319+0000","last_became_active":"2024-09-12T17:29:54.771786+0000","last_became_peered":"2024-09-12T17:29:54.771786+0000","last_unstale":"2024-09-12T19:21:55.901319+0000","last_undegraded":"2024-09-12T19:21:55.901319+0000","last_fullsized":"2024-09-12T19:21:55.901319+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:21.472732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2657,"num_read_kb":2482,"num_write":638,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'372","reported_seq":1177,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:17.145386+0000","last_change":"2024-09-12T17:29:52.732747+0000","last_active":"2024-09-12T19:20:17.145386+0000","last_peered":"2024-09-12T19:20:17.145386+0000","last_clean":"2024-09-12T19:20:17.145386+0000","last_became_active":"2024-09-12T17:29:52.725473+0000","last_became_peered":"2024-09-12T17:29:52.725473+0000","last_unstale":"2024-09-12T19:20:17.145386+0000","last_undegraded":"2024-09-12T19:20:17.145386+0000","last_fullsized":"2024-09-12T19:20:17.145386+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:09.986286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14900598,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":868,"num_read_kb":41903,"num_write":1346,"num_write_kb":44280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'655","reported_seq":2279,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.719735+0000","last_change":"2024-09-12T17:29:54.754617+0000","last_active":"2024-09-12T19:20:03.719735+0000","last_peered":"2024-09-12T19:20:03.719735+0000","last_clean":"2024-09-12T19:20:03.719735+0000","last_became_active":"2024-09-12T17:29:54.754119+0000","last_became_peered":"2024-09-12T17:29:54.754119+0000","last_unstale":"2024-09-12T19:20:03.719735+0000","last_undegraded":"2024-09-12T19:20:03.719735+0000","last_fullsized":"2024-09-12T19:20:03.719735+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":600,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:21.492662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3376,"num_read_kb":3085,"num_write":861,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'319","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.973912+0000","last_change":"2024-09-12T17:29:52.764999+0000","last_active":"2024-09-12T19:23:01.973912+0000","last_peered":"2024-09-12T19:23:01.973912+0000","last_clean":"2024-09-12T19:23:01.973912+0000","last_became_active":"2024-09-12T17:29:52.764052+0000","last_became_peered":"2024-09-12T17:29:52.764052+0000","last_unstale":"2024-09-12T19:23:01.973912+0000","last_undegraded":"2024-09-12T19:23:01.973912+0000","last_fullsized":"2024-09-12T19:23:01.973912+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:13.155680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":477,"num_read_kb":61037,"num_write":999,"num_write_kb":13603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'891","reported_seq":2453,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.721020+0000","last_change":"2024-09-12T17:29:54.761081+0000","last_active":"2024-09-12T19:20:03.721020+0000","last_peered":"2024-09-12T19:20:03.721020+0000","last_clean":"2024-09-12T19:20:03.721020+0000","last_became_active":"2024-09-12T17:29:54.760746+0000","last_became_peered":"2024-09-12T17:29:54.760746+0000","last_unstale":"2024-09-12T19:20:03.721020+0000","last_undegraded":"2024-09-12T19:20:03.721020+0000","last_fullsized":"2024-09-12T19:20:03.721020+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:53.411177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4106,"num_read_kb":3659,"num_write":1202,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'310","reported_seq":999,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:38.235481+0000","last_change":"2024-09-12T17:29:52.721435+0000","last_active":"2024-09-12T19:18:38.235481+0000","last_peered":"2024-09-12T19:18:38.235481+0000","last_clean":"2024-09-12T19:18:38.235481+0000","last_became_active":"2024-09-12T17:29:52.720974+0000","last_became_peered":"2024-09-12T17:29:52.720974+0000","last_unstale":"2024-09-12T19:18:38.235481+0000","last_undegraded":"2024-09-12T19:18:38.235481+0000","last_fullsized":"2024-09-12T19:18:38.235481+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:05.898096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9129257,"num_objects":89,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":514,"num_read_kb":19633,"num_write":1149,"num_write_kb":34097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'744","reported_seq":2333,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.010273+0000","last_change":"2024-09-12T17:29:54.757481+0000","last_active":"2024-09-12T19:22:45.010273+0000","last_peered":"2024-09-12T19:22:45.010273+0000","last_clean":"2024-09-12T19:22:45.010273+0000","last_became_active":"2024-09-12T17:29:54.756675+0000","last_became_peered":"2024-09-12T17:29:54.756675+0000","last_unstale":"2024-09-12T19:22:45.010273+0000","last_undegraded":"2024-09-12T19:22:45.010273+0000","last_fullsized":"2024-09-12T19:22:45.010273+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:30.640890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3670,"num_read_kb":3349,"num_write":979,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'350","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.946835+0000","last_change":"2024-09-12T17:29:52.767402+0000","last_active":"2024-09-12T19:23:01.946835+0000","last_peered":"2024-09-12T19:23:01.946835+0000","last_clean":"2024-09-12T19:23:01.946835+0000","last_became_active":"2024-09-12T17:29:52.766959+0000","last_became_peered":"2024-09-12T17:29:52.766959+0000","last_unstale":"2024-09-12T19:23:01.946835+0000","last_undegraded":"2024-09-12T19:23:01.946835+0000","last_fullsized":"2024-09-12T19:23:01.946835+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:19.932278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":468,"num_read_kb":494,"num_write":1113,"num_write_kb":20716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'130","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.666477+0000","last_change":"2024-09-12T17:30:02.803588+0000","last_active":"2024-09-12T19:21:21.666477+0000","last_peered":"2024-09-12T19:21:21.666477+0000","last_clean":"2024-09-12T19:21:21.666477+0000","last_became_active":"2024-09-12T17:30:02.802659+0000","last_became_peered":"2024-09-12T17:30:02.802659+0000","last_unstale":"2024-09-12T19:21:21.666477+0000","last_undegraded":"2024-09-12T19:21:21.666477+0000","last_fullsized":"2024-09-12T19:21:21.666477+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:05.775037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":169,"num_write":297,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'432","reported_seq":2018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:14.631110+0000","last_change":"2024-09-12T17:29:54.758798+0000","last_active":"2024-09-12T19:20:14.631110+0000","last_peered":"2024-09-12T19:20:14.631110+0000","last_clean":"2024-09-12T19:20:14.631110+0000","last_became_active":"2024-09-12T17:29:54.758303+0000","last_became_peered":"2024-09-12T17:29:54.758303+0000","last_unstale":"2024-09-12T19:20:14.631110+0000","last_undegraded":"2024-09-12T19:20:14.631110+0000","last_fullsized":"2024-09-12T19:20:14.631110+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:43.384034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2323,"num_read_kb":2196,"num_write":494,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'401","reported_seq":1112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.757287+0000","last_change":"2024-09-12T17:29:52.755910+0000","last_active":"2024-09-12T19:23:01.757287+0000","last_peered":"2024-09-12T19:23:01.757287+0000","last_clean":"2024-09-12T19:23:01.757287+0000","last_became_active":"2024-09-12T17:29:52.755103+0000","last_became_peered":"2024-09-12T17:29:52.755103+0000","last_unstale":"2024-09-12T19:23:01.757287+0000","last_undegraded":"2024-09-12T19:23:01.757287+0000","last_fullsized":"2024-09-12T19:23:01.757287+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:39.921239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524450,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":671,"num_read_kb":34526,"num_write":1327,"num_write_kb":26646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:42.965930+0000","last_change":"2024-09-12T17:29:56.764275+0000","last_active":"2024-09-12T19:18:42.965930+0000","last_peered":"2024-09-12T19:18:42.965930+0000","last_clean":"2024-09-12T19:18:42.965930+0000","last_became_active":"2024-09-12T17:29:56.763547+0000","last_became_peered":"2024-09-12T17:29:56.763547+0000","last_unstale":"2024-09-12T19:18:42.965930+0000","last_undegraded":"2024-09-12T19:18:42.965930+0000","last_fullsized":"2024-09-12T19:18:42.965930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:50.827569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'387","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.933998+0000","last_change":"2024-09-12T17:29:58.780660+0000","last_active":"2024-09-12T19:23:01.933998+0000","last_peered":"2024-09-12T19:23:01.933998+0000","last_clean":"2024-09-12T19:23:01.933998+0000","last_became_active":"2024-09-12T17:29:58.777554+0000","last_became_peered":"2024-09-12T17:29:58.777554+0000","last_unstale":"2024-09-12T19:23:01.933998+0000","last_undegraded":"2024-09-12T19:23:01.933998+0000","last_fullsized":"2024-09-12T19:23:01.933998+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:45.028521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45863,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":1229,"num_write":480,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:47.950949+0000","last_change":"2024-09-12T17:30:00.806462+0000","last_active":"2024-09-12T19:18:47.950949+0000","last_peered":"2024-09-12T19:18:47.950949+0000","last_clean":"2024-09-12T19:18:47.950949+0000","last_became_active":"2024-09-12T17:30:00.805568+0000","last_became_peered":"2024-09-12T17:30:00.805568+0000","last_unstale":"2024-09-12T19:18:47.950949+0000","last_undegraded":"2024-09-12T19:18:47.950949+0000","last_fullsized":"2024-09-12T19:18:47.950949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:19.223415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'145","reported_seq":724,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.098828+0000","last_change":"2024-09-12T17:30:02.786275+0000","last_active":"2024-09-12T19:20:28.098828+0000","last_peered":"2024-09-12T19:20:28.098828+0000","last_clean":"2024-09-12T19:20:28.098828+0000","last_became_active":"2024-09-12T17:30:02.785212+0000","last_became_peered":"2024-09-12T17:30:02.785212+0000","last_unstale":"2024-09-12T19:20:28.098828+0000","last_undegraded":"2024-09-12T19:20:28.098828+0000","last_fullsized":"2024-09-12T19:20:28.098828+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:15.216332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":252,"num_read_kb":243,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'682","reported_seq":2548,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.376127+0000","last_change":"2024-09-12T17:29:54.763192+0000","last_active":"2024-09-12T19:21:21.376127+0000","last_peered":"2024-09-12T19:21:21.376127+0000","last_clean":"2024-09-12T19:21:21.376127+0000","last_became_active":"2024-09-12T17:29:54.761497+0000","last_became_peered":"2024-09-12T17:29:54.761497+0000","last_unstale":"2024-09-12T19:21:21.376127+0000","last_undegraded":"2024-09-12T19:21:21.376127+0000","last_fullsized":"2024-09-12T19:21:21.376127+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":600,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:10.152526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3854,"num_read_kb":3534,"num_write":981,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'373","reported_seq":1046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.969152+0000","last_change":"2024-09-12T17:29:52.714312+0000","last_active":"2024-09-12T19:23:01.969152+0000","last_peered":"2024-09-12T19:23:01.969152+0000","last_clean":"2024-09-12T19:23:01.969152+0000","last_became_active":"2024-09-12T17:29:52.713938+0000","last_became_peered":"2024-09-12T17:29:52.713938+0000","last_unstale":"2024-09-12T19:23:01.969152+0000","last_undegraded":"2024-09-12T19:23:01.969152+0000","last_fullsized":"2024-09-12T19:23:01.969152+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:41.597689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460272,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":10309,"num_write":1260,"num_write_kb":32712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.256354+0000","last_change":"2024-09-12T17:29:56.776910+0000","last_active":"2024-09-12T19:20:03.256354+0000","last_peered":"2024-09-12T19:20:03.256354+0000","last_clean":"2024-09-12T19:20:03.256354+0000","last_became_active":"2024-09-12T17:29:56.776335+0000","last_became_peered":"2024-09-12T17:29:56.776335+0000","last_unstale":"2024-09-12T19:20:03.256354+0000","last_undegraded":"2024-09-12T19:20:03.256354+0000","last_fullsized":"2024-09-12T19:20:03.256354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:54.362260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'120","reported_seq":694,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:50.316180+0000","last_change":"2024-09-12T17:29:58.778467+0000","last_active":"2024-09-12T19:20:50.316180+0000","last_peered":"2024-09-12T19:20:50.316180+0000","last_clean":"2024-09-12T19:20:50.316180+0000","last_became_active":"2024-09-12T17:29:58.777883+0000","last_became_peered":"2024-09-12T17:29:58.777883+0000","last_unstale":"2024-09-12T19:20:50.316180+0000","last_undegraded":"2024-09-12T19:20:50.316180+0000","last_fullsized":"2024-09-12T19:20:50.316180+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:33.007083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:48.179069+0000","last_change":"2024-09-12T17:30:00.782290+0000","last_active":"2024-09-12T19:18:48.179069+0000","last_peered":"2024-09-12T19:18:48.179069+0000","last_clean":"2024-09-12T19:18:48.179069+0000","last_became_active":"2024-09-12T17:30:00.781554+0000","last_became_peered":"2024-09-12T17:30:00.781554+0000","last_unstale":"2024-09-12T19:18:48.179069+0000","last_undegraded":"2024-09-12T19:18:48.179069+0000","last_fullsized":"2024-09-12T19:18:48.179069+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:16.914242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'118","reported_seq":660,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.731504+0000","last_change":"2024-09-12T17:30:02.806243+0000","last_active":"2024-09-12T19:21:21.731504+0000","last_peered":"2024-09-12T19:21:21.731504+0000","last_clean":"2024-09-12T19:21:21.731504+0000","last_became_active":"2024-09-12T17:30:02.805556+0000","last_became_peered":"2024-09-12T17:30:02.805556+0000","last_unstale":"2024-09-12T19:21:21.731504+0000","last_undegraded":"2024-09-12T19:21:21.731504+0000","last_fullsized":"2024-09-12T19:21:21.731504+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:10.526393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":177,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'907","reported_seq":2534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:35.932561+0000","last_change":"2024-09-12T17:29:54.752472+0000","last_active":"2024-09-12T19:19:35.932561+0000","last_peered":"2024-09-12T19:19:35.932561+0000","last_clean":"2024-09-12T19:19:35.932561+0000","last_became_active":"2024-09-12T17:29:54.751997+0000","last_became_peered":"2024-09-12T17:29:54.751997+0000","last_unstale":"2024-09-12T19:19:35.932561+0000","last_undegraded":"2024-09-12T19:19:35.932561+0000","last_fullsized":"2024-09-12T19:19:35.932561+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":800,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:22.947507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4250,"num_read_kb":3802,"num_write":1203,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'368","reported_seq":1085,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.941483+0000","last_change":"2024-09-12T17:29:52.762803+0000","last_active":"2024-09-12T19:23:01.941483+0000","last_peered":"2024-09-12T19:23:01.941483+0000","last_clean":"2024-09-12T19:23:01.941483+0000","last_became_active":"2024-09-12T17:29:52.762149+0000","last_became_peered":"2024-09-12T17:29:52.762149+0000","last_unstale":"2024-09-12T19:23:01.941483+0000","last_undegraded":"2024-09-12T19:23:01.941483+0000","last_fullsized":"2024-09-12T19:23:01.941483+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:00.553936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":626,"num_read_kb":63082,"num_write":1322,"num_write_kb":27819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.236790+0000","last_change":"2024-09-12T17:29:56.762319+0000","last_active":"2024-09-12T19:18:43.236790+0000","last_peered":"2024-09-12T19:18:43.236790+0000","last_clean":"2024-09-12T19:18:43.236790+0000","last_became_active":"2024-09-12T17:29:56.761027+0000","last_became_peered":"2024-09-12T17:29:56.761027+0000","last_unstale":"2024-09-12T19:18:43.236790+0000","last_undegraded":"2024-09-12T19:18:43.236790+0000","last_fullsized":"2024-09-12T19:18:43.236790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:25.029553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'172","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:51.961304+0000","last_change":"2024-09-12T17:29:58.770614+0000","last_active":"2024-09-12T19:20:51.961304+0000","last_peered":"2024-09-12T19:20:51.961304+0000","last_clean":"2024-09-12T19:20:51.961304+0000","last_became_active":"2024-09-12T17:29:58.769889+0000","last_became_peered":"2024-09-12T17:29:58.769889+0000","last_unstale":"2024-09-12T19:20:51.961304+0000","last_undegraded":"2024-09-12T19:20:51.961304+0000","last_fullsized":"2024-09-12T19:20:51.961304+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:01.639009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'756","reported_seq":3324,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.884918+0000","last_change":"2024-09-12T17:30:00.810692+0000","last_active":"2024-09-12T19:22:58.884918+0000","last_peered":"2024-09-12T19:22:58.884918+0000","last_clean":"2024-09-12T19:22:58.884918+0000","last_became_active":"2024-09-12T17:30:00.810030+0000","last_became_peered":"2024-09-12T17:30:00.810030+0000","last_unstale":"2024-09-12T19:22:58.884918+0000","last_undegraded":"2024-09-12T19:22:58.884918+0000","last_fullsized":"2024-09-12T19:22:58.884918+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:18.541833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'206","reported_seq":1064,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.854762+0000","last_change":"2024-09-12T17:30:02.807819+0000","last_active":"2024-09-12T19:21:21.854762+0000","last_peered":"2024-09-12T19:21:21.854762+0000","last_clean":"2024-09-12T19:21:21.854762+0000","last_became_active":"2024-09-12T17:30:02.803144+0000","last_became_peered":"2024-09-12T17:30:02.803144+0000","last_unstale":"2024-09-12T19:21:21.854762+0000","last_undegraded":"2024-09-12T19:21:21.854762+0000","last_fullsized":"2024-09-12T19:21:21.854762+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:22.571499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":674,"num_read_kb":661,"num_write":463,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'413","reported_seq":2070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.356713+0000","last_change":"2024-09-12T17:29:54.762812+0000","last_active":"2024-09-12T19:21:21.356713+0000","last_peered":"2024-09-12T19:21:21.356713+0000","last_clean":"2024-09-12T19:21:21.356713+0000","last_became_active":"2024-09-12T17:29:54.762448+0000","last_became_peered":"2024-09-12T17:29:54.762448+0000","last_unstale":"2024-09-12T19:21:21.356713+0000","last_undegraded":"2024-09-12T19:21:21.356713+0000","last_fullsized":"2024-09-12T19:21:21.356713+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:00.556614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2329,"num_read_kb":2238,"num_write":469,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'277","reported_seq":940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.550601+0000","last_change":"2024-09-12T17:29:52.740127+0000","last_active":"2024-09-12T19:19:33.550601+0000","last_peered":"2024-09-12T19:19:33.550601+0000","last_clean":"2024-09-12T19:19:33.550601+0000","last_became_active":"2024-09-12T17:29:52.738957+0000","last_became_peered":"2024-09-12T17:29:52.738957+0000","last_unstale":"2024-09-12T19:19:33.550601+0000","last_undegraded":"2024-09-12T19:19:33.550601+0000","last_fullsized":"2024-09-12T19:19:33.550601+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:50.808537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6340313,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":453,"num_read_kb":16175,"num_write":1086,"num_write_kb":26946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:42.966023+0000","last_change":"2024-09-12T17:29:56.757650+0000","last_active":"2024-09-12T19:18:42.966023+0000","last_peered":"2024-09-12T19:18:42.966023+0000","last_clean":"2024-09-12T19:18:42.966023+0000","last_became_active":"2024-09-12T17:29:56.755730+0000","last_became_peered":"2024-09-12T17:29:56.755730+0000","last_unstale":"2024-09-12T19:18:42.966023+0000","last_undegraded":"2024-09-12T19:18:42.966023+0000","last_fullsized":"2024-09-12T19:18:42.966023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:23.463400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'322","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.554435+0000","last_change":"2024-09-12T17:29:58.829682+0000","last_active":"2024-09-12T19:23:01.554435+0000","last_peered":"2024-09-12T19:23:01.554435+0000","last_clean":"2024-09-12T19:23:01.554435+0000","last_became_active":"2024-09-12T17:29:58.829021+0000","last_became_peered":"2024-09-12T17:29:58.829021+0000","last_unstale":"2024-09-12T19:23:01.554435+0000","last_undegraded":"2024-09-12T19:23:01.554435+0000","last_fullsized":"2024-09-12T19:23:01.554435+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:56.407873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49018,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":1196,"num_write":438,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'810","reported_seq":3020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.295056+0000","last_change":"2024-09-12T17:30:00.794188+0000","last_active":"2024-09-12T19:22:46.295056+0000","last_peered":"2024-09-12T19:22:46.295056+0000","last_clean":"2024-09-12T19:22:46.295056+0000","last_became_active":"2024-09-12T17:30:00.793067+0000","last_became_peered":"2024-09-12T17:30:00.793067+0000","last_unstale":"2024-09-12T19:22:46.295056+0000","last_undegraded":"2024-09-12T19:22:46.295056+0000","last_fullsized":"2024-09-12T19:22:46.295056+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:26.995446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'523","reported_seq":2063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.442210+0000","last_change":"2024-09-12T17:29:54.766898+0000","last_active":"2024-09-12T19:21:21.442210+0000","last_peered":"2024-09-12T19:21:21.442210+0000","last_clean":"2024-09-12T19:21:21.442210+0000","last_became_active":"2024-09-12T17:29:54.766092+0000","last_became_peered":"2024-09-12T17:29:54.766092+0000","last_unstale":"2024-09-12T19:21:21.442210+0000","last_undegraded":"2024-09-12T19:21:21.442210+0000","last_fullsized":"2024-09-12T19:21:21.442210+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:01.060409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2636,"num_read_kb":2418,"num_write":649,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'353","reported_seq":1039,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.895862+0000","last_change":"2024-09-12T17:29:52.762735+0000","last_active":"2024-09-12T19:23:01.895862+0000","last_peered":"2024-09-12T19:23:01.895862+0000","last_clean":"2024-09-12T19:23:01.895862+0000","last_became_active":"2024-09-12T17:29:52.757326+0000","last_became_peered":"2024-09-12T17:29:52.757326+0000","last_unstale":"2024-09-12T19:23:01.895862+0000","last_undegraded":"2024-09-12T19:23:01.895862+0000","last_fullsized":"2024-09-12T19:23:01.895862+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:34.150960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730145,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":565,"num_read_kb":12520,"num_write":1100,"num_write_kb":32977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.974785+0000","last_change":"2024-09-12T17:29:56.769344+0000","last_active":"2024-09-12T19:20:27.974785+0000","last_peered":"2024-09-12T19:20:27.974785+0000","last_clean":"2024-09-12T19:20:27.974785+0000","last_became_active":"2024-09-12T17:29:56.768267+0000","last_became_peered":"2024-09-12T17:29:56.768267+0000","last_unstale":"2024-09-12T19:20:27.974785+0000","last_undegraded":"2024-09-12T19:20:27.974785+0000","last_fullsized":"2024-09-12T19:20:27.974785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:14.841905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'452","reported_seq":1143,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.315539+0000","last_change":"2024-09-12T17:29:58.834050+0000","last_active":"2024-09-12T19:22:59.315539+0000","last_peered":"2024-09-12T19:22:59.315539+0000","last_clean":"2024-09-12T19:22:59.315539+0000","last_became_active":"2024-09-12T17:29:58.833291+0000","last_became_peered":"2024-09-12T17:29:58.833291+0000","last_unstale":"2024-09-12T19:22:59.315539+0000","last_undegraded":"2024-09-12T19:22:59.315539+0000","last_fullsized":"2024-09-12T19:22:59.315539+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:23.364120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60505,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":721,"num_read_kb":1312,"num_write":540,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:17.982998+0000","last_change":"2024-09-12T17:30:00.810543+0000","last_active":"2024-09-12T19:20:17.982998+0000","last_peered":"2024-09-12T19:20:17.982998+0000","last_clean":"2024-09-12T19:20:17.982998+0000","last_became_active":"2024-09-12T17:30:00.809914+0000","last_became_peered":"2024-09-12T17:30:00.809914+0000","last_unstale":"2024-09-12T19:20:17.982998+0000","last_undegraded":"2024-09-12T19:20:17.982998+0000","last_fullsized":"2024-09-12T19:20:17.982998+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:44.935436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'548","reported_seq":1404,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.253948+0000","last_change":"2024-09-12T17:30:02.797843+0000","last_active":"2024-09-12T19:22:46.253948+0000","last_peered":"2024-09-12T19:22:46.253948+0000","last_clean":"2024-09-12T19:22:46.253948+0000","last_became_active":"2024-09-12T17:30:02.797046+0000","last_became_peered":"2024-09-12T17:30:02.797046+0000","last_unstale":"2024-09-12T19:22:46.253948+0000","last_undegraded":"2024-09-12T19:22:46.253948+0000","last_fullsized":"2024-09-12T19:22:46.253948+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:58.930778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1413,"num_read_kb":1390,"num_write":1179,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'480","reported_seq":2156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.202292+0000","last_change":"2024-09-12T17:29:54.756840+0000","last_active":"2024-09-12T19:20:28.202292+0000","last_peered":"2024-09-12T19:20:28.202292+0000","last_clean":"2024-09-12T19:20:28.202292+0000","last_became_active":"2024-09-12T17:29:54.754517+0000","last_became_peered":"2024-09-12T17:29:54.754517+0000","last_unstale":"2024-09-12T19:20:28.202292+0000","last_undegraded":"2024-09-12T19:20:28.202292+0000","last_fullsized":"2024-09-12T19:20:28.202292+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:21.909735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2565,"num_read_kb":2417,"num_write":558,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'317","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.891150+0000","last_change":"2024-09-12T17:29:52.761247+0000","last_active":"2024-09-12T19:23:01.891150+0000","last_peered":"2024-09-12T19:23:01.891150+0000","last_clean":"2024-09-12T19:23:01.891150+0000","last_became_active":"2024-09-12T17:29:52.760711+0000","last_became_peered":"2024-09-12T17:29:52.760711+0000","last_unstale":"2024-09-12T19:23:01.891150+0000","last_undegraded":"2024-09-12T19:23:01.891150+0000","last_fullsized":"2024-09-12T19:23:01.891150+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:21.789117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759519,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":447,"num_read_kb":40999,"num_write":1044,"num_write_kb":42394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.538942+0000","last_change":"2024-09-12T17:29:56.758473+0000","last_active":"2024-09-12T19:20:28.538942+0000","last_peered":"2024-09-12T19:20:28.538942+0000","last_clean":"2024-09-12T19:20:28.538942+0000","last_became_active":"2024-09-12T17:29:56.757805+0000","last_became_peered":"2024-09-12T17:29:56.757805+0000","last_unstale":"2024-09-12T19:20:28.538942+0000","last_undegraded":"2024-09-12T19:20:28.538942+0000","last_fullsized":"2024-09-12T19:20:28.538942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:32.794119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'299","reported_seq":917,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:33.290790+0000","last_change":"2024-09-12T17:29:58.774261+0000","last_active":"2024-09-12T19:22:33.290790+0000","last_peered":"2024-09-12T19:22:33.290790+0000","last_clean":"2024-09-12T19:22:33.290790+0000","last_became_active":"2024-09-12T17:29:58.773959+0000","last_became_peered":"2024-09-12T17:29:58.773959+0000","last_unstale":"2024-09-12T19:22:33.290790+0000","last_undegraded":"2024-09-12T19:22:33.290790+0000","last_fullsized":"2024-09-12T19:22:33.290790+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:53.591898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56650,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":967,"num_write":394,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:48.237729+0000","last_change":"2024-09-12T17:30:00.792690+0000","last_active":"2024-09-12T19:18:48.237729+0000","last_peered":"2024-09-12T19:18:48.237729+0000","last_clean":"2024-09-12T19:18:48.237729+0000","last_became_active":"2024-09-12T17:30:00.792138+0000","last_became_peered":"2024-09-12T17:30:00.792138+0000","last_unstale":"2024-09-12T19:18:48.237729+0000","last_undegraded":"2024-09-12T19:18:48.237729+0000","last_fullsized":"2024-09-12T19:18:48.237729+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:12.058912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2476","reported_seq":4391,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.257061+0000","last_change":"2024-09-12T17:30:02.801585+0000","last_active":"2024-09-12T19:22:46.257061+0000","last_peered":"2024-09-12T19:22:46.257061+0000","last_clean":"2024-09-12T19:22:46.257061+0000","last_became_active":"2024-09-12T17:30:02.800860+0000","last_became_peered":"2024-09-12T17:30:02.800860+0000","last_unstale":"2024-09-12T19:22:46.257061+0000","last_undegraded":"2024-09-12T19:22:46.257061+0000","last_fullsized":"2024-09-12T19:22:46.257061+0000","mapping_epoch":36,"log_start":"267'2400","ondisk_log_start":"267'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":2400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:23.192552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6373,"num_read_kb":6312,"num_write":5027,"num_write_kb":1835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'430","reported_seq":2068,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.148759+0000","last_change":"2024-09-12T17:29:54.770302+0000","last_active":"2024-09-12T19:21:19.148759+0000","last_peered":"2024-09-12T19:21:19.148759+0000","last_clean":"2024-09-12T19:21:19.148759+0000","last_became_active":"2024-09-12T17:29:54.769541+0000","last_became_peered":"2024-09-12T17:29:54.769541+0000","last_unstale":"2024-09-12T19:21:19.148759+0000","last_undegraded":"2024-09-12T19:21:19.148759+0000","last_fullsized":"2024-09-12T19:21:19.148759+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:46.646360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2445,"num_read_kb":2340,"num_write":496,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'273","reported_seq":948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:59.167804+0000","last_change":"2024-09-12T17:30:21.794660+0000","last_active":"2024-09-12T19:20:59.167804+0000","last_peered":"2024-09-12T19:20:59.167804+0000","last_clean":"2024-09-12T19:20:59.167804+0000","last_became_active":"2024-09-12T17:30:21.793950+0000","last_became_peered":"2024-09-12T17:30:21.793950+0000","last_unstale":"2024-09-12T19:20:59.167804+0000","last_undegraded":"2024-09-12T19:20:59.167804+0000","last_fullsized":"2024-09-12T19:20:59.167804+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:45.690479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17796039,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":466,"num_read_kb":65282,"num_write":1011,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,6],"acting":[2,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.535841+0000","last_change":"2024-09-12T17:29:56.770636+0000","last_active":"2024-09-12T19:20:13.535841+0000","last_peered":"2024-09-12T19:20:13.535841+0000","last_clean":"2024-09-12T19:20:13.535841+0000","last_became_active":"2024-09-12T17:29:56.770222+0000","last_became_peered":"2024-09-12T17:29:56.770222+0000","last_unstale":"2024-09-12T19:20:13.535841+0000","last_undegraded":"2024-09-12T19:20:13.535841+0000","last_fullsized":"2024-09-12T19:20:13.535841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:00.086855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'394","reported_seq":1045,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.505552+0000","last_change":"2024-09-12T17:29:58.755448+0000","last_active":"2024-09-12T19:22:59.505552+0000","last_peered":"2024-09-12T19:22:59.505552+0000","last_clean":"2024-09-12T19:22:59.505552+0000","last_became_active":"2024-09-12T17:29:58.754613+0000","last_became_peered":"2024-09-12T17:29:58.754613+0000","last_unstale":"2024-09-12T19:22:59.505552+0000","last_undegraded":"2024-09-12T19:22:59.505552+0000","last_fullsized":"2024-09-12T19:22:59.505552+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:50.294662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50732,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":653,"num_read_kb":1328,"num_write":512,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'796","reported_seq":3207,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.319657+0000","last_change":"2024-09-12T17:30:00.806110+0000","last_active":"2024-09-12T19:23:01.319657+0000","last_peered":"2024-09-12T19:23:01.319657+0000","last_clean":"2024-09-12T19:23:01.319657+0000","last_became_active":"2024-09-12T17:30:00.805428+0000","last_became_peered":"2024-09-12T17:30:00.805428+0000","last_unstale":"2024-09-12T19:23:01.319657+0000","last_undegraded":"2024-09-12T19:23:01.319657+0000","last_fullsized":"2024-09-12T19:23:01.319657+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:28.577730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'112","reported_seq":659,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.641116+0000","last_change":"2024-09-12T17:30:02.817717+0000","last_active":"2024-09-12T19:22:44.641116+0000","last_peered":"2024-09-12T19:22:44.641116+0000","last_clean":"2024-09-12T19:22:44.641116+0000","last_became_active":"2024-09-12T17:30:02.816983+0000","last_became_peered":"2024-09-12T17:30:02.816983+0000","last_unstale":"2024-09-12T19:22:44.641116+0000","last_undegraded":"2024-09-12T19:22:44.641116+0000","last_fullsized":"2024-09-12T19:22:44.641116+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:16.290296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":194,"num_write":254,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'871","reported_seq":2499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.139491+0000","last_change":"2024-09-12T17:29:54.752312+0000","last_active":"2024-09-12T19:21:19.139491+0000","last_peered":"2024-09-12T19:21:19.139491+0000","last_clean":"2024-09-12T19:21:19.139491+0000","last_became_active":"2024-09-12T17:29:54.744926+0000","last_became_peered":"2024-09-12T17:29:54.744926+0000","last_unstale":"2024-09-12T19:21:19.139491+0000","last_undegraded":"2024-09-12T19:21:19.139491+0000","last_fullsized":"2024-09-12T19:21:19.139491+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:28.330625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4186,"num_read_kb":3781,"num_write":1194,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'377","reported_seq":1067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.981260+0000","last_change":"2024-09-12T17:29:52.749559+0000","last_active":"2024-09-12T19:23:01.981260+0000","last_peered":"2024-09-12T19:23:01.981260+0000","last_clean":"2024-09-12T19:23:01.981260+0000","last_became_active":"2024-09-12T17:29:52.748439+0000","last_became_peered":"2024-09-12T17:29:52.748439+0000","last_unstale":"2024-09-12T19:23:01.981260+0000","last_undegraded":"2024-09-12T19:23:01.981260+0000","last_fullsized":"2024-09-12T19:23:01.981260+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:29.874598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992343,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":628,"num_read_kb":40400,"num_write":1240,"num_write_kb":24508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:43.542396+0000","last_change":"2024-09-12T17:29:56.743345+0000","last_active":"2024-09-12T19:20:43.542396+0000","last_peered":"2024-09-12T19:20:43.542396+0000","last_clean":"2024-09-12T19:20:43.542396+0000","last_became_active":"2024-09-12T17:29:56.742361+0000","last_became_peered":"2024-09-12T17:29:56.742361+0000","last_unstale":"2024-09-12T19:20:43.542396+0000","last_undegraded":"2024-09-12T19:20:43.542396+0000","last_fullsized":"2024-09-12T19:20:43.542396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:08.175418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'514","reported_seq":1198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.038329+0000","last_change":"2024-09-12T17:29:58.782097+0000","last_active":"2024-09-12T19:23:01.038329+0000","last_peered":"2024-09-12T19:23:01.038329+0000","last_clean":"2024-09-12T19:23:01.038329+0000","last_became_active":"2024-09-12T17:29:58.777576+0000","last_became_peered":"2024-09-12T17:29:58.777576+0000","last_unstale":"2024-09-12T19:23:01.038329+0000","last_undegraded":"2024-09-12T19:23:01.038329+0000","last_fullsized":"2024-09-12T19:23:01.038329+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:55.160859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94518,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":881,"num_read_kb":2010,"num_write":710,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.540027+0000","last_change":"2024-09-12T17:30:00.780996+0000","last_active":"2024-09-12T19:20:33.540027+0000","last_peered":"2024-09-12T19:20:33.540027+0000","last_clean":"2024-09-12T19:20:33.540027+0000","last_became_active":"2024-09-12T17:30:00.780193+0000","last_became_peered":"2024-09-12T17:30:00.780193+0000","last_unstale":"2024-09-12T19:20:33.540027+0000","last_undegraded":"2024-09-12T19:20:33.540027+0000","last_fullsized":"2024-09-12T19:20:33.540027+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:54.843536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'166","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.101340+0000","last_change":"2024-09-12T17:30:02.810105+0000","last_active":"2024-09-12T19:21:19.101340+0000","last_peered":"2024-09-12T19:21:19.101340+0000","last_clean":"2024-09-12T19:21:19.101340+0000","last_became_active":"2024-09-12T17:30:02.809357+0000","last_became_peered":"2024-09-12T17:30:02.809357+0000","last_unstale":"2024-09-12T19:21:19.101340+0000","last_undegraded":"2024-09-12T19:21:19.101340+0000","last_fullsized":"2024-09-12T19:21:19.101340+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:26.703985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":287,"num_read_kb":265,"num_write":391,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'1305","reported_seq":2983,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.932579+0000","last_change":"2024-09-12T17:29:54.759425+0000","last_active":"2024-09-12T19:20:27.932579+0000","last_peered":"2024-09-12T19:20:27.932579+0000","last_clean":"2024-09-12T19:20:27.932579+0000","last_became_active":"2024-09-12T17:29:54.758550+0000","last_became_peered":"2024-09-12T17:29:54.758550+0000","last_unstale":"2024-09-12T19:20:27.932579+0000","last_undegraded":"2024-09-12T19:20:27.932579+0000","last_fullsized":"2024-09-12T19:20:27.932579+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:30.793762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6018,"num_read_kb":5333,"num_write":1857,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'258","reported_seq":917,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.257493+0000","last_change":"2024-09-12T17:29:52.767951+0000","last_active":"2024-09-12T19:20:08.257493+0000","last_peered":"2024-09-12T19:20:08.257493+0000","last_clean":"2024-09-12T19:20:08.257493+0000","last_became_active":"2024-09-12T17:29:52.765603+0000","last_became_peered":"2024-09-12T17:29:52.765603+0000","last_unstale":"2024-09-12T19:20:08.257493+0000","last_undegraded":"2024-09-12T19:20:08.257493+0000","last_fullsized":"2024-09-12T19:20:08.257493+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:49.870827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7161968,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":378,"num_read_kb":36052,"num_write":1000,"num_write_kb":37263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.535963+0000","last_change":"2024-09-12T17:29:56.772981+0000","last_active":"2024-09-12T19:20:13.535963+0000","last_peered":"2024-09-12T19:20:13.535963+0000","last_clean":"2024-09-12T19:20:13.535963+0000","last_became_active":"2024-09-12T17:29:56.772580+0000","last_became_peered":"2024-09-12T17:29:56.772580+0000","last_unstale":"2024-09-12T19:20:13.535963+0000","last_undegraded":"2024-09-12T19:20:13.535963+0000","last_fullsized":"2024-09-12T19:20:13.535963+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:40.668767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'332","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.109246+0000","last_change":"2024-09-12T17:29:58.774656+0000","last_active":"2024-09-12T19:23:01.109246+0000","last_peered":"2024-09-12T19:23:01.109246+0000","last_clean":"2024-09-12T19:23:01.109246+0000","last_became_active":"2024-09-12T17:29:58.773869+0000","last_became_peered":"2024-09-12T17:29:58.773869+0000","last_unstale":"2024-09-12T19:23:01.109246+0000","last_undegraded":"2024-09-12T19:23:01.109246+0000","last_fullsized":"2024-09-12T19:23:01.109246+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:05.201058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47005,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":1116,"num_write":486,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:38.195416+0000","last_change":"2024-09-12T17:30:00.779241+0000","last_active":"2024-09-12T19:20:38.195416+0000","last_peered":"2024-09-12T19:20:38.195416+0000","last_clean":"2024-09-12T19:20:38.195416+0000","last_became_active":"2024-09-12T17:30:00.778642+0000","last_became_peered":"2024-09-12T17:30:00.778642+0000","last_unstale":"2024-09-12T19:20:38.195416+0000","last_undegraded":"2024-09-12T19:20:38.195416+0000","last_fullsized":"2024-09-12T19:20:38.195416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:29.538173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'107","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:28.289420+0000","last_change":"2024-09-12T17:30:02.791858+0000","last_active":"2024-09-12T19:22:28.289420+0000","last_peered":"2024-09-12T19:22:28.289420+0000","last_clean":"2024-09-12T19:22:28.289420+0000","last_became_active":"2024-09-12T17:30:02.788612+0000","last_became_peered":"2024-09-12T17:30:02.788612+0000","last_unstale":"2024-09-12T19:22:28.289420+0000","last_undegraded":"2024-09-12T19:22:28.289420+0000","last_fullsized":"2024-09-12T19:22:28.289420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:58.832322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":252,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'362","reported_seq":1817,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.198695+0000","last_change":"2024-09-12T17:29:54.759245+0000","last_active":"2024-09-12T19:20:13.198695+0000","last_peered":"2024-09-12T19:20:13.198695+0000","last_clean":"2024-09-12T19:20:13.198695+0000","last_became_active":"2024-09-12T17:29:54.758311+0000","last_became_peered":"2024-09-12T17:29:54.758311+0000","last_unstale":"2024-09-12T19:20:13.198695+0000","last_undegraded":"2024-09-12T19:20:13.198695+0000","last_fullsized":"2024-09-12T19:20:13.198695+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:22.106256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1918,"num_read_kb":1833,"num_write":390,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'276","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:38.564839+0000","last_change":"2024-09-12T17:29:52.725267+0000","last_active":"2024-09-12T19:20:38.564839+0000","last_peered":"2024-09-12T19:20:38.564839+0000","last_clean":"2024-09-12T19:20:38.564839+0000","last_became_active":"2024-09-12T17:29:52.716965+0000","last_became_peered":"2024-09-12T17:29:52.716965+0000","last_unstale":"2024-09-12T19:20:38.564839+0000","last_undegraded":"2024-09-12T19:20:38.564839+0000","last_fullsized":"2024-09-12T19:20:38.564839+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:28.061496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":941036,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":471,"num_read_kb":1122,"num_write":1043,"num_write_kb":14973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:12.981854+0000","last_change":"2024-09-12T17:29:56.766356+0000","last_active":"2024-09-12T19:20:12.981854+0000","last_peered":"2024-09-12T19:20:12.981854+0000","last_clean":"2024-09-12T19:20:12.981854+0000","last_became_active":"2024-09-12T17:29:56.765057+0000","last_became_peered":"2024-09-12T17:29:56.765057+0000","last_unstale":"2024-09-12T19:20:12.981854+0000","last_undegraded":"2024-09-12T19:20:12.981854+0000","last_fullsized":"2024-09-12T19:20:12.981854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:33.658858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'364","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.249490+0000","last_change":"2024-09-12T17:29:58.772847+0000","last_active":"2024-09-12T19:22:46.249490+0000","last_peered":"2024-09-12T19:22:46.249490+0000","last_clean":"2024-09-12T19:22:46.249490+0000","last_became_active":"2024-09-12T17:29:58.771991+0000","last_became_peered":"2024-09-12T17:29:58.771991+0000","last_unstale":"2024-09-12T19:22:46.249490+0000","last_undegraded":"2024-09-12T19:22:46.249490+0000","last_fullsized":"2024-09-12T19:22:46.249490+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:25.707619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53427,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":587,"num_read_kb":1037,"num_write":454,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'747","reported_seq":5250,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.289539+0000","last_change":"2024-09-12T17:30:00.803339+0000","last_active":"2024-09-12T19:22:46.289539+0000","last_peered":"2024-09-12T19:22:46.289539+0000","last_clean":"2024-09-12T19:22:46.289539+0000","last_became_active":"2024-09-12T17:30:00.802950+0000","last_became_peered":"2024-09-12T17:30:00.802950+0000","last_unstale":"2024-09-12T19:22:46.289539+0000","last_undegraded":"2024-09-12T19:22:46.289539+0000","last_fullsized":"2024-09-12T19:22:46.289539+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":701,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:53.399614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'111","reported_seq":637,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:16.233380+0000","last_change":"2024-09-12T17:30:02.807435+0000","last_active":"2024-09-12T19:21:16.233380+0000","last_peered":"2024-09-12T19:21:16.233380+0000","last_clean":"2024-09-12T19:21:16.233380+0000","last_became_active":"2024-09-12T17:30:02.806621+0000","last_became_peered":"2024-09-12T17:30:02.806621+0000","last_unstale":"2024-09-12T19:21:16.233380+0000","last_undegraded":"2024-09-12T19:21:16.233380+0000","last_fullsized":"2024-09-12T19:21:16.233380+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:28.598520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":276,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'775","reported_seq":2449,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.998604+0000","last_change":"2024-09-12T17:29:54.764077+0000","last_active":"2024-09-12T19:22:44.998604+0000","last_peered":"2024-09-12T19:22:44.998604+0000","last_clean":"2024-09-12T19:22:44.998604+0000","last_became_active":"2024-09-12T17:29:54.763348+0000","last_became_peered":"2024-09-12T17:29:54.763348+0000","last_unstale":"2024-09-12T19:22:44.998604+0000","last_undegraded":"2024-09-12T19:22:44.998604+0000","last_fullsized":"2024-09-12T19:22:44.998604+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:36.252557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4009,"num_read_kb":3654,"num_write":1024,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'307","reported_seq":976,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.868076+0000","last_change":"2024-09-12T17:29:52.752133+0000","last_active":"2024-09-12T19:23:01.868076+0000","last_peered":"2024-09-12T19:23:01.868076+0000","last_clean":"2024-09-12T19:23:01.868076+0000","last_became_active":"2024-09-12T17:29:52.744356+0000","last_became_peered":"2024-09-12T17:29:52.744356+0000","last_unstale":"2024-09-12T19:23:01.868076+0000","last_undegraded":"2024-09-12T19:23:01.868076+0000","last_fullsized":"2024-09-12T19:23:01.868076+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:36.220798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":48689,"num_write":1045,"num_write_kb":32373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1474,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.852068+0000","last_change":"2024-09-12T17:29:56.751658+0000","last_active":"2024-09-12T19:22:58.852068+0000","last_peered":"2024-09-12T19:22:58.852068+0000","last_clean":"2024-09-12T19:22:58.852068+0000","last_became_active":"2024-09-12T17:29:56.750915+0000","last_became_peered":"2024-09-12T17:29:56.750915+0000","last_unstale":"2024-09-12T19:22:58.852068+0000","last_undegraded":"2024-09-12T19:22:58.852068+0000","last_fullsized":"2024-09-12T19:22:58.852068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:54.038362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'146","reported_seq":731,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:49.669036+0000","last_change":"2024-09-12T17:29:58.832618+0000","last_active":"2024-09-12T19:20:49.669036+0000","last_peered":"2024-09-12T19:20:49.669036+0000","last_clean":"2024-09-12T19:20:49.669036+0000","last_became_active":"2024-09-12T17:29:58.831628+0000","last_became_peered":"2024-09-12T17:29:58.831628+0000","last_unstale":"2024-09-12T19:20:49.669036+0000","last_undegraded":"2024-09-12T19:20:49.669036+0000","last_fullsized":"2024-09-12T19:20:49.669036+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:43.249799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'768","reported_seq":3241,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.291879+0000","last_change":"2024-09-12T17:30:00.807629+0000","last_active":"2024-09-12T19:22:46.291879+0000","last_peered":"2024-09-12T19:22:46.291879+0000","last_clean":"2024-09-12T19:22:46.291879+0000","last_became_active":"2024-09-12T17:30:00.806681+0000","last_became_peered":"2024-09-12T17:30:00.806681+0000","last_unstale":"2024-09-12T19:22:46.291879+0000","last_undegraded":"2024-09-12T19:22:46.291879+0000","last_fullsized":"2024-09-12T19:22:46.291879+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":701,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:09.571492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'116","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:14.309491+0000","last_change":"2024-09-12T17:30:02.806772+0000","last_active":"2024-09-12T19:21:14.309491+0000","last_peered":"2024-09-12T19:21:14.309491+0000","last_clean":"2024-09-12T19:21:14.309491+0000","last_became_active":"2024-09-12T17:30:02.805954+0000","last_became_peered":"2024-09-12T17:30:02.805954+0000","last_unstale":"2024-09-12T19:21:14.309491+0000","last_undegraded":"2024-09-12T19:21:14.309491+0000","last_fullsized":"2024-09-12T19:21:14.309491+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:48.506411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":135,"num_write":268,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'519","reported_seq":2056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.988475+0000","last_change":"2024-09-12T17:29:54.755879+0000","last_active":"2024-09-12T19:20:42.988475+0000","last_peered":"2024-09-12T19:20:42.988475+0000","last_clean":"2024-09-12T19:20:42.988475+0000","last_became_active":"2024-09-12T17:29:54.755550+0000","last_became_peered":"2024-09-12T17:29:54.755550+0000","last_unstale":"2024-09-12T19:20:42.988475+0000","last_undegraded":"2024-09-12T19:20:42.988475+0000","last_fullsized":"2024-09-12T19:20:42.988475+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:22.424955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2775,"num_read_kb":2556,"num_write":676,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'313","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262232+0000","last_change":"2024-09-12T17:30:21.696907+0000","last_active":"2024-09-12T19:20:23.262232+0000","last_peered":"2024-09-12T19:20:23.262232+0000","last_clean":"2024-09-12T19:20:23.262232+0000","last_became_active":"2024-09-12T17:30:21.696077+0000","last_became_peered":"2024-09-12T17:30:21.696077+0000","last_unstale":"2024-09-12T19:20:23.262232+0000","last_undegraded":"2024-09-12T19:20:23.262232+0000","last_fullsized":"2024-09-12T19:20:23.262232+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:10.253722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5311480,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":506,"num_read_kb":12866,"num_write":1134,"num_write_kb":34720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.198755+0000","last_change":"2024-09-12T17:29:56.758620+0000","last_active":"2024-09-12T19:20:13.198755+0000","last_peered":"2024-09-12T19:20:13.198755+0000","last_clean":"2024-09-12T19:20:13.198755+0000","last_became_active":"2024-09-12T17:29:56.757728+0000","last_became_peered":"2024-09-12T17:29:56.757728+0000","last_unstale":"2024-09-12T19:20:13.198755+0000","last_undegraded":"2024-09-12T19:20:13.198755+0000","last_fullsized":"2024-09-12T19:20:13.198755+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:39.838154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'417","reported_seq":1095,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:02.001142+0000","last_change":"2024-09-12T17:29:58.776898+0000","last_active":"2024-09-12T19:23:02.001142+0000","last_peered":"2024-09-12T19:23:02.001142+0000","last_clean":"2024-09-12T19:23:02.001142+0000","last_became_active":"2024-09-12T17:29:58.776033+0000","last_became_peered":"2024-09-12T17:29:58.776033+0000","last_unstale":"2024-09-12T19:23:02.001142+0000","last_undegraded":"2024-09-12T19:23:02.001142+0000","last_fullsized":"2024-09-12T19:23:02.001142+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:29.107658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47722,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":665,"num_read_kb":1193,"num_write":496,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:18.560371+0000","last_change":"2024-09-12T17:30:00.793376+0000","last_active":"2024-09-12T19:20:18.560371+0000","last_peered":"2024-09-12T19:20:18.560371+0000","last_clean":"2024-09-12T19:20:18.560371+0000","last_became_active":"2024-09-12T17:30:00.792687+0000","last_became_peered":"2024-09-12T17:30:00.792687+0000","last_unstale":"2024-09-12T19:20:18.560371+0000","last_undegraded":"2024-09-12T19:20:18.560371+0000","last_fullsized":"2024-09-12T19:20:18.560371+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:53.873367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'165","reported_seq":696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.984898+0000","last_change":"2024-09-12T17:30:02.809944+0000","last_active":"2024-09-12T19:20:27.984898+0000","last_peered":"2024-09-12T19:20:27.984898+0000","last_clean":"2024-09-12T19:20:27.984898+0000","last_became_active":"2024-09-12T17:30:02.809252+0000","last_became_peered":"2024-09-12T17:30:02.809252+0000","last_unstale":"2024-09-12T19:20:27.984898+0000","last_undegraded":"2024-09-12T19:20:27.984898+0000","last_fullsized":"2024-09-12T19:20:27.984898+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:42.655346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":242,"num_read_kb":230,"num_write":407,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'457","reported_seq":1883,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:38.564931+0000","last_change":"2024-09-12T17:29:54.773311+0000","last_active":"2024-09-12T19:20:38.564931+0000","last_peered":"2024-09-12T19:20:38.564931+0000","last_clean":"2024-09-12T19:20:38.564931+0000","last_became_active":"2024-09-12T17:29:54.771538+0000","last_became_peered":"2024-09-12T17:29:54.771538+0000","last_unstale":"2024-09-12T19:20:38.564931+0000","last_undegraded":"2024-09-12T19:20:38.564931+0000","last_fullsized":"2024-09-12T19:20:38.564931+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:11.655778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2249,"num_read_kb":2075,"num_write":554,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:52.966096+0000","last_change":"2024-09-12T17:29:30.603974+0000","last_active":"2024-09-12T19:19:52.966096+0000","last_peered":"2024-09-12T19:19:52.966096+0000","last_clean":"2024-09-12T19:19:52.966096+0000","last_became_active":"2024-09-12T17:29:30.601518+0000","last_became_peered":"2024-09-12T17:29:30.601518+0000","last_unstale":"2024-09-12T19:19:52.966096+0000","last_undegraded":"2024-09-12T19:19:52.966096+0000","last_fullsized":"2024-09-12T19:19:52.966096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:29.241459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:29.241459+0000","last_clean_scrub_stamp":"2024-09-12T17:29:29.241459+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:32.039824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":552,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.986642+0000","last_change":"2024-09-12T17:29:37.351871+0000","last_active":"2024-09-12T19:20:02.986642+0000","last_peered":"2024-09-12T19:20:02.986642+0000","last_clean":"2024-09-12T19:20:02.986642+0000","last_became_active":"2024-09-12T17:29:35.340342+0000","last_became_peered":"2024-09-12T17:29:35.340342+0000","last_unstale":"2024-09-12T19:20:02.986642+0000","last_undegraded":"2024-09-12T19:20:02.986642+0000","last_fullsized":"2024-09-12T19:20:02.986642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:04.662413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097602599999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'268","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:18.260770+0000","last_change":"2024-09-12T17:29:52.767042+0000","last_active":"2024-09-12T19:20:18.260770+0000","last_peered":"2024-09-12T19:20:18.260770+0000","last_clean":"2024-09-12T19:20:18.260770+0000","last_became_active":"2024-09-12T17:29:52.765497+0000","last_became_peered":"2024-09-12T17:29:52.765497+0000","last_unstale":"2024-09-12T19:20:18.260770+0000","last_undegraded":"2024-09-12T19:20:18.260770+0000","last_fullsized":"2024-09-12T19:20:18.260770+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:05.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14183958,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":465,"num_read_kb":15769,"num_write":975,"num_write_kb":23964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:22.973720+0000","last_change":"2024-09-12T17:29:56.750663+0000","last_active":"2024-09-12T19:20:22.973720+0000","last_peered":"2024-09-12T19:20:22.973720+0000","last_clean":"2024-09-12T19:20:22.973720+0000","last_became_active":"2024-09-12T17:29:56.749938+0000","last_became_peered":"2024-09-12T17:29:56.749938+0000","last_unstale":"2024-09-12T19:20:22.973720+0000","last_undegraded":"2024-09-12T19:20:22.973720+0000","last_fullsized":"2024-09-12T19:20:22.973720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:42.837901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'798","reported_seq":1542,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.770805+0000","last_change":"2024-09-12T17:29:58.770209+0000","last_active":"2024-09-12T19:23:01.770805+0000","last_peered":"2024-09-12T19:23:01.770805+0000","last_clean":"2024-09-12T19:23:01.770805+0000","last_became_active":"2024-09-12T17:29:58.769277+0000","last_became_peered":"2024-09-12T17:29:58.769277+0000","last_unstale":"2024-09-12T19:23:01.770805+0000","last_undegraded":"2024-09-12T19:23:01.770805+0000","last_fullsized":"2024-09-12T19:23:01.770805+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:07.152072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159898,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1560,"num_read_kb":3538,"num_write":1488,"num_write_kb":1318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.193952+0000","last_change":"2024-09-12T17:30:00.800340+0000","last_active":"2024-09-12T19:20:33.193952+0000","last_peered":"2024-09-12T19:20:33.193952+0000","last_clean":"2024-09-12T19:20:33.193952+0000","last_became_active":"2024-09-12T17:30:00.799883+0000","last_became_peered":"2024-09-12T17:30:00.799883+0000","last_unstale":"2024-09-12T19:20:33.193952+0000","last_undegraded":"2024-09-12T19:20:33.193952+0000","last_fullsized":"2024-09-12T19:20:33.193952+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:44.555994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'197","reported_seq":924,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.519551+0000","last_change":"2024-09-12T17:30:02.800451+0000","last_active":"2024-09-12T19:21:21.519551+0000","last_peered":"2024-09-12T19:21:21.519551+0000","last_clean":"2024-09-12T19:21:21.519551+0000","last_became_active":"2024-09-12T17:30:02.799307+0000","last_became_peered":"2024-09-12T17:30:02.799307+0000","last_unstale":"2024-09-12T19:21:21.519551+0000","last_undegraded":"2024-09-12T19:21:21.519551+0000","last_fullsized":"2024-09-12T19:21:21.519551+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:50.826285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1000,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":467,"num_write":393,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'474","reported_seq":2035,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.192554+0000","last_change":"2024-09-12T17:29:54.758652+0000","last_active":"2024-09-12T19:20:28.192554+0000","last_peered":"2024-09-12T19:20:28.192554+0000","last_clean":"2024-09-12T19:20:28.192554+0000","last_became_active":"2024-09-12T17:29:54.758196+0000","last_became_peered":"2024-09-12T17:29:54.758196+0000","last_unstale":"2024-09-12T19:20:28.192554+0000","last_undegraded":"2024-09-12T19:20:28.192554+0000","last_fullsized":"2024-09-12T19:20:28.192554+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:38.243254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2778,"num_read_kb":2582,"num_write":658,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":552,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.967413+0000","last_change":"2024-09-12T17:29:37.541726+0000","last_active":"2024-09-12T19:19:57.967413+0000","last_peered":"2024-09-12T19:19:57.967413+0000","last_clean":"2024-09-12T19:19:57.967413+0000","last_became_active":"2024-09-12T17:29:35.336475+0000","last_became_peered":"2024-09-12T17:29:35.336475+0000","last_unstale":"2024-09-12T19:19:57.967413+0000","last_undegraded":"2024-09-12T19:19:57.967413+0000","last_fullsized":"2024-09-12T19:19:57.967413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:17.489304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012883599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'346","reported_seq":1071,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.777899+0000","last_change":"2024-09-12T17:29:52.766738+0000","last_active":"2024-09-12T19:23:01.777899+0000","last_peered":"2024-09-12T19:23:01.777899+0000","last_clean":"2024-09-12T19:23:01.777899+0000","last_became_active":"2024-09-12T17:29:52.766251+0000","last_became_peered":"2024-09-12T17:29:52.766251+0000","last_unstale":"2024-09-12T19:23:01.777899+0000","last_undegraded":"2024-09-12T19:23:01.777899+0000","last_fullsized":"2024-09-12T19:23:01.777899+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:37.272387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730134,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":595,"num_read_kb":84420,"num_write":1189,"num_write_kb":23129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.992482+0000","last_change":"2024-09-12T17:29:56.763217+0000","last_active":"2024-09-12T19:20:27.992482+0000","last_peered":"2024-09-12T19:20:27.992482+0000","last_clean":"2024-09-12T19:20:27.992482+0000","last_became_active":"2024-09-12T17:29:56.762451+0000","last_became_peered":"2024-09-12T17:29:56.762451+0000","last_unstale":"2024-09-12T19:20:27.992482+0000","last_undegraded":"2024-09-12T19:20:27.992482+0000","last_fullsized":"2024-09-12T19:20:27.992482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:29.246666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1460","reported_seq":3809,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.692205+0000","last_change":"2024-09-12T17:29:58.772005+0000","last_active":"2024-09-12T19:23:01.692205+0000","last_peered":"2024-09-12T19:23:01.692205+0000","last_clean":"2024-09-12T19:23:01.692205+0000","last_became_active":"2024-09-12T17:29:58.771561+0000","last_became_peered":"2024-09-12T17:29:58.771561+0000","last_unstale":"2024-09-12T19:23:01.692205+0000","last_undegraded":"2024-09-12T19:23:01.692205+0000","last_fullsized":"2024-09-12T19:23:01.692205+0000","mapping_epoch":32,"log_start":"267'1400","ondisk_log_start":"267'1400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:12.774049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146977,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2279,"num_read_kb":4182,"num_write":1388,"num_write_kb":1130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:47.979732+0000","last_change":"2024-09-12T17:30:00.806748+0000","last_active":"2024-09-12T19:20:47.979732+0000","last_peered":"2024-09-12T19:20:47.979732+0000","last_clean":"2024-09-12T19:20:47.979732+0000","last_became_active":"2024-09-12T17:30:00.806030+0000","last_became_peered":"2024-09-12T17:30:00.806030+0000","last_unstale":"2024-09-12T19:20:47.979732+0000","last_undegraded":"2024-09-12T19:20:47.979732+0000","last_fullsized":"2024-09-12T19:20:47.979732+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:16.762914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'217","reported_seq":760,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:18.500162+0000","last_change":"2024-09-12T17:30:02.810034+0000","last_active":"2024-09-12T19:21:18.500162+0000","last_peered":"2024-09-12T19:21:18.500162+0000","last_clean":"2024-09-12T19:21:18.500162+0000","last_became_active":"2024-09-12T17:30:02.809372+0000","last_became_peered":"2024-09-12T17:30:02.809372+0000","last_unstale":"2024-09-12T19:21:18.500162+0000","last_undegraded":"2024-09-12T19:21:18.500162+0000","last_fullsized":"2024-09-12T19:21:18.500162+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:48.796437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":353,"num_read_kb":353,"num_write":469,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'466","reported_seq":2050,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.441742+0000","last_change":"2024-09-12T17:29:54.747544+0000","last_active":"2024-09-12T19:21:21.441742+0000","last_peered":"2024-09-12T19:21:21.441742+0000","last_clean":"2024-09-12T19:21:21.441742+0000","last_became_active":"2024-09-12T17:29:54.747270+0000","last_became_peered":"2024-09-12T17:29:54.747270+0000","last_unstale":"2024-09-12T19:21:21.441742+0000","last_undegraded":"2024-09-12T19:21:21.441742+0000","last_fullsized":"2024-09-12T19:21:21.441742+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:57.930978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2522,"num_read_kb":2358,"num_write":589,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":564,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.533496+0000","last_change":"2024-09-12T17:29:37.348932+0000","last_active":"2024-09-12T19:20:03.533496+0000","last_peered":"2024-09-12T19:20:03.533496+0000","last_clean":"2024-09-12T19:20:03.533496+0000","last_became_active":"2024-09-12T17:29:35.331504+0000","last_became_peered":"2024-09-12T17:29:35.331504+0000","last_unstale":"2024-09-12T19:20:03.533496+0000","last_undegraded":"2024-09-12T19:20:03.533496+0000","last_fullsized":"2024-09-12T19:20:03.533496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:24.198110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001034428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'347","reported_seq":983,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.883682+0000","last_change":"2024-09-12T17:29:52.741712+0000","last_active":"2024-09-12T19:23:01.883682+0000","last_peered":"2024-09-12T19:23:01.883682+0000","last_clean":"2024-09-12T19:23:01.883682+0000","last_became_active":"2024-09-12T17:29:52.741209+0000","last_became_peered":"2024-09-12T17:29:52.741209+0000","last_unstale":"2024-09-12T19:23:01.883682+0000","last_undegraded":"2024-09-12T19:23:01.883682+0000","last_fullsized":"2024-09-12T19:23:01.883682+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:54.967025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":451,"num_read_kb":5499,"num_write":979,"num_write_kb":15070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.539110+0000","last_change":"2024-09-12T17:29:56.753741+0000","last_active":"2024-09-12T19:20:28.539110+0000","last_peered":"2024-09-12T19:20:28.539110+0000","last_clean":"2024-09-12T19:20:28.539110+0000","last_became_active":"2024-09-12T17:29:56.753063+0000","last_became_peered":"2024-09-12T17:29:56.753063+0000","last_unstale":"2024-09-12T19:20:28.539110+0000","last_undegraded":"2024-09-12T19:20:28.539110+0000","last_fullsized":"2024-09-12T19:20:28.539110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:26.088728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'367","reported_seq":2316,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.478760+0000","last_change":"2024-09-12T17:29:58.835335+0000","last_active":"2024-09-12T19:22:46.478760+0000","last_peered":"2024-09-12T19:22:46.478760+0000","last_clean":"2024-09-12T19:22:46.478760+0000","last_became_active":"2024-09-12T17:29:58.834447+0000","last_became_peered":"2024-09-12T17:29:58.834447+0000","last_unstale":"2024-09-12T19:22:46.478760+0000","last_undegraded":"2024-09-12T19:22:46.478760+0000","last_fullsized":"2024-09-12T19:22:46.478760+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:10.184300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":368,"num_read_kb":360,"num_write":359,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.192453+0000","last_change":"2024-09-12T17:30:00.778895+0000","last_active":"2024-09-12T19:20:28.192453+0000","last_peered":"2024-09-12T19:20:28.192453+0000","last_clean":"2024-09-12T19:20:28.192453+0000","last_became_active":"2024-09-12T17:30:00.778134+0000","last_became_peered":"2024-09-12T17:30:00.778134+0000","last_unstale":"2024-09-12T19:20:28.192453+0000","last_undegraded":"2024-09-12T19:20:28.192453+0000","last_fullsized":"2024-09-12T19:20:28.192453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:40.692916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'270","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:22.003400+0000","last_change":"2024-09-12T17:30:02.805738+0000","last_active":"2024-09-12T19:21:22.003400+0000","last_peered":"2024-09-12T19:21:22.003400+0000","last_clean":"2024-09-12T19:21:22.003400+0000","last_became_active":"2024-09-12T17:30:02.805090+0000","last_became_peered":"2024-09-12T17:30:02.805090+0000","last_unstale":"2024-09-12T19:21:22.003400+0000","last_undegraded":"2024-09-12T19:21:22.003400+0000","last_fullsized":"2024-09-12T19:21:22.003400+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:19.612013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":596,"num_read_kb":605,"num_write":610,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'409","reported_seq":1956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.029492+0000","last_change":"2024-09-12T17:29:54.745943+0000","last_active":"2024-09-12T19:22:45.029492+0000","last_peered":"2024-09-12T19:22:45.029492+0000","last_clean":"2024-09-12T19:22:45.029492+0000","last_became_active":"2024-09-12T17:29:54.745423+0000","last_became_peered":"2024-09-12T17:29:54.745423+0000","last_unstale":"2024-09-12T19:22:45.029492+0000","last_undegraded":"2024-09-12T19:22:45.029492+0000","last_fullsized":"2024-09-12T19:22:45.029492+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:49.009438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2154,"num_read_kb":2073,"num_write":474,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":553,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.986585+0000","last_change":"2024-09-12T17:29:37.352917+0000","last_active":"2024-09-12T19:20:02.986585+0000","last_peered":"2024-09-12T19:20:02.986585+0000","last_clean":"2024-09-12T19:20:02.986585+0000","last_became_active":"2024-09-12T17:29:35.340113+0000","last_became_peered":"2024-09-12T17:29:35.340113+0000","last_unstale":"2024-09-12T19:20:02.986585+0000","last_undegraded":"2024-09-12T19:20:02.986585+0000","last_fullsized":"2024-09-12T19:20:02.986585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:23.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020086050000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'366","reported_seq":1114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.974429+0000","last_change":"2024-09-12T17:29:52.760726+0000","last_active":"2024-09-12T19:23:01.974429+0000","last_peered":"2024-09-12T19:23:01.974429+0000","last_clean":"2024-09-12T19:23:01.974429+0000","last_became_active":"2024-09-12T17:29:52.759957+0000","last_became_peered":"2024-09-12T17:29:52.759957+0000","last_unstale":"2024-09-12T19:23:01.974429+0000","last_undegraded":"2024-09-12T19:23:01.974429+0000","last_fullsized":"2024-09-12T19:23:01.974429+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:47.608386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279708,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":651,"num_read_kb":39253,"num_write":1178,"num_write_kb":45869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:43.196821+0000","last_change":"2024-09-12T17:29:56.766428+0000","last_active":"2024-09-12T19:20:43.196821+0000","last_peered":"2024-09-12T19:20:43.196821+0000","last_clean":"2024-09-12T19:20:43.196821+0000","last_became_active":"2024-09-12T17:29:56.765361+0000","last_became_peered":"2024-09-12T17:29:56.765361+0000","last_unstale":"2024-09-12T19:20:43.196821+0000","last_undegraded":"2024-09-12T19:20:43.196821+0000","last_fullsized":"2024-09-12T19:20:43.196821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:24.942838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'210","reported_seq":825,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:43.293295+0000","last_change":"2024-09-12T17:29:58.769020+0000","last_active":"2024-09-12T19:22:43.293295+0000","last_peered":"2024-09-12T19:22:43.293295+0000","last_clean":"2024-09-12T19:22:43.293295+0000","last_became_active":"2024-09-12T17:29:58.768596+0000","last_became_peered":"2024-09-12T17:29:58.768596+0000","last_unstale":"2024-09-12T19:22:43.293295+0000","last_undegraded":"2024-09-12T19:22:43.293295+0000","last_fullsized":"2024-09-12T19:22:43.293295+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:34.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.563828+0000","last_change":"2024-09-12T17:30:00.790648+0000","last_active":"2024-09-12T19:20:33.563828+0000","last_peered":"2024-09-12T19:20:33.563828+0000","last_clean":"2024-09-12T19:20:33.563828+0000","last_became_active":"2024-09-12T17:30:00.788505+0000","last_became_peered":"2024-09-12T17:30:00.788505+0000","last_unstale":"2024-09-12T19:20:33.563828+0000","last_undegraded":"2024-09-12T19:20:33.563828+0000","last_fullsized":"2024-09-12T19:20:33.563828+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:54.847829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'156","reported_seq":736,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.643106+0000","last_change":"2024-09-12T17:30:02.795566+0000","last_active":"2024-09-12T19:22:44.643106+0000","last_peered":"2024-09-12T19:22:44.643106+0000","last_clean":"2024-09-12T19:22:44.643106+0000","last_became_active":"2024-09-12T17:30:02.794703+0000","last_became_peered":"2024-09-12T17:30:02.794703+0000","last_unstale":"2024-09-12T19:22:44.643106+0000","last_undegraded":"2024-09-12T19:22:44.643106+0000","last_fullsized":"2024-09-12T19:22:44.643106+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:19.673266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":268,"num_read_kb":254,"num_write":347,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'419","reported_seq":2016,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:22.983809+0000","last_change":"2024-09-12T17:29:54.766600+0000","last_active":"2024-09-12T19:20:22.983809+0000","last_peered":"2024-09-12T19:20:22.983809+0000","last_clean":"2024-09-12T19:20:22.983809+0000","last_became_active":"2024-09-12T17:29:54.766275+0000","last_became_peered":"2024-09-12T17:29:54.766275+0000","last_unstale":"2024-09-12T19:20:22.983809+0000","last_undegraded":"2024-09-12T19:20:22.983809+0000","last_fullsized":"2024-09-12T19:20:22.983809+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:40.431193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2280,"num_read_kb":2171,"num_write":482,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'349","reported_seq":1026,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.969892+0000","last_change":"2024-09-12T17:29:52.741487+0000","last_active":"2024-09-12T19:23:01.969892+0000","last_peered":"2024-09-12T19:23:01.969892+0000","last_clean":"2024-09-12T19:23:01.969892+0000","last_became_active":"2024-09-12T17:29:52.740544+0000","last_became_peered":"2024-09-12T17:29:52.740544+0000","last_unstale":"2024-09-12T19:23:01.969892+0000","last_undegraded":"2024-09-12T19:23:01.969892+0000","last_fullsized":"2024-09-12T19:23:01.969892+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:29.317350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":6019,"num_write":1130,"num_write_kb":22769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":554,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.979639+0000","last_change":"2024-09-12T17:29:37.346858+0000","last_active":"2024-09-12T19:20:02.979639+0000","last_peered":"2024-09-12T19:20:02.979639+0000","last_clean":"2024-09-12T19:20:02.979639+0000","last_became_active":"2024-09-12T17:29:35.407492+0000","last_became_peered":"2024-09-12T17:29:35.407492+0000","last_unstale":"2024-09-12T19:20:02.979639+0000","last_undegraded":"2024-09-12T19:20:02.979639+0000","last_fullsized":"2024-09-12T19:20:02.979639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:34.824127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098134900000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.191284+0000","last_change":"2024-09-12T17:29:56.769832+0000","last_active":"2024-09-12T19:20:23.191284+0000","last_peered":"2024-09-12T19:20:23.191284+0000","last_clean":"2024-09-12T19:20:23.191284+0000","last_became_active":"2024-09-12T17:29:56.769344+0000","last_became_peered":"2024-09-12T17:29:56.769344+0000","last_unstale":"2024-09-12T19:20:23.191284+0000","last_undegraded":"2024-09-12T19:20:23.191284+0000","last_fullsized":"2024-09-12T19:20:23.191284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:05.381579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'763","reported_seq":1503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.624058+0000","last_change":"2024-09-12T17:29:58.776516+0000","last_active":"2024-09-12T19:23:01.624058+0000","last_peered":"2024-09-12T19:23:01.624058+0000","last_clean":"2024-09-12T19:23:01.624058+0000","last_became_active":"2024-09-12T17:29:58.766353+0000","last_became_peered":"2024-09-12T17:29:58.766353+0000","last_unstale":"2024-09-12T19:23:01.624058+0000","last_undegraded":"2024-09-12T19:23:01.624058+0000","last_fullsized":"2024-09-12T19:23:01.624058+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:35.937627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88446,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1874,"num_read_kb":3148,"num_write":2424,"num_write_kb":2173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.202330+0000","last_change":"2024-09-12T17:30:00.784218+0000","last_active":"2024-09-12T19:20:28.202330+0000","last_peered":"2024-09-12T19:20:28.202330+0000","last_clean":"2024-09-12T19:20:28.202330+0000","last_became_active":"2024-09-12T17:30:00.783385+0000","last_became_peered":"2024-09-12T17:30:00.783385+0000","last_unstale":"2024-09-12T19:20:28.202330+0000","last_undegraded":"2024-09-12T19:20:28.202330+0000","last_fullsized":"2024-09-12T19:20:28.202330+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:44.877583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'143","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:14.315826+0000","last_change":"2024-09-12T17:30:02.806515+0000","last_active":"2024-09-12T19:21:14.315826+0000","last_peered":"2024-09-12T19:21:14.315826+0000","last_clean":"2024-09-12T19:21:14.315826+0000","last_became_active":"2024-09-12T17:30:02.805684+0000","last_became_peered":"2024-09-12T17:30:02.805684+0000","last_unstale":"2024-09-12T19:21:14.315826+0000","last_undegraded":"2024-09-12T19:21:14.315826+0000","last_fullsized":"2024-09-12T19:21:14.315826+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:50.293983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":165,"num_read_kb":163,"num_write":341,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'404","reported_seq":1905,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.896908+0000","last_change":"2024-09-12T17:29:54.758506+0000","last_active":"2024-09-12T19:21:55.896908+0000","last_peered":"2024-09-12T19:21:55.896908+0000","last_clean":"2024-09-12T19:21:55.896908+0000","last_became_active":"2024-09-12T17:29:54.758047+0000","last_became_peered":"2024-09-12T17:29:54.758047+0000","last_unstale":"2024-09-12T19:21:55.896908+0000","last_undegraded":"2024-09-12T19:21:55.896908+0000","last_fullsized":"2024-09-12T19:21:55.896908+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:06.718970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2269,"num_read_kb":2144,"num_write":466,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'307","reported_seq":1185,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.919860+0000","last_change":"2024-09-12T17:29:52.728144+0000","last_active":"2024-09-12T19:23:01.919860+0000","last_peered":"2024-09-12T19:23:01.919860+0000","last_clean":"2024-09-12T19:23:01.919860+0000","last_became_active":"2024-09-12T17:29:52.727635+0000","last_became_peered":"2024-09-12T17:29:52.727635+0000","last_unstale":"2024-09-12T19:23:01.919860+0000","last_undegraded":"2024-09-12T19:23:01.919860+0000","last_fullsized":"2024-09-12T19:23:01.919860+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:03.775561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109709,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":897,"num_read_kb":32569,"num_write":1024,"num_write_kb":39553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":550,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:22.973772+0000","last_change":"2024-09-12T17:29:37.541831+0000","last_active":"2024-09-12T19:20:22.973772+0000","last_peered":"2024-09-12T19:20:22.973772+0000","last_clean":"2024-09-12T19:20:22.973772+0000","last_became_active":"2024-09-12T17:29:35.406653+0000","last_became_peered":"2024-09-12T17:29:35.406653+0000","last_unstale":"2024-09-12T19:20:22.973772+0000","last_undegraded":"2024-09-12T19:20:22.973772+0000","last_fullsized":"2024-09-12T19:20:22.973772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:04.148521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001315566,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.561483+0000","last_change":"2024-09-12T17:29:56.770303+0000","last_active":"2024-09-12T19:20:23.561483+0000","last_peered":"2024-09-12T19:20:23.561483+0000","last_clean":"2024-09-12T19:20:23.561483+0000","last_became_active":"2024-09-12T17:29:56.769576+0000","last_became_peered":"2024-09-12T17:29:56.769576+0000","last_unstale":"2024-09-12T19:20:23.561483+0000","last_undegraded":"2024-09-12T19:20:23.561483+0000","last_fullsized":"2024-09-12T19:20:23.561483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:04.267964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'337","reported_seq":976,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:29.216151+0000","last_change":"2024-09-12T17:29:58.831755+0000","last_active":"2024-09-12T19:21:29.216151+0000","last_peered":"2024-09-12T19:21:29.216151+0000","last_clean":"2024-09-12T19:21:29.216151+0000","last_became_active":"2024-09-12T17:29:58.830993+0000","last_became_peered":"2024-09-12T17:29:58.830993+0000","last_unstale":"2024-09-12T19:21:29.216151+0000","last_undegraded":"2024-09-12T19:21:29.216151+0000","last_fullsized":"2024-09-12T19:21:29.216151+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:47.520303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":439,"num_read_kb":430,"num_write":418,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'791","reported_seq":3373,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.882999+0000","last_change":"2024-09-12T17:30:00.805745+0000","last_active":"2024-09-12T19:22:58.882999+0000","last_peered":"2024-09-12T19:22:58.882999+0000","last_clean":"2024-09-12T19:22:58.882999+0000","last_became_active":"2024-09-12T17:30:00.805059+0000","last_became_peered":"2024-09-12T17:30:00.805059+0000","last_unstale":"2024-09-12T19:22:58.882999+0000","last_undegraded":"2024-09-12T19:22:58.882999+0000","last_fullsized":"2024-09-12T19:22:58.882999+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":701,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:20.515894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'134","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.261254+0000","last_change":"2024-09-12T17:30:02.805558+0000","last_active":"2024-09-12T19:22:46.261254+0000","last_peered":"2024-09-12T19:22:46.261254+0000","last_clean":"2024-09-12T19:22:46.261254+0000","last_became_active":"2024-09-12T17:30:02.803051+0000","last_became_peered":"2024-09-12T17:30:02.803051+0000","last_unstale":"2024-09-12T19:22:46.261254+0000","last_undegraded":"2024-09-12T19:22:46.261254+0000","last_fullsized":"2024-09-12T19:22:46.261254+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:30.608707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":726,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":188,"num_read_kb":177,"num_write":312,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'427","reported_seq":1967,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262257+0000","last_change":"2024-09-12T17:29:54.762856+0000","last_active":"2024-09-12T19:20:23.262257+0000","last_peered":"2024-09-12T19:20:23.262257+0000","last_clean":"2024-09-12T19:20:23.262257+0000","last_became_active":"2024-09-12T17:29:54.762522+0000","last_became_peered":"2024-09-12T17:29:54.762522+0000","last_unstale":"2024-09-12T19:20:23.262257+0000","last_undegraded":"2024-09-12T19:20:23.262257+0000","last_fullsized":"2024-09-12T19:20:23.262257+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:33.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2273,"num_read_kb":2141,"num_write":510,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'241","reported_seq":869,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:38.915328+0000","last_change":"2024-09-12T17:29:52.716685+0000","last_active":"2024-09-12T19:22:38.915328+0000","last_peered":"2024-09-12T19:22:38.915328+0000","last_clean":"2024-09-12T19:22:38.915328+0000","last_became_active":"2024-09-12T17:29:52.716210+0000","last_became_peered":"2024-09-12T17:29:52.716210+0000","last_unstale":"2024-09-12T19:22:38.915328+0000","last_undegraded":"2024-09-12T19:22:38.915328+0000","last_fullsized":"2024-09-12T19:22:38.915328+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:59.907663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243543,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":327,"num_read_kb":381,"num_write":871,"num_write_kb":30307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":552,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:07.980821+0000","last_change":"2024-09-12T17:29:37.346714+0000","last_active":"2024-09-12T19:20:07.980821+0000","last_peered":"2024-09-12T19:20:07.980821+0000","last_clean":"2024-09-12T19:20:07.980821+0000","last_became_active":"2024-09-12T17:29:35.337987+0000","last_became_peered":"2024-09-12T17:29:35.337987+0000","last_unstale":"2024-09-12T19:20:07.980821+0000","last_undegraded":"2024-09-12T19:20:07.980821+0000","last_fullsized":"2024-09-12T19:20:07.980821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:46.254256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011496340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"38'3","reported_seq":1014,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.839940+0000","last_change":"2024-09-12T17:29:56.756687+0000","last_active":"2024-09-12T19:22:58.839940+0000","last_peered":"2024-09-12T19:22:58.839940+0000","last_clean":"2024-09-12T19:22:58.839940+0000","last_became_active":"2024-09-12T17:29:56.754415+0000","last_became_peered":"2024-09-12T17:29:56.754415+0000","last_unstale":"2024-09-12T19:22:58.839940+0000","last_undegraded":"2024-09-12T19:22:58.839940+0000","last_fullsized":"2024-09-12T19:22:58.839940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:14.164674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'175","reported_seq":781,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:52.559741+0000","last_change":"2024-09-12T17:29:58.767652+0000","last_active":"2024-09-12T19:20:52.559741+0000","last_peered":"2024-09-12T19:20:52.559741+0000","last_clean":"2024-09-12T19:20:52.559741+0000","last_became_active":"2024-09-12T17:29:58.766420+0000","last_became_peered":"2024-09-12T17:29:58.766420+0000","last_unstale":"2024-09-12T19:20:52.559741+0000","last_undegraded":"2024-09-12T19:20:52.559741+0000","last_fullsized":"2024-09-12T19:20:52.559741+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:24.045295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":231,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'814","reported_seq":5001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.293341+0000","last_change":"2024-09-12T17:30:00.796740+0000","last_active":"2024-09-12T19:22:46.293341+0000","last_peered":"2024-09-12T19:22:46.293341+0000","last_clean":"2024-09-12T19:22:46.293341+0000","last_became_active":"2024-09-12T17:30:00.793234+0000","last_became_peered":"2024-09-12T17:30:00.793234+0000","last_unstale":"2024-09-12T19:22:46.293341+0000","last_undegraded":"2024-09-12T19:22:46.293341+0000","last_fullsized":"2024-09-12T19:22:46.293341+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:52.398488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'186","reported_seq":723,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:17.279016+0000","last_change":"2024-09-12T17:30:02.800748+0000","last_active":"2024-09-12T19:21:17.279016+0000","last_peered":"2024-09-12T19:21:17.279016+0000","last_clean":"2024-09-12T19:21:17.279016+0000","last_became_active":"2024-09-12T17:30:02.799944+0000","last_became_peered":"2024-09-12T17:30:02.799944+0000","last_unstale":"2024-09-12T19:21:17.279016+0000","last_undegraded":"2024-09-12T19:21:17.279016+0000","last_fullsized":"2024-09-12T19:21:17.279016+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:37.045857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":199,"num_read_kb":188,"num_write":423,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'1235","reported_seq":2851,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.201038+0000","last_change":"2024-09-12T17:29:54.753103+0000","last_active":"2024-09-12T19:20:23.201038+0000","last_peered":"2024-09-12T19:20:23.201038+0000","last_clean":"2024-09-12T19:20:23.201038+0000","last_became_active":"2024-09-12T17:29:54.751931+0000","last_became_peered":"2024-09-12T17:29:54.751931+0000","last_unstale":"2024-09-12T19:20:23.201038+0000","last_undegraded":"2024-09-12T19:20:23.201038+0000","last_fullsized":"2024-09-12T19:20:23.201038+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":1200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:55.642337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5667,"num_read_kb":5016,"num_write":1745,"num_write_kb":765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'270","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.516108+0000","last_change":"2024-09-12T17:30:21.698110+0000","last_active":"2024-09-12T19:18:43.516108+0000","last_peered":"2024-09-12T19:18:43.516108+0000","last_clean":"2024-09-12T19:18:43.516108+0000","last_became_active":"2024-09-12T17:30:21.697470+0000","last_became_peered":"2024-09-12T17:30:21.697470+0000","last_unstale":"2024-09-12T19:18:43.516108+0000","last_undegraded":"2024-09-12T19:18:43.516108+0000","last_fullsized":"2024-09-12T19:18:43.516108+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:17.468181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13170,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":380,"num_read_kb":2583,"num_write":988,"num_write_kb":28824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":552,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.558253+0000","last_change":"2024-09-12T17:29:37.541991+0000","last_active":"2024-09-12T19:20:08.558253+0000","last_peered":"2024-09-12T19:20:08.558253+0000","last_clean":"2024-09-12T19:20:08.558253+0000","last_became_active":"2024-09-12T17:29:35.337998+0000","last_became_peered":"2024-09-12T17:29:35.337998+0000","last_unstale":"2024-09-12T19:20:08.558253+0000","last_undegraded":"2024-09-12T19:20:08.558253+0000","last_fullsized":"2024-09-12T19:20:08.558253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:23.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011850280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262198+0000","last_change":"2024-09-12T17:29:56.761573+0000","last_active":"2024-09-12T19:20:23.262198+0000","last_peered":"2024-09-12T19:20:23.262198+0000","last_clean":"2024-09-12T19:20:23.262198+0000","last_became_active":"2024-09-12T17:29:56.760822+0000","last_became_peered":"2024-09-12T17:29:56.760822+0000","last_unstale":"2024-09-12T19:20:23.262198+0000","last_undegraded":"2024-09-12T19:20:23.262198+0000","last_fullsized":"2024-09-12T19:20:23.262198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:48.200758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'808","reported_seq":1589,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.852202+0000","last_change":"2024-09-12T17:29:58.831322+0000","last_active":"2024-09-12T19:23:01.852202+0000","last_peered":"2024-09-12T19:23:01.852202+0000","last_clean":"2024-09-12T19:23:01.852202+0000","last_became_active":"2024-09-12T17:29:58.830605+0000","last_became_peered":"2024-09-12T17:29:58.830605+0000","last_unstale":"2024-09-12T19:23:01.852202+0000","last_undegraded":"2024-09-12T19:23:01.852202+0000","last_fullsized":"2024-09-12T19:23:01.852202+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:34.715340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138319,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1432,"num_read_kb":3265,"num_write":1150,"num_write_kb":898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.263615+0000","last_change":"2024-09-12T17:30:00.810969+0000","last_active":"2024-09-12T19:20:28.263615+0000","last_peered":"2024-09-12T19:20:28.263615+0000","last_clean":"2024-09-12T19:20:28.263615+0000","last_became_active":"2024-09-12T17:30:00.810341+0000","last_became_peered":"2024-09-12T17:30:00.810341+0000","last_unstale":"2024-09-12T19:20:28.263615+0000","last_undegraded":"2024-09-12T19:20:28.263615+0000","last_fullsized":"2024-09-12T19:20:28.263615+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:02.611552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'162","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:17.990022+0000","last_change":"2024-09-12T17:30:02.787340+0000","last_active":"2024-09-12T19:20:17.990022+0000","last_peered":"2024-09-12T19:20:17.990022+0000","last_clean":"2024-09-12T19:20:17.990022+0000","last_became_active":"2024-09-12T17:30:02.786443+0000","last_became_peered":"2024-09-12T17:30:02.786443+0000","last_unstale":"2024-09-12T19:20:17.990022+0000","last_undegraded":"2024-09-12T19:20:17.990022+0000","last_fullsized":"2024-09-12T19:20:17.990022+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:16.833731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":311,"num_read_kb":271,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'112","reported_seq":698,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.907333+0000","last_change":"2024-09-12T17:30:02.805626+0000","last_active":"2024-09-12T19:21:21.907333+0000","last_peered":"2024-09-12T19:21:21.907333+0000","last_clean":"2024-09-12T19:21:21.907333+0000","last_became_active":"2024-09-12T17:30:02.801038+0000","last_became_peered":"2024-09-12T17:30:02.801038+0000","last_unstale":"2024-09-12T19:21:21.907333+0000","last_undegraded":"2024-09-12T19:21:21.907333+0000","last_fullsized":"2024-09-12T19:21:21.907333+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:20.200364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":212,"num_write":265,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'453","reported_seq":2036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.190526+0000","last_change":"2024-09-12T17:29:54.761528+0000","last_active":"2024-09-12T19:19:38.190526+0000","last_peered":"2024-09-12T19:19:38.190526+0000","last_clean":"2024-09-12T19:19:38.190526+0000","last_became_active":"2024-09-12T17:29:54.760809+0000","last_became_peered":"2024-09-12T17:29:54.760809+0000","last_unstale":"2024-09-12T19:19:38.190526+0000","last_undegraded":"2024-09-12T19:19:38.190526+0000","last_fullsized":"2024-09-12T19:19:38.190526+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:31.018358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2369,"num_read_kb":2229,"num_write":528,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'332","reported_seq":1034,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.885305+0000","last_change":"2024-09-12T17:29:52.761032+0000","last_active":"2024-09-12T19:23:01.885305+0000","last_peered":"2024-09-12T19:23:01.885305+0000","last_clean":"2024-09-12T19:23:01.885305+0000","last_became_active":"2024-09-12T17:29:52.760432+0000","last_became_peered":"2024-09-12T17:29:52.760432+0000","last_unstale":"2024-09-12T19:23:01.885305+0000","last_undegraded":"2024-09-12T19:23:01.885305+0000","last_fullsized":"2024-09-12T19:23:01.885305+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:17.695625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":31499,"num_write":1138,"num_write_kb":37455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.973687+0000","last_change":"2024-09-12T17:29:56.766527+0000","last_active":"2024-09-12T19:19:37.973687+0000","last_peered":"2024-09-12T19:19:37.973687+0000","last_clean":"2024-09-12T19:19:37.973687+0000","last_became_active":"2024-09-12T17:29:56.765656+0000","last_became_peered":"2024-09-12T17:29:56.765656+0000","last_unstale":"2024-09-12T19:19:37.973687+0000","last_undegraded":"2024-09-12T19:19:37.973687+0000","last_fullsized":"2024-09-12T19:19:37.973687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:02.895743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'307","reported_seq":935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:03.285342+0000","last_change":"2024-09-12T17:29:58.778689+0000","last_active":"2024-09-12T19:22:03.285342+0000","last_peered":"2024-09-12T19:22:03.285342+0000","last_clean":"2024-09-12T19:22:03.285342+0000","last_became_active":"2024-09-12T17:29:58.777997+0000","last_became_peered":"2024-09-12T17:29:58.777997+0000","last_unstale":"2024-09-12T19:22:03.285342+0000","last_undegraded":"2024-09-12T19:22:03.285342+0000","last_fullsized":"2024-09-12T19:22:03.285342+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:11.474675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":480,"num_read_kb":893,"num_write":370,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:43.251258+0000","last_change":"2024-09-12T17:30:00.794010+0000","last_active":"2024-09-12T19:19:43.251258+0000","last_peered":"2024-09-12T19:19:43.251258+0000","last_clean":"2024-09-12T19:19:43.251258+0000","last_became_active":"2024-09-12T17:30:00.793204+0000","last_became_peered":"2024-09-12T17:30:00.793204+0000","last_unstale":"2024-09-12T19:19:43.251258+0000","last_undegraded":"2024-09-12T19:19:43.251258+0000","last_fullsized":"2024-09-12T19:19:43.251258+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:53.881334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'108","reported_seq":638,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.263789+0000","last_change":"2024-09-12T17:30:02.790200+0000","last_active":"2024-09-12T19:20:28.263789+0000","last_peered":"2024-09-12T19:20:28.263789+0000","last_clean":"2024-09-12T19:20:28.263789+0000","last_became_active":"2024-09-12T17:30:02.789511+0000","last_became_peered":"2024-09-12T17:30:02.789511+0000","last_unstale":"2024-09-12T19:20:28.263789+0000","last_undegraded":"2024-09-12T19:20:28.263789+0000","last_fullsized":"2024-09-12T19:20:28.263789+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:57.833180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":267,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'1080","reported_seq":2628,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.973714+0000","last_change":"2024-09-12T17:29:54.774595+0000","last_active":"2024-09-12T19:19:37.973714+0000","last_peered":"2024-09-12T19:19:37.973714+0000","last_clean":"2024-09-12T19:19:37.973714+0000","last_became_active":"2024-09-12T17:29:54.774337+0000","last_became_peered":"2024-09-12T17:29:54.774337+0000","last_unstale":"2024-09-12T19:19:37.973714+0000","last_undegraded":"2024-09-12T19:19:37.973714+0000","last_fullsized":"2024-09-12T19:19:37.973714+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":1000,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:59.476733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5006,"num_read_kb":4447,"num_write":1496,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'343","reported_seq":1038,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.907118+0000","last_change":"2024-09-12T17:29:52.763186+0000","last_active":"2024-09-12T19:23:01.907118+0000","last_peered":"2024-09-12T19:23:01.907118+0000","last_clean":"2024-09-12T19:23:01.907118+0000","last_became_active":"2024-09-12T17:29:52.757775+0000","last_became_peered":"2024-09-12T17:29:52.757775+0000","last_unstale":"2024-09-12T19:23:01.907118+0000","last_undegraded":"2024-09-12T19:23:01.907118+0000","last_fullsized":"2024-09-12T19:23:01.907118+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:36.685627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399166,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":510,"num_read_kb":111933,"num_write":1035,"num_write_kb":43950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.250268+0000","last_change":"2024-09-12T17:29:56.771395+0000","last_active":"2024-09-12T19:19:38.250268+0000","last_peered":"2024-09-12T19:19:38.250268+0000","last_clean":"2024-09-12T19:19:38.250268+0000","last_became_active":"2024-09-12T17:29:56.770639+0000","last_became_peered":"2024-09-12T17:29:56.770639+0000","last_unstale":"2024-09-12T19:19:38.250268+0000","last_undegraded":"2024-09-12T19:19:38.250268+0000","last_fullsized":"2024-09-12T19:19:38.250268+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:05.853569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'78","reported_seq":622,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:41.373097+0000","last_change":"2024-09-12T17:29:58.782766+0000","last_active":"2024-09-12T19:20:41.373097+0000","last_peered":"2024-09-12T19:20:41.373097+0000","last_clean":"2024-09-12T19:20:41.373097+0000","last_became_active":"2024-09-12T17:29:58.781731+0000","last_became_peered":"2024-09-12T17:29:58.781731+0000","last_unstale":"2024-09-12T19:20:41.373097+0000","last_undegraded":"2024-09-12T19:20:41.373097+0000","last_fullsized":"2024-09-12T19:20:41.373097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:49.979279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":73,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:42.963782+0000","last_change":"2024-09-12T17:30:00.801153+0000","last_active":"2024-09-12T19:19:42.963782+0000","last_peered":"2024-09-12T19:19:42.963782+0000","last_clean":"2024-09-12T19:19:42.963782+0000","last_became_active":"2024-09-12T17:30:00.799588+0000","last_became_peered":"2024-09-12T17:30:00.799588+0000","last_unstale":"2024-09-12T19:19:42.963782+0000","last_undegraded":"2024-09-12T19:19:42.963782+0000","last_fullsized":"2024-09-12T19:19:42.963782+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:18.930813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'191","reported_seq":733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.175915+0000","last_change":"2024-09-12T17:30:02.814008+0000","last_active":"2024-09-12T19:21:19.175915+0000","last_peered":"2024-09-12T19:21:19.175915+0000","last_clean":"2024-09-12T19:21:19.175915+0000","last_became_active":"2024-09-12T17:30:02.813284+0000","last_became_peered":"2024-09-12T17:30:02.813284+0000","last_unstale":"2024-09-12T19:21:19.175915+0000","last_undegraded":"2024-09-12T19:21:19.175915+0000","last_fullsized":"2024-09-12T19:21:19.175915+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:56.023655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":312,"num_read_kb":310,"num_write":442,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'824","reported_seq":2436,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:53.595775+0000","last_change":"2024-09-12T17:29:54.763134+0000","last_active":"2024-09-12T19:19:53.595775+0000","last_peered":"2024-09-12T19:19:53.595775+0000","last_clean":"2024-09-12T19:19:53.595775+0000","last_became_active":"2024-09-12T17:29:54.762793+0000","last_became_peered":"2024-09-12T17:29:54.762793+0000","last_unstale":"2024-09-12T19:19:53.595775+0000","last_undegraded":"2024-09-12T19:19:53.595775+0000","last_fullsized":"2024-09-12T19:19:53.595775+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:54.833462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3973,"num_read_kb":3581,"num_write":1093,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'282","reported_seq":905,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:00.877399+0000","last_change":"2024-09-12T17:30:21.692800+0000","last_active":"2024-09-12T19:20:00.877399+0000","last_peered":"2024-09-12T19:20:00.877399+0000","last_clean":"2024-09-12T19:20:00.877399+0000","last_became_active":"2024-09-12T17:30:21.692338+0000","last_became_peered":"2024-09-12T17:30:21.692338+0000","last_unstale":"2024-09-12T19:20:00.877399+0000","last_undegraded":"2024-09-12T19:20:00.877399+0000","last_fullsized":"2024-09-12T19:20:00.877399+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:01.217885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2256591,"num_objects":84,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":400,"num_read_kb":2104,"num_write":967,"num_write_kb":33078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.962529+0000","last_change":"2024-09-12T17:29:56.772976+0000","last_active":"2024-09-12T19:19:37.962529+0000","last_peered":"2024-09-12T19:19:37.962529+0000","last_clean":"2024-09-12T19:19:37.962529+0000","last_became_active":"2024-09-12T17:29:56.771923+0000","last_became_peered":"2024-09-12T17:29:56.771923+0000","last_unstale":"2024-09-12T19:19:37.962529+0000","last_undegraded":"2024-09-12T19:19:37.962529+0000","last_fullsized":"2024-09-12T19:19:37.962529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:15.080934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'348","reported_seq":992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:03.285412+0000","last_change":"2024-09-12T17:29:58.782391+0000","last_active":"2024-09-12T19:22:03.285412+0000","last_peered":"2024-09-12T19:22:03.285412+0000","last_clean":"2024-09-12T19:22:03.285412+0000","last_became_active":"2024-09-12T17:29:58.781756+0000","last_became_peered":"2024-09-12T17:29:58.781756+0000","last_unstale":"2024-09-12T19:22:03.285412+0000","last_undegraded":"2024-09-12T19:22:03.285412+0000","last_fullsized":"2024-09-12T19:22:03.285412+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:18.104306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49252,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":561,"num_read_kb":1017,"num_write":436,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:43.552916+0000","last_change":"2024-09-12T17:30:00.788793+0000","last_active":"2024-09-12T19:19:43.552916+0000","last_peered":"2024-09-12T19:19:43.552916+0000","last_clean":"2024-09-12T19:19:43.552916+0000","last_became_active":"2024-09-12T17:30:00.787872+0000","last_became_peered":"2024-09-12T17:30:00.787872+0000","last_unstale":"2024-09-12T19:19:43.552916+0000","last_undegraded":"2024-09-12T19:19:43.552916+0000","last_fullsized":"2024-09-12T19:19:43.552916+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:11.139793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'137","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.416574+0000","last_change":"2024-09-12T17:30:02.790977+0000","last_active":"2024-09-12T19:21:21.416574+0000","last_peered":"2024-09-12T19:21:21.416574+0000","last_clean":"2024-09-12T19:21:21.416574+0000","last_became_active":"2024-09-12T17:30:02.790246+0000","last_became_peered":"2024-09-12T17:30:02.790246+0000","last_unstale":"2024-09-12T19:21:21.416574+0000","last_undegraded":"2024-09-12T19:21:21.416574+0000","last_fullsized":"2024-09-12T19:21:21.416574+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:27.228227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":190,"num_write":334,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'494","reported_seq":2164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.899613+0000","last_change":"2024-09-12T17:30:22.256595+0000","last_active":"2024-09-12T19:21:55.899613+0000","last_peered":"2024-09-12T19:21:55.899613+0000","last_clean":"2024-09-12T19:21:55.899613+0000","last_became_active":"2024-09-12T17:30:22.255871+0000","last_became_peered":"2024-09-12T17:30:22.255871+0000","last_unstale":"2024-09-12T19:21:55.899613+0000","last_undegraded":"2024-09-12T19:21:55.899613+0000","last_fullsized":"2024-09-12T19:21:55.899613+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:37.746895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2849,"num_read_kb":2646,"num_write":616,"num_write_kb":185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'330","reported_seq":1071,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.958227+0000","last_change":"2024-09-12T17:29:52.726203+0000","last_active":"2024-09-12T19:23:01.958227+0000","last_peered":"2024-09-12T19:23:01.958227+0000","last_clean":"2024-09-12T19:23:01.958227+0000","last_became_active":"2024-09-12T17:29:52.725672+0000","last_became_peered":"2024-09-12T17:29:52.725672+0000","last_unstale":"2024-09-12T19:23:01.958227+0000","last_undegraded":"2024-09-12T19:23:01.958227+0000","last_fullsized":"2024-09-12T19:23:01.958227+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:14.245863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524466,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":607,"num_read_kb":120165,"num_write":1109,"num_write_kb":47030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.551750+0000","last_change":"2024-09-12T17:29:56.762247+0000","last_active":"2024-09-12T19:19:38.551750+0000","last_peered":"2024-09-12T19:19:38.551750+0000","last_clean":"2024-09-12T19:19:38.551750+0000","last_became_active":"2024-09-12T17:29:56.761442+0000","last_became_peered":"2024-09-12T17:29:56.761442+0000","last_unstale":"2024-09-12T19:19:38.551750+0000","last_undegraded":"2024-09-12T19:19:38.551750+0000","last_fullsized":"2024-09-12T19:19:38.551750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:29.298860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'324","reported_seq":935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.271936+0000","last_change":"2024-09-12T17:29:58.758717+0000","last_active":"2024-09-12T19:23:01.271936+0000","last_peered":"2024-09-12T19:23:01.271936+0000","last_clean":"2024-09-12T19:23:01.271936+0000","last_became_active":"2024-09-12T17:29:58.758050+0000","last_became_peered":"2024-09-12T17:29:58.758050+0000","last_unstale":"2024-09-12T19:23:01.271936+0000","last_undegraded":"2024-09-12T19:23:01.271936+0000","last_fullsized":"2024-09-12T19:23:01.271936+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:17.764686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47374,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":545,"num_read_kb":1211,"num_write":440,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:43.181010+0000","last_change":"2024-09-12T17:30:00.780831+0000","last_active":"2024-09-12T19:19:43.181010+0000","last_peered":"2024-09-12T19:19:43.181010+0000","last_clean":"2024-09-12T19:19:43.181010+0000","last_became_active":"2024-09-12T17:30:00.780216+0000","last_became_peered":"2024-09-12T17:30:00.780216+0000","last_unstale":"2024-09-12T19:19:43.181010+0000","last_undegraded":"2024-09-12T19:19:43.181010+0000","last_fullsized":"2024-09-12T19:19:43.181010+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:54.040743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'412","reported_seq":1851,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.561608+0000","last_change":"2024-09-12T17:29:54.777350+0000","last_active":"2024-09-12T19:20:23.561608+0000","last_peered":"2024-09-12T19:20:23.561608+0000","last_clean":"2024-09-12T19:20:23.561608+0000","last_became_active":"2024-09-12T17:29:54.776503+0000","last_became_peered":"2024-09-12T17:29:54.776503+0000","last_unstale":"2024-09-12T19:20:23.561608+0000","last_undegraded":"2024-09-12T19:20:23.561608+0000","last_fullsized":"2024-09-12T19:20:23.561608+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:48.613783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2157,"num_read_kb":2011,"num_write":494,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'283","reported_seq":985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:38.235299+0000","last_change":"2024-09-12T17:29:52.716790+0000","last_active":"2024-09-12T19:18:38.235299+0000","last_peered":"2024-09-12T19:18:38.235299+0000","last_clean":"2024-09-12T19:18:38.235299+0000","last_became_active":"2024-09-12T17:29:52.716376+0000","last_became_peered":"2024-09-12T17:29:52.716376+0000","last_unstale":"2024-09-12T19:18:38.235299+0000","last_undegraded":"2024-09-12T19:18:38.235299+0000","last_fullsized":"2024-09-12T19:18:38.235299+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:51.977058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7472771,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":513,"num_read_kb":2666,"num_write":1067,"num_write_kb":45238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:18.190273+0000","last_change":"2024-09-12T17:29:56.773917+0000","last_active":"2024-09-12T19:20:18.190273+0000","last_peered":"2024-09-12T19:20:18.190273+0000","last_clean":"2024-09-12T19:20:18.190273+0000","last_became_active":"2024-09-12T17:29:56.773239+0000","last_became_peered":"2024-09-12T17:29:56.773239+0000","last_unstale":"2024-09-12T19:20:18.190273+0000","last_undegraded":"2024-09-12T19:20:18.190273+0000","last_fullsized":"2024-09-12T19:20:18.190273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:02.813155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'553","reported_seq":1227,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.189986+0000","last_change":"2024-09-12T17:29:58.779631+0000","last_active":"2024-09-12T19:23:01.189986+0000","last_peered":"2024-09-12T19:23:01.189986+0000","last_clean":"2024-09-12T19:23:01.189986+0000","last_became_active":"2024-09-12T17:29:58.778931+0000","last_became_peered":"2024-09-12T17:29:58.778931+0000","last_unstale":"2024-09-12T19:23:01.189986+0000","last_undegraded":"2024-09-12T19:23:01.189986+0000","last_fullsized":"2024-09-12T19:23:01.189986+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:14.544244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":998,"num_read_kb":2327,"num_write":858,"num_write_kb":737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.986697+0000","last_change":"2024-09-12T17:30:00.802806+0000","last_active":"2024-09-12T19:20:02.986697+0000","last_peered":"2024-09-12T19:20:02.986697+0000","last_clean":"2024-09-12T19:20:02.986697+0000","last_became_active":"2024-09-12T17:30:00.802021+0000","last_became_peered":"2024-09-12T17:30:00.802021+0000","last_unstale":"2024-09-12T19:20:02.986697+0000","last_undegraded":"2024-09-12T19:20:02.986697+0000","last_fullsized":"2024-09-12T19:20:02.986697+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:49.504684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'167","reported_seq":710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:43.251407+0000","last_change":"2024-09-12T17:30:02.795603+0000","last_active":"2024-09-12T19:19:43.251407+0000","last_peered":"2024-09-12T19:19:43.251407+0000","last_clean":"2024-09-12T19:19:43.251407+0000","last_became_active":"2024-09-12T17:30:02.794353+0000","last_became_peered":"2024-09-12T17:30:02.794353+0000","last_unstale":"2024-09-12T19:19:43.251407+0000","last_undegraded":"2024-09-12T19:19:43.251407+0000","last_fullsized":"2024-09-12T19:19:43.251407+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:41.683296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":277,"num_read_kb":276,"num_write":376,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'723","reported_seq":2316,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.139310+0000","last_change":"2024-09-12T17:29:54.761432+0000","last_active":"2024-09-12T19:21:19.139310+0000","last_peered":"2024-09-12T19:21:19.139310+0000","last_clean":"2024-09-12T19:21:19.139310+0000","last_became_active":"2024-09-12T17:29:54.761144+0000","last_became_peered":"2024-09-12T17:29:54.761144+0000","last_unstale":"2024-09-12T19:21:19.139310+0000","last_undegraded":"2024-09-12T19:21:19.139310+0000","last_fullsized":"2024-09-12T19:21:19.139310+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":700,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:07.824094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3459,"num_read_kb":3076,"num_write":1006,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'309","reported_seq":927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.848731+0000","last_change":"2024-09-12T17:29:52.742141+0000","last_active":"2024-09-12T19:23:01.848731+0000","last_peered":"2024-09-12T19:23:01.848731+0000","last_clean":"2024-09-12T19:23:01.848731+0000","last_became_active":"2024-09-12T17:29:52.741594+0000","last_became_peered":"2024-09-12T17:29:52.741594+0000","last_unstale":"2024-09-12T19:23:01.848731+0000","last_undegraded":"2024-09-12T19:23:01.848731+0000","last_fullsized":"2024-09-12T19:23:01.848731+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:12.453167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262349,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":376,"num_read_kb":5602,"num_write":913,"num_write_kb":46297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.561587+0000","last_change":"2024-09-12T17:29:56.762091+0000","last_active":"2024-09-12T19:20:23.561587+0000","last_peered":"2024-09-12T19:20:23.561587+0000","last_clean":"2024-09-12T19:20:23.561587+0000","last_became_active":"2024-09-12T17:29:56.761256+0000","last_became_peered":"2024-09-12T17:29:56.761256+0000","last_unstale":"2024-09-12T19:20:23.561587+0000","last_undegraded":"2024-09-12T19:20:23.561587+0000","last_fullsized":"2024-09-12T19:20:23.561587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:38.052214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'389","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.339586+0000","last_change":"2024-09-12T17:29:58.769030+0000","last_active":"2024-09-12T19:23:01.339586+0000","last_peered":"2024-09-12T19:23:01.339586+0000","last_clean":"2024-09-12T19:23:01.339586+0000","last_became_active":"2024-09-12T17:29:58.768310+0000","last_became_peered":"2024-09-12T17:29:58.768310+0000","last_unstale":"2024-09-12T19:23:01.339586+0000","last_undegraded":"2024-09-12T19:23:01.339586+0000","last_fullsized":"2024-09-12T19:23:01.339586+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:31.668084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51217,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":641,"num_read_kb":1226,"num_write":524,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.979690+0000","last_change":"2024-09-12T17:30:00.805417+0000","last_active":"2024-09-12T19:20:02.979690+0000","last_peered":"2024-09-12T19:20:02.979690+0000","last_clean":"2024-09-12T19:20:02.979690+0000","last_became_active":"2024-09-12T17:30:00.804655+0000","last_became_peered":"2024-09-12T17:30:00.804655+0000","last_unstale":"2024-09-12T19:20:02.979690+0000","last_undegraded":"2024-09-12T19:20:02.979690+0000","last_fullsized":"2024-09-12T19:20:02.979690+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:59.390183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'189","reported_seq":1089,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.747208+0000","last_change":"2024-09-12T17:30:02.815235+0000","last_active":"2024-09-12T19:21:21.747208+0000","last_peered":"2024-09-12T19:21:21.747208+0000","last_clean":"2024-09-12T19:21:21.747208+0000","last_became_active":"2024-09-12T17:30:02.813027+0000","last_became_peered":"2024-09-12T17:30:02.813027+0000","last_unstale":"2024-09-12T19:21:21.747208+0000","last_undegraded":"2024-09-12T19:21:21.747208+0000","last_fullsized":"2024-09-12T19:21:21.747208+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:45.419844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2050,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":664,"num_read_kb":654,"num_write":538,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'390","reported_seq":1798,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.254923+0000","last_change":"2024-09-12T17:29:54.757128+0000","last_active":"2024-09-12T19:19:58.254923+0000","last_peered":"2024-09-12T19:19:58.254923+0000","last_clean":"2024-09-12T19:19:58.254923+0000","last_became_active":"2024-09-12T17:29:54.756800+0000","last_became_peered":"2024-09-12T17:29:54.756800+0000","last_unstale":"2024-09-12T19:19:58.254923+0000","last_undegraded":"2024-09-12T19:19:58.254923+0000","last_fullsized":"2024-09-12T19:19:58.254923+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:42.137004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1992,"num_read_kb":1877,"num_write":455,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'311","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.957551+0000","last_change":"2024-09-12T17:29:52.756252+0000","last_active":"2024-09-12T19:23:01.957551+0000","last_peered":"2024-09-12T19:23:01.957551+0000","last_clean":"2024-09-12T19:23:01.957551+0000","last_became_active":"2024-09-12T17:29:52.755401+0000","last_became_peered":"2024-09-12T17:29:52.755401+0000","last_unstale":"2024-09-12T19:23:01.957551+0000","last_undegraded":"2024-09-12T19:23:01.957551+0000","last_fullsized":"2024-09-12T19:23:01.957551+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:19.340127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2036176,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":3663,"num_write":1039,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.195101+0000","last_change":"2024-09-12T17:29:56.759557+0000","last_active":"2024-09-12T19:19:58.195101+0000","last_peered":"2024-09-12T19:19:58.195101+0000","last_clean":"2024-09-12T19:19:58.195101+0000","last_became_active":"2024-09-12T17:29:56.752172+0000","last_became_peered":"2024-09-12T17:29:56.752172+0000","last_unstale":"2024-09-12T19:19:58.195101+0000","last_undegraded":"2024-09-12T19:19:58.195101+0000","last_fullsized":"2024-09-12T19:19:58.195101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:01.184376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'325","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:33.291005+0000","last_change":"2024-09-12T17:29:58.832518+0000","last_active":"2024-09-12T19:22:33.291005+0000","last_peered":"2024-09-12T19:22:33.291005+0000","last_clean":"2024-09-12T19:22:33.291005+0000","last_became_active":"2024-09-12T17:29:58.831574+0000","last_became_peered":"2024-09-12T17:29:58.831574+0000","last_unstale":"2024-09-12T19:22:33.291005+0000","last_undegraded":"2024-09-12T19:22:33.291005+0000","last_fullsized":"2024-09-12T19:22:33.291005+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:45.202085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53455,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":517,"num_read_kb":965,"num_write":408,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:32.986123+0000","last_change":"2024-09-12T17:30:00.805560+0000","last_active":"2024-09-12T19:20:32.986123+0000","last_peered":"2024-09-12T19:20:32.986123+0000","last_clean":"2024-09-12T19:20:32.986123+0000","last_became_active":"2024-09-12T17:30:00.804705+0000","last_became_peered":"2024-09-12T17:30:00.804705+0000","last_unstale":"2024-09-12T19:20:32.986123+0000","last_undegraded":"2024-09-12T19:20:32.986123+0000","last_fullsized":"2024-09-12T19:20:32.986123+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:30.654520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'113","reported_seq":624,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.252350+0000","last_change":"2024-09-12T17:30:02.787761+0000","last_active":"2024-09-12T19:22:46.252350+0000","last_peered":"2024-09-12T19:22:46.252350+0000","last_clean":"2024-09-12T19:22:46.252350+0000","last_became_active":"2024-09-12T17:30:02.787038+0000","last_became_peered":"2024-09-12T17:30:02.787038+0000","last_unstale":"2024-09-12T19:22:46.252350+0000","last_undegraded":"2024-09-12T19:22:46.252350+0000","last_fullsized":"2024-09-12T19:22:46.252350+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:46.467512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":121,"num_write":252,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'360","reported_seq":1890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.436578+0000","last_change":"2024-09-12T17:29:54.742127+0000","last_active":"2024-09-12T19:21:21.436578+0000","last_peered":"2024-09-12T19:21:21.436578+0000","last_clean":"2024-09-12T19:21:21.436578+0000","last_became_active":"2024-09-12T17:29:54.741486+0000","last_became_peered":"2024-09-12T17:29:54.741486+0000","last_unstale":"2024-09-12T19:21:21.436578+0000","last_undegraded":"2024-09-12T19:21:21.436578+0000","last_fullsized":"2024-09-12T19:21:21.436578+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:16.184632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1958,"num_read_kb":1901,"num_write":388,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'318","reported_seq":1029,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.832928+0000","last_change":"2024-09-12T17:29:52.767395+0000","last_active":"2024-09-12T19:23:01.832928+0000","last_peered":"2024-09-12T19:23:01.832928+0000","last_clean":"2024-09-12T19:23:01.832928+0000","last_became_active":"2024-09-12T17:29:52.766141+0000","last_became_peered":"2024-09-12T17:29:52.766141+0000","last_unstale":"2024-09-12T19:23:01.832928+0000","last_undegraded":"2024-09-12T19:23:01.832928+0000","last_fullsized":"2024-09-12T19:23:01.832928+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:32.771937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7320708,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":562,"num_read_kb":101880,"num_write":1008,"num_write_kb":18651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"38'5","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.837339+0000","last_change":"2024-09-12T17:29:56.761300+0000","last_active":"2024-09-12T19:22:58.837339+0000","last_peered":"2024-09-12T19:22:58.837339+0000","last_clean":"2024-09-12T19:22:58.837339+0000","last_became_active":"2024-09-12T17:29:56.760505+0000","last_became_peered":"2024-09-12T17:29:56.760505+0000","last_unstale":"2024-09-12T19:22:58.837339+0000","last_undegraded":"2024-09-12T19:22:58.837339+0000","last_fullsized":"2024-09-12T19:22:58.837339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:19.918382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'170","reported_seq":762,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:53.697797+0000","last_change":"2024-09-12T17:29:58.830103+0000","last_active":"2024-09-12T19:20:53.697797+0000","last_peered":"2024-09-12T19:20:53.697797+0000","last_clean":"2024-09-12T19:20:53.697797+0000","last_became_active":"2024-09-12T17:29:58.829023+0000","last_became_peered":"2024-09-12T17:29:58.829023+0000","last_unstale":"2024-09-12T19:20:53.697797+0000","last_undegraded":"2024-09-12T19:20:53.697797+0000","last_fullsized":"2024-09-12T19:20:53.697797+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:27.778582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":218,"num_write":206,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'770","reported_seq":3287,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.282972+0000","last_change":"2024-09-12T17:30:00.787430+0000","last_active":"2024-09-12T19:22:46.282972+0000","last_peered":"2024-09-12T19:22:46.282972+0000","last_clean":"2024-09-12T19:22:46.282972+0000","last_became_active":"2024-09-12T17:30:00.786102+0000","last_became_peered":"2024-09-12T17:30:00.786102+0000","last_unstale":"2024-09-12T19:22:46.282972+0000","last_undegraded":"2024-09-12T19:22:46.282972+0000","last_fullsized":"2024-09-12T19:22:46.282972+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:58.157521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'148","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.288957+0000","last_change":"2024-09-12T17:30:02.804619+0000","last_active":"2024-09-12T19:21:19.288957+0000","last_peered":"2024-09-12T19:21:19.288957+0000","last_clean":"2024-09-12T19:21:19.288957+0000","last_became_active":"2024-09-12T17:30:02.803612+0000","last_became_peered":"2024-09-12T17:30:02.803612+0000","last_unstale":"2024-09-12T19:21:19.288957+0000","last_undegraded":"2024-09-12T19:21:19.288957+0000","last_fullsized":"2024-09-12T19:21:19.288957+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:34.332012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":232,"num_read_kb":219,"num_write":373,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'827","reported_seq":2550,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.933874+0000","last_change":"2024-09-12T17:30:21.699087+0000","last_active":"2024-09-12T19:20:27.933874+0000","last_peered":"2024-09-12T19:20:27.933874+0000","last_clean":"2024-09-12T19:20:27.933874+0000","last_became_active":"2024-09-12T17:30:21.696952+0000","last_became_peered":"2024-09-12T17:30:21.696952+0000","last_unstale":"2024-09-12T19:20:27.933874+0000","last_undegraded":"2024-09-12T19:20:27.933874+0000","last_fullsized":"2024-09-12T19:20:27.933874+0000","mapping_epoch":39,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:48.294079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3950,"num_read_kb":3589,"num_write":1060,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'353","reported_seq":1072,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.976090+0000","last_change":"2024-09-12T17:29:52.753703+0000","last_active":"2024-09-12T19:23:01.976090+0000","last_peered":"2024-09-12T19:23:01.976090+0000","last_clean":"2024-09-12T19:23:01.976090+0000","last_became_active":"2024-09-12T17:29:52.749735+0000","last_became_peered":"2024-09-12T17:29:52.749735+0000","last_unstale":"2024-09-12T19:23:01.976090+0000","last_undegraded":"2024-09-12T19:23:01.976090+0000","last_fullsized":"2024-09-12T19:23:01.976090+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:40.802637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437125,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":46392,"num_write":1072,"num_write_kb":51525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.967526+0000","last_change":"2024-09-12T17:29:56.766629+0000","last_active":"2024-09-12T19:19:57.967526+0000","last_peered":"2024-09-12T19:19:57.967526+0000","last_clean":"2024-09-12T19:19:57.967526+0000","last_became_active":"2024-09-12T17:29:56.765909+0000","last_became_peered":"2024-09-12T17:29:56.765909+0000","last_unstale":"2024-09-12T19:19:57.967526+0000","last_undegraded":"2024-09-12T19:19:57.967526+0000","last_fullsized":"2024-09-12T19:19:57.967526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:16.737963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'386","reported_seq":1032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.586459+0000","last_change":"2024-09-12T17:29:58.772348+0000","last_active":"2024-09-12T19:23:00.586459+0000","last_peered":"2024-09-12T19:23:00.586459+0000","last_clean":"2024-09-12T19:23:00.586459+0000","last_became_active":"2024-09-12T17:29:58.771522+0000","last_became_peered":"2024-09-12T17:29:58.771522+0000","last_unstale":"2024-09-12T19:23:00.586459+0000","last_undegraded":"2024-09-12T19:23:00.586459+0000","last_fullsized":"2024-09-12T19:23:00.586459+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:37.869319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46902,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":612,"num_read_kb":1188,"num_write":476,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:48.165589+0000","last_change":"2024-09-12T17:30:00.789334+0000","last_active":"2024-09-12T19:18:48.165589+0000","last_peered":"2024-09-12T19:18:48.165589+0000","last_clean":"2024-09-12T19:18:48.165589+0000","last_became_active":"2024-09-12T17:30:00.788559+0000","last_became_peered":"2024-09-12T17:30:00.788559+0000","last_unstale":"2024-09-12T19:18:48.165589+0000","last_undegraded":"2024-09-12T19:18:48.165589+0000","last_fullsized":"2024-09-12T19:18:48.165589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:23.307242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'116","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:12.986237+0000","last_change":"2024-09-12T17:30:02.807855+0000","last_active":"2024-09-12T19:21:12.986237+0000","last_peered":"2024-09-12T19:21:12.986237+0000","last_clean":"2024-09-12T19:21:12.986237+0000","last_became_active":"2024-09-12T17:30:02.807083+0000","last_became_peered":"2024-09-12T17:30:02.807083+0000","last_unstale":"2024-09-12T19:21:12.986237+0000","last_undegraded":"2024-09-12T19:21:12.986237+0000","last_fullsized":"2024-09-12T19:21:12.986237+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:51.993531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":147,"num_write":283,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'825","reported_seq":2498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.437648+0000","last_change":"2024-09-12T17:29:54.774040+0000","last_active":"2024-09-12T19:21:21.437648+0000","last_peered":"2024-09-12T19:21:21.437648+0000","last_clean":"2024-09-12T19:21:21.437648+0000","last_became_active":"2024-09-12T17:29:54.770569+0000","last_became_peered":"2024-09-12T17:29:54.770569+0000","last_unstale":"2024-09-12T19:21:21.437648+0000","last_undegraded":"2024-09-12T19:21:21.437648+0000","last_fullsized":"2024-09-12T19:21:21.437648+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:01.250678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4029,"num_read_kb":3656,"num_write":1088,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'392","reported_seq":1299,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.975417+0000","last_change":"2024-09-12T17:29:52.750235+0000","last_active":"2024-09-12T19:23:01.975417+0000","last_peered":"2024-09-12T19:23:01.975417+0000","last_clean":"2024-09-12T19:23:01.975417+0000","last_became_active":"2024-09-12T17:29:52.749566+0000","last_became_peered":"2024-09-12T17:29:52.749566+0000","last_unstale":"2024-09-12T19:23:01.975417+0000","last_undegraded":"2024-09-12T19:23:01.975417+0000","last_fullsized":"2024-09-12T19:23:01.975417+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:16.632102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174738,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1171,"num_read_kb":8659,"num_write":1266,"num_write_kb":49806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.985406+0000","last_change":"2024-09-12T17:29:56.768011+0000","last_active":"2024-09-12T19:19:57.985406+0000","last_peered":"2024-09-12T19:19:57.985406+0000","last_clean":"2024-09-12T19:19:57.985406+0000","last_became_active":"2024-09-12T17:29:56.766952+0000","last_became_peered":"2024-09-12T17:29:56.766952+0000","last_unstale":"2024-09-12T19:19:57.985406+0000","last_undegraded":"2024-09-12T19:19:57.985406+0000","last_fullsized":"2024-09-12T19:19:57.985406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:54.137260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'322","reported_seq":938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.669796+0000","last_change":"2024-09-12T17:29:58.783690+0000","last_active":"2024-09-12T19:23:00.669796+0000","last_peered":"2024-09-12T19:23:00.669796+0000","last_clean":"2024-09-12T19:23:00.669796+0000","last_became_active":"2024-09-12T17:29:58.783105+0000","last_became_peered":"2024-09-12T17:29:58.783105+0000","last_unstale":"2024-09-12T19:23:00.669796+0000","last_undegraded":"2024-09-12T19:23:00.669796+0000","last_fullsized":"2024-09-12T19:23:00.669796+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:02.161325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50641,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":544,"num_read_kb":1206,"num_write":440,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.544277+0000","last_change":"2024-09-12T17:30:00.800799+0000","last_active":"2024-09-12T19:19:03.544277+0000","last_peered":"2024-09-12T19:19:03.544277+0000","last_clean":"2024-09-12T19:19:03.544277+0000","last_became_active":"2024-09-12T17:30:00.799680+0000","last_became_peered":"2024-09-12T17:30:00.799680+0000","last_unstale":"2024-09-12T19:19:03.544277+0000","last_undegraded":"2024-09-12T19:19:03.544277+0000","last_fullsized":"2024-09-12T19:19:03.544277+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:13.337531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'130","reported_seq":684,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:48.237923+0000","last_change":"2024-09-12T17:30:02.787080+0000","last_active":"2024-09-12T19:18:48.237923+0000","last_peered":"2024-09-12T19:18:48.237923+0000","last_clean":"2024-09-12T19:18:48.237923+0000","last_became_active":"2024-09-12T17:30:02.786478+0000","last_became_peered":"2024-09-12T17:30:02.786478+0000","last_unstale":"2024-09-12T19:18:48.237923+0000","last_undegraded":"2024-09-12T19:18:48.237923+0000","last_fullsized":"2024-09-12T19:18:48.237923+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:32.030701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":240,"num_read_kb":229,"num_write":300,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'976","reported_seq":2759,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.994489+0000","last_change":"2024-09-12T17:29:54.762247+0000","last_active":"2024-09-12T19:22:44.994489+0000","last_peered":"2024-09-12T19:22:44.994489+0000","last_clean":"2024-09-12T19:22:44.994489+0000","last_became_active":"2024-09-12T17:29:54.761902+0000","last_became_peered":"2024-09-12T17:29:54.761902+0000","last_unstale":"2024-09-12T19:22:44.994489+0000","last_undegraded":"2024-09-12T19:22:44.994489+0000","last_fullsized":"2024-09-12T19:22:44.994489+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":900,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:57.000138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4608,"num_read_kb":4133,"num_write":1300,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'269","reported_seq":926,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:18.261132+0000","last_change":"2024-09-12T17:29:52.733633+0000","last_active":"2024-09-12T19:20:18.261132+0000","last_peered":"2024-09-12T19:20:18.261132+0000","last_clean":"2024-09-12T19:20:18.261132+0000","last_became_active":"2024-09-12T17:29:52.733119+0000","last_became_peered":"2024-09-12T17:29:52.733119+0000","last_unstale":"2024-09-12T19:20:18.261132+0000","last_undegraded":"2024-09-12T19:20:18.261132+0000","last_fullsized":"2024-09-12T19:20:18.261132+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:07.270536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5297874,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":406,"num_read_kb":1565,"num_write":1091,"num_write_kb":34702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.177481+0000","last_change":"2024-09-12T17:29:56.761445+0000","last_active":"2024-09-12T19:18:43.177481+0000","last_peered":"2024-09-12T19:18:43.177481+0000","last_clean":"2024-09-12T19:18:43.177481+0000","last_became_active":"2024-09-12T17:29:56.760142+0000","last_became_peered":"2024-09-12T17:29:56.760142+0000","last_unstale":"2024-09-12T19:18:43.177481+0000","last_undegraded":"2024-09-12T19:18:43.177481+0000","last_fullsized":"2024-09-12T19:18:43.177481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:58.137646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'269","reported_seq":858,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:33.290820+0000","last_change":"2024-09-12T17:29:58.775954+0000","last_active":"2024-09-12T19:22:33.290820+0000","last_peered":"2024-09-12T19:22:33.290820+0000","last_clean":"2024-09-12T19:22:33.290820+0000","last_became_active":"2024-09-12T17:29:58.775284+0000","last_became_peered":"2024-09-12T17:29:58.775284+0000","last_unstale":"2024-09-12T19:22:33.290820+0000","last_undegraded":"2024-09-12T19:22:33.290820+0000","last_fullsized":"2024-09-12T19:22:33.290820+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:04.232747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47771,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":415,"num_read_kb":848,"num_write":348,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.196243+0000","last_change":"2024-09-12T17:30:00.791617+0000","last_active":"2024-09-12T19:20:03.196243+0000","last_peered":"2024-09-12T19:20:03.196243+0000","last_clean":"2024-09-12T19:20:03.196243+0000","last_became_active":"2024-09-12T17:30:00.790907+0000","last_became_peered":"2024-09-12T17:30:00.790907+0000","last_unstale":"2024-09-12T19:20:03.196243+0000","last_undegraded":"2024-09-12T19:20:03.196243+0000","last_fullsized":"2024-09-12T19:20:03.196243+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:40.769544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'156","reported_seq":1270,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:13.192105+0000","last_change":"2024-09-12T17:30:02.813564+0000","last_active":"2024-09-12T19:21:13.192105+0000","last_peered":"2024-09-12T19:21:13.192105+0000","last_clean":"2024-09-12T19:21:13.192105+0000","last_became_active":"2024-09-12T17:30:02.812918+0000","last_became_peered":"2024-09-12T17:30:02.812918+0000","last_unstale":"2024-09-12T19:21:13.192105+0000","last_undegraded":"2024-09-12T19:21:13.192105+0000","last_fullsized":"2024-09-12T19:21:13.192105+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:30.419361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":804,"num_write":370,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'756","reported_seq":2286,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.177531+0000","last_change":"2024-09-12T17:29:54.768778+0000","last_active":"2024-09-12T19:18:43.177531+0000","last_peered":"2024-09-12T19:18:43.177531+0000","last_clean":"2024-09-12T19:18:43.177531+0000","last_became_active":"2024-09-12T17:29:54.767573+0000","last_became_peered":"2024-09-12T17:29:54.767573+0000","last_unstale":"2024-09-12T19:18:43.177531+0000","last_undegraded":"2024-09-12T19:18:43.177531+0000","last_fullsized":"2024-09-12T19:18:43.177531+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:31.066680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3552,"num_read_kb":3227,"num_write":976,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'365","reported_seq":1226,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.832859+0000","last_change":"2024-09-12T17:29:52.766538+0000","last_active":"2024-09-12T19:23:01.832859+0000","last_peered":"2024-09-12T19:23:01.832859+0000","last_clean":"2024-09-12T19:23:01.832859+0000","last_became_active":"2024-09-12T17:29:52.765692+0000","last_became_peered":"2024-09-12T17:29:52.765692+0000","last_unstale":"2024-09-12T19:23:01.832859+0000","last_undegraded":"2024-09-12T19:23:01.832859+0000","last_fullsized":"2024-09-12T19:23:01.832859+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:37.762190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110874,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":771,"num_read_kb":82698,"num_write":1110,"num_write_kb":56258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:12.968197+0000","last_change":"2024-09-12T17:29:56.761088+0000","last_active":"2024-09-12T19:19:12.968197+0000","last_peered":"2024-09-12T19:19:12.968197+0000","last_clean":"2024-09-12T19:19:12.968197+0000","last_became_active":"2024-09-12T17:29:56.760345+0000","last_became_peered":"2024-09-12T17:29:56.760345+0000","last_unstale":"2024-09-12T19:19:12.968197+0000","last_undegraded":"2024-09-12T19:19:12.968197+0000","last_fullsized":"2024-09-12T19:19:12.968197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:02.802366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'344","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.856112+0000","last_change":"2024-09-12T17:29:58.769661+0000","last_active":"2024-09-12T19:22:59.856112+0000","last_peered":"2024-09-12T19:22:59.856112+0000","last_clean":"2024-09-12T19:22:59.856112+0000","last_became_active":"2024-09-12T17:29:58.768812+0000","last_became_peered":"2024-09-12T17:29:58.768812+0000","last_unstale":"2024-09-12T19:22:59.856112+0000","last_undegraded":"2024-09-12T19:22:59.856112+0000","last_fullsized":"2024-09-12T19:22:59.856112+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:55.549725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46003,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1072,"num_write":420,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.185932+0000","last_change":"2024-09-12T17:30:00.786938+0000","last_active":"2024-09-12T19:20:03.185932+0000","last_peered":"2024-09-12T19:20:03.185932+0000","last_clean":"2024-09-12T19:20:03.185932+0000","last_became_active":"2024-09-12T17:30:00.786100+0000","last_became_peered":"2024-09-12T17:30:00.786100+0000","last_unstale":"2024-09-12T19:20:03.185932+0000","last_undegraded":"2024-09-12T19:20:03.185932+0000","last_fullsized":"2024-09-12T19:20:03.185932+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:07.158524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'138","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.989412+0000","last_change":"2024-09-12T17:30:02.808784+0000","last_active":"2024-09-12T19:22:44.989412+0000","last_peered":"2024-09-12T19:22:44.989412+0000","last_clean":"2024-09-12T19:22:44.989412+0000","last_became_active":"2024-09-12T17:30:02.807953+0000","last_became_peered":"2024-09-12T17:30:02.807953+0000","last_unstale":"2024-09-12T19:22:44.989412+0000","last_undegraded":"2024-09-12T19:22:44.989412+0000","last_fullsized":"2024-09-12T19:22:44.989412+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:19.588574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216,"num_read_kb":199,"num_write":346,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'852","reported_seq":2464,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.442108+0000","last_change":"2024-09-12T17:29:54.768750+0000","last_active":"2024-09-12T19:21:21.442108+0000","last_peered":"2024-09-12T19:21:21.442108+0000","last_clean":"2024-09-12T19:21:21.442108+0000","last_became_active":"2024-09-12T17:29:54.768439+0000","last_became_peered":"2024-09-12T17:29:54.768439+0000","last_unstale":"2024-09-12T19:21:21.442108+0000","last_undegraded":"2024-09-12T19:21:21.442108+0000","last_fullsized":"2024-09-12T19:21:21.442108+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:29.593777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3940,"num_read_kb":3539,"num_write":1104,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'323","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:18.560246+0000","last_change":"2024-09-12T17:29:52.738990+0000","last_active":"2024-09-12T19:20:18.560246+0000","last_peered":"2024-09-12T19:20:18.560246+0000","last_clean":"2024-09-12T19:20:18.560246+0000","last_became_active":"2024-09-12T17:29:52.732894+0000","last_became_peered":"2024-09-12T17:29:52.732894+0000","last_unstale":"2024-09-12T19:20:18.560246+0000","last_undegraded":"2024-09-12T19:20:18.560246+0000","last_fullsized":"2024-09-12T19:20:18.560246+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:05.898096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10511198,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":522,"num_read_kb":27715,"num_write":1217,"num_write_kb":46649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'495","reported_seq":1986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.006107+0000","last_change":"2024-09-12T17:29:54.747526+0000","last_active":"2024-09-12T19:22:45.006107+0000","last_peered":"2024-09-12T19:22:45.006107+0000","last_clean":"2024-09-12T19:22:45.006107+0000","last_became_active":"2024-09-12T17:29:54.745192+0000","last_became_peered":"2024-09-12T17:29:54.745192+0000","last_unstale":"2024-09-12T19:22:45.006107+0000","last_undegraded":"2024-09-12T19:22:45.006107+0000","last_fullsized":"2024-09-12T19:22:45.006107+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:53.534036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2446,"num_read_kb":2266,"num_write":619,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'340","reported_seq":1074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:43.825981+0000","last_change":"2024-09-12T17:29:52.728474+0000","last_active":"2024-09-12T19:22:43.825981+0000","last_peered":"2024-09-12T19:22:43.825981+0000","last_clean":"2024-09-12T19:22:43.825981+0000","last_became_active":"2024-09-12T17:29:52.727433+0000","last_became_peered":"2024-09-12T17:29:52.727433+0000","last_unstale":"2024-09-12T19:22:43.825981+0000","last_undegraded":"2024-09-12T19:22:43.825981+0000","last_fullsized":"2024-09-12T19:22:43.825981+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:45.539010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11557877,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":623,"num_read_kb":95087,"num_write":1222,"num_write_kb":35037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'393","reported_seq":1964,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.992422+0000","last_change":"2024-09-12T17:29:54.764069+0000","last_active":"2024-09-12T19:20:27.992422+0000","last_peered":"2024-09-12T19:20:27.992422+0000","last_clean":"2024-09-12T19:20:27.992422+0000","last_became_active":"2024-09-12T17:29:54.762400+0000","last_became_peered":"2024-09-12T17:29:54.762400+0000","last_unstale":"2024-09-12T19:20:27.992422+0000","last_undegraded":"2024-09-12T19:20:27.992422+0000","last_fullsized":"2024-09-12T19:20:27.992422+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:34.051350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2164,"num_read_kb":2073,"num_write":429,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'404","reported_seq":1120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.969671+0000","last_change":"2024-09-12T17:29:52.761477+0000","last_active":"2024-09-12T19:23:01.969671+0000","last_peered":"2024-09-12T19:23:01.969671+0000","last_clean":"2024-09-12T19:23:01.969671+0000","last_became_active":"2024-09-12T17:29:52.756626+0000","last_became_peered":"2024-09-12T17:29:52.756626+0000","last_unstale":"2024-09-12T19:23:01.969671+0000","last_undegraded":"2024-09-12T19:23:01.969671+0000","last_fullsized":"2024-09-12T19:23:01.969671+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:06.453259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":688,"num_read_kb":25414,"num_write":1427,"num_write_kb":18603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'782","reported_seq":2452,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.140613+0000","last_change":"2024-09-12T17:29:54.749594+0000","last_active":"2024-09-12T19:21:19.140613+0000","last_peered":"2024-09-12T19:21:19.140613+0000","last_clean":"2024-09-12T19:21:19.140613+0000","last_became_active":"2024-09-12T17:29:54.749249+0000","last_became_peered":"2024-09-12T17:29:54.749249+0000","last_unstale":"2024-09-12T19:21:19.140613+0000","last_undegraded":"2024-09-12T19:21:19.140613+0000","last_fullsized":"2024-09-12T19:21:19.140613+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:55.915159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3916,"num_read_kb":3572,"num_write":1026,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'306","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.958263+0000","last_change":"2024-09-12T17:29:52.767576+0000","last_active":"2024-09-12T19:23:01.958263+0000","last_peered":"2024-09-12T19:23:01.958263+0000","last_clean":"2024-09-12T19:23:01.958263+0000","last_became_active":"2024-09-12T17:29:52.767047+0000","last_became_peered":"2024-09-12T17:29:52.767047+0000","last_unstale":"2024-09-12T19:23:01.958263+0000","last_undegraded":"2024-09-12T19:23:01.958263+0000","last_fullsized":"2024-09-12T19:23:01.958263+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:01.748288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900516,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":422,"num_read_kb":21273,"num_write":1050,"num_write_kb":35522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'491","reported_seq":2152,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:48.268636+0000","last_change":"2024-09-12T17:29:54.763106+0000","last_active":"2024-09-12T19:20:48.268636+0000","last_peered":"2024-09-12T19:20:48.268636+0000","last_clean":"2024-09-12T19:20:48.268636+0000","last_became_active":"2024-09-12T17:29:54.762667+0000","last_became_peered":"2024-09-12T17:29:54.762667+0000","last_unstale":"2024-09-12T19:20:48.268636+0000","last_undegraded":"2024-09-12T19:20:48.268636+0000","last_fullsized":"2024-09-12T19:20:48.268636+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:57.057096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2506,"num_read_kb":2365,"num_write":559,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'282","reported_seq":962,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262415+0000","last_change":"2024-09-12T17:29:52.768451+0000","last_active":"2024-09-12T19:20:23.262415+0000","last_peered":"2024-09-12T19:20:23.262415+0000","last_clean":"2024-09-12T19:20:23.262415+0000","last_became_active":"2024-09-12T17:29:52.765692+0000","last_became_peered":"2024-09-12T17:29:52.765692+0000","last_unstale":"2024-09-12T19:20:23.262415+0000","last_undegraded":"2024-09-12T19:20:23.262415+0000","last_fullsized":"2024-09-12T19:20:23.262415+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:48.428826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13902119,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":465,"num_read_kb":21751,"num_write":939,"num_write_kb":25522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'959","reported_seq":2733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.201114+0000","last_change":"2024-09-12T17:29:54.770999+0000","last_active":"2024-09-12T19:20:23.201114+0000","last_peered":"2024-09-12T19:20:23.201114+0000","last_clean":"2024-09-12T19:20:23.201114+0000","last_became_active":"2024-09-12T17:29:54.769223+0000","last_became_peered":"2024-09-12T17:29:54.769223+0000","last_unstale":"2024-09-12T19:20:23.201114+0000","last_undegraded":"2024-09-12T19:20:23.201114+0000","last_fullsized":"2024-09-12T19:20:23.201114+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":900,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:48.896632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4532,"num_read_kb":4067,"num_write":1265,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'312","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.905057+0000","last_change":"2024-09-12T17:29:52.729350+0000","last_active":"2024-09-12T19:23:01.905057+0000","last_peered":"2024-09-12T19:23:01.905057+0000","last_clean":"2024-09-12T19:23:01.905057+0000","last_became_active":"2024-09-12T17:29:52.728523+0000","last_became_peered":"2024-09-12T17:29:52.728523+0000","last_unstale":"2024-09-12T19:23:01.905057+0000","last_undegraded":"2024-09-12T19:23:01.905057+0000","last_fullsized":"2024-09-12T19:23:01.905057+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:38.562226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":2514,"num_write":1024,"num_write_kb":45573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'964","reported_seq":2656,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.899595+0000","last_change":"2024-09-12T17:29:54.759369+0000","last_active":"2024-09-12T19:21:55.899595+0000","last_peered":"2024-09-12T19:21:55.899595+0000","last_clean":"2024-09-12T19:21:55.899595+0000","last_became_active":"2024-09-12T17:29:54.758687+0000","last_became_peered":"2024-09-12T17:29:54.758687+0000","last_unstale":"2024-09-12T19:21:55.899595+0000","last_undegraded":"2024-09-12T19:21:55.899595+0000","last_fullsized":"2024-09-12T19:21:55.899595+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":900,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:12.470932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4571,"num_read_kb":4077,"num_write":1316,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'281","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.561556+0000","last_change":"2024-09-12T17:29:52.719880+0000","last_active":"2024-09-12T19:20:23.561556+0000","last_peered":"2024-09-12T19:20:23.561556+0000","last_clean":"2024-09-12T19:20:23.561556+0000","last_became_active":"2024-09-12T17:29:52.718689+0000","last_became_peered":"2024-09-12T17:29:52.718689+0000","last_unstale":"2024-09-12T19:20:23.561556+0000","last_undegraded":"2024-09-12T19:20:23.561556+0000","last_fullsized":"2024-09-12T19:20:23.561556+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:01.173987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10242962,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":448,"num_read_kb":13386,"num_write":1024,"num_write_kb":27082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'1290","reported_seq":2901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.561396+0000","last_change":"2024-09-12T17:29:54.765637+0000","last_active":"2024-09-12T19:20:23.561396+0000","last_peered":"2024-09-12T19:20:23.561396+0000","last_clean":"2024-09-12T19:20:23.561396+0000","last_became_active":"2024-09-12T17:29:54.764876+0000","last_became_peered":"2024-09-12T17:29:54.764876+0000","last_unstale":"2024-09-12T19:20:23.561396+0000","last_undegraded":"2024-09-12T19:20:23.561396+0000","last_fullsized":"2024-09-12T19:20:23.561396+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":1200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:13.358482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5917,"num_read_kb":5200,"num_write":1797,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'324","reported_seq":999,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262560+0000","last_change":"2024-09-12T17:29:52.769653+0000","last_active":"2024-09-12T19:20:23.262560+0000","last_peered":"2024-09-12T19:20:23.262560+0000","last_clean":"2024-09-12T19:20:23.262560+0000","last_became_active":"2024-09-12T17:29:52.769086+0000","last_became_peered":"2024-09-12T17:29:52.769086+0000","last_unstale":"2024-09-12T19:20:23.262560+0000","last_undegraded":"2024-09-12T19:20:23.262560+0000","last_fullsized":"2024-09-12T19:20:23.262560+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:03.761062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12345675,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":479,"num_read_kb":7690,"num_write":1160,"num_write_kb":36052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"267'894","reported_seq":2482,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.901241+0000","last_change":"2024-09-12T17:29:54.760165+0000","last_active":"2024-09-12T19:21:55.901241+0000","last_peered":"2024-09-12T19:21:55.901241+0000","last_clean":"2024-09-12T19:21:55.901241+0000","last_became_active":"2024-09-12T17:29:54.759892+0000","last_became_peered":"2024-09-12T17:29:54.759892+0000","last_unstale":"2024-09-12T19:21:55.901241+0000","last_undegraded":"2024-09-12T19:21:55.901241+0000","last_fullsized":"2024-09-12T19:21:55.901241+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":800,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:50.901074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4227,"num_read_kb":3797,"num_write":1212,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'326","reported_seq":966,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.964273+0000","last_change":"2024-09-12T17:29:52.750118+0000","last_active":"2024-09-12T19:23:01.964273+0000","last_peered":"2024-09-12T19:23:01.964273+0000","last_clean":"2024-09-12T19:23:01.964273+0000","last_became_active":"2024-09-12T17:29:52.748790+0000","last_became_peered":"2024-09-12T17:29:52.748790+0000","last_unstale":"2024-09-12T19:23:01.964273+0000","last_undegraded":"2024-09-12T19:23:01.964273+0000","last_fullsized":"2024-09-12T19:23:01.964273+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:59.925499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":434,"num_read_kb":14399,"num_write":1080,"num_write_kb":30402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'1651","reported_seq":3218,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.025784+0000","last_change":"2024-09-12T17:29:54.755458+0000","last_active":"2024-09-12T19:22:45.025784+0000","last_peered":"2024-09-12T19:22:45.025784+0000","last_clean":"2024-09-12T19:22:45.025784+0000","last_became_active":"2024-09-12T17:29:54.754702+0000","last_became_peered":"2024-09-12T17:29:54.754702+0000","last_unstale":"2024-09-12T19:22:45.025784+0000","last_undegraded":"2024-09-12T19:22:45.025784+0000","last_fullsized":"2024-09-12T19:22:45.025784+0000","mapping_epoch":28,"log_start":"267'1600","ondisk_log_start":"267'1600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":1600,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:29.268644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7245,"num_read_kb":6284,"num_write":2371,"num_write_kb":1100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'246","reported_seq":912,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.257391+0000","last_change":"2024-09-12T17:29:52.768556+0000","last_active":"2024-09-12T19:20:08.257391+0000","last_peered":"2024-09-12T19:20:08.257391+0000","last_clean":"2024-09-12T19:20:08.257391+0000","last_became_active":"2024-09-12T17:29:52.767990+0000","last_became_peered":"2024-09-12T17:29:52.767990+0000","last_unstale":"2024-09-12T19:20:08.257391+0000","last_undegraded":"2024-09-12T19:20:08.257391+0000","last_fullsized":"2024-09-12T19:20:08.257391+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:04.577061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23401,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":413,"num_read_kb":642,"num_write":973,"num_write_kb":10844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'933","reported_seq":2506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.017536+0000","last_change":"2024-09-12T17:29:54.759508+0000","last_active":"2024-09-12T19:22:45.017536+0000","last_peered":"2024-09-12T19:22:45.017536+0000","last_clean":"2024-09-12T19:22:45.017536+0000","last_became_active":"2024-09-12T17:29:54.759169+0000","last_became_peered":"2024-09-12T17:29:54.759169+0000","last_unstale":"2024-09-12T19:22:45.017536+0000","last_undegraded":"2024-09-12T19:22:45.017536+0000","last_fullsized":"2024-09-12T19:22:45.017536+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":900,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:45.168551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4504,"num_read_kb":3992,"num_write":1315,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'297","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.954118+0000","last_change":"2024-09-12T17:29:52.757191+0000","last_active":"2024-09-12T19:23:01.954118+0000","last_peered":"2024-09-12T19:23:01.954118+0000","last_clean":"2024-09-12T19:23:01.954118+0000","last_became_active":"2024-09-12T17:29:52.753935+0000","last_became_peered":"2024-09-12T17:29:52.753935+0000","last_unstale":"2024-09-12T19:23:01.954118+0000","last_undegraded":"2024-09-12T19:23:01.954118+0000","last_fullsized":"2024-09-12T19:23:01.954118+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:29.050781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340668,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":430,"num_read_kb":10673,"num_write":974,"num_write_kb":41601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'834","reported_seq":2496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.014092+0000","last_change":"2024-09-12T17:29:54.761668+0000","last_active":"2024-09-12T19:22:45.014092+0000","last_peered":"2024-09-12T19:22:45.014092+0000","last_clean":"2024-09-12T19:22:45.014092+0000","last_became_active":"2024-09-12T17:29:54.760784+0000","last_became_peered":"2024-09-12T17:29:54.760784+0000","last_unstale":"2024-09-12T19:22:45.014092+0000","last_undegraded":"2024-09-12T19:22:45.014092+0000","last_fullsized":"2024-09-12T19:22:45.014092+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:25.364138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4062,"num_read_kb":3682,"num_write":1062,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'490","reported_seq":1212,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.951581+0000","last_change":"2024-09-12T17:29:52.735767+0000","last_active":"2024-09-12T19:23:01.951581+0000","last_peered":"2024-09-12T19:23:01.951581+0000","last_clean":"2024-09-12T19:23:01.951581+0000","last_became_active":"2024-09-12T17:29:52.735333+0000","last_became_peered":"2024-09-12T17:29:52.735333+0000","last_unstale":"2024-09-12T19:23:01.951581+0000","last_undegraded":"2024-09-12T19:23:01.951581+0000","last_fullsized":"2024-09-12T19:23:01.951581+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:56.415475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":869,"num_read_kb":5832,"num_write":1431,"num_write_kb":32355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'864","reported_seq":2443,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.002468+0000","last_change":"2024-09-12T17:29:54.754343+0000","last_active":"2024-09-12T19:22:45.002468+0000","last_peered":"2024-09-12T19:22:45.002468+0000","last_clean":"2024-09-12T19:22:45.002468+0000","last_became_active":"2024-09-12T17:29:54.753635+0000","last_became_peered":"2024-09-12T17:29:54.753635+0000","last_unstale":"2024-09-12T19:22:45.002468+0000","last_undegraded":"2024-09-12T19:22:45.002468+0000","last_fullsized":"2024-09-12T19:22:45.002468+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:06.006688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4079,"num_read_kb":3651,"num_write":1151,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'255","reported_seq":1011,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.558171+0000","last_change":"2024-09-12T17:29:52.745226+0000","last_active":"2024-09-12T19:20:08.558171+0000","last_peered":"2024-09-12T19:20:08.558171+0000","last_clean":"2024-09-12T19:20:08.558171+0000","last_became_active":"2024-09-12T17:29:52.744397+0000","last_became_peered":"2024-09-12T17:29:52.744397+0000","last_unstale":"2024-09-12T19:20:08.558171+0000","last_undegraded":"2024-09-12T19:20:08.558171+0000","last_fullsized":"2024-09-12T19:20:08.558171+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:30.018286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227539,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":707,"num_read_kb":16845,"num_write":984,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'473","reported_seq":2099,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.925933+0000","last_change":"2024-09-12T17:29:54.752376+0000","last_active":"2024-09-12T19:20:27.925933+0000","last_peered":"2024-09-12T19:20:27.925933+0000","last_clean":"2024-09-12T19:20:27.925933+0000","last_became_active":"2024-09-12T17:29:54.751872+0000","last_became_peered":"2024-09-12T17:29:54.751872+0000","last_unstale":"2024-09-12T19:20:27.925933+0000","last_undegraded":"2024-09-12T19:20:27.925933+0000","last_fullsized":"2024-09-12T19:20:27.925933+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:26.641497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2533,"num_read_kb":2381,"num_write":539,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'294","reported_seq":923,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.985448+0000","last_change":"2024-09-12T17:29:52.751477+0000","last_active":"2024-09-12T19:23:01.985448+0000","last_peered":"2024-09-12T19:23:01.985448+0000","last_clean":"2024-09-12T19:23:01.985448+0000","last_became_active":"2024-09-12T17:29:52.747688+0000","last_became_peered":"2024-09-12T17:29:52.747688+0000","last_unstale":"2024-09-12T19:23:01.985448+0000","last_undegraded":"2024-09-12T19:23:01.985448+0000","last_fullsized":"2024-09-12T19:23:01.985448+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:59.598093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262281,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":403,"num_read_kb":6219,"num_write":990,"num_write_kb":21267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'427","reported_seq":1940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.258996+0000","last_change":"2024-09-12T17:29:54.760829+0000","last_active":"2024-09-12T19:20:13.258996+0000","last_peered":"2024-09-12T19:20:13.258996+0000","last_clean":"2024-09-12T19:20:13.258996+0000","last_became_active":"2024-09-12T17:29:54.760373+0000","last_became_peered":"2024-09-12T17:29:54.760373+0000","last_unstale":"2024-09-12T19:20:13.258996+0000","last_undegraded":"2024-09-12T19:20:13.258996+0000","last_fullsized":"2024-09-12T19:20:13.258996+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:05.548951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2333,"num_read_kb":2181,"num_write":522,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'271","reported_seq":966,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.527121+0000","last_change":"2024-09-12T17:29:52.747300+0000","last_active":"2024-09-12T19:19:33.527121+0000","last_peered":"2024-09-12T19:19:33.527121+0000","last_clean":"2024-09-12T19:19:33.527121+0000","last_became_active":"2024-09-12T17:29:52.746880+0000","last_became_peered":"2024-09-12T17:29:52.746880+0000","last_unstale":"2024-09-12T19:19:33.527121+0000","last_undegraded":"2024-09-12T19:19:33.527121+0000","last_fullsized":"2024-09-12T19:19:33.527121+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:38.876679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17178221,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":464,"num_read_kb":70820,"num_write":1029,"num_write_kb":52448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'787","reported_seq":2445,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:47.979536+0000","last_change":"2024-09-12T17:29:54.766132+0000","last_active":"2024-09-12T19:20:47.979536+0000","last_peered":"2024-09-12T19:20:47.979536+0000","last_clean":"2024-09-12T19:20:47.979536+0000","last_became_active":"2024-09-12T17:29:54.765197+0000","last_became_peered":"2024-09-12T17:29:54.765197+0000","last_unstale":"2024-09-12T19:20:47.979536+0000","last_undegraded":"2024-09-12T19:20:47.979536+0000","last_fullsized":"2024-09-12T19:20:47.979536+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:06.211284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3968,"num_read_kb":3617,"num_write":1032,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'309","reported_seq":963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.968746+0000","last_change":"2024-09-12T17:29:52.753447+0000","last_active":"2024-09-12T19:23:01.968746+0000","last_peered":"2024-09-12T19:23:01.968746+0000","last_clean":"2024-09-12T19:23:01.968746+0000","last_became_active":"2024-09-12T17:29:52.749742+0000","last_became_peered":"2024-09-12T17:29:52.749742+0000","last_unstale":"2024-09-12T19:23:01.968746+0000","last_undegraded":"2024-09-12T19:23:01.968746+0000","last_fullsized":"2024-09-12T19:23:01.968746+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:57.718662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":13262,"num_write":1037,"num_write_kb":35239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'334","reported_seq":980,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.906142+0000","last_change":"2024-09-12T17:29:52.722769+0000","last_active":"2024-09-12T19:23:01.906142+0000","last_peered":"2024-09-12T19:23:01.906142+0000","last_clean":"2024-09-12T19:23:01.906142+0000","last_became_active":"2024-09-12T17:29:52.720918+0000","last_became_peered":"2024-09-12T17:29:52.720918+0000","last_unstale":"2024-09-12T19:23:01.906142+0000","last_undegraded":"2024-09-12T19:23:01.906142+0000","last_fullsized":"2024-09-12T19:23:01.906142+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:33.296017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170702,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":3934,"num_write":1046,"num_write_kb":9633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'599","reported_seq":2184,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:28.207331+0000","last_change":"2024-09-12T17:29:54.758143+0000","last_active":"2024-09-12T19:21:28.207331+0000","last_peered":"2024-09-12T19:21:28.207331+0000","last_clean":"2024-09-12T19:21:28.207331+0000","last_became_active":"2024-09-12T17:29:54.752553+0000","last_became_peered":"2024-09-12T17:29:54.752553+0000","last_unstale":"2024-09-12T19:21:28.207331+0000","last_undegraded":"2024-09-12T19:21:28.207331+0000","last_fullsized":"2024-09-12T19:21:28.207331+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:19.216701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3060,"num_read_kb":2784,"num_write":774,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'400","reported_seq":1086,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.952320+0000","last_change":"2024-09-12T17:30:22.255466+0000","last_active":"2024-09-12T19:23:01.952320+0000","last_peered":"2024-09-12T19:23:01.952320+0000","last_clean":"2024-09-12T19:23:01.952320+0000","last_became_active":"2024-09-12T17:30:22.254863+0000","last_became_peered":"2024-09-12T17:30:22.254863+0000","last_unstale":"2024-09-12T19:23:01.952320+0000","last_undegraded":"2024-09-12T19:23:01.952320+0000","last_fullsized":"2024-09-12T19:23:01.952320+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:14.162185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992370,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":655,"num_read_kb":2597,"num_write":1307,"num_write_kb":14489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5,0],"acting":[1,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'444","reported_seq":1944,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:08.001889+0000","last_change":"2024-09-12T17:29:54.764546+0000","last_active":"2024-09-12T19:21:08.001889+0000","last_peered":"2024-09-12T19:21:08.001889+0000","last_clean":"2024-09-12T19:21:08.001889+0000","last_became_active":"2024-09-12T17:29:54.763613+0000","last_became_peered":"2024-09-12T17:29:54.763613+0000","last_unstale":"2024-09-12T19:21:08.001889+0000","last_undegraded":"2024-09-12T19:21:08.001889+0000","last_fullsized":"2024-09-12T19:21:08.001889+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:27.590175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2478,"num_read_kb":2322,"num_write":560,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5989,"num_read_kb":4199,"num_write":1940,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1011,"ondisk_log_size":1011,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16341,"num_read_kb":15997,"num_write":16735,"num_write_kb":4892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1670,"ondisk_log_size":1670,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":549,"ondisk_log_size":549,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1577752,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":20884,"num_read_kb":39593,"num_write":17449,"num_write_kb":12355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1228800,"data_stored":870213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1952,"ondisk_log_size":1952,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212845,"num_read_kb":194484,"num_write":55296,"num_write_kb":18842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3814,"ondisk_log_size":3814,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":229695992,"num_objects":1838,"num_object_clones":0,"num_object_copies":7352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1838,"num_whiteouts":0,"num_read":34697,"num_read_kb":1906077,"num_write":70014,"num_write_kb":2114280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":352837632,"data_stored":352837632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4045,"ondisk_log_size":4045,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":24213981,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":122,"num_read_kb":168420,"num_write":145,"num_write_kb":116143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77750272,"data_stored":77742985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16785383,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":174519,"num_write":148,"num_write_kb":116143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":50438144,"data_stored":50431588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543512,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":323556,"kb_used_data":21480,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94048284,"statfs":{"total":96636764160,"available":96305442816,"internally_reserved":0,"allocated":21995520,"data_stored":19982866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":309131722},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,3,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543517,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444108,"kb_used_data":151932,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":93927732,"statfs":{"total":96636764160,"available":96181997568,"internally_reserved":0,"allocated":155578368,"data_stored":153570661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":299170246},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543511,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177360,"kb_used_data":11368,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94194480,"statfs":{"total":96636764160,"available":96455147520,"internally_reserved":0,"allocated":11640832,"data_stored":9617929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543513,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161488,"kb_used_data":17856,"kb_used_omap":1,"kb_used_meta":143614,"kb_avail":94210352,"statfs":{"total":96636764160,"available":96471400448,"internally_reserved":0,"allocated":18284544,"data_stored":16335473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":147061189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543511,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":426588,"kb_used_data":146892,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":93945252,"statfs":{"total":96636764160,"available":96199938048,"internally_reserved":0,"allocated":150417408,"data_stored":148351516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":286390727},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543513,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229400,"kb_used_data":130184,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94142440,"statfs":{"total":96636764160,"available":96401858560,"internally_reserved":0,"allocated":133308416,"data_stored":131326773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543510,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":196164,"kb_used_data":16420,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94175676,"statfs":{"total":96636764160,"available":96435892224,"internally_reserved":0,"allocated":16814080,"data_stored":14841351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543512,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299976,"kb_used_data":15912,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":94071864,"statfs":{"total":96636764160,"available":96329588736,"internally_reserved":0,"allocated":16293888,"data_stored":14257873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":290585029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11374592,"data_stored":11374592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12550144,"data_stored":12550144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":82669568,"data_stored":82669568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":100405248,"data_stored":100405248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14045184,"data_stored":14045184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7327744,"data_stored":7327744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":114262016,"data_stored":114262016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10203136,"data_stored":10203136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":137128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":466906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":261129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":5848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29405184,"data_stored":29403480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6295552,"data_stored":6294663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14737408,"data_stored":14733445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16826368,"data_stored":16825637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38899712,"data_stored":38894045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":22024192,"data_stored":22023303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:23:03.770 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T19:23:03.771 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:23:04.147 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:23:04.158 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-12T19:23:04.164 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":3666,"stamp":"2024-09-12T19:23:03.254098+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":272880683,"num_objects":2321,"num_object_clones":0,"num_object_copies":8318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2321,"num_whiteouts":0,"num_read":293484,"num_read_kb":2506219,"num_write":161870,"num_write_kb":2385149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13307,"ondisk_log_size":13307,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2258640,"kb_used_data":512044,"kb_used_omap":12,"kb_used_meta":1745715,"kb_avail":752716080,"statfs":{"total":773094113280,"available":770781265920,"internally_reserved":0,"allocated":524333056,"data_stored":508284442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1787612720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,1,4,4],"upper_bound":16},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-424265911,"num_objects":-2569,"num_object_clones":0,"num_object_copies":-10234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2569,"num_whiteouts":0,"num_read":2967,"num_read_kb":3389,"num_write":2772,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007042"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.976722+0000","last_change":"2024-09-12T18:19:22.664402+0000","last_active":"2024-09-12T19:19:22.976722+0000","last_peered":"2024-09-12T19:19:22.976722+0000","last_clean":"2024-09-12T19:19:22.976722+0000","last_became_active":"2024-09-12T18:19:22.658759+0000","last_became_peered":"2024-09-12T18:19:22.658759+0000","last_unstale":"2024-09-12T19:19:22.976722+0000","last_undegraded":"2024-09-12T19:19:22.976722+0000","last_fullsized":"2024-09-12T19:19:22.976722+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:29.891894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:32.979320+0000","last_change":"2024-09-12T17:51:59.970111+0000","last_active":"2024-09-12T19:19:32.979320+0000","last_peered":"2024-09-12T19:19:32.979320+0000","last_clean":"2024-09-12T19:19:32.979320+0000","last_became_active":"2024-09-12T17:51:59.969612+0000","last_became_peered":"2024-09-12T17:51:59.969612+0000","last_unstale":"2024-09-12T19:19:32.979320+0000","last_undegraded":"2024-09-12T19:19:32.979320+0000","last_fullsized":"2024-09-12T19:19:32.979320+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:23.773617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'5","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:23.246751+0000","last_change":"2024-09-12T17:51:52.890790+0000","last_active":"2024-09-12T19:19:23.246751+0000","last_peered":"2024-09-12T19:19:23.246751+0000","last_clean":"2024-09-12T19:19:23.246751+0000","last_became_active":"2024-09-12T17:51:52.890029+0000","last_became_peered":"2024-09-12T17:51:52.890029+0000","last_unstale":"2024-09-12T19:19:23.246751+0000","last_undegraded":"2024-09-12T19:19:23.246751+0000","last_fullsized":"2024-09-12T19:19:23.246751+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:58.035727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'75","reported_seq":374,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:28.176973+0000","last_change":"2024-09-12T17:45:41.586304+0000","last_active":"2024-09-12T19:19:28.176973+0000","last_peered":"2024-09-12T19:19:28.176973+0000","last_clean":"2024-09-12T19:19:28.176973+0000","last_became_active":"2024-09-12T17:45:41.585012+0000","last_became_peered":"2024-09-12T17:45:41.585012+0000","last_unstale":"2024-09-12T19:19:28.176973+0000","last_undegraded":"2024-09-12T19:19:28.176973+0000","last_fullsized":"2024-09-12T19:19:28.176973+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:25.815410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":580,"num_read_kb":395,"num_write":86,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:23.524914+0000","last_change":"2024-09-12T18:19:22.641896+0000","last_active":"2024-09-12T19:19:23.524914+0000","last_peered":"2024-09-12T19:19:23.524914+0000","last_clean":"2024-09-12T19:19:23.524914+0000","last_became_active":"2024-09-12T18:19:22.641172+0000","last_became_peered":"2024-09-12T18:19:22.641172+0000","last_unstale":"2024-09-12T19:19:23.524914+0000","last_undegraded":"2024-09-12T19:19:23.524914+0000","last_fullsized":"2024-09-12T19:19:23.524914+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:53.586176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.189386+0000","last_change":"2024-09-12T17:51:59.957708+0000","last_active":"2024-09-12T19:19:33.189386+0000","last_peered":"2024-09-12T19:19:33.189386+0000","last_clean":"2024-09-12T19:19:33.189386+0000","last_became_active":"2024-09-12T17:51:59.957109+0000","last_became_peered":"2024-09-12T17:51:59.957109+0000","last_unstale":"2024-09-12T19:19:33.189386+0000","last_undegraded":"2024-09-12T19:19:33.189386+0000","last_fullsized":"2024-09-12T19:19:33.189386+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:06.641011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.970297+0000","last_change":"2024-09-12T17:51:52.905930+0000","last_active":"2024-09-12T19:19:22.970297+0000","last_peered":"2024-09-12T19:19:22.970297+0000","last_clean":"2024-09-12T19:19:22.970297+0000","last_became_active":"2024-09-12T17:51:52.905220+0000","last_became_peered":"2024-09-12T17:51:52.905220+0000","last_unstale":"2024-09-12T19:19:22.970297+0000","last_undegraded":"2024-09-12T19:19:22.970297+0000","last_fullsized":"2024-09-12T19:19:22.970297+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:22.520893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'122","reported_seq":487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:53.531273+0000","last_change":"2024-09-12T17:45:41.573549+0000","last_active":"2024-09-12T19:19:53.531273+0000","last_peered":"2024-09-12T19:19:53.531273+0000","last_clean":"2024-09-12T19:19:53.531273+0000","last_became_active":"2024-09-12T17:45:41.572859+0000","last_became_peered":"2024-09-12T17:45:41.572859+0000","last_unstale":"2024-09-12T19:19:53.531273+0000","last_undegraded":"2024-09-12T19:19:53.531273+0000","last_fullsized":"2024-09-12T19:19:53.531273+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:00.082452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":788,"num_read_kb":542,"num_write":175,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.553951+0000","last_change":"2024-09-12T18:19:22.653551+0000","last_active":"2024-09-12T19:19:48.553951+0000","last_peered":"2024-09-12T19:19:48.553951+0000","last_clean":"2024-09-12T19:19:48.553951+0000","last_became_active":"2024-09-12T18:19:22.652800+0000","last_became_peered":"2024-09-12T18:19:22.652800+0000","last_unstale":"2024-09-12T19:19:48.553951+0000","last_undegraded":"2024-09-12T19:19:48.553951+0000","last_fullsized":"2024-09-12T19:19:48.553951+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:00.720225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.178212+0000","last_change":"2024-09-12T17:51:59.955159+0000","last_active":"2024-09-12T19:19:33.178212+0000","last_peered":"2024-09-12T19:19:33.178212+0000","last_clean":"2024-09-12T19:19:33.178212+0000","last_became_active":"2024-09-12T17:51:59.954517+0000","last_became_peered":"2024-09-12T17:51:59.954517+0000","last_unstale":"2024-09-12T19:19:33.178212+0000","last_undegraded":"2024-09-12T19:19:33.178212+0000","last_fullsized":"2024-09-12T19:19:33.178212+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:02.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"267'1","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.533724+0000","last_change":"2024-09-12T17:51:52.886345+0000","last_active":"2024-09-12T19:20:03.533724+0000","last_peered":"2024-09-12T19:20:03.533724+0000","last_clean":"2024-09-12T19:20:03.533724+0000","last_became_active":"2024-09-12T17:51:52.885677+0000","last_became_peered":"2024-09-12T17:51:52.885677+0000","last_unstale":"2024-09-12T19:20:03.533724+0000","last_undegraded":"2024-09-12T19:20:03.533724+0000","last_fullsized":"2024-09-12T19:20:03.533724+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:04.278645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'26","reported_seq":140,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:13.156514+0000","last_change":"2024-09-12T17:45:41.576549+0000","last_active":"2024-09-12T19:18:13.156514+0000","last_peered":"2024-09-12T19:18:13.156514+0000","last_clean":"2024-09-12T19:18:13.156514+0000","last_became_active":"2024-09-12T17:45:41.575793+0000","last_became_peered":"2024-09-12T17:45:41.575793+0000","last_unstale":"2024-09-12T19:18:13.156514+0000","last_undegraded":"2024-09-12T19:18:13.156514+0000","last_fullsized":"2024-09-12T19:18:13.156514+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:35.718641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":83,"num_write":51,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.254703+0000","last_change":"2024-09-12T18:19:22.656103+0000","last_active":"2024-09-12T19:19:58.254703+0000","last_peered":"2024-09-12T19:19:58.254703+0000","last_clean":"2024-09-12T19:19:58.254703+0000","last_became_active":"2024-09-12T18:19:22.655357+0000","last_became_peered":"2024-09-12T18:19:22.655357+0000","last_unstale":"2024-09-12T19:19:58.254703+0000","last_undegraded":"2024-09-12T19:19:58.254703+0000","last_fullsized":"2024-09-12T19:19:58.254703+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:44.884891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"267'1","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262497+0000","last_change":"2024-09-12T17:51:59.941561+0000","last_active":"2024-09-12T19:20:23.262497+0000","last_peered":"2024-09-12T19:20:23.262497+0000","last_clean":"2024-09-12T19:20:23.262497+0000","last_became_active":"2024-09-12T17:51:59.935185+0000","last_became_peered":"2024-09-12T17:51:59.935185+0000","last_unstale":"2024-09-12T19:20:23.262497+0000","last_undegraded":"2024-09-12T19:20:23.262497+0000","last_fullsized":"2024-09-12T19:20:23.262497+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:03.775657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"267'10","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.345477+0000","last_change":"2024-09-12T17:51:52.865694+0000","last_active":"2024-09-12T19:23:01.345477+0000","last_peered":"2024-09-12T19:23:01.345477+0000","last_clean":"2024-09-12T19:23:01.345477+0000","last_became_active":"2024-09-12T17:51:52.864951+0000","last_became_peered":"2024-09-12T17:51:52.864951+0000","last_unstale":"2024-09-12T19:23:01.345477+0000","last_undegraded":"2024-09-12T19:23:01.345477+0000","last_fullsized":"2024-09-12T19:23:01.345477+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:53.129719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32810,"num_write":10,"num_write_kb":11304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'28","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:13.228547+0000","last_change":"2024-09-12T17:45:41.577459+0000","last_active":"2024-09-12T19:18:13.228547+0000","last_peered":"2024-09-12T19:18:13.228547+0000","last_clean":"2024-09-12T19:18:13.228547+0000","last_became_active":"2024-09-12T17:45:41.576714+0000","last_became_peered":"2024-09-12T17:45:41.576714+0000","last_unstale":"2024-09-12T19:18:13.228547+0000","last_undegraded":"2024-09-12T19:18:13.228547+0000","last_fullsized":"2024-09-12T19:18:13.228547+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:46.641068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":94,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.249030+0000","last_change":"2024-09-12T18:19:22.665947+0000","last_active":"2024-09-12T19:19:33.249030+0000","last_peered":"2024-09-12T19:19:33.249030+0000","last_clean":"2024-09-12T19:19:33.249030+0000","last_became_active":"2024-09-12T18:19:22.665152+0000","last_became_peered":"2024-09-12T18:19:22.665152+0000","last_unstale":"2024-09-12T19:19:33.249030+0000","last_undegraded":"2024-09-12T19:19:33.249030+0000","last_fullsized":"2024-09-12T19:19:33.249030+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:24.528404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"267'3","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.011866+0000","last_change":"2024-09-12T17:51:59.951234+0000","last_active":"2024-09-12T19:21:53.011866+0000","last_peered":"2024-09-12T19:21:53.011866+0000","last_clean":"2024-09-12T19:21:53.011866+0000","last_became_active":"2024-09-12T17:51:59.950595+0000","last_became_peered":"2024-09-12T17:51:59.950595+0000","last_unstale":"2024-09-12T19:21:53.011866+0000","last_undegraded":"2024-09-12T19:21:53.011866+0000","last_fullsized":"2024-09-12T19:21:53.011866+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:58.571310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.166933+0000","last_change":"2024-09-12T17:51:52.908434+0000","last_active":"2024-09-12T19:18:53.166933+0000","last_peered":"2024-09-12T19:18:53.166933+0000","last_clean":"2024-09-12T19:18:53.166933+0000","last_became_active":"2024-09-12T17:51:52.907863+0000","last_became_peered":"2024-09-12T17:51:52.907863+0000","last_unstale":"2024-09-12T19:18:53.166933+0000","last_undegraded":"2024-09-12T19:18:53.166933+0000","last_fullsized":"2024-09-12T19:18:53.166933+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:14.608689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'42","reported_seq":186,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:13.228451+0000","last_change":"2024-09-12T17:45:41.596640+0000","last_active":"2024-09-12T19:18:13.228451+0000","last_peered":"2024-09-12T19:18:13.228451+0000","last_clean":"2024-09-12T19:18:13.228451+0000","last_became_active":"2024-09-12T17:45:41.596133+0000","last_became_peered":"2024-09-12T17:45:41.596133+0000","last_unstale":"2024-09-12T19:18:13.228451+0000","last_undegraded":"2024-09-12T19:18:13.228451+0000","last_fullsized":"2024-09-12T19:18:13.228451+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:41.921834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":80,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.975905+0000","last_change":"2024-09-12T18:19:22.652917+0000","last_active":"2024-09-12T19:19:47.975905+0000","last_peered":"2024-09-12T19:19:47.975905+0000","last_clean":"2024-09-12T19:19:47.975905+0000","last_became_active":"2024-09-12T18:19:22.652141+0000","last_became_peered":"2024-09-12T18:19:22.652141+0000","last_unstale":"2024-09-12T19:19:47.975905+0000","last_undegraded":"2024-09-12T19:19:47.975905+0000","last_fullsized":"2024-09-12T19:19:47.975905+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:16.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"267'1","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.544204+0000","last_change":"2024-09-12T17:51:59.937787+0000","last_active":"2024-09-12T19:19:03.544204+0000","last_peered":"2024-09-12T19:19:03.544204+0000","last_clean":"2024-09-12T19:19:03.544204+0000","last_became_active":"2024-09-12T17:51:59.936941+0000","last_became_peered":"2024-09-12T17:51:59.936941+0000","last_unstale":"2024-09-12T19:19:03.544204+0000","last_undegraded":"2024-09-12T19:19:03.544204+0000","last_fullsized":"2024-09-12T19:19:03.544204+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:37.516754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'2","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:38.218337+0000","last_change":"2024-09-12T17:51:52.882882+0000","last_active":"2024-09-12T19:21:38.218337+0000","last_peered":"2024-09-12T19:21:38.218337+0000","last_clean":"2024-09-12T19:21:38.218337+0000","last_became_active":"2024-09-12T17:51:52.882157+0000","last_became_peered":"2024-09-12T17:51:52.882157+0000","last_unstale":"2024-09-12T19:21:38.218337+0000","last_undegraded":"2024-09-12T19:21:38.218337+0000","last_fullsized":"2024-09-12T19:21:38.218337+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:28.059422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'16","reported_seq":113,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:13.533500+0000","last_change":"2024-09-12T17:45:41.587495+0000","last_active":"2024-09-12T19:18:13.533500+0000","last_peered":"2024-09-12T19:18:13.533500+0000","last_clean":"2024-09-12T19:18:13.533500+0000","last_became_active":"2024-09-12T17:45:41.586661+0000","last_became_peered":"2024-09-12T17:45:41.586661+0000","last_unstale":"2024-09-12T19:18:13.533500+0000","last_undegraded":"2024-09-12T19:18:13.533500+0000","last_fullsized":"2024-09-12T19:18:13.533500+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:51.564389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959085+0000","last_change":"2024-09-12T18:19:22.671131+0000","last_active":"2024-09-12T19:19:22.959085+0000","last_peered":"2024-09-12T19:19:22.959085+0000","last_clean":"2024-09-12T19:19:22.959085+0000","last_became_active":"2024-09-12T18:19:22.668945+0000","last_became_peered":"2024-09-12T18:19:22.668945+0000","last_unstale":"2024-09-12T19:19:22.959085+0000","last_undegraded":"2024-09-12T19:19:22.959085+0000","last_fullsized":"2024-09-12T19:19:22.959085+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:51.667065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.550741+0000","last_change":"2024-09-12T17:51:59.937170+0000","last_active":"2024-09-12T19:19:33.550741+0000","last_peered":"2024-09-12T19:19:33.550741+0000","last_clean":"2024-09-12T19:19:33.550741+0000","last_became_active":"2024-09-12T17:51:59.936441+0000","last_became_peered":"2024-09-12T17:51:59.936441+0000","last_unstale":"2024-09-12T19:19:33.550741+0000","last_undegraded":"2024-09-12T19:19:33.550741+0000","last_fullsized":"2024-09-12T19:19:33.550741+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:54.536101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:23.187174+0000","last_change":"2024-09-12T17:51:52.888730+0000","last_active":"2024-09-12T19:19:23.187174+0000","last_peered":"2024-09-12T19:19:23.187174+0000","last_clean":"2024-09-12T19:19:23.187174+0000","last_became_active":"2024-09-12T17:51:52.887962+0000","last_became_peered":"2024-09-12T17:51:52.887962+0000","last_unstale":"2024-09-12T19:19:23.187174+0000","last_undegraded":"2024-09-12T19:19:23.187174+0000","last_fullsized":"2024-09-12T19:19:23.187174+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:25.669346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'25","reported_seq":141,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.188763+0000","last_change":"2024-09-12T17:45:41.566696+0000","last_active":"2024-09-12T19:20:13.188763+0000","last_peered":"2024-09-12T19:20:13.188763+0000","last_clean":"2024-09-12T19:20:13.188763+0000","last_became_active":"2024-09-12T17:45:41.565956+0000","last_became_peered":"2024-09-12T17:45:41.565956+0000","last_unstale":"2024-09-12T19:20:13.188763+0000","last_undegraded":"2024-09-12T19:20:13.188763+0000","last_fullsized":"2024-09-12T19:20:13.188763+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:11.837864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959148+0000","last_change":"2024-09-12T18:19:22.677901+0000","last_active":"2024-09-12T19:19:22.959148+0000","last_peered":"2024-09-12T19:19:22.959148+0000","last_clean":"2024-09-12T19:19:22.959148+0000","last_became_active":"2024-09-12T18:19:22.677111+0000","last_became_peered":"2024-09-12T18:19:22.677111+0000","last_unstale":"2024-09-12T19:19:22.959148+0000","last_undegraded":"2024-09-12T19:19:22.959148+0000","last_fullsized":"2024-09-12T19:19:22.959148+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:39.916282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'1","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.248864+0000","last_change":"2024-09-12T17:51:59.942614+0000","last_active":"2024-09-12T19:19:33.248864+0000","last_peered":"2024-09-12T19:19:33.248864+0000","last_clean":"2024-09-12T19:19:33.248864+0000","last_became_active":"2024-09-12T17:51:59.941825+0000","last_became_peered":"2024-09-12T17:51:59.941825+0000","last_unstale":"2024-09-12T19:19:33.248864+0000","last_undegraded":"2024-09-12T19:19:33.248864+0000","last_fullsized":"2024-09-12T19:19:33.248864+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:10.399861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4960,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":10,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.212609+0000","last_change":"2024-09-12T17:51:52.899944+0000","last_active":"2024-09-12T19:21:53.212609+0000","last_peered":"2024-09-12T19:21:53.212609+0000","last_clean":"2024-09-12T19:21:53.212609+0000","last_became_active":"2024-09-12T17:51:52.899511+0000","last_became_peered":"2024-09-12T17:51:52.899511+0000","last_unstale":"2024-09-12T19:21:53.212609+0000","last_undegraded":"2024-09-12T19:21:53.212609+0000","last_fullsized":"2024-09-12T19:21:53.212609+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:39.682445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'27","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.978150+0000","last_change":"2024-09-12T17:45:41.587067+0000","last_active":"2024-09-12T19:19:57.978150+0000","last_peered":"2024-09-12T19:19:57.978150+0000","last_clean":"2024-09-12T19:19:57.978150+0000","last_became_active":"2024-09-12T17:45:41.578021+0000","last_became_peered":"2024-09-12T17:45:41.578021+0000","last_unstale":"2024-09-12T19:19:57.978150+0000","last_undegraded":"2024-09-12T19:19:57.978150+0000","last_fullsized":"2024-09-12T19:19:57.978150+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:35.349527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":97,"num_write":50,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.979562+0000","last_change":"2024-09-12T18:19:22.669975+0000","last_active":"2024-09-12T19:20:02.979562+0000","last_peered":"2024-09-12T19:20:02.979562+0000","last_clean":"2024-09-12T19:20:02.979562+0000","last_became_active":"2024-09-12T18:19:22.668802+0000","last_became_peered":"2024-09-12T18:19:22.668802+0000","last_unstale":"2024-09-12T19:20:02.979562+0000","last_undegraded":"2024-09-12T19:20:02.979562+0000","last_fullsized":"2024-09-12T19:20:02.979562+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:20.736060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.241946+0000","last_change":"2024-09-12T17:51:59.940440+0000","last_active":"2024-09-12T19:19:03.241946+0000","last_peered":"2024-09-12T19:19:03.241946+0000","last_clean":"2024-09-12T19:19:03.241946+0000","last_became_active":"2024-09-12T17:51:59.939686+0000","last_became_peered":"2024-09-12T17:51:59.939686+0000","last_unstale":"2024-09-12T19:19:03.241946+0000","last_undegraded":"2024-09-12T19:19:03.241946+0000","last_fullsized":"2024-09-12T19:19:03.241946+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:25.031497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:37.964561+0000","last_change":"2024-09-12T17:51:52.894394+0000","last_active":"2024-09-12T19:18:37.964561+0000","last_peered":"2024-09-12T19:18:37.964561+0000","last_clean":"2024-09-12T19:18:37.964561+0000","last_became_active":"2024-09-12T17:51:52.892953+0000","last_became_peered":"2024-09-12T17:51:52.892953+0000","last_unstale":"2024-09-12T19:18:37.964561+0000","last_undegraded":"2024-09-12T19:18:37.964561+0000","last_fullsized":"2024-09-12T19:18:37.964561+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:34.018077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'51","reported_seq":214,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.184846+0000","last_change":"2024-09-12T17:45:41.574719+0000","last_active":"2024-09-12T19:19:58.184846+0000","last_peered":"2024-09-12T19:19:58.184846+0000","last_clean":"2024-09-12T19:19:58.184846+0000","last_became_active":"2024-09-12T17:45:41.572941+0000","last_became_peered":"2024-09-12T17:45:41.572941+0000","last_unstale":"2024-09-12T19:19:58.184846+0000","last_undegraded":"2024-09-12T19:19:58.184846+0000","last_fullsized":"2024-09-12T19:19:58.184846+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:25.447410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":190,"num_write":83,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.533559+0000","last_change":"2024-09-12T18:19:22.652584+0000","last_active":"2024-09-12T19:20:03.533559+0000","last_peered":"2024-09-12T19:20:03.533559+0000","last_clean":"2024-09-12T19:20:03.533559+0000","last_became_active":"2024-09-12T18:19:22.651901+0000","last_became_peered":"2024-09-12T18:19:22.651901+0000","last_unstale":"2024-09-12T19:20:03.533559+0000","last_undegraded":"2024-09-12T19:20:03.533559+0000","last_fullsized":"2024-09-12T19:20:03.533559+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:40.051168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.236632+0000","last_change":"2024-09-12T17:51:59.948536+0000","last_active":"2024-09-12T19:18:43.236632+0000","last_peered":"2024-09-12T19:18:43.236632+0000","last_clean":"2024-09-12T19:18:43.236632+0000","last_became_active":"2024-09-12T17:51:59.947392+0000","last_became_peered":"2024-09-12T17:51:59.947392+0000","last_unstale":"2024-09-12T19:18:43.236632+0000","last_undegraded":"2024-09-12T19:18:43.236632+0000","last_fullsized":"2024-09-12T19:18:43.236632+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:47.397467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'5","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:52.952062+0000","last_change":"2024-09-12T17:51:52.887100+0000","last_active":"2024-09-12T19:18:52.952062+0000","last_peered":"2024-09-12T19:18:52.952062+0000","last_clean":"2024-09-12T19:18:52.952062+0000","last_became_active":"2024-09-12T17:51:52.886123+0000","last_became_peered":"2024-09-12T17:51:52.886123+0000","last_unstale":"2024-09-12T19:18:52.952062+0000","last_undegraded":"2024-09-12T19:18:52.952062+0000","last_fullsized":"2024-09-12T19:18:52.952062+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:11.295668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'32","reported_seq":165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.255039+0000","last_change":"2024-09-12T17:45:41.592562+0000","last_active":"2024-09-12T19:19:58.255039+0000","last_peered":"2024-09-12T19:19:58.255039+0000","last_clean":"2024-09-12T19:19:58.255039+0000","last_became_active":"2024-09-12T17:45:41.591637+0000","last_became_peered":"2024-09-12T17:45:41.591637+0000","last_unstale":"2024-09-12T19:19:58.255039+0000","last_undegraded":"2024-09-12T19:19:58.255039+0000","last_fullsized":"2024-09-12T19:19:58.255039+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:52.032057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":117,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968591+0000","last_change":"2024-09-12T18:19:22.646555+0000","last_active":"2024-09-12T19:20:02.968591+0000","last_peered":"2024-09-12T19:20:02.968591+0000","last_clean":"2024-09-12T19:20:02.968591+0000","last_became_active":"2024-09-12T18:19:22.645829+0000","last_became_peered":"2024-09-12T18:19:22.645829+0000","last_unstale":"2024-09-12T19:20:02.968591+0000","last_undegraded":"2024-09-12T19:20:02.968591+0000","last_fullsized":"2024-09-12T19:20:02.968591+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:14.278527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"267'9","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.986200+0000","last_change":"2024-09-12T17:52:23.472557+0000","last_active":"2024-09-12T19:22:58.986200+0000","last_peered":"2024-09-12T19:22:58.986200+0000","last_clean":"2024-09-12T19:22:58.986200+0000","last_became_active":"2024-09-12T17:52:23.438623+0000","last_became_peered":"2024-09-12T17:52:23.438623+0000","last_unstale":"2024-09-12T19:22:58.986200+0000","last_undegraded":"2024-09-12T19:22:58.986200+0000","last_fullsized":"2024-09-12T19:22:58.986200+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:04.013275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":19,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.16","version":"267'1","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.518185+0000","last_change":"2024-09-12T17:51:52.884671+0000","last_active":"2024-09-12T19:18:53.518185+0000","last_peered":"2024-09-12T19:18:53.518185+0000","last_clean":"2024-09-12T19:18:53.518185+0000","last_became_active":"2024-09-12T17:51:52.876542+0000","last_became_peered":"2024-09-12T17:51:52.876542+0000","last_unstale":"2024-09-12T19:18:53.518185+0000","last_undegraded":"2024-09-12T19:18:53.518185+0000","last_fullsized":"2024-09-12T19:18:53.518185+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:01.214988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"0'0","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.532458+0000","last_change":"2024-09-12T17:45:41.575734+0000","last_active":"2024-09-12T19:19:58.532458+0000","last_peered":"2024-09-12T19:19:58.532458+0000","last_clean":"2024-09-12T19:19:58.532458+0000","last_became_active":"2024-09-12T17:45:41.574953+0000","last_became_peered":"2024-09-12T17:45:41.574953+0000","last_unstale":"2024-09-12T19:19:58.532458+0000","last_undegraded":"2024-09-12T19:19:58.532458+0000","last_fullsized":"2024-09-12T19:19:58.532458+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:53.875702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.986527+0000","last_change":"2024-09-12T18:19:22.658747+0000","last_active":"2024-09-12T19:20:02.986527+0000","last_peered":"2024-09-12T19:20:02.986527+0000","last_clean":"2024-09-12T19:20:02.986527+0000","last_became_active":"2024-09-12T18:19:22.657731+0000","last_became_peered":"2024-09-12T18:19:22.657731+0000","last_unstale":"2024-09-12T19:20:02.986527+0000","last_undegraded":"2024-09-12T19:20:02.986527+0000","last_fullsized":"2024-09-12T19:20:02.986527+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:22.834751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"267'5","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:28.216153+0000","last_change":"2024-09-12T17:51:59.948754+0000","last_active":"2024-09-12T19:21:28.216153+0000","last_peered":"2024-09-12T19:21:28.216153+0000","last_clean":"2024-09-12T19:21:28.216153+0000","last_became_active":"2024-09-12T17:51:59.937650+0000","last_became_peered":"2024-09-12T17:51:59.937650+0000","last_unstale":"2024-09-12T19:21:28.216153+0000","last_undegraded":"2024-09-12T19:21:28.216153+0000","last_fullsized":"2024-09-12T19:21:28.216153+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:52.287318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.167284+0000","last_change":"2024-09-12T17:51:52.888708+0000","last_active":"2024-09-12T19:18:53.167284+0000","last_peered":"2024-09-12T19:18:53.167284+0000","last_clean":"2024-09-12T19:18:53.167284+0000","last_became_active":"2024-09-12T17:51:52.887964+0000","last_became_peered":"2024-09-12T17:51:52.887964+0000","last_unstale":"2024-09-12T19:18:53.167284+0000","last_undegraded":"2024-09-12T19:18:53.167284+0000","last_fullsized":"2024-09-12T19:18:53.167284+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:57.571315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'27","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959037+0000","last_change":"2024-09-12T17:45:41.595246+0000","last_active":"2024-09-12T19:19:22.959037+0000","last_peered":"2024-09-12T19:19:22.959037+0000","last_clean":"2024-09-12T19:19:22.959037+0000","last_became_active":"2024-09-12T17:45:41.594619+0000","last_became_peered":"2024-09-12T17:45:41.594619+0000","last_unstale":"2024-09-12T19:19:22.959037+0000","last_undegraded":"2024-09-12T19:19:22.959037+0000","last_fullsized":"2024-09-12T19:19:22.959037+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:08.142112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252332+0000","last_change":"2024-09-12T18:19:22.646874+0000","last_active":"2024-09-12T19:19:48.252332+0000","last_peered":"2024-09-12T19:19:48.252332+0000","last_clean":"2024-09-12T19:19:48.252332+0000","last_became_active":"2024-09-12T18:19:22.646129+0000","last_became_peered":"2024-09-12T18:19:22.646129+0000","last_unstale":"2024-09-12T19:19:48.252332+0000","last_undegraded":"2024-09-12T19:19:48.252332+0000","last_fullsized":"2024-09-12T19:19:48.252332+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:17.061904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.988325+0000","last_change":"2024-09-12T17:51:59.962952+0000","last_active":"2024-09-12T19:20:42.988325+0000","last_peered":"2024-09-12T19:20:42.988325+0000","last_clean":"2024-09-12T19:20:42.988325+0000","last_became_active":"2024-09-12T17:51:59.961892+0000","last_became_peered":"2024-09-12T17:51:59.961892+0000","last_unstale":"2024-09-12T19:20:42.988325+0000","last_undegraded":"2024-09-12T19:20:42.988325+0000","last_fullsized":"2024-09-12T19:20:42.988325+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:48.287564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'5","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.203445+0000","last_change":"2024-09-12T17:51:52.865750+0000","last_active":"2024-09-12T19:20:33.203445+0000","last_peered":"2024-09-12T19:20:33.203445+0000","last_clean":"2024-09-12T19:20:33.203445+0000","last_became_active":"2024-09-12T17:51:52.865019+0000","last_became_peered":"2024-09-12T17:51:52.865019+0000","last_unstale":"2024-09-12T19:20:33.203445+0000","last_undegraded":"2024-09-12T19:20:33.203445+0000","last_fullsized":"2024-09-12T19:20:33.203445+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:48.706108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'30","reported_seq":153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:02.954345+0000","last_change":"2024-09-12T17:45:41.595661+0000","last_active":"2024-09-12T19:19:02.954345+0000","last_peered":"2024-09-12T19:19:02.954345+0000","last_clean":"2024-09-12T19:19:02.954345+0000","last_became_active":"2024-09-12T17:45:41.594848+0000","last_became_peered":"2024-09-12T17:45:41.594848+0000","last_unstale":"2024-09-12T19:19:02.954345+0000","last_undegraded":"2024-09-12T19:19:02.954345+0000","last_fullsized":"2024-09-12T19:19:02.954345+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:51.035395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":101,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.182427+0000","last_change":"2024-09-12T18:19:22.649527+0000","last_active":"2024-09-12T19:19:48.182427+0000","last_peered":"2024-09-12T19:19:48.182427+0000","last_clean":"2024-09-12T19:19:48.182427+0000","last_became_active":"2024-09-12T18:19:22.648818+0000","last_became_peered":"2024-09-12T18:19:22.648818+0000","last_unstale":"2024-09-12T19:19:48.182427+0000","last_undegraded":"2024-09-12T19:19:48.182427+0000","last_fullsized":"2024-09-12T19:19:48.182427+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:23.776526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.988222+0000","last_change":"2024-09-12T17:51:59.954324+0000","last_active":"2024-09-12T19:20:42.988222+0000","last_peered":"2024-09-12T19:20:42.988222+0000","last_clean":"2024-09-12T19:20:42.988222+0000","last_became_active":"2024-09-12T17:51:59.953480+0000","last_became_peered":"2024-09-12T17:51:59.953480+0000","last_unstale":"2024-09-12T19:20:42.988222+0000","last_undegraded":"2024-09-12T19:20:42.988222+0000","last_fullsized":"2024-09-12T19:20:42.988222+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:03.945523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.264807+0000","last_change":"2024-09-12T17:51:52.886235+0000","last_active":"2024-09-12T19:20:33.264807+0000","last_peered":"2024-09-12T19:20:33.264807+0000","last_clean":"2024-09-12T19:20:33.264807+0000","last_became_active":"2024-09-12T17:51:52.884758+0000","last_became_peered":"2024-09-12T17:51:52.884758+0000","last_unstale":"2024-09-12T19:20:33.264807+0000","last_undegraded":"2024-09-12T19:20:33.264807+0000","last_fullsized":"2024-09-12T19:20:33.264807+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:14.092386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'17","reported_seq":121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.169851+0000","last_change":"2024-09-12T17:45:41.586061+0000","last_active":"2024-09-12T19:19:03.169851+0000","last_peered":"2024-09-12T19:19:03.169851+0000","last_clean":"2024-09-12T19:19:03.169851+0000","last_became_active":"2024-09-12T17:45:41.585259+0000","last_became_peered":"2024-09-12T17:45:41.585259+0000","last_unstale":"2024-09-12T19:19:03.169851+0000","last_undegraded":"2024-09-12T19:19:03.169851+0000","last_fullsized":"2024-09-12T19:19:03.169851+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:41.750928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":55,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.189074+0000","last_change":"2024-09-12T18:19:22.658645+0000","last_active":"2024-09-12T19:20:13.189074+0000","last_peered":"2024-09-12T19:20:13.189074+0000","last_clean":"2024-09-12T19:20:13.189074+0000","last_became_active":"2024-09-12T18:19:22.655117+0000","last_became_peered":"2024-09-12T18:19:22.655117+0000","last_unstale":"2024-09-12T19:20:13.189074+0000","last_undegraded":"2024-09-12T19:20:13.189074+0000","last_fullsized":"2024-09-12T19:20:13.189074+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:32.691865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:23.231264+0000","last_change":"2024-09-12T17:51:59.940572+0000","last_active":"2024-09-12T19:18:23.231264+0000","last_peered":"2024-09-12T19:18:23.231264+0000","last_clean":"2024-09-12T19:18:23.231264+0000","last_became_active":"2024-09-12T17:51:59.939751+0000","last_became_peered":"2024-09-12T17:51:59.939751+0000","last_unstale":"2024-09-12T19:18:23.231264+0000","last_undegraded":"2024-09-12T19:18:23.231264+0000","last_fullsized":"2024-09-12T19:18:23.231264+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:17.997521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.563717+0000","last_change":"2024-09-12T17:51:52.897941+0000","last_active":"2024-09-12T19:20:33.563717+0000","last_peered":"2024-09-12T19:20:33.563717+0000","last_clean":"2024-09-12T19:20:33.563717+0000","last_became_active":"2024-09-12T17:51:52.897168+0000","last_became_peered":"2024-09-12T17:51:52.897168+0000","last_unstale":"2024-09-12T19:20:33.563717+0000","last_undegraded":"2024-09-12T19:20:33.563717+0000","last_fullsized":"2024-09-12T19:20:33.563717+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:25.110112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'29","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.182170+0000","last_change":"2024-09-12T17:45:41.580462+0000","last_active":"2024-09-12T19:19:03.182170+0000","last_peered":"2024-09-12T19:19:03.182170+0000","last_clean":"2024-09-12T19:19:03.182170+0000","last_became_active":"2024-09-12T17:45:41.579765+0000","last_became_peered":"2024-09-12T17:45:41.579765+0000","last_unstale":"2024-09-12T19:19:03.182170+0000","last_undegraded":"2024-09-12T19:19:03.182170+0000","last_fullsized":"2024-09-12T19:19:03.182170+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:03.611178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":115,"num_write":41,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252289+0000","last_change":"2024-09-12T18:19:22.643191+0000","last_active":"2024-09-12T19:19:48.252289+0000","last_peered":"2024-09-12T19:19:48.252289+0000","last_clean":"2024-09-12T19:19:48.252289+0000","last_became_active":"2024-09-12T18:19:22.642415+0000","last_became_peered":"2024-09-12T18:19:22.642415+0000","last_unstale":"2024-09-12T19:19:48.252289+0000","last_undegraded":"2024-09-12T19:19:48.252289+0000","last_fullsized":"2024-09-12T19:19:48.252289+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:16.303449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:23.535948+0000","last_change":"2024-09-12T17:51:59.934455+0000","last_active":"2024-09-12T19:18:23.535948+0000","last_peered":"2024-09-12T19:18:23.535948+0000","last_clean":"2024-09-12T19:18:23.535948+0000","last_became_active":"2024-09-12T17:51:59.933679+0000","last_became_peered":"2024-09-12T17:51:59.933679+0000","last_unstale":"2024-09-12T19:18:23.535948+0000","last_undegraded":"2024-09-12T19:18:23.535948+0000","last_fullsized":"2024-09-12T19:18:23.535948+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:50.876767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"267'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:53.026201+0000","last_change":"2024-09-12T17:51:52.892730+0000","last_active":"2024-09-12T19:22:53.026201+0000","last_peered":"2024-09-12T19:22:53.026201+0000","last_clean":"2024-09-12T19:22:53.026201+0000","last_became_active":"2024-09-12T17:51:52.891977+0000","last_became_peered":"2024-09-12T17:51:52.891977+0000","last_unstale":"2024-09-12T19:22:53.026201+0000","last_undegraded":"2024-09-12T19:22:53.026201+0000","last_fullsized":"2024-09-12T19:22:53.026201+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:36.414562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'38","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.241715+0000","last_change":"2024-09-12T17:45:41.580119+0000","last_active":"2024-09-12T19:19:03.241715+0000","last_peered":"2024-09-12T19:19:03.241715+0000","last_clean":"2024-09-12T19:19:03.241715+0000","last_became_active":"2024-09-12T17:45:41.579275+0000","last_became_peered":"2024-09-12T17:45:41.579275+0000","last_unstale":"2024-09-12T19:19:03.241715+0000","last_undegraded":"2024-09-12T19:19:03.241715+0000","last_fullsized":"2024-09-12T19:19:03.241715+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:25.255989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":125,"num_write":71,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.534755+0000","last_change":"2024-09-12T18:19:22.657572+0000","last_active":"2024-09-12T19:20:08.534755+0000","last_peered":"2024-09-12T19:20:08.534755+0000","last_clean":"2024-09-12T19:20:08.534755+0000","last_became_active":"2024-09-12T18:19:22.656770+0000","last_became_peered":"2024-09-12T18:19:22.656770+0000","last_unstale":"2024-09-12T19:20:08.534755+0000","last_undegraded":"2024-09-12T19:20:08.534755+0000","last_fullsized":"2024-09-12T19:20:08.534755+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:58.749315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"267'4","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252315+0000","last_change":"2024-09-12T17:51:59.941713+0000","last_active":"2024-09-12T19:19:48.252315+0000","last_peered":"2024-09-12T19:19:48.252315+0000","last_clean":"2024-09-12T19:19:48.252315+0000","last_became_active":"2024-09-12T17:51:59.934972+0000","last_became_peered":"2024-09-12T17:51:59.934972+0000","last_unstale":"2024-09-12T19:19:48.252315+0000","last_undegraded":"2024-09-12T19:19:48.252315+0000","last_fullsized":"2024-09-12T19:19:48.252315+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:09.715388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":18432,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.962680+0000","last_change":"2024-09-12T17:51:52.901505+0000","last_active":"2024-09-12T19:19:37.962680+0000","last_peered":"2024-09-12T19:19:37.962680+0000","last_clean":"2024-09-12T19:19:37.962680+0000","last_became_active":"2024-09-12T17:51:52.900002+0000","last_became_peered":"2024-09-12T17:51:52.900002+0000","last_unstale":"2024-09-12T19:19:37.962680+0000","last_undegraded":"2024-09-12T19:19:37.962680+0000","last_fullsized":"2024-09-12T19:19:37.962680+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:16.493687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'34","reported_seq":174,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.265060+0000","last_change":"2024-09-12T17:45:41.581349+0000","last_active":"2024-09-12T19:20:33.265060+0000","last_peered":"2024-09-12T19:20:33.265060+0000","last_clean":"2024-09-12T19:20:33.265060+0000","last_became_active":"2024-09-12T17:45:41.580617+0000","last_became_peered":"2024-09-12T17:45:41.580617+0000","last_unstale":"2024-09-12T19:20:33.265060+0000","last_undegraded":"2024-09-12T19:20:33.265060+0000","last_fullsized":"2024-09-12T19:20:33.265060+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:04.951687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":129,"num_write":59,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:07.970075+0000","last_change":"2024-09-12T18:19:22.665735+0000","last_active":"2024-09-12T19:20:07.970075+0000","last_peered":"2024-09-12T19:20:07.970075+0000","last_clean":"2024-09-12T19:20:07.970075+0000","last_became_active":"2024-09-12T18:19:22.664960+0000","last_became_peered":"2024-09-12T18:19:22.664960+0000","last_unstale":"2024-09-12T19:20:07.970075+0000","last_undegraded":"2024-09-12T19:20:07.970075+0000","last_fullsized":"2024-09-12T19:20:07.970075+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:46.264476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'2","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252248+0000","last_change":"2024-09-12T17:51:59.949566+0000","last_active":"2024-09-12T19:19:48.252248+0000","last_peered":"2024-09-12T19:19:48.252248+0000","last_clean":"2024-09-12T19:19:48.252248+0000","last_became_active":"2024-09-12T17:51:59.948733+0000","last_became_peered":"2024-09-12T17:51:59.948733+0000","last_unstale":"2024-09-12T19:19:48.252248+0000","last_undegraded":"2024-09-12T19:19:48.252248+0000","last_fullsized":"2024-09-12T19:19:48.252248+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:47.852395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.528103+0000","last_change":"2024-09-12T17:51:52.905209+0000","last_active":"2024-09-12T19:19:38.528103+0000","last_peered":"2024-09-12T19:19:38.528103+0000","last_clean":"2024-09-12T19:19:38.528103+0000","last_became_active":"2024-09-12T17:51:52.904092+0000","last_became_peered":"2024-09-12T17:51:52.904092+0000","last_unstale":"2024-09-12T19:19:38.528103+0000","last_undegraded":"2024-09-12T19:19:38.528103+0000","last_fullsized":"2024-09-12T19:19:38.528103+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:00.570363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'87","reported_seq":311,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:12.988906+0000","last_change":"2024-09-12T17:45:41.578591+0000","last_active":"2024-09-12T19:20:12.988906+0000","last_peered":"2024-09-12T19:20:12.988906+0000","last_clean":"2024-09-12T19:20:12.988906+0000","last_became_active":"2024-09-12T17:45:41.574884+0000","last_became_peered":"2024-09-12T17:45:41.574884+0000","last_unstale":"2024-09-12T19:20:12.988906+0000","last_undegraded":"2024-09-12T19:20:12.988906+0000","last_fullsized":"2024-09-12T19:20:12.988906+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:26.324719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":442,"num_read_kb":315,"num_write":154,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.557025+0000","last_change":"2024-09-12T18:19:22.633163+0000","last_active":"2024-09-12T19:20:03.557025+0000","last_peered":"2024-09-12T19:20:03.557025+0000","last_clean":"2024-09-12T19:20:03.557025+0000","last_became_active":"2024-09-12T18:19:22.632360+0000","last_became_peered":"2024-09-12T18:19:22.632360+0000","last_unstale":"2024-09-12T19:20:03.557025+0000","last_undegraded":"2024-09-12T19:20:03.557025+0000","last_fullsized":"2024-09-12T19:20:03.557025+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:12.189773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'7","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:12.981953+0000","last_change":"2024-09-12T17:51:59.946265+0000","last_active":"2024-09-12T19:20:12.981953+0000","last_peered":"2024-09-12T19:20:12.981953+0000","last_clean":"2024-09-12T19:20:12.981953+0000","last_became_active":"2024-09-12T17:51:59.945099+0000","last_became_peered":"2024-09-12T17:51:59.945099+0000","last_unstale":"2024-09-12T19:20:12.981953+0000","last_undegraded":"2024-09-12T19:20:12.981953+0000","last_fullsized":"2024-09-12T19:20:12.981953+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:52.338695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.212670+0000","last_change":"2024-09-12T17:51:52.899779+0000","last_active":"2024-09-12T19:21:53.212670+0000","last_peered":"2024-09-12T19:21:53.212670+0000","last_clean":"2024-09-12T19:21:53.212670+0000","last_became_active":"2024-09-12T17:51:52.889772+0000","last_became_peered":"2024-09-12T17:51:52.889772+0000","last_unstale":"2024-09-12T19:21:53.212670+0000","last_undegraded":"2024-09-12T19:21:53.212670+0000","last_fullsized":"2024-09-12T19:21:53.212670+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:13.521012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'27","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.559281+0000","last_change":"2024-09-12T17:45:41.591605+0000","last_active":"2024-09-12T19:20:13.559281+0000","last_peered":"2024-09-12T19:20:13.559281+0000","last_clean":"2024-09-12T19:20:13.559281+0000","last_became_active":"2024-09-12T17:45:41.590861+0000","last_became_peered":"2024-09-12T17:45:41.590861+0000","last_unstale":"2024-09-12T19:20:13.559281+0000","last_undegraded":"2024-09-12T19:20:13.559281+0000","last_fullsized":"2024-09-12T19:20:13.559281+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:02.020910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":90,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968726+0000","last_change":"2024-09-12T18:19:22.656976+0000","last_active":"2024-09-12T19:20:02.968726+0000","last_peered":"2024-09-12T19:20:02.968726+0000","last_clean":"2024-09-12T19:20:02.968726+0000","last_became_active":"2024-09-12T18:19:22.655979+0000","last_became_peered":"2024-09-12T18:19:22.655979+0000","last_unstale":"2024-09-12T19:20:02.968726+0000","last_undegraded":"2024-09-12T19:20:02.968726+0000","last_fullsized":"2024-09-12T19:20:02.968726+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:36.624661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252347+0000","last_change":"2024-09-12T17:51:59.945983+0000","last_active":"2024-09-12T19:19:48.252347+0000","last_peered":"2024-09-12T19:19:48.252347+0000","last_clean":"2024-09-12T19:19:48.252347+0000","last_became_active":"2024-09-12T17:51:59.942431+0000","last_became_peered":"2024-09-12T17:51:59.942431+0000","last_unstale":"2024-09-12T19:19:48.252347+0000","last_undegraded":"2024-09-12T19:19:48.252347+0000","last_fullsized":"2024-09-12T19:19:48.252347+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:57.343792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5283025,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10320,"num_write":8,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:18.007302+0000","last_change":"2024-09-12T17:51:52.901374+0000","last_active":"2024-09-12T19:22:18.007302+0000","last_peered":"2024-09-12T19:22:18.007302+0000","last_clean":"2024-09-12T19:22:18.007302+0000","last_became_active":"2024-09-12T17:51:52.900785+0000","last_became_peered":"2024-09-12T17:51:52.900785+0000","last_unstale":"2024-09-12T19:22:18.007302+0000","last_undegraded":"2024-09-12T19:22:18.007302+0000","last_fullsized":"2024-09-12T19:22:18.007302+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:43.825575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'9","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.535920+0000","last_change":"2024-09-12T17:45:41.566506+0000","last_active":"2024-09-12T19:20:13.535920+0000","last_peered":"2024-09-12T19:20:13.535920+0000","last_clean":"2024-09-12T19:20:13.535920+0000","last_became_active":"2024-09-12T17:45:41.565793+0000","last_became_peered":"2024-09-12T17:45:41.565793+0000","last_unstale":"2024-09-12T19:20:13.535920+0000","last_undegraded":"2024-09-12T19:20:13.535920+0000","last_fullsized":"2024-09-12T19:20:13.535920+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:00.492098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.257645+0000","last_change":"2024-09-12T18:19:22.664289+0000","last_active":"2024-09-12T19:20:08.257645+0000","last_peered":"2024-09-12T19:20:08.257645+0000","last_clean":"2024-09-12T19:20:08.257645+0000","last_became_active":"2024-09-12T18:19:22.663586+0000","last_became_peered":"2024-09-12T18:19:22.663586+0000","last_unstale":"2024-09-12T19:20:08.257645+0000","last_undegraded":"2024-09-12T19:20:08.257645+0000","last_fullsized":"2024-09-12T19:20:08.257645+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:24.618521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:53.208011+0000","last_change":"2024-09-12T17:51:59.950216+0000","last_active":"2024-09-12T19:20:53.208011+0000","last_peered":"2024-09-12T19:20:53.208011+0000","last_clean":"2024-09-12T19:20:53.208011+0000","last_became_active":"2024-09-12T17:51:59.949437+0000","last_became_peered":"2024-09-12T17:51:59.949437+0000","last_unstale":"2024-09-12T19:20:53.208011+0000","last_undegraded":"2024-09-12T19:20:53.208011+0000","last_fullsized":"2024-09-12T19:20:53.208011+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:26.376958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:53.224729+0000","last_change":"2024-09-12T17:51:52.899343+0000","last_active":"2024-09-12T19:22:53.224729+0000","last_peered":"2024-09-12T19:22:53.224729+0000","last_clean":"2024-09-12T19:22:53.224729+0000","last_became_active":"2024-09-12T17:51:52.898903+0000","last_became_peered":"2024-09-12T17:51:52.898903+0000","last_unstale":"2024-09-12T19:22:53.224729+0000","last_undegraded":"2024-09-12T19:22:53.224729+0000","last_fullsized":"2024-09-12T19:22:53.224729+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:05.020501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'42","reported_seq":194,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.188942+0000","last_change":"2024-09-12T17:45:41.577630+0000","last_active":"2024-09-12T19:20:13.188942+0000","last_peered":"2024-09-12T19:20:13.188942+0000","last_clean":"2024-09-12T19:20:13.188942+0000","last_became_active":"2024-09-12T17:45:41.576921+0000","last_became_peered":"2024-09-12T17:45:41.576921+0000","last_unstale":"2024-09-12T19:20:13.188942+0000","last_undegraded":"2024-09-12T19:20:13.188942+0000","last_fullsized":"2024-09-12T19:20:13.188942+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:39.622331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":172,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:22.973830+0000","last_change":"2024-09-12T18:19:22.670182+0000","last_active":"2024-09-12T19:20:22.973830+0000","last_peered":"2024-09-12T19:20:22.973830+0000","last_clean":"2024-09-12T19:20:22.973830+0000","last_became_active":"2024-09-12T18:19:22.669476+0000","last_became_peered":"2024-09-12T18:19:22.669476+0000","last_unstale":"2024-09-12T19:20:22.973830+0000","last_undegraded":"2024-09-12T19:20:22.973830+0000","last_fullsized":"2024-09-12T19:20:22.973830+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:51.189488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:52.980628+0000","last_change":"2024-09-12T17:51:59.939499+0000","last_active":"2024-09-12T19:20:52.980628+0000","last_peered":"2024-09-12T19:20:52.980628+0000","last_clean":"2024-09-12T19:20:52.980628+0000","last_became_active":"2024-09-12T17:51:59.938736+0000","last_became_peered":"2024-09-12T17:51:59.938736+0000","last_unstale":"2024-09-12T19:20:52.980628+0000","last_undegraded":"2024-09-12T19:20:52.980628+0000","last_fullsized":"2024-09-12T19:20:52.980628+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:10.628111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'2","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:53.014895+0000","last_change":"2024-09-12T17:51:52.901410+0000","last_active":"2024-09-12T19:22:53.014895+0000","last_peered":"2024-09-12T19:22:53.014895+0000","last_clean":"2024-09-12T19:22:53.014895+0000","last_became_active":"2024-09-12T17:51:52.900972+0000","last_became_peered":"2024-09-12T17:51:52.900972+0000","last_unstale":"2024-09-12T19:22:53.014895+0000","last_undegraded":"2024-09-12T19:22:53.014895+0000","last_fullsized":"2024-09-12T19:22:53.014895+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:55.522541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'26","reported_seq":147,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:12.956617+0000","last_change":"2024-09-12T17:45:41.588736+0000","last_active":"2024-09-12T19:19:12.956617+0000","last_peered":"2024-09-12T19:19:12.956617+0000","last_clean":"2024-09-12T19:19:12.956617+0000","last_became_active":"2024-09-12T17:45:41.588013+0000","last_became_peered":"2024-09-12T17:45:41.588013+0000","last_unstale":"2024-09-12T19:19:12.956617+0000","last_undegraded":"2024-09-12T19:19:12.956617+0000","last_fullsized":"2024-09-12T19:19:12.956617+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:46.460159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":89,"num_write":52,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:07.970160+0000","last_change":"2024-09-12T18:19:22.664050+0000","last_active":"2024-09-12T19:20:07.970160+0000","last_peered":"2024-09-12T19:20:07.970160+0000","last_clean":"2024-09-12T19:20:07.970160+0000","last_became_active":"2024-09-12T18:19:22.662685+0000","last_became_peered":"2024-09-12T18:19:22.662685+0000","last_unstale":"2024-09-12T19:20:07.970160+0000","last_undegraded":"2024-09-12T19:20:07.970160+0000","last_fullsized":"2024-09-12T19:20:07.970160+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:20.137876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'10","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.864488+0000","last_change":"2024-09-12T17:51:59.943267+0000","last_active":"2024-09-12T19:22:59.864488+0000","last_peered":"2024-09-12T19:22:59.864488+0000","last_clean":"2024-09-12T19:22:59.864488+0000","last_became_active":"2024-09-12T17:51:59.942597+0000","last_became_peered":"2024-09-12T17:51:59.942597+0000","last_unstale":"2024-09-12T19:22:59.864488+0000","last_undegraded":"2024-09-12T19:22:59.864488+0000","last_fullsized":"2024-09-12T19:22:59.864488+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:04.930513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":29698,"num_write":10,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"267'3","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:58.200287+0000","last_change":"2024-09-12T17:51:52.908849+0000","last_active":"2024-09-12T19:20:58.200287+0000","last_peered":"2024-09-12T19:20:58.200287+0000","last_clean":"2024-09-12T19:20:58.200287+0000","last_became_active":"2024-09-12T17:51:52.908200+0000","last_became_peered":"2024-09-12T17:51:52.908200+0000","last_unstale":"2024-09-12T19:20:58.200287+0000","last_undegraded":"2024-09-12T19:20:58.200287+0000","last_fullsized":"2024-09-12T19:20:58.200287+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:57.469586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'15","reported_seq":118,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.239287+0000","last_change":"2024-09-12T17:45:41.578047+0000","last_active":"2024-09-12T19:18:53.239287+0000","last_peered":"2024-09-12T19:18:53.239287+0000","last_clean":"2024-09-12T19:18:53.239287+0000","last_became_active":"2024-09-12T17:45:41.572067+0000","last_became_peered":"2024-09-12T17:45:41.572067+0000","last_unstale":"2024-09-12T19:18:53.239287+0000","last_undegraded":"2024-09-12T19:18:53.239287+0000","last_fullsized":"2024-09-12T19:18:53.239287+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:00.575546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.187554+0000","last_change":"2024-09-12T18:19:22.653075+0000","last_active":"2024-09-12T19:20:08.187554+0000","last_peered":"2024-09-12T19:20:08.187554+0000","last_clean":"2024-09-12T19:20:08.187554+0000","last_became_active":"2024-09-12T18:19:22.648052+0000","last_became_peered":"2024-09-12T18:19:22.648052+0000","last_unstale":"2024-09-12T19:20:08.187554+0000","last_undegraded":"2024-09-12T19:20:08.187554+0000","last_fullsized":"2024-09-12T19:20:08.187554+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:19.707016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"267'8","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.988426+0000","last_change":"2024-09-12T17:51:59.949619+0000","last_active":"2024-09-12T19:22:58.988426+0000","last_peered":"2024-09-12T19:22:58.988426+0000","last_clean":"2024-09-12T19:22:58.988426+0000","last_became_active":"2024-09-12T17:51:59.948873+0000","last_became_peered":"2024-09-12T17:51:59.948873+0000","last_unstale":"2024-09-12T19:22:58.988426+0000","last_undegraded":"2024-09-12T19:22:58.988426+0000","last_fullsized":"2024-09-12T19:22:58.988426+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:03.402596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.190557+0000","last_change":"2024-09-12T17:51:52.890333+0000","last_active":"2024-09-12T19:19:38.190557+0000","last_peered":"2024-09-12T19:19:38.190557+0000","last_clean":"2024-09-12T19:19:38.190557+0000","last_became_active":"2024-09-12T17:51:52.889529+0000","last_became_peered":"2024-09-12T17:51:52.889529+0000","last_unstale":"2024-09-12T19:19:38.190557+0000","last_undegraded":"2024-09-12T19:19:38.190557+0000","last_fullsized":"2024-09-12T19:19:38.190557+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:16.334887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'21","reported_seq":135,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.542152+0000","last_change":"2024-09-12T17:45:41.580279+0000","last_active":"2024-09-12T19:18:53.542152+0000","last_peered":"2024-09-12T19:18:53.542152+0000","last_clean":"2024-09-12T19:18:53.542152+0000","last_became_active":"2024-09-12T17:45:41.579580+0000","last_became_peered":"2024-09-12T17:45:41.579580+0000","last_unstale":"2024-09-12T19:18:53.542152+0000","last_undegraded":"2024-09-12T19:18:53.542152+0000","last_fullsized":"2024-09-12T19:18:53.542152+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:43.960745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":77,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.964979+0000","last_change":"2024-09-12T18:19:22.669927+0000","last_active":"2024-09-12T19:19:47.964979+0000","last_peered":"2024-09-12T19:19:47.964979+0000","last_clean":"2024-09-12T19:19:47.964979+0000","last_became_active":"2024-09-12T18:19:22.669240+0000","last_became_peered":"2024-09-12T18:19:22.669240+0000","last_unstale":"2024-09-12T19:19:47.964979+0000","last_undegraded":"2024-09-12T19:19:47.964979+0000","last_fullsized":"2024-09-12T19:19:47.964979+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:35.739210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.182370+0000","last_change":"2024-09-12T17:51:59.970451+0000","last_active":"2024-09-12T19:19:48.182370+0000","last_peered":"2024-09-12T19:19:48.182370+0000","last_clean":"2024-09-12T19:19:48.182370+0000","last_became_active":"2024-09-12T17:51:59.969706+0000","last_became_peered":"2024-09-12T17:51:59.969706+0000","last_unstale":"2024-09-12T19:19:48.182370+0000","last_undegraded":"2024-09-12T19:19:48.182370+0000","last_fullsized":"2024-09-12T19:19:48.182370+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:53.849725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'6","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959065+0000","last_change":"2024-09-12T17:51:52.884785+0000","last_active":"2024-09-12T19:19:22.959065+0000","last_peered":"2024-09-12T19:19:22.959065+0000","last_clean":"2024-09-12T19:19:22.959065+0000","last_became_active":"2024-09-12T17:51:52.884061+0000","last_became_peered":"2024-09-12T17:51:52.884061+0000","last_unstale":"2024-09-12T19:19:22.959065+0000","last_undegraded":"2024-09-12T19:19:22.959065+0000","last_fullsized":"2024-09-12T19:19:22.959065+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:17.943043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'29","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.167345+0000","last_change":"2024-09-12T17:45:41.573958+0000","last_active":"2024-09-12T19:18:53.167345+0000","last_peered":"2024-09-12T19:18:53.167345+0000","last_clean":"2024-09-12T19:18:53.167345+0000","last_became_active":"2024-09-12T17:45:41.572130+0000","last_became_peered":"2024-09-12T17:45:41.572130+0000","last_unstale":"2024-09-12T19:18:53.167345+0000","last_undegraded":"2024-09-12T19:18:53.167345+0000","last_fullsized":"2024-09-12T19:18:53.167345+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:19.465432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":63,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.982479+0000","last_change":"2024-09-12T18:19:22.667322+0000","last_active":"2024-09-12T19:19:47.982479+0000","last_peered":"2024-09-12T19:19:47.982479+0000","last_clean":"2024-09-12T19:19:47.982479+0000","last_became_active":"2024-09-12T18:19:22.666608+0000","last_became_peered":"2024-09-12T18:19:22.666608+0000","last_unstale":"2024-09-12T19:19:47.982479+0000","last_undegraded":"2024-09-12T19:19:47.982479+0000","last_fullsized":"2024-09-12T19:19:47.982479+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:35.427234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.178096+0000","last_change":"2024-09-12T17:51:59.956619+0000","last_active":"2024-09-12T19:19:33.178096+0000","last_peered":"2024-09-12T19:19:33.178096+0000","last_clean":"2024-09-12T19:19:33.178096+0000","last_became_active":"2024-09-12T17:51:59.956010+0000","last_became_peered":"2024-09-12T17:51:59.956010+0000","last_unstale":"2024-09-12T19:19:33.178096+0000","last_undegraded":"2024-09-12T19:19:33.178096+0000","last_fullsized":"2024-09-12T19:19:33.178096+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:44.171788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'2","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.527059+0000","last_change":"2024-09-12T17:51:52.904694+0000","last_active":"2024-09-12T19:19:33.527059+0000","last_peered":"2024-09-12T19:19:33.527059+0000","last_clean":"2024-09-12T19:19:33.527059+0000","last_became_active":"2024-09-12T17:51:52.903355+0000","last_became_peered":"2024-09-12T17:51:52.903355+0000","last_unstale":"2024-09-12T19:19:33.527059+0000","last_undegraded":"2024-09-12T19:19:33.527059+0000","last_fullsized":"2024-09-12T19:19:33.527059+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:54.768969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'38","reported_seq":184,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.542289+0000","last_change":"2024-09-12T17:45:41.578036+0000","last_active":"2024-09-12T19:18:53.542289+0000","last_peered":"2024-09-12T19:18:53.542289+0000","last_clean":"2024-09-12T19:18:53.542289+0000","last_became_active":"2024-09-12T17:45:41.577322+0000","last_became_peered":"2024-09-12T17:45:41.577322+0000","last_unstale":"2024-09-12T19:18:53.542289+0000","last_undegraded":"2024-09-12T19:18:53.542289+0000","last_fullsized":"2024-09-12T19:18:53.542289+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:32.631509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":139,"num_write":67,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.973565+0000","last_change":"2024-09-12T18:19:22.652387+0000","last_active":"2024-09-12T19:19:37.973565+0000","last_peered":"2024-09-12T19:19:37.973565+0000","last_clean":"2024-09-12T19:19:37.973565+0000","last_became_active":"2024-09-12T18:19:22.647003+0000","last_became_peered":"2024-09-12T18:19:22.647003+0000","last_unstale":"2024-09-12T19:19:37.973565+0000","last_undegraded":"2024-09-12T19:19:37.973565+0000","last_fullsized":"2024-09-12T19:19:37.973565+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:55.195971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.986890+0000","last_change":"2024-09-12T17:51:59.940082+0000","last_active":"2024-09-12T19:22:58.986890+0000","last_peered":"2024-09-12T19:22:58.986890+0000","last_clean":"2024-09-12T19:22:58.986890+0000","last_became_active":"2024-09-12T17:51:59.939200+0000","last_became_peered":"2024-09-12T17:51:59.939200+0000","last_unstale":"2024-09-12T19:22:58.986890+0000","last_undegraded":"2024-09-12T19:22:58.986890+0000","last_fullsized":"2024-09-12T19:22:58.986890+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:37.667275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"267'6","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.988584+0000","last_change":"2024-09-12T17:51:52.897536+0000","last_active":"2024-09-12T19:22:58.988584+0000","last_peered":"2024-09-12T19:22:58.988584+0000","last_clean":"2024-09-12T19:22:58.988584+0000","last_became_active":"2024-09-12T17:51:52.896708+0000","last_became_peered":"2024-09-12T17:51:52.896708+0000","last_unstale":"2024-09-12T19:22:58.988584+0000","last_undegraded":"2024-09-12T19:22:58.988584+0000","last_fullsized":"2024-09-12T19:22:58.988584+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:36.334907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'29","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.965069+0000","last_change":"2024-09-12T17:45:41.592647+0000","last_active":"2024-09-12T19:19:47.965069+0000","last_peered":"2024-09-12T19:19:47.965069+0000","last_clean":"2024-09-12T19:19:47.965069+0000","last_became_active":"2024-09-12T17:45:41.591866+0000","last_became_peered":"2024-09-12T17:45:41.591866+0000","last_unstale":"2024-09-12T19:19:47.965069+0000","last_undegraded":"2024-09-12T19:19:47.965069+0000","last_fullsized":"2024-09-12T19:19:47.965069+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:29.840636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.192729+0000","last_change":"2024-09-12T18:19:22.661674+0000","last_active":"2024-09-12T19:19:48.192729+0000","last_peered":"2024-09-12T19:19:48.192729+0000","last_clean":"2024-09-12T19:19:48.192729+0000","last_became_active":"2024-09-12T18:19:22.660667+0000","last_became_peered":"2024-09-12T18:19:22.660667+0000","last_unstale":"2024-09-12T19:19:48.192729+0000","last_undegraded":"2024-09-12T19:19:48.192729+0000","last_fullsized":"2024-09-12T19:19:48.192729+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:47.455186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:53.208174+0000","last_change":"2024-09-12T17:51:59.949737+0000","last_active":"2024-09-12T19:20:53.208174+0000","last_peered":"2024-09-12T19:20:53.208174+0000","last_clean":"2024-09-12T19:20:53.208174+0000","last_became_active":"2024-09-12T17:51:59.948786+0000","last_became_peered":"2024-09-12T17:51:59.948786+0000","last_unstale":"2024-09-12T19:20:53.208174+0000","last_undegraded":"2024-09-12T19:20:53.208174+0000","last_fullsized":"2024-09-12T19:20:53.208174+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:33.491621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.978565+0000","last_change":"2024-09-12T17:51:52.896511+0000","last_active":"2024-09-12T19:20:42.978565+0000","last_peered":"2024-09-12T19:20:42.978565+0000","last_clean":"2024-09-12T19:20:42.978565+0000","last_became_active":"2024-09-12T17:51:52.895779+0000","last_became_peered":"2024-09-12T17:51:52.895779+0000","last_unstale":"2024-09-12T19:20:42.978565+0000","last_undegraded":"2024-09-12T19:20:42.978565+0000","last_fullsized":"2024-09-12T19:20:42.978565+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:11.529897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'43","reported_seq":205,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:27.971388+0000","last_change":"2024-09-12T17:45:41.584723+0000","last_active":"2024-09-12T19:19:27.971388+0000","last_peered":"2024-09-12T19:19:27.971388+0000","last_clean":"2024-09-12T19:19:27.971388+0000","last_became_active":"2024-09-12T17:45:41.576707+0000","last_became_peered":"2024-09-12T17:45:41.576707+0000","last_unstale":"2024-09-12T19:19:27.971388+0000","last_undegraded":"2024-09-12T19:19:27.971388+0000","last_fullsized":"2024-09-12T19:19:27.971388+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:31.487354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":167,"num_write":65,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.533665+0000","last_change":"2024-09-12T18:19:22.658620+0000","last_active":"2024-09-12T19:20:03.533665+0000","last_peered":"2024-09-12T19:20:03.533665+0000","last_clean":"2024-09-12T19:20:03.533665+0000","last_became_active":"2024-09-12T18:19:22.657891+0000","last_became_peered":"2024-09-12T18:19:22.657891+0000","last_unstale":"2024-09-12T19:20:03.533665+0000","last_undegraded":"2024-09-12T19:20:03.533665+0000","last_fullsized":"2024-09-12T19:20:03.533665+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:56.867297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:32.972545+0000","last_change":"2024-09-12T17:51:59.963668+0000","last_active":"2024-09-12T19:19:32.972545+0000","last_peered":"2024-09-12T19:19:32.972545+0000","last_clean":"2024-09-12T19:19:32.972545+0000","last_became_active":"2024-09-12T17:51:59.962769+0000","last_became_peered":"2024-09-12T17:51:59.962769+0000","last_unstale":"2024-09-12T19:19:32.972545+0000","last_undegraded":"2024-09-12T19:19:32.972545+0000","last_fullsized":"2024-09-12T19:19:32.972545+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:25.342532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'5","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:12.971293+0000","last_change":"2024-09-12T17:51:52.902253+0000","last_active":"2024-09-12T19:20:12.971293+0000","last_peered":"2024-09-12T19:20:12.971293+0000","last_clean":"2024-09-12T19:20:12.971293+0000","last_became_active":"2024-09-12T17:51:52.899987+0000","last_became_peered":"2024-09-12T17:51:52.899987+0000","last_unstale":"2024-09-12T19:20:12.971293+0000","last_undegraded":"2024-09-12T19:20:12.971293+0000","last_fullsized":"2024-09-12T19:20:12.971293+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:40.914632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'9","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:27.978145+0000","last_change":"2024-09-12T17:45:41.571623+0000","last_active":"2024-09-12T19:19:27.978145+0000","last_peered":"2024-09-12T19:19:27.978145+0000","last_clean":"2024-09-12T19:19:27.978145+0000","last_became_active":"2024-09-12T17:45:41.569871+0000","last_became_peered":"2024-09-12T17:45:41.569871+0000","last_unstale":"2024-09-12T19:19:27.978145+0000","last_undegraded":"2024-09-12T19:19:27.978145+0000","last_fullsized":"2024-09-12T19:19:27.978145+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:49.201478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.186072+0000","last_change":"2024-09-12T18:19:22.663293+0000","last_active":"2024-09-12T19:20:03.186072+0000","last_peered":"2024-09-12T19:20:03.186072+0000","last_clean":"2024-09-12T19:20:03.186072+0000","last_became_active":"2024-09-12T18:19:22.648018+0000","last_became_peered":"2024-09-12T18:19:22.648018+0000","last_unstale":"2024-09-12T19:20:03.186072+0000","last_undegraded":"2024-09-12T19:20:03.186072+0000","last_fullsized":"2024-09-12T19:20:03.186072+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:02.291028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'7","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.992212+0000","last_change":"2024-09-12T17:51:59.944498+0000","last_active":"2024-09-12T19:20:27.992212+0000","last_peered":"2024-09-12T19:20:27.992212+0000","last_clean":"2024-09-12T19:20:27.992212+0000","last_became_active":"2024-09-12T17:51:59.943764+0000","last_became_peered":"2024-09-12T17:51:59.943764+0000","last_unstale":"2024-09-12T19:20:27.992212+0000","last_undegraded":"2024-09-12T19:20:27.992212+0000","last_fullsized":"2024-09-12T19:20:27.992212+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:10.664480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20800,"num_write":12,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.958933+0000","last_change":"2024-09-12T17:51:52.894510+0000","last_active":"2024-09-12T19:19:22.958933+0000","last_peered":"2024-09-12T19:19:22.958933+0000","last_clean":"2024-09-12T19:19:22.958933+0000","last_became_active":"2024-09-12T17:51:52.893764+0000","last_became_peered":"2024-09-12T17:51:52.893764+0000","last_unstale":"2024-09-12T19:19:22.958933+0000","last_undegraded":"2024-09-12T19:19:22.958933+0000","last_fullsized":"2024-09-12T19:19:22.958933+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:33.064325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'85","reported_seq":313,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:28.188253+0000","last_change":"2024-09-12T17:45:41.579106+0000","last_active":"2024-09-12T19:19:28.188253+0000","last_peered":"2024-09-12T19:19:28.188253+0000","last_clean":"2024-09-12T19:19:28.188253+0000","last_became_active":"2024-09-12T17:45:41.576079+0000","last_became_peered":"2024-09-12T17:45:41.576079+0000","last_unstale":"2024-09-12T19:19:28.188253+0000","last_undegraded":"2024-09-12T19:19:28.188253+0000","last_fullsized":"2024-09-12T19:19:28.188253+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:21.619591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":312,"num_write":160,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.182314+0000","last_change":"2024-09-12T18:19:22.663744+0000","last_active":"2024-09-12T19:19:48.182314+0000","last_peered":"2024-09-12T19:19:48.182314+0000","last_clean":"2024-09-12T19:19:48.182314+0000","last_became_active":"2024-09-12T18:19:22.662955+0000","last_became_peered":"2024-09-12T18:19:22.662955+0000","last_unstale":"2024-09-12T19:19:48.182314+0000","last_undegraded":"2024-09-12T19:19:48.182314+0000","last_fullsized":"2024-09-12T19:19:48.182314+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:06.958542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.550710+0000","last_change":"2024-09-12T17:51:59.943709+0000","last_active":"2024-09-12T19:19:33.550710+0000","last_peered":"2024-09-12T19:19:33.550710+0000","last_clean":"2024-09-12T19:19:33.550710+0000","last_became_active":"2024-09-12T17:51:59.942275+0000","last_became_peered":"2024-09-12T17:51:59.942275+0000","last_unstale":"2024-09-12T19:19:33.550710+0000","last_undegraded":"2024-09-12T19:19:33.550710+0000","last_fullsized":"2024-09-12T19:19:33.550710+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:15.298466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.970211+0000","last_change":"2024-09-12T17:51:52.896451+0000","last_active":"2024-09-12T19:19:22.970211+0000","last_peered":"2024-09-12T19:19:22.970211+0000","last_clean":"2024-09-12T19:19:22.970211+0000","last_became_active":"2024-09-12T17:51:52.895913+0000","last_became_peered":"2024-09-12T17:51:52.895913+0000","last_unstale":"2024-09-12T19:19:22.970211+0000","last_undegraded":"2024-09-12T19:19:22.970211+0000","last_fullsized":"2024-09-12T19:19:22.970211+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:21.249149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'8","reported_seq":102,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:28.549494+0000","last_change":"2024-09-12T17:45:41.577598+0000","last_active":"2024-09-12T19:19:28.549494+0000","last_peered":"2024-09-12T19:19:28.549494+0000","last_clean":"2024-09-12T19:19:28.549494+0000","last_became_active":"2024-09-12T17:45:41.576841+0000","last_became_peered":"2024-09-12T17:45:41.576841+0000","last_unstale":"2024-09-12T19:19:28.549494+0000","last_undegraded":"2024-09-12T19:19:28.549494+0000","last_fullsized":"2024-09-12T19:19:28.549494+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:40.378322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968901+0000","last_change":"2024-09-12T18:19:22.663672+0000","last_active":"2024-09-12T19:20:02.968901+0000","last_peered":"2024-09-12T19:20:02.968901+0000","last_clean":"2024-09-12T19:20:02.968901+0000","last_became_active":"2024-09-12T18:19:22.662633+0000","last_became_peered":"2024-09-12T18:19:22.662633+0000","last_unstale":"2024-09-12T19:20:02.968901+0000","last_undegraded":"2024-09-12T19:20:02.968901+0000","last_fullsized":"2024-09-12T19:20:02.968901+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:40.210719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.189287+0000","last_change":"2024-09-12T17:51:59.929795+0000","last_active":"2024-09-12T19:19:33.189287+0000","last_peered":"2024-09-12T19:19:33.189287+0000","last_clean":"2024-09-12T19:19:33.189287+0000","last_became_active":"2024-09-12T17:51:59.929108+0000","last_became_peered":"2024-09-12T17:51:59.929108+0000","last_unstale":"2024-09-12T19:19:33.189287+0000","last_undegraded":"2024-09-12T19:19:33.189287+0000","last_fullsized":"2024-09-12T19:19:33.189287+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:42.206076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"267'1","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:23.548516+0000","last_change":"2024-09-12T17:51:52.883949+0000","last_active":"2024-09-12T19:19:23.548516+0000","last_peered":"2024-09-12T19:19:23.548516+0000","last_clean":"2024-09-12T19:19:23.548516+0000","last_became_active":"2024-09-12T17:51:52.876809+0000","last_became_peered":"2024-09-12T17:51:52.876809+0000","last_unstale":"2024-09-12T19:19:23.548516+0000","last_undegraded":"2024-09-12T19:19:23.548516+0000","last_fullsized":"2024-09-12T19:19:23.548516+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:43.734348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4960,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":5,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'24","reported_seq":146,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968654+0000","last_change":"2024-09-12T17:45:41.588350+0000","last_active":"2024-09-12T19:20:02.968654+0000","last_peered":"2024-09-12T19:20:02.968654+0000","last_clean":"2024-09-12T19:20:02.968654+0000","last_became_active":"2024-09-12T17:45:41.587464+0000","last_became_peered":"2024-09-12T17:45:41.587464+0000","last_unstale":"2024-09-12T19:20:02.968654+0000","last_undegraded":"2024-09-12T19:20:02.968654+0000","last_fullsized":"2024-09-12T19:20:02.968654+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:57.305993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":80,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'298","reported_seq":949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.953141+0000","last_change":"2024-09-12T17:29:52.756359+0000","last_active":"2024-09-12T19:23:01.953141+0000","last_peered":"2024-09-12T19:23:01.953141+0000","last_clean":"2024-09-12T19:23:01.953141+0000","last_became_active":"2024-09-12T17:29:52.754920+0000","last_became_peered":"2024-09-12T17:29:52.754920+0000","last_unstale":"2024-09-12T19:23:01.953141+0000","last_undegraded":"2024-09-12T19:23:01.953141+0000","last_fullsized":"2024-09-12T19:23:01.953141+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:04.557129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262253,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":663,"num_write":1055,"num_write_kb":22160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'506","reported_seq":2205,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.033717+0000","last_change":"2024-09-12T17:29:54.761709+0000","last_active":"2024-09-12T19:22:45.033717+0000","last_peered":"2024-09-12T19:22:45.033717+0000","last_clean":"2024-09-12T19:22:45.033717+0000","last_became_active":"2024-09-12T17:29:54.760892+0000","last_became_peered":"2024-09-12T17:29:54.760892+0000","last_unstale":"2024-09-12T19:22:45.033717+0000","last_undegraded":"2024-09-12T19:22:45.033717+0000","last_fullsized":"2024-09-12T19:22:45.033717+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:41.865266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2904,"num_read_kb":2740,"num_write":620,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'340","reported_seq":1028,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.906791+0000","last_change":"2024-09-12T17:29:52.748073+0000","last_active":"2024-09-12T19:23:01.906791+0000","last_peered":"2024-09-12T19:23:01.906791+0000","last_clean":"2024-09-12T19:23:01.906791+0000","last_became_active":"2024-09-12T17:29:52.747481+0000","last_became_peered":"2024-09-12T17:29:52.747481+0000","last_unstale":"2024-09-12T19:23:01.906791+0000","last_undegraded":"2024-09-12T19:23:01.906791+0000","last_fullsized":"2024-09-12T19:23:01.906791+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:09.939962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306162,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":522,"num_read_kb":19278,"num_write":1123,"num_write_kb":29260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'430","reported_seq":1893,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.967478+0000","last_change":"2024-09-12T17:29:54.754770+0000","last_active":"2024-09-12T19:19:57.967478+0000","last_peered":"2024-09-12T19:19:57.967478+0000","last_clean":"2024-09-12T19:19:57.967478+0000","last_became_active":"2024-09-12T17:29:54.753272+0000","last_became_peered":"2024-09-12T17:29:54.753272+0000","last_unstale":"2024-09-12T19:19:57.967478+0000","last_undegraded":"2024-09-12T19:19:57.967478+0000","last_fullsized":"2024-09-12T19:19:57.967478+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:02.705919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2129,"num_read_kb":2000,"num_write":496,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'342","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.943225+0000","last_change":"2024-09-12T17:29:52.736428+0000","last_active":"2024-09-12T19:23:01.943225+0000","last_peered":"2024-09-12T19:23:01.943225+0000","last_clean":"2024-09-12T19:23:01.943225+0000","last_became_active":"2024-09-12T17:29:52.735978+0000","last_became_peered":"2024-09-12T17:29:52.735978+0000","last_unstale":"2024-09-12T19:23:01.943225+0000","last_undegraded":"2024-09-12T19:23:01.943225+0000","last_fullsized":"2024-09-12T19:23:01.943225+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:58.103754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2553570,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":504,"num_read_kb":35253,"num_write":1107,"num_write_kb":35855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'935","reported_seq":2602,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.437432+0000","last_change":"2024-09-12T17:29:54.771720+0000","last_active":"2024-09-12T19:21:21.437432+0000","last_peered":"2024-09-12T19:21:21.437432+0000","last_clean":"2024-09-12T19:21:21.437432+0000","last_became_active":"2024-09-12T17:29:54.770286+0000","last_became_peered":"2024-09-12T17:29:54.770286+0000","last_unstale":"2024-09-12T19:21:21.437432+0000","last_undegraded":"2024-09-12T19:21:21.437432+0000","last_fullsized":"2024-09-12T19:21:21.437432+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":900,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:38.926608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4498,"num_read_kb":4029,"num_write":1285,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'344","reported_seq":1087,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.957130+0000","last_change":"2024-09-12T17:30:21.690086+0000","last_active":"2024-09-12T19:23:01.957130+0000","last_peered":"2024-09-12T19:23:01.957130+0000","last_clean":"2024-09-12T19:23:01.957130+0000","last_became_active":"2024-09-12T17:30:21.689546+0000","last_became_peered":"2024-09-12T17:30:21.689546+0000","last_unstale":"2024-09-12T19:23:01.957130+0000","last_undegraded":"2024-09-12T19:23:01.957130+0000","last_fullsized":"2024-09-12T19:23:01.957130+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:14.185451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170253,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":648,"num_read_kb":124307,"num_write":1100,"num_write_kb":33866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7,2],"acting":[1,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"267'841","reported_seq":2480,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.726477+0000","last_change":"2024-09-12T17:29:54.760698+0000","last_active":"2024-09-12T19:20:03.726477+0000","last_peered":"2024-09-12T19:20:03.726477+0000","last_clean":"2024-09-12T19:20:03.726477+0000","last_became_active":"2024-09-12T17:29:54.760180+0000","last_became_peered":"2024-09-12T17:29:54.760180+0000","last_unstale":"2024-09-12T19:20:03.726477+0000","last_undegraded":"2024-09-12T19:20:03.726477+0000","last_fullsized":"2024-09-12T19:20:03.726477+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:44.225987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3987,"num_read_kb":3603,"num_write":1097,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'364","reported_seq":1008,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.958299+0000","last_change":"2024-09-12T17:29:52.750742+0000","last_active":"2024-09-12T19:23:01.958299+0000","last_peered":"2024-09-12T19:23:01.958299+0000","last_clean":"2024-09-12T19:23:01.958299+0000","last_became_active":"2024-09-12T17:29:52.744115+0000","last_became_peered":"2024-09-12T17:29:52.744115+0000","last_unstale":"2024-09-12T19:23:01.958299+0000","last_undegraded":"2024-09-12T19:23:01.958299+0000","last_fullsized":"2024-09-12T19:23:01.958299+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:24.050332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262269,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":11709,"num_write":1093,"num_write_kb":63153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'869","reported_seq":2502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.934290+0000","last_change":"2024-09-12T17:29:54.759304+0000","last_active":"2024-09-12T19:20:27.934290+0000","last_peered":"2024-09-12T19:20:27.934290+0000","last_clean":"2024-09-12T19:20:27.934290+0000","last_became_active":"2024-09-12T17:29:54.758552+0000","last_became_peered":"2024-09-12T17:29:54.758552+0000","last_unstale":"2024-09-12T19:20:27.934290+0000","last_undegraded":"2024-09-12T19:20:27.934290+0000","last_fullsized":"2024-09-12T19:20:27.934290+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:33.584027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4049,"num_read_kb":3640,"num_write":1140,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'353","reported_seq":1017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.900610+0000","last_change":"2024-09-12T17:29:52.762266+0000","last_active":"2024-09-12T19:23:01.900610+0000","last_peered":"2024-09-12T19:23:01.900610+0000","last_clean":"2024-09-12T19:23:01.900610+0000","last_became_active":"2024-09-12T17:29:52.756242+0000","last_became_peered":"2024-09-12T17:29:52.756242+0000","last_unstale":"2024-09-12T19:23:01.900610+0000","last_undegraded":"2024-09-12T19:23:01.900610+0000","last_fullsized":"2024-09-12T19:23:01.900610+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:47.783235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311546,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":527,"num_read_kb":10971,"num_write":1015,"num_write_kb":29590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'390","reported_seq":1980,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.933638+0000","last_change":"2024-09-12T17:29:54.770914+0000","last_active":"2024-09-12T19:20:27.933638+0000","last_peered":"2024-09-12T19:20:27.933638+0000","last_clean":"2024-09-12T19:20:27.933638+0000","last_became_active":"2024-09-12T17:29:54.770050+0000","last_became_peered":"2024-09-12T17:29:54.770050+0000","last_unstale":"2024-09-12T19:20:27.933638+0000","last_undegraded":"2024-09-12T19:20:27.933638+0000","last_fullsized":"2024-09-12T19:20:27.933638+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:43.841653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2225,"num_read_kb":2129,"num_write":425,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'366","reported_seq":1019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.985420+0000","last_change":"2024-09-12T17:29:52.767237+0000","last_active":"2024-09-12T19:23:01.985420+0000","last_peered":"2024-09-12T19:23:01.985420+0000","last_clean":"2024-09-12T19:23:01.985420+0000","last_became_active":"2024-09-12T17:29:52.762473+0000","last_became_peered":"2024-09-12T17:29:52.762473+0000","last_unstale":"2024-09-12T19:23:01.985420+0000","last_undegraded":"2024-09-12T19:23:01.985420+0000","last_fullsized":"2024-09-12T19:23:01.985420+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:30.353609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25719,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":480,"num_read_kb":16012,"num_write":1030,"num_write_kb":47372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'480","reported_seq":2013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.021704+0000","last_change":"2024-09-12T17:29:54.746687+0000","last_active":"2024-09-12T19:22:45.021704+0000","last_peered":"2024-09-12T19:22:45.021704+0000","last_clean":"2024-09-12T19:22:45.021704+0000","last_became_active":"2024-09-12T17:29:54.745833+0000","last_became_peered":"2024-09-12T17:29:54.745833+0000","last_unstale":"2024-09-12T19:22:45.021704+0000","last_undegraded":"2024-09-12T19:22:45.021704+0000","last_fullsized":"2024-09-12T19:22:45.021704+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:20.546304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2543,"num_read_kb":2369,"num_write":601,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'273","reported_seq":1051,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:53.253193+0000","last_change":"2024-09-12T17:29:52.730557+0000","last_active":"2024-09-12T19:19:53.253193+0000","last_peered":"2024-09-12T19:19:53.253193+0000","last_clean":"2024-09-12T19:19:53.253193+0000","last_became_active":"2024-09-12T17:29:52.730010+0000","last_became_peered":"2024-09-12T17:29:52.730010+0000","last_unstale":"2024-09-12T19:19:53.253193+0000","last_undegraded":"2024-09-12T19:19:53.253193+0000","last_fullsized":"2024-09-12T19:19:53.253193+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:31.862041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6872421,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":547,"num_read_kb":14958,"num_write":1022,"num_write_kb":34324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'422","reported_seq":2021,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.137760+0000","last_change":"2024-09-12T17:29:54.756031+0000","last_active":"2024-09-12T19:21:19.137760+0000","last_peered":"2024-09-12T19:21:19.137760+0000","last_clean":"2024-09-12T19:21:19.137760+0000","last_became_active":"2024-09-12T17:29:54.755721+0000","last_became_peered":"2024-09-12T17:29:54.755721+0000","last_unstale":"2024-09-12T19:21:19.137760+0000","last_undegraded":"2024-09-12T19:21:19.137760+0000","last_fullsized":"2024-09-12T19:21:19.137760+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:26.559449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2342,"num_read_kb":2221,"num_write":470,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'360","reported_seq":1930,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.146565+0000","last_change":"2024-09-12T17:29:54.756918+0000","last_active":"2024-09-12T19:21:19.146565+0000","last_peered":"2024-09-12T19:21:19.146565+0000","last_clean":"2024-09-12T19:21:19.146565+0000","last_became_active":"2024-09-12T17:29:54.753012+0000","last_became_peered":"2024-09-12T17:29:54.753012+0000","last_unstale":"2024-09-12T19:21:19.146565+0000","last_undegraded":"2024-09-12T19:21:19.146565+0000","last_fullsized":"2024-09-12T19:21:19.146565+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:44.419129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2149,"num_read_kb":2071,"num_write":395,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'362","reported_seq":1046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.876903+0000","last_change":"2024-09-12T17:29:52.751176+0000","last_active":"2024-09-12T19:23:01.876903+0000","last_peered":"2024-09-12T19:23:01.876903+0000","last_clean":"2024-09-12T19:23:01.876903+0000","last_became_active":"2024-09-12T17:29:52.747589+0000","last_became_peered":"2024-09-12T17:29:52.747589+0000","last_unstale":"2024-09-12T19:23:01.876903+0000","last_undegraded":"2024-09-12T19:23:01.876903+0000","last_fullsized":"2024-09-12T19:23:01.876903+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:03.234800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":507,"num_read_kb":50487,"num_write":1096,"num_write_kb":29653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'423","reported_seq":1988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.900038+0000","last_change":"2024-09-12T17:29:54.754021+0000","last_active":"2024-09-12T19:21:55.900038+0000","last_peered":"2024-09-12T19:21:55.900038+0000","last_clean":"2024-09-12T19:21:55.900038+0000","last_became_active":"2024-09-12T17:29:54.752373+0000","last_became_peered":"2024-09-12T17:29:54.752373+0000","last_unstale":"2024-09-12T19:21:55.900038+0000","last_undegraded":"2024-09-12T19:21:55.900038+0000","last_fullsized":"2024-09-12T19:21:55.900038+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:55.036481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2327,"num_read_kb":2222,"num_write":465,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'284","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:33.723963+0000","last_change":"2024-09-12T17:30:22.256707+0000","last_active":"2024-09-12T19:22:33.723963+0000","last_peered":"2024-09-12T19:22:33.723963+0000","last_clean":"2024-09-12T19:22:33.723963+0000","last_became_active":"2024-09-12T17:30:22.255773+0000","last_became_peered":"2024-09-12T17:30:22.255773+0000","last_unstale":"2024-09-12T19:22:33.723963+0000","last_undegraded":"2024-09-12T19:22:33.723963+0000","last_fullsized":"2024-09-12T19:22:33.723963+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:57.570475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16120849,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":789,"num_read_kb":51978,"num_write":1091,"num_write_kb":60983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2,1],"acting":[3,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.32","version":"267'526","reported_seq":2179,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.901319+0000","last_change":"2024-09-12T17:29:54.773260+0000","last_active":"2024-09-12T19:21:55.901319+0000","last_peered":"2024-09-12T19:21:55.901319+0000","last_clean":"2024-09-12T19:21:55.901319+0000","last_became_active":"2024-09-12T17:29:54.771786+0000","last_became_peered":"2024-09-12T17:29:54.771786+0000","last_unstale":"2024-09-12T19:21:55.901319+0000","last_undegraded":"2024-09-12T19:21:55.901319+0000","last_fullsized":"2024-09-12T19:21:55.901319+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:21.472732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2657,"num_read_kb":2482,"num_write":638,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'372","reported_seq":1177,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:17.145386+0000","last_change":"2024-09-12T17:29:52.732747+0000","last_active":"2024-09-12T19:20:17.145386+0000","last_peered":"2024-09-12T19:20:17.145386+0000","last_clean":"2024-09-12T19:20:17.145386+0000","last_became_active":"2024-09-12T17:29:52.725473+0000","last_became_peered":"2024-09-12T17:29:52.725473+0000","last_unstale":"2024-09-12T19:20:17.145386+0000","last_undegraded":"2024-09-12T19:20:17.145386+0000","last_fullsized":"2024-09-12T19:20:17.145386+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:09.986286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14900598,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":868,"num_read_kb":41903,"num_write":1346,"num_write_kb":44280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'655","reported_seq":2279,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.719735+0000","last_change":"2024-09-12T17:29:54.754617+0000","last_active":"2024-09-12T19:20:03.719735+0000","last_peered":"2024-09-12T19:20:03.719735+0000","last_clean":"2024-09-12T19:20:03.719735+0000","last_became_active":"2024-09-12T17:29:54.754119+0000","last_became_peered":"2024-09-12T17:29:54.754119+0000","last_unstale":"2024-09-12T19:20:03.719735+0000","last_undegraded":"2024-09-12T19:20:03.719735+0000","last_fullsized":"2024-09-12T19:20:03.719735+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":600,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:21.492662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3376,"num_read_kb":3085,"num_write":861,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'319","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.973912+0000","last_change":"2024-09-12T17:29:52.764999+0000","last_active":"2024-09-12T19:23:01.973912+0000","last_peered":"2024-09-12T19:23:01.973912+0000","last_clean":"2024-09-12T19:23:01.973912+0000","last_became_active":"2024-09-12T17:29:52.764052+0000","last_became_peered":"2024-09-12T17:29:52.764052+0000","last_unstale":"2024-09-12T19:23:01.973912+0000","last_undegraded":"2024-09-12T19:23:01.973912+0000","last_fullsized":"2024-09-12T19:23:01.973912+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:13.155680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":477,"num_read_kb":61037,"num_write":999,"num_write_kb":13603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'891","reported_seq":2453,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.721020+0000","last_change":"2024-09-12T17:29:54.761081+0000","last_active":"2024-09-12T19:20:03.721020+0000","last_peered":"2024-09-12T19:20:03.721020+0000","last_clean":"2024-09-12T19:20:03.721020+0000","last_became_active":"2024-09-12T17:29:54.760746+0000","last_became_peered":"2024-09-12T17:29:54.760746+0000","last_unstale":"2024-09-12T19:20:03.721020+0000","last_undegraded":"2024-09-12T19:20:03.721020+0000","last_fullsized":"2024-09-12T19:20:03.721020+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:53.411177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4106,"num_read_kb":3659,"num_write":1202,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'310","reported_seq":999,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:38.235481+0000","last_change":"2024-09-12T17:29:52.721435+0000","last_active":"2024-09-12T19:18:38.235481+0000","last_peered":"2024-09-12T19:18:38.235481+0000","last_clean":"2024-09-12T19:18:38.235481+0000","last_became_active":"2024-09-12T17:29:52.720974+0000","last_became_peered":"2024-09-12T17:29:52.720974+0000","last_unstale":"2024-09-12T19:18:38.235481+0000","last_undegraded":"2024-09-12T19:18:38.235481+0000","last_fullsized":"2024-09-12T19:18:38.235481+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:05.898096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9129257,"num_objects":89,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":514,"num_read_kb":19633,"num_write":1149,"num_write_kb":34097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'744","reported_seq":2333,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.010273+0000","last_change":"2024-09-12T17:29:54.757481+0000","last_active":"2024-09-12T19:22:45.010273+0000","last_peered":"2024-09-12T19:22:45.010273+0000","last_clean":"2024-09-12T19:22:45.010273+0000","last_became_active":"2024-09-12T17:29:54.756675+0000","last_became_peered":"2024-09-12T17:29:54.756675+0000","last_unstale":"2024-09-12T19:22:45.010273+0000","last_undegraded":"2024-09-12T19:22:45.010273+0000","last_fullsized":"2024-09-12T19:22:45.010273+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:30.640890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3670,"num_read_kb":3349,"num_write":979,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'350","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.946835+0000","last_change":"2024-09-12T17:29:52.767402+0000","last_active":"2024-09-12T19:23:01.946835+0000","last_peered":"2024-09-12T19:23:01.946835+0000","last_clean":"2024-09-12T19:23:01.946835+0000","last_became_active":"2024-09-12T17:29:52.766959+0000","last_became_peered":"2024-09-12T17:29:52.766959+0000","last_unstale":"2024-09-12T19:23:01.946835+0000","last_undegraded":"2024-09-12T19:23:01.946835+0000","last_fullsized":"2024-09-12T19:23:01.946835+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:19.932278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":468,"num_read_kb":494,"num_write":1113,"num_write_kb":20716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'130","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.666477+0000","last_change":"2024-09-12T17:30:02.803588+0000","last_active":"2024-09-12T19:21:21.666477+0000","last_peered":"2024-09-12T19:21:21.666477+0000","last_clean":"2024-09-12T19:21:21.666477+0000","last_became_active":"2024-09-12T17:30:02.802659+0000","last_became_peered":"2024-09-12T17:30:02.802659+0000","last_unstale":"2024-09-12T19:21:21.666477+0000","last_undegraded":"2024-09-12T19:21:21.666477+0000","last_fullsized":"2024-09-12T19:21:21.666477+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:05.775037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":169,"num_write":297,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'432","reported_seq":2018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:14.631110+0000","last_change":"2024-09-12T17:29:54.758798+0000","last_active":"2024-09-12T19:20:14.631110+0000","last_peered":"2024-09-12T19:20:14.631110+0000","last_clean":"2024-09-12T19:20:14.631110+0000","last_became_active":"2024-09-12T17:29:54.758303+0000","last_became_peered":"2024-09-12T17:29:54.758303+0000","last_unstale":"2024-09-12T19:20:14.631110+0000","last_undegraded":"2024-09-12T19:20:14.631110+0000","last_fullsized":"2024-09-12T19:20:14.631110+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:43.384034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2323,"num_read_kb":2196,"num_write":494,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'401","reported_seq":1112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.757287+0000","last_change":"2024-09-12T17:29:52.755910+0000","last_active":"2024-09-12T19:23:01.757287+0000","last_peered":"2024-09-12T19:23:01.757287+0000","last_clean":"2024-09-12T19:23:01.757287+0000","last_became_active":"2024-09-12T17:29:52.755103+0000","last_became_peered":"2024-09-12T17:29:52.755103+0000","last_unstale":"2024-09-12T19:23:01.757287+0000","last_undegraded":"2024-09-12T19:23:01.757287+0000","last_fullsized":"2024-09-12T19:23:01.757287+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:39.921239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524450,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":671,"num_read_kb":34526,"num_write":1327,"num_write_kb":26646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:42.965930+0000","last_change":"2024-09-12T17:29:56.764275+0000","last_active":"2024-09-12T19:18:42.965930+0000","last_peered":"2024-09-12T19:18:42.965930+0000","last_clean":"2024-09-12T19:18:42.965930+0000","last_became_active":"2024-09-12T17:29:56.763547+0000","last_became_peered":"2024-09-12T17:29:56.763547+0000","last_unstale":"2024-09-12T19:18:42.965930+0000","last_undegraded":"2024-09-12T19:18:42.965930+0000","last_fullsized":"2024-09-12T19:18:42.965930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:50.827569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'387","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.933998+0000","last_change":"2024-09-12T17:29:58.780660+0000","last_active":"2024-09-12T19:23:01.933998+0000","last_peered":"2024-09-12T19:23:01.933998+0000","last_clean":"2024-09-12T19:23:01.933998+0000","last_became_active":"2024-09-12T17:29:58.777554+0000","last_became_peered":"2024-09-12T17:29:58.777554+0000","last_unstale":"2024-09-12T19:23:01.933998+0000","last_undegraded":"2024-09-12T19:23:01.933998+0000","last_fullsized":"2024-09-12T19:23:01.933998+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:45.028521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45863,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":1229,"num_write":480,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:47.950949+0000","last_change":"2024-09-12T17:30:00.806462+0000","last_active":"2024-09-12T19:18:47.950949+0000","last_peered":"2024-09-12T19:18:47.950949+0000","last_clean":"2024-09-12T19:18:47.950949+0000","last_became_active":"2024-09-12T17:30:00.805568+0000","last_became_peered":"2024-09-12T17:30:00.805568+0000","last_unstale":"2024-09-12T19:18:47.950949+0000","last_undegraded":"2024-09-12T19:18:47.950949+0000","last_fullsized":"2024-09-12T19:18:47.950949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:19.223415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'145","reported_seq":724,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.098828+0000","last_change":"2024-09-12T17:30:02.786275+0000","last_active":"2024-09-12T19:20:28.098828+0000","last_peered":"2024-09-12T19:20:28.098828+0000","last_clean":"2024-09-12T19:20:28.098828+0000","last_became_active":"2024-09-12T17:30:02.785212+0000","last_became_peered":"2024-09-12T17:30:02.785212+0000","last_unstale":"2024-09-12T19:20:28.098828+0000","last_undegraded":"2024-09-12T19:20:28.098828+0000","last_fullsized":"2024-09-12T19:20:28.098828+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:15.216332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":252,"num_read_kb":243,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'682","reported_seq":2548,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.376127+0000","last_change":"2024-09-12T17:29:54.763192+0000","last_active":"2024-09-12T19:21:21.376127+0000","last_peered":"2024-09-12T19:21:21.376127+0000","last_clean":"2024-09-12T19:21:21.376127+0000","last_became_active":"2024-09-12T17:29:54.761497+0000","last_became_peered":"2024-09-12T17:29:54.761497+0000","last_unstale":"2024-09-12T19:21:21.376127+0000","last_undegraded":"2024-09-12T19:21:21.376127+0000","last_fullsized":"2024-09-12T19:21:21.376127+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":600,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:10.152526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3854,"num_read_kb":3534,"num_write":981,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'373","reported_seq":1046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.969152+0000","last_change":"2024-09-12T17:29:52.714312+0000","last_active":"2024-09-12T19:23:01.969152+0000","last_peered":"2024-09-12T19:23:01.969152+0000","last_clean":"2024-09-12T19:23:01.969152+0000","last_became_active":"2024-09-12T17:29:52.713938+0000","last_became_peered":"2024-09-12T17:29:52.713938+0000","last_unstale":"2024-09-12T19:23:01.969152+0000","last_undegraded":"2024-09-12T19:23:01.969152+0000","last_fullsized":"2024-09-12T19:23:01.969152+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:41.597689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460272,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":10309,"num_write":1260,"num_write_kb":32712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.256354+0000","last_change":"2024-09-12T17:29:56.776910+0000","last_active":"2024-09-12T19:20:03.256354+0000","last_peered":"2024-09-12T19:20:03.256354+0000","last_clean":"2024-09-12T19:20:03.256354+0000","last_became_active":"2024-09-12T17:29:56.776335+0000","last_became_peered":"2024-09-12T17:29:56.776335+0000","last_unstale":"2024-09-12T19:20:03.256354+0000","last_undegraded":"2024-09-12T19:20:03.256354+0000","last_fullsized":"2024-09-12T19:20:03.256354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:54.362260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'120","reported_seq":694,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:50.316180+0000","last_change":"2024-09-12T17:29:58.778467+0000","last_active":"2024-09-12T19:20:50.316180+0000","last_peered":"2024-09-12T19:20:50.316180+0000","last_clean":"2024-09-12T19:20:50.316180+0000","last_became_active":"2024-09-12T17:29:58.777883+0000","last_became_peered":"2024-09-12T17:29:58.777883+0000","last_unstale":"2024-09-12T19:20:50.316180+0000","last_undegraded":"2024-09-12T19:20:50.316180+0000","last_fullsized":"2024-09-12T19:20:50.316180+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:33.007083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:48.179069+0000","last_change":"2024-09-12T17:30:00.782290+0000","last_active":"2024-09-12T19:18:48.179069+0000","last_peered":"2024-09-12T19:18:48.179069+0000","last_clean":"2024-09-12T19:18:48.179069+0000","last_became_active":"2024-09-12T17:30:00.781554+0000","last_became_peered":"2024-09-12T17:30:00.781554+0000","last_unstale":"2024-09-12T19:18:48.179069+0000","last_undegraded":"2024-09-12T19:18:48.179069+0000","last_fullsized":"2024-09-12T19:18:48.179069+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:16.914242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'118","reported_seq":660,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.731504+0000","last_change":"2024-09-12T17:30:02.806243+0000","last_active":"2024-09-12T19:21:21.731504+0000","last_peered":"2024-09-12T19:21:21.731504+0000","last_clean":"2024-09-12T19:21:21.731504+0000","last_became_active":"2024-09-12T17:30:02.805556+0000","last_became_peered":"2024-09-12T17:30:02.805556+0000","last_unstale":"2024-09-12T19:21:21.731504+0000","last_undegraded":"2024-09-12T19:21:21.731504+0000","last_fullsized":"2024-09-12T19:21:21.731504+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:10.526393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":177,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'907","reported_seq":2534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:35.932561+0000","last_change":"2024-09-12T17:29:54.752472+0000","last_active":"2024-09-12T19:19:35.932561+0000","last_peered":"2024-09-12T19:19:35.932561+0000","last_clean":"2024-09-12T19:19:35.932561+0000","last_became_active":"2024-09-12T17:29:54.751997+0000","last_became_peered":"2024-09-12T17:29:54.751997+0000","last_unstale":"2024-09-12T19:19:35.932561+0000","last_undegraded":"2024-09-12T19:19:35.932561+0000","last_fullsized":"2024-09-12T19:19:35.932561+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":800,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:22.947507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4250,"num_read_kb":3802,"num_write":1203,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'368","reported_seq":1085,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.941483+0000","last_change":"2024-09-12T17:29:52.762803+0000","last_active":"2024-09-12T19:23:01.941483+0000","last_peered":"2024-09-12T19:23:01.941483+0000","last_clean":"2024-09-12T19:23:01.941483+0000","last_became_active":"2024-09-12T17:29:52.762149+0000","last_became_peered":"2024-09-12T17:29:52.762149+0000","last_unstale":"2024-09-12T19:23:01.941483+0000","last_undegraded":"2024-09-12T19:23:01.941483+0000","last_fullsized":"2024-09-12T19:23:01.941483+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:00.553936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":626,"num_read_kb":63082,"num_write":1322,"num_write_kb":27819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.236790+0000","last_change":"2024-09-12T17:29:56.762319+0000","last_active":"2024-09-12T19:18:43.236790+0000","last_peered":"2024-09-12T19:18:43.236790+0000","last_clean":"2024-09-12T19:18:43.236790+0000","last_became_active":"2024-09-12T17:29:56.761027+0000","last_became_peered":"2024-09-12T17:29:56.761027+0000","last_unstale":"2024-09-12T19:18:43.236790+0000","last_undegraded":"2024-09-12T19:18:43.236790+0000","last_fullsized":"2024-09-12T19:18:43.236790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:25.029553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'172","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:51.961304+0000","last_change":"2024-09-12T17:29:58.770614+0000","last_active":"2024-09-12T19:20:51.961304+0000","last_peered":"2024-09-12T19:20:51.961304+0000","last_clean":"2024-09-12T19:20:51.961304+0000","last_became_active":"2024-09-12T17:29:58.769889+0000","last_became_peered":"2024-09-12T17:29:58.769889+0000","last_unstale":"2024-09-12T19:20:51.961304+0000","last_undegraded":"2024-09-12T19:20:51.961304+0000","last_fullsized":"2024-09-12T19:20:51.961304+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:01.639009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'756","reported_seq":3324,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.884918+0000","last_change":"2024-09-12T17:30:00.810692+0000","last_active":"2024-09-12T19:22:58.884918+0000","last_peered":"2024-09-12T19:22:58.884918+0000","last_clean":"2024-09-12T19:22:58.884918+0000","last_became_active":"2024-09-12T17:30:00.810030+0000","last_became_peered":"2024-09-12T17:30:00.810030+0000","last_unstale":"2024-09-12T19:22:58.884918+0000","last_undegraded":"2024-09-12T19:22:58.884918+0000","last_fullsized":"2024-09-12T19:22:58.884918+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:18.541833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'206","reported_seq":1064,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.854762+0000","last_change":"2024-09-12T17:30:02.807819+0000","last_active":"2024-09-12T19:21:21.854762+0000","last_peered":"2024-09-12T19:21:21.854762+0000","last_clean":"2024-09-12T19:21:21.854762+0000","last_became_active":"2024-09-12T17:30:02.803144+0000","last_became_peered":"2024-09-12T17:30:02.803144+0000","last_unstale":"2024-09-12T19:21:21.854762+0000","last_undegraded":"2024-09-12T19:21:21.854762+0000","last_fullsized":"2024-09-12T19:21:21.854762+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:22.571499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":674,"num_read_kb":661,"num_write":463,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'413","reported_seq":2070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.356713+0000","last_change":"2024-09-12T17:29:54.762812+0000","last_active":"2024-09-12T19:21:21.356713+0000","last_peered":"2024-09-12T19:21:21.356713+0000","last_clean":"2024-09-12T19:21:21.356713+0000","last_became_active":"2024-09-12T17:29:54.762448+0000","last_became_peered":"2024-09-12T17:29:54.762448+0000","last_unstale":"2024-09-12T19:21:21.356713+0000","last_undegraded":"2024-09-12T19:21:21.356713+0000","last_fullsized":"2024-09-12T19:21:21.356713+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:00.556614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2329,"num_read_kb":2238,"num_write":469,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'277","reported_seq":940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.550601+0000","last_change":"2024-09-12T17:29:52.740127+0000","last_active":"2024-09-12T19:19:33.550601+0000","last_peered":"2024-09-12T19:19:33.550601+0000","last_clean":"2024-09-12T19:19:33.550601+0000","last_became_active":"2024-09-12T17:29:52.738957+0000","last_became_peered":"2024-09-12T17:29:52.738957+0000","last_unstale":"2024-09-12T19:19:33.550601+0000","last_undegraded":"2024-09-12T19:19:33.550601+0000","last_fullsized":"2024-09-12T19:19:33.550601+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:50.808537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6340313,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":453,"num_read_kb":16175,"num_write":1086,"num_write_kb":26946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:42.966023+0000","last_change":"2024-09-12T17:29:56.757650+0000","last_active":"2024-09-12T19:18:42.966023+0000","last_peered":"2024-09-12T19:18:42.966023+0000","last_clean":"2024-09-12T19:18:42.966023+0000","last_became_active":"2024-09-12T17:29:56.755730+0000","last_became_peered":"2024-09-12T17:29:56.755730+0000","last_unstale":"2024-09-12T19:18:42.966023+0000","last_undegraded":"2024-09-12T19:18:42.966023+0000","last_fullsized":"2024-09-12T19:18:42.966023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:23.463400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'322","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.554435+0000","last_change":"2024-09-12T17:29:58.829682+0000","last_active":"2024-09-12T19:23:01.554435+0000","last_peered":"2024-09-12T19:23:01.554435+0000","last_clean":"2024-09-12T19:23:01.554435+0000","last_became_active":"2024-09-12T17:29:58.829021+0000","last_became_peered":"2024-09-12T17:29:58.829021+0000","last_unstale":"2024-09-12T19:23:01.554435+0000","last_undegraded":"2024-09-12T19:23:01.554435+0000","last_fullsized":"2024-09-12T19:23:01.554435+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:56.407873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49018,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":1196,"num_write":438,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'810","reported_seq":3020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.295056+0000","last_change":"2024-09-12T17:30:00.794188+0000","last_active":"2024-09-12T19:22:46.295056+0000","last_peered":"2024-09-12T19:22:46.295056+0000","last_clean":"2024-09-12T19:22:46.295056+0000","last_became_active":"2024-09-12T17:30:00.793067+0000","last_became_peered":"2024-09-12T17:30:00.793067+0000","last_unstale":"2024-09-12T19:22:46.295056+0000","last_undegraded":"2024-09-12T19:22:46.295056+0000","last_fullsized":"2024-09-12T19:22:46.295056+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:26.995446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'523","reported_seq":2063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.442210+0000","last_change":"2024-09-12T17:29:54.766898+0000","last_active":"2024-09-12T19:21:21.442210+0000","last_peered":"2024-09-12T19:21:21.442210+0000","last_clean":"2024-09-12T19:21:21.442210+0000","last_became_active":"2024-09-12T17:29:54.766092+0000","last_became_peered":"2024-09-12T17:29:54.766092+0000","last_unstale":"2024-09-12T19:21:21.442210+0000","last_undegraded":"2024-09-12T19:21:21.442210+0000","last_fullsized":"2024-09-12T19:21:21.442210+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:01.060409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2636,"num_read_kb":2418,"num_write":649,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'353","reported_seq":1039,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.895862+0000","last_change":"2024-09-12T17:29:52.762735+0000","last_active":"2024-09-12T19:23:01.895862+0000","last_peered":"2024-09-12T19:23:01.895862+0000","last_clean":"2024-09-12T19:23:01.895862+0000","last_became_active":"2024-09-12T17:29:52.757326+0000","last_became_peered":"2024-09-12T17:29:52.757326+0000","last_unstale":"2024-09-12T19:23:01.895862+0000","last_undegraded":"2024-09-12T19:23:01.895862+0000","last_fullsized":"2024-09-12T19:23:01.895862+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:34.150960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730145,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":565,"num_read_kb":12520,"num_write":1100,"num_write_kb":32977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.974785+0000","last_change":"2024-09-12T17:29:56.769344+0000","last_active":"2024-09-12T19:20:27.974785+0000","last_peered":"2024-09-12T19:20:27.974785+0000","last_clean":"2024-09-12T19:20:27.974785+0000","last_became_active":"2024-09-12T17:29:56.768267+0000","last_became_peered":"2024-09-12T17:29:56.768267+0000","last_unstale":"2024-09-12T19:20:27.974785+0000","last_undegraded":"2024-09-12T19:20:27.974785+0000","last_fullsized":"2024-09-12T19:20:27.974785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:14.841905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'452","reported_seq":1143,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.315539+0000","last_change":"2024-09-12T17:29:58.834050+0000","last_active":"2024-09-12T19:22:59.315539+0000","last_peered":"2024-09-12T19:22:59.315539+0000","last_clean":"2024-09-12T19:22:59.315539+0000","last_became_active":"2024-09-12T17:29:58.833291+0000","last_became_peered":"2024-09-12T17:29:58.833291+0000","last_unstale":"2024-09-12T19:22:59.315539+0000","last_undegraded":"2024-09-12T19:22:59.315539+0000","last_fullsized":"2024-09-12T19:22:59.315539+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:23.364120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60505,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":721,"num_read_kb":1312,"num_write":540,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:17.982998+0000","last_change":"2024-09-12T17:30:00.810543+0000","last_active":"2024-09-12T19:20:17.982998+0000","last_peered":"2024-09-12T19:20:17.982998+0000","last_clean":"2024-09-12T19:20:17.982998+0000","last_became_active":"2024-09-12T17:30:00.809914+0000","last_became_peered":"2024-09-12T17:30:00.809914+0000","last_unstale":"2024-09-12T19:20:17.982998+0000","last_undegraded":"2024-09-12T19:20:17.982998+0000","last_fullsized":"2024-09-12T19:20:17.982998+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:44.935436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'548","reported_seq":1404,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.253948+0000","last_change":"2024-09-12T17:30:02.797843+0000","last_active":"2024-09-12T19:22:46.253948+0000","last_peered":"2024-09-12T19:22:46.253948+0000","last_clean":"2024-09-12T19:22:46.253948+0000","last_became_active":"2024-09-12T17:30:02.797046+0000","last_became_peered":"2024-09-12T17:30:02.797046+0000","last_unstale":"2024-09-12T19:22:46.253948+0000","last_undegraded":"2024-09-12T19:22:46.253948+0000","last_fullsized":"2024-09-12T19:22:46.253948+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:58.930778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1413,"num_read_kb":1390,"num_write":1179,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'480","reported_seq":2156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.202292+0000","last_change":"2024-09-12T17:29:54.756840+0000","last_active":"2024-09-12T19:20:28.202292+0000","last_peered":"2024-09-12T19:20:28.202292+0000","last_clean":"2024-09-12T19:20:28.202292+0000","last_became_active":"2024-09-12T17:29:54.754517+0000","last_became_peered":"2024-09-12T17:29:54.754517+0000","last_unstale":"2024-09-12T19:20:28.202292+0000","last_undegraded":"2024-09-12T19:20:28.202292+0000","last_fullsized":"2024-09-12T19:20:28.202292+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:21.909735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2565,"num_read_kb":2417,"num_write":558,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'317","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.891150+0000","last_change":"2024-09-12T17:29:52.761247+0000","last_active":"2024-09-12T19:23:01.891150+0000","last_peered":"2024-09-12T19:23:01.891150+0000","last_clean":"2024-09-12T19:23:01.891150+0000","last_became_active":"2024-09-12T17:29:52.760711+0000","last_became_peered":"2024-09-12T17:29:52.760711+0000","last_unstale":"2024-09-12T19:23:01.891150+0000","last_undegraded":"2024-09-12T19:23:01.891150+0000","last_fullsized":"2024-09-12T19:23:01.891150+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:21.789117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759519,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":447,"num_read_kb":40999,"num_write":1044,"num_write_kb":42394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.538942+0000","last_change":"2024-09-12T17:29:56.758473+0000","last_active":"2024-09-12T19:20:28.538942+0000","last_peered":"2024-09-12T19:20:28.538942+0000","last_clean":"2024-09-12T19:20:28.538942+0000","last_became_active":"2024-09-12T17:29:56.757805+0000","last_became_peered":"2024-09-12T17:29:56.757805+0000","last_unstale":"2024-09-12T19:20:28.538942+0000","last_undegraded":"2024-09-12T19:20:28.538942+0000","last_fullsized":"2024-09-12T19:20:28.538942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:32.794119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'299","reported_seq":917,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:33.290790+0000","last_change":"2024-09-12T17:29:58.774261+0000","last_active":"2024-09-12T19:22:33.290790+0000","last_peered":"2024-09-12T19:22:33.290790+0000","last_clean":"2024-09-12T19:22:33.290790+0000","last_became_active":"2024-09-12T17:29:58.773959+0000","last_became_peered":"2024-09-12T17:29:58.773959+0000","last_unstale":"2024-09-12T19:22:33.290790+0000","last_undegraded":"2024-09-12T19:22:33.290790+0000","last_fullsized":"2024-09-12T19:22:33.290790+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:53.591898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56650,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":967,"num_write":394,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:48.237729+0000","last_change":"2024-09-12T17:30:00.792690+0000","last_active":"2024-09-12T19:18:48.237729+0000","last_peered":"2024-09-12T19:18:48.237729+0000","last_clean":"2024-09-12T19:18:48.237729+0000","last_became_active":"2024-09-12T17:30:00.792138+0000","last_became_peered":"2024-09-12T17:30:00.792138+0000","last_unstale":"2024-09-12T19:18:48.237729+0000","last_undegraded":"2024-09-12T19:18:48.237729+0000","last_fullsized":"2024-09-12T19:18:48.237729+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:12.058912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2476","reported_seq":4391,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.257061+0000","last_change":"2024-09-12T17:30:02.801585+0000","last_active":"2024-09-12T19:22:46.257061+0000","last_peered":"2024-09-12T19:22:46.257061+0000","last_clean":"2024-09-12T19:22:46.257061+0000","last_became_active":"2024-09-12T17:30:02.800860+0000","last_became_peered":"2024-09-12T17:30:02.800860+0000","last_unstale":"2024-09-12T19:22:46.257061+0000","last_undegraded":"2024-09-12T19:22:46.257061+0000","last_fullsized":"2024-09-12T19:22:46.257061+0000","mapping_epoch":36,"log_start":"267'2400","ondisk_log_start":"267'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":2400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:23.192552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6373,"num_read_kb":6312,"num_write":5027,"num_write_kb":1835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'430","reported_seq":2068,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.148759+0000","last_change":"2024-09-12T17:29:54.770302+0000","last_active":"2024-09-12T19:21:19.148759+0000","last_peered":"2024-09-12T19:21:19.148759+0000","last_clean":"2024-09-12T19:21:19.148759+0000","last_became_active":"2024-09-12T17:29:54.769541+0000","last_became_peered":"2024-09-12T17:29:54.769541+0000","last_unstale":"2024-09-12T19:21:19.148759+0000","last_undegraded":"2024-09-12T19:21:19.148759+0000","last_fullsized":"2024-09-12T19:21:19.148759+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:46.646360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2445,"num_read_kb":2340,"num_write":496,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'273","reported_seq":948,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:59.167804+0000","last_change":"2024-09-12T17:30:21.794660+0000","last_active":"2024-09-12T19:20:59.167804+0000","last_peered":"2024-09-12T19:20:59.167804+0000","last_clean":"2024-09-12T19:20:59.167804+0000","last_became_active":"2024-09-12T17:30:21.793950+0000","last_became_peered":"2024-09-12T17:30:21.793950+0000","last_unstale":"2024-09-12T19:20:59.167804+0000","last_undegraded":"2024-09-12T19:20:59.167804+0000","last_fullsized":"2024-09-12T19:20:59.167804+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:45.690479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17796039,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":466,"num_read_kb":65282,"num_write":1011,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,6],"acting":[2,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.535841+0000","last_change":"2024-09-12T17:29:56.770636+0000","last_active":"2024-09-12T19:20:13.535841+0000","last_peered":"2024-09-12T19:20:13.535841+0000","last_clean":"2024-09-12T19:20:13.535841+0000","last_became_active":"2024-09-12T17:29:56.770222+0000","last_became_peered":"2024-09-12T17:29:56.770222+0000","last_unstale":"2024-09-12T19:20:13.535841+0000","last_undegraded":"2024-09-12T19:20:13.535841+0000","last_fullsized":"2024-09-12T19:20:13.535841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:00.086855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'394","reported_seq":1045,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.505552+0000","last_change":"2024-09-12T17:29:58.755448+0000","last_active":"2024-09-12T19:22:59.505552+0000","last_peered":"2024-09-12T19:22:59.505552+0000","last_clean":"2024-09-12T19:22:59.505552+0000","last_became_active":"2024-09-12T17:29:58.754613+0000","last_became_peered":"2024-09-12T17:29:58.754613+0000","last_unstale":"2024-09-12T19:22:59.505552+0000","last_undegraded":"2024-09-12T19:22:59.505552+0000","last_fullsized":"2024-09-12T19:22:59.505552+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:50.294662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50732,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":653,"num_read_kb":1328,"num_write":512,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'796","reported_seq":3207,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.319657+0000","last_change":"2024-09-12T17:30:00.806110+0000","last_active":"2024-09-12T19:23:01.319657+0000","last_peered":"2024-09-12T19:23:01.319657+0000","last_clean":"2024-09-12T19:23:01.319657+0000","last_became_active":"2024-09-12T17:30:00.805428+0000","last_became_peered":"2024-09-12T17:30:00.805428+0000","last_unstale":"2024-09-12T19:23:01.319657+0000","last_undegraded":"2024-09-12T19:23:01.319657+0000","last_fullsized":"2024-09-12T19:23:01.319657+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:28.577730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'112","reported_seq":659,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.641116+0000","last_change":"2024-09-12T17:30:02.817717+0000","last_active":"2024-09-12T19:22:44.641116+0000","last_peered":"2024-09-12T19:22:44.641116+0000","last_clean":"2024-09-12T19:22:44.641116+0000","last_became_active":"2024-09-12T17:30:02.816983+0000","last_became_peered":"2024-09-12T17:30:02.816983+0000","last_unstale":"2024-09-12T19:22:44.641116+0000","last_undegraded":"2024-09-12T19:22:44.641116+0000","last_fullsized":"2024-09-12T19:22:44.641116+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:16.290296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":194,"num_write":254,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'871","reported_seq":2499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.139491+0000","last_change":"2024-09-12T17:29:54.752312+0000","last_active":"2024-09-12T19:21:19.139491+0000","last_peered":"2024-09-12T19:21:19.139491+0000","last_clean":"2024-09-12T19:21:19.139491+0000","last_became_active":"2024-09-12T17:29:54.744926+0000","last_became_peered":"2024-09-12T17:29:54.744926+0000","last_unstale":"2024-09-12T19:21:19.139491+0000","last_undegraded":"2024-09-12T19:21:19.139491+0000","last_fullsized":"2024-09-12T19:21:19.139491+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:28.330625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4186,"num_read_kb":3781,"num_write":1194,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'377","reported_seq":1067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.981260+0000","last_change":"2024-09-12T17:29:52.749559+0000","last_active":"2024-09-12T19:23:01.981260+0000","last_peered":"2024-09-12T19:23:01.981260+0000","last_clean":"2024-09-12T19:23:01.981260+0000","last_became_active":"2024-09-12T17:29:52.748439+0000","last_became_peered":"2024-09-12T17:29:52.748439+0000","last_unstale":"2024-09-12T19:23:01.981260+0000","last_undegraded":"2024-09-12T19:23:01.981260+0000","last_fullsized":"2024-09-12T19:23:01.981260+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:29.874598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992343,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":628,"num_read_kb":40400,"num_write":1240,"num_write_kb":24508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:43.542396+0000","last_change":"2024-09-12T17:29:56.743345+0000","last_active":"2024-09-12T19:20:43.542396+0000","last_peered":"2024-09-12T19:20:43.542396+0000","last_clean":"2024-09-12T19:20:43.542396+0000","last_became_active":"2024-09-12T17:29:56.742361+0000","last_became_peered":"2024-09-12T17:29:56.742361+0000","last_unstale":"2024-09-12T19:20:43.542396+0000","last_undegraded":"2024-09-12T19:20:43.542396+0000","last_fullsized":"2024-09-12T19:20:43.542396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:08.175418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'514","reported_seq":1198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.038329+0000","last_change":"2024-09-12T17:29:58.782097+0000","last_active":"2024-09-12T19:23:01.038329+0000","last_peered":"2024-09-12T19:23:01.038329+0000","last_clean":"2024-09-12T19:23:01.038329+0000","last_became_active":"2024-09-12T17:29:58.777576+0000","last_became_peered":"2024-09-12T17:29:58.777576+0000","last_unstale":"2024-09-12T19:23:01.038329+0000","last_undegraded":"2024-09-12T19:23:01.038329+0000","last_fullsized":"2024-09-12T19:23:01.038329+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:55.160859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94518,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":881,"num_read_kb":2010,"num_write":710,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.540027+0000","last_change":"2024-09-12T17:30:00.780996+0000","last_active":"2024-09-12T19:20:33.540027+0000","last_peered":"2024-09-12T19:20:33.540027+0000","last_clean":"2024-09-12T19:20:33.540027+0000","last_became_active":"2024-09-12T17:30:00.780193+0000","last_became_peered":"2024-09-12T17:30:00.780193+0000","last_unstale":"2024-09-12T19:20:33.540027+0000","last_undegraded":"2024-09-12T19:20:33.540027+0000","last_fullsized":"2024-09-12T19:20:33.540027+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:54.843536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'166","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.101340+0000","last_change":"2024-09-12T17:30:02.810105+0000","last_active":"2024-09-12T19:21:19.101340+0000","last_peered":"2024-09-12T19:21:19.101340+0000","last_clean":"2024-09-12T19:21:19.101340+0000","last_became_active":"2024-09-12T17:30:02.809357+0000","last_became_peered":"2024-09-12T17:30:02.809357+0000","last_unstale":"2024-09-12T19:21:19.101340+0000","last_undegraded":"2024-09-12T19:21:19.101340+0000","last_fullsized":"2024-09-12T19:21:19.101340+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:26.703985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":287,"num_read_kb":265,"num_write":391,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'1305","reported_seq":2983,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.932579+0000","last_change":"2024-09-12T17:29:54.759425+0000","last_active":"2024-09-12T19:20:27.932579+0000","last_peered":"2024-09-12T19:20:27.932579+0000","last_clean":"2024-09-12T19:20:27.932579+0000","last_became_active":"2024-09-12T17:29:54.758550+0000","last_became_peered":"2024-09-12T17:29:54.758550+0000","last_unstale":"2024-09-12T19:20:27.932579+0000","last_undegraded":"2024-09-12T19:20:27.932579+0000","last_fullsized":"2024-09-12T19:20:27.932579+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:30.793762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6018,"num_read_kb":5333,"num_write":1857,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'258","reported_seq":917,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.257493+0000","last_change":"2024-09-12T17:29:52.767951+0000","last_active":"2024-09-12T19:20:08.257493+0000","last_peered":"2024-09-12T19:20:08.257493+0000","last_clean":"2024-09-12T19:20:08.257493+0000","last_became_active":"2024-09-12T17:29:52.765603+0000","last_became_peered":"2024-09-12T17:29:52.765603+0000","last_unstale":"2024-09-12T19:20:08.257493+0000","last_undegraded":"2024-09-12T19:20:08.257493+0000","last_fullsized":"2024-09-12T19:20:08.257493+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:49.870827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7161968,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":378,"num_read_kb":36052,"num_write":1000,"num_write_kb":37263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.535963+0000","last_change":"2024-09-12T17:29:56.772981+0000","last_active":"2024-09-12T19:20:13.535963+0000","last_peered":"2024-09-12T19:20:13.535963+0000","last_clean":"2024-09-12T19:20:13.535963+0000","last_became_active":"2024-09-12T17:29:56.772580+0000","last_became_peered":"2024-09-12T17:29:56.772580+0000","last_unstale":"2024-09-12T19:20:13.535963+0000","last_undegraded":"2024-09-12T19:20:13.535963+0000","last_fullsized":"2024-09-12T19:20:13.535963+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:40.668767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'332","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.109246+0000","last_change":"2024-09-12T17:29:58.774656+0000","last_active":"2024-09-12T19:23:01.109246+0000","last_peered":"2024-09-12T19:23:01.109246+0000","last_clean":"2024-09-12T19:23:01.109246+0000","last_became_active":"2024-09-12T17:29:58.773869+0000","last_became_peered":"2024-09-12T17:29:58.773869+0000","last_unstale":"2024-09-12T19:23:01.109246+0000","last_undegraded":"2024-09-12T19:23:01.109246+0000","last_fullsized":"2024-09-12T19:23:01.109246+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:05.201058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47005,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":1116,"num_write":486,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:38.195416+0000","last_change":"2024-09-12T17:30:00.779241+0000","last_active":"2024-09-12T19:20:38.195416+0000","last_peered":"2024-09-12T19:20:38.195416+0000","last_clean":"2024-09-12T19:20:38.195416+0000","last_became_active":"2024-09-12T17:30:00.778642+0000","last_became_peered":"2024-09-12T17:30:00.778642+0000","last_unstale":"2024-09-12T19:20:38.195416+0000","last_undegraded":"2024-09-12T19:20:38.195416+0000","last_fullsized":"2024-09-12T19:20:38.195416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:29.538173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'107","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:28.289420+0000","last_change":"2024-09-12T17:30:02.791858+0000","last_active":"2024-09-12T19:22:28.289420+0000","last_peered":"2024-09-12T19:22:28.289420+0000","last_clean":"2024-09-12T19:22:28.289420+0000","last_became_active":"2024-09-12T17:30:02.788612+0000","last_became_peered":"2024-09-12T17:30:02.788612+0000","last_unstale":"2024-09-12T19:22:28.289420+0000","last_undegraded":"2024-09-12T19:22:28.289420+0000","last_fullsized":"2024-09-12T19:22:28.289420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:58.832322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":252,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'362","reported_seq":1817,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.198695+0000","last_change":"2024-09-12T17:29:54.759245+0000","last_active":"2024-09-12T19:20:13.198695+0000","last_peered":"2024-09-12T19:20:13.198695+0000","last_clean":"2024-09-12T19:20:13.198695+0000","last_became_active":"2024-09-12T17:29:54.758311+0000","last_became_peered":"2024-09-12T17:29:54.758311+0000","last_unstale":"2024-09-12T19:20:13.198695+0000","last_undegraded":"2024-09-12T19:20:13.198695+0000","last_fullsized":"2024-09-12T19:20:13.198695+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:22.106256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1918,"num_read_kb":1833,"num_write":390,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'276","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:38.564839+0000","last_change":"2024-09-12T17:29:52.725267+0000","last_active":"2024-09-12T19:20:38.564839+0000","last_peered":"2024-09-12T19:20:38.564839+0000","last_clean":"2024-09-12T19:20:38.564839+0000","last_became_active":"2024-09-12T17:29:52.716965+0000","last_became_peered":"2024-09-12T17:29:52.716965+0000","last_unstale":"2024-09-12T19:20:38.564839+0000","last_undegraded":"2024-09-12T19:20:38.564839+0000","last_fullsized":"2024-09-12T19:20:38.564839+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:28.061496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":941036,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":471,"num_read_kb":1122,"num_write":1043,"num_write_kb":14973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:12.981854+0000","last_change":"2024-09-12T17:29:56.766356+0000","last_active":"2024-09-12T19:20:12.981854+0000","last_peered":"2024-09-12T19:20:12.981854+0000","last_clean":"2024-09-12T19:20:12.981854+0000","last_became_active":"2024-09-12T17:29:56.765057+0000","last_became_peered":"2024-09-12T17:29:56.765057+0000","last_unstale":"2024-09-12T19:20:12.981854+0000","last_undegraded":"2024-09-12T19:20:12.981854+0000","last_fullsized":"2024-09-12T19:20:12.981854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:33.658858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'364","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.249490+0000","last_change":"2024-09-12T17:29:58.772847+0000","last_active":"2024-09-12T19:22:46.249490+0000","last_peered":"2024-09-12T19:22:46.249490+0000","last_clean":"2024-09-12T19:22:46.249490+0000","last_became_active":"2024-09-12T17:29:58.771991+0000","last_became_peered":"2024-09-12T17:29:58.771991+0000","last_unstale":"2024-09-12T19:22:46.249490+0000","last_undegraded":"2024-09-12T19:22:46.249490+0000","last_fullsized":"2024-09-12T19:22:46.249490+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:25.707619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53427,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":587,"num_read_kb":1037,"num_write":454,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'747","reported_seq":5250,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.289539+0000","last_change":"2024-09-12T17:30:00.803339+0000","last_active":"2024-09-12T19:22:46.289539+0000","last_peered":"2024-09-12T19:22:46.289539+0000","last_clean":"2024-09-12T19:22:46.289539+0000","last_became_active":"2024-09-12T17:30:00.802950+0000","last_became_peered":"2024-09-12T17:30:00.802950+0000","last_unstale":"2024-09-12T19:22:46.289539+0000","last_undegraded":"2024-09-12T19:22:46.289539+0000","last_fullsized":"2024-09-12T19:22:46.289539+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":701,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:53.399614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'111","reported_seq":637,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:16.233380+0000","last_change":"2024-09-12T17:30:02.807435+0000","last_active":"2024-09-12T19:21:16.233380+0000","last_peered":"2024-09-12T19:21:16.233380+0000","last_clean":"2024-09-12T19:21:16.233380+0000","last_became_active":"2024-09-12T17:30:02.806621+0000","last_became_peered":"2024-09-12T17:30:02.806621+0000","last_unstale":"2024-09-12T19:21:16.233380+0000","last_undegraded":"2024-09-12T19:21:16.233380+0000","last_fullsized":"2024-09-12T19:21:16.233380+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:28.598520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":276,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'775","reported_seq":2449,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.998604+0000","last_change":"2024-09-12T17:29:54.764077+0000","last_active":"2024-09-12T19:22:44.998604+0000","last_peered":"2024-09-12T19:22:44.998604+0000","last_clean":"2024-09-12T19:22:44.998604+0000","last_became_active":"2024-09-12T17:29:54.763348+0000","last_became_peered":"2024-09-12T17:29:54.763348+0000","last_unstale":"2024-09-12T19:22:44.998604+0000","last_undegraded":"2024-09-12T19:22:44.998604+0000","last_fullsized":"2024-09-12T19:22:44.998604+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:36.252557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4009,"num_read_kb":3654,"num_write":1024,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'307","reported_seq":976,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.868076+0000","last_change":"2024-09-12T17:29:52.752133+0000","last_active":"2024-09-12T19:23:01.868076+0000","last_peered":"2024-09-12T19:23:01.868076+0000","last_clean":"2024-09-12T19:23:01.868076+0000","last_became_active":"2024-09-12T17:29:52.744356+0000","last_became_peered":"2024-09-12T17:29:52.744356+0000","last_unstale":"2024-09-12T19:23:01.868076+0000","last_undegraded":"2024-09-12T19:23:01.868076+0000","last_fullsized":"2024-09-12T19:23:01.868076+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:36.220798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":48689,"num_write":1045,"num_write_kb":32373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1474,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.852068+0000","last_change":"2024-09-12T17:29:56.751658+0000","last_active":"2024-09-12T19:22:58.852068+0000","last_peered":"2024-09-12T19:22:58.852068+0000","last_clean":"2024-09-12T19:22:58.852068+0000","last_became_active":"2024-09-12T17:29:56.750915+0000","last_became_peered":"2024-09-12T17:29:56.750915+0000","last_unstale":"2024-09-12T19:22:58.852068+0000","last_undegraded":"2024-09-12T19:22:58.852068+0000","last_fullsized":"2024-09-12T19:22:58.852068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:54.038362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'146","reported_seq":731,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:49.669036+0000","last_change":"2024-09-12T17:29:58.832618+0000","last_active":"2024-09-12T19:20:49.669036+0000","last_peered":"2024-09-12T19:20:49.669036+0000","last_clean":"2024-09-12T19:20:49.669036+0000","last_became_active":"2024-09-12T17:29:58.831628+0000","last_became_peered":"2024-09-12T17:29:58.831628+0000","last_unstale":"2024-09-12T19:20:49.669036+0000","last_undegraded":"2024-09-12T19:20:49.669036+0000","last_fullsized":"2024-09-12T19:20:49.669036+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:43.249799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'768","reported_seq":3241,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.291879+0000","last_change":"2024-09-12T17:30:00.807629+0000","last_active":"2024-09-12T19:22:46.291879+0000","last_peered":"2024-09-12T19:22:46.291879+0000","last_clean":"2024-09-12T19:22:46.291879+0000","last_became_active":"2024-09-12T17:30:00.806681+0000","last_became_peered":"2024-09-12T17:30:00.806681+0000","last_unstale":"2024-09-12T19:22:46.291879+0000","last_undegraded":"2024-09-12T19:22:46.291879+0000","last_fullsized":"2024-09-12T19:22:46.291879+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":701,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:09.571492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'116","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:14.309491+0000","last_change":"2024-09-12T17:30:02.806772+0000","last_active":"2024-09-12T19:21:14.309491+0000","last_peered":"2024-09-12T19:21:14.309491+0000","last_clean":"2024-09-12T19:21:14.309491+0000","last_became_active":"2024-09-12T17:30:02.805954+0000","last_became_peered":"2024-09-12T17:30:02.805954+0000","last_unstale":"2024-09-12T19:21:14.309491+0000","last_undegraded":"2024-09-12T19:21:14.309491+0000","last_fullsized":"2024-09-12T19:21:14.309491+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:48.506411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":135,"num_write":268,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'519","reported_seq":2056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.988475+0000","last_change":"2024-09-12T17:29:54.755879+0000","last_active":"2024-09-12T19:20:42.988475+0000","last_peered":"2024-09-12T19:20:42.988475+0000","last_clean":"2024-09-12T19:20:42.988475+0000","last_became_active":"2024-09-12T17:29:54.755550+0000","last_became_peered":"2024-09-12T17:29:54.755550+0000","last_unstale":"2024-09-12T19:20:42.988475+0000","last_undegraded":"2024-09-12T19:20:42.988475+0000","last_fullsized":"2024-09-12T19:20:42.988475+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:22.424955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2775,"num_read_kb":2556,"num_write":676,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'313","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262232+0000","last_change":"2024-09-12T17:30:21.696907+0000","last_active":"2024-09-12T19:20:23.262232+0000","last_peered":"2024-09-12T19:20:23.262232+0000","last_clean":"2024-09-12T19:20:23.262232+0000","last_became_active":"2024-09-12T17:30:21.696077+0000","last_became_peered":"2024-09-12T17:30:21.696077+0000","last_unstale":"2024-09-12T19:20:23.262232+0000","last_undegraded":"2024-09-12T19:20:23.262232+0000","last_fullsized":"2024-09-12T19:20:23.262232+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:10.253722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5311480,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":506,"num_read_kb":12866,"num_write":1134,"num_write_kb":34720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.198755+0000","last_change":"2024-09-12T17:29:56.758620+0000","last_active":"2024-09-12T19:20:13.198755+0000","last_peered":"2024-09-12T19:20:13.198755+0000","last_clean":"2024-09-12T19:20:13.198755+0000","last_became_active":"2024-09-12T17:29:56.757728+0000","last_became_peered":"2024-09-12T17:29:56.757728+0000","last_unstale":"2024-09-12T19:20:13.198755+0000","last_undegraded":"2024-09-12T19:20:13.198755+0000","last_fullsized":"2024-09-12T19:20:13.198755+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:39.838154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'417","reported_seq":1095,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:02.001142+0000","last_change":"2024-09-12T17:29:58.776898+0000","last_active":"2024-09-12T19:23:02.001142+0000","last_peered":"2024-09-12T19:23:02.001142+0000","last_clean":"2024-09-12T19:23:02.001142+0000","last_became_active":"2024-09-12T17:29:58.776033+0000","last_became_peered":"2024-09-12T17:29:58.776033+0000","last_unstale":"2024-09-12T19:23:02.001142+0000","last_undegraded":"2024-09-12T19:23:02.001142+0000","last_fullsized":"2024-09-12T19:23:02.001142+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:29.107658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47722,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":665,"num_read_kb":1193,"num_write":496,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:18.560371+0000","last_change":"2024-09-12T17:30:00.793376+0000","last_active":"2024-09-12T19:20:18.560371+0000","last_peered":"2024-09-12T19:20:18.560371+0000","last_clean":"2024-09-12T19:20:18.560371+0000","last_became_active":"2024-09-12T17:30:00.792687+0000","last_became_peered":"2024-09-12T17:30:00.792687+0000","last_unstale":"2024-09-12T19:20:18.560371+0000","last_undegraded":"2024-09-12T19:20:18.560371+0000","last_fullsized":"2024-09-12T19:20:18.560371+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:53.873367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'165","reported_seq":696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.984898+0000","last_change":"2024-09-12T17:30:02.809944+0000","last_active":"2024-09-12T19:20:27.984898+0000","last_peered":"2024-09-12T19:20:27.984898+0000","last_clean":"2024-09-12T19:20:27.984898+0000","last_became_active":"2024-09-12T17:30:02.809252+0000","last_became_peered":"2024-09-12T17:30:02.809252+0000","last_unstale":"2024-09-12T19:20:27.984898+0000","last_undegraded":"2024-09-12T19:20:27.984898+0000","last_fullsized":"2024-09-12T19:20:27.984898+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:42.655346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":242,"num_read_kb":230,"num_write":407,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'457","reported_seq":1883,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:38.564931+0000","last_change":"2024-09-12T17:29:54.773311+0000","last_active":"2024-09-12T19:20:38.564931+0000","last_peered":"2024-09-12T19:20:38.564931+0000","last_clean":"2024-09-12T19:20:38.564931+0000","last_became_active":"2024-09-12T17:29:54.771538+0000","last_became_peered":"2024-09-12T17:29:54.771538+0000","last_unstale":"2024-09-12T19:20:38.564931+0000","last_undegraded":"2024-09-12T19:20:38.564931+0000","last_fullsized":"2024-09-12T19:20:38.564931+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:11.655778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2249,"num_read_kb":2075,"num_write":554,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:52.966096+0000","last_change":"2024-09-12T17:29:30.603974+0000","last_active":"2024-09-12T19:19:52.966096+0000","last_peered":"2024-09-12T19:19:52.966096+0000","last_clean":"2024-09-12T19:19:52.966096+0000","last_became_active":"2024-09-12T17:29:30.601518+0000","last_became_peered":"2024-09-12T17:29:30.601518+0000","last_unstale":"2024-09-12T19:19:52.966096+0000","last_undegraded":"2024-09-12T19:19:52.966096+0000","last_fullsized":"2024-09-12T19:19:52.966096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:29.241459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:29.241459+0000","last_clean_scrub_stamp":"2024-09-12T17:29:29.241459+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:32.039824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":552,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.986642+0000","last_change":"2024-09-12T17:29:37.351871+0000","last_active":"2024-09-12T19:20:02.986642+0000","last_peered":"2024-09-12T19:20:02.986642+0000","last_clean":"2024-09-12T19:20:02.986642+0000","last_became_active":"2024-09-12T17:29:35.340342+0000","last_became_peered":"2024-09-12T17:29:35.340342+0000","last_unstale":"2024-09-12T19:20:02.986642+0000","last_undegraded":"2024-09-12T19:20:02.986642+0000","last_fullsized":"2024-09-12T19:20:02.986642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:04.662413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097602599999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'268","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:18.260770+0000","last_change":"2024-09-12T17:29:52.767042+0000","last_active":"2024-09-12T19:20:18.260770+0000","last_peered":"2024-09-12T19:20:18.260770+0000","last_clean":"2024-09-12T19:20:18.260770+0000","last_became_active":"2024-09-12T17:29:52.765497+0000","last_became_peered":"2024-09-12T17:29:52.765497+0000","last_unstale":"2024-09-12T19:20:18.260770+0000","last_undegraded":"2024-09-12T19:20:18.260770+0000","last_fullsized":"2024-09-12T19:20:18.260770+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:05.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14183958,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":465,"num_read_kb":15769,"num_write":975,"num_write_kb":23964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:22.973720+0000","last_change":"2024-09-12T17:29:56.750663+0000","last_active":"2024-09-12T19:20:22.973720+0000","last_peered":"2024-09-12T19:20:22.973720+0000","last_clean":"2024-09-12T19:20:22.973720+0000","last_became_active":"2024-09-12T17:29:56.749938+0000","last_became_peered":"2024-09-12T17:29:56.749938+0000","last_unstale":"2024-09-12T19:20:22.973720+0000","last_undegraded":"2024-09-12T19:20:22.973720+0000","last_fullsized":"2024-09-12T19:20:22.973720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:42.837901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'798","reported_seq":1542,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.770805+0000","last_change":"2024-09-12T17:29:58.770209+0000","last_active":"2024-09-12T19:23:01.770805+0000","last_peered":"2024-09-12T19:23:01.770805+0000","last_clean":"2024-09-12T19:23:01.770805+0000","last_became_active":"2024-09-12T17:29:58.769277+0000","last_became_peered":"2024-09-12T17:29:58.769277+0000","last_unstale":"2024-09-12T19:23:01.770805+0000","last_undegraded":"2024-09-12T19:23:01.770805+0000","last_fullsized":"2024-09-12T19:23:01.770805+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:07.152072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159898,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1560,"num_read_kb":3538,"num_write":1488,"num_write_kb":1318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.193952+0000","last_change":"2024-09-12T17:30:00.800340+0000","last_active":"2024-09-12T19:20:33.193952+0000","last_peered":"2024-09-12T19:20:33.193952+0000","last_clean":"2024-09-12T19:20:33.193952+0000","last_became_active":"2024-09-12T17:30:00.799883+0000","last_became_peered":"2024-09-12T17:30:00.799883+0000","last_unstale":"2024-09-12T19:20:33.193952+0000","last_undegraded":"2024-09-12T19:20:33.193952+0000","last_fullsized":"2024-09-12T19:20:33.193952+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:44.555994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'197","reported_seq":924,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.519551+0000","last_change":"2024-09-12T17:30:02.800451+0000","last_active":"2024-09-12T19:21:21.519551+0000","last_peered":"2024-09-12T19:21:21.519551+0000","last_clean":"2024-09-12T19:21:21.519551+0000","last_became_active":"2024-09-12T17:30:02.799307+0000","last_became_peered":"2024-09-12T17:30:02.799307+0000","last_unstale":"2024-09-12T19:21:21.519551+0000","last_undegraded":"2024-09-12T19:21:21.519551+0000","last_fullsized":"2024-09-12T19:21:21.519551+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:50.826285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1000,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":467,"num_write":393,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'474","reported_seq":2035,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.192554+0000","last_change":"2024-09-12T17:29:54.758652+0000","last_active":"2024-09-12T19:20:28.192554+0000","last_peered":"2024-09-12T19:20:28.192554+0000","last_clean":"2024-09-12T19:20:28.192554+0000","last_became_active":"2024-09-12T17:29:54.758196+0000","last_became_peered":"2024-09-12T17:29:54.758196+0000","last_unstale":"2024-09-12T19:20:28.192554+0000","last_undegraded":"2024-09-12T19:20:28.192554+0000","last_fullsized":"2024-09-12T19:20:28.192554+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:38.243254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2778,"num_read_kb":2582,"num_write":658,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":552,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.967413+0000","last_change":"2024-09-12T17:29:37.541726+0000","last_active":"2024-09-12T19:19:57.967413+0000","last_peered":"2024-09-12T19:19:57.967413+0000","last_clean":"2024-09-12T19:19:57.967413+0000","last_became_active":"2024-09-12T17:29:35.336475+0000","last_became_peered":"2024-09-12T17:29:35.336475+0000","last_unstale":"2024-09-12T19:19:57.967413+0000","last_undegraded":"2024-09-12T19:19:57.967413+0000","last_fullsized":"2024-09-12T19:19:57.967413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:17.489304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012883599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'346","reported_seq":1071,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.777899+0000","last_change":"2024-09-12T17:29:52.766738+0000","last_active":"2024-09-12T19:23:01.777899+0000","last_peered":"2024-09-12T19:23:01.777899+0000","last_clean":"2024-09-12T19:23:01.777899+0000","last_became_active":"2024-09-12T17:29:52.766251+0000","last_became_peered":"2024-09-12T17:29:52.766251+0000","last_unstale":"2024-09-12T19:23:01.777899+0000","last_undegraded":"2024-09-12T19:23:01.777899+0000","last_fullsized":"2024-09-12T19:23:01.777899+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:37.272387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730134,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":595,"num_read_kb":84420,"num_write":1189,"num_write_kb":23129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.992482+0000","last_change":"2024-09-12T17:29:56.763217+0000","last_active":"2024-09-12T19:20:27.992482+0000","last_peered":"2024-09-12T19:20:27.992482+0000","last_clean":"2024-09-12T19:20:27.992482+0000","last_became_active":"2024-09-12T17:29:56.762451+0000","last_became_peered":"2024-09-12T17:29:56.762451+0000","last_unstale":"2024-09-12T19:20:27.992482+0000","last_undegraded":"2024-09-12T19:20:27.992482+0000","last_fullsized":"2024-09-12T19:20:27.992482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:29.246666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1460","reported_seq":3809,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.692205+0000","last_change":"2024-09-12T17:29:58.772005+0000","last_active":"2024-09-12T19:23:01.692205+0000","last_peered":"2024-09-12T19:23:01.692205+0000","last_clean":"2024-09-12T19:23:01.692205+0000","last_became_active":"2024-09-12T17:29:58.771561+0000","last_became_peered":"2024-09-12T17:29:58.771561+0000","last_unstale":"2024-09-12T19:23:01.692205+0000","last_undegraded":"2024-09-12T19:23:01.692205+0000","last_fullsized":"2024-09-12T19:23:01.692205+0000","mapping_epoch":32,"log_start":"267'1400","ondisk_log_start":"267'1400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:12.774049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146977,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2279,"num_read_kb":4182,"num_write":1388,"num_write_kb":1130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:47.979732+0000","last_change":"2024-09-12T17:30:00.806748+0000","last_active":"2024-09-12T19:20:47.979732+0000","last_peered":"2024-09-12T19:20:47.979732+0000","last_clean":"2024-09-12T19:20:47.979732+0000","last_became_active":"2024-09-12T17:30:00.806030+0000","last_became_peered":"2024-09-12T17:30:00.806030+0000","last_unstale":"2024-09-12T19:20:47.979732+0000","last_undegraded":"2024-09-12T19:20:47.979732+0000","last_fullsized":"2024-09-12T19:20:47.979732+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:16.762914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'217","reported_seq":760,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:18.500162+0000","last_change":"2024-09-12T17:30:02.810034+0000","last_active":"2024-09-12T19:21:18.500162+0000","last_peered":"2024-09-12T19:21:18.500162+0000","last_clean":"2024-09-12T19:21:18.500162+0000","last_became_active":"2024-09-12T17:30:02.809372+0000","last_became_peered":"2024-09-12T17:30:02.809372+0000","last_unstale":"2024-09-12T19:21:18.500162+0000","last_undegraded":"2024-09-12T19:21:18.500162+0000","last_fullsized":"2024-09-12T19:21:18.500162+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:48.796437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":353,"num_read_kb":353,"num_write":469,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'466","reported_seq":2050,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.441742+0000","last_change":"2024-09-12T17:29:54.747544+0000","last_active":"2024-09-12T19:21:21.441742+0000","last_peered":"2024-09-12T19:21:21.441742+0000","last_clean":"2024-09-12T19:21:21.441742+0000","last_became_active":"2024-09-12T17:29:54.747270+0000","last_became_peered":"2024-09-12T17:29:54.747270+0000","last_unstale":"2024-09-12T19:21:21.441742+0000","last_undegraded":"2024-09-12T19:21:21.441742+0000","last_fullsized":"2024-09-12T19:21:21.441742+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:57.930978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2522,"num_read_kb":2358,"num_write":589,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":564,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.533496+0000","last_change":"2024-09-12T17:29:37.348932+0000","last_active":"2024-09-12T19:20:03.533496+0000","last_peered":"2024-09-12T19:20:03.533496+0000","last_clean":"2024-09-12T19:20:03.533496+0000","last_became_active":"2024-09-12T17:29:35.331504+0000","last_became_peered":"2024-09-12T17:29:35.331504+0000","last_unstale":"2024-09-12T19:20:03.533496+0000","last_undegraded":"2024-09-12T19:20:03.533496+0000","last_fullsized":"2024-09-12T19:20:03.533496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:24.198110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001034428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'347","reported_seq":983,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.883682+0000","last_change":"2024-09-12T17:29:52.741712+0000","last_active":"2024-09-12T19:23:01.883682+0000","last_peered":"2024-09-12T19:23:01.883682+0000","last_clean":"2024-09-12T19:23:01.883682+0000","last_became_active":"2024-09-12T17:29:52.741209+0000","last_became_peered":"2024-09-12T17:29:52.741209+0000","last_unstale":"2024-09-12T19:23:01.883682+0000","last_undegraded":"2024-09-12T19:23:01.883682+0000","last_fullsized":"2024-09-12T19:23:01.883682+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:54.967025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":451,"num_read_kb":5499,"num_write":979,"num_write_kb":15070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.539110+0000","last_change":"2024-09-12T17:29:56.753741+0000","last_active":"2024-09-12T19:20:28.539110+0000","last_peered":"2024-09-12T19:20:28.539110+0000","last_clean":"2024-09-12T19:20:28.539110+0000","last_became_active":"2024-09-12T17:29:56.753063+0000","last_became_peered":"2024-09-12T17:29:56.753063+0000","last_unstale":"2024-09-12T19:20:28.539110+0000","last_undegraded":"2024-09-12T19:20:28.539110+0000","last_fullsized":"2024-09-12T19:20:28.539110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:26.088728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'367","reported_seq":2316,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.478760+0000","last_change":"2024-09-12T17:29:58.835335+0000","last_active":"2024-09-12T19:22:46.478760+0000","last_peered":"2024-09-12T19:22:46.478760+0000","last_clean":"2024-09-12T19:22:46.478760+0000","last_became_active":"2024-09-12T17:29:58.834447+0000","last_became_peered":"2024-09-12T17:29:58.834447+0000","last_unstale":"2024-09-12T19:22:46.478760+0000","last_undegraded":"2024-09-12T19:22:46.478760+0000","last_fullsized":"2024-09-12T19:22:46.478760+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:10.184300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":368,"num_read_kb":360,"num_write":359,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.192453+0000","last_change":"2024-09-12T17:30:00.778895+0000","last_active":"2024-09-12T19:20:28.192453+0000","last_peered":"2024-09-12T19:20:28.192453+0000","last_clean":"2024-09-12T19:20:28.192453+0000","last_became_active":"2024-09-12T17:30:00.778134+0000","last_became_peered":"2024-09-12T17:30:00.778134+0000","last_unstale":"2024-09-12T19:20:28.192453+0000","last_undegraded":"2024-09-12T19:20:28.192453+0000","last_fullsized":"2024-09-12T19:20:28.192453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:40.692916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'270","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:22.003400+0000","last_change":"2024-09-12T17:30:02.805738+0000","last_active":"2024-09-12T19:21:22.003400+0000","last_peered":"2024-09-12T19:21:22.003400+0000","last_clean":"2024-09-12T19:21:22.003400+0000","last_became_active":"2024-09-12T17:30:02.805090+0000","last_became_peered":"2024-09-12T17:30:02.805090+0000","last_unstale":"2024-09-12T19:21:22.003400+0000","last_undegraded":"2024-09-12T19:21:22.003400+0000","last_fullsized":"2024-09-12T19:21:22.003400+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:19.612013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":596,"num_read_kb":605,"num_write":610,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'409","reported_seq":1956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.029492+0000","last_change":"2024-09-12T17:29:54.745943+0000","last_active":"2024-09-12T19:22:45.029492+0000","last_peered":"2024-09-12T19:22:45.029492+0000","last_clean":"2024-09-12T19:22:45.029492+0000","last_became_active":"2024-09-12T17:29:54.745423+0000","last_became_peered":"2024-09-12T17:29:54.745423+0000","last_unstale":"2024-09-12T19:22:45.029492+0000","last_undegraded":"2024-09-12T19:22:45.029492+0000","last_fullsized":"2024-09-12T19:22:45.029492+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:49.009438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2154,"num_read_kb":2073,"num_write":474,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":553,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.986585+0000","last_change":"2024-09-12T17:29:37.352917+0000","last_active":"2024-09-12T19:20:02.986585+0000","last_peered":"2024-09-12T19:20:02.986585+0000","last_clean":"2024-09-12T19:20:02.986585+0000","last_became_active":"2024-09-12T17:29:35.340113+0000","last_became_peered":"2024-09-12T17:29:35.340113+0000","last_unstale":"2024-09-12T19:20:02.986585+0000","last_undegraded":"2024-09-12T19:20:02.986585+0000","last_fullsized":"2024-09-12T19:20:02.986585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:23.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020086050000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'366","reported_seq":1114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.974429+0000","last_change":"2024-09-12T17:29:52.760726+0000","last_active":"2024-09-12T19:23:01.974429+0000","last_peered":"2024-09-12T19:23:01.974429+0000","last_clean":"2024-09-12T19:23:01.974429+0000","last_became_active":"2024-09-12T17:29:52.759957+0000","last_became_peered":"2024-09-12T17:29:52.759957+0000","last_unstale":"2024-09-12T19:23:01.974429+0000","last_undegraded":"2024-09-12T19:23:01.974429+0000","last_fullsized":"2024-09-12T19:23:01.974429+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:47.608386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279708,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":651,"num_read_kb":39253,"num_write":1178,"num_write_kb":45869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:43.196821+0000","last_change":"2024-09-12T17:29:56.766428+0000","last_active":"2024-09-12T19:20:43.196821+0000","last_peered":"2024-09-12T19:20:43.196821+0000","last_clean":"2024-09-12T19:20:43.196821+0000","last_became_active":"2024-09-12T17:29:56.765361+0000","last_became_peered":"2024-09-12T17:29:56.765361+0000","last_unstale":"2024-09-12T19:20:43.196821+0000","last_undegraded":"2024-09-12T19:20:43.196821+0000","last_fullsized":"2024-09-12T19:20:43.196821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:24.942838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'210","reported_seq":825,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:43.293295+0000","last_change":"2024-09-12T17:29:58.769020+0000","last_active":"2024-09-12T19:22:43.293295+0000","last_peered":"2024-09-12T19:22:43.293295+0000","last_clean":"2024-09-12T19:22:43.293295+0000","last_became_active":"2024-09-12T17:29:58.768596+0000","last_became_peered":"2024-09-12T17:29:58.768596+0000","last_unstale":"2024-09-12T19:22:43.293295+0000","last_undegraded":"2024-09-12T19:22:43.293295+0000","last_fullsized":"2024-09-12T19:22:43.293295+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:34.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.563828+0000","last_change":"2024-09-12T17:30:00.790648+0000","last_active":"2024-09-12T19:20:33.563828+0000","last_peered":"2024-09-12T19:20:33.563828+0000","last_clean":"2024-09-12T19:20:33.563828+0000","last_became_active":"2024-09-12T17:30:00.788505+0000","last_became_peered":"2024-09-12T17:30:00.788505+0000","last_unstale":"2024-09-12T19:20:33.563828+0000","last_undegraded":"2024-09-12T19:20:33.563828+0000","last_fullsized":"2024-09-12T19:20:33.563828+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:54.847829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'156","reported_seq":736,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.643106+0000","last_change":"2024-09-12T17:30:02.795566+0000","last_active":"2024-09-12T19:22:44.643106+0000","last_peered":"2024-09-12T19:22:44.643106+0000","last_clean":"2024-09-12T19:22:44.643106+0000","last_became_active":"2024-09-12T17:30:02.794703+0000","last_became_peered":"2024-09-12T17:30:02.794703+0000","last_unstale":"2024-09-12T19:22:44.643106+0000","last_undegraded":"2024-09-12T19:22:44.643106+0000","last_fullsized":"2024-09-12T19:22:44.643106+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:19.673266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":268,"num_read_kb":254,"num_write":347,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'419","reported_seq":2016,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:22.983809+0000","last_change":"2024-09-12T17:29:54.766600+0000","last_active":"2024-09-12T19:20:22.983809+0000","last_peered":"2024-09-12T19:20:22.983809+0000","last_clean":"2024-09-12T19:20:22.983809+0000","last_became_active":"2024-09-12T17:29:54.766275+0000","last_became_peered":"2024-09-12T17:29:54.766275+0000","last_unstale":"2024-09-12T19:20:22.983809+0000","last_undegraded":"2024-09-12T19:20:22.983809+0000","last_fullsized":"2024-09-12T19:20:22.983809+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:40.431193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2280,"num_read_kb":2171,"num_write":482,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'349","reported_seq":1026,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.969892+0000","last_change":"2024-09-12T17:29:52.741487+0000","last_active":"2024-09-12T19:23:01.969892+0000","last_peered":"2024-09-12T19:23:01.969892+0000","last_clean":"2024-09-12T19:23:01.969892+0000","last_became_active":"2024-09-12T17:29:52.740544+0000","last_became_peered":"2024-09-12T17:29:52.740544+0000","last_unstale":"2024-09-12T19:23:01.969892+0000","last_undegraded":"2024-09-12T19:23:01.969892+0000","last_fullsized":"2024-09-12T19:23:01.969892+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:29.317350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":6019,"num_write":1130,"num_write_kb":22769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":554,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.979639+0000","last_change":"2024-09-12T17:29:37.346858+0000","last_active":"2024-09-12T19:20:02.979639+0000","last_peered":"2024-09-12T19:20:02.979639+0000","last_clean":"2024-09-12T19:20:02.979639+0000","last_became_active":"2024-09-12T17:29:35.407492+0000","last_became_peered":"2024-09-12T17:29:35.407492+0000","last_unstale":"2024-09-12T19:20:02.979639+0000","last_undegraded":"2024-09-12T19:20:02.979639+0000","last_fullsized":"2024-09-12T19:20:02.979639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:34.824127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098134900000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.191284+0000","last_change":"2024-09-12T17:29:56.769832+0000","last_active":"2024-09-12T19:20:23.191284+0000","last_peered":"2024-09-12T19:20:23.191284+0000","last_clean":"2024-09-12T19:20:23.191284+0000","last_became_active":"2024-09-12T17:29:56.769344+0000","last_became_peered":"2024-09-12T17:29:56.769344+0000","last_unstale":"2024-09-12T19:20:23.191284+0000","last_undegraded":"2024-09-12T19:20:23.191284+0000","last_fullsized":"2024-09-12T19:20:23.191284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:05.381579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'763","reported_seq":1503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.624058+0000","last_change":"2024-09-12T17:29:58.776516+0000","last_active":"2024-09-12T19:23:01.624058+0000","last_peered":"2024-09-12T19:23:01.624058+0000","last_clean":"2024-09-12T19:23:01.624058+0000","last_became_active":"2024-09-12T17:29:58.766353+0000","last_became_peered":"2024-09-12T17:29:58.766353+0000","last_unstale":"2024-09-12T19:23:01.624058+0000","last_undegraded":"2024-09-12T19:23:01.624058+0000","last_fullsized":"2024-09-12T19:23:01.624058+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:35.937627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88446,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1874,"num_read_kb":3148,"num_write":2424,"num_write_kb":2173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.202330+0000","last_change":"2024-09-12T17:30:00.784218+0000","last_active":"2024-09-12T19:20:28.202330+0000","last_peered":"2024-09-12T19:20:28.202330+0000","last_clean":"2024-09-12T19:20:28.202330+0000","last_became_active":"2024-09-12T17:30:00.783385+0000","last_became_peered":"2024-09-12T17:30:00.783385+0000","last_unstale":"2024-09-12T19:20:28.202330+0000","last_undegraded":"2024-09-12T19:20:28.202330+0000","last_fullsized":"2024-09-12T19:20:28.202330+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:44.877583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'143","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:14.315826+0000","last_change":"2024-09-12T17:30:02.806515+0000","last_active":"2024-09-12T19:21:14.315826+0000","last_peered":"2024-09-12T19:21:14.315826+0000","last_clean":"2024-09-12T19:21:14.315826+0000","last_became_active":"2024-09-12T17:30:02.805684+0000","last_became_peered":"2024-09-12T17:30:02.805684+0000","last_unstale":"2024-09-12T19:21:14.315826+0000","last_undegraded":"2024-09-12T19:21:14.315826+0000","last_fullsized":"2024-09-12T19:21:14.315826+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:50.293983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":165,"num_read_kb":163,"num_write":341,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'404","reported_seq":1905,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.896908+0000","last_change":"2024-09-12T17:29:54.758506+0000","last_active":"2024-09-12T19:21:55.896908+0000","last_peered":"2024-09-12T19:21:55.896908+0000","last_clean":"2024-09-12T19:21:55.896908+0000","last_became_active":"2024-09-12T17:29:54.758047+0000","last_became_peered":"2024-09-12T17:29:54.758047+0000","last_unstale":"2024-09-12T19:21:55.896908+0000","last_undegraded":"2024-09-12T19:21:55.896908+0000","last_fullsized":"2024-09-12T19:21:55.896908+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:06.718970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2269,"num_read_kb":2144,"num_write":466,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'307","reported_seq":1185,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.919860+0000","last_change":"2024-09-12T17:29:52.728144+0000","last_active":"2024-09-12T19:23:01.919860+0000","last_peered":"2024-09-12T19:23:01.919860+0000","last_clean":"2024-09-12T19:23:01.919860+0000","last_became_active":"2024-09-12T17:29:52.727635+0000","last_became_peered":"2024-09-12T17:29:52.727635+0000","last_unstale":"2024-09-12T19:23:01.919860+0000","last_undegraded":"2024-09-12T19:23:01.919860+0000","last_fullsized":"2024-09-12T19:23:01.919860+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:03.775561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109709,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":897,"num_read_kb":32569,"num_write":1024,"num_write_kb":39553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":550,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:22.973772+0000","last_change":"2024-09-12T17:29:37.541831+0000","last_active":"2024-09-12T19:20:22.973772+0000","last_peered":"2024-09-12T19:20:22.973772+0000","last_clean":"2024-09-12T19:20:22.973772+0000","last_became_active":"2024-09-12T17:29:35.406653+0000","last_became_peered":"2024-09-12T17:29:35.406653+0000","last_unstale":"2024-09-12T19:20:22.973772+0000","last_undegraded":"2024-09-12T19:20:22.973772+0000","last_fullsized":"2024-09-12T19:20:22.973772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:04.148521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001315566,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.561483+0000","last_change":"2024-09-12T17:29:56.770303+0000","last_active":"2024-09-12T19:20:23.561483+0000","last_peered":"2024-09-12T19:20:23.561483+0000","last_clean":"2024-09-12T19:20:23.561483+0000","last_became_active":"2024-09-12T17:29:56.769576+0000","last_became_peered":"2024-09-12T17:29:56.769576+0000","last_unstale":"2024-09-12T19:20:23.561483+0000","last_undegraded":"2024-09-12T19:20:23.561483+0000","last_fullsized":"2024-09-12T19:20:23.561483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:04.267964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'337","reported_seq":976,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:29.216151+0000","last_change":"2024-09-12T17:29:58.831755+0000","last_active":"2024-09-12T19:21:29.216151+0000","last_peered":"2024-09-12T19:21:29.216151+0000","last_clean":"2024-09-12T19:21:29.216151+0000","last_became_active":"2024-09-12T17:29:58.830993+0000","last_became_peered":"2024-09-12T17:29:58.830993+0000","last_unstale":"2024-09-12T19:21:29.216151+0000","last_undegraded":"2024-09-12T19:21:29.216151+0000","last_fullsized":"2024-09-12T19:21:29.216151+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:47.520303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":439,"num_read_kb":430,"num_write":418,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'791","reported_seq":3373,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.882999+0000","last_change":"2024-09-12T17:30:00.805745+0000","last_active":"2024-09-12T19:22:58.882999+0000","last_peered":"2024-09-12T19:22:58.882999+0000","last_clean":"2024-09-12T19:22:58.882999+0000","last_became_active":"2024-09-12T17:30:00.805059+0000","last_became_peered":"2024-09-12T17:30:00.805059+0000","last_unstale":"2024-09-12T19:22:58.882999+0000","last_undegraded":"2024-09-12T19:22:58.882999+0000","last_fullsized":"2024-09-12T19:22:58.882999+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":701,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:20.515894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'134","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.261254+0000","last_change":"2024-09-12T17:30:02.805558+0000","last_active":"2024-09-12T19:22:46.261254+0000","last_peered":"2024-09-12T19:22:46.261254+0000","last_clean":"2024-09-12T19:22:46.261254+0000","last_became_active":"2024-09-12T17:30:02.803051+0000","last_became_peered":"2024-09-12T17:30:02.803051+0000","last_unstale":"2024-09-12T19:22:46.261254+0000","last_undegraded":"2024-09-12T19:22:46.261254+0000","last_fullsized":"2024-09-12T19:22:46.261254+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:30.608707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":726,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":188,"num_read_kb":177,"num_write":312,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'427","reported_seq":1967,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262257+0000","last_change":"2024-09-12T17:29:54.762856+0000","last_active":"2024-09-12T19:20:23.262257+0000","last_peered":"2024-09-12T19:20:23.262257+0000","last_clean":"2024-09-12T19:20:23.262257+0000","last_became_active":"2024-09-12T17:29:54.762522+0000","last_became_peered":"2024-09-12T17:29:54.762522+0000","last_unstale":"2024-09-12T19:20:23.262257+0000","last_undegraded":"2024-09-12T19:20:23.262257+0000","last_fullsized":"2024-09-12T19:20:23.262257+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:33.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2273,"num_read_kb":2141,"num_write":510,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'241","reported_seq":869,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:38.915328+0000","last_change":"2024-09-12T17:29:52.716685+0000","last_active":"2024-09-12T19:22:38.915328+0000","last_peered":"2024-09-12T19:22:38.915328+0000","last_clean":"2024-09-12T19:22:38.915328+0000","last_became_active":"2024-09-12T17:29:52.716210+0000","last_became_peered":"2024-09-12T17:29:52.716210+0000","last_unstale":"2024-09-12T19:22:38.915328+0000","last_undegraded":"2024-09-12T19:22:38.915328+0000","last_fullsized":"2024-09-12T19:22:38.915328+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:59.907663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243543,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":327,"num_read_kb":381,"num_write":871,"num_write_kb":30307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":552,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:07.980821+0000","last_change":"2024-09-12T17:29:37.346714+0000","last_active":"2024-09-12T19:20:07.980821+0000","last_peered":"2024-09-12T19:20:07.980821+0000","last_clean":"2024-09-12T19:20:07.980821+0000","last_became_active":"2024-09-12T17:29:35.337987+0000","last_became_peered":"2024-09-12T17:29:35.337987+0000","last_unstale":"2024-09-12T19:20:07.980821+0000","last_undegraded":"2024-09-12T19:20:07.980821+0000","last_fullsized":"2024-09-12T19:20:07.980821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:46.254256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011496340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"38'3","reported_seq":1014,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.839940+0000","last_change":"2024-09-12T17:29:56.756687+0000","last_active":"2024-09-12T19:22:58.839940+0000","last_peered":"2024-09-12T19:22:58.839940+0000","last_clean":"2024-09-12T19:22:58.839940+0000","last_became_active":"2024-09-12T17:29:56.754415+0000","last_became_peered":"2024-09-12T17:29:56.754415+0000","last_unstale":"2024-09-12T19:22:58.839940+0000","last_undegraded":"2024-09-12T19:22:58.839940+0000","last_fullsized":"2024-09-12T19:22:58.839940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:14.164674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'175","reported_seq":781,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:52.559741+0000","last_change":"2024-09-12T17:29:58.767652+0000","last_active":"2024-09-12T19:20:52.559741+0000","last_peered":"2024-09-12T19:20:52.559741+0000","last_clean":"2024-09-12T19:20:52.559741+0000","last_became_active":"2024-09-12T17:29:58.766420+0000","last_became_peered":"2024-09-12T17:29:58.766420+0000","last_unstale":"2024-09-12T19:20:52.559741+0000","last_undegraded":"2024-09-12T19:20:52.559741+0000","last_fullsized":"2024-09-12T19:20:52.559741+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:24.045295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":231,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'814","reported_seq":5001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.293341+0000","last_change":"2024-09-12T17:30:00.796740+0000","last_active":"2024-09-12T19:22:46.293341+0000","last_peered":"2024-09-12T19:22:46.293341+0000","last_clean":"2024-09-12T19:22:46.293341+0000","last_became_active":"2024-09-12T17:30:00.793234+0000","last_became_peered":"2024-09-12T17:30:00.793234+0000","last_unstale":"2024-09-12T19:22:46.293341+0000","last_undegraded":"2024-09-12T19:22:46.293341+0000","last_fullsized":"2024-09-12T19:22:46.293341+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:52.398488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'186","reported_seq":723,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:17.279016+0000","last_change":"2024-09-12T17:30:02.800748+0000","last_active":"2024-09-12T19:21:17.279016+0000","last_peered":"2024-09-12T19:21:17.279016+0000","last_clean":"2024-09-12T19:21:17.279016+0000","last_became_active":"2024-09-12T17:30:02.799944+0000","last_became_peered":"2024-09-12T17:30:02.799944+0000","last_unstale":"2024-09-12T19:21:17.279016+0000","last_undegraded":"2024-09-12T19:21:17.279016+0000","last_fullsized":"2024-09-12T19:21:17.279016+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:37.045857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":199,"num_read_kb":188,"num_write":423,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'1235","reported_seq":2851,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.201038+0000","last_change":"2024-09-12T17:29:54.753103+0000","last_active":"2024-09-12T19:20:23.201038+0000","last_peered":"2024-09-12T19:20:23.201038+0000","last_clean":"2024-09-12T19:20:23.201038+0000","last_became_active":"2024-09-12T17:29:54.751931+0000","last_became_peered":"2024-09-12T17:29:54.751931+0000","last_unstale":"2024-09-12T19:20:23.201038+0000","last_undegraded":"2024-09-12T19:20:23.201038+0000","last_fullsized":"2024-09-12T19:20:23.201038+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":1200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:55.642337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5667,"num_read_kb":5016,"num_write":1745,"num_write_kb":765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'270","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.516108+0000","last_change":"2024-09-12T17:30:21.698110+0000","last_active":"2024-09-12T19:18:43.516108+0000","last_peered":"2024-09-12T19:18:43.516108+0000","last_clean":"2024-09-12T19:18:43.516108+0000","last_became_active":"2024-09-12T17:30:21.697470+0000","last_became_peered":"2024-09-12T17:30:21.697470+0000","last_unstale":"2024-09-12T19:18:43.516108+0000","last_undegraded":"2024-09-12T19:18:43.516108+0000","last_fullsized":"2024-09-12T19:18:43.516108+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:17.468181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13170,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":380,"num_read_kb":2583,"num_write":988,"num_write_kb":28824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":552,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.558253+0000","last_change":"2024-09-12T17:29:37.541991+0000","last_active":"2024-09-12T19:20:08.558253+0000","last_peered":"2024-09-12T19:20:08.558253+0000","last_clean":"2024-09-12T19:20:08.558253+0000","last_became_active":"2024-09-12T17:29:35.337998+0000","last_became_peered":"2024-09-12T17:29:35.337998+0000","last_unstale":"2024-09-12T19:20:08.558253+0000","last_undegraded":"2024-09-12T19:20:08.558253+0000","last_fullsized":"2024-09-12T19:20:08.558253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:23.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011850280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262198+0000","last_change":"2024-09-12T17:29:56.761573+0000","last_active":"2024-09-12T19:20:23.262198+0000","last_peered":"2024-09-12T19:20:23.262198+0000","last_clean":"2024-09-12T19:20:23.262198+0000","last_became_active":"2024-09-12T17:29:56.760822+0000","last_became_peered":"2024-09-12T17:29:56.760822+0000","last_unstale":"2024-09-12T19:20:23.262198+0000","last_undegraded":"2024-09-12T19:20:23.262198+0000","last_fullsized":"2024-09-12T19:20:23.262198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:48.200758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'808","reported_seq":1589,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.852202+0000","last_change":"2024-09-12T17:29:58.831322+0000","last_active":"2024-09-12T19:23:01.852202+0000","last_peered":"2024-09-12T19:23:01.852202+0000","last_clean":"2024-09-12T19:23:01.852202+0000","last_became_active":"2024-09-12T17:29:58.830605+0000","last_became_peered":"2024-09-12T17:29:58.830605+0000","last_unstale":"2024-09-12T19:23:01.852202+0000","last_undegraded":"2024-09-12T19:23:01.852202+0000","last_fullsized":"2024-09-12T19:23:01.852202+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:34.715340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138319,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1432,"num_read_kb":3265,"num_write":1150,"num_write_kb":898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.263615+0000","last_change":"2024-09-12T17:30:00.810969+0000","last_active":"2024-09-12T19:20:28.263615+0000","last_peered":"2024-09-12T19:20:28.263615+0000","last_clean":"2024-09-12T19:20:28.263615+0000","last_became_active":"2024-09-12T17:30:00.810341+0000","last_became_peered":"2024-09-12T17:30:00.810341+0000","last_unstale":"2024-09-12T19:20:28.263615+0000","last_undegraded":"2024-09-12T19:20:28.263615+0000","last_fullsized":"2024-09-12T19:20:28.263615+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:02.611552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'162","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:17.990022+0000","last_change":"2024-09-12T17:30:02.787340+0000","last_active":"2024-09-12T19:20:17.990022+0000","last_peered":"2024-09-12T19:20:17.990022+0000","last_clean":"2024-09-12T19:20:17.990022+0000","last_became_active":"2024-09-12T17:30:02.786443+0000","last_became_peered":"2024-09-12T17:30:02.786443+0000","last_unstale":"2024-09-12T19:20:17.990022+0000","last_undegraded":"2024-09-12T19:20:17.990022+0000","last_fullsized":"2024-09-12T19:20:17.990022+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:16.833731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":311,"num_read_kb":271,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'112","reported_seq":698,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.907333+0000","last_change":"2024-09-12T17:30:02.805626+0000","last_active":"2024-09-12T19:21:21.907333+0000","last_peered":"2024-09-12T19:21:21.907333+0000","last_clean":"2024-09-12T19:21:21.907333+0000","last_became_active":"2024-09-12T17:30:02.801038+0000","last_became_peered":"2024-09-12T17:30:02.801038+0000","last_unstale":"2024-09-12T19:21:21.907333+0000","last_undegraded":"2024-09-12T19:21:21.907333+0000","last_fullsized":"2024-09-12T19:21:21.907333+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:20.200364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":212,"num_write":265,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'453","reported_seq":2036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.190526+0000","last_change":"2024-09-12T17:29:54.761528+0000","last_active":"2024-09-12T19:19:38.190526+0000","last_peered":"2024-09-12T19:19:38.190526+0000","last_clean":"2024-09-12T19:19:38.190526+0000","last_became_active":"2024-09-12T17:29:54.760809+0000","last_became_peered":"2024-09-12T17:29:54.760809+0000","last_unstale":"2024-09-12T19:19:38.190526+0000","last_undegraded":"2024-09-12T19:19:38.190526+0000","last_fullsized":"2024-09-12T19:19:38.190526+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:31.018358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2369,"num_read_kb":2229,"num_write":528,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'332","reported_seq":1034,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.885305+0000","last_change":"2024-09-12T17:29:52.761032+0000","last_active":"2024-09-12T19:23:01.885305+0000","last_peered":"2024-09-12T19:23:01.885305+0000","last_clean":"2024-09-12T19:23:01.885305+0000","last_became_active":"2024-09-12T17:29:52.760432+0000","last_became_peered":"2024-09-12T17:29:52.760432+0000","last_unstale":"2024-09-12T19:23:01.885305+0000","last_undegraded":"2024-09-12T19:23:01.885305+0000","last_fullsized":"2024-09-12T19:23:01.885305+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:17.695625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":31499,"num_write":1138,"num_write_kb":37455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.973687+0000","last_change":"2024-09-12T17:29:56.766527+0000","last_active":"2024-09-12T19:19:37.973687+0000","last_peered":"2024-09-12T19:19:37.973687+0000","last_clean":"2024-09-12T19:19:37.973687+0000","last_became_active":"2024-09-12T17:29:56.765656+0000","last_became_peered":"2024-09-12T17:29:56.765656+0000","last_unstale":"2024-09-12T19:19:37.973687+0000","last_undegraded":"2024-09-12T19:19:37.973687+0000","last_fullsized":"2024-09-12T19:19:37.973687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:02.895743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'307","reported_seq":935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:03.285342+0000","last_change":"2024-09-12T17:29:58.778689+0000","last_active":"2024-09-12T19:22:03.285342+0000","last_peered":"2024-09-12T19:22:03.285342+0000","last_clean":"2024-09-12T19:22:03.285342+0000","last_became_active":"2024-09-12T17:29:58.777997+0000","last_became_peered":"2024-09-12T17:29:58.777997+0000","last_unstale":"2024-09-12T19:22:03.285342+0000","last_undegraded":"2024-09-12T19:22:03.285342+0000","last_fullsized":"2024-09-12T19:22:03.285342+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:11.474675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":480,"num_read_kb":893,"num_write":370,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:43.251258+0000","last_change":"2024-09-12T17:30:00.794010+0000","last_active":"2024-09-12T19:19:43.251258+0000","last_peered":"2024-09-12T19:19:43.251258+0000","last_clean":"2024-09-12T19:19:43.251258+0000","last_became_active":"2024-09-12T17:30:00.793204+0000","last_became_peered":"2024-09-12T17:30:00.793204+0000","last_unstale":"2024-09-12T19:19:43.251258+0000","last_undegraded":"2024-09-12T19:19:43.251258+0000","last_fullsized":"2024-09-12T19:19:43.251258+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:53.881334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'108","reported_seq":638,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.263789+0000","last_change":"2024-09-12T17:30:02.790200+0000","last_active":"2024-09-12T19:20:28.263789+0000","last_peered":"2024-09-12T19:20:28.263789+0000","last_clean":"2024-09-12T19:20:28.263789+0000","last_became_active":"2024-09-12T17:30:02.789511+0000","last_became_peered":"2024-09-12T17:30:02.789511+0000","last_unstale":"2024-09-12T19:20:28.263789+0000","last_undegraded":"2024-09-12T19:20:28.263789+0000","last_fullsized":"2024-09-12T19:20:28.263789+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:57.833180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":267,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'1080","reported_seq":2628,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.973714+0000","last_change":"2024-09-12T17:29:54.774595+0000","last_active":"2024-09-12T19:19:37.973714+0000","last_peered":"2024-09-12T19:19:37.973714+0000","last_clean":"2024-09-12T19:19:37.973714+0000","last_became_active":"2024-09-12T17:29:54.774337+0000","last_became_peered":"2024-09-12T17:29:54.774337+0000","last_unstale":"2024-09-12T19:19:37.973714+0000","last_undegraded":"2024-09-12T19:19:37.973714+0000","last_fullsized":"2024-09-12T19:19:37.973714+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":1000,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:59.476733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5006,"num_read_kb":4447,"num_write":1496,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'343","reported_seq":1038,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.907118+0000","last_change":"2024-09-12T17:29:52.763186+0000","last_active":"2024-09-12T19:23:01.907118+0000","last_peered":"2024-09-12T19:23:01.907118+0000","last_clean":"2024-09-12T19:23:01.907118+0000","last_became_active":"2024-09-12T17:29:52.757775+0000","last_became_peered":"2024-09-12T17:29:52.757775+0000","last_unstale":"2024-09-12T19:23:01.907118+0000","last_undegraded":"2024-09-12T19:23:01.907118+0000","last_fullsized":"2024-09-12T19:23:01.907118+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:36.685627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399166,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":510,"num_read_kb":111933,"num_write":1035,"num_write_kb":43950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.250268+0000","last_change":"2024-09-12T17:29:56.771395+0000","last_active":"2024-09-12T19:19:38.250268+0000","last_peered":"2024-09-12T19:19:38.250268+0000","last_clean":"2024-09-12T19:19:38.250268+0000","last_became_active":"2024-09-12T17:29:56.770639+0000","last_became_peered":"2024-09-12T17:29:56.770639+0000","last_unstale":"2024-09-12T19:19:38.250268+0000","last_undegraded":"2024-09-12T19:19:38.250268+0000","last_fullsized":"2024-09-12T19:19:38.250268+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:05.853569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'78","reported_seq":622,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:41.373097+0000","last_change":"2024-09-12T17:29:58.782766+0000","last_active":"2024-09-12T19:20:41.373097+0000","last_peered":"2024-09-12T19:20:41.373097+0000","last_clean":"2024-09-12T19:20:41.373097+0000","last_became_active":"2024-09-12T17:29:58.781731+0000","last_became_peered":"2024-09-12T17:29:58.781731+0000","last_unstale":"2024-09-12T19:20:41.373097+0000","last_undegraded":"2024-09-12T19:20:41.373097+0000","last_fullsized":"2024-09-12T19:20:41.373097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:49.979279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":73,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:42.963782+0000","last_change":"2024-09-12T17:30:00.801153+0000","last_active":"2024-09-12T19:19:42.963782+0000","last_peered":"2024-09-12T19:19:42.963782+0000","last_clean":"2024-09-12T19:19:42.963782+0000","last_became_active":"2024-09-12T17:30:00.799588+0000","last_became_peered":"2024-09-12T17:30:00.799588+0000","last_unstale":"2024-09-12T19:19:42.963782+0000","last_undegraded":"2024-09-12T19:19:42.963782+0000","last_fullsized":"2024-09-12T19:19:42.963782+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:18.930813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'191","reported_seq":733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.175915+0000","last_change":"2024-09-12T17:30:02.814008+0000","last_active":"2024-09-12T19:21:19.175915+0000","last_peered":"2024-09-12T19:21:19.175915+0000","last_clean":"2024-09-12T19:21:19.175915+0000","last_became_active":"2024-09-12T17:30:02.813284+0000","last_became_peered":"2024-09-12T17:30:02.813284+0000","last_unstale":"2024-09-12T19:21:19.175915+0000","last_undegraded":"2024-09-12T19:21:19.175915+0000","last_fullsized":"2024-09-12T19:21:19.175915+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:56.023655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":312,"num_read_kb":310,"num_write":442,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'824","reported_seq":2436,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:53.595775+0000","last_change":"2024-09-12T17:29:54.763134+0000","last_active":"2024-09-12T19:19:53.595775+0000","last_peered":"2024-09-12T19:19:53.595775+0000","last_clean":"2024-09-12T19:19:53.595775+0000","last_became_active":"2024-09-12T17:29:54.762793+0000","last_became_peered":"2024-09-12T17:29:54.762793+0000","last_unstale":"2024-09-12T19:19:53.595775+0000","last_undegraded":"2024-09-12T19:19:53.595775+0000","last_fullsized":"2024-09-12T19:19:53.595775+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:54.833462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3973,"num_read_kb":3581,"num_write":1093,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'282","reported_seq":905,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:00.877399+0000","last_change":"2024-09-12T17:30:21.692800+0000","last_active":"2024-09-12T19:20:00.877399+0000","last_peered":"2024-09-12T19:20:00.877399+0000","last_clean":"2024-09-12T19:20:00.877399+0000","last_became_active":"2024-09-12T17:30:21.692338+0000","last_became_peered":"2024-09-12T17:30:21.692338+0000","last_unstale":"2024-09-12T19:20:00.877399+0000","last_undegraded":"2024-09-12T19:20:00.877399+0000","last_fullsized":"2024-09-12T19:20:00.877399+0000","mapping_epoch":39,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:01.217885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2256591,"num_objects":84,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":400,"num_read_kb":2104,"num_write":967,"num_write_kb":33078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.962529+0000","last_change":"2024-09-12T17:29:56.772976+0000","last_active":"2024-09-12T19:19:37.962529+0000","last_peered":"2024-09-12T19:19:37.962529+0000","last_clean":"2024-09-12T19:19:37.962529+0000","last_became_active":"2024-09-12T17:29:56.771923+0000","last_became_peered":"2024-09-12T17:29:56.771923+0000","last_unstale":"2024-09-12T19:19:37.962529+0000","last_undegraded":"2024-09-12T19:19:37.962529+0000","last_fullsized":"2024-09-12T19:19:37.962529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:15.080934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'348","reported_seq":992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:03.285412+0000","last_change":"2024-09-12T17:29:58.782391+0000","last_active":"2024-09-12T19:22:03.285412+0000","last_peered":"2024-09-12T19:22:03.285412+0000","last_clean":"2024-09-12T19:22:03.285412+0000","last_became_active":"2024-09-12T17:29:58.781756+0000","last_became_peered":"2024-09-12T17:29:58.781756+0000","last_unstale":"2024-09-12T19:22:03.285412+0000","last_undegraded":"2024-09-12T19:22:03.285412+0000","last_fullsized":"2024-09-12T19:22:03.285412+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:18.104306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49252,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":561,"num_read_kb":1017,"num_write":436,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:43.552916+0000","last_change":"2024-09-12T17:30:00.788793+0000","last_active":"2024-09-12T19:19:43.552916+0000","last_peered":"2024-09-12T19:19:43.552916+0000","last_clean":"2024-09-12T19:19:43.552916+0000","last_became_active":"2024-09-12T17:30:00.787872+0000","last_became_peered":"2024-09-12T17:30:00.787872+0000","last_unstale":"2024-09-12T19:19:43.552916+0000","last_undegraded":"2024-09-12T19:19:43.552916+0000","last_fullsized":"2024-09-12T19:19:43.552916+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:11.139793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'137","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.416574+0000","last_change":"2024-09-12T17:30:02.790977+0000","last_active":"2024-09-12T19:21:21.416574+0000","last_peered":"2024-09-12T19:21:21.416574+0000","last_clean":"2024-09-12T19:21:21.416574+0000","last_became_active":"2024-09-12T17:30:02.790246+0000","last_became_peered":"2024-09-12T17:30:02.790246+0000","last_unstale":"2024-09-12T19:21:21.416574+0000","last_undegraded":"2024-09-12T19:21:21.416574+0000","last_fullsized":"2024-09-12T19:21:21.416574+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:27.228227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":190,"num_write":334,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'494","reported_seq":2164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.899613+0000","last_change":"2024-09-12T17:30:22.256595+0000","last_active":"2024-09-12T19:21:55.899613+0000","last_peered":"2024-09-12T19:21:55.899613+0000","last_clean":"2024-09-12T19:21:55.899613+0000","last_became_active":"2024-09-12T17:30:22.255871+0000","last_became_peered":"2024-09-12T17:30:22.255871+0000","last_unstale":"2024-09-12T19:21:55.899613+0000","last_undegraded":"2024-09-12T19:21:55.899613+0000","last_fullsized":"2024-09-12T19:21:55.899613+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:37.746895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2849,"num_read_kb":2646,"num_write":616,"num_write_kb":185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'330","reported_seq":1071,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.958227+0000","last_change":"2024-09-12T17:29:52.726203+0000","last_active":"2024-09-12T19:23:01.958227+0000","last_peered":"2024-09-12T19:23:01.958227+0000","last_clean":"2024-09-12T19:23:01.958227+0000","last_became_active":"2024-09-12T17:29:52.725672+0000","last_became_peered":"2024-09-12T17:29:52.725672+0000","last_unstale":"2024-09-12T19:23:01.958227+0000","last_undegraded":"2024-09-12T19:23:01.958227+0000","last_fullsized":"2024-09-12T19:23:01.958227+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:14.245863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524466,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":607,"num_read_kb":120165,"num_write":1109,"num_write_kb":47030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.551750+0000","last_change":"2024-09-12T17:29:56.762247+0000","last_active":"2024-09-12T19:19:38.551750+0000","last_peered":"2024-09-12T19:19:38.551750+0000","last_clean":"2024-09-12T19:19:38.551750+0000","last_became_active":"2024-09-12T17:29:56.761442+0000","last_became_peered":"2024-09-12T17:29:56.761442+0000","last_unstale":"2024-09-12T19:19:38.551750+0000","last_undegraded":"2024-09-12T19:19:38.551750+0000","last_fullsized":"2024-09-12T19:19:38.551750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:29.298860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'324","reported_seq":935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.271936+0000","last_change":"2024-09-12T17:29:58.758717+0000","last_active":"2024-09-12T19:23:01.271936+0000","last_peered":"2024-09-12T19:23:01.271936+0000","last_clean":"2024-09-12T19:23:01.271936+0000","last_became_active":"2024-09-12T17:29:58.758050+0000","last_became_peered":"2024-09-12T17:29:58.758050+0000","last_unstale":"2024-09-12T19:23:01.271936+0000","last_undegraded":"2024-09-12T19:23:01.271936+0000","last_fullsized":"2024-09-12T19:23:01.271936+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:17.764686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47374,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":545,"num_read_kb":1211,"num_write":440,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:43.181010+0000","last_change":"2024-09-12T17:30:00.780831+0000","last_active":"2024-09-12T19:19:43.181010+0000","last_peered":"2024-09-12T19:19:43.181010+0000","last_clean":"2024-09-12T19:19:43.181010+0000","last_became_active":"2024-09-12T17:30:00.780216+0000","last_became_peered":"2024-09-12T17:30:00.780216+0000","last_unstale":"2024-09-12T19:19:43.181010+0000","last_undegraded":"2024-09-12T19:19:43.181010+0000","last_fullsized":"2024-09-12T19:19:43.181010+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:54.040743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'412","reported_seq":1851,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.561608+0000","last_change":"2024-09-12T17:29:54.777350+0000","last_active":"2024-09-12T19:20:23.561608+0000","last_peered":"2024-09-12T19:20:23.561608+0000","last_clean":"2024-09-12T19:20:23.561608+0000","last_became_active":"2024-09-12T17:29:54.776503+0000","last_became_peered":"2024-09-12T17:29:54.776503+0000","last_unstale":"2024-09-12T19:20:23.561608+0000","last_undegraded":"2024-09-12T19:20:23.561608+0000","last_fullsized":"2024-09-12T19:20:23.561608+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:48.613783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2157,"num_read_kb":2011,"num_write":494,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'283","reported_seq":985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:38.235299+0000","last_change":"2024-09-12T17:29:52.716790+0000","last_active":"2024-09-12T19:18:38.235299+0000","last_peered":"2024-09-12T19:18:38.235299+0000","last_clean":"2024-09-12T19:18:38.235299+0000","last_became_active":"2024-09-12T17:29:52.716376+0000","last_became_peered":"2024-09-12T17:29:52.716376+0000","last_unstale":"2024-09-12T19:18:38.235299+0000","last_undegraded":"2024-09-12T19:18:38.235299+0000","last_fullsized":"2024-09-12T19:18:38.235299+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:51.977058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7472771,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":513,"num_read_kb":2666,"num_write":1067,"num_write_kb":45238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:18.190273+0000","last_change":"2024-09-12T17:29:56.773917+0000","last_active":"2024-09-12T19:20:18.190273+0000","last_peered":"2024-09-12T19:20:18.190273+0000","last_clean":"2024-09-12T19:20:18.190273+0000","last_became_active":"2024-09-12T17:29:56.773239+0000","last_became_peered":"2024-09-12T17:29:56.773239+0000","last_unstale":"2024-09-12T19:20:18.190273+0000","last_undegraded":"2024-09-12T19:20:18.190273+0000","last_fullsized":"2024-09-12T19:20:18.190273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:02.813155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'553","reported_seq":1227,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.189986+0000","last_change":"2024-09-12T17:29:58.779631+0000","last_active":"2024-09-12T19:23:01.189986+0000","last_peered":"2024-09-12T19:23:01.189986+0000","last_clean":"2024-09-12T19:23:01.189986+0000","last_became_active":"2024-09-12T17:29:58.778931+0000","last_became_peered":"2024-09-12T17:29:58.778931+0000","last_unstale":"2024-09-12T19:23:01.189986+0000","last_undegraded":"2024-09-12T19:23:01.189986+0000","last_fullsized":"2024-09-12T19:23:01.189986+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:14.544244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":998,"num_read_kb":2327,"num_write":858,"num_write_kb":737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.986697+0000","last_change":"2024-09-12T17:30:00.802806+0000","last_active":"2024-09-12T19:20:02.986697+0000","last_peered":"2024-09-12T19:20:02.986697+0000","last_clean":"2024-09-12T19:20:02.986697+0000","last_became_active":"2024-09-12T17:30:00.802021+0000","last_became_peered":"2024-09-12T17:30:00.802021+0000","last_unstale":"2024-09-12T19:20:02.986697+0000","last_undegraded":"2024-09-12T19:20:02.986697+0000","last_fullsized":"2024-09-12T19:20:02.986697+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:49.504684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'167","reported_seq":710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:43.251407+0000","last_change":"2024-09-12T17:30:02.795603+0000","last_active":"2024-09-12T19:19:43.251407+0000","last_peered":"2024-09-12T19:19:43.251407+0000","last_clean":"2024-09-12T19:19:43.251407+0000","last_became_active":"2024-09-12T17:30:02.794353+0000","last_became_peered":"2024-09-12T17:30:02.794353+0000","last_unstale":"2024-09-12T19:19:43.251407+0000","last_undegraded":"2024-09-12T19:19:43.251407+0000","last_fullsized":"2024-09-12T19:19:43.251407+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:41.683296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":277,"num_read_kb":276,"num_write":376,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'723","reported_seq":2316,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.139310+0000","last_change":"2024-09-12T17:29:54.761432+0000","last_active":"2024-09-12T19:21:19.139310+0000","last_peered":"2024-09-12T19:21:19.139310+0000","last_clean":"2024-09-12T19:21:19.139310+0000","last_became_active":"2024-09-12T17:29:54.761144+0000","last_became_peered":"2024-09-12T17:29:54.761144+0000","last_unstale":"2024-09-12T19:21:19.139310+0000","last_undegraded":"2024-09-12T19:21:19.139310+0000","last_fullsized":"2024-09-12T19:21:19.139310+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":700,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:07.824094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3459,"num_read_kb":3076,"num_write":1006,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'309","reported_seq":927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.848731+0000","last_change":"2024-09-12T17:29:52.742141+0000","last_active":"2024-09-12T19:23:01.848731+0000","last_peered":"2024-09-12T19:23:01.848731+0000","last_clean":"2024-09-12T19:23:01.848731+0000","last_became_active":"2024-09-12T17:29:52.741594+0000","last_became_peered":"2024-09-12T17:29:52.741594+0000","last_unstale":"2024-09-12T19:23:01.848731+0000","last_undegraded":"2024-09-12T19:23:01.848731+0000","last_fullsized":"2024-09-12T19:23:01.848731+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:12.453167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262349,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":376,"num_read_kb":5602,"num_write":913,"num_write_kb":46297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.561587+0000","last_change":"2024-09-12T17:29:56.762091+0000","last_active":"2024-09-12T19:20:23.561587+0000","last_peered":"2024-09-12T19:20:23.561587+0000","last_clean":"2024-09-12T19:20:23.561587+0000","last_became_active":"2024-09-12T17:29:56.761256+0000","last_became_peered":"2024-09-12T17:29:56.761256+0000","last_unstale":"2024-09-12T19:20:23.561587+0000","last_undegraded":"2024-09-12T19:20:23.561587+0000","last_fullsized":"2024-09-12T19:20:23.561587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:38.052214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'389","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.339586+0000","last_change":"2024-09-12T17:29:58.769030+0000","last_active":"2024-09-12T19:23:01.339586+0000","last_peered":"2024-09-12T19:23:01.339586+0000","last_clean":"2024-09-12T19:23:01.339586+0000","last_became_active":"2024-09-12T17:29:58.768310+0000","last_became_peered":"2024-09-12T17:29:58.768310+0000","last_unstale":"2024-09-12T19:23:01.339586+0000","last_undegraded":"2024-09-12T19:23:01.339586+0000","last_fullsized":"2024-09-12T19:23:01.339586+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:31.668084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51217,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":641,"num_read_kb":1226,"num_write":524,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.979690+0000","last_change":"2024-09-12T17:30:00.805417+0000","last_active":"2024-09-12T19:20:02.979690+0000","last_peered":"2024-09-12T19:20:02.979690+0000","last_clean":"2024-09-12T19:20:02.979690+0000","last_became_active":"2024-09-12T17:30:00.804655+0000","last_became_peered":"2024-09-12T17:30:00.804655+0000","last_unstale":"2024-09-12T19:20:02.979690+0000","last_undegraded":"2024-09-12T19:20:02.979690+0000","last_fullsized":"2024-09-12T19:20:02.979690+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:59.390183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'189","reported_seq":1089,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.747208+0000","last_change":"2024-09-12T17:30:02.815235+0000","last_active":"2024-09-12T19:21:21.747208+0000","last_peered":"2024-09-12T19:21:21.747208+0000","last_clean":"2024-09-12T19:21:21.747208+0000","last_became_active":"2024-09-12T17:30:02.813027+0000","last_became_peered":"2024-09-12T17:30:02.813027+0000","last_unstale":"2024-09-12T19:21:21.747208+0000","last_undegraded":"2024-09-12T19:21:21.747208+0000","last_fullsized":"2024-09-12T19:21:21.747208+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:45.419844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2050,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":664,"num_read_kb":654,"num_write":538,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'390","reported_seq":1798,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.254923+0000","last_change":"2024-09-12T17:29:54.757128+0000","last_active":"2024-09-12T19:19:58.254923+0000","last_peered":"2024-09-12T19:19:58.254923+0000","last_clean":"2024-09-12T19:19:58.254923+0000","last_became_active":"2024-09-12T17:29:54.756800+0000","last_became_peered":"2024-09-12T17:29:54.756800+0000","last_unstale":"2024-09-12T19:19:58.254923+0000","last_undegraded":"2024-09-12T19:19:58.254923+0000","last_fullsized":"2024-09-12T19:19:58.254923+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:42.137004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1992,"num_read_kb":1877,"num_write":455,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'311","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.957551+0000","last_change":"2024-09-12T17:29:52.756252+0000","last_active":"2024-09-12T19:23:01.957551+0000","last_peered":"2024-09-12T19:23:01.957551+0000","last_clean":"2024-09-12T19:23:01.957551+0000","last_became_active":"2024-09-12T17:29:52.755401+0000","last_became_peered":"2024-09-12T17:29:52.755401+0000","last_unstale":"2024-09-12T19:23:01.957551+0000","last_undegraded":"2024-09-12T19:23:01.957551+0000","last_fullsized":"2024-09-12T19:23:01.957551+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:19.340127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2036176,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":3663,"num_write":1039,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.195101+0000","last_change":"2024-09-12T17:29:56.759557+0000","last_active":"2024-09-12T19:19:58.195101+0000","last_peered":"2024-09-12T19:19:58.195101+0000","last_clean":"2024-09-12T19:19:58.195101+0000","last_became_active":"2024-09-12T17:29:56.752172+0000","last_became_peered":"2024-09-12T17:29:56.752172+0000","last_unstale":"2024-09-12T19:19:58.195101+0000","last_undegraded":"2024-09-12T19:19:58.195101+0000","last_fullsized":"2024-09-12T19:19:58.195101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:01.184376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'325","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:33.291005+0000","last_change":"2024-09-12T17:29:58.832518+0000","last_active":"2024-09-12T19:22:33.291005+0000","last_peered":"2024-09-12T19:22:33.291005+0000","last_clean":"2024-09-12T19:22:33.291005+0000","last_became_active":"2024-09-12T17:29:58.831574+0000","last_became_peered":"2024-09-12T17:29:58.831574+0000","last_unstale":"2024-09-12T19:22:33.291005+0000","last_undegraded":"2024-09-12T19:22:33.291005+0000","last_fullsized":"2024-09-12T19:22:33.291005+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:45.202085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53455,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":517,"num_read_kb":965,"num_write":408,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:32.986123+0000","last_change":"2024-09-12T17:30:00.805560+0000","last_active":"2024-09-12T19:20:32.986123+0000","last_peered":"2024-09-12T19:20:32.986123+0000","last_clean":"2024-09-12T19:20:32.986123+0000","last_became_active":"2024-09-12T17:30:00.804705+0000","last_became_peered":"2024-09-12T17:30:00.804705+0000","last_unstale":"2024-09-12T19:20:32.986123+0000","last_undegraded":"2024-09-12T19:20:32.986123+0000","last_fullsized":"2024-09-12T19:20:32.986123+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:30.654520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'113","reported_seq":624,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.252350+0000","last_change":"2024-09-12T17:30:02.787761+0000","last_active":"2024-09-12T19:22:46.252350+0000","last_peered":"2024-09-12T19:22:46.252350+0000","last_clean":"2024-09-12T19:22:46.252350+0000","last_became_active":"2024-09-12T17:30:02.787038+0000","last_became_peered":"2024-09-12T17:30:02.787038+0000","last_unstale":"2024-09-12T19:22:46.252350+0000","last_undegraded":"2024-09-12T19:22:46.252350+0000","last_fullsized":"2024-09-12T19:22:46.252350+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:46.467512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":121,"num_write":252,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'360","reported_seq":1890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.436578+0000","last_change":"2024-09-12T17:29:54.742127+0000","last_active":"2024-09-12T19:21:21.436578+0000","last_peered":"2024-09-12T19:21:21.436578+0000","last_clean":"2024-09-12T19:21:21.436578+0000","last_became_active":"2024-09-12T17:29:54.741486+0000","last_became_peered":"2024-09-12T17:29:54.741486+0000","last_unstale":"2024-09-12T19:21:21.436578+0000","last_undegraded":"2024-09-12T19:21:21.436578+0000","last_fullsized":"2024-09-12T19:21:21.436578+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:16.184632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1958,"num_read_kb":1901,"num_write":388,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'318","reported_seq":1029,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.832928+0000","last_change":"2024-09-12T17:29:52.767395+0000","last_active":"2024-09-12T19:23:01.832928+0000","last_peered":"2024-09-12T19:23:01.832928+0000","last_clean":"2024-09-12T19:23:01.832928+0000","last_became_active":"2024-09-12T17:29:52.766141+0000","last_became_peered":"2024-09-12T17:29:52.766141+0000","last_unstale":"2024-09-12T19:23:01.832928+0000","last_undegraded":"2024-09-12T19:23:01.832928+0000","last_fullsized":"2024-09-12T19:23:01.832928+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:32.771937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7320708,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":562,"num_read_kb":101880,"num_write":1008,"num_write_kb":18651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"38'5","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.837339+0000","last_change":"2024-09-12T17:29:56.761300+0000","last_active":"2024-09-12T19:22:58.837339+0000","last_peered":"2024-09-12T19:22:58.837339+0000","last_clean":"2024-09-12T19:22:58.837339+0000","last_became_active":"2024-09-12T17:29:56.760505+0000","last_became_peered":"2024-09-12T17:29:56.760505+0000","last_unstale":"2024-09-12T19:22:58.837339+0000","last_undegraded":"2024-09-12T19:22:58.837339+0000","last_fullsized":"2024-09-12T19:22:58.837339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:19.918382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'170","reported_seq":762,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:53.697797+0000","last_change":"2024-09-12T17:29:58.830103+0000","last_active":"2024-09-12T19:20:53.697797+0000","last_peered":"2024-09-12T19:20:53.697797+0000","last_clean":"2024-09-12T19:20:53.697797+0000","last_became_active":"2024-09-12T17:29:58.829023+0000","last_became_peered":"2024-09-12T17:29:58.829023+0000","last_unstale":"2024-09-12T19:20:53.697797+0000","last_undegraded":"2024-09-12T19:20:53.697797+0000","last_fullsized":"2024-09-12T19:20:53.697797+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:27.778582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":218,"num_write":206,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'770","reported_seq":3287,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.282972+0000","last_change":"2024-09-12T17:30:00.787430+0000","last_active":"2024-09-12T19:22:46.282972+0000","last_peered":"2024-09-12T19:22:46.282972+0000","last_clean":"2024-09-12T19:22:46.282972+0000","last_became_active":"2024-09-12T17:30:00.786102+0000","last_became_peered":"2024-09-12T17:30:00.786102+0000","last_unstale":"2024-09-12T19:22:46.282972+0000","last_undegraded":"2024-09-12T19:22:46.282972+0000","last_fullsized":"2024-09-12T19:22:46.282972+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:58.157521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'148","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.288957+0000","last_change":"2024-09-12T17:30:02.804619+0000","last_active":"2024-09-12T19:21:19.288957+0000","last_peered":"2024-09-12T19:21:19.288957+0000","last_clean":"2024-09-12T19:21:19.288957+0000","last_became_active":"2024-09-12T17:30:02.803612+0000","last_became_peered":"2024-09-12T17:30:02.803612+0000","last_unstale":"2024-09-12T19:21:19.288957+0000","last_undegraded":"2024-09-12T19:21:19.288957+0000","last_fullsized":"2024-09-12T19:21:19.288957+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:34.332012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":232,"num_read_kb":219,"num_write":373,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'827","reported_seq":2550,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.933874+0000","last_change":"2024-09-12T17:30:21.699087+0000","last_active":"2024-09-12T19:20:27.933874+0000","last_peered":"2024-09-12T19:20:27.933874+0000","last_clean":"2024-09-12T19:20:27.933874+0000","last_became_active":"2024-09-12T17:30:21.696952+0000","last_became_peered":"2024-09-12T17:30:21.696952+0000","last_unstale":"2024-09-12T19:20:27.933874+0000","last_undegraded":"2024-09-12T19:20:27.933874+0000","last_fullsized":"2024-09-12T19:20:27.933874+0000","mapping_epoch":39,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:48.294079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3950,"num_read_kb":3589,"num_write":1060,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'353","reported_seq":1072,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.976090+0000","last_change":"2024-09-12T17:29:52.753703+0000","last_active":"2024-09-12T19:23:01.976090+0000","last_peered":"2024-09-12T19:23:01.976090+0000","last_clean":"2024-09-12T19:23:01.976090+0000","last_became_active":"2024-09-12T17:29:52.749735+0000","last_became_peered":"2024-09-12T17:29:52.749735+0000","last_unstale":"2024-09-12T19:23:01.976090+0000","last_undegraded":"2024-09-12T19:23:01.976090+0000","last_fullsized":"2024-09-12T19:23:01.976090+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:40.802637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437125,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":46392,"num_write":1072,"num_write_kb":51525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.967526+0000","last_change":"2024-09-12T17:29:56.766629+0000","last_active":"2024-09-12T19:19:57.967526+0000","last_peered":"2024-09-12T19:19:57.967526+0000","last_clean":"2024-09-12T19:19:57.967526+0000","last_became_active":"2024-09-12T17:29:56.765909+0000","last_became_peered":"2024-09-12T17:29:56.765909+0000","last_unstale":"2024-09-12T19:19:57.967526+0000","last_undegraded":"2024-09-12T19:19:57.967526+0000","last_fullsized":"2024-09-12T19:19:57.967526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:16.737963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'386","reported_seq":1032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.586459+0000","last_change":"2024-09-12T17:29:58.772348+0000","last_active":"2024-09-12T19:23:00.586459+0000","last_peered":"2024-09-12T19:23:00.586459+0000","last_clean":"2024-09-12T19:23:00.586459+0000","last_became_active":"2024-09-12T17:29:58.771522+0000","last_became_peered":"2024-09-12T17:29:58.771522+0000","last_unstale":"2024-09-12T19:23:00.586459+0000","last_undegraded":"2024-09-12T19:23:00.586459+0000","last_fullsized":"2024-09-12T19:23:00.586459+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:37.869319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46902,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":612,"num_read_kb":1188,"num_write":476,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:48.165589+0000","last_change":"2024-09-12T17:30:00.789334+0000","last_active":"2024-09-12T19:18:48.165589+0000","last_peered":"2024-09-12T19:18:48.165589+0000","last_clean":"2024-09-12T19:18:48.165589+0000","last_became_active":"2024-09-12T17:30:00.788559+0000","last_became_peered":"2024-09-12T17:30:00.788559+0000","last_unstale":"2024-09-12T19:18:48.165589+0000","last_undegraded":"2024-09-12T19:18:48.165589+0000","last_fullsized":"2024-09-12T19:18:48.165589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:23.307242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'116","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:12.986237+0000","last_change":"2024-09-12T17:30:02.807855+0000","last_active":"2024-09-12T19:21:12.986237+0000","last_peered":"2024-09-12T19:21:12.986237+0000","last_clean":"2024-09-12T19:21:12.986237+0000","last_became_active":"2024-09-12T17:30:02.807083+0000","last_became_peered":"2024-09-12T17:30:02.807083+0000","last_unstale":"2024-09-12T19:21:12.986237+0000","last_undegraded":"2024-09-12T19:21:12.986237+0000","last_fullsized":"2024-09-12T19:21:12.986237+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:51.993531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":147,"num_write":283,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'825","reported_seq":2498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.437648+0000","last_change":"2024-09-12T17:29:54.774040+0000","last_active":"2024-09-12T19:21:21.437648+0000","last_peered":"2024-09-12T19:21:21.437648+0000","last_clean":"2024-09-12T19:21:21.437648+0000","last_became_active":"2024-09-12T17:29:54.770569+0000","last_became_peered":"2024-09-12T17:29:54.770569+0000","last_unstale":"2024-09-12T19:21:21.437648+0000","last_undegraded":"2024-09-12T19:21:21.437648+0000","last_fullsized":"2024-09-12T19:21:21.437648+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:01.250678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4029,"num_read_kb":3656,"num_write":1088,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'392","reported_seq":1299,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.975417+0000","last_change":"2024-09-12T17:29:52.750235+0000","last_active":"2024-09-12T19:23:01.975417+0000","last_peered":"2024-09-12T19:23:01.975417+0000","last_clean":"2024-09-12T19:23:01.975417+0000","last_became_active":"2024-09-12T17:29:52.749566+0000","last_became_peered":"2024-09-12T17:29:52.749566+0000","last_unstale":"2024-09-12T19:23:01.975417+0000","last_undegraded":"2024-09-12T19:23:01.975417+0000","last_fullsized":"2024-09-12T19:23:01.975417+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:16.632102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174738,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1171,"num_read_kb":8659,"num_write":1266,"num_write_kb":49806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.985406+0000","last_change":"2024-09-12T17:29:56.768011+0000","last_active":"2024-09-12T19:19:57.985406+0000","last_peered":"2024-09-12T19:19:57.985406+0000","last_clean":"2024-09-12T19:19:57.985406+0000","last_became_active":"2024-09-12T17:29:56.766952+0000","last_became_peered":"2024-09-12T17:29:56.766952+0000","last_unstale":"2024-09-12T19:19:57.985406+0000","last_undegraded":"2024-09-12T19:19:57.985406+0000","last_fullsized":"2024-09-12T19:19:57.985406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:54.137260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'322","reported_seq":938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.669796+0000","last_change":"2024-09-12T17:29:58.783690+0000","last_active":"2024-09-12T19:23:00.669796+0000","last_peered":"2024-09-12T19:23:00.669796+0000","last_clean":"2024-09-12T19:23:00.669796+0000","last_became_active":"2024-09-12T17:29:58.783105+0000","last_became_peered":"2024-09-12T17:29:58.783105+0000","last_unstale":"2024-09-12T19:23:00.669796+0000","last_undegraded":"2024-09-12T19:23:00.669796+0000","last_fullsized":"2024-09-12T19:23:00.669796+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:02.161325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50641,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":544,"num_read_kb":1206,"num_write":440,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.544277+0000","last_change":"2024-09-12T17:30:00.800799+0000","last_active":"2024-09-12T19:19:03.544277+0000","last_peered":"2024-09-12T19:19:03.544277+0000","last_clean":"2024-09-12T19:19:03.544277+0000","last_became_active":"2024-09-12T17:30:00.799680+0000","last_became_peered":"2024-09-12T17:30:00.799680+0000","last_unstale":"2024-09-12T19:19:03.544277+0000","last_undegraded":"2024-09-12T19:19:03.544277+0000","last_fullsized":"2024-09-12T19:19:03.544277+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:13.337531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'130","reported_seq":684,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:48.237923+0000","last_change":"2024-09-12T17:30:02.787080+0000","last_active":"2024-09-12T19:18:48.237923+0000","last_peered":"2024-09-12T19:18:48.237923+0000","last_clean":"2024-09-12T19:18:48.237923+0000","last_became_active":"2024-09-12T17:30:02.786478+0000","last_became_peered":"2024-09-12T17:30:02.786478+0000","last_unstale":"2024-09-12T19:18:48.237923+0000","last_undegraded":"2024-09-12T19:18:48.237923+0000","last_fullsized":"2024-09-12T19:18:48.237923+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:32.030701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":240,"num_read_kb":229,"num_write":300,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'976","reported_seq":2759,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.994489+0000","last_change":"2024-09-12T17:29:54.762247+0000","last_active":"2024-09-12T19:22:44.994489+0000","last_peered":"2024-09-12T19:22:44.994489+0000","last_clean":"2024-09-12T19:22:44.994489+0000","last_became_active":"2024-09-12T17:29:54.761902+0000","last_became_peered":"2024-09-12T17:29:54.761902+0000","last_unstale":"2024-09-12T19:22:44.994489+0000","last_undegraded":"2024-09-12T19:22:44.994489+0000","last_fullsized":"2024-09-12T19:22:44.994489+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":900,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:57.000138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4608,"num_read_kb":4133,"num_write":1300,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'269","reported_seq":926,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:18.261132+0000","last_change":"2024-09-12T17:29:52.733633+0000","last_active":"2024-09-12T19:20:18.261132+0000","last_peered":"2024-09-12T19:20:18.261132+0000","last_clean":"2024-09-12T19:20:18.261132+0000","last_became_active":"2024-09-12T17:29:52.733119+0000","last_became_peered":"2024-09-12T17:29:52.733119+0000","last_unstale":"2024-09-12T19:20:18.261132+0000","last_undegraded":"2024-09-12T19:20:18.261132+0000","last_fullsized":"2024-09-12T19:20:18.261132+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:07.270536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5297874,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":406,"num_read_kb":1565,"num_write":1091,"num_write_kb":34702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.177481+0000","last_change":"2024-09-12T17:29:56.761445+0000","last_active":"2024-09-12T19:18:43.177481+0000","last_peered":"2024-09-12T19:18:43.177481+0000","last_clean":"2024-09-12T19:18:43.177481+0000","last_became_active":"2024-09-12T17:29:56.760142+0000","last_became_peered":"2024-09-12T17:29:56.760142+0000","last_unstale":"2024-09-12T19:18:43.177481+0000","last_undegraded":"2024-09-12T19:18:43.177481+0000","last_fullsized":"2024-09-12T19:18:43.177481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:58.137646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'269","reported_seq":858,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:33.290820+0000","last_change":"2024-09-12T17:29:58.775954+0000","last_active":"2024-09-12T19:22:33.290820+0000","last_peered":"2024-09-12T19:22:33.290820+0000","last_clean":"2024-09-12T19:22:33.290820+0000","last_became_active":"2024-09-12T17:29:58.775284+0000","last_became_peered":"2024-09-12T17:29:58.775284+0000","last_unstale":"2024-09-12T19:22:33.290820+0000","last_undegraded":"2024-09-12T19:22:33.290820+0000","last_fullsized":"2024-09-12T19:22:33.290820+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:04.232747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47771,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":415,"num_read_kb":848,"num_write":348,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.196243+0000","last_change":"2024-09-12T17:30:00.791617+0000","last_active":"2024-09-12T19:20:03.196243+0000","last_peered":"2024-09-12T19:20:03.196243+0000","last_clean":"2024-09-12T19:20:03.196243+0000","last_became_active":"2024-09-12T17:30:00.790907+0000","last_became_peered":"2024-09-12T17:30:00.790907+0000","last_unstale":"2024-09-12T19:20:03.196243+0000","last_undegraded":"2024-09-12T19:20:03.196243+0000","last_fullsized":"2024-09-12T19:20:03.196243+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:40.769544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'156","reported_seq":1270,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:13.192105+0000","last_change":"2024-09-12T17:30:02.813564+0000","last_active":"2024-09-12T19:21:13.192105+0000","last_peered":"2024-09-12T19:21:13.192105+0000","last_clean":"2024-09-12T19:21:13.192105+0000","last_became_active":"2024-09-12T17:30:02.812918+0000","last_became_peered":"2024-09-12T17:30:02.812918+0000","last_unstale":"2024-09-12T19:21:13.192105+0000","last_undegraded":"2024-09-12T19:21:13.192105+0000","last_fullsized":"2024-09-12T19:21:13.192105+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:30.419361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":804,"num_write":370,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'756","reported_seq":2286,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.177531+0000","last_change":"2024-09-12T17:29:54.768778+0000","last_active":"2024-09-12T19:18:43.177531+0000","last_peered":"2024-09-12T19:18:43.177531+0000","last_clean":"2024-09-12T19:18:43.177531+0000","last_became_active":"2024-09-12T17:29:54.767573+0000","last_became_peered":"2024-09-12T17:29:54.767573+0000","last_unstale":"2024-09-12T19:18:43.177531+0000","last_undegraded":"2024-09-12T19:18:43.177531+0000","last_fullsized":"2024-09-12T19:18:43.177531+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:31.066680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3552,"num_read_kb":3227,"num_write":976,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'365","reported_seq":1226,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.832859+0000","last_change":"2024-09-12T17:29:52.766538+0000","last_active":"2024-09-12T19:23:01.832859+0000","last_peered":"2024-09-12T19:23:01.832859+0000","last_clean":"2024-09-12T19:23:01.832859+0000","last_became_active":"2024-09-12T17:29:52.765692+0000","last_became_peered":"2024-09-12T17:29:52.765692+0000","last_unstale":"2024-09-12T19:23:01.832859+0000","last_undegraded":"2024-09-12T19:23:01.832859+0000","last_fullsized":"2024-09-12T19:23:01.832859+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:37.762190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110874,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":771,"num_read_kb":82698,"num_write":1110,"num_write_kb":56258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:12.968197+0000","last_change":"2024-09-12T17:29:56.761088+0000","last_active":"2024-09-12T19:19:12.968197+0000","last_peered":"2024-09-12T19:19:12.968197+0000","last_clean":"2024-09-12T19:19:12.968197+0000","last_became_active":"2024-09-12T17:29:56.760345+0000","last_became_peered":"2024-09-12T17:29:56.760345+0000","last_unstale":"2024-09-12T19:19:12.968197+0000","last_undegraded":"2024-09-12T19:19:12.968197+0000","last_fullsized":"2024-09-12T19:19:12.968197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:02.802366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'344","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.856112+0000","last_change":"2024-09-12T17:29:58.769661+0000","last_active":"2024-09-12T19:22:59.856112+0000","last_peered":"2024-09-12T19:22:59.856112+0000","last_clean":"2024-09-12T19:22:59.856112+0000","last_became_active":"2024-09-12T17:29:58.768812+0000","last_became_peered":"2024-09-12T17:29:58.768812+0000","last_unstale":"2024-09-12T19:22:59.856112+0000","last_undegraded":"2024-09-12T19:22:59.856112+0000","last_fullsized":"2024-09-12T19:22:59.856112+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:55.549725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46003,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1072,"num_write":420,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.185932+0000","last_change":"2024-09-12T17:30:00.786938+0000","last_active":"2024-09-12T19:20:03.185932+0000","last_peered":"2024-09-12T19:20:03.185932+0000","last_clean":"2024-09-12T19:20:03.185932+0000","last_became_active":"2024-09-12T17:30:00.786100+0000","last_became_peered":"2024-09-12T17:30:00.786100+0000","last_unstale":"2024-09-12T19:20:03.185932+0000","last_undegraded":"2024-09-12T19:20:03.185932+0000","last_fullsized":"2024-09-12T19:20:03.185932+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:07.158524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'138","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.989412+0000","last_change":"2024-09-12T17:30:02.808784+0000","last_active":"2024-09-12T19:22:44.989412+0000","last_peered":"2024-09-12T19:22:44.989412+0000","last_clean":"2024-09-12T19:22:44.989412+0000","last_became_active":"2024-09-12T17:30:02.807953+0000","last_became_peered":"2024-09-12T17:30:02.807953+0000","last_unstale":"2024-09-12T19:22:44.989412+0000","last_undegraded":"2024-09-12T19:22:44.989412+0000","last_fullsized":"2024-09-12T19:22:44.989412+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:19.588574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216,"num_read_kb":199,"num_write":346,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'852","reported_seq":2464,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.442108+0000","last_change":"2024-09-12T17:29:54.768750+0000","last_active":"2024-09-12T19:21:21.442108+0000","last_peered":"2024-09-12T19:21:21.442108+0000","last_clean":"2024-09-12T19:21:21.442108+0000","last_became_active":"2024-09-12T17:29:54.768439+0000","last_became_peered":"2024-09-12T17:29:54.768439+0000","last_unstale":"2024-09-12T19:21:21.442108+0000","last_undegraded":"2024-09-12T19:21:21.442108+0000","last_fullsized":"2024-09-12T19:21:21.442108+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:29.593777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3940,"num_read_kb":3539,"num_write":1104,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'323","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:18.560246+0000","last_change":"2024-09-12T17:29:52.738990+0000","last_active":"2024-09-12T19:20:18.560246+0000","last_peered":"2024-09-12T19:20:18.560246+0000","last_clean":"2024-09-12T19:20:18.560246+0000","last_became_active":"2024-09-12T17:29:52.732894+0000","last_became_peered":"2024-09-12T17:29:52.732894+0000","last_unstale":"2024-09-12T19:20:18.560246+0000","last_undegraded":"2024-09-12T19:20:18.560246+0000","last_fullsized":"2024-09-12T19:20:18.560246+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:05.898096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10511198,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":522,"num_read_kb":27715,"num_write":1217,"num_write_kb":46649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'495","reported_seq":1986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.006107+0000","last_change":"2024-09-12T17:29:54.747526+0000","last_active":"2024-09-12T19:22:45.006107+0000","last_peered":"2024-09-12T19:22:45.006107+0000","last_clean":"2024-09-12T19:22:45.006107+0000","last_became_active":"2024-09-12T17:29:54.745192+0000","last_became_peered":"2024-09-12T17:29:54.745192+0000","last_unstale":"2024-09-12T19:22:45.006107+0000","last_undegraded":"2024-09-12T19:22:45.006107+0000","last_fullsized":"2024-09-12T19:22:45.006107+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:53.534036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2446,"num_read_kb":2266,"num_write":619,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'340","reported_seq":1074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:43.825981+0000","last_change":"2024-09-12T17:29:52.728474+0000","last_active":"2024-09-12T19:22:43.825981+0000","last_peered":"2024-09-12T19:22:43.825981+0000","last_clean":"2024-09-12T19:22:43.825981+0000","last_became_active":"2024-09-12T17:29:52.727433+0000","last_became_peered":"2024-09-12T17:29:52.727433+0000","last_unstale":"2024-09-12T19:22:43.825981+0000","last_undegraded":"2024-09-12T19:22:43.825981+0000","last_fullsized":"2024-09-12T19:22:43.825981+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:45.539010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11557877,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":623,"num_read_kb":95087,"num_write":1222,"num_write_kb":35037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'393","reported_seq":1964,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.992422+0000","last_change":"2024-09-12T17:29:54.764069+0000","last_active":"2024-09-12T19:20:27.992422+0000","last_peered":"2024-09-12T19:20:27.992422+0000","last_clean":"2024-09-12T19:20:27.992422+0000","last_became_active":"2024-09-12T17:29:54.762400+0000","last_became_peered":"2024-09-12T17:29:54.762400+0000","last_unstale":"2024-09-12T19:20:27.992422+0000","last_undegraded":"2024-09-12T19:20:27.992422+0000","last_fullsized":"2024-09-12T19:20:27.992422+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:34.051350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2164,"num_read_kb":2073,"num_write":429,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'404","reported_seq":1120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.969671+0000","last_change":"2024-09-12T17:29:52.761477+0000","last_active":"2024-09-12T19:23:01.969671+0000","last_peered":"2024-09-12T19:23:01.969671+0000","last_clean":"2024-09-12T19:23:01.969671+0000","last_became_active":"2024-09-12T17:29:52.756626+0000","last_became_peered":"2024-09-12T17:29:52.756626+0000","last_unstale":"2024-09-12T19:23:01.969671+0000","last_undegraded":"2024-09-12T19:23:01.969671+0000","last_fullsized":"2024-09-12T19:23:01.969671+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:06.453259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":688,"num_read_kb":25414,"num_write":1427,"num_write_kb":18603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'782","reported_seq":2452,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.140613+0000","last_change":"2024-09-12T17:29:54.749594+0000","last_active":"2024-09-12T19:21:19.140613+0000","last_peered":"2024-09-12T19:21:19.140613+0000","last_clean":"2024-09-12T19:21:19.140613+0000","last_became_active":"2024-09-12T17:29:54.749249+0000","last_became_peered":"2024-09-12T17:29:54.749249+0000","last_unstale":"2024-09-12T19:21:19.140613+0000","last_undegraded":"2024-09-12T19:21:19.140613+0000","last_fullsized":"2024-09-12T19:21:19.140613+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:55.915159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3916,"num_read_kb":3572,"num_write":1026,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'306","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.958263+0000","last_change":"2024-09-12T17:29:52.767576+0000","last_active":"2024-09-12T19:23:01.958263+0000","last_peered":"2024-09-12T19:23:01.958263+0000","last_clean":"2024-09-12T19:23:01.958263+0000","last_became_active":"2024-09-12T17:29:52.767047+0000","last_became_peered":"2024-09-12T17:29:52.767047+0000","last_unstale":"2024-09-12T19:23:01.958263+0000","last_undegraded":"2024-09-12T19:23:01.958263+0000","last_fullsized":"2024-09-12T19:23:01.958263+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:01.748288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900516,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":422,"num_read_kb":21273,"num_write":1050,"num_write_kb":35522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'491","reported_seq":2152,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:48.268636+0000","last_change":"2024-09-12T17:29:54.763106+0000","last_active":"2024-09-12T19:20:48.268636+0000","last_peered":"2024-09-12T19:20:48.268636+0000","last_clean":"2024-09-12T19:20:48.268636+0000","last_became_active":"2024-09-12T17:29:54.762667+0000","last_became_peered":"2024-09-12T17:29:54.762667+0000","last_unstale":"2024-09-12T19:20:48.268636+0000","last_undegraded":"2024-09-12T19:20:48.268636+0000","last_fullsized":"2024-09-12T19:20:48.268636+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:57.057096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2506,"num_read_kb":2365,"num_write":559,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'282","reported_seq":962,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262415+0000","last_change":"2024-09-12T17:29:52.768451+0000","last_active":"2024-09-12T19:20:23.262415+0000","last_peered":"2024-09-12T19:20:23.262415+0000","last_clean":"2024-09-12T19:20:23.262415+0000","last_became_active":"2024-09-12T17:29:52.765692+0000","last_became_peered":"2024-09-12T17:29:52.765692+0000","last_unstale":"2024-09-12T19:20:23.262415+0000","last_undegraded":"2024-09-12T19:20:23.262415+0000","last_fullsized":"2024-09-12T19:20:23.262415+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:48.428826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13902119,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":465,"num_read_kb":21751,"num_write":939,"num_write_kb":25522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'959","reported_seq":2733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.201114+0000","last_change":"2024-09-12T17:29:54.770999+0000","last_active":"2024-09-12T19:20:23.201114+0000","last_peered":"2024-09-12T19:20:23.201114+0000","last_clean":"2024-09-12T19:20:23.201114+0000","last_became_active":"2024-09-12T17:29:54.769223+0000","last_became_peered":"2024-09-12T17:29:54.769223+0000","last_unstale":"2024-09-12T19:20:23.201114+0000","last_undegraded":"2024-09-12T19:20:23.201114+0000","last_fullsized":"2024-09-12T19:20:23.201114+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":900,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:48.896632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4532,"num_read_kb":4067,"num_write":1265,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'312","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.905057+0000","last_change":"2024-09-12T17:29:52.729350+0000","last_active":"2024-09-12T19:23:01.905057+0000","last_peered":"2024-09-12T19:23:01.905057+0000","last_clean":"2024-09-12T19:23:01.905057+0000","last_became_active":"2024-09-12T17:29:52.728523+0000","last_became_peered":"2024-09-12T17:29:52.728523+0000","last_unstale":"2024-09-12T19:23:01.905057+0000","last_undegraded":"2024-09-12T19:23:01.905057+0000","last_fullsized":"2024-09-12T19:23:01.905057+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:38.562226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":2514,"num_write":1024,"num_write_kb":45573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'964","reported_seq":2656,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.899595+0000","last_change":"2024-09-12T17:29:54.759369+0000","last_active":"2024-09-12T19:21:55.899595+0000","last_peered":"2024-09-12T19:21:55.899595+0000","last_clean":"2024-09-12T19:21:55.899595+0000","last_became_active":"2024-09-12T17:29:54.758687+0000","last_became_peered":"2024-09-12T17:29:54.758687+0000","last_unstale":"2024-09-12T19:21:55.899595+0000","last_undegraded":"2024-09-12T19:21:55.899595+0000","last_fullsized":"2024-09-12T19:21:55.899595+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":900,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:12.470932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4571,"num_read_kb":4077,"num_write":1316,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'281","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.561556+0000","last_change":"2024-09-12T17:29:52.719880+0000","last_active":"2024-09-12T19:20:23.561556+0000","last_peered":"2024-09-12T19:20:23.561556+0000","last_clean":"2024-09-12T19:20:23.561556+0000","last_became_active":"2024-09-12T17:29:52.718689+0000","last_became_peered":"2024-09-12T17:29:52.718689+0000","last_unstale":"2024-09-12T19:20:23.561556+0000","last_undegraded":"2024-09-12T19:20:23.561556+0000","last_fullsized":"2024-09-12T19:20:23.561556+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:01.173987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10242962,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":448,"num_read_kb":13386,"num_write":1024,"num_write_kb":27082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'1290","reported_seq":2901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.561396+0000","last_change":"2024-09-12T17:29:54.765637+0000","last_active":"2024-09-12T19:20:23.561396+0000","last_peered":"2024-09-12T19:20:23.561396+0000","last_clean":"2024-09-12T19:20:23.561396+0000","last_became_active":"2024-09-12T17:29:54.764876+0000","last_became_peered":"2024-09-12T17:29:54.764876+0000","last_unstale":"2024-09-12T19:20:23.561396+0000","last_undegraded":"2024-09-12T19:20:23.561396+0000","last_fullsized":"2024-09-12T19:20:23.561396+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":1200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:13.358482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5917,"num_read_kb":5200,"num_write":1797,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'324","reported_seq":999,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262560+0000","last_change":"2024-09-12T17:29:52.769653+0000","last_active":"2024-09-12T19:20:23.262560+0000","last_peered":"2024-09-12T19:20:23.262560+0000","last_clean":"2024-09-12T19:20:23.262560+0000","last_became_active":"2024-09-12T17:29:52.769086+0000","last_became_peered":"2024-09-12T17:29:52.769086+0000","last_unstale":"2024-09-12T19:20:23.262560+0000","last_undegraded":"2024-09-12T19:20:23.262560+0000","last_fullsized":"2024-09-12T19:20:23.262560+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:03.761062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12345675,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":479,"num_read_kb":7690,"num_write":1160,"num_write_kb":36052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"267'894","reported_seq":2482,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.901241+0000","last_change":"2024-09-12T17:29:54.760165+0000","last_active":"2024-09-12T19:21:55.901241+0000","last_peered":"2024-09-12T19:21:55.901241+0000","last_clean":"2024-09-12T19:21:55.901241+0000","last_became_active":"2024-09-12T17:29:54.759892+0000","last_became_peered":"2024-09-12T17:29:54.759892+0000","last_unstale":"2024-09-12T19:21:55.901241+0000","last_undegraded":"2024-09-12T19:21:55.901241+0000","last_fullsized":"2024-09-12T19:21:55.901241+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":800,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:50.901074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4227,"num_read_kb":3797,"num_write":1212,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'326","reported_seq":966,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.964273+0000","last_change":"2024-09-12T17:29:52.750118+0000","last_active":"2024-09-12T19:23:01.964273+0000","last_peered":"2024-09-12T19:23:01.964273+0000","last_clean":"2024-09-12T19:23:01.964273+0000","last_became_active":"2024-09-12T17:29:52.748790+0000","last_became_peered":"2024-09-12T17:29:52.748790+0000","last_unstale":"2024-09-12T19:23:01.964273+0000","last_undegraded":"2024-09-12T19:23:01.964273+0000","last_fullsized":"2024-09-12T19:23:01.964273+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:59.925499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":434,"num_read_kb":14399,"num_write":1080,"num_write_kb":30402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'1651","reported_seq":3218,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.025784+0000","last_change":"2024-09-12T17:29:54.755458+0000","last_active":"2024-09-12T19:22:45.025784+0000","last_peered":"2024-09-12T19:22:45.025784+0000","last_clean":"2024-09-12T19:22:45.025784+0000","last_became_active":"2024-09-12T17:29:54.754702+0000","last_became_peered":"2024-09-12T17:29:54.754702+0000","last_unstale":"2024-09-12T19:22:45.025784+0000","last_undegraded":"2024-09-12T19:22:45.025784+0000","last_fullsized":"2024-09-12T19:22:45.025784+0000","mapping_epoch":28,"log_start":"267'1600","ondisk_log_start":"267'1600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":1600,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:29.268644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7245,"num_read_kb":6284,"num_write":2371,"num_write_kb":1100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'246","reported_seq":912,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.257391+0000","last_change":"2024-09-12T17:29:52.768556+0000","last_active":"2024-09-12T19:20:08.257391+0000","last_peered":"2024-09-12T19:20:08.257391+0000","last_clean":"2024-09-12T19:20:08.257391+0000","last_became_active":"2024-09-12T17:29:52.767990+0000","last_became_peered":"2024-09-12T17:29:52.767990+0000","last_unstale":"2024-09-12T19:20:08.257391+0000","last_undegraded":"2024-09-12T19:20:08.257391+0000","last_fullsized":"2024-09-12T19:20:08.257391+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:04.577061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23401,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":413,"num_read_kb":642,"num_write":973,"num_write_kb":10844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'933","reported_seq":2506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.017536+0000","last_change":"2024-09-12T17:29:54.759508+0000","last_active":"2024-09-12T19:22:45.017536+0000","last_peered":"2024-09-12T19:22:45.017536+0000","last_clean":"2024-09-12T19:22:45.017536+0000","last_became_active":"2024-09-12T17:29:54.759169+0000","last_became_peered":"2024-09-12T17:29:54.759169+0000","last_unstale":"2024-09-12T19:22:45.017536+0000","last_undegraded":"2024-09-12T19:22:45.017536+0000","last_fullsized":"2024-09-12T19:22:45.017536+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":900,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:45.168551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4504,"num_read_kb":3992,"num_write":1315,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'297","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.954118+0000","last_change":"2024-09-12T17:29:52.757191+0000","last_active":"2024-09-12T19:23:01.954118+0000","last_peered":"2024-09-12T19:23:01.954118+0000","last_clean":"2024-09-12T19:23:01.954118+0000","last_became_active":"2024-09-12T17:29:52.753935+0000","last_became_peered":"2024-09-12T17:29:52.753935+0000","last_unstale":"2024-09-12T19:23:01.954118+0000","last_undegraded":"2024-09-12T19:23:01.954118+0000","last_fullsized":"2024-09-12T19:23:01.954118+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:29.050781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340668,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":430,"num_read_kb":10673,"num_write":974,"num_write_kb":41601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'834","reported_seq":2496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.014092+0000","last_change":"2024-09-12T17:29:54.761668+0000","last_active":"2024-09-12T19:22:45.014092+0000","last_peered":"2024-09-12T19:22:45.014092+0000","last_clean":"2024-09-12T19:22:45.014092+0000","last_became_active":"2024-09-12T17:29:54.760784+0000","last_became_peered":"2024-09-12T17:29:54.760784+0000","last_unstale":"2024-09-12T19:22:45.014092+0000","last_undegraded":"2024-09-12T19:22:45.014092+0000","last_fullsized":"2024-09-12T19:22:45.014092+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:25.364138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4062,"num_read_kb":3682,"num_write":1062,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'490","reported_seq":1212,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.951581+0000","last_change":"2024-09-12T17:29:52.735767+0000","last_active":"2024-09-12T19:23:01.951581+0000","last_peered":"2024-09-12T19:23:01.951581+0000","last_clean":"2024-09-12T19:23:01.951581+0000","last_became_active":"2024-09-12T17:29:52.735333+0000","last_became_peered":"2024-09-12T17:29:52.735333+0000","last_unstale":"2024-09-12T19:23:01.951581+0000","last_undegraded":"2024-09-12T19:23:01.951581+0000","last_fullsized":"2024-09-12T19:23:01.951581+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:56.415475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":869,"num_read_kb":5832,"num_write":1431,"num_write_kb":32355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'864","reported_seq":2443,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.002468+0000","last_change":"2024-09-12T17:29:54.754343+0000","last_active":"2024-09-12T19:22:45.002468+0000","last_peered":"2024-09-12T19:22:45.002468+0000","last_clean":"2024-09-12T19:22:45.002468+0000","last_became_active":"2024-09-12T17:29:54.753635+0000","last_became_peered":"2024-09-12T17:29:54.753635+0000","last_unstale":"2024-09-12T19:22:45.002468+0000","last_undegraded":"2024-09-12T19:22:45.002468+0000","last_fullsized":"2024-09-12T19:22:45.002468+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:06.006688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4079,"num_read_kb":3651,"num_write":1151,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'255","reported_seq":1011,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.558171+0000","last_change":"2024-09-12T17:29:52.745226+0000","last_active":"2024-09-12T19:20:08.558171+0000","last_peered":"2024-09-12T19:20:08.558171+0000","last_clean":"2024-09-12T19:20:08.558171+0000","last_became_active":"2024-09-12T17:29:52.744397+0000","last_became_peered":"2024-09-12T17:29:52.744397+0000","last_unstale":"2024-09-12T19:20:08.558171+0000","last_undegraded":"2024-09-12T19:20:08.558171+0000","last_fullsized":"2024-09-12T19:20:08.558171+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:30.018286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227539,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":707,"num_read_kb":16845,"num_write":984,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'473","reported_seq":2099,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.925933+0000","last_change":"2024-09-12T17:29:54.752376+0000","last_active":"2024-09-12T19:20:27.925933+0000","last_peered":"2024-09-12T19:20:27.925933+0000","last_clean":"2024-09-12T19:20:27.925933+0000","last_became_active":"2024-09-12T17:29:54.751872+0000","last_became_peered":"2024-09-12T17:29:54.751872+0000","last_unstale":"2024-09-12T19:20:27.925933+0000","last_undegraded":"2024-09-12T19:20:27.925933+0000","last_fullsized":"2024-09-12T19:20:27.925933+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:26.641497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2533,"num_read_kb":2381,"num_write":539,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'294","reported_seq":923,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.985448+0000","last_change":"2024-09-12T17:29:52.751477+0000","last_active":"2024-09-12T19:23:01.985448+0000","last_peered":"2024-09-12T19:23:01.985448+0000","last_clean":"2024-09-12T19:23:01.985448+0000","last_became_active":"2024-09-12T17:29:52.747688+0000","last_became_peered":"2024-09-12T17:29:52.747688+0000","last_unstale":"2024-09-12T19:23:01.985448+0000","last_undegraded":"2024-09-12T19:23:01.985448+0000","last_fullsized":"2024-09-12T19:23:01.985448+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:59.598093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262281,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":403,"num_read_kb":6219,"num_write":990,"num_write_kb":21267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'427","reported_seq":1940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.258996+0000","last_change":"2024-09-12T17:29:54.760829+0000","last_active":"2024-09-12T19:20:13.258996+0000","last_peered":"2024-09-12T19:20:13.258996+0000","last_clean":"2024-09-12T19:20:13.258996+0000","last_became_active":"2024-09-12T17:29:54.760373+0000","last_became_peered":"2024-09-12T17:29:54.760373+0000","last_unstale":"2024-09-12T19:20:13.258996+0000","last_undegraded":"2024-09-12T19:20:13.258996+0000","last_fullsized":"2024-09-12T19:20:13.258996+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:05.548951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2333,"num_read_kb":2181,"num_write":522,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'271","reported_seq":966,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.527121+0000","last_change":"2024-09-12T17:29:52.747300+0000","last_active":"2024-09-12T19:19:33.527121+0000","last_peered":"2024-09-12T19:19:33.527121+0000","last_clean":"2024-09-12T19:19:33.527121+0000","last_became_active":"2024-09-12T17:29:52.746880+0000","last_became_peered":"2024-09-12T17:29:52.746880+0000","last_unstale":"2024-09-12T19:19:33.527121+0000","last_undegraded":"2024-09-12T19:19:33.527121+0000","last_fullsized":"2024-09-12T19:19:33.527121+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:38.876679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17178221,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":464,"num_read_kb":70820,"num_write":1029,"num_write_kb":52448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'787","reported_seq":2445,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:47.979536+0000","last_change":"2024-09-12T17:29:54.766132+0000","last_active":"2024-09-12T19:20:47.979536+0000","last_peered":"2024-09-12T19:20:47.979536+0000","last_clean":"2024-09-12T19:20:47.979536+0000","last_became_active":"2024-09-12T17:29:54.765197+0000","last_became_peered":"2024-09-12T17:29:54.765197+0000","last_unstale":"2024-09-12T19:20:47.979536+0000","last_undegraded":"2024-09-12T19:20:47.979536+0000","last_fullsized":"2024-09-12T19:20:47.979536+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:06.211284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3968,"num_read_kb":3617,"num_write":1032,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'309","reported_seq":963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.968746+0000","last_change":"2024-09-12T17:29:52.753447+0000","last_active":"2024-09-12T19:23:01.968746+0000","last_peered":"2024-09-12T19:23:01.968746+0000","last_clean":"2024-09-12T19:23:01.968746+0000","last_became_active":"2024-09-12T17:29:52.749742+0000","last_became_peered":"2024-09-12T17:29:52.749742+0000","last_unstale":"2024-09-12T19:23:01.968746+0000","last_undegraded":"2024-09-12T19:23:01.968746+0000","last_fullsized":"2024-09-12T19:23:01.968746+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:57.718662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":13262,"num_write":1037,"num_write_kb":35239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'334","reported_seq":980,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.906142+0000","last_change":"2024-09-12T17:29:52.722769+0000","last_active":"2024-09-12T19:23:01.906142+0000","last_peered":"2024-09-12T19:23:01.906142+0000","last_clean":"2024-09-12T19:23:01.906142+0000","last_became_active":"2024-09-12T17:29:52.720918+0000","last_became_peered":"2024-09-12T17:29:52.720918+0000","last_unstale":"2024-09-12T19:23:01.906142+0000","last_undegraded":"2024-09-12T19:23:01.906142+0000","last_fullsized":"2024-09-12T19:23:01.906142+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:33.296017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170702,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":3934,"num_write":1046,"num_write_kb":9633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'599","reported_seq":2184,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:28.207331+0000","last_change":"2024-09-12T17:29:54.758143+0000","last_active":"2024-09-12T19:21:28.207331+0000","last_peered":"2024-09-12T19:21:28.207331+0000","last_clean":"2024-09-12T19:21:28.207331+0000","last_became_active":"2024-09-12T17:29:54.752553+0000","last_became_peered":"2024-09-12T17:29:54.752553+0000","last_unstale":"2024-09-12T19:21:28.207331+0000","last_undegraded":"2024-09-12T19:21:28.207331+0000","last_fullsized":"2024-09-12T19:21:28.207331+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:19.216701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3060,"num_read_kb":2784,"num_write":774,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'400","reported_seq":1086,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.952320+0000","last_change":"2024-09-12T17:30:22.255466+0000","last_active":"2024-09-12T19:23:01.952320+0000","last_peered":"2024-09-12T19:23:01.952320+0000","last_clean":"2024-09-12T19:23:01.952320+0000","last_became_active":"2024-09-12T17:30:22.254863+0000","last_became_peered":"2024-09-12T17:30:22.254863+0000","last_unstale":"2024-09-12T19:23:01.952320+0000","last_undegraded":"2024-09-12T19:23:01.952320+0000","last_fullsized":"2024-09-12T19:23:01.952320+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:14.162185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992370,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":655,"num_read_kb":2597,"num_write":1307,"num_write_kb":14489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5,0],"acting":[1,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'444","reported_seq":1944,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:08.001889+0000","last_change":"2024-09-12T17:29:54.764546+0000","last_active":"2024-09-12T19:21:08.001889+0000","last_peered":"2024-09-12T19:21:08.001889+0000","last_clean":"2024-09-12T19:21:08.001889+0000","last_became_active":"2024-09-12T17:29:54.763613+0000","last_became_peered":"2024-09-12T17:29:54.763613+0000","last_unstale":"2024-09-12T19:21:08.001889+0000","last_undegraded":"2024-09-12T19:21:08.001889+0000","last_fullsized":"2024-09-12T19:21:08.001889+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:27.590175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2478,"num_read_kb":2322,"num_write":560,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5989,"num_read_kb":4199,"num_write":1940,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1011,"ondisk_log_size":1011,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16341,"num_read_kb":15997,"num_write":16735,"num_write_kb":4892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1670,"ondisk_log_size":1670,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":549,"ondisk_log_size":549,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1577752,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":20884,"num_read_kb":39593,"num_write":17449,"num_write_kb":12355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1228800,"data_stored":870213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1952,"ondisk_log_size":1952,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212845,"num_read_kb":194484,"num_write":55296,"num_write_kb":18842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3814,"ondisk_log_size":3814,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":229695992,"num_objects":1838,"num_object_clones":0,"num_object_copies":7352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1838,"num_whiteouts":0,"num_read":34697,"num_read_kb":1906077,"num_write":70014,"num_write_kb":2114280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":352837632,"data_stored":352837632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4045,"ondisk_log_size":4045,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":24213981,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":122,"num_read_kb":168420,"num_write":145,"num_write_kb":116143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77750272,"data_stored":77742985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16785383,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":174519,"num_write":148,"num_write_kb":116143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":50438144,"data_stored":50431588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543512,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":323556,"kb_used_data":21480,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94048284,"statfs":{"total":96636764160,"available":96305442816,"internally_reserved":0,"allocated":21995520,"data_stored":19982866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":309131722},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,3,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543517,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444108,"kb_used_data":151932,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":93927732,"statfs":{"total":96636764160,"available":96181997568,"internally_reserved":0,"allocated":155578368,"data_stored":153570661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":299170246},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543511,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177360,"kb_used_data":11368,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94194480,"statfs":{"total":96636764160,"available":96455147520,"internally_reserved":0,"allocated":11640832,"data_stored":9617929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543513,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161488,"kb_used_data":17856,"kb_used_omap":1,"kb_used_meta":143614,"kb_avail":94210352,"statfs":{"total":96636764160,"available":96471400448,"internally_reserved":0,"allocated":18284544,"data_stored":16335473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":147061189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543511,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":426588,"kb_used_data":146892,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":93945252,"statfs":{"total":96636764160,"available":96199938048,"internally_reserved":0,"allocated":150417408,"data_stored":148351516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":286390727},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543513,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":229400,"kb_used_data":130184,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94142440,"statfs":{"total":96636764160,"available":96401858560,"internally_reserved":0,"allocated":133308416,"data_stored":131326773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543510,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":196164,"kb_used_data":16420,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94175676,"statfs":{"total":96636764160,"available":96435892224,"internally_reserved":0,"allocated":16814080,"data_stored":14841351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543512,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299976,"kb_used_data":15912,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":94071864,"statfs":{"total":96636764160,"available":96329588736,"internally_reserved":0,"allocated":16293888,"data_stored":14257873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":290585029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11374592,"data_stored":11374592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12550144,"data_stored":12550144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":82669568,"data_stored":82669568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":100405248,"data_stored":100405248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14045184,"data_stored":14045184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7327744,"data_stored":7327744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":114262016,"data_stored":114262016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10203136,"data_stored":10203136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":137128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":466906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":261129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":5848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":29405184,"data_stored":29403480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6295552,"data_stored":6294663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14737408,"data_stored":14733445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16826368,"data_stored":16825637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38899712,"data_stored":38894045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":22024192,"data_stored":22023303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:23:04.178 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T19:23:04.518 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:23:04.518 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":267,"fsid":"3a2fc85d-b57e-4cf4-9108-8b5b644d1f9b","created":"2024-09-12T17:29:15.601521+0000","modified":"2024-09-12T18:19:23.616461+0000","last_up_change":"2024-09-12T17:29:27.235782+0000","last_in_change":"2024-09-12T17:29:17.827643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:29:28.604898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:29:33.831944+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T17:29:50.666254+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T17:29:53.052117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T17:29:54.851782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T17:29:57.071271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T17:29:58.776740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T17:30:00.926018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T17:45:40.450557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"256","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T17:51:51.831484+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"259","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T17:51:58.500571+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"262","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T18:19:20.917520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"267","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59393804-5b55-40e7-a02c-d59adbad3262","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4243656823},{"type":"v1","addr":"172.21.15.98:6825","nonce":4243656823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4243656823},{"type":"v1","addr":"172.21.15.98:6827","nonce":4243656823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4243656823},{"type":"v1","addr":"172.21.15.98:6831","nonce":4243656823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4243656823},{"type":"v1","addr":"172.21.15.98:6829","nonce":4243656823}]},"public_addr":"172.21.15.98:6825/4243656823","cluster_addr":"172.21.15.98:6827/4243656823","heartbeat_back_addr":"172.21.15.98:6831/4243656823","heartbeat_front_addr":"172.21.15.98:6829/4243656823","state":["exists","up"]},{"osd":1,"uuid":"bc65fc46-f716-4759-9674-f4d52e841fe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2797286459},{"type":"v1","addr":"172.21.15.98:6809","nonce":2797286459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2797286459},{"type":"v1","addr":"172.21.15.98:6811","nonce":2797286459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2797286459},{"type":"v1","addr":"172.21.15.98:6815","nonce":2797286459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2797286459},{"type":"v1","addr":"172.21.15.98:6813","nonce":2797286459}]},"public_addr":"172.21.15.98:6809/2797286459","cluster_addr":"172.21.15.98:6811/2797286459","heartbeat_back_addr":"172.21.15.98:6815/2797286459","heartbeat_front_addr":"172.21.15.98:6813/2797286459","state":["exists","up"]},{"osd":2,"uuid":"892166b4-6977-44db-89ef-a3ce55a26482","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":1225764258},{"type":"v1","addr":"172.21.15.98:6817","nonce":1225764258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1225764258},{"type":"v1","addr":"172.21.15.98:6819","nonce":1225764258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1225764258},{"type":"v1","addr":"172.21.15.98:6823","nonce":1225764258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1225764258},{"type":"v1","addr":"172.21.15.98:6821","nonce":1225764258}]},"public_addr":"172.21.15.98:6817/1225764258","cluster_addr":"172.21.15.98:6819/1225764258","heartbeat_back_addr":"172.21.15.98:6823/1225764258","heartbeat_front_addr":"172.21.15.98:6821/1225764258","state":["exists","up"]},{"osd":3,"uuid":"dea4c29d-1e7d-4fae-8d26-cbf492e6c4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3702628629},{"type":"v1","addr":"172.21.15.98:6801","nonce":3702628629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3702628629},{"type":"v1","addr":"172.21.15.98:6803","nonce":3702628629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3702628629},{"type":"v1","addr":"172.21.15.98:6807","nonce":3702628629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3702628629},{"type":"v1","addr":"172.21.15.98:6805","nonce":3702628629}]},"public_addr":"172.21.15.98:6801/3702628629","cluster_addr":"172.21.15.98:6803/3702628629","heartbeat_back_addr":"172.21.15.98:6807/3702628629","heartbeat_front_addr":"172.21.15.98:6805/3702628629","state":["exists","up"]},{"osd":4,"uuid":"ca8f7737-483e-4494-8b72-95033eff0979","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2100658905},{"type":"v1","addr":"172.21.15.187:6801","nonce":2100658905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2100658905},{"type":"v1","addr":"172.21.15.187:6803","nonce":2100658905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2100658905},{"type":"v1","addr":"172.21.15.187:6807","nonce":2100658905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2100658905},{"type":"v1","addr":"172.21.15.187:6805","nonce":2100658905}]},"public_addr":"172.21.15.187:6801/2100658905","cluster_addr":"172.21.15.187:6803/2100658905","heartbeat_back_addr":"172.21.15.187:6807/2100658905","heartbeat_front_addr":"172.21.15.187:6805/2100658905","state":["exists","up"]},{"osd":5,"uuid":"637e9483-a6fe-419d-9e91-b06499296fa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":2426426364},{"type":"v1","addr":"172.21.15.187:6825","nonce":2426426364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":2426426364},{"type":"v1","addr":"172.21.15.187:6827","nonce":2426426364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":2426426364},{"type":"v1","addr":"172.21.15.187:6831","nonce":2426426364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":2426426364},{"type":"v1","addr":"172.21.15.187:6829","nonce":2426426364}]},"public_addr":"172.21.15.187:6825/2426426364","cluster_addr":"172.21.15.187:6827/2426426364","heartbeat_back_addr":"172.21.15.187:6831/2426426364","heartbeat_front_addr":"172.21.15.187:6829/2426426364","state":["exists","up"]},{"osd":6,"uuid":"e0469cf4-de40-41af-9c71-b636e2d12fa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":1254463716},{"type":"v1","addr":"172.21.15.187:6817","nonce":1254463716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":1254463716},{"type":"v1","addr":"172.21.15.187:6819","nonce":1254463716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":1254463716},{"type":"v1","addr":"172.21.15.187:6823","nonce":1254463716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":1254463716},{"type":"v1","addr":"172.21.15.187:6821","nonce":1254463716}]},"public_addr":"172.21.15.187:6817/1254463716","cluster_addr":"172.21.15.187:6819/1254463716","heartbeat_back_addr":"172.21.15.187:6823/1254463716","heartbeat_front_addr":"172.21.15.187:6821/1254463716","state":["exists","up"]},{"osd":7,"uuid":"b00f9fd0-896f-4ccd-8a8e-e948942ab9d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":1025052779},{"type":"v1","addr":"172.21.15.187:6809","nonce":1025052779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":1025052779},{"type":"v1","addr":"172.21.15.187:6811","nonce":1025052779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":1025052779},{"type":"v1","addr":"172.21.15.187:6815","nonce":1025052779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":1025052779},{"type":"v1","addr":"172.21.15.187:6813","nonce":1025052779}]},"public_addr":"172.21.15.187:6809/1025052779","cluster_addr":"172.21.15.187:6811/1025052779","heartbeat_back_addr":"172.21.15.187:6815/1025052779","heartbeat_front_addr":"172.21.15.187:6813/1025052779","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.757876+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.182429+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:25.146448+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.343732+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.019438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:26.843873+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.594080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:29:24.397391+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.6","mappings":[{"from":0,"to":2}]},{"pgid":"3.8","mappings":[{"from":7,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":3},{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.31","mappings":[{"from":4,"to":2}]},{"pgid":"3.36","mappings":[{"from":6,"to":3}]},{"pgid":"3.3c","mappings":[{"from":5,"to":1}]},{"pgid":"4.10","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":3,"to":2}]},{"pgid":"67.17","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T19:23:05.538 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T19:23:05.538 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:23:05.701 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T19:23:05.701 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:23:05.701 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T19:23:05.717 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T19:23:06.021 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T19:23:06.040 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T19:23:06.041 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:23:06.187 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T19:23:06.187 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:23:06.187 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T19:23:06.203 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T19:23:06.485 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T19:23:06.504 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T19:23:06.504 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:23:06.655 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T19:23:06.655 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:23:06.655 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T19:23:06.671 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T19:23:06.967 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T19:23:06.985 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T19:23:06.985 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:23:07.126 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T19:23:07.127 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:23:07.127 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T19:23:07.141 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T19:23:07.417 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T19:23:07.435 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T19:23:07.435 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:23:07.581 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T19:23:07.581 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:23:07.581 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T19:23:07.596 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T19:23:07.875 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T19:23:07.894 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T19:23:07.894 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:23:08.036 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T19:23:08.036 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:23:08.036 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T19:23:08.051 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T19:23:08.343 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T19:23:08.362 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T19:23:08.362 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:23:08.512 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T19:23:08.512 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:23:08.512 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T19:23:08.527 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T19:23:08.802 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T19:23:08.821 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T19:23:08.821 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:23:08.967 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-12T19:23:08.968 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:23:08.968 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-12T19:23:08.983 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T19:23:09.272 INFO:teuthology.orchestra.run.smithi098.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T19:23:09.292 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:23:09.629 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:23:09.641 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-12T19:23:09.645 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":3669,"stamp":"2024-09-12T19:23:09.258109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68190910,"num_objects":834,"num_object_clones":0,"num_object_copies":2400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":834,"num_whiteouts":0,"num_read":295061,"num_read_kb":2506908,"num_write":163405,"num_write_kb":2385161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12959,"ondisk_log_size":12959,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1881804,"kb_used_data":122928,"kb_used_omap":12,"kb_used_meta":1758195,"kb_avail":753092916,"statfs":{"total":773094113280,"available":771167145984,"internally_reserved":0,"allocated":125878272,"data_stored":109935330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1800392240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-628955684,"num_objects":-4056,"num_object_clones":0,"num_object_copies":-16152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4056,"num_whiteouts":0,"num_read":4544,"num_read_kb":4078,"num_write":4307,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006964"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.976722+0000","last_change":"2024-09-12T18:19:22.664402+0000","last_active":"2024-09-12T19:19:22.976722+0000","last_peered":"2024-09-12T19:19:22.976722+0000","last_clean":"2024-09-12T19:19:22.976722+0000","last_became_active":"2024-09-12T18:19:22.658759+0000","last_became_peered":"2024-09-12T18:19:22.658759+0000","last_unstale":"2024-09-12T19:19:22.976722+0000","last_undegraded":"2024-09-12T19:19:22.976722+0000","last_fullsized":"2024-09-12T19:19:22.976722+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:29.891894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:32.979320+0000","last_change":"2024-09-12T17:51:59.970111+0000","last_active":"2024-09-12T19:19:32.979320+0000","last_peered":"2024-09-12T19:19:32.979320+0000","last_clean":"2024-09-12T19:19:32.979320+0000","last_became_active":"2024-09-12T17:51:59.969612+0000","last_became_peered":"2024-09-12T17:51:59.969612+0000","last_unstale":"2024-09-12T19:19:32.979320+0000","last_undegraded":"2024-09-12T19:19:32.979320+0000","last_fullsized":"2024-09-12T19:19:32.979320+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:23.773617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'6","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.283938+0000","last_change":"2024-09-12T17:51:52.890790+0000","last_active":"2024-09-12T19:21:53.283938+0000","last_peered":"2024-09-12T19:21:53.283938+0000","last_clean":"2024-09-12T19:21:53.283938+0000","last_became_active":"2024-09-12T17:51:52.890029+0000","last_became_peered":"2024-09-12T17:51:52.890029+0000","last_unstale":"2024-09-12T19:21:53.283938+0000","last_undegraded":"2024-09-12T19:21:53.283938+0000","last_fullsized":"2024-09-12T19:21:53.283938+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:58.035727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'75","reported_seq":374,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:28.176973+0000","last_change":"2024-09-12T17:45:41.586304+0000","last_active":"2024-09-12T19:19:28.176973+0000","last_peered":"2024-09-12T19:19:28.176973+0000","last_clean":"2024-09-12T19:19:28.176973+0000","last_became_active":"2024-09-12T17:45:41.585012+0000","last_became_peered":"2024-09-12T17:45:41.585012+0000","last_unstale":"2024-09-12T19:19:28.176973+0000","last_undegraded":"2024-09-12T19:19:28.176973+0000","last_fullsized":"2024-09-12T19:19:28.176973+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:25.815410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":580,"num_read_kb":395,"num_write":86,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:23.524914+0000","last_change":"2024-09-12T18:19:22.641896+0000","last_active":"2024-09-12T19:19:23.524914+0000","last_peered":"2024-09-12T19:19:23.524914+0000","last_clean":"2024-09-12T19:19:23.524914+0000","last_became_active":"2024-09-12T18:19:22.641172+0000","last_became_peered":"2024-09-12T18:19:22.641172+0000","last_unstale":"2024-09-12T19:19:23.524914+0000","last_undegraded":"2024-09-12T19:19:23.524914+0000","last_fullsized":"2024-09-12T19:19:23.524914+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:53.586176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.189386+0000","last_change":"2024-09-12T17:51:59.957708+0000","last_active":"2024-09-12T19:19:33.189386+0000","last_peered":"2024-09-12T19:19:33.189386+0000","last_clean":"2024-09-12T19:19:33.189386+0000","last_became_active":"2024-09-12T17:51:59.957109+0000","last_became_peered":"2024-09-12T17:51:59.957109+0000","last_unstale":"2024-09-12T19:19:33.189386+0000","last_undegraded":"2024-09-12T19:19:33.189386+0000","last_fullsized":"2024-09-12T19:19:33.189386+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:06.641011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.970297+0000","last_change":"2024-09-12T17:51:52.905930+0000","last_active":"2024-09-12T19:19:22.970297+0000","last_peered":"2024-09-12T19:19:22.970297+0000","last_clean":"2024-09-12T19:19:22.970297+0000","last_became_active":"2024-09-12T17:51:52.905220+0000","last_became_peered":"2024-09-12T17:51:52.905220+0000","last_unstale":"2024-09-12T19:19:22.970297+0000","last_undegraded":"2024-09-12T19:19:22.970297+0000","last_fullsized":"2024-09-12T19:19:22.970297+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:22.520893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'122","reported_seq":487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:53.531273+0000","last_change":"2024-09-12T17:45:41.573549+0000","last_active":"2024-09-12T19:19:53.531273+0000","last_peered":"2024-09-12T19:19:53.531273+0000","last_clean":"2024-09-12T19:19:53.531273+0000","last_became_active":"2024-09-12T17:45:41.572859+0000","last_became_peered":"2024-09-12T17:45:41.572859+0000","last_unstale":"2024-09-12T19:19:53.531273+0000","last_undegraded":"2024-09-12T19:19:53.531273+0000","last_fullsized":"2024-09-12T19:19:53.531273+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:00.082452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":788,"num_read_kb":542,"num_write":175,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.553951+0000","last_change":"2024-09-12T18:19:22.653551+0000","last_active":"2024-09-12T19:19:48.553951+0000","last_peered":"2024-09-12T19:19:48.553951+0000","last_clean":"2024-09-12T19:19:48.553951+0000","last_became_active":"2024-09-12T18:19:22.652800+0000","last_became_peered":"2024-09-12T18:19:22.652800+0000","last_unstale":"2024-09-12T19:19:48.553951+0000","last_undegraded":"2024-09-12T19:19:48.553951+0000","last_fullsized":"2024-09-12T19:19:48.553951+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:00.720225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.178212+0000","last_change":"2024-09-12T17:51:59.955159+0000","last_active":"2024-09-12T19:19:33.178212+0000","last_peered":"2024-09-12T19:19:33.178212+0000","last_clean":"2024-09-12T19:19:33.178212+0000","last_became_active":"2024-09-12T17:51:59.954517+0000","last_became_peered":"2024-09-12T17:51:59.954517+0000","last_unstale":"2024-09-12T19:19:33.178212+0000","last_undegraded":"2024-09-12T19:19:33.178212+0000","last_fullsized":"2024-09-12T19:19:33.178212+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:02.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"267'2","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:03.559058+0000","last_change":"2024-09-12T17:51:52.886345+0000","last_active":"2024-09-12T19:22:03.559058+0000","last_peered":"2024-09-12T19:22:03.559058+0000","last_clean":"2024-09-12T19:22:03.559058+0000","last_became_active":"2024-09-12T17:51:52.885677+0000","last_became_peered":"2024-09-12T17:51:52.885677+0000","last_unstale":"2024-09-12T19:22:03.559058+0000","last_undegraded":"2024-09-12T19:22:03.559058+0000","last_fullsized":"2024-09-12T19:22:03.559058+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:04.278645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'26","reported_seq":140,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:13.156514+0000","last_change":"2024-09-12T17:45:41.576549+0000","last_active":"2024-09-12T19:18:13.156514+0000","last_peered":"2024-09-12T19:18:13.156514+0000","last_clean":"2024-09-12T19:18:13.156514+0000","last_became_active":"2024-09-12T17:45:41.575793+0000","last_became_peered":"2024-09-12T17:45:41.575793+0000","last_unstale":"2024-09-12T19:18:13.156514+0000","last_undegraded":"2024-09-12T19:18:13.156514+0000","last_fullsized":"2024-09-12T19:18:13.156514+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:35.718641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":83,"num_write":51,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.254703+0000","last_change":"2024-09-12T18:19:22.656103+0000","last_active":"2024-09-12T19:19:58.254703+0000","last_peered":"2024-09-12T19:19:58.254703+0000","last_clean":"2024-09-12T19:19:58.254703+0000","last_became_active":"2024-09-12T18:19:22.655357+0000","last_became_peered":"2024-09-12T18:19:22.655357+0000","last_unstale":"2024-09-12T19:19:58.254703+0000","last_undegraded":"2024-09-12T19:19:58.254703+0000","last_fullsized":"2024-09-12T19:19:58.254703+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:44.884891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"267'2","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:23.288565+0000","last_change":"2024-09-12T17:51:59.941561+0000","last_active":"2024-09-12T19:22:23.288565+0000","last_peered":"2024-09-12T19:22:23.288565+0000","last_clean":"2024-09-12T19:22:23.288565+0000","last_became_active":"2024-09-12T17:51:59.935185+0000","last_became_peered":"2024-09-12T17:51:59.935185+0000","last_unstale":"2024-09-12T19:22:23.288565+0000","last_undegraded":"2024-09-12T19:22:23.288565+0000","last_fullsized":"2024-09-12T19:22:23.288565+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:03.775657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"267'10","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.345477+0000","last_change":"2024-09-12T17:51:52.865694+0000","last_active":"2024-09-12T19:23:01.345477+0000","last_peered":"2024-09-12T19:23:01.345477+0000","last_clean":"2024-09-12T19:23:01.345477+0000","last_became_active":"2024-09-12T17:51:52.864951+0000","last_became_peered":"2024-09-12T17:51:52.864951+0000","last_unstale":"2024-09-12T19:23:01.345477+0000","last_undegraded":"2024-09-12T19:23:01.345477+0000","last_fullsized":"2024-09-12T19:23:01.345477+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:53.129719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32810,"num_write":10,"num_write_kb":11304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'28","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:13.228547+0000","last_change":"2024-09-12T17:45:41.577459+0000","last_active":"2024-09-12T19:18:13.228547+0000","last_peered":"2024-09-12T19:18:13.228547+0000","last_clean":"2024-09-12T19:18:13.228547+0000","last_became_active":"2024-09-12T17:45:41.576714+0000","last_became_peered":"2024-09-12T17:45:41.576714+0000","last_unstale":"2024-09-12T19:18:13.228547+0000","last_undegraded":"2024-09-12T19:18:13.228547+0000","last_fullsized":"2024-09-12T19:18:13.228547+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:46.641068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":94,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.249030+0000","last_change":"2024-09-12T18:19:22.665947+0000","last_active":"2024-09-12T19:19:33.249030+0000","last_peered":"2024-09-12T19:19:33.249030+0000","last_clean":"2024-09-12T19:19:33.249030+0000","last_became_active":"2024-09-12T18:19:22.665152+0000","last_became_peered":"2024-09-12T18:19:22.665152+0000","last_unstale":"2024-09-12T19:19:33.249030+0000","last_undegraded":"2024-09-12T19:19:33.249030+0000","last_fullsized":"2024-09-12T19:19:33.249030+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:24.528404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"267'3","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.011866+0000","last_change":"2024-09-12T17:51:59.951234+0000","last_active":"2024-09-12T19:21:53.011866+0000","last_peered":"2024-09-12T19:21:53.011866+0000","last_clean":"2024-09-12T19:21:53.011866+0000","last_became_active":"2024-09-12T17:51:59.950595+0000","last_became_peered":"2024-09-12T17:51:59.950595+0000","last_unstale":"2024-09-12T19:21:53.011866+0000","last_undegraded":"2024-09-12T19:21:53.011866+0000","last_fullsized":"2024-09-12T19:21:53.011866+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:58.571310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.166933+0000","last_change":"2024-09-12T17:51:52.908434+0000","last_active":"2024-09-12T19:18:53.166933+0000","last_peered":"2024-09-12T19:18:53.166933+0000","last_clean":"2024-09-12T19:18:53.166933+0000","last_became_active":"2024-09-12T17:51:52.907863+0000","last_became_peered":"2024-09-12T17:51:52.907863+0000","last_unstale":"2024-09-12T19:18:53.166933+0000","last_undegraded":"2024-09-12T19:18:53.166933+0000","last_fullsized":"2024-09-12T19:18:53.166933+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:14.608689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'42","reported_seq":186,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:13.228451+0000","last_change":"2024-09-12T17:45:41.596640+0000","last_active":"2024-09-12T19:18:13.228451+0000","last_peered":"2024-09-12T19:18:13.228451+0000","last_clean":"2024-09-12T19:18:13.228451+0000","last_became_active":"2024-09-12T17:45:41.596133+0000","last_became_peered":"2024-09-12T17:45:41.596133+0000","last_unstale":"2024-09-12T19:18:13.228451+0000","last_undegraded":"2024-09-12T19:18:13.228451+0000","last_fullsized":"2024-09-12T19:18:13.228451+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:41.921834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":80,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.975905+0000","last_change":"2024-09-12T18:19:22.652917+0000","last_active":"2024-09-12T19:19:47.975905+0000","last_peered":"2024-09-12T19:19:47.975905+0000","last_clean":"2024-09-12T19:19:47.975905+0000","last_became_active":"2024-09-12T18:19:22.652141+0000","last_became_peered":"2024-09-12T18:19:22.652141+0000","last_unstale":"2024-09-12T19:19:47.975905+0000","last_undegraded":"2024-09-12T19:19:47.975905+0000","last_fullsized":"2024-09-12T19:19:47.975905+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:16.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"267'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:28.575571+0000","last_change":"2024-09-12T17:51:59.937787+0000","last_active":"2024-09-12T19:21:28.575571+0000","last_peered":"2024-09-12T19:21:28.575571+0000","last_clean":"2024-09-12T19:21:28.575571+0000","last_became_active":"2024-09-12T17:51:59.936941+0000","last_became_peered":"2024-09-12T17:51:59.936941+0000","last_unstale":"2024-09-12T19:21:28.575571+0000","last_undegraded":"2024-09-12T19:21:28.575571+0000","last_fullsized":"2024-09-12T19:21:28.575571+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:37.516754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'2","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:38.218337+0000","last_change":"2024-09-12T17:51:52.882882+0000","last_active":"2024-09-12T19:21:38.218337+0000","last_peered":"2024-09-12T19:21:38.218337+0000","last_clean":"2024-09-12T19:21:38.218337+0000","last_became_active":"2024-09-12T17:51:52.882157+0000","last_became_peered":"2024-09-12T17:51:52.882157+0000","last_unstale":"2024-09-12T19:21:38.218337+0000","last_undegraded":"2024-09-12T19:21:38.218337+0000","last_fullsized":"2024-09-12T19:21:38.218337+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:28.059422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'16","reported_seq":113,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:13.533500+0000","last_change":"2024-09-12T17:45:41.587495+0000","last_active":"2024-09-12T19:18:13.533500+0000","last_peered":"2024-09-12T19:18:13.533500+0000","last_clean":"2024-09-12T19:18:13.533500+0000","last_became_active":"2024-09-12T17:45:41.586661+0000","last_became_peered":"2024-09-12T17:45:41.586661+0000","last_unstale":"2024-09-12T19:18:13.533500+0000","last_undegraded":"2024-09-12T19:18:13.533500+0000","last_fullsized":"2024-09-12T19:18:13.533500+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:51.564389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959085+0000","last_change":"2024-09-12T18:19:22.671131+0000","last_active":"2024-09-12T19:19:22.959085+0000","last_peered":"2024-09-12T19:19:22.959085+0000","last_clean":"2024-09-12T19:19:22.959085+0000","last_became_active":"2024-09-12T18:19:22.668945+0000","last_became_peered":"2024-09-12T18:19:22.668945+0000","last_unstale":"2024-09-12T19:19:22.959085+0000","last_undegraded":"2024-09-12T19:19:22.959085+0000","last_fullsized":"2024-09-12T19:19:22.959085+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:51.667065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.550741+0000","last_change":"2024-09-12T17:51:59.937170+0000","last_active":"2024-09-12T19:19:33.550741+0000","last_peered":"2024-09-12T19:19:33.550741+0000","last_clean":"2024-09-12T19:19:33.550741+0000","last_became_active":"2024-09-12T17:51:59.936441+0000","last_became_peered":"2024-09-12T17:51:59.936441+0000","last_unstale":"2024-09-12T19:19:33.550741+0000","last_undegraded":"2024-09-12T19:19:33.550741+0000","last_fullsized":"2024-09-12T19:19:33.550741+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:54.536101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:23.187174+0000","last_change":"2024-09-12T17:51:52.888730+0000","last_active":"2024-09-12T19:19:23.187174+0000","last_peered":"2024-09-12T19:19:23.187174+0000","last_clean":"2024-09-12T19:19:23.187174+0000","last_became_active":"2024-09-12T17:51:52.887962+0000","last_became_peered":"2024-09-12T17:51:52.887962+0000","last_unstale":"2024-09-12T19:19:23.187174+0000","last_undegraded":"2024-09-12T19:19:23.187174+0000","last_fullsized":"2024-09-12T19:19:23.187174+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:25.669346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'25","reported_seq":141,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.188763+0000","last_change":"2024-09-12T17:45:41.566696+0000","last_active":"2024-09-12T19:20:13.188763+0000","last_peered":"2024-09-12T19:20:13.188763+0000","last_clean":"2024-09-12T19:20:13.188763+0000","last_became_active":"2024-09-12T17:45:41.565956+0000","last_became_peered":"2024-09-12T17:45:41.565956+0000","last_unstale":"2024-09-12T19:20:13.188763+0000","last_undegraded":"2024-09-12T19:20:13.188763+0000","last_fullsized":"2024-09-12T19:20:13.188763+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:11.837864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959148+0000","last_change":"2024-09-12T18:19:22.677901+0000","last_active":"2024-09-12T19:19:22.959148+0000","last_peered":"2024-09-12T19:19:22.959148+0000","last_clean":"2024-09-12T19:19:22.959148+0000","last_became_active":"2024-09-12T18:19:22.677111+0000","last_became_peered":"2024-09-12T18:19:22.677111+0000","last_unstale":"2024-09-12T19:19:22.959148+0000","last_undegraded":"2024-09-12T19:19:22.959148+0000","last_fullsized":"2024-09-12T19:19:22.959148+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:39.916282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:03.285359+0000","last_change":"2024-09-12T17:51:59.942614+0000","last_active":"2024-09-12T19:22:03.285359+0000","last_peered":"2024-09-12T19:22:03.285359+0000","last_clean":"2024-09-12T19:22:03.285359+0000","last_became_active":"2024-09-12T17:51:59.941825+0000","last_became_peered":"2024-09-12T17:51:59.941825+0000","last_unstale":"2024-09-12T19:22:03.285359+0000","last_undegraded":"2024-09-12T19:22:03.285359+0000","last_fullsized":"2024-09-12T19:22:03.285359+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:10.399861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":10,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.212609+0000","last_change":"2024-09-12T17:51:52.899944+0000","last_active":"2024-09-12T19:21:53.212609+0000","last_peered":"2024-09-12T19:21:53.212609+0000","last_clean":"2024-09-12T19:21:53.212609+0000","last_became_active":"2024-09-12T17:51:52.899511+0000","last_became_peered":"2024-09-12T17:51:52.899511+0000","last_unstale":"2024-09-12T19:21:53.212609+0000","last_undegraded":"2024-09-12T19:21:53.212609+0000","last_fullsized":"2024-09-12T19:21:53.212609+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:39.682445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'27","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.978150+0000","last_change":"2024-09-12T17:45:41.587067+0000","last_active":"2024-09-12T19:19:57.978150+0000","last_peered":"2024-09-12T19:19:57.978150+0000","last_clean":"2024-09-12T19:19:57.978150+0000","last_became_active":"2024-09-12T17:45:41.578021+0000","last_became_peered":"2024-09-12T17:45:41.578021+0000","last_unstale":"2024-09-12T19:19:57.978150+0000","last_undegraded":"2024-09-12T19:19:57.978150+0000","last_fullsized":"2024-09-12T19:19:57.978150+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:35.349527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":97,"num_write":50,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.979562+0000","last_change":"2024-09-12T18:19:22.669975+0000","last_active":"2024-09-12T19:20:02.979562+0000","last_peered":"2024-09-12T19:20:02.979562+0000","last_clean":"2024-09-12T19:20:02.979562+0000","last_became_active":"2024-09-12T18:19:22.668802+0000","last_became_peered":"2024-09-12T18:19:22.668802+0000","last_unstale":"2024-09-12T19:20:02.979562+0000","last_undegraded":"2024-09-12T19:20:02.979562+0000","last_fullsized":"2024-09-12T19:20:02.979562+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:20.736060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'3","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:28.278184+0000","last_change":"2024-09-12T17:51:59.940440+0000","last_active":"2024-09-12T19:21:28.278184+0000","last_peered":"2024-09-12T19:21:28.278184+0000","last_clean":"2024-09-12T19:21:28.278184+0000","last_became_active":"2024-09-12T17:51:59.939686+0000","last_became_peered":"2024-09-12T17:51:59.939686+0000","last_unstale":"2024-09-12T19:21:28.278184+0000","last_undegraded":"2024-09-12T19:21:28.278184+0000","last_fullsized":"2024-09-12T19:21:28.278184+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:25.031497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:37.964561+0000","last_change":"2024-09-12T17:51:52.894394+0000","last_active":"2024-09-12T19:18:37.964561+0000","last_peered":"2024-09-12T19:18:37.964561+0000","last_clean":"2024-09-12T19:18:37.964561+0000","last_became_active":"2024-09-12T17:51:52.892953+0000","last_became_peered":"2024-09-12T17:51:52.892953+0000","last_unstale":"2024-09-12T19:18:37.964561+0000","last_undegraded":"2024-09-12T19:18:37.964561+0000","last_fullsized":"2024-09-12T19:18:37.964561+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:34.018077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'51","reported_seq":214,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.184846+0000","last_change":"2024-09-12T17:45:41.574719+0000","last_active":"2024-09-12T19:19:58.184846+0000","last_peered":"2024-09-12T19:19:58.184846+0000","last_clean":"2024-09-12T19:19:58.184846+0000","last_became_active":"2024-09-12T17:45:41.572941+0000","last_became_peered":"2024-09-12T17:45:41.572941+0000","last_unstale":"2024-09-12T19:19:58.184846+0000","last_undegraded":"2024-09-12T19:19:58.184846+0000","last_fullsized":"2024-09-12T19:19:58.184846+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:25.447410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":190,"num_write":83,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.533559+0000","last_change":"2024-09-12T18:19:22.652584+0000","last_active":"2024-09-12T19:20:03.533559+0000","last_peered":"2024-09-12T19:20:03.533559+0000","last_clean":"2024-09-12T19:20:03.533559+0000","last_became_active":"2024-09-12T18:19:22.651901+0000","last_became_peered":"2024-09-12T18:19:22.651901+0000","last_unstale":"2024-09-12T19:20:03.533559+0000","last_undegraded":"2024-09-12T19:20:03.533559+0000","last_fullsized":"2024-09-12T19:20:03.533559+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:40.051168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.236632+0000","last_change":"2024-09-12T17:51:59.948536+0000","last_active":"2024-09-12T19:18:43.236632+0000","last_peered":"2024-09-12T19:18:43.236632+0000","last_clean":"2024-09-12T19:18:43.236632+0000","last_became_active":"2024-09-12T17:51:59.947392+0000","last_became_peered":"2024-09-12T17:51:59.947392+0000","last_unstale":"2024-09-12T19:18:43.236632+0000","last_undegraded":"2024-09-12T19:18:43.236632+0000","last_fullsized":"2024-09-12T19:18:43.236632+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:47.397467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'5","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:52.952062+0000","last_change":"2024-09-12T17:51:52.887100+0000","last_active":"2024-09-12T19:18:52.952062+0000","last_peered":"2024-09-12T19:18:52.952062+0000","last_clean":"2024-09-12T19:18:52.952062+0000","last_became_active":"2024-09-12T17:51:52.886123+0000","last_became_peered":"2024-09-12T17:51:52.886123+0000","last_unstale":"2024-09-12T19:18:52.952062+0000","last_undegraded":"2024-09-12T19:18:52.952062+0000","last_fullsized":"2024-09-12T19:18:52.952062+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:11.295668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'32","reported_seq":165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.255039+0000","last_change":"2024-09-12T17:45:41.592562+0000","last_active":"2024-09-12T19:19:58.255039+0000","last_peered":"2024-09-12T19:19:58.255039+0000","last_clean":"2024-09-12T19:19:58.255039+0000","last_became_active":"2024-09-12T17:45:41.591637+0000","last_became_peered":"2024-09-12T17:45:41.591637+0000","last_unstale":"2024-09-12T19:19:58.255039+0000","last_undegraded":"2024-09-12T19:19:58.255039+0000","last_fullsized":"2024-09-12T19:19:58.255039+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:52.032057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":117,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968591+0000","last_change":"2024-09-12T18:19:22.646555+0000","last_active":"2024-09-12T19:20:02.968591+0000","last_peered":"2024-09-12T19:20:02.968591+0000","last_clean":"2024-09-12T19:20:02.968591+0000","last_became_active":"2024-09-12T18:19:22.645829+0000","last_became_peered":"2024-09-12T18:19:22.645829+0000","last_unstale":"2024-09-12T19:20:02.968591+0000","last_undegraded":"2024-09-12T19:20:02.968591+0000","last_fullsized":"2024-09-12T19:20:02.968591+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:14.278527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"267'9","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.986200+0000","last_change":"2024-09-12T17:52:23.472557+0000","last_active":"2024-09-12T19:22:58.986200+0000","last_peered":"2024-09-12T19:22:58.986200+0000","last_clean":"2024-09-12T19:22:58.986200+0000","last_became_active":"2024-09-12T17:52:23.438623+0000","last_became_peered":"2024-09-12T17:52:23.438623+0000","last_unstale":"2024-09-12T19:22:58.986200+0000","last_undegraded":"2024-09-12T19:22:58.986200+0000","last_fullsized":"2024-09-12T19:22:58.986200+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:04.013275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":19,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.16","version":"267'2","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:18.549641+0000","last_change":"2024-09-12T17:51:52.884671+0000","last_active":"2024-09-12T19:21:18.549641+0000","last_peered":"2024-09-12T19:21:18.549641+0000","last_clean":"2024-09-12T19:21:18.549641+0000","last_became_active":"2024-09-12T17:51:52.876542+0000","last_became_peered":"2024-09-12T17:51:52.876542+0000","last_unstale":"2024-09-12T19:21:18.549641+0000","last_undegraded":"2024-09-12T19:21:18.549641+0000","last_fullsized":"2024-09-12T19:21:18.549641+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:01.214988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"0'0","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.532458+0000","last_change":"2024-09-12T17:45:41.575734+0000","last_active":"2024-09-12T19:19:58.532458+0000","last_peered":"2024-09-12T19:19:58.532458+0000","last_clean":"2024-09-12T19:19:58.532458+0000","last_became_active":"2024-09-12T17:45:41.574953+0000","last_became_peered":"2024-09-12T17:45:41.574953+0000","last_unstale":"2024-09-12T19:19:58.532458+0000","last_undegraded":"2024-09-12T19:19:58.532458+0000","last_fullsized":"2024-09-12T19:19:58.532458+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:53.875702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.986527+0000","last_change":"2024-09-12T18:19:22.658747+0000","last_active":"2024-09-12T19:20:02.986527+0000","last_peered":"2024-09-12T19:20:02.986527+0000","last_clean":"2024-09-12T19:20:02.986527+0000","last_became_active":"2024-09-12T18:19:22.657731+0000","last_became_peered":"2024-09-12T18:19:22.657731+0000","last_unstale":"2024-09-12T19:20:02.986527+0000","last_undegraded":"2024-09-12T19:20:02.986527+0000","last_fullsized":"2024-09-12T19:20:02.986527+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:22.834751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"267'5","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:28.216153+0000","last_change":"2024-09-12T17:51:59.948754+0000","last_active":"2024-09-12T19:21:28.216153+0000","last_peered":"2024-09-12T19:21:28.216153+0000","last_clean":"2024-09-12T19:21:28.216153+0000","last_became_active":"2024-09-12T17:51:59.937650+0000","last_became_peered":"2024-09-12T17:51:59.937650+0000","last_unstale":"2024-09-12T19:21:28.216153+0000","last_undegraded":"2024-09-12T19:21:28.216153+0000","last_fullsized":"2024-09-12T19:21:28.216153+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:52.287318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.167284+0000","last_change":"2024-09-12T17:51:52.888708+0000","last_active":"2024-09-12T19:18:53.167284+0000","last_peered":"2024-09-12T19:18:53.167284+0000","last_clean":"2024-09-12T19:18:53.167284+0000","last_became_active":"2024-09-12T17:51:52.887964+0000","last_became_peered":"2024-09-12T17:51:52.887964+0000","last_unstale":"2024-09-12T19:18:53.167284+0000","last_undegraded":"2024-09-12T19:18:53.167284+0000","last_fullsized":"2024-09-12T19:18:53.167284+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:57.571315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'27","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959037+0000","last_change":"2024-09-12T17:45:41.595246+0000","last_active":"2024-09-12T19:19:22.959037+0000","last_peered":"2024-09-12T19:19:22.959037+0000","last_clean":"2024-09-12T19:19:22.959037+0000","last_became_active":"2024-09-12T17:45:41.594619+0000","last_became_peered":"2024-09-12T17:45:41.594619+0000","last_unstale":"2024-09-12T19:19:22.959037+0000","last_undegraded":"2024-09-12T19:19:22.959037+0000","last_fullsized":"2024-09-12T19:19:22.959037+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:08.142112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252332+0000","last_change":"2024-09-12T18:19:22.646874+0000","last_active":"2024-09-12T19:19:48.252332+0000","last_peered":"2024-09-12T19:19:48.252332+0000","last_clean":"2024-09-12T19:19:48.252332+0000","last_became_active":"2024-09-12T18:19:22.646129+0000","last_became_peered":"2024-09-12T18:19:22.646129+0000","last_unstale":"2024-09-12T19:19:48.252332+0000","last_undegraded":"2024-09-12T19:19:48.252332+0000","last_fullsized":"2024-09-12T19:19:48.252332+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:17.061904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.988325+0000","last_change":"2024-09-12T17:51:59.962952+0000","last_active":"2024-09-12T19:20:42.988325+0000","last_peered":"2024-09-12T19:20:42.988325+0000","last_clean":"2024-09-12T19:20:42.988325+0000","last_became_active":"2024-09-12T17:51:59.961892+0000","last_became_peered":"2024-09-12T17:51:59.961892+0000","last_unstale":"2024-09-12T19:20:42.988325+0000","last_undegraded":"2024-09-12T19:20:42.988325+0000","last_fullsized":"2024-09-12T19:20:42.988325+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:48.287564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'5","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.203445+0000","last_change":"2024-09-12T17:51:52.865750+0000","last_active":"2024-09-12T19:20:33.203445+0000","last_peered":"2024-09-12T19:20:33.203445+0000","last_clean":"2024-09-12T19:20:33.203445+0000","last_became_active":"2024-09-12T17:51:52.865019+0000","last_became_peered":"2024-09-12T17:51:52.865019+0000","last_unstale":"2024-09-12T19:20:33.203445+0000","last_undegraded":"2024-09-12T19:20:33.203445+0000","last_fullsized":"2024-09-12T19:20:33.203445+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:48.706108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'30","reported_seq":153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:02.954345+0000","last_change":"2024-09-12T17:45:41.595661+0000","last_active":"2024-09-12T19:19:02.954345+0000","last_peered":"2024-09-12T19:19:02.954345+0000","last_clean":"2024-09-12T19:19:02.954345+0000","last_became_active":"2024-09-12T17:45:41.594848+0000","last_became_peered":"2024-09-12T17:45:41.594848+0000","last_unstale":"2024-09-12T19:19:02.954345+0000","last_undegraded":"2024-09-12T19:19:02.954345+0000","last_fullsized":"2024-09-12T19:19:02.954345+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:51.035395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":101,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.182427+0000","last_change":"2024-09-12T18:19:22.649527+0000","last_active":"2024-09-12T19:19:48.182427+0000","last_peered":"2024-09-12T19:19:48.182427+0000","last_clean":"2024-09-12T19:19:48.182427+0000","last_became_active":"2024-09-12T18:19:22.648818+0000","last_became_peered":"2024-09-12T18:19:22.648818+0000","last_unstale":"2024-09-12T19:19:48.182427+0000","last_undegraded":"2024-09-12T19:19:48.182427+0000","last_fullsized":"2024-09-12T19:19:48.182427+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:23.776526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.988222+0000","last_change":"2024-09-12T17:51:59.954324+0000","last_active":"2024-09-12T19:20:42.988222+0000","last_peered":"2024-09-12T19:20:42.988222+0000","last_clean":"2024-09-12T19:20:42.988222+0000","last_became_active":"2024-09-12T17:51:59.953480+0000","last_became_peered":"2024-09-12T17:51:59.953480+0000","last_unstale":"2024-09-12T19:20:42.988222+0000","last_undegraded":"2024-09-12T19:20:42.988222+0000","last_fullsized":"2024-09-12T19:20:42.988222+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:03.945523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.264807+0000","last_change":"2024-09-12T17:51:52.886235+0000","last_active":"2024-09-12T19:20:33.264807+0000","last_peered":"2024-09-12T19:20:33.264807+0000","last_clean":"2024-09-12T19:20:33.264807+0000","last_became_active":"2024-09-12T17:51:52.884758+0000","last_became_peered":"2024-09-12T17:51:52.884758+0000","last_unstale":"2024-09-12T19:20:33.264807+0000","last_undegraded":"2024-09-12T19:20:33.264807+0000","last_fullsized":"2024-09-12T19:20:33.264807+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:14.092386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'17","reported_seq":121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.169851+0000","last_change":"2024-09-12T17:45:41.586061+0000","last_active":"2024-09-12T19:19:03.169851+0000","last_peered":"2024-09-12T19:19:03.169851+0000","last_clean":"2024-09-12T19:19:03.169851+0000","last_became_active":"2024-09-12T17:45:41.585259+0000","last_became_peered":"2024-09-12T17:45:41.585259+0000","last_unstale":"2024-09-12T19:19:03.169851+0000","last_undegraded":"2024-09-12T19:19:03.169851+0000","last_fullsized":"2024-09-12T19:19:03.169851+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:41.750928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":55,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.189074+0000","last_change":"2024-09-12T18:19:22.658645+0000","last_active":"2024-09-12T19:20:13.189074+0000","last_peered":"2024-09-12T19:20:13.189074+0000","last_clean":"2024-09-12T19:20:13.189074+0000","last_became_active":"2024-09-12T18:19:22.655117+0000","last_became_peered":"2024-09-12T18:19:22.655117+0000","last_unstale":"2024-09-12T19:20:13.189074+0000","last_undegraded":"2024-09-12T19:20:13.189074+0000","last_fullsized":"2024-09-12T19:20:13.189074+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:32.691865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:43.267416+0000","last_change":"2024-09-12T17:51:59.940572+0000","last_active":"2024-09-12T19:20:43.267416+0000","last_peered":"2024-09-12T19:20:43.267416+0000","last_clean":"2024-09-12T19:20:43.267416+0000","last_became_active":"2024-09-12T17:51:59.939751+0000","last_became_peered":"2024-09-12T17:51:59.939751+0000","last_unstale":"2024-09-12T19:20:43.267416+0000","last_undegraded":"2024-09-12T19:20:43.267416+0000","last_fullsized":"2024-09-12T19:20:43.267416+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:17.997521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.563717+0000","last_change":"2024-09-12T17:51:52.897941+0000","last_active":"2024-09-12T19:20:33.563717+0000","last_peered":"2024-09-12T19:20:33.563717+0000","last_clean":"2024-09-12T19:20:33.563717+0000","last_became_active":"2024-09-12T17:51:52.897168+0000","last_became_peered":"2024-09-12T17:51:52.897168+0000","last_unstale":"2024-09-12T19:20:33.563717+0000","last_undegraded":"2024-09-12T19:20:33.563717+0000","last_fullsized":"2024-09-12T19:20:33.563717+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:25.110112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'29","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.182170+0000","last_change":"2024-09-12T17:45:41.580462+0000","last_active":"2024-09-12T19:19:03.182170+0000","last_peered":"2024-09-12T19:19:03.182170+0000","last_clean":"2024-09-12T19:19:03.182170+0000","last_became_active":"2024-09-12T17:45:41.579765+0000","last_became_peered":"2024-09-12T17:45:41.579765+0000","last_unstale":"2024-09-12T19:19:03.182170+0000","last_undegraded":"2024-09-12T19:19:03.182170+0000","last_fullsized":"2024-09-12T19:19:03.182170+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:03.611178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":115,"num_write":41,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252289+0000","last_change":"2024-09-12T18:19:22.643191+0000","last_active":"2024-09-12T19:19:48.252289+0000","last_peered":"2024-09-12T19:19:48.252289+0000","last_clean":"2024-09-12T19:19:48.252289+0000","last_became_active":"2024-09-12T18:19:22.642415+0000","last_became_peered":"2024-09-12T18:19:22.642415+0000","last_unstale":"2024-09-12T19:19:48.252289+0000","last_undegraded":"2024-09-12T19:19:48.252289+0000","last_fullsized":"2024-09-12T19:19:48.252289+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:16.303449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:43.565948+0000","last_change":"2024-09-12T17:51:59.934455+0000","last_active":"2024-09-12T19:20:43.565948+0000","last_peered":"2024-09-12T19:20:43.565948+0000","last_clean":"2024-09-12T19:20:43.565948+0000","last_became_active":"2024-09-12T17:51:59.933679+0000","last_became_peered":"2024-09-12T17:51:59.933679+0000","last_unstale":"2024-09-12T19:20:43.565948+0000","last_undegraded":"2024-09-12T19:20:43.565948+0000","last_fullsized":"2024-09-12T19:20:43.565948+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:50.876767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"267'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:53.026201+0000","last_change":"2024-09-12T17:51:52.892730+0000","last_active":"2024-09-12T19:22:53.026201+0000","last_peered":"2024-09-12T19:22:53.026201+0000","last_clean":"2024-09-12T19:22:53.026201+0000","last_became_active":"2024-09-12T17:51:52.891977+0000","last_became_peered":"2024-09-12T17:51:52.891977+0000","last_unstale":"2024-09-12T19:22:53.026201+0000","last_undegraded":"2024-09-12T19:22:53.026201+0000","last_fullsized":"2024-09-12T19:22:53.026201+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:36.414562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'38","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.241715+0000","last_change":"2024-09-12T17:45:41.580119+0000","last_active":"2024-09-12T19:19:03.241715+0000","last_peered":"2024-09-12T19:19:03.241715+0000","last_clean":"2024-09-12T19:19:03.241715+0000","last_became_active":"2024-09-12T17:45:41.579275+0000","last_became_peered":"2024-09-12T17:45:41.579275+0000","last_unstale":"2024-09-12T19:19:03.241715+0000","last_undegraded":"2024-09-12T19:19:03.241715+0000","last_fullsized":"2024-09-12T19:19:03.241715+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:25.255989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":125,"num_write":71,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.534755+0000","last_change":"2024-09-12T18:19:22.657572+0000","last_active":"2024-09-12T19:20:08.534755+0000","last_peered":"2024-09-12T19:20:08.534755+0000","last_clean":"2024-09-12T19:20:08.534755+0000","last_became_active":"2024-09-12T18:19:22.656770+0000","last_became_peered":"2024-09-12T18:19:22.656770+0000","last_unstale":"2024-09-12T19:20:08.534755+0000","last_undegraded":"2024-09-12T19:20:08.534755+0000","last_fullsized":"2024-09-12T19:20:08.534755+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:58.749315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"267'6","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.188097+0000","last_change":"2024-09-12T17:51:59.941713+0000","last_active":"2024-09-12T19:23:00.188097+0000","last_peered":"2024-09-12T19:23:00.188097+0000","last_clean":"2024-09-12T19:23:00.188097+0000","last_became_active":"2024-09-12T17:51:59.934972+0000","last_became_peered":"2024-09-12T17:51:59.934972+0000","last_unstale":"2024-09-12T19:23:00.188097+0000","last_undegraded":"2024-09-12T19:23:00.188097+0000","last_fullsized":"2024-09-12T19:23:00.188097+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:09.715388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.962680+0000","last_change":"2024-09-12T17:51:52.901505+0000","last_active":"2024-09-12T19:19:37.962680+0000","last_peered":"2024-09-12T19:19:37.962680+0000","last_clean":"2024-09-12T19:19:37.962680+0000","last_became_active":"2024-09-12T17:51:52.900002+0000","last_became_peered":"2024-09-12T17:51:52.900002+0000","last_unstale":"2024-09-12T19:19:37.962680+0000","last_undegraded":"2024-09-12T19:19:37.962680+0000","last_fullsized":"2024-09-12T19:19:37.962680+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:16.493687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'34","reported_seq":174,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.265060+0000","last_change":"2024-09-12T17:45:41.581349+0000","last_active":"2024-09-12T19:20:33.265060+0000","last_peered":"2024-09-12T19:20:33.265060+0000","last_clean":"2024-09-12T19:20:33.265060+0000","last_became_active":"2024-09-12T17:45:41.580617+0000","last_became_peered":"2024-09-12T17:45:41.580617+0000","last_unstale":"2024-09-12T19:20:33.265060+0000","last_undegraded":"2024-09-12T19:20:33.265060+0000","last_fullsized":"2024-09-12T19:20:33.265060+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:04.951687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":129,"num_write":59,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:07.970075+0000","last_change":"2024-09-12T18:19:22.665735+0000","last_active":"2024-09-12T19:20:07.970075+0000","last_peered":"2024-09-12T19:20:07.970075+0000","last_clean":"2024-09-12T19:20:07.970075+0000","last_became_active":"2024-09-12T18:19:22.664960+0000","last_became_peered":"2024-09-12T18:19:22.664960+0000","last_unstale":"2024-09-12T19:20:07.970075+0000","last_undegraded":"2024-09-12T19:20:07.970075+0000","last_fullsized":"2024-09-12T19:20:07.970075+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:46.264476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:03.285437+0000","last_change":"2024-09-12T17:51:59.949566+0000","last_active":"2024-09-12T19:22:03.285437+0000","last_peered":"2024-09-12T19:22:03.285437+0000","last_clean":"2024-09-12T19:22:03.285437+0000","last_became_active":"2024-09-12T17:51:59.948733+0000","last_became_peered":"2024-09-12T17:51:59.948733+0000","last_unstale":"2024-09-12T19:22:03.285437+0000","last_undegraded":"2024-09-12T19:22:03.285437+0000","last_fullsized":"2024-09-12T19:22:03.285437+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:47.852395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'5","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.759933+0000","last_change":"2024-09-12T17:51:52.905209+0000","last_active":"2024-09-12T19:23:00.759933+0000","last_peered":"2024-09-12T19:23:00.759933+0000","last_clean":"2024-09-12T19:23:00.759933+0000","last_became_active":"2024-09-12T17:51:52.904092+0000","last_became_peered":"2024-09-12T17:51:52.904092+0000","last_unstale":"2024-09-12T19:23:00.759933+0000","last_undegraded":"2024-09-12T19:23:00.759933+0000","last_fullsized":"2024-09-12T19:23:00.759933+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:00.570363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'87","reported_seq":311,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:12.988906+0000","last_change":"2024-09-12T17:45:41.578591+0000","last_active":"2024-09-12T19:20:12.988906+0000","last_peered":"2024-09-12T19:20:12.988906+0000","last_clean":"2024-09-12T19:20:12.988906+0000","last_became_active":"2024-09-12T17:45:41.574884+0000","last_became_peered":"2024-09-12T17:45:41.574884+0000","last_unstale":"2024-09-12T19:20:12.988906+0000","last_undegraded":"2024-09-12T19:20:12.988906+0000","last_fullsized":"2024-09-12T19:20:12.988906+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:26.324719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":442,"num_read_kb":315,"num_write":154,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.557025+0000","last_change":"2024-09-12T18:19:22.633163+0000","last_active":"2024-09-12T19:20:03.557025+0000","last_peered":"2024-09-12T19:20:03.557025+0000","last_clean":"2024-09-12T19:20:03.557025+0000","last_became_active":"2024-09-12T18:19:22.632360+0000","last_became_peered":"2024-09-12T18:19:22.632360+0000","last_unstale":"2024-09-12T19:20:03.557025+0000","last_undegraded":"2024-09-12T19:20:03.557025+0000","last_fullsized":"2024-09-12T19:20:03.557025+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:12.189773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'7","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:12.981953+0000","last_change":"2024-09-12T17:51:59.946265+0000","last_active":"2024-09-12T19:20:12.981953+0000","last_peered":"2024-09-12T19:20:12.981953+0000","last_clean":"2024-09-12T19:20:12.981953+0000","last_became_active":"2024-09-12T17:51:59.945099+0000","last_became_peered":"2024-09-12T17:51:59.945099+0000","last_unstale":"2024-09-12T19:20:12.981953+0000","last_undegraded":"2024-09-12T19:20:12.981953+0000","last_fullsized":"2024-09-12T19:20:12.981953+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:52.338695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.212670+0000","last_change":"2024-09-12T17:51:52.899779+0000","last_active":"2024-09-12T19:21:53.212670+0000","last_peered":"2024-09-12T19:21:53.212670+0000","last_clean":"2024-09-12T19:21:53.212670+0000","last_became_active":"2024-09-12T17:51:52.889772+0000","last_became_peered":"2024-09-12T17:51:52.889772+0000","last_unstale":"2024-09-12T19:21:53.212670+0000","last_undegraded":"2024-09-12T19:21:53.212670+0000","last_fullsized":"2024-09-12T19:21:53.212670+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:13.521012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'27","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.559281+0000","last_change":"2024-09-12T17:45:41.591605+0000","last_active":"2024-09-12T19:20:13.559281+0000","last_peered":"2024-09-12T19:20:13.559281+0000","last_clean":"2024-09-12T19:20:13.559281+0000","last_became_active":"2024-09-12T17:45:41.590861+0000","last_became_peered":"2024-09-12T17:45:41.590861+0000","last_unstale":"2024-09-12T19:20:13.559281+0000","last_undegraded":"2024-09-12T19:20:13.559281+0000","last_fullsized":"2024-09-12T19:20:13.559281+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:02.020910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":90,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968726+0000","last_change":"2024-09-12T18:19:22.656976+0000","last_active":"2024-09-12T19:20:02.968726+0000","last_peered":"2024-09-12T19:20:02.968726+0000","last_clean":"2024-09-12T19:20:02.968726+0000","last_became_active":"2024-09-12T18:19:22.655979+0000","last_became_peered":"2024-09-12T18:19:22.655979+0000","last_unstale":"2024-09-12T19:20:02.968726+0000","last_undegraded":"2024-09-12T19:20:02.968726+0000","last_fullsized":"2024-09-12T19:20:02.968726+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:36.624661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'5","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.592803+0000","last_change":"2024-09-12T17:51:59.945983+0000","last_active":"2024-09-12T19:23:00.592803+0000","last_peered":"2024-09-12T19:23:00.592803+0000","last_clean":"2024-09-12T19:23:00.592803+0000","last_became_active":"2024-09-12T17:51:59.942431+0000","last_became_peered":"2024-09-12T17:51:59.942431+0000","last_unstale":"2024-09-12T19:23:00.592803+0000","last_undegraded":"2024-09-12T19:23:00.592803+0000","last_fullsized":"2024-09-12T19:23:00.592803+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:57.343792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10320,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:18.007302+0000","last_change":"2024-09-12T17:51:52.901374+0000","last_active":"2024-09-12T19:22:18.007302+0000","last_peered":"2024-09-12T19:22:18.007302+0000","last_clean":"2024-09-12T19:22:18.007302+0000","last_became_active":"2024-09-12T17:51:52.900785+0000","last_became_peered":"2024-09-12T17:51:52.900785+0000","last_unstale":"2024-09-12T19:22:18.007302+0000","last_undegraded":"2024-09-12T19:22:18.007302+0000","last_fullsized":"2024-09-12T19:22:18.007302+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:43.825575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'9","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.535920+0000","last_change":"2024-09-12T17:45:41.566506+0000","last_active":"2024-09-12T19:20:13.535920+0000","last_peered":"2024-09-12T19:20:13.535920+0000","last_clean":"2024-09-12T19:20:13.535920+0000","last_became_active":"2024-09-12T17:45:41.565793+0000","last_became_peered":"2024-09-12T17:45:41.565793+0000","last_unstale":"2024-09-12T19:20:13.535920+0000","last_undegraded":"2024-09-12T19:20:13.535920+0000","last_fullsized":"2024-09-12T19:20:13.535920+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:00.492098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.257645+0000","last_change":"2024-09-12T18:19:22.664289+0000","last_active":"2024-09-12T19:20:08.257645+0000","last_peered":"2024-09-12T19:20:08.257645+0000","last_clean":"2024-09-12T19:20:08.257645+0000","last_became_active":"2024-09-12T18:19:22.663586+0000","last_became_peered":"2024-09-12T18:19:22.663586+0000","last_unstale":"2024-09-12T19:20:08.257645+0000","last_undegraded":"2024-09-12T19:20:08.257645+0000","last_fullsized":"2024-09-12T19:20:08.257645+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:24.618521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:53.208011+0000","last_change":"2024-09-12T17:51:59.950216+0000","last_active":"2024-09-12T19:20:53.208011+0000","last_peered":"2024-09-12T19:20:53.208011+0000","last_clean":"2024-09-12T19:20:53.208011+0000","last_became_active":"2024-09-12T17:51:59.949437+0000","last_became_peered":"2024-09-12T17:51:59.949437+0000","last_unstale":"2024-09-12T19:20:53.208011+0000","last_undegraded":"2024-09-12T19:20:53.208011+0000","last_fullsized":"2024-09-12T19:20:53.208011+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:26.376958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:53.224729+0000","last_change":"2024-09-12T17:51:52.899343+0000","last_active":"2024-09-12T19:22:53.224729+0000","last_peered":"2024-09-12T19:22:53.224729+0000","last_clean":"2024-09-12T19:22:53.224729+0000","last_became_active":"2024-09-12T17:51:52.898903+0000","last_became_peered":"2024-09-12T17:51:52.898903+0000","last_unstale":"2024-09-12T19:22:53.224729+0000","last_undegraded":"2024-09-12T19:22:53.224729+0000","last_fullsized":"2024-09-12T19:22:53.224729+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:05.020501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'42","reported_seq":194,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.188942+0000","last_change":"2024-09-12T17:45:41.577630+0000","last_active":"2024-09-12T19:20:13.188942+0000","last_peered":"2024-09-12T19:20:13.188942+0000","last_clean":"2024-09-12T19:20:13.188942+0000","last_became_active":"2024-09-12T17:45:41.576921+0000","last_became_peered":"2024-09-12T17:45:41.576921+0000","last_unstale":"2024-09-12T19:20:13.188942+0000","last_undegraded":"2024-09-12T19:20:13.188942+0000","last_fullsized":"2024-09-12T19:20:13.188942+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:39.622331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":172,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:22.973830+0000","last_change":"2024-09-12T18:19:22.670182+0000","last_active":"2024-09-12T19:20:22.973830+0000","last_peered":"2024-09-12T19:20:22.973830+0000","last_clean":"2024-09-12T19:20:22.973830+0000","last_became_active":"2024-09-12T18:19:22.669476+0000","last_became_peered":"2024-09-12T18:19:22.669476+0000","last_unstale":"2024-09-12T19:20:22.973830+0000","last_undegraded":"2024-09-12T19:20:22.973830+0000","last_fullsized":"2024-09-12T19:20:22.973830+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:51.189488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:52.980628+0000","last_change":"2024-09-12T17:51:59.939499+0000","last_active":"2024-09-12T19:20:52.980628+0000","last_peered":"2024-09-12T19:20:52.980628+0000","last_clean":"2024-09-12T19:20:52.980628+0000","last_became_active":"2024-09-12T17:51:59.938736+0000","last_became_peered":"2024-09-12T17:51:59.938736+0000","last_unstale":"2024-09-12T19:20:52.980628+0000","last_undegraded":"2024-09-12T19:20:52.980628+0000","last_fullsized":"2024-09-12T19:20:52.980628+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:10.628111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'2","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:53.014895+0000","last_change":"2024-09-12T17:51:52.901410+0000","last_active":"2024-09-12T19:22:53.014895+0000","last_peered":"2024-09-12T19:22:53.014895+0000","last_clean":"2024-09-12T19:22:53.014895+0000","last_became_active":"2024-09-12T17:51:52.900972+0000","last_became_peered":"2024-09-12T17:51:52.900972+0000","last_unstale":"2024-09-12T19:22:53.014895+0000","last_undegraded":"2024-09-12T19:22:53.014895+0000","last_fullsized":"2024-09-12T19:22:53.014895+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:55.522541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'26","reported_seq":147,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:12.956617+0000","last_change":"2024-09-12T17:45:41.588736+0000","last_active":"2024-09-12T19:19:12.956617+0000","last_peered":"2024-09-12T19:19:12.956617+0000","last_clean":"2024-09-12T19:19:12.956617+0000","last_became_active":"2024-09-12T17:45:41.588013+0000","last_became_peered":"2024-09-12T17:45:41.588013+0000","last_unstale":"2024-09-12T19:19:12.956617+0000","last_undegraded":"2024-09-12T19:19:12.956617+0000","last_fullsized":"2024-09-12T19:19:12.956617+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:46.460159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":89,"num_write":52,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:07.970160+0000","last_change":"2024-09-12T18:19:22.664050+0000","last_active":"2024-09-12T19:20:07.970160+0000","last_peered":"2024-09-12T19:20:07.970160+0000","last_clean":"2024-09-12T19:20:07.970160+0000","last_became_active":"2024-09-12T18:19:22.662685+0000","last_became_peered":"2024-09-12T18:19:22.662685+0000","last_unstale":"2024-09-12T19:20:07.970160+0000","last_undegraded":"2024-09-12T19:20:07.970160+0000","last_fullsized":"2024-09-12T19:20:07.970160+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:20.137876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'10","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.864488+0000","last_change":"2024-09-12T17:51:59.943267+0000","last_active":"2024-09-12T19:22:59.864488+0000","last_peered":"2024-09-12T19:22:59.864488+0000","last_clean":"2024-09-12T19:22:59.864488+0000","last_became_active":"2024-09-12T17:51:59.942597+0000","last_became_peered":"2024-09-12T17:51:59.942597+0000","last_unstale":"2024-09-12T19:22:59.864488+0000","last_undegraded":"2024-09-12T19:22:59.864488+0000","last_fullsized":"2024-09-12T19:22:59.864488+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:04.930513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":29698,"num_write":10,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"267'3","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.116269+0000","last_change":"2024-09-12T17:51:52.908849+0000","last_active":"2024-09-12T19:23:01.116269+0000","last_peered":"2024-09-12T19:23:01.116269+0000","last_clean":"2024-09-12T19:23:01.116269+0000","last_became_active":"2024-09-12T17:51:52.908200+0000","last_became_peered":"2024-09-12T17:51:52.908200+0000","last_unstale":"2024-09-12T19:23:01.116269+0000","last_undegraded":"2024-09-12T19:23:01.116269+0000","last_fullsized":"2024-09-12T19:23:01.116269+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'15","reported_seq":118,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.239287+0000","last_change":"2024-09-12T17:45:41.578047+0000","last_active":"2024-09-12T19:18:53.239287+0000","last_peered":"2024-09-12T19:18:53.239287+0000","last_clean":"2024-09-12T19:18:53.239287+0000","last_became_active":"2024-09-12T17:45:41.572067+0000","last_became_peered":"2024-09-12T17:45:41.572067+0000","last_unstale":"2024-09-12T19:18:53.239287+0000","last_undegraded":"2024-09-12T19:18:53.239287+0000","last_fullsized":"2024-09-12T19:18:53.239287+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:00.575546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.187554+0000","last_change":"2024-09-12T18:19:22.653075+0000","last_active":"2024-09-12T19:20:08.187554+0000","last_peered":"2024-09-12T19:20:08.187554+0000","last_clean":"2024-09-12T19:20:08.187554+0000","last_became_active":"2024-09-12T18:19:22.648052+0000","last_became_peered":"2024-09-12T18:19:22.648052+0000","last_unstale":"2024-09-12T19:20:08.187554+0000","last_undegraded":"2024-09-12T19:20:08.187554+0000","last_fullsized":"2024-09-12T19:20:08.187554+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:19.707016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"267'8","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.988426+0000","last_change":"2024-09-12T17:51:59.949619+0000","last_active":"2024-09-12T19:22:58.988426+0000","last_peered":"2024-09-12T19:22:58.988426+0000","last_clean":"2024-09-12T19:22:58.988426+0000","last_became_active":"2024-09-12T17:51:59.948873+0000","last_became_peered":"2024-09-12T17:51:59.948873+0000","last_unstale":"2024-09-12T19:22:58.988426+0000","last_undegraded":"2024-09-12T19:22:58.988426+0000","last_fullsized":"2024-09-12T19:22:58.988426+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:03.402596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.190557+0000","last_change":"2024-09-12T17:51:52.890333+0000","last_active":"2024-09-12T19:19:38.190557+0000","last_peered":"2024-09-12T19:19:38.190557+0000","last_clean":"2024-09-12T19:19:38.190557+0000","last_became_active":"2024-09-12T17:51:52.889529+0000","last_became_peered":"2024-09-12T17:51:52.889529+0000","last_unstale":"2024-09-12T19:19:38.190557+0000","last_undegraded":"2024-09-12T19:19:38.190557+0000","last_fullsized":"2024-09-12T19:19:38.190557+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:16.334887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'21","reported_seq":135,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.542152+0000","last_change":"2024-09-12T17:45:41.580279+0000","last_active":"2024-09-12T19:18:53.542152+0000","last_peered":"2024-09-12T19:18:53.542152+0000","last_clean":"2024-09-12T19:18:53.542152+0000","last_became_active":"2024-09-12T17:45:41.579580+0000","last_became_peered":"2024-09-12T17:45:41.579580+0000","last_unstale":"2024-09-12T19:18:53.542152+0000","last_undegraded":"2024-09-12T19:18:53.542152+0000","last_fullsized":"2024-09-12T19:18:53.542152+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:43.960745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":77,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.964979+0000","last_change":"2024-09-12T18:19:22.669927+0000","last_active":"2024-09-12T19:19:47.964979+0000","last_peered":"2024-09-12T19:19:47.964979+0000","last_clean":"2024-09-12T19:19:47.964979+0000","last_became_active":"2024-09-12T18:19:22.669240+0000","last_became_peered":"2024-09-12T18:19:22.669240+0000","last_unstale":"2024-09-12T19:19:47.964979+0000","last_undegraded":"2024-09-12T19:19:47.964979+0000","last_fullsized":"2024-09-12T19:19:47.964979+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:35.739210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.182370+0000","last_change":"2024-09-12T17:51:59.970451+0000","last_active":"2024-09-12T19:19:48.182370+0000","last_peered":"2024-09-12T19:19:48.182370+0000","last_clean":"2024-09-12T19:19:48.182370+0000","last_became_active":"2024-09-12T17:51:59.969706+0000","last_became_peered":"2024-09-12T17:51:59.969706+0000","last_unstale":"2024-09-12T19:19:48.182370+0000","last_undegraded":"2024-09-12T19:19:48.182370+0000","last_fullsized":"2024-09-12T19:19:48.182370+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:53.849725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'6","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959065+0000","last_change":"2024-09-12T17:51:52.884785+0000","last_active":"2024-09-12T19:19:22.959065+0000","last_peered":"2024-09-12T19:19:22.959065+0000","last_clean":"2024-09-12T19:19:22.959065+0000","last_became_active":"2024-09-12T17:51:52.884061+0000","last_became_peered":"2024-09-12T17:51:52.884061+0000","last_unstale":"2024-09-12T19:19:22.959065+0000","last_undegraded":"2024-09-12T19:19:22.959065+0000","last_fullsized":"2024-09-12T19:19:22.959065+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:17.943043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'29","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.167345+0000","last_change":"2024-09-12T17:45:41.573958+0000","last_active":"2024-09-12T19:18:53.167345+0000","last_peered":"2024-09-12T19:18:53.167345+0000","last_clean":"2024-09-12T19:18:53.167345+0000","last_became_active":"2024-09-12T17:45:41.572130+0000","last_became_peered":"2024-09-12T17:45:41.572130+0000","last_unstale":"2024-09-12T19:18:53.167345+0000","last_undegraded":"2024-09-12T19:18:53.167345+0000","last_fullsized":"2024-09-12T19:18:53.167345+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:19.465432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":63,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.982479+0000","last_change":"2024-09-12T18:19:22.667322+0000","last_active":"2024-09-12T19:19:47.982479+0000","last_peered":"2024-09-12T19:19:47.982479+0000","last_clean":"2024-09-12T19:19:47.982479+0000","last_became_active":"2024-09-12T18:19:22.666608+0000","last_became_peered":"2024-09-12T18:19:22.666608+0000","last_unstale":"2024-09-12T19:19:47.982479+0000","last_undegraded":"2024-09-12T19:19:47.982479+0000","last_fullsized":"2024-09-12T19:19:47.982479+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:35.427234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.178096+0000","last_change":"2024-09-12T17:51:59.956619+0000","last_active":"2024-09-12T19:19:33.178096+0000","last_peered":"2024-09-12T19:19:33.178096+0000","last_clean":"2024-09-12T19:19:33.178096+0000","last_became_active":"2024-09-12T17:51:59.956010+0000","last_became_peered":"2024-09-12T17:51:59.956010+0000","last_unstale":"2024-09-12T19:19:33.178096+0000","last_undegraded":"2024-09-12T19:19:33.178096+0000","last_fullsized":"2024-09-12T19:19:33.178096+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:44.171788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'2","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.527059+0000","last_change":"2024-09-12T17:51:52.904694+0000","last_active":"2024-09-12T19:19:33.527059+0000","last_peered":"2024-09-12T19:19:33.527059+0000","last_clean":"2024-09-12T19:19:33.527059+0000","last_became_active":"2024-09-12T17:51:52.903355+0000","last_became_peered":"2024-09-12T17:51:52.903355+0000","last_unstale":"2024-09-12T19:19:33.527059+0000","last_undegraded":"2024-09-12T19:19:33.527059+0000","last_fullsized":"2024-09-12T19:19:33.527059+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:54.768969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'38","reported_seq":184,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.542289+0000","last_change":"2024-09-12T17:45:41.578036+0000","last_active":"2024-09-12T19:18:53.542289+0000","last_peered":"2024-09-12T19:18:53.542289+0000","last_clean":"2024-09-12T19:18:53.542289+0000","last_became_active":"2024-09-12T17:45:41.577322+0000","last_became_peered":"2024-09-12T17:45:41.577322+0000","last_unstale":"2024-09-12T19:18:53.542289+0000","last_undegraded":"2024-09-12T19:18:53.542289+0000","last_fullsized":"2024-09-12T19:18:53.542289+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:32.631509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":139,"num_write":67,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.973565+0000","last_change":"2024-09-12T18:19:22.652387+0000","last_active":"2024-09-12T19:19:37.973565+0000","last_peered":"2024-09-12T19:19:37.973565+0000","last_clean":"2024-09-12T19:19:37.973565+0000","last_became_active":"2024-09-12T18:19:22.647003+0000","last_became_peered":"2024-09-12T18:19:22.647003+0000","last_unstale":"2024-09-12T19:19:37.973565+0000","last_undegraded":"2024-09-12T19:19:37.973565+0000","last_fullsized":"2024-09-12T19:19:37.973565+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:55.195971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.986890+0000","last_change":"2024-09-12T17:51:59.940082+0000","last_active":"2024-09-12T19:22:58.986890+0000","last_peered":"2024-09-12T19:22:58.986890+0000","last_clean":"2024-09-12T19:22:58.986890+0000","last_became_active":"2024-09-12T17:51:59.939200+0000","last_became_peered":"2024-09-12T17:51:59.939200+0000","last_unstale":"2024-09-12T19:22:58.986890+0000","last_undegraded":"2024-09-12T19:22:58.986890+0000","last_fullsized":"2024-09-12T19:22:58.986890+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:37.667275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"267'6","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.988584+0000","last_change":"2024-09-12T17:51:52.897536+0000","last_active":"2024-09-12T19:22:58.988584+0000","last_peered":"2024-09-12T19:22:58.988584+0000","last_clean":"2024-09-12T19:22:58.988584+0000","last_became_active":"2024-09-12T17:51:52.896708+0000","last_became_peered":"2024-09-12T17:51:52.896708+0000","last_unstale":"2024-09-12T19:22:58.988584+0000","last_undegraded":"2024-09-12T19:22:58.988584+0000","last_fullsized":"2024-09-12T19:22:58.988584+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:36.334907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'29","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.965069+0000","last_change":"2024-09-12T17:45:41.592647+0000","last_active":"2024-09-12T19:19:47.965069+0000","last_peered":"2024-09-12T19:19:47.965069+0000","last_clean":"2024-09-12T19:19:47.965069+0000","last_became_active":"2024-09-12T17:45:41.591866+0000","last_became_peered":"2024-09-12T17:45:41.591866+0000","last_unstale":"2024-09-12T19:19:47.965069+0000","last_undegraded":"2024-09-12T19:19:47.965069+0000","last_fullsized":"2024-09-12T19:19:47.965069+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:29.840636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.192729+0000","last_change":"2024-09-12T18:19:22.661674+0000","last_active":"2024-09-12T19:19:48.192729+0000","last_peered":"2024-09-12T19:19:48.192729+0000","last_clean":"2024-09-12T19:19:48.192729+0000","last_became_active":"2024-09-12T18:19:22.660667+0000","last_became_peered":"2024-09-12T18:19:22.660667+0000","last_unstale":"2024-09-12T19:19:48.192729+0000","last_undegraded":"2024-09-12T19:19:48.192729+0000","last_fullsized":"2024-09-12T19:19:48.192729+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:47.455186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:53.208174+0000","last_change":"2024-09-12T17:51:59.949737+0000","last_active":"2024-09-12T19:20:53.208174+0000","last_peered":"2024-09-12T19:20:53.208174+0000","last_clean":"2024-09-12T19:20:53.208174+0000","last_became_active":"2024-09-12T17:51:59.948786+0000","last_became_peered":"2024-09-12T17:51:59.948786+0000","last_unstale":"2024-09-12T19:20:53.208174+0000","last_undegraded":"2024-09-12T19:20:53.208174+0000","last_fullsized":"2024-09-12T19:20:53.208174+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:33.491621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.978565+0000","last_change":"2024-09-12T17:51:52.896511+0000","last_active":"2024-09-12T19:20:42.978565+0000","last_peered":"2024-09-12T19:20:42.978565+0000","last_clean":"2024-09-12T19:20:42.978565+0000","last_became_active":"2024-09-12T17:51:52.895779+0000","last_became_peered":"2024-09-12T17:51:52.895779+0000","last_unstale":"2024-09-12T19:20:42.978565+0000","last_undegraded":"2024-09-12T19:20:42.978565+0000","last_fullsized":"2024-09-12T19:20:42.978565+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:11.529897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'43","reported_seq":205,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:27.971388+0000","last_change":"2024-09-12T17:45:41.584723+0000","last_active":"2024-09-12T19:19:27.971388+0000","last_peered":"2024-09-12T19:19:27.971388+0000","last_clean":"2024-09-12T19:19:27.971388+0000","last_became_active":"2024-09-12T17:45:41.576707+0000","last_became_peered":"2024-09-12T17:45:41.576707+0000","last_unstale":"2024-09-12T19:19:27.971388+0000","last_undegraded":"2024-09-12T19:19:27.971388+0000","last_fullsized":"2024-09-12T19:19:27.971388+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:31.487354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":167,"num_write":65,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.533665+0000","last_change":"2024-09-12T18:19:22.658620+0000","last_active":"2024-09-12T19:20:03.533665+0000","last_peered":"2024-09-12T19:20:03.533665+0000","last_clean":"2024-09-12T19:20:03.533665+0000","last_became_active":"2024-09-12T18:19:22.657891+0000","last_became_peered":"2024-09-12T18:19:22.657891+0000","last_unstale":"2024-09-12T19:20:03.533665+0000","last_undegraded":"2024-09-12T19:20:03.533665+0000","last_fullsized":"2024-09-12T19:20:03.533665+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:56.867297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:32.972545+0000","last_change":"2024-09-12T17:51:59.963668+0000","last_active":"2024-09-12T19:19:32.972545+0000","last_peered":"2024-09-12T19:19:32.972545+0000","last_clean":"2024-09-12T19:19:32.972545+0000","last_became_active":"2024-09-12T17:51:59.962769+0000","last_became_peered":"2024-09-12T17:51:59.962769+0000","last_unstale":"2024-09-12T19:19:32.972545+0000","last_undegraded":"2024-09-12T19:19:32.972545+0000","last_fullsized":"2024-09-12T19:19:32.972545+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:25.342532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'5","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:12.971293+0000","last_change":"2024-09-12T17:51:52.902253+0000","last_active":"2024-09-12T19:20:12.971293+0000","last_peered":"2024-09-12T19:20:12.971293+0000","last_clean":"2024-09-12T19:20:12.971293+0000","last_became_active":"2024-09-12T17:51:52.899987+0000","last_became_peered":"2024-09-12T17:51:52.899987+0000","last_unstale":"2024-09-12T19:20:12.971293+0000","last_undegraded":"2024-09-12T19:20:12.971293+0000","last_fullsized":"2024-09-12T19:20:12.971293+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:40.914632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'9","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:27.978145+0000","last_change":"2024-09-12T17:45:41.571623+0000","last_active":"2024-09-12T19:19:27.978145+0000","last_peered":"2024-09-12T19:19:27.978145+0000","last_clean":"2024-09-12T19:19:27.978145+0000","last_became_active":"2024-09-12T17:45:41.569871+0000","last_became_peered":"2024-09-12T17:45:41.569871+0000","last_unstale":"2024-09-12T19:19:27.978145+0000","last_undegraded":"2024-09-12T19:19:27.978145+0000","last_fullsized":"2024-09-12T19:19:27.978145+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:49.201478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.186072+0000","last_change":"2024-09-12T18:19:22.663293+0000","last_active":"2024-09-12T19:20:03.186072+0000","last_peered":"2024-09-12T19:20:03.186072+0000","last_clean":"2024-09-12T19:20:03.186072+0000","last_became_active":"2024-09-12T18:19:22.648018+0000","last_became_peered":"2024-09-12T18:19:22.648018+0000","last_unstale":"2024-09-12T19:20:03.186072+0000","last_undegraded":"2024-09-12T19:20:03.186072+0000","last_fullsized":"2024-09-12T19:20:03.186072+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:02.291028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'7","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.992212+0000","last_change":"2024-09-12T17:51:59.944498+0000","last_active":"2024-09-12T19:20:27.992212+0000","last_peered":"2024-09-12T19:20:27.992212+0000","last_clean":"2024-09-12T19:20:27.992212+0000","last_became_active":"2024-09-12T17:51:59.943764+0000","last_became_peered":"2024-09-12T17:51:59.943764+0000","last_unstale":"2024-09-12T19:20:27.992212+0000","last_undegraded":"2024-09-12T19:20:27.992212+0000","last_fullsized":"2024-09-12T19:20:27.992212+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:10.664480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20800,"num_write":12,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.958933+0000","last_change":"2024-09-12T17:51:52.894510+0000","last_active":"2024-09-12T19:19:22.958933+0000","last_peered":"2024-09-12T19:19:22.958933+0000","last_clean":"2024-09-12T19:19:22.958933+0000","last_became_active":"2024-09-12T17:51:52.893764+0000","last_became_peered":"2024-09-12T17:51:52.893764+0000","last_unstale":"2024-09-12T19:19:22.958933+0000","last_undegraded":"2024-09-12T19:19:22.958933+0000","last_fullsized":"2024-09-12T19:19:22.958933+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:33.064325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'85","reported_seq":313,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:28.188253+0000","last_change":"2024-09-12T17:45:41.579106+0000","last_active":"2024-09-12T19:19:28.188253+0000","last_peered":"2024-09-12T19:19:28.188253+0000","last_clean":"2024-09-12T19:19:28.188253+0000","last_became_active":"2024-09-12T17:45:41.576079+0000","last_became_peered":"2024-09-12T17:45:41.576079+0000","last_unstale":"2024-09-12T19:19:28.188253+0000","last_undegraded":"2024-09-12T19:19:28.188253+0000","last_fullsized":"2024-09-12T19:19:28.188253+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:21.619591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":312,"num_write":160,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.182314+0000","last_change":"2024-09-12T18:19:22.663744+0000","last_active":"2024-09-12T19:19:48.182314+0000","last_peered":"2024-09-12T19:19:48.182314+0000","last_clean":"2024-09-12T19:19:48.182314+0000","last_became_active":"2024-09-12T18:19:22.662955+0000","last_became_peered":"2024-09-12T18:19:22.662955+0000","last_unstale":"2024-09-12T19:19:48.182314+0000","last_undegraded":"2024-09-12T19:19:48.182314+0000","last_fullsized":"2024-09-12T19:19:48.182314+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:06.958542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.550710+0000","last_change":"2024-09-12T17:51:59.943709+0000","last_active":"2024-09-12T19:19:33.550710+0000","last_peered":"2024-09-12T19:19:33.550710+0000","last_clean":"2024-09-12T19:19:33.550710+0000","last_became_active":"2024-09-12T17:51:59.942275+0000","last_became_peered":"2024-09-12T17:51:59.942275+0000","last_unstale":"2024-09-12T19:19:33.550710+0000","last_undegraded":"2024-09-12T19:19:33.550710+0000","last_fullsized":"2024-09-12T19:19:33.550710+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:15.298466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.970211+0000","last_change":"2024-09-12T17:51:52.896451+0000","last_active":"2024-09-12T19:19:22.970211+0000","last_peered":"2024-09-12T19:19:22.970211+0000","last_clean":"2024-09-12T19:19:22.970211+0000","last_became_active":"2024-09-12T17:51:52.895913+0000","last_became_peered":"2024-09-12T17:51:52.895913+0000","last_unstale":"2024-09-12T19:19:22.970211+0000","last_undegraded":"2024-09-12T19:19:22.970211+0000","last_fullsized":"2024-09-12T19:19:22.970211+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:21.249149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'8","reported_seq":102,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:28.549494+0000","last_change":"2024-09-12T17:45:41.577598+0000","last_active":"2024-09-12T19:19:28.549494+0000","last_peered":"2024-09-12T19:19:28.549494+0000","last_clean":"2024-09-12T19:19:28.549494+0000","last_became_active":"2024-09-12T17:45:41.576841+0000","last_became_peered":"2024-09-12T17:45:41.576841+0000","last_unstale":"2024-09-12T19:19:28.549494+0000","last_undegraded":"2024-09-12T19:19:28.549494+0000","last_fullsized":"2024-09-12T19:19:28.549494+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:40.378322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968901+0000","last_change":"2024-09-12T18:19:22.663672+0000","last_active":"2024-09-12T19:20:02.968901+0000","last_peered":"2024-09-12T19:20:02.968901+0000","last_clean":"2024-09-12T19:20:02.968901+0000","last_became_active":"2024-09-12T18:19:22.662633+0000","last_became_peered":"2024-09-12T18:19:22.662633+0000","last_unstale":"2024-09-12T19:20:02.968901+0000","last_undegraded":"2024-09-12T19:20:02.968901+0000","last_fullsized":"2024-09-12T19:20:02.968901+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:40.210719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.189287+0000","last_change":"2024-09-12T17:51:59.929795+0000","last_active":"2024-09-12T19:19:33.189287+0000","last_peered":"2024-09-12T19:19:33.189287+0000","last_clean":"2024-09-12T19:19:33.189287+0000","last_became_active":"2024-09-12T17:51:59.929108+0000","last_became_peered":"2024-09-12T17:51:59.929108+0000","last_unstale":"2024-09-12T19:19:33.189287+0000","last_undegraded":"2024-09-12T19:19:33.189287+0000","last_fullsized":"2024-09-12T19:19:33.189287+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:42.206076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"267'2","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:28.575723+0000","last_change":"2024-09-12T17:51:52.883949+0000","last_active":"2024-09-12T19:21:28.575723+0000","last_peered":"2024-09-12T19:21:28.575723+0000","last_clean":"2024-09-12T19:21:28.575723+0000","last_became_active":"2024-09-12T17:51:52.876809+0000","last_became_peered":"2024-09-12T17:51:52.876809+0000","last_unstale":"2024-09-12T19:21:28.575723+0000","last_undegraded":"2024-09-12T19:21:28.575723+0000","last_fullsized":"2024-09-12T19:21:28.575723+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:43.734348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":5,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'24","reported_seq":146,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968654+0000","last_change":"2024-09-12T17:45:41.588350+0000","last_active":"2024-09-12T19:20:02.968654+0000","last_peered":"2024-09-12T19:20:02.968654+0000","last_clean":"2024-09-12T19:20:02.968654+0000","last_became_active":"2024-09-12T17:45:41.587464+0000","last_became_peered":"2024-09-12T17:45:41.587464+0000","last_unstale":"2024-09-12T19:20:02.968654+0000","last_undegraded":"2024-09-12T19:20:02.968654+0000","last_fullsized":"2024-09-12T19:20:02.968654+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:57.305993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":80,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'298","reported_seq":949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.953141+0000","last_change":"2024-09-12T17:29:52.756359+0000","last_active":"2024-09-12T19:23:01.953141+0000","last_peered":"2024-09-12T19:23:01.953141+0000","last_clean":"2024-09-12T19:23:01.953141+0000","last_became_active":"2024-09-12T17:29:52.754920+0000","last_became_peered":"2024-09-12T17:29:52.754920+0000","last_unstale":"2024-09-12T19:23:01.953141+0000","last_undegraded":"2024-09-12T19:23:01.953141+0000","last_fullsized":"2024-09-12T19:23:01.953141+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:04.557129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262253,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":663,"num_write":1055,"num_write_kb":22160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'506","reported_seq":2205,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.033717+0000","last_change":"2024-09-12T17:29:54.761709+0000","last_active":"2024-09-12T19:22:45.033717+0000","last_peered":"2024-09-12T19:22:45.033717+0000","last_clean":"2024-09-12T19:22:45.033717+0000","last_became_active":"2024-09-12T17:29:54.760892+0000","last_became_peered":"2024-09-12T17:29:54.760892+0000","last_unstale":"2024-09-12T19:22:45.033717+0000","last_undegraded":"2024-09-12T19:22:45.033717+0000","last_fullsized":"2024-09-12T19:22:45.033717+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:41.865266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2904,"num_read_kb":2740,"num_write":620,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'340","reported_seq":1028,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.906791+0000","last_change":"2024-09-12T17:29:52.748073+0000","last_active":"2024-09-12T19:23:01.906791+0000","last_peered":"2024-09-12T19:23:01.906791+0000","last_clean":"2024-09-12T19:23:01.906791+0000","last_became_active":"2024-09-12T17:29:52.747481+0000","last_became_peered":"2024-09-12T17:29:52.747481+0000","last_unstale":"2024-09-12T19:23:01.906791+0000","last_undegraded":"2024-09-12T19:23:01.906791+0000","last_fullsized":"2024-09-12T19:23:01.906791+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:09.939962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306162,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":522,"num_read_kb":19278,"num_write":1123,"num_write_kb":29260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'430","reported_seq":1893,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.967478+0000","last_change":"2024-09-12T17:29:54.754770+0000","last_active":"2024-09-12T19:19:57.967478+0000","last_peered":"2024-09-12T19:19:57.967478+0000","last_clean":"2024-09-12T19:19:57.967478+0000","last_became_active":"2024-09-12T17:29:54.753272+0000","last_became_peered":"2024-09-12T17:29:54.753272+0000","last_unstale":"2024-09-12T19:19:57.967478+0000","last_undegraded":"2024-09-12T19:19:57.967478+0000","last_fullsized":"2024-09-12T19:19:57.967478+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:02.705919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2129,"num_read_kb":2000,"num_write":496,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'342","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.943225+0000","last_change":"2024-09-12T17:29:52.736428+0000","last_active":"2024-09-12T19:23:01.943225+0000","last_peered":"2024-09-12T19:23:01.943225+0000","last_clean":"2024-09-12T19:23:01.943225+0000","last_became_active":"2024-09-12T17:29:52.735978+0000","last_became_peered":"2024-09-12T17:29:52.735978+0000","last_unstale":"2024-09-12T19:23:01.943225+0000","last_undegraded":"2024-09-12T19:23:01.943225+0000","last_fullsized":"2024-09-12T19:23:01.943225+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:58.103754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2553570,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":504,"num_read_kb":35253,"num_write":1107,"num_write_kb":35855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'935","reported_seq":2602,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.437432+0000","last_change":"2024-09-12T17:29:54.771720+0000","last_active":"2024-09-12T19:21:21.437432+0000","last_peered":"2024-09-12T19:21:21.437432+0000","last_clean":"2024-09-12T19:21:21.437432+0000","last_became_active":"2024-09-12T17:29:54.770286+0000","last_became_peered":"2024-09-12T17:29:54.770286+0000","last_unstale":"2024-09-12T19:21:21.437432+0000","last_undegraded":"2024-09-12T19:21:21.437432+0000","last_fullsized":"2024-09-12T19:21:21.437432+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":900,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:38.926608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4498,"num_read_kb":4029,"num_write":1285,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'344","reported_seq":1087,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.957130+0000","last_change":"2024-09-12T17:30:21.690086+0000","last_active":"2024-09-12T19:23:01.957130+0000","last_peered":"2024-09-12T19:23:01.957130+0000","last_clean":"2024-09-12T19:23:01.957130+0000","last_became_active":"2024-09-12T17:30:21.689546+0000","last_became_peered":"2024-09-12T17:30:21.689546+0000","last_unstale":"2024-09-12T19:23:01.957130+0000","last_undegraded":"2024-09-12T19:23:01.957130+0000","last_fullsized":"2024-09-12T19:23:01.957130+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:14.185451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170253,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":648,"num_read_kb":124307,"num_write":1100,"num_write_kb":33866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7,2],"acting":[1,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"267'841","reported_seq":2480,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.726477+0000","last_change":"2024-09-12T17:29:54.760698+0000","last_active":"2024-09-12T19:20:03.726477+0000","last_peered":"2024-09-12T19:20:03.726477+0000","last_clean":"2024-09-12T19:20:03.726477+0000","last_became_active":"2024-09-12T17:29:54.760180+0000","last_became_peered":"2024-09-12T17:29:54.760180+0000","last_unstale":"2024-09-12T19:20:03.726477+0000","last_undegraded":"2024-09-12T19:20:03.726477+0000","last_fullsized":"2024-09-12T19:20:03.726477+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:44.225987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3987,"num_read_kb":3603,"num_write":1097,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'364","reported_seq":1008,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.958299+0000","last_change":"2024-09-12T17:29:52.750742+0000","last_active":"2024-09-12T19:23:01.958299+0000","last_peered":"2024-09-12T19:23:01.958299+0000","last_clean":"2024-09-12T19:23:01.958299+0000","last_became_active":"2024-09-12T17:29:52.744115+0000","last_became_peered":"2024-09-12T17:29:52.744115+0000","last_unstale":"2024-09-12T19:23:01.958299+0000","last_undegraded":"2024-09-12T19:23:01.958299+0000","last_fullsized":"2024-09-12T19:23:01.958299+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:24.050332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262269,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":11709,"num_write":1093,"num_write_kb":63153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'869","reported_seq":2502,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.934290+0000","last_change":"2024-09-12T17:29:54.759304+0000","last_active":"2024-09-12T19:20:27.934290+0000","last_peered":"2024-09-12T19:20:27.934290+0000","last_clean":"2024-09-12T19:20:27.934290+0000","last_became_active":"2024-09-12T17:29:54.758552+0000","last_became_peered":"2024-09-12T17:29:54.758552+0000","last_unstale":"2024-09-12T19:20:27.934290+0000","last_undegraded":"2024-09-12T19:20:27.934290+0000","last_fullsized":"2024-09-12T19:20:27.934290+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:33.584027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4049,"num_read_kb":3640,"num_write":1140,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'353","reported_seq":1017,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.900610+0000","last_change":"2024-09-12T17:29:52.762266+0000","last_active":"2024-09-12T19:23:01.900610+0000","last_peered":"2024-09-12T19:23:01.900610+0000","last_clean":"2024-09-12T19:23:01.900610+0000","last_became_active":"2024-09-12T17:29:52.756242+0000","last_became_peered":"2024-09-12T17:29:52.756242+0000","last_unstale":"2024-09-12T19:23:01.900610+0000","last_undegraded":"2024-09-12T19:23:01.900610+0000","last_fullsized":"2024-09-12T19:23:01.900610+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:47.783235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311546,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":527,"num_read_kb":10971,"num_write":1015,"num_write_kb":29590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'390","reported_seq":1980,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.933638+0000","last_change":"2024-09-12T17:29:54.770914+0000","last_active":"2024-09-12T19:20:27.933638+0000","last_peered":"2024-09-12T19:20:27.933638+0000","last_clean":"2024-09-12T19:20:27.933638+0000","last_became_active":"2024-09-12T17:29:54.770050+0000","last_became_peered":"2024-09-12T17:29:54.770050+0000","last_unstale":"2024-09-12T19:20:27.933638+0000","last_undegraded":"2024-09-12T19:20:27.933638+0000","last_fullsized":"2024-09-12T19:20:27.933638+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:43.841653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2225,"num_read_kb":2129,"num_write":425,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'366","reported_seq":1019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.985420+0000","last_change":"2024-09-12T17:29:52.767237+0000","last_active":"2024-09-12T19:23:01.985420+0000","last_peered":"2024-09-12T19:23:01.985420+0000","last_clean":"2024-09-12T19:23:01.985420+0000","last_became_active":"2024-09-12T17:29:52.762473+0000","last_became_peered":"2024-09-12T17:29:52.762473+0000","last_unstale":"2024-09-12T19:23:01.985420+0000","last_undegraded":"2024-09-12T19:23:01.985420+0000","last_fullsized":"2024-09-12T19:23:01.985420+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:30.353609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25719,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":480,"num_read_kb":16012,"num_write":1030,"num_write_kb":47372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'480","reported_seq":2013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.021704+0000","last_change":"2024-09-12T17:29:54.746687+0000","last_active":"2024-09-12T19:22:45.021704+0000","last_peered":"2024-09-12T19:22:45.021704+0000","last_clean":"2024-09-12T19:22:45.021704+0000","last_became_active":"2024-09-12T17:29:54.745833+0000","last_became_peered":"2024-09-12T17:29:54.745833+0000","last_unstale":"2024-09-12T19:22:45.021704+0000","last_undegraded":"2024-09-12T19:22:45.021704+0000","last_fullsized":"2024-09-12T19:22:45.021704+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:20.546304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2543,"num_read_kb":2369,"num_write":601,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'339","reported_seq":1117,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.965229+0000","last_change":"2024-09-12T17:29:52.730557+0000","last_active":"2024-09-12T19:23:01.965229+0000","last_peered":"2024-09-12T19:23:01.965229+0000","last_clean":"2024-09-12T19:23:01.965229+0000","last_became_active":"2024-09-12T17:29:52.730010+0000","last_became_peered":"2024-09-12T17:29:52.730010+0000","last_unstale":"2024-09-12T19:23:01.965229+0000","last_undegraded":"2024-09-12T19:23:01.965229+0000","last_fullsized":"2024-09-12T19:23:01.965229+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:31.862041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580168,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":14958,"num_write":1088,"num_write_kb":34324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'422","reported_seq":2021,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.137760+0000","last_change":"2024-09-12T17:29:54.756031+0000","last_active":"2024-09-12T19:21:19.137760+0000","last_peered":"2024-09-12T19:21:19.137760+0000","last_clean":"2024-09-12T19:21:19.137760+0000","last_became_active":"2024-09-12T17:29:54.755721+0000","last_became_peered":"2024-09-12T17:29:54.755721+0000","last_unstale":"2024-09-12T19:21:19.137760+0000","last_undegraded":"2024-09-12T19:21:19.137760+0000","last_fullsized":"2024-09-12T19:21:19.137760+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:26.559449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2342,"num_read_kb":2221,"num_write":470,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'360","reported_seq":1930,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.146565+0000","last_change":"2024-09-12T17:29:54.756918+0000","last_active":"2024-09-12T19:21:19.146565+0000","last_peered":"2024-09-12T19:21:19.146565+0000","last_clean":"2024-09-12T19:21:19.146565+0000","last_became_active":"2024-09-12T17:29:54.753012+0000","last_became_peered":"2024-09-12T17:29:54.753012+0000","last_unstale":"2024-09-12T19:21:19.146565+0000","last_undegraded":"2024-09-12T19:21:19.146565+0000","last_fullsized":"2024-09-12T19:21:19.146565+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:44.419129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2149,"num_read_kb":2071,"num_write":395,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'362","reported_seq":1046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.876903+0000","last_change":"2024-09-12T17:29:52.751176+0000","last_active":"2024-09-12T19:23:01.876903+0000","last_peered":"2024-09-12T19:23:01.876903+0000","last_clean":"2024-09-12T19:23:01.876903+0000","last_became_active":"2024-09-12T17:29:52.747589+0000","last_became_peered":"2024-09-12T17:29:52.747589+0000","last_unstale":"2024-09-12T19:23:01.876903+0000","last_undegraded":"2024-09-12T19:23:01.876903+0000","last_fullsized":"2024-09-12T19:23:01.876903+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:03.234800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":507,"num_read_kb":50487,"num_write":1096,"num_write_kb":29653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'423","reported_seq":1988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.900038+0000","last_change":"2024-09-12T17:29:54.754021+0000","last_active":"2024-09-12T19:21:55.900038+0000","last_peered":"2024-09-12T19:21:55.900038+0000","last_clean":"2024-09-12T19:21:55.900038+0000","last_became_active":"2024-09-12T17:29:54.752373+0000","last_became_peered":"2024-09-12T17:29:54.752373+0000","last_unstale":"2024-09-12T19:21:55.900038+0000","last_undegraded":"2024-09-12T19:21:55.900038+0000","last_fullsized":"2024-09-12T19:21:55.900038+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:55.036481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2327,"num_read_kb":2222,"num_write":465,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'338","reported_seq":1108,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.940906+0000","last_change":"2024-09-12T17:30:22.256707+0000","last_active":"2024-09-12T19:23:01.940906+0000","last_peered":"2024-09-12T19:23:01.940906+0000","last_clean":"2024-09-12T19:23:01.940906+0000","last_became_active":"2024-09-12T17:30:22.255773+0000","last_became_peered":"2024-09-12T17:30:22.255773+0000","last_unstale":"2024-09-12T19:23:01.940906+0000","last_undegraded":"2024-09-12T19:23:01.940906+0000","last_fullsized":"2024-09-12T19:23:01.940906+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:44:57.570475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364459,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":843,"num_read_kb":51980,"num_write":1145,"num_write_kb":60983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2,1],"acting":[3,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.32","version":"267'526","reported_seq":2179,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.901319+0000","last_change":"2024-09-12T17:29:54.773260+0000","last_active":"2024-09-12T19:21:55.901319+0000","last_peered":"2024-09-12T19:21:55.901319+0000","last_clean":"2024-09-12T19:21:55.901319+0000","last_became_active":"2024-09-12T17:29:54.771786+0000","last_became_peered":"2024-09-12T17:29:54.771786+0000","last_unstale":"2024-09-12T19:21:55.901319+0000","last_undegraded":"2024-09-12T19:21:55.901319+0000","last_fullsized":"2024-09-12T19:21:55.901319+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:21.472732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2657,"num_read_kb":2482,"num_write":638,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'438","reported_seq":1243,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.931289+0000","last_change":"2024-09-12T17:29:52.732747+0000","last_active":"2024-09-12T19:23:01.931289+0000","last_peered":"2024-09-12T19:23:01.931289+0000","last_clean":"2024-09-12T19:23:01.931289+0000","last_became_active":"2024-09-12T17:29:52.725473+0000","last_became_peered":"2024-09-12T17:29:52.725473+0000","last_unstale":"2024-09-12T19:23:01.931289+0000","last_undegraded":"2024-09-12T19:23:01.931289+0000","last_fullsized":"2024-09-12T19:23:01.931289+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:09.986286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3634873,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":934,"num_read_kb":41903,"num_write":1412,"num_write_kb":44280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'655","reported_seq":2279,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.719735+0000","last_change":"2024-09-12T17:29:54.754617+0000","last_active":"2024-09-12T19:20:03.719735+0000","last_peered":"2024-09-12T19:20:03.719735+0000","last_clean":"2024-09-12T19:20:03.719735+0000","last_became_active":"2024-09-12T17:29:54.754119+0000","last_became_peered":"2024-09-12T17:29:54.754119+0000","last_unstale":"2024-09-12T19:20:03.719735+0000","last_undegraded":"2024-09-12T19:20:03.719735+0000","last_fullsized":"2024-09-12T19:20:03.719735+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":600,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:21.492662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3376,"num_read_kb":3085,"num_write":861,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'319","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.973912+0000","last_change":"2024-09-12T17:29:52.764999+0000","last_active":"2024-09-12T19:23:01.973912+0000","last_peered":"2024-09-12T19:23:01.973912+0000","last_clean":"2024-09-12T19:23:01.973912+0000","last_became_active":"2024-09-12T17:29:52.764052+0000","last_became_peered":"2024-09-12T17:29:52.764052+0000","last_unstale":"2024-09-12T19:23:01.973912+0000","last_undegraded":"2024-09-12T19:23:01.973912+0000","last_fullsized":"2024-09-12T19:23:01.973912+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:13.155680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":477,"num_read_kb":61037,"num_write":999,"num_write_kb":13603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'891","reported_seq":2453,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.721020+0000","last_change":"2024-09-12T17:29:54.761081+0000","last_active":"2024-09-12T19:20:03.721020+0000","last_peered":"2024-09-12T19:20:03.721020+0000","last_clean":"2024-09-12T19:20:03.721020+0000","last_became_active":"2024-09-12T17:29:54.760746+0000","last_became_peered":"2024-09-12T17:29:54.760746+0000","last_unstale":"2024-09-12T19:20:03.721020+0000","last_undegraded":"2024-09-12T19:20:03.721020+0000","last_fullsized":"2024-09-12T19:20:03.721020+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:53.411177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4106,"num_read_kb":3659,"num_write":1202,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'393","reported_seq":1082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.930926+0000","last_change":"2024-09-12T17:29:52.721435+0000","last_active":"2024-09-12T19:23:01.930926+0000","last_peered":"2024-09-12T19:23:01.930926+0000","last_clean":"2024-09-12T19:23:01.930926+0000","last_became_active":"2024-09-12T17:29:52.720974+0000","last_became_peered":"2024-09-12T17:29:52.720974+0000","last_unstale":"2024-09-12T19:23:01.930926+0000","last_undegraded":"2024-09-12T19:23:01.930926+0000","last_fullsized":"2024-09-12T19:23:01.930926+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:05.898096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730141,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":597,"num_read_kb":19633,"num_write":1232,"num_write_kb":34097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'744","reported_seq":2333,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.010273+0000","last_change":"2024-09-12T17:29:54.757481+0000","last_active":"2024-09-12T19:22:45.010273+0000","last_peered":"2024-09-12T19:22:45.010273+0000","last_clean":"2024-09-12T19:22:45.010273+0000","last_became_active":"2024-09-12T17:29:54.756675+0000","last_became_peered":"2024-09-12T17:29:54.756675+0000","last_unstale":"2024-09-12T19:22:45.010273+0000","last_undegraded":"2024-09-12T19:22:45.010273+0000","last_fullsized":"2024-09-12T19:22:45.010273+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:30.640890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3670,"num_read_kb":3349,"num_write":979,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'350","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.946835+0000","last_change":"2024-09-12T17:29:52.767402+0000","last_active":"2024-09-12T19:23:01.946835+0000","last_peered":"2024-09-12T19:23:01.946835+0000","last_clean":"2024-09-12T19:23:01.946835+0000","last_became_active":"2024-09-12T17:29:52.766959+0000","last_became_peered":"2024-09-12T17:29:52.766959+0000","last_unstale":"2024-09-12T19:23:01.946835+0000","last_undegraded":"2024-09-12T19:23:01.946835+0000","last_fullsized":"2024-09-12T19:23:01.946835+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:19.932278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":468,"num_read_kb":494,"num_write":1113,"num_write_kb":20716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'130","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.666477+0000","last_change":"2024-09-12T17:30:02.803588+0000","last_active":"2024-09-12T19:21:21.666477+0000","last_peered":"2024-09-12T19:21:21.666477+0000","last_clean":"2024-09-12T19:21:21.666477+0000","last_became_active":"2024-09-12T17:30:02.802659+0000","last_became_peered":"2024-09-12T17:30:02.802659+0000","last_unstale":"2024-09-12T19:21:21.666477+0000","last_undegraded":"2024-09-12T19:21:21.666477+0000","last_fullsized":"2024-09-12T19:21:21.666477+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:05.775037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":169,"num_write":297,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'432","reported_seq":2018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:14.631110+0000","last_change":"2024-09-12T17:29:54.758798+0000","last_active":"2024-09-12T19:20:14.631110+0000","last_peered":"2024-09-12T19:20:14.631110+0000","last_clean":"2024-09-12T19:20:14.631110+0000","last_became_active":"2024-09-12T17:29:54.758303+0000","last_became_peered":"2024-09-12T17:29:54.758303+0000","last_unstale":"2024-09-12T19:20:14.631110+0000","last_undegraded":"2024-09-12T19:20:14.631110+0000","last_fullsized":"2024-09-12T19:20:14.631110+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:43.384034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2323,"num_read_kb":2196,"num_write":494,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'401","reported_seq":1112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.757287+0000","last_change":"2024-09-12T17:29:52.755910+0000","last_active":"2024-09-12T19:23:01.757287+0000","last_peered":"2024-09-12T19:23:01.757287+0000","last_clean":"2024-09-12T19:23:01.757287+0000","last_became_active":"2024-09-12T17:29:52.755103+0000","last_became_peered":"2024-09-12T17:29:52.755103+0000","last_unstale":"2024-09-12T19:23:01.757287+0000","last_undegraded":"2024-09-12T19:23:01.757287+0000","last_fullsized":"2024-09-12T19:23:01.757287+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:39.921239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524450,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":671,"num_read_kb":34526,"num_write":1327,"num_write_kb":26646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:42.965930+0000","last_change":"2024-09-12T17:29:56.764275+0000","last_active":"2024-09-12T19:18:42.965930+0000","last_peered":"2024-09-12T19:18:42.965930+0000","last_clean":"2024-09-12T19:18:42.965930+0000","last_became_active":"2024-09-12T17:29:56.763547+0000","last_became_peered":"2024-09-12T17:29:56.763547+0000","last_unstale":"2024-09-12T19:18:42.965930+0000","last_undegraded":"2024-09-12T19:18:42.965930+0000","last_fullsized":"2024-09-12T19:18:42.965930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:50.827569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'387","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.933998+0000","last_change":"2024-09-12T17:29:58.780660+0000","last_active":"2024-09-12T19:23:01.933998+0000","last_peered":"2024-09-12T19:23:01.933998+0000","last_clean":"2024-09-12T19:23:01.933998+0000","last_became_active":"2024-09-12T17:29:58.777554+0000","last_became_peered":"2024-09-12T17:29:58.777554+0000","last_unstale":"2024-09-12T19:23:01.933998+0000","last_undegraded":"2024-09-12T19:23:01.933998+0000","last_fullsized":"2024-09-12T19:23:01.933998+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:45.028521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45863,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":1229,"num_write":480,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:47.950949+0000","last_change":"2024-09-12T17:30:00.806462+0000","last_active":"2024-09-12T19:18:47.950949+0000","last_peered":"2024-09-12T19:18:47.950949+0000","last_clean":"2024-09-12T19:18:47.950949+0000","last_became_active":"2024-09-12T17:30:00.805568+0000","last_became_peered":"2024-09-12T17:30:00.805568+0000","last_unstale":"2024-09-12T19:18:47.950949+0000","last_undegraded":"2024-09-12T19:18:47.950949+0000","last_fullsized":"2024-09-12T19:18:47.950949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:19.223415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'145","reported_seq":724,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.098828+0000","last_change":"2024-09-12T17:30:02.786275+0000","last_active":"2024-09-12T19:20:28.098828+0000","last_peered":"2024-09-12T19:20:28.098828+0000","last_clean":"2024-09-12T19:20:28.098828+0000","last_became_active":"2024-09-12T17:30:02.785212+0000","last_became_peered":"2024-09-12T17:30:02.785212+0000","last_unstale":"2024-09-12T19:20:28.098828+0000","last_undegraded":"2024-09-12T19:20:28.098828+0000","last_fullsized":"2024-09-12T19:20:28.098828+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:15.216332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":252,"num_read_kb":243,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'682","reported_seq":2548,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.376127+0000","last_change":"2024-09-12T17:29:54.763192+0000","last_active":"2024-09-12T19:21:21.376127+0000","last_peered":"2024-09-12T19:21:21.376127+0000","last_clean":"2024-09-12T19:21:21.376127+0000","last_became_active":"2024-09-12T17:29:54.761497+0000","last_became_peered":"2024-09-12T17:29:54.761497+0000","last_unstale":"2024-09-12T19:21:21.376127+0000","last_undegraded":"2024-09-12T19:21:21.376127+0000","last_fullsized":"2024-09-12T19:21:21.376127+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":600,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:10.152526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3854,"num_read_kb":3534,"num_write":981,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'373","reported_seq":1046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.969152+0000","last_change":"2024-09-12T17:29:52.714312+0000","last_active":"2024-09-12T19:23:01.969152+0000","last_peered":"2024-09-12T19:23:01.969152+0000","last_clean":"2024-09-12T19:23:01.969152+0000","last_became_active":"2024-09-12T17:29:52.713938+0000","last_became_peered":"2024-09-12T17:29:52.713938+0000","last_unstale":"2024-09-12T19:23:01.969152+0000","last_undegraded":"2024-09-12T19:23:01.969152+0000","last_fullsized":"2024-09-12T19:23:01.969152+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:41.597689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460272,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":10309,"num_write":1260,"num_write_kb":32712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.256354+0000","last_change":"2024-09-12T17:29:56.776910+0000","last_active":"2024-09-12T19:20:03.256354+0000","last_peered":"2024-09-12T19:20:03.256354+0000","last_clean":"2024-09-12T19:20:03.256354+0000","last_became_active":"2024-09-12T17:29:56.776335+0000","last_became_peered":"2024-09-12T17:29:56.776335+0000","last_unstale":"2024-09-12T19:20:03.256354+0000","last_undegraded":"2024-09-12T19:20:03.256354+0000","last_fullsized":"2024-09-12T19:20:03.256354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:54.362260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'120","reported_seq":694,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:50.316180+0000","last_change":"2024-09-12T17:29:58.778467+0000","last_active":"2024-09-12T19:20:50.316180+0000","last_peered":"2024-09-12T19:20:50.316180+0000","last_clean":"2024-09-12T19:20:50.316180+0000","last_became_active":"2024-09-12T17:29:58.777883+0000","last_became_peered":"2024-09-12T17:29:58.777883+0000","last_unstale":"2024-09-12T19:20:50.316180+0000","last_undegraded":"2024-09-12T19:20:50.316180+0000","last_fullsized":"2024-09-12T19:20:50.316180+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:33.007083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:48.179069+0000","last_change":"2024-09-12T17:30:00.782290+0000","last_active":"2024-09-12T19:18:48.179069+0000","last_peered":"2024-09-12T19:18:48.179069+0000","last_clean":"2024-09-12T19:18:48.179069+0000","last_became_active":"2024-09-12T17:30:00.781554+0000","last_became_peered":"2024-09-12T17:30:00.781554+0000","last_unstale":"2024-09-12T19:18:48.179069+0000","last_undegraded":"2024-09-12T19:18:48.179069+0000","last_fullsized":"2024-09-12T19:18:48.179069+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:16.914242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'118","reported_seq":660,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.731504+0000","last_change":"2024-09-12T17:30:02.806243+0000","last_active":"2024-09-12T19:21:21.731504+0000","last_peered":"2024-09-12T19:21:21.731504+0000","last_clean":"2024-09-12T19:21:21.731504+0000","last_became_active":"2024-09-12T17:30:02.805556+0000","last_became_peered":"2024-09-12T17:30:02.805556+0000","last_unstale":"2024-09-12T19:21:21.731504+0000","last_undegraded":"2024-09-12T19:21:21.731504+0000","last_fullsized":"2024-09-12T19:21:21.731504+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:10.526393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":177,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'907","reported_seq":2534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:35.932561+0000","last_change":"2024-09-12T17:29:54.752472+0000","last_active":"2024-09-12T19:19:35.932561+0000","last_peered":"2024-09-12T19:19:35.932561+0000","last_clean":"2024-09-12T19:19:35.932561+0000","last_became_active":"2024-09-12T17:29:54.751997+0000","last_became_peered":"2024-09-12T17:29:54.751997+0000","last_unstale":"2024-09-12T19:19:35.932561+0000","last_undegraded":"2024-09-12T19:19:35.932561+0000","last_fullsized":"2024-09-12T19:19:35.932561+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":800,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:22.947507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4250,"num_read_kb":3802,"num_write":1203,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'368","reported_seq":1085,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.941483+0000","last_change":"2024-09-12T17:29:52.762803+0000","last_active":"2024-09-12T19:23:01.941483+0000","last_peered":"2024-09-12T19:23:01.941483+0000","last_clean":"2024-09-12T19:23:01.941483+0000","last_became_active":"2024-09-12T17:29:52.762149+0000","last_became_peered":"2024-09-12T17:29:52.762149+0000","last_unstale":"2024-09-12T19:23:01.941483+0000","last_undegraded":"2024-09-12T19:23:01.941483+0000","last_fullsized":"2024-09-12T19:23:01.941483+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:00.553936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":626,"num_read_kb":63082,"num_write":1322,"num_write_kb":27819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.236790+0000","last_change":"2024-09-12T17:29:56.762319+0000","last_active":"2024-09-12T19:18:43.236790+0000","last_peered":"2024-09-12T19:18:43.236790+0000","last_clean":"2024-09-12T19:18:43.236790+0000","last_became_active":"2024-09-12T17:29:56.761027+0000","last_became_peered":"2024-09-12T17:29:56.761027+0000","last_unstale":"2024-09-12T19:18:43.236790+0000","last_undegraded":"2024-09-12T19:18:43.236790+0000","last_fullsized":"2024-09-12T19:18:43.236790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:25.029553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'172","reported_seq":775,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:51.961304+0000","last_change":"2024-09-12T17:29:58.770614+0000","last_active":"2024-09-12T19:20:51.961304+0000","last_peered":"2024-09-12T19:20:51.961304+0000","last_clean":"2024-09-12T19:20:51.961304+0000","last_became_active":"2024-09-12T17:29:58.769889+0000","last_became_peered":"2024-09-12T17:29:58.769889+0000","last_unstale":"2024-09-12T19:20:51.961304+0000","last_undegraded":"2024-09-12T19:20:51.961304+0000","last_fullsized":"2024-09-12T19:20:51.961304+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:01.639009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'756","reported_seq":3324,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.884918+0000","last_change":"2024-09-12T17:30:00.810692+0000","last_active":"2024-09-12T19:22:58.884918+0000","last_peered":"2024-09-12T19:22:58.884918+0000","last_clean":"2024-09-12T19:22:58.884918+0000","last_became_active":"2024-09-12T17:30:00.810030+0000","last_became_peered":"2024-09-12T17:30:00.810030+0000","last_unstale":"2024-09-12T19:22:58.884918+0000","last_undegraded":"2024-09-12T19:22:58.884918+0000","last_fullsized":"2024-09-12T19:22:58.884918+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:18.541833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'206","reported_seq":1064,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.854762+0000","last_change":"2024-09-12T17:30:02.807819+0000","last_active":"2024-09-12T19:21:21.854762+0000","last_peered":"2024-09-12T19:21:21.854762+0000","last_clean":"2024-09-12T19:21:21.854762+0000","last_became_active":"2024-09-12T17:30:02.803144+0000","last_became_peered":"2024-09-12T17:30:02.803144+0000","last_unstale":"2024-09-12T19:21:21.854762+0000","last_undegraded":"2024-09-12T19:21:21.854762+0000","last_fullsized":"2024-09-12T19:21:21.854762+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:22.571499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":674,"num_read_kb":661,"num_write":463,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'413","reported_seq":2070,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.356713+0000","last_change":"2024-09-12T17:29:54.762812+0000","last_active":"2024-09-12T19:21:21.356713+0000","last_peered":"2024-09-12T19:21:21.356713+0000","last_clean":"2024-09-12T19:21:21.356713+0000","last_became_active":"2024-09-12T17:29:54.762448+0000","last_became_peered":"2024-09-12T17:29:54.762448+0000","last_unstale":"2024-09-12T19:21:21.356713+0000","last_undegraded":"2024-09-12T19:21:21.356713+0000","last_fullsized":"2024-09-12T19:21:21.356713+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:00.556614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2329,"num_read_kb":2238,"num_write":469,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'341","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.963719+0000","last_change":"2024-09-12T17:29:52.740127+0000","last_active":"2024-09-12T19:23:01.963719+0000","last_peered":"2024-09-12T19:23:01.963719+0000","last_clean":"2024-09-12T19:23:01.963719+0000","last_became_active":"2024-09-12T17:29:52.738957+0000","last_became_peered":"2024-09-12T17:29:52.738957+0000","last_unstale":"2024-09-12T19:23:01.963719+0000","last_undegraded":"2024-09-12T19:23:01.963719+0000","last_fullsized":"2024-09-12T19:23:01.963719+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:50.808537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":517,"num_read_kb":16175,"num_write":1150,"num_write_kb":26946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:42.966023+0000","last_change":"2024-09-12T17:29:56.757650+0000","last_active":"2024-09-12T19:18:42.966023+0000","last_peered":"2024-09-12T19:18:42.966023+0000","last_clean":"2024-09-12T19:18:42.966023+0000","last_became_active":"2024-09-12T17:29:56.755730+0000","last_became_peered":"2024-09-12T17:29:56.755730+0000","last_unstale":"2024-09-12T19:18:42.966023+0000","last_undegraded":"2024-09-12T19:18:42.966023+0000","last_fullsized":"2024-09-12T19:18:42.966023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:23.463400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'322","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.554435+0000","last_change":"2024-09-12T17:29:58.829682+0000","last_active":"2024-09-12T19:23:01.554435+0000","last_peered":"2024-09-12T19:23:01.554435+0000","last_clean":"2024-09-12T19:23:01.554435+0000","last_became_active":"2024-09-12T17:29:58.829021+0000","last_became_peered":"2024-09-12T17:29:58.829021+0000","last_unstale":"2024-09-12T19:23:01.554435+0000","last_undegraded":"2024-09-12T19:23:01.554435+0000","last_fullsized":"2024-09-12T19:23:01.554435+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:56.407873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49018,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":1196,"num_write":438,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'813","reported_seq":3023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.895306+0000","last_change":"2024-09-12T17:30:00.794188+0000","last_active":"2024-09-12T19:22:58.895306+0000","last_peered":"2024-09-12T19:22:58.895306+0000","last_clean":"2024-09-12T19:22:58.895306+0000","last_became_active":"2024-09-12T17:30:00.793067+0000","last_became_peered":"2024-09-12T17:30:00.793067+0000","last_unstale":"2024-09-12T19:22:58.895306+0000","last_undegraded":"2024-09-12T19:22:58.895306+0000","last_fullsized":"2024-09-12T19:22:58.895306+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:26.995446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'523","reported_seq":2063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.442210+0000","last_change":"2024-09-12T17:29:54.766898+0000","last_active":"2024-09-12T19:21:21.442210+0000","last_peered":"2024-09-12T19:21:21.442210+0000","last_clean":"2024-09-12T19:21:21.442210+0000","last_became_active":"2024-09-12T17:29:54.766092+0000","last_became_peered":"2024-09-12T17:29:54.766092+0000","last_unstale":"2024-09-12T19:21:21.442210+0000","last_undegraded":"2024-09-12T19:21:21.442210+0000","last_fullsized":"2024-09-12T19:21:21.442210+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":500,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:01.060409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2636,"num_read_kb":2418,"num_write":649,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'353","reported_seq":1039,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.895862+0000","last_change":"2024-09-12T17:29:52.762735+0000","last_active":"2024-09-12T19:23:01.895862+0000","last_peered":"2024-09-12T19:23:01.895862+0000","last_clean":"2024-09-12T19:23:01.895862+0000","last_became_active":"2024-09-12T17:29:52.757326+0000","last_became_peered":"2024-09-12T17:29:52.757326+0000","last_unstale":"2024-09-12T19:23:01.895862+0000","last_undegraded":"2024-09-12T19:23:01.895862+0000","last_fullsized":"2024-09-12T19:23:01.895862+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:34.150960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730145,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":565,"num_read_kb":12520,"num_write":1100,"num_write_kb":32977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.974785+0000","last_change":"2024-09-12T17:29:56.769344+0000","last_active":"2024-09-12T19:20:27.974785+0000","last_peered":"2024-09-12T19:20:27.974785+0000","last_clean":"2024-09-12T19:20:27.974785+0000","last_became_active":"2024-09-12T17:29:56.768267+0000","last_became_peered":"2024-09-12T17:29:56.768267+0000","last_unstale":"2024-09-12T19:20:27.974785+0000","last_undegraded":"2024-09-12T19:20:27.974785+0000","last_fullsized":"2024-09-12T19:20:27.974785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:14.841905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'452","reported_seq":1143,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.315539+0000","last_change":"2024-09-12T17:29:58.834050+0000","last_active":"2024-09-12T19:22:59.315539+0000","last_peered":"2024-09-12T19:22:59.315539+0000","last_clean":"2024-09-12T19:22:59.315539+0000","last_became_active":"2024-09-12T17:29:58.833291+0000","last_became_peered":"2024-09-12T17:29:58.833291+0000","last_unstale":"2024-09-12T19:22:59.315539+0000","last_undegraded":"2024-09-12T19:22:59.315539+0000","last_fullsized":"2024-09-12T19:22:59.315539+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:23.364120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60505,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":721,"num_read_kb":1312,"num_write":540,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:17.982998+0000","last_change":"2024-09-12T17:30:00.810543+0000","last_active":"2024-09-12T19:20:17.982998+0000","last_peered":"2024-09-12T19:20:17.982998+0000","last_clean":"2024-09-12T19:20:17.982998+0000","last_became_active":"2024-09-12T17:30:00.809914+0000","last_became_peered":"2024-09-12T17:30:00.809914+0000","last_unstale":"2024-09-12T19:20:17.982998+0000","last_undegraded":"2024-09-12T19:20:17.982998+0000","last_fullsized":"2024-09-12T19:20:17.982998+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:44.935436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'548","reported_seq":1404,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.253948+0000","last_change":"2024-09-12T17:30:02.797843+0000","last_active":"2024-09-12T19:22:46.253948+0000","last_peered":"2024-09-12T19:22:46.253948+0000","last_clean":"2024-09-12T19:22:46.253948+0000","last_became_active":"2024-09-12T17:30:02.797046+0000","last_became_peered":"2024-09-12T17:30:02.797046+0000","last_unstale":"2024-09-12T19:22:46.253948+0000","last_undegraded":"2024-09-12T19:22:46.253948+0000","last_fullsized":"2024-09-12T19:22:46.253948+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:58.930778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1413,"num_read_kb":1390,"num_write":1179,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'480","reported_seq":2156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.202292+0000","last_change":"2024-09-12T17:29:54.756840+0000","last_active":"2024-09-12T19:20:28.202292+0000","last_peered":"2024-09-12T19:20:28.202292+0000","last_clean":"2024-09-12T19:20:28.202292+0000","last_became_active":"2024-09-12T17:29:54.754517+0000","last_became_peered":"2024-09-12T17:29:54.754517+0000","last_unstale":"2024-09-12T19:20:28.202292+0000","last_undegraded":"2024-09-12T19:20:28.202292+0000","last_fullsized":"2024-09-12T19:20:28.202292+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:21.909735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2565,"num_read_kb":2417,"num_write":558,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'317","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.891150+0000","last_change":"2024-09-12T17:29:52.761247+0000","last_active":"2024-09-12T19:23:01.891150+0000","last_peered":"2024-09-12T19:23:01.891150+0000","last_clean":"2024-09-12T19:23:01.891150+0000","last_became_active":"2024-09-12T17:29:52.760711+0000","last_became_peered":"2024-09-12T17:29:52.760711+0000","last_unstale":"2024-09-12T19:23:01.891150+0000","last_undegraded":"2024-09-12T19:23:01.891150+0000","last_fullsized":"2024-09-12T19:23:01.891150+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:21.789117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759519,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":447,"num_read_kb":40999,"num_write":1044,"num_write_kb":42394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.538942+0000","last_change":"2024-09-12T17:29:56.758473+0000","last_active":"2024-09-12T19:20:28.538942+0000","last_peered":"2024-09-12T19:20:28.538942+0000","last_clean":"2024-09-12T19:20:28.538942+0000","last_became_active":"2024-09-12T17:29:56.757805+0000","last_became_peered":"2024-09-12T17:29:56.757805+0000","last_unstale":"2024-09-12T19:20:28.538942+0000","last_undegraded":"2024-09-12T19:20:28.538942+0000","last_fullsized":"2024-09-12T19:20:28.538942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:32.794119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'304","reported_seq":927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.753487+0000","last_change":"2024-09-12T17:29:58.774261+0000","last_active":"2024-09-12T19:23:00.753487+0000","last_peered":"2024-09-12T19:23:00.753487+0000","last_clean":"2024-09-12T19:23:00.753487+0000","last_became_active":"2024-09-12T17:29:58.773959+0000","last_became_peered":"2024-09-12T17:29:58.773959+0000","last_unstale":"2024-09-12T19:23:00.753487+0000","last_undegraded":"2024-09-12T19:23:00.753487+0000","last_fullsized":"2024-09-12T19:23:00.753487+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:53.591898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47390,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":1092,"num_write":400,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:58.270859+0000","last_change":"2024-09-12T17:30:00.792690+0000","last_active":"2024-09-12T19:20:58.270859+0000","last_peered":"2024-09-12T19:20:58.270859+0000","last_clean":"2024-09-12T19:20:58.270859+0000","last_became_active":"2024-09-12T17:30:00.792138+0000","last_became_peered":"2024-09-12T17:30:00.792138+0000","last_unstale":"2024-09-12T19:20:58.270859+0000","last_undegraded":"2024-09-12T19:20:58.270859+0000","last_fullsized":"2024-09-12T19:20:58.270859+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2476","reported_seq":4391,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.257061+0000","last_change":"2024-09-12T17:30:02.801585+0000","last_active":"2024-09-12T19:22:46.257061+0000","last_peered":"2024-09-12T19:22:46.257061+0000","last_clean":"2024-09-12T19:22:46.257061+0000","last_became_active":"2024-09-12T17:30:02.800860+0000","last_became_peered":"2024-09-12T17:30:02.800860+0000","last_unstale":"2024-09-12T19:22:46.257061+0000","last_undegraded":"2024-09-12T19:22:46.257061+0000","last_fullsized":"2024-09-12T19:22:46.257061+0000","mapping_epoch":36,"log_start":"267'2400","ondisk_log_start":"267'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":2400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:23.192552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6373,"num_read_kb":6312,"num_write":5027,"num_write_kb":1835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'430","reported_seq":2068,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.148759+0000","last_change":"2024-09-12T17:29:54.770302+0000","last_active":"2024-09-12T19:21:19.148759+0000","last_peered":"2024-09-12T19:21:19.148759+0000","last_clean":"2024-09-12T19:21:19.148759+0000","last_became_active":"2024-09-12T17:29:54.769541+0000","last_became_peered":"2024-09-12T17:29:54.769541+0000","last_unstale":"2024-09-12T19:21:19.148759+0000","last_undegraded":"2024-09-12T19:21:19.148759+0000","last_fullsized":"2024-09-12T19:21:19.148759+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:46.646360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2445,"num_read_kb":2340,"num_write":496,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'333","reported_seq":1008,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.745129+0000","last_change":"2024-09-12T17:30:21.794660+0000","last_active":"2024-09-12T19:23:01.745129+0000","last_peered":"2024-09-12T19:23:01.745129+0000","last_clean":"2024-09-12T19:23:01.745129+0000","last_became_active":"2024-09-12T17:30:21.793950+0000","last_became_peered":"2024-09-12T17:30:21.793950+0000","last_unstale":"2024-09-12T19:23:01.745129+0000","last_undegraded":"2024-09-12T19:23:01.745129+0000","last_fullsized":"2024-09-12T19:23:01.745129+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:45.690479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12448261,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":65282,"num_write":1071,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,6],"acting":[2,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.535841+0000","last_change":"2024-09-12T17:29:56.770636+0000","last_active":"2024-09-12T19:20:13.535841+0000","last_peered":"2024-09-12T19:20:13.535841+0000","last_clean":"2024-09-12T19:20:13.535841+0000","last_became_active":"2024-09-12T17:29:56.770222+0000","last_became_peered":"2024-09-12T17:29:56.770222+0000","last_unstale":"2024-09-12T19:20:13.535841+0000","last_undegraded":"2024-09-12T19:20:13.535841+0000","last_fullsized":"2024-09-12T19:20:13.535841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:00.086855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'394","reported_seq":1045,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.505552+0000","last_change":"2024-09-12T17:29:58.755448+0000","last_active":"2024-09-12T19:22:59.505552+0000","last_peered":"2024-09-12T19:22:59.505552+0000","last_clean":"2024-09-12T19:22:59.505552+0000","last_became_active":"2024-09-12T17:29:58.754613+0000","last_became_peered":"2024-09-12T17:29:58.754613+0000","last_unstale":"2024-09-12T19:22:59.505552+0000","last_undegraded":"2024-09-12T19:22:59.505552+0000","last_fullsized":"2024-09-12T19:22:59.505552+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:50.294662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50732,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":653,"num_read_kb":1328,"num_write":512,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'796","reported_seq":3207,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.319657+0000","last_change":"2024-09-12T17:30:00.806110+0000","last_active":"2024-09-12T19:23:01.319657+0000","last_peered":"2024-09-12T19:23:01.319657+0000","last_clean":"2024-09-12T19:23:01.319657+0000","last_became_active":"2024-09-12T17:30:00.805428+0000","last_became_peered":"2024-09-12T17:30:00.805428+0000","last_unstale":"2024-09-12T19:23:01.319657+0000","last_undegraded":"2024-09-12T19:23:01.319657+0000","last_fullsized":"2024-09-12T19:23:01.319657+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:28.577730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'112","reported_seq":659,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.641116+0000","last_change":"2024-09-12T17:30:02.817717+0000","last_active":"2024-09-12T19:22:44.641116+0000","last_peered":"2024-09-12T19:22:44.641116+0000","last_clean":"2024-09-12T19:22:44.641116+0000","last_became_active":"2024-09-12T17:30:02.816983+0000","last_became_peered":"2024-09-12T17:30:02.816983+0000","last_unstale":"2024-09-12T19:22:44.641116+0000","last_undegraded":"2024-09-12T19:22:44.641116+0000","last_fullsized":"2024-09-12T19:22:44.641116+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:16.290296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":194,"num_write":254,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'871","reported_seq":2499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.139491+0000","last_change":"2024-09-12T17:29:54.752312+0000","last_active":"2024-09-12T19:21:19.139491+0000","last_peered":"2024-09-12T19:21:19.139491+0000","last_clean":"2024-09-12T19:21:19.139491+0000","last_became_active":"2024-09-12T17:29:54.744926+0000","last_became_peered":"2024-09-12T17:29:54.744926+0000","last_unstale":"2024-09-12T19:21:19.139491+0000","last_undegraded":"2024-09-12T19:21:19.139491+0000","last_fullsized":"2024-09-12T19:21:19.139491+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:28.330625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4186,"num_read_kb":3781,"num_write":1194,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'377","reported_seq":1067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.981260+0000","last_change":"2024-09-12T17:29:52.749559+0000","last_active":"2024-09-12T19:23:01.981260+0000","last_peered":"2024-09-12T19:23:01.981260+0000","last_clean":"2024-09-12T19:23:01.981260+0000","last_became_active":"2024-09-12T17:29:52.748439+0000","last_became_peered":"2024-09-12T17:29:52.748439+0000","last_unstale":"2024-09-12T19:23:01.981260+0000","last_undegraded":"2024-09-12T19:23:01.981260+0000","last_fullsized":"2024-09-12T19:23:01.981260+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:29.874598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992343,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":628,"num_read_kb":40400,"num_write":1240,"num_write_kb":24508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:43.542396+0000","last_change":"2024-09-12T17:29:56.743345+0000","last_active":"2024-09-12T19:20:43.542396+0000","last_peered":"2024-09-12T19:20:43.542396+0000","last_clean":"2024-09-12T19:20:43.542396+0000","last_became_active":"2024-09-12T17:29:56.742361+0000","last_became_peered":"2024-09-12T17:29:56.742361+0000","last_unstale":"2024-09-12T19:20:43.542396+0000","last_undegraded":"2024-09-12T19:20:43.542396+0000","last_fullsized":"2024-09-12T19:20:43.542396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:08.175418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'514","reported_seq":1198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.038329+0000","last_change":"2024-09-12T17:29:58.782097+0000","last_active":"2024-09-12T19:23:01.038329+0000","last_peered":"2024-09-12T19:23:01.038329+0000","last_clean":"2024-09-12T19:23:01.038329+0000","last_became_active":"2024-09-12T17:29:58.777576+0000","last_became_peered":"2024-09-12T17:29:58.777576+0000","last_unstale":"2024-09-12T19:23:01.038329+0000","last_undegraded":"2024-09-12T19:23:01.038329+0000","last_fullsized":"2024-09-12T19:23:01.038329+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:55.160859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94518,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":881,"num_read_kb":2010,"num_write":710,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.540027+0000","last_change":"2024-09-12T17:30:00.780996+0000","last_active":"2024-09-12T19:20:33.540027+0000","last_peered":"2024-09-12T19:20:33.540027+0000","last_clean":"2024-09-12T19:20:33.540027+0000","last_became_active":"2024-09-12T17:30:00.780193+0000","last_became_peered":"2024-09-12T17:30:00.780193+0000","last_unstale":"2024-09-12T19:20:33.540027+0000","last_undegraded":"2024-09-12T19:20:33.540027+0000","last_fullsized":"2024-09-12T19:20:33.540027+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:54.843536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'166","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.101340+0000","last_change":"2024-09-12T17:30:02.810105+0000","last_active":"2024-09-12T19:21:19.101340+0000","last_peered":"2024-09-12T19:21:19.101340+0000","last_clean":"2024-09-12T19:21:19.101340+0000","last_became_active":"2024-09-12T17:30:02.809357+0000","last_became_peered":"2024-09-12T17:30:02.809357+0000","last_unstale":"2024-09-12T19:21:19.101340+0000","last_undegraded":"2024-09-12T19:21:19.101340+0000","last_fullsized":"2024-09-12T19:21:19.101340+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:26.703985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":287,"num_read_kb":265,"num_write":391,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'1305","reported_seq":2983,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.932579+0000","last_change":"2024-09-12T17:29:54.759425+0000","last_active":"2024-09-12T19:20:27.932579+0000","last_peered":"2024-09-12T19:20:27.932579+0000","last_clean":"2024-09-12T19:20:27.932579+0000","last_became_active":"2024-09-12T17:29:54.758550+0000","last_became_peered":"2024-09-12T17:29:54.758550+0000","last_unstale":"2024-09-12T19:20:27.932579+0000","last_undegraded":"2024-09-12T19:20:27.932579+0000","last_fullsized":"2024-09-12T19:20:27.932579+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:30.793762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6018,"num_read_kb":5333,"num_write":1857,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'317","reported_seq":976,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.887489+0000","last_change":"2024-09-12T17:29:52.767951+0000","last_active":"2024-09-12T19:23:01.887489+0000","last_peered":"2024-09-12T19:23:01.887489+0000","last_clean":"2024-09-12T19:23:01.887489+0000","last_became_active":"2024-09-12T17:29:52.765603+0000","last_became_peered":"2024-09-12T17:29:52.765603+0000","last_unstale":"2024-09-12T19:23:01.887489+0000","last_undegraded":"2024-09-12T19:23:01.887489+0000","last_fullsized":"2024-09-12T19:23:01.887489+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:49.870827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911305,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":437,"num_read_kb":36052,"num_write":1059,"num_write_kb":37263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.535963+0000","last_change":"2024-09-12T17:29:56.772981+0000","last_active":"2024-09-12T19:20:13.535963+0000","last_peered":"2024-09-12T19:20:13.535963+0000","last_clean":"2024-09-12T19:20:13.535963+0000","last_became_active":"2024-09-12T17:29:56.772580+0000","last_became_peered":"2024-09-12T17:29:56.772580+0000","last_unstale":"2024-09-12T19:20:13.535963+0000","last_undegraded":"2024-09-12T19:20:13.535963+0000","last_fullsized":"2024-09-12T19:20:13.535963+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:40.668767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'332","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.109246+0000","last_change":"2024-09-12T17:29:58.774656+0000","last_active":"2024-09-12T19:23:01.109246+0000","last_peered":"2024-09-12T19:23:01.109246+0000","last_clean":"2024-09-12T19:23:01.109246+0000","last_became_active":"2024-09-12T17:29:58.773869+0000","last_became_peered":"2024-09-12T17:29:58.773869+0000","last_unstale":"2024-09-12T19:23:01.109246+0000","last_undegraded":"2024-09-12T19:23:01.109246+0000","last_fullsized":"2024-09-12T19:23:01.109246+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:05.201058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47005,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":1116,"num_write":486,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:38.195416+0000","last_change":"2024-09-12T17:30:00.779241+0000","last_active":"2024-09-12T19:20:38.195416+0000","last_peered":"2024-09-12T19:20:38.195416+0000","last_clean":"2024-09-12T19:20:38.195416+0000","last_became_active":"2024-09-12T17:30:00.778642+0000","last_became_peered":"2024-09-12T17:30:00.778642+0000","last_unstale":"2024-09-12T19:20:38.195416+0000","last_undegraded":"2024-09-12T19:20:38.195416+0000","last_fullsized":"2024-09-12T19:20:38.195416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:29.538173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'107","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:28.289420+0000","last_change":"2024-09-12T17:30:02.791858+0000","last_active":"2024-09-12T19:22:28.289420+0000","last_peered":"2024-09-12T19:22:28.289420+0000","last_clean":"2024-09-12T19:22:28.289420+0000","last_became_active":"2024-09-12T17:30:02.788612+0000","last_became_peered":"2024-09-12T17:30:02.788612+0000","last_unstale":"2024-09-12T19:22:28.289420+0000","last_undegraded":"2024-09-12T19:22:28.289420+0000","last_fullsized":"2024-09-12T19:22:28.289420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:58.832322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":252,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'362","reported_seq":1817,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.198695+0000","last_change":"2024-09-12T17:29:54.759245+0000","last_active":"2024-09-12T19:20:13.198695+0000","last_peered":"2024-09-12T19:20:13.198695+0000","last_clean":"2024-09-12T19:20:13.198695+0000","last_became_active":"2024-09-12T17:29:54.758311+0000","last_became_peered":"2024-09-12T17:29:54.758311+0000","last_unstale":"2024-09-12T19:20:13.198695+0000","last_undegraded":"2024-09-12T19:20:13.198695+0000","last_fullsized":"2024-09-12T19:20:13.198695+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:22.106256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1918,"num_read_kb":1833,"num_write":390,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'336","reported_seq":1012,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.928255+0000","last_change":"2024-09-12T17:29:52.725267+0000","last_active":"2024-09-12T19:23:01.928255+0000","last_peered":"2024-09-12T19:23:01.928255+0000","last_clean":"2024-09-12T19:23:01.928255+0000","last_became_active":"2024-09-12T17:29:52.716965+0000","last_became_peered":"2024-09-12T17:29:52.716965+0000","last_unstale":"2024-09-12T19:23:01.928255+0000","last_undegraded":"2024-09-12T19:23:01.928255+0000","last_fullsized":"2024-09-12T19:23:01.928255+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:28.061496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262277,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":1122,"num_write":1102,"num_write_kb":14973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:12.981854+0000","last_change":"2024-09-12T17:29:56.766356+0000","last_active":"2024-09-12T19:20:12.981854+0000","last_peered":"2024-09-12T19:20:12.981854+0000","last_clean":"2024-09-12T19:20:12.981854+0000","last_became_active":"2024-09-12T17:29:56.765057+0000","last_became_peered":"2024-09-12T17:29:56.765057+0000","last_unstale":"2024-09-12T19:20:12.981854+0000","last_undegraded":"2024-09-12T19:20:12.981854+0000","last_fullsized":"2024-09-12T19:20:12.981854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:33.658858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'369","reported_seq":1032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.501652+0000","last_change":"2024-09-12T17:29:58.772847+0000","last_active":"2024-09-12T19:23:00.501652+0000","last_peered":"2024-09-12T19:23:00.501652+0000","last_clean":"2024-09-12T19:23:00.501652+0000","last_became_active":"2024-09-12T17:29:58.771991+0000","last_became_peered":"2024-09-12T17:29:58.771991+0000","last_unstale":"2024-09-12T19:23:00.501652+0000","last_undegraded":"2024-09-12T19:23:00.501652+0000","last_fullsized":"2024-09-12T19:23:00.501652+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:25.707619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43575,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":600,"num_read_kb":1164,"num_write":460,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'753","reported_seq":5256,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.962726+0000","last_change":"2024-09-12T17:30:00.803339+0000","last_active":"2024-09-12T19:23:01.962726+0000","last_peered":"2024-09-12T19:23:01.962726+0000","last_clean":"2024-09-12T19:23:01.962726+0000","last_became_active":"2024-09-12T17:30:00.802950+0000","last_became_peered":"2024-09-12T17:30:00.802950+0000","last_unstale":"2024-09-12T19:23:01.962726+0000","last_undegraded":"2024-09-12T19:23:01.962726+0000","last_fullsized":"2024-09-12T19:23:01.962726+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":701,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:53.399614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'111","reported_seq":637,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:16.233380+0000","last_change":"2024-09-12T17:30:02.807435+0000","last_active":"2024-09-12T19:21:16.233380+0000","last_peered":"2024-09-12T19:21:16.233380+0000","last_clean":"2024-09-12T19:21:16.233380+0000","last_became_active":"2024-09-12T17:30:02.806621+0000","last_became_peered":"2024-09-12T17:30:02.806621+0000","last_unstale":"2024-09-12T19:21:16.233380+0000","last_undegraded":"2024-09-12T19:21:16.233380+0000","last_fullsized":"2024-09-12T19:21:16.233380+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:28.598520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":276,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'775","reported_seq":2449,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.998604+0000","last_change":"2024-09-12T17:29:54.764077+0000","last_active":"2024-09-12T19:22:44.998604+0000","last_peered":"2024-09-12T19:22:44.998604+0000","last_clean":"2024-09-12T19:22:44.998604+0000","last_became_active":"2024-09-12T17:29:54.763348+0000","last_became_peered":"2024-09-12T17:29:54.763348+0000","last_unstale":"2024-09-12T19:22:44.998604+0000","last_undegraded":"2024-09-12T19:22:44.998604+0000","last_fullsized":"2024-09-12T19:22:44.998604+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:36.252557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4009,"num_read_kb":3654,"num_write":1024,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'307","reported_seq":976,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.868076+0000","last_change":"2024-09-12T17:29:52.752133+0000","last_active":"2024-09-12T19:23:01.868076+0000","last_peered":"2024-09-12T19:23:01.868076+0000","last_clean":"2024-09-12T19:23:01.868076+0000","last_became_active":"2024-09-12T17:29:52.744356+0000","last_became_peered":"2024-09-12T17:29:52.744356+0000","last_unstale":"2024-09-12T19:23:01.868076+0000","last_undegraded":"2024-09-12T19:23:01.868076+0000","last_fullsized":"2024-09-12T19:23:01.868076+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:36.220798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":48689,"num_write":1045,"num_write_kb":32373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1474,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.852068+0000","last_change":"2024-09-12T17:29:56.751658+0000","last_active":"2024-09-12T19:22:58.852068+0000","last_peered":"2024-09-12T19:22:58.852068+0000","last_clean":"2024-09-12T19:22:58.852068+0000","last_became_active":"2024-09-12T17:29:56.750915+0000","last_became_peered":"2024-09-12T17:29:56.750915+0000","last_unstale":"2024-09-12T19:22:58.852068+0000","last_undegraded":"2024-09-12T19:22:58.852068+0000","last_fullsized":"2024-09-12T19:22:58.852068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:54.038362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'146","reported_seq":731,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:49.669036+0000","last_change":"2024-09-12T17:29:58.832618+0000","last_active":"2024-09-12T19:20:49.669036+0000","last_peered":"2024-09-12T19:20:49.669036+0000","last_clean":"2024-09-12T19:20:49.669036+0000","last_became_active":"2024-09-12T17:29:58.831628+0000","last_became_peered":"2024-09-12T17:29:58.831628+0000","last_unstale":"2024-09-12T19:20:49.669036+0000","last_undegraded":"2024-09-12T19:20:49.669036+0000","last_fullsized":"2024-09-12T19:20:49.669036+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:43.249799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'773","reported_seq":3246,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.325259+0000","last_change":"2024-09-12T17:30:00.807629+0000","last_active":"2024-09-12T19:23:01.325259+0000","last_peered":"2024-09-12T19:23:01.325259+0000","last_clean":"2024-09-12T19:23:01.325259+0000","last_became_active":"2024-09-12T17:30:00.806681+0000","last_became_peered":"2024-09-12T17:30:00.806681+0000","last_unstale":"2024-09-12T19:23:01.325259+0000","last_undegraded":"2024-09-12T19:23:01.325259+0000","last_fullsized":"2024-09-12T19:23:01.325259+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":701,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:09.571492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'116","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:14.309491+0000","last_change":"2024-09-12T17:30:02.806772+0000","last_active":"2024-09-12T19:21:14.309491+0000","last_peered":"2024-09-12T19:21:14.309491+0000","last_clean":"2024-09-12T19:21:14.309491+0000","last_became_active":"2024-09-12T17:30:02.805954+0000","last_became_peered":"2024-09-12T17:30:02.805954+0000","last_unstale":"2024-09-12T19:21:14.309491+0000","last_undegraded":"2024-09-12T19:21:14.309491+0000","last_fullsized":"2024-09-12T19:21:14.309491+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:48.506411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":135,"num_write":268,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'519","reported_seq":2056,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.988475+0000","last_change":"2024-09-12T17:29:54.755879+0000","last_active":"2024-09-12T19:20:42.988475+0000","last_peered":"2024-09-12T19:20:42.988475+0000","last_clean":"2024-09-12T19:20:42.988475+0000","last_became_active":"2024-09-12T17:29:54.755550+0000","last_became_peered":"2024-09-12T17:29:54.755550+0000","last_unstale":"2024-09-12T19:20:42.988475+0000","last_undegraded":"2024-09-12T19:20:42.988475+0000","last_fullsized":"2024-09-12T19:20:42.988475+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:22.424955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2775,"num_read_kb":2556,"num_write":676,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'376","reported_seq":1072,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.848938+0000","last_change":"2024-09-12T17:30:21.696907+0000","last_active":"2024-09-12T19:23:01.848938+0000","last_peered":"2024-09-12T19:23:01.848938+0000","last_clean":"2024-09-12T19:23:01.848938+0000","last_became_active":"2024-09-12T17:30:21.696077+0000","last_became_peered":"2024-09-12T17:30:21.696077+0000","last_unstale":"2024-09-12T19:23:01.848938+0000","last_undegraded":"2024-09-12T19:23:01.848938+0000","last_fullsized":"2024-09-12T19:23:01.848938+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:10.253722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":12866,"num_write":1197,"num_write_kb":34720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.198755+0000","last_change":"2024-09-12T17:29:56.758620+0000","last_active":"2024-09-12T19:20:13.198755+0000","last_peered":"2024-09-12T19:20:13.198755+0000","last_clean":"2024-09-12T19:20:13.198755+0000","last_became_active":"2024-09-12T17:29:56.757728+0000","last_became_peered":"2024-09-12T17:29:56.757728+0000","last_unstale":"2024-09-12T19:20:13.198755+0000","last_undegraded":"2024-09-12T19:20:13.198755+0000","last_fullsized":"2024-09-12T19:20:13.198755+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:39.838154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'417","reported_seq":1095,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:02.001142+0000","last_change":"2024-09-12T17:29:58.776898+0000","last_active":"2024-09-12T19:23:02.001142+0000","last_peered":"2024-09-12T19:23:02.001142+0000","last_clean":"2024-09-12T19:23:02.001142+0000","last_became_active":"2024-09-12T17:29:58.776033+0000","last_became_peered":"2024-09-12T17:29:58.776033+0000","last_unstale":"2024-09-12T19:23:02.001142+0000","last_undegraded":"2024-09-12T19:23:02.001142+0000","last_fullsized":"2024-09-12T19:23:02.001142+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:29.107658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47722,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":665,"num_read_kb":1193,"num_write":496,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:18.560371+0000","last_change":"2024-09-12T17:30:00.793376+0000","last_active":"2024-09-12T19:20:18.560371+0000","last_peered":"2024-09-12T19:20:18.560371+0000","last_clean":"2024-09-12T19:20:18.560371+0000","last_became_active":"2024-09-12T17:30:00.792687+0000","last_became_peered":"2024-09-12T17:30:00.792687+0000","last_unstale":"2024-09-12T19:20:18.560371+0000","last_undegraded":"2024-09-12T19:20:18.560371+0000","last_fullsized":"2024-09-12T19:20:18.560371+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:53.873367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'165","reported_seq":696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.984898+0000","last_change":"2024-09-12T17:30:02.809944+0000","last_active":"2024-09-12T19:20:27.984898+0000","last_peered":"2024-09-12T19:20:27.984898+0000","last_clean":"2024-09-12T19:20:27.984898+0000","last_became_active":"2024-09-12T17:30:02.809252+0000","last_became_peered":"2024-09-12T17:30:02.809252+0000","last_unstale":"2024-09-12T19:20:27.984898+0000","last_undegraded":"2024-09-12T19:20:27.984898+0000","last_fullsized":"2024-09-12T19:20:27.984898+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:42.655346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":242,"num_read_kb":230,"num_write":407,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'457","reported_seq":1883,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:38.564931+0000","last_change":"2024-09-12T17:29:54.773311+0000","last_active":"2024-09-12T19:20:38.564931+0000","last_peered":"2024-09-12T19:20:38.564931+0000","last_clean":"2024-09-12T19:20:38.564931+0000","last_became_active":"2024-09-12T17:29:54.771538+0000","last_became_peered":"2024-09-12T17:29:54.771538+0000","last_unstale":"2024-09-12T19:20:38.564931+0000","last_undegraded":"2024-09-12T19:20:38.564931+0000","last_fullsized":"2024-09-12T19:20:38.564931+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:11.655778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2249,"num_read_kb":2075,"num_write":554,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:52.966096+0000","last_change":"2024-09-12T17:29:30.603974+0000","last_active":"2024-09-12T19:19:52.966096+0000","last_peered":"2024-09-12T19:19:52.966096+0000","last_clean":"2024-09-12T19:19:52.966096+0000","last_became_active":"2024-09-12T17:29:30.601518+0000","last_became_peered":"2024-09-12T17:29:30.601518+0000","last_unstale":"2024-09-12T19:19:52.966096+0000","last_undegraded":"2024-09-12T19:19:52.966096+0000","last_fullsized":"2024-09-12T19:19:52.966096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:29.241459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:29.241459+0000","last_clean_scrub_stamp":"2024-09-12T17:29:29.241459+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:49:32.039824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":552,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.986642+0000","last_change":"2024-09-12T17:29:37.351871+0000","last_active":"2024-09-12T19:20:02.986642+0000","last_peered":"2024-09-12T19:20:02.986642+0000","last_clean":"2024-09-12T19:20:02.986642+0000","last_became_active":"2024-09-12T17:29:35.340342+0000","last_became_peered":"2024-09-12T17:29:35.340342+0000","last_unstale":"2024-09-12T19:20:02.986642+0000","last_undegraded":"2024-09-12T19:20:02.986642+0000","last_fullsized":"2024-09-12T19:20:02.986642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:04.662413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097602599999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'336","reported_seq":1026,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:08.204936+0000","last_change":"2024-09-12T19:23:08.204936+0000","last_active":"2024-09-12T19:23:08.204936+0000","last_peered":"2024-09-12T19:23:08.204936+0000","last_clean":"2024-09-12T19:23:08.204936+0000","last_became_active":"2024-09-12T17:29:52.765497+0000","last_became_peered":"2024-09-12T17:29:52.765497+0000","last_unstale":"2024-09-12T19:23:08.204936+0000","last_undegraded":"2024-09-12T19:23:08.204936+0000","last_fullsized":"2024-09-12T19:23:08.204936+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-12T19:23:08.204778+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-12T19:23:08.204778+0000","last_clean_scrub_stamp":"2024-09-12T19:23:08.204778+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:46.017915+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2167098,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":533,"num_read_kb":15769,"num_write":1043,"num_write_kb":23964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:22.973720+0000","last_change":"2024-09-12T17:29:56.750663+0000","last_active":"2024-09-12T19:20:22.973720+0000","last_peered":"2024-09-12T19:20:22.973720+0000","last_clean":"2024-09-12T19:20:22.973720+0000","last_became_active":"2024-09-12T17:29:56.749938+0000","last_became_peered":"2024-09-12T17:29:56.749938+0000","last_unstale":"2024-09-12T19:20:22.973720+0000","last_undegraded":"2024-09-12T19:20:22.973720+0000","last_fullsized":"2024-09-12T19:20:22.973720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:42.837901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'798","reported_seq":1542,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.770805+0000","last_change":"2024-09-12T17:29:58.770209+0000","last_active":"2024-09-12T19:23:01.770805+0000","last_peered":"2024-09-12T19:23:01.770805+0000","last_clean":"2024-09-12T19:23:01.770805+0000","last_became_active":"2024-09-12T17:29:58.769277+0000","last_became_peered":"2024-09-12T17:29:58.769277+0000","last_unstale":"2024-09-12T19:23:01.770805+0000","last_undegraded":"2024-09-12T19:23:01.770805+0000","last_fullsized":"2024-09-12T19:23:01.770805+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:07.152072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159898,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1560,"num_read_kb":3538,"num_write":1488,"num_write_kb":1318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.193952+0000","last_change":"2024-09-12T17:30:00.800340+0000","last_active":"2024-09-12T19:20:33.193952+0000","last_peered":"2024-09-12T19:20:33.193952+0000","last_clean":"2024-09-12T19:20:33.193952+0000","last_became_active":"2024-09-12T17:30:00.799883+0000","last_became_peered":"2024-09-12T17:30:00.799883+0000","last_unstale":"2024-09-12T19:20:33.193952+0000","last_undegraded":"2024-09-12T19:20:33.193952+0000","last_fullsized":"2024-09-12T19:20:33.193952+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:44.555994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'197","reported_seq":924,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.519551+0000","last_change":"2024-09-12T17:30:02.800451+0000","last_active":"2024-09-12T19:21:21.519551+0000","last_peered":"2024-09-12T19:21:21.519551+0000","last_clean":"2024-09-12T19:21:21.519551+0000","last_became_active":"2024-09-12T17:30:02.799307+0000","last_became_peered":"2024-09-12T17:30:02.799307+0000","last_unstale":"2024-09-12T19:21:21.519551+0000","last_undegraded":"2024-09-12T19:21:21.519551+0000","last_fullsized":"2024-09-12T19:21:21.519551+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:50.826285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1000,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":467,"num_write":393,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'474","reported_seq":2035,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.192554+0000","last_change":"2024-09-12T17:29:54.758652+0000","last_active":"2024-09-12T19:20:28.192554+0000","last_peered":"2024-09-12T19:20:28.192554+0000","last_clean":"2024-09-12T19:20:28.192554+0000","last_became_active":"2024-09-12T17:29:54.758196+0000","last_became_peered":"2024-09-12T17:29:54.758196+0000","last_unstale":"2024-09-12T19:20:28.192554+0000","last_undegraded":"2024-09-12T19:20:28.192554+0000","last_fullsized":"2024-09-12T19:20:28.192554+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:38.243254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2778,"num_read_kb":2582,"num_write":658,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":552,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.967413+0000","last_change":"2024-09-12T17:29:37.541726+0000","last_active":"2024-09-12T19:19:57.967413+0000","last_peered":"2024-09-12T19:19:57.967413+0000","last_clean":"2024-09-12T19:19:57.967413+0000","last_became_active":"2024-09-12T17:29:35.336475+0000","last_became_peered":"2024-09-12T17:29:35.336475+0000","last_unstale":"2024-09-12T19:19:57.967413+0000","last_undegraded":"2024-09-12T19:19:57.967413+0000","last_fullsized":"2024-09-12T19:19:57.967413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:17.489304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012883599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'346","reported_seq":1071,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.777899+0000","last_change":"2024-09-12T17:29:52.766738+0000","last_active":"2024-09-12T19:23:01.777899+0000","last_peered":"2024-09-12T19:23:01.777899+0000","last_clean":"2024-09-12T19:23:01.777899+0000","last_became_active":"2024-09-12T17:29:52.766251+0000","last_became_peered":"2024-09-12T17:29:52.766251+0000","last_unstale":"2024-09-12T19:23:01.777899+0000","last_undegraded":"2024-09-12T19:23:01.777899+0000","last_fullsized":"2024-09-12T19:23:01.777899+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:37.272387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730134,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":595,"num_read_kb":84420,"num_write":1189,"num_write_kb":23129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.992482+0000","last_change":"2024-09-12T17:29:56.763217+0000","last_active":"2024-09-12T19:20:27.992482+0000","last_peered":"2024-09-12T19:20:27.992482+0000","last_clean":"2024-09-12T19:20:27.992482+0000","last_became_active":"2024-09-12T17:29:56.762451+0000","last_became_peered":"2024-09-12T17:29:56.762451+0000","last_unstale":"2024-09-12T19:20:27.992482+0000","last_undegraded":"2024-09-12T19:20:27.992482+0000","last_fullsized":"2024-09-12T19:20:27.992482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:29.246666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1460","reported_seq":3809,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.692205+0000","last_change":"2024-09-12T17:29:58.772005+0000","last_active":"2024-09-12T19:23:01.692205+0000","last_peered":"2024-09-12T19:23:01.692205+0000","last_clean":"2024-09-12T19:23:01.692205+0000","last_became_active":"2024-09-12T17:29:58.771561+0000","last_became_peered":"2024-09-12T17:29:58.771561+0000","last_unstale":"2024-09-12T19:23:01.692205+0000","last_undegraded":"2024-09-12T19:23:01.692205+0000","last_fullsized":"2024-09-12T19:23:01.692205+0000","mapping_epoch":32,"log_start":"267'1400","ondisk_log_start":"267'1400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:12.774049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146977,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2279,"num_read_kb":4182,"num_write":1388,"num_write_kb":1130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:47.979732+0000","last_change":"2024-09-12T17:30:00.806748+0000","last_active":"2024-09-12T19:20:47.979732+0000","last_peered":"2024-09-12T19:20:47.979732+0000","last_clean":"2024-09-12T19:20:47.979732+0000","last_became_active":"2024-09-12T17:30:00.806030+0000","last_became_peered":"2024-09-12T17:30:00.806030+0000","last_unstale":"2024-09-12T19:20:47.979732+0000","last_undegraded":"2024-09-12T19:20:47.979732+0000","last_fullsized":"2024-09-12T19:20:47.979732+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:16.762914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'217","reported_seq":760,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:18.500162+0000","last_change":"2024-09-12T17:30:02.810034+0000","last_active":"2024-09-12T19:21:18.500162+0000","last_peered":"2024-09-12T19:21:18.500162+0000","last_clean":"2024-09-12T19:21:18.500162+0000","last_became_active":"2024-09-12T17:30:02.809372+0000","last_became_peered":"2024-09-12T17:30:02.809372+0000","last_unstale":"2024-09-12T19:21:18.500162+0000","last_undegraded":"2024-09-12T19:21:18.500162+0000","last_fullsized":"2024-09-12T19:21:18.500162+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:48.796437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":353,"num_read_kb":353,"num_write":469,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'466","reported_seq":2050,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.441742+0000","last_change":"2024-09-12T17:29:54.747544+0000","last_active":"2024-09-12T19:21:21.441742+0000","last_peered":"2024-09-12T19:21:21.441742+0000","last_clean":"2024-09-12T19:21:21.441742+0000","last_became_active":"2024-09-12T17:29:54.747270+0000","last_became_peered":"2024-09-12T17:29:54.747270+0000","last_unstale":"2024-09-12T19:21:21.441742+0000","last_undegraded":"2024-09-12T19:21:21.441742+0000","last_fullsized":"2024-09-12T19:21:21.441742+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:57.930978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2522,"num_read_kb":2358,"num_write":589,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":564,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.533496+0000","last_change":"2024-09-12T17:29:37.348932+0000","last_active":"2024-09-12T19:20:03.533496+0000","last_peered":"2024-09-12T19:20:03.533496+0000","last_clean":"2024-09-12T19:20:03.533496+0000","last_became_active":"2024-09-12T17:29:35.331504+0000","last_became_peered":"2024-09-12T17:29:35.331504+0000","last_unstale":"2024-09-12T19:20:03.533496+0000","last_undegraded":"2024-09-12T19:20:03.533496+0000","last_fullsized":"2024-09-12T19:20:03.533496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:24.198110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001034428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'347","reported_seq":991,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:07.691765+0000","last_change":"2024-09-12T19:23:07.691765+0000","last_active":"2024-09-12T19:23:07.691765+0000","last_peered":"2024-09-12T19:23:07.691765+0000","last_clean":"2024-09-12T19:23:07.691765+0000","last_became_active":"2024-09-12T17:29:52.741209+0000","last_became_peered":"2024-09-12T17:29:52.741209+0000","last_unstale":"2024-09-12T19:23:07.691765+0000","last_undegraded":"2024-09-12T19:23:07.691765+0000","last_fullsized":"2024-09-12T19:23:07.691765+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'347","last_scrub_stamp":"2024-09-12T19:23:07.691644+0000","last_deep_scrub":"267'347","last_deep_scrub_stamp":"2024-09-12T19:23:07.691644+0000","last_clean_scrub_stamp":"2024-09-12T19:23:07.691644+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:20.196315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":451,"num_read_kb":5499,"num_write":979,"num_write_kb":15070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.539110+0000","last_change":"2024-09-12T17:29:56.753741+0000","last_active":"2024-09-12T19:20:28.539110+0000","last_peered":"2024-09-12T19:20:28.539110+0000","last_clean":"2024-09-12T19:20:28.539110+0000","last_became_active":"2024-09-12T17:29:56.753063+0000","last_became_peered":"2024-09-12T17:29:56.753063+0000","last_unstale":"2024-09-12T19:20:28.539110+0000","last_undegraded":"2024-09-12T19:20:28.539110+0000","last_fullsized":"2024-09-12T19:20:28.539110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:26.088728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'367","reported_seq":2316,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.478760+0000","last_change":"2024-09-12T17:29:58.835335+0000","last_active":"2024-09-12T19:22:46.478760+0000","last_peered":"2024-09-12T19:22:46.478760+0000","last_clean":"2024-09-12T19:22:46.478760+0000","last_became_active":"2024-09-12T17:29:58.834447+0000","last_became_peered":"2024-09-12T17:29:58.834447+0000","last_unstale":"2024-09-12T19:22:46.478760+0000","last_undegraded":"2024-09-12T19:22:46.478760+0000","last_fullsized":"2024-09-12T19:22:46.478760+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:10.184300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":368,"num_read_kb":360,"num_write":359,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.192453+0000","last_change":"2024-09-12T17:30:00.778895+0000","last_active":"2024-09-12T19:20:28.192453+0000","last_peered":"2024-09-12T19:20:28.192453+0000","last_clean":"2024-09-12T19:20:28.192453+0000","last_became_active":"2024-09-12T17:30:00.778134+0000","last_became_peered":"2024-09-12T17:30:00.778134+0000","last_unstale":"2024-09-12T19:20:28.192453+0000","last_undegraded":"2024-09-12T19:20:28.192453+0000","last_fullsized":"2024-09-12T19:20:28.192453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:40.692916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'270","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:22.003400+0000","last_change":"2024-09-12T17:30:02.805738+0000","last_active":"2024-09-12T19:21:22.003400+0000","last_peered":"2024-09-12T19:21:22.003400+0000","last_clean":"2024-09-12T19:21:22.003400+0000","last_became_active":"2024-09-12T17:30:02.805090+0000","last_became_peered":"2024-09-12T17:30:02.805090+0000","last_unstale":"2024-09-12T19:21:22.003400+0000","last_undegraded":"2024-09-12T19:21:22.003400+0000","last_fullsized":"2024-09-12T19:21:22.003400+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:19.612013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":596,"num_read_kb":605,"num_write":610,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'409","reported_seq":1956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.029492+0000","last_change":"2024-09-12T17:29:54.745943+0000","last_active":"2024-09-12T19:22:45.029492+0000","last_peered":"2024-09-12T19:22:45.029492+0000","last_clean":"2024-09-12T19:22:45.029492+0000","last_became_active":"2024-09-12T17:29:54.745423+0000","last_became_peered":"2024-09-12T17:29:54.745423+0000","last_unstale":"2024-09-12T19:22:45.029492+0000","last_undegraded":"2024-09-12T19:22:45.029492+0000","last_fullsized":"2024-09-12T19:22:45.029492+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:49.009438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2154,"num_read_kb":2073,"num_write":474,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":553,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.986585+0000","last_change":"2024-09-12T17:29:37.352917+0000","last_active":"2024-09-12T19:20:02.986585+0000","last_peered":"2024-09-12T19:20:02.986585+0000","last_clean":"2024-09-12T19:20:02.986585+0000","last_became_active":"2024-09-12T17:29:35.340113+0000","last_became_peered":"2024-09-12T17:29:35.340113+0000","last_unstale":"2024-09-12T19:20:02.986585+0000","last_undegraded":"2024-09-12T19:20:02.986585+0000","last_fullsized":"2024-09-12T19:20:02.986585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:23.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020086050000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'366","reported_seq":1122,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:08.225908+0000","last_change":"2024-09-12T19:23:08.225908+0000","last_active":"2024-09-12T19:23:08.225908+0000","last_peered":"2024-09-12T19:23:08.225908+0000","last_clean":"2024-09-12T19:23:08.225908+0000","last_became_active":"2024-09-12T17:29:52.759957+0000","last_became_peered":"2024-09-12T17:29:52.759957+0000","last_unstale":"2024-09-12T19:23:08.225908+0000","last_undegraded":"2024-09-12T19:23:08.225908+0000","last_fullsized":"2024-09-12T19:23:08.225908+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'366","last_scrub_stamp":"2024-09-12T19:23:08.225657+0000","last_deep_scrub":"267'366","last_deep_scrub_stamp":"2024-09-12T19:23:08.225657+0000","last_clean_scrub_stamp":"2024-09-12T19:23:08.225657+0000","objects_scrubbed":10,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:08.296014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279708,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":651,"num_read_kb":39253,"num_write":1178,"num_write_kb":45869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:43.196821+0000","last_change":"2024-09-12T17:29:56.766428+0000","last_active":"2024-09-12T19:20:43.196821+0000","last_peered":"2024-09-12T19:20:43.196821+0000","last_clean":"2024-09-12T19:20:43.196821+0000","last_became_active":"2024-09-12T17:29:56.765361+0000","last_became_peered":"2024-09-12T17:29:56.765361+0000","last_unstale":"2024-09-12T19:20:43.196821+0000","last_undegraded":"2024-09-12T19:20:43.196821+0000","last_fullsized":"2024-09-12T19:20:43.196821+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:24.942838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'210","reported_seq":825,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:43.293295+0000","last_change":"2024-09-12T17:29:58.769020+0000","last_active":"2024-09-12T19:22:43.293295+0000","last_peered":"2024-09-12T19:22:43.293295+0000","last_clean":"2024-09-12T19:22:43.293295+0000","last_became_active":"2024-09-12T17:29:58.768596+0000","last_became_peered":"2024-09-12T17:29:58.768596+0000","last_unstale":"2024-09-12T19:22:43.293295+0000","last_undegraded":"2024-09-12T19:22:43.293295+0000","last_fullsized":"2024-09-12T19:22:43.293295+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:34.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.563828+0000","last_change":"2024-09-12T17:30:00.790648+0000","last_active":"2024-09-12T19:20:33.563828+0000","last_peered":"2024-09-12T19:20:33.563828+0000","last_clean":"2024-09-12T19:20:33.563828+0000","last_became_active":"2024-09-12T17:30:00.788505+0000","last_became_peered":"2024-09-12T17:30:00.788505+0000","last_unstale":"2024-09-12T19:20:33.563828+0000","last_undegraded":"2024-09-12T19:20:33.563828+0000","last_fullsized":"2024-09-12T19:20:33.563828+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:54.847829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'156","reported_seq":736,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.643106+0000","last_change":"2024-09-12T17:30:02.795566+0000","last_active":"2024-09-12T19:22:44.643106+0000","last_peered":"2024-09-12T19:22:44.643106+0000","last_clean":"2024-09-12T19:22:44.643106+0000","last_became_active":"2024-09-12T17:30:02.794703+0000","last_became_peered":"2024-09-12T17:30:02.794703+0000","last_unstale":"2024-09-12T19:22:44.643106+0000","last_undegraded":"2024-09-12T19:22:44.643106+0000","last_fullsized":"2024-09-12T19:22:44.643106+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:19.673266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":268,"num_read_kb":254,"num_write":347,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'419","reported_seq":2016,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:22.983809+0000","last_change":"2024-09-12T17:29:54.766600+0000","last_active":"2024-09-12T19:20:22.983809+0000","last_peered":"2024-09-12T19:20:22.983809+0000","last_clean":"2024-09-12T19:20:22.983809+0000","last_became_active":"2024-09-12T17:29:54.766275+0000","last_became_peered":"2024-09-12T17:29:54.766275+0000","last_unstale":"2024-09-12T19:20:22.983809+0000","last_undegraded":"2024-09-12T19:20:22.983809+0000","last_fullsized":"2024-09-12T19:20:22.983809+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:40.431193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2280,"num_read_kb":2171,"num_write":482,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'349","reported_seq":1026,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.969892+0000","last_change":"2024-09-12T17:29:52.741487+0000","last_active":"2024-09-12T19:23:01.969892+0000","last_peered":"2024-09-12T19:23:01.969892+0000","last_clean":"2024-09-12T19:23:01.969892+0000","last_became_active":"2024-09-12T17:29:52.740544+0000","last_became_peered":"2024-09-12T17:29:52.740544+0000","last_unstale":"2024-09-12T19:23:01.969892+0000","last_undegraded":"2024-09-12T19:23:01.969892+0000","last_fullsized":"2024-09-12T19:23:01.969892+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:29.317350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":6019,"num_write":1130,"num_write_kb":22769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":554,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.979639+0000","last_change":"2024-09-12T17:29:37.346858+0000","last_active":"2024-09-12T19:20:02.979639+0000","last_peered":"2024-09-12T19:20:02.979639+0000","last_clean":"2024-09-12T19:20:02.979639+0000","last_became_active":"2024-09-12T17:29:35.407492+0000","last_became_peered":"2024-09-12T17:29:35.407492+0000","last_unstale":"2024-09-12T19:20:02.979639+0000","last_undegraded":"2024-09-12T19:20:02.979639+0000","last_fullsized":"2024-09-12T19:20:02.979639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:34.824127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098134900000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.191284+0000","last_change":"2024-09-12T17:29:56.769832+0000","last_active":"2024-09-12T19:20:23.191284+0000","last_peered":"2024-09-12T19:20:23.191284+0000","last_clean":"2024-09-12T19:20:23.191284+0000","last_became_active":"2024-09-12T17:29:56.769344+0000","last_became_peered":"2024-09-12T17:29:56.769344+0000","last_unstale":"2024-09-12T19:20:23.191284+0000","last_undegraded":"2024-09-12T19:20:23.191284+0000","last_fullsized":"2024-09-12T19:20:23.191284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:05.381579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'763","reported_seq":1503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.624058+0000","last_change":"2024-09-12T17:29:58.776516+0000","last_active":"2024-09-12T19:23:01.624058+0000","last_peered":"2024-09-12T19:23:01.624058+0000","last_clean":"2024-09-12T19:23:01.624058+0000","last_became_active":"2024-09-12T17:29:58.766353+0000","last_became_peered":"2024-09-12T17:29:58.766353+0000","last_unstale":"2024-09-12T19:23:01.624058+0000","last_undegraded":"2024-09-12T19:23:01.624058+0000","last_fullsized":"2024-09-12T19:23:01.624058+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:35.937627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88446,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1874,"num_read_kb":3148,"num_write":2424,"num_write_kb":2173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.202330+0000","last_change":"2024-09-12T17:30:00.784218+0000","last_active":"2024-09-12T19:20:28.202330+0000","last_peered":"2024-09-12T19:20:28.202330+0000","last_clean":"2024-09-12T19:20:28.202330+0000","last_became_active":"2024-09-12T17:30:00.783385+0000","last_became_peered":"2024-09-12T17:30:00.783385+0000","last_unstale":"2024-09-12T19:20:28.202330+0000","last_undegraded":"2024-09-12T19:20:28.202330+0000","last_fullsized":"2024-09-12T19:20:28.202330+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:44.877583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'143","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:14.315826+0000","last_change":"2024-09-12T17:30:02.806515+0000","last_active":"2024-09-12T19:21:14.315826+0000","last_peered":"2024-09-12T19:21:14.315826+0000","last_clean":"2024-09-12T19:21:14.315826+0000","last_became_active":"2024-09-12T17:30:02.805684+0000","last_became_peered":"2024-09-12T17:30:02.805684+0000","last_unstale":"2024-09-12T19:21:14.315826+0000","last_undegraded":"2024-09-12T19:21:14.315826+0000","last_fullsized":"2024-09-12T19:21:14.315826+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:50.293983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":165,"num_read_kb":163,"num_write":341,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'404","reported_seq":1905,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.896908+0000","last_change":"2024-09-12T17:29:54.758506+0000","last_active":"2024-09-12T19:21:55.896908+0000","last_peered":"2024-09-12T19:21:55.896908+0000","last_clean":"2024-09-12T19:21:55.896908+0000","last_became_active":"2024-09-12T17:29:54.758047+0000","last_became_peered":"2024-09-12T17:29:54.758047+0000","last_unstale":"2024-09-12T19:21:55.896908+0000","last_undegraded":"2024-09-12T19:21:55.896908+0000","last_fullsized":"2024-09-12T19:21:55.896908+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:06.718970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2269,"num_read_kb":2144,"num_write":466,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'307","reported_seq":1185,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.919860+0000","last_change":"2024-09-12T17:29:52.728144+0000","last_active":"2024-09-12T19:23:01.919860+0000","last_peered":"2024-09-12T19:23:01.919860+0000","last_clean":"2024-09-12T19:23:01.919860+0000","last_became_active":"2024-09-12T17:29:52.727635+0000","last_became_peered":"2024-09-12T17:29:52.727635+0000","last_unstale":"2024-09-12T19:23:01.919860+0000","last_undegraded":"2024-09-12T19:23:01.919860+0000","last_fullsized":"2024-09-12T19:23:01.919860+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:03.775561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109709,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":897,"num_read_kb":32569,"num_write":1024,"num_write_kb":39553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":550,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:22.973772+0000","last_change":"2024-09-12T17:29:37.541831+0000","last_active":"2024-09-12T19:20:22.973772+0000","last_peered":"2024-09-12T19:20:22.973772+0000","last_clean":"2024-09-12T19:20:22.973772+0000","last_became_active":"2024-09-12T17:29:35.406653+0000","last_became_peered":"2024-09-12T17:29:35.406653+0000","last_unstale":"2024-09-12T19:20:22.973772+0000","last_undegraded":"2024-09-12T19:20:22.973772+0000","last_fullsized":"2024-09-12T19:20:22.973772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:04.148521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001315566,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.561483+0000","last_change":"2024-09-12T17:29:56.770303+0000","last_active":"2024-09-12T19:20:23.561483+0000","last_peered":"2024-09-12T19:20:23.561483+0000","last_clean":"2024-09-12T19:20:23.561483+0000","last_became_active":"2024-09-12T17:29:56.769576+0000","last_became_peered":"2024-09-12T17:29:56.769576+0000","last_unstale":"2024-09-12T19:20:23.561483+0000","last_undegraded":"2024-09-12T19:20:23.561483+0000","last_fullsized":"2024-09-12T19:20:23.561483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:04.267964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'337","reported_seq":976,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:29.216151+0000","last_change":"2024-09-12T17:29:58.831755+0000","last_active":"2024-09-12T19:21:29.216151+0000","last_peered":"2024-09-12T19:21:29.216151+0000","last_clean":"2024-09-12T19:21:29.216151+0000","last_became_active":"2024-09-12T17:29:58.830993+0000","last_became_peered":"2024-09-12T17:29:58.830993+0000","last_unstale":"2024-09-12T19:21:29.216151+0000","last_undegraded":"2024-09-12T19:21:29.216151+0000","last_fullsized":"2024-09-12T19:21:29.216151+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:47.520303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":439,"num_read_kb":430,"num_write":418,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'791","reported_seq":3373,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.882999+0000","last_change":"2024-09-12T17:30:00.805745+0000","last_active":"2024-09-12T19:22:58.882999+0000","last_peered":"2024-09-12T19:22:58.882999+0000","last_clean":"2024-09-12T19:22:58.882999+0000","last_became_active":"2024-09-12T17:30:00.805059+0000","last_became_peered":"2024-09-12T17:30:00.805059+0000","last_unstale":"2024-09-12T19:22:58.882999+0000","last_undegraded":"2024-09-12T19:22:58.882999+0000","last_fullsized":"2024-09-12T19:22:58.882999+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":701,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:20.515894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'134","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.261254+0000","last_change":"2024-09-12T17:30:02.805558+0000","last_active":"2024-09-12T19:22:46.261254+0000","last_peered":"2024-09-12T19:22:46.261254+0000","last_clean":"2024-09-12T19:22:46.261254+0000","last_became_active":"2024-09-12T17:30:02.803051+0000","last_became_peered":"2024-09-12T17:30:02.803051+0000","last_unstale":"2024-09-12T19:22:46.261254+0000","last_undegraded":"2024-09-12T19:22:46.261254+0000","last_fullsized":"2024-09-12T19:22:46.261254+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:30.608707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":726,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":188,"num_read_kb":177,"num_write":312,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'427","reported_seq":1967,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262257+0000","last_change":"2024-09-12T17:29:54.762856+0000","last_active":"2024-09-12T19:20:23.262257+0000","last_peered":"2024-09-12T19:20:23.262257+0000","last_clean":"2024-09-12T19:20:23.262257+0000","last_became_active":"2024-09-12T17:29:54.762522+0000","last_became_peered":"2024-09-12T17:29:54.762522+0000","last_unstale":"2024-09-12T19:20:23.262257+0000","last_undegraded":"2024-09-12T19:20:23.262257+0000","last_fullsized":"2024-09-12T19:20:23.262257+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:33.737616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2273,"num_read_kb":2141,"num_write":510,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'293","reported_seq":921,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.929200+0000","last_change":"2024-09-12T17:29:52.716685+0000","last_active":"2024-09-12T19:23:01.929200+0000","last_peered":"2024-09-12T19:23:01.929200+0000","last_clean":"2024-09-12T19:23:01.929200+0000","last_became_active":"2024-09-12T17:29:52.716210+0000","last_became_peered":"2024-09-12T17:29:52.716210+0000","last_unstale":"2024-09-12T19:23:01.929200+0000","last_undegraded":"2024-09-12T19:23:01.929200+0000","last_fullsized":"2024-09-12T19:23:01.929200+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:59.907663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":379,"num_read_kb":381,"num_write":923,"num_write_kb":30307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":560,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:06.731459+0000","last_change":"2024-09-12T19:23:06.731459+0000","last_active":"2024-09-12T19:23:06.731459+0000","last_peered":"2024-09-12T19:23:06.731459+0000","last_clean":"2024-09-12T19:23:06.731459+0000","last_became_active":"2024-09-12T17:29:35.337987+0000","last_became_peered":"2024-09-12T17:29:35.337987+0000","last_unstale":"2024-09-12T19:23:06.731459+0000","last_undegraded":"2024-09-12T19:23:06.731459+0000","last_fullsized":"2024-09-12T19:23:06.731459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:06.731386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:06.731386+0000","last_clean_scrub_stamp":"2024-09-12T19:23:06.731386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:59.862051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011496340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"38'3","reported_seq":1014,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.839940+0000","last_change":"2024-09-12T17:29:56.756687+0000","last_active":"2024-09-12T19:22:58.839940+0000","last_peered":"2024-09-12T19:22:58.839940+0000","last_clean":"2024-09-12T19:22:58.839940+0000","last_became_active":"2024-09-12T17:29:56.754415+0000","last_became_peered":"2024-09-12T17:29:56.754415+0000","last_unstale":"2024-09-12T19:22:58.839940+0000","last_undegraded":"2024-09-12T19:22:58.839940+0000","last_fullsized":"2024-09-12T19:22:58.839940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:14.164674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'175","reported_seq":781,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:52.559741+0000","last_change":"2024-09-12T17:29:58.767652+0000","last_active":"2024-09-12T19:20:52.559741+0000","last_peered":"2024-09-12T19:20:52.559741+0000","last_clean":"2024-09-12T19:20:52.559741+0000","last_became_active":"2024-09-12T17:29:58.766420+0000","last_became_peered":"2024-09-12T17:29:58.766420+0000","last_unstale":"2024-09-12T19:20:52.559741+0000","last_undegraded":"2024-09-12T19:20:52.559741+0000","last_fullsized":"2024-09-12T19:20:52.559741+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:24.045295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":231,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'817","reported_seq":5004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.891453+0000","last_change":"2024-09-12T17:30:00.796740+0000","last_active":"2024-09-12T19:22:58.891453+0000","last_peered":"2024-09-12T19:22:58.891453+0000","last_clean":"2024-09-12T19:22:58.891453+0000","last_became_active":"2024-09-12T17:30:00.793234+0000","last_became_peered":"2024-09-12T17:30:00.793234+0000","last_unstale":"2024-09-12T19:22:58.891453+0000","last_undegraded":"2024-09-12T19:22:58.891453+0000","last_fullsized":"2024-09-12T19:22:58.891453+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:52.398488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'186","reported_seq":723,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:17.279016+0000","last_change":"2024-09-12T17:30:02.800748+0000","last_active":"2024-09-12T19:21:17.279016+0000","last_peered":"2024-09-12T19:21:17.279016+0000","last_clean":"2024-09-12T19:21:17.279016+0000","last_became_active":"2024-09-12T17:30:02.799944+0000","last_became_peered":"2024-09-12T17:30:02.799944+0000","last_unstale":"2024-09-12T19:21:17.279016+0000","last_undegraded":"2024-09-12T19:21:17.279016+0000","last_fullsized":"2024-09-12T19:21:17.279016+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:37.045857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":199,"num_read_kb":188,"num_write":423,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'1235","reported_seq":2851,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.201038+0000","last_change":"2024-09-12T17:29:54.753103+0000","last_active":"2024-09-12T19:20:23.201038+0000","last_peered":"2024-09-12T19:20:23.201038+0000","last_clean":"2024-09-12T19:20:23.201038+0000","last_became_active":"2024-09-12T17:29:54.751931+0000","last_became_peered":"2024-09-12T17:29:54.751931+0000","last_unstale":"2024-09-12T19:20:23.201038+0000","last_undegraded":"2024-09-12T19:20:23.201038+0000","last_fullsized":"2024-09-12T19:20:23.201038+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":1200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:55.642337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5667,"num_read_kb":5016,"num_write":1745,"num_write_kb":765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'336","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:07.977004+0000","last_change":"2024-09-12T19:23:07.977004+0000","last_active":"2024-09-12T19:23:07.977004+0000","last_peered":"2024-09-12T19:23:07.977004+0000","last_clean":"2024-09-12T19:23:07.977004+0000","last_became_active":"2024-09-12T17:30:21.697470+0000","last_became_peered":"2024-09-12T17:30:21.697470+0000","last_unstale":"2024-09-12T19:23:07.977004+0000","last_undegraded":"2024-09-12T19:23:07.977004+0000","last_fullsized":"2024-09-12T19:23:07.977004+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-12T19:23:07.976758+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-12T19:23:07.976758+0000","last_clean_scrub_stamp":"2024-09-12T19:23:07.976758+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:24.268288+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":2583,"num_write":1054,"num_write_kb":28824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":552,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.558253+0000","last_change":"2024-09-12T17:29:37.541991+0000","last_active":"2024-09-12T19:20:08.558253+0000","last_peered":"2024-09-12T19:20:08.558253+0000","last_clean":"2024-09-12T19:20:08.558253+0000","last_became_active":"2024-09-12T17:29:35.337998+0000","last_became_peered":"2024-09-12T17:29:35.337998+0000","last_unstale":"2024-09-12T19:20:08.558253+0000","last_undegraded":"2024-09-12T19:20:08.558253+0000","last_fullsized":"2024-09-12T19:20:08.558253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:34.307063+0000","last_clean_scrub_stamp":"2024-09-12T17:29:34.307063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:23.098766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011850280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262198+0000","last_change":"2024-09-12T17:29:56.761573+0000","last_active":"2024-09-12T19:20:23.262198+0000","last_peered":"2024-09-12T19:20:23.262198+0000","last_clean":"2024-09-12T19:20:23.262198+0000","last_became_active":"2024-09-12T17:29:56.760822+0000","last_became_peered":"2024-09-12T17:29:56.760822+0000","last_unstale":"2024-09-12T19:20:23.262198+0000","last_undegraded":"2024-09-12T19:20:23.262198+0000","last_fullsized":"2024-09-12T19:20:23.262198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:48.200758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'808","reported_seq":1589,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.852202+0000","last_change":"2024-09-12T17:29:58.831322+0000","last_active":"2024-09-12T19:23:01.852202+0000","last_peered":"2024-09-12T19:23:01.852202+0000","last_clean":"2024-09-12T19:23:01.852202+0000","last_became_active":"2024-09-12T17:29:58.830605+0000","last_became_peered":"2024-09-12T17:29:58.830605+0000","last_unstale":"2024-09-12T19:23:01.852202+0000","last_undegraded":"2024-09-12T19:23:01.852202+0000","last_fullsized":"2024-09-12T19:23:01.852202+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:34.715340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138319,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1432,"num_read_kb":3265,"num_write":1150,"num_write_kb":898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.263615+0000","last_change":"2024-09-12T17:30:00.810969+0000","last_active":"2024-09-12T19:20:28.263615+0000","last_peered":"2024-09-12T19:20:28.263615+0000","last_clean":"2024-09-12T19:20:28.263615+0000","last_became_active":"2024-09-12T17:30:00.810341+0000","last_became_peered":"2024-09-12T17:30:00.810341+0000","last_unstale":"2024-09-12T19:20:28.263615+0000","last_undegraded":"2024-09-12T19:20:28.263615+0000","last_fullsized":"2024-09-12T19:20:28.263615+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:02.611552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'162","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:17.990022+0000","last_change":"2024-09-12T17:30:02.787340+0000","last_active":"2024-09-12T19:20:17.990022+0000","last_peered":"2024-09-12T19:20:17.990022+0000","last_clean":"2024-09-12T19:20:17.990022+0000","last_became_active":"2024-09-12T17:30:02.786443+0000","last_became_peered":"2024-09-12T17:30:02.786443+0000","last_unstale":"2024-09-12T19:20:17.990022+0000","last_undegraded":"2024-09-12T19:20:17.990022+0000","last_fullsized":"2024-09-12T19:20:17.990022+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:16.833731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":311,"num_read_kb":271,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'112","reported_seq":698,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.907333+0000","last_change":"2024-09-12T17:30:02.805626+0000","last_active":"2024-09-12T19:21:21.907333+0000","last_peered":"2024-09-12T19:21:21.907333+0000","last_clean":"2024-09-12T19:21:21.907333+0000","last_became_active":"2024-09-12T17:30:02.801038+0000","last_became_peered":"2024-09-12T17:30:02.801038+0000","last_unstale":"2024-09-12T19:21:21.907333+0000","last_undegraded":"2024-09-12T19:21:21.907333+0000","last_fullsized":"2024-09-12T19:21:21.907333+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:20.200364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":212,"num_write":265,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'453","reported_seq":2036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.190526+0000","last_change":"2024-09-12T17:29:54.761528+0000","last_active":"2024-09-12T19:19:38.190526+0000","last_peered":"2024-09-12T19:19:38.190526+0000","last_clean":"2024-09-12T19:19:38.190526+0000","last_became_active":"2024-09-12T17:29:54.760809+0000","last_became_peered":"2024-09-12T17:29:54.760809+0000","last_unstale":"2024-09-12T19:19:38.190526+0000","last_undegraded":"2024-09-12T19:19:38.190526+0000","last_fullsized":"2024-09-12T19:19:38.190526+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:31.018358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2369,"num_read_kb":2229,"num_write":528,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'332","reported_seq":1034,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.885305+0000","last_change":"2024-09-12T17:29:52.761032+0000","last_active":"2024-09-12T19:23:01.885305+0000","last_peered":"2024-09-12T19:23:01.885305+0000","last_clean":"2024-09-12T19:23:01.885305+0000","last_became_active":"2024-09-12T17:29:52.760432+0000","last_became_peered":"2024-09-12T17:29:52.760432+0000","last_unstale":"2024-09-12T19:23:01.885305+0000","last_undegraded":"2024-09-12T19:23:01.885305+0000","last_fullsized":"2024-09-12T19:23:01.885305+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:17.695625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":31499,"num_write":1138,"num_write_kb":37455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.973687+0000","last_change":"2024-09-12T17:29:56.766527+0000","last_active":"2024-09-12T19:19:37.973687+0000","last_peered":"2024-09-12T19:19:37.973687+0000","last_clean":"2024-09-12T19:19:37.973687+0000","last_became_active":"2024-09-12T17:29:56.765656+0000","last_became_peered":"2024-09-12T17:29:56.765656+0000","last_unstale":"2024-09-12T19:19:37.973687+0000","last_undegraded":"2024-09-12T19:19:37.973687+0000","last_fullsized":"2024-09-12T19:19:37.973687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:02.895743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'312","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.391857+0000","last_change":"2024-09-12T17:29:58.778689+0000","last_active":"2024-09-12T19:22:59.391857+0000","last_peered":"2024-09-12T19:22:59.391857+0000","last_clean":"2024-09-12T19:22:59.391857+0000","last_became_active":"2024-09-12T17:29:58.777997+0000","last_became_peered":"2024-09-12T17:29:58.777997+0000","last_unstale":"2024-09-12T19:22:59.391857+0000","last_undegraded":"2024-09-12T19:22:59.391857+0000","last_fullsized":"2024-09-12T19:22:59.391857+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:11.474675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47243,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":493,"num_read_kb":996,"num_write":376,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:43.251258+0000","last_change":"2024-09-12T17:30:00.794010+0000","last_active":"2024-09-12T19:19:43.251258+0000","last_peered":"2024-09-12T19:19:43.251258+0000","last_clean":"2024-09-12T19:19:43.251258+0000","last_became_active":"2024-09-12T17:30:00.793204+0000","last_became_peered":"2024-09-12T17:30:00.793204+0000","last_unstale":"2024-09-12T19:19:43.251258+0000","last_undegraded":"2024-09-12T19:19:43.251258+0000","last_fullsized":"2024-09-12T19:19:43.251258+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:53.881334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'108","reported_seq":638,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.263789+0000","last_change":"2024-09-12T17:30:02.790200+0000","last_active":"2024-09-12T19:20:28.263789+0000","last_peered":"2024-09-12T19:20:28.263789+0000","last_clean":"2024-09-12T19:20:28.263789+0000","last_became_active":"2024-09-12T17:30:02.789511+0000","last_became_peered":"2024-09-12T17:30:02.789511+0000","last_unstale":"2024-09-12T19:20:28.263789+0000","last_undegraded":"2024-09-12T19:20:28.263789+0000","last_fullsized":"2024-09-12T19:20:28.263789+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:57.833180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":267,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'1080","reported_seq":2628,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.973714+0000","last_change":"2024-09-12T17:29:54.774595+0000","last_active":"2024-09-12T19:19:37.973714+0000","last_peered":"2024-09-12T19:19:37.973714+0000","last_clean":"2024-09-12T19:19:37.973714+0000","last_became_active":"2024-09-12T17:29:54.774337+0000","last_became_peered":"2024-09-12T17:29:54.774337+0000","last_unstale":"2024-09-12T19:19:37.973714+0000","last_undegraded":"2024-09-12T19:19:37.973714+0000","last_fullsized":"2024-09-12T19:19:37.973714+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":1000,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:59.476733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5006,"num_read_kb":4447,"num_write":1496,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'343","reported_seq":1038,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.907118+0000","last_change":"2024-09-12T17:29:52.763186+0000","last_active":"2024-09-12T19:23:01.907118+0000","last_peered":"2024-09-12T19:23:01.907118+0000","last_clean":"2024-09-12T19:23:01.907118+0000","last_became_active":"2024-09-12T17:29:52.757775+0000","last_became_peered":"2024-09-12T17:29:52.757775+0000","last_unstale":"2024-09-12T19:23:01.907118+0000","last_undegraded":"2024-09-12T19:23:01.907118+0000","last_fullsized":"2024-09-12T19:23:01.907118+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:44:36.685627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399166,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":510,"num_read_kb":111933,"num_write":1035,"num_write_kb":43950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.250268+0000","last_change":"2024-09-12T17:29:56.771395+0000","last_active":"2024-09-12T19:19:38.250268+0000","last_peered":"2024-09-12T19:19:38.250268+0000","last_clean":"2024-09-12T19:19:38.250268+0000","last_became_active":"2024-09-12T17:29:56.770639+0000","last_became_peered":"2024-09-12T17:29:56.770639+0000","last_unstale":"2024-09-12T19:19:38.250268+0000","last_undegraded":"2024-09-12T19:19:38.250268+0000","last_fullsized":"2024-09-12T19:19:38.250268+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:05.853569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'78","reported_seq":622,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:41.373097+0000","last_change":"2024-09-12T17:29:58.782766+0000","last_active":"2024-09-12T19:20:41.373097+0000","last_peered":"2024-09-12T19:20:41.373097+0000","last_clean":"2024-09-12T19:20:41.373097+0000","last_became_active":"2024-09-12T17:29:58.781731+0000","last_became_peered":"2024-09-12T17:29:58.781731+0000","last_unstale":"2024-09-12T19:20:41.373097+0000","last_undegraded":"2024-09-12T19:20:41.373097+0000","last_fullsized":"2024-09-12T19:20:41.373097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:49.979279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":73,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:42.963782+0000","last_change":"2024-09-12T17:30:00.801153+0000","last_active":"2024-09-12T19:19:42.963782+0000","last_peered":"2024-09-12T19:19:42.963782+0000","last_clean":"2024-09-12T19:19:42.963782+0000","last_became_active":"2024-09-12T17:30:00.799588+0000","last_became_peered":"2024-09-12T17:30:00.799588+0000","last_unstale":"2024-09-12T19:19:42.963782+0000","last_undegraded":"2024-09-12T19:19:42.963782+0000","last_fullsized":"2024-09-12T19:19:42.963782+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:18.930813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'191","reported_seq":733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.175915+0000","last_change":"2024-09-12T17:30:02.814008+0000","last_active":"2024-09-12T19:21:19.175915+0000","last_peered":"2024-09-12T19:21:19.175915+0000","last_clean":"2024-09-12T19:21:19.175915+0000","last_became_active":"2024-09-12T17:30:02.813284+0000","last_became_peered":"2024-09-12T17:30:02.813284+0000","last_unstale":"2024-09-12T19:21:19.175915+0000","last_undegraded":"2024-09-12T19:21:19.175915+0000","last_fullsized":"2024-09-12T19:21:19.175915+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:56.023655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":312,"num_read_kb":310,"num_write":442,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'824","reported_seq":2436,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:53.595775+0000","last_change":"2024-09-12T17:29:54.763134+0000","last_active":"2024-09-12T19:19:53.595775+0000","last_peered":"2024-09-12T19:19:53.595775+0000","last_clean":"2024-09-12T19:19:53.595775+0000","last_became_active":"2024-09-12T17:29:54.762793+0000","last_became_peered":"2024-09-12T17:29:54.762793+0000","last_unstale":"2024-09-12T19:19:53.595775+0000","last_undegraded":"2024-09-12T19:19:53.595775+0000","last_fullsized":"2024-09-12T19:19:53.595775+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:54.833462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3973,"num_read_kb":3581,"num_write":1093,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'357","reported_seq":980,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.930936+0000","last_change":"2024-09-12T17:30:21.692800+0000","last_active":"2024-09-12T19:23:01.930936+0000","last_peered":"2024-09-12T19:23:01.930936+0000","last_clean":"2024-09-12T19:23:01.930936+0000","last_became_active":"2024-09-12T17:30:21.692338+0000","last_became_peered":"2024-09-12T17:30:21.692338+0000","last_unstale":"2024-09-12T19:23:01.930936+0000","last_undegraded":"2024-09-12T19:23:01.930936+0000","last_fullsized":"2024-09-12T19:23:01.930936+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:01.217885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2254600,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":475,"num_read_kb":2106,"num_write":1042,"num_write_kb":33078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.962529+0000","last_change":"2024-09-12T17:29:56.772976+0000","last_active":"2024-09-12T19:19:37.962529+0000","last_peered":"2024-09-12T19:19:37.962529+0000","last_clean":"2024-09-12T19:19:37.962529+0000","last_became_active":"2024-09-12T17:29:56.771923+0000","last_became_peered":"2024-09-12T17:29:56.771923+0000","last_unstale":"2024-09-12T19:19:37.962529+0000","last_undegraded":"2024-09-12T19:19:37.962529+0000","last_fullsized":"2024-09-12T19:19:37.962529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:15.080934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'353","reported_seq":1002,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.470731+0000","last_change":"2024-09-12T17:29:58.782391+0000","last_active":"2024-09-12T19:23:01.470731+0000","last_peered":"2024-09-12T19:23:01.470731+0000","last_clean":"2024-09-12T19:23:01.470731+0000","last_became_active":"2024-09-12T17:29:58.781756+0000","last_became_peered":"2024-09-12T17:29:58.781756+0000","last_unstale":"2024-09-12T19:23:01.470731+0000","last_undegraded":"2024-09-12T19:23:01.470731+0000","last_fullsized":"2024-09-12T19:23:01.470731+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:18.104306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44606,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":574,"num_read_kb":1122,"num_write":442,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:43.552916+0000","last_change":"2024-09-12T17:30:00.788793+0000","last_active":"2024-09-12T19:19:43.552916+0000","last_peered":"2024-09-12T19:19:43.552916+0000","last_clean":"2024-09-12T19:19:43.552916+0000","last_became_active":"2024-09-12T17:30:00.787872+0000","last_became_peered":"2024-09-12T17:30:00.787872+0000","last_unstale":"2024-09-12T19:19:43.552916+0000","last_undegraded":"2024-09-12T19:19:43.552916+0000","last_fullsized":"2024-09-12T19:19:43.552916+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:11.139793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'137","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.416574+0000","last_change":"2024-09-12T17:30:02.790977+0000","last_active":"2024-09-12T19:21:21.416574+0000","last_peered":"2024-09-12T19:21:21.416574+0000","last_clean":"2024-09-12T19:21:21.416574+0000","last_became_active":"2024-09-12T17:30:02.790246+0000","last_became_peered":"2024-09-12T17:30:02.790246+0000","last_unstale":"2024-09-12T19:21:21.416574+0000","last_undegraded":"2024-09-12T19:21:21.416574+0000","last_fullsized":"2024-09-12T19:21:21.416574+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:27.228227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":190,"num_write":334,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'494","reported_seq":2164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.899613+0000","last_change":"2024-09-12T17:30:22.256595+0000","last_active":"2024-09-12T19:21:55.899613+0000","last_peered":"2024-09-12T19:21:55.899613+0000","last_clean":"2024-09-12T19:21:55.899613+0000","last_became_active":"2024-09-12T17:30:22.255871+0000","last_became_peered":"2024-09-12T17:30:22.255871+0000","last_unstale":"2024-09-12T19:21:55.899613+0000","last_undegraded":"2024-09-12T19:21:55.899613+0000","last_fullsized":"2024-09-12T19:21:55.899613+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:37.746895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2849,"num_read_kb":2646,"num_write":616,"num_write_kb":185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'330","reported_seq":1079,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:06.908628+0000","last_change":"2024-09-12T19:23:06.908628+0000","last_active":"2024-09-12T19:23:06.908628+0000","last_peered":"2024-09-12T19:23:06.908628+0000","last_clean":"2024-09-12T19:23:06.908628+0000","last_became_active":"2024-09-12T17:29:52.725672+0000","last_became_peered":"2024-09-12T17:29:52.725672+0000","last_unstale":"2024-09-12T19:23:06.908628+0000","last_undegraded":"2024-09-12T19:23:06.908628+0000","last_fullsized":"2024-09-12T19:23:06.908628+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'330","last_scrub_stamp":"2024-09-12T19:23:06.908405+0000","last_deep_scrub":"267'330","last_deep_scrub_stamp":"2024-09-12T19:23:06.908405+0000","last_clean_scrub_stamp":"2024-09-12T19:23:06.908405+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:18.850583+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524466,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":607,"num_read_kb":120165,"num_write":1109,"num_write_kb":47030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.551750+0000","last_change":"2024-09-12T17:29:56.762247+0000","last_active":"2024-09-12T19:19:38.551750+0000","last_peered":"2024-09-12T19:19:38.551750+0000","last_clean":"2024-09-12T19:19:38.551750+0000","last_became_active":"2024-09-12T17:29:56.761442+0000","last_became_peered":"2024-09-12T17:29:56.761442+0000","last_unstale":"2024-09-12T19:19:38.551750+0000","last_undegraded":"2024-09-12T19:19:38.551750+0000","last_fullsized":"2024-09-12T19:19:38.551750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:29.298860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'324","reported_seq":935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.271936+0000","last_change":"2024-09-12T17:29:58.758717+0000","last_active":"2024-09-12T19:23:01.271936+0000","last_peered":"2024-09-12T19:23:01.271936+0000","last_clean":"2024-09-12T19:23:01.271936+0000","last_became_active":"2024-09-12T17:29:58.758050+0000","last_became_peered":"2024-09-12T17:29:58.758050+0000","last_unstale":"2024-09-12T19:23:01.271936+0000","last_undegraded":"2024-09-12T19:23:01.271936+0000","last_fullsized":"2024-09-12T19:23:01.271936+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:17.764686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47374,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":545,"num_read_kb":1211,"num_write":440,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:43.181010+0000","last_change":"2024-09-12T17:30:00.780831+0000","last_active":"2024-09-12T19:19:43.181010+0000","last_peered":"2024-09-12T19:19:43.181010+0000","last_clean":"2024-09-12T19:19:43.181010+0000","last_became_active":"2024-09-12T17:30:00.780216+0000","last_became_peered":"2024-09-12T17:30:00.780216+0000","last_unstale":"2024-09-12T19:19:43.181010+0000","last_undegraded":"2024-09-12T19:19:43.181010+0000","last_fullsized":"2024-09-12T19:19:43.181010+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:54.040743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'412","reported_seq":1851,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.561608+0000","last_change":"2024-09-12T17:29:54.777350+0000","last_active":"2024-09-12T19:20:23.561608+0000","last_peered":"2024-09-12T19:20:23.561608+0000","last_clean":"2024-09-12T19:20:23.561608+0000","last_became_active":"2024-09-12T17:29:54.776503+0000","last_became_peered":"2024-09-12T17:29:54.776503+0000","last_unstale":"2024-09-12T19:20:23.561608+0000","last_undegraded":"2024-09-12T19:20:23.561608+0000","last_fullsized":"2024-09-12T19:20:23.561608+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:48.613783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2157,"num_read_kb":2011,"num_write":494,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'346","reported_seq":1048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.989562+0000","last_change":"2024-09-12T17:29:52.716790+0000","last_active":"2024-09-12T19:23:01.989562+0000","last_peered":"2024-09-12T19:23:01.989562+0000","last_clean":"2024-09-12T19:23:01.989562+0000","last_became_active":"2024-09-12T17:29:52.716376+0000","last_became_peered":"2024-09-12T17:29:52.716376+0000","last_unstale":"2024-09-12T19:23:01.989562+0000","last_undegraded":"2024-09-12T19:23:01.989562+0000","last_fullsized":"2024-09-12T19:23:01.989562+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:51.977058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730157,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":576,"num_read_kb":2668,"num_write":1130,"num_write_kb":45238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:18.190273+0000","last_change":"2024-09-12T17:29:56.773917+0000","last_active":"2024-09-12T19:20:18.190273+0000","last_peered":"2024-09-12T19:20:18.190273+0000","last_clean":"2024-09-12T19:20:18.190273+0000","last_became_active":"2024-09-12T17:29:56.773239+0000","last_became_peered":"2024-09-12T17:29:56.773239+0000","last_unstale":"2024-09-12T19:20:18.190273+0000","last_undegraded":"2024-09-12T19:20:18.190273+0000","last_fullsized":"2024-09-12T19:20:18.190273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:31:02.813155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'553","reported_seq":1227,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.189986+0000","last_change":"2024-09-12T17:29:58.779631+0000","last_active":"2024-09-12T19:23:01.189986+0000","last_peered":"2024-09-12T19:23:01.189986+0000","last_clean":"2024-09-12T19:23:01.189986+0000","last_became_active":"2024-09-12T17:29:58.778931+0000","last_became_peered":"2024-09-12T17:29:58.778931+0000","last_unstale":"2024-09-12T19:23:01.189986+0000","last_undegraded":"2024-09-12T19:23:01.189986+0000","last_fullsized":"2024-09-12T19:23:01.189986+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:14.544244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":998,"num_read_kb":2327,"num_write":858,"num_write_kb":737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.986697+0000","last_change":"2024-09-12T17:30:00.802806+0000","last_active":"2024-09-12T19:20:02.986697+0000","last_peered":"2024-09-12T19:20:02.986697+0000","last_clean":"2024-09-12T19:20:02.986697+0000","last_became_active":"2024-09-12T17:30:00.802021+0000","last_became_peered":"2024-09-12T17:30:00.802021+0000","last_unstale":"2024-09-12T19:20:02.986697+0000","last_undegraded":"2024-09-12T19:20:02.986697+0000","last_fullsized":"2024-09-12T19:20:02.986697+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:49.504684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'167","reported_seq":710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:43.251407+0000","last_change":"2024-09-12T17:30:02.795603+0000","last_active":"2024-09-12T19:19:43.251407+0000","last_peered":"2024-09-12T19:19:43.251407+0000","last_clean":"2024-09-12T19:19:43.251407+0000","last_became_active":"2024-09-12T17:30:02.794353+0000","last_became_peered":"2024-09-12T17:30:02.794353+0000","last_unstale":"2024-09-12T19:19:43.251407+0000","last_undegraded":"2024-09-12T19:19:43.251407+0000","last_fullsized":"2024-09-12T19:19:43.251407+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:41.683296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":277,"num_read_kb":276,"num_write":376,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'723","reported_seq":2316,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.139310+0000","last_change":"2024-09-12T17:29:54.761432+0000","last_active":"2024-09-12T19:21:19.139310+0000","last_peered":"2024-09-12T19:21:19.139310+0000","last_clean":"2024-09-12T19:21:19.139310+0000","last_became_active":"2024-09-12T17:29:54.761144+0000","last_became_peered":"2024-09-12T17:29:54.761144+0000","last_unstale":"2024-09-12T19:21:19.139310+0000","last_undegraded":"2024-09-12T19:21:19.139310+0000","last_fullsized":"2024-09-12T19:21:19.139310+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":700,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:07.824094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3459,"num_read_kb":3076,"num_write":1006,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'309","reported_seq":927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.848731+0000","last_change":"2024-09-12T17:29:52.742141+0000","last_active":"2024-09-12T19:23:01.848731+0000","last_peered":"2024-09-12T19:23:01.848731+0000","last_clean":"2024-09-12T19:23:01.848731+0000","last_became_active":"2024-09-12T17:29:52.741594+0000","last_became_peered":"2024-09-12T17:29:52.741594+0000","last_unstale":"2024-09-12T19:23:01.848731+0000","last_undegraded":"2024-09-12T19:23:01.848731+0000","last_fullsized":"2024-09-12T19:23:01.848731+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:12.453167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262349,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":376,"num_read_kb":5602,"num_write":913,"num_write_kb":46297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.561587+0000","last_change":"2024-09-12T17:29:56.762091+0000","last_active":"2024-09-12T19:20:23.561587+0000","last_peered":"2024-09-12T19:20:23.561587+0000","last_clean":"2024-09-12T19:20:23.561587+0000","last_became_active":"2024-09-12T17:29:56.761256+0000","last_became_peered":"2024-09-12T17:29:56.761256+0000","last_unstale":"2024-09-12T19:20:23.561587+0000","last_undegraded":"2024-09-12T19:20:23.561587+0000","last_fullsized":"2024-09-12T19:20:23.561587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:38.052214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'389","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.339586+0000","last_change":"2024-09-12T17:29:58.769030+0000","last_active":"2024-09-12T19:23:01.339586+0000","last_peered":"2024-09-12T19:23:01.339586+0000","last_clean":"2024-09-12T19:23:01.339586+0000","last_became_active":"2024-09-12T17:29:58.768310+0000","last_became_peered":"2024-09-12T17:29:58.768310+0000","last_unstale":"2024-09-12T19:23:01.339586+0000","last_undegraded":"2024-09-12T19:23:01.339586+0000","last_fullsized":"2024-09-12T19:23:01.339586+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:31.668084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51217,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":641,"num_read_kb":1226,"num_write":524,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.979690+0000","last_change":"2024-09-12T17:30:00.805417+0000","last_active":"2024-09-12T19:20:02.979690+0000","last_peered":"2024-09-12T19:20:02.979690+0000","last_clean":"2024-09-12T19:20:02.979690+0000","last_became_active":"2024-09-12T17:30:00.804655+0000","last_became_peered":"2024-09-12T17:30:00.804655+0000","last_unstale":"2024-09-12T19:20:02.979690+0000","last_undegraded":"2024-09-12T19:20:02.979690+0000","last_fullsized":"2024-09-12T19:20:02.979690+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:59.390183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'189","reported_seq":1089,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.747208+0000","last_change":"2024-09-12T17:30:02.815235+0000","last_active":"2024-09-12T19:21:21.747208+0000","last_peered":"2024-09-12T19:21:21.747208+0000","last_clean":"2024-09-12T19:21:21.747208+0000","last_became_active":"2024-09-12T17:30:02.813027+0000","last_became_peered":"2024-09-12T17:30:02.813027+0000","last_unstale":"2024-09-12T19:21:21.747208+0000","last_undegraded":"2024-09-12T19:21:21.747208+0000","last_fullsized":"2024-09-12T19:21:21.747208+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:45.419844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2050,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":664,"num_read_kb":654,"num_write":538,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'390","reported_seq":1798,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.254923+0000","last_change":"2024-09-12T17:29:54.757128+0000","last_active":"2024-09-12T19:19:58.254923+0000","last_peered":"2024-09-12T19:19:58.254923+0000","last_clean":"2024-09-12T19:19:58.254923+0000","last_became_active":"2024-09-12T17:29:54.756800+0000","last_became_peered":"2024-09-12T17:29:54.756800+0000","last_unstale":"2024-09-12T19:19:58.254923+0000","last_undegraded":"2024-09-12T19:19:58.254923+0000","last_fullsized":"2024-09-12T19:19:58.254923+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:42.137004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1992,"num_read_kb":1877,"num_write":455,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'311","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.957551+0000","last_change":"2024-09-12T17:29:52.756252+0000","last_active":"2024-09-12T19:23:01.957551+0000","last_peered":"2024-09-12T19:23:01.957551+0000","last_clean":"2024-09-12T19:23:01.957551+0000","last_became_active":"2024-09-12T17:29:52.755401+0000","last_became_peered":"2024-09-12T17:29:52.755401+0000","last_unstale":"2024-09-12T19:23:01.957551+0000","last_undegraded":"2024-09-12T19:23:01.957551+0000","last_fullsized":"2024-09-12T19:23:01.957551+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:19.340127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2036176,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":3663,"num_write":1039,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.195101+0000","last_change":"2024-09-12T17:29:56.759557+0000","last_active":"2024-09-12T19:19:58.195101+0000","last_peered":"2024-09-12T19:19:58.195101+0000","last_clean":"2024-09-12T19:19:58.195101+0000","last_became_active":"2024-09-12T17:29:56.752172+0000","last_became_peered":"2024-09-12T17:29:56.752172+0000","last_unstale":"2024-09-12T19:19:58.195101+0000","last_undegraded":"2024-09-12T19:19:58.195101+0000","last_fullsized":"2024-09-12T19:19:58.195101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:01.184376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'330","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.766853+0000","last_change":"2024-09-12T17:29:58.832518+0000","last_active":"2024-09-12T19:22:59.766853+0000","last_peered":"2024-09-12T19:22:59.766853+0000","last_clean":"2024-09-12T19:22:59.766853+0000","last_became_active":"2024-09-12T17:29:58.831574+0000","last_became_peered":"2024-09-12T17:29:58.831574+0000","last_unstale":"2024-09-12T19:22:59.766853+0000","last_undegraded":"2024-09-12T19:22:59.766853+0000","last_fullsized":"2024-09-12T19:22:59.766853+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:45.202085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49155,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":530,"num_read_kb":1074,"num_write":414,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:32.986123+0000","last_change":"2024-09-12T17:30:00.805560+0000","last_active":"2024-09-12T19:20:32.986123+0000","last_peered":"2024-09-12T19:20:32.986123+0000","last_clean":"2024-09-12T19:20:32.986123+0000","last_became_active":"2024-09-12T17:30:00.804705+0000","last_became_peered":"2024-09-12T17:30:00.804705+0000","last_unstale":"2024-09-12T19:20:32.986123+0000","last_undegraded":"2024-09-12T19:20:32.986123+0000","last_fullsized":"2024-09-12T19:20:32.986123+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:30.654520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'113","reported_seq":624,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.252350+0000","last_change":"2024-09-12T17:30:02.787761+0000","last_active":"2024-09-12T19:22:46.252350+0000","last_peered":"2024-09-12T19:22:46.252350+0000","last_clean":"2024-09-12T19:22:46.252350+0000","last_became_active":"2024-09-12T17:30:02.787038+0000","last_became_peered":"2024-09-12T17:30:02.787038+0000","last_unstale":"2024-09-12T19:22:46.252350+0000","last_undegraded":"2024-09-12T19:22:46.252350+0000","last_fullsized":"2024-09-12T19:22:46.252350+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:46.467512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":121,"num_write":252,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'360","reported_seq":1890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.436578+0000","last_change":"2024-09-12T17:29:54.742127+0000","last_active":"2024-09-12T19:21:21.436578+0000","last_peered":"2024-09-12T19:21:21.436578+0000","last_clean":"2024-09-12T19:21:21.436578+0000","last_became_active":"2024-09-12T17:29:54.741486+0000","last_became_peered":"2024-09-12T17:29:54.741486+0000","last_unstale":"2024-09-12T19:21:21.436578+0000","last_undegraded":"2024-09-12T19:21:21.436578+0000","last_fullsized":"2024-09-12T19:21:21.436578+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:16.184632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1958,"num_read_kb":1901,"num_write":388,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'318","reported_seq":1029,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.832928+0000","last_change":"2024-09-12T17:29:52.767395+0000","last_active":"2024-09-12T19:23:01.832928+0000","last_peered":"2024-09-12T19:23:01.832928+0000","last_clean":"2024-09-12T19:23:01.832928+0000","last_became_active":"2024-09-12T17:29:52.766141+0000","last_became_peered":"2024-09-12T17:29:52.766141+0000","last_unstale":"2024-09-12T19:23:01.832928+0000","last_undegraded":"2024-09-12T19:23:01.832928+0000","last_fullsized":"2024-09-12T19:23:01.832928+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:32.771937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7320708,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":562,"num_read_kb":101880,"num_write":1008,"num_write_kb":18651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"38'5","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.837339+0000","last_change":"2024-09-12T17:29:56.761300+0000","last_active":"2024-09-12T19:22:58.837339+0000","last_peered":"2024-09-12T19:22:58.837339+0000","last_clean":"2024-09-12T19:22:58.837339+0000","last_became_active":"2024-09-12T17:29:56.760505+0000","last_became_peered":"2024-09-12T17:29:56.760505+0000","last_unstale":"2024-09-12T19:22:58.837339+0000","last_undegraded":"2024-09-12T19:22:58.837339+0000","last_fullsized":"2024-09-12T19:22:58.837339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:19.918382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'170","reported_seq":762,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:53.697797+0000","last_change":"2024-09-12T17:29:58.830103+0000","last_active":"2024-09-12T19:20:53.697797+0000","last_peered":"2024-09-12T19:20:53.697797+0000","last_clean":"2024-09-12T19:20:53.697797+0000","last_became_active":"2024-09-12T17:29:58.829023+0000","last_became_peered":"2024-09-12T17:29:58.829023+0000","last_unstale":"2024-09-12T19:20:53.697797+0000","last_undegraded":"2024-09-12T19:20:53.697797+0000","last_fullsized":"2024-09-12T19:20:53.697797+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:27.778582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":218,"num_write":206,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'775","reported_seq":3292,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.324958+0000","last_change":"2024-09-12T17:30:00.787430+0000","last_active":"2024-09-12T19:23:01.324958+0000","last_peered":"2024-09-12T19:23:01.324958+0000","last_clean":"2024-09-12T19:23:01.324958+0000","last_became_active":"2024-09-12T17:30:00.786102+0000","last_became_peered":"2024-09-12T17:30:00.786102+0000","last_unstale":"2024-09-12T19:23:01.324958+0000","last_undegraded":"2024-09-12T19:23:01.324958+0000","last_fullsized":"2024-09-12T19:23:01.324958+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:58.157521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'148","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.288957+0000","last_change":"2024-09-12T17:30:02.804619+0000","last_active":"2024-09-12T19:21:19.288957+0000","last_peered":"2024-09-12T19:21:19.288957+0000","last_clean":"2024-09-12T19:21:19.288957+0000","last_became_active":"2024-09-12T17:30:02.803612+0000","last_became_peered":"2024-09-12T17:30:02.803612+0000","last_unstale":"2024-09-12T19:21:19.288957+0000","last_undegraded":"2024-09-12T19:21:19.288957+0000","last_fullsized":"2024-09-12T19:21:19.288957+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:34.332012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":232,"num_read_kb":219,"num_write":373,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'827","reported_seq":2550,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.933874+0000","last_change":"2024-09-12T17:30:21.699087+0000","last_active":"2024-09-12T19:20:27.933874+0000","last_peered":"2024-09-12T19:20:27.933874+0000","last_clean":"2024-09-12T19:20:27.933874+0000","last_became_active":"2024-09-12T17:30:21.696952+0000","last_became_peered":"2024-09-12T17:30:21.696952+0000","last_unstale":"2024-09-12T19:20:27.933874+0000","last_undegraded":"2024-09-12T19:20:27.933874+0000","last_fullsized":"2024-09-12T19:20:27.933874+0000","mapping_epoch":39,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:14:48.294079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3950,"num_read_kb":3589,"num_write":1060,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'353","reported_seq":1072,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.976090+0000","last_change":"2024-09-12T17:29:52.753703+0000","last_active":"2024-09-12T19:23:01.976090+0000","last_peered":"2024-09-12T19:23:01.976090+0000","last_clean":"2024-09-12T19:23:01.976090+0000","last_became_active":"2024-09-12T17:29:52.749735+0000","last_became_peered":"2024-09-12T17:29:52.749735+0000","last_unstale":"2024-09-12T19:23:01.976090+0000","last_undegraded":"2024-09-12T19:23:01.976090+0000","last_fullsized":"2024-09-12T19:23:01.976090+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:40.802637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437125,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":46392,"num_write":1072,"num_write_kb":51525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.967526+0000","last_change":"2024-09-12T17:29:56.766629+0000","last_active":"2024-09-12T19:19:57.967526+0000","last_peered":"2024-09-12T19:19:57.967526+0000","last_clean":"2024-09-12T19:19:57.967526+0000","last_became_active":"2024-09-12T17:29:56.765909+0000","last_became_peered":"2024-09-12T17:29:56.765909+0000","last_unstale":"2024-09-12T19:19:57.967526+0000","last_undegraded":"2024-09-12T19:19:57.967526+0000","last_fullsized":"2024-09-12T19:19:57.967526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:16.737963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'386","reported_seq":1032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.586459+0000","last_change":"2024-09-12T17:29:58.772348+0000","last_active":"2024-09-12T19:23:00.586459+0000","last_peered":"2024-09-12T19:23:00.586459+0000","last_clean":"2024-09-12T19:23:00.586459+0000","last_became_active":"2024-09-12T17:29:58.771522+0000","last_became_peered":"2024-09-12T17:29:58.771522+0000","last_unstale":"2024-09-12T19:23:00.586459+0000","last_undegraded":"2024-09-12T19:23:00.586459+0000","last_fullsized":"2024-09-12T19:23:00.586459+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:37.869319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46902,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":612,"num_read_kb":1188,"num_write":476,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:48.165589+0000","last_change":"2024-09-12T17:30:00.789334+0000","last_active":"2024-09-12T19:18:48.165589+0000","last_peered":"2024-09-12T19:18:48.165589+0000","last_clean":"2024-09-12T19:18:48.165589+0000","last_became_active":"2024-09-12T17:30:00.788559+0000","last_became_peered":"2024-09-12T17:30:00.788559+0000","last_unstale":"2024-09-12T19:18:48.165589+0000","last_undegraded":"2024-09-12T19:18:48.165589+0000","last_fullsized":"2024-09-12T19:18:48.165589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:23.307242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'116","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:12.986237+0000","last_change":"2024-09-12T17:30:02.807855+0000","last_active":"2024-09-12T19:21:12.986237+0000","last_peered":"2024-09-12T19:21:12.986237+0000","last_clean":"2024-09-12T19:21:12.986237+0000","last_became_active":"2024-09-12T17:30:02.807083+0000","last_became_peered":"2024-09-12T17:30:02.807083+0000","last_unstale":"2024-09-12T19:21:12.986237+0000","last_undegraded":"2024-09-12T19:21:12.986237+0000","last_fullsized":"2024-09-12T19:21:12.986237+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:51.993531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":147,"num_write":283,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'825","reported_seq":2498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.437648+0000","last_change":"2024-09-12T17:29:54.774040+0000","last_active":"2024-09-12T19:21:21.437648+0000","last_peered":"2024-09-12T19:21:21.437648+0000","last_clean":"2024-09-12T19:21:21.437648+0000","last_became_active":"2024-09-12T17:29:54.770569+0000","last_became_peered":"2024-09-12T17:29:54.770569+0000","last_unstale":"2024-09-12T19:21:21.437648+0000","last_undegraded":"2024-09-12T19:21:21.437648+0000","last_fullsized":"2024-09-12T19:21:21.437648+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:01.250678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4029,"num_read_kb":3656,"num_write":1088,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'392","reported_seq":1299,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.975417+0000","last_change":"2024-09-12T17:29:52.750235+0000","last_active":"2024-09-12T19:23:01.975417+0000","last_peered":"2024-09-12T19:23:01.975417+0000","last_clean":"2024-09-12T19:23:01.975417+0000","last_became_active":"2024-09-12T17:29:52.749566+0000","last_became_peered":"2024-09-12T17:29:52.749566+0000","last_unstale":"2024-09-12T19:23:01.975417+0000","last_undegraded":"2024-09-12T19:23:01.975417+0000","last_fullsized":"2024-09-12T19:23:01.975417+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:16.632102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174738,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1171,"num_read_kb":8659,"num_write":1266,"num_write_kb":49806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.985406+0000","last_change":"2024-09-12T17:29:56.768011+0000","last_active":"2024-09-12T19:19:57.985406+0000","last_peered":"2024-09-12T19:19:57.985406+0000","last_clean":"2024-09-12T19:19:57.985406+0000","last_became_active":"2024-09-12T17:29:56.766952+0000","last_became_peered":"2024-09-12T17:29:56.766952+0000","last_unstale":"2024-09-12T19:19:57.985406+0000","last_undegraded":"2024-09-12T19:19:57.985406+0000","last_fullsized":"2024-09-12T19:19:57.985406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:54.137260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'322","reported_seq":938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.669796+0000","last_change":"2024-09-12T17:29:58.783690+0000","last_active":"2024-09-12T19:23:00.669796+0000","last_peered":"2024-09-12T19:23:00.669796+0000","last_clean":"2024-09-12T19:23:00.669796+0000","last_became_active":"2024-09-12T17:29:58.783105+0000","last_became_peered":"2024-09-12T17:29:58.783105+0000","last_unstale":"2024-09-12T19:23:00.669796+0000","last_undegraded":"2024-09-12T19:23:00.669796+0000","last_fullsized":"2024-09-12T19:23:00.669796+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:02.161325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50641,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":544,"num_read_kb":1206,"num_write":440,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.544277+0000","last_change":"2024-09-12T17:30:00.800799+0000","last_active":"2024-09-12T19:19:03.544277+0000","last_peered":"2024-09-12T19:19:03.544277+0000","last_clean":"2024-09-12T19:19:03.544277+0000","last_became_active":"2024-09-12T17:30:00.799680+0000","last_became_peered":"2024-09-12T17:30:00.799680+0000","last_unstale":"2024-09-12T19:19:03.544277+0000","last_undegraded":"2024-09-12T19:19:03.544277+0000","last_fullsized":"2024-09-12T19:19:03.544277+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:13.337531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'130","reported_seq":684,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:48.237923+0000","last_change":"2024-09-12T17:30:02.787080+0000","last_active":"2024-09-12T19:18:48.237923+0000","last_peered":"2024-09-12T19:18:48.237923+0000","last_clean":"2024-09-12T19:18:48.237923+0000","last_became_active":"2024-09-12T17:30:02.786478+0000","last_became_peered":"2024-09-12T17:30:02.786478+0000","last_unstale":"2024-09-12T19:18:48.237923+0000","last_undegraded":"2024-09-12T19:18:48.237923+0000","last_fullsized":"2024-09-12T19:18:48.237923+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:32.030701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":240,"num_read_kb":229,"num_write":300,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'976","reported_seq":2759,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.994489+0000","last_change":"2024-09-12T17:29:54.762247+0000","last_active":"2024-09-12T19:22:44.994489+0000","last_peered":"2024-09-12T19:22:44.994489+0000","last_clean":"2024-09-12T19:22:44.994489+0000","last_became_active":"2024-09-12T17:29:54.761902+0000","last_became_peered":"2024-09-12T17:29:54.761902+0000","last_unstale":"2024-09-12T19:22:44.994489+0000","last_undegraded":"2024-09-12T19:22:44.994489+0000","last_fullsized":"2024-09-12T19:22:44.994489+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":900,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:57.000138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4608,"num_read_kb":4133,"num_write":1300,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'320","reported_seq":977,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.897840+0000","last_change":"2024-09-12T17:29:52.733633+0000","last_active":"2024-09-12T19:23:01.897840+0000","last_peered":"2024-09-12T19:23:01.897840+0000","last_clean":"2024-09-12T19:23:01.897840+0000","last_became_active":"2024-09-12T17:29:52.733119+0000","last_became_peered":"2024-09-12T17:29:52.733119+0000","last_unstale":"2024-09-12T19:23:01.897840+0000","last_undegraded":"2024-09-12T19:23:01.897840+0000","last_fullsized":"2024-09-12T19:23:01.897840+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:07.270536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":457,"num_read_kb":1565,"num_write":1142,"num_write_kb":34702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.177481+0000","last_change":"2024-09-12T17:29:56.761445+0000","last_active":"2024-09-12T19:18:43.177481+0000","last_peered":"2024-09-12T19:18:43.177481+0000","last_clean":"2024-09-12T19:18:43.177481+0000","last_became_active":"2024-09-12T17:29:56.760142+0000","last_became_peered":"2024-09-12T17:29:56.760142+0000","last_unstale":"2024-09-12T19:18:43.177481+0000","last_undegraded":"2024-09-12T19:18:43.177481+0000","last_fullsized":"2024-09-12T19:18:43.177481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:58.137646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'274","reported_seq":868,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.592999+0000","last_change":"2024-09-12T17:29:58.775954+0000","last_active":"2024-09-12T19:22:59.592999+0000","last_peered":"2024-09-12T19:22:59.592999+0000","last_clean":"2024-09-12T19:22:59.592999+0000","last_became_active":"2024-09-12T17:29:58.775284+0000","last_became_peered":"2024-09-12T17:29:58.775284+0000","last_unstale":"2024-09-12T19:22:59.592999+0000","last_undegraded":"2024-09-12T19:22:59.592999+0000","last_fullsized":"2024-09-12T19:22:59.592999+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:04.232747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44259,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":428,"num_read_kb":949,"num_write":354,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.196243+0000","last_change":"2024-09-12T17:30:00.791617+0000","last_active":"2024-09-12T19:20:03.196243+0000","last_peered":"2024-09-12T19:20:03.196243+0000","last_clean":"2024-09-12T19:20:03.196243+0000","last_became_active":"2024-09-12T17:30:00.790907+0000","last_became_peered":"2024-09-12T17:30:00.790907+0000","last_unstale":"2024-09-12T19:20:03.196243+0000","last_undegraded":"2024-09-12T19:20:03.196243+0000","last_fullsized":"2024-09-12T19:20:03.196243+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:40.769544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'156","reported_seq":1270,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:13.192105+0000","last_change":"2024-09-12T17:30:02.813564+0000","last_active":"2024-09-12T19:21:13.192105+0000","last_peered":"2024-09-12T19:21:13.192105+0000","last_clean":"2024-09-12T19:21:13.192105+0000","last_became_active":"2024-09-12T17:30:02.812918+0000","last_became_peered":"2024-09-12T17:30:02.812918+0000","last_unstale":"2024-09-12T19:21:13.192105+0000","last_undegraded":"2024-09-12T19:21:13.192105+0000","last_fullsized":"2024-09-12T19:21:13.192105+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:30.419361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":804,"num_write":370,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'756","reported_seq":2286,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.177531+0000","last_change":"2024-09-12T17:29:54.768778+0000","last_active":"2024-09-12T19:18:43.177531+0000","last_peered":"2024-09-12T19:18:43.177531+0000","last_clean":"2024-09-12T19:18:43.177531+0000","last_became_active":"2024-09-12T17:29:54.767573+0000","last_became_peered":"2024-09-12T17:29:54.767573+0000","last_unstale":"2024-09-12T19:18:43.177531+0000","last_undegraded":"2024-09-12T19:18:43.177531+0000","last_fullsized":"2024-09-12T19:18:43.177531+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:31.066680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3552,"num_read_kb":3227,"num_write":976,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'365","reported_seq":1234,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:07.925988+0000","last_change":"2024-09-12T19:23:07.925988+0000","last_active":"2024-09-12T19:23:07.925988+0000","last_peered":"2024-09-12T19:23:07.925988+0000","last_clean":"2024-09-12T19:23:07.925988+0000","last_became_active":"2024-09-12T17:29:52.765692+0000","last_became_peered":"2024-09-12T17:29:52.765692+0000","last_unstale":"2024-09-12T19:23:07.925988+0000","last_undegraded":"2024-09-12T19:23:07.925988+0000","last_fullsized":"2024-09-12T19:23:07.925988+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'365","last_scrub_stamp":"2024-09-12T19:23:07.925864+0000","last_deep_scrub":"267'365","last_deep_scrub_stamp":"2024-09-12T19:23:07.925864+0000","last_clean_scrub_stamp":"2024-09-12T19:23:07.925864+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:17.489429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110874,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":771,"num_read_kb":82698,"num_write":1110,"num_write_kb":56258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:12.968197+0000","last_change":"2024-09-12T17:29:56.761088+0000","last_active":"2024-09-12T19:19:12.968197+0000","last_peered":"2024-09-12T19:19:12.968197+0000","last_clean":"2024-09-12T19:19:12.968197+0000","last_became_active":"2024-09-12T17:29:56.760345+0000","last_became_peered":"2024-09-12T17:29:56.760345+0000","last_unstale":"2024-09-12T19:19:12.968197+0000","last_undegraded":"2024-09-12T19:19:12.968197+0000","last_fullsized":"2024-09-12T19:19:12.968197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:02.802366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'344","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.856112+0000","last_change":"2024-09-12T17:29:58.769661+0000","last_active":"2024-09-12T19:22:59.856112+0000","last_peered":"2024-09-12T19:22:59.856112+0000","last_clean":"2024-09-12T19:22:59.856112+0000","last_became_active":"2024-09-12T17:29:58.768812+0000","last_became_peered":"2024-09-12T17:29:58.768812+0000","last_unstale":"2024-09-12T19:22:59.856112+0000","last_undegraded":"2024-09-12T19:22:59.856112+0000","last_fullsized":"2024-09-12T19:22:59.856112+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:55.549725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46003,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1072,"num_write":420,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.185932+0000","last_change":"2024-09-12T17:30:00.786938+0000","last_active":"2024-09-12T19:20:03.185932+0000","last_peered":"2024-09-12T19:20:03.185932+0000","last_clean":"2024-09-12T19:20:03.185932+0000","last_became_active":"2024-09-12T17:30:00.786100+0000","last_became_peered":"2024-09-12T17:30:00.786100+0000","last_unstale":"2024-09-12T19:20:03.185932+0000","last_undegraded":"2024-09-12T19:20:03.185932+0000","last_fullsized":"2024-09-12T19:20:03.185932+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:07.158524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'138","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.989412+0000","last_change":"2024-09-12T17:30:02.808784+0000","last_active":"2024-09-12T19:22:44.989412+0000","last_peered":"2024-09-12T19:22:44.989412+0000","last_clean":"2024-09-12T19:22:44.989412+0000","last_became_active":"2024-09-12T17:30:02.807953+0000","last_became_peered":"2024-09-12T17:30:02.807953+0000","last_unstale":"2024-09-12T19:22:44.989412+0000","last_undegraded":"2024-09-12T19:22:44.989412+0000","last_fullsized":"2024-09-12T19:22:44.989412+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:19.588574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216,"num_read_kb":199,"num_write":346,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'852","reported_seq":2464,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.442108+0000","last_change":"2024-09-12T17:29:54.768750+0000","last_active":"2024-09-12T19:21:21.442108+0000","last_peered":"2024-09-12T19:21:21.442108+0000","last_clean":"2024-09-12T19:21:21.442108+0000","last_became_active":"2024-09-12T17:29:54.768439+0000","last_became_peered":"2024-09-12T17:29:54.768439+0000","last_unstale":"2024-09-12T19:21:21.442108+0000","last_undegraded":"2024-09-12T19:21:21.442108+0000","last_fullsized":"2024-09-12T19:21:21.442108+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:29.593777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3940,"num_read_kb":3539,"num_write":1104,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'384","reported_seq":1074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.974510+0000","last_change":"2024-09-12T17:29:52.738990+0000","last_active":"2024-09-12T19:23:01.974510+0000","last_peered":"2024-09-12T19:23:01.974510+0000","last_clean":"2024-09-12T19:23:01.974510+0000","last_became_active":"2024-09-12T17:29:52.732894+0000","last_became_peered":"2024-09-12T17:29:52.732894+0000","last_unstale":"2024-09-12T19:23:01.974510+0000","last_undegraded":"2024-09-12T19:23:01.974510+0000","last_fullsized":"2024-09-12T19:23:01.974510+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:05.898096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":583,"num_read_kb":27715,"num_write":1278,"num_write_kb":46649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'495","reported_seq":1986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.006107+0000","last_change":"2024-09-12T17:29:54.747526+0000","last_active":"2024-09-12T19:22:45.006107+0000","last_peered":"2024-09-12T19:22:45.006107+0000","last_clean":"2024-09-12T19:22:45.006107+0000","last_became_active":"2024-09-12T17:29:54.745192+0000","last_became_peered":"2024-09-12T17:29:54.745192+0000","last_unstale":"2024-09-12T19:22:45.006107+0000","last_undegraded":"2024-09-12T19:22:45.006107+0000","last_fullsized":"2024-09-12T19:22:45.006107+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:58:53.534036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2446,"num_read_kb":2266,"num_write":619,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'407","reported_seq":1141,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.963431+0000","last_change":"2024-09-12T17:29:52.728474+0000","last_active":"2024-09-12T19:23:01.963431+0000","last_peered":"2024-09-12T19:23:01.963431+0000","last_clean":"2024-09-12T19:23:01.963431+0000","last_became_active":"2024-09-12T17:29:52.727433+0000","last_became_peered":"2024-09-12T17:29:52.727433+0000","last_unstale":"2024-09-12T19:23:01.963431+0000","last_undegraded":"2024-09-12T19:23:01.963431+0000","last_fullsized":"2024-09-12T19:23:01.963431+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:45.539010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":690,"num_read_kb":95087,"num_write":1289,"num_write_kb":35037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'393","reported_seq":1964,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.992422+0000","last_change":"2024-09-12T17:29:54.764069+0000","last_active":"2024-09-12T19:20:27.992422+0000","last_peered":"2024-09-12T19:20:27.992422+0000","last_clean":"2024-09-12T19:20:27.992422+0000","last_became_active":"2024-09-12T17:29:54.762400+0000","last_became_peered":"2024-09-12T17:29:54.762400+0000","last_unstale":"2024-09-12T19:20:27.992422+0000","last_undegraded":"2024-09-12T19:20:27.992422+0000","last_fullsized":"2024-09-12T19:20:27.992422+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:34.051350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2164,"num_read_kb":2073,"num_write":429,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'404","reported_seq":1120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.969671+0000","last_change":"2024-09-12T17:29:52.761477+0000","last_active":"2024-09-12T19:23:01.969671+0000","last_peered":"2024-09-12T19:23:01.969671+0000","last_clean":"2024-09-12T19:23:01.969671+0000","last_became_active":"2024-09-12T17:29:52.756626+0000","last_became_peered":"2024-09-12T17:29:52.756626+0000","last_unstale":"2024-09-12T19:23:01.969671+0000","last_undegraded":"2024-09-12T19:23:01.969671+0000","last_fullsized":"2024-09-12T19:23:01.969671+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:06.453259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":688,"num_read_kb":25414,"num_write":1427,"num_write_kb":18603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'782","reported_seq":2452,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.140613+0000","last_change":"2024-09-12T17:29:54.749594+0000","last_active":"2024-09-12T19:21:19.140613+0000","last_peered":"2024-09-12T19:21:19.140613+0000","last_clean":"2024-09-12T19:21:19.140613+0000","last_became_active":"2024-09-12T17:29:54.749249+0000","last_became_peered":"2024-09-12T17:29:54.749249+0000","last_unstale":"2024-09-12T19:21:19.140613+0000","last_undegraded":"2024-09-12T19:21:19.140613+0000","last_fullsized":"2024-09-12T19:21:19.140613+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:55.915159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3916,"num_read_kb":3572,"num_write":1026,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'306","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.958263+0000","last_change":"2024-09-12T17:29:52.767576+0000","last_active":"2024-09-12T19:23:01.958263+0000","last_peered":"2024-09-12T19:23:01.958263+0000","last_clean":"2024-09-12T19:23:01.958263+0000","last_became_active":"2024-09-12T17:29:52.767047+0000","last_became_peered":"2024-09-12T17:29:52.767047+0000","last_unstale":"2024-09-12T19:23:01.958263+0000","last_undegraded":"2024-09-12T19:23:01.958263+0000","last_fullsized":"2024-09-12T19:23:01.958263+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:22:01.748288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900516,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":422,"num_read_kb":21273,"num_write":1050,"num_write_kb":35522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'491","reported_seq":2152,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:48.268636+0000","last_change":"2024-09-12T17:29:54.763106+0000","last_active":"2024-09-12T19:20:48.268636+0000","last_peered":"2024-09-12T19:20:48.268636+0000","last_clean":"2024-09-12T19:20:48.268636+0000","last_became_active":"2024-09-12T17:29:54.762667+0000","last_became_peered":"2024-09-12T17:29:54.762667+0000","last_unstale":"2024-09-12T19:20:48.268636+0000","last_undegraded":"2024-09-12T19:20:48.268636+0000","last_fullsized":"2024-09-12T19:20:48.268636+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:57.057096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2506,"num_read_kb":2365,"num_write":559,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'353","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.858808+0000","last_change":"2024-09-12T17:29:52.768451+0000","last_active":"2024-09-12T19:23:01.858808+0000","last_peered":"2024-09-12T19:23:01.858808+0000","last_clean":"2024-09-12T19:23:01.858808+0000","last_became_active":"2024-09-12T17:29:52.765692+0000","last_became_peered":"2024-09-12T17:29:52.765692+0000","last_unstale":"2024-09-12T19:23:01.858808+0000","last_undegraded":"2024-09-12T19:23:01.858808+0000","last_fullsized":"2024-09-12T19:23:01.858808+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:48.428826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992395,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":536,"num_read_kb":21751,"num_write":1010,"num_write_kb":25522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'959","reported_seq":2733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.201114+0000","last_change":"2024-09-12T17:29:54.770999+0000","last_active":"2024-09-12T19:20:23.201114+0000","last_peered":"2024-09-12T19:20:23.201114+0000","last_clean":"2024-09-12T19:20:23.201114+0000","last_became_active":"2024-09-12T17:29:54.769223+0000","last_became_peered":"2024-09-12T17:29:54.769223+0000","last_unstale":"2024-09-12T19:20:23.201114+0000","last_undegraded":"2024-09-12T19:20:23.201114+0000","last_fullsized":"2024-09-12T19:20:23.201114+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":900,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:48.896632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4532,"num_read_kb":4067,"num_write":1265,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'312","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.905057+0000","last_change":"2024-09-12T17:29:52.729350+0000","last_active":"2024-09-12T19:23:01.905057+0000","last_peered":"2024-09-12T19:23:01.905057+0000","last_clean":"2024-09-12T19:23:01.905057+0000","last_became_active":"2024-09-12T17:29:52.728523+0000","last_became_peered":"2024-09-12T17:29:52.728523+0000","last_unstale":"2024-09-12T19:23:01.905057+0000","last_undegraded":"2024-09-12T19:23:01.905057+0000","last_fullsized":"2024-09-12T19:23:01.905057+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:38.562226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":2514,"num_write":1024,"num_write_kb":45573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'964","reported_seq":2656,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.899595+0000","last_change":"2024-09-12T17:29:54.759369+0000","last_active":"2024-09-12T19:21:55.899595+0000","last_peered":"2024-09-12T19:21:55.899595+0000","last_clean":"2024-09-12T19:21:55.899595+0000","last_became_active":"2024-09-12T17:29:54.758687+0000","last_became_peered":"2024-09-12T17:29:54.758687+0000","last_unstale":"2024-09-12T19:21:55.899595+0000","last_undegraded":"2024-09-12T19:21:55.899595+0000","last_fullsized":"2024-09-12T19:21:55.899595+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":900,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:12.470932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4571,"num_read_kb":4077,"num_write":1316,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'354","reported_seq":1032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.980365+0000","last_change":"2024-09-12T17:29:52.719880+0000","last_active":"2024-09-12T19:23:01.980365+0000","last_peered":"2024-09-12T19:23:01.980365+0000","last_clean":"2024-09-12T19:23:01.980365+0000","last_became_active":"2024-09-12T17:29:52.718689+0000","last_became_peered":"2024-09-12T17:29:52.718689+0000","last_unstale":"2024-09-12T19:23:01.980365+0000","last_undegraded":"2024-09-12T19:23:01.980365+0000","last_fullsized":"2024-09-12T19:23:01.980365+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:01.173987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":521,"num_read_kb":13386,"num_write":1097,"num_write_kb":27082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'1290","reported_seq":2901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.561396+0000","last_change":"2024-09-12T17:29:54.765637+0000","last_active":"2024-09-12T19:20:23.561396+0000","last_peered":"2024-09-12T19:20:23.561396+0000","last_clean":"2024-09-12T19:20:23.561396+0000","last_became_active":"2024-09-12T17:29:54.764876+0000","last_became_peered":"2024-09-12T17:29:54.764876+0000","last_unstale":"2024-09-12T19:20:23.561396+0000","last_undegraded":"2024-09-12T19:20:23.561396+0000","last_fullsized":"2024-09-12T19:20:23.561396+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":1200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:13.358482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5917,"num_read_kb":5200,"num_write":1797,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'408","reported_seq":1083,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.978833+0000","last_change":"2024-09-12T17:29:52.769653+0000","last_active":"2024-09-12T19:23:01.978833+0000","last_peered":"2024-09-12T19:23:01.978833+0000","last_clean":"2024-09-12T19:23:01.978833+0000","last_became_active":"2024-09-12T17:29:52.769086+0000","last_became_peered":"2024-09-12T17:29:52.769086+0000","last_unstale":"2024-09-12T19:23:01.978833+0000","last_undegraded":"2024-09-12T19:23:01.978833+0000","last_fullsized":"2024-09-12T19:23:01.978833+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:03.761062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730154,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":563,"num_read_kb":7699,"num_write":1244,"num_write_kb":36052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"267'894","reported_seq":2482,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:55.901241+0000","last_change":"2024-09-12T17:29:54.760165+0000","last_active":"2024-09-12T19:21:55.901241+0000","last_peered":"2024-09-12T19:21:55.901241+0000","last_clean":"2024-09-12T19:21:55.901241+0000","last_became_active":"2024-09-12T17:29:54.759892+0000","last_became_peered":"2024-09-12T17:29:54.759892+0000","last_unstale":"2024-09-12T19:21:55.901241+0000","last_undegraded":"2024-09-12T19:21:55.901241+0000","last_fullsized":"2024-09-12T19:21:55.901241+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":800,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:50.901074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4227,"num_read_kb":3797,"num_write":1212,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'326","reported_seq":966,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.964273+0000","last_change":"2024-09-12T17:29:52.750118+0000","last_active":"2024-09-12T19:23:01.964273+0000","last_peered":"2024-09-12T19:23:01.964273+0000","last_clean":"2024-09-12T19:23:01.964273+0000","last_became_active":"2024-09-12T17:29:52.748790+0000","last_became_peered":"2024-09-12T17:29:52.748790+0000","last_unstale":"2024-09-12T19:23:01.964273+0000","last_undegraded":"2024-09-12T19:23:01.964273+0000","last_fullsized":"2024-09-12T19:23:01.964273+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:59.925499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":434,"num_read_kb":14399,"num_write":1080,"num_write_kb":30402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'1651","reported_seq":3218,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.025784+0000","last_change":"2024-09-12T17:29:54.755458+0000","last_active":"2024-09-12T19:22:45.025784+0000","last_peered":"2024-09-12T19:22:45.025784+0000","last_clean":"2024-09-12T19:22:45.025784+0000","last_became_active":"2024-09-12T17:29:54.754702+0000","last_became_peered":"2024-09-12T17:29:54.754702+0000","last_unstale":"2024-09-12T19:22:45.025784+0000","last_undegraded":"2024-09-12T19:22:45.025784+0000","last_fullsized":"2024-09-12T19:22:45.025784+0000","mapping_epoch":28,"log_start":"267'1600","ondisk_log_start":"267'1600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":1600,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:29.268644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7245,"num_read_kb":6284,"num_write":2371,"num_write_kb":1100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'306","reported_seq":972,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.959565+0000","last_change":"2024-09-12T17:29:52.768556+0000","last_active":"2024-09-12T19:23:01.959565+0000","last_peered":"2024-09-12T19:23:01.959565+0000","last_clean":"2024-09-12T19:23:01.959565+0000","last_became_active":"2024-09-12T17:29:52.767990+0000","last_became_peered":"2024-09-12T17:29:52.767990+0000","last_unstale":"2024-09-12T19:23:01.959565+0000","last_undegraded":"2024-09-12T19:23:01.959565+0000","last_fullsized":"2024-09-12T19:23:01.959565+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:04.577061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":644,"num_write":1033,"num_write_kb":10844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'933","reported_seq":2506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.017536+0000","last_change":"2024-09-12T17:29:54.759508+0000","last_active":"2024-09-12T19:22:45.017536+0000","last_peered":"2024-09-12T19:22:45.017536+0000","last_clean":"2024-09-12T19:22:45.017536+0000","last_became_active":"2024-09-12T17:29:54.759169+0000","last_became_peered":"2024-09-12T17:29:54.759169+0000","last_unstale":"2024-09-12T19:22:45.017536+0000","last_undegraded":"2024-09-12T19:22:45.017536+0000","last_fullsized":"2024-09-12T19:22:45.017536+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":900,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:45.168551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4504,"num_read_kb":3992,"num_write":1315,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'297","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.954118+0000","last_change":"2024-09-12T17:29:52.757191+0000","last_active":"2024-09-12T19:23:01.954118+0000","last_peered":"2024-09-12T19:23:01.954118+0000","last_clean":"2024-09-12T19:23:01.954118+0000","last_became_active":"2024-09-12T17:29:52.753935+0000","last_became_peered":"2024-09-12T17:29:52.753935+0000","last_unstale":"2024-09-12T19:23:01.954118+0000","last_undegraded":"2024-09-12T19:23:01.954118+0000","last_fullsized":"2024-09-12T19:23:01.954118+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:29.050781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340668,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":430,"num_read_kb":10673,"num_write":974,"num_write_kb":41601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'834","reported_seq":2496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.014092+0000","last_change":"2024-09-12T17:29:54.761668+0000","last_active":"2024-09-12T19:22:45.014092+0000","last_peered":"2024-09-12T19:22:45.014092+0000","last_clean":"2024-09-12T19:22:45.014092+0000","last_became_active":"2024-09-12T17:29:54.760784+0000","last_became_peered":"2024-09-12T17:29:54.760784+0000","last_unstale":"2024-09-12T19:22:45.014092+0000","last_undegraded":"2024-09-12T19:22:45.014092+0000","last_fullsized":"2024-09-12T19:22:45.014092+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:25.364138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4062,"num_read_kb":3682,"num_write":1062,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'490","reported_seq":1212,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.951581+0000","last_change":"2024-09-12T17:29:52.735767+0000","last_active":"2024-09-12T19:23:01.951581+0000","last_peered":"2024-09-12T19:23:01.951581+0000","last_clean":"2024-09-12T19:23:01.951581+0000","last_became_active":"2024-09-12T17:29:52.735333+0000","last_became_peered":"2024-09-12T17:29:52.735333+0000","last_unstale":"2024-09-12T19:23:01.951581+0000","last_undegraded":"2024-09-12T19:23:01.951581+0000","last_fullsized":"2024-09-12T19:23:01.951581+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:56.415475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":869,"num_read_kb":5832,"num_write":1431,"num_write_kb":32355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'864","reported_seq":2443,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:45.002468+0000","last_change":"2024-09-12T17:29:54.754343+0000","last_active":"2024-09-12T19:22:45.002468+0000","last_peered":"2024-09-12T19:22:45.002468+0000","last_clean":"2024-09-12T19:22:45.002468+0000","last_became_active":"2024-09-12T17:29:54.753635+0000","last_became_peered":"2024-09-12T17:29:54.753635+0000","last_unstale":"2024-09-12T19:22:45.002468+0000","last_undegraded":"2024-09-12T19:22:45.002468+0000","last_fullsized":"2024-09-12T19:22:45.002468+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":800,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:06.006688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4079,"num_read_kb":3651,"num_write":1151,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'312","reported_seq":1068,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.943603+0000","last_change":"2024-09-12T17:29:52.745226+0000","last_active":"2024-09-12T19:23:01.943603+0000","last_peered":"2024-09-12T19:23:01.943603+0000","last_clean":"2024-09-12T19:23:01.943603+0000","last_became_active":"2024-09-12T17:29:52.744397+0000","last_became_peered":"2024-09-12T17:29:52.744397+0000","last_unstale":"2024-09-12T19:23:01.943603+0000","last_undegraded":"2024-09-12T19:23:01.943603+0000","last_fullsized":"2024-09-12T19:23:01.943603+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:30.018286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170396,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":764,"num_read_kb":16845,"num_write":1041,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'473","reported_seq":2099,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.925933+0000","last_change":"2024-09-12T17:29:54.752376+0000","last_active":"2024-09-12T19:20:27.925933+0000","last_peered":"2024-09-12T19:20:27.925933+0000","last_clean":"2024-09-12T19:20:27.925933+0000","last_became_active":"2024-09-12T17:29:54.751872+0000","last_became_peered":"2024-09-12T17:29:54.751872+0000","last_unstale":"2024-09-12T19:20:27.925933+0000","last_undegraded":"2024-09-12T19:20:27.925933+0000","last_fullsized":"2024-09-12T19:20:27.925933+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:26.641497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2533,"num_read_kb":2381,"num_write":539,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'294","reported_seq":923,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.985448+0000","last_change":"2024-09-12T17:29:52.751477+0000","last_active":"2024-09-12T19:23:01.985448+0000","last_peered":"2024-09-12T19:23:01.985448+0000","last_clean":"2024-09-12T19:23:01.985448+0000","last_became_active":"2024-09-12T17:29:52.747688+0000","last_became_peered":"2024-09-12T17:29:52.747688+0000","last_unstale":"2024-09-12T19:23:01.985448+0000","last_undegraded":"2024-09-12T19:23:01.985448+0000","last_fullsized":"2024-09-12T19:23:01.985448+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:59.598093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262281,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":403,"num_read_kb":6219,"num_write":990,"num_write_kb":21267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'427","reported_seq":1940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.258996+0000","last_change":"2024-09-12T17:29:54.760829+0000","last_active":"2024-09-12T19:20:13.258996+0000","last_peered":"2024-09-12T19:20:13.258996+0000","last_clean":"2024-09-12T19:20:13.258996+0000","last_became_active":"2024-09-12T17:29:54.760373+0000","last_became_peered":"2024-09-12T17:29:54.760373+0000","last_unstale":"2024-09-12T19:20:13.258996+0000","last_undegraded":"2024-09-12T19:20:13.258996+0000","last_fullsized":"2024-09-12T19:20:13.258996+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:05.548951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2333,"num_read_kb":2181,"num_write":522,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'333","reported_seq":1028,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.866951+0000","last_change":"2024-09-12T17:29:52.747300+0000","last_active":"2024-09-12T19:23:01.866951+0000","last_peered":"2024-09-12T19:23:01.866951+0000","last_clean":"2024-09-12T19:23:01.866951+0000","last_became_active":"2024-09-12T17:29:52.746880+0000","last_became_peered":"2024-09-12T17:29:52.746880+0000","last_unstale":"2024-09-12T19:23:01.866951+0000","last_undegraded":"2024-09-12T19:23:01.866951+0000","last_fullsized":"2024-09-12T19:23:01.866951+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:38.876679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399180,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":70822,"num_write":1091,"num_write_kb":52448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'787","reported_seq":2445,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:47.979536+0000","last_change":"2024-09-12T17:29:54.766132+0000","last_active":"2024-09-12T19:20:47.979536+0000","last_peered":"2024-09-12T19:20:47.979536+0000","last_clean":"2024-09-12T19:20:47.979536+0000","last_became_active":"2024-09-12T17:29:54.765197+0000","last_became_peered":"2024-09-12T17:29:54.765197+0000","last_unstale":"2024-09-12T19:20:47.979536+0000","last_undegraded":"2024-09-12T19:20:47.979536+0000","last_fullsized":"2024-09-12T19:20:47.979536+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:06.211284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3968,"num_read_kb":3617,"num_write":1032,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'309","reported_seq":963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.968746+0000","last_change":"2024-09-12T17:29:52.753447+0000","last_active":"2024-09-12T19:23:01.968746+0000","last_peered":"2024-09-12T19:23:01.968746+0000","last_clean":"2024-09-12T19:23:01.968746+0000","last_became_active":"2024-09-12T17:29:52.749742+0000","last_became_peered":"2024-09-12T17:29:52.749742+0000","last_unstale":"2024-09-12T19:23:01.968746+0000","last_undegraded":"2024-09-12T19:23:01.968746+0000","last_fullsized":"2024-09-12T19:23:01.968746+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:57.718662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":13262,"num_write":1037,"num_write_kb":35239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'334","reported_seq":980,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.906142+0000","last_change":"2024-09-12T17:29:52.722769+0000","last_active":"2024-09-12T19:23:01.906142+0000","last_peered":"2024-09-12T19:23:01.906142+0000","last_clean":"2024-09-12T19:23:01.906142+0000","last_became_active":"2024-09-12T17:29:52.720918+0000","last_became_peered":"2024-09-12T17:29:52.720918+0000","last_unstale":"2024-09-12T19:23:01.906142+0000","last_undegraded":"2024-09-12T19:23:01.906142+0000","last_fullsized":"2024-09-12T19:23:01.906142+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:33.296017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170702,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":3934,"num_write":1046,"num_write_kb":9633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'599","reported_seq":2184,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:28.207331+0000","last_change":"2024-09-12T17:29:54.758143+0000","last_active":"2024-09-12T19:21:28.207331+0000","last_peered":"2024-09-12T19:21:28.207331+0000","last_clean":"2024-09-12T19:21:28.207331+0000","last_became_active":"2024-09-12T17:29:54.752553+0000","last_became_peered":"2024-09-12T17:29:54.752553+0000","last_unstale":"2024-09-12T19:21:28.207331+0000","last_undegraded":"2024-09-12T19:21:28.207331+0000","last_fullsized":"2024-09-12T19:21:28.207331+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:19.216701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3060,"num_read_kb":2784,"num_write":774,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'400","reported_seq":1086,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.952320+0000","last_change":"2024-09-12T17:30:22.255466+0000","last_active":"2024-09-12T19:23:01.952320+0000","last_peered":"2024-09-12T19:23:01.952320+0000","last_clean":"2024-09-12T19:23:01.952320+0000","last_became_active":"2024-09-12T17:30:22.254863+0000","last_became_peered":"2024-09-12T17:30:22.254863+0000","last_unstale":"2024-09-12T19:23:01.952320+0000","last_undegraded":"2024-09-12T19:23:01.952320+0000","last_fullsized":"2024-09-12T19:23:01.952320+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:51.659189+0000","last_clean_scrub_stamp":"2024-09-12T17:29:51.659189+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:14.162185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992370,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":655,"num_read_kb":2597,"num_write":1307,"num_write_kb":14489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5,0],"acting":[1,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'444","reported_seq":1944,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:08.001889+0000","last_change":"2024-09-12T17:29:54.764546+0000","last_active":"2024-09-12T19:21:08.001889+0000","last_peered":"2024-09-12T19:21:08.001889+0000","last_clean":"2024-09-12T19:21:08.001889+0000","last_became_active":"2024-09-12T17:29:54.763613+0000","last_became_peered":"2024-09-12T17:29:54.763613+0000","last_unstale":"2024-09-12T19:21:08.001889+0000","last_undegraded":"2024-09-12T19:21:08.001889+0000","last_fullsized":"2024-09-12T19:21:08.001889+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:27.590175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2478,"num_read_kb":2322,"num_write":560,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5989,"num_read_kb":4199,"num_write":1940,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1011,"ondisk_log_size":1011,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16341,"num_read_kb":15997,"num_write":16735,"num_write_kb":4892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1670,"ondisk_log_size":1670,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":471,"ondisk_log_size":471,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1542315,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":20962,"num_read_kb":40263,"num_write":17485,"num_write_kb":12367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1882,"ondisk_log_size":1882,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212845,"num_read_kb":194484,"num_write":55296,"num_write_kb":18842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3814,"ondisk_log_size":3814,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":66041020,"num_objects":366,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":366,"num_whiteouts":0,"num_read":36181,"num_read_kb":1906096,"num_write":71498,"num_write_kb":2114280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90423296,"data_stored":90423296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3830,"ondisk_log_size":3830,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":168420,"num_write":154,"num_write_kb":116143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":174519,"num_write":154,"num_write_kb":116143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543513,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316832,"kb_used_data":14740,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94055008,"statfs":{"total":96636764160,"available":96312328192,"internally_reserved":0,"allocated":15093760,"data_stored":13085472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":309131722},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543519,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296832,"kb_used_data":12976,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94075008,"statfs":{"total":96636764160,"available":96332808192,"internally_reserved":0,"allocated":13287424,"data_stored":11310974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":290650566},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543512,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177360,"kb_used_data":11368,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94194480,"statfs":{"total":96636764160,"available":96455147520,"internally_reserved":0,"allocated":11640832,"data_stored":9617929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543514,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161488,"kb_used_data":17856,"kb_used_omap":1,"kb_used_meta":143614,"kb_avail":94210352,"statfs":{"total":96636764160,"available":96471400448,"internally_reserved":0,"allocated":18284544,"data_stored":16335473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":147061189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543513,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311000,"kb_used_data":18688,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":94060840,"statfs":{"total":96636764160,"available":96318300160,"internally_reserved":0,"allocated":19136512,"data_stored":17127576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":299170247},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543515,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122504,"kb_used_data":14968,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94249336,"statfs":{"total":96636764160,"available":96511320064,"internally_reserved":0,"allocated":15327232,"data_stored":13358682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543511,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":196084,"kb_used_data":16420,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94175756,"statfs":{"total":96636764160,"available":96435974144,"internally_reserved":0,"allocated":16814080,"data_stored":14841351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543513,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299704,"kb_used_data":15912,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":94072136,"statfs":{"total":96636764160,"available":96329867264,"internally_reserved":0,"allocated":16293888,"data_stored":14257873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":290585029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11374592,"data_stored":11374592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12550144,"data_stored":12550144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11067392,"data_stored":11067392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14835712,"data_stored":14835712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14045184,"data_stored":14045184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7327744,"data_stored":7327744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9019392,"data_stored":9019392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10203136,"data_stored":10203136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":5848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:23:09.721 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.721 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.721 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.721 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.721 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.721 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.721 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.722 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.722 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.722 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.722 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.722 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.722 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.722 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.722 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.722 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.722 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.723 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.723 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.723 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.723 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.723 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.723 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.723 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.723 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.723 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.724 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.724 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.724 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.724 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.724 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.724 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.724 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.724 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.725 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.725 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.725 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.725 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.725 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.725 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.725 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.725 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.725 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.726 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.726 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.726 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.726 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.726 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.726 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.726 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.726 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.726 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.727 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.727 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.727 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.727 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.727 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.727 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.727 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.727 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.727 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.728 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.728 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.728 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.728 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.728 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.728 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.728 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.728 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.728 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.728 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.729 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.729 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.729 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.729 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.729 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.729 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.729 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.729 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.729 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.730 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.730 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.730 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.730 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.730 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.730 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.730 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.730 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.730 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.731 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.731 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.731 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.731 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.731 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.731 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.731 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.732 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.732 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.732 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.732 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.732 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.732 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.733 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.733 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.733 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.733 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.733 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.733 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.733 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.733 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.733 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.734 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.734 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.734 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.734 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.734 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.734 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.734 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.734 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.734 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.735 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.735 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.735 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.735 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.735 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.735 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.735 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.735 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.735 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.735 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.736 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.736 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.736 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.736 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.736 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.736 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.736 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.736 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.736 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.737 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.737 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.737 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.737 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.737 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.737 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.737 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.737 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.737 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.738 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.738 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.738 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.738 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.738 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.738 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.738 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.738 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.738 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.739 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.739 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.739 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.739 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.739 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.739 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.739 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.739 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.739 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.740 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.740 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.740 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.740 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.740 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.740 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.740 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.740 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.741 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.741 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.741 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.741 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.741 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.741 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.741 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.741 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.741 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.741 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.742 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.742 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.742 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.742 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.742 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.742 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.742 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.742 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.742 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.743 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.743 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.743 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.743 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.743 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.743 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.743 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.743 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.743 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.744 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.744 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.744 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.744 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.744 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.744 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.744 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.744 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.744 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.745 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.745 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.745 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.745 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.745 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.745 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.745 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.745 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.745 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.746 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.746 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.746 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.746 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.746 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.746 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.746 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.746 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.746 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.747 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T17:29:29.241459+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=29, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.747 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T17:29:34.307063+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.747 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.747 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.747 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.747 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.747 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.747 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T17:29:34.307063+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.747 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.747 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.748 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.748 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.748 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.748 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.748 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T17:29:34.307063+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.748 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.748 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.748 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.748 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.749 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.749 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T17:29:34.307063+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.749 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.749 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.749 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.749 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.749 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.749 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.749 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T17:29:34.307063+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.750 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.750 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.750 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.750 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.750 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.750 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.750 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T17:29:34.307063+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.750 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.750 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.751 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.751 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.751 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.751 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.751 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.751 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.751 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.751 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.751 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.752 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T17:29:34.307063+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.752 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.752 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.752 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.752 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.752 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.752 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.752 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.752 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.753 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.753 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.753 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.753 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.753 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.753 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.753 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.753 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.753 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.754 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.754 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.754 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.754 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.754 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.754 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.754 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.754 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.754 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.755 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.755 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.755 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.755 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.755 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.755 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.755 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.755 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.755 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.756 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.756 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.756 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.756 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.756 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.756 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.756 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.756 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.756 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.757 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.757 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.757 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.757 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.757 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.757 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.757 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.757 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.757 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.757 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.758 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.758 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.758 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.758 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.758 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.758 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.758 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.758 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.758 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.759 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.759 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.759 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.759 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.759 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.759 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.759 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.759 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.759 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.760 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.760 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.760 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.760 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.760 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.760 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.760 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.760 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.760 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.761 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.761 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.761 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.761 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.761 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.761 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.761 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.761 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.762 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.762 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.762 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.762 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.762 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.763 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.763 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.763 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.763 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.763 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.763 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.763 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.763 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.763 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.764 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.764 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.764 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.764 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.764 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.764 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T17:29:51.659189+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.764 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:09.764 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T19:23:29.765 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:23:30.131 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:23:30.147 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-12T19:23:30.157 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":3679,"stamp":"2024-09-12T19:23:29.273909+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68190910,"num_objects":834,"num_object_clones":0,"num_object_copies":2400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":834,"num_whiteouts":0,"num_read":295061,"num_read_kb":2506908,"num_write":163405,"num_write_kb":2385161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":554406,"num_omap_keys":1334,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13049,"ondisk_log_size":13049,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1885424,"kb_used_data":122928,"kb_used_omap":12,"kb_used_meta":1762355,"kb_avail":753089296,"statfs":{"total":773094113280,"available":771163439104,"internally_reserved":0,"allocated":125878272,"data_stored":109935330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1804652080},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":554406,"num_omap_keys":1334,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008652"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.976722+0000","last_change":"2024-09-12T18:19:22.664402+0000","last_active":"2024-09-12T19:19:22.976722+0000","last_peered":"2024-09-12T19:19:22.976722+0000","last_clean":"2024-09-12T19:19:22.976722+0000","last_became_active":"2024-09-12T18:19:22.658759+0000","last_became_peered":"2024-09-12T18:19:22.658759+0000","last_unstale":"2024-09-12T19:19:22.976722+0000","last_undegraded":"2024-09-12T19:19:22.976722+0000","last_fullsized":"2024-09-12T19:19:22.976722+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:29.891894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:32.979320+0000","last_change":"2024-09-12T17:51:59.970111+0000","last_active":"2024-09-12T19:19:32.979320+0000","last_peered":"2024-09-12T19:19:32.979320+0000","last_clean":"2024-09-12T19:19:32.979320+0000","last_became_active":"2024-09-12T17:51:59.969612+0000","last_became_peered":"2024-09-12T17:51:59.969612+0000","last_unstale":"2024-09-12T19:19:32.979320+0000","last_undegraded":"2024-09-12T19:19:32.979320+0000","last_fullsized":"2024-09-12T19:19:32.979320+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:23.773617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'6","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.283938+0000","last_change":"2024-09-12T17:51:52.890790+0000","last_active":"2024-09-12T19:21:53.283938+0000","last_peered":"2024-09-12T19:21:53.283938+0000","last_clean":"2024-09-12T19:21:53.283938+0000","last_became_active":"2024-09-12T17:51:52.890029+0000","last_became_peered":"2024-09-12T17:51:52.890029+0000","last_unstale":"2024-09-12T19:21:53.283938+0000","last_undegraded":"2024-09-12T19:21:53.283938+0000","last_fullsized":"2024-09-12T19:21:53.283938+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:58.035727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'75","reported_seq":374,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:28.176973+0000","last_change":"2024-09-12T17:45:41.586304+0000","last_active":"2024-09-12T19:19:28.176973+0000","last_peered":"2024-09-12T19:19:28.176973+0000","last_clean":"2024-09-12T19:19:28.176973+0000","last_became_active":"2024-09-12T17:45:41.585012+0000","last_became_peered":"2024-09-12T17:45:41.585012+0000","last_unstale":"2024-09-12T19:19:28.176973+0000","last_undegraded":"2024-09-12T19:19:28.176973+0000","last_fullsized":"2024-09-12T19:19:28.176973+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:25.815410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":580,"num_read_kb":395,"num_write":86,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:23.524914+0000","last_change":"2024-09-12T18:19:22.641896+0000","last_active":"2024-09-12T19:19:23.524914+0000","last_peered":"2024-09-12T19:19:23.524914+0000","last_clean":"2024-09-12T19:19:23.524914+0000","last_became_active":"2024-09-12T18:19:22.641172+0000","last_became_peered":"2024-09-12T18:19:22.641172+0000","last_unstale":"2024-09-12T19:19:23.524914+0000","last_undegraded":"2024-09-12T19:19:23.524914+0000","last_fullsized":"2024-09-12T19:19:23.524914+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:53.586176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.189386+0000","last_change":"2024-09-12T17:51:59.957708+0000","last_active":"2024-09-12T19:19:33.189386+0000","last_peered":"2024-09-12T19:19:33.189386+0000","last_clean":"2024-09-12T19:19:33.189386+0000","last_became_active":"2024-09-12T17:51:59.957109+0000","last_became_peered":"2024-09-12T17:51:59.957109+0000","last_unstale":"2024-09-12T19:19:33.189386+0000","last_undegraded":"2024-09-12T19:19:33.189386+0000","last_fullsized":"2024-09-12T19:19:33.189386+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:06.641011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.970297+0000","last_change":"2024-09-12T17:51:52.905930+0000","last_active":"2024-09-12T19:19:22.970297+0000","last_peered":"2024-09-12T19:19:22.970297+0000","last_clean":"2024-09-12T19:19:22.970297+0000","last_became_active":"2024-09-12T17:51:52.905220+0000","last_became_peered":"2024-09-12T17:51:52.905220+0000","last_unstale":"2024-09-12T19:19:22.970297+0000","last_undegraded":"2024-09-12T19:19:22.970297+0000","last_fullsized":"2024-09-12T19:19:22.970297+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:22.520893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'123","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.967588+0000","last_change":"2024-09-12T19:23:27.967588+0000","last_active":"2024-09-12T19:23:27.967588+0000","last_peered":"2024-09-12T19:23:27.967588+0000","last_clean":"2024-09-12T19:23:27.967588+0000","last_became_active":"2024-09-12T17:45:41.572859+0000","last_became_peered":"2024-09-12T17:45:41.572859+0000","last_unstale":"2024-09-12T19:23:27.967588+0000","last_undegraded":"2024-09-12T19:23:27.967588+0000","last_fullsized":"2024-09-12T19:23:27.967588+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'123","last_scrub_stamp":"2024-09-12T19:23:27.967374+0000","last_deep_scrub":"267'123","last_deep_scrub_stamp":"2024-09-12T19:23:27.967374+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.967374+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:59.956709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":788,"num_read_kb":542,"num_write":175,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2500,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.553951+0000","last_change":"2024-09-12T18:19:22.653551+0000","last_active":"2024-09-12T19:19:48.553951+0000","last_peered":"2024-09-12T19:19:48.553951+0000","last_clean":"2024-09-12T19:19:48.553951+0000","last_became_active":"2024-09-12T18:19:22.652800+0000","last_became_peered":"2024-09-12T18:19:22.652800+0000","last_unstale":"2024-09-12T19:19:48.553951+0000","last_undegraded":"2024-09-12T19:19:48.553951+0000","last_fullsized":"2024-09-12T19:19:48.553951+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:00.720225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.178212+0000","last_change":"2024-09-12T17:51:59.955159+0000","last_active":"2024-09-12T19:19:33.178212+0000","last_peered":"2024-09-12T19:19:33.178212+0000","last_clean":"2024-09-12T19:19:33.178212+0000","last_became_active":"2024-09-12T17:51:59.954517+0000","last_became_peered":"2024-09-12T17:51:59.954517+0000","last_unstale":"2024-09-12T19:19:33.178212+0000","last_undegraded":"2024-09-12T19:19:33.178212+0000","last_fullsized":"2024-09-12T19:19:33.178212+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:02.765786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"267'2","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:03.559058+0000","last_change":"2024-09-12T17:51:52.886345+0000","last_active":"2024-09-12T19:22:03.559058+0000","last_peered":"2024-09-12T19:22:03.559058+0000","last_clean":"2024-09-12T19:22:03.559058+0000","last_became_active":"2024-09-12T17:51:52.885677+0000","last_became_peered":"2024-09-12T17:51:52.885677+0000","last_unstale":"2024-09-12T19:22:03.559058+0000","last_undegraded":"2024-09-12T19:22:03.559058+0000","last_fullsized":"2024-09-12T19:22:03.559058+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:04.278645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'26","reported_seq":141,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:43.196758+0000","last_change":"2024-09-12T17:45:41.576549+0000","last_active":"2024-09-12T19:20:43.196758+0000","last_peered":"2024-09-12T19:20:43.196758+0000","last_clean":"2024-09-12T19:20:43.196758+0000","last_became_active":"2024-09-12T17:45:41.575793+0000","last_became_peered":"2024-09-12T17:45:41.575793+0000","last_unstale":"2024-09-12T19:20:43.196758+0000","last_undegraded":"2024-09-12T19:20:43.196758+0000","last_fullsized":"2024-09-12T19:20:43.196758+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":83,"num_write":51,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.254703+0000","last_change":"2024-09-12T18:19:22.656103+0000","last_active":"2024-09-12T19:19:58.254703+0000","last_peered":"2024-09-12T19:19:58.254703+0000","last_clean":"2024-09-12T19:19:58.254703+0000","last_became_active":"2024-09-12T18:19:22.655357+0000","last_became_peered":"2024-09-12T18:19:22.655357+0000","last_unstale":"2024-09-12T19:19:58.254703+0000","last_undegraded":"2024-09-12T19:19:58.254703+0000","last_fullsized":"2024-09-12T19:19:58.254703+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:44.884891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"267'2","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:23.288565+0000","last_change":"2024-09-12T17:51:59.941561+0000","last_active":"2024-09-12T19:22:23.288565+0000","last_peered":"2024-09-12T19:22:23.288565+0000","last_clean":"2024-09-12T19:22:23.288565+0000","last_became_active":"2024-09-12T17:51:59.935185+0000","last_became_peered":"2024-09-12T17:51:59.935185+0000","last_unstale":"2024-09-12T19:22:23.288565+0000","last_undegraded":"2024-09-12T19:22:23.288565+0000","last_fullsized":"2024-09-12T19:22:23.288565+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:03.775657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"267'10","reported_seq":97,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.345477+0000","last_change":"2024-09-12T17:51:52.865694+0000","last_active":"2024-09-12T19:23:01.345477+0000","last_peered":"2024-09-12T19:23:01.345477+0000","last_clean":"2024-09-12T19:23:01.345477+0000","last_became_active":"2024-09-12T17:51:52.864951+0000","last_became_peered":"2024-09-12T17:51:52.864951+0000","last_unstale":"2024-09-12T19:23:01.345477+0000","last_undegraded":"2024-09-12T19:23:01.345477+0000","last_fullsized":"2024-09-12T19:23:01.345477+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:53.129719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32810,"num_write":10,"num_write_kb":11304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'28","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:43.267456+0000","last_change":"2024-09-12T17:45:41.577459+0000","last_active":"2024-09-12T19:20:43.267456+0000","last_peered":"2024-09-12T19:20:43.267456+0000","last_clean":"2024-09-12T19:20:43.267456+0000","last_became_active":"2024-09-12T17:45:41.576714+0000","last_became_peered":"2024-09-12T17:45:41.576714+0000","last_unstale":"2024-09-12T19:20:43.267456+0000","last_undegraded":"2024-09-12T19:20:43.267456+0000","last_fullsized":"2024-09-12T19:20:43.267456+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":94,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.249030+0000","last_change":"2024-09-12T18:19:22.665947+0000","last_active":"2024-09-12T19:19:33.249030+0000","last_peered":"2024-09-12T19:19:33.249030+0000","last_clean":"2024-09-12T19:19:33.249030+0000","last_became_active":"2024-09-12T18:19:22.665152+0000","last_became_peered":"2024-09-12T18:19:22.665152+0000","last_unstale":"2024-09-12T19:19:33.249030+0000","last_undegraded":"2024-09-12T19:19:33.249030+0000","last_fullsized":"2024-09-12T19:19:33.249030+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:24.528404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"267'3","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.011866+0000","last_change":"2024-09-12T17:51:59.951234+0000","last_active":"2024-09-12T19:21:53.011866+0000","last_peered":"2024-09-12T19:21:53.011866+0000","last_clean":"2024-09-12T19:21:53.011866+0000","last_became_active":"2024-09-12T17:51:59.950595+0000","last_became_peered":"2024-09-12T17:51:59.950595+0000","last_unstale":"2024-09-12T19:21:53.011866+0000","last_undegraded":"2024-09-12T19:21:53.011866+0000","last_fullsized":"2024-09-12T19:21:53.011866+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:58.571310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.166933+0000","last_change":"2024-09-12T17:51:52.908434+0000","last_active":"2024-09-12T19:18:53.166933+0000","last_peered":"2024-09-12T19:18:53.166933+0000","last_clean":"2024-09-12T19:18:53.166933+0000","last_became_active":"2024-09-12T17:51:52.907863+0000","last_became_peered":"2024-09-12T17:51:52.907863+0000","last_unstale":"2024-09-12T19:18:53.166933+0000","last_undegraded":"2024-09-12T19:18:53.166933+0000","last_fullsized":"2024-09-12T19:18:53.166933+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:14.608689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'42","reported_seq":187,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:43.267346+0000","last_change":"2024-09-12T17:45:41.596640+0000","last_active":"2024-09-12T19:20:43.267346+0000","last_peered":"2024-09-12T19:20:43.267346+0000","last_clean":"2024-09-12T19:20:43.267346+0000","last_became_active":"2024-09-12T17:45:41.596133+0000","last_became_peered":"2024-09-12T17:45:41.596133+0000","last_unstale":"2024-09-12T19:20:43.267346+0000","last_undegraded":"2024-09-12T19:20:43.267346+0000","last_fullsized":"2024-09-12T19:20:43.267346+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":80,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.975905+0000","last_change":"2024-09-12T18:19:22.652917+0000","last_active":"2024-09-12T19:19:47.975905+0000","last_peered":"2024-09-12T19:19:47.975905+0000","last_clean":"2024-09-12T19:19:47.975905+0000","last_became_active":"2024-09-12T18:19:22.652141+0000","last_became_peered":"2024-09-12T18:19:22.652141+0000","last_unstale":"2024-09-12T19:19:47.975905+0000","last_undegraded":"2024-09-12T19:19:47.975905+0000","last_fullsized":"2024-09-12T19:19:47.975905+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:16.013284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"267'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:28.575571+0000","last_change":"2024-09-12T17:51:59.937787+0000","last_active":"2024-09-12T19:21:28.575571+0000","last_peered":"2024-09-12T19:21:28.575571+0000","last_clean":"2024-09-12T19:21:28.575571+0000","last_became_active":"2024-09-12T17:51:59.936941+0000","last_became_peered":"2024-09-12T17:51:59.936941+0000","last_unstale":"2024-09-12T19:21:28.575571+0000","last_undegraded":"2024-09-12T19:21:28.575571+0000","last_fullsized":"2024-09-12T19:21:28.575571+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:37.516754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'2","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:38.218337+0000","last_change":"2024-09-12T17:51:52.882882+0000","last_active":"2024-09-12T19:21:38.218337+0000","last_peered":"2024-09-12T19:21:38.218337+0000","last_clean":"2024-09-12T19:21:38.218337+0000","last_became_active":"2024-09-12T17:51:52.882157+0000","last_became_peered":"2024-09-12T17:51:52.882157+0000","last_unstale":"2024-09-12T19:21:38.218337+0000","last_undegraded":"2024-09-12T19:21:38.218337+0000","last_fullsized":"2024-09-12T19:21:38.218337+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:28.059422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'16","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:43.565985+0000","last_change":"2024-09-12T17:45:41.587495+0000","last_active":"2024-09-12T19:20:43.565985+0000","last_peered":"2024-09-12T19:20:43.565985+0000","last_clean":"2024-09-12T19:20:43.565985+0000","last_became_active":"2024-09-12T17:45:41.586661+0000","last_became_peered":"2024-09-12T17:45:41.586661+0000","last_unstale":"2024-09-12T19:20:43.565985+0000","last_undegraded":"2024-09-12T19:20:43.565985+0000","last_fullsized":"2024-09-12T19:20:43.565985+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959085+0000","last_change":"2024-09-12T18:19:22.671131+0000","last_active":"2024-09-12T19:19:22.959085+0000","last_peered":"2024-09-12T19:19:22.959085+0000","last_clean":"2024-09-12T19:19:22.959085+0000","last_became_active":"2024-09-12T18:19:22.668945+0000","last_became_peered":"2024-09-12T18:19:22.668945+0000","last_unstale":"2024-09-12T19:19:22.959085+0000","last_undegraded":"2024-09-12T19:19:22.959085+0000","last_fullsized":"2024-09-12T19:19:22.959085+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:51.667065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.550741+0000","last_change":"2024-09-12T17:51:59.937170+0000","last_active":"2024-09-12T19:19:33.550741+0000","last_peered":"2024-09-12T19:19:33.550741+0000","last_clean":"2024-09-12T19:19:33.550741+0000","last_became_active":"2024-09-12T17:51:59.936441+0000","last_became_peered":"2024-09-12T17:51:59.936441+0000","last_unstale":"2024-09-12T19:19:33.550741+0000","last_undegraded":"2024-09-12T19:19:33.550741+0000","last_fullsized":"2024-09-12T19:19:33.550741+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:54.536101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:23.187174+0000","last_change":"2024-09-12T17:51:52.888730+0000","last_active":"2024-09-12T19:19:23.187174+0000","last_peered":"2024-09-12T19:19:23.187174+0000","last_clean":"2024-09-12T19:19:23.187174+0000","last_became_active":"2024-09-12T17:51:52.887962+0000","last_became_peered":"2024-09-12T17:51:52.887962+0000","last_unstale":"2024-09-12T19:19:23.187174+0000","last_undegraded":"2024-09-12T19:19:23.187174+0000","last_fullsized":"2024-09-12T19:19:23.187174+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:25.669346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'25","reported_seq":141,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.188763+0000","last_change":"2024-09-12T17:45:41.566696+0000","last_active":"2024-09-12T19:20:13.188763+0000","last_peered":"2024-09-12T19:20:13.188763+0000","last_clean":"2024-09-12T19:20:13.188763+0000","last_became_active":"2024-09-12T17:45:41.565956+0000","last_became_peered":"2024-09-12T17:45:41.565956+0000","last_unstale":"2024-09-12T19:20:13.188763+0000","last_undegraded":"2024-09-12T19:20:13.188763+0000","last_fullsized":"2024-09-12T19:20:13.188763+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:11.837864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959148+0000","last_change":"2024-09-12T18:19:22.677901+0000","last_active":"2024-09-12T19:19:22.959148+0000","last_peered":"2024-09-12T19:19:22.959148+0000","last_clean":"2024-09-12T19:19:22.959148+0000","last_became_active":"2024-09-12T18:19:22.677111+0000","last_became_peered":"2024-09-12T18:19:22.677111+0000","last_unstale":"2024-09-12T19:19:22.959148+0000","last_undegraded":"2024-09-12T19:19:22.959148+0000","last_fullsized":"2024-09-12T19:19:22.959148+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:39.916282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:03.285359+0000","last_change":"2024-09-12T17:51:59.942614+0000","last_active":"2024-09-12T19:22:03.285359+0000","last_peered":"2024-09-12T19:22:03.285359+0000","last_clean":"2024-09-12T19:22:03.285359+0000","last_became_active":"2024-09-12T17:51:59.941825+0000","last_became_peered":"2024-09-12T17:51:59.941825+0000","last_unstale":"2024-09-12T19:22:03.285359+0000","last_undegraded":"2024-09-12T19:22:03.285359+0000","last_fullsized":"2024-09-12T19:22:03.285359+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:10.399861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":10,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.212609+0000","last_change":"2024-09-12T17:51:52.899944+0000","last_active":"2024-09-12T19:21:53.212609+0000","last_peered":"2024-09-12T19:21:53.212609+0000","last_clean":"2024-09-12T19:21:53.212609+0000","last_became_active":"2024-09-12T17:51:52.899511+0000","last_became_peered":"2024-09-12T17:51:52.899511+0000","last_unstale":"2024-09-12T19:21:53.212609+0000","last_undegraded":"2024-09-12T19:21:53.212609+0000","last_fullsized":"2024-09-12T19:21:53.212609+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:39.682445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'27","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.978150+0000","last_change":"2024-09-12T17:45:41.587067+0000","last_active":"2024-09-12T19:19:57.978150+0000","last_peered":"2024-09-12T19:19:57.978150+0000","last_clean":"2024-09-12T19:19:57.978150+0000","last_became_active":"2024-09-12T17:45:41.578021+0000","last_became_peered":"2024-09-12T17:45:41.578021+0000","last_unstale":"2024-09-12T19:19:57.978150+0000","last_undegraded":"2024-09-12T19:19:57.978150+0000","last_fullsized":"2024-09-12T19:19:57.978150+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:35.349527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":97,"num_write":50,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.979562+0000","last_change":"2024-09-12T18:19:22.669975+0000","last_active":"2024-09-12T19:20:02.979562+0000","last_peered":"2024-09-12T19:20:02.979562+0000","last_clean":"2024-09-12T19:20:02.979562+0000","last_became_active":"2024-09-12T18:19:22.668802+0000","last_became_peered":"2024-09-12T18:19:22.668802+0000","last_unstale":"2024-09-12T19:20:02.979562+0000","last_undegraded":"2024-09-12T19:20:02.979562+0000","last_fullsized":"2024-09-12T19:20:02.979562+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:20.736060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'3","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:28.278184+0000","last_change":"2024-09-12T17:51:59.940440+0000","last_active":"2024-09-12T19:21:28.278184+0000","last_peered":"2024-09-12T19:21:28.278184+0000","last_clean":"2024-09-12T19:21:28.278184+0000","last_became_active":"2024-09-12T17:51:59.939686+0000","last_became_peered":"2024-09-12T17:51:59.939686+0000","last_unstale":"2024-09-12T19:21:28.278184+0000","last_undegraded":"2024-09-12T19:21:28.278184+0000","last_fullsized":"2024-09-12T19:21:28.278184+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:25.031497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:57.999381+0000","last_change":"2024-09-12T17:51:52.894394+0000","last_active":"2024-09-12T19:20:57.999381+0000","last_peered":"2024-09-12T19:20:57.999381+0000","last_clean":"2024-09-12T19:20:57.999381+0000","last_became_active":"2024-09-12T17:51:52.892953+0000","last_became_peered":"2024-09-12T17:51:52.892953+0000","last_unstale":"2024-09-12T19:20:57.999381+0000","last_undegraded":"2024-09-12T19:20:57.999381+0000","last_fullsized":"2024-09-12T19:20:57.999381+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'51","reported_seq":214,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.184846+0000","last_change":"2024-09-12T17:45:41.574719+0000","last_active":"2024-09-12T19:19:58.184846+0000","last_peered":"2024-09-12T19:19:58.184846+0000","last_clean":"2024-09-12T19:19:58.184846+0000","last_became_active":"2024-09-12T17:45:41.572941+0000","last_became_peered":"2024-09-12T17:45:41.572941+0000","last_unstale":"2024-09-12T19:19:58.184846+0000","last_undegraded":"2024-09-12T19:19:58.184846+0000","last_fullsized":"2024-09-12T19:19:58.184846+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:25.447410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":190,"num_write":83,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.533559+0000","last_change":"2024-09-12T18:19:22.652584+0000","last_active":"2024-09-12T19:20:03.533559+0000","last_peered":"2024-09-12T19:20:03.533559+0000","last_clean":"2024-09-12T19:20:03.533559+0000","last_became_active":"2024-09-12T18:19:22.651901+0000","last_became_peered":"2024-09-12T18:19:22.651901+0000","last_unstale":"2024-09-12T19:20:03.533559+0000","last_undegraded":"2024-09-12T19:20:03.533559+0000","last_fullsized":"2024-09-12T19:20:03.533559+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:40.051168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:03.272203+0000","last_change":"2024-09-12T17:51:59.948536+0000","last_active":"2024-09-12T19:21:03.272203+0000","last_peered":"2024-09-12T19:21:03.272203+0000","last_clean":"2024-09-12T19:21:03.272203+0000","last_became_active":"2024-09-12T17:51:59.947392+0000","last_became_peered":"2024-09-12T17:51:59.947392+0000","last_unstale":"2024-09-12T19:21:03.272203+0000","last_undegraded":"2024-09-12T19:21:03.272203+0000","last_fullsized":"2024-09-12T19:21:03.272203+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'5","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:52.952062+0000","last_change":"2024-09-12T17:51:52.887100+0000","last_active":"2024-09-12T19:18:52.952062+0000","last_peered":"2024-09-12T19:18:52.952062+0000","last_clean":"2024-09-12T19:18:52.952062+0000","last_became_active":"2024-09-12T17:51:52.886123+0000","last_became_peered":"2024-09-12T17:51:52.886123+0000","last_unstale":"2024-09-12T19:18:52.952062+0000","last_undegraded":"2024-09-12T19:18:52.952062+0000","last_fullsized":"2024-09-12T19:18:52.952062+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:11.295668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'32","reported_seq":165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.255039+0000","last_change":"2024-09-12T17:45:41.592562+0000","last_active":"2024-09-12T19:19:58.255039+0000","last_peered":"2024-09-12T19:19:58.255039+0000","last_clean":"2024-09-12T19:19:58.255039+0000","last_became_active":"2024-09-12T17:45:41.591637+0000","last_became_peered":"2024-09-12T17:45:41.591637+0000","last_unstale":"2024-09-12T19:19:58.255039+0000","last_undegraded":"2024-09-12T19:19:58.255039+0000","last_fullsized":"2024-09-12T19:19:58.255039+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:52.032057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":117,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968591+0000","last_change":"2024-09-12T18:19:22.646555+0000","last_active":"2024-09-12T19:20:02.968591+0000","last_peered":"2024-09-12T19:20:02.968591+0000","last_clean":"2024-09-12T19:20:02.968591+0000","last_became_active":"2024-09-12T18:19:22.645829+0000","last_became_peered":"2024-09-12T18:19:22.645829+0000","last_unstale":"2024-09-12T19:20:02.968591+0000","last_undegraded":"2024-09-12T19:20:02.968591+0000","last_fullsized":"2024-09-12T19:20:02.968591+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:14.278527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"267'9","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.986200+0000","last_change":"2024-09-12T17:52:23.472557+0000","last_active":"2024-09-12T19:22:58.986200+0000","last_peered":"2024-09-12T19:22:58.986200+0000","last_clean":"2024-09-12T19:22:58.986200+0000","last_became_active":"2024-09-12T17:52:23.438623+0000","last_became_peered":"2024-09-12T17:52:23.438623+0000","last_unstale":"2024-09-12T19:22:58.986200+0000","last_undegraded":"2024-09-12T19:22:58.986200+0000","last_fullsized":"2024-09-12T19:22:58.986200+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:04.013275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":19,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.16","version":"267'2","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:18.549641+0000","last_change":"2024-09-12T17:51:52.884671+0000","last_active":"2024-09-12T19:21:18.549641+0000","last_peered":"2024-09-12T19:21:18.549641+0000","last_clean":"2024-09-12T19:21:18.549641+0000","last_became_active":"2024-09-12T17:51:52.876542+0000","last_became_peered":"2024-09-12T17:51:52.876542+0000","last_unstale":"2024-09-12T19:21:18.549641+0000","last_undegraded":"2024-09-12T19:21:18.549641+0000","last_fullsized":"2024-09-12T19:21:18.549641+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:01.214988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"0'0","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.532458+0000","last_change":"2024-09-12T17:45:41.575734+0000","last_active":"2024-09-12T19:19:58.532458+0000","last_peered":"2024-09-12T19:19:58.532458+0000","last_clean":"2024-09-12T19:19:58.532458+0000","last_became_active":"2024-09-12T17:45:41.574953+0000","last_became_peered":"2024-09-12T17:45:41.574953+0000","last_unstale":"2024-09-12T19:19:58.532458+0000","last_undegraded":"2024-09-12T19:19:58.532458+0000","last_fullsized":"2024-09-12T19:19:58.532458+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:53.875702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.986527+0000","last_change":"2024-09-12T18:19:22.658747+0000","last_active":"2024-09-12T19:20:02.986527+0000","last_peered":"2024-09-12T19:20:02.986527+0000","last_clean":"2024-09-12T19:20:02.986527+0000","last_became_active":"2024-09-12T18:19:22.657731+0000","last_became_peered":"2024-09-12T18:19:22.657731+0000","last_unstale":"2024-09-12T19:20:02.986527+0000","last_undegraded":"2024-09-12T19:20:02.986527+0000","last_fullsized":"2024-09-12T19:20:02.986527+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:22.834751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"267'5","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:28.216153+0000","last_change":"2024-09-12T17:51:59.948754+0000","last_active":"2024-09-12T19:21:28.216153+0000","last_peered":"2024-09-12T19:21:28.216153+0000","last_clean":"2024-09-12T19:21:28.216153+0000","last_became_active":"2024-09-12T17:51:59.937650+0000","last_became_peered":"2024-09-12T17:51:59.937650+0000","last_unstale":"2024-09-12T19:21:28.216153+0000","last_undegraded":"2024-09-12T19:21:28.216153+0000","last_fullsized":"2024-09-12T19:21:28.216153+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:52.287318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:53.167284+0000","last_change":"2024-09-12T17:51:52.888708+0000","last_active":"2024-09-12T19:18:53.167284+0000","last_peered":"2024-09-12T19:18:53.167284+0000","last_clean":"2024-09-12T19:18:53.167284+0000","last_became_active":"2024-09-12T17:51:52.887964+0000","last_became_peered":"2024-09-12T17:51:52.887964+0000","last_unstale":"2024-09-12T19:18:53.167284+0000","last_undegraded":"2024-09-12T19:18:53.167284+0000","last_fullsized":"2024-09-12T19:18:53.167284+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:57.571315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'27","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959037+0000","last_change":"2024-09-12T17:45:41.595246+0000","last_active":"2024-09-12T19:19:22.959037+0000","last_peered":"2024-09-12T19:19:22.959037+0000","last_clean":"2024-09-12T19:19:22.959037+0000","last_became_active":"2024-09-12T17:45:41.594619+0000","last_became_peered":"2024-09-12T17:45:41.594619+0000","last_unstale":"2024-09-12T19:19:22.959037+0000","last_undegraded":"2024-09-12T19:19:22.959037+0000","last_fullsized":"2024-09-12T19:19:22.959037+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:08.142112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252332+0000","last_change":"2024-09-12T18:19:22.646874+0000","last_active":"2024-09-12T19:19:48.252332+0000","last_peered":"2024-09-12T19:19:48.252332+0000","last_clean":"2024-09-12T19:19:48.252332+0000","last_became_active":"2024-09-12T18:19:22.646129+0000","last_became_peered":"2024-09-12T18:19:22.646129+0000","last_unstale":"2024-09-12T19:19:48.252332+0000","last_undegraded":"2024-09-12T19:19:48.252332+0000","last_fullsized":"2024-09-12T19:19:48.252332+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:17.061904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.988325+0000","last_change":"2024-09-12T17:51:59.962952+0000","last_active":"2024-09-12T19:20:42.988325+0000","last_peered":"2024-09-12T19:20:42.988325+0000","last_clean":"2024-09-12T19:20:42.988325+0000","last_became_active":"2024-09-12T17:51:59.961892+0000","last_became_peered":"2024-09-12T17:51:59.961892+0000","last_unstale":"2024-09-12T19:20:42.988325+0000","last_undegraded":"2024-09-12T19:20:42.988325+0000","last_fullsized":"2024-09-12T19:20:42.988325+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:48.287564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'5","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.203445+0000","last_change":"2024-09-12T17:51:52.865750+0000","last_active":"2024-09-12T19:20:33.203445+0000","last_peered":"2024-09-12T19:20:33.203445+0000","last_clean":"2024-09-12T19:20:33.203445+0000","last_became_active":"2024-09-12T17:51:52.865019+0000","last_became_peered":"2024-09-12T17:51:52.865019+0000","last_unstale":"2024-09-12T19:20:33.203445+0000","last_undegraded":"2024-09-12T19:20:33.203445+0000","last_fullsized":"2024-09-12T19:20:33.203445+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:48.706108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'30","reported_seq":153,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:02.954345+0000","last_change":"2024-09-12T17:45:41.595661+0000","last_active":"2024-09-12T19:19:02.954345+0000","last_peered":"2024-09-12T19:19:02.954345+0000","last_clean":"2024-09-12T19:19:02.954345+0000","last_became_active":"2024-09-12T17:45:41.594848+0000","last_became_peered":"2024-09-12T17:45:41.594848+0000","last_unstale":"2024-09-12T19:19:02.954345+0000","last_undegraded":"2024-09-12T19:19:02.954345+0000","last_fullsized":"2024-09-12T19:19:02.954345+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:51.035395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":101,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.182427+0000","last_change":"2024-09-12T18:19:22.649527+0000","last_active":"2024-09-12T19:19:48.182427+0000","last_peered":"2024-09-12T19:19:48.182427+0000","last_clean":"2024-09-12T19:19:48.182427+0000","last_became_active":"2024-09-12T18:19:22.648818+0000","last_became_peered":"2024-09-12T18:19:22.648818+0000","last_unstale":"2024-09-12T19:19:48.182427+0000","last_undegraded":"2024-09-12T19:19:48.182427+0000","last_fullsized":"2024-09-12T19:19:48.182427+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:23.776526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.988222+0000","last_change":"2024-09-12T17:51:59.954324+0000","last_active":"2024-09-12T19:20:42.988222+0000","last_peered":"2024-09-12T19:20:42.988222+0000","last_clean":"2024-09-12T19:20:42.988222+0000","last_became_active":"2024-09-12T17:51:59.953480+0000","last_became_peered":"2024-09-12T17:51:59.953480+0000","last_unstale":"2024-09-12T19:20:42.988222+0000","last_undegraded":"2024-09-12T19:20:42.988222+0000","last_fullsized":"2024-09-12T19:20:42.988222+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:03.945523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.264807+0000","last_change":"2024-09-12T17:51:52.886235+0000","last_active":"2024-09-12T19:20:33.264807+0000","last_peered":"2024-09-12T19:20:33.264807+0000","last_clean":"2024-09-12T19:20:33.264807+0000","last_became_active":"2024-09-12T17:51:52.884758+0000","last_became_peered":"2024-09-12T17:51:52.884758+0000","last_unstale":"2024-09-12T19:20:33.264807+0000","last_undegraded":"2024-09-12T19:20:33.264807+0000","last_fullsized":"2024-09-12T19:20:33.264807+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:14.092386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'17","reported_seq":121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.169851+0000","last_change":"2024-09-12T17:45:41.586061+0000","last_active":"2024-09-12T19:19:03.169851+0000","last_peered":"2024-09-12T19:19:03.169851+0000","last_clean":"2024-09-12T19:19:03.169851+0000","last_became_active":"2024-09-12T17:45:41.585259+0000","last_became_peered":"2024-09-12T17:45:41.585259+0000","last_unstale":"2024-09-12T19:19:03.169851+0000","last_undegraded":"2024-09-12T19:19:03.169851+0000","last_fullsized":"2024-09-12T19:19:03.169851+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:41.750928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":55,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.189074+0000","last_change":"2024-09-12T18:19:22.658645+0000","last_active":"2024-09-12T19:20:13.189074+0000","last_peered":"2024-09-12T19:20:13.189074+0000","last_clean":"2024-09-12T19:20:13.189074+0000","last_became_active":"2024-09-12T18:19:22.655117+0000","last_became_peered":"2024-09-12T18:19:22.655117+0000","last_unstale":"2024-09-12T19:20:13.189074+0000","last_undegraded":"2024-09-12T19:20:13.189074+0000","last_fullsized":"2024-09-12T19:20:13.189074+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:32.691865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:43.267416+0000","last_change":"2024-09-12T17:51:59.940572+0000","last_active":"2024-09-12T19:20:43.267416+0000","last_peered":"2024-09-12T19:20:43.267416+0000","last_clean":"2024-09-12T19:20:43.267416+0000","last_became_active":"2024-09-12T17:51:59.939751+0000","last_became_peered":"2024-09-12T17:51:59.939751+0000","last_unstale":"2024-09-12T19:20:43.267416+0000","last_undegraded":"2024-09-12T19:20:43.267416+0000","last_fullsized":"2024-09-12T19:20:43.267416+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:17.997521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.563717+0000","last_change":"2024-09-12T17:51:52.897941+0000","last_active":"2024-09-12T19:20:33.563717+0000","last_peered":"2024-09-12T19:20:33.563717+0000","last_clean":"2024-09-12T19:20:33.563717+0000","last_became_active":"2024-09-12T17:51:52.897168+0000","last_became_peered":"2024-09-12T17:51:52.897168+0000","last_unstale":"2024-09-12T19:20:33.563717+0000","last_undegraded":"2024-09-12T19:20:33.563717+0000","last_fullsized":"2024-09-12T19:20:33.563717+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:25.110112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'29","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.182170+0000","last_change":"2024-09-12T17:45:41.580462+0000","last_active":"2024-09-12T19:19:03.182170+0000","last_peered":"2024-09-12T19:19:03.182170+0000","last_clean":"2024-09-12T19:19:03.182170+0000","last_became_active":"2024-09-12T17:45:41.579765+0000","last_became_peered":"2024-09-12T17:45:41.579765+0000","last_unstale":"2024-09-12T19:19:03.182170+0000","last_undegraded":"2024-09-12T19:19:03.182170+0000","last_fullsized":"2024-09-12T19:19:03.182170+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:03.611178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":115,"num_write":41,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252289+0000","last_change":"2024-09-12T18:19:22.643191+0000","last_active":"2024-09-12T19:19:48.252289+0000","last_peered":"2024-09-12T19:19:48.252289+0000","last_clean":"2024-09-12T19:19:48.252289+0000","last_became_active":"2024-09-12T18:19:22.642415+0000","last_became_peered":"2024-09-12T18:19:22.642415+0000","last_unstale":"2024-09-12T19:19:48.252289+0000","last_undegraded":"2024-09-12T19:19:48.252289+0000","last_fullsized":"2024-09-12T19:19:48.252289+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:16.303449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:43.565948+0000","last_change":"2024-09-12T17:51:59.934455+0000","last_active":"2024-09-12T19:20:43.565948+0000","last_peered":"2024-09-12T19:20:43.565948+0000","last_clean":"2024-09-12T19:20:43.565948+0000","last_became_active":"2024-09-12T17:51:59.933679+0000","last_became_peered":"2024-09-12T17:51:59.933679+0000","last_unstale":"2024-09-12T19:20:43.565948+0000","last_undegraded":"2024-09-12T19:20:43.565948+0000","last_fullsized":"2024-09-12T19:20:43.565948+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:50.876767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"267'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:53.026201+0000","last_change":"2024-09-12T17:51:52.892730+0000","last_active":"2024-09-12T19:22:53.026201+0000","last_peered":"2024-09-12T19:22:53.026201+0000","last_clean":"2024-09-12T19:22:53.026201+0000","last_became_active":"2024-09-12T17:51:52.891977+0000","last_became_peered":"2024-09-12T17:51:52.891977+0000","last_unstale":"2024-09-12T19:22:53.026201+0000","last_undegraded":"2024-09-12T19:22:53.026201+0000","last_fullsized":"2024-09-12T19:22:53.026201+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:36.414562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'38","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:03.241715+0000","last_change":"2024-09-12T17:45:41.580119+0000","last_active":"2024-09-12T19:19:03.241715+0000","last_peered":"2024-09-12T19:19:03.241715+0000","last_clean":"2024-09-12T19:19:03.241715+0000","last_became_active":"2024-09-12T17:45:41.579275+0000","last_became_peered":"2024-09-12T17:45:41.579275+0000","last_unstale":"2024-09-12T19:19:03.241715+0000","last_undegraded":"2024-09-12T19:19:03.241715+0000","last_fullsized":"2024-09-12T19:19:03.241715+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:25.255989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":125,"num_write":71,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.534755+0000","last_change":"2024-09-12T18:19:22.657572+0000","last_active":"2024-09-12T19:20:08.534755+0000","last_peered":"2024-09-12T19:20:08.534755+0000","last_clean":"2024-09-12T19:20:08.534755+0000","last_became_active":"2024-09-12T18:19:22.656770+0000","last_became_peered":"2024-09-12T18:19:22.656770+0000","last_unstale":"2024-09-12T19:20:08.534755+0000","last_undegraded":"2024-09-12T19:20:08.534755+0000","last_fullsized":"2024-09-12T19:20:08.534755+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:58.749315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"267'6","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.188097+0000","last_change":"2024-09-12T17:51:59.941713+0000","last_active":"2024-09-12T19:23:00.188097+0000","last_peered":"2024-09-12T19:23:00.188097+0000","last_clean":"2024-09-12T19:23:00.188097+0000","last_became_active":"2024-09-12T17:51:59.934972+0000","last_became_peered":"2024-09-12T17:51:59.934972+0000","last_unstale":"2024-09-12T19:23:00.188097+0000","last_undegraded":"2024-09-12T19:23:00.188097+0000","last_fullsized":"2024-09-12T19:23:00.188097+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:09.715388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.962680+0000","last_change":"2024-09-12T17:51:52.901505+0000","last_active":"2024-09-12T19:19:37.962680+0000","last_peered":"2024-09-12T19:19:37.962680+0000","last_clean":"2024-09-12T19:19:37.962680+0000","last_became_active":"2024-09-12T17:51:52.900002+0000","last_became_peered":"2024-09-12T17:51:52.900002+0000","last_unstale":"2024-09-12T19:19:37.962680+0000","last_undegraded":"2024-09-12T19:19:37.962680+0000","last_fullsized":"2024-09-12T19:19:37.962680+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:16.493687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'34","reported_seq":174,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.265060+0000","last_change":"2024-09-12T17:45:41.581349+0000","last_active":"2024-09-12T19:20:33.265060+0000","last_peered":"2024-09-12T19:20:33.265060+0000","last_clean":"2024-09-12T19:20:33.265060+0000","last_became_active":"2024-09-12T17:45:41.580617+0000","last_became_peered":"2024-09-12T17:45:41.580617+0000","last_unstale":"2024-09-12T19:20:33.265060+0000","last_undegraded":"2024-09-12T19:20:33.265060+0000","last_fullsized":"2024-09-12T19:20:33.265060+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:04.951687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":129,"num_write":59,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:07.970075+0000","last_change":"2024-09-12T18:19:22.665735+0000","last_active":"2024-09-12T19:20:07.970075+0000","last_peered":"2024-09-12T19:20:07.970075+0000","last_clean":"2024-09-12T19:20:07.970075+0000","last_became_active":"2024-09-12T18:19:22.664960+0000","last_became_peered":"2024-09-12T18:19:22.664960+0000","last_unstale":"2024-09-12T19:20:07.970075+0000","last_undegraded":"2024-09-12T19:20:07.970075+0000","last_fullsized":"2024-09-12T19:20:07.970075+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:46.264476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:03.285437+0000","last_change":"2024-09-12T17:51:59.949566+0000","last_active":"2024-09-12T19:22:03.285437+0000","last_peered":"2024-09-12T19:22:03.285437+0000","last_clean":"2024-09-12T19:22:03.285437+0000","last_became_active":"2024-09-12T17:51:59.948733+0000","last_became_peered":"2024-09-12T17:51:59.948733+0000","last_unstale":"2024-09-12T19:22:03.285437+0000","last_undegraded":"2024-09-12T19:22:03.285437+0000","last_fullsized":"2024-09-12T19:22:03.285437+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:47.852395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'5","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.759933+0000","last_change":"2024-09-12T17:51:52.905209+0000","last_active":"2024-09-12T19:23:00.759933+0000","last_peered":"2024-09-12T19:23:00.759933+0000","last_clean":"2024-09-12T19:23:00.759933+0000","last_became_active":"2024-09-12T17:51:52.904092+0000","last_became_peered":"2024-09-12T17:51:52.904092+0000","last_unstale":"2024-09-12T19:23:00.759933+0000","last_undegraded":"2024-09-12T19:23:00.759933+0000","last_fullsized":"2024-09-12T19:23:00.759933+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:00.570363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'87","reported_seq":311,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:12.988906+0000","last_change":"2024-09-12T17:45:41.578591+0000","last_active":"2024-09-12T19:20:12.988906+0000","last_peered":"2024-09-12T19:20:12.988906+0000","last_clean":"2024-09-12T19:20:12.988906+0000","last_became_active":"2024-09-12T17:45:41.574884+0000","last_became_peered":"2024-09-12T17:45:41.574884+0000","last_unstale":"2024-09-12T19:20:12.988906+0000","last_undegraded":"2024-09-12T19:20:12.988906+0000","last_fullsized":"2024-09-12T19:20:12.988906+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:26.324719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":442,"num_read_kb":315,"num_write":154,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.557025+0000","last_change":"2024-09-12T18:19:22.633163+0000","last_active":"2024-09-12T19:20:03.557025+0000","last_peered":"2024-09-12T19:20:03.557025+0000","last_clean":"2024-09-12T19:20:03.557025+0000","last_became_active":"2024-09-12T18:19:22.632360+0000","last_became_peered":"2024-09-12T18:19:22.632360+0000","last_unstale":"2024-09-12T19:20:03.557025+0000","last_undegraded":"2024-09-12T19:20:03.557025+0000","last_fullsized":"2024-09-12T19:20:03.557025+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:12.189773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'7","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:12.981953+0000","last_change":"2024-09-12T17:51:59.946265+0000","last_active":"2024-09-12T19:20:12.981953+0000","last_peered":"2024-09-12T19:20:12.981953+0000","last_clean":"2024-09-12T19:20:12.981953+0000","last_became_active":"2024-09-12T17:51:59.945099+0000","last_became_peered":"2024-09-12T17:51:59.945099+0000","last_unstale":"2024-09-12T19:20:12.981953+0000","last_undegraded":"2024-09-12T19:20:12.981953+0000","last_fullsized":"2024-09-12T19:20:12.981953+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:52.338695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.212670+0000","last_change":"2024-09-12T17:51:52.899779+0000","last_active":"2024-09-12T19:21:53.212670+0000","last_peered":"2024-09-12T19:21:53.212670+0000","last_clean":"2024-09-12T19:21:53.212670+0000","last_became_active":"2024-09-12T17:51:52.889772+0000","last_became_peered":"2024-09-12T17:51:52.889772+0000","last_unstale":"2024-09-12T19:21:53.212670+0000","last_undegraded":"2024-09-12T19:21:53.212670+0000","last_fullsized":"2024-09-12T19:21:53.212670+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:13.521012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'27","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.559281+0000","last_change":"2024-09-12T17:45:41.591605+0000","last_active":"2024-09-12T19:20:13.559281+0000","last_peered":"2024-09-12T19:20:13.559281+0000","last_clean":"2024-09-12T19:20:13.559281+0000","last_became_active":"2024-09-12T17:45:41.590861+0000","last_became_peered":"2024-09-12T17:45:41.590861+0000","last_unstale":"2024-09-12T19:20:13.559281+0000","last_undegraded":"2024-09-12T19:20:13.559281+0000","last_fullsized":"2024-09-12T19:20:13.559281+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:02.020910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":90,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968726+0000","last_change":"2024-09-12T18:19:22.656976+0000","last_active":"2024-09-12T19:20:02.968726+0000","last_peered":"2024-09-12T19:20:02.968726+0000","last_clean":"2024-09-12T19:20:02.968726+0000","last_became_active":"2024-09-12T18:19:22.655979+0000","last_became_peered":"2024-09-12T18:19:22.655979+0000","last_unstale":"2024-09-12T19:20:02.968726+0000","last_undegraded":"2024-09-12T19:20:02.968726+0000","last_fullsized":"2024-09-12T19:20:02.968726+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:36.624661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'5","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.592803+0000","last_change":"2024-09-12T17:51:59.945983+0000","last_active":"2024-09-12T19:23:00.592803+0000","last_peered":"2024-09-12T19:23:00.592803+0000","last_clean":"2024-09-12T19:23:00.592803+0000","last_became_active":"2024-09-12T17:51:59.942431+0000","last_became_peered":"2024-09-12T17:51:59.942431+0000","last_unstale":"2024-09-12T19:23:00.592803+0000","last_undegraded":"2024-09-12T19:23:00.592803+0000","last_fullsized":"2024-09-12T19:23:00.592803+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:57.343792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10320,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:18.007302+0000","last_change":"2024-09-12T17:51:52.901374+0000","last_active":"2024-09-12T19:22:18.007302+0000","last_peered":"2024-09-12T19:22:18.007302+0000","last_clean":"2024-09-12T19:22:18.007302+0000","last_became_active":"2024-09-12T17:51:52.900785+0000","last_became_peered":"2024-09-12T17:51:52.900785+0000","last_unstale":"2024-09-12T19:22:18.007302+0000","last_undegraded":"2024-09-12T19:22:18.007302+0000","last_fullsized":"2024-09-12T19:22:18.007302+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:43.825575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'9","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.922578+0000","last_change":"2024-09-12T19:23:26.922578+0000","last_active":"2024-09-12T19:23:26.922578+0000","last_peered":"2024-09-12T19:23:26.922578+0000","last_clean":"2024-09-12T19:23:26.922578+0000","last_became_active":"2024-09-12T17:45:41.565793+0000","last_became_peered":"2024-09-12T17:45:41.565793+0000","last_unstale":"2024-09-12T19:23:26.922578+0000","last_undegraded":"2024-09-12T19:23:26.922578+0000","last_fullsized":"2024-09-12T19:23:26.922578+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'9","last_scrub_stamp":"2024-09-12T19:23:26.922376+0000","last_deep_scrub":"267'9","last_deep_scrub_stamp":"2024-09-12T19:23:26.922376+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.922376+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:57.354679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.257645+0000","last_change":"2024-09-12T18:19:22.664289+0000","last_active":"2024-09-12T19:20:08.257645+0000","last_peered":"2024-09-12T19:20:08.257645+0000","last_clean":"2024-09-12T19:20:08.257645+0000","last_became_active":"2024-09-12T18:19:22.663586+0000","last_became_peered":"2024-09-12T18:19:22.663586+0000","last_unstale":"2024-09-12T19:20:08.257645+0000","last_undegraded":"2024-09-12T19:20:08.257645+0000","last_fullsized":"2024-09-12T19:20:08.257645+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:24.618521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:53.208011+0000","last_change":"2024-09-12T17:51:59.950216+0000","last_active":"2024-09-12T19:20:53.208011+0000","last_peered":"2024-09-12T19:20:53.208011+0000","last_clean":"2024-09-12T19:20:53.208011+0000","last_became_active":"2024-09-12T17:51:59.949437+0000","last_became_peered":"2024-09-12T17:51:59.949437+0000","last_unstale":"2024-09-12T19:20:53.208011+0000","last_undegraded":"2024-09-12T19:20:53.208011+0000","last_fullsized":"2024-09-12T19:20:53.208011+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:26.376958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:53.224729+0000","last_change":"2024-09-12T17:51:52.899343+0000","last_active":"2024-09-12T19:22:53.224729+0000","last_peered":"2024-09-12T19:22:53.224729+0000","last_clean":"2024-09-12T19:22:53.224729+0000","last_became_active":"2024-09-12T17:51:52.898903+0000","last_became_peered":"2024-09-12T17:51:52.898903+0000","last_unstale":"2024-09-12T19:22:53.224729+0000","last_undegraded":"2024-09-12T19:22:53.224729+0000","last_fullsized":"2024-09-12T19:22:53.224729+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:05.020501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'42","reported_seq":194,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.188942+0000","last_change":"2024-09-12T17:45:41.577630+0000","last_active":"2024-09-12T19:20:13.188942+0000","last_peered":"2024-09-12T19:20:13.188942+0000","last_clean":"2024-09-12T19:20:13.188942+0000","last_became_active":"2024-09-12T17:45:41.576921+0000","last_became_peered":"2024-09-12T17:45:41.576921+0000","last_unstale":"2024-09-12T19:20:13.188942+0000","last_undegraded":"2024-09-12T19:20:13.188942+0000","last_fullsized":"2024-09-12T19:20:13.188942+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:39.622331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":172,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:22.973830+0000","last_change":"2024-09-12T18:19:22.670182+0000","last_active":"2024-09-12T19:20:22.973830+0000","last_peered":"2024-09-12T19:20:22.973830+0000","last_clean":"2024-09-12T19:20:22.973830+0000","last_became_active":"2024-09-12T18:19:22.669476+0000","last_became_peered":"2024-09-12T18:19:22.669476+0000","last_unstale":"2024-09-12T19:20:22.973830+0000","last_undegraded":"2024-09-12T19:20:22.973830+0000","last_fullsized":"2024-09-12T19:20:22.973830+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:51.189488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:52.980628+0000","last_change":"2024-09-12T17:51:59.939499+0000","last_active":"2024-09-12T19:20:52.980628+0000","last_peered":"2024-09-12T19:20:52.980628+0000","last_clean":"2024-09-12T19:20:52.980628+0000","last_became_active":"2024-09-12T17:51:59.938736+0000","last_became_peered":"2024-09-12T17:51:59.938736+0000","last_unstale":"2024-09-12T19:20:52.980628+0000","last_undegraded":"2024-09-12T19:20:52.980628+0000","last_fullsized":"2024-09-12T19:20:52.980628+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:10.628111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'2","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:53.014895+0000","last_change":"2024-09-12T17:51:52.901410+0000","last_active":"2024-09-12T19:22:53.014895+0000","last_peered":"2024-09-12T19:22:53.014895+0000","last_clean":"2024-09-12T19:22:53.014895+0000","last_became_active":"2024-09-12T17:51:52.900972+0000","last_became_peered":"2024-09-12T17:51:52.900972+0000","last_unstale":"2024-09-12T19:22:53.014895+0000","last_undegraded":"2024-09-12T19:22:53.014895+0000","last_fullsized":"2024-09-12T19:22:53.014895+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:55.522541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'26","reported_seq":147,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:12.956617+0000","last_change":"2024-09-12T17:45:41.588736+0000","last_active":"2024-09-12T19:19:12.956617+0000","last_peered":"2024-09-12T19:19:12.956617+0000","last_clean":"2024-09-12T19:19:12.956617+0000","last_became_active":"2024-09-12T17:45:41.588013+0000","last_became_peered":"2024-09-12T17:45:41.588013+0000","last_unstale":"2024-09-12T19:19:12.956617+0000","last_undegraded":"2024-09-12T19:19:12.956617+0000","last_fullsized":"2024-09-12T19:19:12.956617+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:46.460159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":89,"num_write":52,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:07.970160+0000","last_change":"2024-09-12T18:19:22.664050+0000","last_active":"2024-09-12T19:20:07.970160+0000","last_peered":"2024-09-12T19:20:07.970160+0000","last_clean":"2024-09-12T19:20:07.970160+0000","last_became_active":"2024-09-12T18:19:22.662685+0000","last_became_peered":"2024-09-12T18:19:22.662685+0000","last_unstale":"2024-09-12T19:20:07.970160+0000","last_undegraded":"2024-09-12T19:20:07.970160+0000","last_fullsized":"2024-09-12T19:20:07.970160+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:20.137876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'10","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.864488+0000","last_change":"2024-09-12T17:51:59.943267+0000","last_active":"2024-09-12T19:22:59.864488+0000","last_peered":"2024-09-12T19:22:59.864488+0000","last_clean":"2024-09-12T19:22:59.864488+0000","last_became_active":"2024-09-12T17:51:59.942597+0000","last_became_peered":"2024-09-12T17:51:59.942597+0000","last_unstale":"2024-09-12T19:22:59.864488+0000","last_undegraded":"2024-09-12T19:22:59.864488+0000","last_fullsized":"2024-09-12T19:22:59.864488+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:04.930513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":29698,"num_write":10,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"267'3","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.116269+0000","last_change":"2024-09-12T17:51:52.908849+0000","last_active":"2024-09-12T19:23:01.116269+0000","last_peered":"2024-09-12T19:23:01.116269+0000","last_clean":"2024-09-12T19:23:01.116269+0000","last_became_active":"2024-09-12T17:51:52.908200+0000","last_became_peered":"2024-09-12T17:51:52.908200+0000","last_unstale":"2024-09-12T19:23:01.116269+0000","last_undegraded":"2024-09-12T19:23:01.116269+0000","last_fullsized":"2024-09-12T19:23:01.116269+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'15","reported_seq":119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:03.272080+0000","last_change":"2024-09-12T17:45:41.578047+0000","last_active":"2024-09-12T19:21:03.272080+0000","last_peered":"2024-09-12T19:21:03.272080+0000","last_clean":"2024-09-12T19:21:03.272080+0000","last_became_active":"2024-09-12T17:45:41.572067+0000","last_became_peered":"2024-09-12T17:45:41.572067+0000","last_unstale":"2024-09-12T19:21:03.272080+0000","last_undegraded":"2024-09-12T19:21:03.272080+0000","last_fullsized":"2024-09-12T19:21:03.272080+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.187554+0000","last_change":"2024-09-12T18:19:22.653075+0000","last_active":"2024-09-12T19:20:08.187554+0000","last_peered":"2024-09-12T19:20:08.187554+0000","last_clean":"2024-09-12T19:20:08.187554+0000","last_became_active":"2024-09-12T18:19:22.648052+0000","last_became_peered":"2024-09-12T18:19:22.648052+0000","last_unstale":"2024-09-12T19:20:08.187554+0000","last_undegraded":"2024-09-12T19:20:08.187554+0000","last_fullsized":"2024-09-12T19:20:08.187554+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:19.707016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"267'8","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.314590+0000","last_change":"2024-09-12T17:51:59.949619+0000","last_active":"2024-09-12T19:23:00.314590+0000","last_peered":"2024-09-12T19:23:00.314590+0000","last_clean":"2024-09-12T19:23:00.314590+0000","last_became_active":"2024-09-12T17:51:59.948873+0000","last_became_peered":"2024-09-12T17:51:59.948873+0000","last_unstale":"2024-09-12T19:23:00.314590+0000","last_undegraded":"2024-09-12T19:23:00.314590+0000","last_fullsized":"2024-09-12T19:23:00.314590+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.190557+0000","last_change":"2024-09-12T17:51:52.890333+0000","last_active":"2024-09-12T19:19:38.190557+0000","last_peered":"2024-09-12T19:19:38.190557+0000","last_clean":"2024-09-12T19:19:38.190557+0000","last_became_active":"2024-09-12T17:51:52.889529+0000","last_became_peered":"2024-09-12T17:51:52.889529+0000","last_unstale":"2024-09-12T19:19:38.190557+0000","last_undegraded":"2024-09-12T19:19:38.190557+0000","last_fullsized":"2024-09-12T19:19:38.190557+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:16.334887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'21","reported_seq":136,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:03.570213+0000","last_change":"2024-09-12T17:45:41.580279+0000","last_active":"2024-09-12T19:21:03.570213+0000","last_peered":"2024-09-12T19:21:03.570213+0000","last_clean":"2024-09-12T19:21:03.570213+0000","last_became_active":"2024-09-12T17:45:41.579580+0000","last_became_peered":"2024-09-12T17:45:41.579580+0000","last_unstale":"2024-09-12T19:21:03.570213+0000","last_undegraded":"2024-09-12T19:21:03.570213+0000","last_fullsized":"2024-09-12T19:21:03.570213+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":77,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.964979+0000","last_change":"2024-09-12T18:19:22.669927+0000","last_active":"2024-09-12T19:19:47.964979+0000","last_peered":"2024-09-12T19:19:47.964979+0000","last_clean":"2024-09-12T19:19:47.964979+0000","last_became_active":"2024-09-12T18:19:22.669240+0000","last_became_peered":"2024-09-12T18:19:22.669240+0000","last_unstale":"2024-09-12T19:19:47.964979+0000","last_undegraded":"2024-09-12T19:19:47.964979+0000","last_fullsized":"2024-09-12T19:19:47.964979+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:35.739210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.182370+0000","last_change":"2024-09-12T17:51:59.970451+0000","last_active":"2024-09-12T19:19:48.182370+0000","last_peered":"2024-09-12T19:19:48.182370+0000","last_clean":"2024-09-12T19:19:48.182370+0000","last_became_active":"2024-09-12T17:51:59.969706+0000","last_became_peered":"2024-09-12T17:51:59.969706+0000","last_unstale":"2024-09-12T19:19:48.182370+0000","last_undegraded":"2024-09-12T19:19:48.182370+0000","last_fullsized":"2024-09-12T19:19:48.182370+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:53.849725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'6","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959065+0000","last_change":"2024-09-12T17:51:52.884785+0000","last_active":"2024-09-12T19:19:22.959065+0000","last_peered":"2024-09-12T19:19:22.959065+0000","last_clean":"2024-09-12T19:19:22.959065+0000","last_became_active":"2024-09-12T17:51:52.884061+0000","last_became_peered":"2024-09-12T17:51:52.884061+0000","last_unstale":"2024-09-12T19:19:22.959065+0000","last_undegraded":"2024-09-12T19:19:22.959065+0000","last_fullsized":"2024-09-12T19:19:22.959065+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:17.943043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'29","reported_seq":160,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:03.201552+0000","last_change":"2024-09-12T17:45:41.573958+0000","last_active":"2024-09-12T19:21:03.201552+0000","last_peered":"2024-09-12T19:21:03.201552+0000","last_clean":"2024-09-12T19:21:03.201552+0000","last_became_active":"2024-09-12T17:45:41.572130+0000","last_became_peered":"2024-09-12T17:45:41.572130+0000","last_unstale":"2024-09-12T19:21:03.201552+0000","last_undegraded":"2024-09-12T19:21:03.201552+0000","last_fullsized":"2024-09-12T19:21:03.201552+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":63,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.982479+0000","last_change":"2024-09-12T18:19:22.667322+0000","last_active":"2024-09-12T19:19:47.982479+0000","last_peered":"2024-09-12T19:19:47.982479+0000","last_clean":"2024-09-12T19:19:47.982479+0000","last_became_active":"2024-09-12T18:19:22.666608+0000","last_became_peered":"2024-09-12T18:19:22.666608+0000","last_unstale":"2024-09-12T19:19:47.982479+0000","last_undegraded":"2024-09-12T19:19:47.982479+0000","last_fullsized":"2024-09-12T19:19:47.982479+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:35.427234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.178096+0000","last_change":"2024-09-12T17:51:59.956619+0000","last_active":"2024-09-12T19:19:33.178096+0000","last_peered":"2024-09-12T19:19:33.178096+0000","last_clean":"2024-09-12T19:19:33.178096+0000","last_became_active":"2024-09-12T17:51:59.956010+0000","last_became_peered":"2024-09-12T17:51:59.956010+0000","last_unstale":"2024-09-12T19:19:33.178096+0000","last_undegraded":"2024-09-12T19:19:33.178096+0000","last_fullsized":"2024-09-12T19:19:33.178096+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:44.171788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'2","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.527059+0000","last_change":"2024-09-12T17:51:52.904694+0000","last_active":"2024-09-12T19:19:33.527059+0000","last_peered":"2024-09-12T19:19:33.527059+0000","last_clean":"2024-09-12T19:19:33.527059+0000","last_became_active":"2024-09-12T17:51:52.903355+0000","last_became_peered":"2024-09-12T17:51:52.903355+0000","last_unstale":"2024-09-12T19:19:33.527059+0000","last_undegraded":"2024-09-12T19:19:33.527059+0000","last_fullsized":"2024-09-12T19:19:33.527059+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:54.768969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'38","reported_seq":185,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:03.570435+0000","last_change":"2024-09-12T17:45:41.578036+0000","last_active":"2024-09-12T19:21:03.570435+0000","last_peered":"2024-09-12T19:21:03.570435+0000","last_clean":"2024-09-12T19:21:03.570435+0000","last_became_active":"2024-09-12T17:45:41.577322+0000","last_became_peered":"2024-09-12T17:45:41.577322+0000","last_unstale":"2024-09-12T19:21:03.570435+0000","last_undegraded":"2024-09-12T19:21:03.570435+0000","last_fullsized":"2024-09-12T19:21:03.570435+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":139,"num_write":67,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.973565+0000","last_change":"2024-09-12T18:19:22.652387+0000","last_active":"2024-09-12T19:19:37.973565+0000","last_peered":"2024-09-12T19:19:37.973565+0000","last_clean":"2024-09-12T19:19:37.973565+0000","last_became_active":"2024-09-12T18:19:22.647003+0000","last_became_peered":"2024-09-12T18:19:22.647003+0000","last_unstale":"2024-09-12T19:19:37.973565+0000","last_undegraded":"2024-09-12T19:19:37.973565+0000","last_fullsized":"2024-09-12T19:19:37.973565+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:55.195971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.986890+0000","last_change":"2024-09-12T17:51:59.940082+0000","last_active":"2024-09-12T19:22:58.986890+0000","last_peered":"2024-09-12T19:22:58.986890+0000","last_clean":"2024-09-12T19:22:58.986890+0000","last_became_active":"2024-09-12T17:51:59.939200+0000","last_became_peered":"2024-09-12T17:51:59.939200+0000","last_unstale":"2024-09-12T19:22:58.986890+0000","last_undegraded":"2024-09-12T19:22:58.986890+0000","last_fullsized":"2024-09-12T19:22:58.986890+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:37.667275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"267'6","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.988584+0000","last_change":"2024-09-12T17:51:52.897536+0000","last_active":"2024-09-12T19:22:58.988584+0000","last_peered":"2024-09-12T19:22:58.988584+0000","last_clean":"2024-09-12T19:22:58.988584+0000","last_became_active":"2024-09-12T17:51:52.896708+0000","last_became_peered":"2024-09-12T17:51:52.896708+0000","last_unstale":"2024-09-12T19:22:58.988584+0000","last_undegraded":"2024-09-12T19:22:58.988584+0000","last_fullsized":"2024-09-12T19:22:58.988584+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:36.334907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'29","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.965069+0000","last_change":"2024-09-12T17:45:41.592647+0000","last_active":"2024-09-12T19:19:47.965069+0000","last_peered":"2024-09-12T19:19:47.965069+0000","last_clean":"2024-09-12T19:19:47.965069+0000","last_became_active":"2024-09-12T17:45:41.591866+0000","last_became_peered":"2024-09-12T17:45:41.591866+0000","last_unstale":"2024-09-12T19:19:47.965069+0000","last_undegraded":"2024-09-12T19:19:47.965069+0000","last_fullsized":"2024-09-12T19:19:47.965069+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:29.840636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.192729+0000","last_change":"2024-09-12T18:19:22.661674+0000","last_active":"2024-09-12T19:19:48.192729+0000","last_peered":"2024-09-12T19:19:48.192729+0000","last_clean":"2024-09-12T19:19:48.192729+0000","last_became_active":"2024-09-12T18:19:22.660667+0000","last_became_peered":"2024-09-12T18:19:22.660667+0000","last_unstale":"2024-09-12T19:19:48.192729+0000","last_undegraded":"2024-09-12T19:19:48.192729+0000","last_fullsized":"2024-09-12T19:19:48.192729+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:47.455186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:53.208174+0000","last_change":"2024-09-12T17:51:59.949737+0000","last_active":"2024-09-12T19:20:53.208174+0000","last_peered":"2024-09-12T19:20:53.208174+0000","last_clean":"2024-09-12T19:20:53.208174+0000","last_became_active":"2024-09-12T17:51:59.948786+0000","last_became_peered":"2024-09-12T17:51:59.948786+0000","last_unstale":"2024-09-12T19:20:53.208174+0000","last_undegraded":"2024-09-12T19:20:53.208174+0000","last_fullsized":"2024-09-12T19:20:53.208174+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:33.491621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.978565+0000","last_change":"2024-09-12T17:51:52.896511+0000","last_active":"2024-09-12T19:20:42.978565+0000","last_peered":"2024-09-12T19:20:42.978565+0000","last_clean":"2024-09-12T19:20:42.978565+0000","last_became_active":"2024-09-12T17:51:52.895779+0000","last_became_peered":"2024-09-12T17:51:52.895779+0000","last_unstale":"2024-09-12T19:20:42.978565+0000","last_undegraded":"2024-09-12T19:20:42.978565+0000","last_fullsized":"2024-09-12T19:20:42.978565+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:11.529897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'43","reported_seq":205,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:27.971388+0000","last_change":"2024-09-12T17:45:41.584723+0000","last_active":"2024-09-12T19:19:27.971388+0000","last_peered":"2024-09-12T19:19:27.971388+0000","last_clean":"2024-09-12T19:19:27.971388+0000","last_became_active":"2024-09-12T17:45:41.576707+0000","last_became_peered":"2024-09-12T17:45:41.576707+0000","last_unstale":"2024-09-12T19:19:27.971388+0000","last_undegraded":"2024-09-12T19:19:27.971388+0000","last_fullsized":"2024-09-12T19:19:27.971388+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:31.487354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":167,"num_write":65,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"266'1","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.533665+0000","last_change":"2024-09-12T18:19:22.658620+0000","last_active":"2024-09-12T19:20:03.533665+0000","last_peered":"2024-09-12T19:20:03.533665+0000","last_clean":"2024-09-12T19:20:03.533665+0000","last_became_active":"2024-09-12T18:19:22.657891+0000","last_became_peered":"2024-09-12T18:19:22.657891+0000","last_unstale":"2024-09-12T19:20:03.533665+0000","last_undegraded":"2024-09-12T19:20:03.533665+0000","last_fullsized":"2024-09-12T19:20:03.533665+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:56.867297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:32.972545+0000","last_change":"2024-09-12T17:51:59.963668+0000","last_active":"2024-09-12T19:19:32.972545+0000","last_peered":"2024-09-12T19:19:32.972545+0000","last_clean":"2024-09-12T19:19:32.972545+0000","last_became_active":"2024-09-12T17:51:59.962769+0000","last_became_peered":"2024-09-12T17:51:59.962769+0000","last_unstale":"2024-09-12T19:19:32.972545+0000","last_undegraded":"2024-09-12T19:19:32.972545+0000","last_fullsized":"2024-09-12T19:19:32.972545+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:25.342532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'5","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:12.971293+0000","last_change":"2024-09-12T17:51:52.902253+0000","last_active":"2024-09-12T19:20:12.971293+0000","last_peered":"2024-09-12T19:20:12.971293+0000","last_clean":"2024-09-12T19:20:12.971293+0000","last_became_active":"2024-09-12T17:51:52.899987+0000","last_became_peered":"2024-09-12T17:51:52.899987+0000","last_unstale":"2024-09-12T19:20:12.971293+0000","last_undegraded":"2024-09-12T19:20:12.971293+0000","last_fullsized":"2024-09-12T19:20:12.971293+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:40.914632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'9","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:27.978145+0000","last_change":"2024-09-12T17:45:41.571623+0000","last_active":"2024-09-12T19:19:27.978145+0000","last_peered":"2024-09-12T19:19:27.978145+0000","last_clean":"2024-09-12T19:19:27.978145+0000","last_became_active":"2024-09-12T17:45:41.569871+0000","last_became_peered":"2024-09-12T17:45:41.569871+0000","last_unstale":"2024-09-12T19:19:27.978145+0000","last_undegraded":"2024-09-12T19:19:27.978145+0000","last_fullsized":"2024-09-12T19:19:27.978145+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:49.201478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.186072+0000","last_change":"2024-09-12T18:19:22.663293+0000","last_active":"2024-09-12T19:20:03.186072+0000","last_peered":"2024-09-12T19:20:03.186072+0000","last_clean":"2024-09-12T19:20:03.186072+0000","last_became_active":"2024-09-12T18:19:22.648018+0000","last_became_peered":"2024-09-12T18:19:22.648018+0000","last_unstale":"2024-09-12T19:20:03.186072+0000","last_undegraded":"2024-09-12T19:20:03.186072+0000","last_fullsized":"2024-09-12T19:20:03.186072+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:02.291028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'7","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.992212+0000","last_change":"2024-09-12T17:51:59.944498+0000","last_active":"2024-09-12T19:20:27.992212+0000","last_peered":"2024-09-12T19:20:27.992212+0000","last_clean":"2024-09-12T19:20:27.992212+0000","last_became_active":"2024-09-12T17:51:59.943764+0000","last_became_peered":"2024-09-12T17:51:59.943764+0000","last_unstale":"2024-09-12T19:20:27.992212+0000","last_undegraded":"2024-09-12T19:20:27.992212+0000","last_fullsized":"2024-09-12T19:20:27.992212+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:10.664480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20800,"num_write":12,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.958933+0000","last_change":"2024-09-12T17:51:52.894510+0000","last_active":"2024-09-12T19:19:22.958933+0000","last_peered":"2024-09-12T19:19:22.958933+0000","last_clean":"2024-09-12T19:19:22.958933+0000","last_became_active":"2024-09-12T17:51:52.893764+0000","last_became_peered":"2024-09-12T17:51:52.893764+0000","last_unstale":"2024-09-12T19:19:22.958933+0000","last_undegraded":"2024-09-12T19:19:22.958933+0000","last_fullsized":"2024-09-12T19:19:22.958933+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:33.064325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'85","reported_seq":313,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:28.188253+0000","last_change":"2024-09-12T17:45:41.579106+0000","last_active":"2024-09-12T19:19:28.188253+0000","last_peered":"2024-09-12T19:19:28.188253+0000","last_clean":"2024-09-12T19:19:28.188253+0000","last_became_active":"2024-09-12T17:45:41.576079+0000","last_became_peered":"2024-09-12T17:45:41.576079+0000","last_unstale":"2024-09-12T19:19:28.188253+0000","last_undegraded":"2024-09-12T19:19:28.188253+0000","last_fullsized":"2024-09-12T19:19:28.188253+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:43:21.619591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":312,"num_write":160,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.182314+0000","last_change":"2024-09-12T18:19:22.663744+0000","last_active":"2024-09-12T19:19:48.182314+0000","last_peered":"2024-09-12T19:19:48.182314+0000","last_clean":"2024-09-12T19:19:48.182314+0000","last_became_active":"2024-09-12T18:19:22.662955+0000","last_became_peered":"2024-09-12T18:19:22.662955+0000","last_unstale":"2024-09-12T19:19:48.182314+0000","last_undegraded":"2024-09-12T19:19:48.182314+0000","last_fullsized":"2024-09-12T19:19:48.182314+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:06.958542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.550710+0000","last_change":"2024-09-12T17:51:59.943709+0000","last_active":"2024-09-12T19:19:33.550710+0000","last_peered":"2024-09-12T19:19:33.550710+0000","last_clean":"2024-09-12T19:19:33.550710+0000","last_became_active":"2024-09-12T17:51:59.942275+0000","last_became_peered":"2024-09-12T17:51:59.942275+0000","last_unstale":"2024-09-12T19:19:33.550710+0000","last_undegraded":"2024-09-12T19:19:33.550710+0000","last_fullsized":"2024-09-12T19:19:33.550710+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:15.298466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.970211+0000","last_change":"2024-09-12T17:51:52.896451+0000","last_active":"2024-09-12T19:19:22.970211+0000","last_peered":"2024-09-12T19:19:22.970211+0000","last_clean":"2024-09-12T19:19:22.970211+0000","last_became_active":"2024-09-12T17:51:52.895913+0000","last_became_peered":"2024-09-12T17:51:52.895913+0000","last_unstale":"2024-09-12T19:19:22.970211+0000","last_undegraded":"2024-09-12T19:19:22.970211+0000","last_fullsized":"2024-09-12T19:19:22.970211+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:21.249149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'8","reported_seq":102,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:28.549494+0000","last_change":"2024-09-12T17:45:41.577598+0000","last_active":"2024-09-12T19:19:28.549494+0000","last_peered":"2024-09-12T19:19:28.549494+0000","last_clean":"2024-09-12T19:19:28.549494+0000","last_became_active":"2024-09-12T17:45:41.576841+0000","last_became_peered":"2024-09-12T17:45:41.576841+0000","last_unstale":"2024-09-12T19:19:28.549494+0000","last_undegraded":"2024-09-12T19:19:28.549494+0000","last_fullsized":"2024-09-12T19:19:28.549494+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:40.378322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968901+0000","last_change":"2024-09-12T18:19:22.663672+0000","last_active":"2024-09-12T19:20:02.968901+0000","last_peered":"2024-09-12T19:20:02.968901+0000","last_clean":"2024-09-12T19:20:02.968901+0000","last_became_active":"2024-09-12T18:19:22.662633+0000","last_became_peered":"2024-09-12T18:19:22.662633+0000","last_unstale":"2024-09-12T19:20:02.968901+0000","last_undegraded":"2024-09-12T19:20:02.968901+0000","last_fullsized":"2024-09-12T19:20:02.968901+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:40.210719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.189287+0000","last_change":"2024-09-12T17:51:59.929795+0000","last_active":"2024-09-12T19:19:33.189287+0000","last_peered":"2024-09-12T19:19:33.189287+0000","last_clean":"2024-09-12T19:19:33.189287+0000","last_became_active":"2024-09-12T17:51:59.929108+0000","last_became_peered":"2024-09-12T17:51:59.929108+0000","last_unstale":"2024-09-12T19:19:33.189287+0000","last_undegraded":"2024-09-12T19:19:33.189287+0000","last_fullsized":"2024-09-12T19:19:33.189287+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:42.206076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"267'2","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:28.575723+0000","last_change":"2024-09-12T17:51:52.883949+0000","last_active":"2024-09-12T19:21:28.575723+0000","last_peered":"2024-09-12T19:21:28.575723+0000","last_clean":"2024-09-12T19:21:28.575723+0000","last_became_active":"2024-09-12T17:51:52.876809+0000","last_became_peered":"2024-09-12T17:51:52.876809+0000","last_unstale":"2024-09-12T19:21:28.575723+0000","last_undegraded":"2024-09-12T19:21:28.575723+0000","last_fullsized":"2024-09-12T19:21:28.575723+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:43.734348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":5,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'24","reported_seq":146,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968654+0000","last_change":"2024-09-12T17:45:41.588350+0000","last_active":"2024-09-12T19:20:02.968654+0000","last_peered":"2024-09-12T19:20:02.968654+0000","last_clean":"2024-09-12T19:20:02.968654+0000","last_became_active":"2024-09-12T17:45:41.587464+0000","last_became_peered":"2024-09-12T17:45:41.587464+0000","last_unstale":"2024-09-12T19:20:02.968654+0000","last_undegraded":"2024-09-12T19:20:02.968654+0000","last_fullsized":"2024-09-12T19:20:02.968654+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:57.305993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":80,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'298","reported_seq":957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.108249+0000","last_change":"2024-09-12T19:23:21.108249+0000","last_active":"2024-09-12T19:23:21.108249+0000","last_peered":"2024-09-12T19:23:21.108249+0000","last_clean":"2024-09-12T19:23:21.108249+0000","last_became_active":"2024-09-12T17:29:52.754920+0000","last_became_peered":"2024-09-12T17:29:52.754920+0000","last_unstale":"2024-09-12T19:23:21.108249+0000","last_undegraded":"2024-09-12T19:23:21.108249+0000","last_fullsized":"2024-09-12T19:23:21.108249+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'298","last_scrub_stamp":"2024-09-12T19:23:21.108016+0000","last_deep_scrub":"267'298","last_deep_scrub_stamp":"2024-09-12T19:23:21.108016+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.108016+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:55.221859+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262253,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":663,"num_write":1055,"num_write_kb":22160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'507","reported_seq":2214,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.392030+0000","last_change":"2024-09-12T19:23:26.392030+0000","last_active":"2024-09-12T19:23:26.392030+0000","last_peered":"2024-09-12T19:23:26.392030+0000","last_clean":"2024-09-12T19:23:26.392030+0000","last_became_active":"2024-09-12T17:29:54.760892+0000","last_became_peered":"2024-09-12T17:29:54.760892+0000","last_unstale":"2024-09-12T19:23:26.392030+0000","last_undegraded":"2024-09-12T19:23:26.392030+0000","last_fullsized":"2024-09-12T19:23:26.392030+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'507","last_scrub_stamp":"2024-09-12T19:23:26.391829+0000","last_deep_scrub":"267'507","last_deep_scrub_stamp":"2024-09-12T19:23:26.391829+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.391829+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:48.210092+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2904,"num_read_kb":2740,"num_write":620,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'340","reported_seq":1036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.713604+0000","last_change":"2024-09-12T19:23:17.713604+0000","last_active":"2024-09-12T19:23:17.713604+0000","last_peered":"2024-09-12T19:23:17.713604+0000","last_clean":"2024-09-12T19:23:17.713604+0000","last_became_active":"2024-09-12T17:29:52.747481+0000","last_became_peered":"2024-09-12T17:29:52.747481+0000","last_unstale":"2024-09-12T19:23:17.713604+0000","last_undegraded":"2024-09-12T19:23:17.713604+0000","last_fullsized":"2024-09-12T19:23:17.713604+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'340","last_scrub_stamp":"2024-09-12T19:23:17.713262+0000","last_deep_scrub":"267'340","last_deep_scrub_stamp":"2024-09-12T19:23:17.713262+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.713262+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:02.653602+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306162,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":522,"num_read_kb":19278,"num_write":1123,"num_write_kb":29260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'430","reported_seq":1893,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.967478+0000","last_change":"2024-09-12T17:29:54.754770+0000","last_active":"2024-09-12T19:19:57.967478+0000","last_peered":"2024-09-12T19:19:57.967478+0000","last_clean":"2024-09-12T19:19:57.967478+0000","last_became_active":"2024-09-12T17:29:54.753272+0000","last_became_peered":"2024-09-12T17:29:54.753272+0000","last_unstale":"2024-09-12T19:19:57.967478+0000","last_undegraded":"2024-09-12T19:19:57.967478+0000","last_fullsized":"2024-09-12T19:19:57.967478+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:02.705919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2129,"num_read_kb":2000,"num_write":496,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'342","reported_seq":1041,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:08.906121+0000","last_change":"2024-09-12T19:23:08.906121+0000","last_active":"2024-09-12T19:23:08.906121+0000","last_peered":"2024-09-12T19:23:08.906121+0000","last_clean":"2024-09-12T19:23:08.906121+0000","last_became_active":"2024-09-12T17:29:52.735978+0000","last_became_peered":"2024-09-12T17:29:52.735978+0000","last_unstale":"2024-09-12T19:23:08.906121+0000","last_undegraded":"2024-09-12T19:23:08.906121+0000","last_fullsized":"2024-09-12T19:23:08.906121+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'342","last_scrub_stamp":"2024-09-12T19:23:08.905981+0000","last_deep_scrub":"267'342","last_deep_scrub_stamp":"2024-09-12T19:23:08.905981+0000","last_clean_scrub_stamp":"2024-09-12T19:23:08.905981+0000","objects_scrubbed":10,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:12.305189+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2553570,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":504,"num_read_kb":35253,"num_write":1107,"num_write_kb":35855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'940","reported_seq":2615,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.215432+0000","last_change":"2024-09-12T19:23:27.215432+0000","last_active":"2024-09-12T19:23:27.215432+0000","last_peered":"2024-09-12T19:23:27.215432+0000","last_clean":"2024-09-12T19:23:27.215432+0000","last_became_active":"2024-09-12T17:29:54.770286+0000","last_became_peered":"2024-09-12T17:29:54.770286+0000","last_unstale":"2024-09-12T19:23:27.215432+0000","last_undegraded":"2024-09-12T19:23:27.215432+0000","last_fullsized":"2024-09-12T19:23:27.215432+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'940","last_scrub_stamp":"2024-09-12T19:23:27.215139+0000","last_deep_scrub":"267'940","last_deep_scrub_stamp":"2024-09-12T19:23:27.215139+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.215139+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":900,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:57.585678+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4498,"num_read_kb":4029,"num_write":1285,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2544,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'344","reported_seq":1095,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.682756+0000","last_change":"2024-09-12T19:23:15.682756+0000","last_active":"2024-09-12T19:23:15.682756+0000","last_peered":"2024-09-12T19:23:15.682756+0000","last_clean":"2024-09-12T19:23:15.682756+0000","last_became_active":"2024-09-12T17:30:21.689546+0000","last_became_peered":"2024-09-12T17:30:21.689546+0000","last_unstale":"2024-09-12T19:23:15.682756+0000","last_undegraded":"2024-09-12T19:23:15.682756+0000","last_fullsized":"2024-09-12T19:23:15.682756+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'344","last_scrub_stamp":"2024-09-12T19:23:15.682534+0000","last_deep_scrub":"267'344","last_deep_scrub_stamp":"2024-09-12T19:23:15.682534+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.682534+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:01.240340+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170253,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":648,"num_read_kb":124307,"num_write":1100,"num_write_kb":33866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7,2],"acting":[1,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"267'841","reported_seq":2488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.786065+0000","last_change":"2024-09-12T19:23:27.786065+0000","last_active":"2024-09-12T19:23:27.786065+0000","last_peered":"2024-09-12T19:23:27.786065+0000","last_clean":"2024-09-12T19:23:27.786065+0000","last_became_active":"2024-09-12T17:29:54.760180+0000","last_became_peered":"2024-09-12T17:29:54.760180+0000","last_unstale":"2024-09-12T19:23:27.786065+0000","last_undegraded":"2024-09-12T19:23:27.786065+0000","last_fullsized":"2024-09-12T19:23:27.786065+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'841","last_scrub_stamp":"2024-09-12T19:23:27.785877+0000","last_deep_scrub":"267'841","last_deep_scrub_stamp":"2024-09-12T19:23:27.785877+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.785877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:05.230667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3987,"num_read_kb":3603,"num_write":1097,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'364","reported_seq":1016,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.084038+0000","last_change":"2024-09-12T19:23:22.084038+0000","last_active":"2024-09-12T19:23:22.084038+0000","last_peered":"2024-09-12T19:23:22.084038+0000","last_clean":"2024-09-12T19:23:22.084038+0000","last_became_active":"2024-09-12T17:29:52.744115+0000","last_became_peered":"2024-09-12T17:29:52.744115+0000","last_unstale":"2024-09-12T19:23:22.084038+0000","last_undegraded":"2024-09-12T19:23:22.084038+0000","last_fullsized":"2024-09-12T19:23:22.084038+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'364","last_scrub_stamp":"2024-09-12T19:23:22.083674+0000","last_deep_scrub":"267'364","last_deep_scrub_stamp":"2024-09-12T19:23:22.083674+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.083674+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:33.271484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262269,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":11709,"num_write":1093,"num_write_kb":63153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'872","reported_seq":2513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.240607+0000","last_change":"2024-09-12T19:23:20.240607+0000","last_active":"2024-09-12T19:23:20.240607+0000","last_peered":"2024-09-12T19:23:20.240607+0000","last_clean":"2024-09-12T19:23:20.240607+0000","last_became_active":"2024-09-12T17:29:54.758552+0000","last_became_peered":"2024-09-12T17:29:54.758552+0000","last_unstale":"2024-09-12T19:23:20.240607+0000","last_undegraded":"2024-09-12T19:23:20.240607+0000","last_fullsized":"2024-09-12T19:23:20.240607+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'872","last_scrub_stamp":"2024-09-12T19:23:20.240387+0000","last_deep_scrub":"267'872","last_deep_scrub_stamp":"2024-09-12T19:23:20.240387+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.240387+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:09.305077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4049,"num_read_kb":3640,"num_write":1140,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'353","reported_seq":1025,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.337794+0000","last_change":"2024-09-12T19:23:20.337794+0000","last_active":"2024-09-12T19:23:20.337794+0000","last_peered":"2024-09-12T19:23:20.337794+0000","last_clean":"2024-09-12T19:23:20.337794+0000","last_became_active":"2024-09-12T17:29:52.756242+0000","last_became_peered":"2024-09-12T17:29:52.756242+0000","last_unstale":"2024-09-12T19:23:20.337794+0000","last_undegraded":"2024-09-12T19:23:20.337794+0000","last_fullsized":"2024-09-12T19:23:20.337794+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'353","last_scrub_stamp":"2024-09-12T19:23:20.337459+0000","last_deep_scrub":"267'353","last_deep_scrub_stamp":"2024-09-12T19:23:20.337459+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.337459+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:26.759309+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311546,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":527,"num_read_kb":10971,"num_write":1015,"num_write_kb":29590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'392","reported_seq":1990,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.168012+0000","last_change":"2024-09-12T19:23:28.168012+0000","last_active":"2024-09-12T19:23:28.168012+0000","last_peered":"2024-09-12T19:23:28.168012+0000","last_clean":"2024-09-12T19:23:28.168012+0000","last_became_active":"2024-09-12T17:29:54.770050+0000","last_became_peered":"2024-09-12T17:29:54.770050+0000","last_unstale":"2024-09-12T19:23:28.168012+0000","last_undegraded":"2024-09-12T19:23:28.168012+0000","last_fullsized":"2024-09-12T19:23:28.168012+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'392","last_scrub_stamp":"2024-09-12T19:23:28.167823+0000","last_deep_scrub":"267'392","last_deep_scrub_stamp":"2024-09-12T19:23:28.167823+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.167823+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:05:18.931144+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2225,"num_read_kb":2129,"num_write":425,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":667,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'366","reported_seq":1027,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.068967+0000","last_change":"2024-09-12T19:23:20.068967+0000","last_active":"2024-09-12T19:23:20.068967+0000","last_peered":"2024-09-12T19:23:20.068967+0000","last_clean":"2024-09-12T19:23:20.068967+0000","last_became_active":"2024-09-12T17:29:52.762473+0000","last_became_peered":"2024-09-12T17:29:52.762473+0000","last_unstale":"2024-09-12T19:23:20.068967+0000","last_undegraded":"2024-09-12T19:23:20.068967+0000","last_fullsized":"2024-09-12T19:23:20.068967+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'366","last_scrub_stamp":"2024-09-12T19:23:20.068679+0000","last_deep_scrub":"267'366","last_deep_scrub_stamp":"2024-09-12T19:23:20.068679+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.068679+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:19.139220+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25719,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":480,"num_read_kb":16012,"num_write":1030,"num_write_kb":47372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'481","reported_seq":2022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.360178+0000","last_change":"2024-09-12T19:23:27.360178+0000","last_active":"2024-09-12T19:23:27.360178+0000","last_peered":"2024-09-12T19:23:27.360178+0000","last_clean":"2024-09-12T19:23:27.360178+0000","last_became_active":"2024-09-12T17:29:54.745833+0000","last_became_peered":"2024-09-12T17:29:54.745833+0000","last_unstale":"2024-09-12T19:23:27.360178+0000","last_undegraded":"2024-09-12T19:23:27.360178+0000","last_fullsized":"2024-09-12T19:23:27.360178+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'481","last_scrub_stamp":"2024-09-12T19:23:27.359982+0000","last_deep_scrub":"267'481","last_deep_scrub_stamp":"2024-09-12T19:23:27.359982+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.359982+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:27.719917+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2543,"num_read_kb":2369,"num_write":601,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'339","reported_seq":1125,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.105983+0000","last_change":"2024-09-12T19:23:19.105983+0000","last_active":"2024-09-12T19:23:19.105983+0000","last_peered":"2024-09-12T19:23:19.105983+0000","last_clean":"2024-09-12T19:23:19.105983+0000","last_became_active":"2024-09-12T17:29:52.730010+0000","last_became_peered":"2024-09-12T17:29:52.730010+0000","last_unstale":"2024-09-12T19:23:19.105983+0000","last_undegraded":"2024-09-12T19:23:19.105983+0000","last_fullsized":"2024-09-12T19:23:19.105983+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'339","last_scrub_stamp":"2024-09-12T19:23:19.105777+0000","last_deep_scrub":"267'339","last_deep_scrub_stamp":"2024-09-12T19:23:19.105777+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.105777+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:17.217745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580168,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":14958,"num_write":1088,"num_write_kb":34324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'424","reported_seq":2031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.913338+0000","last_change":"2024-09-12T19:23:16.913338+0000","last_active":"2024-09-12T19:23:16.913338+0000","last_peered":"2024-09-12T19:23:16.913338+0000","last_clean":"2024-09-12T19:23:16.913338+0000","last_became_active":"2024-09-12T17:29:54.755721+0000","last_became_peered":"2024-09-12T17:29:54.755721+0000","last_unstale":"2024-09-12T19:23:16.913338+0000","last_undegraded":"2024-09-12T19:23:16.913338+0000","last_fullsized":"2024-09-12T19:23:16.913338+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'424","last_scrub_stamp":"2024-09-12T19:23:16.913164+0000","last_deep_scrub":"267'424","last_deep_scrub_stamp":"2024-09-12T19:23:16.913164+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.913164+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:30.429196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2342,"num_read_kb":2221,"num_write":470,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1531,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'362","reported_seq":1940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.211026+0000","last_change":"2024-09-12T19:23:25.211026+0000","last_active":"2024-09-12T19:23:25.211026+0000","last_peered":"2024-09-12T19:23:25.211026+0000","last_clean":"2024-09-12T19:23:25.211026+0000","last_became_active":"2024-09-12T17:29:54.753012+0000","last_became_peered":"2024-09-12T17:29:54.753012+0000","last_unstale":"2024-09-12T19:23:25.211026+0000","last_undegraded":"2024-09-12T19:23:25.211026+0000","last_fullsized":"2024-09-12T19:23:25.211026+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-09-12T19:23:25.210742+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-09-12T19:23:25.210742+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.210742+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:09.088143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2149,"num_read_kb":2071,"num_write":395,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'362","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.093896+0000","last_change":"2024-09-12T19:23:19.093896+0000","last_active":"2024-09-12T19:23:19.093896+0000","last_peered":"2024-09-12T19:23:19.093896+0000","last_clean":"2024-09-12T19:23:19.093896+0000","last_became_active":"2024-09-12T17:29:52.747589+0000","last_became_peered":"2024-09-12T17:29:52.747589+0000","last_unstale":"2024-09-12T19:23:19.093896+0000","last_undegraded":"2024-09-12T19:23:19.093896+0000","last_fullsized":"2024-09-12T19:23:19.093896+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-09-12T19:23:19.093553+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-09-12T19:23:19.093553+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.093553+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:37.013602+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":507,"num_read_kb":50487,"num_write":1096,"num_write_kb":29653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'428","reported_seq":2001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.061297+0000","last_change":"2024-09-12T19:23:25.061297+0000","last_active":"2024-09-12T19:23:25.061297+0000","last_peered":"2024-09-12T19:23:25.061297+0000","last_clean":"2024-09-12T19:23:25.061297+0000","last_became_active":"2024-09-12T17:29:54.752373+0000","last_became_peered":"2024-09-12T17:29:54.752373+0000","last_unstale":"2024-09-12T19:23:25.061297+0000","last_undegraded":"2024-09-12T19:23:25.061297+0000","last_fullsized":"2024-09-12T19:23:25.061297+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'428","last_scrub_stamp":"2024-09-12T19:23:25.061115+0000","last_deep_scrub":"267'428","last_deep_scrub_stamp":"2024-09-12T19:23:25.061115+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.061115+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:07.521489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2327,"num_read_kb":2222,"num_write":465,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'338","reported_seq":1116,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.130740+0000","last_change":"2024-09-12T19:23:18.130740+0000","last_active":"2024-09-12T19:23:18.130740+0000","last_peered":"2024-09-12T19:23:18.130740+0000","last_clean":"2024-09-12T19:23:18.130740+0000","last_became_active":"2024-09-12T17:30:22.255773+0000","last_became_peered":"2024-09-12T17:30:22.255773+0000","last_unstale":"2024-09-12T19:23:18.130740+0000","last_undegraded":"2024-09-12T19:23:18.130740+0000","last_fullsized":"2024-09-12T19:23:18.130740+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'338","last_scrub_stamp":"2024-09-12T19:23:18.130470+0000","last_deep_scrub":"267'338","last_deep_scrub_stamp":"2024-09-12T19:23:18.130470+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.130470+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:35.478105+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364459,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":843,"num_read_kb":51980,"num_write":1145,"num_write_kb":60983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2,1],"acting":[3,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.32","version":"267'529","reported_seq":2190,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.368130+0000","last_change":"2024-09-12T19:23:24.368130+0000","last_active":"2024-09-12T19:23:24.368130+0000","last_peered":"2024-09-12T19:23:24.368130+0000","last_clean":"2024-09-12T19:23:24.368130+0000","last_became_active":"2024-09-12T17:29:54.771786+0000","last_became_peered":"2024-09-12T17:29:54.771786+0000","last_unstale":"2024-09-12T19:23:24.368130+0000","last_undegraded":"2024-09-12T19:23:24.368130+0000","last_fullsized":"2024-09-12T19:23:24.368130+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'529","last_scrub_stamp":"2024-09-12T19:23:24.367953+0000","last_deep_scrub":"267'529","last_deep_scrub_stamp":"2024-09-12T19:23:24.367953+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.367953+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:57:53.562274+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2657,"num_read_kb":2482,"num_write":638,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'438","reported_seq":1252,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.224353+0000","last_change":"2024-09-12T19:23:14.224171+0000","last_active":"2024-09-12T19:23:14.224353+0000","last_peered":"2024-09-12T19:23:14.224353+0000","last_clean":"2024-09-12T19:23:14.224353+0000","last_became_active":"2024-09-12T17:29:52.725473+0000","last_became_peered":"2024-09-12T17:29:52.725473+0000","last_unstale":"2024-09-12T19:23:14.224353+0000","last_undegraded":"2024-09-12T19:23:14.224353+0000","last_fullsized":"2024-09-12T19:23:14.224353+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'438","last_scrub_stamp":"2024-09-12T19:23:14.223910+0000","last_deep_scrub":"267'438","last_deep_scrub_stamp":"2024-09-12T19:23:14.223910+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.223910+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:40.091598+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3634873,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":934,"num_read_kb":41903,"num_write":1412,"num_write_kb":44280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'658","reported_seq":2290,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.984600+0000","last_change":"2024-09-12T19:23:13.984600+0000","last_active":"2024-09-12T19:23:13.984600+0000","last_peered":"2024-09-12T19:23:13.984600+0000","last_clean":"2024-09-12T19:23:13.984600+0000","last_became_active":"2024-09-12T17:29:54.754119+0000","last_became_peered":"2024-09-12T17:29:54.754119+0000","last_unstale":"2024-09-12T19:23:13.984600+0000","last_undegraded":"2024-09-12T19:23:13.984600+0000","last_fullsized":"2024-09-12T19:23:13.984600+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'658","last_scrub_stamp":"2024-09-12T19:23:13.984417+0000","last_deep_scrub":"267'658","last_deep_scrub_stamp":"2024-09-12T19:23:13.984417+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.984417+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":600,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:49.226444+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3376,"num_read_kb":3085,"num_write":861,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3276,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'319","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.237886+0000","last_change":"2024-09-12T19:23:12.237745+0000","last_active":"2024-09-12T19:23:12.237886+0000","last_peered":"2024-09-12T19:23:12.237886+0000","last_clean":"2024-09-12T19:23:12.237886+0000","last_became_active":"2024-09-12T17:29:52.764052+0000","last_became_peered":"2024-09-12T17:29:52.764052+0000","last_unstale":"2024-09-12T19:23:12.237886+0000","last_undegraded":"2024-09-12T19:23:12.237886+0000","last_fullsized":"2024-09-12T19:23:12.237886+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'319","last_scrub_stamp":"2024-09-12T19:23:12.237529+0000","last_deep_scrub":"267'319","last_deep_scrub_stamp":"2024-09-12T19:23:12.237529+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.237529+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:41.845980+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":477,"num_read_kb":61037,"num_write":999,"num_write_kb":13603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'894","reported_seq":2464,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.023908+0000","last_change":"2024-09-12T19:23:22.023908+0000","last_active":"2024-09-12T19:23:22.023908+0000","last_peered":"2024-09-12T19:23:22.023908+0000","last_clean":"2024-09-12T19:23:22.023908+0000","last_became_active":"2024-09-12T17:29:54.760746+0000","last_became_peered":"2024-09-12T17:29:54.760746+0000","last_unstale":"2024-09-12T19:23:22.023908+0000","last_undegraded":"2024-09-12T19:23:22.023908+0000","last_fullsized":"2024-09-12T19:23:22.023908+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'894","last_scrub_stamp":"2024-09-12T19:23:22.023716+0000","last_deep_scrub":"267'894","last_deep_scrub_stamp":"2024-09-12T19:23:22.023716+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.023716+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":800,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:10.198893+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4106,"num_read_kb":3659,"num_write":1202,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'393","reported_seq":1091,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.121327+0000","last_change":"2024-09-12T19:23:17.121182+0000","last_active":"2024-09-12T19:23:17.121327+0000","last_peered":"2024-09-12T19:23:17.121327+0000","last_clean":"2024-09-12T19:23:17.121327+0000","last_became_active":"2024-09-12T17:29:52.720974+0000","last_became_peered":"2024-09-12T17:29:52.720974+0000","last_unstale":"2024-09-12T19:23:17.121327+0000","last_undegraded":"2024-09-12T19:23:17.121327+0000","last_fullsized":"2024-09-12T19:23:17.121327+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'393","last_scrub_stamp":"2024-09-12T19:23:17.120877+0000","last_deep_scrub":"267'393","last_deep_scrub_stamp":"2024-09-12T19:23:17.120877+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.120877+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:23.312770+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730141,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":597,"num_read_kb":19633,"num_write":1232,"num_write_kb":34097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'745","reported_seq":2342,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.257990+0000","last_change":"2024-09-12T19:23:26.257990+0000","last_active":"2024-09-12T19:23:26.257990+0000","last_peered":"2024-09-12T19:23:26.257990+0000","last_clean":"2024-09-12T19:23:26.257990+0000","last_became_active":"2024-09-12T17:29:54.756675+0000","last_became_peered":"2024-09-12T17:29:54.756675+0000","last_unstale":"2024-09-12T19:23:26.257990+0000","last_undegraded":"2024-09-12T19:23:26.257990+0000","last_fullsized":"2024-09-12T19:23:26.257990+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'745","last_scrub_stamp":"2024-09-12T19:23:26.257807+0000","last_deep_scrub":"267'745","last_deep_scrub_stamp":"2024-09-12T19:23:26.257807+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.257807+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:41.842768+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3670,"num_read_kb":3349,"num_write":979,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'350","reported_seq":1005,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.882345+0000","last_change":"2024-09-12T19:23:11.882345+0000","last_active":"2024-09-12T19:23:11.882345+0000","last_peered":"2024-09-12T19:23:11.882345+0000","last_clean":"2024-09-12T19:23:11.882345+0000","last_became_active":"2024-09-12T17:29:52.766959+0000","last_became_peered":"2024-09-12T17:29:52.766959+0000","last_unstale":"2024-09-12T19:23:11.882345+0000","last_undegraded":"2024-09-12T19:23:11.882345+0000","last_fullsized":"2024-09-12T19:23:11.882345+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'350","last_scrub_stamp":"2024-09-12T19:23:11.882126+0000","last_deep_scrub":"267'350","last_deep_scrub_stamp":"2024-09-12T19:23:11.882126+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.882126+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:02.282493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":468,"num_read_kb":494,"num_write":1113,"num_write_kb":20716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'130","reported_seq":661,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.666477+0000","last_change":"2024-09-12T17:30:02.803588+0000","last_active":"2024-09-12T19:21:21.666477+0000","last_peered":"2024-09-12T19:21:21.666477+0000","last_clean":"2024-09-12T19:21:21.666477+0000","last_became_active":"2024-09-12T17:30:02.802659+0000","last_became_peered":"2024-09-12T17:30:02.802659+0000","last_unstale":"2024-09-12T19:21:21.666477+0000","last_undegraded":"2024-09-12T19:21:21.666477+0000","last_fullsized":"2024-09-12T19:21:21.666477+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:05.775037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":169,"num_write":297,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'432","reported_seq":2026,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.153150+0000","last_change":"2024-09-12T19:23:24.153150+0000","last_active":"2024-09-12T19:23:24.153150+0000","last_peered":"2024-09-12T19:23:24.153150+0000","last_clean":"2024-09-12T19:23:24.153150+0000","last_became_active":"2024-09-12T17:29:54.758303+0000","last_became_peered":"2024-09-12T17:29:54.758303+0000","last_unstale":"2024-09-12T19:23:24.153150+0000","last_undegraded":"2024-09-12T19:23:24.153150+0000","last_fullsized":"2024-09-12T19:23:24.153150+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'432","last_scrub_stamp":"2024-09-12T19:23:24.152868+0000","last_deep_scrub":"267'432","last_deep_scrub_stamp":"2024-09-12T19:23:24.152868+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.152868+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:50.955827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2323,"num_read_kb":2196,"num_write":494,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'401","reported_seq":1120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.070452+0000","last_change":"2024-09-12T19:23:14.070452+0000","last_active":"2024-09-12T19:23:14.070452+0000","last_peered":"2024-09-12T19:23:14.070452+0000","last_clean":"2024-09-12T19:23:14.070452+0000","last_became_active":"2024-09-12T17:29:52.755103+0000","last_became_peered":"2024-09-12T17:29:52.755103+0000","last_unstale":"2024-09-12T19:23:14.070452+0000","last_undegraded":"2024-09-12T19:23:14.070452+0000","last_fullsized":"2024-09-12T19:23:14.070452+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'401","last_scrub_stamp":"2024-09-12T19:23:14.070224+0000","last_deep_scrub":"267'401","last_deep_scrub_stamp":"2024-09-12T19:23:14.070224+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.070224+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:15.519300+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524450,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":671,"num_read_kb":34526,"num_write":1327,"num_write_kb":26646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:42.965930+0000","last_change":"2024-09-12T17:29:56.764275+0000","last_active":"2024-09-12T19:18:42.965930+0000","last_peered":"2024-09-12T19:18:42.965930+0000","last_clean":"2024-09-12T19:18:42.965930+0000","last_became_active":"2024-09-12T17:29:56.763547+0000","last_became_peered":"2024-09-12T17:29:56.763547+0000","last_unstale":"2024-09-12T19:18:42.965930+0000","last_undegraded":"2024-09-12T19:18:42.965930+0000","last_fullsized":"2024-09-12T19:18:42.965930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:20:50.827569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'387","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.933998+0000","last_change":"2024-09-12T17:29:58.780660+0000","last_active":"2024-09-12T19:23:01.933998+0000","last_peered":"2024-09-12T19:23:01.933998+0000","last_clean":"2024-09-12T19:23:01.933998+0000","last_became_active":"2024-09-12T17:29:58.777554+0000","last_became_peered":"2024-09-12T17:29:58.777554+0000","last_unstale":"2024-09-12T19:23:01.933998+0000","last_undegraded":"2024-09-12T19:23:01.933998+0000","last_fullsized":"2024-09-12T19:23:01.933998+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:45.028521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45863,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":1229,"num_write":480,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:47.950949+0000","last_change":"2024-09-12T17:30:00.806462+0000","last_active":"2024-09-12T19:18:47.950949+0000","last_peered":"2024-09-12T19:18:47.950949+0000","last_clean":"2024-09-12T19:18:47.950949+0000","last_became_active":"2024-09-12T17:30:00.805568+0000","last_became_peered":"2024-09-12T17:30:00.805568+0000","last_unstale":"2024-09-12T19:18:47.950949+0000","last_undegraded":"2024-09-12T19:18:47.950949+0000","last_fullsized":"2024-09-12T19:18:47.950949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:19.223415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'145","reported_seq":724,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.098828+0000","last_change":"2024-09-12T17:30:02.786275+0000","last_active":"2024-09-12T19:20:28.098828+0000","last_peered":"2024-09-12T19:20:28.098828+0000","last_clean":"2024-09-12T19:20:28.098828+0000","last_became_active":"2024-09-12T17:30:02.785212+0000","last_became_peered":"2024-09-12T17:30:02.785212+0000","last_unstale":"2024-09-12T19:20:28.098828+0000","last_undegraded":"2024-09-12T19:20:28.098828+0000","last_fullsized":"2024-09-12T19:20:28.098828+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:15.216332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":252,"num_read_kb":243,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'686","reported_seq":2560,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.304212+0000","last_change":"2024-09-12T19:23:22.304212+0000","last_active":"2024-09-12T19:23:22.304212+0000","last_peered":"2024-09-12T19:23:22.304212+0000","last_clean":"2024-09-12T19:23:22.304212+0000","last_became_active":"2024-09-12T17:29:54.761497+0000","last_became_peered":"2024-09-12T17:29:54.761497+0000","last_unstale":"2024-09-12T19:23:22.304212+0000","last_undegraded":"2024-09-12T19:23:22.304212+0000","last_fullsized":"2024-09-12T19:23:22.304212+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'686","last_scrub_stamp":"2024-09-12T19:23:22.303998+0000","last_deep_scrub":"267'686","last_deep_scrub_stamp":"2024-09-12T19:23:22.303998+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.303998+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":600,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:35.218804+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3854,"num_read_kb":3534,"num_write":981,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2484,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'373","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.894094+0000","last_change":"2024-09-12T19:23:10.894094+0000","last_active":"2024-09-12T19:23:10.894094+0000","last_peered":"2024-09-12T19:23:10.894094+0000","last_clean":"2024-09-12T19:23:10.894094+0000","last_became_active":"2024-09-12T17:29:52.713938+0000","last_became_peered":"2024-09-12T17:29:52.713938+0000","last_unstale":"2024-09-12T19:23:10.894094+0000","last_undegraded":"2024-09-12T19:23:10.894094+0000","last_fullsized":"2024-09-12T19:23:10.894094+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'373","last_scrub_stamp":"2024-09-12T19:23:10.893784+0000","last_deep_scrub":"267'373","last_deep_scrub_stamp":"2024-09-12T19:23:10.893784+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.893784+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:17.828171+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460272,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":10309,"num_write":1260,"num_write_kb":32712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.256354+0000","last_change":"2024-09-12T17:29:56.776910+0000","last_active":"2024-09-12T19:20:03.256354+0000","last_peered":"2024-09-12T19:20:03.256354+0000","last_clean":"2024-09-12T19:20:03.256354+0000","last_became_active":"2024-09-12T17:29:56.776335+0000","last_became_peered":"2024-09-12T17:29:56.776335+0000","last_unstale":"2024-09-12T19:20:03.256354+0000","last_undegraded":"2024-09-12T19:20:03.256354+0000","last_fullsized":"2024-09-12T19:20:03.256354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:54.362260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'120","reported_seq":694,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:50.316180+0000","last_change":"2024-09-12T17:29:58.778467+0000","last_active":"2024-09-12T19:20:50.316180+0000","last_peered":"2024-09-12T19:20:50.316180+0000","last_clean":"2024-09-12T19:20:50.316180+0000","last_became_active":"2024-09-12T17:29:58.777883+0000","last_became_peered":"2024-09-12T17:29:58.777883+0000","last_unstale":"2024-09-12T19:20:50.316180+0000","last_undegraded":"2024-09-12T19:20:50.316180+0000","last_fullsized":"2024-09-12T19:20:50.316180+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:33.007083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:48.179069+0000","last_change":"2024-09-12T17:30:00.782290+0000","last_active":"2024-09-12T19:18:48.179069+0000","last_peered":"2024-09-12T19:18:48.179069+0000","last_clean":"2024-09-12T19:18:48.179069+0000","last_became_active":"2024-09-12T17:30:00.781554+0000","last_became_peered":"2024-09-12T17:30:00.781554+0000","last_unstale":"2024-09-12T19:18:48.179069+0000","last_undegraded":"2024-09-12T19:18:48.179069+0000","last_fullsized":"2024-09-12T19:18:48.179069+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:16.914242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'118","reported_seq":660,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.731504+0000","last_change":"2024-09-12T17:30:02.806243+0000","last_active":"2024-09-12T19:21:21.731504+0000","last_peered":"2024-09-12T19:21:21.731504+0000","last_clean":"2024-09-12T19:21:21.731504+0000","last_became_active":"2024-09-12T17:30:02.805556+0000","last_became_peered":"2024-09-12T17:30:02.805556+0000","last_unstale":"2024-09-12T19:21:21.731504+0000","last_undegraded":"2024-09-12T19:21:21.731504+0000","last_fullsized":"2024-09-12T19:21:21.731504+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:10.526393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":177,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'910","reported_seq":2545,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.925790+0000","last_change":"2024-09-12T19:23:17.925790+0000","last_active":"2024-09-12T19:23:17.925790+0000","last_peered":"2024-09-12T19:23:17.925790+0000","last_clean":"2024-09-12T19:23:17.925790+0000","last_became_active":"2024-09-12T17:29:54.751997+0000","last_became_peered":"2024-09-12T17:29:54.751997+0000","last_unstale":"2024-09-12T19:23:17.925790+0000","last_undegraded":"2024-09-12T19:23:17.925790+0000","last_fullsized":"2024-09-12T19:23:17.925790+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'910","last_scrub_stamp":"2024-09-12T19:23:17.925604+0000","last_deep_scrub":"267'910","last_deep_scrub_stamp":"2024-09-12T19:23:17.925604+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.925604+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":800,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:18.238141+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4250,"num_read_kb":3802,"num_write":1203,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":496,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'368","reported_seq":1093,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.024733+0000","last_change":"2024-09-12T19:23:13.024733+0000","last_active":"2024-09-12T19:23:13.024733+0000","last_peered":"2024-09-12T19:23:13.024733+0000","last_clean":"2024-09-12T19:23:13.024733+0000","last_became_active":"2024-09-12T17:29:52.762149+0000","last_became_peered":"2024-09-12T17:29:52.762149+0000","last_unstale":"2024-09-12T19:23:13.024733+0000","last_undegraded":"2024-09-12T19:23:13.024733+0000","last_fullsized":"2024-09-12T19:23:13.024733+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'368","last_scrub_stamp":"2024-09-12T19:23:13.024462+0000","last_deep_scrub":"267'368","last_deep_scrub_stamp":"2024-09-12T19:23:13.024462+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.024462+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:06.503899+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":626,"num_read_kb":63082,"num_write":1322,"num_write_kb":27819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.236790+0000","last_change":"2024-09-12T17:29:56.762319+0000","last_active":"2024-09-12T19:18:43.236790+0000","last_peered":"2024-09-12T19:18:43.236790+0000","last_clean":"2024-09-12T19:18:43.236790+0000","last_became_active":"2024-09-12T17:29:56.761027+0000","last_became_peered":"2024-09-12T17:29:56.761027+0000","last_unstale":"2024-09-12T19:18:43.236790+0000","last_undegraded":"2024-09-12T19:18:43.236790+0000","last_fullsized":"2024-09-12T19:18:43.236790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:25.029553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'178","reported_seq":789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.980218+0000","last_change":"2024-09-12T19:23:23.980218+0000","last_active":"2024-09-12T19:23:23.980218+0000","last_peered":"2024-09-12T19:23:23.980218+0000","last_clean":"2024-09-12T19:23:23.980218+0000","last_became_active":"2024-09-12T17:29:58.769889+0000","last_became_peered":"2024-09-12T17:29:58.769889+0000","last_unstale":"2024-09-12T19:23:23.980218+0000","last_undegraded":"2024-09-12T19:23:23.980218+0000","last_fullsized":"2024-09-12T19:23:23.980218+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'178","last_scrub_stamp":"2024-09-12T19:23:23.980018+0000","last_deep_scrub":"267'178","last_deep_scrub_stamp":"2024-09-12T19:23:23.980018+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.980018+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:07.667832+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'756","reported_seq":3324,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.884918+0000","last_change":"2024-09-12T17:30:00.810692+0000","last_active":"2024-09-12T19:22:58.884918+0000","last_peered":"2024-09-12T19:22:58.884918+0000","last_clean":"2024-09-12T19:22:58.884918+0000","last_became_active":"2024-09-12T17:30:00.810030+0000","last_became_peered":"2024-09-12T17:30:00.810030+0000","last_unstale":"2024-09-12T19:22:58.884918+0000","last_undegraded":"2024-09-12T19:22:58.884918+0000","last_fullsized":"2024-09-12T19:22:58.884918+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:18.541833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'206","reported_seq":1064,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.854762+0000","last_change":"2024-09-12T17:30:02.807819+0000","last_active":"2024-09-12T19:21:21.854762+0000","last_peered":"2024-09-12T19:21:21.854762+0000","last_clean":"2024-09-12T19:21:21.854762+0000","last_became_active":"2024-09-12T17:30:02.803144+0000","last_became_peered":"2024-09-12T17:30:02.803144+0000","last_unstale":"2024-09-12T19:21:21.854762+0000","last_undegraded":"2024-09-12T19:21:21.854762+0000","last_fullsized":"2024-09-12T19:21:21.854762+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:21:22.571499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":674,"num_read_kb":661,"num_write":463,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'416","reported_seq":2081,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.176544+0000","last_change":"2024-09-12T19:23:23.176544+0000","last_active":"2024-09-12T19:23:23.176544+0000","last_peered":"2024-09-12T19:23:23.176544+0000","last_clean":"2024-09-12T19:23:23.176544+0000","last_became_active":"2024-09-12T17:29:54.762448+0000","last_became_peered":"2024-09-12T17:29:54.762448+0000","last_unstale":"2024-09-12T19:23:23.176544+0000","last_undegraded":"2024-09-12T19:23:23.176544+0000","last_fullsized":"2024-09-12T19:23:23.176544+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'416","last_scrub_stamp":"2024-09-12T19:23:23.176364+0000","last_deep_scrub":"267'416","last_deep_scrub_stamp":"2024-09-12T19:23:23.176364+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.176364+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:27.592188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2329,"num_read_kb":2238,"num_write":469,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'341","reported_seq":1012,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.138789+0000","last_change":"2024-09-12T19:23:11.138789+0000","last_active":"2024-09-12T19:23:11.138789+0000","last_peered":"2024-09-12T19:23:11.138789+0000","last_clean":"2024-09-12T19:23:11.138789+0000","last_became_active":"2024-09-12T17:29:52.738957+0000","last_became_peered":"2024-09-12T17:29:52.738957+0000","last_unstale":"2024-09-12T19:23:11.138789+0000","last_undegraded":"2024-09-12T19:23:11.138789+0000","last_fullsized":"2024-09-12T19:23:11.138789+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'341","last_scrub_stamp":"2024-09-12T19:23:11.138465+0000","last_deep_scrub":"267'341","last_deep_scrub_stamp":"2024-09-12T19:23:11.138465+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.138465+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:25.950750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":517,"num_read_kb":16175,"num_write":1150,"num_write_kb":26946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:42.966023+0000","last_change":"2024-09-12T17:29:56.757650+0000","last_active":"2024-09-12T19:18:42.966023+0000","last_peered":"2024-09-12T19:18:42.966023+0000","last_clean":"2024-09-12T19:18:42.966023+0000","last_became_active":"2024-09-12T17:29:56.755730+0000","last_became_peered":"2024-09-12T17:29:56.755730+0000","last_unstale":"2024-09-12T19:18:42.966023+0000","last_undegraded":"2024-09-12T19:18:42.966023+0000","last_fullsized":"2024-09-12T19:18:42.966023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:23.463400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'322","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.554435+0000","last_change":"2024-09-12T17:29:58.829682+0000","last_active":"2024-09-12T19:23:01.554435+0000","last_peered":"2024-09-12T19:23:01.554435+0000","last_clean":"2024-09-12T19:23:01.554435+0000","last_became_active":"2024-09-12T17:29:58.829021+0000","last_became_peered":"2024-09-12T17:29:58.829021+0000","last_unstale":"2024-09-12T19:23:01.554435+0000","last_undegraded":"2024-09-12T19:23:01.554435+0000","last_fullsized":"2024-09-12T19:23:01.554435+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:56.407873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49018,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":1196,"num_write":438,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'813","reported_seq":3023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.895306+0000","last_change":"2024-09-12T17:30:00.794188+0000","last_active":"2024-09-12T19:22:58.895306+0000","last_peered":"2024-09-12T19:22:58.895306+0000","last_clean":"2024-09-12T19:22:58.895306+0000","last_became_active":"2024-09-12T17:30:00.793067+0000","last_became_peered":"2024-09-12T17:30:00.793067+0000","last_unstale":"2024-09-12T19:22:58.895306+0000","last_undegraded":"2024-09-12T19:22:58.895306+0000","last_fullsized":"2024-09-12T19:22:58.895306+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:26.995446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'526","reported_seq":2074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.298840+0000","last_change":"2024-09-12T19:23:21.298840+0000","last_active":"2024-09-12T19:23:21.298840+0000","last_peered":"2024-09-12T19:23:21.298840+0000","last_clean":"2024-09-12T19:23:21.298840+0000","last_became_active":"2024-09-12T17:29:54.766092+0000","last_became_peered":"2024-09-12T17:29:54.766092+0000","last_unstale":"2024-09-12T19:23:21.298840+0000","last_undegraded":"2024-09-12T19:23:21.298840+0000","last_fullsized":"2024-09-12T19:23:21.298840+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'526","last_scrub_stamp":"2024-09-12T19:23:21.298622+0000","last_deep_scrub":"267'526","last_deep_scrub_stamp":"2024-09-12T19:23:21.298622+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.298622+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:56.252493+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2636,"num_read_kb":2418,"num_write":649,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'353","reported_seq":1047,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.059198+0000","last_change":"2024-09-12T19:23:15.059198+0000","last_active":"2024-09-12T19:23:15.059198+0000","last_peered":"2024-09-12T19:23:15.059198+0000","last_clean":"2024-09-12T19:23:15.059198+0000","last_became_active":"2024-09-12T17:29:52.757326+0000","last_became_peered":"2024-09-12T17:29:52.757326+0000","last_unstale":"2024-09-12T19:23:15.059198+0000","last_undegraded":"2024-09-12T19:23:15.059198+0000","last_fullsized":"2024-09-12T19:23:15.059198+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'353","last_scrub_stamp":"2024-09-12T19:23:15.058913+0000","last_deep_scrub":"267'353","last_deep_scrub_stamp":"2024-09-12T19:23:15.058913+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.058913+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:10.734098+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730145,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":565,"num_read_kb":12520,"num_write":1100,"num_write_kb":32977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.974785+0000","last_change":"2024-09-12T17:29:56.769344+0000","last_active":"2024-09-12T19:20:27.974785+0000","last_peered":"2024-09-12T19:20:27.974785+0000","last_clean":"2024-09-12T19:20:27.974785+0000","last_became_active":"2024-09-12T17:29:56.768267+0000","last_became_peered":"2024-09-12T17:29:56.768267+0000","last_unstale":"2024-09-12T19:20:27.974785+0000","last_undegraded":"2024-09-12T19:20:27.974785+0000","last_fullsized":"2024-09-12T19:20:27.974785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:14.841905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'452","reported_seq":1144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.316655+0000","last_change":"2024-09-12T17:29:58.834050+0000","last_active":"2024-09-12T19:22:59.316655+0000","last_peered":"2024-09-12T19:22:59.316655+0000","last_clean":"2024-09-12T19:22:59.316655+0000","last_became_active":"2024-09-12T17:29:58.833291+0000","last_became_peered":"2024-09-12T17:29:58.833291+0000","last_unstale":"2024-09-12T19:22:59.316655+0000","last_undegraded":"2024-09-12T19:22:59.316655+0000","last_fullsized":"2024-09-12T19:22:59.316655+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60505,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":721,"num_read_kb":1312,"num_write":540,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:17.982998+0000","last_change":"2024-09-12T17:30:00.810543+0000","last_active":"2024-09-12T19:20:17.982998+0000","last_peered":"2024-09-12T19:20:17.982998+0000","last_clean":"2024-09-12T19:20:17.982998+0000","last_became_active":"2024-09-12T17:30:00.809914+0000","last_became_peered":"2024-09-12T17:30:00.809914+0000","last_unstale":"2024-09-12T19:20:17.982998+0000","last_undegraded":"2024-09-12T19:20:17.982998+0000","last_fullsized":"2024-09-12T19:20:17.982998+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:44.935436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'548","reported_seq":1404,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.253948+0000","last_change":"2024-09-12T17:30:02.797843+0000","last_active":"2024-09-12T19:22:46.253948+0000","last_peered":"2024-09-12T19:22:46.253948+0000","last_clean":"2024-09-12T19:22:46.253948+0000","last_became_active":"2024-09-12T17:30:02.797046+0000","last_became_peered":"2024-09-12T17:30:02.797046+0000","last_unstale":"2024-09-12T19:22:46.253948+0000","last_undegraded":"2024-09-12T19:22:46.253948+0000","last_fullsized":"2024-09-12T19:22:46.253948+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:58.930778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1413,"num_read_kb":1390,"num_write":1179,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'484","reported_seq":2168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.213752+0000","last_change":"2024-09-12T19:23:14.213752+0000","last_active":"2024-09-12T19:23:14.213752+0000","last_peered":"2024-09-12T19:23:14.213752+0000","last_clean":"2024-09-12T19:23:14.213752+0000","last_became_active":"2024-09-12T17:29:54.754517+0000","last_became_peered":"2024-09-12T17:29:54.754517+0000","last_unstale":"2024-09-12T19:23:14.213752+0000","last_undegraded":"2024-09-12T19:23:14.213752+0000","last_fullsized":"2024-09-12T19:23:14.213752+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'484","last_scrub_stamp":"2024-09-12T19:23:14.213543+0000","last_deep_scrub":"267'484","last_deep_scrub_stamp":"2024-09-12T19:23:14.213543+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.213543+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:45.018822+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2565,"num_read_kb":2417,"num_write":558,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'317","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.054850+0000","last_change":"2024-09-12T19:23:16.054850+0000","last_active":"2024-09-12T19:23:16.054850+0000","last_peered":"2024-09-12T19:23:16.054850+0000","last_clean":"2024-09-12T19:23:16.054850+0000","last_became_active":"2024-09-12T17:29:52.760711+0000","last_became_peered":"2024-09-12T17:29:52.760711+0000","last_unstale":"2024-09-12T19:23:16.054850+0000","last_undegraded":"2024-09-12T19:23:16.054850+0000","last_fullsized":"2024-09-12T19:23:16.054850+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-12T19:23:16.054566+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-12T19:23:16.054566+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.054566+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:14.486166+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759519,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":447,"num_read_kb":40999,"num_write":1044,"num_write_kb":42394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.974544+0000","last_change":"2024-09-12T19:23:18.974544+0000","last_active":"2024-09-12T19:23:18.974544+0000","last_peered":"2024-09-12T19:23:18.974544+0000","last_clean":"2024-09-12T19:23:18.974544+0000","last_became_active":"2024-09-12T17:29:56.757805+0000","last_became_peered":"2024-09-12T17:29:56.757805+0000","last_unstale":"2024-09-12T19:23:18.974544+0000","last_undegraded":"2024-09-12T19:23:18.974544+0000","last_fullsized":"2024-09-12T19:23:18.974544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:18.974369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:18.974369+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.974369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:12.714029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'304","reported_seq":927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.753487+0000","last_change":"2024-09-12T17:29:58.774261+0000","last_active":"2024-09-12T19:23:00.753487+0000","last_peered":"2024-09-12T19:23:00.753487+0000","last_clean":"2024-09-12T19:23:00.753487+0000","last_became_active":"2024-09-12T17:29:58.773959+0000","last_became_peered":"2024-09-12T17:29:58.773959+0000","last_unstale":"2024-09-12T19:23:00.753487+0000","last_undegraded":"2024-09-12T19:23:00.753487+0000","last_fullsized":"2024-09-12T19:23:00.753487+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:53.591898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47390,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":1092,"num_write":400,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:58.270859+0000","last_change":"2024-09-12T17:30:00.792690+0000","last_active":"2024-09-12T19:20:58.270859+0000","last_peered":"2024-09-12T19:20:58.270859+0000","last_clean":"2024-09-12T19:20:58.270859+0000","last_became_active":"2024-09-12T17:30:00.792138+0000","last_became_peered":"2024-09-12T17:30:00.792138+0000","last_unstale":"2024-09-12T19:20:58.270859+0000","last_undegraded":"2024-09-12T19:20:58.270859+0000","last_fullsized":"2024-09-12T19:20:58.270859+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2476","reported_seq":4391,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.257061+0000","last_change":"2024-09-12T17:30:02.801585+0000","last_active":"2024-09-12T19:22:46.257061+0000","last_peered":"2024-09-12T19:22:46.257061+0000","last_clean":"2024-09-12T19:22:46.257061+0000","last_became_active":"2024-09-12T17:30:02.800860+0000","last_became_peered":"2024-09-12T17:30:02.800860+0000","last_unstale":"2024-09-12T19:22:46.257061+0000","last_undegraded":"2024-09-12T19:22:46.257061+0000","last_fullsized":"2024-09-12T19:22:46.257061+0000","mapping_epoch":36,"log_start":"267'2400","ondisk_log_start":"267'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":2400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:23.192552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6373,"num_read_kb":6312,"num_write":5027,"num_write_kb":1835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'434","reported_seq":2080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.214501+0000","last_change":"2024-09-12T19:23:17.214501+0000","last_active":"2024-09-12T19:23:17.214501+0000","last_peered":"2024-09-12T19:23:17.214501+0000","last_clean":"2024-09-12T19:23:17.214501+0000","last_became_active":"2024-09-12T17:29:54.769541+0000","last_became_peered":"2024-09-12T17:29:54.769541+0000","last_unstale":"2024-09-12T19:23:17.214501+0000","last_undegraded":"2024-09-12T19:23:17.214501+0000","last_fullsized":"2024-09-12T19:23:17.214501+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'434","last_scrub_stamp":"2024-09-12T19:23:17.214333+0000","last_deep_scrub":"267'434","last_deep_scrub_stamp":"2024-09-12T19:23:17.214333+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.214333+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:25.717262+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2445,"num_read_kb":2340,"num_write":496,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'333","reported_seq":1016,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.024545+0000","last_change":"2024-09-12T19:23:09.024545+0000","last_active":"2024-09-12T19:23:09.024545+0000","last_peered":"2024-09-12T19:23:09.024545+0000","last_clean":"2024-09-12T19:23:09.024545+0000","last_became_active":"2024-09-12T17:30:21.793950+0000","last_became_peered":"2024-09-12T17:30:21.793950+0000","last_unstale":"2024-09-12T19:23:09.024545+0000","last_undegraded":"2024-09-12T19:23:09.024545+0000","last_fullsized":"2024-09-12T19:23:09.024545+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-09-12T19:23:09.024422+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-09-12T19:23:09.024422+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.024422+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:49.775219+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12448261,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":65282,"num_write":1071,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,6],"acting":[2,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.001307+0000","last_change":"2024-09-12T19:23:20.001307+0000","last_active":"2024-09-12T19:23:20.001307+0000","last_peered":"2024-09-12T19:23:20.001307+0000","last_clean":"2024-09-12T19:23:20.001307+0000","last_became_active":"2024-09-12T17:29:56.770222+0000","last_became_peered":"2024-09-12T17:29:56.770222+0000","last_unstale":"2024-09-12T19:23:20.001307+0000","last_undegraded":"2024-09-12T19:23:20.001307+0000","last_fullsized":"2024-09-12T19:23:20.001307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:20.001094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:20.001094+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.001094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:34.611973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'394","reported_seq":1045,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.505552+0000","last_change":"2024-09-12T17:29:58.755448+0000","last_active":"2024-09-12T19:22:59.505552+0000","last_peered":"2024-09-12T19:22:59.505552+0000","last_clean":"2024-09-12T19:22:59.505552+0000","last_became_active":"2024-09-12T17:29:58.754613+0000","last_became_peered":"2024-09-12T17:29:58.754613+0000","last_unstale":"2024-09-12T19:22:59.505552+0000","last_undegraded":"2024-09-12T19:22:59.505552+0000","last_fullsized":"2024-09-12T19:22:59.505552+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:50.294662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50732,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":653,"num_read_kb":1328,"num_write":512,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'796","reported_seq":3207,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.319657+0000","last_change":"2024-09-12T17:30:00.806110+0000","last_active":"2024-09-12T19:23:01.319657+0000","last_peered":"2024-09-12T19:23:01.319657+0000","last_clean":"2024-09-12T19:23:01.319657+0000","last_became_active":"2024-09-12T17:30:00.805428+0000","last_became_peered":"2024-09-12T17:30:00.805428+0000","last_unstale":"2024-09-12T19:23:01.319657+0000","last_undegraded":"2024-09-12T19:23:01.319657+0000","last_fullsized":"2024-09-12T19:23:01.319657+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:28.577730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'112","reported_seq":659,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.641116+0000","last_change":"2024-09-12T17:30:02.817717+0000","last_active":"2024-09-12T19:22:44.641116+0000","last_peered":"2024-09-12T19:22:44.641116+0000","last_clean":"2024-09-12T19:22:44.641116+0000","last_became_active":"2024-09-12T17:30:02.816983+0000","last_became_peered":"2024-09-12T17:30:02.816983+0000","last_unstale":"2024-09-12T19:22:44.641116+0000","last_undegraded":"2024-09-12T19:22:44.641116+0000","last_fullsized":"2024-09-12T19:22:44.641116+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:16.290296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":194,"num_write":254,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'875","reported_seq":2511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.846463+0000","last_change":"2024-09-12T19:23:25.846463+0000","last_active":"2024-09-12T19:23:25.846463+0000","last_peered":"2024-09-12T19:23:25.846463+0000","last_clean":"2024-09-12T19:23:25.846463+0000","last_became_active":"2024-09-12T17:29:54.744926+0000","last_became_peered":"2024-09-12T17:29:54.744926+0000","last_unstale":"2024-09-12T19:23:25.846463+0000","last_undegraded":"2024-09-12T19:23:25.846463+0000","last_fullsized":"2024-09-12T19:23:25.846463+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'875","last_scrub_stamp":"2024-09-12T19:23:25.846277+0000","last_deep_scrub":"267'875","last_deep_scrub_stamp":"2024-09-12T19:23:25.846277+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.846277+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:32.763858+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4186,"num_read_kb":3781,"num_write":1194,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'377","reported_seq":1075,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.256060+0000","last_change":"2024-09-12T19:23:11.256060+0000","last_active":"2024-09-12T19:23:11.256060+0000","last_peered":"2024-09-12T19:23:11.256060+0000","last_clean":"2024-09-12T19:23:11.256060+0000","last_became_active":"2024-09-12T17:29:52.748439+0000","last_became_peered":"2024-09-12T17:29:52.748439+0000","last_unstale":"2024-09-12T19:23:11.256060+0000","last_undegraded":"2024-09-12T19:23:11.256060+0000","last_fullsized":"2024-09-12T19:23:11.256060+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'377","last_scrub_stamp":"2024-09-12T19:23:11.255752+0000","last_deep_scrub":"267'377","last_deep_scrub_stamp":"2024-09-12T19:23:11.255752+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.255752+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:44.862051+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992343,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":628,"num_read_kb":40400,"num_write":1240,"num_write_kb":24508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.008450+0000","last_change":"2024-09-12T19:23:21.008450+0000","last_active":"2024-09-12T19:23:21.008450+0000","last_peered":"2024-09-12T19:23:21.008450+0000","last_clean":"2024-09-12T19:23:21.008450+0000","last_became_active":"2024-09-12T17:29:56.742361+0000","last_became_peered":"2024-09-12T17:29:56.742361+0000","last_unstale":"2024-09-12T19:23:21.008450+0000","last_undegraded":"2024-09-12T19:23:21.008450+0000","last_fullsized":"2024-09-12T19:23:21.008450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:21.008185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:21.008185+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.008185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:29.516729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'518","reported_seq":1210,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.807529+0000","last_change":"2024-09-12T19:23:26.807529+0000","last_active":"2024-09-12T19:23:26.807529+0000","last_peered":"2024-09-12T19:23:26.807529+0000","last_clean":"2024-09-12T19:23:26.807529+0000","last_became_active":"2024-09-12T17:29:58.777576+0000","last_became_peered":"2024-09-12T17:29:58.777576+0000","last_unstale":"2024-09-12T19:23:26.807529+0000","last_undegraded":"2024-09-12T19:23:26.807529+0000","last_fullsized":"2024-09-12T19:23:26.807529+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'518","last_scrub_stamp":"2024-09-12T19:23:26.807330+0000","last_deep_scrub":"267'518","last_deep_scrub_stamp":"2024-09-12T19:23:26.807330+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.807330+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:29.286764+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94518,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":881,"num_read_kb":2010,"num_write":710,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.540027+0000","last_change":"2024-09-12T17:30:00.780996+0000","last_active":"2024-09-12T19:20:33.540027+0000","last_peered":"2024-09-12T19:20:33.540027+0000","last_clean":"2024-09-12T19:20:33.540027+0000","last_became_active":"2024-09-12T17:30:00.780193+0000","last_became_peered":"2024-09-12T17:30:00.780193+0000","last_unstale":"2024-09-12T19:20:33.540027+0000","last_undegraded":"2024-09-12T19:20:33.540027+0000","last_fullsized":"2024-09-12T19:20:33.540027+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:54.843536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'166","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.101340+0000","last_change":"2024-09-12T17:30:02.810105+0000","last_active":"2024-09-12T19:21:19.101340+0000","last_peered":"2024-09-12T19:21:19.101340+0000","last_clean":"2024-09-12T19:21:19.101340+0000","last_became_active":"2024-09-12T17:30:02.809357+0000","last_became_peered":"2024-09-12T17:30:02.809357+0000","last_unstale":"2024-09-12T19:21:19.101340+0000","last_undegraded":"2024-09-12T19:21:19.101340+0000","last_fullsized":"2024-09-12T19:21:19.101340+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:26.703985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":287,"num_read_kb":265,"num_write":391,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'1307","reported_seq":2993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.254001+0000","last_change":"2024-09-12T19:23:15.254001+0000","last_active":"2024-09-12T19:23:15.254001+0000","last_peered":"2024-09-12T19:23:15.254001+0000","last_clean":"2024-09-12T19:23:15.254001+0000","last_became_active":"2024-09-12T17:29:54.758550+0000","last_became_peered":"2024-09-12T17:29:54.758550+0000","last_unstale":"2024-09-12T19:23:15.254001+0000","last_undegraded":"2024-09-12T19:23:15.254001+0000","last_fullsized":"2024-09-12T19:23:15.254001+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1307","last_scrub_stamp":"2024-09-12T19:23:15.253774+0000","last_deep_scrub":"267'1307","last_deep_scrub_stamp":"2024-09-12T19:23:15.253774+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.253774+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":1200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:53.604695+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6018,"num_read_kb":5333,"num_write":1857,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'317","reported_seq":984,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.187666+0000","last_change":"2024-09-12T19:23:10.187666+0000","last_active":"2024-09-12T19:23:10.187666+0000","last_peered":"2024-09-12T19:23:10.187666+0000","last_clean":"2024-09-12T19:23:10.187666+0000","last_became_active":"2024-09-12T17:29:52.765603+0000","last_became_peered":"2024-09-12T17:29:52.765603+0000","last_unstale":"2024-09-12T19:23:10.187666+0000","last_undegraded":"2024-09-12T19:23:10.187666+0000","last_fullsized":"2024-09-12T19:23:10.187666+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-12T19:23:10.187423+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-12T19:23:10.187423+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.187423+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:25.588115+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911305,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":437,"num_read_kb":36052,"num_write":1059,"num_write_kb":37263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.020465+0000","last_change":"2024-09-12T19:23:23.020465+0000","last_active":"2024-09-12T19:23:23.020465+0000","last_peered":"2024-09-12T19:23:23.020465+0000","last_clean":"2024-09-12T19:23:23.020465+0000","last_became_active":"2024-09-12T17:29:56.772580+0000","last_became_peered":"2024-09-12T17:29:56.772580+0000","last_unstale":"2024-09-12T19:23:23.020465+0000","last_undegraded":"2024-09-12T19:23:23.020465+0000","last_fullsized":"2024-09-12T19:23:23.020465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:23.020268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:23.020268+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.020268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:35.030994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'332","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.109246+0000","last_change":"2024-09-12T17:29:58.774656+0000","last_active":"2024-09-12T19:23:01.109246+0000","last_peered":"2024-09-12T19:23:01.109246+0000","last_clean":"2024-09-12T19:23:01.109246+0000","last_became_active":"2024-09-12T17:29:58.773869+0000","last_became_peered":"2024-09-12T17:29:58.773869+0000","last_unstale":"2024-09-12T19:23:01.109246+0000","last_undegraded":"2024-09-12T19:23:01.109246+0000","last_fullsized":"2024-09-12T19:23:01.109246+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:05.201058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47005,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":1116,"num_write":486,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:38.195416+0000","last_change":"2024-09-12T17:30:00.779241+0000","last_active":"2024-09-12T19:20:38.195416+0000","last_peered":"2024-09-12T19:20:38.195416+0000","last_clean":"2024-09-12T19:20:38.195416+0000","last_became_active":"2024-09-12T17:30:00.778642+0000","last_became_peered":"2024-09-12T17:30:00.778642+0000","last_unstale":"2024-09-12T19:20:38.195416+0000","last_undegraded":"2024-09-12T19:20:38.195416+0000","last_fullsized":"2024-09-12T19:20:38.195416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:31:29.538173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'107","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:28.289420+0000","last_change":"2024-09-12T17:30:02.791858+0000","last_active":"2024-09-12T19:22:28.289420+0000","last_peered":"2024-09-12T19:22:28.289420+0000","last_clean":"2024-09-12T19:22:28.289420+0000","last_became_active":"2024-09-12T17:30:02.788612+0000","last_became_peered":"2024-09-12T17:30:02.788612+0000","last_unstale":"2024-09-12T19:22:28.289420+0000","last_undegraded":"2024-09-12T19:22:28.289420+0000","last_fullsized":"2024-09-12T19:22:28.289420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:58.832322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":252,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'363","reported_seq":1826,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.266919+0000","last_change":"2024-09-12T19:23:16.266919+0000","last_active":"2024-09-12T19:23:16.266919+0000","last_peered":"2024-09-12T19:23:16.266919+0000","last_clean":"2024-09-12T19:23:16.266919+0000","last_became_active":"2024-09-12T17:29:54.758311+0000","last_became_peered":"2024-09-12T17:29:54.758311+0000","last_unstale":"2024-09-12T19:23:16.266919+0000","last_undegraded":"2024-09-12T19:23:16.266919+0000","last_fullsized":"2024-09-12T19:23:16.266919+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'363","last_scrub_stamp":"2024-09-12T19:23:16.266739+0000","last_deep_scrub":"267'363","last_deep_scrub_stamp":"2024-09-12T19:23:16.266739+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.266739+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:18.541808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1918,"num_read_kb":1833,"num_write":390,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'336","reported_seq":1020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.171645+0000","last_change":"2024-09-12T19:23:10.171645+0000","last_active":"2024-09-12T19:23:10.171645+0000","last_peered":"2024-09-12T19:23:10.171645+0000","last_clean":"2024-09-12T19:23:10.171645+0000","last_became_active":"2024-09-12T17:29:52.716965+0000","last_became_peered":"2024-09-12T17:29:52.716965+0000","last_unstale":"2024-09-12T19:23:10.171645+0000","last_undegraded":"2024-09-12T19:23:10.171645+0000","last_fullsized":"2024-09-12T19:23:10.171645+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-12T19:23:10.171401+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-12T19:23:10.171401+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.171401+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:15.438323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262277,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":1122,"num_write":1102,"num_write_kb":14973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.669689+0000","last_change":"2024-09-12T19:23:25.669689+0000","last_active":"2024-09-12T19:23:25.669689+0000","last_peered":"2024-09-12T19:23:25.669689+0000","last_clean":"2024-09-12T19:23:25.669689+0000","last_became_active":"2024-09-12T17:29:56.765057+0000","last_became_peered":"2024-09-12T17:29:56.765057+0000","last_unstale":"2024-09-12T19:23:25.669689+0000","last_undegraded":"2024-09-12T19:23:25.669689+0000","last_fullsized":"2024-09-12T19:23:25.669689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:25.669504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:25.669504+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.669504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:14.220999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'375","reported_seq":1046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.977622+0000","last_change":"2024-09-12T19:23:24.977622+0000","last_active":"2024-09-12T19:23:24.977622+0000","last_peered":"2024-09-12T19:23:24.977622+0000","last_clean":"2024-09-12T19:23:24.977622+0000","last_became_active":"2024-09-12T17:29:58.771991+0000","last_became_peered":"2024-09-12T17:29:58.771991+0000","last_unstale":"2024-09-12T19:23:24.977622+0000","last_undegraded":"2024-09-12T19:23:24.977622+0000","last_fullsized":"2024-09-12T19:23:24.977622+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'375","last_scrub_stamp":"2024-09-12T19:23:24.977409+0000","last_deep_scrub":"267'375","last_deep_scrub_stamp":"2024-09-12T19:23:24.977409+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.977409+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:34.466039+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43575,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":600,"num_read_kb":1164,"num_write":460,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'753","reported_seq":5264,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.923677+0000","last_change":"2024-09-12T19:23:25.923677+0000","last_active":"2024-09-12T19:23:25.923677+0000","last_peered":"2024-09-12T19:23:25.923677+0000","last_clean":"2024-09-12T19:23:25.923677+0000","last_became_active":"2024-09-12T17:30:00.802950+0000","last_became_peered":"2024-09-12T17:30:00.802950+0000","last_unstale":"2024-09-12T19:23:25.923677+0000","last_undegraded":"2024-09-12T19:23:25.923677+0000","last_fullsized":"2024-09-12T19:23:25.923677+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'753","last_scrub_stamp":"2024-09-12T19:23:25.923495+0000","last_deep_scrub":"267'753","last_deep_scrub_stamp":"2024-09-12T19:23:25.923495+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.923495+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":701,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:31.579440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'111","reported_seq":637,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:16.233380+0000","last_change":"2024-09-12T17:30:02.807435+0000","last_active":"2024-09-12T19:21:16.233380+0000","last_peered":"2024-09-12T19:21:16.233380+0000","last_clean":"2024-09-12T19:21:16.233380+0000","last_became_active":"2024-09-12T17:30:02.806621+0000","last_became_peered":"2024-09-12T17:30:02.806621+0000","last_unstale":"2024-09-12T19:21:16.233380+0000","last_undegraded":"2024-09-12T19:21:16.233380+0000","last_fullsized":"2024-09-12T19:21:16.233380+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:28.598520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":276,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'779","reported_seq":2461,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.251063+0000","last_change":"2024-09-12T19:23:17.251063+0000","last_active":"2024-09-12T19:23:17.251063+0000","last_peered":"2024-09-12T19:23:17.251063+0000","last_clean":"2024-09-12T19:23:17.251063+0000","last_became_active":"2024-09-12T17:29:54.763348+0000","last_became_peered":"2024-09-12T17:29:54.763348+0000","last_unstale":"2024-09-12T19:23:17.251063+0000","last_undegraded":"2024-09-12T19:23:17.251063+0000","last_fullsized":"2024-09-12T19:23:17.251063+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'779","last_scrub_stamp":"2024-09-12T19:23:17.250871+0000","last_deep_scrub":"267'779","last_deep_scrub_stamp":"2024-09-12T19:23:17.250871+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.250871+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:17.003332+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4009,"num_read_kb":3654,"num_write":1024,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3240,"num_omap_keys":13,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'307","reported_seq":984,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.186027+0000","last_change":"2024-09-12T19:23:09.186027+0000","last_active":"2024-09-12T19:23:09.186027+0000","last_peered":"2024-09-12T19:23:09.186027+0000","last_clean":"2024-09-12T19:23:09.186027+0000","last_became_active":"2024-09-12T17:29:52.744356+0000","last_became_peered":"2024-09-12T17:29:52.744356+0000","last_unstale":"2024-09-12T19:23:09.186027+0000","last_undegraded":"2024-09-12T19:23:09.186027+0000","last_fullsized":"2024-09-12T19:23:09.186027+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'307","last_scrub_stamp":"2024-09-12T19:23:09.185810+0000","last_deep_scrub":"267'307","last_deep_scrub_stamp":"2024-09-12T19:23:09.185810+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.185810+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:50.544329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":48689,"num_write":1045,"num_write_kb":32373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1474,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.852068+0000","last_change":"2024-09-12T17:29:56.751658+0000","last_active":"2024-09-12T19:22:58.852068+0000","last_peered":"2024-09-12T19:22:58.852068+0000","last_clean":"2024-09-12T19:22:58.852068+0000","last_became_active":"2024-09-12T17:29:56.750915+0000","last_became_peered":"2024-09-12T17:29:56.750915+0000","last_unstale":"2024-09-12T19:22:58.852068+0000","last_undegraded":"2024-09-12T19:22:58.852068+0000","last_fullsized":"2024-09-12T19:22:58.852068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:54.038362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'146","reported_seq":731,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:49.669036+0000","last_change":"2024-09-12T17:29:58.832618+0000","last_active":"2024-09-12T19:20:49.669036+0000","last_peered":"2024-09-12T19:20:49.669036+0000","last_clean":"2024-09-12T19:20:49.669036+0000","last_became_active":"2024-09-12T17:29:58.831628+0000","last_became_peered":"2024-09-12T17:29:58.831628+0000","last_unstale":"2024-09-12T19:20:49.669036+0000","last_undegraded":"2024-09-12T19:20:49.669036+0000","last_fullsized":"2024-09-12T19:20:49.669036+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:43.249799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'773","reported_seq":3254,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.215663+0000","last_change":"2024-09-12T19:23:26.215663+0000","last_active":"2024-09-12T19:23:26.215663+0000","last_peered":"2024-09-12T19:23:26.215663+0000","last_clean":"2024-09-12T19:23:26.215663+0000","last_became_active":"2024-09-12T17:30:00.806681+0000","last_became_peered":"2024-09-12T17:30:00.806681+0000","last_unstale":"2024-09-12T19:23:26.215663+0000","last_undegraded":"2024-09-12T19:23:26.215663+0000","last_fullsized":"2024-09-12T19:23:26.215663+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'773","last_scrub_stamp":"2024-09-12T19:23:26.215444+0000","last_deep_scrub":"267'773","last_deep_scrub_stamp":"2024-09-12T19:23:26.215444+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.215444+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":701,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:50.424909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'116","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:14.309491+0000","last_change":"2024-09-12T17:30:02.806772+0000","last_active":"2024-09-12T19:21:14.309491+0000","last_peered":"2024-09-12T19:21:14.309491+0000","last_clean":"2024-09-12T19:21:14.309491+0000","last_became_active":"2024-09-12T17:30:02.805954+0000","last_became_peered":"2024-09-12T17:30:02.805954+0000","last_unstale":"2024-09-12T19:21:14.309491+0000","last_undegraded":"2024-09-12T19:21:14.309491+0000","last_fullsized":"2024-09-12T19:21:14.309491+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:48.506411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":135,"num_write":268,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'521","reported_seq":2066,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.716900+0000","last_change":"2024-09-12T19:23:18.716900+0000","last_active":"2024-09-12T19:23:18.716900+0000","last_peered":"2024-09-12T19:23:18.716900+0000","last_clean":"2024-09-12T19:23:18.716900+0000","last_became_active":"2024-09-12T17:29:54.755550+0000","last_became_peered":"2024-09-12T17:29:54.755550+0000","last_unstale":"2024-09-12T19:23:18.716900+0000","last_undegraded":"2024-09-12T19:23:18.716900+0000","last_fullsized":"2024-09-12T19:23:18.716900+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'521","last_scrub_stamp":"2024-09-12T19:23:18.716720+0000","last_deep_scrub":"267'521","last_deep_scrub_stamp":"2024-09-12T19:23:18.716720+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.716720+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:37.752618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2775,"num_read_kb":2556,"num_write":676,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'376","reported_seq":1080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.210414+0000","last_change":"2024-09-12T19:23:09.210414+0000","last_active":"2024-09-12T19:23:09.210414+0000","last_peered":"2024-09-12T19:23:09.210414+0000","last_clean":"2024-09-12T19:23:09.210414+0000","last_became_active":"2024-09-12T17:30:21.696077+0000","last_became_peered":"2024-09-12T17:30:21.696077+0000","last_unstale":"2024-09-12T19:23:09.210414+0000","last_undegraded":"2024-09-12T19:23:09.210414+0000","last_fullsized":"2024-09-12T19:23:09.210414+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'376","last_scrub_stamp":"2024-09-12T19:23:09.210184+0000","last_deep_scrub":"267'376","last_deep_scrub_stamp":"2024-09-12T19:23:09.210184+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.210184+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:47.241745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":12866,"num_write":1197,"num_write_kb":34720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.198755+0000","last_change":"2024-09-12T17:29:56.758620+0000","last_active":"2024-09-12T19:20:13.198755+0000","last_peered":"2024-09-12T19:20:13.198755+0000","last_clean":"2024-09-12T19:20:13.198755+0000","last_became_active":"2024-09-12T17:29:56.757728+0000","last_became_peered":"2024-09-12T17:29:56.757728+0000","last_unstale":"2024-09-12T19:20:13.198755+0000","last_undegraded":"2024-09-12T19:20:13.198755+0000","last_fullsized":"2024-09-12T19:20:13.198755+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:39.838154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'417","reported_seq":1095,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:02.001142+0000","last_change":"2024-09-12T17:29:58.776898+0000","last_active":"2024-09-12T19:23:02.001142+0000","last_peered":"2024-09-12T19:23:02.001142+0000","last_clean":"2024-09-12T19:23:02.001142+0000","last_became_active":"2024-09-12T17:29:58.776033+0000","last_became_peered":"2024-09-12T17:29:58.776033+0000","last_unstale":"2024-09-12T19:23:02.001142+0000","last_undegraded":"2024-09-12T19:23:02.001142+0000","last_fullsized":"2024-09-12T19:23:02.001142+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:29.107658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47722,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":665,"num_read_kb":1193,"num_write":496,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.210780+0000","last_change":"2024-09-12T19:23:25.210780+0000","last_active":"2024-09-12T19:23:25.210780+0000","last_peered":"2024-09-12T19:23:25.210780+0000","last_clean":"2024-09-12T19:23:25.210780+0000","last_became_active":"2024-09-12T17:30:00.792687+0000","last_became_peered":"2024-09-12T17:30:00.792687+0000","last_unstale":"2024-09-12T19:23:25.210780+0000","last_undegraded":"2024-09-12T19:23:25.210780+0000","last_fullsized":"2024-09-12T19:23:25.210780+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:25.210462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:25.210462+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.210462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:31.054537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'165","reported_seq":696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.984898+0000","last_change":"2024-09-12T17:30:02.809944+0000","last_active":"2024-09-12T19:20:27.984898+0000","last_peered":"2024-09-12T19:20:27.984898+0000","last_clean":"2024-09-12T19:20:27.984898+0000","last_became_active":"2024-09-12T17:30:02.809252+0000","last_became_peered":"2024-09-12T17:30:02.809252+0000","last_unstale":"2024-09-12T19:20:27.984898+0000","last_undegraded":"2024-09-12T19:20:27.984898+0000","last_fullsized":"2024-09-12T19:20:27.984898+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:42.655346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":242,"num_read_kb":230,"num_write":407,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'457","reported_seq":1891,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.227830+0000","last_change":"2024-09-12T19:23:16.227830+0000","last_active":"2024-09-12T19:23:16.227830+0000","last_peered":"2024-09-12T19:23:16.227830+0000","last_clean":"2024-09-12T19:23:16.227830+0000","last_became_active":"2024-09-12T17:29:54.771538+0000","last_became_peered":"2024-09-12T17:29:54.771538+0000","last_unstale":"2024-09-12T19:23:16.227830+0000","last_undegraded":"2024-09-12T19:23:16.227830+0000","last_fullsized":"2024-09-12T19:23:16.227830+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'457","last_scrub_stamp":"2024-09-12T19:23:16.227601+0000","last_deep_scrub":"267'457","last_deep_scrub_stamp":"2024-09-12T19:23:16.227601+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.227601+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:42.639886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2249,"num_read_kb":2075,"num_write":554,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":653,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.928447+0000","last_change":"2024-09-12T19:23:09.928447+0000","last_active":"2024-09-12T19:23:09.928447+0000","last_peered":"2024-09-12T19:23:09.928447+0000","last_clean":"2024-09-12T19:23:09.928447+0000","last_became_active":"2024-09-12T17:29:30.601518+0000","last_became_peered":"2024-09-12T17:29:30.601518+0000","last_unstale":"2024-09-12T19:23:09.928447+0000","last_undegraded":"2024-09-12T19:23:09.928447+0000","last_fullsized":"2024-09-12T19:23:09.928447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-12T19:23:09.928248+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-12T19:23:09.928248+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.928248+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:35.888829+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.259855+0000","last_change":"2024-09-12T19:23:10.259855+0000","last_active":"2024-09-12T19:23:10.259855+0000","last_peered":"2024-09-12T19:23:10.259855+0000","last_clean":"2024-09-12T19:23:10.259855+0000","last_became_active":"2024-09-12T17:29:35.340342+0000","last_became_peered":"2024-09-12T17:29:35.340342+0000","last_unstale":"2024-09-12T19:23:10.259855+0000","last_undegraded":"2024-09-12T19:23:10.259855+0000","last_fullsized":"2024-09-12T19:23:10.259855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:10.259670+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:10.259670+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.259670+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:38.403829+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.00097602599999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'336","reported_seq":1026,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:08.204936+0000","last_change":"2024-09-12T19:23:08.204936+0000","last_active":"2024-09-12T19:23:08.204936+0000","last_peered":"2024-09-12T19:23:08.204936+0000","last_clean":"2024-09-12T19:23:08.204936+0000","last_became_active":"2024-09-12T17:29:52.765497+0000","last_became_peered":"2024-09-12T17:29:52.765497+0000","last_unstale":"2024-09-12T19:23:08.204936+0000","last_undegraded":"2024-09-12T19:23:08.204936+0000","last_fullsized":"2024-09-12T19:23:08.204936+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-12T19:23:08.204778+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-12T19:23:08.204778+0000","last_clean_scrub_stamp":"2024-09-12T19:23:08.204778+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:46.017915+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2167098,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":533,"num_read_kb":15769,"num_write":1043,"num_write_kb":23964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.078540+0000","last_change":"2024-09-12T19:23:26.078540+0000","last_active":"2024-09-12T19:23:26.078540+0000","last_peered":"2024-09-12T19:23:26.078540+0000","last_clean":"2024-09-12T19:23:26.078540+0000","last_became_active":"2024-09-12T17:29:56.749938+0000","last_became_peered":"2024-09-12T17:29:56.749938+0000","last_unstale":"2024-09-12T19:23:26.078540+0000","last_undegraded":"2024-09-12T19:23:26.078540+0000","last_fullsized":"2024-09-12T19:23:26.078540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:26.078358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:26.078358+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.078358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:45.805777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'798","reported_seq":1542,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.770805+0000","last_change":"2024-09-12T17:29:58.770209+0000","last_active":"2024-09-12T19:23:01.770805+0000","last_peered":"2024-09-12T19:23:01.770805+0000","last_clean":"2024-09-12T19:23:01.770805+0000","last_became_active":"2024-09-12T17:29:58.769277+0000","last_became_peered":"2024-09-12T17:29:58.769277+0000","last_unstale":"2024-09-12T19:23:01.770805+0000","last_undegraded":"2024-09-12T19:23:01.770805+0000","last_fullsized":"2024-09-12T19:23:01.770805+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:07.152072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159898,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1560,"num_read_kb":3538,"num_write":1488,"num_write_kb":1318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.193952+0000","last_change":"2024-09-12T17:30:00.800340+0000","last_active":"2024-09-12T19:20:33.193952+0000","last_peered":"2024-09-12T19:20:33.193952+0000","last_clean":"2024-09-12T19:20:33.193952+0000","last_became_active":"2024-09-12T17:30:00.799883+0000","last_became_peered":"2024-09-12T17:30:00.799883+0000","last_unstale":"2024-09-12T19:20:33.193952+0000","last_undegraded":"2024-09-12T19:20:33.193952+0000","last_fullsized":"2024-09-12T19:20:33.193952+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:44.555994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'197","reported_seq":924,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.519551+0000","last_change":"2024-09-12T17:30:02.800451+0000","last_active":"2024-09-12T19:21:21.519551+0000","last_peered":"2024-09-12T19:21:21.519551+0000","last_clean":"2024-09-12T19:21:21.519551+0000","last_became_active":"2024-09-12T17:30:02.799307+0000","last_became_peered":"2024-09-12T17:30:02.799307+0000","last_unstale":"2024-09-12T19:21:21.519551+0000","last_undegraded":"2024-09-12T19:21:21.519551+0000","last_fullsized":"2024-09-12T19:21:21.519551+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:50.826285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1000,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":467,"num_write":393,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'477","reported_seq":2046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.883431+0000","last_change":"2024-09-12T19:23:13.883431+0000","last_active":"2024-09-12T19:23:13.883431+0000","last_peered":"2024-09-12T19:23:13.883431+0000","last_clean":"2024-09-12T19:23:13.883431+0000","last_became_active":"2024-09-12T17:29:54.758196+0000","last_became_peered":"2024-09-12T17:29:54.758196+0000","last_unstale":"2024-09-12T19:23:13.883431+0000","last_undegraded":"2024-09-12T19:23:13.883431+0000","last_fullsized":"2024-09-12T19:23:13.883431+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'477","last_scrub_stamp":"2024-09-12T19:23:13.883243+0000","last_deep_scrub":"267'477","last_deep_scrub_stamp":"2024-09-12T19:23:13.883243+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.883243+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:38.406363+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2778,"num_read_kb":2582,"num_write":658,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":560,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.930668+0000","last_change":"2024-09-12T19:23:10.930668+0000","last_active":"2024-09-12T19:23:10.930668+0000","last_peered":"2024-09-12T19:23:10.930668+0000","last_clean":"2024-09-12T19:23:10.930668+0000","last_became_active":"2024-09-12T17:29:35.336475+0000","last_became_peered":"2024-09-12T17:29:35.336475+0000","last_unstale":"2024-09-12T19:23:10.930668+0000","last_undegraded":"2024-09-12T19:23:10.930668+0000","last_fullsized":"2024-09-12T19:23:10.930668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:10.930485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:10.930485+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.930485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:54.374314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012883599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'346","reported_seq":1079,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.866118+0000","last_change":"2024-09-12T19:23:09.866118+0000","last_active":"2024-09-12T19:23:09.866118+0000","last_peered":"2024-09-12T19:23:09.866118+0000","last_clean":"2024-09-12T19:23:09.866118+0000","last_became_active":"2024-09-12T17:29:52.766251+0000","last_became_peered":"2024-09-12T17:29:52.766251+0000","last_unstale":"2024-09-12T19:23:09.866118+0000","last_undegraded":"2024-09-12T19:23:09.866118+0000","last_fullsized":"2024-09-12T19:23:09.866118+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-09-12T19:23:09.865739+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-09-12T19:23:09.865739+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.865739+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:30.064297+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730134,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":595,"num_read_kb":84420,"num_write":1189,"num_write_kb":23129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.992482+0000","last_change":"2024-09-12T17:29:56.763217+0000","last_active":"2024-09-12T19:20:27.992482+0000","last_peered":"2024-09-12T19:20:27.992482+0000","last_clean":"2024-09-12T19:20:27.992482+0000","last_became_active":"2024-09-12T17:29:56.762451+0000","last_became_peered":"2024-09-12T17:29:56.762451+0000","last_unstale":"2024-09-12T19:20:27.992482+0000","last_undegraded":"2024-09-12T19:20:27.992482+0000","last_fullsized":"2024-09-12T19:20:27.992482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:29.246666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1460","reported_seq":3809,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.692205+0000","last_change":"2024-09-12T17:29:58.772005+0000","last_active":"2024-09-12T19:23:01.692205+0000","last_peered":"2024-09-12T19:23:01.692205+0000","last_clean":"2024-09-12T19:23:01.692205+0000","last_became_active":"2024-09-12T17:29:58.771561+0000","last_became_peered":"2024-09-12T17:29:58.771561+0000","last_unstale":"2024-09-12T19:23:01.692205+0000","last_undegraded":"2024-09-12T19:23:01.692205+0000","last_fullsized":"2024-09-12T19:23:01.692205+0000","mapping_epoch":32,"log_start":"267'1400","ondisk_log_start":"267'1400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":1400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:12.774049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146977,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2279,"num_read_kb":4182,"num_write":1388,"num_write_kb":1130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:47.979732+0000","last_change":"2024-09-12T17:30:00.806748+0000","last_active":"2024-09-12T19:20:47.979732+0000","last_peered":"2024-09-12T19:20:47.979732+0000","last_clean":"2024-09-12T19:20:47.979732+0000","last_became_active":"2024-09-12T17:30:00.806030+0000","last_became_peered":"2024-09-12T17:30:00.806030+0000","last_unstale":"2024-09-12T19:20:47.979732+0000","last_undegraded":"2024-09-12T19:20:47.979732+0000","last_fullsized":"2024-09-12T19:20:47.979732+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:16.762914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'217","reported_seq":761,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.117067+0000","last_change":"2024-09-12T17:30:02.810034+0000","last_active":"2024-09-12T19:21:19.117067+0000","last_peered":"2024-09-12T19:21:19.117067+0000","last_clean":"2024-09-12T19:21:19.117067+0000","last_became_active":"2024-09-12T17:30:02.809372+0000","last_became_peered":"2024-09-12T17:30:02.809372+0000","last_unstale":"2024-09-12T19:21:19.117067+0000","last_undegraded":"2024-09-12T19:21:19.117067+0000","last_fullsized":"2024-09-12T19:21:19.117067+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":353,"num_read_kb":353,"num_write":469,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'467","reported_seq":2059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.685511+0000","last_change":"2024-09-12T19:23:14.685511+0000","last_active":"2024-09-12T19:23:14.685511+0000","last_peered":"2024-09-12T19:23:14.685511+0000","last_clean":"2024-09-12T19:23:14.685511+0000","last_became_active":"2024-09-12T17:29:54.747270+0000","last_became_peered":"2024-09-12T17:29:54.747270+0000","last_unstale":"2024-09-12T19:23:14.685511+0000","last_undegraded":"2024-09-12T19:23:14.685511+0000","last_fullsized":"2024-09-12T19:23:14.685511+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'467","last_scrub_stamp":"2024-09-12T19:23:14.685322+0000","last_deep_scrub":"267'467","last_deep_scrub_stamp":"2024-09-12T19:23:14.685322+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.685322+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:35.304389+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2522,"num_read_kb":2358,"num_write":589,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":572,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.974668+0000","last_change":"2024-09-12T19:23:09.974668+0000","last_active":"2024-09-12T19:23:09.974668+0000","last_peered":"2024-09-12T19:23:09.974668+0000","last_clean":"2024-09-12T19:23:09.974668+0000","last_became_active":"2024-09-12T17:29:35.331504+0000","last_became_peered":"2024-09-12T17:29:35.331504+0000","last_unstale":"2024-09-12T19:23:09.974668+0000","last_undegraded":"2024-09-12T19:23:09.974668+0000","last_fullsized":"2024-09-12T19:23:09.974668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:09.974482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:09.974482+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.974482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:21.285772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001034428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'347","reported_seq":991,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:07.691765+0000","last_change":"2024-09-12T19:23:07.691765+0000","last_active":"2024-09-12T19:23:07.691765+0000","last_peered":"2024-09-12T19:23:07.691765+0000","last_clean":"2024-09-12T19:23:07.691765+0000","last_became_active":"2024-09-12T17:29:52.741209+0000","last_became_peered":"2024-09-12T17:29:52.741209+0000","last_unstale":"2024-09-12T19:23:07.691765+0000","last_undegraded":"2024-09-12T19:23:07.691765+0000","last_fullsized":"2024-09-12T19:23:07.691765+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'347","last_scrub_stamp":"2024-09-12T19:23:07.691644+0000","last_deep_scrub":"267'347","last_deep_scrub_stamp":"2024-09-12T19:23:07.691644+0000","last_clean_scrub_stamp":"2024-09-12T19:23:07.691644+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:20.196315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":451,"num_read_kb":5499,"num_write":979,"num_write_kb":15070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":545,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.942556+0000","last_change":"2024-09-12T19:23:17.942556+0000","last_active":"2024-09-12T19:23:17.942556+0000","last_peered":"2024-09-12T19:23:17.942556+0000","last_clean":"2024-09-12T19:23:17.942556+0000","last_became_active":"2024-09-12T17:29:56.753063+0000","last_became_peered":"2024-09-12T17:29:56.753063+0000","last_unstale":"2024-09-12T19:23:17.942556+0000","last_undegraded":"2024-09-12T19:23:17.942556+0000","last_fullsized":"2024-09-12T19:23:17.942556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:17.942378+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:17.942378+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.942378+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:50.587264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'367","reported_seq":2316,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.478760+0000","last_change":"2024-09-12T17:29:58.835335+0000","last_active":"2024-09-12T19:22:46.478760+0000","last_peered":"2024-09-12T19:22:46.478760+0000","last_clean":"2024-09-12T19:22:46.478760+0000","last_became_active":"2024-09-12T17:29:58.834447+0000","last_became_peered":"2024-09-12T17:29:58.834447+0000","last_unstale":"2024-09-12T19:22:46.478760+0000","last_undegraded":"2024-09-12T19:22:46.478760+0000","last_fullsized":"2024-09-12T19:22:46.478760+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:10.184300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":368,"num_read_kb":360,"num_write":359,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.192453+0000","last_change":"2024-09-12T17:30:00.778895+0000","last_active":"2024-09-12T19:20:28.192453+0000","last_peered":"2024-09-12T19:20:28.192453+0000","last_clean":"2024-09-12T19:20:28.192453+0000","last_became_active":"2024-09-12T17:30:00.778134+0000","last_became_peered":"2024-09-12T17:30:00.778134+0000","last_unstale":"2024-09-12T19:20:28.192453+0000","last_undegraded":"2024-09-12T19:20:28.192453+0000","last_fullsized":"2024-09-12T19:20:28.192453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:51:40.692916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'270","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:22.003400+0000","last_change":"2024-09-12T17:30:02.805738+0000","last_active":"2024-09-12T19:21:22.003400+0000","last_peered":"2024-09-12T19:21:22.003400+0000","last_clean":"2024-09-12T19:21:22.003400+0000","last_became_active":"2024-09-12T17:30:02.805090+0000","last_became_peered":"2024-09-12T17:30:02.805090+0000","last_unstale":"2024-09-12T19:21:22.003400+0000","last_undegraded":"2024-09-12T19:21:22.003400+0000","last_fullsized":"2024-09-12T19:21:22.003400+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:19.612013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":596,"num_read_kb":605,"num_write":610,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'411","reported_seq":1966,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.669552+0000","last_change":"2024-09-12T19:23:20.669552+0000","last_active":"2024-09-12T19:23:20.669552+0000","last_peered":"2024-09-12T19:23:20.669552+0000","last_clean":"2024-09-12T19:23:20.669552+0000","last_became_active":"2024-09-12T17:29:54.745423+0000","last_became_peered":"2024-09-12T17:29:54.745423+0000","last_unstale":"2024-09-12T19:23:20.669552+0000","last_undegraded":"2024-09-12T19:23:20.669552+0000","last_fullsized":"2024-09-12T19:23:20.669552+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'411","last_scrub_stamp":"2024-09-12T19:23:20.669299+0000","last_deep_scrub":"267'411","last_deep_scrub_stamp":"2024-09-12T19:23:20.669299+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.669299+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:50.595760+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2154,"num_read_kb":2073,"num_write":474,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":562,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.235866+0000","last_change":"2024-09-12T19:23:12.235866+0000","last_active":"2024-09-12T19:23:12.235866+0000","last_peered":"2024-09-12T19:23:12.235866+0000","last_clean":"2024-09-12T19:23:12.235866+0000","last_became_active":"2024-09-12T17:29:35.340113+0000","last_became_peered":"2024-09-12T17:29:35.340113+0000","last_unstale":"2024-09-12T19:23:12.235866+0000","last_undegraded":"2024-09-12T19:23:12.235866+0000","last_fullsized":"2024-09-12T19:23:12.235866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:12.235689+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:12.235689+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.235689+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:20.303471+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0020086050000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'366","reported_seq":1122,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:08.225908+0000","last_change":"2024-09-12T19:23:08.225908+0000","last_active":"2024-09-12T19:23:08.225908+0000","last_peered":"2024-09-12T19:23:08.225908+0000","last_clean":"2024-09-12T19:23:08.225908+0000","last_became_active":"2024-09-12T17:29:52.759957+0000","last_became_peered":"2024-09-12T17:29:52.759957+0000","last_unstale":"2024-09-12T19:23:08.225908+0000","last_undegraded":"2024-09-12T19:23:08.225908+0000","last_fullsized":"2024-09-12T19:23:08.225908+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'366","last_scrub_stamp":"2024-09-12T19:23:08.225657+0000","last_deep_scrub":"267'366","last_deep_scrub_stamp":"2024-09-12T19:23:08.225657+0000","last_clean_scrub_stamp":"2024-09-12T19:23:08.225657+0000","objects_scrubbed":10,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:08.296014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279708,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":651,"num_read_kb":39253,"num_write":1178,"num_write_kb":45869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.816409+0000","last_change":"2024-09-12T19:23:20.816409+0000","last_active":"2024-09-12T19:23:20.816409+0000","last_peered":"2024-09-12T19:23:20.816409+0000","last_clean":"2024-09-12T19:23:20.816409+0000","last_became_active":"2024-09-12T17:29:56.765361+0000","last_became_peered":"2024-09-12T17:29:56.765361+0000","last_unstale":"2024-09-12T19:23:20.816409+0000","last_undegraded":"2024-09-12T19:23:20.816409+0000","last_fullsized":"2024-09-12T19:23:20.816409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:20.816187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:20.816187+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.816187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:19:00.594416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'210","reported_seq":825,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:43.293295+0000","last_change":"2024-09-12T17:29:58.769020+0000","last_active":"2024-09-12T19:22:43.293295+0000","last_peered":"2024-09-12T19:22:43.293295+0000","last_clean":"2024-09-12T19:22:43.293295+0000","last_became_active":"2024-09-12T17:29:58.768596+0000","last_became_peered":"2024-09-12T17:29:58.768596+0000","last_unstale":"2024-09-12T19:22:43.293295+0000","last_undegraded":"2024-09-12T19:22:43.293295+0000","last_fullsized":"2024-09-12T19:22:43.293295+0000","mapping_epoch":32,"log_start":"264'100","ondisk_log_start":"264'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:34.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.237039+0000","last_change":"2024-09-12T19:23:24.237039+0000","last_active":"2024-09-12T19:23:24.237039+0000","last_peered":"2024-09-12T19:23:24.237039+0000","last_clean":"2024-09-12T19:23:24.237039+0000","last_became_active":"2024-09-12T17:30:00.788505+0000","last_became_peered":"2024-09-12T17:30:00.788505+0000","last_unstale":"2024-09-12T19:23:24.237039+0000","last_undegraded":"2024-09-12T19:23:24.237039+0000","last_fullsized":"2024-09-12T19:23:24.237039+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:24.236855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:24.236855+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.236855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:04:51.530055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'156","reported_seq":736,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.643106+0000","last_change":"2024-09-12T17:30:02.795566+0000","last_active":"2024-09-12T19:22:44.643106+0000","last_peered":"2024-09-12T19:22:44.643106+0000","last_clean":"2024-09-12T19:22:44.643106+0000","last_became_active":"2024-09-12T17:30:02.794703+0000","last_became_peered":"2024-09-12T17:30:02.794703+0000","last_unstale":"2024-09-12T19:22:44.643106+0000","last_undegraded":"2024-09-12T19:22:44.643106+0000","last_fullsized":"2024-09-12T19:22:44.643106+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:19.673266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":268,"num_read_kb":254,"num_write":347,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'419","reported_seq":2024,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.689299+0000","last_change":"2024-09-12T19:23:11.689299+0000","last_active":"2024-09-12T19:23:11.689299+0000","last_peered":"2024-09-12T19:23:11.689299+0000","last_clean":"2024-09-12T19:23:11.689299+0000","last_became_active":"2024-09-12T17:29:54.766275+0000","last_became_peered":"2024-09-12T17:29:54.766275+0000","last_unstale":"2024-09-12T19:23:11.689299+0000","last_undegraded":"2024-09-12T19:23:11.689299+0000","last_fullsized":"2024-09-12T19:23:11.689299+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'419","last_scrub_stamp":"2024-09-12T19:23:11.689112+0000","last_deep_scrub":"267'419","last_deep_scrub_stamp":"2024-09-12T19:23:11.689112+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.689112+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:41.829755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2280,"num_read_kb":2171,"num_write":482,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'349","reported_seq":1034,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.235471+0000","last_change":"2024-09-12T19:23:09.235471+0000","last_active":"2024-09-12T19:23:09.235471+0000","last_peered":"2024-09-12T19:23:09.235471+0000","last_clean":"2024-09-12T19:23:09.235471+0000","last_became_active":"2024-09-12T17:29:52.740544+0000","last_became_peered":"2024-09-12T17:29:52.740544+0000","last_unstale":"2024-09-12T19:23:09.235471+0000","last_undegraded":"2024-09-12T19:23:09.235471+0000","last_fullsized":"2024-09-12T19:23:09.235471+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-12T19:23:09.235171+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-12T19:23:09.235171+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.235171+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:19.968121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":6019,"num_write":1130,"num_write_kb":22769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":562,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:08.639498+0000","last_change":"2024-09-12T19:23:08.639498+0000","last_active":"2024-09-12T19:23:08.639498+0000","last_peered":"2024-09-12T19:23:08.639498+0000","last_clean":"2024-09-12T19:23:08.639498+0000","last_became_active":"2024-09-12T17:29:35.407492+0000","last_became_peered":"2024-09-12T17:29:35.407492+0000","last_unstale":"2024-09-12T19:23:08.639498+0000","last_undegraded":"2024-09-12T19:23:08.639498+0000","last_fullsized":"2024-09-12T19:23:08.639498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:08.639425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:08.639425+0000","last_clean_scrub_stamp":"2024-09-12T19:23:08.639425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:59.907415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098134900000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.191284+0000","last_change":"2024-09-12T17:29:56.769832+0000","last_active":"2024-09-12T19:20:23.191284+0000","last_peered":"2024-09-12T19:20:23.191284+0000","last_clean":"2024-09-12T19:20:23.191284+0000","last_became_active":"2024-09-12T17:29:56.769344+0000","last_became_peered":"2024-09-12T17:29:56.769344+0000","last_unstale":"2024-09-12T19:20:23.191284+0000","last_undegraded":"2024-09-12T19:20:23.191284+0000","last_fullsized":"2024-09-12T19:20:23.191284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:42:05.381579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'771","reported_seq":1519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.838550+0000","last_change":"2024-09-12T19:23:24.838550+0000","last_active":"2024-09-12T19:23:24.838550+0000","last_peered":"2024-09-12T19:23:24.838550+0000","last_clean":"2024-09-12T19:23:24.838550+0000","last_became_active":"2024-09-12T17:29:58.766353+0000","last_became_peered":"2024-09-12T17:29:58.766353+0000","last_unstale":"2024-09-12T19:23:24.838550+0000","last_undegraded":"2024-09-12T19:23:24.838550+0000","last_fullsized":"2024-09-12T19:23:24.838550+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'771","last_scrub_stamp":"2024-09-12T19:23:24.838217+0000","last_deep_scrub":"267'771","last_deep_scrub_stamp":"2024-09-12T19:23:24.838217+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.838217+0000","objects_scrubbed":10,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:30.026559+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88446,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1874,"num_read_kb":3148,"num_write":2424,"num_write_kb":2173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":501744,"num_omap_keys":1138,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.202330+0000","last_change":"2024-09-12T17:30:00.784218+0000","last_active":"2024-09-12T19:20:28.202330+0000","last_peered":"2024-09-12T19:20:28.202330+0000","last_clean":"2024-09-12T19:20:28.202330+0000","last_became_active":"2024-09-12T17:30:00.783385+0000","last_became_peered":"2024-09-12T17:30:00.783385+0000","last_unstale":"2024-09-12T19:20:28.202330+0000","last_undegraded":"2024-09-12T19:20:28.202330+0000","last_fullsized":"2024-09-12T19:20:28.202330+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:44.877583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'143","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:14.315826+0000","last_change":"2024-09-12T17:30:02.806515+0000","last_active":"2024-09-12T19:21:14.315826+0000","last_peered":"2024-09-12T19:21:14.315826+0000","last_clean":"2024-09-12T19:21:14.315826+0000","last_became_active":"2024-09-12T17:30:02.805684+0000","last_became_peered":"2024-09-12T17:30:02.805684+0000","last_unstale":"2024-09-12T19:21:14.315826+0000","last_undegraded":"2024-09-12T19:21:14.315826+0000","last_fullsized":"2024-09-12T19:21:14.315826+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:50.293983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":165,"num_read_kb":163,"num_write":341,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'407","reported_seq":1916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.843610+0000","last_change":"2024-09-12T19:23:23.843610+0000","last_active":"2024-09-12T19:23:23.843610+0000","last_peered":"2024-09-12T19:23:23.843610+0000","last_clean":"2024-09-12T19:23:23.843610+0000","last_became_active":"2024-09-12T17:29:54.758047+0000","last_became_peered":"2024-09-12T17:29:54.758047+0000","last_unstale":"2024-09-12T19:23:23.843610+0000","last_undegraded":"2024-09-12T19:23:23.843610+0000","last_fullsized":"2024-09-12T19:23:23.843610+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'407","last_scrub_stamp":"2024-09-12T19:23:23.843421+0000","last_deep_scrub":"267'407","last_deep_scrub_stamp":"2024-09-12T19:23:23.843421+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.843421+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:49.696068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2269,"num_read_kb":2144,"num_write":466,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1732,"num_omap_keys":7,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'307","reported_seq":1193,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.655275+0000","last_change":"2024-09-12T19:23:10.655275+0000","last_active":"2024-09-12T19:23:10.655275+0000","last_peered":"2024-09-12T19:23:10.655275+0000","last_clean":"2024-09-12T19:23:10.655275+0000","last_became_active":"2024-09-12T17:29:52.727635+0000","last_became_peered":"2024-09-12T17:29:52.727635+0000","last_unstale":"2024-09-12T19:23:10.655275+0000","last_undegraded":"2024-09-12T19:23:10.655275+0000","last_fullsized":"2024-09-12T19:23:10.655275+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'307","last_scrub_stamp":"2024-09-12T19:23:10.655045+0000","last_deep_scrub":"267'307","last_deep_scrub_stamp":"2024-09-12T19:23:10.655045+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.655045+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:43.716739+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109709,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":897,"num_read_kb":32569,"num_write":1024,"num_write_kb":39553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":558,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.972190+0000","last_change":"2024-09-12T19:23:11.972190+0000","last_active":"2024-09-12T19:23:11.972190+0000","last_peered":"2024-09-12T19:23:11.972190+0000","last_clean":"2024-09-12T19:23:11.972190+0000","last_became_active":"2024-09-12T17:29:35.406653+0000","last_became_peered":"2024-09-12T17:29:35.406653+0000","last_unstale":"2024-09-12T19:23:11.972190+0000","last_undegraded":"2024-09-12T19:23:11.972190+0000","last_fullsized":"2024-09-12T19:23:11.972190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:11.972019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:11.972019+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.972019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:02.613400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001315566,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.209747+0000","last_change":"2024-09-12T19:23:21.209747+0000","last_active":"2024-09-12T19:23:21.209747+0000","last_peered":"2024-09-12T19:23:21.209747+0000","last_clean":"2024-09-12T19:23:21.209747+0000","last_became_active":"2024-09-12T17:29:56.769576+0000","last_became_peered":"2024-09-12T17:29:56.769576+0000","last_unstale":"2024-09-12T19:23:21.209747+0000","last_undegraded":"2024-09-12T19:23:21.209747+0000","last_fullsized":"2024-09-12T19:23:21.209747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:21.209539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:21.209539+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.209539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:58.220864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'345","reported_seq":992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.684786+0000","last_change":"2024-09-12T19:23:26.684786+0000","last_active":"2024-09-12T19:23:26.684786+0000","last_peered":"2024-09-12T19:23:26.684786+0000","last_clean":"2024-09-12T19:23:26.684786+0000","last_became_active":"2024-09-12T17:29:58.830993+0000","last_became_peered":"2024-09-12T17:29:58.830993+0000","last_unstale":"2024-09-12T19:23:26.684786+0000","last_undegraded":"2024-09-12T19:23:26.684786+0000","last_fullsized":"2024-09-12T19:23:26.684786+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'345","last_scrub_stamp":"2024-09-12T19:23:26.684582+0000","last_deep_scrub":"267'345","last_deep_scrub_stamp":"2024-09-12T19:23:26.684582+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.684582+0000","objects_scrubbed":8,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:39.601631+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":439,"num_read_kb":430,"num_write":418,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'791","reported_seq":3373,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.882999+0000","last_change":"2024-09-12T17:30:00.805745+0000","last_active":"2024-09-12T19:22:58.882999+0000","last_peered":"2024-09-12T19:22:58.882999+0000","last_clean":"2024-09-12T19:22:58.882999+0000","last_became_active":"2024-09-12T17:30:00.805059+0000","last_became_peered":"2024-09-12T17:30:00.805059+0000","last_unstale":"2024-09-12T19:22:58.882999+0000","last_undegraded":"2024-09-12T19:22:58.882999+0000","last_fullsized":"2024-09-12T19:22:58.882999+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":701,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:20.515894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'134","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.261254+0000","last_change":"2024-09-12T17:30:02.805558+0000","last_active":"2024-09-12T19:22:46.261254+0000","last_peered":"2024-09-12T19:22:46.261254+0000","last_clean":"2024-09-12T19:22:46.261254+0000","last_became_active":"2024-09-12T17:30:02.803051+0000","last_became_peered":"2024-09-12T17:30:02.803051+0000","last_unstale":"2024-09-12T19:22:46.261254+0000","last_undegraded":"2024-09-12T19:22:46.261254+0000","last_fullsized":"2024-09-12T19:22:46.261254+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:30.608707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":726,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":188,"num_read_kb":177,"num_write":312,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'429","reported_seq":1977,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.137194+0000","last_change":"2024-09-12T19:23:20.137194+0000","last_active":"2024-09-12T19:23:20.137194+0000","last_peered":"2024-09-12T19:23:20.137194+0000","last_clean":"2024-09-12T19:23:20.137194+0000","last_became_active":"2024-09-12T17:29:54.762522+0000","last_became_peered":"2024-09-12T17:29:54.762522+0000","last_unstale":"2024-09-12T19:23:20.137194+0000","last_undegraded":"2024-09-12T19:23:20.137194+0000","last_fullsized":"2024-09-12T19:23:20.137194+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'429","last_scrub_stamp":"2024-09-12T19:23:20.136990+0000","last_deep_scrub":"267'429","last_deep_scrub_stamp":"2024-09-12T19:23:20.136990+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.136990+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:28.426663+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2273,"num_read_kb":2141,"num_write":510,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'293","reported_seq":929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.212947+0000","last_change":"2024-09-12T19:23:11.212947+0000","last_active":"2024-09-12T19:23:11.212947+0000","last_peered":"2024-09-12T19:23:11.212947+0000","last_clean":"2024-09-12T19:23:11.212947+0000","last_became_active":"2024-09-12T17:29:52.716210+0000","last_became_peered":"2024-09-12T17:29:52.716210+0000","last_unstale":"2024-09-12T19:23:11.212947+0000","last_undegraded":"2024-09-12T19:23:11.212947+0000","last_fullsized":"2024-09-12T19:23:11.212947+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'293","last_scrub_stamp":"2024-09-12T19:23:11.212651+0000","last_deep_scrub":"267'293","last_deep_scrub_stamp":"2024-09-12T19:23:11.212651+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.212651+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:55.274163+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":379,"num_read_kb":381,"num_write":923,"num_write_kb":30307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":560,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:06.731459+0000","last_change":"2024-09-12T19:23:06.731459+0000","last_active":"2024-09-12T19:23:06.731459+0000","last_peered":"2024-09-12T19:23:06.731459+0000","last_clean":"2024-09-12T19:23:06.731459+0000","last_became_active":"2024-09-12T17:29:35.337987+0000","last_became_peered":"2024-09-12T17:29:35.337987+0000","last_unstale":"2024-09-12T19:23:06.731459+0000","last_undegraded":"2024-09-12T19:23:06.731459+0000","last_fullsized":"2024-09-12T19:23:06.731459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:06.731386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:06.731386+0000","last_clean_scrub_stamp":"2024-09-12T19:23:06.731386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:59.862051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011496340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"38'3","reported_seq":1014,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.839940+0000","last_change":"2024-09-12T17:29:56.756687+0000","last_active":"2024-09-12T19:22:58.839940+0000","last_peered":"2024-09-12T19:22:58.839940+0000","last_clean":"2024-09-12T19:22:58.839940+0000","last_became_active":"2024-09-12T17:29:56.754415+0000","last_became_peered":"2024-09-12T17:29:56.754415+0000","last_unstale":"2024-09-12T19:22:58.839940+0000","last_undegraded":"2024-09-12T19:22:58.839940+0000","last_fullsized":"2024-09-12T19:22:58.839940+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:14.164674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'175","reported_seq":781,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:52.559741+0000","last_change":"2024-09-12T17:29:58.767652+0000","last_active":"2024-09-12T19:20:52.559741+0000","last_peered":"2024-09-12T19:20:52.559741+0000","last_clean":"2024-09-12T19:20:52.559741+0000","last_became_active":"2024-09-12T17:29:58.766420+0000","last_became_peered":"2024-09-12T17:29:58.766420+0000","last_unstale":"2024-09-12T19:20:52.559741+0000","last_undegraded":"2024-09-12T19:20:52.559741+0000","last_fullsized":"2024-09-12T19:20:52.559741+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:24.045295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":231,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'817","reported_seq":5004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.891453+0000","last_change":"2024-09-12T17:30:00.796740+0000","last_active":"2024-09-12T19:22:58.891453+0000","last_peered":"2024-09-12T19:22:58.891453+0000","last_clean":"2024-09-12T19:22:58.891453+0000","last_became_active":"2024-09-12T17:30:00.793234+0000","last_became_peered":"2024-09-12T17:30:00.793234+0000","last_unstale":"2024-09-12T19:22:58.891453+0000","last_undegraded":"2024-09-12T19:22:58.891453+0000","last_fullsized":"2024-09-12T19:22:58.891453+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:52.398488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'186","reported_seq":723,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:17.279016+0000","last_change":"2024-09-12T17:30:02.800748+0000","last_active":"2024-09-12T19:21:17.279016+0000","last_peered":"2024-09-12T19:21:17.279016+0000","last_clean":"2024-09-12T19:21:17.279016+0000","last_became_active":"2024-09-12T17:30:02.799944+0000","last_became_peered":"2024-09-12T17:30:02.799944+0000","last_unstale":"2024-09-12T19:21:17.279016+0000","last_undegraded":"2024-09-12T19:21:17.279016+0000","last_fullsized":"2024-09-12T19:21:17.279016+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:57:37.045857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":199,"num_read_kb":188,"num_write":423,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'1237","reported_seq":2862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.247365+0000","last_change":"2024-09-12T19:23:13.247365+0000","last_active":"2024-09-12T19:23:13.247365+0000","last_peered":"2024-09-12T19:23:13.247365+0000","last_clean":"2024-09-12T19:23:13.247365+0000","last_became_active":"2024-09-12T17:29:54.751931+0000","last_became_peered":"2024-09-12T17:29:54.751931+0000","last_unstale":"2024-09-12T19:23:13.247365+0000","last_undegraded":"2024-09-12T19:23:13.247365+0000","last_fullsized":"2024-09-12T19:23:13.247365+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1237","last_scrub_stamp":"2024-09-12T19:23:13.247189+0000","last_deep_scrub":"267'1237","last_deep_scrub_stamp":"2024-09-12T19:23:13.247189+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.247189+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":1200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:52.825946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5667,"num_read_kb":5016,"num_write":1745,"num_write_kb":765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'336","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:07.977004+0000","last_change":"2024-09-12T19:23:07.977004+0000","last_active":"2024-09-12T19:23:07.977004+0000","last_peered":"2024-09-12T19:23:07.977004+0000","last_clean":"2024-09-12T19:23:07.977004+0000","last_became_active":"2024-09-12T17:30:21.697470+0000","last_became_peered":"2024-09-12T17:30:21.697470+0000","last_unstale":"2024-09-12T19:23:07.977004+0000","last_undegraded":"2024-09-12T19:23:07.977004+0000","last_fullsized":"2024-09-12T19:23:07.977004+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-12T19:23:07.976758+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-12T19:23:07.976758+0000","last_clean_scrub_stamp":"2024-09-12T19:23:07.976758+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:24.268288+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":2583,"num_write":1054,"num_write_kb":28824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":560,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.146828+0000","last_change":"2024-09-12T19:23:09.146828+0000","last_active":"2024-09-12T19:23:09.146828+0000","last_peered":"2024-09-12T19:23:09.146828+0000","last_clean":"2024-09-12T19:23:09.146828+0000","last_became_active":"2024-09-12T17:29:35.337998+0000","last_became_peered":"2024-09-12T17:29:35.337998+0000","last_unstale":"2024-09-12T19:23:09.146828+0000","last_undegraded":"2024-09-12T19:23:09.146828+0000","last_fullsized":"2024-09-12T19:23:09.146828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:09.146655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:09.146655+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.146655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:56.445997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011850280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:23.262198+0000","last_change":"2024-09-12T17:29:56.761573+0000","last_active":"2024-09-12T19:20:23.262198+0000","last_peered":"2024-09-12T19:20:23.262198+0000","last_clean":"2024-09-12T19:20:23.262198+0000","last_became_active":"2024-09-12T17:29:56.760822+0000","last_became_peered":"2024-09-12T17:29:56.760822+0000","last_unstale":"2024-09-12T19:20:23.262198+0000","last_undegraded":"2024-09-12T19:20:23.262198+0000","last_fullsized":"2024-09-12T19:20:23.262198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:48.200758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'808","reported_seq":1589,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.852202+0000","last_change":"2024-09-12T17:29:58.831322+0000","last_active":"2024-09-12T19:23:01.852202+0000","last_peered":"2024-09-12T19:23:01.852202+0000","last_clean":"2024-09-12T19:23:01.852202+0000","last_became_active":"2024-09-12T17:29:58.830605+0000","last_became_peered":"2024-09-12T17:29:58.830605+0000","last_unstale":"2024-09-12T19:23:01.852202+0000","last_undegraded":"2024-09-12T19:23:01.852202+0000","last_fullsized":"2024-09-12T19:23:01.852202+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:34.715340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138319,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1432,"num_read_kb":3265,"num_write":1150,"num_write_kb":898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.263615+0000","last_change":"2024-09-12T17:30:00.810969+0000","last_active":"2024-09-12T19:20:28.263615+0000","last_peered":"2024-09-12T19:20:28.263615+0000","last_clean":"2024-09-12T19:20:28.263615+0000","last_became_active":"2024-09-12T17:30:00.810341+0000","last_became_peered":"2024-09-12T17:30:00.810341+0000","last_unstale":"2024-09-12T19:20:28.263615+0000","last_undegraded":"2024-09-12T19:20:28.263615+0000","last_fullsized":"2024-09-12T19:20:28.263615+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:02.611552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'162","reported_seq":718,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:17.990022+0000","last_change":"2024-09-12T17:30:02.787340+0000","last_active":"2024-09-12T19:20:17.990022+0000","last_peered":"2024-09-12T19:20:17.990022+0000","last_clean":"2024-09-12T19:20:17.990022+0000","last_became_active":"2024-09-12T17:30:02.786443+0000","last_became_peered":"2024-09-12T17:30:02.786443+0000","last_unstale":"2024-09-12T19:20:17.990022+0000","last_undegraded":"2024-09-12T19:20:17.990022+0000","last_fullsized":"2024-09-12T19:20:17.990022+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:16.833731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":311,"num_read_kb":271,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'112","reported_seq":698,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.907333+0000","last_change":"2024-09-12T17:30:02.805626+0000","last_active":"2024-09-12T19:21:21.907333+0000","last_peered":"2024-09-12T19:21:21.907333+0000","last_clean":"2024-09-12T19:21:21.907333+0000","last_became_active":"2024-09-12T17:30:02.801038+0000","last_became_peered":"2024-09-12T17:30:02.801038+0000","last_unstale":"2024-09-12T19:21:21.907333+0000","last_undegraded":"2024-09-12T19:21:21.907333+0000","last_fullsized":"2024-09-12T19:21:21.907333+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:20.200364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":212,"num_write":265,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'456","reported_seq":2047,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.222255+0000","last_change":"2024-09-12T19:23:18.222255+0000","last_active":"2024-09-12T19:23:18.222255+0000","last_peered":"2024-09-12T19:23:18.222255+0000","last_clean":"2024-09-12T19:23:18.222255+0000","last_became_active":"2024-09-12T17:29:54.760809+0000","last_became_peered":"2024-09-12T17:29:54.760809+0000","last_unstale":"2024-09-12T19:23:18.222255+0000","last_undegraded":"2024-09-12T19:23:18.222255+0000","last_fullsized":"2024-09-12T19:23:18.222255+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'456","last_scrub_stamp":"2024-09-12T19:23:18.222068+0000","last_deep_scrub":"267'456","last_deep_scrub_stamp":"2024-09-12T19:23:18.222068+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.222068+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:12.516436+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2369,"num_read_kb":2229,"num_write":528,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'332","reported_seq":1042,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.234197+0000","last_change":"2024-09-12T19:23:10.234197+0000","last_active":"2024-09-12T19:23:10.234197+0000","last_peered":"2024-09-12T19:23:10.234197+0000","last_clean":"2024-09-12T19:23:10.234197+0000","last_became_active":"2024-09-12T17:29:52.760432+0000","last_became_peered":"2024-09-12T17:29:52.760432+0000","last_unstale":"2024-09-12T19:23:10.234197+0000","last_undegraded":"2024-09-12T19:23:10.234197+0000","last_fullsized":"2024-09-12T19:23:10.234197+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'332","last_scrub_stamp":"2024-09-12T19:23:10.233909+0000","last_deep_scrub":"267'332","last_deep_scrub_stamp":"2024-09-12T19:23:10.233909+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.233909+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:23.059087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":31499,"num_write":1138,"num_write_kb":37455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.648629+0000","last_change":"2024-09-12T19:23:24.648629+0000","last_active":"2024-09-12T19:23:24.648629+0000","last_peered":"2024-09-12T19:23:24.648629+0000","last_clean":"2024-09-12T19:23:24.648629+0000","last_became_active":"2024-09-12T17:29:56.765656+0000","last_became_peered":"2024-09-12T17:29:56.765656+0000","last_unstale":"2024-09-12T19:23:24.648629+0000","last_undegraded":"2024-09-12T19:23:24.648629+0000","last_fullsized":"2024-09-12T19:23:24.648629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:24.648446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:24.648446+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.648446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:56.698094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'312","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.391857+0000","last_change":"2024-09-12T17:29:58.778689+0000","last_active":"2024-09-12T19:22:59.391857+0000","last_peered":"2024-09-12T19:22:59.391857+0000","last_clean":"2024-09-12T19:22:59.391857+0000","last_became_active":"2024-09-12T17:29:58.777997+0000","last_became_peered":"2024-09-12T17:29:58.777997+0000","last_unstale":"2024-09-12T19:22:59.391857+0000","last_undegraded":"2024-09-12T19:22:59.391857+0000","last_fullsized":"2024-09-12T19:22:59.391857+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:11.474675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47243,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":493,"num_read_kb":996,"num_write":376,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:43.251258+0000","last_change":"2024-09-12T17:30:00.794010+0000","last_active":"2024-09-12T19:19:43.251258+0000","last_peered":"2024-09-12T19:19:43.251258+0000","last_clean":"2024-09-12T19:19:43.251258+0000","last_became_active":"2024-09-12T17:30:00.793204+0000","last_became_peered":"2024-09-12T17:30:00.793204+0000","last_unstale":"2024-09-12T19:19:43.251258+0000","last_undegraded":"2024-09-12T19:19:43.251258+0000","last_fullsized":"2024-09-12T19:19:43.251258+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:53.881334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'108","reported_seq":638,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.263789+0000","last_change":"2024-09-12T17:30:02.790200+0000","last_active":"2024-09-12T19:20:28.263789+0000","last_peered":"2024-09-12T19:20:28.263789+0000","last_clean":"2024-09-12T19:20:28.263789+0000","last_became_active":"2024-09-12T17:30:02.789511+0000","last_became_peered":"2024-09-12T17:30:02.789511+0000","last_unstale":"2024-09-12T19:20:28.263789+0000","last_undegraded":"2024-09-12T19:20:28.263789+0000","last_fullsized":"2024-09-12T19:20:28.263789+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:57.833180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":267,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'1081","reported_seq":2637,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.697979+0000","last_change":"2024-09-12T19:23:16.697979+0000","last_active":"2024-09-12T19:23:16.697979+0000","last_peered":"2024-09-12T19:23:16.697979+0000","last_clean":"2024-09-12T19:23:16.697979+0000","last_became_active":"2024-09-12T17:29:54.774337+0000","last_became_peered":"2024-09-12T17:29:54.774337+0000","last_unstale":"2024-09-12T19:23:16.697979+0000","last_undegraded":"2024-09-12T19:23:16.697979+0000","last_fullsized":"2024-09-12T19:23:16.697979+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1081","last_scrub_stamp":"2024-09-12T19:23:16.697790+0000","last_deep_scrub":"267'1081","last_deep_scrub_stamp":"2024-09-12T19:23:16.697790+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.697790+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":1000,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:19.478713+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5006,"num_read_kb":4447,"num_write":1496,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'343","reported_seq":1047,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.093187+0000","last_change":"2024-09-12T19:23:17.093038+0000","last_active":"2024-09-12T19:23:17.093187+0000","last_peered":"2024-09-12T19:23:17.093187+0000","last_clean":"2024-09-12T19:23:17.093187+0000","last_became_active":"2024-09-12T17:29:52.757775+0000","last_became_peered":"2024-09-12T17:29:52.757775+0000","last_unstale":"2024-09-12T19:23:17.093187+0000","last_undegraded":"2024-09-12T19:23:17.093187+0000","last_fullsized":"2024-09-12T19:23:17.093187+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'343","last_scrub_stamp":"2024-09-12T19:23:17.092815+0000","last_deep_scrub":"267'343","last_deep_scrub_stamp":"2024-09-12T19:23:17.092815+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.092815+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:09.547140+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399166,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":510,"num_read_kb":111933,"num_write":1035,"num_write_kb":43950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:38.250268+0000","last_change":"2024-09-12T17:29:56.771395+0000","last_active":"2024-09-12T19:19:38.250268+0000","last_peered":"2024-09-12T19:19:38.250268+0000","last_clean":"2024-09-12T19:19:38.250268+0000","last_became_active":"2024-09-12T17:29:56.770639+0000","last_became_peered":"2024-09-12T17:29:56.770639+0000","last_unstale":"2024-09-12T19:19:38.250268+0000","last_undegraded":"2024-09-12T19:19:38.250268+0000","last_fullsized":"2024-09-12T19:19:38.250268+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:05.853569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'78","reported_seq":622,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:41.373097+0000","last_change":"2024-09-12T17:29:58.782766+0000","last_active":"2024-09-12T19:20:41.373097+0000","last_peered":"2024-09-12T19:20:41.373097+0000","last_clean":"2024-09-12T19:20:41.373097+0000","last_became_active":"2024-09-12T17:29:58.781731+0000","last_became_peered":"2024-09-12T17:29:58.781731+0000","last_unstale":"2024-09-12T19:20:41.373097+0000","last_undegraded":"2024-09-12T19:20:41.373097+0000","last_fullsized":"2024-09-12T19:20:41.373097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:49.979279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":73,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":509,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:42.963782+0000","last_change":"2024-09-12T17:30:00.801153+0000","last_active":"2024-09-12T19:19:42.963782+0000","last_peered":"2024-09-12T19:19:42.963782+0000","last_clean":"2024-09-12T19:19:42.963782+0000","last_became_active":"2024-09-12T17:30:00.799588+0000","last_became_peered":"2024-09-12T17:30:00.799588+0000","last_unstale":"2024-09-12T19:19:42.963782+0000","last_undegraded":"2024-09-12T19:19:42.963782+0000","last_fullsized":"2024-09-12T19:19:42.963782+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:18.930813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'191","reported_seq":733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.175915+0000","last_change":"2024-09-12T17:30:02.814008+0000","last_active":"2024-09-12T19:21:19.175915+0000","last_peered":"2024-09-12T19:21:19.175915+0000","last_clean":"2024-09-12T19:21:19.175915+0000","last_became_active":"2024-09-12T17:30:02.813284+0000","last_became_peered":"2024-09-12T17:30:02.813284+0000","last_unstale":"2024-09-12T19:21:19.175915+0000","last_undegraded":"2024-09-12T19:21:19.175915+0000","last_fullsized":"2024-09-12T19:21:19.175915+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:56.023655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":312,"num_read_kb":310,"num_write":442,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'826","reported_seq":2446,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.189050+0000","last_change":"2024-09-12T19:23:22.189050+0000","last_active":"2024-09-12T19:23:22.189050+0000","last_peered":"2024-09-12T19:23:22.189050+0000","last_clean":"2024-09-12T19:23:22.189050+0000","last_became_active":"2024-09-12T17:29:54.762793+0000","last_became_peered":"2024-09-12T17:29:54.762793+0000","last_unstale":"2024-09-12T19:23:22.189050+0000","last_undegraded":"2024-09-12T19:23:22.189050+0000","last_fullsized":"2024-09-12T19:23:22.189050+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'826","last_scrub_stamp":"2024-09-12T19:23:22.188867+0000","last_deep_scrub":"267'826","last_deep_scrub_stamp":"2024-09-12T19:23:22.188867+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.188867+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:07.821462+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3973,"num_read_kb":3581,"num_write":1093,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'357","reported_seq":988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.011911+0000","last_change":"2024-09-12T19:23:13.011911+0000","last_active":"2024-09-12T19:23:13.011911+0000","last_peered":"2024-09-12T19:23:13.011911+0000","last_clean":"2024-09-12T19:23:13.011911+0000","last_became_active":"2024-09-12T17:30:21.692338+0000","last_became_peered":"2024-09-12T17:30:21.692338+0000","last_unstale":"2024-09-12T19:23:13.011911+0000","last_undegraded":"2024-09-12T19:23:13.011911+0000","last_fullsized":"2024-09-12T19:23:13.011911+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'357","last_scrub_stamp":"2024-09-12T19:23:13.011577+0000","last_deep_scrub":"267'357","last_deep_scrub_stamp":"2024-09-12T19:23:13.011577+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.011577+0000","objects_scrubbed":10,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:00.683791+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2254600,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":475,"num_read_kb":2106,"num_write":1042,"num_write_kb":33078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.100650+0000","last_change":"2024-09-12T19:23:27.100650+0000","last_active":"2024-09-12T19:23:27.100650+0000","last_peered":"2024-09-12T19:23:27.100650+0000","last_clean":"2024-09-12T19:23:27.100650+0000","last_became_active":"2024-09-12T17:29:56.771923+0000","last_became_peered":"2024-09-12T17:29:56.771923+0000","last_unstale":"2024-09-12T19:23:27.100650+0000","last_undegraded":"2024-09-12T19:23:27.100650+0000","last_fullsized":"2024-09-12T19:23:27.100650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:27.100463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:27.100463+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.100463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:27.173988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'353","reported_seq":1002,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.470731+0000","last_change":"2024-09-12T17:29:58.782391+0000","last_active":"2024-09-12T19:23:01.470731+0000","last_peered":"2024-09-12T19:23:01.470731+0000","last_clean":"2024-09-12T19:23:01.470731+0000","last_became_active":"2024-09-12T17:29:58.781756+0000","last_became_peered":"2024-09-12T17:29:58.781756+0000","last_unstale":"2024-09-12T19:23:01.470731+0000","last_undegraded":"2024-09-12T19:23:01.470731+0000","last_fullsized":"2024-09-12T19:23:01.470731+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:18.104306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44606,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":574,"num_read_kb":1122,"num_write":442,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.263372+0000","last_change":"2024-09-12T19:23:27.263372+0000","last_active":"2024-09-12T19:23:27.263372+0000","last_peered":"2024-09-12T19:23:27.263372+0000","last_clean":"2024-09-12T19:23:27.263372+0000","last_became_active":"2024-09-12T17:30:00.787872+0000","last_became_peered":"2024-09-12T17:30:00.787872+0000","last_unstale":"2024-09-12T19:23:27.263372+0000","last_undegraded":"2024-09-12T19:23:27.263372+0000","last_fullsized":"2024-09-12T19:23:27.263372+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:27.263189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:27.263189+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.263189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:00.496808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'137","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.416574+0000","last_change":"2024-09-12T17:30:02.790977+0000","last_active":"2024-09-12T19:21:21.416574+0000","last_peered":"2024-09-12T19:21:21.416574+0000","last_clean":"2024-09-12T19:21:21.416574+0000","last_became_active":"2024-09-12T17:30:02.790246+0000","last_became_peered":"2024-09-12T17:30:02.790246+0000","last_unstale":"2024-09-12T19:21:21.416574+0000","last_undegraded":"2024-09-12T19:21:21.416574+0000","last_fullsized":"2024-09-12T19:21:21.416574+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:27.228227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":190,"num_write":334,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'498","reported_seq":2176,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.155966+0000","last_change":"2024-09-12T19:23:21.155966+0000","last_active":"2024-09-12T19:23:21.155966+0000","last_peered":"2024-09-12T19:23:21.155966+0000","last_clean":"2024-09-12T19:23:21.155966+0000","last_became_active":"2024-09-12T17:30:22.255871+0000","last_became_peered":"2024-09-12T17:30:22.255871+0000","last_unstale":"2024-09-12T19:23:21.155966+0000","last_undegraded":"2024-09-12T19:23:21.155966+0000","last_fullsized":"2024-09-12T19:23:21.155966+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'498","last_scrub_stamp":"2024-09-12T19:23:21.155552+0000","last_deep_scrub":"267'498","last_deep_scrub_stamp":"2024-09-12T19:23:21.155552+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.155552+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:38.758690+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2849,"num_read_kb":2646,"num_write":616,"num_write_kb":185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4203,"num_omap_keys":17,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'330","reported_seq":1080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:06.908774+0000","last_change":"2024-09-12T19:23:06.908628+0000","last_active":"2024-09-12T19:23:06.908774+0000","last_peered":"2024-09-12T19:23:06.908774+0000","last_clean":"2024-09-12T19:23:06.908774+0000","last_became_active":"2024-09-12T17:29:52.725672+0000","last_became_peered":"2024-09-12T17:29:52.725672+0000","last_unstale":"2024-09-12T19:23:06.908774+0000","last_undegraded":"2024-09-12T19:23:06.908774+0000","last_fullsized":"2024-09-12T19:23:06.908774+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'330","last_scrub_stamp":"2024-09-12T19:23:06.908405+0000","last_deep_scrub":"267'330","last_deep_scrub_stamp":"2024-09-12T19:23:06.908405+0000","last_clean_scrub_stamp":"2024-09-12T19:23:06.908405+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:18.850583+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524466,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":607,"num_read_kb":120165,"num_write":1109,"num_write_kb":47030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.221546+0000","last_change":"2024-09-12T19:23:22.221546+0000","last_active":"2024-09-12T19:23:22.221546+0000","last_peered":"2024-09-12T19:23:22.221546+0000","last_clean":"2024-09-12T19:23:22.221546+0000","last_became_active":"2024-09-12T17:29:56.761442+0000","last_became_peered":"2024-09-12T17:29:56.761442+0000","last_unstale":"2024-09-12T19:23:22.221546+0000","last_undegraded":"2024-09-12T19:23:22.221546+0000","last_fullsized":"2024-09-12T19:23:22.221546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:22.221361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:22.221361+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.221361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:34.450653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'324","reported_seq":935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.271936+0000","last_change":"2024-09-12T17:29:58.758717+0000","last_active":"2024-09-12T19:23:01.271936+0000","last_peered":"2024-09-12T19:23:01.271936+0000","last_clean":"2024-09-12T19:23:01.271936+0000","last_became_active":"2024-09-12T17:29:58.758050+0000","last_became_peered":"2024-09-12T17:29:58.758050+0000","last_unstale":"2024-09-12T19:23:01.271936+0000","last_undegraded":"2024-09-12T19:23:01.271936+0000","last_fullsized":"2024-09-12T19:23:01.271936+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:17.764686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47374,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":545,"num_read_kb":1211,"num_write":440,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:43.181010+0000","last_change":"2024-09-12T17:30:00.780831+0000","last_active":"2024-09-12T19:19:43.181010+0000","last_peered":"2024-09-12T19:19:43.181010+0000","last_clean":"2024-09-12T19:19:43.181010+0000","last_became_active":"2024-09-12T17:30:00.780216+0000","last_became_peered":"2024-09-12T17:30:00.780216+0000","last_unstale":"2024-09-12T19:19:43.181010+0000","last_undegraded":"2024-09-12T19:19:43.181010+0000","last_fullsized":"2024-09-12T19:19:43.181010+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:54.040743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'415","reported_seq":1862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.193904+0000","last_change":"2024-09-12T19:23:18.193904+0000","last_active":"2024-09-12T19:23:18.193904+0000","last_peered":"2024-09-12T19:23:18.193904+0000","last_clean":"2024-09-12T19:23:18.193904+0000","last_became_active":"2024-09-12T17:29:54.776503+0000","last_became_peered":"2024-09-12T17:29:54.776503+0000","last_unstale":"2024-09-12T19:23:18.193904+0000","last_undegraded":"2024-09-12T19:23:18.193904+0000","last_fullsized":"2024-09-12T19:23:18.193904+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'415","last_scrub_stamp":"2024-09-12T19:23:18.193704+0000","last_deep_scrub":"267'415","last_deep_scrub_stamp":"2024-09-12T19:23:18.193704+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.193704+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:23.257855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2157,"num_read_kb":2011,"num_write":494,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'346","reported_seq":1057,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.194650+0000","last_change":"2024-09-12T19:23:13.194506+0000","last_active":"2024-09-12T19:23:13.194650+0000","last_peered":"2024-09-12T19:23:13.194650+0000","last_clean":"2024-09-12T19:23:13.194650+0000","last_became_active":"2024-09-12T17:29:52.716376+0000","last_became_peered":"2024-09-12T17:29:52.716376+0000","last_unstale":"2024-09-12T19:23:13.194650+0000","last_undegraded":"2024-09-12T19:23:13.194650+0000","last_fullsized":"2024-09-12T19:23:13.194650+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-09-12T19:23:13.194237+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-09-12T19:23:13.194237+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.194237+0000","objects_scrubbed":9,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:44.170037+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730157,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":576,"num_read_kb":2668,"num_write":1130,"num_write_kb":45238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.853164+0000","last_change":"2024-09-12T19:23:22.853164+0000","last_active":"2024-09-12T19:23:22.853164+0000","last_peered":"2024-09-12T19:23:22.853164+0000","last_clean":"2024-09-12T19:23:22.853164+0000","last_became_active":"2024-09-12T17:29:56.773239+0000","last_became_peered":"2024-09-12T17:29:56.773239+0000","last_unstale":"2024-09-12T19:23:22.853164+0000","last_undegraded":"2024-09-12T19:23:22.853164+0000","last_fullsized":"2024-09-12T19:23:22.853164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:22.852967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:22.852967+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.852967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:06.983644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'553","reported_seq":1227,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.189986+0000","last_change":"2024-09-12T17:29:58.779631+0000","last_active":"2024-09-12T19:23:01.189986+0000","last_peered":"2024-09-12T19:23:01.189986+0000","last_clean":"2024-09-12T19:23:01.189986+0000","last_became_active":"2024-09-12T17:29:58.778931+0000","last_became_peered":"2024-09-12T17:29:58.778931+0000","last_unstale":"2024-09-12T19:23:01.189986+0000","last_undegraded":"2024-09-12T19:23:01.189986+0000","last_fullsized":"2024-09-12T19:23:01.189986+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:14.544244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":998,"num_read_kb":2327,"num_write":858,"num_write_kb":737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.986697+0000","last_change":"2024-09-12T17:30:00.802806+0000","last_active":"2024-09-12T19:20:02.986697+0000","last_peered":"2024-09-12T19:20:02.986697+0000","last_clean":"2024-09-12T19:20:02.986697+0000","last_became_active":"2024-09-12T17:30:00.802021+0000","last_became_peered":"2024-09-12T17:30:00.802021+0000","last_unstale":"2024-09-12T19:20:02.986697+0000","last_undegraded":"2024-09-12T19:20:02.986697+0000","last_fullsized":"2024-09-12T19:20:02.986697+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:49.504684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'167","reported_seq":710,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:43.251407+0000","last_change":"2024-09-12T17:30:02.795603+0000","last_active":"2024-09-12T19:19:43.251407+0000","last_peered":"2024-09-12T19:19:43.251407+0000","last_clean":"2024-09-12T19:19:43.251407+0000","last_became_active":"2024-09-12T17:30:02.794353+0000","last_became_peered":"2024-09-12T17:30:02.794353+0000","last_unstale":"2024-09-12T19:19:43.251407+0000","last_undegraded":"2024-09-12T19:19:43.251407+0000","last_fullsized":"2024-09-12T19:19:43.251407+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:41.683296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":277,"num_read_kb":276,"num_write":376,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'726","reported_seq":2327,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.864092+0000","last_change":"2024-09-12T19:23:19.864092+0000","last_active":"2024-09-12T19:23:19.864092+0000","last_peered":"2024-09-12T19:23:19.864092+0000","last_clean":"2024-09-12T19:23:19.864092+0000","last_became_active":"2024-09-12T17:29:54.761144+0000","last_became_peered":"2024-09-12T17:29:54.761144+0000","last_unstale":"2024-09-12T19:23:19.864092+0000","last_undegraded":"2024-09-12T19:23:19.864092+0000","last_fullsized":"2024-09-12T19:23:19.864092+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'726","last_scrub_stamp":"2024-09-12T19:23:19.863911+0000","last_deep_scrub":"267'726","last_deep_scrub_stamp":"2024-09-12T19:23:19.863911+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.863911+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":700,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:39.862307+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3459,"num_read_kb":3076,"num_write":1006,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":514,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'309","reported_seq":935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.681650+0000","last_change":"2024-09-12T19:23:13.681650+0000","last_active":"2024-09-12T19:23:13.681650+0000","last_peered":"2024-09-12T19:23:13.681650+0000","last_clean":"2024-09-12T19:23:13.681650+0000","last_became_active":"2024-09-12T17:29:52.741594+0000","last_became_peered":"2024-09-12T17:29:52.741594+0000","last_unstale":"2024-09-12T19:23:13.681650+0000","last_undegraded":"2024-09-12T19:23:13.681650+0000","last_fullsized":"2024-09-12T19:23:13.681650+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'309","last_scrub_stamp":"2024-09-12T19:23:13.681397+0000","last_deep_scrub":"267'309","last_deep_scrub_stamp":"2024-09-12T19:23:13.681397+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.681397+0000","objects_scrubbed":9,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:35.606108+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262349,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":376,"num_read_kb":5602,"num_write":913,"num_write_kb":46297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.265670+0000","last_change":"2024-09-12T19:23:23.265670+0000","last_active":"2024-09-12T19:23:23.265670+0000","last_peered":"2024-09-12T19:23:23.265670+0000","last_clean":"2024-09-12T19:23:23.265670+0000","last_became_active":"2024-09-12T17:29:56.761256+0000","last_became_peered":"2024-09-12T17:29:56.761256+0000","last_unstale":"2024-09-12T19:23:23.265670+0000","last_undegraded":"2024-09-12T19:23:23.265670+0000","last_fullsized":"2024-09-12T19:23:23.265670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:23.265379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:23.265379+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.265379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:33:19.790842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'389","reported_seq":1033,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.339586+0000","last_change":"2024-09-12T17:29:58.769030+0000","last_active":"2024-09-12T19:23:01.339586+0000","last_peered":"2024-09-12T19:23:01.339586+0000","last_clean":"2024-09-12T19:23:01.339586+0000","last_became_active":"2024-09-12T17:29:58.768310+0000","last_became_peered":"2024-09-12T17:29:58.768310+0000","last_unstale":"2024-09-12T19:23:01.339586+0000","last_undegraded":"2024-09-12T19:23:01.339586+0000","last_fullsized":"2024-09-12T19:23:01.339586+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:31.668084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51217,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":641,"num_read_kb":1226,"num_write":524,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":510,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.979690+0000","last_change":"2024-09-12T17:30:00.805417+0000","last_active":"2024-09-12T19:20:02.979690+0000","last_peered":"2024-09-12T19:20:02.979690+0000","last_clean":"2024-09-12T19:20:02.979690+0000","last_became_active":"2024-09-12T17:30:00.804655+0000","last_became_peered":"2024-09-12T17:30:00.804655+0000","last_unstale":"2024-09-12T19:20:02.979690+0000","last_undegraded":"2024-09-12T19:20:02.979690+0000","last_fullsized":"2024-09-12T19:20:02.979690+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:59.390183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'189","reported_seq":1089,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:21.747208+0000","last_change":"2024-09-12T17:30:02.815235+0000","last_active":"2024-09-12T19:21:21.747208+0000","last_peered":"2024-09-12T19:21:21.747208+0000","last_clean":"2024-09-12T19:21:21.747208+0000","last_became_active":"2024-09-12T17:30:02.813027+0000","last_became_peered":"2024-09-12T17:30:02.813027+0000","last_unstale":"2024-09-12T19:21:21.747208+0000","last_undegraded":"2024-09-12T19:21:21.747208+0000","last_fullsized":"2024-09-12T19:21:21.747208+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:45.419844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2050,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":664,"num_read_kb":654,"num_write":538,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'392","reported_seq":1808,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.211401+0000","last_change":"2024-09-12T19:23:26.211401+0000","last_active":"2024-09-12T19:23:26.211401+0000","last_peered":"2024-09-12T19:23:26.211401+0000","last_clean":"2024-09-12T19:23:26.211401+0000","last_became_active":"2024-09-12T17:29:54.756800+0000","last_became_peered":"2024-09-12T17:29:54.756800+0000","last_unstale":"2024-09-12T19:23:26.211401+0000","last_undegraded":"2024-09-12T19:23:26.211401+0000","last_fullsized":"2024-09-12T19:23:26.211401+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'392","last_scrub_stamp":"2024-09-12T19:23:26.211201+0000","last_deep_scrub":"267'392","last_deep_scrub_stamp":"2024-09-12T19:23:26.211201+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.211201+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:17.864703+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1992,"num_read_kb":1877,"num_write":455,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'311","reported_seq":994,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.267339+0000","last_change":"2024-09-12T19:23:11.267339+0000","last_active":"2024-09-12T19:23:11.267339+0000","last_peered":"2024-09-12T19:23:11.267339+0000","last_clean":"2024-09-12T19:23:11.267339+0000","last_became_active":"2024-09-12T17:29:52.755401+0000","last_became_peered":"2024-09-12T17:29:52.755401+0000","last_unstale":"2024-09-12T19:23:11.267339+0000","last_undegraded":"2024-09-12T19:23:11.267339+0000","last_fullsized":"2024-09-12T19:23:11.267339+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-09-12T19:23:11.267078+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-09-12T19:23:11.267078+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.267078+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:12.277344+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2036176,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":3663,"num_write":1039,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.195101+0000","last_change":"2024-09-12T17:29:56.759557+0000","last_active":"2024-09-12T19:19:58.195101+0000","last_peered":"2024-09-12T19:19:58.195101+0000","last_clean":"2024-09-12T19:19:58.195101+0000","last_became_active":"2024-09-12T17:29:56.752172+0000","last_became_peered":"2024-09-12T17:29:56.752172+0000","last_unstale":"2024-09-12T19:19:58.195101+0000","last_undegraded":"2024-09-12T19:19:58.195101+0000","last_fullsized":"2024-09-12T19:19:58.195101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:01.184376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'330","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.766853+0000","last_change":"2024-09-12T17:29:58.832518+0000","last_active":"2024-09-12T19:22:59.766853+0000","last_peered":"2024-09-12T19:22:59.766853+0000","last_clean":"2024-09-12T19:22:59.766853+0000","last_became_active":"2024-09-12T17:29:58.831574+0000","last_became_peered":"2024-09-12T17:29:58.831574+0000","last_unstale":"2024-09-12T19:22:59.766853+0000","last_undegraded":"2024-09-12T19:22:59.766853+0000","last_fullsized":"2024-09-12T19:22:59.766853+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:45.202085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49155,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":530,"num_read_kb":1074,"num_write":414,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:32.986123+0000","last_change":"2024-09-12T17:30:00.805560+0000","last_active":"2024-09-12T19:20:32.986123+0000","last_peered":"2024-09-12T19:20:32.986123+0000","last_clean":"2024-09-12T19:20:32.986123+0000","last_became_active":"2024-09-12T17:30:00.804705+0000","last_became_peered":"2024-09-12T17:30:00.804705+0000","last_unstale":"2024-09-12T19:20:32.986123+0000","last_undegraded":"2024-09-12T19:20:32.986123+0000","last_fullsized":"2024-09-12T19:20:32.986123+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:30.654520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'113","reported_seq":624,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.252350+0000","last_change":"2024-09-12T17:30:02.787761+0000","last_active":"2024-09-12T19:22:46.252350+0000","last_peered":"2024-09-12T19:22:46.252350+0000","last_clean":"2024-09-12T19:22:46.252350+0000","last_became_active":"2024-09-12T17:30:02.787038+0000","last_became_peered":"2024-09-12T17:30:02.787038+0000","last_unstale":"2024-09-12T19:22:46.252350+0000","last_undegraded":"2024-09-12T19:22:46.252350+0000","last_fullsized":"2024-09-12T19:22:46.252350+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:46.467512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":121,"num_write":252,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'361","reported_seq":1899,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.987483+0000","last_change":"2024-09-12T19:23:14.987483+0000","last_active":"2024-09-12T19:23:14.987483+0000","last_peered":"2024-09-12T19:23:14.987483+0000","last_clean":"2024-09-12T19:23:14.987483+0000","last_became_active":"2024-09-12T17:29:54.741486+0000","last_became_peered":"2024-09-12T17:29:54.741486+0000","last_unstale":"2024-09-12T19:23:14.987483+0000","last_undegraded":"2024-09-12T19:23:14.987483+0000","last_fullsized":"2024-09-12T19:23:14.987483+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'361","last_scrub_stamp":"2024-09-12T19:23:14.987293+0000","last_deep_scrub":"267'361","last_deep_scrub_stamp":"2024-09-12T19:23:14.987293+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.987293+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:37.939163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1958,"num_read_kb":1901,"num_write":388,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'318","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.907394+0000","last_change":"2024-09-12T19:23:12.907394+0000","last_active":"2024-09-12T19:23:12.907394+0000","last_peered":"2024-09-12T19:23:12.907394+0000","last_clean":"2024-09-12T19:23:12.907394+0000","last_became_active":"2024-09-12T17:29:52.766141+0000","last_became_peered":"2024-09-12T17:29:52.766141+0000","last_unstale":"2024-09-12T19:23:12.907394+0000","last_undegraded":"2024-09-12T19:23:12.907394+0000","last_fullsized":"2024-09-12T19:23:12.907394+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'318","last_scrub_stamp":"2024-09-12T19:23:12.907122+0000","last_deep_scrub":"267'318","last_deep_scrub_stamp":"2024-09-12T19:23:12.907122+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.907122+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:49.071217+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7320708,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":562,"num_read_kb":101880,"num_write":1008,"num_write_kb":18651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"267'6","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.726938+0000","last_change":"2024-09-12T19:23:27.726938+0000","last_active":"2024-09-12T19:23:27.726938+0000","last_peered":"2024-09-12T19:23:27.726938+0000","last_clean":"2024-09-12T19:23:27.726938+0000","last_became_active":"2024-09-12T17:29:56.760505+0000","last_became_peered":"2024-09-12T17:29:56.760505+0000","last_unstale":"2024-09-12T19:23:27.726938+0000","last_undegraded":"2024-09-12T19:23:27.726938+0000","last_fullsized":"2024-09-12T19:23:27.726938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T19:23:27.726750+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T19:23:27.726750+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.726750+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:36.263576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'170","reported_seq":762,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:53.697797+0000","last_change":"2024-09-12T17:29:58.830103+0000","last_active":"2024-09-12T19:20:53.697797+0000","last_peered":"2024-09-12T19:20:53.697797+0000","last_clean":"2024-09-12T19:20:53.697797+0000","last_became_active":"2024-09-12T17:29:58.829023+0000","last_became_peered":"2024-09-12T17:29:58.829023+0000","last_unstale":"2024-09-12T19:20:53.697797+0000","last_undegraded":"2024-09-12T19:20:53.697797+0000","last_fullsized":"2024-09-12T19:20:53.697797+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:12:27.778582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":218,"num_write":206,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'775","reported_seq":3292,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.324958+0000","last_change":"2024-09-12T17:30:00.787430+0000","last_active":"2024-09-12T19:23:01.324958+0000","last_peered":"2024-09-12T19:23:01.324958+0000","last_clean":"2024-09-12T19:23:01.324958+0000","last_became_active":"2024-09-12T17:30:00.786102+0000","last_became_peered":"2024-09-12T17:30:00.786102+0000","last_unstale":"2024-09-12T19:23:01.324958+0000","last_undegraded":"2024-09-12T19:23:01.324958+0000","last_fullsized":"2024-09-12T19:23:01.324958+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:58.157521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'148","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:19.288957+0000","last_change":"2024-09-12T17:30:02.804619+0000","last_active":"2024-09-12T19:21:19.288957+0000","last_peered":"2024-09-12T19:21:19.288957+0000","last_clean":"2024-09-12T19:21:19.288957+0000","last_became_active":"2024-09-12T17:30:02.803612+0000","last_became_peered":"2024-09-12T17:30:02.803612+0000","last_unstale":"2024-09-12T19:21:19.288957+0000","last_undegraded":"2024-09-12T19:21:19.288957+0000","last_fullsized":"2024-09-12T19:21:19.288957+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:34.332012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":232,"num_read_kb":219,"num_write":373,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'828","reported_seq":2559,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.291568+0000","last_change":"2024-09-12T19:23:22.291568+0000","last_active":"2024-09-12T19:23:22.291568+0000","last_peered":"2024-09-12T19:23:22.291568+0000","last_clean":"2024-09-12T19:23:22.291568+0000","last_became_active":"2024-09-12T17:30:21.696952+0000","last_became_peered":"2024-09-12T17:30:21.696952+0000","last_unstale":"2024-09-12T19:23:22.291568+0000","last_undegraded":"2024-09-12T19:23:22.291568+0000","last_fullsized":"2024-09-12T19:23:22.291568+0000","mapping_epoch":39,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'828","last_scrub_stamp":"2024-09-12T19:23:22.291363+0000","last_deep_scrub":"267'828","last_deep_scrub_stamp":"2024-09-12T19:23:22.291363+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.291363+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:50.049566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3950,"num_read_kb":3589,"num_write":1060,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'353","reported_seq":1080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.268016+0000","last_change":"2024-09-12T19:23:13.268016+0000","last_active":"2024-09-12T19:23:13.268016+0000","last_peered":"2024-09-12T19:23:13.268016+0000","last_clean":"2024-09-12T19:23:13.268016+0000","last_became_active":"2024-09-12T17:29:52.749735+0000","last_became_peered":"2024-09-12T17:29:52.749735+0000","last_unstale":"2024-09-12T19:23:13.268016+0000","last_undegraded":"2024-09-12T19:23:13.268016+0000","last_fullsized":"2024-09-12T19:23:13.268016+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'353","last_scrub_stamp":"2024-09-12T19:23:13.267796+0000","last_deep_scrub":"267'353","last_deep_scrub_stamp":"2024-09-12T19:23:13.267796+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.267796+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:59.721962+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437125,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":46392,"num_write":1072,"num_write_kb":51525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.967526+0000","last_change":"2024-09-12T17:29:56.766629+0000","last_active":"2024-09-12T19:19:57.967526+0000","last_peered":"2024-09-12T19:19:57.967526+0000","last_clean":"2024-09-12T19:19:57.967526+0000","last_became_active":"2024-09-12T17:29:56.765909+0000","last_became_peered":"2024-09-12T17:29:56.765909+0000","last_unstale":"2024-09-12T19:19:57.967526+0000","last_undegraded":"2024-09-12T19:19:57.967526+0000","last_fullsized":"2024-09-12T19:19:57.967526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:16.737963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'386","reported_seq":1032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.586459+0000","last_change":"2024-09-12T17:29:58.772348+0000","last_active":"2024-09-12T19:23:00.586459+0000","last_peered":"2024-09-12T19:23:00.586459+0000","last_clean":"2024-09-12T19:23:00.586459+0000","last_became_active":"2024-09-12T17:29:58.771522+0000","last_became_peered":"2024-09-12T17:29:58.771522+0000","last_unstale":"2024-09-12T19:23:00.586459+0000","last_undegraded":"2024-09-12T19:23:00.586459+0000","last_fullsized":"2024-09-12T19:23:00.586459+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:37.869319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46902,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":612,"num_read_kb":1188,"num_write":476,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:48.165589+0000","last_change":"2024-09-12T17:30:00.789334+0000","last_active":"2024-09-12T19:18:48.165589+0000","last_peered":"2024-09-12T19:18:48.165589+0000","last_clean":"2024-09-12T19:18:48.165589+0000","last_became_active":"2024-09-12T17:30:00.788559+0000","last_became_peered":"2024-09-12T17:30:00.788559+0000","last_unstale":"2024-09-12T19:18:48.165589+0000","last_undegraded":"2024-09-12T19:18:48.165589+0000","last_fullsized":"2024-09-12T19:18:48.165589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:23.307242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'116","reported_seq":631,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:12.986237+0000","last_change":"2024-09-12T17:30:02.807855+0000","last_active":"2024-09-12T19:21:12.986237+0000","last_peered":"2024-09-12T19:21:12.986237+0000","last_clean":"2024-09-12T19:21:12.986237+0000","last_became_active":"2024-09-12T17:30:02.807083+0000","last_became_peered":"2024-09-12T17:30:02.807083+0000","last_unstale":"2024-09-12T19:21:12.986237+0000","last_undegraded":"2024-09-12T19:21:12.986237+0000","last_fullsized":"2024-09-12T19:21:12.986237+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:51.993531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":147,"num_write":283,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'827","reported_seq":2508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.266912+0000","last_change":"2024-09-12T19:23:19.266912+0000","last_active":"2024-09-12T19:23:19.266912+0000","last_peered":"2024-09-12T19:23:19.266912+0000","last_clean":"2024-09-12T19:23:19.266912+0000","last_became_active":"2024-09-12T17:29:54.770569+0000","last_became_peered":"2024-09-12T17:29:54.770569+0000","last_unstale":"2024-09-12T19:23:19.266912+0000","last_undegraded":"2024-09-12T19:23:19.266912+0000","last_fullsized":"2024-09-12T19:23:19.266912+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'827","last_scrub_stamp":"2024-09-12T19:23:19.266750+0000","last_deep_scrub":"267'827","last_deep_scrub_stamp":"2024-09-12T19:23:19.266750+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.266750+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:38.162790+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4029,"num_read_kb":3656,"num_write":1088,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'392","reported_seq":1307,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.263333+0000","last_change":"2024-09-12T19:23:14.263333+0000","last_active":"2024-09-12T19:23:14.263333+0000","last_peered":"2024-09-12T19:23:14.263333+0000","last_clean":"2024-09-12T19:23:14.263333+0000","last_became_active":"2024-09-12T17:29:52.749566+0000","last_became_peered":"2024-09-12T17:29:52.749566+0000","last_unstale":"2024-09-12T19:23:14.263333+0000","last_undegraded":"2024-09-12T19:23:14.263333+0000","last_fullsized":"2024-09-12T19:23:14.263333+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'392","last_scrub_stamp":"2024-09-12T19:23:14.262990+0000","last_deep_scrub":"267'392","last_deep_scrub_stamp":"2024-09-12T19:23:14.262990+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.262990+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:34.154250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174738,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1171,"num_read_kb":8659,"num_write":1266,"num_write_kb":49806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:57.985406+0000","last_change":"2024-09-12T17:29:56.768011+0000","last_active":"2024-09-12T19:19:57.985406+0000","last_peered":"2024-09-12T19:19:57.985406+0000","last_clean":"2024-09-12T19:19:57.985406+0000","last_became_active":"2024-09-12T17:29:56.766952+0000","last_became_peered":"2024-09-12T17:29:56.766952+0000","last_unstale":"2024-09-12T19:19:57.985406+0000","last_undegraded":"2024-09-12T19:19:57.985406+0000","last_fullsized":"2024-09-12T19:19:57.985406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:54.137260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'322","reported_seq":938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.669796+0000","last_change":"2024-09-12T17:29:58.783690+0000","last_active":"2024-09-12T19:23:00.669796+0000","last_peered":"2024-09-12T19:23:00.669796+0000","last_clean":"2024-09-12T19:23:00.669796+0000","last_became_active":"2024-09-12T17:29:58.783105+0000","last_became_peered":"2024-09-12T17:29:58.783105+0000","last_unstale":"2024-09-12T19:23:00.669796+0000","last_undegraded":"2024-09-12T19:23:00.669796+0000","last_fullsized":"2024-09-12T19:23:00.669796+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:02.161325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50641,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":544,"num_read_kb":1206,"num_write":440,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.240737+0000","last_change":"2024-09-12T19:23:28.240737+0000","last_active":"2024-09-12T19:23:28.240737+0000","last_peered":"2024-09-12T19:23:28.240737+0000","last_clean":"2024-09-12T19:23:28.240737+0000","last_became_active":"2024-09-12T17:30:00.799680+0000","last_became_peered":"2024-09-12T17:30:00.799680+0000","last_unstale":"2024-09-12T19:23:28.240737+0000","last_undegraded":"2024-09-12T19:23:28.240737+0000","last_fullsized":"2024-09-12T19:23:28.240737+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:28.240549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:28.240549+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.240549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:11.520672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'130","reported_seq":684,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:48.237923+0000","last_change":"2024-09-12T17:30:02.787080+0000","last_active":"2024-09-12T19:18:48.237923+0000","last_peered":"2024-09-12T19:18:48.237923+0000","last_clean":"2024-09-12T19:18:48.237923+0000","last_became_active":"2024-09-12T17:30:02.786478+0000","last_became_peered":"2024-09-12T17:30:02.786478+0000","last_unstale":"2024-09-12T19:18:48.237923+0000","last_undegraded":"2024-09-12T19:18:48.237923+0000","last_fullsized":"2024-09-12T19:18:48.237923+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:32.030701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":240,"num_read_kb":229,"num_write":300,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'980","reported_seq":2771,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.198525+0000","last_change":"2024-09-12T19:23:25.198525+0000","last_active":"2024-09-12T19:23:25.198525+0000","last_peered":"2024-09-12T19:23:25.198525+0000","last_clean":"2024-09-12T19:23:25.198525+0000","last_became_active":"2024-09-12T17:29:54.761902+0000","last_became_peered":"2024-09-12T17:29:54.761902+0000","last_unstale":"2024-09-12T19:23:25.198525+0000","last_undegraded":"2024-09-12T19:23:25.198525+0000","last_fullsized":"2024-09-12T19:23:25.198525+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'980","last_scrub_stamp":"2024-09-12T19:23:25.198333+0000","last_deep_scrub":"267'980","last_deep_scrub_stamp":"2024-09-12T19:23:25.198333+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.198333+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":900,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:20.662236+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4608,"num_read_kb":4133,"num_write":1300,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'320","reported_seq":985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.200680+0000","last_change":"2024-09-12T19:23:12.200680+0000","last_active":"2024-09-12T19:23:12.200680+0000","last_peered":"2024-09-12T19:23:12.200680+0000","last_clean":"2024-09-12T19:23:12.200680+0000","last_became_active":"2024-09-12T17:29:52.733119+0000","last_became_peered":"2024-09-12T17:29:52.733119+0000","last_unstale":"2024-09-12T19:23:12.200680+0000","last_undegraded":"2024-09-12T19:23:12.200680+0000","last_fullsized":"2024-09-12T19:23:12.200680+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'320","last_scrub_stamp":"2024-09-12T19:23:12.200496+0000","last_deep_scrub":"267'320","last_deep_scrub_stamp":"2024-09-12T19:23:12.200496+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.200496+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:12.257376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":457,"num_read_kb":1565,"num_write":1142,"num_write_kb":34702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:18:43.177481+0000","last_change":"2024-09-12T17:29:56.761445+0000","last_active":"2024-09-12T19:18:43.177481+0000","last_peered":"2024-09-12T19:18:43.177481+0000","last_clean":"2024-09-12T19:18:43.177481+0000","last_became_active":"2024-09-12T17:29:56.760142+0000","last_became_peered":"2024-09-12T17:29:56.760142+0000","last_unstale":"2024-09-12T19:18:43.177481+0000","last_undegraded":"2024-09-12T19:18:43.177481+0000","last_fullsized":"2024-09-12T19:18:43.177481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:55.719876+0000","last_clean_scrub_stamp":"2024-09-12T17:29:55.719876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:58.137646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'274","reported_seq":868,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.592999+0000","last_change":"2024-09-12T17:29:58.775954+0000","last_active":"2024-09-12T19:22:59.592999+0000","last_peered":"2024-09-12T19:22:59.592999+0000","last_clean":"2024-09-12T19:22:59.592999+0000","last_became_active":"2024-09-12T17:29:58.775284+0000","last_became_peered":"2024-09-12T17:29:58.775284+0000","last_unstale":"2024-09-12T19:22:59.592999+0000","last_undegraded":"2024-09-12T19:22:59.592999+0000","last_fullsized":"2024-09-12T19:22:59.592999+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:04.232747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44259,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":428,"num_read_kb":949,"num_write":354,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.196243+0000","last_change":"2024-09-12T17:30:00.791617+0000","last_active":"2024-09-12T19:20:03.196243+0000","last_peered":"2024-09-12T19:20:03.196243+0000","last_clean":"2024-09-12T19:20:03.196243+0000","last_became_active":"2024-09-12T17:30:00.790907+0000","last_became_peered":"2024-09-12T17:30:00.790907+0000","last_unstale":"2024-09-12T19:20:03.196243+0000","last_undegraded":"2024-09-12T19:20:03.196243+0000","last_fullsized":"2024-09-12T19:20:03.196243+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:40.769544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'156","reported_seq":1270,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:13.192105+0000","last_change":"2024-09-12T17:30:02.813564+0000","last_active":"2024-09-12T19:21:13.192105+0000","last_peered":"2024-09-12T19:21:13.192105+0000","last_clean":"2024-09-12T19:21:13.192105+0000","last_became_active":"2024-09-12T17:30:02.812918+0000","last_became_peered":"2024-09-12T17:30:02.812918+0000","last_unstale":"2024-09-12T19:21:13.192105+0000","last_undegraded":"2024-09-12T19:21:13.192105+0000","last_fullsized":"2024-09-12T19:21:13.192105+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:30.419361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":804,"num_write":370,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'758","reported_seq":2296,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.236818+0000","last_change":"2024-09-12T19:23:20.236818+0000","last_active":"2024-09-12T19:23:20.236818+0000","last_peered":"2024-09-12T19:23:20.236818+0000","last_clean":"2024-09-12T19:23:20.236818+0000","last_became_active":"2024-09-12T17:29:54.767573+0000","last_became_peered":"2024-09-12T17:29:54.767573+0000","last_unstale":"2024-09-12T19:23:20.236818+0000","last_undegraded":"2024-09-12T19:23:20.236818+0000","last_fullsized":"2024-09-12T19:23:20.236818+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'758","last_scrub_stamp":"2024-09-12T19:23:20.236638+0000","last_deep_scrub":"267'758","last_deep_scrub_stamp":"2024-09-12T19:23:20.236638+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.236638+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:45.825300+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3552,"num_read_kb":3227,"num_write":976,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'365","reported_seq":1234,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:07.925988+0000","last_change":"2024-09-12T19:23:07.925988+0000","last_active":"2024-09-12T19:23:07.925988+0000","last_peered":"2024-09-12T19:23:07.925988+0000","last_clean":"2024-09-12T19:23:07.925988+0000","last_became_active":"2024-09-12T17:29:52.765692+0000","last_became_peered":"2024-09-12T17:29:52.765692+0000","last_unstale":"2024-09-12T19:23:07.925988+0000","last_undegraded":"2024-09-12T19:23:07.925988+0000","last_fullsized":"2024-09-12T19:23:07.925988+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'365","last_scrub_stamp":"2024-09-12T19:23:07.925864+0000","last_deep_scrub":"267'365","last_deep_scrub_stamp":"2024-09-12T19:23:07.925864+0000","last_clean_scrub_stamp":"2024-09-12T19:23:07.925864+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:17.489429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110874,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":771,"num_read_kb":82698,"num_write":1110,"num_write_kb":56258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"267'2","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.681287+0000","last_change":"2024-09-12T19:23:23.681287+0000","last_active":"2024-09-12T19:23:23.681287+0000","last_peered":"2024-09-12T19:23:23.681287+0000","last_clean":"2024-09-12T19:23:23.681287+0000","last_became_active":"2024-09-12T17:29:56.760345+0000","last_became_peered":"2024-09-12T17:29:56.760345+0000","last_unstale":"2024-09-12T19:23:23.681287+0000","last_undegraded":"2024-09-12T19:23:23.681287+0000","last_fullsized":"2024-09-12T19:23:23.681287+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:23.681094+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:23.681094+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.681094+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:13.124487+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'344","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:59.856112+0000","last_change":"2024-09-12T17:29:58.769661+0000","last_active":"2024-09-12T19:22:59.856112+0000","last_peered":"2024-09-12T19:22:59.856112+0000","last_clean":"2024-09-12T19:22:59.856112+0000","last_became_active":"2024-09-12T17:29:58.768812+0000","last_became_peered":"2024-09-12T17:29:58.768812+0000","last_unstale":"2024-09-12T19:22:59.856112+0000","last_undegraded":"2024-09-12T19:22:59.856112+0000","last_fullsized":"2024-09-12T19:22:59.856112+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:57.727005+0000","last_clean_scrub_stamp":"2024-09-12T17:29:57.727005+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:55.549725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46003,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1072,"num_write":420,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.185932+0000","last_change":"2024-09-12T17:30:00.786938+0000","last_active":"2024-09-12T19:20:03.185932+0000","last_peered":"2024-09-12T19:20:03.185932+0000","last_clean":"2024-09-12T19:20:03.185932+0000","last_became_active":"2024-09-12T17:30:00.786100+0000","last_became_peered":"2024-09-12T17:30:00.786100+0000","last_unstale":"2024-09-12T19:20:03.185932+0000","last_undegraded":"2024-09-12T19:20:03.185932+0000","last_fullsized":"2024-09-12T19:20:03.185932+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:59.740137+0000","last_clean_scrub_stamp":"2024-09-12T17:29:59.740137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:07.158524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'138","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:44.989412+0000","last_change":"2024-09-12T17:30:02.808784+0000","last_active":"2024-09-12T19:22:44.989412+0000","last_peered":"2024-09-12T19:22:44.989412+0000","last_clean":"2024-09-12T19:22:44.989412+0000","last_became_active":"2024-09-12T17:30:02.807953+0000","last_became_peered":"2024-09-12T17:30:02.807953+0000","last_unstale":"2024-09-12T19:22:44.989412+0000","last_undegraded":"2024-09-12T19:22:44.989412+0000","last_fullsized":"2024-09-12T19:22:44.989412+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:19.588574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216,"num_read_kb":199,"num_write":346,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'853","reported_seq":2473,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.709674+0000","last_change":"2024-09-12T19:23:19.709674+0000","last_active":"2024-09-12T19:23:19.709674+0000","last_peered":"2024-09-12T19:23:19.709674+0000","last_clean":"2024-09-12T19:23:19.709674+0000","last_became_active":"2024-09-12T17:29:54.768439+0000","last_became_peered":"2024-09-12T17:29:54.768439+0000","last_unstale":"2024-09-12T19:23:19.709674+0000","last_undegraded":"2024-09-12T19:23:19.709674+0000","last_fullsized":"2024-09-12T19:23:19.709674+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'853","last_scrub_stamp":"2024-09-12T19:23:19.709485+0000","last_deep_scrub":"267'853","last_deep_scrub_stamp":"2024-09-12T19:23:19.709485+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.709485+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:38.560571+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3940,"num_read_kb":3539,"num_write":1104,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'384","reported_seq":1082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.154790+0000","last_change":"2024-09-12T19:23:12.154790+0000","last_active":"2024-09-12T19:23:12.154790+0000","last_peered":"2024-09-12T19:23:12.154790+0000","last_clean":"2024-09-12T19:23:12.154790+0000","last_became_active":"2024-09-12T17:29:52.732894+0000","last_became_peered":"2024-09-12T17:29:52.732894+0000","last_unstale":"2024-09-12T19:23:12.154790+0000","last_undegraded":"2024-09-12T19:23:12.154790+0000","last_fullsized":"2024-09-12T19:23:12.154790+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'384","last_scrub_stamp":"2024-09-12T19:23:12.154565+0000","last_deep_scrub":"267'384","last_deep_scrub_stamp":"2024-09-12T19:23:12.154565+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.154565+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:11.123992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":583,"num_read_kb":27715,"num_write":1278,"num_write_kb":46649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'496","reported_seq":1995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.698567+0000","last_change":"2024-09-12T19:23:21.698567+0000","last_active":"2024-09-12T19:23:21.698567+0000","last_peered":"2024-09-12T19:23:21.698567+0000","last_clean":"2024-09-12T19:23:21.698567+0000","last_became_active":"2024-09-12T17:29:54.745192+0000","last_became_peered":"2024-09-12T17:29:54.745192+0000","last_unstale":"2024-09-12T19:23:21.698567+0000","last_undegraded":"2024-09-12T19:23:21.698567+0000","last_fullsized":"2024-09-12T19:23:21.698567+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'496","last_scrub_stamp":"2024-09-12T19:23:21.698347+0000","last_deep_scrub":"267'496","last_deep_scrub_stamp":"2024-09-12T19:23:21.698347+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.698347+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:41.917668+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2446,"num_read_kb":2266,"num_write":619,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'407","reported_seq":1149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.950490+0000","last_change":"2024-09-12T19:23:15.950490+0000","last_active":"2024-09-12T19:23:15.950490+0000","last_peered":"2024-09-12T19:23:15.950490+0000","last_clean":"2024-09-12T19:23:15.950490+0000","last_became_active":"2024-09-12T17:29:52.727433+0000","last_became_peered":"2024-09-12T17:29:52.727433+0000","last_unstale":"2024-09-12T19:23:15.950490+0000","last_undegraded":"2024-09-12T19:23:15.950490+0000","last_fullsized":"2024-09-12T19:23:15.950490+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'407","last_scrub_stamp":"2024-09-12T19:23:15.950082+0000","last_deep_scrub":"267'407","last_deep_scrub_stamp":"2024-09-12T19:23:15.950082+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.950082+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:52.289398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":690,"num_read_kb":95087,"num_write":1289,"num_write_kb":35037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'394","reported_seq":1973,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.345761+0000","last_change":"2024-09-12T19:23:23.345761+0000","last_active":"2024-09-12T19:23:23.345761+0000","last_peered":"2024-09-12T19:23:23.345761+0000","last_clean":"2024-09-12T19:23:23.345761+0000","last_became_active":"2024-09-12T17:29:54.762400+0000","last_became_peered":"2024-09-12T17:29:54.762400+0000","last_unstale":"2024-09-12T19:23:23.345761+0000","last_undegraded":"2024-09-12T19:23:23.345761+0000","last_fullsized":"2024-09-12T19:23:23.345761+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'394","last_scrub_stamp":"2024-09-12T19:23:23.345516+0000","last_deep_scrub":"267'394","last_deep_scrub_stamp":"2024-09-12T19:23:23.345516+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.345516+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:40.023760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2164,"num_read_kb":2073,"num_write":429,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'404","reported_seq":1128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.285536+0000","last_change":"2024-09-12T19:23:16.285536+0000","last_active":"2024-09-12T19:23:16.285536+0000","last_peered":"2024-09-12T19:23:16.285536+0000","last_clean":"2024-09-12T19:23:16.285536+0000","last_became_active":"2024-09-12T17:29:52.756626+0000","last_became_peered":"2024-09-12T17:29:52.756626+0000","last_unstale":"2024-09-12T19:23:16.285536+0000","last_undegraded":"2024-09-12T19:23:16.285536+0000","last_fullsized":"2024-09-12T19:23:16.285536+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'404","last_scrub_stamp":"2024-09-12T19:23:16.285300+0000","last_deep_scrub":"267'404","last_deep_scrub_stamp":"2024-09-12T19:23:16.285300+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.285300+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:58.905956+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":688,"num_read_kb":25414,"num_write":1427,"num_write_kb":18603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'785","reported_seq":2463,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.706702+0000","last_change":"2024-09-12T19:23:22.706702+0000","last_active":"2024-09-12T19:23:22.706702+0000","last_peered":"2024-09-12T19:23:22.706702+0000","last_clean":"2024-09-12T19:23:22.706702+0000","last_became_active":"2024-09-12T17:29:54.749249+0000","last_became_peered":"2024-09-12T17:29:54.749249+0000","last_unstale":"2024-09-12T19:23:22.706702+0000","last_undegraded":"2024-09-12T19:23:22.706702+0000","last_fullsized":"2024-09-12T19:23:22.706702+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'785","last_scrub_stamp":"2024-09-12T19:23:22.706520+0000","last_deep_scrub":"267'785","last_deep_scrub_stamp":"2024-09-12T19:23:22.706520+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.706520+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:51.140029+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3916,"num_read_kb":3572,"num_write":1026,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2553,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'306","reported_seq":967,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.917382+0000","last_change":"2024-09-12T19:23:14.917382+0000","last_active":"2024-09-12T19:23:14.917382+0000","last_peered":"2024-09-12T19:23:14.917382+0000","last_clean":"2024-09-12T19:23:14.917382+0000","last_became_active":"2024-09-12T17:29:52.767047+0000","last_became_peered":"2024-09-12T17:29:52.767047+0000","last_unstale":"2024-09-12T19:23:14.917382+0000","last_undegraded":"2024-09-12T19:23:14.917382+0000","last_fullsized":"2024-09-12T19:23:14.917382+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'306","last_scrub_stamp":"2024-09-12T19:23:14.916990+0000","last_deep_scrub":"267'306","last_deep_scrub_stamp":"2024-09-12T19:23:14.916990+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.916990+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:55.549231+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900516,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":422,"num_read_kb":21273,"num_write":1050,"num_write_kb":35522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'495","reported_seq":2164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.149430+0000","last_change":"2024-09-12T19:23:28.149430+0000","last_active":"2024-09-12T19:23:28.149430+0000","last_peered":"2024-09-12T19:23:28.149430+0000","last_clean":"2024-09-12T19:23:28.149430+0000","last_became_active":"2024-09-12T17:29:54.762667+0000","last_became_peered":"2024-09-12T17:29:54.762667+0000","last_unstale":"2024-09-12T19:23:28.149430+0000","last_undegraded":"2024-09-12T19:23:28.149430+0000","last_fullsized":"2024-09-12T19:23:28.149430+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'495","last_scrub_stamp":"2024-09-12T19:23:28.149234+0000","last_deep_scrub":"267'495","last_deep_scrub_stamp":"2024-09-12T19:23:28.149234+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.149234+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:49.849143+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2506,"num_read_kb":2365,"num_write":559,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'353","reported_seq":1041,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.110866+0000","last_change":"2024-09-12T19:23:16.110866+0000","last_active":"2024-09-12T19:23:16.110866+0000","last_peered":"2024-09-12T19:23:16.110866+0000","last_clean":"2024-09-12T19:23:16.110866+0000","last_became_active":"2024-09-12T17:29:52.765692+0000","last_became_peered":"2024-09-12T17:29:52.765692+0000","last_unstale":"2024-09-12T19:23:16.110866+0000","last_undegraded":"2024-09-12T19:23:16.110866+0000","last_fullsized":"2024-09-12T19:23:16.110866+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'353","last_scrub_stamp":"2024-09-12T19:23:16.110496+0000","last_deep_scrub":"267'353","last_deep_scrub_stamp":"2024-09-12T19:23:16.110496+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.110496+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:11.327254+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992395,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":536,"num_read_kb":21751,"num_write":1010,"num_write_kb":25522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'962","reported_seq":2744,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.252068+0000","last_change":"2024-09-12T19:23:24.252068+0000","last_active":"2024-09-12T19:23:24.252068+0000","last_peered":"2024-09-12T19:23:24.252068+0000","last_clean":"2024-09-12T19:23:24.252068+0000","last_became_active":"2024-09-12T17:29:54.769223+0000","last_became_peered":"2024-09-12T17:29:54.769223+0000","last_unstale":"2024-09-12T19:23:24.252068+0000","last_undegraded":"2024-09-12T19:23:24.252068+0000","last_fullsized":"2024-09-12T19:23:24.252068+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'962","last_scrub_stamp":"2024-09-12T19:23:24.251880+0000","last_deep_scrub":"267'962","last_deep_scrub_stamp":"2024-09-12T19:23:24.251880+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.251880+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":900,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:09.231713+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4532,"num_read_kb":4067,"num_write":1265,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'312","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.658326+0000","last_change":"2024-09-12T19:23:09.658326+0000","last_active":"2024-09-12T19:23:09.658326+0000","last_peered":"2024-09-12T19:23:09.658326+0000","last_clean":"2024-09-12T19:23:09.658326+0000","last_became_active":"2024-09-12T17:29:52.728523+0000","last_became_peered":"2024-09-12T17:29:52.728523+0000","last_unstale":"2024-09-12T19:23:09.658326+0000","last_undegraded":"2024-09-12T19:23:09.658326+0000","last_fullsized":"2024-09-12T19:23:09.658326+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'312","last_scrub_stamp":"2024-09-12T19:23:09.658187+0000","last_deep_scrub":"267'312","last_deep_scrub_stamp":"2024-09-12T19:23:09.658187+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.658187+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:25.530411+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":2514,"num_write":1024,"num_write_kb":45573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'968","reported_seq":2668,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.193466+0000","last_change":"2024-09-12T19:23:27.193466+0000","last_active":"2024-09-12T19:23:27.193466+0000","last_peered":"2024-09-12T19:23:27.193466+0000","last_clean":"2024-09-12T19:23:27.193466+0000","last_became_active":"2024-09-12T17:29:54.758687+0000","last_became_peered":"2024-09-12T17:29:54.758687+0000","last_unstale":"2024-09-12T19:23:27.193466+0000","last_undegraded":"2024-09-12T19:23:27.193466+0000","last_fullsized":"2024-09-12T19:23:27.193466+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'968","last_scrub_stamp":"2024-09-12T19:23:27.193272+0000","last_deep_scrub":"267'968","last_deep_scrub_stamp":"2024-09-12T19:23:27.193272+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.193272+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":900,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:29.700297+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4571,"num_read_kb":4077,"num_write":1316,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'354","reported_seq":1040,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.196879+0000","last_change":"2024-09-12T19:23:13.196879+0000","last_active":"2024-09-12T19:23:13.196879+0000","last_peered":"2024-09-12T19:23:13.196879+0000","last_clean":"2024-09-12T19:23:13.196879+0000","last_became_active":"2024-09-12T17:29:52.718689+0000","last_became_peered":"2024-09-12T17:29:52.718689+0000","last_unstale":"2024-09-12T19:23:13.196879+0000","last_undegraded":"2024-09-12T19:23:13.196879+0000","last_fullsized":"2024-09-12T19:23:13.196879+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-09-12T19:23:13.196640+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-09-12T19:23:13.196640+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.196640+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:32:39.813132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":521,"num_read_kb":13386,"num_write":1097,"num_write_kb":27082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'1292","reported_seq":2911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.220616+0000","last_change":"2024-09-12T19:23:19.220616+0000","last_active":"2024-09-12T19:23:19.220616+0000","last_peered":"2024-09-12T19:23:19.220616+0000","last_clean":"2024-09-12T19:23:19.220616+0000","last_became_active":"2024-09-12T17:29:54.764876+0000","last_became_peered":"2024-09-12T17:29:54.764876+0000","last_unstale":"2024-09-12T19:23:19.220616+0000","last_undegraded":"2024-09-12T19:23:19.220616+0000","last_fullsized":"2024-09-12T19:23:19.220616+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1292","last_scrub_stamp":"2024-09-12T19:23:19.220421+0000","last_deep_scrub":"267'1292","last_deep_scrub_stamp":"2024-09-12T19:23:19.220421+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.220421+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":1200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:24.771326+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5917,"num_read_kb":5200,"num_write":1797,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'408","reported_seq":1091,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.128933+0000","last_change":"2024-09-12T19:23:15.128933+0000","last_active":"2024-09-12T19:23:15.128933+0000","last_peered":"2024-09-12T19:23:15.128933+0000","last_clean":"2024-09-12T19:23:15.128933+0000","last_became_active":"2024-09-12T17:29:52.769086+0000","last_became_peered":"2024-09-12T17:29:52.769086+0000","last_unstale":"2024-09-12T19:23:15.128933+0000","last_undegraded":"2024-09-12T19:23:15.128933+0000","last_fullsized":"2024-09-12T19:23:15.128933+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'408","last_scrub_stamp":"2024-09-12T19:23:15.128724+0000","last_deep_scrub":"267'408","last_deep_scrub_stamp":"2024-09-12T19:23:15.128724+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.128724+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:19.551998+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730154,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":563,"num_read_kb":7699,"num_write":1244,"num_write_kb":36052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"267'896","reported_seq":2492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.943017+0000","last_change":"2024-09-12T19:23:15.943017+0000","last_active":"2024-09-12T19:23:15.943017+0000","last_peered":"2024-09-12T19:23:15.943017+0000","last_clean":"2024-09-12T19:23:15.943017+0000","last_became_active":"2024-09-12T17:29:54.759892+0000","last_became_peered":"2024-09-12T17:29:54.759892+0000","last_unstale":"2024-09-12T19:23:15.943017+0000","last_undegraded":"2024-09-12T19:23:15.943017+0000","last_fullsized":"2024-09-12T19:23:15.943017+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'896","last_scrub_stamp":"2024-09-12T19:23:15.942710+0000","last_deep_scrub":"267'896","last_deep_scrub_stamp":"2024-09-12T19:23:15.942710+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.942710+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:22.175169+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4227,"num_read_kb":3797,"num_write":1212,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":729,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'326","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.372677+0000","last_change":"2024-09-12T19:23:18.372677+0000","last_active":"2024-09-12T19:23:18.372677+0000","last_peered":"2024-09-12T19:23:18.372677+0000","last_clean":"2024-09-12T19:23:18.372677+0000","last_became_active":"2024-09-12T17:29:52.748790+0000","last_became_peered":"2024-09-12T17:29:52.748790+0000","last_unstale":"2024-09-12T19:23:18.372677+0000","last_undegraded":"2024-09-12T19:23:18.372677+0000","last_fullsized":"2024-09-12T19:23:18.372677+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'326","last_scrub_stamp":"2024-09-12T19:23:18.372450+0000","last_deep_scrub":"267'326","last_deep_scrub_stamp":"2024-09-12T19:23:18.372450+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.372450+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:49.825077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":434,"num_read_kb":14399,"num_write":1080,"num_write_kb":30402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'1656","reported_seq":3231,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.270886+0000","last_change":"2024-09-12T19:23:23.270886+0000","last_active":"2024-09-12T19:23:23.270886+0000","last_peered":"2024-09-12T19:23:23.270886+0000","last_clean":"2024-09-12T19:23:23.270886+0000","last_became_active":"2024-09-12T17:29:54.754702+0000","last_became_peered":"2024-09-12T17:29:54.754702+0000","last_unstale":"2024-09-12T19:23:23.270886+0000","last_undegraded":"2024-09-12T19:23:23.270886+0000","last_fullsized":"2024-09-12T19:23:23.270886+0000","mapping_epoch":28,"log_start":"267'1600","ondisk_log_start":"267'1600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1656","last_scrub_stamp":"2024-09-12T19:23:23.270692+0000","last_deep_scrub":"267'1656","last_deep_scrub_stamp":"2024-09-12T19:23:23.270692+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.270692+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":1600,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:49:05.709009+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7245,"num_read_kb":6284,"num_write":2371,"num_write_kb":1100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'306","reported_seq":980,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.172017+0000","last_change":"2024-09-12T19:23:14.172017+0000","last_active":"2024-09-12T19:23:14.172017+0000","last_peered":"2024-09-12T19:23:14.172017+0000","last_clean":"2024-09-12T19:23:14.172017+0000","last_became_active":"2024-09-12T17:29:52.767990+0000","last_became_peered":"2024-09-12T17:29:52.767990+0000","last_unstale":"2024-09-12T19:23:14.172017+0000","last_undegraded":"2024-09-12T19:23:14.172017+0000","last_fullsized":"2024-09-12T19:23:14.172017+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'306","last_scrub_stamp":"2024-09-12T19:23:14.171585+0000","last_deep_scrub":"267'306","last_deep_scrub_stamp":"2024-09-12T19:23:14.171585+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.171585+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:44.675581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":644,"num_write":1033,"num_write_kb":10844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'933","reported_seq":2514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.964877+0000","last_change":"2024-09-12T19:23:11.964877+0000","last_active":"2024-09-12T19:23:11.964877+0000","last_peered":"2024-09-12T19:23:11.964877+0000","last_clean":"2024-09-12T19:23:11.964877+0000","last_became_active":"2024-09-12T17:29:54.759169+0000","last_became_peered":"2024-09-12T17:29:54.759169+0000","last_unstale":"2024-09-12T19:23:11.964877+0000","last_undegraded":"2024-09-12T19:23:11.964877+0000","last_fullsized":"2024-09-12T19:23:11.964877+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'933","last_scrub_stamp":"2024-09-12T19:23:11.964699+0000","last_deep_scrub":"267'933","last_deep_scrub_stamp":"2024-09-12T19:23:11.964699+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.964699+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":900,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:21.605696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4504,"num_read_kb":3992,"num_write":1315,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'297","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.240869+0000","last_change":"2024-09-12T19:23:15.240869+0000","last_active":"2024-09-12T19:23:15.240869+0000","last_peered":"2024-09-12T19:23:15.240869+0000","last_clean":"2024-09-12T19:23:15.240869+0000","last_became_active":"2024-09-12T17:29:52.753935+0000","last_became_peered":"2024-09-12T17:29:52.753935+0000","last_unstale":"2024-09-12T19:23:15.240869+0000","last_undegraded":"2024-09-12T19:23:15.240869+0000","last_fullsized":"2024-09-12T19:23:15.240869+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'297","last_scrub_stamp":"2024-09-12T19:23:15.240643+0000","last_deep_scrub":"267'297","last_deep_scrub_stamp":"2024-09-12T19:23:15.240643+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.240643+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:02.060836+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340668,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":430,"num_read_kb":10673,"num_write":974,"num_write_kb":41601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'837","reported_seq":2507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.256275+0000","last_change":"2024-09-12T19:23:21.256275+0000","last_active":"2024-09-12T19:23:21.256275+0000","last_peered":"2024-09-12T19:23:21.256275+0000","last_clean":"2024-09-12T19:23:21.256275+0000","last_became_active":"2024-09-12T17:29:54.760784+0000","last_became_peered":"2024-09-12T17:29:54.760784+0000","last_unstale":"2024-09-12T19:23:21.256275+0000","last_undegraded":"2024-09-12T19:23:21.256275+0000","last_fullsized":"2024-09-12T19:23:21.256275+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'837","last_scrub_stamp":"2024-09-12T19:23:21.256101+0000","last_deep_scrub":"267'837","last_deep_scrub_stamp":"2024-09-12T19:23:21.256101+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.256101+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:33:40.828572+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4062,"num_read_kb":3682,"num_write":1062,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1008,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'490","reported_seq":1220,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.818268+0000","last_change":"2024-09-12T19:23:21.818268+0000","last_active":"2024-09-12T19:23:21.818268+0000","last_peered":"2024-09-12T19:23:21.818268+0000","last_clean":"2024-09-12T19:23:21.818268+0000","last_became_active":"2024-09-12T17:29:52.735333+0000","last_became_peered":"2024-09-12T17:29:52.735333+0000","last_unstale":"2024-09-12T19:23:21.818268+0000","last_undegraded":"2024-09-12T19:23:21.818268+0000","last_fullsized":"2024-09-12T19:23:21.818268+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'490","last_scrub_stamp":"2024-09-12T19:23:21.818028+0000","last_deep_scrub":"267'490","last_deep_scrub_stamp":"2024-09-12T19:23:21.818028+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.818028+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:20.819323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":869,"num_read_kb":5832,"num_write":1431,"num_write_kb":32355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'868","reported_seq":2455,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.061161+0000","last_change":"2024-09-12T19:23:23.061161+0000","last_active":"2024-09-12T19:23:23.061161+0000","last_peered":"2024-09-12T19:23:23.061161+0000","last_clean":"2024-09-12T19:23:23.061161+0000","last_became_active":"2024-09-12T17:29:54.753635+0000","last_became_peered":"2024-09-12T17:29:54.753635+0000","last_unstale":"2024-09-12T19:23:23.061161+0000","last_undegraded":"2024-09-12T19:23:23.061161+0000","last_fullsized":"2024-09-12T19:23:23.061161+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'868","last_scrub_stamp":"2024-09-12T19:23:23.060978+0000","last_deep_scrub":"267'868","last_deep_scrub_stamp":"2024-09-12T19:23:23.060978+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.060978+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:13.470283+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4079,"num_read_kb":3651,"num_write":1151,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'312","reported_seq":1076,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.225895+0000","last_change":"2024-09-12T19:23:15.225895+0000","last_active":"2024-09-12T19:23:15.225895+0000","last_peered":"2024-09-12T19:23:15.225895+0000","last_clean":"2024-09-12T19:23:15.225895+0000","last_became_active":"2024-09-12T17:29:52.744397+0000","last_became_peered":"2024-09-12T17:29:52.744397+0000","last_unstale":"2024-09-12T19:23:15.225895+0000","last_undegraded":"2024-09-12T19:23:15.225895+0000","last_fullsized":"2024-09-12T19:23:15.225895+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'312","last_scrub_stamp":"2024-09-12T19:23:15.225542+0000","last_deep_scrub":"267'312","last_deep_scrub_stamp":"2024-09-12T19:23:15.225542+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.225542+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:31.333562+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170396,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":764,"num_read_kb":16845,"num_write":1041,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'476","reported_seq":2110,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.887757+0000","last_change":"2024-09-12T19:23:18.887757+0000","last_active":"2024-09-12T19:23:18.887757+0000","last_peered":"2024-09-12T19:23:18.887757+0000","last_clean":"2024-09-12T19:23:18.887757+0000","last_became_active":"2024-09-12T17:29:54.751872+0000","last_became_peered":"2024-09-12T17:29:54.751872+0000","last_unstale":"2024-09-12T19:23:18.887757+0000","last_undegraded":"2024-09-12T19:23:18.887757+0000","last_fullsized":"2024-09-12T19:23:18.887757+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'476","last_scrub_stamp":"2024-09-12T19:23:18.887565+0000","last_deep_scrub":"267'476","last_deep_scrub_stamp":"2024-09-12T19:23:18.887565+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.887565+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:59.888303+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2533,"num_read_kb":2381,"num_write":539,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2539,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'294","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.102283+0000","last_change":"2024-09-12T19:23:18.102283+0000","last_active":"2024-09-12T19:23:18.102283+0000","last_peered":"2024-09-12T19:23:18.102283+0000","last_clean":"2024-09-12T19:23:18.102283+0000","last_became_active":"2024-09-12T17:29:52.747688+0000","last_became_peered":"2024-09-12T17:29:52.747688+0000","last_unstale":"2024-09-12T19:23:18.102283+0000","last_undegraded":"2024-09-12T19:23:18.102283+0000","last_fullsized":"2024-09-12T19:23:18.102283+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'294","last_scrub_stamp":"2024-09-12T19:23:18.102039+0000","last_deep_scrub":"267'294","last_deep_scrub_stamp":"2024-09-12T19:23:18.102039+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.102039+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:41.889385+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262281,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":403,"num_read_kb":6219,"num_write":990,"num_write_kb":21267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'427","reported_seq":1940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.258996+0000","last_change":"2024-09-12T17:29:54.760829+0000","last_active":"2024-09-12T19:20:13.258996+0000","last_peered":"2024-09-12T19:20:13.258996+0000","last_clean":"2024-09-12T19:20:13.258996+0000","last_became_active":"2024-09-12T17:29:54.760373+0000","last_became_peered":"2024-09-12T17:29:54.760373+0000","last_unstale":"2024-09-12T19:20:13.258996+0000","last_undegraded":"2024-09-12T19:20:13.258996+0000","last_fullsized":"2024-09-12T19:20:13.258996+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:29:53.701037+0000","last_clean_scrub_stamp":"2024-09-12T17:29:53.701037+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:05.548951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2333,"num_read_kb":2181,"num_write":522,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'333","reported_seq":1036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.012002+0000","last_change":"2024-09-12T19:23:11.012002+0000","last_active":"2024-09-12T19:23:11.012002+0000","last_peered":"2024-09-12T19:23:11.012002+0000","last_clean":"2024-09-12T19:23:11.012002+0000","last_became_active":"2024-09-12T17:29:52.746880+0000","last_became_peered":"2024-09-12T17:29:52.746880+0000","last_unstale":"2024-09-12T19:23:11.012002+0000","last_undegraded":"2024-09-12T19:23:11.012002+0000","last_fullsized":"2024-09-12T19:23:11.012002+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-09-12T19:23:11.011792+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-09-12T19:23:11.011792+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.011792+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:47.703391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399180,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":70822,"num_write":1091,"num_write_kb":52448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'788","reported_seq":2454,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.032535+0000","last_change":"2024-09-12T19:23:24.032535+0000","last_active":"2024-09-12T19:23:24.032535+0000","last_peered":"2024-09-12T19:23:24.032535+0000","last_clean":"2024-09-12T19:23:24.032535+0000","last_became_active":"2024-09-12T17:29:54.765197+0000","last_became_peered":"2024-09-12T17:29:54.765197+0000","last_unstale":"2024-09-12T19:23:24.032535+0000","last_undegraded":"2024-09-12T19:23:24.032535+0000","last_fullsized":"2024-09-12T19:23:24.032535+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'788","last_scrub_stamp":"2024-09-12T19:23:24.032353+0000","last_deep_scrub":"267'788","last_deep_scrub_stamp":"2024-09-12T19:23:24.032353+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.032353+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:14.118280+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3968,"num_read_kb":3617,"num_write":1032,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'309","reported_seq":971,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.332041+0000","last_change":"2024-09-12T19:23:17.332041+0000","last_active":"2024-09-12T19:23:17.332041+0000","last_peered":"2024-09-12T19:23:17.332041+0000","last_clean":"2024-09-12T19:23:17.332041+0000","last_became_active":"2024-09-12T17:29:52.749742+0000","last_became_peered":"2024-09-12T17:29:52.749742+0000","last_unstale":"2024-09-12T19:23:17.332041+0000","last_undegraded":"2024-09-12T19:23:17.332041+0000","last_fullsized":"2024-09-12T19:23:17.332041+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'309","last_scrub_stamp":"2024-09-12T19:23:17.331803+0000","last_deep_scrub":"267'309","last_deep_scrub_stamp":"2024-09-12T19:23:17.331803+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.331803+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:46.672373+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":13262,"num_write":1037,"num_write_kb":35239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'334","reported_seq":988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.345593+0000","last_change":"2024-09-12T19:23:19.345593+0000","last_active":"2024-09-12T19:23:19.345593+0000","last_peered":"2024-09-12T19:23:19.345593+0000","last_clean":"2024-09-12T19:23:19.345593+0000","last_became_active":"2024-09-12T17:29:52.720918+0000","last_became_peered":"2024-09-12T17:29:52.720918+0000","last_unstale":"2024-09-12T19:23:19.345593+0000","last_undegraded":"2024-09-12T19:23:19.345593+0000","last_fullsized":"2024-09-12T19:23:19.345593+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'334","last_scrub_stamp":"2024-09-12T19:23:19.345352+0000","last_deep_scrub":"267'334","last_deep_scrub_stamp":"2024-09-12T19:23:19.345352+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.345352+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:34.000068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170702,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":3934,"num_write":1046,"num_write_kb":9633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'602","reported_seq":2195,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.928044+0000","last_change":"2024-09-12T19:23:16.928044+0000","last_active":"2024-09-12T19:23:16.928044+0000","last_peered":"2024-09-12T19:23:16.928044+0000","last_clean":"2024-09-12T19:23:16.928044+0000","last_became_active":"2024-09-12T17:29:54.752553+0000","last_became_peered":"2024-09-12T17:29:54.752553+0000","last_unstale":"2024-09-12T19:23:16.928044+0000","last_undegraded":"2024-09-12T19:23:16.928044+0000","last_fullsized":"2024-09-12T19:23:16.928044+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'602","last_scrub_stamp":"2024-09-12T19:23:16.927841+0000","last_deep_scrub":"267'602","last_deep_scrub_stamp":"2024-09-12T19:23:16.927841+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.927841+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":500,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:30.799294+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3060,"num_read_kb":2784,"num_write":774,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'400","reported_seq":1094,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.722510+0000","last_change":"2024-09-12T19:23:12.722510+0000","last_active":"2024-09-12T19:23:12.722510+0000","last_peered":"2024-09-12T19:23:12.722510+0000","last_clean":"2024-09-12T19:23:12.722510+0000","last_became_active":"2024-09-12T17:30:22.254863+0000","last_became_peered":"2024-09-12T17:30:22.254863+0000","last_unstale":"2024-09-12T19:23:12.722510+0000","last_undegraded":"2024-09-12T19:23:12.722510+0000","last_fullsized":"2024-09-12T19:23:12.722510+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'400","last_scrub_stamp":"2024-09-12T19:23:12.722194+0000","last_deep_scrub":"267'400","last_deep_scrub_stamp":"2024-09-12T19:23:12.722194+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.722194+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:23.077630+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992370,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":655,"num_read_kb":2597,"num_write":1307,"num_write_kb":14489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5,0],"acting":[1,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'448","reported_seq":1956,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.408021+0000","last_change":"2024-09-12T19:23:25.408021+0000","last_active":"2024-09-12T19:23:25.408021+0000","last_peered":"2024-09-12T19:23:25.408021+0000","last_clean":"2024-09-12T19:23:25.408021+0000","last_became_active":"2024-09-12T17:29:54.763613+0000","last_became_peered":"2024-09-12T17:29:54.763613+0000","last_unstale":"2024-09-12T19:23:25.408021+0000","last_undegraded":"2024-09-12T19:23:25.408021+0000","last_fullsized":"2024-09-12T19:23:25.408021+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'448","last_scrub_stamp":"2024-09-12T19:23:25.407841+0000","last_deep_scrub":"267'448","last_deep_scrub_stamp":"2024-09-12T19:23:25.407841+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.407841+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:02.339912+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2478,"num_read_kb":2322,"num_write":560,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5989,"num_read_kb":4199,"num_write":1940,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2500,"num_omap_keys":5,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1012,"ondisk_log_size":1012,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16341,"num_read_kb":15997,"num_write":16735,"num_write_kb":4892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1670,"ondisk_log_size":1670,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":471,"ondisk_log_size":471,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1542315,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":20962,"num_read_kb":40263,"num_write":17485,"num_write_kb":12367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508346,"num_omap_keys":1154,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1914,"ondisk_log_size":1914,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212845,"num_read_kb":194484,"num_write":55296,"num_write_kb":18842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43560,"num_omap_keys":175,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3864,"ondisk_log_size":3864,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":66041020,"num_objects":366,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":366,"num_whiteouts":0,"num_read":36181,"num_read_kb":1906096,"num_write":71498,"num_write_kb":2114280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90423296,"data_stored":90423296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3830,"ondisk_log_size":3830,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":168420,"num_write":154,"num_write_kb":116143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":174519,"num_write":154,"num_write_kb":116143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543517,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316644,"kb_used_data":14740,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94055196,"statfs":{"total":96636764160,"available":96312520704,"internally_reserved":0,"allocated":15093760,"data_stored":13085472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":309131722},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543523,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296832,"kb_used_data":12976,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94075008,"statfs":{"total":96636764160,"available":96332808192,"internally_reserved":0,"allocated":13287424,"data_stored":11310974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":290650566},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543516,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177144,"kb_used_data":11368,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94194696,"statfs":{"total":96636764160,"available":96455368704,"internally_reserved":0,"allocated":11640832,"data_stored":9617929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543518,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161488,"kb_used_data":17856,"kb_used_omap":1,"kb_used_meta":143614,"kb_avail":94210352,"statfs":{"total":96636764160,"available":96471400448,"internally_reserved":0,"allocated":18284544,"data_stored":16335473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":147061189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543517,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310864,"kb_used_data":18688,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":94060976,"statfs":{"total":96636764160,"available":96318439424,"internally_reserved":0,"allocated":19136512,"data_stored":17127576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":299170247},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543519,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122504,"kb_used_data":14968,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94249336,"statfs":{"total":96636764160,"available":96511320064,"internally_reserved":0,"allocated":15327232,"data_stored":13358682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543515,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200244,"kb_used_data":16420,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94171596,"statfs":{"total":96636764160,"available":96431714304,"internally_reserved":0,"allocated":16814080,"data_stored":14841351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543517,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299704,"kb_used_data":15912,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":94072136,"statfs":{"total":96636764160,"available":96329867264,"internally_reserved":0,"allocated":16293888,"data_stored":14257873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":290585029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11374592,"data_stored":11374592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12550144,"data_stored":12550144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11067392,"data_stored":11067392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14835712,"data_stored":14835712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14045184,"data_stored":14045184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7327744,"data_stored":7327744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9019392,"data_stored":9019392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10203136,"data_stored":10203136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":5848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:23:30.229 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.229 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.230 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.230 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.230 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.230 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.230 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.230 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.230 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.230 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.230 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.231 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.231 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.231 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.231 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.231 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.231 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.231 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.231 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.231 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.231 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.232 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.232 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.232 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.232 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.232 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.232 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.232 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.232 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.233 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.233 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.233 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.233 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.233 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.233 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.233 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.233 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.233 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.233 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.234 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.234 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.234 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.234 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.234 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.234 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.234 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.234 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.234 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.235 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.235 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.235 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.235 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.235 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.235 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.235 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.235 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.235 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.236 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.236 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.236 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.236 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.236 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.236 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.236 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.236 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.236 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.237 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.237 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.237 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.237 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.237 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.237 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.237 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.237 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.237 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.238 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.238 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.238 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.238 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.238 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.238 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.238 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.238 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.238 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.238 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.239 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.239 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.239 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.239 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.239 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.239 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.239 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.239 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.240 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.240 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.240 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.240 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.240 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.240 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.240 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.240 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.240 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.241 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.241 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.241 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.241 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.241 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.241 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.241 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.241 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.242 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.242 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.242 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.242 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.242 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.242 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.242 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.242 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.242 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.243 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.243 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.243 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.243 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.243 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.243 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.243 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.244 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.244 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.244 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.244 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.245 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.245 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.245 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.245 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.245 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.245 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.245 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.246 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.246 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.246 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.246 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.246 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.246 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.246 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.246 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.246 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.247 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.247 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.247 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.247 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.247 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.247 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.247 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.247 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.248 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.248 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.248 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.248 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.248 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.248 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.248 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.249 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.249 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.249 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.249 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.249 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.249 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.250 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.250 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.250 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.250 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.250 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.250 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.250 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.250 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.251 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.251 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.251 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.251 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.251 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.251 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.251 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.251 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.252 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.252 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.252 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.252 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.252 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.252 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.252 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.253 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.253 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.253 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.253 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.253 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.253 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.254 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.254 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.254 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.254 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.254 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.254 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.254 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.254 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.255 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.255 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.255 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.255 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.255 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.255 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.255 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.255 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.256 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.256 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.256 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.256 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.256 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.256 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.257 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.257 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.257 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.257 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:29:55.719876+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.257 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.257 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.257 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.258 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:29:57.727005+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.258 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:29:59.740137+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.258 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.258 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:29:53.701037+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=29, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:30.259 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T19:23:50.260 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:23:50.635 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:23:50.653 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-12T19:23:50.657 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":3689,"stamp":"2024-09-12T19:23:49.289590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68190910,"num_objects":834,"num_object_clones":0,"num_object_copies":2400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":834,"num_whiteouts":0,"num_read":295061,"num_read_kb":2506908,"num_write":163405,"num_write_kb":2385161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":734307,"num_omap_keys":1776,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13095,"ondisk_log_size":13095,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1889584,"kb_used_data":122928,"kb_used_omap":12,"kb_used_meta":1766515,"kb_avail":753085136,"statfs":{"total":773094113280,"available":771159179264,"internally_reserved":0,"allocated":125878272,"data_stored":109935330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1808911920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":147218,"num_omap_keys":367,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009050"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.976722+0000","last_change":"2024-09-12T18:19:22.664402+0000","last_active":"2024-09-12T19:19:22.976722+0000","last_peered":"2024-09-12T19:19:22.976722+0000","last_clean":"2024-09-12T19:19:22.976722+0000","last_became_active":"2024-09-12T18:19:22.658759+0000","last_became_peered":"2024-09-12T18:19:22.658759+0000","last_unstale":"2024-09-12T19:19:22.976722+0000","last_undegraded":"2024-09-12T19:19:22.976722+0000","last_fullsized":"2024-09-12T19:19:22.976722+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:29.891894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:32.979320+0000","last_change":"2024-09-12T17:51:59.970111+0000","last_active":"2024-09-12T19:19:32.979320+0000","last_peered":"2024-09-12T19:19:32.979320+0000","last_clean":"2024-09-12T19:19:32.979320+0000","last_became_active":"2024-09-12T17:51:59.969612+0000","last_became_peered":"2024-09-12T17:51:59.969612+0000","last_unstale":"2024-09-12T19:19:32.979320+0000","last_undegraded":"2024-09-12T19:19:32.979320+0000","last_fullsized":"2024-09-12T19:19:32.979320+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:23.773617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'6","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.283938+0000","last_change":"2024-09-12T17:51:52.890790+0000","last_active":"2024-09-12T19:21:53.283938+0000","last_peered":"2024-09-12T19:21:53.283938+0000","last_clean":"2024-09-12T19:21:53.283938+0000","last_became_active":"2024-09-12T17:51:52.890029+0000","last_became_peered":"2024-09-12T17:51:52.890029+0000","last_unstale":"2024-09-12T19:21:53.283938+0000","last_undegraded":"2024-09-12T19:21:53.283938+0000","last_fullsized":"2024-09-12T19:21:53.283938+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:58.035727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'75","reported_seq":375,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:33.208505+0000","last_change":"2024-09-12T17:45:41.586304+0000","last_active":"2024-09-12T19:21:33.208505+0000","last_peered":"2024-09-12T19:21:33.208505+0000","last_clean":"2024-09-12T19:21:33.208505+0000","last_became_active":"2024-09-12T17:45:41.585012+0000","last_became_peered":"2024-09-12T17:45:41.585012+0000","last_unstale":"2024-09-12T19:21:33.208505+0000","last_undegraded":"2024-09-12T19:21:33.208505+0000","last_fullsized":"2024-09-12T19:21:33.208505+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":580,"num_read_kb":395,"num_write":86,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.933499+0000","last_change":"2024-09-12T19:23:35.933499+0000","last_active":"2024-09-12T19:23:35.933499+0000","last_peered":"2024-09-12T19:23:35.933499+0000","last_clean":"2024-09-12T19:23:35.933499+0000","last_became_active":"2024-09-12T18:19:22.641172+0000","last_became_peered":"2024-09-12T18:19:22.641172+0000","last_unstale":"2024-09-12T19:23:35.933499+0000","last_undegraded":"2024-09-12T19:23:35.933499+0000","last_fullsized":"2024-09-12T19:23:35.933499+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:35.933324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:35.933324+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.933324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:07.656674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:33.189386+0000","last_change":"2024-09-12T17:51:59.957708+0000","last_active":"2024-09-12T19:19:33.189386+0000","last_peered":"2024-09-12T19:19:33.189386+0000","last_clean":"2024-09-12T19:19:33.189386+0000","last_became_active":"2024-09-12T17:51:59.957109+0000","last_became_peered":"2024-09-12T17:51:59.957109+0000","last_unstale":"2024-09-12T19:19:33.189386+0000","last_undegraded":"2024-09-12T19:19:33.189386+0000","last_fullsized":"2024-09-12T19:19:33.189386+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:06.641011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'3","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:47.700672+0000","last_change":"2024-09-12T19:23:47.700672+0000","last_active":"2024-09-12T19:23:47.700672+0000","last_peered":"2024-09-12T19:23:47.700672+0000","last_clean":"2024-09-12T19:23:47.700672+0000","last_became_active":"2024-09-12T17:51:52.905220+0000","last_became_peered":"2024-09-12T17:51:52.905220+0000","last_unstale":"2024-09-12T19:23:47.700672+0000","last_undegraded":"2024-09-12T19:23:47.700672+0000","last_fullsized":"2024-09-12T19:23:47.700672+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:23:47.700481+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:23:47.700481+0000","last_clean_scrub_stamp":"2024-09-12T19:23:47.700481+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:24.745509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'123","reported_seq":496,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.967588+0000","last_change":"2024-09-12T19:23:27.967588+0000","last_active":"2024-09-12T19:23:27.967588+0000","last_peered":"2024-09-12T19:23:27.967588+0000","last_clean":"2024-09-12T19:23:27.967588+0000","last_became_active":"2024-09-12T17:45:41.572859+0000","last_became_peered":"2024-09-12T17:45:41.572859+0000","last_unstale":"2024-09-12T19:23:27.967588+0000","last_undegraded":"2024-09-12T19:23:27.967588+0000","last_fullsized":"2024-09-12T19:23:27.967588+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'123","last_scrub_stamp":"2024-09-12T19:23:27.967374+0000","last_deep_scrub":"267'123","last_deep_scrub_stamp":"2024-09-12T19:23:27.967374+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.967374+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:59.956709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":788,"num_read_kb":542,"num_write":175,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2500,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.278025+0000","last_change":"2024-09-12T19:23:42.278025+0000","last_active":"2024-09-12T19:23:42.278025+0000","last_peered":"2024-09-12T19:23:42.278025+0000","last_clean":"2024-09-12T19:23:42.278025+0000","last_became_active":"2024-09-12T18:19:22.652800+0000","last_became_peered":"2024-09-12T18:19:22.652800+0000","last_unstale":"2024-09-12T19:23:42.278025+0000","last_undegraded":"2024-09-12T19:23:42.278025+0000","last_fullsized":"2024-09-12T19:23:42.278025+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:42.277839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:42.277839+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.277839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:03.630377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:38.209734+0000","last_change":"2024-09-12T17:51:59.955159+0000","last_active":"2024-09-12T19:21:38.209734+0000","last_peered":"2024-09-12T19:21:38.209734+0000","last_clean":"2024-09-12T19:21:38.209734+0000","last_became_active":"2024-09-12T17:51:59.954517+0000","last_became_peered":"2024-09-12T17:51:59.954517+0000","last_unstale":"2024-09-12T19:21:38.209734+0000","last_undegraded":"2024-09-12T19:21:38.209734+0000","last_fullsized":"2024-09-12T19:21:38.209734+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"267'2","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.928017+0000","last_change":"2024-09-12T19:23:31.928017+0000","last_active":"2024-09-12T19:23:31.928017+0000","last_peered":"2024-09-12T19:23:31.928017+0000","last_clean":"2024-09-12T19:23:31.928017+0000","last_became_active":"2024-09-12T17:51:52.885677+0000","last_became_peered":"2024-09-12T17:51:52.885677+0000","last_unstale":"2024-09-12T19:23:31.928017+0000","last_undegraded":"2024-09-12T19:23:31.928017+0000","last_fullsized":"2024-09-12T19:23:31.928017+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:31.927774+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:31.927774+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.927774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:39.909778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'26","reported_seq":141,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:43.196758+0000","last_change":"2024-09-12T17:45:41.576549+0000","last_active":"2024-09-12T19:20:43.196758+0000","last_peered":"2024-09-12T19:20:43.196758+0000","last_clean":"2024-09-12T19:20:43.196758+0000","last_became_active":"2024-09-12T17:45:41.575793+0000","last_became_peered":"2024-09-12T17:45:41.575793+0000","last_unstale":"2024-09-12T19:20:43.196758+0000","last_undegraded":"2024-09-12T19:20:43.196758+0000","last_fullsized":"2024-09-12T19:20:43.196758+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":83,"num_write":51,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.254703+0000","last_change":"2024-09-12T18:19:22.656103+0000","last_active":"2024-09-12T19:19:58.254703+0000","last_peered":"2024-09-12T19:19:58.254703+0000","last_clean":"2024-09-12T19:19:58.254703+0000","last_became_active":"2024-09-12T18:19:22.655357+0000","last_became_peered":"2024-09-12T18:19:22.655357+0000","last_unstale":"2024-09-12T19:19:58.254703+0000","last_undegraded":"2024-09-12T19:19:58.254703+0000","last_fullsized":"2024-09-12T19:19:58.254703+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:44.884891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"267'2","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:23.288565+0000","last_change":"2024-09-12T17:51:59.941561+0000","last_active":"2024-09-12T19:22:23.288565+0000","last_peered":"2024-09-12T19:22:23.288565+0000","last_clean":"2024-09-12T19:22:23.288565+0000","last_became_active":"2024-09-12T17:51:59.935185+0000","last_became_peered":"2024-09-12T17:51:59.935185+0000","last_unstale":"2024-09-12T19:22:23.288565+0000","last_undegraded":"2024-09-12T19:22:23.288565+0000","last_fullsized":"2024-09-12T19:22:23.288565+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:03.775657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"267'10","reported_seq":98,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.698910+0000","last_change":"2024-09-12T17:51:52.865694+0000","last_active":"2024-09-12T19:23:01.698910+0000","last_peered":"2024-09-12T19:23:01.698910+0000","last_clean":"2024-09-12T19:23:01.698910+0000","last_became_active":"2024-09-12T17:51:52.864951+0000","last_became_peered":"2024-09-12T17:51:52.864951+0000","last_unstale":"2024-09-12T19:23:01.698910+0000","last_undegraded":"2024-09-12T19:23:01.698910+0000","last_fullsized":"2024-09-12T19:23:01.698910+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32810,"num_write":10,"num_write_kb":11304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'28","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:43.267456+0000","last_change":"2024-09-12T17:45:41.577459+0000","last_active":"2024-09-12T19:20:43.267456+0000","last_peered":"2024-09-12T19:20:43.267456+0000","last_clean":"2024-09-12T19:20:43.267456+0000","last_became_active":"2024-09-12T17:45:41.576714+0000","last_became_peered":"2024-09-12T17:45:41.576714+0000","last_unstale":"2024-09-12T19:20:43.267456+0000","last_undegraded":"2024-09-12T19:20:43.267456+0000","last_fullsized":"2024-09-12T19:20:43.267456+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":94,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:33.279448+0000","last_change":"2024-09-12T18:19:22.665947+0000","last_active":"2024-09-12T19:21:33.279448+0000","last_peered":"2024-09-12T19:21:33.279448+0000","last_clean":"2024-09-12T19:21:33.279448+0000","last_became_active":"2024-09-12T18:19:22.665152+0000","last_became_peered":"2024-09-12T18:19:22.665152+0000","last_unstale":"2024-09-12T19:21:33.279448+0000","last_undegraded":"2024-09-12T19:21:33.279448+0000","last_fullsized":"2024-09-12T19:21:33.279448+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"267'3","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.011866+0000","last_change":"2024-09-12T17:51:59.951234+0000","last_active":"2024-09-12T19:21:53.011866+0000","last_peered":"2024-09-12T19:21:53.011866+0000","last_clean":"2024-09-12T19:21:53.011866+0000","last_became_active":"2024-09-12T17:51:59.950595+0000","last_became_peered":"2024-09-12T17:51:59.950595+0000","last_unstale":"2024-09-12T19:21:53.011866+0000","last_undegraded":"2024-09-12T19:21:53.011866+0000","last_fullsized":"2024-09-12T19:21:53.011866+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:58.571310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:18.204840+0000","last_change":"2024-09-12T17:51:52.908434+0000","last_active":"2024-09-12T19:21:18.204840+0000","last_peered":"2024-09-12T19:21:18.204840+0000","last_clean":"2024-09-12T19:21:18.204840+0000","last_became_active":"2024-09-12T17:51:52.907863+0000","last_became_peered":"2024-09-12T17:51:52.907863+0000","last_unstale":"2024-09-12T19:21:18.204840+0000","last_undegraded":"2024-09-12T19:21:18.204840+0000","last_fullsized":"2024-09-12T19:21:18.204840+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'42","reported_seq":187,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:43.267346+0000","last_change":"2024-09-12T17:45:41.596640+0000","last_active":"2024-09-12T19:20:43.267346+0000","last_peered":"2024-09-12T19:20:43.267346+0000","last_clean":"2024-09-12T19:20:43.267346+0000","last_became_active":"2024-09-12T17:45:41.596133+0000","last_became_peered":"2024-09-12T17:45:41.596133+0000","last_unstale":"2024-09-12T19:20:43.267346+0000","last_undegraded":"2024-09-12T19:20:43.267346+0000","last_fullsized":"2024-09-12T19:20:43.267346+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":80,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.757664+0000","last_change":"2024-09-12T19:23:45.757664+0000","last_active":"2024-09-12T19:23:45.757664+0000","last_peered":"2024-09-12T19:23:45.757664+0000","last_clean":"2024-09-12T19:23:45.757664+0000","last_became_active":"2024-09-12T18:19:22.652141+0000","last_became_peered":"2024-09-12T18:19:22.652141+0000","last_unstale":"2024-09-12T19:23:45.757664+0000","last_undegraded":"2024-09-12T19:23:45.757664+0000","last_fullsized":"2024-09-12T19:23:45.757664+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:45.757489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:45.757489+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.757489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:29.631747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"267'2","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.251781+0000","last_change":"2024-09-12T19:23:40.251781+0000","last_active":"2024-09-12T19:23:40.251781+0000","last_peered":"2024-09-12T19:23:40.251781+0000","last_clean":"2024-09-12T19:23:40.251781+0000","last_became_active":"2024-09-12T17:51:59.936941+0000","last_became_peered":"2024-09-12T17:51:59.936941+0000","last_unstale":"2024-09-12T19:23:40.251781+0000","last_undegraded":"2024-09-12T19:23:40.251781+0000","last_fullsized":"2024-09-12T19:23:40.251781+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:40.251559+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:40.251559+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.251559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:26.712415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'2","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:38.218337+0000","last_change":"2024-09-12T17:51:52.882882+0000","last_active":"2024-09-12T19:21:38.218337+0000","last_peered":"2024-09-12T19:21:38.218337+0000","last_clean":"2024-09-12T19:21:38.218337+0000","last_became_active":"2024-09-12T17:51:52.882157+0000","last_became_peered":"2024-09-12T17:51:52.882157+0000","last_unstale":"2024-09-12T19:21:38.218337+0000","last_undegraded":"2024-09-12T19:21:38.218337+0000","last_fullsized":"2024-09-12T19:21:38.218337+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:28.059422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'16","reported_seq":122,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.307486+0000","last_change":"2024-09-12T19:23:37.307486+0000","last_active":"2024-09-12T19:23:37.307486+0000","last_peered":"2024-09-12T19:23:37.307486+0000","last_clean":"2024-09-12T19:23:37.307486+0000","last_became_active":"2024-09-12T17:45:41.586661+0000","last_became_peered":"2024-09-12T17:45:41.586661+0000","last_unstale":"2024-09-12T19:23:37.307486+0000","last_undegraded":"2024-09-12T19:23:37.307486+0000","last_fullsized":"2024-09-12T19:23:37.307486+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'16","last_scrub_stamp":"2024-09-12T19:23:37.307195+0000","last_deep_scrub":"267'16","last_deep_scrub_stamp":"2024-09-12T19:23:37.307195+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.307195+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:28.732335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959085+0000","last_change":"2024-09-12T18:19:22.671131+0000","last_active":"2024-09-12T19:19:22.959085+0000","last_peered":"2024-09-12T19:19:22.959085+0000","last_clean":"2024-09-12T19:19:22.959085+0000","last_became_active":"2024-09-12T18:19:22.668945+0000","last_became_peered":"2024-09-12T18:19:22.668945+0000","last_unstale":"2024-09-12T19:19:22.959085+0000","last_undegraded":"2024-09-12T19:19:22.959085+0000","last_fullsized":"2024-09-12T19:19:22.959085+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:51.667065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.310464+0000","last_change":"2024-09-12T19:23:45.310464+0000","last_active":"2024-09-12T19:23:45.310464+0000","last_peered":"2024-09-12T19:23:45.310464+0000","last_clean":"2024-09-12T19:23:45.310464+0000","last_became_active":"2024-09-12T17:51:59.936441+0000","last_became_peered":"2024-09-12T17:51:59.936441+0000","last_unstale":"2024-09-12T19:23:45.310464+0000","last_undegraded":"2024-09-12T19:23:45.310464+0000","last_fullsized":"2024-09-12T19:23:45.310464+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:45.310281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:45.310281+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.310281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:27.701105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'3","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:23.187174+0000","last_change":"2024-09-12T17:51:52.888730+0000","last_active":"2024-09-12T19:19:23.187174+0000","last_peered":"2024-09-12T19:19:23.187174+0000","last_clean":"2024-09-12T19:19:23.187174+0000","last_became_active":"2024-09-12T17:51:52.887962+0000","last_became_peered":"2024-09-12T17:51:52.887962+0000","last_unstale":"2024-09-12T19:19:23.187174+0000","last_undegraded":"2024-09-12T19:19:23.187174+0000","last_fullsized":"2024-09-12T19:19:23.187174+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:25.669346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'25","reported_seq":141,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.188763+0000","last_change":"2024-09-12T17:45:41.566696+0000","last_active":"2024-09-12T19:20:13.188763+0000","last_peered":"2024-09-12T19:20:13.188763+0000","last_clean":"2024-09-12T19:20:13.188763+0000","last_became_active":"2024-09-12T17:45:41.565956+0000","last_became_peered":"2024-09-12T17:45:41.565956+0000","last_unstale":"2024-09-12T19:20:13.188763+0000","last_undegraded":"2024-09-12T19:20:13.188763+0000","last_fullsized":"2024-09-12T19:20:13.188763+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:11.837864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959148+0000","last_change":"2024-09-12T18:19:22.677901+0000","last_active":"2024-09-12T19:19:22.959148+0000","last_peered":"2024-09-12T19:19:22.959148+0000","last_clean":"2024-09-12T19:19:22.959148+0000","last_became_active":"2024-09-12T18:19:22.677111+0000","last_became_peered":"2024-09-12T18:19:22.677111+0000","last_unstale":"2024-09-12T19:19:22.959148+0000","last_undegraded":"2024-09-12T19:19:22.959148+0000","last_fullsized":"2024-09-12T19:19:22.959148+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:39.916282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:03.285359+0000","last_change":"2024-09-12T17:51:59.942614+0000","last_active":"2024-09-12T19:22:03.285359+0000","last_peered":"2024-09-12T19:22:03.285359+0000","last_clean":"2024-09-12T19:22:03.285359+0000","last_became_active":"2024-09-12T17:51:59.941825+0000","last_became_peered":"2024-09-12T17:51:59.941825+0000","last_unstale":"2024-09-12T19:22:03.285359+0000","last_undegraded":"2024-09-12T19:22:03.285359+0000","last_fullsized":"2024-09-12T19:22:03.285359+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:10.399861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":10,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"267'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.212609+0000","last_change":"2024-09-12T17:51:52.899944+0000","last_active":"2024-09-12T19:21:53.212609+0000","last_peered":"2024-09-12T19:21:53.212609+0000","last_clean":"2024-09-12T19:21:53.212609+0000","last_became_active":"2024-09-12T17:51:52.899511+0000","last_became_peered":"2024-09-12T17:51:52.899511+0000","last_unstale":"2024-09-12T19:21:53.212609+0000","last_undegraded":"2024-09-12T19:21:53.212609+0000","last_fullsized":"2024-09-12T19:21:53.212609+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:39.682445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'27","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.696922+0000","last_change":"2024-09-12T19:23:39.696922+0000","last_active":"2024-09-12T19:23:39.696922+0000","last_peered":"2024-09-12T19:23:39.696922+0000","last_clean":"2024-09-12T19:23:39.696922+0000","last_became_active":"2024-09-12T17:45:41.578021+0000","last_became_peered":"2024-09-12T17:45:41.578021+0000","last_unstale":"2024-09-12T19:23:39.696922+0000","last_undegraded":"2024-09-12T19:23:39.696922+0000","last_fullsized":"2024-09-12T19:23:39.696922+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'27","last_scrub_stamp":"2024-09-12T19:23:39.696712+0000","last_deep_scrub":"267'27","last_deep_scrub_stamp":"2024-09-12T19:23:39.696712+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.696712+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:17.945359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":97,"num_write":50,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:46.735693+0000","last_change":"2024-09-12T19:23:46.735693+0000","last_active":"2024-09-12T19:23:46.735693+0000","last_peered":"2024-09-12T19:23:46.735693+0000","last_clean":"2024-09-12T19:23:46.735693+0000","last_became_active":"2024-09-12T18:19:22.668802+0000","last_became_peered":"2024-09-12T18:19:22.668802+0000","last_unstale":"2024-09-12T19:23:46.735693+0000","last_undegraded":"2024-09-12T19:23:46.735693+0000","last_fullsized":"2024-09-12T19:23:46.735693+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:46.735517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:46.735517+0000","last_clean_scrub_stamp":"2024-09-12T19:23:46.735517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:47.277789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'3","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:28.278184+0000","last_change":"2024-09-12T17:51:59.940440+0000","last_active":"2024-09-12T19:21:28.278184+0000","last_peered":"2024-09-12T19:21:28.278184+0000","last_clean":"2024-09-12T19:21:28.278184+0000","last_became_active":"2024-09-12T17:51:59.939686+0000","last_became_peered":"2024-09-12T17:51:59.939686+0000","last_unstale":"2024-09-12T19:21:28.278184+0000","last_undegraded":"2024-09-12T19:21:28.278184+0000","last_fullsized":"2024-09-12T19:21:28.278184+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:25.031497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:57.999381+0000","last_change":"2024-09-12T17:51:52.894394+0000","last_active":"2024-09-12T19:20:57.999381+0000","last_peered":"2024-09-12T19:20:57.999381+0000","last_clean":"2024-09-12T19:20:57.999381+0000","last_became_active":"2024-09-12T17:51:52.892953+0000","last_became_peered":"2024-09-12T17:51:52.892953+0000","last_unstale":"2024-09-12T19:20:57.999381+0000","last_undegraded":"2024-09-12T19:20:57.999381+0000","last_fullsized":"2024-09-12T19:20:57.999381+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'51","reported_seq":214,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.184846+0000","last_change":"2024-09-12T17:45:41.574719+0000","last_active":"2024-09-12T19:19:58.184846+0000","last_peered":"2024-09-12T19:19:58.184846+0000","last_clean":"2024-09-12T19:19:58.184846+0000","last_became_active":"2024-09-12T17:45:41.572941+0000","last_became_peered":"2024-09-12T17:45:41.572941+0000","last_unstale":"2024-09-12T19:19:58.184846+0000","last_undegraded":"2024-09-12T19:19:58.184846+0000","last_fullsized":"2024-09-12T19:19:58.184846+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:25.447410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":190,"num_write":83,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'2","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.930550+0000","last_change":"2024-09-12T19:23:32.930550+0000","last_active":"2024-09-12T19:23:32.930550+0000","last_peered":"2024-09-12T19:23:32.930550+0000","last_clean":"2024-09-12T19:23:32.930550+0000","last_became_active":"2024-09-12T18:19:22.651901+0000","last_became_peered":"2024-09-12T18:19:22.651901+0000","last_unstale":"2024-09-12T19:23:32.930550+0000","last_undegraded":"2024-09-12T19:23:32.930550+0000","last_fullsized":"2024-09-12T19:23:32.930550+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:32.930331+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:32.930331+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.930331+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:50.719199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:03.272203+0000","last_change":"2024-09-12T17:51:59.948536+0000","last_active":"2024-09-12T19:21:03.272203+0000","last_peered":"2024-09-12T19:21:03.272203+0000","last_clean":"2024-09-12T19:21:03.272203+0000","last_became_active":"2024-09-12T17:51:59.947392+0000","last_became_peered":"2024-09-12T17:51:59.947392+0000","last_unstale":"2024-09-12T19:21:03.272203+0000","last_undegraded":"2024-09-12T19:21:03.272203+0000","last_fullsized":"2024-09-12T19:21:03.272203+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'5","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:17.987470+0000","last_change":"2024-09-12T17:51:52.887100+0000","last_active":"2024-09-12T19:21:17.987470+0000","last_peered":"2024-09-12T19:21:17.987470+0000","last_clean":"2024-09-12T19:21:17.987470+0000","last_became_active":"2024-09-12T17:51:52.886123+0000","last_became_peered":"2024-09-12T17:51:52.886123+0000","last_unstale":"2024-09-12T19:21:17.987470+0000","last_undegraded":"2024-09-12T19:21:17.987470+0000","last_fullsized":"2024-09-12T19:21:17.987470+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'32","reported_seq":165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.255039+0000","last_change":"2024-09-12T17:45:41.592562+0000","last_active":"2024-09-12T19:19:58.255039+0000","last_peered":"2024-09-12T19:19:58.255039+0000","last_clean":"2024-09-12T19:19:58.255039+0000","last_became_active":"2024-09-12T17:45:41.591637+0000","last_became_peered":"2024-09-12T17:45:41.591637+0000","last_unstale":"2024-09-12T19:19:58.255039+0000","last_undegraded":"2024-09-12T19:19:58.255039+0000","last_fullsized":"2024-09-12T19:19:58.255039+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:52.032057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":117,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968591+0000","last_change":"2024-09-12T18:19:22.646555+0000","last_active":"2024-09-12T19:20:02.968591+0000","last_peered":"2024-09-12T19:20:02.968591+0000","last_clean":"2024-09-12T19:20:02.968591+0000","last_became_active":"2024-09-12T18:19:22.645829+0000","last_became_peered":"2024-09-12T18:19:22.645829+0000","last_unstale":"2024-09-12T19:20:02.968591+0000","last_undegraded":"2024-09-12T19:20:02.968591+0000","last_fullsized":"2024-09-12T19:20:02.968591+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:14.278527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"267'9","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.986200+0000","last_change":"2024-09-12T17:52:23.472557+0000","last_active":"2024-09-12T19:22:58.986200+0000","last_peered":"2024-09-12T19:22:58.986200+0000","last_clean":"2024-09-12T19:22:58.986200+0000","last_became_active":"2024-09-12T17:52:23.438623+0000","last_became_peered":"2024-09-12T17:52:23.438623+0000","last_unstale":"2024-09-12T19:22:58.986200+0000","last_undegraded":"2024-09-12T19:22:58.986200+0000","last_fullsized":"2024-09-12T19:22:58.986200+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:04.013275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":19,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.16","version":"267'2","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.895617+0000","last_change":"2024-09-12T19:23:29.895553+0000","last_active":"2024-09-12T19:23:29.895617+0000","last_peered":"2024-09-12T19:23:29.895617+0000","last_clean":"2024-09-12T19:23:29.895617+0000","last_became_active":"2024-09-12T17:51:52.876542+0000","last_became_peered":"2024-09-12T17:51:52.876542+0000","last_unstale":"2024-09-12T19:23:29.895617+0000","last_undegraded":"2024-09-12T19:23:29.895617+0000","last_fullsized":"2024-09-12T19:23:29.895617+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:29.895459+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:29.895459+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.895459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:04.933465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"0'0","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.916967+0000","last_change":"2024-09-12T19:23:34.916967+0000","last_active":"2024-09-12T19:23:34.916967+0000","last_peered":"2024-09-12T19:23:34.916967+0000","last_clean":"2024-09-12T19:23:34.916967+0000","last_became_active":"2024-09-12T17:45:41.574953+0000","last_became_peered":"2024-09-12T17:45:41.574953+0000","last_unstale":"2024-09-12T19:23:34.916967+0000","last_undegraded":"2024-09-12T19:23:34.916967+0000","last_fullsized":"2024-09-12T19:23:34.916967+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:34.916775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:34.916775+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.916775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:23.463117+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.986527+0000","last_change":"2024-09-12T18:19:22.658747+0000","last_active":"2024-09-12T19:20:02.986527+0000","last_peered":"2024-09-12T19:20:02.986527+0000","last_clean":"2024-09-12T19:20:02.986527+0000","last_became_active":"2024-09-12T18:19:22.657731+0000","last_became_peered":"2024-09-12T18:19:22.657731+0000","last_unstale":"2024-09-12T19:20:02.986527+0000","last_undegraded":"2024-09-12T19:20:02.986527+0000","last_fullsized":"2024-09-12T19:20:02.986527+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:22.834751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"267'5","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:28.216153+0000","last_change":"2024-09-12T17:51:59.948754+0000","last_active":"2024-09-12T19:21:28.216153+0000","last_peered":"2024-09-12T19:21:28.216153+0000","last_clean":"2024-09-12T19:21:28.216153+0000","last_became_active":"2024-09-12T17:51:59.937650+0000","last_became_peered":"2024-09-12T17:51:59.937650+0000","last_unstale":"2024-09-12T19:21:28.216153+0000","last_undegraded":"2024-09-12T19:21:28.216153+0000","last_fullsized":"2024-09-12T19:21:28.216153+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:52.287318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'2","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:18.205093+0000","last_change":"2024-09-12T17:51:52.888708+0000","last_active":"2024-09-12T19:21:18.205093+0000","last_peered":"2024-09-12T19:21:18.205093+0000","last_clean":"2024-09-12T19:21:18.205093+0000","last_became_active":"2024-09-12T17:51:52.887964+0000","last_became_peered":"2024-09-12T17:51:52.887964+0000","last_unstale":"2024-09-12T19:21:18.205093+0000","last_undegraded":"2024-09-12T19:21:18.205093+0000","last_fullsized":"2024-09-12T19:21:18.205093+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'27","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:22.959037+0000","last_change":"2024-09-12T17:45:41.595246+0000","last_active":"2024-09-12T19:19:22.959037+0000","last_peered":"2024-09-12T19:19:22.959037+0000","last_clean":"2024-09-12T19:19:22.959037+0000","last_became_active":"2024-09-12T17:45:41.594619+0000","last_became_peered":"2024-09-12T17:45:41.594619+0000","last_unstale":"2024-09-12T19:19:22.959037+0000","last_undegraded":"2024-09-12T19:19:22.959037+0000","last_fullsized":"2024-09-12T19:19:22.959037+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:08.142112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252332+0000","last_change":"2024-09-12T18:19:22.646874+0000","last_active":"2024-09-12T19:19:48.252332+0000","last_peered":"2024-09-12T19:19:48.252332+0000","last_clean":"2024-09-12T19:19:48.252332+0000","last_became_active":"2024-09-12T18:19:22.646129+0000","last_became_peered":"2024-09-12T18:19:22.646129+0000","last_unstale":"2024-09-12T19:19:48.252332+0000","last_undegraded":"2024-09-12T19:19:48.252332+0000","last_fullsized":"2024-09-12T19:19:48.252332+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:17.061904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.988325+0000","last_change":"2024-09-12T17:51:59.962952+0000","last_active":"2024-09-12T19:20:42.988325+0000","last_peered":"2024-09-12T19:20:42.988325+0000","last_clean":"2024-09-12T19:20:42.988325+0000","last_became_active":"2024-09-12T17:51:59.961892+0000","last_became_peered":"2024-09-12T17:51:59.961892+0000","last_unstale":"2024-09-12T19:20:42.988325+0000","last_undegraded":"2024-09-12T19:20:42.988325+0000","last_fullsized":"2024-09-12T19:20:42.988325+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:48.287564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'5","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:48.084438+0000","last_change":"2024-09-12T19:23:48.084438+0000","last_active":"2024-09-12T19:23:48.084438+0000","last_peered":"2024-09-12T19:23:48.084438+0000","last_clean":"2024-09-12T19:23:48.084438+0000","last_became_active":"2024-09-12T17:51:52.865019+0000","last_became_peered":"2024-09-12T17:51:52.865019+0000","last_unstale":"2024-09-12T19:23:48.084438+0000","last_undegraded":"2024-09-12T19:23:48.084438+0000","last_fullsized":"2024-09-12T19:23:48.084438+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T19:23:48.084224+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T19:23:48.084224+0000","last_clean_scrub_stamp":"2024-09-12T19:23:48.084224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:29.411074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'30","reported_seq":162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:47.108012+0000","last_change":"2024-09-12T19:23:47.108012+0000","last_active":"2024-09-12T19:23:47.108012+0000","last_peered":"2024-09-12T19:23:47.108012+0000","last_clean":"2024-09-12T19:23:47.108012+0000","last_became_active":"2024-09-12T17:45:41.594848+0000","last_became_peered":"2024-09-12T17:45:41.594848+0000","last_unstale":"2024-09-12T19:23:47.108012+0000","last_undegraded":"2024-09-12T19:23:47.108012+0000","last_fullsized":"2024-09-12T19:23:47.108012+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'30","last_scrub_stamp":"2024-09-12T19:23:47.107794+0000","last_deep_scrub":"267'30","last_deep_scrub_stamp":"2024-09-12T19:23:47.107794+0000","last_clean_scrub_stamp":"2024-09-12T19:23:47.107794+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:28.712598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":101,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.182427+0000","last_change":"2024-09-12T18:19:22.649527+0000","last_active":"2024-09-12T19:19:48.182427+0000","last_peered":"2024-09-12T19:19:48.182427+0000","last_clean":"2024-09-12T19:19:48.182427+0000","last_became_active":"2024-09-12T18:19:22.648818+0000","last_became_peered":"2024-09-12T18:19:22.648818+0000","last_unstale":"2024-09-12T19:19:48.182427+0000","last_undegraded":"2024-09-12T19:19:48.182427+0000","last_fullsized":"2024-09-12T19:19:48.182427+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:23.776526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.988222+0000","last_change":"2024-09-12T17:51:59.954324+0000","last_active":"2024-09-12T19:20:42.988222+0000","last_peered":"2024-09-12T19:20:42.988222+0000","last_clean":"2024-09-12T19:20:42.988222+0000","last_became_active":"2024-09-12T17:51:59.953480+0000","last_became_peered":"2024-09-12T17:51:59.953480+0000","last_unstale":"2024-09-12T19:20:42.988222+0000","last_undegraded":"2024-09-12T19:20:42.988222+0000","last_fullsized":"2024-09-12T19:20:42.988222+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:03.945523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.264807+0000","last_change":"2024-09-12T17:51:52.886235+0000","last_active":"2024-09-12T19:20:33.264807+0000","last_peered":"2024-09-12T19:20:33.264807+0000","last_clean":"2024-09-12T19:20:33.264807+0000","last_became_active":"2024-09-12T17:51:52.884758+0000","last_became_peered":"2024-09-12T17:51:52.884758+0000","last_unstale":"2024-09-12T19:20:33.264807+0000","last_undegraded":"2024-09-12T19:20:33.264807+0000","last_fullsized":"2024-09-12T19:20:33.264807+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:14.092386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'17","reported_seq":130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:46.694947+0000","last_change":"2024-09-12T19:23:46.694947+0000","last_active":"2024-09-12T19:23:46.694947+0000","last_peered":"2024-09-12T19:23:46.694947+0000","last_clean":"2024-09-12T19:23:46.694947+0000","last_became_active":"2024-09-12T17:45:41.585259+0000","last_became_peered":"2024-09-12T17:45:41.585259+0000","last_unstale":"2024-09-12T19:23:46.694947+0000","last_undegraded":"2024-09-12T19:23:46.694947+0000","last_fullsized":"2024-09-12T19:23:46.694947+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'17","last_scrub_stamp":"2024-09-12T19:23:46.694759+0000","last_deep_scrub":"267'17","last_deep_scrub_stamp":"2024-09-12T19:23:46.694759+0000","last_clean_scrub_stamp":"2024-09-12T19:23:46.694759+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:40.321282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":55,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:13.189074+0000","last_change":"2024-09-12T18:19:22.658645+0000","last_active":"2024-09-12T19:20:13.189074+0000","last_peered":"2024-09-12T19:20:13.189074+0000","last_clean":"2024-09-12T19:20:13.189074+0000","last_became_active":"2024-09-12T18:19:22.655117+0000","last_became_peered":"2024-09-12T18:19:22.655117+0000","last_unstale":"2024-09-12T19:20:13.189074+0000","last_undegraded":"2024-09-12T19:20:13.189074+0000","last_fullsized":"2024-09-12T19:20:13.189074+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:32.691865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:43.267416+0000","last_change":"2024-09-12T17:51:59.940572+0000","last_active":"2024-09-12T19:20:43.267416+0000","last_peered":"2024-09-12T19:20:43.267416+0000","last_clean":"2024-09-12T19:20:43.267416+0000","last_became_active":"2024-09-12T17:51:59.939751+0000","last_became_peered":"2024-09-12T17:51:59.939751+0000","last_unstale":"2024-09-12T19:20:43.267416+0000","last_undegraded":"2024-09-12T19:20:43.267416+0000","last_fullsized":"2024-09-12T19:20:43.267416+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:17.997521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.227581+0000","last_change":"2024-09-12T19:23:39.227581+0000","last_active":"2024-09-12T19:23:39.227581+0000","last_peered":"2024-09-12T19:23:39.227581+0000","last_clean":"2024-09-12T19:23:39.227581+0000","last_became_active":"2024-09-12T17:51:52.897168+0000","last_became_peered":"2024-09-12T17:51:52.897168+0000","last_unstale":"2024-09-12T19:23:39.227581+0000","last_undegraded":"2024-09-12T19:23:39.227581+0000","last_fullsized":"2024-09-12T19:23:39.227581+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:39.227384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:39.227384+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.227384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:32.983284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'29","reported_seq":166,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:46.053233+0000","last_change":"2024-09-12T19:23:46.053233+0000","last_active":"2024-09-12T19:23:46.053233+0000","last_peered":"2024-09-12T19:23:46.053233+0000","last_clean":"2024-09-12T19:23:46.053233+0000","last_became_active":"2024-09-12T17:45:41.579765+0000","last_became_peered":"2024-09-12T17:45:41.579765+0000","last_unstale":"2024-09-12T19:23:46.053233+0000","last_undegraded":"2024-09-12T19:23:46.053233+0000","last_fullsized":"2024-09-12T19:23:46.053233+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-12T19:23:46.052945+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-12T19:23:46.052945+0000","last_clean_scrub_stamp":"2024-09-12T19:23:46.052945+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:31.279781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":115,"num_write":41,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.252289+0000","last_change":"2024-09-12T18:19:22.643191+0000","last_active":"2024-09-12T19:19:48.252289+0000","last_peered":"2024-09-12T19:19:48.252289+0000","last_clean":"2024-09-12T19:19:48.252289+0000","last_became_active":"2024-09-12T18:19:22.642415+0000","last_became_peered":"2024-09-12T18:19:22.642415+0000","last_unstale":"2024-09-12T19:19:48.252289+0000","last_undegraded":"2024-09-12T19:19:48.252289+0000","last_fullsized":"2024-09-12T19:19:48.252289+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:16.303449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.280529+0000","last_change":"2024-09-12T19:23:41.280529+0000","last_active":"2024-09-12T19:23:41.280529+0000","last_peered":"2024-09-12T19:23:41.280529+0000","last_clean":"2024-09-12T19:23:41.280529+0000","last_became_active":"2024-09-12T17:51:59.933679+0000","last_became_peered":"2024-09-12T17:51:59.933679+0000","last_unstale":"2024-09-12T19:23:41.280529+0000","last_undegraded":"2024-09-12T19:23:41.280529+0000","last_fullsized":"2024-09-12T19:23:41.280529+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:41.280350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:41.280350+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.280350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:06.704055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"267'3","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:47.296811+0000","last_change":"2024-09-12T19:23:47.296811+0000","last_active":"2024-09-12T19:23:47.296811+0000","last_peered":"2024-09-12T19:23:47.296811+0000","last_clean":"2024-09-12T19:23:47.296811+0000","last_became_active":"2024-09-12T17:51:52.891977+0000","last_became_peered":"2024-09-12T17:51:52.891977+0000","last_unstale":"2024-09-12T19:23:47.296811+0000","last_undegraded":"2024-09-12T19:23:47.296811+0000","last_fullsized":"2024-09-12T19:23:47.296811+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:47.296494+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:47.296494+0000","last_clean_scrub_stamp":"2024-09-12T19:23:47.296494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:52.443733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'38","reported_seq":176,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:23.276809+0000","last_change":"2024-09-12T17:45:41.580119+0000","last_active":"2024-09-12T19:21:23.276809+0000","last_peered":"2024-09-12T19:21:23.276809+0000","last_clean":"2024-09-12T19:21:23.276809+0000","last_became_active":"2024-09-12T17:45:41.579275+0000","last_became_peered":"2024-09-12T17:45:41.579275+0000","last_unstale":"2024-09-12T19:21:23.276809+0000","last_undegraded":"2024-09-12T19:21:23.276809+0000","last_fullsized":"2024-09-12T19:21:23.276809+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":125,"num_write":71,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.942420+0000","last_change":"2024-09-12T19:23:30.942420+0000","last_active":"2024-09-12T19:23:30.942420+0000","last_peered":"2024-09-12T19:23:30.942420+0000","last_clean":"2024-09-12T19:23:30.942420+0000","last_became_active":"2024-09-12T18:19:22.656770+0000","last_became_peered":"2024-09-12T18:19:22.656770+0000","last_unstale":"2024-09-12T19:23:30.942420+0000","last_undegraded":"2024-09-12T19:23:30.942420+0000","last_fullsized":"2024-09-12T19:23:30.942420+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:30.942234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:30.942234+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.942234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:50.066937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"267'6","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.188097+0000","last_change":"2024-09-12T17:51:59.941713+0000","last_active":"2024-09-12T19:23:00.188097+0000","last_peered":"2024-09-12T19:23:00.188097+0000","last_clean":"2024-09-12T19:23:00.188097+0000","last_became_active":"2024-09-12T17:51:59.934972+0000","last_became_peered":"2024-09-12T17:51:59.934972+0000","last_unstale":"2024-09-12T19:23:00.188097+0000","last_undegraded":"2024-09-12T19:23:00.188097+0000","last_fullsized":"2024-09-12T19:23:00.188097+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:09.715388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:37.962680+0000","last_change":"2024-09-12T17:51:52.901505+0000","last_active":"2024-09-12T19:19:37.962680+0000","last_peered":"2024-09-12T19:19:37.962680+0000","last_clean":"2024-09-12T19:19:37.962680+0000","last_became_active":"2024-09-12T17:51:52.900002+0000","last_became_peered":"2024-09-12T17:51:52.900002+0000","last_unstale":"2024-09-12T19:19:37.962680+0000","last_undegraded":"2024-09-12T19:19:37.962680+0000","last_fullsized":"2024-09-12T19:19:37.962680+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:16.493687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'34","reported_seq":174,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:33.265060+0000","last_change":"2024-09-12T17:45:41.581349+0000","last_active":"2024-09-12T19:20:33.265060+0000","last_peered":"2024-09-12T19:20:33.265060+0000","last_clean":"2024-09-12T19:20:33.265060+0000","last_became_active":"2024-09-12T17:45:41.580617+0000","last_became_peered":"2024-09-12T17:45:41.580617+0000","last_unstale":"2024-09-12T19:20:33.265060+0000","last_undegraded":"2024-09-12T19:20:33.265060+0000","last_fullsized":"2024-09-12T19:20:33.265060+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:04.951687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":129,"num_write":59,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:07.970075+0000","last_change":"2024-09-12T18:19:22.665735+0000","last_active":"2024-09-12T19:20:07.970075+0000","last_peered":"2024-09-12T19:20:07.970075+0000","last_clean":"2024-09-12T19:20:07.970075+0000","last_became_active":"2024-09-12T18:19:22.664960+0000","last_became_peered":"2024-09-12T18:19:22.664960+0000","last_unstale":"2024-09-12T19:20:07.970075+0000","last_undegraded":"2024-09-12T19:20:07.970075+0000","last_fullsized":"2024-09-12T19:20:07.970075+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:46.264476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:03.285437+0000","last_change":"2024-09-12T17:51:59.949566+0000","last_active":"2024-09-12T19:22:03.285437+0000","last_peered":"2024-09-12T19:22:03.285437+0000","last_clean":"2024-09-12T19:22:03.285437+0000","last_became_active":"2024-09-12T17:51:59.948733+0000","last_became_peered":"2024-09-12T17:51:59.948733+0000","last_unstale":"2024-09-12T19:22:03.285437+0000","last_undegraded":"2024-09-12T19:22:03.285437+0000","last_fullsized":"2024-09-12T19:22:03.285437+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:47.852395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'5","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.904948+0000","last_change":"2024-09-12T19:23:36.904948+0000","last_active":"2024-09-12T19:23:36.904948+0000","last_peered":"2024-09-12T19:23:36.904948+0000","last_clean":"2024-09-12T19:23:36.904948+0000","last_became_active":"2024-09-12T17:51:52.904092+0000","last_became_peered":"2024-09-12T17:51:52.904092+0000","last_unstale":"2024-09-12T19:23:36.904948+0000","last_undegraded":"2024-09-12T19:23:36.904948+0000","last_fullsized":"2024-09-12T19:23:36.904948+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T19:23:36.904778+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T19:23:36.904778+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.904778+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:23.628020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'87","reported_seq":319,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:46.336227+0000","last_change":"2024-09-12T19:23:46.336227+0000","last_active":"2024-09-12T19:23:46.336227+0000","last_peered":"2024-09-12T19:23:46.336227+0000","last_clean":"2024-09-12T19:23:46.336227+0000","last_became_active":"2024-09-12T17:45:41.574884+0000","last_became_peered":"2024-09-12T17:45:41.574884+0000","last_unstale":"2024-09-12T19:23:46.336227+0000","last_undegraded":"2024-09-12T19:23:46.336227+0000","last_fullsized":"2024-09-12T19:23:46.336227+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'87","last_scrub_stamp":"2024-09-12T19:23:46.336046+0000","last_deep_scrub":"267'87","last_deep_scrub_stamp":"2024-09-12T19:23:46.336046+0000","last_clean_scrub_stamp":"2024-09-12T19:23:46.336046+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:28.767258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":442,"num_read_kb":315,"num_write":154,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.334929+0000","last_change":"2024-09-12T19:23:44.334929+0000","last_active":"2024-09-12T19:23:44.334929+0000","last_peered":"2024-09-12T19:23:44.334929+0000","last_clean":"2024-09-12T19:23:44.334929+0000","last_became_active":"2024-09-12T18:19:22.632360+0000","last_became_peered":"2024-09-12T18:19:22.632360+0000","last_unstale":"2024-09-12T19:23:44.334929+0000","last_undegraded":"2024-09-12T19:23:44.334929+0000","last_fullsized":"2024-09-12T19:23:44.334929+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:44.334714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:44.334714+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.334714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:34.896398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'7","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.771492+0000","last_change":"2024-09-12T19:23:41.771492+0000","last_active":"2024-09-12T19:23:41.771492+0000","last_peered":"2024-09-12T19:23:41.771492+0000","last_clean":"2024-09-12T19:23:41.771492+0000","last_became_active":"2024-09-12T17:51:59.945099+0000","last_became_peered":"2024-09-12T17:51:59.945099+0000","last_unstale":"2024-09-12T19:23:41.771492+0000","last_undegraded":"2024-09-12T19:23:41.771492+0000","last_fullsized":"2024-09-12T19:23:41.771492+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T19:23:41.771302+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T19:23:41.771302+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.771302+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:59.577235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.212670+0000","last_change":"2024-09-12T17:51:52.899779+0000","last_active":"2024-09-12T19:21:53.212670+0000","last_peered":"2024-09-12T19:21:53.212670+0000","last_clean":"2024-09-12T19:21:53.212670+0000","last_became_active":"2024-09-12T17:51:52.889772+0000","last_became_peered":"2024-09-12T17:51:52.889772+0000","last_unstale":"2024-09-12T19:21:53.212670+0000","last_undegraded":"2024-09-12T19:21:53.212670+0000","last_fullsized":"2024-09-12T19:21:53.212670+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:13.521012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'27","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.320694+0000","last_change":"2024-09-12T19:23:35.320694+0000","last_active":"2024-09-12T19:23:35.320694+0000","last_peered":"2024-09-12T19:23:35.320694+0000","last_clean":"2024-09-12T19:23:35.320694+0000","last_became_active":"2024-09-12T17:45:41.590861+0000","last_became_peered":"2024-09-12T17:45:41.590861+0000","last_unstale":"2024-09-12T19:23:35.320694+0000","last_undegraded":"2024-09-12T19:23:35.320694+0000","last_fullsized":"2024-09-12T19:23:35.320694+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'27","last_scrub_stamp":"2024-09-12T19:23:35.320419+0000","last_deep_scrub":"267'27","last_deep_scrub_stamp":"2024-09-12T19:23:35.320419+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.320419+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:07.312095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":90,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968726+0000","last_change":"2024-09-12T18:19:22.656976+0000","last_active":"2024-09-12T19:20:02.968726+0000","last_peered":"2024-09-12T19:20:02.968726+0000","last_clean":"2024-09-12T19:20:02.968726+0000","last_became_active":"2024-09-12T18:19:22.655979+0000","last_became_peered":"2024-09-12T18:19:22.655979+0000","last_unstale":"2024-09-12T19:20:02.968726+0000","last_undegraded":"2024-09-12T19:20:02.968726+0000","last_fullsized":"2024-09-12T19:20:02.968726+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:36.624661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'5","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.592803+0000","last_change":"2024-09-12T17:51:59.945983+0000","last_active":"2024-09-12T19:23:00.592803+0000","last_peered":"2024-09-12T19:23:00.592803+0000","last_clean":"2024-09-12T19:23:00.592803+0000","last_became_active":"2024-09-12T17:51:59.942431+0000","last_became_peered":"2024-09-12T17:51:59.942431+0000","last_unstale":"2024-09-12T19:23:00.592803+0000","last_undegraded":"2024-09-12T19:23:00.592803+0000","last_fullsized":"2024-09-12T19:23:00.592803+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:57.343792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10320,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"267'3","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.648064+0000","last_change":"2024-09-12T19:23:38.648064+0000","last_active":"2024-09-12T19:23:38.648064+0000","last_peered":"2024-09-12T19:23:38.648064+0000","last_clean":"2024-09-12T19:23:38.648064+0000","last_became_active":"2024-09-12T17:51:52.900785+0000","last_became_peered":"2024-09-12T17:51:52.900785+0000","last_unstale":"2024-09-12T19:23:38.648064+0000","last_undegraded":"2024-09-12T19:23:38.648064+0000","last_fullsized":"2024-09-12T19:23:38.648064+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:38.647871+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:38.647871+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.647871+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:58:40.144934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'9","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.922578+0000","last_change":"2024-09-12T19:23:26.922578+0000","last_active":"2024-09-12T19:23:26.922578+0000","last_peered":"2024-09-12T19:23:26.922578+0000","last_clean":"2024-09-12T19:23:26.922578+0000","last_became_active":"2024-09-12T17:45:41.565793+0000","last_became_peered":"2024-09-12T17:45:41.565793+0000","last_unstale":"2024-09-12T19:23:26.922578+0000","last_undegraded":"2024-09-12T19:23:26.922578+0000","last_fullsized":"2024-09-12T19:23:26.922578+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'9","last_scrub_stamp":"2024-09-12T19:23:26.922376+0000","last_deep_scrub":"267'9","last_deep_scrub_stamp":"2024-09-12T19:23:26.922376+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.922376+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:57.354679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.257645+0000","last_change":"2024-09-12T18:19:22.664289+0000","last_active":"2024-09-12T19:20:08.257645+0000","last_peered":"2024-09-12T19:20:08.257645+0000","last_clean":"2024-09-12T19:20:08.257645+0000","last_became_active":"2024-09-12T18:19:22.663586+0000","last_became_peered":"2024-09-12T18:19:22.663586+0000","last_unstale":"2024-09-12T19:20:08.257645+0000","last_undegraded":"2024-09-12T19:20:08.257645+0000","last_fullsized":"2024-09-12T19:20:08.257645+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:24.618521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:53.208011+0000","last_change":"2024-09-12T17:51:59.950216+0000","last_active":"2024-09-12T19:20:53.208011+0000","last_peered":"2024-09-12T19:20:53.208011+0000","last_clean":"2024-09-12T19:20:53.208011+0000","last_became_active":"2024-09-12T17:51:59.949437+0000","last_became_peered":"2024-09-12T17:51:59.949437+0000","last_unstale":"2024-09-12T19:20:53.208011+0000","last_undegraded":"2024-09-12T19:20:53.208011+0000","last_fullsized":"2024-09-12T19:20:53.208011+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:26.376958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:53.224729+0000","last_change":"2024-09-12T17:51:52.899343+0000","last_active":"2024-09-12T19:22:53.224729+0000","last_peered":"2024-09-12T19:22:53.224729+0000","last_clean":"2024-09-12T19:22:53.224729+0000","last_became_active":"2024-09-12T17:51:52.898903+0000","last_became_peered":"2024-09-12T17:51:52.898903+0000","last_unstale":"2024-09-12T19:22:53.224729+0000","last_undegraded":"2024-09-12T19:22:53.224729+0000","last_fullsized":"2024-09-12T19:22:53.224729+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:34:05.020501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'42","reported_seq":202,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.727948+0000","last_change":"2024-09-12T19:23:45.727948+0000","last_active":"2024-09-12T19:23:45.727948+0000","last_peered":"2024-09-12T19:23:45.727948+0000","last_clean":"2024-09-12T19:23:45.727948+0000","last_became_active":"2024-09-12T17:45:41.576921+0000","last_became_peered":"2024-09-12T17:45:41.576921+0000","last_unstale":"2024-09-12T19:23:45.727948+0000","last_undegraded":"2024-09-12T19:23:45.727948+0000","last_fullsized":"2024-09-12T19:23:45.727948+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'42","last_scrub_stamp":"2024-09-12T19:23:45.727767+0000","last_deep_scrub":"267'42","last_deep_scrub_stamp":"2024-09-12T19:23:45.727767+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.727767+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:24.431823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":172,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:22.973830+0000","last_change":"2024-09-12T18:19:22.670182+0000","last_active":"2024-09-12T19:20:22.973830+0000","last_peered":"2024-09-12T19:20:22.973830+0000","last_clean":"2024-09-12T19:20:22.973830+0000","last_became_active":"2024-09-12T18:19:22.669476+0000","last_became_peered":"2024-09-12T18:19:22.669476+0000","last_unstale":"2024-09-12T19:20:22.973830+0000","last_undegraded":"2024-09-12T19:20:22.973830+0000","last_fullsized":"2024-09-12T19:20:22.973830+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:51.189488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:52.980628+0000","last_change":"2024-09-12T17:51:59.939499+0000","last_active":"2024-09-12T19:20:52.980628+0000","last_peered":"2024-09-12T19:20:52.980628+0000","last_clean":"2024-09-12T19:20:52.980628+0000","last_became_active":"2024-09-12T17:51:59.938736+0000","last_became_peered":"2024-09-12T17:51:59.938736+0000","last_unstale":"2024-09-12T19:20:52.980628+0000","last_undegraded":"2024-09-12T19:20:52.980628+0000","last_fullsized":"2024-09-12T19:20:52.980628+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:10.628111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'2","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.741744+0000","last_change":"2024-09-12T19:23:42.741744+0000","last_active":"2024-09-12T19:23:42.741744+0000","last_peered":"2024-09-12T19:23:42.741744+0000","last_clean":"2024-09-12T19:23:42.741744+0000","last_became_active":"2024-09-12T17:51:52.900972+0000","last_became_peered":"2024-09-12T17:51:52.900972+0000","last_unstale":"2024-09-12T19:23:42.741744+0000","last_undegraded":"2024-09-12T19:23:42.741744+0000","last_fullsized":"2024-09-12T19:23:42.741744+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:42.741557+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:42.741557+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.741557+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:30.376497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'26","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:46.107274+0000","last_change":"2024-09-12T19:23:46.107274+0000","last_active":"2024-09-12T19:23:46.107274+0000","last_peered":"2024-09-12T19:23:46.107274+0000","last_clean":"2024-09-12T19:23:46.107274+0000","last_became_active":"2024-09-12T17:45:41.588013+0000","last_became_peered":"2024-09-12T17:45:41.588013+0000","last_unstale":"2024-09-12T19:23:46.107274+0000","last_undegraded":"2024-09-12T19:23:46.107274+0000","last_fullsized":"2024-09-12T19:23:46.107274+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-09-12T19:23:46.107067+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-09-12T19:23:46.107067+0000","last_clean_scrub_stamp":"2024-09-12T19:23:46.107067+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:10.161274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":89,"num_write":52,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:07.970160+0000","last_change":"2024-09-12T18:19:22.664050+0000","last_active":"2024-09-12T19:20:07.970160+0000","last_peered":"2024-09-12T19:20:07.970160+0000","last_clean":"2024-09-12T19:20:07.970160+0000","last_became_active":"2024-09-12T18:19:22.662685+0000","last_became_peered":"2024-09-12T18:19:22.662685+0000","last_unstale":"2024-09-12T19:20:07.970160+0000","last_undegraded":"2024-09-12T19:20:07.970160+0000","last_fullsized":"2024-09-12T19:20:07.970160+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:20.137876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'10","reported_seq":94,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.747751+0000","last_change":"2024-09-12T19:23:44.747751+0000","last_active":"2024-09-12T19:23:44.747751+0000","last_peered":"2024-09-12T19:23:44.747751+0000","last_clean":"2024-09-12T19:23:44.747751+0000","last_became_active":"2024-09-12T17:51:59.942597+0000","last_became_peered":"2024-09-12T17:51:59.942597+0000","last_unstale":"2024-09-12T19:23:44.747751+0000","last_undegraded":"2024-09-12T19:23:44.747751+0000","last_fullsized":"2024-09-12T19:23:44.747751+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'10","last_scrub_stamp":"2024-09-12T19:23:44.747561+0000","last_deep_scrub":"267'10","last_deep_scrub_stamp":"2024-09-12T19:23:44.747561+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.747561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:46.937016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":29698,"num_write":10,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"267'3","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:01.116269+0000","last_change":"2024-09-12T17:51:52.908849+0000","last_active":"2024-09-12T19:23:01.116269+0000","last_peered":"2024-09-12T19:23:01.116269+0000","last_clean":"2024-09-12T19:23:01.116269+0000","last_became_active":"2024-09-12T17:51:52.908200+0000","last_became_peered":"2024-09-12T17:51:52.908200+0000","last_unstale":"2024-09-12T19:23:01.116269+0000","last_undegraded":"2024-09-12T19:23:01.116269+0000","last_fullsized":"2024-09-12T19:23:01.116269+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'15","reported_seq":119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:03.272080+0000","last_change":"2024-09-12T17:45:41.578047+0000","last_active":"2024-09-12T19:21:03.272080+0000","last_peered":"2024-09-12T19:21:03.272080+0000","last_clean":"2024-09-12T19:21:03.272080+0000","last_became_active":"2024-09-12T17:45:41.572067+0000","last_became_peered":"2024-09-12T17:45:41.572067+0000","last_unstale":"2024-09-12T19:21:03.272080+0000","last_undegraded":"2024-09-12T19:21:03.272080+0000","last_fullsized":"2024-09-12T19:21:03.272080+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:45:40.519079+0000","last_clean_scrub_stamp":"2024-09-12T17:45:40.519079+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:08.187554+0000","last_change":"2024-09-12T18:19:22.653075+0000","last_active":"2024-09-12T19:20:08.187554+0000","last_peered":"2024-09-12T19:20:08.187554+0000","last_clean":"2024-09-12T19:20:08.187554+0000","last_became_active":"2024-09-12T18:19:22.648052+0000","last_became_peered":"2024-09-12T18:19:22.648052+0000","last_unstale":"2024-09-12T19:20:08.187554+0000","last_undegraded":"2024-09-12T19:20:08.187554+0000","last_fullsized":"2024-09-12T19:20:08.187554+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:19.707016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"267'8","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:00.314590+0000","last_change":"2024-09-12T17:51:59.949619+0000","last_active":"2024-09-12T19:23:00.314590+0000","last_peered":"2024-09-12T19:23:00.314590+0000","last_clean":"2024-09-12T19:23:00.314590+0000","last_became_active":"2024-09-12T17:51:59.948873+0000","last_became_peered":"2024-09-12T17:51:59.948873+0000","last_unstale":"2024-09-12T19:23:00.314590+0000","last_undegraded":"2024-09-12T19:23:00.314590+0000","last_fullsized":"2024-09-12T19:23:00.314590+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'2","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:47.040142+0000","last_change":"2024-09-12T19:23:47.040142+0000","last_active":"2024-09-12T19:23:47.040142+0000","last_peered":"2024-09-12T19:23:47.040142+0000","last_clean":"2024-09-12T19:23:47.040142+0000","last_became_active":"2024-09-12T17:51:52.889529+0000","last_became_peered":"2024-09-12T17:51:52.889529+0000","last_unstale":"2024-09-12T19:23:47.040142+0000","last_undegraded":"2024-09-12T19:23:47.040142+0000","last_fullsized":"2024-09-12T19:23:47.040142+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:23:47.039949+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:23:47.039949+0000","last_clean_scrub_stamp":"2024-09-12T19:23:47.039949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:13.335803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'21","reported_seq":144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.354478+0000","last_change":"2024-09-12T19:23:34.354478+0000","last_active":"2024-09-12T19:23:34.354478+0000","last_peered":"2024-09-12T19:23:34.354478+0000","last_clean":"2024-09-12T19:23:34.354478+0000","last_became_active":"2024-09-12T17:45:41.579580+0000","last_became_peered":"2024-09-12T17:45:41.579580+0000","last_unstale":"2024-09-12T19:23:34.354478+0000","last_undegraded":"2024-09-12T19:23:34.354478+0000","last_fullsized":"2024-09-12T19:23:34.354478+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'21","last_scrub_stamp":"2024-09-12T19:23:34.354300+0000","last_deep_scrub":"267'21","last_deep_scrub_stamp":"2024-09-12T19:23:34.354300+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.354300+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:11.810963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":77,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.964979+0000","last_change":"2024-09-12T18:19:22.669927+0000","last_active":"2024-09-12T19:19:47.964979+0000","last_peered":"2024-09-12T19:19:47.964979+0000","last_clean":"2024-09-12T19:19:47.964979+0000","last_became_active":"2024-09-12T18:19:22.669240+0000","last_became_peered":"2024-09-12T18:19:22.669240+0000","last_unstale":"2024-09-12T19:19:47.964979+0000","last_undegraded":"2024-09-12T19:19:47.964979+0000","last_fullsized":"2024-09-12T19:19:47.964979+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:35.739210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.182370+0000","last_change":"2024-09-12T17:51:59.970451+0000","last_active":"2024-09-12T19:19:48.182370+0000","last_peered":"2024-09-12T19:19:48.182370+0000","last_clean":"2024-09-12T19:19:48.182370+0000","last_became_active":"2024-09-12T17:51:59.969706+0000","last_became_peered":"2024-09-12T17:51:59.969706+0000","last_unstale":"2024-09-12T19:19:48.182370+0000","last_undegraded":"2024-09-12T19:19:48.182370+0000","last_fullsized":"2024-09-12T19:19:48.182370+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:53.849725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'6","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:27.989883+0000","last_change":"2024-09-12T17:51:52.884785+0000","last_active":"2024-09-12T19:21:27.989883+0000","last_peered":"2024-09-12T19:21:27.989883+0000","last_clean":"2024-09-12T19:21:27.989883+0000","last_became_active":"2024-09-12T17:51:52.884061+0000","last_became_peered":"2024-09-12T17:51:52.884061+0000","last_unstale":"2024-09-12T19:21:27.989883+0000","last_undegraded":"2024-09-12T19:21:27.989883+0000","last_fullsized":"2024-09-12T19:21:27.989883+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'29","reported_seq":168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:47.731710+0000","last_change":"2024-09-12T19:23:47.731710+0000","last_active":"2024-09-12T19:23:47.731710+0000","last_peered":"2024-09-12T19:23:47.731710+0000","last_clean":"2024-09-12T19:23:47.731710+0000","last_became_active":"2024-09-12T17:45:41.572130+0000","last_became_peered":"2024-09-12T17:45:41.572130+0000","last_unstale":"2024-09-12T19:23:47.731710+0000","last_undegraded":"2024-09-12T19:23:47.731710+0000","last_fullsized":"2024-09-12T19:23:47.731710+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-12T19:23:47.731427+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-12T19:23:47.731427+0000","last_clean_scrub_stamp":"2024-09-12T19:23:47.731427+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:51.880356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":63,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:47.982479+0000","last_change":"2024-09-12T18:19:22.667322+0000","last_active":"2024-09-12T19:19:47.982479+0000","last_peered":"2024-09-12T19:19:47.982479+0000","last_clean":"2024-09-12T19:19:47.982479+0000","last_became_active":"2024-09-12T18:19:22.666608+0000","last_became_peered":"2024-09-12T18:19:22.666608+0000","last_unstale":"2024-09-12T19:19:47.982479+0000","last_undegraded":"2024-09-12T19:19:47.982479+0000","last_fullsized":"2024-09-12T19:19:47.982479+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:35.427234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'2","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:38.209619+0000","last_change":"2024-09-12T17:51:59.956619+0000","last_active":"2024-09-12T19:21:38.209619+0000","last_peered":"2024-09-12T19:21:38.209619+0000","last_clean":"2024-09-12T19:21:38.209619+0000","last_became_active":"2024-09-12T17:51:59.956010+0000","last_became_peered":"2024-09-12T17:51:59.956010+0000","last_unstale":"2024-09-12T19:21:38.209619+0000","last_undegraded":"2024-09-12T19:21:38.209619+0000","last_fullsized":"2024-09-12T19:21:38.209619+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'2","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.869054+0000","last_change":"2024-09-12T19:23:37.868902+0000","last_active":"2024-09-12T19:23:37.869054+0000","last_peered":"2024-09-12T19:23:37.869054+0000","last_clean":"2024-09-12T19:23:37.869054+0000","last_became_active":"2024-09-12T17:51:52.903355+0000","last_became_peered":"2024-09-12T17:51:52.903355+0000","last_unstale":"2024-09-12T19:23:37.869054+0000","last_undegraded":"2024-09-12T19:23:37.869054+0000","last_fullsized":"2024-09-12T19:23:37.869054+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:23:37.868720+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:23:37.868720+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.868720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:29.790506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'38","reported_seq":193,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.383832+0000","last_change":"2024-09-12T19:23:33.383832+0000","last_active":"2024-09-12T19:23:33.383832+0000","last_peered":"2024-09-12T19:23:33.383832+0000","last_clean":"2024-09-12T19:23:33.383832+0000","last_became_active":"2024-09-12T17:45:41.577322+0000","last_became_peered":"2024-09-12T17:45:41.577322+0000","last_unstale":"2024-09-12T19:23:33.383832+0000","last_undegraded":"2024-09-12T19:23:33.383832+0000","last_fullsized":"2024-09-12T19:23:33.383832+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'38","last_scrub_stamp":"2024-09-12T19:23:33.383649+0000","last_deep_scrub":"267'38","last_deep_scrub_stamp":"2024-09-12T19:23:33.383649+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.383649+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:12.349851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":139,"num_write":67,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.760559+0000","last_change":"2024-09-12T19:23:43.760559+0000","last_active":"2024-09-12T19:23:43.760559+0000","last_peered":"2024-09-12T19:23:43.760559+0000","last_clean":"2024-09-12T19:23:43.760559+0000","last_became_active":"2024-09-12T18:19:22.647003+0000","last_became_peered":"2024-09-12T18:19:22.647003+0000","last_unstale":"2024-09-12T19:23:43.760559+0000","last_undegraded":"2024-09-12T19:23:43.760559+0000","last_fullsized":"2024-09-12T19:23:43.760559+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:43.760345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:43.760345+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.760345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:43.242394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.986890+0000","last_change":"2024-09-12T17:51:59.940082+0000","last_active":"2024-09-12T19:22:58.986890+0000","last_peered":"2024-09-12T19:22:58.986890+0000","last_clean":"2024-09-12T19:22:58.986890+0000","last_became_active":"2024-09-12T17:51:59.939200+0000","last_became_peered":"2024-09-12T17:51:59.939200+0000","last_unstale":"2024-09-12T19:22:58.986890+0000","last_undegraded":"2024-09-12T19:22:58.986890+0000","last_fullsized":"2024-09-12T19:22:58.986890+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:37.667275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"267'6","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:58.988584+0000","last_change":"2024-09-12T17:51:52.897536+0000","last_active":"2024-09-12T19:22:58.988584+0000","last_peered":"2024-09-12T19:22:58.988584+0000","last_clean":"2024-09-12T19:22:58.988584+0000","last_became_active":"2024-09-12T17:51:52.896708+0000","last_became_peered":"2024-09-12T17:51:52.896708+0000","last_unstale":"2024-09-12T19:22:58.988584+0000","last_undegraded":"2024-09-12T19:22:58.988584+0000","last_fullsized":"2024-09-12T19:22:58.988584+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:36.334907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'29","reported_seq":167,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.126393+0000","last_change":"2024-09-12T19:23:45.126393+0000","last_active":"2024-09-12T19:23:45.126393+0000","last_peered":"2024-09-12T19:23:45.126393+0000","last_clean":"2024-09-12T19:23:45.126393+0000","last_became_active":"2024-09-12T17:45:41.591866+0000","last_became_peered":"2024-09-12T17:45:41.591866+0000","last_unstale":"2024-09-12T19:23:45.126393+0000","last_undegraded":"2024-09-12T19:23:45.126393+0000","last_fullsized":"2024-09-12T19:23:45.126393+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-12T19:23:45.126211+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-12T19:23:45.126211+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.126211+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:17.439558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.192729+0000","last_change":"2024-09-12T18:19:22.661674+0000","last_active":"2024-09-12T19:19:48.192729+0000","last_peered":"2024-09-12T19:19:48.192729+0000","last_clean":"2024-09-12T19:19:48.192729+0000","last_became_active":"2024-09-12T18:19:22.660667+0000","last_became_peered":"2024-09-12T18:19:22.660667+0000","last_unstale":"2024-09-12T19:19:48.192729+0000","last_undegraded":"2024-09-12T19:19:48.192729+0000","last_fullsized":"2024-09-12T19:19:48.192729+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:47.455186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:53.208174+0000","last_change":"2024-09-12T17:51:59.949737+0000","last_active":"2024-09-12T19:20:53.208174+0000","last_peered":"2024-09-12T19:20:53.208174+0000","last_clean":"2024-09-12T19:20:53.208174+0000","last_became_active":"2024-09-12T17:51:59.948786+0000","last_became_peered":"2024-09-12T17:51:59.948786+0000","last_unstale":"2024-09-12T19:20:53.208174+0000","last_undegraded":"2024-09-12T19:20:53.208174+0000","last_fullsized":"2024-09-12T19:20:53.208174+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:33.491621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:42.978565+0000","last_change":"2024-09-12T17:51:52.896511+0000","last_active":"2024-09-12T19:20:42.978565+0000","last_peered":"2024-09-12T19:20:42.978565+0000","last_clean":"2024-09-12T19:20:42.978565+0000","last_became_active":"2024-09-12T17:51:52.895779+0000","last_became_peered":"2024-09-12T17:51:52.895779+0000","last_unstale":"2024-09-12T19:20:42.978565+0000","last_undegraded":"2024-09-12T19:20:42.978565+0000","last_fullsized":"2024-09-12T19:20:42.978565+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:33:11.529897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'43","reported_seq":214,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.682157+0000","last_change":"2024-09-12T19:23:37.681979+0000","last_active":"2024-09-12T19:23:37.682157+0000","last_peered":"2024-09-12T19:23:37.682157+0000","last_clean":"2024-09-12T19:23:37.682157+0000","last_became_active":"2024-09-12T17:45:41.576707+0000","last_became_peered":"2024-09-12T17:45:41.576707+0000","last_unstale":"2024-09-12T19:23:37.682157+0000","last_undegraded":"2024-09-12T19:23:37.682157+0000","last_fullsized":"2024-09-12T19:23:37.682157+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'43","last_scrub_stamp":"2024-09-12T19:23:37.681798+0000","last_deep_scrub":"267'43","last_deep_scrub_stamp":"2024-09-12T19:23:37.681798+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.681798+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:07.348875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":167,"num_write":65,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'2","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.946038+0000","last_change":"2024-09-12T19:23:33.946038+0000","last_active":"2024-09-12T19:23:33.946038+0000","last_peered":"2024-09-12T19:23:33.946038+0000","last_clean":"2024-09-12T19:23:33.946038+0000","last_became_active":"2024-09-12T18:19:22.657891+0000","last_became_peered":"2024-09-12T18:19:22.657891+0000","last_unstale":"2024-09-12T19:23:33.946038+0000","last_undegraded":"2024-09-12T19:23:33.946038+0000","last_fullsized":"2024-09-12T19:23:33.946038+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:33.945861+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:33.945861+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.945861+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:53.760623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'3","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:38.000490+0000","last_change":"2024-09-12T17:51:59.963668+0000","last_active":"2024-09-12T19:21:38.000490+0000","last_peered":"2024-09-12T19:21:38.000490+0000","last_clean":"2024-09-12T19:21:38.000490+0000","last_became_active":"2024-09-12T17:51:59.962769+0000","last_became_peered":"2024-09-12T17:51:59.962769+0000","last_unstale":"2024-09-12T19:21:38.000490+0000","last_undegraded":"2024-09-12T19:21:38.000490+0000","last_fullsized":"2024-09-12T19:21:38.000490+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'5","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:12.971293+0000","last_change":"2024-09-12T17:51:52.902253+0000","last_active":"2024-09-12T19:20:12.971293+0000","last_peered":"2024-09-12T19:20:12.971293+0000","last_clean":"2024-09-12T19:20:12.971293+0000","last_became_active":"2024-09-12T17:51:52.899987+0000","last_became_peered":"2024-09-12T17:51:52.899987+0000","last_unstale":"2024-09-12T19:20:12.971293+0000","last_undegraded":"2024-09-12T19:20:12.971293+0000","last_fullsized":"2024-09-12T19:20:12.971293+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:40.914632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'9","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.320833+0000","last_change":"2024-09-12T19:23:45.320833+0000","last_active":"2024-09-12T19:23:45.320833+0000","last_peered":"2024-09-12T19:23:45.320833+0000","last_clean":"2024-09-12T19:23:45.320833+0000","last_became_active":"2024-09-12T17:45:41.569871+0000","last_became_peered":"2024-09-12T17:45:41.569871+0000","last_unstale":"2024-09-12T19:23:45.320833+0000","last_undegraded":"2024-09-12T19:23:45.320833+0000","last_fullsized":"2024-09-12T19:23:45.320833+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'9","last_scrub_stamp":"2024-09-12T19:23:45.320654+0000","last_deep_scrub":"267'9","last_deep_scrub_stamp":"2024-09-12T19:23:45.320654+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.320654+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:45.364355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:03.186072+0000","last_change":"2024-09-12T18:19:22.663293+0000","last_active":"2024-09-12T19:20:03.186072+0000","last_peered":"2024-09-12T19:20:03.186072+0000","last_clean":"2024-09-12T19:20:03.186072+0000","last_became_active":"2024-09-12T18:19:22.648018+0000","last_became_peered":"2024-09-12T18:19:22.648018+0000","last_unstale":"2024-09-12T19:20:03.186072+0000","last_undegraded":"2024-09-12T19:20:03.186072+0000","last_fullsized":"2024-09-12T19:20:03.186072+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:02.291028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'7","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:27.992212+0000","last_change":"2024-09-12T17:51:59.944498+0000","last_active":"2024-09-12T19:20:27.992212+0000","last_peered":"2024-09-12T19:20:27.992212+0000","last_clean":"2024-09-12T19:20:27.992212+0000","last_became_active":"2024-09-12T17:51:59.943764+0000","last_became_peered":"2024-09-12T17:51:59.943764+0000","last_unstale":"2024-09-12T19:20:27.992212+0000","last_undegraded":"2024-09-12T19:20:27.992212+0000","last_fullsized":"2024-09-12T19:20:27.992212+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:10.664480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20800,"num_write":12,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:27.989735+0000","last_change":"2024-09-12T17:51:52.894510+0000","last_active":"2024-09-12T19:21:27.989735+0000","last_peered":"2024-09-12T19:21:27.989735+0000","last_clean":"2024-09-12T19:21:27.989735+0000","last_became_active":"2024-09-12T17:51:52.893764+0000","last_became_peered":"2024-09-12T17:51:52.893764+0000","last_unstale":"2024-09-12T19:21:27.989735+0000","last_undegraded":"2024-09-12T19:21:27.989735+0000","last_fullsized":"2024-09-12T19:21:27.989735+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'85","reported_seq":322,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.009230+0000","last_change":"2024-09-12T19:23:44.009230+0000","last_active":"2024-09-12T19:23:44.009230+0000","last_peered":"2024-09-12T19:23:44.009230+0000","last_clean":"2024-09-12T19:23:44.009230+0000","last_became_active":"2024-09-12T17:45:41.576079+0000","last_became_peered":"2024-09-12T17:45:41.576079+0000","last_unstale":"2024-09-12T19:23:44.009230+0000","last_undegraded":"2024-09-12T19:23:44.009230+0000","last_fullsized":"2024-09-12T19:23:44.009230+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'85","last_scrub_stamp":"2024-09-12T19:23:44.009038+0000","last_deep_scrub":"267'85","last_deep_scrub_stamp":"2024-09-12T19:23:44.009038+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.009038+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:50.593899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":312,"num_write":160,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:48.182314+0000","last_change":"2024-09-12T18:19:22.663744+0000","last_active":"2024-09-12T19:19:48.182314+0000","last_peered":"2024-09-12T19:19:48.182314+0000","last_clean":"2024-09-12T19:19:48.182314+0000","last_became_active":"2024-09-12T18:19:22.662955+0000","last_became_peered":"2024-09-12T18:19:22.662955+0000","last_unstale":"2024-09-12T19:19:48.182314+0000","last_undegraded":"2024-09-12T19:19:48.182314+0000","last_fullsized":"2024-09-12T19:19:48.182314+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:06.958542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.300955+0000","last_change":"2024-09-12T19:23:43.300831+0000","last_active":"2024-09-12T19:23:43.300955+0000","last_peered":"2024-09-12T19:23:43.300955+0000","last_clean":"2024-09-12T19:23:43.300955+0000","last_became_active":"2024-09-12T17:51:59.942275+0000","last_became_peered":"2024-09-12T17:51:59.942275+0000","last_unstale":"2024-09-12T19:23:43.300955+0000","last_undegraded":"2024-09-12T19:23:43.300955+0000","last_fullsized":"2024-09-12T19:23:43.300955+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:43.300653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:43.300653+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.300653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:31.246433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.725109+0000","last_change":"2024-09-12T19:23:40.725109+0000","last_active":"2024-09-12T19:23:40.725109+0000","last_peered":"2024-09-12T19:23:40.725109+0000","last_clean":"2024-09-12T19:23:40.725109+0000","last_became_active":"2024-09-12T17:51:52.895913+0000","last_became_peered":"2024-09-12T17:51:52.895913+0000","last_unstale":"2024-09-12T19:23:40.725109+0000","last_undegraded":"2024-09-12T19:23:40.725109+0000","last_fullsized":"2024-09-12T19:23:40.725109+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:40.724930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:40.724930+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.724930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:34.829056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'8","reported_seq":111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.342466+0000","last_change":"2024-09-12T19:23:36.342301+0000","last_active":"2024-09-12T19:23:36.342466+0000","last_peered":"2024-09-12T19:23:36.342466+0000","last_clean":"2024-09-12T19:23:36.342466+0000","last_became_active":"2024-09-12T17:45:41.576841+0000","last_became_peered":"2024-09-12T17:45:41.576841+0000","last_unstale":"2024-09-12T19:23:36.342466+0000","last_undegraded":"2024-09-12T19:23:36.342466+0000","last_fullsized":"2024-09-12T19:23:36.342466+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T19:23:36.342110+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T19:23:36.342110+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.342110+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:35.442446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:02.968901+0000","last_change":"2024-09-12T18:19:22.663672+0000","last_active":"2024-09-12T19:20:02.968901+0000","last_peered":"2024-09-12T19:20:02.968901+0000","last_clean":"2024-09-12T19:20:02.968901+0000","last_became_active":"2024-09-12T18:19:22.662633+0000","last_became_peered":"2024-09-12T18:19:22.662633+0000","last_unstale":"2024-09-12T19:20:02.968901+0000","last_undegraded":"2024-09-12T19:20:02.968901+0000","last_fullsized":"2024-09-12T19:20:02.968901+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:40.210719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:38.218439+0000","last_change":"2024-09-12T17:51:59.929795+0000","last_active":"2024-09-12T19:21:38.218439+0000","last_peered":"2024-09-12T19:21:38.218439+0000","last_clean":"2024-09-12T19:21:38.218439+0000","last_became_active":"2024-09-12T17:51:59.929108+0000","last_became_peered":"2024-09-12T17:51:59.929108+0000","last_unstale":"2024-09-12T19:21:38.218439+0000","last_undegraded":"2024-09-12T19:21:38.218439+0000","last_fullsized":"2024-09-12T19:21:38.218439+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"267'2","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.264589+0000","last_change":"2024-09-12T19:23:38.264589+0000","last_active":"2024-09-12T19:23:38.264589+0000","last_peered":"2024-09-12T19:23:38.264589+0000","last_clean":"2024-09-12T19:23:38.264589+0000","last_became_active":"2024-09-12T17:51:52.876809+0000","last_became_peered":"2024-09-12T17:51:52.876809+0000","last_unstale":"2024-09-12T19:23:38.264589+0000","last_undegraded":"2024-09-12T19:23:38.264589+0000","last_fullsized":"2024-09-12T19:23:38.264589+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:38.264407+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:38.264407+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.264407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:47.457682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":5,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'24","reported_seq":154,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.137407+0000","last_change":"2024-09-12T19:23:44.137407+0000","last_active":"2024-09-12T19:23:44.137407+0000","last_peered":"2024-09-12T19:23:44.137407+0000","last_clean":"2024-09-12T19:23:44.137407+0000","last_became_active":"2024-09-12T17:45:41.587464+0000","last_became_peered":"2024-09-12T17:45:41.587464+0000","last_unstale":"2024-09-12T19:23:44.137407+0000","last_undegraded":"2024-09-12T19:23:44.137407+0000","last_fullsized":"2024-09-12T19:23:44.137407+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'24","last_scrub_stamp":"2024-09-12T19:23:44.137217+0000","last_deep_scrub":"267'24","last_deep_scrub_stamp":"2024-09-12T19:23:44.137217+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.137217+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:46.257126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":80,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'298","reported_seq":957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.108249+0000","last_change":"2024-09-12T19:23:21.108249+0000","last_active":"2024-09-12T19:23:21.108249+0000","last_peered":"2024-09-12T19:23:21.108249+0000","last_clean":"2024-09-12T19:23:21.108249+0000","last_became_active":"2024-09-12T17:29:52.754920+0000","last_became_peered":"2024-09-12T17:29:52.754920+0000","last_unstale":"2024-09-12T19:23:21.108249+0000","last_undegraded":"2024-09-12T19:23:21.108249+0000","last_fullsized":"2024-09-12T19:23:21.108249+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'298","last_scrub_stamp":"2024-09-12T19:23:21.108016+0000","last_deep_scrub":"267'298","last_deep_scrub_stamp":"2024-09-12T19:23:21.108016+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.108016+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:55.221859+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262253,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":663,"num_write":1055,"num_write_kb":22160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'507","reported_seq":2214,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.392030+0000","last_change":"2024-09-12T19:23:26.392030+0000","last_active":"2024-09-12T19:23:26.392030+0000","last_peered":"2024-09-12T19:23:26.392030+0000","last_clean":"2024-09-12T19:23:26.392030+0000","last_became_active":"2024-09-12T17:29:54.760892+0000","last_became_peered":"2024-09-12T17:29:54.760892+0000","last_unstale":"2024-09-12T19:23:26.392030+0000","last_undegraded":"2024-09-12T19:23:26.392030+0000","last_fullsized":"2024-09-12T19:23:26.392030+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'507","last_scrub_stamp":"2024-09-12T19:23:26.391829+0000","last_deep_scrub":"267'507","last_deep_scrub_stamp":"2024-09-12T19:23:26.391829+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.391829+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:48.210092+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2904,"num_read_kb":2740,"num_write":620,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'340","reported_seq":1036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.713604+0000","last_change":"2024-09-12T19:23:17.713604+0000","last_active":"2024-09-12T19:23:17.713604+0000","last_peered":"2024-09-12T19:23:17.713604+0000","last_clean":"2024-09-12T19:23:17.713604+0000","last_became_active":"2024-09-12T17:29:52.747481+0000","last_became_peered":"2024-09-12T17:29:52.747481+0000","last_unstale":"2024-09-12T19:23:17.713604+0000","last_undegraded":"2024-09-12T19:23:17.713604+0000","last_fullsized":"2024-09-12T19:23:17.713604+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'340","last_scrub_stamp":"2024-09-12T19:23:17.713262+0000","last_deep_scrub":"267'340","last_deep_scrub_stamp":"2024-09-12T19:23:17.713262+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.713262+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:02.653602+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306162,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":522,"num_read_kb":19278,"num_write":1123,"num_write_kb":29260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'431","reported_seq":1902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.096403+0000","last_change":"2024-09-12T19:23:30.096403+0000","last_active":"2024-09-12T19:23:30.096403+0000","last_peered":"2024-09-12T19:23:30.096403+0000","last_clean":"2024-09-12T19:23:30.096403+0000","last_became_active":"2024-09-12T17:29:54.753272+0000","last_became_peered":"2024-09-12T17:29:54.753272+0000","last_unstale":"2024-09-12T19:23:30.096403+0000","last_undegraded":"2024-09-12T19:23:30.096403+0000","last_fullsized":"2024-09-12T19:23:30.096403+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'431","last_scrub_stamp":"2024-09-12T19:23:30.096150+0000","last_deep_scrub":"267'431","last_deep_scrub_stamp":"2024-09-12T19:23:30.096150+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.096150+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:52.937689+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2129,"num_read_kb":2000,"num_write":496,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'342","reported_seq":1041,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:08.906121+0000","last_change":"2024-09-12T19:23:08.906121+0000","last_active":"2024-09-12T19:23:08.906121+0000","last_peered":"2024-09-12T19:23:08.906121+0000","last_clean":"2024-09-12T19:23:08.906121+0000","last_became_active":"2024-09-12T17:29:52.735978+0000","last_became_peered":"2024-09-12T17:29:52.735978+0000","last_unstale":"2024-09-12T19:23:08.906121+0000","last_undegraded":"2024-09-12T19:23:08.906121+0000","last_fullsized":"2024-09-12T19:23:08.906121+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'342","last_scrub_stamp":"2024-09-12T19:23:08.905981+0000","last_deep_scrub":"267'342","last_deep_scrub_stamp":"2024-09-12T19:23:08.905981+0000","last_clean_scrub_stamp":"2024-09-12T19:23:08.905981+0000","objects_scrubbed":10,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:12.305189+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2553570,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":504,"num_read_kb":35253,"num_write":1107,"num_write_kb":35855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'940","reported_seq":2615,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.215432+0000","last_change":"2024-09-12T19:23:27.215432+0000","last_active":"2024-09-12T19:23:27.215432+0000","last_peered":"2024-09-12T19:23:27.215432+0000","last_clean":"2024-09-12T19:23:27.215432+0000","last_became_active":"2024-09-12T17:29:54.770286+0000","last_became_peered":"2024-09-12T17:29:54.770286+0000","last_unstale":"2024-09-12T19:23:27.215432+0000","last_undegraded":"2024-09-12T19:23:27.215432+0000","last_fullsized":"2024-09-12T19:23:27.215432+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'940","last_scrub_stamp":"2024-09-12T19:23:27.215139+0000","last_deep_scrub":"267'940","last_deep_scrub_stamp":"2024-09-12T19:23:27.215139+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.215139+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":900,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:57.585678+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4498,"num_read_kb":4029,"num_write":1285,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2544,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'344","reported_seq":1095,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.682756+0000","last_change":"2024-09-12T19:23:15.682756+0000","last_active":"2024-09-12T19:23:15.682756+0000","last_peered":"2024-09-12T19:23:15.682756+0000","last_clean":"2024-09-12T19:23:15.682756+0000","last_became_active":"2024-09-12T17:30:21.689546+0000","last_became_peered":"2024-09-12T17:30:21.689546+0000","last_unstale":"2024-09-12T19:23:15.682756+0000","last_undegraded":"2024-09-12T19:23:15.682756+0000","last_fullsized":"2024-09-12T19:23:15.682756+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'344","last_scrub_stamp":"2024-09-12T19:23:15.682534+0000","last_deep_scrub":"267'344","last_deep_scrub_stamp":"2024-09-12T19:23:15.682534+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.682534+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:01.240340+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170253,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":648,"num_read_kb":124307,"num_write":1100,"num_write_kb":33866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7,2],"acting":[1,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"267'841","reported_seq":2488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.786065+0000","last_change":"2024-09-12T19:23:27.786065+0000","last_active":"2024-09-12T19:23:27.786065+0000","last_peered":"2024-09-12T19:23:27.786065+0000","last_clean":"2024-09-12T19:23:27.786065+0000","last_became_active":"2024-09-12T17:29:54.760180+0000","last_became_peered":"2024-09-12T17:29:54.760180+0000","last_unstale":"2024-09-12T19:23:27.786065+0000","last_undegraded":"2024-09-12T19:23:27.786065+0000","last_fullsized":"2024-09-12T19:23:27.786065+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'841","last_scrub_stamp":"2024-09-12T19:23:27.785877+0000","last_deep_scrub":"267'841","last_deep_scrub_stamp":"2024-09-12T19:23:27.785877+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.785877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:05.230667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3987,"num_read_kb":3603,"num_write":1097,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'364","reported_seq":1016,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.084038+0000","last_change":"2024-09-12T19:23:22.084038+0000","last_active":"2024-09-12T19:23:22.084038+0000","last_peered":"2024-09-12T19:23:22.084038+0000","last_clean":"2024-09-12T19:23:22.084038+0000","last_became_active":"2024-09-12T17:29:52.744115+0000","last_became_peered":"2024-09-12T17:29:52.744115+0000","last_unstale":"2024-09-12T19:23:22.084038+0000","last_undegraded":"2024-09-12T19:23:22.084038+0000","last_fullsized":"2024-09-12T19:23:22.084038+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'364","last_scrub_stamp":"2024-09-12T19:23:22.083674+0000","last_deep_scrub":"267'364","last_deep_scrub_stamp":"2024-09-12T19:23:22.083674+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.083674+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:33.271484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262269,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":11709,"num_write":1093,"num_write_kb":63153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'872","reported_seq":2513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.240607+0000","last_change":"2024-09-12T19:23:20.240607+0000","last_active":"2024-09-12T19:23:20.240607+0000","last_peered":"2024-09-12T19:23:20.240607+0000","last_clean":"2024-09-12T19:23:20.240607+0000","last_became_active":"2024-09-12T17:29:54.758552+0000","last_became_peered":"2024-09-12T17:29:54.758552+0000","last_unstale":"2024-09-12T19:23:20.240607+0000","last_undegraded":"2024-09-12T19:23:20.240607+0000","last_fullsized":"2024-09-12T19:23:20.240607+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'872","last_scrub_stamp":"2024-09-12T19:23:20.240387+0000","last_deep_scrub":"267'872","last_deep_scrub_stamp":"2024-09-12T19:23:20.240387+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.240387+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:09.305077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4049,"num_read_kb":3640,"num_write":1140,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'353","reported_seq":1025,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.337794+0000","last_change":"2024-09-12T19:23:20.337794+0000","last_active":"2024-09-12T19:23:20.337794+0000","last_peered":"2024-09-12T19:23:20.337794+0000","last_clean":"2024-09-12T19:23:20.337794+0000","last_became_active":"2024-09-12T17:29:52.756242+0000","last_became_peered":"2024-09-12T17:29:52.756242+0000","last_unstale":"2024-09-12T19:23:20.337794+0000","last_undegraded":"2024-09-12T19:23:20.337794+0000","last_fullsized":"2024-09-12T19:23:20.337794+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'353","last_scrub_stamp":"2024-09-12T19:23:20.337459+0000","last_deep_scrub":"267'353","last_deep_scrub_stamp":"2024-09-12T19:23:20.337459+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.337459+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:26.759309+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311546,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":527,"num_read_kb":10971,"num_write":1015,"num_write_kb":29590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'392","reported_seq":1990,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.168012+0000","last_change":"2024-09-12T19:23:28.168012+0000","last_active":"2024-09-12T19:23:28.168012+0000","last_peered":"2024-09-12T19:23:28.168012+0000","last_clean":"2024-09-12T19:23:28.168012+0000","last_became_active":"2024-09-12T17:29:54.770050+0000","last_became_peered":"2024-09-12T17:29:54.770050+0000","last_unstale":"2024-09-12T19:23:28.168012+0000","last_undegraded":"2024-09-12T19:23:28.168012+0000","last_fullsized":"2024-09-12T19:23:28.168012+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'392","last_scrub_stamp":"2024-09-12T19:23:28.167823+0000","last_deep_scrub":"267'392","last_deep_scrub_stamp":"2024-09-12T19:23:28.167823+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.167823+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:05:18.931144+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2225,"num_read_kb":2129,"num_write":425,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":667,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'366","reported_seq":1027,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.068967+0000","last_change":"2024-09-12T19:23:20.068967+0000","last_active":"2024-09-12T19:23:20.068967+0000","last_peered":"2024-09-12T19:23:20.068967+0000","last_clean":"2024-09-12T19:23:20.068967+0000","last_became_active":"2024-09-12T17:29:52.762473+0000","last_became_peered":"2024-09-12T17:29:52.762473+0000","last_unstale":"2024-09-12T19:23:20.068967+0000","last_undegraded":"2024-09-12T19:23:20.068967+0000","last_fullsized":"2024-09-12T19:23:20.068967+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'366","last_scrub_stamp":"2024-09-12T19:23:20.068679+0000","last_deep_scrub":"267'366","last_deep_scrub_stamp":"2024-09-12T19:23:20.068679+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.068679+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:19.139220+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25719,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":480,"num_read_kb":16012,"num_write":1030,"num_write_kb":47372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'481","reported_seq":2022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.360178+0000","last_change":"2024-09-12T19:23:27.360178+0000","last_active":"2024-09-12T19:23:27.360178+0000","last_peered":"2024-09-12T19:23:27.360178+0000","last_clean":"2024-09-12T19:23:27.360178+0000","last_became_active":"2024-09-12T17:29:54.745833+0000","last_became_peered":"2024-09-12T17:29:54.745833+0000","last_unstale":"2024-09-12T19:23:27.360178+0000","last_undegraded":"2024-09-12T19:23:27.360178+0000","last_fullsized":"2024-09-12T19:23:27.360178+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'481","last_scrub_stamp":"2024-09-12T19:23:27.359982+0000","last_deep_scrub":"267'481","last_deep_scrub_stamp":"2024-09-12T19:23:27.359982+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.359982+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:27.719917+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2543,"num_read_kb":2369,"num_write":601,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'339","reported_seq":1125,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.105983+0000","last_change":"2024-09-12T19:23:19.105983+0000","last_active":"2024-09-12T19:23:19.105983+0000","last_peered":"2024-09-12T19:23:19.105983+0000","last_clean":"2024-09-12T19:23:19.105983+0000","last_became_active":"2024-09-12T17:29:52.730010+0000","last_became_peered":"2024-09-12T17:29:52.730010+0000","last_unstale":"2024-09-12T19:23:19.105983+0000","last_undegraded":"2024-09-12T19:23:19.105983+0000","last_fullsized":"2024-09-12T19:23:19.105983+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'339","last_scrub_stamp":"2024-09-12T19:23:19.105777+0000","last_deep_scrub":"267'339","last_deep_scrub_stamp":"2024-09-12T19:23:19.105777+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.105777+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:17.217745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580168,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":14958,"num_write":1088,"num_write_kb":34324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'424","reported_seq":2031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.913338+0000","last_change":"2024-09-12T19:23:16.913338+0000","last_active":"2024-09-12T19:23:16.913338+0000","last_peered":"2024-09-12T19:23:16.913338+0000","last_clean":"2024-09-12T19:23:16.913338+0000","last_became_active":"2024-09-12T17:29:54.755721+0000","last_became_peered":"2024-09-12T17:29:54.755721+0000","last_unstale":"2024-09-12T19:23:16.913338+0000","last_undegraded":"2024-09-12T19:23:16.913338+0000","last_fullsized":"2024-09-12T19:23:16.913338+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'424","last_scrub_stamp":"2024-09-12T19:23:16.913164+0000","last_deep_scrub":"267'424","last_deep_scrub_stamp":"2024-09-12T19:23:16.913164+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.913164+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:30.429196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2342,"num_read_kb":2221,"num_write":470,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1531,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'362","reported_seq":1940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.211026+0000","last_change":"2024-09-12T19:23:25.211026+0000","last_active":"2024-09-12T19:23:25.211026+0000","last_peered":"2024-09-12T19:23:25.211026+0000","last_clean":"2024-09-12T19:23:25.211026+0000","last_became_active":"2024-09-12T17:29:54.753012+0000","last_became_peered":"2024-09-12T17:29:54.753012+0000","last_unstale":"2024-09-12T19:23:25.211026+0000","last_undegraded":"2024-09-12T19:23:25.211026+0000","last_fullsized":"2024-09-12T19:23:25.211026+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-09-12T19:23:25.210742+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-09-12T19:23:25.210742+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.210742+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:09.088143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2149,"num_read_kb":2071,"num_write":395,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'362","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.093896+0000","last_change":"2024-09-12T19:23:19.093896+0000","last_active":"2024-09-12T19:23:19.093896+0000","last_peered":"2024-09-12T19:23:19.093896+0000","last_clean":"2024-09-12T19:23:19.093896+0000","last_became_active":"2024-09-12T17:29:52.747589+0000","last_became_peered":"2024-09-12T17:29:52.747589+0000","last_unstale":"2024-09-12T19:23:19.093896+0000","last_undegraded":"2024-09-12T19:23:19.093896+0000","last_fullsized":"2024-09-12T19:23:19.093896+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-09-12T19:23:19.093553+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-09-12T19:23:19.093553+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.093553+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:37.013602+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":507,"num_read_kb":50487,"num_write":1096,"num_write_kb":29653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'428","reported_seq":2001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.061297+0000","last_change":"2024-09-12T19:23:25.061297+0000","last_active":"2024-09-12T19:23:25.061297+0000","last_peered":"2024-09-12T19:23:25.061297+0000","last_clean":"2024-09-12T19:23:25.061297+0000","last_became_active":"2024-09-12T17:29:54.752373+0000","last_became_peered":"2024-09-12T17:29:54.752373+0000","last_unstale":"2024-09-12T19:23:25.061297+0000","last_undegraded":"2024-09-12T19:23:25.061297+0000","last_fullsized":"2024-09-12T19:23:25.061297+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'428","last_scrub_stamp":"2024-09-12T19:23:25.061115+0000","last_deep_scrub":"267'428","last_deep_scrub_stamp":"2024-09-12T19:23:25.061115+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.061115+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:07.521489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2327,"num_read_kb":2222,"num_write":465,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'338","reported_seq":1116,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.130740+0000","last_change":"2024-09-12T19:23:18.130740+0000","last_active":"2024-09-12T19:23:18.130740+0000","last_peered":"2024-09-12T19:23:18.130740+0000","last_clean":"2024-09-12T19:23:18.130740+0000","last_became_active":"2024-09-12T17:30:22.255773+0000","last_became_peered":"2024-09-12T17:30:22.255773+0000","last_unstale":"2024-09-12T19:23:18.130740+0000","last_undegraded":"2024-09-12T19:23:18.130740+0000","last_fullsized":"2024-09-12T19:23:18.130740+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'338","last_scrub_stamp":"2024-09-12T19:23:18.130470+0000","last_deep_scrub":"267'338","last_deep_scrub_stamp":"2024-09-12T19:23:18.130470+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.130470+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:35.478105+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364459,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":843,"num_read_kb":51980,"num_write":1145,"num_write_kb":60983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2,1],"acting":[3,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.32","version":"267'529","reported_seq":2190,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.368130+0000","last_change":"2024-09-12T19:23:24.368130+0000","last_active":"2024-09-12T19:23:24.368130+0000","last_peered":"2024-09-12T19:23:24.368130+0000","last_clean":"2024-09-12T19:23:24.368130+0000","last_became_active":"2024-09-12T17:29:54.771786+0000","last_became_peered":"2024-09-12T17:29:54.771786+0000","last_unstale":"2024-09-12T19:23:24.368130+0000","last_undegraded":"2024-09-12T19:23:24.368130+0000","last_fullsized":"2024-09-12T19:23:24.368130+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'529","last_scrub_stamp":"2024-09-12T19:23:24.367953+0000","last_deep_scrub":"267'529","last_deep_scrub_stamp":"2024-09-12T19:23:24.367953+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.367953+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:57:53.562274+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2657,"num_read_kb":2482,"num_write":638,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'438","reported_seq":1252,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.224353+0000","last_change":"2024-09-12T19:23:14.224171+0000","last_active":"2024-09-12T19:23:14.224353+0000","last_peered":"2024-09-12T19:23:14.224353+0000","last_clean":"2024-09-12T19:23:14.224353+0000","last_became_active":"2024-09-12T17:29:52.725473+0000","last_became_peered":"2024-09-12T17:29:52.725473+0000","last_unstale":"2024-09-12T19:23:14.224353+0000","last_undegraded":"2024-09-12T19:23:14.224353+0000","last_fullsized":"2024-09-12T19:23:14.224353+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'438","last_scrub_stamp":"2024-09-12T19:23:14.223910+0000","last_deep_scrub":"267'438","last_deep_scrub_stamp":"2024-09-12T19:23:14.223910+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.223910+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:40.091598+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3634873,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":934,"num_read_kb":41903,"num_write":1412,"num_write_kb":44280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'658","reported_seq":2291,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.984732+0000","last_change":"2024-09-12T19:23:13.984600+0000","last_active":"2024-09-12T19:23:13.984732+0000","last_peered":"2024-09-12T19:23:13.984732+0000","last_clean":"2024-09-12T19:23:13.984732+0000","last_became_active":"2024-09-12T17:29:54.754119+0000","last_became_peered":"2024-09-12T17:29:54.754119+0000","last_unstale":"2024-09-12T19:23:13.984732+0000","last_undegraded":"2024-09-12T19:23:13.984732+0000","last_fullsized":"2024-09-12T19:23:13.984732+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'658","last_scrub_stamp":"2024-09-12T19:23:13.984417+0000","last_deep_scrub":"267'658","last_deep_scrub_stamp":"2024-09-12T19:23:13.984417+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.984417+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":600,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:49.226444+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3376,"num_read_kb":3085,"num_write":861,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3276,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'319","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.237886+0000","last_change":"2024-09-12T19:23:12.237745+0000","last_active":"2024-09-12T19:23:12.237886+0000","last_peered":"2024-09-12T19:23:12.237886+0000","last_clean":"2024-09-12T19:23:12.237886+0000","last_became_active":"2024-09-12T17:29:52.764052+0000","last_became_peered":"2024-09-12T17:29:52.764052+0000","last_unstale":"2024-09-12T19:23:12.237886+0000","last_undegraded":"2024-09-12T19:23:12.237886+0000","last_fullsized":"2024-09-12T19:23:12.237886+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'319","last_scrub_stamp":"2024-09-12T19:23:12.237529+0000","last_deep_scrub":"267'319","last_deep_scrub_stamp":"2024-09-12T19:23:12.237529+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.237529+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:41.845980+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":477,"num_read_kb":61037,"num_write":999,"num_write_kb":13603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'894","reported_seq":2465,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.024053+0000","last_change":"2024-09-12T19:23:22.023908+0000","last_active":"2024-09-12T19:23:22.024053+0000","last_peered":"2024-09-12T19:23:22.024053+0000","last_clean":"2024-09-12T19:23:22.024053+0000","last_became_active":"2024-09-12T17:29:54.760746+0000","last_became_peered":"2024-09-12T17:29:54.760746+0000","last_unstale":"2024-09-12T19:23:22.024053+0000","last_undegraded":"2024-09-12T19:23:22.024053+0000","last_fullsized":"2024-09-12T19:23:22.024053+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'894","last_scrub_stamp":"2024-09-12T19:23:22.023716+0000","last_deep_scrub":"267'894","last_deep_scrub_stamp":"2024-09-12T19:23:22.023716+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.023716+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":800,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:10.198893+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4106,"num_read_kb":3659,"num_write":1202,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'393","reported_seq":1091,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.121327+0000","last_change":"2024-09-12T19:23:17.121182+0000","last_active":"2024-09-12T19:23:17.121327+0000","last_peered":"2024-09-12T19:23:17.121327+0000","last_clean":"2024-09-12T19:23:17.121327+0000","last_became_active":"2024-09-12T17:29:52.720974+0000","last_became_peered":"2024-09-12T17:29:52.720974+0000","last_unstale":"2024-09-12T19:23:17.121327+0000","last_undegraded":"2024-09-12T19:23:17.121327+0000","last_fullsized":"2024-09-12T19:23:17.121327+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'393","last_scrub_stamp":"2024-09-12T19:23:17.120877+0000","last_deep_scrub":"267'393","last_deep_scrub_stamp":"2024-09-12T19:23:17.120877+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.120877+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:23.312770+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730141,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":597,"num_read_kb":19633,"num_write":1232,"num_write_kb":34097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'745","reported_seq":2343,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.258153+0000","last_change":"2024-09-12T19:23:26.257990+0000","last_active":"2024-09-12T19:23:26.258153+0000","last_peered":"2024-09-12T19:23:26.258153+0000","last_clean":"2024-09-12T19:23:26.258153+0000","last_became_active":"2024-09-12T17:29:54.756675+0000","last_became_peered":"2024-09-12T17:29:54.756675+0000","last_unstale":"2024-09-12T19:23:26.258153+0000","last_undegraded":"2024-09-12T19:23:26.258153+0000","last_fullsized":"2024-09-12T19:23:26.258153+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'745","last_scrub_stamp":"2024-09-12T19:23:26.257807+0000","last_deep_scrub":"267'745","last_deep_scrub_stamp":"2024-09-12T19:23:26.257807+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.257807+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:41.842768+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3670,"num_read_kb":3349,"num_write":979,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'350","reported_seq":1005,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.882345+0000","last_change":"2024-09-12T19:23:11.882345+0000","last_active":"2024-09-12T19:23:11.882345+0000","last_peered":"2024-09-12T19:23:11.882345+0000","last_clean":"2024-09-12T19:23:11.882345+0000","last_became_active":"2024-09-12T17:29:52.766959+0000","last_became_peered":"2024-09-12T17:29:52.766959+0000","last_unstale":"2024-09-12T19:23:11.882345+0000","last_undegraded":"2024-09-12T19:23:11.882345+0000","last_fullsized":"2024-09-12T19:23:11.882345+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'350","last_scrub_stamp":"2024-09-12T19:23:11.882126+0000","last_deep_scrub":"267'350","last_deep_scrub_stamp":"2024-09-12T19:23:11.882126+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.882126+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:02.282493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":468,"num_read_kb":494,"num_write":1113,"num_write_kb":20716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'131","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.037145+0000","last_change":"2024-09-12T19:23:42.037145+0000","last_active":"2024-09-12T19:23:42.037145+0000","last_peered":"2024-09-12T19:23:42.037145+0000","last_clean":"2024-09-12T19:23:42.037145+0000","last_became_active":"2024-09-12T17:30:02.802659+0000","last_became_peered":"2024-09-12T17:30:02.802659+0000","last_unstale":"2024-09-12T19:23:42.037145+0000","last_undegraded":"2024-09-12T19:23:42.037145+0000","last_fullsized":"2024-09-12T19:23:42.037145+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-09-12T19:23:42.036925+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-09-12T19:23:42.036925+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.036925+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:38.006162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":169,"num_write":297,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'432","reported_seq":2026,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.153150+0000","last_change":"2024-09-12T19:23:24.153150+0000","last_active":"2024-09-12T19:23:24.153150+0000","last_peered":"2024-09-12T19:23:24.153150+0000","last_clean":"2024-09-12T19:23:24.153150+0000","last_became_active":"2024-09-12T17:29:54.758303+0000","last_became_peered":"2024-09-12T17:29:54.758303+0000","last_unstale":"2024-09-12T19:23:24.153150+0000","last_undegraded":"2024-09-12T19:23:24.153150+0000","last_fullsized":"2024-09-12T19:23:24.153150+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'432","last_scrub_stamp":"2024-09-12T19:23:24.152868+0000","last_deep_scrub":"267'432","last_deep_scrub_stamp":"2024-09-12T19:23:24.152868+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.152868+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:50.955827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2323,"num_read_kb":2196,"num_write":494,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'401","reported_seq":1120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.070452+0000","last_change":"2024-09-12T19:23:14.070452+0000","last_active":"2024-09-12T19:23:14.070452+0000","last_peered":"2024-09-12T19:23:14.070452+0000","last_clean":"2024-09-12T19:23:14.070452+0000","last_became_active":"2024-09-12T17:29:52.755103+0000","last_became_peered":"2024-09-12T17:29:52.755103+0000","last_unstale":"2024-09-12T19:23:14.070452+0000","last_undegraded":"2024-09-12T19:23:14.070452+0000","last_fullsized":"2024-09-12T19:23:14.070452+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'401","last_scrub_stamp":"2024-09-12T19:23:14.070224+0000","last_deep_scrub":"267'401","last_deep_scrub_stamp":"2024-09-12T19:23:14.070224+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.070224+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:15.519300+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524450,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":671,"num_read_kb":34526,"num_write":1327,"num_write_kb":26646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.319765+0000","last_change":"2024-09-12T19:23:30.319587+0000","last_active":"2024-09-12T19:23:30.319765+0000","last_peered":"2024-09-12T19:23:30.319765+0000","last_clean":"2024-09-12T19:23:30.319765+0000","last_became_active":"2024-09-12T17:29:56.763547+0000","last_became_peered":"2024-09-12T17:29:56.763547+0000","last_unstale":"2024-09-12T19:23:30.319765+0000","last_undegraded":"2024-09-12T19:23:30.319765+0000","last_fullsized":"2024-09-12T19:23:30.319765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:30.319381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:30.319381+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.319381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:11.796126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'391","reported_seq":1050,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.766076+0000","last_change":"2024-09-12T19:23:28.765866+0000","last_active":"2024-09-12T19:23:28.766076+0000","last_peered":"2024-09-12T19:23:28.766076+0000","last_clean":"2024-09-12T19:23:28.766076+0000","last_became_active":"2024-09-12T17:29:58.777554+0000","last_became_peered":"2024-09-12T17:29:58.777554+0000","last_unstale":"2024-09-12T19:23:28.766076+0000","last_undegraded":"2024-09-12T19:23:28.766076+0000","last_fullsized":"2024-09-12T19:23:28.766076+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'391","last_scrub_stamp":"2024-09-12T19:23:28.765622+0000","last_deep_scrub":"267'391","last_deep_scrub_stamp":"2024-09-12T19:23:28.765622+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.765622+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:18.062130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45863,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":1229,"num_write":480,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.039838+0000","last_change":"2024-09-12T19:23:39.039838+0000","last_active":"2024-09-12T19:23:39.039838+0000","last_peered":"2024-09-12T19:23:39.039838+0000","last_clean":"2024-09-12T19:23:39.039838+0000","last_became_active":"2024-09-12T17:30:00.805568+0000","last_became_peered":"2024-09-12T17:30:00.805568+0000","last_unstale":"2024-09-12T19:23:39.039838+0000","last_undegraded":"2024-09-12T19:23:39.039838+0000","last_fullsized":"2024-09-12T19:23:39.039838+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:39.039604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:39.039604+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.039604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:42.434322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'147","reported_seq":734,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.340340+0000","last_change":"2024-09-12T19:23:43.340340+0000","last_active":"2024-09-12T19:23:43.340340+0000","last_peered":"2024-09-12T19:23:43.340340+0000","last_clean":"2024-09-12T19:23:43.340340+0000","last_became_active":"2024-09-12T17:30:02.785212+0000","last_became_peered":"2024-09-12T17:30:02.785212+0000","last_unstale":"2024-09-12T19:23:43.340340+0000","last_undegraded":"2024-09-12T19:23:43.340340+0000","last_fullsized":"2024-09-12T19:23:43.340340+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'147","last_scrub_stamp":"2024-09-12T19:23:43.340126+0000","last_deep_scrub":"267'147","last_deep_scrub_stamp":"2024-09-12T19:23:43.340126+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.340126+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:42.490361+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":252,"num_read_kb":243,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'686","reported_seq":2561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.304352+0000","last_change":"2024-09-12T19:23:22.304212+0000","last_active":"2024-09-12T19:23:22.304352+0000","last_peered":"2024-09-12T19:23:22.304352+0000","last_clean":"2024-09-12T19:23:22.304352+0000","last_became_active":"2024-09-12T17:29:54.761497+0000","last_became_peered":"2024-09-12T17:29:54.761497+0000","last_unstale":"2024-09-12T19:23:22.304352+0000","last_undegraded":"2024-09-12T19:23:22.304352+0000","last_fullsized":"2024-09-12T19:23:22.304352+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'686","last_scrub_stamp":"2024-09-12T19:23:22.303998+0000","last_deep_scrub":"267'686","last_deep_scrub_stamp":"2024-09-12T19:23:22.303998+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.303998+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":600,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:35.218804+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3854,"num_read_kb":3534,"num_write":981,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2484,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'373","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.894094+0000","last_change":"2024-09-12T19:23:10.894094+0000","last_active":"2024-09-12T19:23:10.894094+0000","last_peered":"2024-09-12T19:23:10.894094+0000","last_clean":"2024-09-12T19:23:10.894094+0000","last_became_active":"2024-09-12T17:29:52.713938+0000","last_became_peered":"2024-09-12T17:29:52.713938+0000","last_unstale":"2024-09-12T19:23:10.894094+0000","last_undegraded":"2024-09-12T19:23:10.894094+0000","last_fullsized":"2024-09-12T19:23:10.894094+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'373","last_scrub_stamp":"2024-09-12T19:23:10.893784+0000","last_deep_scrub":"267'373","last_deep_scrub_stamp":"2024-09-12T19:23:10.893784+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.893784+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:17.828171+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460272,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":10309,"num_write":1260,"num_write_kb":32712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.117064+0000","last_change":"2024-09-12T19:23:33.117064+0000","last_active":"2024-09-12T19:23:33.117064+0000","last_peered":"2024-09-12T19:23:33.117064+0000","last_clean":"2024-09-12T19:23:33.117064+0000","last_became_active":"2024-09-12T17:29:56.776335+0000","last_became_peered":"2024-09-12T17:29:56.776335+0000","last_unstale":"2024-09-12T19:23:33.117064+0000","last_undegraded":"2024-09-12T19:23:33.117064+0000","last_fullsized":"2024-09-12T19:23:33.117064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:33.116805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:33.116805+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.116805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:05.221499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'123","reported_seq":706,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.097443+0000","last_change":"2024-09-12T19:23:35.097315+0000","last_active":"2024-09-12T19:23:35.097443+0000","last_peered":"2024-09-12T19:23:35.097443+0000","last_clean":"2024-09-12T19:23:35.097443+0000","last_became_active":"2024-09-12T17:29:58.777883+0000","last_became_peered":"2024-09-12T17:29:58.777883+0000","last_unstale":"2024-09-12T19:23:35.097443+0000","last_undegraded":"2024-09-12T19:23:35.097443+0000","last_fullsized":"2024-09-12T19:23:35.097443+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'123","last_scrub_stamp":"2024-09-12T19:23:35.097136+0000","last_deep_scrub":"267'123","last_deep_scrub_stamp":"2024-09-12T19:23:35.097136+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.097136+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:45.936503+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.005166+0000","last_change":"2024-09-12T19:23:40.005166+0000","last_active":"2024-09-12T19:23:40.005166+0000","last_peered":"2024-09-12T19:23:40.005166+0000","last_clean":"2024-09-12T19:23:40.005166+0000","last_became_active":"2024-09-12T17:30:00.781554+0000","last_became_peered":"2024-09-12T17:30:00.781554+0000","last_unstale":"2024-09-12T19:23:40.005166+0000","last_undegraded":"2024-09-12T19:23:40.005166+0000","last_fullsized":"2024-09-12T19:23:40.005166+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:40.004991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:40.004991+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.004991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:11.814607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'124","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.677123+0000","last_change":"2024-09-12T19:23:41.677123+0000","last_active":"2024-09-12T19:23:41.677123+0000","last_peered":"2024-09-12T19:23:41.677123+0000","last_clean":"2024-09-12T19:23:41.677123+0000","last_became_active":"2024-09-12T17:30:02.805556+0000","last_became_peered":"2024-09-12T17:30:02.805556+0000","last_unstale":"2024-09-12T19:23:41.677123+0000","last_undegraded":"2024-09-12T19:23:41.677123+0000","last_fullsized":"2024-09-12T19:23:41.677123+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'124","last_scrub_stamp":"2024-09-12T19:23:41.676926+0000","last_deep_scrub":"267'124","last_deep_scrub_stamp":"2024-09-12T19:23:41.676926+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.676926+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:02:35.359271+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":177,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'910","reported_seq":2546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.925925+0000","last_change":"2024-09-12T19:23:17.925790+0000","last_active":"2024-09-12T19:23:17.925925+0000","last_peered":"2024-09-12T19:23:17.925925+0000","last_clean":"2024-09-12T19:23:17.925925+0000","last_became_active":"2024-09-12T17:29:54.751997+0000","last_became_peered":"2024-09-12T17:29:54.751997+0000","last_unstale":"2024-09-12T19:23:17.925925+0000","last_undegraded":"2024-09-12T19:23:17.925925+0000","last_fullsized":"2024-09-12T19:23:17.925925+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'910","last_scrub_stamp":"2024-09-12T19:23:17.925604+0000","last_deep_scrub":"267'910","last_deep_scrub_stamp":"2024-09-12T19:23:17.925604+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.925604+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":800,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:18.238141+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4250,"num_read_kb":3802,"num_write":1203,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":496,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'368","reported_seq":1093,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.024733+0000","last_change":"2024-09-12T19:23:13.024733+0000","last_active":"2024-09-12T19:23:13.024733+0000","last_peered":"2024-09-12T19:23:13.024733+0000","last_clean":"2024-09-12T19:23:13.024733+0000","last_became_active":"2024-09-12T17:29:52.762149+0000","last_became_peered":"2024-09-12T17:29:52.762149+0000","last_unstale":"2024-09-12T19:23:13.024733+0000","last_undegraded":"2024-09-12T19:23:13.024733+0000","last_fullsized":"2024-09-12T19:23:13.024733+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'368","last_scrub_stamp":"2024-09-12T19:23:13.024462+0000","last_deep_scrub":"267'368","last_deep_scrub_stamp":"2024-09-12T19:23:13.024462+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.024462+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:06.503899+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":626,"num_read_kb":63082,"num_write":1322,"num_write_kb":27819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.144641+0000","last_change":"2024-09-12T19:23:32.144463+0000","last_active":"2024-09-12T19:23:32.144641+0000","last_peered":"2024-09-12T19:23:32.144641+0000","last_clean":"2024-09-12T19:23:32.144641+0000","last_became_active":"2024-09-12T17:29:56.761027+0000","last_became_peered":"2024-09-12T17:29:56.761027+0000","last_unstale":"2024-09-12T19:23:32.144641+0000","last_undegraded":"2024-09-12T19:23:32.144641+0000","last_fullsized":"2024-09-12T19:23:32.144641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:32.144189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:32.144189+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.144189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:33.492487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'178","reported_seq":789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.980218+0000","last_change":"2024-09-12T19:23:23.980218+0000","last_active":"2024-09-12T19:23:23.980218+0000","last_peered":"2024-09-12T19:23:23.980218+0000","last_clean":"2024-09-12T19:23:23.980218+0000","last_became_active":"2024-09-12T17:29:58.769889+0000","last_became_peered":"2024-09-12T17:29:58.769889+0000","last_unstale":"2024-09-12T19:23:23.980218+0000","last_undegraded":"2024-09-12T19:23:23.980218+0000","last_fullsized":"2024-09-12T19:23:23.980218+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'178","last_scrub_stamp":"2024-09-12T19:23:23.980018+0000","last_deep_scrub":"267'178","last_deep_scrub_stamp":"2024-09-12T19:23:23.980018+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.980018+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:07.667832+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'757","reported_seq":3334,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.082479+0000","last_change":"2024-09-12T19:23:40.082479+0000","last_active":"2024-09-12T19:23:40.082479+0000","last_peered":"2024-09-12T19:23:40.082479+0000","last_clean":"2024-09-12T19:23:40.082479+0000","last_became_active":"2024-09-12T17:30:00.810030+0000","last_became_peered":"2024-09-12T17:30:00.810030+0000","last_unstale":"2024-09-12T19:23:40.082479+0000","last_undegraded":"2024-09-12T19:23:40.082479+0000","last_fullsized":"2024-09-12T19:23:40.082479+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'757","last_scrub_stamp":"2024-09-12T19:23:40.082255+0000","last_deep_scrub":"267'757","last_deep_scrub_stamp":"2024-09-12T19:23:40.082255+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.082255+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:00.429097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'210","reported_seq":1076,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.034245+0000","last_change":"2024-09-12T19:23:45.034245+0000","last_active":"2024-09-12T19:23:45.034245+0000","last_peered":"2024-09-12T19:23:45.034245+0000","last_clean":"2024-09-12T19:23:45.034245+0000","last_became_active":"2024-09-12T17:30:02.803144+0000","last_became_peered":"2024-09-12T17:30:02.803144+0000","last_unstale":"2024-09-12T19:23:45.034245+0000","last_undegraded":"2024-09-12T19:23:45.034245+0000","last_fullsized":"2024-09-12T19:23:45.034245+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'210","last_scrub_stamp":"2024-09-12T19:23:45.034025+0000","last_deep_scrub":"267'210","last_deep_scrub_stamp":"2024-09-12T19:23:45.034025+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.034025+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:07.379679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":674,"num_read_kb":661,"num_write":463,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'416","reported_seq":2082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.176672+0000","last_change":"2024-09-12T19:23:23.176544+0000","last_active":"2024-09-12T19:23:23.176672+0000","last_peered":"2024-09-12T19:23:23.176672+0000","last_clean":"2024-09-12T19:23:23.176672+0000","last_became_active":"2024-09-12T17:29:54.762448+0000","last_became_peered":"2024-09-12T17:29:54.762448+0000","last_unstale":"2024-09-12T19:23:23.176672+0000","last_undegraded":"2024-09-12T19:23:23.176672+0000","last_fullsized":"2024-09-12T19:23:23.176672+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'416","last_scrub_stamp":"2024-09-12T19:23:23.176364+0000","last_deep_scrub":"267'416","last_deep_scrub_stamp":"2024-09-12T19:23:23.176364+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.176364+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:27.592188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2329,"num_read_kb":2238,"num_write":469,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'341","reported_seq":1012,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.138789+0000","last_change":"2024-09-12T19:23:11.138789+0000","last_active":"2024-09-12T19:23:11.138789+0000","last_peered":"2024-09-12T19:23:11.138789+0000","last_clean":"2024-09-12T19:23:11.138789+0000","last_became_active":"2024-09-12T17:29:52.738957+0000","last_became_peered":"2024-09-12T17:29:52.738957+0000","last_unstale":"2024-09-12T19:23:11.138789+0000","last_undegraded":"2024-09-12T19:23:11.138789+0000","last_fullsized":"2024-09-12T19:23:11.138789+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'341","last_scrub_stamp":"2024-09-12T19:23:11.138465+0000","last_deep_scrub":"267'341","last_deep_scrub_stamp":"2024-09-12T19:23:11.138465+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.138465+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:25.950750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":517,"num_read_kb":16175,"num_write":1150,"num_write_kb":26946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.312490+0000","last_change":"2024-09-12T19:23:29.312344+0000","last_active":"2024-09-12T19:23:29.312490+0000","last_peered":"2024-09-12T19:23:29.312490+0000","last_clean":"2024-09-12T19:23:29.312490+0000","last_became_active":"2024-09-12T17:29:56.755730+0000","last_became_peered":"2024-09-12T17:29:56.755730+0000","last_unstale":"2024-09-12T19:23:29.312490+0000","last_undegraded":"2024-09-12T19:23:29.312490+0000","last_fullsized":"2024-09-12T19:23:29.312490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:29.312160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:29.312160+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.312160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:47.556257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'327","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.149102+0000","last_change":"2024-09-12T19:23:35.148955+0000","last_active":"2024-09-12T19:23:35.149102+0000","last_peered":"2024-09-12T19:23:35.149102+0000","last_clean":"2024-09-12T19:23:35.149102+0000","last_became_active":"2024-09-12T17:29:58.829021+0000","last_became_peered":"2024-09-12T17:29:58.829021+0000","last_unstale":"2024-09-12T19:23:35.149102+0000","last_undegraded":"2024-09-12T19:23:35.149102+0000","last_fullsized":"2024-09-12T19:23:35.149102+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'327","last_scrub_stamp":"2024-09-12T19:23:35.148750+0000","last_deep_scrub":"267'327","last_deep_scrub_stamp":"2024-09-12T19:23:35.148750+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.148750+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:02:26.287034+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49018,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":1196,"num_write":438,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'814","reported_seq":3032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.093076+0000","last_change":"2024-09-12T19:23:45.093076+0000","last_active":"2024-09-12T19:23:45.093076+0000","last_peered":"2024-09-12T19:23:45.093076+0000","last_clean":"2024-09-12T19:23:45.093076+0000","last_became_active":"2024-09-12T17:30:00.793067+0000","last_became_peered":"2024-09-12T17:30:00.793067+0000","last_unstale":"2024-09-12T19:23:45.093076+0000","last_undegraded":"2024-09-12T19:23:45.093076+0000","last_fullsized":"2024-09-12T19:23:45.093076+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'814","last_scrub_stamp":"2024-09-12T19:23:45.092843+0000","last_deep_scrub":"267'814","last_deep_scrub_stamp":"2024-09-12T19:23:45.092843+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.092843+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:39.919209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'526","reported_seq":2074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.298840+0000","last_change":"2024-09-12T19:23:21.298840+0000","last_active":"2024-09-12T19:23:21.298840+0000","last_peered":"2024-09-12T19:23:21.298840+0000","last_clean":"2024-09-12T19:23:21.298840+0000","last_became_active":"2024-09-12T17:29:54.766092+0000","last_became_peered":"2024-09-12T17:29:54.766092+0000","last_unstale":"2024-09-12T19:23:21.298840+0000","last_undegraded":"2024-09-12T19:23:21.298840+0000","last_fullsized":"2024-09-12T19:23:21.298840+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'526","last_scrub_stamp":"2024-09-12T19:23:21.298622+0000","last_deep_scrub":"267'526","last_deep_scrub_stamp":"2024-09-12T19:23:21.298622+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.298622+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:56.252493+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2636,"num_read_kb":2418,"num_write":649,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'353","reported_seq":1047,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.059198+0000","last_change":"2024-09-12T19:23:15.059198+0000","last_active":"2024-09-12T19:23:15.059198+0000","last_peered":"2024-09-12T19:23:15.059198+0000","last_clean":"2024-09-12T19:23:15.059198+0000","last_became_active":"2024-09-12T17:29:52.757326+0000","last_became_peered":"2024-09-12T17:29:52.757326+0000","last_unstale":"2024-09-12T19:23:15.059198+0000","last_undegraded":"2024-09-12T19:23:15.059198+0000","last_fullsized":"2024-09-12T19:23:15.059198+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'353","last_scrub_stamp":"2024-09-12T19:23:15.058913+0000","last_deep_scrub":"267'353","last_deep_scrub_stamp":"2024-09-12T19:23:15.058913+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.058913+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:10.734098+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730145,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":565,"num_read_kb":12520,"num_write":1100,"num_write_kb":32977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.109066+0000","last_change":"2024-09-12T19:23:33.109066+0000","last_active":"2024-09-12T19:23:33.109066+0000","last_peered":"2024-09-12T19:23:33.109066+0000","last_clean":"2024-09-12T19:23:33.109066+0000","last_became_active":"2024-09-12T17:29:56.768267+0000","last_became_peered":"2024-09-12T17:29:56.768267+0000","last_unstale":"2024-09-12T19:23:33.109066+0000","last_undegraded":"2024-09-12T19:23:33.109066+0000","last_fullsized":"2024-09-12T19:23:33.109066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:33.108858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:33.108858+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.108858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:40.490165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'461","reported_seq":1161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.296203+0000","last_change":"2024-09-12T19:23:34.296203+0000","last_active":"2024-09-12T19:23:34.296203+0000","last_peered":"2024-09-12T19:23:34.296203+0000","last_clean":"2024-09-12T19:23:34.296203+0000","last_became_active":"2024-09-12T17:29:58.833291+0000","last_became_peered":"2024-09-12T17:29:58.833291+0000","last_unstale":"2024-09-12T19:23:34.296203+0000","last_undegraded":"2024-09-12T19:23:34.296203+0000","last_fullsized":"2024-09-12T19:23:34.296203+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'461","last_scrub_stamp":"2024-09-12T19:23:34.295959+0000","last_deep_scrub":"267'461","last_deep_scrub_stamp":"2024-09-12T19:23:34.295959+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.295959+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:24.206523+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60505,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":721,"num_read_kb":1312,"num_write":540,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.640178+0000","last_change":"2024-09-12T19:23:29.640178+0000","last_active":"2024-09-12T19:23:29.640178+0000","last_peered":"2024-09-12T19:23:29.640178+0000","last_clean":"2024-09-12T19:23:29.640178+0000","last_became_active":"2024-09-12T17:30:00.809914+0000","last_became_peered":"2024-09-12T17:30:00.809914+0000","last_unstale":"2024-09-12T19:23:29.640178+0000","last_undegraded":"2024-09-12T19:23:29.640178+0000","last_fullsized":"2024-09-12T19:23:29.640178+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:29.639987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:29.639987+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.639987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:34.064980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'551","reported_seq":1415,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.282843+0000","last_change":"2024-09-12T19:23:39.282843+0000","last_active":"2024-09-12T19:23:39.282843+0000","last_peered":"2024-09-12T19:23:39.282843+0000","last_clean":"2024-09-12T19:23:39.282843+0000","last_became_active":"2024-09-12T17:30:02.797046+0000","last_became_peered":"2024-09-12T17:30:02.797046+0000","last_unstale":"2024-09-12T19:23:39.282843+0000","last_undegraded":"2024-09-12T19:23:39.282843+0000","last_fullsized":"2024-09-12T19:23:39.282843+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'551","last_scrub_stamp":"2024-09-12T19:23:39.282658+0000","last_deep_scrub":"267'551","last_deep_scrub_stamp":"2024-09-12T19:23:39.282658+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.282658+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:04.085433+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1413,"num_read_kb":1390,"num_write":1179,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'484","reported_seq":2168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.213752+0000","last_change":"2024-09-12T19:23:14.213752+0000","last_active":"2024-09-12T19:23:14.213752+0000","last_peered":"2024-09-12T19:23:14.213752+0000","last_clean":"2024-09-12T19:23:14.213752+0000","last_became_active":"2024-09-12T17:29:54.754517+0000","last_became_peered":"2024-09-12T17:29:54.754517+0000","last_unstale":"2024-09-12T19:23:14.213752+0000","last_undegraded":"2024-09-12T19:23:14.213752+0000","last_fullsized":"2024-09-12T19:23:14.213752+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'484","last_scrub_stamp":"2024-09-12T19:23:14.213543+0000","last_deep_scrub":"267'484","last_deep_scrub_stamp":"2024-09-12T19:23:14.213543+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.213543+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:45.018822+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2565,"num_read_kb":2417,"num_write":558,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'317","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.054850+0000","last_change":"2024-09-12T19:23:16.054850+0000","last_active":"2024-09-12T19:23:16.054850+0000","last_peered":"2024-09-12T19:23:16.054850+0000","last_clean":"2024-09-12T19:23:16.054850+0000","last_became_active":"2024-09-12T17:29:52.760711+0000","last_became_peered":"2024-09-12T17:29:52.760711+0000","last_unstale":"2024-09-12T19:23:16.054850+0000","last_undegraded":"2024-09-12T19:23:16.054850+0000","last_fullsized":"2024-09-12T19:23:16.054850+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-12T19:23:16.054566+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-12T19:23:16.054566+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.054566+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:14.486166+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759519,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":447,"num_read_kb":40999,"num_write":1044,"num_write_kb":42394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.974544+0000","last_change":"2024-09-12T19:23:18.974544+0000","last_active":"2024-09-12T19:23:18.974544+0000","last_peered":"2024-09-12T19:23:18.974544+0000","last_clean":"2024-09-12T19:23:18.974544+0000","last_became_active":"2024-09-12T17:29:56.757805+0000","last_became_peered":"2024-09-12T17:29:56.757805+0000","last_unstale":"2024-09-12T19:23:18.974544+0000","last_undegraded":"2024-09-12T19:23:18.974544+0000","last_fullsized":"2024-09-12T19:23:18.974544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:18.974369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:18.974369+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.974369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:12.714029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'308","reported_seq":939,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.093350+0000","last_change":"2024-09-12T19:23:34.093350+0000","last_active":"2024-09-12T19:23:34.093350+0000","last_peered":"2024-09-12T19:23:34.093350+0000","last_clean":"2024-09-12T19:23:34.093350+0000","last_became_active":"2024-09-12T17:29:58.773959+0000","last_became_peered":"2024-09-12T17:29:58.773959+0000","last_unstale":"2024-09-12T19:23:34.093350+0000","last_undegraded":"2024-09-12T19:23:34.093350+0000","last_fullsized":"2024-09-12T19:23:34.093350+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'308","last_scrub_stamp":"2024-09-12T19:23:34.093156+0000","last_deep_scrub":"267'308","last_deep_scrub_stamp":"2024-09-12T19:23:34.093156+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.093156+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:21.646685+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47390,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":1092,"num_write":400,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.108233+0000","last_change":"2024-09-12T19:23:44.108233+0000","last_active":"2024-09-12T19:23:44.108233+0000","last_peered":"2024-09-12T19:23:44.108233+0000","last_clean":"2024-09-12T19:23:44.108233+0000","last_became_active":"2024-09-12T17:30:00.792138+0000","last_became_peered":"2024-09-12T17:30:00.792138+0000","last_unstale":"2024-09-12T19:23:44.108233+0000","last_undegraded":"2024-09-12T19:23:44.108233+0000","last_fullsized":"2024-09-12T19:23:44.108233+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:44.108013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:44.108013+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.108013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:42.196467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2478","reported_seq":4401,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.288441+0000","last_change":"2024-09-12T19:23:30.288441+0000","last_active":"2024-09-12T19:23:30.288441+0000","last_peered":"2024-09-12T19:23:30.288441+0000","last_clean":"2024-09-12T19:23:30.288441+0000","last_became_active":"2024-09-12T17:30:02.800860+0000","last_became_peered":"2024-09-12T17:30:02.800860+0000","last_unstale":"2024-09-12T19:23:30.288441+0000","last_undegraded":"2024-09-12T19:23:30.288441+0000","last_fullsized":"2024-09-12T19:23:30.288441+0000","mapping_epoch":36,"log_start":"267'2400","ondisk_log_start":"267'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2478","last_scrub_stamp":"2024-09-12T19:23:30.288237+0000","last_deep_scrub":"267'2478","last_deep_scrub_stamp":"2024-09-12T19:23:30.288237+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.288237+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":2400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.820569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6373,"num_read_kb":6312,"num_write":5027,"num_write_kb":1835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'434","reported_seq":2080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.214501+0000","last_change":"2024-09-12T19:23:17.214501+0000","last_active":"2024-09-12T19:23:17.214501+0000","last_peered":"2024-09-12T19:23:17.214501+0000","last_clean":"2024-09-12T19:23:17.214501+0000","last_became_active":"2024-09-12T17:29:54.769541+0000","last_became_peered":"2024-09-12T17:29:54.769541+0000","last_unstale":"2024-09-12T19:23:17.214501+0000","last_undegraded":"2024-09-12T19:23:17.214501+0000","last_fullsized":"2024-09-12T19:23:17.214501+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'434","last_scrub_stamp":"2024-09-12T19:23:17.214333+0000","last_deep_scrub":"267'434","last_deep_scrub_stamp":"2024-09-12T19:23:17.214333+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.214333+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:25.717262+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2445,"num_read_kb":2340,"num_write":496,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'333","reported_seq":1016,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.024545+0000","last_change":"2024-09-12T19:23:09.024545+0000","last_active":"2024-09-12T19:23:09.024545+0000","last_peered":"2024-09-12T19:23:09.024545+0000","last_clean":"2024-09-12T19:23:09.024545+0000","last_became_active":"2024-09-12T17:30:21.793950+0000","last_became_peered":"2024-09-12T17:30:21.793950+0000","last_unstale":"2024-09-12T19:23:09.024545+0000","last_undegraded":"2024-09-12T19:23:09.024545+0000","last_fullsized":"2024-09-12T19:23:09.024545+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-09-12T19:23:09.024422+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-09-12T19:23:09.024422+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.024422+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:49.775219+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12448261,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":65282,"num_write":1071,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,6],"acting":[2,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.001307+0000","last_change":"2024-09-12T19:23:20.001307+0000","last_active":"2024-09-12T19:23:20.001307+0000","last_peered":"2024-09-12T19:23:20.001307+0000","last_clean":"2024-09-12T19:23:20.001307+0000","last_became_active":"2024-09-12T17:29:56.770222+0000","last_became_peered":"2024-09-12T17:29:56.770222+0000","last_unstale":"2024-09-12T19:23:20.001307+0000","last_undegraded":"2024-09-12T19:23:20.001307+0000","last_fullsized":"2024-09-12T19:23:20.001307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:20.001094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:20.001094+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.001094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:34.611973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'401","reported_seq":1060,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.149777+0000","last_change":"2024-09-12T19:23:32.149777+0000","last_active":"2024-09-12T19:23:32.149777+0000","last_peered":"2024-09-12T19:23:32.149777+0000","last_clean":"2024-09-12T19:23:32.149777+0000","last_became_active":"2024-09-12T17:29:58.754613+0000","last_became_peered":"2024-09-12T17:29:58.754613+0000","last_unstale":"2024-09-12T19:23:32.149777+0000","last_undegraded":"2024-09-12T19:23:32.149777+0000","last_fullsized":"2024-09-12T19:23:32.149777+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'401","last_scrub_stamp":"2024-09-12T19:23:32.149559+0000","last_deep_scrub":"267'401","last_deep_scrub_stamp":"2024-09-12T19:23:32.149559+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.149559+0000","objects_scrubbed":7,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:40.743834+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50732,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":653,"num_read_kb":1328,"num_write":512,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'797","reported_seq":3216,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.757194+0000","last_change":"2024-09-12T19:23:32.757194+0000","last_active":"2024-09-12T19:23:32.757194+0000","last_peered":"2024-09-12T19:23:32.757194+0000","last_clean":"2024-09-12T19:23:32.757194+0000","last_became_active":"2024-09-12T17:30:00.805428+0000","last_became_peered":"2024-09-12T17:30:00.805428+0000","last_unstale":"2024-09-12T19:23:32.757194+0000","last_undegraded":"2024-09-12T19:23:32.757194+0000","last_fullsized":"2024-09-12T19:23:32.757194+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'797","last_scrub_stamp":"2024-09-12T19:23:32.757019+0000","last_deep_scrub":"267'797","last_deep_scrub_stamp":"2024-09-12T19:23:32.757019+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.757019+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:36:55.355736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'113","reported_seq":668,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.753686+0000","last_change":"2024-09-12T19:23:39.753686+0000","last_active":"2024-09-12T19:23:39.753686+0000","last_peered":"2024-09-12T19:23:39.753686+0000","last_clean":"2024-09-12T19:23:39.753686+0000","last_became_active":"2024-09-12T17:30:02.816983+0000","last_became_peered":"2024-09-12T17:30:02.816983+0000","last_unstale":"2024-09-12T19:23:39.753686+0000","last_undegraded":"2024-09-12T19:23:39.753686+0000","last_fullsized":"2024-09-12T19:23:39.753686+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'113","last_scrub_stamp":"2024-09-12T19:23:39.753494+0000","last_deep_scrub":"267'113","last_deep_scrub_stamp":"2024-09-12T19:23:39.753494+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.753494+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:47.021198+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":194,"num_write":254,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'875","reported_seq":2511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.846463+0000","last_change":"2024-09-12T19:23:25.846463+0000","last_active":"2024-09-12T19:23:25.846463+0000","last_peered":"2024-09-12T19:23:25.846463+0000","last_clean":"2024-09-12T19:23:25.846463+0000","last_became_active":"2024-09-12T17:29:54.744926+0000","last_became_peered":"2024-09-12T17:29:54.744926+0000","last_unstale":"2024-09-12T19:23:25.846463+0000","last_undegraded":"2024-09-12T19:23:25.846463+0000","last_fullsized":"2024-09-12T19:23:25.846463+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'875","last_scrub_stamp":"2024-09-12T19:23:25.846277+0000","last_deep_scrub":"267'875","last_deep_scrub_stamp":"2024-09-12T19:23:25.846277+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.846277+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:32.763858+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4186,"num_read_kb":3781,"num_write":1194,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'377","reported_seq":1075,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.256060+0000","last_change":"2024-09-12T19:23:11.256060+0000","last_active":"2024-09-12T19:23:11.256060+0000","last_peered":"2024-09-12T19:23:11.256060+0000","last_clean":"2024-09-12T19:23:11.256060+0000","last_became_active":"2024-09-12T17:29:52.748439+0000","last_became_peered":"2024-09-12T17:29:52.748439+0000","last_unstale":"2024-09-12T19:23:11.256060+0000","last_undegraded":"2024-09-12T19:23:11.256060+0000","last_fullsized":"2024-09-12T19:23:11.256060+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'377","last_scrub_stamp":"2024-09-12T19:23:11.255752+0000","last_deep_scrub":"267'377","last_deep_scrub_stamp":"2024-09-12T19:23:11.255752+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.255752+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:44.862051+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992343,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":628,"num_read_kb":40400,"num_write":1240,"num_write_kb":24508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.008450+0000","last_change":"2024-09-12T19:23:21.008450+0000","last_active":"2024-09-12T19:23:21.008450+0000","last_peered":"2024-09-12T19:23:21.008450+0000","last_clean":"2024-09-12T19:23:21.008450+0000","last_became_active":"2024-09-12T17:29:56.742361+0000","last_became_peered":"2024-09-12T17:29:56.742361+0000","last_unstale":"2024-09-12T19:23:21.008450+0000","last_undegraded":"2024-09-12T19:23:21.008450+0000","last_fullsized":"2024-09-12T19:23:21.008450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:21.008185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:21.008185+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.008185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:29.516729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'518","reported_seq":1210,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.807529+0000","last_change":"2024-09-12T19:23:26.807529+0000","last_active":"2024-09-12T19:23:26.807529+0000","last_peered":"2024-09-12T19:23:26.807529+0000","last_clean":"2024-09-12T19:23:26.807529+0000","last_became_active":"2024-09-12T17:29:58.777576+0000","last_became_peered":"2024-09-12T17:29:58.777576+0000","last_unstale":"2024-09-12T19:23:26.807529+0000","last_undegraded":"2024-09-12T19:23:26.807529+0000","last_fullsized":"2024-09-12T19:23:26.807529+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'518","last_scrub_stamp":"2024-09-12T19:23:26.807330+0000","last_deep_scrub":"267'518","last_deep_scrub_stamp":"2024-09-12T19:23:26.807330+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.807330+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:29.286764+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94518,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":881,"num_read_kb":2010,"num_write":710,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.933893+0000","last_change":"2024-09-12T19:23:28.933893+0000","last_active":"2024-09-12T19:23:28.933893+0000","last_peered":"2024-09-12T19:23:28.933893+0000","last_clean":"2024-09-12T19:23:28.933893+0000","last_became_active":"2024-09-12T17:30:00.780193+0000","last_became_peered":"2024-09-12T17:30:00.780193+0000","last_unstale":"2024-09-12T19:23:28.933893+0000","last_undegraded":"2024-09-12T19:23:28.933893+0000","last_fullsized":"2024-09-12T19:23:28.933893+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:28.933682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:28.933682+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.933682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:40.568216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'168","reported_seq":728,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.655622+0000","last_change":"2024-09-12T19:23:35.655622+0000","last_active":"2024-09-12T19:23:35.655622+0000","last_peered":"2024-09-12T19:23:35.655622+0000","last_clean":"2024-09-12T19:23:35.655622+0000","last_became_active":"2024-09-12T17:30:02.809357+0000","last_became_peered":"2024-09-12T17:30:02.809357+0000","last_unstale":"2024-09-12T19:23:35.655622+0000","last_undegraded":"2024-09-12T19:23:35.655622+0000","last_fullsized":"2024-09-12T19:23:35.655622+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'168","last_scrub_stamp":"2024-09-12T19:23:35.655394+0000","last_deep_scrub":"267'168","last_deep_scrub_stamp":"2024-09-12T19:23:35.655394+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.655394+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:49.193802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":287,"num_read_kb":265,"num_write":391,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'1307","reported_seq":2993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.254001+0000","last_change":"2024-09-12T19:23:15.254001+0000","last_active":"2024-09-12T19:23:15.254001+0000","last_peered":"2024-09-12T19:23:15.254001+0000","last_clean":"2024-09-12T19:23:15.254001+0000","last_became_active":"2024-09-12T17:29:54.758550+0000","last_became_peered":"2024-09-12T17:29:54.758550+0000","last_unstale":"2024-09-12T19:23:15.254001+0000","last_undegraded":"2024-09-12T19:23:15.254001+0000","last_fullsized":"2024-09-12T19:23:15.254001+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1307","last_scrub_stamp":"2024-09-12T19:23:15.253774+0000","last_deep_scrub":"267'1307","last_deep_scrub_stamp":"2024-09-12T19:23:15.253774+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.253774+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":1200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:53.604695+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6018,"num_read_kb":5333,"num_write":1857,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'317","reported_seq":984,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.187666+0000","last_change":"2024-09-12T19:23:10.187666+0000","last_active":"2024-09-12T19:23:10.187666+0000","last_peered":"2024-09-12T19:23:10.187666+0000","last_clean":"2024-09-12T19:23:10.187666+0000","last_became_active":"2024-09-12T17:29:52.765603+0000","last_became_peered":"2024-09-12T17:29:52.765603+0000","last_unstale":"2024-09-12T19:23:10.187666+0000","last_undegraded":"2024-09-12T19:23:10.187666+0000","last_fullsized":"2024-09-12T19:23:10.187666+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-12T19:23:10.187423+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-12T19:23:10.187423+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.187423+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:25.588115+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911305,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":437,"num_read_kb":36052,"num_write":1059,"num_write_kb":37263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.020465+0000","last_change":"2024-09-12T19:23:23.020465+0000","last_active":"2024-09-12T19:23:23.020465+0000","last_peered":"2024-09-12T19:23:23.020465+0000","last_clean":"2024-09-12T19:23:23.020465+0000","last_became_active":"2024-09-12T17:29:56.772580+0000","last_became_peered":"2024-09-12T17:29:56.772580+0000","last_unstale":"2024-09-12T19:23:23.020465+0000","last_undegraded":"2024-09-12T19:23:23.020465+0000","last_fullsized":"2024-09-12T19:23:23.020465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:23.020268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:23.020268+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.020268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:35.030994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'338","reported_seq":983,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.088674+0000","last_change":"2024-09-12T19:23:34.088674+0000","last_active":"2024-09-12T19:23:34.088674+0000","last_peered":"2024-09-12T19:23:34.088674+0000","last_clean":"2024-09-12T19:23:34.088674+0000","last_became_active":"2024-09-12T17:29:58.773869+0000","last_became_peered":"2024-09-12T17:29:58.773869+0000","last_unstale":"2024-09-12T19:23:34.088674+0000","last_undegraded":"2024-09-12T19:23:34.088674+0000","last_fullsized":"2024-09-12T19:23:34.088674+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'338","last_scrub_stamp":"2024-09-12T19:23:34.088466+0000","last_deep_scrub":"267'338","last_deep_scrub_stamp":"2024-09-12T19:23:34.088466+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.088466+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:47.300557+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47005,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":1116,"num_write":486,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.794503+0000","last_change":"2024-09-12T19:23:33.794503+0000","last_active":"2024-09-12T19:23:33.794503+0000","last_peered":"2024-09-12T19:23:33.794503+0000","last_clean":"2024-09-12T19:23:33.794503+0000","last_became_active":"2024-09-12T17:30:00.778642+0000","last_became_peered":"2024-09-12T17:30:00.778642+0000","last_unstale":"2024-09-12T19:23:33.794503+0000","last_undegraded":"2024-09-12T19:23:33.794503+0000","last_fullsized":"2024-09-12T19:23:33.794503+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:33.794328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:33.794328+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.794328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:41.179489+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'110","reported_seq":642,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:47.056825+0000","last_change":"2024-09-12T19:23:47.056825+0000","last_active":"2024-09-12T19:23:47.056825+0000","last_peered":"2024-09-12T19:23:47.056825+0000","last_clean":"2024-09-12T19:23:47.056825+0000","last_became_active":"2024-09-12T17:30:02.788612+0000","last_became_peered":"2024-09-12T17:30:02.788612+0000","last_unstale":"2024-09-12T19:23:47.056825+0000","last_undegraded":"2024-09-12T19:23:47.056825+0000","last_fullsized":"2024-09-12T19:23:47.056825+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'110","last_scrub_stamp":"2024-09-12T19:23:47.056643+0000","last_deep_scrub":"267'110","last_deep_scrub_stamp":"2024-09-12T19:23:47.056643+0000","last_clean_scrub_stamp":"2024-09-12T19:23:47.056643+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:04:16.784374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":252,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'363","reported_seq":1826,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.266919+0000","last_change":"2024-09-12T19:23:16.266919+0000","last_active":"2024-09-12T19:23:16.266919+0000","last_peered":"2024-09-12T19:23:16.266919+0000","last_clean":"2024-09-12T19:23:16.266919+0000","last_became_active":"2024-09-12T17:29:54.758311+0000","last_became_peered":"2024-09-12T17:29:54.758311+0000","last_unstale":"2024-09-12T19:23:16.266919+0000","last_undegraded":"2024-09-12T19:23:16.266919+0000","last_fullsized":"2024-09-12T19:23:16.266919+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'363","last_scrub_stamp":"2024-09-12T19:23:16.266739+0000","last_deep_scrub":"267'363","last_deep_scrub_stamp":"2024-09-12T19:23:16.266739+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.266739+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:18.541808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1918,"num_read_kb":1833,"num_write":390,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'336","reported_seq":1020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.171645+0000","last_change":"2024-09-12T19:23:10.171645+0000","last_active":"2024-09-12T19:23:10.171645+0000","last_peered":"2024-09-12T19:23:10.171645+0000","last_clean":"2024-09-12T19:23:10.171645+0000","last_became_active":"2024-09-12T17:29:52.716965+0000","last_became_peered":"2024-09-12T17:29:52.716965+0000","last_unstale":"2024-09-12T19:23:10.171645+0000","last_undegraded":"2024-09-12T19:23:10.171645+0000","last_fullsized":"2024-09-12T19:23:10.171645+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-12T19:23:10.171401+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-12T19:23:10.171401+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.171401+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:15.438323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262277,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":1122,"num_write":1102,"num_write_kb":14973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.669689+0000","last_change":"2024-09-12T19:23:25.669689+0000","last_active":"2024-09-12T19:23:25.669689+0000","last_peered":"2024-09-12T19:23:25.669689+0000","last_clean":"2024-09-12T19:23:25.669689+0000","last_became_active":"2024-09-12T17:29:56.765057+0000","last_became_peered":"2024-09-12T17:29:56.765057+0000","last_unstale":"2024-09-12T19:23:25.669689+0000","last_undegraded":"2024-09-12T19:23:25.669689+0000","last_fullsized":"2024-09-12T19:23:25.669689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:25.669504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:25.669504+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.669504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:14.220999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'375","reported_seq":1046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.977622+0000","last_change":"2024-09-12T19:23:24.977622+0000","last_active":"2024-09-12T19:23:24.977622+0000","last_peered":"2024-09-12T19:23:24.977622+0000","last_clean":"2024-09-12T19:23:24.977622+0000","last_became_active":"2024-09-12T17:29:58.771991+0000","last_became_peered":"2024-09-12T17:29:58.771991+0000","last_unstale":"2024-09-12T19:23:24.977622+0000","last_undegraded":"2024-09-12T19:23:24.977622+0000","last_fullsized":"2024-09-12T19:23:24.977622+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'375","last_scrub_stamp":"2024-09-12T19:23:24.977409+0000","last_deep_scrub":"267'375","last_deep_scrub_stamp":"2024-09-12T19:23:24.977409+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.977409+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:34.466039+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43575,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":600,"num_read_kb":1164,"num_write":460,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'753","reported_seq":5264,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.923677+0000","last_change":"2024-09-12T19:23:25.923677+0000","last_active":"2024-09-12T19:23:25.923677+0000","last_peered":"2024-09-12T19:23:25.923677+0000","last_clean":"2024-09-12T19:23:25.923677+0000","last_became_active":"2024-09-12T17:30:00.802950+0000","last_became_peered":"2024-09-12T17:30:00.802950+0000","last_unstale":"2024-09-12T19:23:25.923677+0000","last_undegraded":"2024-09-12T19:23:25.923677+0000","last_fullsized":"2024-09-12T19:23:25.923677+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'753","last_scrub_stamp":"2024-09-12T19:23:25.923495+0000","last_deep_scrub":"267'753","last_deep_scrub_stamp":"2024-09-12T19:23:25.923495+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.923495+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":701,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:31.579440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'114","reported_seq":648,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.672695+0000","last_change":"2024-09-12T19:23:32.672695+0000","last_active":"2024-09-12T19:23:32.672695+0000","last_peered":"2024-09-12T19:23:32.672695+0000","last_clean":"2024-09-12T19:23:32.672695+0000","last_became_active":"2024-09-12T17:30:02.806621+0000","last_became_peered":"2024-09-12T17:30:02.806621+0000","last_unstale":"2024-09-12T19:23:32.672695+0000","last_undegraded":"2024-09-12T19:23:32.672695+0000","last_fullsized":"2024-09-12T19:23:32.672695+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'114","last_scrub_stamp":"2024-09-12T19:23:32.672521+0000","last_deep_scrub":"267'114","last_deep_scrub_stamp":"2024-09-12T19:23:32.672521+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.672521+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:12.425992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":276,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'779","reported_seq":2461,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.251063+0000","last_change":"2024-09-12T19:23:17.251063+0000","last_active":"2024-09-12T19:23:17.251063+0000","last_peered":"2024-09-12T19:23:17.251063+0000","last_clean":"2024-09-12T19:23:17.251063+0000","last_became_active":"2024-09-12T17:29:54.763348+0000","last_became_peered":"2024-09-12T17:29:54.763348+0000","last_unstale":"2024-09-12T19:23:17.251063+0000","last_undegraded":"2024-09-12T19:23:17.251063+0000","last_fullsized":"2024-09-12T19:23:17.251063+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'779","last_scrub_stamp":"2024-09-12T19:23:17.250871+0000","last_deep_scrub":"267'779","last_deep_scrub_stamp":"2024-09-12T19:23:17.250871+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.250871+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:17.003332+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4009,"num_read_kb":3654,"num_write":1024,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3240,"num_omap_keys":13,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'307","reported_seq":984,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.186027+0000","last_change":"2024-09-12T19:23:09.186027+0000","last_active":"2024-09-12T19:23:09.186027+0000","last_peered":"2024-09-12T19:23:09.186027+0000","last_clean":"2024-09-12T19:23:09.186027+0000","last_became_active":"2024-09-12T17:29:52.744356+0000","last_became_peered":"2024-09-12T17:29:52.744356+0000","last_unstale":"2024-09-12T19:23:09.186027+0000","last_undegraded":"2024-09-12T19:23:09.186027+0000","last_fullsized":"2024-09-12T19:23:09.186027+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'307","last_scrub_stamp":"2024-09-12T19:23:09.185810+0000","last_deep_scrub":"267'307","last_deep_scrub_stamp":"2024-09-12T19:23:09.185810+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.185810+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:50.544329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":48689,"num_write":1045,"num_write_kb":32373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"267'4","reported_seq":1484,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.275059+0000","last_change":"2024-09-12T19:23:31.275059+0000","last_active":"2024-09-12T19:23:31.275059+0000","last_peered":"2024-09-12T19:23:31.275059+0000","last_clean":"2024-09-12T19:23:31.275059+0000","last_became_active":"2024-09-12T17:29:56.750915+0000","last_became_peered":"2024-09-12T17:29:56.750915+0000","last_unstale":"2024-09-12T19:23:31.275059+0000","last_undegraded":"2024-09-12T19:23:31.275059+0000","last_fullsized":"2024-09-12T19:23:31.275059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T19:23:31.274847+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T19:23:31.274847+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.274847+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:25.056431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'151","reported_seq":744,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.041887+0000","last_change":"2024-09-12T19:23:37.041887+0000","last_active":"2024-09-12T19:23:37.041887+0000","last_peered":"2024-09-12T19:23:37.041887+0000","last_clean":"2024-09-12T19:23:37.041887+0000","last_became_active":"2024-09-12T17:29:58.831628+0000","last_became_peered":"2024-09-12T17:29:58.831628+0000","last_unstale":"2024-09-12T19:23:37.041887+0000","last_undegraded":"2024-09-12T19:23:37.041887+0000","last_fullsized":"2024-09-12T19:23:37.041887+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'151","last_scrub_stamp":"2024-09-12T19:23:37.041661+0000","last_deep_scrub":"267'151","last_deep_scrub_stamp":"2024-09-12T19:23:37.041661+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.041661+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:39.506865+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'773","reported_seq":3254,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.215663+0000","last_change":"2024-09-12T19:23:26.215663+0000","last_active":"2024-09-12T19:23:26.215663+0000","last_peered":"2024-09-12T19:23:26.215663+0000","last_clean":"2024-09-12T19:23:26.215663+0000","last_became_active":"2024-09-12T17:30:00.806681+0000","last_became_peered":"2024-09-12T17:30:00.806681+0000","last_unstale":"2024-09-12T19:23:26.215663+0000","last_undegraded":"2024-09-12T19:23:26.215663+0000","last_fullsized":"2024-09-12T19:23:26.215663+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'773","last_scrub_stamp":"2024-09-12T19:23:26.215444+0000","last_deep_scrub":"267'773","last_deep_scrub_stamp":"2024-09-12T19:23:26.215444+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.215444+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":701,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:50.424909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'120","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.056467+0000","last_change":"2024-09-12T19:23:43.056467+0000","last_active":"2024-09-12T19:23:43.056467+0000","last_peered":"2024-09-12T19:23:43.056467+0000","last_clean":"2024-09-12T19:23:43.056467+0000","last_became_active":"2024-09-12T17:30:02.805954+0000","last_became_peered":"2024-09-12T17:30:02.805954+0000","last_unstale":"2024-09-12T19:23:43.056467+0000","last_undegraded":"2024-09-12T19:23:43.056467+0000","last_fullsized":"2024-09-12T19:23:43.056467+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'120","last_scrub_stamp":"2024-09-12T19:23:43.056284+0000","last_deep_scrub":"267'120","last_deep_scrub_stamp":"2024-09-12T19:23:43.056284+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.056284+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:11.535350+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":135,"num_write":268,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'521","reported_seq":2066,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.716900+0000","last_change":"2024-09-12T19:23:18.716900+0000","last_active":"2024-09-12T19:23:18.716900+0000","last_peered":"2024-09-12T19:23:18.716900+0000","last_clean":"2024-09-12T19:23:18.716900+0000","last_became_active":"2024-09-12T17:29:54.755550+0000","last_became_peered":"2024-09-12T17:29:54.755550+0000","last_unstale":"2024-09-12T19:23:18.716900+0000","last_undegraded":"2024-09-12T19:23:18.716900+0000","last_fullsized":"2024-09-12T19:23:18.716900+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'521","last_scrub_stamp":"2024-09-12T19:23:18.716720+0000","last_deep_scrub":"267'521","last_deep_scrub_stamp":"2024-09-12T19:23:18.716720+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.716720+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:37.752618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2775,"num_read_kb":2556,"num_write":676,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'376","reported_seq":1080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.210414+0000","last_change":"2024-09-12T19:23:09.210414+0000","last_active":"2024-09-12T19:23:09.210414+0000","last_peered":"2024-09-12T19:23:09.210414+0000","last_clean":"2024-09-12T19:23:09.210414+0000","last_became_active":"2024-09-12T17:30:21.696077+0000","last_became_peered":"2024-09-12T17:30:21.696077+0000","last_unstale":"2024-09-12T19:23:09.210414+0000","last_undegraded":"2024-09-12T19:23:09.210414+0000","last_fullsized":"2024-09-12T19:23:09.210414+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'376","last_scrub_stamp":"2024-09-12T19:23:09.210184+0000","last_deep_scrub":"267'376","last_deep_scrub_stamp":"2024-09-12T19:23:09.210184+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.210184+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:47.241745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":12866,"num_write":1197,"num_write_kb":34720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.184206+0000","last_change":"2024-09-12T19:23:30.184206+0000","last_active":"2024-09-12T19:23:30.184206+0000","last_peered":"2024-09-12T19:23:30.184206+0000","last_clean":"2024-09-12T19:23:30.184206+0000","last_became_active":"2024-09-12T17:29:56.757728+0000","last_became_peered":"2024-09-12T17:29:56.757728+0000","last_unstale":"2024-09-12T19:23:30.184206+0000","last_undegraded":"2024-09-12T19:23:30.184206+0000","last_fullsized":"2024-09-12T19:23:30.184206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:30.184021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:30.184021+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.184021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:39.958678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'425","reported_seq":1111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.253848+0000","last_change":"2024-09-12T19:23:35.253848+0000","last_active":"2024-09-12T19:23:35.253848+0000","last_peered":"2024-09-12T19:23:35.253848+0000","last_clean":"2024-09-12T19:23:35.253848+0000","last_became_active":"2024-09-12T17:29:58.776033+0000","last_became_peered":"2024-09-12T17:29:58.776033+0000","last_unstale":"2024-09-12T19:23:35.253848+0000","last_undegraded":"2024-09-12T19:23:35.253848+0000","last_fullsized":"2024-09-12T19:23:35.253848+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'425","last_scrub_stamp":"2024-09-12T19:23:35.253485+0000","last_deep_scrub":"267'425","last_deep_scrub_stamp":"2024-09-12T19:23:35.253485+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.253485+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:26.115780+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47722,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":665,"num_read_kb":1193,"num_write":496,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.210780+0000","last_change":"2024-09-12T19:23:25.210780+0000","last_active":"2024-09-12T19:23:25.210780+0000","last_peered":"2024-09-12T19:23:25.210780+0000","last_clean":"2024-09-12T19:23:25.210780+0000","last_became_active":"2024-09-12T17:30:00.792687+0000","last_became_peered":"2024-09-12T17:30:00.792687+0000","last_unstale":"2024-09-12T19:23:25.210780+0000","last_undegraded":"2024-09-12T19:23:25.210780+0000","last_fullsized":"2024-09-12T19:23:25.210780+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:25.210462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:25.210462+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.210462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:31.054537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'167","reported_seq":706,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.651594+0000","last_change":"2024-09-12T19:23:33.651594+0000","last_active":"2024-09-12T19:23:33.651594+0000","last_peered":"2024-09-12T19:23:33.651594+0000","last_clean":"2024-09-12T19:23:33.651594+0000","last_became_active":"2024-09-12T17:30:02.809252+0000","last_became_peered":"2024-09-12T17:30:02.809252+0000","last_unstale":"2024-09-12T19:23:33.651594+0000","last_undegraded":"2024-09-12T19:23:33.651594+0000","last_fullsized":"2024-09-12T19:23:33.651594+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'167","last_scrub_stamp":"2024-09-12T19:23:33.651391+0000","last_deep_scrub":"267'167","last_deep_scrub_stamp":"2024-09-12T19:23:33.651391+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.651391+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:24.162865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":242,"num_read_kb":230,"num_write":407,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'457","reported_seq":1891,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.227830+0000","last_change":"2024-09-12T19:23:16.227830+0000","last_active":"2024-09-12T19:23:16.227830+0000","last_peered":"2024-09-12T19:23:16.227830+0000","last_clean":"2024-09-12T19:23:16.227830+0000","last_became_active":"2024-09-12T17:29:54.771538+0000","last_became_peered":"2024-09-12T17:29:54.771538+0000","last_unstale":"2024-09-12T19:23:16.227830+0000","last_undegraded":"2024-09-12T19:23:16.227830+0000","last_fullsized":"2024-09-12T19:23:16.227830+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'457","last_scrub_stamp":"2024-09-12T19:23:16.227601+0000","last_deep_scrub":"267'457","last_deep_scrub_stamp":"2024-09-12T19:23:16.227601+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.227601+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:42.639886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2249,"num_read_kb":2075,"num_write":554,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":653,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.928447+0000","last_change":"2024-09-12T19:23:09.928447+0000","last_active":"2024-09-12T19:23:09.928447+0000","last_peered":"2024-09-12T19:23:09.928447+0000","last_clean":"2024-09-12T19:23:09.928447+0000","last_became_active":"2024-09-12T17:29:30.601518+0000","last_became_peered":"2024-09-12T17:29:30.601518+0000","last_unstale":"2024-09-12T19:23:09.928447+0000","last_undegraded":"2024-09-12T19:23:09.928447+0000","last_fullsized":"2024-09-12T19:23:09.928447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-12T19:23:09.928248+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-12T19:23:09.928248+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.928248+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:35.888829+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.259855+0000","last_change":"2024-09-12T19:23:10.259855+0000","last_active":"2024-09-12T19:23:10.259855+0000","last_peered":"2024-09-12T19:23:10.259855+0000","last_clean":"2024-09-12T19:23:10.259855+0000","last_became_active":"2024-09-12T17:29:35.340342+0000","last_became_peered":"2024-09-12T17:29:35.340342+0000","last_unstale":"2024-09-12T19:23:10.259855+0000","last_undegraded":"2024-09-12T19:23:10.259855+0000","last_fullsized":"2024-09-12T19:23:10.259855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:10.259670+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:10.259670+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.259670+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:38.403829+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.00097602599999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'336","reported_seq":1026,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:08.204936+0000","last_change":"2024-09-12T19:23:08.204936+0000","last_active":"2024-09-12T19:23:08.204936+0000","last_peered":"2024-09-12T19:23:08.204936+0000","last_clean":"2024-09-12T19:23:08.204936+0000","last_became_active":"2024-09-12T17:29:52.765497+0000","last_became_peered":"2024-09-12T17:29:52.765497+0000","last_unstale":"2024-09-12T19:23:08.204936+0000","last_undegraded":"2024-09-12T19:23:08.204936+0000","last_fullsized":"2024-09-12T19:23:08.204936+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-12T19:23:08.204778+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-12T19:23:08.204778+0000","last_clean_scrub_stamp":"2024-09-12T19:23:08.204778+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:46.017915+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2167098,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":533,"num_read_kb":15769,"num_write":1043,"num_write_kb":23964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.078540+0000","last_change":"2024-09-12T19:23:26.078540+0000","last_active":"2024-09-12T19:23:26.078540+0000","last_peered":"2024-09-12T19:23:26.078540+0000","last_clean":"2024-09-12T19:23:26.078540+0000","last_became_active":"2024-09-12T17:29:56.749938+0000","last_became_peered":"2024-09-12T17:29:56.749938+0000","last_unstale":"2024-09-12T19:23:26.078540+0000","last_undegraded":"2024-09-12T19:23:26.078540+0000","last_fullsized":"2024-09-12T19:23:26.078540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:26.078358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:26.078358+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.078358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:45.805777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'804","reported_seq":1556,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.284313+0000","last_change":"2024-09-12T19:23:33.284313+0000","last_active":"2024-09-12T19:23:33.284313+0000","last_peered":"2024-09-12T19:23:33.284313+0000","last_clean":"2024-09-12T19:23:33.284313+0000","last_became_active":"2024-09-12T17:29:58.769277+0000","last_became_peered":"2024-09-12T17:29:58.769277+0000","last_unstale":"2024-09-12T19:23:33.284313+0000","last_undegraded":"2024-09-12T19:23:33.284313+0000","last_fullsized":"2024-09-12T19:23:33.284313+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'804","last_scrub_stamp":"2024-09-12T19:23:33.284129+0000","last_deep_scrub":"267'804","last_deep_scrub_stamp":"2024-09-12T19:23:33.284129+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.284129+0000","objects_scrubbed":6,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:19.887143+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159898,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1560,"num_read_kb":3538,"num_write":1488,"num_write_kb":1318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89338,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.804403+0000","last_change":"2024-09-12T19:23:35.804403+0000","last_active":"2024-09-12T19:23:35.804403+0000","last_peered":"2024-09-12T19:23:35.804403+0000","last_clean":"2024-09-12T19:23:35.804403+0000","last_became_active":"2024-09-12T17:30:00.799883+0000","last_became_peered":"2024-09-12T17:30:00.799883+0000","last_unstale":"2024-09-12T19:23:35.804403+0000","last_undegraded":"2024-09-12T19:23:35.804403+0000","last_fullsized":"2024-09-12T19:23:35.804403+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:35.804163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:35.804163+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.804163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:13.337181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'201","reported_seq":936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.358243+0000","last_change":"2024-09-12T19:23:32.358243+0000","last_active":"2024-09-12T19:23:32.358243+0000","last_peered":"2024-09-12T19:23:32.358243+0000","last_clean":"2024-09-12T19:23:32.358243+0000","last_became_active":"2024-09-12T17:30:02.799307+0000","last_became_peered":"2024-09-12T17:30:02.799307+0000","last_unstale":"2024-09-12T19:23:32.358243+0000","last_undegraded":"2024-09-12T19:23:32.358243+0000","last_fullsized":"2024-09-12T19:23:32.358243+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-12T19:23:32.358039+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-12T19:23:32.358039+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.358039+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:54.479773+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1000,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":467,"num_write":393,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'477","reported_seq":2046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.883431+0000","last_change":"2024-09-12T19:23:13.883431+0000","last_active":"2024-09-12T19:23:13.883431+0000","last_peered":"2024-09-12T19:23:13.883431+0000","last_clean":"2024-09-12T19:23:13.883431+0000","last_became_active":"2024-09-12T17:29:54.758196+0000","last_became_peered":"2024-09-12T17:29:54.758196+0000","last_unstale":"2024-09-12T19:23:13.883431+0000","last_undegraded":"2024-09-12T19:23:13.883431+0000","last_fullsized":"2024-09-12T19:23:13.883431+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'477","last_scrub_stamp":"2024-09-12T19:23:13.883243+0000","last_deep_scrub":"267'477","last_deep_scrub_stamp":"2024-09-12T19:23:13.883243+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.883243+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:38.406363+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2778,"num_read_kb":2582,"num_write":658,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":560,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.930668+0000","last_change":"2024-09-12T19:23:10.930668+0000","last_active":"2024-09-12T19:23:10.930668+0000","last_peered":"2024-09-12T19:23:10.930668+0000","last_clean":"2024-09-12T19:23:10.930668+0000","last_became_active":"2024-09-12T17:29:35.336475+0000","last_became_peered":"2024-09-12T17:29:35.336475+0000","last_unstale":"2024-09-12T19:23:10.930668+0000","last_undegraded":"2024-09-12T19:23:10.930668+0000","last_fullsized":"2024-09-12T19:23:10.930668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:10.930485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:10.930485+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.930485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:54.374314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012883599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'346","reported_seq":1079,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.866118+0000","last_change":"2024-09-12T19:23:09.866118+0000","last_active":"2024-09-12T19:23:09.866118+0000","last_peered":"2024-09-12T19:23:09.866118+0000","last_clean":"2024-09-12T19:23:09.866118+0000","last_became_active":"2024-09-12T17:29:52.766251+0000","last_became_peered":"2024-09-12T17:29:52.766251+0000","last_unstale":"2024-09-12T19:23:09.866118+0000","last_undegraded":"2024-09-12T19:23:09.866118+0000","last_fullsized":"2024-09-12T19:23:09.866118+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-09-12T19:23:09.865739+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-09-12T19:23:09.865739+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.865739+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:30.064297+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730134,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":595,"num_read_kb":84420,"num_write":1189,"num_write_kb":23129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.361544+0000","last_change":"2024-09-12T19:23:28.361544+0000","last_active":"2024-09-12T19:23:28.361544+0000","last_peered":"2024-09-12T19:23:28.361544+0000","last_clean":"2024-09-12T19:23:28.361544+0000","last_became_active":"2024-09-12T17:29:56.762451+0000","last_became_peered":"2024-09-12T17:29:56.762451+0000","last_unstale":"2024-09-12T19:23:28.361544+0000","last_undegraded":"2024-09-12T19:23:28.361544+0000","last_fullsized":"2024-09-12T19:23:28.361544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:28.361367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:28.361367+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.361367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:29.878422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1467","reported_seq":3824,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.687095+0000","last_change":"2024-09-12T19:23:28.687095+0000","last_active":"2024-09-12T19:23:28.687095+0000","last_peered":"2024-09-12T19:23:28.687095+0000","last_clean":"2024-09-12T19:23:28.687095+0000","last_became_active":"2024-09-12T17:29:58.771561+0000","last_became_peered":"2024-09-12T17:29:58.771561+0000","last_unstale":"2024-09-12T19:23:28.687095+0000","last_undegraded":"2024-09-12T19:23:28.687095+0000","last_fullsized":"2024-09-12T19:23:28.687095+0000","mapping_epoch":32,"log_start":"267'1400","ondisk_log_start":"267'1400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1467","last_scrub_stamp":"2024-09-12T19:23:28.686903+0000","last_deep_scrub":"267'1467","last_deep_scrub_stamp":"2024-09-12T19:23:28.686903+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.686903+0000","objects_scrubbed":11,"log_size":67,"log_dups_size":1400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:38.779259+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146977,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2279,"num_read_kb":4182,"num_write":1388,"num_write_kb":1130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.107674+0000","last_change":"2024-09-12T19:23:36.107674+0000","last_active":"2024-09-12T19:23:36.107674+0000","last_peered":"2024-09-12T19:23:36.107674+0000","last_clean":"2024-09-12T19:23:36.107674+0000","last_became_active":"2024-09-12T17:30:00.806030+0000","last_became_peered":"2024-09-12T17:30:00.806030+0000","last_unstale":"2024-09-12T19:23:36.107674+0000","last_undegraded":"2024-09-12T19:23:36.107674+0000","last_fullsized":"2024-09-12T19:23:36.107674+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:36.107355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:36.107355+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.107355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:31.839594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'219","reported_seq":771,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.671259+0000","last_change":"2024-09-12T19:23:36.671259+0000","last_active":"2024-09-12T19:23:36.671259+0000","last_peered":"2024-09-12T19:23:36.671259+0000","last_clean":"2024-09-12T19:23:36.671259+0000","last_became_active":"2024-09-12T17:30:02.809372+0000","last_became_peered":"2024-09-12T17:30:02.809372+0000","last_unstale":"2024-09-12T19:23:36.671259+0000","last_undegraded":"2024-09-12T19:23:36.671259+0000","last_fullsized":"2024-09-12T19:23:36.671259+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'219","last_scrub_stamp":"2024-09-12T19:23:36.671063+0000","last_deep_scrub":"267'219","last_deep_scrub_stamp":"2024-09-12T19:23:36.671063+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.671063+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:43.095477+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":353,"num_read_kb":353,"num_write":469,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'467","reported_seq":2059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.685511+0000","last_change":"2024-09-12T19:23:14.685511+0000","last_active":"2024-09-12T19:23:14.685511+0000","last_peered":"2024-09-12T19:23:14.685511+0000","last_clean":"2024-09-12T19:23:14.685511+0000","last_became_active":"2024-09-12T17:29:54.747270+0000","last_became_peered":"2024-09-12T17:29:54.747270+0000","last_unstale":"2024-09-12T19:23:14.685511+0000","last_undegraded":"2024-09-12T19:23:14.685511+0000","last_fullsized":"2024-09-12T19:23:14.685511+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'467","last_scrub_stamp":"2024-09-12T19:23:14.685322+0000","last_deep_scrub":"267'467","last_deep_scrub_stamp":"2024-09-12T19:23:14.685322+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.685322+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:35.304389+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2522,"num_read_kb":2358,"num_write":589,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":572,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.974668+0000","last_change":"2024-09-12T19:23:09.974668+0000","last_active":"2024-09-12T19:23:09.974668+0000","last_peered":"2024-09-12T19:23:09.974668+0000","last_clean":"2024-09-12T19:23:09.974668+0000","last_became_active":"2024-09-12T17:29:35.331504+0000","last_became_peered":"2024-09-12T17:29:35.331504+0000","last_unstale":"2024-09-12T19:23:09.974668+0000","last_undegraded":"2024-09-12T19:23:09.974668+0000","last_fullsized":"2024-09-12T19:23:09.974668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:09.974482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:09.974482+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.974482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:21.285772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001034428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'347","reported_seq":991,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:07.691765+0000","last_change":"2024-09-12T19:23:07.691765+0000","last_active":"2024-09-12T19:23:07.691765+0000","last_peered":"2024-09-12T19:23:07.691765+0000","last_clean":"2024-09-12T19:23:07.691765+0000","last_became_active":"2024-09-12T17:29:52.741209+0000","last_became_peered":"2024-09-12T17:29:52.741209+0000","last_unstale":"2024-09-12T19:23:07.691765+0000","last_undegraded":"2024-09-12T19:23:07.691765+0000","last_fullsized":"2024-09-12T19:23:07.691765+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'347","last_scrub_stamp":"2024-09-12T19:23:07.691644+0000","last_deep_scrub":"267'347","last_deep_scrub_stamp":"2024-09-12T19:23:07.691644+0000","last_clean_scrub_stamp":"2024-09-12T19:23:07.691644+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:20.196315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":451,"num_read_kb":5499,"num_write":979,"num_write_kb":15070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":545,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.942556+0000","last_change":"2024-09-12T19:23:17.942556+0000","last_active":"2024-09-12T19:23:17.942556+0000","last_peered":"2024-09-12T19:23:17.942556+0000","last_clean":"2024-09-12T19:23:17.942556+0000","last_became_active":"2024-09-12T17:29:56.753063+0000","last_became_peered":"2024-09-12T17:29:56.753063+0000","last_unstale":"2024-09-12T19:23:17.942556+0000","last_undegraded":"2024-09-12T19:23:17.942556+0000","last_fullsized":"2024-09-12T19:23:17.942556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:17.942378+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:17.942378+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.942378+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:50.587264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'376","reported_seq":2333,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.109008+0000","last_change":"2024-09-12T19:23:34.109008+0000","last_active":"2024-09-12T19:23:34.109008+0000","last_peered":"2024-09-12T19:23:34.109008+0000","last_clean":"2024-09-12T19:23:34.109008+0000","last_became_active":"2024-09-12T17:29:58.834447+0000","last_became_peered":"2024-09-12T17:29:58.834447+0000","last_unstale":"2024-09-12T19:23:34.109008+0000","last_undegraded":"2024-09-12T19:23:34.109008+0000","last_fullsized":"2024-09-12T19:23:34.109008+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'376","last_scrub_stamp":"2024-09-12T19:23:34.108814+0000","last_deep_scrub":"267'376","last_deep_scrub_stamp":"2024-09-12T19:23:34.108814+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.108814+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:43.158205+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":368,"num_read_kb":360,"num_write":359,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.795321+0000","last_change":"2024-09-12T19:23:34.795321+0000","last_active":"2024-09-12T19:23:34.795321+0000","last_peered":"2024-09-12T19:23:34.795321+0000","last_clean":"2024-09-12T19:23:34.795321+0000","last_became_active":"2024-09-12T17:30:00.778134+0000","last_became_peered":"2024-09-12T17:30:00.778134+0000","last_unstale":"2024-09-12T19:23:34.795321+0000","last_undegraded":"2024-09-12T19:23:34.795321+0000","last_fullsized":"2024-09-12T19:23:34.795321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:34.795145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:34.795145+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.795145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:05.761948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'272","reported_seq":923,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:46.097251+0000","last_change":"2024-09-12T19:23:46.097251+0000","last_active":"2024-09-12T19:23:46.097251+0000","last_peered":"2024-09-12T19:23:46.097251+0000","last_clean":"2024-09-12T19:23:46.097251+0000","last_became_active":"2024-09-12T17:30:02.805090+0000","last_became_peered":"2024-09-12T17:30:02.805090+0000","last_unstale":"2024-09-12T19:23:46.097251+0000","last_undegraded":"2024-09-12T19:23:46.097251+0000","last_fullsized":"2024-09-12T19:23:46.097251+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'272","last_scrub_stamp":"2024-09-12T19:23:46.097005+0000","last_deep_scrub":"267'272","last_deep_scrub_stamp":"2024-09-12T19:23:46.097005+0000","last_clean_scrub_stamp":"2024-09-12T19:23:46.097005+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:07.690681+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":596,"num_read_kb":605,"num_write":610,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'411","reported_seq":1966,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.669552+0000","last_change":"2024-09-12T19:23:20.669552+0000","last_active":"2024-09-12T19:23:20.669552+0000","last_peered":"2024-09-12T19:23:20.669552+0000","last_clean":"2024-09-12T19:23:20.669552+0000","last_became_active":"2024-09-12T17:29:54.745423+0000","last_became_peered":"2024-09-12T17:29:54.745423+0000","last_unstale":"2024-09-12T19:23:20.669552+0000","last_undegraded":"2024-09-12T19:23:20.669552+0000","last_fullsized":"2024-09-12T19:23:20.669552+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'411","last_scrub_stamp":"2024-09-12T19:23:20.669299+0000","last_deep_scrub":"267'411","last_deep_scrub_stamp":"2024-09-12T19:23:20.669299+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.669299+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:50.595760+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2154,"num_read_kb":2073,"num_write":474,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":562,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.235866+0000","last_change":"2024-09-12T19:23:12.235866+0000","last_active":"2024-09-12T19:23:12.235866+0000","last_peered":"2024-09-12T19:23:12.235866+0000","last_clean":"2024-09-12T19:23:12.235866+0000","last_became_active":"2024-09-12T17:29:35.340113+0000","last_became_peered":"2024-09-12T17:29:35.340113+0000","last_unstale":"2024-09-12T19:23:12.235866+0000","last_undegraded":"2024-09-12T19:23:12.235866+0000","last_fullsized":"2024-09-12T19:23:12.235866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:12.235689+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:12.235689+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.235689+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:20.303471+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0020086050000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'366","reported_seq":1122,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:08.225908+0000","last_change":"2024-09-12T19:23:08.225908+0000","last_active":"2024-09-12T19:23:08.225908+0000","last_peered":"2024-09-12T19:23:08.225908+0000","last_clean":"2024-09-12T19:23:08.225908+0000","last_became_active":"2024-09-12T17:29:52.759957+0000","last_became_peered":"2024-09-12T17:29:52.759957+0000","last_unstale":"2024-09-12T19:23:08.225908+0000","last_undegraded":"2024-09-12T19:23:08.225908+0000","last_fullsized":"2024-09-12T19:23:08.225908+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'366","last_scrub_stamp":"2024-09-12T19:23:08.225657+0000","last_deep_scrub":"267'366","last_deep_scrub_stamp":"2024-09-12T19:23:08.225657+0000","last_clean_scrub_stamp":"2024-09-12T19:23:08.225657+0000","objects_scrubbed":10,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:08.296014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279708,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":651,"num_read_kb":39253,"num_write":1178,"num_write_kb":45869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.816409+0000","last_change":"2024-09-12T19:23:20.816409+0000","last_active":"2024-09-12T19:23:20.816409+0000","last_peered":"2024-09-12T19:23:20.816409+0000","last_clean":"2024-09-12T19:23:20.816409+0000","last_became_active":"2024-09-12T17:29:56.765361+0000","last_became_peered":"2024-09-12T17:29:56.765361+0000","last_unstale":"2024-09-12T19:23:20.816409+0000","last_undegraded":"2024-09-12T19:23:20.816409+0000","last_fullsized":"2024-09-12T19:23:20.816409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:20.816187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:20.816187+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.816187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:19:00.594416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'217","reported_seq":840,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.055445+0000","last_change":"2024-09-12T19:23:35.055445+0000","last_active":"2024-09-12T19:23:35.055445+0000","last_peered":"2024-09-12T19:23:35.055445+0000","last_clean":"2024-09-12T19:23:35.055445+0000","last_became_active":"2024-09-12T17:29:58.768596+0000","last_became_peered":"2024-09-12T17:29:58.768596+0000","last_unstale":"2024-09-12T19:23:35.055445+0000","last_undegraded":"2024-09-12T19:23:35.055445+0000","last_fullsized":"2024-09-12T19:23:35.055445+0000","mapping_epoch":32,"log_start":"267'201","ondisk_log_start":"267'201","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'217","last_scrub_stamp":"2024-09-12T19:23:35.055130+0000","last_deep_scrub":"267'217","last_deep_scrub_stamp":"2024-09-12T19:23:35.055130+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.055130+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":201,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:05.111750+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.237039+0000","last_change":"2024-09-12T19:23:24.237039+0000","last_active":"2024-09-12T19:23:24.237039+0000","last_peered":"2024-09-12T19:23:24.237039+0000","last_clean":"2024-09-12T19:23:24.237039+0000","last_became_active":"2024-09-12T17:30:00.788505+0000","last_became_peered":"2024-09-12T17:30:00.788505+0000","last_unstale":"2024-09-12T19:23:24.237039+0000","last_undegraded":"2024-09-12T19:23:24.237039+0000","last_fullsized":"2024-09-12T19:23:24.237039+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:24.236855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:24.236855+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.236855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:04:51.530055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'157","reported_seq":745,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.323482+0000","last_change":"2024-09-12T19:23:40.323482+0000","last_active":"2024-09-12T19:23:40.323482+0000","last_peered":"2024-09-12T19:23:40.323482+0000","last_clean":"2024-09-12T19:23:40.323482+0000","last_became_active":"2024-09-12T17:30:02.794703+0000","last_became_peered":"2024-09-12T17:30:02.794703+0000","last_unstale":"2024-09-12T19:23:40.323482+0000","last_undegraded":"2024-09-12T19:23:40.323482+0000","last_fullsized":"2024-09-12T19:23:40.323482+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'157","last_scrub_stamp":"2024-09-12T19:23:40.323277+0000","last_deep_scrub":"267'157","last_deep_scrub_stamp":"2024-09-12T19:23:40.323277+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.323277+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:18.158223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":268,"num_read_kb":254,"num_write":347,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'419","reported_seq":2024,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.689299+0000","last_change":"2024-09-12T19:23:11.689299+0000","last_active":"2024-09-12T19:23:11.689299+0000","last_peered":"2024-09-12T19:23:11.689299+0000","last_clean":"2024-09-12T19:23:11.689299+0000","last_became_active":"2024-09-12T17:29:54.766275+0000","last_became_peered":"2024-09-12T17:29:54.766275+0000","last_unstale":"2024-09-12T19:23:11.689299+0000","last_undegraded":"2024-09-12T19:23:11.689299+0000","last_fullsized":"2024-09-12T19:23:11.689299+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'419","last_scrub_stamp":"2024-09-12T19:23:11.689112+0000","last_deep_scrub":"267'419","last_deep_scrub_stamp":"2024-09-12T19:23:11.689112+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.689112+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:41.829755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2280,"num_read_kb":2171,"num_write":482,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'349","reported_seq":1034,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.235471+0000","last_change":"2024-09-12T19:23:09.235471+0000","last_active":"2024-09-12T19:23:09.235471+0000","last_peered":"2024-09-12T19:23:09.235471+0000","last_clean":"2024-09-12T19:23:09.235471+0000","last_became_active":"2024-09-12T17:29:52.740544+0000","last_became_peered":"2024-09-12T17:29:52.740544+0000","last_unstale":"2024-09-12T19:23:09.235471+0000","last_undegraded":"2024-09-12T19:23:09.235471+0000","last_fullsized":"2024-09-12T19:23:09.235471+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-12T19:23:09.235171+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-12T19:23:09.235171+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.235171+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:19.968121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":6019,"num_write":1130,"num_write_kb":22769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":562,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:08.639498+0000","last_change":"2024-09-12T19:23:08.639498+0000","last_active":"2024-09-12T19:23:08.639498+0000","last_peered":"2024-09-12T19:23:08.639498+0000","last_clean":"2024-09-12T19:23:08.639498+0000","last_became_active":"2024-09-12T17:29:35.407492+0000","last_became_peered":"2024-09-12T17:29:35.407492+0000","last_unstale":"2024-09-12T19:23:08.639498+0000","last_undegraded":"2024-09-12T19:23:08.639498+0000","last_fullsized":"2024-09-12T19:23:08.639498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:08.639425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:08.639425+0000","last_clean_scrub_stamp":"2024-09-12T19:23:08.639425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:59.907415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098134900000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.803905+0000","last_change":"2024-09-12T19:23:31.803905+0000","last_active":"2024-09-12T19:23:31.803905+0000","last_peered":"2024-09-12T19:23:31.803905+0000","last_clean":"2024-09-12T19:23:31.803905+0000","last_became_active":"2024-09-12T17:29:56.769344+0000","last_became_peered":"2024-09-12T17:29:56.769344+0000","last_unstale":"2024-09-12T19:23:31.803905+0000","last_undegraded":"2024-09-12T19:23:31.803905+0000","last_fullsized":"2024-09-12T19:23:31.803905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:31.803722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:31.803722+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.803722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:40.239034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'771","reported_seq":1519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.838550+0000","last_change":"2024-09-12T19:23:24.838550+0000","last_active":"2024-09-12T19:23:24.838550+0000","last_peered":"2024-09-12T19:23:24.838550+0000","last_clean":"2024-09-12T19:23:24.838550+0000","last_became_active":"2024-09-12T17:29:58.766353+0000","last_became_peered":"2024-09-12T17:29:58.766353+0000","last_unstale":"2024-09-12T19:23:24.838550+0000","last_undegraded":"2024-09-12T19:23:24.838550+0000","last_fullsized":"2024-09-12T19:23:24.838550+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'771","last_scrub_stamp":"2024-09-12T19:23:24.838217+0000","last_deep_scrub":"267'771","last_deep_scrub_stamp":"2024-09-12T19:23:24.838217+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.838217+0000","objects_scrubbed":10,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:30.026559+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88446,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1874,"num_read_kb":3148,"num_write":2424,"num_write_kb":2173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":501744,"num_omap_keys":1138,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.128408+0000","last_change":"2024-09-12T19:23:37.128408+0000","last_active":"2024-09-12T19:23:37.128408+0000","last_peered":"2024-09-12T19:23:37.128408+0000","last_clean":"2024-09-12T19:23:37.128408+0000","last_became_active":"2024-09-12T17:30:00.783385+0000","last_became_peered":"2024-09-12T17:30:00.783385+0000","last_unstale":"2024-09-12T19:23:37.128408+0000","last_undegraded":"2024-09-12T19:23:37.128408+0000","last_fullsized":"2024-09-12T19:23:37.128408+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:37.128205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:37.128205+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.128205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:07.825249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'149","reported_seq":685,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.722077+0000","last_change":"2024-09-12T19:23:40.722077+0000","last_active":"2024-09-12T19:23:40.722077+0000","last_peered":"2024-09-12T19:23:40.722077+0000","last_clean":"2024-09-12T19:23:40.722077+0000","last_became_active":"2024-09-12T17:30:02.805684+0000","last_became_peered":"2024-09-12T17:30:02.805684+0000","last_unstale":"2024-09-12T19:23:40.722077+0000","last_undegraded":"2024-09-12T19:23:40.722077+0000","last_fullsized":"2024-09-12T19:23:40.722077+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'149","last_scrub_stamp":"2024-09-12T19:23:40.721838+0000","last_deep_scrub":"267'149","last_deep_scrub_stamp":"2024-09-12T19:23:40.721838+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.721838+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:59.142442+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":165,"num_read_kb":163,"num_write":341,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'407","reported_seq":1916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.843610+0000","last_change":"2024-09-12T19:23:23.843610+0000","last_active":"2024-09-12T19:23:23.843610+0000","last_peered":"2024-09-12T19:23:23.843610+0000","last_clean":"2024-09-12T19:23:23.843610+0000","last_became_active":"2024-09-12T17:29:54.758047+0000","last_became_peered":"2024-09-12T17:29:54.758047+0000","last_unstale":"2024-09-12T19:23:23.843610+0000","last_undegraded":"2024-09-12T19:23:23.843610+0000","last_fullsized":"2024-09-12T19:23:23.843610+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'407","last_scrub_stamp":"2024-09-12T19:23:23.843421+0000","last_deep_scrub":"267'407","last_deep_scrub_stamp":"2024-09-12T19:23:23.843421+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.843421+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:49.696068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2269,"num_read_kb":2144,"num_write":466,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1732,"num_omap_keys":7,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'307","reported_seq":1193,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.655275+0000","last_change":"2024-09-12T19:23:10.655275+0000","last_active":"2024-09-12T19:23:10.655275+0000","last_peered":"2024-09-12T19:23:10.655275+0000","last_clean":"2024-09-12T19:23:10.655275+0000","last_became_active":"2024-09-12T17:29:52.727635+0000","last_became_peered":"2024-09-12T17:29:52.727635+0000","last_unstale":"2024-09-12T19:23:10.655275+0000","last_undegraded":"2024-09-12T19:23:10.655275+0000","last_fullsized":"2024-09-12T19:23:10.655275+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'307","last_scrub_stamp":"2024-09-12T19:23:10.655045+0000","last_deep_scrub":"267'307","last_deep_scrub_stamp":"2024-09-12T19:23:10.655045+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.655045+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:43.716739+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109709,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":897,"num_read_kb":32569,"num_write":1024,"num_write_kb":39553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":558,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.972190+0000","last_change":"2024-09-12T19:23:11.972190+0000","last_active":"2024-09-12T19:23:11.972190+0000","last_peered":"2024-09-12T19:23:11.972190+0000","last_clean":"2024-09-12T19:23:11.972190+0000","last_became_active":"2024-09-12T17:29:35.406653+0000","last_became_peered":"2024-09-12T17:29:35.406653+0000","last_unstale":"2024-09-12T19:23:11.972190+0000","last_undegraded":"2024-09-12T19:23:11.972190+0000","last_fullsized":"2024-09-12T19:23:11.972190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:11.972019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:11.972019+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.972019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:02.613400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001315566,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.209747+0000","last_change":"2024-09-12T19:23:21.209747+0000","last_active":"2024-09-12T19:23:21.209747+0000","last_peered":"2024-09-12T19:23:21.209747+0000","last_clean":"2024-09-12T19:23:21.209747+0000","last_became_active":"2024-09-12T17:29:56.769576+0000","last_became_peered":"2024-09-12T17:29:56.769576+0000","last_unstale":"2024-09-12T19:23:21.209747+0000","last_undegraded":"2024-09-12T19:23:21.209747+0000","last_fullsized":"2024-09-12T19:23:21.209747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:21.209539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:21.209539+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.209539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:58.220864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'345","reported_seq":992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.684786+0000","last_change":"2024-09-12T19:23:26.684786+0000","last_active":"2024-09-12T19:23:26.684786+0000","last_peered":"2024-09-12T19:23:26.684786+0000","last_clean":"2024-09-12T19:23:26.684786+0000","last_became_active":"2024-09-12T17:29:58.830993+0000","last_became_peered":"2024-09-12T17:29:58.830993+0000","last_unstale":"2024-09-12T19:23:26.684786+0000","last_undegraded":"2024-09-12T19:23:26.684786+0000","last_fullsized":"2024-09-12T19:23:26.684786+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'345","last_scrub_stamp":"2024-09-12T19:23:26.684582+0000","last_deep_scrub":"267'345","last_deep_scrub_stamp":"2024-09-12T19:23:26.684582+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.684582+0000","objects_scrubbed":8,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:39.601631+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":439,"num_read_kb":430,"num_write":418,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'792","reported_seq":3382,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.285075+0000","last_change":"2024-09-12T19:23:37.285075+0000","last_active":"2024-09-12T19:23:37.285075+0000","last_peered":"2024-09-12T19:23:37.285075+0000","last_clean":"2024-09-12T19:23:37.285075+0000","last_became_active":"2024-09-12T17:30:00.805059+0000","last_became_peered":"2024-09-12T17:30:00.805059+0000","last_unstale":"2024-09-12T19:23:37.285075+0000","last_undegraded":"2024-09-12T19:23:37.285075+0000","last_fullsized":"2024-09-12T19:23:37.285075+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'792","last_scrub_stamp":"2024-09-12T19:23:37.284894+0000","last_deep_scrub":"267'792","last_deep_scrub_stamp":"2024-09-12T19:23:37.284894+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.284894+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":701,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:14.596435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'134","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:46.261254+0000","last_change":"2024-09-12T17:30:02.805558+0000","last_active":"2024-09-12T19:22:46.261254+0000","last_peered":"2024-09-12T19:22:46.261254+0000","last_clean":"2024-09-12T19:22:46.261254+0000","last_became_active":"2024-09-12T17:30:02.803051+0000","last_became_peered":"2024-09-12T17:30:02.803051+0000","last_unstale":"2024-09-12T19:22:46.261254+0000","last_undegraded":"2024-09-12T19:22:46.261254+0000","last_fullsized":"2024-09-12T19:22:46.261254+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:30.608707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":726,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":188,"num_read_kb":177,"num_write":312,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'429","reported_seq":1977,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.137194+0000","last_change":"2024-09-12T19:23:20.137194+0000","last_active":"2024-09-12T19:23:20.137194+0000","last_peered":"2024-09-12T19:23:20.137194+0000","last_clean":"2024-09-12T19:23:20.137194+0000","last_became_active":"2024-09-12T17:29:54.762522+0000","last_became_peered":"2024-09-12T17:29:54.762522+0000","last_unstale":"2024-09-12T19:23:20.137194+0000","last_undegraded":"2024-09-12T19:23:20.137194+0000","last_fullsized":"2024-09-12T19:23:20.137194+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'429","last_scrub_stamp":"2024-09-12T19:23:20.136990+0000","last_deep_scrub":"267'429","last_deep_scrub_stamp":"2024-09-12T19:23:20.136990+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.136990+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:28.426663+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2273,"num_read_kb":2141,"num_write":510,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'293","reported_seq":929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.212947+0000","last_change":"2024-09-12T19:23:11.212947+0000","last_active":"2024-09-12T19:23:11.212947+0000","last_peered":"2024-09-12T19:23:11.212947+0000","last_clean":"2024-09-12T19:23:11.212947+0000","last_became_active":"2024-09-12T17:29:52.716210+0000","last_became_peered":"2024-09-12T17:29:52.716210+0000","last_unstale":"2024-09-12T19:23:11.212947+0000","last_undegraded":"2024-09-12T19:23:11.212947+0000","last_fullsized":"2024-09-12T19:23:11.212947+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'293","last_scrub_stamp":"2024-09-12T19:23:11.212651+0000","last_deep_scrub":"267'293","last_deep_scrub_stamp":"2024-09-12T19:23:11.212651+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.212651+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:55.274163+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":379,"num_read_kb":381,"num_write":923,"num_write_kb":30307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":560,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:06.731459+0000","last_change":"2024-09-12T19:23:06.731459+0000","last_active":"2024-09-12T19:23:06.731459+0000","last_peered":"2024-09-12T19:23:06.731459+0000","last_clean":"2024-09-12T19:23:06.731459+0000","last_became_active":"2024-09-12T17:29:35.337987+0000","last_became_peered":"2024-09-12T17:29:35.337987+0000","last_unstale":"2024-09-12T19:23:06.731459+0000","last_undegraded":"2024-09-12T19:23:06.731459+0000","last_fullsized":"2024-09-12T19:23:06.731459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:06.731386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:06.731386+0000","last_clean_scrub_stamp":"2024-09-12T19:23:06.731386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:59.862051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011496340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"267'4","reported_seq":1023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.171871+0000","last_change":"2024-09-12T19:23:29.171871+0000","last_active":"2024-09-12T19:23:29.171871+0000","last_peered":"2024-09-12T19:23:29.171871+0000","last_clean":"2024-09-12T19:23:29.171871+0000","last_became_active":"2024-09-12T17:29:56.754415+0000","last_became_peered":"2024-09-12T17:29:56.754415+0000","last_unstale":"2024-09-12T19:23:29.171871+0000","last_undegraded":"2024-09-12T19:23:29.171871+0000","last_fullsized":"2024-09-12T19:23:29.171871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T19:23:29.171658+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T19:23:29.171658+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.171658+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:29.471306+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'181","reported_seq":795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.101183+0000","last_change":"2024-09-12T19:23:33.101183+0000","last_active":"2024-09-12T19:23:33.101183+0000","last_peered":"2024-09-12T19:23:33.101183+0000","last_clean":"2024-09-12T19:23:33.101183+0000","last_became_active":"2024-09-12T17:29:58.766420+0000","last_became_peered":"2024-09-12T17:29:58.766420+0000","last_unstale":"2024-09-12T19:23:33.101183+0000","last_undegraded":"2024-09-12T19:23:33.101183+0000","last_fullsized":"2024-09-12T19:23:33.101183+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-12T19:23:33.100998+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-12T19:23:33.100998+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.100998+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:29.936445+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":231,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'818","reported_seq":5013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.087415+0000","last_change":"2024-09-12T19:23:41.087415+0000","last_active":"2024-09-12T19:23:41.087415+0000","last_peered":"2024-09-12T19:23:41.087415+0000","last_clean":"2024-09-12T19:23:41.087415+0000","last_became_active":"2024-09-12T17:30:00.793234+0000","last_became_peered":"2024-09-12T17:30:00.793234+0000","last_unstale":"2024-09-12T19:23:41.087415+0000","last_undegraded":"2024-09-12T19:23:41.087415+0000","last_fullsized":"2024-09-12T19:23:41.087415+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'818","last_scrub_stamp":"2024-09-12T19:23:41.087229+0000","last_deep_scrub":"267'818","last_deep_scrub_stamp":"2024-09-12T19:23:41.087229+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.087229+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:59.784247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'190","reported_seq":735,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.713817+0000","last_change":"2024-09-12T19:23:42.713817+0000","last_active":"2024-09-12T19:23:42.713817+0000","last_peered":"2024-09-12T19:23:42.713817+0000","last_clean":"2024-09-12T19:23:42.713817+0000","last_became_active":"2024-09-12T17:30:02.799944+0000","last_became_peered":"2024-09-12T17:30:02.799944+0000","last_unstale":"2024-09-12T19:23:42.713817+0000","last_undegraded":"2024-09-12T19:23:42.713817+0000","last_fullsized":"2024-09-12T19:23:42.713817+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'190","last_scrub_stamp":"2024-09-12T19:23:42.713627+0000","last_deep_scrub":"267'190","last_deep_scrub_stamp":"2024-09-12T19:23:42.713627+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.713627+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:01.551556+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":199,"num_read_kb":188,"num_write":423,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'1237","reported_seq":2862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.247365+0000","last_change":"2024-09-12T19:23:13.247365+0000","last_active":"2024-09-12T19:23:13.247365+0000","last_peered":"2024-09-12T19:23:13.247365+0000","last_clean":"2024-09-12T19:23:13.247365+0000","last_became_active":"2024-09-12T17:29:54.751931+0000","last_became_peered":"2024-09-12T17:29:54.751931+0000","last_unstale":"2024-09-12T19:23:13.247365+0000","last_undegraded":"2024-09-12T19:23:13.247365+0000","last_fullsized":"2024-09-12T19:23:13.247365+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1237","last_scrub_stamp":"2024-09-12T19:23:13.247189+0000","last_deep_scrub":"267'1237","last_deep_scrub_stamp":"2024-09-12T19:23:13.247189+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.247189+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":1200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:52.825946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5667,"num_read_kb":5016,"num_write":1745,"num_write_kb":765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'336","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:07.977004+0000","last_change":"2024-09-12T19:23:07.977004+0000","last_active":"2024-09-12T19:23:07.977004+0000","last_peered":"2024-09-12T19:23:07.977004+0000","last_clean":"2024-09-12T19:23:07.977004+0000","last_became_active":"2024-09-12T17:30:21.697470+0000","last_became_peered":"2024-09-12T17:30:21.697470+0000","last_unstale":"2024-09-12T19:23:07.977004+0000","last_undegraded":"2024-09-12T19:23:07.977004+0000","last_fullsized":"2024-09-12T19:23:07.977004+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-12T19:23:07.976758+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-12T19:23:07.976758+0000","last_clean_scrub_stamp":"2024-09-12T19:23:07.976758+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:24.268288+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":2583,"num_write":1054,"num_write_kb":28824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":560,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.146828+0000","last_change":"2024-09-12T19:23:09.146828+0000","last_active":"2024-09-12T19:23:09.146828+0000","last_peered":"2024-09-12T19:23:09.146828+0000","last_clean":"2024-09-12T19:23:09.146828+0000","last_became_active":"2024-09-12T17:29:35.337998+0000","last_became_peered":"2024-09-12T17:29:35.337998+0000","last_unstale":"2024-09-12T19:23:09.146828+0000","last_undegraded":"2024-09-12T19:23:09.146828+0000","last_fullsized":"2024-09-12T19:23:09.146828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:09.146655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:09.146655+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.146655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:56.445997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011850280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.138679+0000","last_change":"2024-09-12T19:23:29.138679+0000","last_active":"2024-09-12T19:23:29.138679+0000","last_peered":"2024-09-12T19:23:29.138679+0000","last_clean":"2024-09-12T19:23:29.138679+0000","last_became_active":"2024-09-12T17:29:56.760822+0000","last_became_peered":"2024-09-12T17:29:56.760822+0000","last_unstale":"2024-09-12T19:23:29.138679+0000","last_undegraded":"2024-09-12T19:23:29.138679+0000","last_fullsized":"2024-09-12T19:23:29.138679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:29.138471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:29.138471+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.138471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:58.898874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'813","reported_seq":1602,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.136516+0000","last_change":"2024-09-12T19:23:29.136516+0000","last_active":"2024-09-12T19:23:29.136516+0000","last_peered":"2024-09-12T19:23:29.136516+0000","last_clean":"2024-09-12T19:23:29.136516+0000","last_became_active":"2024-09-12T17:29:58.830605+0000","last_became_peered":"2024-09-12T17:29:58.830605+0000","last_unstale":"2024-09-12T19:23:29.136516+0000","last_undegraded":"2024-09-12T19:23:29.136516+0000","last_fullsized":"2024-09-12T19:23:29.136516+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'813","last_scrub_stamp":"2024-09-12T19:23:29.136309+0000","last_deep_scrub":"267'813","last_deep_scrub_stamp":"2024-09-12T19:23:29.136309+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.136309+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:15.488966+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138319,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1432,"num_read_kb":3265,"num_write":1150,"num_write_kb":898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.128144+0000","last_change":"2024-09-12T19:23:42.128144+0000","last_active":"2024-09-12T19:23:42.128144+0000","last_peered":"2024-09-12T19:23:42.128144+0000","last_clean":"2024-09-12T19:23:42.128144+0000","last_became_active":"2024-09-12T17:30:00.810341+0000","last_became_peered":"2024-09-12T17:30:00.810341+0000","last_unstale":"2024-09-12T19:23:42.128144+0000","last_undegraded":"2024-09-12T19:23:42.128144+0000","last_fullsized":"2024-09-12T19:23:42.128144+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:42.127960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:42.127960+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.127960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:30.104619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'164","reported_seq":728,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.325599+0000","last_change":"2024-09-12T19:23:41.325599+0000","last_active":"2024-09-12T19:23:41.325599+0000","last_peered":"2024-09-12T19:23:41.325599+0000","last_clean":"2024-09-12T19:23:41.325599+0000","last_became_active":"2024-09-12T17:30:02.786443+0000","last_became_peered":"2024-09-12T17:30:02.786443+0000","last_unstale":"2024-09-12T19:23:41.325599+0000","last_undegraded":"2024-09-12T19:23:41.325599+0000","last_fullsized":"2024-09-12T19:23:41.325599+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'164","last_scrub_stamp":"2024-09-12T19:23:41.325403+0000","last_deep_scrub":"267'164","last_deep_scrub_stamp":"2024-09-12T19:23:41.325403+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.325403+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:23.794999+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":311,"num_read_kb":271,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'113","reported_seq":707,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.727465+0000","last_change":"2024-09-12T19:23:44.727465+0000","last_active":"2024-09-12T19:23:44.727465+0000","last_peered":"2024-09-12T19:23:44.727465+0000","last_clean":"2024-09-12T19:23:44.727465+0000","last_became_active":"2024-09-12T17:30:02.801038+0000","last_became_peered":"2024-09-12T17:30:02.801038+0000","last_unstale":"2024-09-12T19:23:44.727465+0000","last_undegraded":"2024-09-12T19:23:44.727465+0000","last_fullsized":"2024-09-12T19:23:44.727465+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'113","last_scrub_stamp":"2024-09-12T19:23:44.727277+0000","last_deep_scrub":"267'113","last_deep_scrub_stamp":"2024-09-12T19:23:44.727277+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.727277+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:19.039842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":212,"num_write":265,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'456","reported_seq":2047,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.222255+0000","last_change":"2024-09-12T19:23:18.222255+0000","last_active":"2024-09-12T19:23:18.222255+0000","last_peered":"2024-09-12T19:23:18.222255+0000","last_clean":"2024-09-12T19:23:18.222255+0000","last_became_active":"2024-09-12T17:29:54.760809+0000","last_became_peered":"2024-09-12T17:29:54.760809+0000","last_unstale":"2024-09-12T19:23:18.222255+0000","last_undegraded":"2024-09-12T19:23:18.222255+0000","last_fullsized":"2024-09-12T19:23:18.222255+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'456","last_scrub_stamp":"2024-09-12T19:23:18.222068+0000","last_deep_scrub":"267'456","last_deep_scrub_stamp":"2024-09-12T19:23:18.222068+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.222068+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:12.516436+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2369,"num_read_kb":2229,"num_write":528,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'332","reported_seq":1042,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.234197+0000","last_change":"2024-09-12T19:23:10.234197+0000","last_active":"2024-09-12T19:23:10.234197+0000","last_peered":"2024-09-12T19:23:10.234197+0000","last_clean":"2024-09-12T19:23:10.234197+0000","last_became_active":"2024-09-12T17:29:52.760432+0000","last_became_peered":"2024-09-12T17:29:52.760432+0000","last_unstale":"2024-09-12T19:23:10.234197+0000","last_undegraded":"2024-09-12T19:23:10.234197+0000","last_fullsized":"2024-09-12T19:23:10.234197+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'332","last_scrub_stamp":"2024-09-12T19:23:10.233909+0000","last_deep_scrub":"267'332","last_deep_scrub_stamp":"2024-09-12T19:23:10.233909+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.233909+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:23.059087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":31499,"num_write":1138,"num_write_kb":37455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.648629+0000","last_change":"2024-09-12T19:23:24.648629+0000","last_active":"2024-09-12T19:23:24.648629+0000","last_peered":"2024-09-12T19:23:24.648629+0000","last_clean":"2024-09-12T19:23:24.648629+0000","last_became_active":"2024-09-12T17:29:56.765656+0000","last_became_peered":"2024-09-12T17:29:56.765656+0000","last_unstale":"2024-09-12T19:23:24.648629+0000","last_undegraded":"2024-09-12T19:23:24.648629+0000","last_fullsized":"2024-09-12T19:23:24.648629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:24.648446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:24.648446+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.648446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:56.698094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'317","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.013530+0000","last_change":"2024-09-12T19:23:36.013530+0000","last_active":"2024-09-12T19:23:36.013530+0000","last_peered":"2024-09-12T19:23:36.013530+0000","last_clean":"2024-09-12T19:23:36.013530+0000","last_became_active":"2024-09-12T17:29:58.777997+0000","last_became_peered":"2024-09-12T17:29:58.777997+0000","last_unstale":"2024-09-12T19:23:36.013530+0000","last_undegraded":"2024-09-12T19:23:36.013530+0000","last_fullsized":"2024-09-12T19:23:36.013530+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-12T19:23:36.013221+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-12T19:23:36.013221+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.013221+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:00.778670+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47243,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":493,"num_read_kb":996,"num_write":376,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.091988+0000","last_change":"2024-09-12T19:23:43.091988+0000","last_active":"2024-09-12T19:23:43.091988+0000","last_peered":"2024-09-12T19:23:43.091988+0000","last_clean":"2024-09-12T19:23:43.091988+0000","last_became_active":"2024-09-12T17:30:00.793204+0000","last_became_peered":"2024-09-12T17:30:00.793204+0000","last_unstale":"2024-09-12T19:23:43.091988+0000","last_undegraded":"2024-09-12T19:23:43.091988+0000","last_fullsized":"2024-09-12T19:23:43.091988+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:43.091801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:43.091801+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.091801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:44.767133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'108","reported_seq":638,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:20:28.263789+0000","last_change":"2024-09-12T17:30:02.790200+0000","last_active":"2024-09-12T19:20:28.263789+0000","last_peered":"2024-09-12T19:20:28.263789+0000","last_clean":"2024-09-12T19:20:28.263789+0000","last_became_active":"2024-09-12T17:30:02.789511+0000","last_became_peered":"2024-09-12T17:30:02.789511+0000","last_unstale":"2024-09-12T19:20:28.263789+0000","last_undegraded":"2024-09-12T19:20:28.263789+0000","last_fullsized":"2024-09-12T19:20:28.263789+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:57.833180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":267,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'1081","reported_seq":2637,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.697979+0000","last_change":"2024-09-12T19:23:16.697979+0000","last_active":"2024-09-12T19:23:16.697979+0000","last_peered":"2024-09-12T19:23:16.697979+0000","last_clean":"2024-09-12T19:23:16.697979+0000","last_became_active":"2024-09-12T17:29:54.774337+0000","last_became_peered":"2024-09-12T17:29:54.774337+0000","last_unstale":"2024-09-12T19:23:16.697979+0000","last_undegraded":"2024-09-12T19:23:16.697979+0000","last_fullsized":"2024-09-12T19:23:16.697979+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1081","last_scrub_stamp":"2024-09-12T19:23:16.697790+0000","last_deep_scrub":"267'1081","last_deep_scrub_stamp":"2024-09-12T19:23:16.697790+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.697790+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":1000,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:19.478713+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5006,"num_read_kb":4447,"num_write":1496,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'343","reported_seq":1047,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.093187+0000","last_change":"2024-09-12T19:23:17.093038+0000","last_active":"2024-09-12T19:23:17.093187+0000","last_peered":"2024-09-12T19:23:17.093187+0000","last_clean":"2024-09-12T19:23:17.093187+0000","last_became_active":"2024-09-12T17:29:52.757775+0000","last_became_peered":"2024-09-12T17:29:52.757775+0000","last_unstale":"2024-09-12T19:23:17.093187+0000","last_undegraded":"2024-09-12T19:23:17.093187+0000","last_fullsized":"2024-09-12T19:23:17.093187+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'343","last_scrub_stamp":"2024-09-12T19:23:17.092815+0000","last_deep_scrub":"267'343","last_deep_scrub_stamp":"2024-09-12T19:23:17.092815+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.092815+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:09.547140+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399166,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":510,"num_read_kb":111933,"num_write":1035,"num_write_kb":43950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.113656+0000","last_change":"2024-09-12T19:23:30.113656+0000","last_active":"2024-09-12T19:23:30.113656+0000","last_peered":"2024-09-12T19:23:30.113656+0000","last_clean":"2024-09-12T19:23:30.113656+0000","last_became_active":"2024-09-12T17:29:56.770639+0000","last_became_peered":"2024-09-12T17:29:56.770639+0000","last_unstale":"2024-09-12T19:23:30.113656+0000","last_undegraded":"2024-09-12T19:23:30.113656+0000","last_fullsized":"2024-09-12T19:23:30.113656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:30.113470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:30.113470+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.113470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:33.724815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'81","reported_seq":633,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.762633+0000","last_change":"2024-09-12T19:23:29.762633+0000","last_active":"2024-09-12T19:23:29.762633+0000","last_peered":"2024-09-12T19:23:29.762633+0000","last_clean":"2024-09-12T19:23:29.762633+0000","last_became_active":"2024-09-12T17:29:58.781731+0000","last_became_peered":"2024-09-12T17:29:58.781731+0000","last_unstale":"2024-09-12T19:23:29.762633+0000","last_undegraded":"2024-09-12T19:23:29.762633+0000","last_fullsized":"2024-09-12T19:23:29.762633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'81","last_scrub_stamp":"2024-09-12T19:23:29.762445+0000","last_deep_scrub":"267'81","last_deep_scrub_stamp":"2024-09-12T19:23:29.762445+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.762445+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:16:26.707930+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":73,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.064753+0000","last_change":"2024-09-12T19:23:38.064753+0000","last_active":"2024-09-12T19:23:38.064753+0000","last_peered":"2024-09-12T19:23:38.064753+0000","last_clean":"2024-09-12T19:23:38.064753+0000","last_became_active":"2024-09-12T17:30:00.799588+0000","last_became_peered":"2024-09-12T17:30:00.799588+0000","last_unstale":"2024-09-12T19:23:38.064753+0000","last_undegraded":"2024-09-12T19:23:38.064753+0000","last_fullsized":"2024-09-12T19:23:38.064753+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:38.064571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:38.064571+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.064571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:37.484945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'193","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.697614+0000","last_change":"2024-09-12T19:23:43.697614+0000","last_active":"2024-09-12T19:23:43.697614+0000","last_peered":"2024-09-12T19:23:43.697614+0000","last_clean":"2024-09-12T19:23:43.697614+0000","last_became_active":"2024-09-12T17:30:02.813284+0000","last_became_peered":"2024-09-12T17:30:02.813284+0000","last_unstale":"2024-09-12T19:23:43.697614+0000","last_undegraded":"2024-09-12T19:23:43.697614+0000","last_fullsized":"2024-09-12T19:23:43.697614+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'193","last_scrub_stamp":"2024-09-12T19:23:43.697424+0000","last_deep_scrub":"267'193","last_deep_scrub_stamp":"2024-09-12T19:23:43.697424+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.697424+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:41.448750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":312,"num_read_kb":310,"num_write":442,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'826","reported_seq":2446,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.189050+0000","last_change":"2024-09-12T19:23:22.189050+0000","last_active":"2024-09-12T19:23:22.189050+0000","last_peered":"2024-09-12T19:23:22.189050+0000","last_clean":"2024-09-12T19:23:22.189050+0000","last_became_active":"2024-09-12T17:29:54.762793+0000","last_became_peered":"2024-09-12T17:29:54.762793+0000","last_unstale":"2024-09-12T19:23:22.189050+0000","last_undegraded":"2024-09-12T19:23:22.189050+0000","last_fullsized":"2024-09-12T19:23:22.189050+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'826","last_scrub_stamp":"2024-09-12T19:23:22.188867+0000","last_deep_scrub":"267'826","last_deep_scrub_stamp":"2024-09-12T19:23:22.188867+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.188867+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:07.821462+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3973,"num_read_kb":3581,"num_write":1093,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'357","reported_seq":988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.011911+0000","last_change":"2024-09-12T19:23:13.011911+0000","last_active":"2024-09-12T19:23:13.011911+0000","last_peered":"2024-09-12T19:23:13.011911+0000","last_clean":"2024-09-12T19:23:13.011911+0000","last_became_active":"2024-09-12T17:30:21.692338+0000","last_became_peered":"2024-09-12T17:30:21.692338+0000","last_unstale":"2024-09-12T19:23:13.011911+0000","last_undegraded":"2024-09-12T19:23:13.011911+0000","last_fullsized":"2024-09-12T19:23:13.011911+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'357","last_scrub_stamp":"2024-09-12T19:23:13.011577+0000","last_deep_scrub":"267'357","last_deep_scrub_stamp":"2024-09-12T19:23:13.011577+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.011577+0000","objects_scrubbed":10,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:00.683791+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2254600,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":475,"num_read_kb":2106,"num_write":1042,"num_write_kb":33078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.100650+0000","last_change":"2024-09-12T19:23:27.100650+0000","last_active":"2024-09-12T19:23:27.100650+0000","last_peered":"2024-09-12T19:23:27.100650+0000","last_clean":"2024-09-12T19:23:27.100650+0000","last_became_active":"2024-09-12T17:29:56.771923+0000","last_became_peered":"2024-09-12T17:29:56.771923+0000","last_unstale":"2024-09-12T19:23:27.100650+0000","last_undegraded":"2024-09-12T19:23:27.100650+0000","last_fullsized":"2024-09-12T19:23:27.100650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:27.100463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:27.100463+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.100463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:27.173988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'358","reported_seq":1015,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.082680+0000","last_change":"2024-09-12T19:23:38.082680+0000","last_active":"2024-09-12T19:23:38.082680+0000","last_peered":"2024-09-12T19:23:38.082680+0000","last_clean":"2024-09-12T19:23:38.082680+0000","last_became_active":"2024-09-12T17:29:58.781756+0000","last_became_peered":"2024-09-12T17:29:58.781756+0000","last_unstale":"2024-09-12T19:23:38.082680+0000","last_undegraded":"2024-09-12T19:23:38.082680+0000","last_fullsized":"2024-09-12T19:23:38.082680+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'358","last_scrub_stamp":"2024-09-12T19:23:38.082469+0000","last_deep_scrub":"267'358","last_deep_scrub_stamp":"2024-09-12T19:23:38.082469+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.082469+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:05.093797+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44606,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":574,"num_read_kb":1122,"num_write":442,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.263372+0000","last_change":"2024-09-12T19:23:27.263372+0000","last_active":"2024-09-12T19:23:27.263372+0000","last_peered":"2024-09-12T19:23:27.263372+0000","last_clean":"2024-09-12T19:23:27.263372+0000","last_became_active":"2024-09-12T17:30:00.787872+0000","last_became_peered":"2024-09-12T17:30:00.787872+0000","last_unstale":"2024-09-12T19:23:27.263372+0000","last_undegraded":"2024-09-12T19:23:27.263372+0000","last_fullsized":"2024-09-12T19:23:27.263372+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:27.263189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:27.263189+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.263189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:00.496808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'138","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.372146+0000","last_change":"2024-09-12T19:23:44.372146+0000","last_active":"2024-09-12T19:23:44.372146+0000","last_peered":"2024-09-12T19:23:44.372146+0000","last_clean":"2024-09-12T19:23:44.372146+0000","last_became_active":"2024-09-12T17:30:02.790246+0000","last_became_peered":"2024-09-12T17:30:02.790246+0000","last_unstale":"2024-09-12T19:23:44.372146+0000","last_undegraded":"2024-09-12T19:23:44.372146+0000","last_fullsized":"2024-09-12T19:23:44.372146+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'138","last_scrub_stamp":"2024-09-12T19:23:44.371962+0000","last_deep_scrub":"267'138","last_deep_scrub_stamp":"2024-09-12T19:23:44.371962+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.371962+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:30.261994+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":190,"num_write":334,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'498","reported_seq":2176,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.155966+0000","last_change":"2024-09-12T19:23:21.155966+0000","last_active":"2024-09-12T19:23:21.155966+0000","last_peered":"2024-09-12T19:23:21.155966+0000","last_clean":"2024-09-12T19:23:21.155966+0000","last_became_active":"2024-09-12T17:30:22.255871+0000","last_became_peered":"2024-09-12T17:30:22.255871+0000","last_unstale":"2024-09-12T19:23:21.155966+0000","last_undegraded":"2024-09-12T19:23:21.155966+0000","last_fullsized":"2024-09-12T19:23:21.155966+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'498","last_scrub_stamp":"2024-09-12T19:23:21.155552+0000","last_deep_scrub":"267'498","last_deep_scrub_stamp":"2024-09-12T19:23:21.155552+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.155552+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:38.758690+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2849,"num_read_kb":2646,"num_write":616,"num_write_kb":185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4203,"num_omap_keys":17,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'330","reported_seq":1080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:06.908774+0000","last_change":"2024-09-12T19:23:06.908628+0000","last_active":"2024-09-12T19:23:06.908774+0000","last_peered":"2024-09-12T19:23:06.908774+0000","last_clean":"2024-09-12T19:23:06.908774+0000","last_became_active":"2024-09-12T17:29:52.725672+0000","last_became_peered":"2024-09-12T17:29:52.725672+0000","last_unstale":"2024-09-12T19:23:06.908774+0000","last_undegraded":"2024-09-12T19:23:06.908774+0000","last_fullsized":"2024-09-12T19:23:06.908774+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'330","last_scrub_stamp":"2024-09-12T19:23:06.908405+0000","last_deep_scrub":"267'330","last_deep_scrub_stamp":"2024-09-12T19:23:06.908405+0000","last_clean_scrub_stamp":"2024-09-12T19:23:06.908405+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:18.850583+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524466,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":607,"num_read_kb":120165,"num_write":1109,"num_write_kb":47030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.221546+0000","last_change":"2024-09-12T19:23:22.221546+0000","last_active":"2024-09-12T19:23:22.221546+0000","last_peered":"2024-09-12T19:23:22.221546+0000","last_clean":"2024-09-12T19:23:22.221546+0000","last_became_active":"2024-09-12T17:29:56.761442+0000","last_became_peered":"2024-09-12T17:29:56.761442+0000","last_unstale":"2024-09-12T19:23:22.221546+0000","last_undegraded":"2024-09-12T19:23:22.221546+0000","last_fullsized":"2024-09-12T19:23:22.221546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:22.221361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:22.221361+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.221361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:34.450653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'327","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.101276+0000","last_change":"2024-09-12T19:23:31.101276+0000","last_active":"2024-09-12T19:23:31.101276+0000","last_peered":"2024-09-12T19:23:31.101276+0000","last_clean":"2024-09-12T19:23:31.101276+0000","last_became_active":"2024-09-12T17:29:58.758050+0000","last_became_peered":"2024-09-12T17:29:58.758050+0000","last_unstale":"2024-09-12T19:23:31.101276+0000","last_undegraded":"2024-09-12T19:23:31.101276+0000","last_fullsized":"2024-09-12T19:23:31.101276+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'327","last_scrub_stamp":"2024-09-12T19:23:31.101035+0000","last_deep_scrub":"267'327","last_deep_scrub_stamp":"2024-09-12T19:23:31.101035+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.101035+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:54.851659+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47374,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":545,"num_read_kb":1211,"num_write":440,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.774303+0000","last_change":"2024-09-12T19:23:36.774303+0000","last_active":"2024-09-12T19:23:36.774303+0000","last_peered":"2024-09-12T19:23:36.774303+0000","last_clean":"2024-09-12T19:23:36.774303+0000","last_became_active":"2024-09-12T17:30:00.780216+0000","last_became_peered":"2024-09-12T17:30:00.780216+0000","last_unstale":"2024-09-12T19:23:36.774303+0000","last_undegraded":"2024-09-12T19:23:36.774303+0000","last_fullsized":"2024-09-12T19:23:36.774303+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:36.774122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:36.774122+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.774122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:01.600530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'415","reported_seq":1862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.193904+0000","last_change":"2024-09-12T19:23:18.193904+0000","last_active":"2024-09-12T19:23:18.193904+0000","last_peered":"2024-09-12T19:23:18.193904+0000","last_clean":"2024-09-12T19:23:18.193904+0000","last_became_active":"2024-09-12T17:29:54.776503+0000","last_became_peered":"2024-09-12T17:29:54.776503+0000","last_unstale":"2024-09-12T19:23:18.193904+0000","last_undegraded":"2024-09-12T19:23:18.193904+0000","last_fullsized":"2024-09-12T19:23:18.193904+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'415","last_scrub_stamp":"2024-09-12T19:23:18.193704+0000","last_deep_scrub":"267'415","last_deep_scrub_stamp":"2024-09-12T19:23:18.193704+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.193704+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:23.257855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2157,"num_read_kb":2011,"num_write":494,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'346","reported_seq":1057,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.194650+0000","last_change":"2024-09-12T19:23:13.194506+0000","last_active":"2024-09-12T19:23:13.194650+0000","last_peered":"2024-09-12T19:23:13.194650+0000","last_clean":"2024-09-12T19:23:13.194650+0000","last_became_active":"2024-09-12T17:29:52.716376+0000","last_became_peered":"2024-09-12T17:29:52.716376+0000","last_unstale":"2024-09-12T19:23:13.194650+0000","last_undegraded":"2024-09-12T19:23:13.194650+0000","last_fullsized":"2024-09-12T19:23:13.194650+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-09-12T19:23:13.194237+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-09-12T19:23:13.194237+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.194237+0000","objects_scrubbed":9,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:44.170037+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730157,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":576,"num_read_kb":2668,"num_write":1130,"num_write_kb":45238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.853164+0000","last_change":"2024-09-12T19:23:22.853164+0000","last_active":"2024-09-12T19:23:22.853164+0000","last_peered":"2024-09-12T19:23:22.853164+0000","last_clean":"2024-09-12T19:23:22.853164+0000","last_became_active":"2024-09-12T17:29:56.773239+0000","last_became_peered":"2024-09-12T17:29:56.773239+0000","last_unstale":"2024-09-12T19:23:22.853164+0000","last_undegraded":"2024-09-12T19:23:22.853164+0000","last_fullsized":"2024-09-12T19:23:22.853164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:22.852967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:22.852967+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.852967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:06.983644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'558","reported_seq":1240,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.683657+0000","last_change":"2024-09-12T19:23:30.683657+0000","last_active":"2024-09-12T19:23:30.683657+0000","last_peered":"2024-09-12T19:23:30.683657+0000","last_clean":"2024-09-12T19:23:30.683657+0000","last_became_active":"2024-09-12T17:29:58.778931+0000","last_became_peered":"2024-09-12T17:29:58.778931+0000","last_unstale":"2024-09-12T19:23:30.683657+0000","last_undegraded":"2024-09-12T19:23:30.683657+0000","last_fullsized":"2024-09-12T19:23:30.683657+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'558","last_scrub_stamp":"2024-09-12T19:23:30.683533+0000","last_deep_scrub":"267'558","last_deep_scrub_stamp":"2024-09-12T19:23:30.683533+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.683533+0000","objects_scrubbed":6,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:58.234136+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":998,"num_read_kb":2327,"num_write":858,"num_write_kb":737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.304254+0000","last_change":"2024-09-12T19:23:38.304254+0000","last_active":"2024-09-12T19:23:38.304254+0000","last_peered":"2024-09-12T19:23:38.304254+0000","last_clean":"2024-09-12T19:23:38.304254+0000","last_became_active":"2024-09-12T17:30:00.802021+0000","last_became_peered":"2024-09-12T17:30:00.802021+0000","last_unstale":"2024-09-12T19:23:38.304254+0000","last_undegraded":"2024-09-12T19:23:38.304254+0000","last_fullsized":"2024-09-12T19:23:38.304254+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:38.304053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:38.304053+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.304053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:15.422600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'170","reported_seq":721,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:48.083441+0000","last_change":"2024-09-12T19:23:48.083441+0000","last_active":"2024-09-12T19:23:48.083441+0000","last_peered":"2024-09-12T19:23:48.083441+0000","last_clean":"2024-09-12T19:23:48.083441+0000","last_became_active":"2024-09-12T17:30:02.794353+0000","last_became_peered":"2024-09-12T17:30:02.794353+0000","last_unstale":"2024-09-12T19:23:48.083441+0000","last_undegraded":"2024-09-12T19:23:48.083441+0000","last_fullsized":"2024-09-12T19:23:48.083441+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'170","last_scrub_stamp":"2024-09-12T19:23:48.083116+0000","last_deep_scrub":"267'170","last_deep_scrub_stamp":"2024-09-12T19:23:48.083116+0000","last_clean_scrub_stamp":"2024-09-12T19:23:48.083116+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:59.342902+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":277,"num_read_kb":276,"num_write":376,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'726","reported_seq":2327,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.864092+0000","last_change":"2024-09-12T19:23:19.864092+0000","last_active":"2024-09-12T19:23:19.864092+0000","last_peered":"2024-09-12T19:23:19.864092+0000","last_clean":"2024-09-12T19:23:19.864092+0000","last_became_active":"2024-09-12T17:29:54.761144+0000","last_became_peered":"2024-09-12T17:29:54.761144+0000","last_unstale":"2024-09-12T19:23:19.864092+0000","last_undegraded":"2024-09-12T19:23:19.864092+0000","last_fullsized":"2024-09-12T19:23:19.864092+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'726","last_scrub_stamp":"2024-09-12T19:23:19.863911+0000","last_deep_scrub":"267'726","last_deep_scrub_stamp":"2024-09-12T19:23:19.863911+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.863911+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":700,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:39.862307+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3459,"num_read_kb":3076,"num_write":1006,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":514,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'309","reported_seq":935,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.681650+0000","last_change":"2024-09-12T19:23:13.681650+0000","last_active":"2024-09-12T19:23:13.681650+0000","last_peered":"2024-09-12T19:23:13.681650+0000","last_clean":"2024-09-12T19:23:13.681650+0000","last_became_active":"2024-09-12T17:29:52.741594+0000","last_became_peered":"2024-09-12T17:29:52.741594+0000","last_unstale":"2024-09-12T19:23:13.681650+0000","last_undegraded":"2024-09-12T19:23:13.681650+0000","last_fullsized":"2024-09-12T19:23:13.681650+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'309","last_scrub_stamp":"2024-09-12T19:23:13.681397+0000","last_deep_scrub":"267'309","last_deep_scrub_stamp":"2024-09-12T19:23:13.681397+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.681397+0000","objects_scrubbed":9,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:35.606108+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262349,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":376,"num_read_kb":5602,"num_write":913,"num_write_kb":46297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.265670+0000","last_change":"2024-09-12T19:23:23.265670+0000","last_active":"2024-09-12T19:23:23.265670+0000","last_peered":"2024-09-12T19:23:23.265670+0000","last_clean":"2024-09-12T19:23:23.265670+0000","last_became_active":"2024-09-12T17:29:56.761256+0000","last_became_peered":"2024-09-12T17:29:56.761256+0000","last_unstale":"2024-09-12T19:23:23.265670+0000","last_undegraded":"2024-09-12T19:23:23.265670+0000","last_fullsized":"2024-09-12T19:23:23.265670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:23.265379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:23.265379+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.265379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:33:19.790842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'397","reported_seq":1049,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.125931+0000","last_change":"2024-09-12T19:23:37.125931+0000","last_active":"2024-09-12T19:23:37.125931+0000","last_peered":"2024-09-12T19:23:37.125931+0000","last_clean":"2024-09-12T19:23:37.125931+0000","last_became_active":"2024-09-12T17:29:58.768310+0000","last_became_peered":"2024-09-12T17:29:58.768310+0000","last_unstale":"2024-09-12T19:23:37.125931+0000","last_undegraded":"2024-09-12T19:23:37.125931+0000","last_fullsized":"2024-09-12T19:23:37.125931+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'397","last_scrub_stamp":"2024-09-12T19:23:37.125646+0000","last_deep_scrub":"267'397","last_deep_scrub_stamp":"2024-09-12T19:23:37.125646+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.125646+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:23.227590+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51217,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":641,"num_read_kb":1226,"num_write":524,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.632862+0000","last_change":"2024-09-12T19:23:31.632862+0000","last_active":"2024-09-12T19:23:31.632862+0000","last_peered":"2024-09-12T19:23:31.632862+0000","last_clean":"2024-09-12T19:23:31.632862+0000","last_became_active":"2024-09-12T17:30:00.804655+0000","last_became_peered":"2024-09-12T17:30:00.804655+0000","last_unstale":"2024-09-12T19:23:31.632862+0000","last_undegraded":"2024-09-12T19:23:31.632862+0000","last_fullsized":"2024-09-12T19:23:31.632862+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:31.632687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:31.632687+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.632687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:20.780508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'196","reported_seq":1104,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.324814+0000","last_change":"2024-09-12T19:23:31.324814+0000","last_active":"2024-09-12T19:23:31.324814+0000","last_peered":"2024-09-12T19:23:31.324814+0000","last_clean":"2024-09-12T19:23:31.324814+0000","last_became_active":"2024-09-12T17:30:02.813027+0000","last_became_peered":"2024-09-12T17:30:02.813027+0000","last_unstale":"2024-09-12T19:23:31.324814+0000","last_undegraded":"2024-09-12T19:23:31.324814+0000","last_fullsized":"2024-09-12T19:23:31.324814+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'196","last_scrub_stamp":"2024-09-12T19:23:31.324602+0000","last_deep_scrub":"267'196","last_deep_scrub_stamp":"2024-09-12T19:23:31.324602+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.324602+0000","objects_scrubbed":7,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:38.755243+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2050,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":664,"num_read_kb":654,"num_write":538,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'392","reported_seq":1808,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.211401+0000","last_change":"2024-09-12T19:23:26.211401+0000","last_active":"2024-09-12T19:23:26.211401+0000","last_peered":"2024-09-12T19:23:26.211401+0000","last_clean":"2024-09-12T19:23:26.211401+0000","last_became_active":"2024-09-12T17:29:54.756800+0000","last_became_peered":"2024-09-12T17:29:54.756800+0000","last_unstale":"2024-09-12T19:23:26.211401+0000","last_undegraded":"2024-09-12T19:23:26.211401+0000","last_fullsized":"2024-09-12T19:23:26.211401+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'392","last_scrub_stamp":"2024-09-12T19:23:26.211201+0000","last_deep_scrub":"267'392","last_deep_scrub_stamp":"2024-09-12T19:23:26.211201+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.211201+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:17.864703+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1992,"num_read_kb":1877,"num_write":455,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'311","reported_seq":994,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.267339+0000","last_change":"2024-09-12T19:23:11.267339+0000","last_active":"2024-09-12T19:23:11.267339+0000","last_peered":"2024-09-12T19:23:11.267339+0000","last_clean":"2024-09-12T19:23:11.267339+0000","last_became_active":"2024-09-12T17:29:52.755401+0000","last_became_peered":"2024-09-12T17:29:52.755401+0000","last_unstale":"2024-09-12T19:23:11.267339+0000","last_undegraded":"2024-09-12T19:23:11.267339+0000","last_fullsized":"2024-09-12T19:23:11.267339+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-09-12T19:23:11.267078+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-09-12T19:23:11.267078+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.267078+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:12.277344+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2036176,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":3663,"num_write":1039,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.139454+0000","last_change":"2024-09-12T19:23:32.139454+0000","last_active":"2024-09-12T19:23:32.139454+0000","last_peered":"2024-09-12T19:23:32.139454+0000","last_clean":"2024-09-12T19:23:32.139454+0000","last_became_active":"2024-09-12T17:29:56.752172+0000","last_became_peered":"2024-09-12T17:29:56.752172+0000","last_unstale":"2024-09-12T19:23:32.139454+0000","last_undegraded":"2024-09-12T19:23:32.139454+0000","last_fullsized":"2024-09-12T19:23:32.139454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:32.139158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:32.139158+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.139158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:30.140657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'335","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.081102+0000","last_change":"2024-09-12T19:23:40.081102+0000","last_active":"2024-09-12T19:23:40.081102+0000","last_peered":"2024-09-12T19:23:40.081102+0000","last_clean":"2024-09-12T19:23:40.081102+0000","last_became_active":"2024-09-12T17:29:58.831574+0000","last_became_peered":"2024-09-12T17:29:58.831574+0000","last_unstale":"2024-09-12T19:23:40.081102+0000","last_undegraded":"2024-09-12T19:23:40.081102+0000","last_fullsized":"2024-09-12T19:23:40.081102+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-09-12T19:23:40.080862+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-09-12T19:23:40.080862+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.080862+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:42.439444+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49155,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":530,"num_read_kb":1074,"num_write":414,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.638818+0000","last_change":"2024-09-12T19:23:34.638818+0000","last_active":"2024-09-12T19:23:34.638818+0000","last_peered":"2024-09-12T19:23:34.638818+0000","last_clean":"2024-09-12T19:23:34.638818+0000","last_became_active":"2024-09-12T17:30:00.804705+0000","last_became_peered":"2024-09-12T17:30:00.804705+0000","last_unstale":"2024-09-12T19:23:34.638818+0000","last_undegraded":"2024-09-12T19:23:34.638818+0000","last_fullsized":"2024-09-12T19:23:34.638818+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:34.638602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:34.638602+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.638602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:55.950770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'116","reported_seq":635,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.299498+0000","last_change":"2024-09-12T19:23:42.299498+0000","last_active":"2024-09-12T19:23:42.299498+0000","last_peered":"2024-09-12T19:23:42.299498+0000","last_clean":"2024-09-12T19:23:42.299498+0000","last_became_active":"2024-09-12T17:30:02.787038+0000","last_became_peered":"2024-09-12T17:30:02.787038+0000","last_unstale":"2024-09-12T19:23:42.299498+0000","last_undegraded":"2024-09-12T19:23:42.299498+0000","last_fullsized":"2024-09-12T19:23:42.299498+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'116","last_scrub_stamp":"2024-09-12T19:23:42.299293+0000","last_deep_scrub":"267'116","last_deep_scrub_stamp":"2024-09-12T19:23:42.299293+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.299293+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:02.765312+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":121,"num_write":252,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'361","reported_seq":1899,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.987483+0000","last_change":"2024-09-12T19:23:14.987483+0000","last_active":"2024-09-12T19:23:14.987483+0000","last_peered":"2024-09-12T19:23:14.987483+0000","last_clean":"2024-09-12T19:23:14.987483+0000","last_became_active":"2024-09-12T17:29:54.741486+0000","last_became_peered":"2024-09-12T17:29:54.741486+0000","last_unstale":"2024-09-12T19:23:14.987483+0000","last_undegraded":"2024-09-12T19:23:14.987483+0000","last_fullsized":"2024-09-12T19:23:14.987483+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'361","last_scrub_stamp":"2024-09-12T19:23:14.987293+0000","last_deep_scrub":"267'361","last_deep_scrub_stamp":"2024-09-12T19:23:14.987293+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.987293+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:37.939163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1958,"num_read_kb":1901,"num_write":388,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'318","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.907394+0000","last_change":"2024-09-12T19:23:12.907394+0000","last_active":"2024-09-12T19:23:12.907394+0000","last_peered":"2024-09-12T19:23:12.907394+0000","last_clean":"2024-09-12T19:23:12.907394+0000","last_became_active":"2024-09-12T17:29:52.766141+0000","last_became_peered":"2024-09-12T17:29:52.766141+0000","last_unstale":"2024-09-12T19:23:12.907394+0000","last_undegraded":"2024-09-12T19:23:12.907394+0000","last_fullsized":"2024-09-12T19:23:12.907394+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'318","last_scrub_stamp":"2024-09-12T19:23:12.907122+0000","last_deep_scrub":"267'318","last_deep_scrub_stamp":"2024-09-12T19:23:12.907122+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.907122+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:49.071217+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7320708,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":562,"num_read_kb":101880,"num_write":1008,"num_write_kb":18651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"267'6","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.726938+0000","last_change":"2024-09-12T19:23:27.726938+0000","last_active":"2024-09-12T19:23:27.726938+0000","last_peered":"2024-09-12T19:23:27.726938+0000","last_clean":"2024-09-12T19:23:27.726938+0000","last_became_active":"2024-09-12T17:29:56.760505+0000","last_became_peered":"2024-09-12T17:29:56.760505+0000","last_unstale":"2024-09-12T19:23:27.726938+0000","last_undegraded":"2024-09-12T19:23:27.726938+0000","last_fullsized":"2024-09-12T19:23:27.726938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T19:23:27.726750+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T19:23:27.726750+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.726750+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:36.263576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'177","reported_seq":777,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.118490+0000","last_change":"2024-09-12T19:23:36.118490+0000","last_active":"2024-09-12T19:23:36.118490+0000","last_peered":"2024-09-12T19:23:36.118490+0000","last_clean":"2024-09-12T19:23:36.118490+0000","last_became_active":"2024-09-12T17:29:58.829023+0000","last_became_peered":"2024-09-12T17:29:58.829023+0000","last_unstale":"2024-09-12T19:23:36.118490+0000","last_undegraded":"2024-09-12T19:23:36.118490+0000","last_fullsized":"2024-09-12T19:23:36.118490+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'177","last_scrub_stamp":"2024-09-12T19:23:36.118299+0000","last_deep_scrub":"267'177","last_deep_scrub_stamp":"2024-09-12T19:23:36.118299+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.118299+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:05.647435+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":218,"num_write":206,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19254,"num_omap_keys":52,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'775","reported_seq":3300,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.237657+0000","last_change":"2024-09-12T19:23:29.237657+0000","last_active":"2024-09-12T19:23:29.237657+0000","last_peered":"2024-09-12T19:23:29.237657+0000","last_clean":"2024-09-12T19:23:29.237657+0000","last_became_active":"2024-09-12T17:30:00.786102+0000","last_became_peered":"2024-09-12T17:30:00.786102+0000","last_unstale":"2024-09-12T19:23:29.237657+0000","last_undegraded":"2024-09-12T19:23:29.237657+0000","last_fullsized":"2024-09-12T19:23:29.237657+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'775","last_scrub_stamp":"2024-09-12T19:23:29.237474+0000","last_deep_scrub":"267'775","last_deep_scrub_stamp":"2024-09-12T19:23:29.237474+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.237474+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:49.117833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'149","reported_seq":685,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.123673+0000","last_change":"2024-09-12T19:23:41.123673+0000","last_active":"2024-09-12T19:23:41.123673+0000","last_peered":"2024-09-12T19:23:41.123673+0000","last_clean":"2024-09-12T19:23:41.123673+0000","last_became_active":"2024-09-12T17:30:02.803612+0000","last_became_peered":"2024-09-12T17:30:02.803612+0000","last_unstale":"2024-09-12T19:23:41.123673+0000","last_undegraded":"2024-09-12T19:23:41.123673+0000","last_fullsized":"2024-09-12T19:23:41.123673+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'149","last_scrub_stamp":"2024-09-12T19:23:41.123471+0000","last_deep_scrub":"267'149","last_deep_scrub_stamp":"2024-09-12T19:23:41.123471+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.123471+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:28.596544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":232,"num_read_kb":219,"num_write":373,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'828","reported_seq":2559,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.291568+0000","last_change":"2024-09-12T19:23:22.291568+0000","last_active":"2024-09-12T19:23:22.291568+0000","last_peered":"2024-09-12T19:23:22.291568+0000","last_clean":"2024-09-12T19:23:22.291568+0000","last_became_active":"2024-09-12T17:30:21.696952+0000","last_became_peered":"2024-09-12T17:30:21.696952+0000","last_unstale":"2024-09-12T19:23:22.291568+0000","last_undegraded":"2024-09-12T19:23:22.291568+0000","last_fullsized":"2024-09-12T19:23:22.291568+0000","mapping_epoch":39,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'828","last_scrub_stamp":"2024-09-12T19:23:22.291363+0000","last_deep_scrub":"267'828","last_deep_scrub_stamp":"2024-09-12T19:23:22.291363+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.291363+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:50.049566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3950,"num_read_kb":3589,"num_write":1060,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'353","reported_seq":1080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.268016+0000","last_change":"2024-09-12T19:23:13.268016+0000","last_active":"2024-09-12T19:23:13.268016+0000","last_peered":"2024-09-12T19:23:13.268016+0000","last_clean":"2024-09-12T19:23:13.268016+0000","last_became_active":"2024-09-12T17:29:52.749735+0000","last_became_peered":"2024-09-12T17:29:52.749735+0000","last_unstale":"2024-09-12T19:23:13.268016+0000","last_undegraded":"2024-09-12T19:23:13.268016+0000","last_fullsized":"2024-09-12T19:23:13.268016+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'353","last_scrub_stamp":"2024-09-12T19:23:13.267796+0000","last_deep_scrub":"267'353","last_deep_scrub_stamp":"2024-09-12T19:23:13.267796+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.267796+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:59.721962+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437125,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":46392,"num_write":1072,"num_write_kb":51525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.090461+0000","last_change":"2024-09-12T19:23:28.090461+0000","last_active":"2024-09-12T19:23:28.090461+0000","last_peered":"2024-09-12T19:23:28.090461+0000","last_clean":"2024-09-12T19:23:28.090461+0000","last_became_active":"2024-09-12T17:29:56.765909+0000","last_became_peered":"2024-09-12T17:29:56.765909+0000","last_unstale":"2024-09-12T19:23:28.090461+0000","last_undegraded":"2024-09-12T19:23:28.090461+0000","last_fullsized":"2024-09-12T19:23:28.090461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:28.090285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:28.090285+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.090285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:57.757362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'395","reported_seq":1049,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.255290+0000","last_change":"2024-09-12T19:23:36.255290+0000","last_active":"2024-09-12T19:23:36.255290+0000","last_peered":"2024-09-12T19:23:36.255290+0000","last_clean":"2024-09-12T19:23:36.255290+0000","last_became_active":"2024-09-12T17:29:58.771522+0000","last_became_peered":"2024-09-12T17:29:58.771522+0000","last_unstale":"2024-09-12T19:23:36.255290+0000","last_undegraded":"2024-09-12T19:23:36.255290+0000","last_fullsized":"2024-09-12T19:23:36.255290+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'395","last_scrub_stamp":"2024-09-12T19:23:36.255087+0000","last_deep_scrub":"267'395","last_deep_scrub_stamp":"2024-09-12T19:23:36.255087+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.255087+0000","objects_scrubbed":9,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:56.975938+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46902,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":612,"num_read_kb":1188,"num_write":476,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.745370+0000","last_change":"2024-09-12T19:23:37.745186+0000","last_active":"2024-09-12T19:23:37.745370+0000","last_peered":"2024-09-12T19:23:37.745370+0000","last_clean":"2024-09-12T19:23:37.745370+0000","last_became_active":"2024-09-12T17:30:00.788559+0000","last_became_peered":"2024-09-12T17:30:00.788559+0000","last_unstale":"2024-09-12T19:23:37.745370+0000","last_undegraded":"2024-09-12T19:23:37.745370+0000","last_fullsized":"2024-09-12T19:23:37.745370+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:37.745001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:37.745001+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.745001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:17.916393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'119","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.130433+0000","last_change":"2024-09-12T19:23:43.130433+0000","last_active":"2024-09-12T19:23:43.130433+0000","last_peered":"2024-09-12T19:23:43.130433+0000","last_clean":"2024-09-12T19:23:43.130433+0000","last_became_active":"2024-09-12T17:30:02.807083+0000","last_became_peered":"2024-09-12T17:30:02.807083+0000","last_unstale":"2024-09-12T19:23:43.130433+0000","last_undegraded":"2024-09-12T19:23:43.130433+0000","last_fullsized":"2024-09-12T19:23:43.130433+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'119","last_scrub_stamp":"2024-09-12T19:23:43.130241+0000","last_deep_scrub":"267'119","last_deep_scrub_stamp":"2024-09-12T19:23:43.130241+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.130241+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:38.514554+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":147,"num_write":283,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'827","reported_seq":2508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.266912+0000","last_change":"2024-09-12T19:23:19.266912+0000","last_active":"2024-09-12T19:23:19.266912+0000","last_peered":"2024-09-12T19:23:19.266912+0000","last_clean":"2024-09-12T19:23:19.266912+0000","last_became_active":"2024-09-12T17:29:54.770569+0000","last_became_peered":"2024-09-12T17:29:54.770569+0000","last_unstale":"2024-09-12T19:23:19.266912+0000","last_undegraded":"2024-09-12T19:23:19.266912+0000","last_fullsized":"2024-09-12T19:23:19.266912+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'827","last_scrub_stamp":"2024-09-12T19:23:19.266750+0000","last_deep_scrub":"267'827","last_deep_scrub_stamp":"2024-09-12T19:23:19.266750+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.266750+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:38.162790+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4029,"num_read_kb":3656,"num_write":1088,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'392","reported_seq":1307,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.263333+0000","last_change":"2024-09-12T19:23:14.263333+0000","last_active":"2024-09-12T19:23:14.263333+0000","last_peered":"2024-09-12T19:23:14.263333+0000","last_clean":"2024-09-12T19:23:14.263333+0000","last_became_active":"2024-09-12T17:29:52.749566+0000","last_became_peered":"2024-09-12T17:29:52.749566+0000","last_unstale":"2024-09-12T19:23:14.263333+0000","last_undegraded":"2024-09-12T19:23:14.263333+0000","last_fullsized":"2024-09-12T19:23:14.263333+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'392","last_scrub_stamp":"2024-09-12T19:23:14.262990+0000","last_deep_scrub":"267'392","last_deep_scrub_stamp":"2024-09-12T19:23:14.262990+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.262990+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:34.154250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174738,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1171,"num_read_kb":8659,"num_write":1266,"num_write_kb":49806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.312529+0000","last_change":"2024-09-12T19:23:32.312529+0000","last_active":"2024-09-12T19:23:32.312529+0000","last_peered":"2024-09-12T19:23:32.312529+0000","last_clean":"2024-09-12T19:23:32.312529+0000","last_became_active":"2024-09-12T17:29:56.766952+0000","last_became_peered":"2024-09-12T17:29:56.766952+0000","last_unstale":"2024-09-12T19:23:32.312529+0000","last_undegraded":"2024-09-12T19:23:32.312529+0000","last_fullsized":"2024-09-12T19:23:32.312529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:32.312212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:32.312212+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.312212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:54.904863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'326","reported_seq":951,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.811618+0000","last_change":"2024-09-12T19:23:30.811448+0000","last_active":"2024-09-12T19:23:30.811618+0000","last_peered":"2024-09-12T19:23:30.811618+0000","last_clean":"2024-09-12T19:23:30.811618+0000","last_became_active":"2024-09-12T17:29:58.783105+0000","last_became_peered":"2024-09-12T17:29:58.783105+0000","last_unstale":"2024-09-12T19:23:30.811618+0000","last_undegraded":"2024-09-12T19:23:30.811618+0000","last_fullsized":"2024-09-12T19:23:30.811618+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'326","last_scrub_stamp":"2024-09-12T19:23:30.811250+0000","last_deep_scrub":"267'326","last_deep_scrub_stamp":"2024-09-12T19:23:30.811250+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.811250+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:03.247001+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50641,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":544,"num_read_kb":1206,"num_write":440,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.240737+0000","last_change":"2024-09-12T19:23:28.240737+0000","last_active":"2024-09-12T19:23:28.240737+0000","last_peered":"2024-09-12T19:23:28.240737+0000","last_clean":"2024-09-12T19:23:28.240737+0000","last_became_active":"2024-09-12T17:30:00.799680+0000","last_became_peered":"2024-09-12T17:30:00.799680+0000","last_unstale":"2024-09-12T19:23:28.240737+0000","last_undegraded":"2024-09-12T19:23:28.240737+0000","last_fullsized":"2024-09-12T19:23:28.240737+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:28.240549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:28.240549+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.240549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:11.520672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'130","reported_seq":685,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:13.274665+0000","last_change":"2024-09-12T17:30:02.787080+0000","last_active":"2024-09-12T19:21:13.274665+0000","last_peered":"2024-09-12T19:21:13.274665+0000","last_clean":"2024-09-12T19:21:13.274665+0000","last_became_active":"2024-09-12T17:30:02.786478+0000","last_became_peered":"2024-09-12T17:30:02.786478+0000","last_unstale":"2024-09-12T19:21:13.274665+0000","last_undegraded":"2024-09-12T19:21:13.274665+0000","last_fullsized":"2024-09-12T19:21:13.274665+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:30:01.759441+0000","last_clean_scrub_stamp":"2024-09-12T17:30:01.759441+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":240,"num_read_kb":229,"num_write":300,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'980","reported_seq":2771,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.198525+0000","last_change":"2024-09-12T19:23:25.198525+0000","last_active":"2024-09-12T19:23:25.198525+0000","last_peered":"2024-09-12T19:23:25.198525+0000","last_clean":"2024-09-12T19:23:25.198525+0000","last_became_active":"2024-09-12T17:29:54.761902+0000","last_became_peered":"2024-09-12T17:29:54.761902+0000","last_unstale":"2024-09-12T19:23:25.198525+0000","last_undegraded":"2024-09-12T19:23:25.198525+0000","last_fullsized":"2024-09-12T19:23:25.198525+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'980","last_scrub_stamp":"2024-09-12T19:23:25.198333+0000","last_deep_scrub":"267'980","last_deep_scrub_stamp":"2024-09-12T19:23:25.198333+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.198333+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":900,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:20.662236+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4608,"num_read_kb":4133,"num_write":1300,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'320","reported_seq":985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.200680+0000","last_change":"2024-09-12T19:23:12.200680+0000","last_active":"2024-09-12T19:23:12.200680+0000","last_peered":"2024-09-12T19:23:12.200680+0000","last_clean":"2024-09-12T19:23:12.200680+0000","last_became_active":"2024-09-12T17:29:52.733119+0000","last_became_peered":"2024-09-12T17:29:52.733119+0000","last_unstale":"2024-09-12T19:23:12.200680+0000","last_undegraded":"2024-09-12T19:23:12.200680+0000","last_fullsized":"2024-09-12T19:23:12.200680+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'320","last_scrub_stamp":"2024-09-12T19:23:12.200496+0000","last_deep_scrub":"267'320","last_deep_scrub_stamp":"2024-09-12T19:23:12.200496+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.200496+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:12.257376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":457,"num_read_kb":1565,"num_write":1142,"num_write_kb":34702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.168583+0000","last_change":"2024-09-12T19:23:31.168431+0000","last_active":"2024-09-12T19:23:31.168583+0000","last_peered":"2024-09-12T19:23:31.168583+0000","last_clean":"2024-09-12T19:23:31.168583+0000","last_became_active":"2024-09-12T17:29:56.760142+0000","last_became_peered":"2024-09-12T17:29:56.760142+0000","last_unstale":"2024-09-12T19:23:31.168583+0000","last_undegraded":"2024-09-12T19:23:31.168583+0000","last_fullsized":"2024-09-12T19:23:31.168583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:31.168254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:31.168254+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.168254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:15.851026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'277","reported_seq":879,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.111704+0000","last_change":"2024-09-12T19:23:39.111704+0000","last_active":"2024-09-12T19:23:39.111704+0000","last_peered":"2024-09-12T19:23:39.111704+0000","last_clean":"2024-09-12T19:23:39.111704+0000","last_became_active":"2024-09-12T17:29:58.775284+0000","last_became_peered":"2024-09-12T17:29:58.775284+0000","last_unstale":"2024-09-12T19:23:39.111704+0000","last_undegraded":"2024-09-12T19:23:39.111704+0000","last_fullsized":"2024-09-12T19:23:39.111704+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'277","last_scrub_stamp":"2024-09-12T19:23:39.111503+0000","last_deep_scrub":"267'277","last_deep_scrub_stamp":"2024-09-12T19:23:39.111503+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.111503+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:22.116876+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44259,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":428,"num_read_kb":949,"num_write":354,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.041777+0000","last_change":"2024-09-12T19:23:39.041777+0000","last_active":"2024-09-12T19:23:39.041777+0000","last_peered":"2024-09-12T19:23:39.041777+0000","last_clean":"2024-09-12T19:23:39.041777+0000","last_became_active":"2024-09-12T17:30:00.790907+0000","last_became_peered":"2024-09-12T17:30:00.790907+0000","last_unstale":"2024-09-12T19:23:39.041777+0000","last_undegraded":"2024-09-12T19:23:39.041777+0000","last_fullsized":"2024-09-12T19:23:39.041777+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:39.041590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:39.041590+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.041590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:32.005106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'159","reported_seq":1282,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.098132+0000","last_change":"2024-09-12T19:23:42.098132+0000","last_active":"2024-09-12T19:23:42.098132+0000","last_peered":"2024-09-12T19:23:42.098132+0000","last_clean":"2024-09-12T19:23:42.098132+0000","last_became_active":"2024-09-12T17:30:02.812918+0000","last_became_peered":"2024-09-12T17:30:02.812918+0000","last_unstale":"2024-09-12T19:23:42.098132+0000","last_undegraded":"2024-09-12T19:23:42.098132+0000","last_fullsized":"2024-09-12T19:23:42.098132+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'159","last_scrub_stamp":"2024-09-12T19:23:42.097958+0000","last_deep_scrub":"267'159","last_deep_scrub_stamp":"2024-09-12T19:23:42.097958+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.097958+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:02.263716+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":804,"num_write":370,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'758","reported_seq":2297,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.236980+0000","last_change":"2024-09-12T19:23:20.236818+0000","last_active":"2024-09-12T19:23:20.236980+0000","last_peered":"2024-09-12T19:23:20.236980+0000","last_clean":"2024-09-12T19:23:20.236980+0000","last_became_active":"2024-09-12T17:29:54.767573+0000","last_became_peered":"2024-09-12T17:29:54.767573+0000","last_unstale":"2024-09-12T19:23:20.236980+0000","last_undegraded":"2024-09-12T19:23:20.236980+0000","last_fullsized":"2024-09-12T19:23:20.236980+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'758","last_scrub_stamp":"2024-09-12T19:23:20.236638+0000","last_deep_scrub":"267'758","last_deep_scrub_stamp":"2024-09-12T19:23:20.236638+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.236638+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:45.825300+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3552,"num_read_kb":3227,"num_write":976,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'365","reported_seq":1234,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:07.925988+0000","last_change":"2024-09-12T19:23:07.925988+0000","last_active":"2024-09-12T19:23:07.925988+0000","last_peered":"2024-09-12T19:23:07.925988+0000","last_clean":"2024-09-12T19:23:07.925988+0000","last_became_active":"2024-09-12T17:29:52.765692+0000","last_became_peered":"2024-09-12T17:29:52.765692+0000","last_unstale":"2024-09-12T19:23:07.925988+0000","last_undegraded":"2024-09-12T19:23:07.925988+0000","last_fullsized":"2024-09-12T19:23:07.925988+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'365","last_scrub_stamp":"2024-09-12T19:23:07.925864+0000","last_deep_scrub":"267'365","last_deep_scrub_stamp":"2024-09-12T19:23:07.925864+0000","last_clean_scrub_stamp":"2024-09-12T19:23:07.925864+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:17.489429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110874,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":771,"num_read_kb":82698,"num_write":1110,"num_write_kb":56258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"267'2","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.681287+0000","last_change":"2024-09-12T19:23:23.681287+0000","last_active":"2024-09-12T19:23:23.681287+0000","last_peered":"2024-09-12T19:23:23.681287+0000","last_clean":"2024-09-12T19:23:23.681287+0000","last_became_active":"2024-09-12T17:29:56.760345+0000","last_became_peered":"2024-09-12T17:29:56.760345+0000","last_unstale":"2024-09-12T19:23:23.681287+0000","last_undegraded":"2024-09-12T19:23:23.681287+0000","last_fullsized":"2024-09-12T19:23:23.681287+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:23.681094+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:23.681094+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.681094+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:13.124487+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'348","reported_seq":991,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.088295+0000","last_change":"2024-09-12T19:23:38.088295+0000","last_active":"2024-09-12T19:23:38.088295+0000","last_peered":"2024-09-12T19:23:38.088295+0000","last_clean":"2024-09-12T19:23:38.088295+0000","last_became_active":"2024-09-12T17:29:58.768812+0000","last_became_peered":"2024-09-12T17:29:58.768812+0000","last_unstale":"2024-09-12T19:23:38.088295+0000","last_undegraded":"2024-09-12T19:23:38.088295+0000","last_fullsized":"2024-09-12T19:23:38.088295+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'348","last_scrub_stamp":"2024-09-12T19:23:38.088049+0000","last_deep_scrub":"267'348","last_deep_scrub_stamp":"2024-09-12T19:23:38.088049+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.088049+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:45.131291+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46003,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1072,"num_write":420,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.733889+0000","last_change":"2024-09-12T19:23:38.733889+0000","last_active":"2024-09-12T19:23:38.733889+0000","last_peered":"2024-09-12T19:23:38.733889+0000","last_clean":"2024-09-12T19:23:38.733889+0000","last_became_active":"2024-09-12T17:30:00.786100+0000","last_became_peered":"2024-09-12T17:30:00.786100+0000","last_unstale":"2024-09-12T19:23:38.733889+0000","last_undegraded":"2024-09-12T19:23:38.733889+0000","last_fullsized":"2024-09-12T19:23:38.733889+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:38.733659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:38.733659+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.733659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:13.838209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'141","reported_seq":682,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.038822+0000","last_change":"2024-09-12T19:23:41.038822+0000","last_active":"2024-09-12T19:23:41.038822+0000","last_peered":"2024-09-12T19:23:41.038822+0000","last_clean":"2024-09-12T19:23:41.038822+0000","last_became_active":"2024-09-12T17:30:02.807953+0000","last_became_peered":"2024-09-12T17:30:02.807953+0000","last_unstale":"2024-09-12T19:23:41.038822+0000","last_undegraded":"2024-09-12T19:23:41.038822+0000","last_fullsized":"2024-09-12T19:23:41.038822+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-09-12T19:23:41.038597+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-09-12T19:23:41.038597+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.038597+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:28.809543+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216,"num_read_kb":199,"num_write":346,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'853","reported_seq":2473,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.709674+0000","last_change":"2024-09-12T19:23:19.709674+0000","last_active":"2024-09-12T19:23:19.709674+0000","last_peered":"2024-09-12T19:23:19.709674+0000","last_clean":"2024-09-12T19:23:19.709674+0000","last_became_active":"2024-09-12T17:29:54.768439+0000","last_became_peered":"2024-09-12T17:29:54.768439+0000","last_unstale":"2024-09-12T19:23:19.709674+0000","last_undegraded":"2024-09-12T19:23:19.709674+0000","last_fullsized":"2024-09-12T19:23:19.709674+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'853","last_scrub_stamp":"2024-09-12T19:23:19.709485+0000","last_deep_scrub":"267'853","last_deep_scrub_stamp":"2024-09-12T19:23:19.709485+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.709485+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:38.560571+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3940,"num_read_kb":3539,"num_write":1104,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'384","reported_seq":1082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.154790+0000","last_change":"2024-09-12T19:23:12.154790+0000","last_active":"2024-09-12T19:23:12.154790+0000","last_peered":"2024-09-12T19:23:12.154790+0000","last_clean":"2024-09-12T19:23:12.154790+0000","last_became_active":"2024-09-12T17:29:52.732894+0000","last_became_peered":"2024-09-12T17:29:52.732894+0000","last_unstale":"2024-09-12T19:23:12.154790+0000","last_undegraded":"2024-09-12T19:23:12.154790+0000","last_fullsized":"2024-09-12T19:23:12.154790+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'384","last_scrub_stamp":"2024-09-12T19:23:12.154565+0000","last_deep_scrub":"267'384","last_deep_scrub_stamp":"2024-09-12T19:23:12.154565+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.154565+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:11.123992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":583,"num_read_kb":27715,"num_write":1278,"num_write_kb":46649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'496","reported_seq":1995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.698567+0000","last_change":"2024-09-12T19:23:21.698567+0000","last_active":"2024-09-12T19:23:21.698567+0000","last_peered":"2024-09-12T19:23:21.698567+0000","last_clean":"2024-09-12T19:23:21.698567+0000","last_became_active":"2024-09-12T17:29:54.745192+0000","last_became_peered":"2024-09-12T17:29:54.745192+0000","last_unstale":"2024-09-12T19:23:21.698567+0000","last_undegraded":"2024-09-12T19:23:21.698567+0000","last_fullsized":"2024-09-12T19:23:21.698567+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'496","last_scrub_stamp":"2024-09-12T19:23:21.698347+0000","last_deep_scrub":"267'496","last_deep_scrub_stamp":"2024-09-12T19:23:21.698347+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.698347+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:41.917668+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2446,"num_read_kb":2266,"num_write":619,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'407","reported_seq":1149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.950490+0000","last_change":"2024-09-12T19:23:15.950490+0000","last_active":"2024-09-12T19:23:15.950490+0000","last_peered":"2024-09-12T19:23:15.950490+0000","last_clean":"2024-09-12T19:23:15.950490+0000","last_became_active":"2024-09-12T17:29:52.727433+0000","last_became_peered":"2024-09-12T17:29:52.727433+0000","last_unstale":"2024-09-12T19:23:15.950490+0000","last_undegraded":"2024-09-12T19:23:15.950490+0000","last_fullsized":"2024-09-12T19:23:15.950490+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'407","last_scrub_stamp":"2024-09-12T19:23:15.950082+0000","last_deep_scrub":"267'407","last_deep_scrub_stamp":"2024-09-12T19:23:15.950082+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.950082+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:52.289398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":690,"num_read_kb":95087,"num_write":1289,"num_write_kb":35037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'394","reported_seq":1973,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.345761+0000","last_change":"2024-09-12T19:23:23.345761+0000","last_active":"2024-09-12T19:23:23.345761+0000","last_peered":"2024-09-12T19:23:23.345761+0000","last_clean":"2024-09-12T19:23:23.345761+0000","last_became_active":"2024-09-12T17:29:54.762400+0000","last_became_peered":"2024-09-12T17:29:54.762400+0000","last_unstale":"2024-09-12T19:23:23.345761+0000","last_undegraded":"2024-09-12T19:23:23.345761+0000","last_fullsized":"2024-09-12T19:23:23.345761+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'394","last_scrub_stamp":"2024-09-12T19:23:23.345516+0000","last_deep_scrub":"267'394","last_deep_scrub_stamp":"2024-09-12T19:23:23.345516+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.345516+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:40.023760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2164,"num_read_kb":2073,"num_write":429,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'404","reported_seq":1128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.285536+0000","last_change":"2024-09-12T19:23:16.285536+0000","last_active":"2024-09-12T19:23:16.285536+0000","last_peered":"2024-09-12T19:23:16.285536+0000","last_clean":"2024-09-12T19:23:16.285536+0000","last_became_active":"2024-09-12T17:29:52.756626+0000","last_became_peered":"2024-09-12T17:29:52.756626+0000","last_unstale":"2024-09-12T19:23:16.285536+0000","last_undegraded":"2024-09-12T19:23:16.285536+0000","last_fullsized":"2024-09-12T19:23:16.285536+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'404","last_scrub_stamp":"2024-09-12T19:23:16.285300+0000","last_deep_scrub":"267'404","last_deep_scrub_stamp":"2024-09-12T19:23:16.285300+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.285300+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:58.905956+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":688,"num_read_kb":25414,"num_write":1427,"num_write_kb":18603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'785","reported_seq":2463,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.706702+0000","last_change":"2024-09-12T19:23:22.706702+0000","last_active":"2024-09-12T19:23:22.706702+0000","last_peered":"2024-09-12T19:23:22.706702+0000","last_clean":"2024-09-12T19:23:22.706702+0000","last_became_active":"2024-09-12T17:29:54.749249+0000","last_became_peered":"2024-09-12T17:29:54.749249+0000","last_unstale":"2024-09-12T19:23:22.706702+0000","last_undegraded":"2024-09-12T19:23:22.706702+0000","last_fullsized":"2024-09-12T19:23:22.706702+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'785","last_scrub_stamp":"2024-09-12T19:23:22.706520+0000","last_deep_scrub":"267'785","last_deep_scrub_stamp":"2024-09-12T19:23:22.706520+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.706520+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:51.140029+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3916,"num_read_kb":3572,"num_write":1026,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2553,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'306","reported_seq":967,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.917382+0000","last_change":"2024-09-12T19:23:14.917382+0000","last_active":"2024-09-12T19:23:14.917382+0000","last_peered":"2024-09-12T19:23:14.917382+0000","last_clean":"2024-09-12T19:23:14.917382+0000","last_became_active":"2024-09-12T17:29:52.767047+0000","last_became_peered":"2024-09-12T17:29:52.767047+0000","last_unstale":"2024-09-12T19:23:14.917382+0000","last_undegraded":"2024-09-12T19:23:14.917382+0000","last_fullsized":"2024-09-12T19:23:14.917382+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'306","last_scrub_stamp":"2024-09-12T19:23:14.916990+0000","last_deep_scrub":"267'306","last_deep_scrub_stamp":"2024-09-12T19:23:14.916990+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.916990+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:55.549231+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900516,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":422,"num_read_kb":21273,"num_write":1050,"num_write_kb":35522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'495","reported_seq":2164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.149430+0000","last_change":"2024-09-12T19:23:28.149430+0000","last_active":"2024-09-12T19:23:28.149430+0000","last_peered":"2024-09-12T19:23:28.149430+0000","last_clean":"2024-09-12T19:23:28.149430+0000","last_became_active":"2024-09-12T17:29:54.762667+0000","last_became_peered":"2024-09-12T17:29:54.762667+0000","last_unstale":"2024-09-12T19:23:28.149430+0000","last_undegraded":"2024-09-12T19:23:28.149430+0000","last_fullsized":"2024-09-12T19:23:28.149430+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'495","last_scrub_stamp":"2024-09-12T19:23:28.149234+0000","last_deep_scrub":"267'495","last_deep_scrub_stamp":"2024-09-12T19:23:28.149234+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.149234+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:49.849143+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2506,"num_read_kb":2365,"num_write":559,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'353","reported_seq":1041,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.110866+0000","last_change":"2024-09-12T19:23:16.110866+0000","last_active":"2024-09-12T19:23:16.110866+0000","last_peered":"2024-09-12T19:23:16.110866+0000","last_clean":"2024-09-12T19:23:16.110866+0000","last_became_active":"2024-09-12T17:29:52.765692+0000","last_became_peered":"2024-09-12T17:29:52.765692+0000","last_unstale":"2024-09-12T19:23:16.110866+0000","last_undegraded":"2024-09-12T19:23:16.110866+0000","last_fullsized":"2024-09-12T19:23:16.110866+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'353","last_scrub_stamp":"2024-09-12T19:23:16.110496+0000","last_deep_scrub":"267'353","last_deep_scrub_stamp":"2024-09-12T19:23:16.110496+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.110496+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:11.327254+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992395,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":536,"num_read_kb":21751,"num_write":1010,"num_write_kb":25522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'962","reported_seq":2744,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.252068+0000","last_change":"2024-09-12T19:23:24.252068+0000","last_active":"2024-09-12T19:23:24.252068+0000","last_peered":"2024-09-12T19:23:24.252068+0000","last_clean":"2024-09-12T19:23:24.252068+0000","last_became_active":"2024-09-12T17:29:54.769223+0000","last_became_peered":"2024-09-12T17:29:54.769223+0000","last_unstale":"2024-09-12T19:23:24.252068+0000","last_undegraded":"2024-09-12T19:23:24.252068+0000","last_fullsized":"2024-09-12T19:23:24.252068+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'962","last_scrub_stamp":"2024-09-12T19:23:24.251880+0000","last_deep_scrub":"267'962","last_deep_scrub_stamp":"2024-09-12T19:23:24.251880+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.251880+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":900,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:09.231713+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4532,"num_read_kb":4067,"num_write":1265,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'312","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.658326+0000","last_change":"2024-09-12T19:23:09.658326+0000","last_active":"2024-09-12T19:23:09.658326+0000","last_peered":"2024-09-12T19:23:09.658326+0000","last_clean":"2024-09-12T19:23:09.658326+0000","last_became_active":"2024-09-12T17:29:52.728523+0000","last_became_peered":"2024-09-12T17:29:52.728523+0000","last_unstale":"2024-09-12T19:23:09.658326+0000","last_undegraded":"2024-09-12T19:23:09.658326+0000","last_fullsized":"2024-09-12T19:23:09.658326+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'312","last_scrub_stamp":"2024-09-12T19:23:09.658187+0000","last_deep_scrub":"267'312","last_deep_scrub_stamp":"2024-09-12T19:23:09.658187+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.658187+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:25.530411+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":2514,"num_write":1024,"num_write_kb":45573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'968","reported_seq":2668,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.193466+0000","last_change":"2024-09-12T19:23:27.193466+0000","last_active":"2024-09-12T19:23:27.193466+0000","last_peered":"2024-09-12T19:23:27.193466+0000","last_clean":"2024-09-12T19:23:27.193466+0000","last_became_active":"2024-09-12T17:29:54.758687+0000","last_became_peered":"2024-09-12T17:29:54.758687+0000","last_unstale":"2024-09-12T19:23:27.193466+0000","last_undegraded":"2024-09-12T19:23:27.193466+0000","last_fullsized":"2024-09-12T19:23:27.193466+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'968","last_scrub_stamp":"2024-09-12T19:23:27.193272+0000","last_deep_scrub":"267'968","last_deep_scrub_stamp":"2024-09-12T19:23:27.193272+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.193272+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":900,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:29.700297+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4571,"num_read_kb":4077,"num_write":1316,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'354","reported_seq":1040,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.196879+0000","last_change":"2024-09-12T19:23:13.196879+0000","last_active":"2024-09-12T19:23:13.196879+0000","last_peered":"2024-09-12T19:23:13.196879+0000","last_clean":"2024-09-12T19:23:13.196879+0000","last_became_active":"2024-09-12T17:29:52.718689+0000","last_became_peered":"2024-09-12T17:29:52.718689+0000","last_unstale":"2024-09-12T19:23:13.196879+0000","last_undegraded":"2024-09-12T19:23:13.196879+0000","last_fullsized":"2024-09-12T19:23:13.196879+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-09-12T19:23:13.196640+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-09-12T19:23:13.196640+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.196640+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:32:39.813132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":521,"num_read_kb":13386,"num_write":1097,"num_write_kb":27082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'1292","reported_seq":2911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.220616+0000","last_change":"2024-09-12T19:23:19.220616+0000","last_active":"2024-09-12T19:23:19.220616+0000","last_peered":"2024-09-12T19:23:19.220616+0000","last_clean":"2024-09-12T19:23:19.220616+0000","last_became_active":"2024-09-12T17:29:54.764876+0000","last_became_peered":"2024-09-12T17:29:54.764876+0000","last_unstale":"2024-09-12T19:23:19.220616+0000","last_undegraded":"2024-09-12T19:23:19.220616+0000","last_fullsized":"2024-09-12T19:23:19.220616+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1292","last_scrub_stamp":"2024-09-12T19:23:19.220421+0000","last_deep_scrub":"267'1292","last_deep_scrub_stamp":"2024-09-12T19:23:19.220421+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.220421+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":1200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:24.771326+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5917,"num_read_kb":5200,"num_write":1797,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'408","reported_seq":1091,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.128933+0000","last_change":"2024-09-12T19:23:15.128933+0000","last_active":"2024-09-12T19:23:15.128933+0000","last_peered":"2024-09-12T19:23:15.128933+0000","last_clean":"2024-09-12T19:23:15.128933+0000","last_became_active":"2024-09-12T17:29:52.769086+0000","last_became_peered":"2024-09-12T17:29:52.769086+0000","last_unstale":"2024-09-12T19:23:15.128933+0000","last_undegraded":"2024-09-12T19:23:15.128933+0000","last_fullsized":"2024-09-12T19:23:15.128933+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'408","last_scrub_stamp":"2024-09-12T19:23:15.128724+0000","last_deep_scrub":"267'408","last_deep_scrub_stamp":"2024-09-12T19:23:15.128724+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.128724+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:19.551998+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730154,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":563,"num_read_kb":7699,"num_write":1244,"num_write_kb":36052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"267'896","reported_seq":2492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.943017+0000","last_change":"2024-09-12T19:23:15.943017+0000","last_active":"2024-09-12T19:23:15.943017+0000","last_peered":"2024-09-12T19:23:15.943017+0000","last_clean":"2024-09-12T19:23:15.943017+0000","last_became_active":"2024-09-12T17:29:54.759892+0000","last_became_peered":"2024-09-12T17:29:54.759892+0000","last_unstale":"2024-09-12T19:23:15.943017+0000","last_undegraded":"2024-09-12T19:23:15.943017+0000","last_fullsized":"2024-09-12T19:23:15.943017+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'896","last_scrub_stamp":"2024-09-12T19:23:15.942710+0000","last_deep_scrub":"267'896","last_deep_scrub_stamp":"2024-09-12T19:23:15.942710+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.942710+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:22.175169+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4227,"num_read_kb":3797,"num_write":1212,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":729,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'326","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.372677+0000","last_change":"2024-09-12T19:23:18.372677+0000","last_active":"2024-09-12T19:23:18.372677+0000","last_peered":"2024-09-12T19:23:18.372677+0000","last_clean":"2024-09-12T19:23:18.372677+0000","last_became_active":"2024-09-12T17:29:52.748790+0000","last_became_peered":"2024-09-12T17:29:52.748790+0000","last_unstale":"2024-09-12T19:23:18.372677+0000","last_undegraded":"2024-09-12T19:23:18.372677+0000","last_fullsized":"2024-09-12T19:23:18.372677+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'326","last_scrub_stamp":"2024-09-12T19:23:18.372450+0000","last_deep_scrub":"267'326","last_deep_scrub_stamp":"2024-09-12T19:23:18.372450+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.372450+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:49.825077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":434,"num_read_kb":14399,"num_write":1080,"num_write_kb":30402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'1656","reported_seq":3231,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.270886+0000","last_change":"2024-09-12T19:23:23.270886+0000","last_active":"2024-09-12T19:23:23.270886+0000","last_peered":"2024-09-12T19:23:23.270886+0000","last_clean":"2024-09-12T19:23:23.270886+0000","last_became_active":"2024-09-12T17:29:54.754702+0000","last_became_peered":"2024-09-12T17:29:54.754702+0000","last_unstale":"2024-09-12T19:23:23.270886+0000","last_undegraded":"2024-09-12T19:23:23.270886+0000","last_fullsized":"2024-09-12T19:23:23.270886+0000","mapping_epoch":28,"log_start":"267'1600","ondisk_log_start":"267'1600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1656","last_scrub_stamp":"2024-09-12T19:23:23.270692+0000","last_deep_scrub":"267'1656","last_deep_scrub_stamp":"2024-09-12T19:23:23.270692+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.270692+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":1600,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:49:05.709009+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7245,"num_read_kb":6284,"num_write":2371,"num_write_kb":1100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'306","reported_seq":980,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.172017+0000","last_change":"2024-09-12T19:23:14.172017+0000","last_active":"2024-09-12T19:23:14.172017+0000","last_peered":"2024-09-12T19:23:14.172017+0000","last_clean":"2024-09-12T19:23:14.172017+0000","last_became_active":"2024-09-12T17:29:52.767990+0000","last_became_peered":"2024-09-12T17:29:52.767990+0000","last_unstale":"2024-09-12T19:23:14.172017+0000","last_undegraded":"2024-09-12T19:23:14.172017+0000","last_fullsized":"2024-09-12T19:23:14.172017+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'306","last_scrub_stamp":"2024-09-12T19:23:14.171585+0000","last_deep_scrub":"267'306","last_deep_scrub_stamp":"2024-09-12T19:23:14.171585+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.171585+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:44.675581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":644,"num_write":1033,"num_write_kb":10844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'933","reported_seq":2514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.964877+0000","last_change":"2024-09-12T19:23:11.964877+0000","last_active":"2024-09-12T19:23:11.964877+0000","last_peered":"2024-09-12T19:23:11.964877+0000","last_clean":"2024-09-12T19:23:11.964877+0000","last_became_active":"2024-09-12T17:29:54.759169+0000","last_became_peered":"2024-09-12T17:29:54.759169+0000","last_unstale":"2024-09-12T19:23:11.964877+0000","last_undegraded":"2024-09-12T19:23:11.964877+0000","last_fullsized":"2024-09-12T19:23:11.964877+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'933","last_scrub_stamp":"2024-09-12T19:23:11.964699+0000","last_deep_scrub":"267'933","last_deep_scrub_stamp":"2024-09-12T19:23:11.964699+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.964699+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":900,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:21.605696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4504,"num_read_kb":3992,"num_write":1315,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'297","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.240869+0000","last_change":"2024-09-12T19:23:15.240869+0000","last_active":"2024-09-12T19:23:15.240869+0000","last_peered":"2024-09-12T19:23:15.240869+0000","last_clean":"2024-09-12T19:23:15.240869+0000","last_became_active":"2024-09-12T17:29:52.753935+0000","last_became_peered":"2024-09-12T17:29:52.753935+0000","last_unstale":"2024-09-12T19:23:15.240869+0000","last_undegraded":"2024-09-12T19:23:15.240869+0000","last_fullsized":"2024-09-12T19:23:15.240869+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'297","last_scrub_stamp":"2024-09-12T19:23:15.240643+0000","last_deep_scrub":"267'297","last_deep_scrub_stamp":"2024-09-12T19:23:15.240643+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.240643+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:02.060836+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340668,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":430,"num_read_kb":10673,"num_write":974,"num_write_kb":41601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'837","reported_seq":2507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.256275+0000","last_change":"2024-09-12T19:23:21.256275+0000","last_active":"2024-09-12T19:23:21.256275+0000","last_peered":"2024-09-12T19:23:21.256275+0000","last_clean":"2024-09-12T19:23:21.256275+0000","last_became_active":"2024-09-12T17:29:54.760784+0000","last_became_peered":"2024-09-12T17:29:54.760784+0000","last_unstale":"2024-09-12T19:23:21.256275+0000","last_undegraded":"2024-09-12T19:23:21.256275+0000","last_fullsized":"2024-09-12T19:23:21.256275+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'837","last_scrub_stamp":"2024-09-12T19:23:21.256101+0000","last_deep_scrub":"267'837","last_deep_scrub_stamp":"2024-09-12T19:23:21.256101+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.256101+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:33:40.828572+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4062,"num_read_kb":3682,"num_write":1062,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1008,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'490","reported_seq":1220,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.818268+0000","last_change":"2024-09-12T19:23:21.818268+0000","last_active":"2024-09-12T19:23:21.818268+0000","last_peered":"2024-09-12T19:23:21.818268+0000","last_clean":"2024-09-12T19:23:21.818268+0000","last_became_active":"2024-09-12T17:29:52.735333+0000","last_became_peered":"2024-09-12T17:29:52.735333+0000","last_unstale":"2024-09-12T19:23:21.818268+0000","last_undegraded":"2024-09-12T19:23:21.818268+0000","last_fullsized":"2024-09-12T19:23:21.818268+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'490","last_scrub_stamp":"2024-09-12T19:23:21.818028+0000","last_deep_scrub":"267'490","last_deep_scrub_stamp":"2024-09-12T19:23:21.818028+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.818028+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:20.819323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":869,"num_read_kb":5832,"num_write":1431,"num_write_kb":32355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'868","reported_seq":2455,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.061161+0000","last_change":"2024-09-12T19:23:23.061161+0000","last_active":"2024-09-12T19:23:23.061161+0000","last_peered":"2024-09-12T19:23:23.061161+0000","last_clean":"2024-09-12T19:23:23.061161+0000","last_became_active":"2024-09-12T17:29:54.753635+0000","last_became_peered":"2024-09-12T17:29:54.753635+0000","last_unstale":"2024-09-12T19:23:23.061161+0000","last_undegraded":"2024-09-12T19:23:23.061161+0000","last_fullsized":"2024-09-12T19:23:23.061161+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'868","last_scrub_stamp":"2024-09-12T19:23:23.060978+0000","last_deep_scrub":"267'868","last_deep_scrub_stamp":"2024-09-12T19:23:23.060978+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.060978+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:13.470283+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4079,"num_read_kb":3651,"num_write":1151,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'312","reported_seq":1076,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.225895+0000","last_change":"2024-09-12T19:23:15.225895+0000","last_active":"2024-09-12T19:23:15.225895+0000","last_peered":"2024-09-12T19:23:15.225895+0000","last_clean":"2024-09-12T19:23:15.225895+0000","last_became_active":"2024-09-12T17:29:52.744397+0000","last_became_peered":"2024-09-12T17:29:52.744397+0000","last_unstale":"2024-09-12T19:23:15.225895+0000","last_undegraded":"2024-09-12T19:23:15.225895+0000","last_fullsized":"2024-09-12T19:23:15.225895+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'312","last_scrub_stamp":"2024-09-12T19:23:15.225542+0000","last_deep_scrub":"267'312","last_deep_scrub_stamp":"2024-09-12T19:23:15.225542+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.225542+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:31.333562+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170396,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":764,"num_read_kb":16845,"num_write":1041,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'476","reported_seq":2110,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.887757+0000","last_change":"2024-09-12T19:23:18.887757+0000","last_active":"2024-09-12T19:23:18.887757+0000","last_peered":"2024-09-12T19:23:18.887757+0000","last_clean":"2024-09-12T19:23:18.887757+0000","last_became_active":"2024-09-12T17:29:54.751872+0000","last_became_peered":"2024-09-12T17:29:54.751872+0000","last_unstale":"2024-09-12T19:23:18.887757+0000","last_undegraded":"2024-09-12T19:23:18.887757+0000","last_fullsized":"2024-09-12T19:23:18.887757+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'476","last_scrub_stamp":"2024-09-12T19:23:18.887565+0000","last_deep_scrub":"267'476","last_deep_scrub_stamp":"2024-09-12T19:23:18.887565+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.887565+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:59.888303+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2533,"num_read_kb":2381,"num_write":539,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2539,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'294","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.102283+0000","last_change":"2024-09-12T19:23:18.102283+0000","last_active":"2024-09-12T19:23:18.102283+0000","last_peered":"2024-09-12T19:23:18.102283+0000","last_clean":"2024-09-12T19:23:18.102283+0000","last_became_active":"2024-09-12T17:29:52.747688+0000","last_became_peered":"2024-09-12T17:29:52.747688+0000","last_unstale":"2024-09-12T19:23:18.102283+0000","last_undegraded":"2024-09-12T19:23:18.102283+0000","last_fullsized":"2024-09-12T19:23:18.102283+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'294","last_scrub_stamp":"2024-09-12T19:23:18.102039+0000","last_deep_scrub":"267'294","last_deep_scrub_stamp":"2024-09-12T19:23:18.102039+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.102039+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:41.889385+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262281,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":403,"num_read_kb":6219,"num_write":990,"num_write_kb":21267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'430","reported_seq":1951,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.159013+0000","last_change":"2024-09-12T19:23:31.159013+0000","last_active":"2024-09-12T19:23:31.159013+0000","last_peered":"2024-09-12T19:23:31.159013+0000","last_clean":"2024-09-12T19:23:31.159013+0000","last_became_active":"2024-09-12T17:29:54.760373+0000","last_became_peered":"2024-09-12T17:29:54.760373+0000","last_unstale":"2024-09-12T19:23:31.159013+0000","last_undegraded":"2024-09-12T19:23:31.159013+0000","last_fullsized":"2024-09-12T19:23:31.159013+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'430","last_scrub_stamp":"2024-09-12T19:23:31.158824+0000","last_deep_scrub":"267'430","last_deep_scrub_stamp":"2024-09-12T19:23:31.158824+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.158824+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:32.246805+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2333,"num_read_kb":2181,"num_write":522,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'333","reported_seq":1036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.012002+0000","last_change":"2024-09-12T19:23:11.012002+0000","last_active":"2024-09-12T19:23:11.012002+0000","last_peered":"2024-09-12T19:23:11.012002+0000","last_clean":"2024-09-12T19:23:11.012002+0000","last_became_active":"2024-09-12T17:29:52.746880+0000","last_became_peered":"2024-09-12T17:29:52.746880+0000","last_unstale":"2024-09-12T19:23:11.012002+0000","last_undegraded":"2024-09-12T19:23:11.012002+0000","last_fullsized":"2024-09-12T19:23:11.012002+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-09-12T19:23:11.011792+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-09-12T19:23:11.011792+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.011792+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:47.703391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399180,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":70822,"num_write":1091,"num_write_kb":52448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'788","reported_seq":2454,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.032535+0000","last_change":"2024-09-12T19:23:24.032535+0000","last_active":"2024-09-12T19:23:24.032535+0000","last_peered":"2024-09-12T19:23:24.032535+0000","last_clean":"2024-09-12T19:23:24.032535+0000","last_became_active":"2024-09-12T17:29:54.765197+0000","last_became_peered":"2024-09-12T17:29:54.765197+0000","last_unstale":"2024-09-12T19:23:24.032535+0000","last_undegraded":"2024-09-12T19:23:24.032535+0000","last_fullsized":"2024-09-12T19:23:24.032535+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'788","last_scrub_stamp":"2024-09-12T19:23:24.032353+0000","last_deep_scrub":"267'788","last_deep_scrub_stamp":"2024-09-12T19:23:24.032353+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.032353+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:14.118280+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3968,"num_read_kb":3617,"num_write":1032,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'309","reported_seq":971,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.332041+0000","last_change":"2024-09-12T19:23:17.332041+0000","last_active":"2024-09-12T19:23:17.332041+0000","last_peered":"2024-09-12T19:23:17.332041+0000","last_clean":"2024-09-12T19:23:17.332041+0000","last_became_active":"2024-09-12T17:29:52.749742+0000","last_became_peered":"2024-09-12T17:29:52.749742+0000","last_unstale":"2024-09-12T19:23:17.332041+0000","last_undegraded":"2024-09-12T19:23:17.332041+0000","last_fullsized":"2024-09-12T19:23:17.332041+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'309","last_scrub_stamp":"2024-09-12T19:23:17.331803+0000","last_deep_scrub":"267'309","last_deep_scrub_stamp":"2024-09-12T19:23:17.331803+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.331803+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:46.672373+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":13262,"num_write":1037,"num_write_kb":35239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'334","reported_seq":988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.345593+0000","last_change":"2024-09-12T19:23:19.345593+0000","last_active":"2024-09-12T19:23:19.345593+0000","last_peered":"2024-09-12T19:23:19.345593+0000","last_clean":"2024-09-12T19:23:19.345593+0000","last_became_active":"2024-09-12T17:29:52.720918+0000","last_became_peered":"2024-09-12T17:29:52.720918+0000","last_unstale":"2024-09-12T19:23:19.345593+0000","last_undegraded":"2024-09-12T19:23:19.345593+0000","last_fullsized":"2024-09-12T19:23:19.345593+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'334","last_scrub_stamp":"2024-09-12T19:23:19.345352+0000","last_deep_scrub":"267'334","last_deep_scrub_stamp":"2024-09-12T19:23:19.345352+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.345352+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:34.000068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170702,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":3934,"num_write":1046,"num_write_kb":9633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'602","reported_seq":2195,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.928044+0000","last_change":"2024-09-12T19:23:16.928044+0000","last_active":"2024-09-12T19:23:16.928044+0000","last_peered":"2024-09-12T19:23:16.928044+0000","last_clean":"2024-09-12T19:23:16.928044+0000","last_became_active":"2024-09-12T17:29:54.752553+0000","last_became_peered":"2024-09-12T17:29:54.752553+0000","last_unstale":"2024-09-12T19:23:16.928044+0000","last_undegraded":"2024-09-12T19:23:16.928044+0000","last_fullsized":"2024-09-12T19:23:16.928044+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'602","last_scrub_stamp":"2024-09-12T19:23:16.927841+0000","last_deep_scrub":"267'602","last_deep_scrub_stamp":"2024-09-12T19:23:16.927841+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.927841+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":500,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:30.799294+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3060,"num_read_kb":2784,"num_write":774,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'400","reported_seq":1094,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.722510+0000","last_change":"2024-09-12T19:23:12.722510+0000","last_active":"2024-09-12T19:23:12.722510+0000","last_peered":"2024-09-12T19:23:12.722510+0000","last_clean":"2024-09-12T19:23:12.722510+0000","last_became_active":"2024-09-12T17:30:22.254863+0000","last_became_peered":"2024-09-12T17:30:22.254863+0000","last_unstale":"2024-09-12T19:23:12.722510+0000","last_undegraded":"2024-09-12T19:23:12.722510+0000","last_fullsized":"2024-09-12T19:23:12.722510+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'400","last_scrub_stamp":"2024-09-12T19:23:12.722194+0000","last_deep_scrub":"267'400","last_deep_scrub_stamp":"2024-09-12T19:23:12.722194+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.722194+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:23.077630+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992370,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":655,"num_read_kb":2597,"num_write":1307,"num_write_kb":14489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5,0],"acting":[1,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'448","reported_seq":1957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.408164+0000","last_change":"2024-09-12T19:23:25.408021+0000","last_active":"2024-09-12T19:23:25.408164+0000","last_peered":"2024-09-12T19:23:25.408164+0000","last_clean":"2024-09-12T19:23:25.408164+0000","last_became_active":"2024-09-12T17:29:54.763613+0000","last_became_peered":"2024-09-12T17:29:54.763613+0000","last_unstale":"2024-09-12T19:23:25.408164+0000","last_undegraded":"2024-09-12T19:23:25.408164+0000","last_fullsized":"2024-09-12T19:23:25.408164+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'448","last_scrub_stamp":"2024-09-12T19:23:25.407841+0000","last_deep_scrub":"267'448","last_deep_scrub_stamp":"2024-09-12T19:23:25.407841+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.407841+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:02.339912+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2478,"num_read_kb":2322,"num_write":560,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5989,"num_read_kb":4199,"num_write":1940,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2500,"num_omap_keys":5,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1012,"ondisk_log_size":1012,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16341,"num_read_kb":15997,"num_write":16735,"num_write_kb":4892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2619,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1751,"ondisk_log_size":1751,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":476,"ondisk_log_size":476,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1542315,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":20962,"num_read_kb":40263,"num_write":17485,"num_write_kb":12367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685252,"num_omap_keys":1576,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1865,"ondisk_log_size":1865,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212845,"num_read_kb":194484,"num_write":55296,"num_write_kb":18842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43560,"num_omap_keys":175,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3868,"ondisk_log_size":3868,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":66041020,"num_objects":366,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":366,"num_whiteouts":0,"num_read":36181,"num_read_kb":1906096,"num_write":71498,"num_write_kb":2114280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90423296,"data_stored":90423296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3830,"ondisk_log_size":3830,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":168420,"num_write":154,"num_write_kb":116143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":174519,"num_write":154,"num_write_kb":116143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543521,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316644,"kb_used_data":14740,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94055196,"statfs":{"total":96636764160,"available":96312520704,"internally_reserved":0,"allocated":15093760,"data_stored":13085472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":309131722},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543527,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296832,"kb_used_data":12976,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94075008,"statfs":{"total":96636764160,"available":96332808192,"internally_reserved":0,"allocated":13287424,"data_stored":11310974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":290650566},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543520,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177144,"kb_used_data":11368,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94194696,"statfs":{"total":96636764160,"available":96455368704,"internally_reserved":0,"allocated":11640832,"data_stored":9617929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543522,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161488,"kb_used_data":17856,"kb_used_omap":1,"kb_used_meta":143614,"kb_avail":94210352,"statfs":{"total":96636764160,"available":96471400448,"internally_reserved":0,"allocated":18284544,"data_stored":16335473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":147061189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543521,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310864,"kb_used_data":18688,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":94060976,"statfs":{"total":96636764160,"available":96318439424,"internally_reserved":0,"allocated":19136512,"data_stored":17127576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":299170247},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543523,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126664,"kb_used_data":14968,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94245176,"statfs":{"total":96636764160,"available":96507060224,"internally_reserved":0,"allocated":15327232,"data_stored":13358682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543519,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200244,"kb_used_data":16420,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94171596,"statfs":{"total":96636764160,"available":96431714304,"internally_reserved":0,"allocated":16814080,"data_stored":14841351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543521,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299704,"kb_used_data":15912,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":94072136,"statfs":{"total":96636764160,"available":96329867264,"internally_reserved":0,"allocated":16293888,"data_stored":14257873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":290585029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11374592,"data_stored":11374592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12550144,"data_stored":12550144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11067392,"data_stored":11067392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14835712,"data_stored":14835712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14045184,"data_stored":14045184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7327744,"data_stored":7327744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9019392,"data_stored":9019392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10203136,"data_stored":10203136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":5848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:23:50.675 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.675 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.675 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.675 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.675 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.675 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.676 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.676 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.676 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.676 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.676 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.676 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.676 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.676 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.676 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.677 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.677 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.677 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.677 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.677 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.677 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.677 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.677 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.678 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.678 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.678 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.678 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.678 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.678 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.678 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.678 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.678 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.679 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.679 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.679 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.679 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.679 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.679 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.679 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.679 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.679 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.680 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.680 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.680 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.680 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.680 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.680 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.680 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.680 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.681 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.681 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.681 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.681 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.681 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.681 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.681 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.681 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.682 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.682 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T17:45:40.519079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=45, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.682 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.682 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.682 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.682 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.682 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.682 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.682 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.683 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.683 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.683 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.683 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.683 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.683 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.683 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.683 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.684 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.684 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.684 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.684 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.684 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.686 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.686 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.687 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:30:01.759441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=30, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:23:50.687 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T19:24:10.688 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:24:11.054 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:24:11.066 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-12T19:24:11.073 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":3699,"stamp":"2024-09-12T19:24:09.304586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68190910,"num_objects":834,"num_object_clones":0,"num_object_copies":2400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":834,"num_whiteouts":0,"num_read":295061,"num_read_kb":2506908,"num_write":163405,"num_write_kb":2385161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":740133,"num_omap_keys":1795,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13108,"ondisk_log_size":13108,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1889584,"kb_used_data":122928,"kb_used_omap":12,"kb_used_meta":1766515,"kb_avail":753085136,"statfs":{"total":773094113280,"available":771159179264,"internally_reserved":0,"allocated":125878272,"data_stored":109935330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1808911920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008022"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:55.317807+0000","last_change":"2024-09-12T19:23:55.317807+0000","last_active":"2024-09-12T19:23:55.317807+0000","last_peered":"2024-09-12T19:23:55.317807+0000","last_clean":"2024-09-12T19:23:55.317807+0000","last_became_active":"2024-09-12T18:19:22.658759+0000","last_became_peered":"2024-09-12T18:19:22.658759+0000","last_unstale":"2024-09-12T19:23:55.317807+0000","last_undegraded":"2024-09-12T19:23:55.317807+0000","last_fullsized":"2024-09-12T19:23:55.317807+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:55.317627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:55.317627+0000","last_clean_scrub_stamp":"2024-09-12T19:23:55.317627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:43.045483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:54.335021+0000","last_change":"2024-09-12T19:23:54.335021+0000","last_active":"2024-09-12T19:23:54.335021+0000","last_peered":"2024-09-12T19:23:54.335021+0000","last_clean":"2024-09-12T19:23:54.335021+0000","last_became_active":"2024-09-12T17:51:59.969612+0000","last_became_peered":"2024-09-12T17:51:59.969612+0000","last_unstale":"2024-09-12T19:23:54.335021+0000","last_undegraded":"2024-09-12T19:23:54.335021+0000","last_fullsized":"2024-09-12T19:23:54.335021+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:54.334833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:54.334833+0000","last_clean_scrub_stamp":"2024-09-12T19:23:54.334833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:58.509080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'6","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:53.283938+0000","last_change":"2024-09-12T17:51:52.890790+0000","last_active":"2024-09-12T19:21:53.283938+0000","last_peered":"2024-09-12T19:21:53.283938+0000","last_clean":"2024-09-12T19:21:53.283938+0000","last_became_active":"2024-09-12T17:51:52.890029+0000","last_became_peered":"2024-09-12T17:51:52.890029+0000","last_unstale":"2024-09-12T19:21:53.283938+0000","last_undegraded":"2024-09-12T19:21:53.283938+0000","last_fullsized":"2024-09-12T19:21:53.283938+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:51.839814+0000","last_clean_scrub_stamp":"2024-09-12T17:51:51.839814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:33:58.035727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'76","reported_seq":384,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:52.691579+0000","last_change":"2024-09-12T19:23:52.691579+0000","last_active":"2024-09-12T19:23:52.691579+0000","last_peered":"2024-09-12T19:23:52.691579+0000","last_clean":"2024-09-12T19:23:52.691579+0000","last_became_active":"2024-09-12T17:45:41.585012+0000","last_became_peered":"2024-09-12T17:45:41.585012+0000","last_unstale":"2024-09-12T19:23:52.691579+0000","last_undegraded":"2024-09-12T19:23:52.691579+0000","last_fullsized":"2024-09-12T19:23:52.691579+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'76","last_scrub_stamp":"2024-09-12T19:23:52.691397+0000","last_deep_scrub":"267'76","last_deep_scrub_stamp":"2024-09-12T19:23:52.691397+0000","last_clean_scrub_stamp":"2024-09-12T19:23:52.691397+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:27.011402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":580,"num_read_kb":395,"num_write":86,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5010,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.933499+0000","last_change":"2024-09-12T19:23:35.933499+0000","last_active":"2024-09-12T19:23:35.933499+0000","last_peered":"2024-09-12T19:23:35.933499+0000","last_clean":"2024-09-12T19:23:35.933499+0000","last_became_active":"2024-09-12T18:19:22.641172+0000","last_became_peered":"2024-09-12T18:19:22.641172+0000","last_unstale":"2024-09-12T19:23:35.933499+0000","last_undegraded":"2024-09-12T19:23:35.933499+0000","last_fullsized":"2024-09-12T19:23:35.933499+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:35.933324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:35.933324+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.933324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:07.656674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:57.117453+0000","last_change":"2024-09-12T19:23:57.117453+0000","last_active":"2024-09-12T19:23:57.117453+0000","last_peered":"2024-09-12T19:23:57.117453+0000","last_clean":"2024-09-12T19:23:57.117453+0000","last_became_active":"2024-09-12T17:51:59.957109+0000","last_became_peered":"2024-09-12T17:51:59.957109+0000","last_unstale":"2024-09-12T19:23:57.117453+0000","last_undegraded":"2024-09-12T19:23:57.117453+0000","last_fullsized":"2024-09-12T19:23:57.117453+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:23:57.117263+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:23:57.117263+0000","last_clean_scrub_stamp":"2024-09-12T19:23:57.117263+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:27.733737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'3","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:47.700672+0000","last_change":"2024-09-12T19:23:47.700672+0000","last_active":"2024-09-12T19:23:47.700672+0000","last_peered":"2024-09-12T19:23:47.700672+0000","last_clean":"2024-09-12T19:23:47.700672+0000","last_became_active":"2024-09-12T17:51:52.905220+0000","last_became_peered":"2024-09-12T17:51:52.905220+0000","last_unstale":"2024-09-12T19:23:47.700672+0000","last_undegraded":"2024-09-12T19:23:47.700672+0000","last_fullsized":"2024-09-12T19:23:47.700672+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:23:47.700481+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:23:47.700481+0000","last_clean_scrub_stamp":"2024-09-12T19:23:47.700481+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:24.745509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'123","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.967841+0000","last_change":"2024-09-12T19:23:27.967588+0000","last_active":"2024-09-12T19:23:27.967841+0000","last_peered":"2024-09-12T19:23:27.967841+0000","last_clean":"2024-09-12T19:23:27.967841+0000","last_became_active":"2024-09-12T17:45:41.572859+0000","last_became_peered":"2024-09-12T17:45:41.572859+0000","last_unstale":"2024-09-12T19:23:27.967841+0000","last_undegraded":"2024-09-12T19:23:27.967841+0000","last_fullsized":"2024-09-12T19:23:27.967841+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'123","last_scrub_stamp":"2024-09-12T19:23:27.967374+0000","last_deep_scrub":"267'123","last_deep_scrub_stamp":"2024-09-12T19:23:27.967374+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.967374+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:59.956709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":788,"num_read_kb":542,"num_write":175,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2500,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.278025+0000","last_change":"2024-09-12T19:23:42.278025+0000","last_active":"2024-09-12T19:23:42.278025+0000","last_peered":"2024-09-12T19:23:42.278025+0000","last_clean":"2024-09-12T19:23:42.278025+0000","last_became_active":"2024-09-12T18:19:22.652800+0000","last_became_peered":"2024-09-12T18:19:22.652800+0000","last_unstale":"2024-09-12T19:23:42.278025+0000","last_undegraded":"2024-09-12T19:23:42.278025+0000","last_fullsized":"2024-09-12T19:23:42.278025+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:42.277839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:42.277839+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.277839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:03.630377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:02.712018+0000","last_change":"2024-09-12T19:24:02.712018+0000","last_active":"2024-09-12T19:24:02.712018+0000","last_peered":"2024-09-12T19:24:02.712018+0000","last_clean":"2024-09-12T19:24:02.712018+0000","last_became_active":"2024-09-12T17:51:59.954517+0000","last_became_peered":"2024-09-12T17:51:59.954517+0000","last_unstale":"2024-09-12T19:24:02.712018+0000","last_undegraded":"2024-09-12T19:24:02.712018+0000","last_fullsized":"2024-09-12T19:24:02.712018+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:02.711827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:02.711827+0000","last_clean_scrub_stamp":"2024-09-12T19:24:02.711827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:46.831867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"267'2","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.928253+0000","last_change":"2024-09-12T19:23:31.928017+0000","last_active":"2024-09-12T19:23:31.928253+0000","last_peered":"2024-09-12T19:23:31.928253+0000","last_clean":"2024-09-12T19:23:31.928253+0000","last_became_active":"2024-09-12T17:51:52.885677+0000","last_became_peered":"2024-09-12T17:51:52.885677+0000","last_unstale":"2024-09-12T19:23:31.928253+0000","last_undegraded":"2024-09-12T19:23:31.928253+0000","last_fullsized":"2024-09-12T19:23:31.928253+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:31.927774+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:31.927774+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.927774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:39.909778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'26","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:49.739051+0000","last_change":"2024-09-12T19:23:49.739051+0000","last_active":"2024-09-12T19:23:49.739051+0000","last_peered":"2024-09-12T19:23:49.739051+0000","last_clean":"2024-09-12T19:23:49.739051+0000","last_became_active":"2024-09-12T17:45:41.575793+0000","last_became_peered":"2024-09-12T17:45:41.575793+0000","last_unstale":"2024-09-12T19:23:49.739051+0000","last_undegraded":"2024-09-12T19:23:49.739051+0000","last_fullsized":"2024-09-12T19:23:49.739051+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-09-12T19:23:49.738867+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-09-12T19:23:49.738867+0000","last_clean_scrub_stamp":"2024-09-12T19:23:49.738867+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:05.110011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":83,"num_write":51,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:19:58.254703+0000","last_change":"2024-09-12T18:19:22.656103+0000","last_active":"2024-09-12T19:19:58.254703+0000","last_peered":"2024-09-12T19:19:58.254703+0000","last_clean":"2024-09-12T19:19:58.254703+0000","last_became_active":"2024-09-12T18:19:22.655357+0000","last_became_peered":"2024-09-12T18:19:22.655357+0000","last_unstale":"2024-09-12T19:19:58.254703+0000","last_undegraded":"2024-09-12T19:19:58.254703+0000","last_fullsized":"2024-09-12T19:19:58.254703+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:19:21.610301+0000","last_clean_scrub_stamp":"2024-09-12T18:19:21.610301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:44.884891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"267'2","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:01.940088+0000","last_change":"2024-09-12T19:24:01.940088+0000","last_active":"2024-09-12T19:24:01.940088+0000","last_peered":"2024-09-12T19:24:01.940088+0000","last_clean":"2024-09-12T19:24:01.940088+0000","last_became_active":"2024-09-12T17:51:59.935185+0000","last_became_peered":"2024-09-12T17:51:59.935185+0000","last_unstale":"2024-09-12T19:24:01.940088+0000","last_undegraded":"2024-09-12T19:24:01.940088+0000","last_fullsized":"2024-09-12T19:24:01.940088+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:24:01.939906+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:24:01.939906+0000","last_clean_scrub_stamp":"2024-09-12T19:24:01.939906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:42.002676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"267'10","reported_seq":106,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:51.074797+0000","last_change":"2024-09-12T19:23:51.074797+0000","last_active":"2024-09-12T19:23:51.074797+0000","last_peered":"2024-09-12T19:23:51.074797+0000","last_clean":"2024-09-12T19:23:51.074797+0000","last_became_active":"2024-09-12T17:51:52.864951+0000","last_became_peered":"2024-09-12T17:51:52.864951+0000","last_unstale":"2024-09-12T19:23:51.074797+0000","last_undegraded":"2024-09-12T19:23:51.074797+0000","last_fullsized":"2024-09-12T19:23:51.074797+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'10","last_scrub_stamp":"2024-09-12T19:23:51.074625+0000","last_deep_scrub":"267'10","last_deep_scrub_stamp":"2024-09-12T19:23:51.074625+0000","last_clean_scrub_stamp":"2024-09-12T19:23:51.074625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:03.402586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32810,"num_write":10,"num_write_kb":11304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'28","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:04.943714+0000","last_change":"2024-09-12T19:24:04.943714+0000","last_active":"2024-09-12T19:24:04.943714+0000","last_peered":"2024-09-12T19:24:04.943714+0000","last_clean":"2024-09-12T19:24:04.943714+0000","last_became_active":"2024-09-12T17:45:41.576714+0000","last_became_peered":"2024-09-12T17:45:41.576714+0000","last_unstale":"2024-09-12T19:24:04.943714+0000","last_undegraded":"2024-09-12T19:24:04.943714+0000","last_fullsized":"2024-09-12T19:24:04.943714+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'28","last_scrub_stamp":"2024-09-12T19:24:04.943524+0000","last_deep_scrub":"267'28","last_deep_scrub_stamp":"2024-09-12T19:24:04.943524+0000","last_clean_scrub_stamp":"2024-09-12T19:24:04.943524+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:47.839092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":94,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:07.874838+0000","last_change":"2024-09-12T19:24:07.874838+0000","last_active":"2024-09-12T19:24:07.874838+0000","last_peered":"2024-09-12T19:24:07.874838+0000","last_clean":"2024-09-12T19:24:07.874838+0000","last_became_active":"2024-09-12T18:19:22.665152+0000","last_became_peered":"2024-09-12T18:19:22.665152+0000","last_unstale":"2024-09-12T19:24:07.874838+0000","last_undegraded":"2024-09-12T19:24:07.874838+0000","last_fullsized":"2024-09-12T19:24:07.874838+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:07.874642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:07.874642+0000","last_clean_scrub_stamp":"2024-09-12T19:24:07.874642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:26.554640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"267'3","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:51.330322+0000","last_change":"2024-09-12T19:23:51.330322+0000","last_active":"2024-09-12T19:23:51.330322+0000","last_peered":"2024-09-12T19:23:51.330322+0000","last_clean":"2024-09-12T19:23:51.330322+0000","last_became_active":"2024-09-12T17:51:59.950595+0000","last_became_peered":"2024-09-12T17:51:59.950595+0000","last_unstale":"2024-09-12T19:23:51.330322+0000","last_undegraded":"2024-09-12T19:23:51.330322+0000","last_fullsized":"2024-09-12T19:23:51.330322+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:51.330052+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:51.330052+0000","last_clean_scrub_stamp":"2024-09-12T19:23:51.330052+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:56.771898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:55.668332+0000","last_change":"2024-09-12T19:23:55.668332+0000","last_active":"2024-09-12T19:23:55.668332+0000","last_peered":"2024-09-12T19:23:55.668332+0000","last_clean":"2024-09-12T19:23:55.668332+0000","last_became_active":"2024-09-12T17:51:52.907863+0000","last_became_peered":"2024-09-12T17:51:52.907863+0000","last_unstale":"2024-09-12T19:23:55.668332+0000","last_undegraded":"2024-09-12T19:23:55.668332+0000","last_fullsized":"2024-09-12T19:23:55.668332+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:23:55.668106+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:23:55.668106+0000","last_clean_scrub_stamp":"2024-09-12T19:23:55.668106+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:21:03.716051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'42","reported_seq":195,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:55.954073+0000","last_change":"2024-09-12T19:23:55.954073+0000","last_active":"2024-09-12T19:23:55.954073+0000","last_peered":"2024-09-12T19:23:55.954073+0000","last_clean":"2024-09-12T19:23:55.954073+0000","last_became_active":"2024-09-12T17:45:41.596133+0000","last_became_peered":"2024-09-12T17:45:41.596133+0000","last_unstale":"2024-09-12T19:23:55.954073+0000","last_undegraded":"2024-09-12T19:23:55.954073+0000","last_fullsized":"2024-09-12T19:23:55.954073+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'42","last_scrub_stamp":"2024-09-12T19:23:55.953882+0000","last_deep_scrub":"267'42","last_deep_scrub_stamp":"2024-09-12T19:23:55.953882+0000","last_clean_scrub_stamp":"2024-09-12T19:23:55.953882+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:22:04.152899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":80,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.757829+0000","last_change":"2024-09-12T19:23:45.757664+0000","last_active":"2024-09-12T19:23:45.757829+0000","last_peered":"2024-09-12T19:23:45.757829+0000","last_clean":"2024-09-12T19:23:45.757829+0000","last_became_active":"2024-09-12T18:19:22.652141+0000","last_became_peered":"2024-09-12T18:19:22.652141+0000","last_unstale":"2024-09-12T19:23:45.757829+0000","last_undegraded":"2024-09-12T19:23:45.757829+0000","last_fullsized":"2024-09-12T19:23:45.757829+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:45.757489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:45.757489+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.757489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:29.631747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"267'2","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.252057+0000","last_change":"2024-09-12T19:23:40.251781+0000","last_active":"2024-09-12T19:23:40.252057+0000","last_peered":"2024-09-12T19:23:40.252057+0000","last_clean":"2024-09-12T19:23:40.252057+0000","last_became_active":"2024-09-12T17:51:59.936941+0000","last_became_peered":"2024-09-12T17:51:59.936941+0000","last_unstale":"2024-09-12T19:23:40.252057+0000","last_undegraded":"2024-09-12T19:23:40.252057+0000","last_fullsized":"2024-09-12T19:23:40.252057+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:40.251559+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:40.251559+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.251559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:26.712415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'2","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:49.056249+0000","last_change":"2024-09-12T19:23:49.055965+0000","last_active":"2024-09-12T19:23:49.056249+0000","last_peered":"2024-09-12T19:23:49.056249+0000","last_clean":"2024-09-12T19:23:49.056249+0000","last_became_active":"2024-09-12T17:51:52.882157+0000","last_became_peered":"2024-09-12T17:51:52.882157+0000","last_unstale":"2024-09-12T19:23:49.056249+0000","last_undegraded":"2024-09-12T19:23:49.056249+0000","last_fullsized":"2024-09-12T19:23:49.056249+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:49.055748+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:49.055748+0000","last_clean_scrub_stamp":"2024-09-12T19:23:49.055748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:34.198822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'16","reported_seq":122,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.307486+0000","last_change":"2024-09-12T19:23:37.307486+0000","last_active":"2024-09-12T19:23:37.307486+0000","last_peered":"2024-09-12T19:23:37.307486+0000","last_clean":"2024-09-12T19:23:37.307486+0000","last_became_active":"2024-09-12T17:45:41.586661+0000","last_became_peered":"2024-09-12T17:45:41.586661+0000","last_unstale":"2024-09-12T19:23:37.307486+0000","last_undegraded":"2024-09-12T19:23:37.307486+0000","last_fullsized":"2024-09-12T19:23:37.307486+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'16","last_scrub_stamp":"2024-09-12T19:23:37.307195+0000","last_deep_scrub":"267'16","last_deep_scrub_stamp":"2024-09-12T19:23:37.307195+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.307195+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:28.732335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'2","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:04.175194+0000","last_change":"2024-09-12T19:24:04.175194+0000","last_active":"2024-09-12T19:24:04.175194+0000","last_peered":"2024-09-12T19:24:04.175194+0000","last_clean":"2024-09-12T19:24:04.175194+0000","last_became_active":"2024-09-12T18:19:22.668945+0000","last_became_peered":"2024-09-12T18:19:22.668945+0000","last_unstale":"2024-09-12T19:24:04.175194+0000","last_undegraded":"2024-09-12T19:24:04.175194+0000","last_fullsized":"2024-09-12T19:24:04.175194+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:24:04.174979+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:24:04.174979+0000","last_clean_scrub_stamp":"2024-09-12T19:24:04.174979+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:23.961079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.310464+0000","last_change":"2024-09-12T19:23:45.310464+0000","last_active":"2024-09-12T19:23:45.310464+0000","last_peered":"2024-09-12T19:23:45.310464+0000","last_clean":"2024-09-12T19:23:45.310464+0000","last_became_active":"2024-09-12T17:51:59.936441+0000","last_became_peered":"2024-09-12T17:51:59.936441+0000","last_unstale":"2024-09-12T19:23:45.310464+0000","last_undegraded":"2024-09-12T19:23:45.310464+0000","last_fullsized":"2024-09-12T19:23:45.310464+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:45.310281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:45.310281+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.310281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:27.701105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'3","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:50.091569+0000","last_change":"2024-09-12T19:23:50.091569+0000","last_active":"2024-09-12T19:23:50.091569+0000","last_peered":"2024-09-12T19:23:50.091569+0000","last_clean":"2024-09-12T19:23:50.091569+0000","last_became_active":"2024-09-12T17:51:52.887962+0000","last_became_peered":"2024-09-12T17:51:52.887962+0000","last_unstale":"2024-09-12T19:23:50.091569+0000","last_undegraded":"2024-09-12T19:23:50.091569+0000","last_fullsized":"2024-09-12T19:23:50.091569+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:23:50.091407+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:23:50.091407+0000","last_clean_scrub_stamp":"2024-09-12T19:23:50.091407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:47.368613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'25","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:50.728965+0000","last_change":"2024-09-12T19:23:50.728965+0000","last_active":"2024-09-12T19:23:50.728965+0000","last_peered":"2024-09-12T19:23:50.728965+0000","last_clean":"2024-09-12T19:23:50.728965+0000","last_became_active":"2024-09-12T17:45:41.565956+0000","last_became_peered":"2024-09-12T17:45:41.565956+0000","last_unstale":"2024-09-12T19:23:50.728965+0000","last_undegraded":"2024-09-12T19:23:50.728965+0000","last_fullsized":"2024-09-12T19:23:50.728965+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'25","last_scrub_stamp":"2024-09-12T19:23:50.728773+0000","last_deep_scrub":"267'25","last_deep_scrub_stamp":"2024-09-12T19:23:50.728773+0000","last_clean_scrub_stamp":"2024-09-12T19:23:50.728773+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:45.890653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:06.196450+0000","last_change":"2024-09-12T19:24:06.196450+0000","last_active":"2024-09-12T19:24:06.196450+0000","last_peered":"2024-09-12T19:24:06.196450+0000","last_clean":"2024-09-12T19:24:06.196450+0000","last_became_active":"2024-09-12T18:19:22.677111+0000","last_became_peered":"2024-09-12T18:19:22.677111+0000","last_unstale":"2024-09-12T19:24:06.196450+0000","last_undegraded":"2024-09-12T19:24:06.196450+0000","last_fullsized":"2024-09-12T19:24:06.196450+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:06.196272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:06.196272+0000","last_clean_scrub_stamp":"2024-09-12T19:24:06.196272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:14.722236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'2","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:03.962458+0000","last_change":"2024-09-12T19:24:03.962458+0000","last_active":"2024-09-12T19:24:03.962458+0000","last_peered":"2024-09-12T19:24:03.962458+0000","last_clean":"2024-09-12T19:24:03.962458+0000","last_became_active":"2024-09-12T17:51:59.941825+0000","last_became_peered":"2024-09-12T17:51:59.941825+0000","last_unstale":"2024-09-12T19:24:03.962458+0000","last_undegraded":"2024-09-12T19:24:03.962458+0000","last_fullsized":"2024-09-12T19:24:03.962458+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:24:03.962271+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:24:03.962271+0000","last_clean_scrub_stamp":"2024-09-12T19:24:03.962271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:26.163805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":10,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"267'3","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:58.705560+0000","last_change":"2024-09-12T19:23:58.705560+0000","last_active":"2024-09-12T19:23:58.705560+0000","last_peered":"2024-09-12T19:23:58.705560+0000","last_clean":"2024-09-12T19:23:58.705560+0000","last_became_active":"2024-09-12T17:51:52.899511+0000","last_became_peered":"2024-09-12T17:51:52.899511+0000","last_unstale":"2024-09-12T19:23:58.705560+0000","last_undegraded":"2024-09-12T19:23:58.705560+0000","last_fullsized":"2024-09-12T19:23:58.705560+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:58.705256+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:58.705256+0000","last_clean_scrub_stamp":"2024-09-12T19:23:58.705256+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:57.794920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'27","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.696922+0000","last_change":"2024-09-12T19:23:39.696922+0000","last_active":"2024-09-12T19:23:39.696922+0000","last_peered":"2024-09-12T19:23:39.696922+0000","last_clean":"2024-09-12T19:23:39.696922+0000","last_became_active":"2024-09-12T17:45:41.578021+0000","last_became_peered":"2024-09-12T17:45:41.578021+0000","last_unstale":"2024-09-12T19:23:39.696922+0000","last_undegraded":"2024-09-12T19:23:39.696922+0000","last_fullsized":"2024-09-12T19:23:39.696922+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'27","last_scrub_stamp":"2024-09-12T19:23:39.696712+0000","last_deep_scrub":"267'27","last_deep_scrub_stamp":"2024-09-12T19:23:39.696712+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.696712+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:17.945359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":97,"num_write":50,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:46.735693+0000","last_change":"2024-09-12T19:23:46.735693+0000","last_active":"2024-09-12T19:23:46.735693+0000","last_peered":"2024-09-12T19:23:46.735693+0000","last_clean":"2024-09-12T19:23:46.735693+0000","last_became_active":"2024-09-12T18:19:22.668802+0000","last_became_peered":"2024-09-12T18:19:22.668802+0000","last_unstale":"2024-09-12T19:23:46.735693+0000","last_undegraded":"2024-09-12T19:23:46.735693+0000","last_fullsized":"2024-09-12T19:23:46.735693+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:46.735517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:46.735517+0000","last_clean_scrub_stamp":"2024-09-12T19:23:46.735517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:47.277789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:59.951949+0000","last_change":"2024-09-12T19:23:59.951949+0000","last_active":"2024-09-12T19:23:59.951949+0000","last_peered":"2024-09-12T19:23:59.951949+0000","last_clean":"2024-09-12T19:23:59.951949+0000","last_became_active":"2024-09-12T17:51:59.939686+0000","last_became_peered":"2024-09-12T17:51:59.939686+0000","last_unstale":"2024-09-12T19:23:59.951949+0000","last_undegraded":"2024-09-12T19:23:59.951949+0000","last_fullsized":"2024-09-12T19:23:59.951949+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:59.951757+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:59.951757+0000","last_clean_scrub_stamp":"2024-09-12T19:23:59.951757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:24.800825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:49.294040+0000","last_change":"2024-09-12T19:23:49.294040+0000","last_active":"2024-09-12T19:23:49.294040+0000","last_peered":"2024-09-12T19:23:49.294040+0000","last_clean":"2024-09-12T19:23:49.294040+0000","last_became_active":"2024-09-12T17:51:52.892953+0000","last_became_peered":"2024-09-12T17:51:52.892953+0000","last_unstale":"2024-09-12T19:23:49.294040+0000","last_undegraded":"2024-09-12T19:23:49.294040+0000","last_fullsized":"2024-09-12T19:23:49.294040+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:49.293859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:49.293859+0000","last_clean_scrub_stamp":"2024-09-12T19:23:49.293859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:44.997783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'51","reported_seq":222,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:48.717893+0000","last_change":"2024-09-12T19:23:48.717893+0000","last_active":"2024-09-12T19:23:48.717893+0000","last_peered":"2024-09-12T19:23:48.717893+0000","last_clean":"2024-09-12T19:23:48.717893+0000","last_became_active":"2024-09-12T17:45:41.572941+0000","last_became_peered":"2024-09-12T17:45:41.572941+0000","last_unstale":"2024-09-12T19:23:48.717893+0000","last_undegraded":"2024-09-12T19:23:48.717893+0000","last_fullsized":"2024-09-12T19:23:48.717893+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'51","last_scrub_stamp":"2024-09-12T19:23:48.717711+0000","last_deep_scrub":"267'51","last_deep_scrub_stamp":"2024-09-12T19:23:48.717711+0000","last_clean_scrub_stamp":"2024-09-12T19:23:48.717711+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:54.563072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":190,"num_write":83,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'2","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.930550+0000","last_change":"2024-09-12T19:23:32.930550+0000","last_active":"2024-09-12T19:23:32.930550+0000","last_peered":"2024-09-12T19:23:32.930550+0000","last_clean":"2024-09-12T19:23:32.930550+0000","last_became_active":"2024-09-12T18:19:22.651901+0000","last_became_peered":"2024-09-12T18:19:22.651901+0000","last_unstale":"2024-09-12T19:23:32.930550+0000","last_undegraded":"2024-09-12T19:23:32.930550+0000","last_fullsized":"2024-09-12T19:23:32.930550+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:32.930331+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:32.930331+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.930331+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:50.719199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":62,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:21:03.272203+0000","last_change":"2024-09-12T17:51:59.948536+0000","last_active":"2024-09-12T19:21:03.272203+0000","last_peered":"2024-09-12T19:21:03.272203+0000","last_clean":"2024-09-12T19:21:03.272203+0000","last_became_active":"2024-09-12T17:51:59.947392+0000","last_became_peered":"2024-09-12T17:51:59.947392+0000","last_unstale":"2024-09-12T19:21:03.272203+0000","last_undegraded":"2024-09-12T19:21:03.272203+0000","last_fullsized":"2024-09-12T19:21:03.272203+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'5","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:52.990126+0000","last_change":"2024-09-12T19:23:52.990126+0000","last_active":"2024-09-12T19:23:52.990126+0000","last_peered":"2024-09-12T19:23:52.990126+0000","last_clean":"2024-09-12T19:23:52.990126+0000","last_became_active":"2024-09-12T17:51:52.886123+0000","last_became_peered":"2024-09-12T17:51:52.886123+0000","last_unstale":"2024-09-12T19:23:52.990126+0000","last_undegraded":"2024-09-12T19:23:52.990126+0000","last_fullsized":"2024-09-12T19:23:52.990126+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T19:23:52.989805+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T19:23:52.989805+0000","last_clean_scrub_stamp":"2024-09-12T19:23:52.989805+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:43.267916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'32","reported_seq":173,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:53.992122+0000","last_change":"2024-09-12T19:23:53.992122+0000","last_active":"2024-09-12T19:23:53.992122+0000","last_peered":"2024-09-12T19:23:53.992122+0000","last_clean":"2024-09-12T19:23:53.992122+0000","last_became_active":"2024-09-12T17:45:41.591637+0000","last_became_peered":"2024-09-12T17:45:41.591637+0000","last_unstale":"2024-09-12T19:23:53.992122+0000","last_undegraded":"2024-09-12T19:23:53.992122+0000","last_fullsized":"2024-09-12T19:23:53.992122+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'32","last_scrub_stamp":"2024-09-12T19:23:53.991922+0000","last_deep_scrub":"267'32","last_deep_scrub_stamp":"2024-09-12T19:23:53.991922+0000","last_clean_scrub_stamp":"2024-09-12T19:23:53.991922+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:07.256889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":117,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:05.221259+0000","last_change":"2024-09-12T19:24:05.221259+0000","last_active":"2024-09-12T19:24:05.221259+0000","last_peered":"2024-09-12T19:24:05.221259+0000","last_clean":"2024-09-12T19:24:05.221259+0000","last_became_active":"2024-09-12T18:19:22.645829+0000","last_became_peered":"2024-09-12T18:19:22.645829+0000","last_unstale":"2024-09-12T19:24:05.221259+0000","last_undegraded":"2024-09-12T19:24:05.221259+0000","last_fullsized":"2024-09-12T19:24:05.221259+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:05.221079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:05.221079+0000","last_clean_scrub_stamp":"2024-09-12T19:24:05.221079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:26.579169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"267'9","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:00.716887+0000","last_change":"2024-09-12T19:24:00.716887+0000","last_active":"2024-09-12T19:24:00.716887+0000","last_peered":"2024-09-12T19:24:00.716887+0000","last_clean":"2024-09-12T19:24:00.716887+0000","last_became_active":"2024-09-12T17:52:23.438623+0000","last_became_peered":"2024-09-12T17:52:23.438623+0000","last_unstale":"2024-09-12T19:24:00.716887+0000","last_undegraded":"2024-09-12T19:24:00.716887+0000","last_fullsized":"2024-09-12T19:24:00.716887+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'9","last_scrub_stamp":"2024-09-12T19:24:00.716707+0000","last_deep_scrub":"267'9","last_deep_scrub_stamp":"2024-09-12T19:24:00.716707+0000","last_clean_scrub_stamp":"2024-09-12T19:24:00.716707+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:48.867576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":19,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.16","version":"267'2","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.895617+0000","last_change":"2024-09-12T19:23:29.895553+0000","last_active":"2024-09-12T19:23:29.895617+0000","last_peered":"2024-09-12T19:23:29.895617+0000","last_clean":"2024-09-12T19:23:29.895617+0000","last_became_active":"2024-09-12T17:51:52.876542+0000","last_became_peered":"2024-09-12T17:51:52.876542+0000","last_unstale":"2024-09-12T19:23:29.895617+0000","last_undegraded":"2024-09-12T19:23:29.895617+0000","last_fullsized":"2024-09-12T19:23:29.895617+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:29.895459+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:29.895459+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.895459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:04.933465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"0'0","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.916967+0000","last_change":"2024-09-12T19:23:34.916967+0000","last_active":"2024-09-12T19:23:34.916967+0000","last_peered":"2024-09-12T19:23:34.916967+0000","last_clean":"2024-09-12T19:23:34.916967+0000","last_became_active":"2024-09-12T17:45:41.574953+0000","last_became_peered":"2024-09-12T17:45:41.574953+0000","last_unstale":"2024-09-12T19:23:34.916967+0000","last_undegraded":"2024-09-12T19:23:34.916967+0000","last_fullsized":"2024-09-12T19:23:34.916967+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:34.916775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:34.916775+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.916775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:23.463117+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:53.366419+0000","last_change":"2024-09-12T19:23:53.366419+0000","last_active":"2024-09-12T19:23:53.366419+0000","last_peered":"2024-09-12T19:23:53.366419+0000","last_clean":"2024-09-12T19:23:53.366419+0000","last_became_active":"2024-09-12T18:19:22.657731+0000","last_became_peered":"2024-09-12T18:19:22.657731+0000","last_unstale":"2024-09-12T19:23:53.366419+0000","last_undegraded":"2024-09-12T19:23:53.366419+0000","last_fullsized":"2024-09-12T19:23:53.366419+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:53.366205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:53.366205+0000","last_clean_scrub_stamp":"2024-09-12T19:23:53.366205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:31.776287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"267'5","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:55.083484+0000","last_change":"2024-09-12T19:23:55.083484+0000","last_active":"2024-09-12T19:23:55.083484+0000","last_peered":"2024-09-12T19:23:55.083484+0000","last_clean":"2024-09-12T19:23:55.083484+0000","last_became_active":"2024-09-12T17:51:59.937650+0000","last_became_peered":"2024-09-12T17:51:59.937650+0000","last_unstale":"2024-09-12T19:23:55.083484+0000","last_undegraded":"2024-09-12T19:23:55.083484+0000","last_fullsized":"2024-09-12T19:23:55.083484+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T19:23:55.083274+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T19:23:55.083274+0000","last_clean_scrub_stamp":"2024-09-12T19:23:55.083274+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:03.979226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'2","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:57.687769+0000","last_change":"2024-09-12T19:23:57.687769+0000","last_active":"2024-09-12T19:23:57.687769+0000","last_peered":"2024-09-12T19:23:57.687769+0000","last_clean":"2024-09-12T19:23:57.687769+0000","last_became_active":"2024-09-12T17:51:52.887964+0000","last_became_peered":"2024-09-12T17:51:52.887964+0000","last_unstale":"2024-09-12T19:23:57.687769+0000","last_undegraded":"2024-09-12T19:23:57.687769+0000","last_fullsized":"2024-09-12T19:23:57.687769+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:23:57.687566+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:23:57.687566+0000","last_clean_scrub_stamp":"2024-09-12T19:23:57.687566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:06.650397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'27","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:49.993657+0000","last_change":"2024-09-12T19:23:49.993413+0000","last_active":"2024-09-12T19:23:49.993657+0000","last_peered":"2024-09-12T19:23:49.993657+0000","last_clean":"2024-09-12T19:23:49.993657+0000","last_became_active":"2024-09-12T17:45:41.594619+0000","last_became_peered":"2024-09-12T17:45:41.594619+0000","last_unstale":"2024-09-12T19:23:49.993657+0000","last_undegraded":"2024-09-12T19:23:49.993657+0000","last_fullsized":"2024-09-12T19:23:49.993657+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'27","last_scrub_stamp":"2024-09-12T19:23:49.993192+0000","last_deep_scrub":"267'27","last_deep_scrub_stamp":"2024-09-12T19:23:49.993192+0000","last_clean_scrub_stamp":"2024-09-12T19:23:49.993192+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:33.742938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:06.877467+0000","last_change":"2024-09-12T19:24:06.877467+0000","last_active":"2024-09-12T19:24:06.877467+0000","last_peered":"2024-09-12T19:24:06.877467+0000","last_clean":"2024-09-12T19:24:06.877467+0000","last_became_active":"2024-09-12T18:19:22.646129+0000","last_became_peered":"2024-09-12T18:19:22.646129+0000","last_unstale":"2024-09-12T19:24:06.877467+0000","last_undegraded":"2024-09-12T19:24:06.877467+0000","last_fullsized":"2024-09-12T19:24:06.877467+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:06.877265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:06.877265+0000","last_clean_scrub_stamp":"2024-09-12T19:24:06.877265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:11:14.469545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'3","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:49.736288+0000","last_change":"2024-09-12T19:23:49.736288+0000","last_active":"2024-09-12T19:23:49.736288+0000","last_peered":"2024-09-12T19:23:49.736288+0000","last_clean":"2024-09-12T19:23:49.736288+0000","last_became_active":"2024-09-12T17:51:59.961892+0000","last_became_peered":"2024-09-12T17:51:59.961892+0000","last_unstale":"2024-09-12T19:23:49.736288+0000","last_undegraded":"2024-09-12T19:23:49.736288+0000","last_fullsized":"2024-09-12T19:23:49.736288+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:23:49.736089+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:23:49.736089+0000","last_clean_scrub_stamp":"2024-09-12T19:23:49.736089+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:17.250564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'5","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:48.084438+0000","last_change":"2024-09-12T19:23:48.084438+0000","last_active":"2024-09-12T19:23:48.084438+0000","last_peered":"2024-09-12T19:23:48.084438+0000","last_clean":"2024-09-12T19:23:48.084438+0000","last_became_active":"2024-09-12T17:51:52.865019+0000","last_became_peered":"2024-09-12T17:51:52.865019+0000","last_unstale":"2024-09-12T19:23:48.084438+0000","last_undegraded":"2024-09-12T19:23:48.084438+0000","last_fullsized":"2024-09-12T19:23:48.084438+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T19:23:48.084224+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T19:23:48.084224+0000","last_clean_scrub_stamp":"2024-09-12T19:23:48.084224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:29.411074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'30","reported_seq":162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:47.108012+0000","last_change":"2024-09-12T19:23:47.108012+0000","last_active":"2024-09-12T19:23:47.108012+0000","last_peered":"2024-09-12T19:23:47.108012+0000","last_clean":"2024-09-12T19:23:47.108012+0000","last_became_active":"2024-09-12T17:45:41.594848+0000","last_became_peered":"2024-09-12T17:45:41.594848+0000","last_unstale":"2024-09-12T19:23:47.108012+0000","last_undegraded":"2024-09-12T19:23:47.108012+0000","last_fullsized":"2024-09-12T19:23:47.108012+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'30","last_scrub_stamp":"2024-09-12T19:23:47.107794+0000","last_deep_scrub":"267'30","last_deep_scrub_stamp":"2024-09-12T19:23:47.107794+0000","last_clean_scrub_stamp":"2024-09-12T19:23:47.107794+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:28.712598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":101,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:06.720379+0000","last_change":"2024-09-12T19:24:06.720379+0000","last_active":"2024-09-12T19:24:06.720379+0000","last_peered":"2024-09-12T19:24:06.720379+0000","last_clean":"2024-09-12T19:24:06.720379+0000","last_became_active":"2024-09-12T18:19:22.648818+0000","last_became_peered":"2024-09-12T18:19:22.648818+0000","last_unstale":"2024-09-12T19:24:06.720379+0000","last_undegraded":"2024-09-12T19:24:06.720379+0000","last_fullsized":"2024-09-12T19:24:06.720379+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:06.720188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:06.720188+0000","last_clean_scrub_stamp":"2024-09-12T19:24:06.720188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:03.808849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:50.700424+0000","last_change":"2024-09-12T19:23:50.700424+0000","last_active":"2024-09-12T19:23:50.700424+0000","last_peered":"2024-09-12T19:23:50.700424+0000","last_clean":"2024-09-12T19:23:50.700424+0000","last_became_active":"2024-09-12T17:51:59.953480+0000","last_became_peered":"2024-09-12T17:51:59.953480+0000","last_unstale":"2024-09-12T19:23:50.700424+0000","last_undegraded":"2024-09-12T19:23:50.700424+0000","last_fullsized":"2024-09-12T19:23:50.700424+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:50.700219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:50.700219+0000","last_clean_scrub_stamp":"2024-09-12T19:23:50.700219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:05:23.115721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:56.936643+0000","last_change":"2024-09-12T19:23:56.936643+0000","last_active":"2024-09-12T19:23:56.936643+0000","last_peered":"2024-09-12T19:23:56.936643+0000","last_clean":"2024-09-12T19:23:56.936643+0000","last_became_active":"2024-09-12T17:51:52.884758+0000","last_became_peered":"2024-09-12T17:51:52.884758+0000","last_unstale":"2024-09-12T19:23:56.936643+0000","last_undegraded":"2024-09-12T19:23:56.936643+0000","last_fullsized":"2024-09-12T19:23:56.936643+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:56.936452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:56.936452+0000","last_clean_scrub_stamp":"2024-09-12T19:23:56.936452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:11.472424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'17","reported_seq":130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:46.694947+0000","last_change":"2024-09-12T19:23:46.694947+0000","last_active":"2024-09-12T19:23:46.694947+0000","last_peered":"2024-09-12T19:23:46.694947+0000","last_clean":"2024-09-12T19:23:46.694947+0000","last_became_active":"2024-09-12T17:45:41.585259+0000","last_became_peered":"2024-09-12T17:45:41.585259+0000","last_unstale":"2024-09-12T19:23:46.694947+0000","last_undegraded":"2024-09-12T19:23:46.694947+0000","last_fullsized":"2024-09-12T19:23:46.694947+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'17","last_scrub_stamp":"2024-09-12T19:23:46.694759+0000","last_deep_scrub":"267'17","last_deep_scrub_stamp":"2024-09-12T19:23:46.694759+0000","last_clean_scrub_stamp":"2024-09-12T19:23:46.694759+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:40.321282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":55,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'2","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:01.741501+0000","last_change":"2024-09-12T19:24:01.741501+0000","last_active":"2024-09-12T19:24:01.741501+0000","last_peered":"2024-09-12T19:24:01.741501+0000","last_clean":"2024-09-12T19:24:01.741501+0000","last_became_active":"2024-09-12T18:19:22.655117+0000","last_became_peered":"2024-09-12T18:19:22.655117+0000","last_unstale":"2024-09-12T19:24:01.741501+0000","last_undegraded":"2024-09-12T19:24:01.741501+0000","last_fullsized":"2024-09-12T19:24:01.741501+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:24:01.741310+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:24:01.741310+0000","last_clean_scrub_stamp":"2024-09-12T19:24:01.741310+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:13.379537+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:00.919479+0000","last_change":"2024-09-12T19:24:00.919479+0000","last_active":"2024-09-12T19:24:00.919479+0000","last_peered":"2024-09-12T19:24:00.919479+0000","last_clean":"2024-09-12T19:24:00.919479+0000","last_became_active":"2024-09-12T17:51:59.939751+0000","last_became_peered":"2024-09-12T17:51:59.939751+0000","last_unstale":"2024-09-12T19:24:00.919479+0000","last_undegraded":"2024-09-12T19:24:00.919479+0000","last_fullsized":"2024-09-12T19:24:00.919479+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T19:24:00.919277+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T19:24:00.919277+0000","last_clean_scrub_stamp":"2024-09-12T19:24:00.919277+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:55.233746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.227581+0000","last_change":"2024-09-12T19:23:39.227581+0000","last_active":"2024-09-12T19:23:39.227581+0000","last_peered":"2024-09-12T19:23:39.227581+0000","last_clean":"2024-09-12T19:23:39.227581+0000","last_became_active":"2024-09-12T17:51:52.897168+0000","last_became_peered":"2024-09-12T17:51:52.897168+0000","last_unstale":"2024-09-12T19:23:39.227581+0000","last_undegraded":"2024-09-12T19:23:39.227581+0000","last_fullsized":"2024-09-12T19:23:39.227581+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:39.227384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:39.227384+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.227384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:32.983284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'29","reported_seq":166,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:46.053233+0000","last_change":"2024-09-12T19:23:46.053233+0000","last_active":"2024-09-12T19:23:46.053233+0000","last_peered":"2024-09-12T19:23:46.053233+0000","last_clean":"2024-09-12T19:23:46.053233+0000","last_became_active":"2024-09-12T17:45:41.579765+0000","last_became_peered":"2024-09-12T17:45:41.579765+0000","last_unstale":"2024-09-12T19:23:46.053233+0000","last_undegraded":"2024-09-12T19:23:46.053233+0000","last_fullsized":"2024-09-12T19:23:46.053233+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-12T19:23:46.052945+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-12T19:23:46.052945+0000","last_clean_scrub_stamp":"2024-09-12T19:23:46.052945+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:31.279781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":115,"num_write":41,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:05.897209+0000","last_change":"2024-09-12T19:24:05.897209+0000","last_active":"2024-09-12T19:24:05.897209+0000","last_peered":"2024-09-12T19:24:05.897209+0000","last_clean":"2024-09-12T19:24:05.897209+0000","last_became_active":"2024-09-12T18:19:22.642415+0000","last_became_peered":"2024-09-12T18:19:22.642415+0000","last_unstale":"2024-09-12T19:24:05.897209+0000","last_undegraded":"2024-09-12T19:24:05.897209+0000","last_fullsized":"2024-09-12T19:24:05.897209+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:24:05.897008+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:24:05.897008+0000","last_clean_scrub_stamp":"2024-09-12T19:24:05.897008+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:41.494038+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.280529+0000","last_change":"2024-09-12T19:23:41.280529+0000","last_active":"2024-09-12T19:23:41.280529+0000","last_peered":"2024-09-12T19:23:41.280529+0000","last_clean":"2024-09-12T19:23:41.280529+0000","last_became_active":"2024-09-12T17:51:59.933679+0000","last_became_peered":"2024-09-12T17:51:59.933679+0000","last_unstale":"2024-09-12T19:23:41.280529+0000","last_undegraded":"2024-09-12T19:23:41.280529+0000","last_fullsized":"2024-09-12T19:23:41.280529+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:41.280350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:41.280350+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.280350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:06.704055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"267'3","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:47.296811+0000","last_change":"2024-09-12T19:23:47.296811+0000","last_active":"2024-09-12T19:23:47.296811+0000","last_peered":"2024-09-12T19:23:47.296811+0000","last_clean":"2024-09-12T19:23:47.296811+0000","last_became_active":"2024-09-12T17:51:52.891977+0000","last_became_peered":"2024-09-12T17:51:52.891977+0000","last_unstale":"2024-09-12T19:23:47.296811+0000","last_undegraded":"2024-09-12T19:23:47.296811+0000","last_fullsized":"2024-09-12T19:23:47.296811+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:47.296494+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:47.296494+0000","last_clean_scrub_stamp":"2024-09-12T19:23:47.296494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:52.443733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'38","reported_seq":184,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:54.947328+0000","last_change":"2024-09-12T19:23:54.947328+0000","last_active":"2024-09-12T19:23:54.947328+0000","last_peered":"2024-09-12T19:23:54.947328+0000","last_clean":"2024-09-12T19:23:54.947328+0000","last_became_active":"2024-09-12T17:45:41.579275+0000","last_became_peered":"2024-09-12T17:45:41.579275+0000","last_unstale":"2024-09-12T19:23:54.947328+0000","last_undegraded":"2024-09-12T19:23:54.947328+0000","last_fullsized":"2024-09-12T19:23:54.947328+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'38","last_scrub_stamp":"2024-09-12T19:23:54.947128+0000","last_deep_scrub":"267'38","last_deep_scrub_stamp":"2024-09-12T19:23:54.947128+0000","last_clean_scrub_stamp":"2024-09-12T19:23:54.947128+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:32.412515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":125,"num_write":71,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.942420+0000","last_change":"2024-09-12T19:23:30.942420+0000","last_active":"2024-09-12T19:23:30.942420+0000","last_peered":"2024-09-12T19:23:30.942420+0000","last_clean":"2024-09-12T19:23:30.942420+0000","last_became_active":"2024-09-12T18:19:22.656770+0000","last_became_peered":"2024-09-12T18:19:22.656770+0000","last_unstale":"2024-09-12T19:23:30.942420+0000","last_undegraded":"2024-09-12T19:23:30.942420+0000","last_fullsized":"2024-09-12T19:23:30.942420+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:30.942234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:30.942234+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.942234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:50.066937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"267'6","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:57.958536+0000","last_change":"2024-09-12T19:23:57.958536+0000","last_active":"2024-09-12T19:23:57.958536+0000","last_peered":"2024-09-12T19:23:57.958536+0000","last_clean":"2024-09-12T19:23:57.958536+0000","last_became_active":"2024-09-12T17:51:59.934972+0000","last_became_peered":"2024-09-12T17:51:59.934972+0000","last_unstale":"2024-09-12T19:23:57.958536+0000","last_undegraded":"2024-09-12T19:23:57.958536+0000","last_fullsized":"2024-09-12T19:23:57.958536+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T19:23:57.958340+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T19:23:57.958340+0000","last_clean_scrub_stamp":"2024-09-12T19:23:57.958340+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:20.528811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:54.987740+0000","last_change":"2024-09-12T19:23:54.987593+0000","last_active":"2024-09-12T19:23:54.987740+0000","last_peered":"2024-09-12T19:23:54.987740+0000","last_clean":"2024-09-12T19:23:54.987740+0000","last_became_active":"2024-09-12T17:51:52.900002+0000","last_became_peered":"2024-09-12T17:51:52.900002+0000","last_unstale":"2024-09-12T19:23:54.987740+0000","last_undegraded":"2024-09-12T19:23:54.987740+0000","last_fullsized":"2024-09-12T19:23:54.987740+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:54.987414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:54.987414+0000","last_clean_scrub_stamp":"2024-09-12T19:23:54.987414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:16.396829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'34","reported_seq":182,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:51.027740+0000","last_change":"2024-09-12T19:23:51.027740+0000","last_active":"2024-09-12T19:23:51.027740+0000","last_peered":"2024-09-12T19:23:51.027740+0000","last_clean":"2024-09-12T19:23:51.027740+0000","last_became_active":"2024-09-12T17:45:41.580617+0000","last_became_peered":"2024-09-12T17:45:41.580617+0000","last_unstale":"2024-09-12T19:23:51.027740+0000","last_undegraded":"2024-09-12T19:23:51.027740+0000","last_fullsized":"2024-09-12T19:23:51.027740+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-09-12T19:23:51.027516+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-09-12T19:23:51.027516+0000","last_clean_scrub_stamp":"2024-09-12T19:23:51.027516+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:12.642726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":129,"num_write":59,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:00.093429+0000","last_change":"2024-09-12T19:24:00.093429+0000","last_active":"2024-09-12T19:24:00.093429+0000","last_peered":"2024-09-12T19:24:00.093429+0000","last_clean":"2024-09-12T19:24:00.093429+0000","last_became_active":"2024-09-12T18:19:22.664960+0000","last_became_peered":"2024-09-12T18:19:22.664960+0000","last_unstale":"2024-09-12T19:24:00.093429+0000","last_undegraded":"2024-09-12T19:24:00.093429+0000","last_fullsized":"2024-09-12T19:24:00.093429+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:00.093225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:00.093225+0000","last_clean_scrub_stamp":"2024-09-12T19:24:00.093225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:19.993465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:22:03.285437+0000","last_change":"2024-09-12T17:51:59.949566+0000","last_active":"2024-09-12T19:22:03.285437+0000","last_peered":"2024-09-12T19:22:03.285437+0000","last_clean":"2024-09-12T19:22:03.285437+0000","last_became_active":"2024-09-12T17:51:59.948733+0000","last_became_peered":"2024-09-12T17:51:59.948733+0000","last_unstale":"2024-09-12T19:22:03.285437+0000","last_undegraded":"2024-09-12T19:22:03.285437+0000","last_fullsized":"2024-09-12T19:22:03.285437+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:51:58.890347+0000","last_clean_scrub_stamp":"2024-09-12T17:51:58.890347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:47.852395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'5","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.905098+0000","last_change":"2024-09-12T19:23:36.904948+0000","last_active":"2024-09-12T19:23:36.905098+0000","last_peered":"2024-09-12T19:23:36.905098+0000","last_clean":"2024-09-12T19:23:36.905098+0000","last_became_active":"2024-09-12T17:51:52.904092+0000","last_became_peered":"2024-09-12T17:51:52.904092+0000","last_unstale":"2024-09-12T19:23:36.905098+0000","last_undegraded":"2024-09-12T19:23:36.905098+0000","last_fullsized":"2024-09-12T19:23:36.905098+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T19:23:36.904778+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T19:23:36.904778+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.904778+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:23.628020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'87","reported_seq":319,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:46.336227+0000","last_change":"2024-09-12T19:23:46.336227+0000","last_active":"2024-09-12T19:23:46.336227+0000","last_peered":"2024-09-12T19:23:46.336227+0000","last_clean":"2024-09-12T19:23:46.336227+0000","last_became_active":"2024-09-12T17:45:41.574884+0000","last_became_peered":"2024-09-12T17:45:41.574884+0000","last_unstale":"2024-09-12T19:23:46.336227+0000","last_undegraded":"2024-09-12T19:23:46.336227+0000","last_fullsized":"2024-09-12T19:23:46.336227+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'87","last_scrub_stamp":"2024-09-12T19:23:46.336046+0000","last_deep_scrub":"267'87","last_deep_scrub_stamp":"2024-09-12T19:23:46.336046+0000","last_clean_scrub_stamp":"2024-09-12T19:23:46.336046+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:28.767258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":442,"num_read_kb":315,"num_write":154,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.334929+0000","last_change":"2024-09-12T19:23:44.334929+0000","last_active":"2024-09-12T19:23:44.334929+0000","last_peered":"2024-09-12T19:23:44.334929+0000","last_clean":"2024-09-12T19:23:44.334929+0000","last_became_active":"2024-09-12T18:19:22.632360+0000","last_became_peered":"2024-09-12T18:19:22.632360+0000","last_unstale":"2024-09-12T19:23:44.334929+0000","last_undegraded":"2024-09-12T19:23:44.334929+0000","last_fullsized":"2024-09-12T19:23:44.334929+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:44.334714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:44.334714+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.334714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:34.896398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'7","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.771492+0000","last_change":"2024-09-12T19:23:41.771492+0000","last_active":"2024-09-12T19:23:41.771492+0000","last_peered":"2024-09-12T19:23:41.771492+0000","last_clean":"2024-09-12T19:23:41.771492+0000","last_became_active":"2024-09-12T17:51:59.945099+0000","last_became_peered":"2024-09-12T17:51:59.945099+0000","last_unstale":"2024-09-12T19:23:41.771492+0000","last_undegraded":"2024-09-12T19:23:41.771492+0000","last_fullsized":"2024-09-12T19:23:41.771492+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T19:23:41.771302+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T19:23:41.771302+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.771302+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:59.577235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"267'3","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:54.700052+0000","last_change":"2024-09-12T19:23:54.699867+0000","last_active":"2024-09-12T19:23:54.700052+0000","last_peered":"2024-09-12T19:23:54.700052+0000","last_clean":"2024-09-12T19:23:54.700052+0000","last_became_active":"2024-09-12T17:51:52.889772+0000","last_became_peered":"2024-09-12T17:51:52.889772+0000","last_unstale":"2024-09-12T19:23:54.700052+0000","last_undegraded":"2024-09-12T19:23:54.700052+0000","last_fullsized":"2024-09-12T19:23:54.700052+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:54.699675+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:54.699675+0000","last_clean_scrub_stamp":"2024-09-12T19:23:54.699675+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:20.027038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'27","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.320694+0000","last_change":"2024-09-12T19:23:35.320694+0000","last_active":"2024-09-12T19:23:35.320694+0000","last_peered":"2024-09-12T19:23:35.320694+0000","last_clean":"2024-09-12T19:23:35.320694+0000","last_became_active":"2024-09-12T17:45:41.590861+0000","last_became_peered":"2024-09-12T17:45:41.590861+0000","last_unstale":"2024-09-12T19:23:35.320694+0000","last_undegraded":"2024-09-12T19:23:35.320694+0000","last_fullsized":"2024-09-12T19:23:35.320694+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'27","last_scrub_stamp":"2024-09-12T19:23:35.320419+0000","last_deep_scrub":"267'27","last_deep_scrub_stamp":"2024-09-12T19:23:35.320419+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.320419+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:07.312095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":90,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:58.064180+0000","last_change":"2024-09-12T19:23:58.064180+0000","last_active":"2024-09-12T19:23:58.064180+0000","last_peered":"2024-09-12T19:23:58.064180+0000","last_clean":"2024-09-12T19:23:58.064180+0000","last_became_active":"2024-09-12T18:19:22.655979+0000","last_became_peered":"2024-09-12T18:19:22.655979+0000","last_unstale":"2024-09-12T19:23:58.064180+0000","last_undegraded":"2024-09-12T19:23:58.064180+0000","last_fullsized":"2024-09-12T19:23:58.064180+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:58.063993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:58.063993+0000","last_clean_scrub_stamp":"2024-09-12T19:23:58.063993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:59.550885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'5","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:58.965140+0000","last_change":"2024-09-12T19:23:58.965140+0000","last_active":"2024-09-12T19:23:58.965140+0000","last_peered":"2024-09-12T19:23:58.965140+0000","last_clean":"2024-09-12T19:23:58.965140+0000","last_became_active":"2024-09-12T17:51:59.942431+0000","last_became_peered":"2024-09-12T17:51:59.942431+0000","last_unstale":"2024-09-12T19:23:58.965140+0000","last_undegraded":"2024-09-12T19:23:58.965140+0000","last_fullsized":"2024-09-12T19:23:58.965140+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T19:23:58.964946+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T19:23:58.964946+0000","last_clean_scrub_stamp":"2024-09-12T19:23:58.964946+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:41.794118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10320,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"267'3","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.648064+0000","last_change":"2024-09-12T19:23:38.648064+0000","last_active":"2024-09-12T19:23:38.648064+0000","last_peered":"2024-09-12T19:23:38.648064+0000","last_clean":"2024-09-12T19:23:38.648064+0000","last_became_active":"2024-09-12T17:51:52.900785+0000","last_became_peered":"2024-09-12T17:51:52.900785+0000","last_unstale":"2024-09-12T19:23:38.648064+0000","last_undegraded":"2024-09-12T19:23:38.648064+0000","last_fullsized":"2024-09-12T19:23:38.648064+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:38.647871+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:38.647871+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.647871+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:58:40.144934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'9","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.922578+0000","last_change":"2024-09-12T19:23:26.922578+0000","last_active":"2024-09-12T19:23:26.922578+0000","last_peered":"2024-09-12T19:23:26.922578+0000","last_clean":"2024-09-12T19:23:26.922578+0000","last_became_active":"2024-09-12T17:45:41.565793+0000","last_became_peered":"2024-09-12T17:45:41.565793+0000","last_unstale":"2024-09-12T19:23:26.922578+0000","last_undegraded":"2024-09-12T19:23:26.922578+0000","last_fullsized":"2024-09-12T19:23:26.922578+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'9","last_scrub_stamp":"2024-09-12T19:23:26.922376+0000","last_deep_scrub":"267'9","last_deep_scrub_stamp":"2024-09-12T19:23:26.922376+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.922376+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:57.354679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:02.968595+0000","last_change":"2024-09-12T19:24:02.968595+0000","last_active":"2024-09-12T19:24:02.968595+0000","last_peered":"2024-09-12T19:24:02.968595+0000","last_clean":"2024-09-12T19:24:02.968595+0000","last_became_active":"2024-09-12T18:19:22.663586+0000","last_became_peered":"2024-09-12T18:19:22.663586+0000","last_unstale":"2024-09-12T19:24:02.968595+0000","last_undegraded":"2024-09-12T19:24:02.968595+0000","last_fullsized":"2024-09-12T19:24:02.968595+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:02.968406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:02.968406+0000","last_clean_scrub_stamp":"2024-09-12T19:24:02.968406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:43.213049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:54.128867+0000","last_change":"2024-09-12T19:23:54.128867+0000","last_active":"2024-09-12T19:23:54.128867+0000","last_peered":"2024-09-12T19:23:54.128867+0000","last_clean":"2024-09-12T19:23:54.128867+0000","last_became_active":"2024-09-12T17:51:59.949437+0000","last_became_peered":"2024-09-12T17:51:59.949437+0000","last_unstale":"2024-09-12T19:23:54.128867+0000","last_undegraded":"2024-09-12T19:23:54.128867+0000","last_fullsized":"2024-09-12T19:23:54.128867+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:54.128666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:54.128666+0000","last_clean_scrub_stamp":"2024-09-12T19:23:54.128666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:12.016900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":88,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:53.689499+0000","last_change":"2024-09-12T19:23:53.689499+0000","last_active":"2024-09-12T19:23:53.689499+0000","last_peered":"2024-09-12T19:23:53.689499+0000","last_clean":"2024-09-12T19:23:53.689499+0000","last_became_active":"2024-09-12T17:51:52.898903+0000","last_became_peered":"2024-09-12T17:51:52.898903+0000","last_unstale":"2024-09-12T19:23:53.689499+0000","last_undegraded":"2024-09-12T19:23:53.689499+0000","last_fullsized":"2024-09-12T19:23:53.689499+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T19:23:53.689210+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T19:23:53.689210+0000","last_clean_scrub_stamp":"2024-09-12T19:23:53.689210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:24.019318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'42","reported_seq":202,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.727948+0000","last_change":"2024-09-12T19:23:45.727948+0000","last_active":"2024-09-12T19:23:45.727948+0000","last_peered":"2024-09-12T19:23:45.727948+0000","last_clean":"2024-09-12T19:23:45.727948+0000","last_became_active":"2024-09-12T17:45:41.576921+0000","last_became_peered":"2024-09-12T17:45:41.576921+0000","last_unstale":"2024-09-12T19:23:45.727948+0000","last_undegraded":"2024-09-12T19:23:45.727948+0000","last_fullsized":"2024-09-12T19:23:45.727948+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'42","last_scrub_stamp":"2024-09-12T19:23:45.727767+0000","last_deep_scrub":"267'42","last_deep_scrub_stamp":"2024-09-12T19:23:45.727767+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.727767+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:24.431823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":172,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:03.127745+0000","last_change":"2024-09-12T19:24:03.127745+0000","last_active":"2024-09-12T19:24:03.127745+0000","last_peered":"2024-09-12T19:24:03.127745+0000","last_clean":"2024-09-12T19:24:03.127745+0000","last_became_active":"2024-09-12T18:19:22.669476+0000","last_became_peered":"2024-09-12T18:19:22.669476+0000","last_unstale":"2024-09-12T19:24:03.127745+0000","last_undegraded":"2024-09-12T19:24:03.127745+0000","last_fullsized":"2024-09-12T19:24:03.127745+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:03.127561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:03.127561+0000","last_clean_scrub_stamp":"2024-09-12T19:24:03.127561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:03.503233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:55.997801+0000","last_change":"2024-09-12T19:23:55.997801+0000","last_active":"2024-09-12T19:23:55.997801+0000","last_peered":"2024-09-12T19:23:55.997801+0000","last_clean":"2024-09-12T19:23:55.997801+0000","last_became_active":"2024-09-12T17:51:59.938736+0000","last_became_peered":"2024-09-12T17:51:59.938736+0000","last_unstale":"2024-09-12T19:23:55.997801+0000","last_undegraded":"2024-09-12T19:23:55.997801+0000","last_fullsized":"2024-09-12T19:23:55.997801+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:55.997619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:55.997619+0000","last_clean_scrub_stamp":"2024-09-12T19:23:55.997619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:54.134465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'2","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.741744+0000","last_change":"2024-09-12T19:23:42.741744+0000","last_active":"2024-09-12T19:23:42.741744+0000","last_peered":"2024-09-12T19:23:42.741744+0000","last_clean":"2024-09-12T19:23:42.741744+0000","last_became_active":"2024-09-12T17:51:52.900972+0000","last_became_peered":"2024-09-12T17:51:52.900972+0000","last_unstale":"2024-09-12T19:23:42.741744+0000","last_undegraded":"2024-09-12T19:23:42.741744+0000","last_fullsized":"2024-09-12T19:23:42.741744+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:42.741557+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:42.741557+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.741557+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:30.376497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'26","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:46.107274+0000","last_change":"2024-09-12T19:23:46.107274+0000","last_active":"2024-09-12T19:23:46.107274+0000","last_peered":"2024-09-12T19:23:46.107274+0000","last_clean":"2024-09-12T19:23:46.107274+0000","last_became_active":"2024-09-12T17:45:41.588013+0000","last_became_peered":"2024-09-12T17:45:41.588013+0000","last_unstale":"2024-09-12T19:23:46.107274+0000","last_undegraded":"2024-09-12T19:23:46.107274+0000","last_fullsized":"2024-09-12T19:23:46.107274+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-09-12T19:23:46.107067+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-09-12T19:23:46.107067+0000","last_clean_scrub_stamp":"2024-09-12T19:23:46.107067+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:10.161274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":89,"num_write":52,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'2","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:02.138565+0000","last_change":"2024-09-12T19:24:02.138565+0000","last_active":"2024-09-12T19:24:02.138565+0000","last_peered":"2024-09-12T19:24:02.138565+0000","last_clean":"2024-09-12T19:24:02.138565+0000","last_became_active":"2024-09-12T18:19:22.662685+0000","last_became_peered":"2024-09-12T18:19:22.662685+0000","last_unstale":"2024-09-12T19:24:02.138565+0000","last_undegraded":"2024-09-12T19:24:02.138565+0000","last_fullsized":"2024-09-12T19:24:02.138565+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:24:02.138375+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:24:02.138375+0000","last_clean_scrub_stamp":"2024-09-12T19:24:02.138375+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:00.682802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'10","reported_seq":94,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.747751+0000","last_change":"2024-09-12T19:23:44.747751+0000","last_active":"2024-09-12T19:23:44.747751+0000","last_peered":"2024-09-12T19:23:44.747751+0000","last_clean":"2024-09-12T19:23:44.747751+0000","last_became_active":"2024-09-12T17:51:59.942597+0000","last_became_peered":"2024-09-12T17:51:59.942597+0000","last_unstale":"2024-09-12T19:23:44.747751+0000","last_undegraded":"2024-09-12T19:23:44.747751+0000","last_fullsized":"2024-09-12T19:23:44.747751+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'10","last_scrub_stamp":"2024-09-12T19:23:44.747561+0000","last_deep_scrub":"267'10","last_deep_scrub_stamp":"2024-09-12T19:23:44.747561+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.747561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:46.937016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":29698,"num_write":10,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"267'3","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:51.689991+0000","last_change":"2024-09-12T19:23:51.689991+0000","last_active":"2024-09-12T19:23:51.689991+0000","last_peered":"2024-09-12T19:23:51.689991+0000","last_clean":"2024-09-12T19:23:51.689991+0000","last_became_active":"2024-09-12T17:51:52.908200+0000","last_became_peered":"2024-09-12T17:51:52.908200+0000","last_unstale":"2024-09-12T19:23:51.689991+0000","last_undegraded":"2024-09-12T19:23:51.689991+0000","last_fullsized":"2024-09-12T19:23:51.689991+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:51.689767+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:51.689767+0000","last_clean_scrub_stamp":"2024-09-12T19:23:51.689767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:06.824645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'15","reported_seq":127,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:53.035436+0000","last_change":"2024-09-12T19:23:53.035436+0000","last_active":"2024-09-12T19:23:53.035436+0000","last_peered":"2024-09-12T19:23:53.035436+0000","last_clean":"2024-09-12T19:23:53.035436+0000","last_became_active":"2024-09-12T17:45:41.572067+0000","last_became_peered":"2024-09-12T17:45:41.572067+0000","last_unstale":"2024-09-12T19:23:53.035436+0000","last_undegraded":"2024-09-12T19:23:53.035436+0000","last_fullsized":"2024-09-12T19:23:53.035436+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'15","last_scrub_stamp":"2024-09-12T19:23:53.035204+0000","last_deep_scrub":"267'15","last_deep_scrub_stamp":"2024-09-12T19:23:53.035204+0000","last_clean_scrub_stamp":"2024-09-12T19:23:53.035204+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:17.920428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:05.684981+0000","last_change":"2024-09-12T19:24:05.684981+0000","last_active":"2024-09-12T19:24:05.684981+0000","last_peered":"2024-09-12T19:24:05.684981+0000","last_clean":"2024-09-12T19:24:05.684981+0000","last_became_active":"2024-09-12T18:19:22.648052+0000","last_became_peered":"2024-09-12T18:19:22.648052+0000","last_unstale":"2024-09-12T19:24:05.684981+0000","last_undegraded":"2024-09-12T19:24:05.684981+0000","last_fullsized":"2024-09-12T19:24:05.684981+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:05.684756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:05.684756+0000","last_clean_scrub_stamp":"2024-09-12T19:24:05.684756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:15.630683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"267'8","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:59.084781+0000","last_change":"2024-09-12T19:23:59.084781+0000","last_active":"2024-09-12T19:23:59.084781+0000","last_peered":"2024-09-12T19:23:59.084781+0000","last_clean":"2024-09-12T19:23:59.084781+0000","last_became_active":"2024-09-12T17:51:59.948873+0000","last_became_peered":"2024-09-12T17:51:59.948873+0000","last_unstale":"2024-09-12T19:23:59.084781+0000","last_undegraded":"2024-09-12T19:23:59.084781+0000","last_fullsized":"2024-09-12T19:23:59.084781+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T19:23:59.084600+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T19:23:59.084600+0000","last_clean_scrub_stamp":"2024-09-12T19:23:59.084600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:06.458593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'2","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:47.040286+0000","last_change":"2024-09-12T19:23:47.040142+0000","last_active":"2024-09-12T19:23:47.040286+0000","last_peered":"2024-09-12T19:23:47.040286+0000","last_clean":"2024-09-12T19:23:47.040286+0000","last_became_active":"2024-09-12T17:51:52.889529+0000","last_became_peered":"2024-09-12T17:51:52.889529+0000","last_unstale":"2024-09-12T19:23:47.040286+0000","last_undegraded":"2024-09-12T19:23:47.040286+0000","last_fullsized":"2024-09-12T19:23:47.040286+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:23:47.039949+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:23:47.039949+0000","last_clean_scrub_stamp":"2024-09-12T19:23:47.039949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:13.335803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'21","reported_seq":144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.354478+0000","last_change":"2024-09-12T19:23:34.354478+0000","last_active":"2024-09-12T19:23:34.354478+0000","last_peered":"2024-09-12T19:23:34.354478+0000","last_clean":"2024-09-12T19:23:34.354478+0000","last_became_active":"2024-09-12T17:45:41.579580+0000","last_became_peered":"2024-09-12T17:45:41.579580+0000","last_unstale":"2024-09-12T19:23:34.354478+0000","last_undegraded":"2024-09-12T19:23:34.354478+0000","last_fullsized":"2024-09-12T19:23:34.354478+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'21","last_scrub_stamp":"2024-09-12T19:23:34.354300+0000","last_deep_scrub":"267'21","last_deep_scrub_stamp":"2024-09-12T19:23:34.354300+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.354300+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:11.810963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":77,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:01.092544+0000","last_change":"2024-09-12T19:24:01.092544+0000","last_active":"2024-09-12T19:24:01.092544+0000","last_peered":"2024-09-12T19:24:01.092544+0000","last_clean":"2024-09-12T19:24:01.092544+0000","last_became_active":"2024-09-12T18:19:22.669240+0000","last_became_peered":"2024-09-12T18:19:22.669240+0000","last_unstale":"2024-09-12T19:24:01.092544+0000","last_undegraded":"2024-09-12T19:24:01.092544+0000","last_fullsized":"2024-09-12T19:24:01.092544+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:01.092296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:01.092296+0000","last_clean_scrub_stamp":"2024-09-12T19:24:01.092296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:18.579811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:03.691386+0000","last_change":"2024-09-12T19:24:03.691386+0000","last_active":"2024-09-12T19:24:03.691386+0000","last_peered":"2024-09-12T19:24:03.691386+0000","last_clean":"2024-09-12T19:24:03.691386+0000","last_became_active":"2024-09-12T17:51:59.969706+0000","last_became_peered":"2024-09-12T17:51:59.969706+0000","last_unstale":"2024-09-12T19:24:03.691386+0000","last_undegraded":"2024-09-12T19:24:03.691386+0000","last_fullsized":"2024-09-12T19:24:03.691386+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:24:03.691158+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:24:03.691158+0000","last_clean_scrub_stamp":"2024-09-12T19:24:03.691158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:16.498999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'6","reported_seq":93,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:51.029466+0000","last_change":"2024-09-12T19:23:51.029466+0000","last_active":"2024-09-12T19:23:51.029466+0000","last_peered":"2024-09-12T19:23:51.029466+0000","last_clean":"2024-09-12T19:23:51.029466+0000","last_became_active":"2024-09-12T17:51:52.884061+0000","last_became_peered":"2024-09-12T17:51:52.884061+0000","last_unstale":"2024-09-12T19:23:51.029466+0000","last_undegraded":"2024-09-12T19:23:51.029466+0000","last_fullsized":"2024-09-12T19:23:51.029466+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:23:51.029250+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:23:51.029250+0000","last_clean_scrub_stamp":"2024-09-12T19:23:51.029250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:03.083907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'29","reported_seq":168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:47.731710+0000","last_change":"2024-09-12T19:23:47.731710+0000","last_active":"2024-09-12T19:23:47.731710+0000","last_peered":"2024-09-12T19:23:47.731710+0000","last_clean":"2024-09-12T19:23:47.731710+0000","last_became_active":"2024-09-12T17:45:41.572130+0000","last_became_peered":"2024-09-12T17:45:41.572130+0000","last_unstale":"2024-09-12T19:23:47.731710+0000","last_undegraded":"2024-09-12T19:23:47.731710+0000","last_fullsized":"2024-09-12T19:23:47.731710+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-12T19:23:47.731427+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-12T19:23:47.731427+0000","last_clean_scrub_stamp":"2024-09-12T19:23:47.731427+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:51.880356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":63,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:52.338841+0000","last_change":"2024-09-12T19:23:52.338657+0000","last_active":"2024-09-12T19:23:52.338841+0000","last_peered":"2024-09-12T19:23:52.338841+0000","last_clean":"2024-09-12T19:23:52.338841+0000","last_became_active":"2024-09-12T18:19:22.666608+0000","last_became_peered":"2024-09-12T18:19:22.666608+0000","last_unstale":"2024-09-12T19:23:52.338841+0000","last_undegraded":"2024-09-12T19:23:52.338841+0000","last_fullsized":"2024-09-12T19:23:52.338841+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:52.338465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:52.338465+0000","last_clean_scrub_stamp":"2024-09-12T19:23:52.338465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:14.954663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'2","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:56.648841+0000","last_change":"2024-09-12T19:23:56.648841+0000","last_active":"2024-09-12T19:23:56.648841+0000","last_peered":"2024-09-12T19:23:56.648841+0000","last_clean":"2024-09-12T19:23:56.648841+0000","last_became_active":"2024-09-12T17:51:59.956010+0000","last_became_peered":"2024-09-12T17:51:59.956010+0000","last_unstale":"2024-09-12T19:23:56.648841+0000","last_undegraded":"2024-09-12T19:23:56.648841+0000","last_fullsized":"2024-09-12T19:23:56.648841+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:23:56.648640+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:23:56.648640+0000","last_clean_scrub_stamp":"2024-09-12T19:23:56.648640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:04.948132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'2","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.869054+0000","last_change":"2024-09-12T19:23:37.868902+0000","last_active":"2024-09-12T19:23:37.869054+0000","last_peered":"2024-09-12T19:23:37.869054+0000","last_clean":"2024-09-12T19:23:37.869054+0000","last_became_active":"2024-09-12T17:51:52.903355+0000","last_became_peered":"2024-09-12T17:51:52.903355+0000","last_unstale":"2024-09-12T19:23:37.869054+0000","last_undegraded":"2024-09-12T19:23:37.869054+0000","last_fullsized":"2024-09-12T19:23:37.869054+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:23:37.868720+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:23:37.868720+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.868720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:29.790506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'38","reported_seq":193,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.383832+0000","last_change":"2024-09-12T19:23:33.383832+0000","last_active":"2024-09-12T19:23:33.383832+0000","last_peered":"2024-09-12T19:23:33.383832+0000","last_clean":"2024-09-12T19:23:33.383832+0000","last_became_active":"2024-09-12T17:45:41.577322+0000","last_became_peered":"2024-09-12T17:45:41.577322+0000","last_unstale":"2024-09-12T19:23:33.383832+0000","last_undegraded":"2024-09-12T19:23:33.383832+0000","last_fullsized":"2024-09-12T19:23:33.383832+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'38","last_scrub_stamp":"2024-09-12T19:23:33.383649+0000","last_deep_scrub":"267'38","last_deep_scrub_stamp":"2024-09-12T19:23:33.383649+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.383649+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:12.349851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":139,"num_write":67,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.760559+0000","last_change":"2024-09-12T19:23:43.760559+0000","last_active":"2024-09-12T19:23:43.760559+0000","last_peered":"2024-09-12T19:23:43.760559+0000","last_clean":"2024-09-12T19:23:43.760559+0000","last_became_active":"2024-09-12T18:19:22.647003+0000","last_became_peered":"2024-09-12T18:19:22.647003+0000","last_unstale":"2024-09-12T19:23:43.760559+0000","last_undegraded":"2024-09-12T19:23:43.760559+0000","last_fullsized":"2024-09-12T19:23:43.760559+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:43.760345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:43.760345+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.760345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:43.242394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"267'3","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:54.000801+0000","last_change":"2024-09-12T19:23:54.000801+0000","last_active":"2024-09-12T19:23:54.000801+0000","last_peered":"2024-09-12T19:23:54.000801+0000","last_clean":"2024-09-12T19:23:54.000801+0000","last_became_active":"2024-09-12T17:51:59.939200+0000","last_became_peered":"2024-09-12T17:51:59.939200+0000","last_unstale":"2024-09-12T19:23:54.000801+0000","last_undegraded":"2024-09-12T19:23:54.000801+0000","last_fullsized":"2024-09-12T19:23:54.000801+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:54.000620+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:54.000620+0000","last_clean_scrub_stamp":"2024-09-12T19:23:54.000620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:34.220280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"267'6","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:48.324217+0000","last_change":"2024-09-12T19:23:48.324217+0000","last_active":"2024-09-12T19:23:48.324217+0000","last_peered":"2024-09-12T19:23:48.324217+0000","last_clean":"2024-09-12T19:23:48.324217+0000","last_became_active":"2024-09-12T17:51:52.896708+0000","last_became_peered":"2024-09-12T17:51:52.896708+0000","last_unstale":"2024-09-12T19:23:48.324217+0000","last_undegraded":"2024-09-12T19:23:48.324217+0000","last_fullsized":"2024-09-12T19:23:48.324217+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T19:23:48.324028+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T19:23:48.324028+0000","last_clean_scrub_stamp":"2024-09-12T19:23:48.324028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:29.992346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'29","reported_seq":168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.126563+0000","last_change":"2024-09-12T19:23:45.126393+0000","last_active":"2024-09-12T19:23:45.126563+0000","last_peered":"2024-09-12T19:23:45.126563+0000","last_clean":"2024-09-12T19:23:45.126563+0000","last_became_active":"2024-09-12T17:45:41.591866+0000","last_became_peered":"2024-09-12T17:45:41.591866+0000","last_unstale":"2024-09-12T19:23:45.126563+0000","last_undegraded":"2024-09-12T19:23:45.126563+0000","last_fullsized":"2024-09-12T19:23:45.126563+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-12T19:23:45.126211+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-12T19:23:45.126211+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.126211+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:17.439558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:56.094755+0000","last_change":"2024-09-12T19:23:56.094520+0000","last_active":"2024-09-12T19:23:56.094755+0000","last_peered":"2024-09-12T19:23:56.094755+0000","last_clean":"2024-09-12T19:23:56.094755+0000","last_became_active":"2024-09-12T18:19:22.660667+0000","last_became_peered":"2024-09-12T18:19:22.660667+0000","last_unstale":"2024-09-12T19:23:56.094755+0000","last_undegraded":"2024-09-12T19:23:56.094755+0000","last_fullsized":"2024-09-12T19:23:56.094755+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:56.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:56.094243+0000","last_clean_scrub_stamp":"2024-09-12T19:23:56.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:02.444570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:53.162224+0000","last_change":"2024-09-12T19:23:53.162224+0000","last_active":"2024-09-12T19:23:53.162224+0000","last_peered":"2024-09-12T19:23:53.162224+0000","last_clean":"2024-09-12T19:23:53.162224+0000","last_became_active":"2024-09-12T17:51:59.948786+0000","last_became_peered":"2024-09-12T17:51:59.948786+0000","last_unstale":"2024-09-12T19:23:53.162224+0000","last_undegraded":"2024-09-12T19:23:53.162224+0000","last_fullsized":"2024-09-12T19:23:53.162224+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:53.162038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:53.162038+0000","last_clean_scrub_stamp":"2024-09-12T19:23:53.162038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:15.606735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:52.007673+0000","last_change":"2024-09-12T19:23:52.007673+0000","last_active":"2024-09-12T19:23:52.007673+0000","last_peered":"2024-09-12T19:23:52.007673+0000","last_clean":"2024-09-12T19:23:52.007673+0000","last_became_active":"2024-09-12T17:51:52.895779+0000","last_became_peered":"2024-09-12T17:51:52.895779+0000","last_unstale":"2024-09-12T19:23:52.007673+0000","last_undegraded":"2024-09-12T19:23:52.007673+0000","last_fullsized":"2024-09-12T19:23:52.007673+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:52.007481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:52.007481+0000","last_clean_scrub_stamp":"2024-09-12T19:23:52.007481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:52.286786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'43","reported_seq":214,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.682157+0000","last_change":"2024-09-12T19:23:37.681979+0000","last_active":"2024-09-12T19:23:37.682157+0000","last_peered":"2024-09-12T19:23:37.682157+0000","last_clean":"2024-09-12T19:23:37.682157+0000","last_became_active":"2024-09-12T17:45:41.576707+0000","last_became_peered":"2024-09-12T17:45:41.576707+0000","last_unstale":"2024-09-12T19:23:37.682157+0000","last_undegraded":"2024-09-12T19:23:37.682157+0000","last_fullsized":"2024-09-12T19:23:37.682157+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'43","last_scrub_stamp":"2024-09-12T19:23:37.681798+0000","last_deep_scrub":"267'43","last_deep_scrub_stamp":"2024-09-12T19:23:37.681798+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.681798+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:07.348875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":167,"num_write":65,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'2","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.946038+0000","last_change":"2024-09-12T19:23:33.946038+0000","last_active":"2024-09-12T19:23:33.946038+0000","last_peered":"2024-09-12T19:23:33.946038+0000","last_clean":"2024-09-12T19:23:33.946038+0000","last_became_active":"2024-09-12T18:19:22.657891+0000","last_became_peered":"2024-09-12T18:19:22.657891+0000","last_unstale":"2024-09-12T19:23:33.946038+0000","last_undegraded":"2024-09-12T19:23:33.946038+0000","last_fullsized":"2024-09-12T19:23:33.946038+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:33.945861+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:33.945861+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.945861+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:53.760623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'3","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:48.727029+0000","last_change":"2024-09-12T19:23:48.727029+0000","last_active":"2024-09-12T19:23:48.727029+0000","last_peered":"2024-09-12T19:23:48.727029+0000","last_clean":"2024-09-12T19:23:48.727029+0000","last_became_active":"2024-09-12T17:51:59.962769+0000","last_became_peered":"2024-09-12T17:51:59.962769+0000","last_unstale":"2024-09-12T19:23:48.727029+0000","last_undegraded":"2024-09-12T19:23:48.727029+0000","last_fullsized":"2024-09-12T19:23:48.727029+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:23:48.726850+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:23:48.726850+0000","last_clean_scrub_stamp":"2024-09-12T19:23:48.726850+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:45.972951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'5","reported_seq":93,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:48.076280+0000","last_change":"2024-09-12T19:23:48.076280+0000","last_active":"2024-09-12T19:23:48.076280+0000","last_peered":"2024-09-12T19:23:48.076280+0000","last_clean":"2024-09-12T19:23:48.076280+0000","last_became_active":"2024-09-12T17:51:52.899987+0000","last_became_peered":"2024-09-12T17:51:52.899987+0000","last_unstale":"2024-09-12T19:23:48.076280+0000","last_undegraded":"2024-09-12T19:23:48.076280+0000","last_fullsized":"2024-09-12T19:23:48.076280+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T19:23:48.076083+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T19:23:48.076083+0000","last_clean_scrub_stamp":"2024-09-12T19:23:48.076083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:56.924020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'9","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.320833+0000","last_change":"2024-09-12T19:23:45.320833+0000","last_active":"2024-09-12T19:23:45.320833+0000","last_peered":"2024-09-12T19:23:45.320833+0000","last_clean":"2024-09-12T19:23:45.320833+0000","last_became_active":"2024-09-12T17:45:41.569871+0000","last_became_peered":"2024-09-12T17:45:41.569871+0000","last_unstale":"2024-09-12T19:23:45.320833+0000","last_undegraded":"2024-09-12T19:23:45.320833+0000","last_fullsized":"2024-09-12T19:23:45.320833+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'9","last_scrub_stamp":"2024-09-12T19:23:45.320654+0000","last_deep_scrub":"267'9","last_deep_scrub_stamp":"2024-09-12T19:23:45.320654+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.320654+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:45.364355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:04.732750+0000","last_change":"2024-09-12T19:24:04.732750+0000","last_active":"2024-09-12T19:24:04.732750+0000","last_peered":"2024-09-12T19:24:04.732750+0000","last_clean":"2024-09-12T19:24:04.732750+0000","last_became_active":"2024-09-12T18:19:22.648018+0000","last_became_peered":"2024-09-12T18:19:22.648018+0000","last_unstale":"2024-09-12T19:24:04.732750+0000","last_undegraded":"2024-09-12T19:24:04.732750+0000","last_fullsized":"2024-09-12T19:24:04.732750+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:04.732556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:04.732556+0000","last_clean_scrub_stamp":"2024-09-12T19:24:04.732556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:19.948021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'7","reported_seq":95,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:50.297973+0000","last_change":"2024-09-12T19:23:50.297973+0000","last_active":"2024-09-12T19:23:50.297973+0000","last_peered":"2024-09-12T19:23:50.297973+0000","last_clean":"2024-09-12T19:23:50.297973+0000","last_became_active":"2024-09-12T17:51:59.943764+0000","last_became_peered":"2024-09-12T17:51:59.943764+0000","last_unstale":"2024-09-12T19:23:50.297973+0000","last_undegraded":"2024-09-12T19:23:50.297973+0000","last_fullsized":"2024-09-12T19:23:50.297973+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T19:23:50.297769+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T19:23:50.297769+0000","last_clean_scrub_stamp":"2024-09-12T19:23:50.297769+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:50.481808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20800,"num_write":12,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:49.027509+0000","last_change":"2024-09-12T19:23:49.027509+0000","last_active":"2024-09-12T19:23:49.027509+0000","last_peered":"2024-09-12T19:23:49.027509+0000","last_clean":"2024-09-12T19:23:49.027509+0000","last_became_active":"2024-09-12T17:51:52.893764+0000","last_became_peered":"2024-09-12T17:51:52.893764+0000","last_unstale":"2024-09-12T19:23:49.027509+0000","last_undegraded":"2024-09-12T19:23:49.027509+0000","last_fullsized":"2024-09-12T19:23:49.027509+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:49.027310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:49.027310+0000","last_clean_scrub_stamp":"2024-09-12T19:23:49.027310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:39.413260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'85","reported_seq":322,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.009230+0000","last_change":"2024-09-12T19:23:44.009230+0000","last_active":"2024-09-12T19:23:44.009230+0000","last_peered":"2024-09-12T19:23:44.009230+0000","last_clean":"2024-09-12T19:23:44.009230+0000","last_became_active":"2024-09-12T17:45:41.576079+0000","last_became_peered":"2024-09-12T17:45:41.576079+0000","last_unstale":"2024-09-12T19:23:44.009230+0000","last_undegraded":"2024-09-12T19:23:44.009230+0000","last_fullsized":"2024-09-12T19:23:44.009230+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'85","last_scrub_stamp":"2024-09-12T19:23:44.009038+0000","last_deep_scrub":"267'85","last_deep_scrub_stamp":"2024-09-12T19:23:44.009038+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.009038+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:50.593899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":312,"num_write":160,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:59.722585+0000","last_change":"2024-09-12T19:23:59.722585+0000","last_active":"2024-09-12T19:23:59.722585+0000","last_peered":"2024-09-12T19:23:59.722585+0000","last_clean":"2024-09-12T19:23:59.722585+0000","last_became_active":"2024-09-12T18:19:22.662955+0000","last_became_peered":"2024-09-12T18:19:22.662955+0000","last_unstale":"2024-09-12T19:23:59.722585+0000","last_undegraded":"2024-09-12T19:23:59.722585+0000","last_fullsized":"2024-09-12T19:23:59.722585+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:59.722403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:59.722403+0000","last_clean_scrub_stamp":"2024-09-12T19:23:59.722403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:15.808500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.300955+0000","last_change":"2024-09-12T19:23:43.300831+0000","last_active":"2024-09-12T19:23:43.300955+0000","last_peered":"2024-09-12T19:23:43.300955+0000","last_clean":"2024-09-12T19:23:43.300955+0000","last_became_active":"2024-09-12T17:51:59.942275+0000","last_became_peered":"2024-09-12T17:51:59.942275+0000","last_unstale":"2024-09-12T19:23:43.300955+0000","last_undegraded":"2024-09-12T19:23:43.300955+0000","last_fullsized":"2024-09-12T19:23:43.300955+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:43.300653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:43.300653+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.300653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:31.246433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.725109+0000","last_change":"2024-09-12T19:23:40.725109+0000","last_active":"2024-09-12T19:23:40.725109+0000","last_peered":"2024-09-12T19:23:40.725109+0000","last_clean":"2024-09-12T19:23:40.725109+0000","last_became_active":"2024-09-12T17:51:52.895913+0000","last_became_peered":"2024-09-12T17:51:52.895913+0000","last_unstale":"2024-09-12T19:23:40.725109+0000","last_undegraded":"2024-09-12T19:23:40.725109+0000","last_fullsized":"2024-09-12T19:23:40.725109+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:40.724930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:40.724930+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.724930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:34.829056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'8","reported_seq":111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.342466+0000","last_change":"2024-09-12T19:23:36.342301+0000","last_active":"2024-09-12T19:23:36.342466+0000","last_peered":"2024-09-12T19:23:36.342466+0000","last_clean":"2024-09-12T19:23:36.342466+0000","last_became_active":"2024-09-12T17:45:41.576841+0000","last_became_peered":"2024-09-12T17:45:41.576841+0000","last_unstale":"2024-09-12T19:23:36.342466+0000","last_undegraded":"2024-09-12T19:23:36.342466+0000","last_fullsized":"2024-09-12T19:23:36.342466+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T19:23:36.342110+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T19:23:36.342110+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.342110+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:35.442446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:57.034536+0000","last_change":"2024-09-12T19:23:57.034536+0000","last_active":"2024-09-12T19:23:57.034536+0000","last_peered":"2024-09-12T19:23:57.034536+0000","last_clean":"2024-09-12T19:23:57.034536+0000","last_became_active":"2024-09-12T18:19:22.662633+0000","last_became_peered":"2024-09-12T18:19:22.662633+0000","last_unstale":"2024-09-12T19:23:57.034536+0000","last_undegraded":"2024-09-12T19:23:57.034536+0000","last_fullsized":"2024-09-12T19:23:57.034536+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:57.034350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:57.034350+0000","last_clean_scrub_stamp":"2024-09-12T19:23:57.034350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:38.160429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:52.117037+0000","last_change":"2024-09-12T19:23:52.117037+0000","last_active":"2024-09-12T19:23:52.117037+0000","last_peered":"2024-09-12T19:23:52.117037+0000","last_clean":"2024-09-12T19:23:52.117037+0000","last_became_active":"2024-09-12T17:51:59.929108+0000","last_became_peered":"2024-09-12T17:51:59.929108+0000","last_unstale":"2024-09-12T19:23:52.117037+0000","last_undegraded":"2024-09-12T19:23:52.117037+0000","last_fullsized":"2024-09-12T19:23:52.117037+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:52.116850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:52.116850+0000","last_clean_scrub_stamp":"2024-09-12T19:23:52.116850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:04.533236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"267'2","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.264589+0000","last_change":"2024-09-12T19:23:38.264589+0000","last_active":"2024-09-12T19:23:38.264589+0000","last_peered":"2024-09-12T19:23:38.264589+0000","last_clean":"2024-09-12T19:23:38.264589+0000","last_became_active":"2024-09-12T17:51:52.876809+0000","last_became_peered":"2024-09-12T17:51:52.876809+0000","last_unstale":"2024-09-12T19:23:38.264589+0000","last_undegraded":"2024-09-12T19:23:38.264589+0000","last_fullsized":"2024-09-12T19:23:38.264589+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:38.264407+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:38.264407+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.264407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:47.457682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":5,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'24","reported_seq":155,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.137543+0000","last_change":"2024-09-12T19:23:44.137407+0000","last_active":"2024-09-12T19:23:44.137543+0000","last_peered":"2024-09-12T19:23:44.137543+0000","last_clean":"2024-09-12T19:23:44.137543+0000","last_became_active":"2024-09-12T17:45:41.587464+0000","last_became_peered":"2024-09-12T17:45:41.587464+0000","last_unstale":"2024-09-12T19:23:44.137543+0000","last_undegraded":"2024-09-12T19:23:44.137543+0000","last_fullsized":"2024-09-12T19:23:44.137543+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'24","last_scrub_stamp":"2024-09-12T19:23:44.137217+0000","last_deep_scrub":"267'24","last_deep_scrub_stamp":"2024-09-12T19:23:44.137217+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.137217+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:46.257126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":80,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'298","reported_seq":957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.108249+0000","last_change":"2024-09-12T19:23:21.108249+0000","last_active":"2024-09-12T19:23:21.108249+0000","last_peered":"2024-09-12T19:23:21.108249+0000","last_clean":"2024-09-12T19:23:21.108249+0000","last_became_active":"2024-09-12T17:29:52.754920+0000","last_became_peered":"2024-09-12T17:29:52.754920+0000","last_unstale":"2024-09-12T19:23:21.108249+0000","last_undegraded":"2024-09-12T19:23:21.108249+0000","last_fullsized":"2024-09-12T19:23:21.108249+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'298","last_scrub_stamp":"2024-09-12T19:23:21.108016+0000","last_deep_scrub":"267'298","last_deep_scrub_stamp":"2024-09-12T19:23:21.108016+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.108016+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:55.221859+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262253,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":663,"num_write":1055,"num_write_kb":22160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'507","reported_seq":2214,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.392030+0000","last_change":"2024-09-12T19:23:26.392030+0000","last_active":"2024-09-12T19:23:26.392030+0000","last_peered":"2024-09-12T19:23:26.392030+0000","last_clean":"2024-09-12T19:23:26.392030+0000","last_became_active":"2024-09-12T17:29:54.760892+0000","last_became_peered":"2024-09-12T17:29:54.760892+0000","last_unstale":"2024-09-12T19:23:26.392030+0000","last_undegraded":"2024-09-12T19:23:26.392030+0000","last_fullsized":"2024-09-12T19:23:26.392030+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'507","last_scrub_stamp":"2024-09-12T19:23:26.391829+0000","last_deep_scrub":"267'507","last_deep_scrub_stamp":"2024-09-12T19:23:26.391829+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.391829+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:48.210092+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2904,"num_read_kb":2740,"num_write":620,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'340","reported_seq":1036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.713604+0000","last_change":"2024-09-12T19:23:17.713604+0000","last_active":"2024-09-12T19:23:17.713604+0000","last_peered":"2024-09-12T19:23:17.713604+0000","last_clean":"2024-09-12T19:23:17.713604+0000","last_became_active":"2024-09-12T17:29:52.747481+0000","last_became_peered":"2024-09-12T17:29:52.747481+0000","last_unstale":"2024-09-12T19:23:17.713604+0000","last_undegraded":"2024-09-12T19:23:17.713604+0000","last_fullsized":"2024-09-12T19:23:17.713604+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'340","last_scrub_stamp":"2024-09-12T19:23:17.713262+0000","last_deep_scrub":"267'340","last_deep_scrub_stamp":"2024-09-12T19:23:17.713262+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.713262+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:02.653602+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306162,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":522,"num_read_kb":19278,"num_write":1123,"num_write_kb":29260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'431","reported_seq":1902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.096403+0000","last_change":"2024-09-12T19:23:30.096403+0000","last_active":"2024-09-12T19:23:30.096403+0000","last_peered":"2024-09-12T19:23:30.096403+0000","last_clean":"2024-09-12T19:23:30.096403+0000","last_became_active":"2024-09-12T17:29:54.753272+0000","last_became_peered":"2024-09-12T17:29:54.753272+0000","last_unstale":"2024-09-12T19:23:30.096403+0000","last_undegraded":"2024-09-12T19:23:30.096403+0000","last_fullsized":"2024-09-12T19:23:30.096403+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'431","last_scrub_stamp":"2024-09-12T19:23:30.096150+0000","last_deep_scrub":"267'431","last_deep_scrub_stamp":"2024-09-12T19:23:30.096150+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.096150+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:52.937689+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2129,"num_read_kb":2000,"num_write":496,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'342","reported_seq":1041,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:08.906121+0000","last_change":"2024-09-12T19:23:08.906121+0000","last_active":"2024-09-12T19:23:08.906121+0000","last_peered":"2024-09-12T19:23:08.906121+0000","last_clean":"2024-09-12T19:23:08.906121+0000","last_became_active":"2024-09-12T17:29:52.735978+0000","last_became_peered":"2024-09-12T17:29:52.735978+0000","last_unstale":"2024-09-12T19:23:08.906121+0000","last_undegraded":"2024-09-12T19:23:08.906121+0000","last_fullsized":"2024-09-12T19:23:08.906121+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'342","last_scrub_stamp":"2024-09-12T19:23:08.905981+0000","last_deep_scrub":"267'342","last_deep_scrub_stamp":"2024-09-12T19:23:08.905981+0000","last_clean_scrub_stamp":"2024-09-12T19:23:08.905981+0000","objects_scrubbed":10,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:12.305189+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2553570,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":504,"num_read_kb":35253,"num_write":1107,"num_write_kb":35855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'940","reported_seq":2615,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.215432+0000","last_change":"2024-09-12T19:23:27.215432+0000","last_active":"2024-09-12T19:23:27.215432+0000","last_peered":"2024-09-12T19:23:27.215432+0000","last_clean":"2024-09-12T19:23:27.215432+0000","last_became_active":"2024-09-12T17:29:54.770286+0000","last_became_peered":"2024-09-12T17:29:54.770286+0000","last_unstale":"2024-09-12T19:23:27.215432+0000","last_undegraded":"2024-09-12T19:23:27.215432+0000","last_fullsized":"2024-09-12T19:23:27.215432+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'940","last_scrub_stamp":"2024-09-12T19:23:27.215139+0000","last_deep_scrub":"267'940","last_deep_scrub_stamp":"2024-09-12T19:23:27.215139+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.215139+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":900,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:57.585678+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4498,"num_read_kb":4029,"num_write":1285,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2544,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'344","reported_seq":1095,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.682756+0000","last_change":"2024-09-12T19:23:15.682756+0000","last_active":"2024-09-12T19:23:15.682756+0000","last_peered":"2024-09-12T19:23:15.682756+0000","last_clean":"2024-09-12T19:23:15.682756+0000","last_became_active":"2024-09-12T17:30:21.689546+0000","last_became_peered":"2024-09-12T17:30:21.689546+0000","last_unstale":"2024-09-12T19:23:15.682756+0000","last_undegraded":"2024-09-12T19:23:15.682756+0000","last_fullsized":"2024-09-12T19:23:15.682756+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'344","last_scrub_stamp":"2024-09-12T19:23:15.682534+0000","last_deep_scrub":"267'344","last_deep_scrub_stamp":"2024-09-12T19:23:15.682534+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.682534+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:01.240340+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170253,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":648,"num_read_kb":124307,"num_write":1100,"num_write_kb":33866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7,2],"acting":[1,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"267'841","reported_seq":2488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.786065+0000","last_change":"2024-09-12T19:23:27.786065+0000","last_active":"2024-09-12T19:23:27.786065+0000","last_peered":"2024-09-12T19:23:27.786065+0000","last_clean":"2024-09-12T19:23:27.786065+0000","last_became_active":"2024-09-12T17:29:54.760180+0000","last_became_peered":"2024-09-12T17:29:54.760180+0000","last_unstale":"2024-09-12T19:23:27.786065+0000","last_undegraded":"2024-09-12T19:23:27.786065+0000","last_fullsized":"2024-09-12T19:23:27.786065+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'841","last_scrub_stamp":"2024-09-12T19:23:27.785877+0000","last_deep_scrub":"267'841","last_deep_scrub_stamp":"2024-09-12T19:23:27.785877+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.785877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:05.230667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3987,"num_read_kb":3603,"num_write":1097,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'364","reported_seq":1016,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.084038+0000","last_change":"2024-09-12T19:23:22.084038+0000","last_active":"2024-09-12T19:23:22.084038+0000","last_peered":"2024-09-12T19:23:22.084038+0000","last_clean":"2024-09-12T19:23:22.084038+0000","last_became_active":"2024-09-12T17:29:52.744115+0000","last_became_peered":"2024-09-12T17:29:52.744115+0000","last_unstale":"2024-09-12T19:23:22.084038+0000","last_undegraded":"2024-09-12T19:23:22.084038+0000","last_fullsized":"2024-09-12T19:23:22.084038+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'364","last_scrub_stamp":"2024-09-12T19:23:22.083674+0000","last_deep_scrub":"267'364","last_deep_scrub_stamp":"2024-09-12T19:23:22.083674+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.083674+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:33.271484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262269,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":11709,"num_write":1093,"num_write_kb":63153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'872","reported_seq":2513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.240607+0000","last_change":"2024-09-12T19:23:20.240607+0000","last_active":"2024-09-12T19:23:20.240607+0000","last_peered":"2024-09-12T19:23:20.240607+0000","last_clean":"2024-09-12T19:23:20.240607+0000","last_became_active":"2024-09-12T17:29:54.758552+0000","last_became_peered":"2024-09-12T17:29:54.758552+0000","last_unstale":"2024-09-12T19:23:20.240607+0000","last_undegraded":"2024-09-12T19:23:20.240607+0000","last_fullsized":"2024-09-12T19:23:20.240607+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'872","last_scrub_stamp":"2024-09-12T19:23:20.240387+0000","last_deep_scrub":"267'872","last_deep_scrub_stamp":"2024-09-12T19:23:20.240387+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.240387+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:09.305077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4049,"num_read_kb":3640,"num_write":1140,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'353","reported_seq":1025,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.337794+0000","last_change":"2024-09-12T19:23:20.337794+0000","last_active":"2024-09-12T19:23:20.337794+0000","last_peered":"2024-09-12T19:23:20.337794+0000","last_clean":"2024-09-12T19:23:20.337794+0000","last_became_active":"2024-09-12T17:29:52.756242+0000","last_became_peered":"2024-09-12T17:29:52.756242+0000","last_unstale":"2024-09-12T19:23:20.337794+0000","last_undegraded":"2024-09-12T19:23:20.337794+0000","last_fullsized":"2024-09-12T19:23:20.337794+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'353","last_scrub_stamp":"2024-09-12T19:23:20.337459+0000","last_deep_scrub":"267'353","last_deep_scrub_stamp":"2024-09-12T19:23:20.337459+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.337459+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:26.759309+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311546,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":527,"num_read_kb":10971,"num_write":1015,"num_write_kb":29590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'392","reported_seq":1990,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.168012+0000","last_change":"2024-09-12T19:23:28.168012+0000","last_active":"2024-09-12T19:23:28.168012+0000","last_peered":"2024-09-12T19:23:28.168012+0000","last_clean":"2024-09-12T19:23:28.168012+0000","last_became_active":"2024-09-12T17:29:54.770050+0000","last_became_peered":"2024-09-12T17:29:54.770050+0000","last_unstale":"2024-09-12T19:23:28.168012+0000","last_undegraded":"2024-09-12T19:23:28.168012+0000","last_fullsized":"2024-09-12T19:23:28.168012+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'392","last_scrub_stamp":"2024-09-12T19:23:28.167823+0000","last_deep_scrub":"267'392","last_deep_scrub_stamp":"2024-09-12T19:23:28.167823+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.167823+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:05:18.931144+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2225,"num_read_kb":2129,"num_write":425,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":667,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'366","reported_seq":1027,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.068967+0000","last_change":"2024-09-12T19:23:20.068967+0000","last_active":"2024-09-12T19:23:20.068967+0000","last_peered":"2024-09-12T19:23:20.068967+0000","last_clean":"2024-09-12T19:23:20.068967+0000","last_became_active":"2024-09-12T17:29:52.762473+0000","last_became_peered":"2024-09-12T17:29:52.762473+0000","last_unstale":"2024-09-12T19:23:20.068967+0000","last_undegraded":"2024-09-12T19:23:20.068967+0000","last_fullsized":"2024-09-12T19:23:20.068967+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'366","last_scrub_stamp":"2024-09-12T19:23:20.068679+0000","last_deep_scrub":"267'366","last_deep_scrub_stamp":"2024-09-12T19:23:20.068679+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.068679+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:19.139220+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25719,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":480,"num_read_kb":16012,"num_write":1030,"num_write_kb":47372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'481","reported_seq":2022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.360178+0000","last_change":"2024-09-12T19:23:27.360178+0000","last_active":"2024-09-12T19:23:27.360178+0000","last_peered":"2024-09-12T19:23:27.360178+0000","last_clean":"2024-09-12T19:23:27.360178+0000","last_became_active":"2024-09-12T17:29:54.745833+0000","last_became_peered":"2024-09-12T17:29:54.745833+0000","last_unstale":"2024-09-12T19:23:27.360178+0000","last_undegraded":"2024-09-12T19:23:27.360178+0000","last_fullsized":"2024-09-12T19:23:27.360178+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'481","last_scrub_stamp":"2024-09-12T19:23:27.359982+0000","last_deep_scrub":"267'481","last_deep_scrub_stamp":"2024-09-12T19:23:27.359982+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.359982+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:27.719917+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2543,"num_read_kb":2369,"num_write":601,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'339","reported_seq":1125,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.105983+0000","last_change":"2024-09-12T19:23:19.105983+0000","last_active":"2024-09-12T19:23:19.105983+0000","last_peered":"2024-09-12T19:23:19.105983+0000","last_clean":"2024-09-12T19:23:19.105983+0000","last_became_active":"2024-09-12T17:29:52.730010+0000","last_became_peered":"2024-09-12T17:29:52.730010+0000","last_unstale":"2024-09-12T19:23:19.105983+0000","last_undegraded":"2024-09-12T19:23:19.105983+0000","last_fullsized":"2024-09-12T19:23:19.105983+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'339","last_scrub_stamp":"2024-09-12T19:23:19.105777+0000","last_deep_scrub":"267'339","last_deep_scrub_stamp":"2024-09-12T19:23:19.105777+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.105777+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:17.217745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580168,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":14958,"num_write":1088,"num_write_kb":34324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'424","reported_seq":2031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.913338+0000","last_change":"2024-09-12T19:23:16.913338+0000","last_active":"2024-09-12T19:23:16.913338+0000","last_peered":"2024-09-12T19:23:16.913338+0000","last_clean":"2024-09-12T19:23:16.913338+0000","last_became_active":"2024-09-12T17:29:54.755721+0000","last_became_peered":"2024-09-12T17:29:54.755721+0000","last_unstale":"2024-09-12T19:23:16.913338+0000","last_undegraded":"2024-09-12T19:23:16.913338+0000","last_fullsized":"2024-09-12T19:23:16.913338+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'424","last_scrub_stamp":"2024-09-12T19:23:16.913164+0000","last_deep_scrub":"267'424","last_deep_scrub_stamp":"2024-09-12T19:23:16.913164+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.913164+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:30.429196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2342,"num_read_kb":2221,"num_write":470,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1531,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'362","reported_seq":1940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.211026+0000","last_change":"2024-09-12T19:23:25.211026+0000","last_active":"2024-09-12T19:23:25.211026+0000","last_peered":"2024-09-12T19:23:25.211026+0000","last_clean":"2024-09-12T19:23:25.211026+0000","last_became_active":"2024-09-12T17:29:54.753012+0000","last_became_peered":"2024-09-12T17:29:54.753012+0000","last_unstale":"2024-09-12T19:23:25.211026+0000","last_undegraded":"2024-09-12T19:23:25.211026+0000","last_fullsized":"2024-09-12T19:23:25.211026+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-09-12T19:23:25.210742+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-09-12T19:23:25.210742+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.210742+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:09.088143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2149,"num_read_kb":2071,"num_write":395,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'362","reported_seq":1055,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.094171+0000","last_change":"2024-09-12T19:23:19.093896+0000","last_active":"2024-09-12T19:23:19.094171+0000","last_peered":"2024-09-12T19:23:19.094171+0000","last_clean":"2024-09-12T19:23:19.094171+0000","last_became_active":"2024-09-12T17:29:52.747589+0000","last_became_peered":"2024-09-12T17:29:52.747589+0000","last_unstale":"2024-09-12T19:23:19.094171+0000","last_undegraded":"2024-09-12T19:23:19.094171+0000","last_fullsized":"2024-09-12T19:23:19.094171+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-09-12T19:23:19.093553+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-09-12T19:23:19.093553+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.093553+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:37.013602+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":507,"num_read_kb":50487,"num_write":1096,"num_write_kb":29653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'428","reported_seq":2001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.061297+0000","last_change":"2024-09-12T19:23:25.061297+0000","last_active":"2024-09-12T19:23:25.061297+0000","last_peered":"2024-09-12T19:23:25.061297+0000","last_clean":"2024-09-12T19:23:25.061297+0000","last_became_active":"2024-09-12T17:29:54.752373+0000","last_became_peered":"2024-09-12T17:29:54.752373+0000","last_unstale":"2024-09-12T19:23:25.061297+0000","last_undegraded":"2024-09-12T19:23:25.061297+0000","last_fullsized":"2024-09-12T19:23:25.061297+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'428","last_scrub_stamp":"2024-09-12T19:23:25.061115+0000","last_deep_scrub":"267'428","last_deep_scrub_stamp":"2024-09-12T19:23:25.061115+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.061115+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:07.521489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2327,"num_read_kb":2222,"num_write":465,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'338","reported_seq":1117,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.130886+0000","last_change":"2024-09-12T19:23:18.130740+0000","last_active":"2024-09-12T19:23:18.130886+0000","last_peered":"2024-09-12T19:23:18.130886+0000","last_clean":"2024-09-12T19:23:18.130886+0000","last_became_active":"2024-09-12T17:30:22.255773+0000","last_became_peered":"2024-09-12T17:30:22.255773+0000","last_unstale":"2024-09-12T19:23:18.130886+0000","last_undegraded":"2024-09-12T19:23:18.130886+0000","last_fullsized":"2024-09-12T19:23:18.130886+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'338","last_scrub_stamp":"2024-09-12T19:23:18.130470+0000","last_deep_scrub":"267'338","last_deep_scrub_stamp":"2024-09-12T19:23:18.130470+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.130470+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:35.478105+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364459,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":843,"num_read_kb":51980,"num_write":1145,"num_write_kb":60983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2,1],"acting":[3,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.32","version":"267'529","reported_seq":2190,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.368130+0000","last_change":"2024-09-12T19:23:24.368130+0000","last_active":"2024-09-12T19:23:24.368130+0000","last_peered":"2024-09-12T19:23:24.368130+0000","last_clean":"2024-09-12T19:23:24.368130+0000","last_became_active":"2024-09-12T17:29:54.771786+0000","last_became_peered":"2024-09-12T17:29:54.771786+0000","last_unstale":"2024-09-12T19:23:24.368130+0000","last_undegraded":"2024-09-12T19:23:24.368130+0000","last_fullsized":"2024-09-12T19:23:24.368130+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'529","last_scrub_stamp":"2024-09-12T19:23:24.367953+0000","last_deep_scrub":"267'529","last_deep_scrub_stamp":"2024-09-12T19:23:24.367953+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.367953+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:57:53.562274+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2657,"num_read_kb":2482,"num_write":638,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'438","reported_seq":1252,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.224353+0000","last_change":"2024-09-12T19:23:14.224171+0000","last_active":"2024-09-12T19:23:14.224353+0000","last_peered":"2024-09-12T19:23:14.224353+0000","last_clean":"2024-09-12T19:23:14.224353+0000","last_became_active":"2024-09-12T17:29:52.725473+0000","last_became_peered":"2024-09-12T17:29:52.725473+0000","last_unstale":"2024-09-12T19:23:14.224353+0000","last_undegraded":"2024-09-12T19:23:14.224353+0000","last_fullsized":"2024-09-12T19:23:14.224353+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'438","last_scrub_stamp":"2024-09-12T19:23:14.223910+0000","last_deep_scrub":"267'438","last_deep_scrub_stamp":"2024-09-12T19:23:14.223910+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.223910+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:40.091598+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3634873,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":934,"num_read_kb":41903,"num_write":1412,"num_write_kb":44280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'658","reported_seq":2291,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.984732+0000","last_change":"2024-09-12T19:23:13.984600+0000","last_active":"2024-09-12T19:23:13.984732+0000","last_peered":"2024-09-12T19:23:13.984732+0000","last_clean":"2024-09-12T19:23:13.984732+0000","last_became_active":"2024-09-12T17:29:54.754119+0000","last_became_peered":"2024-09-12T17:29:54.754119+0000","last_unstale":"2024-09-12T19:23:13.984732+0000","last_undegraded":"2024-09-12T19:23:13.984732+0000","last_fullsized":"2024-09-12T19:23:13.984732+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'658","last_scrub_stamp":"2024-09-12T19:23:13.984417+0000","last_deep_scrub":"267'658","last_deep_scrub_stamp":"2024-09-12T19:23:13.984417+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.984417+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":600,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:49.226444+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3376,"num_read_kb":3085,"num_write":861,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3276,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'319","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.237886+0000","last_change":"2024-09-12T19:23:12.237745+0000","last_active":"2024-09-12T19:23:12.237886+0000","last_peered":"2024-09-12T19:23:12.237886+0000","last_clean":"2024-09-12T19:23:12.237886+0000","last_became_active":"2024-09-12T17:29:52.764052+0000","last_became_peered":"2024-09-12T17:29:52.764052+0000","last_unstale":"2024-09-12T19:23:12.237886+0000","last_undegraded":"2024-09-12T19:23:12.237886+0000","last_fullsized":"2024-09-12T19:23:12.237886+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'319","last_scrub_stamp":"2024-09-12T19:23:12.237529+0000","last_deep_scrub":"267'319","last_deep_scrub_stamp":"2024-09-12T19:23:12.237529+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.237529+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:41.845980+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":477,"num_read_kb":61037,"num_write":999,"num_write_kb":13603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'894","reported_seq":2465,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.024053+0000","last_change":"2024-09-12T19:23:22.023908+0000","last_active":"2024-09-12T19:23:22.024053+0000","last_peered":"2024-09-12T19:23:22.024053+0000","last_clean":"2024-09-12T19:23:22.024053+0000","last_became_active":"2024-09-12T17:29:54.760746+0000","last_became_peered":"2024-09-12T17:29:54.760746+0000","last_unstale":"2024-09-12T19:23:22.024053+0000","last_undegraded":"2024-09-12T19:23:22.024053+0000","last_fullsized":"2024-09-12T19:23:22.024053+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'894","last_scrub_stamp":"2024-09-12T19:23:22.023716+0000","last_deep_scrub":"267'894","last_deep_scrub_stamp":"2024-09-12T19:23:22.023716+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.023716+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":800,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:10.198893+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4106,"num_read_kb":3659,"num_write":1202,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'393","reported_seq":1091,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.121327+0000","last_change":"2024-09-12T19:23:17.121182+0000","last_active":"2024-09-12T19:23:17.121327+0000","last_peered":"2024-09-12T19:23:17.121327+0000","last_clean":"2024-09-12T19:23:17.121327+0000","last_became_active":"2024-09-12T17:29:52.720974+0000","last_became_peered":"2024-09-12T17:29:52.720974+0000","last_unstale":"2024-09-12T19:23:17.121327+0000","last_undegraded":"2024-09-12T19:23:17.121327+0000","last_fullsized":"2024-09-12T19:23:17.121327+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'393","last_scrub_stamp":"2024-09-12T19:23:17.120877+0000","last_deep_scrub":"267'393","last_deep_scrub_stamp":"2024-09-12T19:23:17.120877+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.120877+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:23.312770+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730141,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":597,"num_read_kb":19633,"num_write":1232,"num_write_kb":34097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'745","reported_seq":2343,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.258153+0000","last_change":"2024-09-12T19:23:26.257990+0000","last_active":"2024-09-12T19:23:26.258153+0000","last_peered":"2024-09-12T19:23:26.258153+0000","last_clean":"2024-09-12T19:23:26.258153+0000","last_became_active":"2024-09-12T17:29:54.756675+0000","last_became_peered":"2024-09-12T17:29:54.756675+0000","last_unstale":"2024-09-12T19:23:26.258153+0000","last_undegraded":"2024-09-12T19:23:26.258153+0000","last_fullsized":"2024-09-12T19:23:26.258153+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'745","last_scrub_stamp":"2024-09-12T19:23:26.257807+0000","last_deep_scrub":"267'745","last_deep_scrub_stamp":"2024-09-12T19:23:26.257807+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.257807+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:41.842768+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3670,"num_read_kb":3349,"num_write":979,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'350","reported_seq":1005,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.882345+0000","last_change":"2024-09-12T19:23:11.882345+0000","last_active":"2024-09-12T19:23:11.882345+0000","last_peered":"2024-09-12T19:23:11.882345+0000","last_clean":"2024-09-12T19:23:11.882345+0000","last_became_active":"2024-09-12T17:29:52.766959+0000","last_became_peered":"2024-09-12T17:29:52.766959+0000","last_unstale":"2024-09-12T19:23:11.882345+0000","last_undegraded":"2024-09-12T19:23:11.882345+0000","last_fullsized":"2024-09-12T19:23:11.882345+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'350","last_scrub_stamp":"2024-09-12T19:23:11.882126+0000","last_deep_scrub":"267'350","last_deep_scrub_stamp":"2024-09-12T19:23:11.882126+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.882126+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:02.282493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":468,"num_read_kb":494,"num_write":1113,"num_write_kb":20716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'131","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.037145+0000","last_change":"2024-09-12T19:23:42.037145+0000","last_active":"2024-09-12T19:23:42.037145+0000","last_peered":"2024-09-12T19:23:42.037145+0000","last_clean":"2024-09-12T19:23:42.037145+0000","last_became_active":"2024-09-12T17:30:02.802659+0000","last_became_peered":"2024-09-12T17:30:02.802659+0000","last_unstale":"2024-09-12T19:23:42.037145+0000","last_undegraded":"2024-09-12T19:23:42.037145+0000","last_fullsized":"2024-09-12T19:23:42.037145+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-09-12T19:23:42.036925+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-09-12T19:23:42.036925+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.036925+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:38.006162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":169,"num_write":297,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'432","reported_seq":2026,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.153150+0000","last_change":"2024-09-12T19:23:24.153150+0000","last_active":"2024-09-12T19:23:24.153150+0000","last_peered":"2024-09-12T19:23:24.153150+0000","last_clean":"2024-09-12T19:23:24.153150+0000","last_became_active":"2024-09-12T17:29:54.758303+0000","last_became_peered":"2024-09-12T17:29:54.758303+0000","last_unstale":"2024-09-12T19:23:24.153150+0000","last_undegraded":"2024-09-12T19:23:24.153150+0000","last_fullsized":"2024-09-12T19:23:24.153150+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'432","last_scrub_stamp":"2024-09-12T19:23:24.152868+0000","last_deep_scrub":"267'432","last_deep_scrub_stamp":"2024-09-12T19:23:24.152868+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.152868+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:50.955827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2323,"num_read_kb":2196,"num_write":494,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'401","reported_seq":1120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.070452+0000","last_change":"2024-09-12T19:23:14.070452+0000","last_active":"2024-09-12T19:23:14.070452+0000","last_peered":"2024-09-12T19:23:14.070452+0000","last_clean":"2024-09-12T19:23:14.070452+0000","last_became_active":"2024-09-12T17:29:52.755103+0000","last_became_peered":"2024-09-12T17:29:52.755103+0000","last_unstale":"2024-09-12T19:23:14.070452+0000","last_undegraded":"2024-09-12T19:23:14.070452+0000","last_fullsized":"2024-09-12T19:23:14.070452+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'401","last_scrub_stamp":"2024-09-12T19:23:14.070224+0000","last_deep_scrub":"267'401","last_deep_scrub_stamp":"2024-09-12T19:23:14.070224+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.070224+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:15.519300+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524450,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":671,"num_read_kb":34526,"num_write":1327,"num_write_kb":26646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.319765+0000","last_change":"2024-09-12T19:23:30.319587+0000","last_active":"2024-09-12T19:23:30.319765+0000","last_peered":"2024-09-12T19:23:30.319765+0000","last_clean":"2024-09-12T19:23:30.319765+0000","last_became_active":"2024-09-12T17:29:56.763547+0000","last_became_peered":"2024-09-12T17:29:56.763547+0000","last_unstale":"2024-09-12T19:23:30.319765+0000","last_undegraded":"2024-09-12T19:23:30.319765+0000","last_fullsized":"2024-09-12T19:23:30.319765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:30.319381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:30.319381+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.319381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:11.796126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'391","reported_seq":1050,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.766076+0000","last_change":"2024-09-12T19:23:28.765866+0000","last_active":"2024-09-12T19:23:28.766076+0000","last_peered":"2024-09-12T19:23:28.766076+0000","last_clean":"2024-09-12T19:23:28.766076+0000","last_became_active":"2024-09-12T17:29:58.777554+0000","last_became_peered":"2024-09-12T17:29:58.777554+0000","last_unstale":"2024-09-12T19:23:28.766076+0000","last_undegraded":"2024-09-12T19:23:28.766076+0000","last_fullsized":"2024-09-12T19:23:28.766076+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'391","last_scrub_stamp":"2024-09-12T19:23:28.765622+0000","last_deep_scrub":"267'391","last_deep_scrub_stamp":"2024-09-12T19:23:28.765622+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.765622+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:18.062130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45863,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":1229,"num_write":480,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.039838+0000","last_change":"2024-09-12T19:23:39.039838+0000","last_active":"2024-09-12T19:23:39.039838+0000","last_peered":"2024-09-12T19:23:39.039838+0000","last_clean":"2024-09-12T19:23:39.039838+0000","last_became_active":"2024-09-12T17:30:00.805568+0000","last_became_peered":"2024-09-12T17:30:00.805568+0000","last_unstale":"2024-09-12T19:23:39.039838+0000","last_undegraded":"2024-09-12T19:23:39.039838+0000","last_fullsized":"2024-09-12T19:23:39.039838+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:39.039604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:39.039604+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.039604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:42.434322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'147","reported_seq":735,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.340517+0000","last_change":"2024-09-12T19:23:43.340340+0000","last_active":"2024-09-12T19:23:43.340517+0000","last_peered":"2024-09-12T19:23:43.340517+0000","last_clean":"2024-09-12T19:23:43.340517+0000","last_became_active":"2024-09-12T17:30:02.785212+0000","last_became_peered":"2024-09-12T17:30:02.785212+0000","last_unstale":"2024-09-12T19:23:43.340517+0000","last_undegraded":"2024-09-12T19:23:43.340517+0000","last_fullsized":"2024-09-12T19:23:43.340517+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'147","last_scrub_stamp":"2024-09-12T19:23:43.340126+0000","last_deep_scrub":"267'147","last_deep_scrub_stamp":"2024-09-12T19:23:43.340126+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.340126+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:42.490361+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":252,"num_read_kb":243,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'686","reported_seq":2561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.304352+0000","last_change":"2024-09-12T19:23:22.304212+0000","last_active":"2024-09-12T19:23:22.304352+0000","last_peered":"2024-09-12T19:23:22.304352+0000","last_clean":"2024-09-12T19:23:22.304352+0000","last_became_active":"2024-09-12T17:29:54.761497+0000","last_became_peered":"2024-09-12T17:29:54.761497+0000","last_unstale":"2024-09-12T19:23:22.304352+0000","last_undegraded":"2024-09-12T19:23:22.304352+0000","last_fullsized":"2024-09-12T19:23:22.304352+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'686","last_scrub_stamp":"2024-09-12T19:23:22.303998+0000","last_deep_scrub":"267'686","last_deep_scrub_stamp":"2024-09-12T19:23:22.303998+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.303998+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":600,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:35.218804+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3854,"num_read_kb":3534,"num_write":981,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2484,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'373","reported_seq":1054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.894094+0000","last_change":"2024-09-12T19:23:10.894094+0000","last_active":"2024-09-12T19:23:10.894094+0000","last_peered":"2024-09-12T19:23:10.894094+0000","last_clean":"2024-09-12T19:23:10.894094+0000","last_became_active":"2024-09-12T17:29:52.713938+0000","last_became_peered":"2024-09-12T17:29:52.713938+0000","last_unstale":"2024-09-12T19:23:10.894094+0000","last_undegraded":"2024-09-12T19:23:10.894094+0000","last_fullsized":"2024-09-12T19:23:10.894094+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'373","last_scrub_stamp":"2024-09-12T19:23:10.893784+0000","last_deep_scrub":"267'373","last_deep_scrub_stamp":"2024-09-12T19:23:10.893784+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.893784+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:17.828171+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460272,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":10309,"num_write":1260,"num_write_kb":32712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.117064+0000","last_change":"2024-09-12T19:23:33.117064+0000","last_active":"2024-09-12T19:23:33.117064+0000","last_peered":"2024-09-12T19:23:33.117064+0000","last_clean":"2024-09-12T19:23:33.117064+0000","last_became_active":"2024-09-12T17:29:56.776335+0000","last_became_peered":"2024-09-12T17:29:56.776335+0000","last_unstale":"2024-09-12T19:23:33.117064+0000","last_undegraded":"2024-09-12T19:23:33.117064+0000","last_fullsized":"2024-09-12T19:23:33.117064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:33.116805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:33.116805+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.116805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:05.221499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'123","reported_seq":706,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.097443+0000","last_change":"2024-09-12T19:23:35.097315+0000","last_active":"2024-09-12T19:23:35.097443+0000","last_peered":"2024-09-12T19:23:35.097443+0000","last_clean":"2024-09-12T19:23:35.097443+0000","last_became_active":"2024-09-12T17:29:58.777883+0000","last_became_peered":"2024-09-12T17:29:58.777883+0000","last_unstale":"2024-09-12T19:23:35.097443+0000","last_undegraded":"2024-09-12T19:23:35.097443+0000","last_fullsized":"2024-09-12T19:23:35.097443+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'123","last_scrub_stamp":"2024-09-12T19:23:35.097136+0000","last_deep_scrub":"267'123","last_deep_scrub_stamp":"2024-09-12T19:23:35.097136+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.097136+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:45.936503+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.005166+0000","last_change":"2024-09-12T19:23:40.005166+0000","last_active":"2024-09-12T19:23:40.005166+0000","last_peered":"2024-09-12T19:23:40.005166+0000","last_clean":"2024-09-12T19:23:40.005166+0000","last_became_active":"2024-09-12T17:30:00.781554+0000","last_became_peered":"2024-09-12T17:30:00.781554+0000","last_unstale":"2024-09-12T19:23:40.005166+0000","last_undegraded":"2024-09-12T19:23:40.005166+0000","last_fullsized":"2024-09-12T19:23:40.005166+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:40.004991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:40.004991+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.004991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:11.814607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'124","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.677123+0000","last_change":"2024-09-12T19:23:41.677123+0000","last_active":"2024-09-12T19:23:41.677123+0000","last_peered":"2024-09-12T19:23:41.677123+0000","last_clean":"2024-09-12T19:23:41.677123+0000","last_became_active":"2024-09-12T17:30:02.805556+0000","last_became_peered":"2024-09-12T17:30:02.805556+0000","last_unstale":"2024-09-12T19:23:41.677123+0000","last_undegraded":"2024-09-12T19:23:41.677123+0000","last_fullsized":"2024-09-12T19:23:41.677123+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'124","last_scrub_stamp":"2024-09-12T19:23:41.676926+0000","last_deep_scrub":"267'124","last_deep_scrub_stamp":"2024-09-12T19:23:41.676926+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.676926+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:02:35.359271+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":177,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'910","reported_seq":2546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.925925+0000","last_change":"2024-09-12T19:23:17.925790+0000","last_active":"2024-09-12T19:23:17.925925+0000","last_peered":"2024-09-12T19:23:17.925925+0000","last_clean":"2024-09-12T19:23:17.925925+0000","last_became_active":"2024-09-12T17:29:54.751997+0000","last_became_peered":"2024-09-12T17:29:54.751997+0000","last_unstale":"2024-09-12T19:23:17.925925+0000","last_undegraded":"2024-09-12T19:23:17.925925+0000","last_fullsized":"2024-09-12T19:23:17.925925+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'910","last_scrub_stamp":"2024-09-12T19:23:17.925604+0000","last_deep_scrub":"267'910","last_deep_scrub_stamp":"2024-09-12T19:23:17.925604+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.925604+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":800,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:18.238141+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4250,"num_read_kb":3802,"num_write":1203,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":496,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'368","reported_seq":1093,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.024733+0000","last_change":"2024-09-12T19:23:13.024733+0000","last_active":"2024-09-12T19:23:13.024733+0000","last_peered":"2024-09-12T19:23:13.024733+0000","last_clean":"2024-09-12T19:23:13.024733+0000","last_became_active":"2024-09-12T17:29:52.762149+0000","last_became_peered":"2024-09-12T17:29:52.762149+0000","last_unstale":"2024-09-12T19:23:13.024733+0000","last_undegraded":"2024-09-12T19:23:13.024733+0000","last_fullsized":"2024-09-12T19:23:13.024733+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'368","last_scrub_stamp":"2024-09-12T19:23:13.024462+0000","last_deep_scrub":"267'368","last_deep_scrub_stamp":"2024-09-12T19:23:13.024462+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.024462+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:06.503899+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":626,"num_read_kb":63082,"num_write":1322,"num_write_kb":27819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.144641+0000","last_change":"2024-09-12T19:23:32.144463+0000","last_active":"2024-09-12T19:23:32.144641+0000","last_peered":"2024-09-12T19:23:32.144641+0000","last_clean":"2024-09-12T19:23:32.144641+0000","last_became_active":"2024-09-12T17:29:56.761027+0000","last_became_peered":"2024-09-12T17:29:56.761027+0000","last_unstale":"2024-09-12T19:23:32.144641+0000","last_undegraded":"2024-09-12T19:23:32.144641+0000","last_fullsized":"2024-09-12T19:23:32.144641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:32.144189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:32.144189+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.144189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:33.492487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'178","reported_seq":789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.980218+0000","last_change":"2024-09-12T19:23:23.980218+0000","last_active":"2024-09-12T19:23:23.980218+0000","last_peered":"2024-09-12T19:23:23.980218+0000","last_clean":"2024-09-12T19:23:23.980218+0000","last_became_active":"2024-09-12T17:29:58.769889+0000","last_became_peered":"2024-09-12T17:29:58.769889+0000","last_unstale":"2024-09-12T19:23:23.980218+0000","last_undegraded":"2024-09-12T19:23:23.980218+0000","last_fullsized":"2024-09-12T19:23:23.980218+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'178","last_scrub_stamp":"2024-09-12T19:23:23.980018+0000","last_deep_scrub":"267'178","last_deep_scrub_stamp":"2024-09-12T19:23:23.980018+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.980018+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:07.667832+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'757","reported_seq":3334,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.082479+0000","last_change":"2024-09-12T19:23:40.082479+0000","last_active":"2024-09-12T19:23:40.082479+0000","last_peered":"2024-09-12T19:23:40.082479+0000","last_clean":"2024-09-12T19:23:40.082479+0000","last_became_active":"2024-09-12T17:30:00.810030+0000","last_became_peered":"2024-09-12T17:30:00.810030+0000","last_unstale":"2024-09-12T19:23:40.082479+0000","last_undegraded":"2024-09-12T19:23:40.082479+0000","last_fullsized":"2024-09-12T19:23:40.082479+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'757","last_scrub_stamp":"2024-09-12T19:23:40.082255+0000","last_deep_scrub":"267'757","last_deep_scrub_stamp":"2024-09-12T19:23:40.082255+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.082255+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:00.429097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'210","reported_seq":1076,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.034245+0000","last_change":"2024-09-12T19:23:45.034245+0000","last_active":"2024-09-12T19:23:45.034245+0000","last_peered":"2024-09-12T19:23:45.034245+0000","last_clean":"2024-09-12T19:23:45.034245+0000","last_became_active":"2024-09-12T17:30:02.803144+0000","last_became_peered":"2024-09-12T17:30:02.803144+0000","last_unstale":"2024-09-12T19:23:45.034245+0000","last_undegraded":"2024-09-12T19:23:45.034245+0000","last_fullsized":"2024-09-12T19:23:45.034245+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'210","last_scrub_stamp":"2024-09-12T19:23:45.034025+0000","last_deep_scrub":"267'210","last_deep_scrub_stamp":"2024-09-12T19:23:45.034025+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.034025+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:07.379679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":674,"num_read_kb":661,"num_write":463,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'416","reported_seq":2082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.176672+0000","last_change":"2024-09-12T19:23:23.176544+0000","last_active":"2024-09-12T19:23:23.176672+0000","last_peered":"2024-09-12T19:23:23.176672+0000","last_clean":"2024-09-12T19:23:23.176672+0000","last_became_active":"2024-09-12T17:29:54.762448+0000","last_became_peered":"2024-09-12T17:29:54.762448+0000","last_unstale":"2024-09-12T19:23:23.176672+0000","last_undegraded":"2024-09-12T19:23:23.176672+0000","last_fullsized":"2024-09-12T19:23:23.176672+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'416","last_scrub_stamp":"2024-09-12T19:23:23.176364+0000","last_deep_scrub":"267'416","last_deep_scrub_stamp":"2024-09-12T19:23:23.176364+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.176364+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:27.592188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2329,"num_read_kb":2238,"num_write":469,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'341","reported_seq":1012,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.138789+0000","last_change":"2024-09-12T19:23:11.138789+0000","last_active":"2024-09-12T19:23:11.138789+0000","last_peered":"2024-09-12T19:23:11.138789+0000","last_clean":"2024-09-12T19:23:11.138789+0000","last_became_active":"2024-09-12T17:29:52.738957+0000","last_became_peered":"2024-09-12T17:29:52.738957+0000","last_unstale":"2024-09-12T19:23:11.138789+0000","last_undegraded":"2024-09-12T19:23:11.138789+0000","last_fullsized":"2024-09-12T19:23:11.138789+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'341","last_scrub_stamp":"2024-09-12T19:23:11.138465+0000","last_deep_scrub":"267'341","last_deep_scrub_stamp":"2024-09-12T19:23:11.138465+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.138465+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:25.950750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":517,"num_read_kb":16175,"num_write":1150,"num_write_kb":26946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.312490+0000","last_change":"2024-09-12T19:23:29.312344+0000","last_active":"2024-09-12T19:23:29.312490+0000","last_peered":"2024-09-12T19:23:29.312490+0000","last_clean":"2024-09-12T19:23:29.312490+0000","last_became_active":"2024-09-12T17:29:56.755730+0000","last_became_peered":"2024-09-12T17:29:56.755730+0000","last_unstale":"2024-09-12T19:23:29.312490+0000","last_undegraded":"2024-09-12T19:23:29.312490+0000","last_fullsized":"2024-09-12T19:23:29.312490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:29.312160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:29.312160+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.312160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:47.556257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'327","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.149102+0000","last_change":"2024-09-12T19:23:35.148955+0000","last_active":"2024-09-12T19:23:35.149102+0000","last_peered":"2024-09-12T19:23:35.149102+0000","last_clean":"2024-09-12T19:23:35.149102+0000","last_became_active":"2024-09-12T17:29:58.829021+0000","last_became_peered":"2024-09-12T17:29:58.829021+0000","last_unstale":"2024-09-12T19:23:35.149102+0000","last_undegraded":"2024-09-12T19:23:35.149102+0000","last_fullsized":"2024-09-12T19:23:35.149102+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'327","last_scrub_stamp":"2024-09-12T19:23:35.148750+0000","last_deep_scrub":"267'327","last_deep_scrub_stamp":"2024-09-12T19:23:35.148750+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.148750+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:02:26.287034+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49018,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":1196,"num_write":438,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'814","reported_seq":3032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.093076+0000","last_change":"2024-09-12T19:23:45.093076+0000","last_active":"2024-09-12T19:23:45.093076+0000","last_peered":"2024-09-12T19:23:45.093076+0000","last_clean":"2024-09-12T19:23:45.093076+0000","last_became_active":"2024-09-12T17:30:00.793067+0000","last_became_peered":"2024-09-12T17:30:00.793067+0000","last_unstale":"2024-09-12T19:23:45.093076+0000","last_undegraded":"2024-09-12T19:23:45.093076+0000","last_fullsized":"2024-09-12T19:23:45.093076+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'814","last_scrub_stamp":"2024-09-12T19:23:45.092843+0000","last_deep_scrub":"267'814","last_deep_scrub_stamp":"2024-09-12T19:23:45.092843+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.092843+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:39.919209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'526","reported_seq":2074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.298840+0000","last_change":"2024-09-12T19:23:21.298840+0000","last_active":"2024-09-12T19:23:21.298840+0000","last_peered":"2024-09-12T19:23:21.298840+0000","last_clean":"2024-09-12T19:23:21.298840+0000","last_became_active":"2024-09-12T17:29:54.766092+0000","last_became_peered":"2024-09-12T17:29:54.766092+0000","last_unstale":"2024-09-12T19:23:21.298840+0000","last_undegraded":"2024-09-12T19:23:21.298840+0000","last_fullsized":"2024-09-12T19:23:21.298840+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'526","last_scrub_stamp":"2024-09-12T19:23:21.298622+0000","last_deep_scrub":"267'526","last_deep_scrub_stamp":"2024-09-12T19:23:21.298622+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.298622+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:56.252493+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2636,"num_read_kb":2418,"num_write":649,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'353","reported_seq":1047,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.059198+0000","last_change":"2024-09-12T19:23:15.059198+0000","last_active":"2024-09-12T19:23:15.059198+0000","last_peered":"2024-09-12T19:23:15.059198+0000","last_clean":"2024-09-12T19:23:15.059198+0000","last_became_active":"2024-09-12T17:29:52.757326+0000","last_became_peered":"2024-09-12T17:29:52.757326+0000","last_unstale":"2024-09-12T19:23:15.059198+0000","last_undegraded":"2024-09-12T19:23:15.059198+0000","last_fullsized":"2024-09-12T19:23:15.059198+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'353","last_scrub_stamp":"2024-09-12T19:23:15.058913+0000","last_deep_scrub":"267'353","last_deep_scrub_stamp":"2024-09-12T19:23:15.058913+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.058913+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:10.734098+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730145,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":565,"num_read_kb":12520,"num_write":1100,"num_write_kb":32977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.109066+0000","last_change":"2024-09-12T19:23:33.109066+0000","last_active":"2024-09-12T19:23:33.109066+0000","last_peered":"2024-09-12T19:23:33.109066+0000","last_clean":"2024-09-12T19:23:33.109066+0000","last_became_active":"2024-09-12T17:29:56.768267+0000","last_became_peered":"2024-09-12T17:29:56.768267+0000","last_unstale":"2024-09-12T19:23:33.109066+0000","last_undegraded":"2024-09-12T19:23:33.109066+0000","last_fullsized":"2024-09-12T19:23:33.109066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:33.108858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:33.108858+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.108858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:40.490165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'461","reported_seq":1161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.296203+0000","last_change":"2024-09-12T19:23:34.296203+0000","last_active":"2024-09-12T19:23:34.296203+0000","last_peered":"2024-09-12T19:23:34.296203+0000","last_clean":"2024-09-12T19:23:34.296203+0000","last_became_active":"2024-09-12T17:29:58.833291+0000","last_became_peered":"2024-09-12T17:29:58.833291+0000","last_unstale":"2024-09-12T19:23:34.296203+0000","last_undegraded":"2024-09-12T19:23:34.296203+0000","last_fullsized":"2024-09-12T19:23:34.296203+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'461","last_scrub_stamp":"2024-09-12T19:23:34.295959+0000","last_deep_scrub":"267'461","last_deep_scrub_stamp":"2024-09-12T19:23:34.295959+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.295959+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:24.206523+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60505,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":721,"num_read_kb":1312,"num_write":540,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.640178+0000","last_change":"2024-09-12T19:23:29.640178+0000","last_active":"2024-09-12T19:23:29.640178+0000","last_peered":"2024-09-12T19:23:29.640178+0000","last_clean":"2024-09-12T19:23:29.640178+0000","last_became_active":"2024-09-12T17:30:00.809914+0000","last_became_peered":"2024-09-12T17:30:00.809914+0000","last_unstale":"2024-09-12T19:23:29.640178+0000","last_undegraded":"2024-09-12T19:23:29.640178+0000","last_fullsized":"2024-09-12T19:23:29.640178+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:29.639987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:29.639987+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.639987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:34.064980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'551","reported_seq":1415,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.282843+0000","last_change":"2024-09-12T19:23:39.282843+0000","last_active":"2024-09-12T19:23:39.282843+0000","last_peered":"2024-09-12T19:23:39.282843+0000","last_clean":"2024-09-12T19:23:39.282843+0000","last_became_active":"2024-09-12T17:30:02.797046+0000","last_became_peered":"2024-09-12T17:30:02.797046+0000","last_unstale":"2024-09-12T19:23:39.282843+0000","last_undegraded":"2024-09-12T19:23:39.282843+0000","last_fullsized":"2024-09-12T19:23:39.282843+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'551","last_scrub_stamp":"2024-09-12T19:23:39.282658+0000","last_deep_scrub":"267'551","last_deep_scrub_stamp":"2024-09-12T19:23:39.282658+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.282658+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:04.085433+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1413,"num_read_kb":1390,"num_write":1179,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'484","reported_seq":2168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.213752+0000","last_change":"2024-09-12T19:23:14.213752+0000","last_active":"2024-09-12T19:23:14.213752+0000","last_peered":"2024-09-12T19:23:14.213752+0000","last_clean":"2024-09-12T19:23:14.213752+0000","last_became_active":"2024-09-12T17:29:54.754517+0000","last_became_peered":"2024-09-12T17:29:54.754517+0000","last_unstale":"2024-09-12T19:23:14.213752+0000","last_undegraded":"2024-09-12T19:23:14.213752+0000","last_fullsized":"2024-09-12T19:23:14.213752+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'484","last_scrub_stamp":"2024-09-12T19:23:14.213543+0000","last_deep_scrub":"267'484","last_deep_scrub_stamp":"2024-09-12T19:23:14.213543+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.213543+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:45.018822+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2565,"num_read_kb":2417,"num_write":558,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'317","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.054850+0000","last_change":"2024-09-12T19:23:16.054850+0000","last_active":"2024-09-12T19:23:16.054850+0000","last_peered":"2024-09-12T19:23:16.054850+0000","last_clean":"2024-09-12T19:23:16.054850+0000","last_became_active":"2024-09-12T17:29:52.760711+0000","last_became_peered":"2024-09-12T17:29:52.760711+0000","last_unstale":"2024-09-12T19:23:16.054850+0000","last_undegraded":"2024-09-12T19:23:16.054850+0000","last_fullsized":"2024-09-12T19:23:16.054850+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-12T19:23:16.054566+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-12T19:23:16.054566+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.054566+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:14.486166+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759519,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":447,"num_read_kb":40999,"num_write":1044,"num_write_kb":42394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.974544+0000","last_change":"2024-09-12T19:23:18.974544+0000","last_active":"2024-09-12T19:23:18.974544+0000","last_peered":"2024-09-12T19:23:18.974544+0000","last_clean":"2024-09-12T19:23:18.974544+0000","last_became_active":"2024-09-12T17:29:56.757805+0000","last_became_peered":"2024-09-12T17:29:56.757805+0000","last_unstale":"2024-09-12T19:23:18.974544+0000","last_undegraded":"2024-09-12T19:23:18.974544+0000","last_fullsized":"2024-09-12T19:23:18.974544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:18.974369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:18.974369+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.974369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:12.714029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'308","reported_seq":939,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.093350+0000","last_change":"2024-09-12T19:23:34.093350+0000","last_active":"2024-09-12T19:23:34.093350+0000","last_peered":"2024-09-12T19:23:34.093350+0000","last_clean":"2024-09-12T19:23:34.093350+0000","last_became_active":"2024-09-12T17:29:58.773959+0000","last_became_peered":"2024-09-12T17:29:58.773959+0000","last_unstale":"2024-09-12T19:23:34.093350+0000","last_undegraded":"2024-09-12T19:23:34.093350+0000","last_fullsized":"2024-09-12T19:23:34.093350+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'308","last_scrub_stamp":"2024-09-12T19:23:34.093156+0000","last_deep_scrub":"267'308","last_deep_scrub_stamp":"2024-09-12T19:23:34.093156+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.093156+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:21.646685+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47390,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":1092,"num_write":400,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.108233+0000","last_change":"2024-09-12T19:23:44.108233+0000","last_active":"2024-09-12T19:23:44.108233+0000","last_peered":"2024-09-12T19:23:44.108233+0000","last_clean":"2024-09-12T19:23:44.108233+0000","last_became_active":"2024-09-12T17:30:00.792138+0000","last_became_peered":"2024-09-12T17:30:00.792138+0000","last_unstale":"2024-09-12T19:23:44.108233+0000","last_undegraded":"2024-09-12T19:23:44.108233+0000","last_fullsized":"2024-09-12T19:23:44.108233+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:44.108013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:44.108013+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.108013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:42.196467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2478","reported_seq":4401,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.288441+0000","last_change":"2024-09-12T19:23:30.288441+0000","last_active":"2024-09-12T19:23:30.288441+0000","last_peered":"2024-09-12T19:23:30.288441+0000","last_clean":"2024-09-12T19:23:30.288441+0000","last_became_active":"2024-09-12T17:30:02.800860+0000","last_became_peered":"2024-09-12T17:30:02.800860+0000","last_unstale":"2024-09-12T19:23:30.288441+0000","last_undegraded":"2024-09-12T19:23:30.288441+0000","last_fullsized":"2024-09-12T19:23:30.288441+0000","mapping_epoch":36,"log_start":"267'2400","ondisk_log_start":"267'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2478","last_scrub_stamp":"2024-09-12T19:23:30.288237+0000","last_deep_scrub":"267'2478","last_deep_scrub_stamp":"2024-09-12T19:23:30.288237+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.288237+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":2400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.820569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6373,"num_read_kb":6312,"num_write":5027,"num_write_kb":1835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'434","reported_seq":2080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.214501+0000","last_change":"2024-09-12T19:23:17.214501+0000","last_active":"2024-09-12T19:23:17.214501+0000","last_peered":"2024-09-12T19:23:17.214501+0000","last_clean":"2024-09-12T19:23:17.214501+0000","last_became_active":"2024-09-12T17:29:54.769541+0000","last_became_peered":"2024-09-12T17:29:54.769541+0000","last_unstale":"2024-09-12T19:23:17.214501+0000","last_undegraded":"2024-09-12T19:23:17.214501+0000","last_fullsized":"2024-09-12T19:23:17.214501+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'434","last_scrub_stamp":"2024-09-12T19:23:17.214333+0000","last_deep_scrub":"267'434","last_deep_scrub_stamp":"2024-09-12T19:23:17.214333+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.214333+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:25.717262+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2445,"num_read_kb":2340,"num_write":496,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'333","reported_seq":1016,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.024545+0000","last_change":"2024-09-12T19:23:09.024545+0000","last_active":"2024-09-12T19:23:09.024545+0000","last_peered":"2024-09-12T19:23:09.024545+0000","last_clean":"2024-09-12T19:23:09.024545+0000","last_became_active":"2024-09-12T17:30:21.793950+0000","last_became_peered":"2024-09-12T17:30:21.793950+0000","last_unstale":"2024-09-12T19:23:09.024545+0000","last_undegraded":"2024-09-12T19:23:09.024545+0000","last_fullsized":"2024-09-12T19:23:09.024545+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-09-12T19:23:09.024422+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-09-12T19:23:09.024422+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.024422+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:49.775219+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12448261,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":65282,"num_write":1071,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,6],"acting":[2,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.001307+0000","last_change":"2024-09-12T19:23:20.001307+0000","last_active":"2024-09-12T19:23:20.001307+0000","last_peered":"2024-09-12T19:23:20.001307+0000","last_clean":"2024-09-12T19:23:20.001307+0000","last_became_active":"2024-09-12T17:29:56.770222+0000","last_became_peered":"2024-09-12T17:29:56.770222+0000","last_unstale":"2024-09-12T19:23:20.001307+0000","last_undegraded":"2024-09-12T19:23:20.001307+0000","last_fullsized":"2024-09-12T19:23:20.001307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:20.001094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:20.001094+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.001094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:34.611973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'401","reported_seq":1060,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.149777+0000","last_change":"2024-09-12T19:23:32.149777+0000","last_active":"2024-09-12T19:23:32.149777+0000","last_peered":"2024-09-12T19:23:32.149777+0000","last_clean":"2024-09-12T19:23:32.149777+0000","last_became_active":"2024-09-12T17:29:58.754613+0000","last_became_peered":"2024-09-12T17:29:58.754613+0000","last_unstale":"2024-09-12T19:23:32.149777+0000","last_undegraded":"2024-09-12T19:23:32.149777+0000","last_fullsized":"2024-09-12T19:23:32.149777+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'401","last_scrub_stamp":"2024-09-12T19:23:32.149559+0000","last_deep_scrub":"267'401","last_deep_scrub_stamp":"2024-09-12T19:23:32.149559+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.149559+0000","objects_scrubbed":7,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:40.743834+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50732,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":653,"num_read_kb":1328,"num_write":512,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'797","reported_seq":3216,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.757194+0000","last_change":"2024-09-12T19:23:32.757194+0000","last_active":"2024-09-12T19:23:32.757194+0000","last_peered":"2024-09-12T19:23:32.757194+0000","last_clean":"2024-09-12T19:23:32.757194+0000","last_became_active":"2024-09-12T17:30:00.805428+0000","last_became_peered":"2024-09-12T17:30:00.805428+0000","last_unstale":"2024-09-12T19:23:32.757194+0000","last_undegraded":"2024-09-12T19:23:32.757194+0000","last_fullsized":"2024-09-12T19:23:32.757194+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'797","last_scrub_stamp":"2024-09-12T19:23:32.757019+0000","last_deep_scrub":"267'797","last_deep_scrub_stamp":"2024-09-12T19:23:32.757019+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.757019+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:36:55.355736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'113","reported_seq":668,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.753686+0000","last_change":"2024-09-12T19:23:39.753686+0000","last_active":"2024-09-12T19:23:39.753686+0000","last_peered":"2024-09-12T19:23:39.753686+0000","last_clean":"2024-09-12T19:23:39.753686+0000","last_became_active":"2024-09-12T17:30:02.816983+0000","last_became_peered":"2024-09-12T17:30:02.816983+0000","last_unstale":"2024-09-12T19:23:39.753686+0000","last_undegraded":"2024-09-12T19:23:39.753686+0000","last_fullsized":"2024-09-12T19:23:39.753686+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'113","last_scrub_stamp":"2024-09-12T19:23:39.753494+0000","last_deep_scrub":"267'113","last_deep_scrub_stamp":"2024-09-12T19:23:39.753494+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.753494+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:47.021198+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":194,"num_write":254,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'875","reported_seq":2511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.846463+0000","last_change":"2024-09-12T19:23:25.846463+0000","last_active":"2024-09-12T19:23:25.846463+0000","last_peered":"2024-09-12T19:23:25.846463+0000","last_clean":"2024-09-12T19:23:25.846463+0000","last_became_active":"2024-09-12T17:29:54.744926+0000","last_became_peered":"2024-09-12T17:29:54.744926+0000","last_unstale":"2024-09-12T19:23:25.846463+0000","last_undegraded":"2024-09-12T19:23:25.846463+0000","last_fullsized":"2024-09-12T19:23:25.846463+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'875","last_scrub_stamp":"2024-09-12T19:23:25.846277+0000","last_deep_scrub":"267'875","last_deep_scrub_stamp":"2024-09-12T19:23:25.846277+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.846277+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:32.763858+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4186,"num_read_kb":3781,"num_write":1194,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'377","reported_seq":1075,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.256060+0000","last_change":"2024-09-12T19:23:11.256060+0000","last_active":"2024-09-12T19:23:11.256060+0000","last_peered":"2024-09-12T19:23:11.256060+0000","last_clean":"2024-09-12T19:23:11.256060+0000","last_became_active":"2024-09-12T17:29:52.748439+0000","last_became_peered":"2024-09-12T17:29:52.748439+0000","last_unstale":"2024-09-12T19:23:11.256060+0000","last_undegraded":"2024-09-12T19:23:11.256060+0000","last_fullsized":"2024-09-12T19:23:11.256060+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'377","last_scrub_stamp":"2024-09-12T19:23:11.255752+0000","last_deep_scrub":"267'377","last_deep_scrub_stamp":"2024-09-12T19:23:11.255752+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.255752+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:44.862051+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992343,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":628,"num_read_kb":40400,"num_write":1240,"num_write_kb":24508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.008450+0000","last_change":"2024-09-12T19:23:21.008450+0000","last_active":"2024-09-12T19:23:21.008450+0000","last_peered":"2024-09-12T19:23:21.008450+0000","last_clean":"2024-09-12T19:23:21.008450+0000","last_became_active":"2024-09-12T17:29:56.742361+0000","last_became_peered":"2024-09-12T17:29:56.742361+0000","last_unstale":"2024-09-12T19:23:21.008450+0000","last_undegraded":"2024-09-12T19:23:21.008450+0000","last_fullsized":"2024-09-12T19:23:21.008450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:21.008185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:21.008185+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.008185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:29.516729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'518","reported_seq":1210,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.807529+0000","last_change":"2024-09-12T19:23:26.807529+0000","last_active":"2024-09-12T19:23:26.807529+0000","last_peered":"2024-09-12T19:23:26.807529+0000","last_clean":"2024-09-12T19:23:26.807529+0000","last_became_active":"2024-09-12T17:29:58.777576+0000","last_became_peered":"2024-09-12T17:29:58.777576+0000","last_unstale":"2024-09-12T19:23:26.807529+0000","last_undegraded":"2024-09-12T19:23:26.807529+0000","last_fullsized":"2024-09-12T19:23:26.807529+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'518","last_scrub_stamp":"2024-09-12T19:23:26.807330+0000","last_deep_scrub":"267'518","last_deep_scrub_stamp":"2024-09-12T19:23:26.807330+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.807330+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:29.286764+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94518,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":881,"num_read_kb":2010,"num_write":710,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.933893+0000","last_change":"2024-09-12T19:23:28.933893+0000","last_active":"2024-09-12T19:23:28.933893+0000","last_peered":"2024-09-12T19:23:28.933893+0000","last_clean":"2024-09-12T19:23:28.933893+0000","last_became_active":"2024-09-12T17:30:00.780193+0000","last_became_peered":"2024-09-12T17:30:00.780193+0000","last_unstale":"2024-09-12T19:23:28.933893+0000","last_undegraded":"2024-09-12T19:23:28.933893+0000","last_fullsized":"2024-09-12T19:23:28.933893+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:28.933682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:28.933682+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.933682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:40.568216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'168","reported_seq":728,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.655622+0000","last_change":"2024-09-12T19:23:35.655622+0000","last_active":"2024-09-12T19:23:35.655622+0000","last_peered":"2024-09-12T19:23:35.655622+0000","last_clean":"2024-09-12T19:23:35.655622+0000","last_became_active":"2024-09-12T17:30:02.809357+0000","last_became_peered":"2024-09-12T17:30:02.809357+0000","last_unstale":"2024-09-12T19:23:35.655622+0000","last_undegraded":"2024-09-12T19:23:35.655622+0000","last_fullsized":"2024-09-12T19:23:35.655622+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'168","last_scrub_stamp":"2024-09-12T19:23:35.655394+0000","last_deep_scrub":"267'168","last_deep_scrub_stamp":"2024-09-12T19:23:35.655394+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.655394+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:49.193802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":287,"num_read_kb":265,"num_write":391,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'1307","reported_seq":2993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.254001+0000","last_change":"2024-09-12T19:23:15.254001+0000","last_active":"2024-09-12T19:23:15.254001+0000","last_peered":"2024-09-12T19:23:15.254001+0000","last_clean":"2024-09-12T19:23:15.254001+0000","last_became_active":"2024-09-12T17:29:54.758550+0000","last_became_peered":"2024-09-12T17:29:54.758550+0000","last_unstale":"2024-09-12T19:23:15.254001+0000","last_undegraded":"2024-09-12T19:23:15.254001+0000","last_fullsized":"2024-09-12T19:23:15.254001+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1307","last_scrub_stamp":"2024-09-12T19:23:15.253774+0000","last_deep_scrub":"267'1307","last_deep_scrub_stamp":"2024-09-12T19:23:15.253774+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.253774+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":1200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:53.604695+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6018,"num_read_kb":5333,"num_write":1857,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'317","reported_seq":984,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.187666+0000","last_change":"2024-09-12T19:23:10.187666+0000","last_active":"2024-09-12T19:23:10.187666+0000","last_peered":"2024-09-12T19:23:10.187666+0000","last_clean":"2024-09-12T19:23:10.187666+0000","last_became_active":"2024-09-12T17:29:52.765603+0000","last_became_peered":"2024-09-12T17:29:52.765603+0000","last_unstale":"2024-09-12T19:23:10.187666+0000","last_undegraded":"2024-09-12T19:23:10.187666+0000","last_fullsized":"2024-09-12T19:23:10.187666+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-12T19:23:10.187423+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-12T19:23:10.187423+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.187423+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:25.588115+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911305,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":437,"num_read_kb":36052,"num_write":1059,"num_write_kb":37263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.020465+0000","last_change":"2024-09-12T19:23:23.020465+0000","last_active":"2024-09-12T19:23:23.020465+0000","last_peered":"2024-09-12T19:23:23.020465+0000","last_clean":"2024-09-12T19:23:23.020465+0000","last_became_active":"2024-09-12T17:29:56.772580+0000","last_became_peered":"2024-09-12T17:29:56.772580+0000","last_unstale":"2024-09-12T19:23:23.020465+0000","last_undegraded":"2024-09-12T19:23:23.020465+0000","last_fullsized":"2024-09-12T19:23:23.020465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:23.020268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:23.020268+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.020268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:35.030994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'338","reported_seq":983,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.088674+0000","last_change":"2024-09-12T19:23:34.088674+0000","last_active":"2024-09-12T19:23:34.088674+0000","last_peered":"2024-09-12T19:23:34.088674+0000","last_clean":"2024-09-12T19:23:34.088674+0000","last_became_active":"2024-09-12T17:29:58.773869+0000","last_became_peered":"2024-09-12T17:29:58.773869+0000","last_unstale":"2024-09-12T19:23:34.088674+0000","last_undegraded":"2024-09-12T19:23:34.088674+0000","last_fullsized":"2024-09-12T19:23:34.088674+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'338","last_scrub_stamp":"2024-09-12T19:23:34.088466+0000","last_deep_scrub":"267'338","last_deep_scrub_stamp":"2024-09-12T19:23:34.088466+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.088466+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:47.300557+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47005,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":1116,"num_write":486,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.794503+0000","last_change":"2024-09-12T19:23:33.794503+0000","last_active":"2024-09-12T19:23:33.794503+0000","last_peered":"2024-09-12T19:23:33.794503+0000","last_clean":"2024-09-12T19:23:33.794503+0000","last_became_active":"2024-09-12T17:30:00.778642+0000","last_became_peered":"2024-09-12T17:30:00.778642+0000","last_unstale":"2024-09-12T19:23:33.794503+0000","last_undegraded":"2024-09-12T19:23:33.794503+0000","last_fullsized":"2024-09-12T19:23:33.794503+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:33.794328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:33.794328+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.794328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:41.179489+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'110","reported_seq":642,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:47.056825+0000","last_change":"2024-09-12T19:23:47.056825+0000","last_active":"2024-09-12T19:23:47.056825+0000","last_peered":"2024-09-12T19:23:47.056825+0000","last_clean":"2024-09-12T19:23:47.056825+0000","last_became_active":"2024-09-12T17:30:02.788612+0000","last_became_peered":"2024-09-12T17:30:02.788612+0000","last_unstale":"2024-09-12T19:23:47.056825+0000","last_undegraded":"2024-09-12T19:23:47.056825+0000","last_fullsized":"2024-09-12T19:23:47.056825+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'110","last_scrub_stamp":"2024-09-12T19:23:47.056643+0000","last_deep_scrub":"267'110","last_deep_scrub_stamp":"2024-09-12T19:23:47.056643+0000","last_clean_scrub_stamp":"2024-09-12T19:23:47.056643+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:04:16.784374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":252,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'363","reported_seq":1826,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.266919+0000","last_change":"2024-09-12T19:23:16.266919+0000","last_active":"2024-09-12T19:23:16.266919+0000","last_peered":"2024-09-12T19:23:16.266919+0000","last_clean":"2024-09-12T19:23:16.266919+0000","last_became_active":"2024-09-12T17:29:54.758311+0000","last_became_peered":"2024-09-12T17:29:54.758311+0000","last_unstale":"2024-09-12T19:23:16.266919+0000","last_undegraded":"2024-09-12T19:23:16.266919+0000","last_fullsized":"2024-09-12T19:23:16.266919+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'363","last_scrub_stamp":"2024-09-12T19:23:16.266739+0000","last_deep_scrub":"267'363","last_deep_scrub_stamp":"2024-09-12T19:23:16.266739+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.266739+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:18.541808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1918,"num_read_kb":1833,"num_write":390,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'336","reported_seq":1020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.171645+0000","last_change":"2024-09-12T19:23:10.171645+0000","last_active":"2024-09-12T19:23:10.171645+0000","last_peered":"2024-09-12T19:23:10.171645+0000","last_clean":"2024-09-12T19:23:10.171645+0000","last_became_active":"2024-09-12T17:29:52.716965+0000","last_became_peered":"2024-09-12T17:29:52.716965+0000","last_unstale":"2024-09-12T19:23:10.171645+0000","last_undegraded":"2024-09-12T19:23:10.171645+0000","last_fullsized":"2024-09-12T19:23:10.171645+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-12T19:23:10.171401+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-12T19:23:10.171401+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.171401+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:15.438323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262277,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":1122,"num_write":1102,"num_write_kb":14973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.669689+0000","last_change":"2024-09-12T19:23:25.669689+0000","last_active":"2024-09-12T19:23:25.669689+0000","last_peered":"2024-09-12T19:23:25.669689+0000","last_clean":"2024-09-12T19:23:25.669689+0000","last_became_active":"2024-09-12T17:29:56.765057+0000","last_became_peered":"2024-09-12T17:29:56.765057+0000","last_unstale":"2024-09-12T19:23:25.669689+0000","last_undegraded":"2024-09-12T19:23:25.669689+0000","last_fullsized":"2024-09-12T19:23:25.669689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:25.669504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:25.669504+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.669504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:14.220999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'375","reported_seq":1046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.977622+0000","last_change":"2024-09-12T19:23:24.977622+0000","last_active":"2024-09-12T19:23:24.977622+0000","last_peered":"2024-09-12T19:23:24.977622+0000","last_clean":"2024-09-12T19:23:24.977622+0000","last_became_active":"2024-09-12T17:29:58.771991+0000","last_became_peered":"2024-09-12T17:29:58.771991+0000","last_unstale":"2024-09-12T19:23:24.977622+0000","last_undegraded":"2024-09-12T19:23:24.977622+0000","last_fullsized":"2024-09-12T19:23:24.977622+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'375","last_scrub_stamp":"2024-09-12T19:23:24.977409+0000","last_deep_scrub":"267'375","last_deep_scrub_stamp":"2024-09-12T19:23:24.977409+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.977409+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:34.466039+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43575,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":600,"num_read_kb":1164,"num_write":460,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'753","reported_seq":5264,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.923677+0000","last_change":"2024-09-12T19:23:25.923677+0000","last_active":"2024-09-12T19:23:25.923677+0000","last_peered":"2024-09-12T19:23:25.923677+0000","last_clean":"2024-09-12T19:23:25.923677+0000","last_became_active":"2024-09-12T17:30:00.802950+0000","last_became_peered":"2024-09-12T17:30:00.802950+0000","last_unstale":"2024-09-12T19:23:25.923677+0000","last_undegraded":"2024-09-12T19:23:25.923677+0000","last_fullsized":"2024-09-12T19:23:25.923677+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'753","last_scrub_stamp":"2024-09-12T19:23:25.923495+0000","last_deep_scrub":"267'753","last_deep_scrub_stamp":"2024-09-12T19:23:25.923495+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.923495+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":701,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:31.579440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'114","reported_seq":648,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.672695+0000","last_change":"2024-09-12T19:23:32.672695+0000","last_active":"2024-09-12T19:23:32.672695+0000","last_peered":"2024-09-12T19:23:32.672695+0000","last_clean":"2024-09-12T19:23:32.672695+0000","last_became_active":"2024-09-12T17:30:02.806621+0000","last_became_peered":"2024-09-12T17:30:02.806621+0000","last_unstale":"2024-09-12T19:23:32.672695+0000","last_undegraded":"2024-09-12T19:23:32.672695+0000","last_fullsized":"2024-09-12T19:23:32.672695+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'114","last_scrub_stamp":"2024-09-12T19:23:32.672521+0000","last_deep_scrub":"267'114","last_deep_scrub_stamp":"2024-09-12T19:23:32.672521+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.672521+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:12.425992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":276,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'779","reported_seq":2461,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.251063+0000","last_change":"2024-09-12T19:23:17.251063+0000","last_active":"2024-09-12T19:23:17.251063+0000","last_peered":"2024-09-12T19:23:17.251063+0000","last_clean":"2024-09-12T19:23:17.251063+0000","last_became_active":"2024-09-12T17:29:54.763348+0000","last_became_peered":"2024-09-12T17:29:54.763348+0000","last_unstale":"2024-09-12T19:23:17.251063+0000","last_undegraded":"2024-09-12T19:23:17.251063+0000","last_fullsized":"2024-09-12T19:23:17.251063+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'779","last_scrub_stamp":"2024-09-12T19:23:17.250871+0000","last_deep_scrub":"267'779","last_deep_scrub_stamp":"2024-09-12T19:23:17.250871+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.250871+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:17.003332+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4009,"num_read_kb":3654,"num_write":1024,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3240,"num_omap_keys":13,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'307","reported_seq":984,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.186027+0000","last_change":"2024-09-12T19:23:09.186027+0000","last_active":"2024-09-12T19:23:09.186027+0000","last_peered":"2024-09-12T19:23:09.186027+0000","last_clean":"2024-09-12T19:23:09.186027+0000","last_became_active":"2024-09-12T17:29:52.744356+0000","last_became_peered":"2024-09-12T17:29:52.744356+0000","last_unstale":"2024-09-12T19:23:09.186027+0000","last_undegraded":"2024-09-12T19:23:09.186027+0000","last_fullsized":"2024-09-12T19:23:09.186027+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'307","last_scrub_stamp":"2024-09-12T19:23:09.185810+0000","last_deep_scrub":"267'307","last_deep_scrub_stamp":"2024-09-12T19:23:09.185810+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.185810+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:50.544329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":48689,"num_write":1045,"num_write_kb":32373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"267'4","reported_seq":1484,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.275059+0000","last_change":"2024-09-12T19:23:31.275059+0000","last_active":"2024-09-12T19:23:31.275059+0000","last_peered":"2024-09-12T19:23:31.275059+0000","last_clean":"2024-09-12T19:23:31.275059+0000","last_became_active":"2024-09-12T17:29:56.750915+0000","last_became_peered":"2024-09-12T17:29:56.750915+0000","last_unstale":"2024-09-12T19:23:31.275059+0000","last_undegraded":"2024-09-12T19:23:31.275059+0000","last_fullsized":"2024-09-12T19:23:31.275059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T19:23:31.274847+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T19:23:31.274847+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.274847+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:25.056431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'151","reported_seq":744,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.041887+0000","last_change":"2024-09-12T19:23:37.041887+0000","last_active":"2024-09-12T19:23:37.041887+0000","last_peered":"2024-09-12T19:23:37.041887+0000","last_clean":"2024-09-12T19:23:37.041887+0000","last_became_active":"2024-09-12T17:29:58.831628+0000","last_became_peered":"2024-09-12T17:29:58.831628+0000","last_unstale":"2024-09-12T19:23:37.041887+0000","last_undegraded":"2024-09-12T19:23:37.041887+0000","last_fullsized":"2024-09-12T19:23:37.041887+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'151","last_scrub_stamp":"2024-09-12T19:23:37.041661+0000","last_deep_scrub":"267'151","last_deep_scrub_stamp":"2024-09-12T19:23:37.041661+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.041661+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:39.506865+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'773","reported_seq":3254,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.215663+0000","last_change":"2024-09-12T19:23:26.215663+0000","last_active":"2024-09-12T19:23:26.215663+0000","last_peered":"2024-09-12T19:23:26.215663+0000","last_clean":"2024-09-12T19:23:26.215663+0000","last_became_active":"2024-09-12T17:30:00.806681+0000","last_became_peered":"2024-09-12T17:30:00.806681+0000","last_unstale":"2024-09-12T19:23:26.215663+0000","last_undegraded":"2024-09-12T19:23:26.215663+0000","last_fullsized":"2024-09-12T19:23:26.215663+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'773","last_scrub_stamp":"2024-09-12T19:23:26.215444+0000","last_deep_scrub":"267'773","last_deep_scrub_stamp":"2024-09-12T19:23:26.215444+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.215444+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":701,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:50.424909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'120","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.056467+0000","last_change":"2024-09-12T19:23:43.056467+0000","last_active":"2024-09-12T19:23:43.056467+0000","last_peered":"2024-09-12T19:23:43.056467+0000","last_clean":"2024-09-12T19:23:43.056467+0000","last_became_active":"2024-09-12T17:30:02.805954+0000","last_became_peered":"2024-09-12T17:30:02.805954+0000","last_unstale":"2024-09-12T19:23:43.056467+0000","last_undegraded":"2024-09-12T19:23:43.056467+0000","last_fullsized":"2024-09-12T19:23:43.056467+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'120","last_scrub_stamp":"2024-09-12T19:23:43.056284+0000","last_deep_scrub":"267'120","last_deep_scrub_stamp":"2024-09-12T19:23:43.056284+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.056284+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:11.535350+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":135,"num_write":268,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'521","reported_seq":2066,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.716900+0000","last_change":"2024-09-12T19:23:18.716900+0000","last_active":"2024-09-12T19:23:18.716900+0000","last_peered":"2024-09-12T19:23:18.716900+0000","last_clean":"2024-09-12T19:23:18.716900+0000","last_became_active":"2024-09-12T17:29:54.755550+0000","last_became_peered":"2024-09-12T17:29:54.755550+0000","last_unstale":"2024-09-12T19:23:18.716900+0000","last_undegraded":"2024-09-12T19:23:18.716900+0000","last_fullsized":"2024-09-12T19:23:18.716900+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'521","last_scrub_stamp":"2024-09-12T19:23:18.716720+0000","last_deep_scrub":"267'521","last_deep_scrub_stamp":"2024-09-12T19:23:18.716720+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.716720+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:37.752618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2775,"num_read_kb":2556,"num_write":676,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'376","reported_seq":1080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.210414+0000","last_change":"2024-09-12T19:23:09.210414+0000","last_active":"2024-09-12T19:23:09.210414+0000","last_peered":"2024-09-12T19:23:09.210414+0000","last_clean":"2024-09-12T19:23:09.210414+0000","last_became_active":"2024-09-12T17:30:21.696077+0000","last_became_peered":"2024-09-12T17:30:21.696077+0000","last_unstale":"2024-09-12T19:23:09.210414+0000","last_undegraded":"2024-09-12T19:23:09.210414+0000","last_fullsized":"2024-09-12T19:23:09.210414+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'376","last_scrub_stamp":"2024-09-12T19:23:09.210184+0000","last_deep_scrub":"267'376","last_deep_scrub_stamp":"2024-09-12T19:23:09.210184+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.210184+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:47.241745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":12866,"num_write":1197,"num_write_kb":34720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.184206+0000","last_change":"2024-09-12T19:23:30.184206+0000","last_active":"2024-09-12T19:23:30.184206+0000","last_peered":"2024-09-12T19:23:30.184206+0000","last_clean":"2024-09-12T19:23:30.184206+0000","last_became_active":"2024-09-12T17:29:56.757728+0000","last_became_peered":"2024-09-12T17:29:56.757728+0000","last_unstale":"2024-09-12T19:23:30.184206+0000","last_undegraded":"2024-09-12T19:23:30.184206+0000","last_fullsized":"2024-09-12T19:23:30.184206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:30.184021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:30.184021+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.184021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:39.958678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'425","reported_seq":1111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.253848+0000","last_change":"2024-09-12T19:23:35.253848+0000","last_active":"2024-09-12T19:23:35.253848+0000","last_peered":"2024-09-12T19:23:35.253848+0000","last_clean":"2024-09-12T19:23:35.253848+0000","last_became_active":"2024-09-12T17:29:58.776033+0000","last_became_peered":"2024-09-12T17:29:58.776033+0000","last_unstale":"2024-09-12T19:23:35.253848+0000","last_undegraded":"2024-09-12T19:23:35.253848+0000","last_fullsized":"2024-09-12T19:23:35.253848+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'425","last_scrub_stamp":"2024-09-12T19:23:35.253485+0000","last_deep_scrub":"267'425","last_deep_scrub_stamp":"2024-09-12T19:23:35.253485+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.253485+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:26.115780+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47722,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":665,"num_read_kb":1193,"num_write":496,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.210780+0000","last_change":"2024-09-12T19:23:25.210780+0000","last_active":"2024-09-12T19:23:25.210780+0000","last_peered":"2024-09-12T19:23:25.210780+0000","last_clean":"2024-09-12T19:23:25.210780+0000","last_became_active":"2024-09-12T17:30:00.792687+0000","last_became_peered":"2024-09-12T17:30:00.792687+0000","last_unstale":"2024-09-12T19:23:25.210780+0000","last_undegraded":"2024-09-12T19:23:25.210780+0000","last_fullsized":"2024-09-12T19:23:25.210780+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:25.210462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:25.210462+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.210462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:31.054537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'167","reported_seq":706,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.651594+0000","last_change":"2024-09-12T19:23:33.651594+0000","last_active":"2024-09-12T19:23:33.651594+0000","last_peered":"2024-09-12T19:23:33.651594+0000","last_clean":"2024-09-12T19:23:33.651594+0000","last_became_active":"2024-09-12T17:30:02.809252+0000","last_became_peered":"2024-09-12T17:30:02.809252+0000","last_unstale":"2024-09-12T19:23:33.651594+0000","last_undegraded":"2024-09-12T19:23:33.651594+0000","last_fullsized":"2024-09-12T19:23:33.651594+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'167","last_scrub_stamp":"2024-09-12T19:23:33.651391+0000","last_deep_scrub":"267'167","last_deep_scrub_stamp":"2024-09-12T19:23:33.651391+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.651391+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:24.162865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":242,"num_read_kb":230,"num_write":407,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'457","reported_seq":1891,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.227830+0000","last_change":"2024-09-12T19:23:16.227830+0000","last_active":"2024-09-12T19:23:16.227830+0000","last_peered":"2024-09-12T19:23:16.227830+0000","last_clean":"2024-09-12T19:23:16.227830+0000","last_became_active":"2024-09-12T17:29:54.771538+0000","last_became_peered":"2024-09-12T17:29:54.771538+0000","last_unstale":"2024-09-12T19:23:16.227830+0000","last_undegraded":"2024-09-12T19:23:16.227830+0000","last_fullsized":"2024-09-12T19:23:16.227830+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'457","last_scrub_stamp":"2024-09-12T19:23:16.227601+0000","last_deep_scrub":"267'457","last_deep_scrub_stamp":"2024-09-12T19:23:16.227601+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.227601+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:42.639886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2249,"num_read_kb":2075,"num_write":554,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.928597+0000","last_change":"2024-09-12T19:23:09.928447+0000","last_active":"2024-09-12T19:23:09.928597+0000","last_peered":"2024-09-12T19:23:09.928597+0000","last_clean":"2024-09-12T19:23:09.928597+0000","last_became_active":"2024-09-12T17:29:30.601518+0000","last_became_peered":"2024-09-12T17:29:30.601518+0000","last_unstale":"2024-09-12T19:23:09.928597+0000","last_undegraded":"2024-09-12T19:23:09.928597+0000","last_fullsized":"2024-09-12T19:23:09.928597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-12T19:23:09.928248+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-12T19:23:09.928248+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.928248+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:35.888829+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.259855+0000","last_change":"2024-09-12T19:23:10.259855+0000","last_active":"2024-09-12T19:23:10.259855+0000","last_peered":"2024-09-12T19:23:10.259855+0000","last_clean":"2024-09-12T19:23:10.259855+0000","last_became_active":"2024-09-12T17:29:35.340342+0000","last_became_peered":"2024-09-12T17:29:35.340342+0000","last_unstale":"2024-09-12T19:23:10.259855+0000","last_undegraded":"2024-09-12T19:23:10.259855+0000","last_fullsized":"2024-09-12T19:23:10.259855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:10.259670+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:10.259670+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.259670+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:38.403829+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.00097602599999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'336","reported_seq":1026,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:08.204936+0000","last_change":"2024-09-12T19:23:08.204936+0000","last_active":"2024-09-12T19:23:08.204936+0000","last_peered":"2024-09-12T19:23:08.204936+0000","last_clean":"2024-09-12T19:23:08.204936+0000","last_became_active":"2024-09-12T17:29:52.765497+0000","last_became_peered":"2024-09-12T17:29:52.765497+0000","last_unstale":"2024-09-12T19:23:08.204936+0000","last_undegraded":"2024-09-12T19:23:08.204936+0000","last_fullsized":"2024-09-12T19:23:08.204936+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-12T19:23:08.204778+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-12T19:23:08.204778+0000","last_clean_scrub_stamp":"2024-09-12T19:23:08.204778+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:46.017915+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2167098,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":533,"num_read_kb":15769,"num_write":1043,"num_write_kb":23964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.078540+0000","last_change":"2024-09-12T19:23:26.078540+0000","last_active":"2024-09-12T19:23:26.078540+0000","last_peered":"2024-09-12T19:23:26.078540+0000","last_clean":"2024-09-12T19:23:26.078540+0000","last_became_active":"2024-09-12T17:29:56.749938+0000","last_became_peered":"2024-09-12T17:29:56.749938+0000","last_unstale":"2024-09-12T19:23:26.078540+0000","last_undegraded":"2024-09-12T19:23:26.078540+0000","last_fullsized":"2024-09-12T19:23:26.078540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:26.078358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:26.078358+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.078358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:45.805777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'804","reported_seq":1556,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.284313+0000","last_change":"2024-09-12T19:23:33.284313+0000","last_active":"2024-09-12T19:23:33.284313+0000","last_peered":"2024-09-12T19:23:33.284313+0000","last_clean":"2024-09-12T19:23:33.284313+0000","last_became_active":"2024-09-12T17:29:58.769277+0000","last_became_peered":"2024-09-12T17:29:58.769277+0000","last_unstale":"2024-09-12T19:23:33.284313+0000","last_undegraded":"2024-09-12T19:23:33.284313+0000","last_fullsized":"2024-09-12T19:23:33.284313+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'804","last_scrub_stamp":"2024-09-12T19:23:33.284129+0000","last_deep_scrub":"267'804","last_deep_scrub_stamp":"2024-09-12T19:23:33.284129+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.284129+0000","objects_scrubbed":6,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:19.887143+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159898,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1560,"num_read_kb":3538,"num_write":1488,"num_write_kb":1318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89338,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.804403+0000","last_change":"2024-09-12T19:23:35.804403+0000","last_active":"2024-09-12T19:23:35.804403+0000","last_peered":"2024-09-12T19:23:35.804403+0000","last_clean":"2024-09-12T19:23:35.804403+0000","last_became_active":"2024-09-12T17:30:00.799883+0000","last_became_peered":"2024-09-12T17:30:00.799883+0000","last_unstale":"2024-09-12T19:23:35.804403+0000","last_undegraded":"2024-09-12T19:23:35.804403+0000","last_fullsized":"2024-09-12T19:23:35.804403+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:35.804163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:35.804163+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.804163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:13.337181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'201","reported_seq":936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.358243+0000","last_change":"2024-09-12T19:23:32.358243+0000","last_active":"2024-09-12T19:23:32.358243+0000","last_peered":"2024-09-12T19:23:32.358243+0000","last_clean":"2024-09-12T19:23:32.358243+0000","last_became_active":"2024-09-12T17:30:02.799307+0000","last_became_peered":"2024-09-12T17:30:02.799307+0000","last_unstale":"2024-09-12T19:23:32.358243+0000","last_undegraded":"2024-09-12T19:23:32.358243+0000","last_fullsized":"2024-09-12T19:23:32.358243+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-12T19:23:32.358039+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-12T19:23:32.358039+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.358039+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:54.479773+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1000,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":467,"num_write":393,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'477","reported_seq":2046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.883431+0000","last_change":"2024-09-12T19:23:13.883431+0000","last_active":"2024-09-12T19:23:13.883431+0000","last_peered":"2024-09-12T19:23:13.883431+0000","last_clean":"2024-09-12T19:23:13.883431+0000","last_became_active":"2024-09-12T17:29:54.758196+0000","last_became_peered":"2024-09-12T17:29:54.758196+0000","last_unstale":"2024-09-12T19:23:13.883431+0000","last_undegraded":"2024-09-12T19:23:13.883431+0000","last_fullsized":"2024-09-12T19:23:13.883431+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'477","last_scrub_stamp":"2024-09-12T19:23:13.883243+0000","last_deep_scrub":"267'477","last_deep_scrub_stamp":"2024-09-12T19:23:13.883243+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.883243+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:38.406363+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2778,"num_read_kb":2582,"num_write":658,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.930844+0000","last_change":"2024-09-12T19:23:10.930668+0000","last_active":"2024-09-12T19:23:10.930844+0000","last_peered":"2024-09-12T19:23:10.930844+0000","last_clean":"2024-09-12T19:23:10.930844+0000","last_became_active":"2024-09-12T17:29:35.336475+0000","last_became_peered":"2024-09-12T17:29:35.336475+0000","last_unstale":"2024-09-12T19:23:10.930844+0000","last_undegraded":"2024-09-12T19:23:10.930844+0000","last_fullsized":"2024-09-12T19:23:10.930844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:10.930485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:10.930485+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.930485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:54.374314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012883599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'346","reported_seq":1079,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.866118+0000","last_change":"2024-09-12T19:23:09.866118+0000","last_active":"2024-09-12T19:23:09.866118+0000","last_peered":"2024-09-12T19:23:09.866118+0000","last_clean":"2024-09-12T19:23:09.866118+0000","last_became_active":"2024-09-12T17:29:52.766251+0000","last_became_peered":"2024-09-12T17:29:52.766251+0000","last_unstale":"2024-09-12T19:23:09.866118+0000","last_undegraded":"2024-09-12T19:23:09.866118+0000","last_fullsized":"2024-09-12T19:23:09.866118+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-09-12T19:23:09.865739+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-09-12T19:23:09.865739+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.865739+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:30.064297+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730134,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":595,"num_read_kb":84420,"num_write":1189,"num_write_kb":23129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.361544+0000","last_change":"2024-09-12T19:23:28.361544+0000","last_active":"2024-09-12T19:23:28.361544+0000","last_peered":"2024-09-12T19:23:28.361544+0000","last_clean":"2024-09-12T19:23:28.361544+0000","last_became_active":"2024-09-12T17:29:56.762451+0000","last_became_peered":"2024-09-12T17:29:56.762451+0000","last_unstale":"2024-09-12T19:23:28.361544+0000","last_undegraded":"2024-09-12T19:23:28.361544+0000","last_fullsized":"2024-09-12T19:23:28.361544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:28.361367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:28.361367+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.361367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:29.878422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1467","reported_seq":3824,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.687095+0000","last_change":"2024-09-12T19:23:28.687095+0000","last_active":"2024-09-12T19:23:28.687095+0000","last_peered":"2024-09-12T19:23:28.687095+0000","last_clean":"2024-09-12T19:23:28.687095+0000","last_became_active":"2024-09-12T17:29:58.771561+0000","last_became_peered":"2024-09-12T17:29:58.771561+0000","last_unstale":"2024-09-12T19:23:28.687095+0000","last_undegraded":"2024-09-12T19:23:28.687095+0000","last_fullsized":"2024-09-12T19:23:28.687095+0000","mapping_epoch":32,"log_start":"267'1400","ondisk_log_start":"267'1400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1467","last_scrub_stamp":"2024-09-12T19:23:28.686903+0000","last_deep_scrub":"267'1467","last_deep_scrub_stamp":"2024-09-12T19:23:28.686903+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.686903+0000","objects_scrubbed":11,"log_size":67,"log_dups_size":1400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:38.779259+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146977,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2279,"num_read_kb":4182,"num_write":1388,"num_write_kb":1130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.107674+0000","last_change":"2024-09-12T19:23:36.107674+0000","last_active":"2024-09-12T19:23:36.107674+0000","last_peered":"2024-09-12T19:23:36.107674+0000","last_clean":"2024-09-12T19:23:36.107674+0000","last_became_active":"2024-09-12T17:30:00.806030+0000","last_became_peered":"2024-09-12T17:30:00.806030+0000","last_unstale":"2024-09-12T19:23:36.107674+0000","last_undegraded":"2024-09-12T19:23:36.107674+0000","last_fullsized":"2024-09-12T19:23:36.107674+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:36.107355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:36.107355+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.107355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:31.839594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'219","reported_seq":771,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.671259+0000","last_change":"2024-09-12T19:23:36.671259+0000","last_active":"2024-09-12T19:23:36.671259+0000","last_peered":"2024-09-12T19:23:36.671259+0000","last_clean":"2024-09-12T19:23:36.671259+0000","last_became_active":"2024-09-12T17:30:02.809372+0000","last_became_peered":"2024-09-12T17:30:02.809372+0000","last_unstale":"2024-09-12T19:23:36.671259+0000","last_undegraded":"2024-09-12T19:23:36.671259+0000","last_fullsized":"2024-09-12T19:23:36.671259+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'219","last_scrub_stamp":"2024-09-12T19:23:36.671063+0000","last_deep_scrub":"267'219","last_deep_scrub_stamp":"2024-09-12T19:23:36.671063+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.671063+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:43.095477+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":353,"num_read_kb":353,"num_write":469,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'467","reported_seq":2059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.685511+0000","last_change":"2024-09-12T19:23:14.685511+0000","last_active":"2024-09-12T19:23:14.685511+0000","last_peered":"2024-09-12T19:23:14.685511+0000","last_clean":"2024-09-12T19:23:14.685511+0000","last_became_active":"2024-09-12T17:29:54.747270+0000","last_became_peered":"2024-09-12T17:29:54.747270+0000","last_unstale":"2024-09-12T19:23:14.685511+0000","last_undegraded":"2024-09-12T19:23:14.685511+0000","last_fullsized":"2024-09-12T19:23:14.685511+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'467","last_scrub_stamp":"2024-09-12T19:23:14.685322+0000","last_deep_scrub":"267'467","last_deep_scrub_stamp":"2024-09-12T19:23:14.685322+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.685322+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:35.304389+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2522,"num_read_kb":2358,"num_write":589,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":572,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.974668+0000","last_change":"2024-09-12T19:23:09.974668+0000","last_active":"2024-09-12T19:23:09.974668+0000","last_peered":"2024-09-12T19:23:09.974668+0000","last_clean":"2024-09-12T19:23:09.974668+0000","last_became_active":"2024-09-12T17:29:35.331504+0000","last_became_peered":"2024-09-12T17:29:35.331504+0000","last_unstale":"2024-09-12T19:23:09.974668+0000","last_undegraded":"2024-09-12T19:23:09.974668+0000","last_fullsized":"2024-09-12T19:23:09.974668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:09.974482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:09.974482+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.974482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:21.285772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001034428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'347","reported_seq":991,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:07.691765+0000","last_change":"2024-09-12T19:23:07.691765+0000","last_active":"2024-09-12T19:23:07.691765+0000","last_peered":"2024-09-12T19:23:07.691765+0000","last_clean":"2024-09-12T19:23:07.691765+0000","last_became_active":"2024-09-12T17:29:52.741209+0000","last_became_peered":"2024-09-12T17:29:52.741209+0000","last_unstale":"2024-09-12T19:23:07.691765+0000","last_undegraded":"2024-09-12T19:23:07.691765+0000","last_fullsized":"2024-09-12T19:23:07.691765+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'347","last_scrub_stamp":"2024-09-12T19:23:07.691644+0000","last_deep_scrub":"267'347","last_deep_scrub_stamp":"2024-09-12T19:23:07.691644+0000","last_clean_scrub_stamp":"2024-09-12T19:23:07.691644+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:20.196315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":451,"num_read_kb":5499,"num_write":979,"num_write_kb":15070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":545,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.942556+0000","last_change":"2024-09-12T19:23:17.942556+0000","last_active":"2024-09-12T19:23:17.942556+0000","last_peered":"2024-09-12T19:23:17.942556+0000","last_clean":"2024-09-12T19:23:17.942556+0000","last_became_active":"2024-09-12T17:29:56.753063+0000","last_became_peered":"2024-09-12T17:29:56.753063+0000","last_unstale":"2024-09-12T19:23:17.942556+0000","last_undegraded":"2024-09-12T19:23:17.942556+0000","last_fullsized":"2024-09-12T19:23:17.942556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:17.942378+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:17.942378+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.942378+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:50.587264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'376","reported_seq":2333,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.109008+0000","last_change":"2024-09-12T19:23:34.109008+0000","last_active":"2024-09-12T19:23:34.109008+0000","last_peered":"2024-09-12T19:23:34.109008+0000","last_clean":"2024-09-12T19:23:34.109008+0000","last_became_active":"2024-09-12T17:29:58.834447+0000","last_became_peered":"2024-09-12T17:29:58.834447+0000","last_unstale":"2024-09-12T19:23:34.109008+0000","last_undegraded":"2024-09-12T19:23:34.109008+0000","last_fullsized":"2024-09-12T19:23:34.109008+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'376","last_scrub_stamp":"2024-09-12T19:23:34.108814+0000","last_deep_scrub":"267'376","last_deep_scrub_stamp":"2024-09-12T19:23:34.108814+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.108814+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:43.158205+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":368,"num_read_kb":360,"num_write":359,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.795321+0000","last_change":"2024-09-12T19:23:34.795321+0000","last_active":"2024-09-12T19:23:34.795321+0000","last_peered":"2024-09-12T19:23:34.795321+0000","last_clean":"2024-09-12T19:23:34.795321+0000","last_became_active":"2024-09-12T17:30:00.778134+0000","last_became_peered":"2024-09-12T17:30:00.778134+0000","last_unstale":"2024-09-12T19:23:34.795321+0000","last_undegraded":"2024-09-12T19:23:34.795321+0000","last_fullsized":"2024-09-12T19:23:34.795321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:34.795145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:34.795145+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.795145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:05.761948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'272","reported_seq":923,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:46.097251+0000","last_change":"2024-09-12T19:23:46.097251+0000","last_active":"2024-09-12T19:23:46.097251+0000","last_peered":"2024-09-12T19:23:46.097251+0000","last_clean":"2024-09-12T19:23:46.097251+0000","last_became_active":"2024-09-12T17:30:02.805090+0000","last_became_peered":"2024-09-12T17:30:02.805090+0000","last_unstale":"2024-09-12T19:23:46.097251+0000","last_undegraded":"2024-09-12T19:23:46.097251+0000","last_fullsized":"2024-09-12T19:23:46.097251+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'272","last_scrub_stamp":"2024-09-12T19:23:46.097005+0000","last_deep_scrub":"267'272","last_deep_scrub_stamp":"2024-09-12T19:23:46.097005+0000","last_clean_scrub_stamp":"2024-09-12T19:23:46.097005+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:07.690681+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":596,"num_read_kb":605,"num_write":610,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'411","reported_seq":1966,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.669552+0000","last_change":"2024-09-12T19:23:20.669552+0000","last_active":"2024-09-12T19:23:20.669552+0000","last_peered":"2024-09-12T19:23:20.669552+0000","last_clean":"2024-09-12T19:23:20.669552+0000","last_became_active":"2024-09-12T17:29:54.745423+0000","last_became_peered":"2024-09-12T17:29:54.745423+0000","last_unstale":"2024-09-12T19:23:20.669552+0000","last_undegraded":"2024-09-12T19:23:20.669552+0000","last_fullsized":"2024-09-12T19:23:20.669552+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'411","last_scrub_stamp":"2024-09-12T19:23:20.669299+0000","last_deep_scrub":"267'411","last_deep_scrub_stamp":"2024-09-12T19:23:20.669299+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.669299+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:50.595760+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2154,"num_read_kb":2073,"num_write":474,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":562,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.235866+0000","last_change":"2024-09-12T19:23:12.235866+0000","last_active":"2024-09-12T19:23:12.235866+0000","last_peered":"2024-09-12T19:23:12.235866+0000","last_clean":"2024-09-12T19:23:12.235866+0000","last_became_active":"2024-09-12T17:29:35.340113+0000","last_became_peered":"2024-09-12T17:29:35.340113+0000","last_unstale":"2024-09-12T19:23:12.235866+0000","last_undegraded":"2024-09-12T19:23:12.235866+0000","last_fullsized":"2024-09-12T19:23:12.235866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:12.235689+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:12.235689+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.235689+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:20.303471+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0020086050000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'366","reported_seq":1122,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:08.225908+0000","last_change":"2024-09-12T19:23:08.225908+0000","last_active":"2024-09-12T19:23:08.225908+0000","last_peered":"2024-09-12T19:23:08.225908+0000","last_clean":"2024-09-12T19:23:08.225908+0000","last_became_active":"2024-09-12T17:29:52.759957+0000","last_became_peered":"2024-09-12T17:29:52.759957+0000","last_unstale":"2024-09-12T19:23:08.225908+0000","last_undegraded":"2024-09-12T19:23:08.225908+0000","last_fullsized":"2024-09-12T19:23:08.225908+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'366","last_scrub_stamp":"2024-09-12T19:23:08.225657+0000","last_deep_scrub":"267'366","last_deep_scrub_stamp":"2024-09-12T19:23:08.225657+0000","last_clean_scrub_stamp":"2024-09-12T19:23:08.225657+0000","objects_scrubbed":10,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:08.296014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279708,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":651,"num_read_kb":39253,"num_write":1178,"num_write_kb":45869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.816409+0000","last_change":"2024-09-12T19:23:20.816409+0000","last_active":"2024-09-12T19:23:20.816409+0000","last_peered":"2024-09-12T19:23:20.816409+0000","last_clean":"2024-09-12T19:23:20.816409+0000","last_became_active":"2024-09-12T17:29:56.765361+0000","last_became_peered":"2024-09-12T17:29:56.765361+0000","last_unstale":"2024-09-12T19:23:20.816409+0000","last_undegraded":"2024-09-12T19:23:20.816409+0000","last_fullsized":"2024-09-12T19:23:20.816409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:20.816187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:20.816187+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.816187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:19:00.594416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'217","reported_seq":840,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.055445+0000","last_change":"2024-09-12T19:23:35.055445+0000","last_active":"2024-09-12T19:23:35.055445+0000","last_peered":"2024-09-12T19:23:35.055445+0000","last_clean":"2024-09-12T19:23:35.055445+0000","last_became_active":"2024-09-12T17:29:58.768596+0000","last_became_peered":"2024-09-12T17:29:58.768596+0000","last_unstale":"2024-09-12T19:23:35.055445+0000","last_undegraded":"2024-09-12T19:23:35.055445+0000","last_fullsized":"2024-09-12T19:23:35.055445+0000","mapping_epoch":32,"log_start":"267'201","ondisk_log_start":"267'201","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'217","last_scrub_stamp":"2024-09-12T19:23:35.055130+0000","last_deep_scrub":"267'217","last_deep_scrub_stamp":"2024-09-12T19:23:35.055130+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.055130+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":201,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:05.111750+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.237039+0000","last_change":"2024-09-12T19:23:24.237039+0000","last_active":"2024-09-12T19:23:24.237039+0000","last_peered":"2024-09-12T19:23:24.237039+0000","last_clean":"2024-09-12T19:23:24.237039+0000","last_became_active":"2024-09-12T17:30:00.788505+0000","last_became_peered":"2024-09-12T17:30:00.788505+0000","last_unstale":"2024-09-12T19:23:24.237039+0000","last_undegraded":"2024-09-12T19:23:24.237039+0000","last_fullsized":"2024-09-12T19:23:24.237039+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:24.236855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:24.236855+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.236855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:04:51.530055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'157","reported_seq":745,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.323482+0000","last_change":"2024-09-12T19:23:40.323482+0000","last_active":"2024-09-12T19:23:40.323482+0000","last_peered":"2024-09-12T19:23:40.323482+0000","last_clean":"2024-09-12T19:23:40.323482+0000","last_became_active":"2024-09-12T17:30:02.794703+0000","last_became_peered":"2024-09-12T17:30:02.794703+0000","last_unstale":"2024-09-12T19:23:40.323482+0000","last_undegraded":"2024-09-12T19:23:40.323482+0000","last_fullsized":"2024-09-12T19:23:40.323482+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'157","last_scrub_stamp":"2024-09-12T19:23:40.323277+0000","last_deep_scrub":"267'157","last_deep_scrub_stamp":"2024-09-12T19:23:40.323277+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.323277+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:18.158223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":268,"num_read_kb":254,"num_write":347,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'419","reported_seq":2024,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.689299+0000","last_change":"2024-09-12T19:23:11.689299+0000","last_active":"2024-09-12T19:23:11.689299+0000","last_peered":"2024-09-12T19:23:11.689299+0000","last_clean":"2024-09-12T19:23:11.689299+0000","last_became_active":"2024-09-12T17:29:54.766275+0000","last_became_peered":"2024-09-12T17:29:54.766275+0000","last_unstale":"2024-09-12T19:23:11.689299+0000","last_undegraded":"2024-09-12T19:23:11.689299+0000","last_fullsized":"2024-09-12T19:23:11.689299+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'419","last_scrub_stamp":"2024-09-12T19:23:11.689112+0000","last_deep_scrub":"267'419","last_deep_scrub_stamp":"2024-09-12T19:23:11.689112+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.689112+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:41.829755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2280,"num_read_kb":2171,"num_write":482,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'349","reported_seq":1034,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.235471+0000","last_change":"2024-09-12T19:23:09.235471+0000","last_active":"2024-09-12T19:23:09.235471+0000","last_peered":"2024-09-12T19:23:09.235471+0000","last_clean":"2024-09-12T19:23:09.235471+0000","last_became_active":"2024-09-12T17:29:52.740544+0000","last_became_peered":"2024-09-12T17:29:52.740544+0000","last_unstale":"2024-09-12T19:23:09.235471+0000","last_undegraded":"2024-09-12T19:23:09.235471+0000","last_fullsized":"2024-09-12T19:23:09.235471+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-12T19:23:09.235171+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-12T19:23:09.235171+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.235171+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:19.968121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":6019,"num_write":1130,"num_write_kb":22769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":562,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:08.639498+0000","last_change":"2024-09-12T19:23:08.639498+0000","last_active":"2024-09-12T19:23:08.639498+0000","last_peered":"2024-09-12T19:23:08.639498+0000","last_clean":"2024-09-12T19:23:08.639498+0000","last_became_active":"2024-09-12T17:29:35.407492+0000","last_became_peered":"2024-09-12T17:29:35.407492+0000","last_unstale":"2024-09-12T19:23:08.639498+0000","last_undegraded":"2024-09-12T19:23:08.639498+0000","last_fullsized":"2024-09-12T19:23:08.639498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:08.639425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:08.639425+0000","last_clean_scrub_stamp":"2024-09-12T19:23:08.639425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:59.907415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098134900000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.803905+0000","last_change":"2024-09-12T19:23:31.803905+0000","last_active":"2024-09-12T19:23:31.803905+0000","last_peered":"2024-09-12T19:23:31.803905+0000","last_clean":"2024-09-12T19:23:31.803905+0000","last_became_active":"2024-09-12T17:29:56.769344+0000","last_became_peered":"2024-09-12T17:29:56.769344+0000","last_unstale":"2024-09-12T19:23:31.803905+0000","last_undegraded":"2024-09-12T19:23:31.803905+0000","last_fullsized":"2024-09-12T19:23:31.803905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:31.803722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:31.803722+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.803722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:40.239034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'771","reported_seq":1519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.838550+0000","last_change":"2024-09-12T19:23:24.838550+0000","last_active":"2024-09-12T19:23:24.838550+0000","last_peered":"2024-09-12T19:23:24.838550+0000","last_clean":"2024-09-12T19:23:24.838550+0000","last_became_active":"2024-09-12T17:29:58.766353+0000","last_became_peered":"2024-09-12T17:29:58.766353+0000","last_unstale":"2024-09-12T19:23:24.838550+0000","last_undegraded":"2024-09-12T19:23:24.838550+0000","last_fullsized":"2024-09-12T19:23:24.838550+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'771","last_scrub_stamp":"2024-09-12T19:23:24.838217+0000","last_deep_scrub":"267'771","last_deep_scrub_stamp":"2024-09-12T19:23:24.838217+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.838217+0000","objects_scrubbed":10,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:30.026559+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88446,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1874,"num_read_kb":3148,"num_write":2424,"num_write_kb":2173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":501744,"num_omap_keys":1138,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.128408+0000","last_change":"2024-09-12T19:23:37.128408+0000","last_active":"2024-09-12T19:23:37.128408+0000","last_peered":"2024-09-12T19:23:37.128408+0000","last_clean":"2024-09-12T19:23:37.128408+0000","last_became_active":"2024-09-12T17:30:00.783385+0000","last_became_peered":"2024-09-12T17:30:00.783385+0000","last_unstale":"2024-09-12T19:23:37.128408+0000","last_undegraded":"2024-09-12T19:23:37.128408+0000","last_fullsized":"2024-09-12T19:23:37.128408+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:37.128205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:37.128205+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.128205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:07.825249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'149","reported_seq":685,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.722077+0000","last_change":"2024-09-12T19:23:40.722077+0000","last_active":"2024-09-12T19:23:40.722077+0000","last_peered":"2024-09-12T19:23:40.722077+0000","last_clean":"2024-09-12T19:23:40.722077+0000","last_became_active":"2024-09-12T17:30:02.805684+0000","last_became_peered":"2024-09-12T17:30:02.805684+0000","last_unstale":"2024-09-12T19:23:40.722077+0000","last_undegraded":"2024-09-12T19:23:40.722077+0000","last_fullsized":"2024-09-12T19:23:40.722077+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'149","last_scrub_stamp":"2024-09-12T19:23:40.721838+0000","last_deep_scrub":"267'149","last_deep_scrub_stamp":"2024-09-12T19:23:40.721838+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.721838+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:59.142442+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":165,"num_read_kb":163,"num_write":341,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'407","reported_seq":1916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.843610+0000","last_change":"2024-09-12T19:23:23.843610+0000","last_active":"2024-09-12T19:23:23.843610+0000","last_peered":"2024-09-12T19:23:23.843610+0000","last_clean":"2024-09-12T19:23:23.843610+0000","last_became_active":"2024-09-12T17:29:54.758047+0000","last_became_peered":"2024-09-12T17:29:54.758047+0000","last_unstale":"2024-09-12T19:23:23.843610+0000","last_undegraded":"2024-09-12T19:23:23.843610+0000","last_fullsized":"2024-09-12T19:23:23.843610+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'407","last_scrub_stamp":"2024-09-12T19:23:23.843421+0000","last_deep_scrub":"267'407","last_deep_scrub_stamp":"2024-09-12T19:23:23.843421+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.843421+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:49.696068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2269,"num_read_kb":2144,"num_write":466,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1732,"num_omap_keys":7,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'307","reported_seq":1193,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.655275+0000","last_change":"2024-09-12T19:23:10.655275+0000","last_active":"2024-09-12T19:23:10.655275+0000","last_peered":"2024-09-12T19:23:10.655275+0000","last_clean":"2024-09-12T19:23:10.655275+0000","last_became_active":"2024-09-12T17:29:52.727635+0000","last_became_peered":"2024-09-12T17:29:52.727635+0000","last_unstale":"2024-09-12T19:23:10.655275+0000","last_undegraded":"2024-09-12T19:23:10.655275+0000","last_fullsized":"2024-09-12T19:23:10.655275+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'307","last_scrub_stamp":"2024-09-12T19:23:10.655045+0000","last_deep_scrub":"267'307","last_deep_scrub_stamp":"2024-09-12T19:23:10.655045+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.655045+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:43.716739+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109709,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":897,"num_read_kb":32569,"num_write":1024,"num_write_kb":39553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":558,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.972190+0000","last_change":"2024-09-12T19:23:11.972190+0000","last_active":"2024-09-12T19:23:11.972190+0000","last_peered":"2024-09-12T19:23:11.972190+0000","last_clean":"2024-09-12T19:23:11.972190+0000","last_became_active":"2024-09-12T17:29:35.406653+0000","last_became_peered":"2024-09-12T17:29:35.406653+0000","last_unstale":"2024-09-12T19:23:11.972190+0000","last_undegraded":"2024-09-12T19:23:11.972190+0000","last_fullsized":"2024-09-12T19:23:11.972190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:11.972019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:11.972019+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.972019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:02.613400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001315566,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.209747+0000","last_change":"2024-09-12T19:23:21.209747+0000","last_active":"2024-09-12T19:23:21.209747+0000","last_peered":"2024-09-12T19:23:21.209747+0000","last_clean":"2024-09-12T19:23:21.209747+0000","last_became_active":"2024-09-12T17:29:56.769576+0000","last_became_peered":"2024-09-12T17:29:56.769576+0000","last_unstale":"2024-09-12T19:23:21.209747+0000","last_undegraded":"2024-09-12T19:23:21.209747+0000","last_fullsized":"2024-09-12T19:23:21.209747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:21.209539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:21.209539+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.209539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:58.220864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'345","reported_seq":992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.684786+0000","last_change":"2024-09-12T19:23:26.684786+0000","last_active":"2024-09-12T19:23:26.684786+0000","last_peered":"2024-09-12T19:23:26.684786+0000","last_clean":"2024-09-12T19:23:26.684786+0000","last_became_active":"2024-09-12T17:29:58.830993+0000","last_became_peered":"2024-09-12T17:29:58.830993+0000","last_unstale":"2024-09-12T19:23:26.684786+0000","last_undegraded":"2024-09-12T19:23:26.684786+0000","last_fullsized":"2024-09-12T19:23:26.684786+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'345","last_scrub_stamp":"2024-09-12T19:23:26.684582+0000","last_deep_scrub":"267'345","last_deep_scrub_stamp":"2024-09-12T19:23:26.684582+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.684582+0000","objects_scrubbed":8,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:39.601631+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":439,"num_read_kb":430,"num_write":418,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'792","reported_seq":3382,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.285075+0000","last_change":"2024-09-12T19:23:37.285075+0000","last_active":"2024-09-12T19:23:37.285075+0000","last_peered":"2024-09-12T19:23:37.285075+0000","last_clean":"2024-09-12T19:23:37.285075+0000","last_became_active":"2024-09-12T17:30:00.805059+0000","last_became_peered":"2024-09-12T17:30:00.805059+0000","last_unstale":"2024-09-12T19:23:37.285075+0000","last_undegraded":"2024-09-12T19:23:37.285075+0000","last_fullsized":"2024-09-12T19:23:37.285075+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'792","last_scrub_stamp":"2024-09-12T19:23:37.284894+0000","last_deep_scrub":"267'792","last_deep_scrub_stamp":"2024-09-12T19:23:37.284894+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.284894+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":701,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:14.596435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'140","reported_seq":688,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:49.038175+0000","last_change":"2024-09-12T19:23:49.038175+0000","last_active":"2024-09-12T19:23:49.038175+0000","last_peered":"2024-09-12T19:23:49.038175+0000","last_clean":"2024-09-12T19:23:49.038175+0000","last_became_active":"2024-09-12T17:30:02.803051+0000","last_became_peered":"2024-09-12T17:30:02.803051+0000","last_unstale":"2024-09-12T19:23:49.038175+0000","last_undegraded":"2024-09-12T19:23:49.038175+0000","last_fullsized":"2024-09-12T19:23:49.038175+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'140","last_scrub_stamp":"2024-09-12T19:23:49.037910+0000","last_deep_scrub":"267'140","last_deep_scrub_stamp":"2024-09-12T19:23:49.037910+0000","last_clean_scrub_stamp":"2024-09-12T19:23:49.037910+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:08.347288+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":726,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":188,"num_read_kb":177,"num_write":312,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'429","reported_seq":1977,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.137194+0000","last_change":"2024-09-12T19:23:20.137194+0000","last_active":"2024-09-12T19:23:20.137194+0000","last_peered":"2024-09-12T19:23:20.137194+0000","last_clean":"2024-09-12T19:23:20.137194+0000","last_became_active":"2024-09-12T17:29:54.762522+0000","last_became_peered":"2024-09-12T17:29:54.762522+0000","last_unstale":"2024-09-12T19:23:20.137194+0000","last_undegraded":"2024-09-12T19:23:20.137194+0000","last_fullsized":"2024-09-12T19:23:20.137194+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'429","last_scrub_stamp":"2024-09-12T19:23:20.136990+0000","last_deep_scrub":"267'429","last_deep_scrub_stamp":"2024-09-12T19:23:20.136990+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.136990+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:28.426663+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2273,"num_read_kb":2141,"num_write":510,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'293","reported_seq":929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.212947+0000","last_change":"2024-09-12T19:23:11.212947+0000","last_active":"2024-09-12T19:23:11.212947+0000","last_peered":"2024-09-12T19:23:11.212947+0000","last_clean":"2024-09-12T19:23:11.212947+0000","last_became_active":"2024-09-12T17:29:52.716210+0000","last_became_peered":"2024-09-12T17:29:52.716210+0000","last_unstale":"2024-09-12T19:23:11.212947+0000","last_undegraded":"2024-09-12T19:23:11.212947+0000","last_fullsized":"2024-09-12T19:23:11.212947+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'293","last_scrub_stamp":"2024-09-12T19:23:11.212651+0000","last_deep_scrub":"267'293","last_deep_scrub_stamp":"2024-09-12T19:23:11.212651+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.212651+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:55.274163+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":379,"num_read_kb":381,"num_write":923,"num_write_kb":30307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":560,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:06.731459+0000","last_change":"2024-09-12T19:23:06.731459+0000","last_active":"2024-09-12T19:23:06.731459+0000","last_peered":"2024-09-12T19:23:06.731459+0000","last_clean":"2024-09-12T19:23:06.731459+0000","last_became_active":"2024-09-12T17:29:35.337987+0000","last_became_peered":"2024-09-12T17:29:35.337987+0000","last_unstale":"2024-09-12T19:23:06.731459+0000","last_undegraded":"2024-09-12T19:23:06.731459+0000","last_fullsized":"2024-09-12T19:23:06.731459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:06.731386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:06.731386+0000","last_clean_scrub_stamp":"2024-09-12T19:23:06.731386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:59.862051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011496340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"267'4","reported_seq":1023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.171871+0000","last_change":"2024-09-12T19:23:29.171871+0000","last_active":"2024-09-12T19:23:29.171871+0000","last_peered":"2024-09-12T19:23:29.171871+0000","last_clean":"2024-09-12T19:23:29.171871+0000","last_became_active":"2024-09-12T17:29:56.754415+0000","last_became_peered":"2024-09-12T17:29:56.754415+0000","last_unstale":"2024-09-12T19:23:29.171871+0000","last_undegraded":"2024-09-12T19:23:29.171871+0000","last_fullsized":"2024-09-12T19:23:29.171871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T19:23:29.171658+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T19:23:29.171658+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.171658+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:29.471306+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'181","reported_seq":795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.101183+0000","last_change":"2024-09-12T19:23:33.101183+0000","last_active":"2024-09-12T19:23:33.101183+0000","last_peered":"2024-09-12T19:23:33.101183+0000","last_clean":"2024-09-12T19:23:33.101183+0000","last_became_active":"2024-09-12T17:29:58.766420+0000","last_became_peered":"2024-09-12T17:29:58.766420+0000","last_unstale":"2024-09-12T19:23:33.101183+0000","last_undegraded":"2024-09-12T19:23:33.101183+0000","last_fullsized":"2024-09-12T19:23:33.101183+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-12T19:23:33.100998+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-12T19:23:33.100998+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.100998+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:29.936445+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":231,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'818","reported_seq":5013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.087415+0000","last_change":"2024-09-12T19:23:41.087415+0000","last_active":"2024-09-12T19:23:41.087415+0000","last_peered":"2024-09-12T19:23:41.087415+0000","last_clean":"2024-09-12T19:23:41.087415+0000","last_became_active":"2024-09-12T17:30:00.793234+0000","last_became_peered":"2024-09-12T17:30:00.793234+0000","last_unstale":"2024-09-12T19:23:41.087415+0000","last_undegraded":"2024-09-12T19:23:41.087415+0000","last_fullsized":"2024-09-12T19:23:41.087415+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'818","last_scrub_stamp":"2024-09-12T19:23:41.087229+0000","last_deep_scrub":"267'818","last_deep_scrub_stamp":"2024-09-12T19:23:41.087229+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.087229+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:59.784247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'190","reported_seq":735,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.713817+0000","last_change":"2024-09-12T19:23:42.713817+0000","last_active":"2024-09-12T19:23:42.713817+0000","last_peered":"2024-09-12T19:23:42.713817+0000","last_clean":"2024-09-12T19:23:42.713817+0000","last_became_active":"2024-09-12T17:30:02.799944+0000","last_became_peered":"2024-09-12T17:30:02.799944+0000","last_unstale":"2024-09-12T19:23:42.713817+0000","last_undegraded":"2024-09-12T19:23:42.713817+0000","last_fullsized":"2024-09-12T19:23:42.713817+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'190","last_scrub_stamp":"2024-09-12T19:23:42.713627+0000","last_deep_scrub":"267'190","last_deep_scrub_stamp":"2024-09-12T19:23:42.713627+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.713627+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:01.551556+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":199,"num_read_kb":188,"num_write":423,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'1237","reported_seq":2862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.247365+0000","last_change":"2024-09-12T19:23:13.247365+0000","last_active":"2024-09-12T19:23:13.247365+0000","last_peered":"2024-09-12T19:23:13.247365+0000","last_clean":"2024-09-12T19:23:13.247365+0000","last_became_active":"2024-09-12T17:29:54.751931+0000","last_became_peered":"2024-09-12T17:29:54.751931+0000","last_unstale":"2024-09-12T19:23:13.247365+0000","last_undegraded":"2024-09-12T19:23:13.247365+0000","last_fullsized":"2024-09-12T19:23:13.247365+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1237","last_scrub_stamp":"2024-09-12T19:23:13.247189+0000","last_deep_scrub":"267'1237","last_deep_scrub_stamp":"2024-09-12T19:23:13.247189+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.247189+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":1200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:52.825946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5667,"num_read_kb":5016,"num_write":1745,"num_write_kb":765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'336","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:07.977004+0000","last_change":"2024-09-12T19:23:07.977004+0000","last_active":"2024-09-12T19:23:07.977004+0000","last_peered":"2024-09-12T19:23:07.977004+0000","last_clean":"2024-09-12T19:23:07.977004+0000","last_became_active":"2024-09-12T17:30:21.697470+0000","last_became_peered":"2024-09-12T17:30:21.697470+0000","last_unstale":"2024-09-12T19:23:07.977004+0000","last_undegraded":"2024-09-12T19:23:07.977004+0000","last_fullsized":"2024-09-12T19:23:07.977004+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-12T19:23:07.976758+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-12T19:23:07.976758+0000","last_clean_scrub_stamp":"2024-09-12T19:23:07.976758+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:24.268288+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":2583,"num_write":1054,"num_write_kb":28824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":560,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.146828+0000","last_change":"2024-09-12T19:23:09.146828+0000","last_active":"2024-09-12T19:23:09.146828+0000","last_peered":"2024-09-12T19:23:09.146828+0000","last_clean":"2024-09-12T19:23:09.146828+0000","last_became_active":"2024-09-12T17:29:35.337998+0000","last_became_peered":"2024-09-12T17:29:35.337998+0000","last_unstale":"2024-09-12T19:23:09.146828+0000","last_undegraded":"2024-09-12T19:23:09.146828+0000","last_fullsized":"2024-09-12T19:23:09.146828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:09.146655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:09.146655+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.146655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:56.445997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011850280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.138679+0000","last_change":"2024-09-12T19:23:29.138679+0000","last_active":"2024-09-12T19:23:29.138679+0000","last_peered":"2024-09-12T19:23:29.138679+0000","last_clean":"2024-09-12T19:23:29.138679+0000","last_became_active":"2024-09-12T17:29:56.760822+0000","last_became_peered":"2024-09-12T17:29:56.760822+0000","last_unstale":"2024-09-12T19:23:29.138679+0000","last_undegraded":"2024-09-12T19:23:29.138679+0000","last_fullsized":"2024-09-12T19:23:29.138679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:29.138471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:29.138471+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.138471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:58.898874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'813","reported_seq":1602,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.136516+0000","last_change":"2024-09-12T19:23:29.136516+0000","last_active":"2024-09-12T19:23:29.136516+0000","last_peered":"2024-09-12T19:23:29.136516+0000","last_clean":"2024-09-12T19:23:29.136516+0000","last_became_active":"2024-09-12T17:29:58.830605+0000","last_became_peered":"2024-09-12T17:29:58.830605+0000","last_unstale":"2024-09-12T19:23:29.136516+0000","last_undegraded":"2024-09-12T19:23:29.136516+0000","last_fullsized":"2024-09-12T19:23:29.136516+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'813","last_scrub_stamp":"2024-09-12T19:23:29.136309+0000","last_deep_scrub":"267'813","last_deep_scrub_stamp":"2024-09-12T19:23:29.136309+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.136309+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:15.488966+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138319,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1432,"num_read_kb":3265,"num_write":1150,"num_write_kb":898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.128144+0000","last_change":"2024-09-12T19:23:42.128144+0000","last_active":"2024-09-12T19:23:42.128144+0000","last_peered":"2024-09-12T19:23:42.128144+0000","last_clean":"2024-09-12T19:23:42.128144+0000","last_became_active":"2024-09-12T17:30:00.810341+0000","last_became_peered":"2024-09-12T17:30:00.810341+0000","last_unstale":"2024-09-12T19:23:42.128144+0000","last_undegraded":"2024-09-12T19:23:42.128144+0000","last_fullsized":"2024-09-12T19:23:42.128144+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:42.127960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:42.127960+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.127960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:30.104619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'164","reported_seq":728,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.325599+0000","last_change":"2024-09-12T19:23:41.325599+0000","last_active":"2024-09-12T19:23:41.325599+0000","last_peered":"2024-09-12T19:23:41.325599+0000","last_clean":"2024-09-12T19:23:41.325599+0000","last_became_active":"2024-09-12T17:30:02.786443+0000","last_became_peered":"2024-09-12T17:30:02.786443+0000","last_unstale":"2024-09-12T19:23:41.325599+0000","last_undegraded":"2024-09-12T19:23:41.325599+0000","last_fullsized":"2024-09-12T19:23:41.325599+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'164","last_scrub_stamp":"2024-09-12T19:23:41.325403+0000","last_deep_scrub":"267'164","last_deep_scrub_stamp":"2024-09-12T19:23:41.325403+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.325403+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:23.794999+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":311,"num_read_kb":271,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'113","reported_seq":707,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.727465+0000","last_change":"2024-09-12T19:23:44.727465+0000","last_active":"2024-09-12T19:23:44.727465+0000","last_peered":"2024-09-12T19:23:44.727465+0000","last_clean":"2024-09-12T19:23:44.727465+0000","last_became_active":"2024-09-12T17:30:02.801038+0000","last_became_peered":"2024-09-12T17:30:02.801038+0000","last_unstale":"2024-09-12T19:23:44.727465+0000","last_undegraded":"2024-09-12T19:23:44.727465+0000","last_fullsized":"2024-09-12T19:23:44.727465+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'113","last_scrub_stamp":"2024-09-12T19:23:44.727277+0000","last_deep_scrub":"267'113","last_deep_scrub_stamp":"2024-09-12T19:23:44.727277+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.727277+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:19.039842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":212,"num_write":265,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'456","reported_seq":2047,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.222255+0000","last_change":"2024-09-12T19:23:18.222255+0000","last_active":"2024-09-12T19:23:18.222255+0000","last_peered":"2024-09-12T19:23:18.222255+0000","last_clean":"2024-09-12T19:23:18.222255+0000","last_became_active":"2024-09-12T17:29:54.760809+0000","last_became_peered":"2024-09-12T17:29:54.760809+0000","last_unstale":"2024-09-12T19:23:18.222255+0000","last_undegraded":"2024-09-12T19:23:18.222255+0000","last_fullsized":"2024-09-12T19:23:18.222255+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'456","last_scrub_stamp":"2024-09-12T19:23:18.222068+0000","last_deep_scrub":"267'456","last_deep_scrub_stamp":"2024-09-12T19:23:18.222068+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.222068+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:12.516436+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2369,"num_read_kb":2229,"num_write":528,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'332","reported_seq":1042,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.234197+0000","last_change":"2024-09-12T19:23:10.234197+0000","last_active":"2024-09-12T19:23:10.234197+0000","last_peered":"2024-09-12T19:23:10.234197+0000","last_clean":"2024-09-12T19:23:10.234197+0000","last_became_active":"2024-09-12T17:29:52.760432+0000","last_became_peered":"2024-09-12T17:29:52.760432+0000","last_unstale":"2024-09-12T19:23:10.234197+0000","last_undegraded":"2024-09-12T19:23:10.234197+0000","last_fullsized":"2024-09-12T19:23:10.234197+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'332","last_scrub_stamp":"2024-09-12T19:23:10.233909+0000","last_deep_scrub":"267'332","last_deep_scrub_stamp":"2024-09-12T19:23:10.233909+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.233909+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:23.059087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":31499,"num_write":1138,"num_write_kb":37455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.648629+0000","last_change":"2024-09-12T19:23:24.648629+0000","last_active":"2024-09-12T19:23:24.648629+0000","last_peered":"2024-09-12T19:23:24.648629+0000","last_clean":"2024-09-12T19:23:24.648629+0000","last_became_active":"2024-09-12T17:29:56.765656+0000","last_became_peered":"2024-09-12T17:29:56.765656+0000","last_unstale":"2024-09-12T19:23:24.648629+0000","last_undegraded":"2024-09-12T19:23:24.648629+0000","last_fullsized":"2024-09-12T19:23:24.648629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:24.648446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:24.648446+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.648446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:56.698094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'317","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.013530+0000","last_change":"2024-09-12T19:23:36.013530+0000","last_active":"2024-09-12T19:23:36.013530+0000","last_peered":"2024-09-12T19:23:36.013530+0000","last_clean":"2024-09-12T19:23:36.013530+0000","last_became_active":"2024-09-12T17:29:58.777997+0000","last_became_peered":"2024-09-12T17:29:58.777997+0000","last_unstale":"2024-09-12T19:23:36.013530+0000","last_undegraded":"2024-09-12T19:23:36.013530+0000","last_fullsized":"2024-09-12T19:23:36.013530+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-12T19:23:36.013221+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-12T19:23:36.013221+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.013221+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:00.778670+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47243,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":493,"num_read_kb":996,"num_write":376,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.091988+0000","last_change":"2024-09-12T19:23:43.091988+0000","last_active":"2024-09-12T19:23:43.091988+0000","last_peered":"2024-09-12T19:23:43.091988+0000","last_clean":"2024-09-12T19:23:43.091988+0000","last_became_active":"2024-09-12T17:30:00.793204+0000","last_became_peered":"2024-09-12T17:30:00.793204+0000","last_unstale":"2024-09-12T19:23:43.091988+0000","last_undegraded":"2024-09-12T19:23:43.091988+0000","last_fullsized":"2024-09-12T19:23:43.091988+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:43.091801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:43.091801+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.091801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:44.767133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'109","reported_seq":647,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:52.051051+0000","last_change":"2024-09-12T19:23:52.051051+0000","last_active":"2024-09-12T19:23:52.051051+0000","last_peered":"2024-09-12T19:23:52.051051+0000","last_clean":"2024-09-12T19:23:52.051051+0000","last_became_active":"2024-09-12T17:30:02.789511+0000","last_became_peered":"2024-09-12T17:30:02.789511+0000","last_unstale":"2024-09-12T19:23:52.051051+0000","last_undegraded":"2024-09-12T19:23:52.051051+0000","last_fullsized":"2024-09-12T19:23:52.051051+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'109","last_scrub_stamp":"2024-09-12T19:23:52.050868+0000","last_deep_scrub":"267'109","last_deep_scrub_stamp":"2024-09-12T19:23:52.050868+0000","last_clean_scrub_stamp":"2024-09-12T19:23:52.050868+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:10.396312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":267,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'1081","reported_seq":2637,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.697979+0000","last_change":"2024-09-12T19:23:16.697979+0000","last_active":"2024-09-12T19:23:16.697979+0000","last_peered":"2024-09-12T19:23:16.697979+0000","last_clean":"2024-09-12T19:23:16.697979+0000","last_became_active":"2024-09-12T17:29:54.774337+0000","last_became_peered":"2024-09-12T17:29:54.774337+0000","last_unstale":"2024-09-12T19:23:16.697979+0000","last_undegraded":"2024-09-12T19:23:16.697979+0000","last_fullsized":"2024-09-12T19:23:16.697979+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1081","last_scrub_stamp":"2024-09-12T19:23:16.697790+0000","last_deep_scrub":"267'1081","last_deep_scrub_stamp":"2024-09-12T19:23:16.697790+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.697790+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":1000,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:19.478713+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5006,"num_read_kb":4447,"num_write":1496,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'343","reported_seq":1047,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.093187+0000","last_change":"2024-09-12T19:23:17.093038+0000","last_active":"2024-09-12T19:23:17.093187+0000","last_peered":"2024-09-12T19:23:17.093187+0000","last_clean":"2024-09-12T19:23:17.093187+0000","last_became_active":"2024-09-12T17:29:52.757775+0000","last_became_peered":"2024-09-12T17:29:52.757775+0000","last_unstale":"2024-09-12T19:23:17.093187+0000","last_undegraded":"2024-09-12T19:23:17.093187+0000","last_fullsized":"2024-09-12T19:23:17.093187+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'343","last_scrub_stamp":"2024-09-12T19:23:17.092815+0000","last_deep_scrub":"267'343","last_deep_scrub_stamp":"2024-09-12T19:23:17.092815+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.092815+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:09.547140+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399166,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":510,"num_read_kb":111933,"num_write":1035,"num_write_kb":43950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.113656+0000","last_change":"2024-09-12T19:23:30.113656+0000","last_active":"2024-09-12T19:23:30.113656+0000","last_peered":"2024-09-12T19:23:30.113656+0000","last_clean":"2024-09-12T19:23:30.113656+0000","last_became_active":"2024-09-12T17:29:56.770639+0000","last_became_peered":"2024-09-12T17:29:56.770639+0000","last_unstale":"2024-09-12T19:23:30.113656+0000","last_undegraded":"2024-09-12T19:23:30.113656+0000","last_fullsized":"2024-09-12T19:23:30.113656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:30.113470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:30.113470+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.113470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:33.724815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'81","reported_seq":633,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.762633+0000","last_change":"2024-09-12T19:23:29.762633+0000","last_active":"2024-09-12T19:23:29.762633+0000","last_peered":"2024-09-12T19:23:29.762633+0000","last_clean":"2024-09-12T19:23:29.762633+0000","last_became_active":"2024-09-12T17:29:58.781731+0000","last_became_peered":"2024-09-12T17:29:58.781731+0000","last_unstale":"2024-09-12T19:23:29.762633+0000","last_undegraded":"2024-09-12T19:23:29.762633+0000","last_fullsized":"2024-09-12T19:23:29.762633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'81","last_scrub_stamp":"2024-09-12T19:23:29.762445+0000","last_deep_scrub":"267'81","last_deep_scrub_stamp":"2024-09-12T19:23:29.762445+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.762445+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:16:26.707930+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":73,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.064753+0000","last_change":"2024-09-12T19:23:38.064753+0000","last_active":"2024-09-12T19:23:38.064753+0000","last_peered":"2024-09-12T19:23:38.064753+0000","last_clean":"2024-09-12T19:23:38.064753+0000","last_became_active":"2024-09-12T17:30:00.799588+0000","last_became_peered":"2024-09-12T17:30:00.799588+0000","last_unstale":"2024-09-12T19:23:38.064753+0000","last_undegraded":"2024-09-12T19:23:38.064753+0000","last_fullsized":"2024-09-12T19:23:38.064753+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:38.064571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:38.064571+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.064571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:37.484945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'193","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.697614+0000","last_change":"2024-09-12T19:23:43.697614+0000","last_active":"2024-09-12T19:23:43.697614+0000","last_peered":"2024-09-12T19:23:43.697614+0000","last_clean":"2024-09-12T19:23:43.697614+0000","last_became_active":"2024-09-12T17:30:02.813284+0000","last_became_peered":"2024-09-12T17:30:02.813284+0000","last_unstale":"2024-09-12T19:23:43.697614+0000","last_undegraded":"2024-09-12T19:23:43.697614+0000","last_fullsized":"2024-09-12T19:23:43.697614+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'193","last_scrub_stamp":"2024-09-12T19:23:43.697424+0000","last_deep_scrub":"267'193","last_deep_scrub_stamp":"2024-09-12T19:23:43.697424+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.697424+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:41.448750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":312,"num_read_kb":310,"num_write":442,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'826","reported_seq":2446,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.189050+0000","last_change":"2024-09-12T19:23:22.189050+0000","last_active":"2024-09-12T19:23:22.189050+0000","last_peered":"2024-09-12T19:23:22.189050+0000","last_clean":"2024-09-12T19:23:22.189050+0000","last_became_active":"2024-09-12T17:29:54.762793+0000","last_became_peered":"2024-09-12T17:29:54.762793+0000","last_unstale":"2024-09-12T19:23:22.189050+0000","last_undegraded":"2024-09-12T19:23:22.189050+0000","last_fullsized":"2024-09-12T19:23:22.189050+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'826","last_scrub_stamp":"2024-09-12T19:23:22.188867+0000","last_deep_scrub":"267'826","last_deep_scrub_stamp":"2024-09-12T19:23:22.188867+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.188867+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:07.821462+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3973,"num_read_kb":3581,"num_write":1093,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'357","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.012095+0000","last_change":"2024-09-12T19:23:13.011911+0000","last_active":"2024-09-12T19:23:13.012095+0000","last_peered":"2024-09-12T19:23:13.012095+0000","last_clean":"2024-09-12T19:23:13.012095+0000","last_became_active":"2024-09-12T17:30:21.692338+0000","last_became_peered":"2024-09-12T17:30:21.692338+0000","last_unstale":"2024-09-12T19:23:13.012095+0000","last_undegraded":"2024-09-12T19:23:13.012095+0000","last_fullsized":"2024-09-12T19:23:13.012095+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'357","last_scrub_stamp":"2024-09-12T19:23:13.011577+0000","last_deep_scrub":"267'357","last_deep_scrub_stamp":"2024-09-12T19:23:13.011577+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.011577+0000","objects_scrubbed":10,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:00.683791+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2254600,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":475,"num_read_kb":2106,"num_write":1042,"num_write_kb":33078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.100650+0000","last_change":"2024-09-12T19:23:27.100650+0000","last_active":"2024-09-12T19:23:27.100650+0000","last_peered":"2024-09-12T19:23:27.100650+0000","last_clean":"2024-09-12T19:23:27.100650+0000","last_became_active":"2024-09-12T17:29:56.771923+0000","last_became_peered":"2024-09-12T17:29:56.771923+0000","last_unstale":"2024-09-12T19:23:27.100650+0000","last_undegraded":"2024-09-12T19:23:27.100650+0000","last_fullsized":"2024-09-12T19:23:27.100650+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:27.100463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:27.100463+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.100463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:27.173988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'358","reported_seq":1015,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.082680+0000","last_change":"2024-09-12T19:23:38.082680+0000","last_active":"2024-09-12T19:23:38.082680+0000","last_peered":"2024-09-12T19:23:38.082680+0000","last_clean":"2024-09-12T19:23:38.082680+0000","last_became_active":"2024-09-12T17:29:58.781756+0000","last_became_peered":"2024-09-12T17:29:58.781756+0000","last_unstale":"2024-09-12T19:23:38.082680+0000","last_undegraded":"2024-09-12T19:23:38.082680+0000","last_fullsized":"2024-09-12T19:23:38.082680+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'358","last_scrub_stamp":"2024-09-12T19:23:38.082469+0000","last_deep_scrub":"267'358","last_deep_scrub_stamp":"2024-09-12T19:23:38.082469+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.082469+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:05.093797+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44606,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":574,"num_read_kb":1122,"num_write":442,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.263372+0000","last_change":"2024-09-12T19:23:27.263372+0000","last_active":"2024-09-12T19:23:27.263372+0000","last_peered":"2024-09-12T19:23:27.263372+0000","last_clean":"2024-09-12T19:23:27.263372+0000","last_became_active":"2024-09-12T17:30:00.787872+0000","last_became_peered":"2024-09-12T17:30:00.787872+0000","last_unstale":"2024-09-12T19:23:27.263372+0000","last_undegraded":"2024-09-12T19:23:27.263372+0000","last_fullsized":"2024-09-12T19:23:27.263372+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:27.263189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:27.263189+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.263189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:00.496808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'138","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.372146+0000","last_change":"2024-09-12T19:23:44.372146+0000","last_active":"2024-09-12T19:23:44.372146+0000","last_peered":"2024-09-12T19:23:44.372146+0000","last_clean":"2024-09-12T19:23:44.372146+0000","last_became_active":"2024-09-12T17:30:02.790246+0000","last_became_peered":"2024-09-12T17:30:02.790246+0000","last_unstale":"2024-09-12T19:23:44.372146+0000","last_undegraded":"2024-09-12T19:23:44.372146+0000","last_fullsized":"2024-09-12T19:23:44.372146+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'138","last_scrub_stamp":"2024-09-12T19:23:44.371962+0000","last_deep_scrub":"267'138","last_deep_scrub_stamp":"2024-09-12T19:23:44.371962+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.371962+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:30.261994+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":190,"num_write":334,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'498","reported_seq":2176,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.155966+0000","last_change":"2024-09-12T19:23:21.155966+0000","last_active":"2024-09-12T19:23:21.155966+0000","last_peered":"2024-09-12T19:23:21.155966+0000","last_clean":"2024-09-12T19:23:21.155966+0000","last_became_active":"2024-09-12T17:30:22.255871+0000","last_became_peered":"2024-09-12T17:30:22.255871+0000","last_unstale":"2024-09-12T19:23:21.155966+0000","last_undegraded":"2024-09-12T19:23:21.155966+0000","last_fullsized":"2024-09-12T19:23:21.155966+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'498","last_scrub_stamp":"2024-09-12T19:23:21.155552+0000","last_deep_scrub":"267'498","last_deep_scrub_stamp":"2024-09-12T19:23:21.155552+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.155552+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:38.758690+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2849,"num_read_kb":2646,"num_write":616,"num_write_kb":185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4203,"num_omap_keys":17,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'330","reported_seq":1080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:06.908774+0000","last_change":"2024-09-12T19:23:06.908628+0000","last_active":"2024-09-12T19:23:06.908774+0000","last_peered":"2024-09-12T19:23:06.908774+0000","last_clean":"2024-09-12T19:23:06.908774+0000","last_became_active":"2024-09-12T17:29:52.725672+0000","last_became_peered":"2024-09-12T17:29:52.725672+0000","last_unstale":"2024-09-12T19:23:06.908774+0000","last_undegraded":"2024-09-12T19:23:06.908774+0000","last_fullsized":"2024-09-12T19:23:06.908774+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'330","last_scrub_stamp":"2024-09-12T19:23:06.908405+0000","last_deep_scrub":"267'330","last_deep_scrub_stamp":"2024-09-12T19:23:06.908405+0000","last_clean_scrub_stamp":"2024-09-12T19:23:06.908405+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:18.850583+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524466,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":607,"num_read_kb":120165,"num_write":1109,"num_write_kb":47030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.221546+0000","last_change":"2024-09-12T19:23:22.221546+0000","last_active":"2024-09-12T19:23:22.221546+0000","last_peered":"2024-09-12T19:23:22.221546+0000","last_clean":"2024-09-12T19:23:22.221546+0000","last_became_active":"2024-09-12T17:29:56.761442+0000","last_became_peered":"2024-09-12T17:29:56.761442+0000","last_unstale":"2024-09-12T19:23:22.221546+0000","last_undegraded":"2024-09-12T19:23:22.221546+0000","last_fullsized":"2024-09-12T19:23:22.221546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:22.221361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:22.221361+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.221361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:34.450653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'327","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.101276+0000","last_change":"2024-09-12T19:23:31.101276+0000","last_active":"2024-09-12T19:23:31.101276+0000","last_peered":"2024-09-12T19:23:31.101276+0000","last_clean":"2024-09-12T19:23:31.101276+0000","last_became_active":"2024-09-12T17:29:58.758050+0000","last_became_peered":"2024-09-12T17:29:58.758050+0000","last_unstale":"2024-09-12T19:23:31.101276+0000","last_undegraded":"2024-09-12T19:23:31.101276+0000","last_fullsized":"2024-09-12T19:23:31.101276+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'327","last_scrub_stamp":"2024-09-12T19:23:31.101035+0000","last_deep_scrub":"267'327","last_deep_scrub_stamp":"2024-09-12T19:23:31.101035+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.101035+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:54.851659+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47374,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":545,"num_read_kb":1211,"num_write":440,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.774303+0000","last_change":"2024-09-12T19:23:36.774303+0000","last_active":"2024-09-12T19:23:36.774303+0000","last_peered":"2024-09-12T19:23:36.774303+0000","last_clean":"2024-09-12T19:23:36.774303+0000","last_became_active":"2024-09-12T17:30:00.780216+0000","last_became_peered":"2024-09-12T17:30:00.780216+0000","last_unstale":"2024-09-12T19:23:36.774303+0000","last_undegraded":"2024-09-12T19:23:36.774303+0000","last_fullsized":"2024-09-12T19:23:36.774303+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:36.774122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:36.774122+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.774122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:01.600530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'415","reported_seq":1862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.193904+0000","last_change":"2024-09-12T19:23:18.193904+0000","last_active":"2024-09-12T19:23:18.193904+0000","last_peered":"2024-09-12T19:23:18.193904+0000","last_clean":"2024-09-12T19:23:18.193904+0000","last_became_active":"2024-09-12T17:29:54.776503+0000","last_became_peered":"2024-09-12T17:29:54.776503+0000","last_unstale":"2024-09-12T19:23:18.193904+0000","last_undegraded":"2024-09-12T19:23:18.193904+0000","last_fullsized":"2024-09-12T19:23:18.193904+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'415","last_scrub_stamp":"2024-09-12T19:23:18.193704+0000","last_deep_scrub":"267'415","last_deep_scrub_stamp":"2024-09-12T19:23:18.193704+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.193704+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:23.257855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2157,"num_read_kb":2011,"num_write":494,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'346","reported_seq":1057,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.194650+0000","last_change":"2024-09-12T19:23:13.194506+0000","last_active":"2024-09-12T19:23:13.194650+0000","last_peered":"2024-09-12T19:23:13.194650+0000","last_clean":"2024-09-12T19:23:13.194650+0000","last_became_active":"2024-09-12T17:29:52.716376+0000","last_became_peered":"2024-09-12T17:29:52.716376+0000","last_unstale":"2024-09-12T19:23:13.194650+0000","last_undegraded":"2024-09-12T19:23:13.194650+0000","last_fullsized":"2024-09-12T19:23:13.194650+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-09-12T19:23:13.194237+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-09-12T19:23:13.194237+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.194237+0000","objects_scrubbed":9,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:44.170037+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730157,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":576,"num_read_kb":2668,"num_write":1130,"num_write_kb":45238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.853164+0000","last_change":"2024-09-12T19:23:22.853164+0000","last_active":"2024-09-12T19:23:22.853164+0000","last_peered":"2024-09-12T19:23:22.853164+0000","last_clean":"2024-09-12T19:23:22.853164+0000","last_became_active":"2024-09-12T17:29:56.773239+0000","last_became_peered":"2024-09-12T17:29:56.773239+0000","last_unstale":"2024-09-12T19:23:22.853164+0000","last_undegraded":"2024-09-12T19:23:22.853164+0000","last_fullsized":"2024-09-12T19:23:22.853164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:22.852967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:22.852967+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.852967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:06.983644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'558","reported_seq":1240,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.683657+0000","last_change":"2024-09-12T19:23:30.683657+0000","last_active":"2024-09-12T19:23:30.683657+0000","last_peered":"2024-09-12T19:23:30.683657+0000","last_clean":"2024-09-12T19:23:30.683657+0000","last_became_active":"2024-09-12T17:29:58.778931+0000","last_became_peered":"2024-09-12T17:29:58.778931+0000","last_unstale":"2024-09-12T19:23:30.683657+0000","last_undegraded":"2024-09-12T19:23:30.683657+0000","last_fullsized":"2024-09-12T19:23:30.683657+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'558","last_scrub_stamp":"2024-09-12T19:23:30.683533+0000","last_deep_scrub":"267'558","last_deep_scrub_stamp":"2024-09-12T19:23:30.683533+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.683533+0000","objects_scrubbed":6,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:58.234136+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":998,"num_read_kb":2327,"num_write":858,"num_write_kb":737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.304254+0000","last_change":"2024-09-12T19:23:38.304254+0000","last_active":"2024-09-12T19:23:38.304254+0000","last_peered":"2024-09-12T19:23:38.304254+0000","last_clean":"2024-09-12T19:23:38.304254+0000","last_became_active":"2024-09-12T17:30:00.802021+0000","last_became_peered":"2024-09-12T17:30:00.802021+0000","last_unstale":"2024-09-12T19:23:38.304254+0000","last_undegraded":"2024-09-12T19:23:38.304254+0000","last_fullsized":"2024-09-12T19:23:38.304254+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:38.304053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:38.304053+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.304053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:15.422600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'170","reported_seq":721,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:48.083441+0000","last_change":"2024-09-12T19:23:48.083441+0000","last_active":"2024-09-12T19:23:48.083441+0000","last_peered":"2024-09-12T19:23:48.083441+0000","last_clean":"2024-09-12T19:23:48.083441+0000","last_became_active":"2024-09-12T17:30:02.794353+0000","last_became_peered":"2024-09-12T17:30:02.794353+0000","last_unstale":"2024-09-12T19:23:48.083441+0000","last_undegraded":"2024-09-12T19:23:48.083441+0000","last_fullsized":"2024-09-12T19:23:48.083441+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'170","last_scrub_stamp":"2024-09-12T19:23:48.083116+0000","last_deep_scrub":"267'170","last_deep_scrub_stamp":"2024-09-12T19:23:48.083116+0000","last_clean_scrub_stamp":"2024-09-12T19:23:48.083116+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:59.342902+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":277,"num_read_kb":276,"num_write":376,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'726","reported_seq":2327,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.864092+0000","last_change":"2024-09-12T19:23:19.864092+0000","last_active":"2024-09-12T19:23:19.864092+0000","last_peered":"2024-09-12T19:23:19.864092+0000","last_clean":"2024-09-12T19:23:19.864092+0000","last_became_active":"2024-09-12T17:29:54.761144+0000","last_became_peered":"2024-09-12T17:29:54.761144+0000","last_unstale":"2024-09-12T19:23:19.864092+0000","last_undegraded":"2024-09-12T19:23:19.864092+0000","last_fullsized":"2024-09-12T19:23:19.864092+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'726","last_scrub_stamp":"2024-09-12T19:23:19.863911+0000","last_deep_scrub":"267'726","last_deep_scrub_stamp":"2024-09-12T19:23:19.863911+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.863911+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":700,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:39.862307+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3459,"num_read_kb":3076,"num_write":1006,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":514,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'309","reported_seq":936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.681801+0000","last_change":"2024-09-12T19:23:13.681650+0000","last_active":"2024-09-12T19:23:13.681801+0000","last_peered":"2024-09-12T19:23:13.681801+0000","last_clean":"2024-09-12T19:23:13.681801+0000","last_became_active":"2024-09-12T17:29:52.741594+0000","last_became_peered":"2024-09-12T17:29:52.741594+0000","last_unstale":"2024-09-12T19:23:13.681801+0000","last_undegraded":"2024-09-12T19:23:13.681801+0000","last_fullsized":"2024-09-12T19:23:13.681801+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'309","last_scrub_stamp":"2024-09-12T19:23:13.681397+0000","last_deep_scrub":"267'309","last_deep_scrub_stamp":"2024-09-12T19:23:13.681397+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.681397+0000","objects_scrubbed":9,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:35.606108+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262349,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":376,"num_read_kb":5602,"num_write":913,"num_write_kb":46297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.265670+0000","last_change":"2024-09-12T19:23:23.265670+0000","last_active":"2024-09-12T19:23:23.265670+0000","last_peered":"2024-09-12T19:23:23.265670+0000","last_clean":"2024-09-12T19:23:23.265670+0000","last_became_active":"2024-09-12T17:29:56.761256+0000","last_became_peered":"2024-09-12T17:29:56.761256+0000","last_unstale":"2024-09-12T19:23:23.265670+0000","last_undegraded":"2024-09-12T19:23:23.265670+0000","last_fullsized":"2024-09-12T19:23:23.265670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:23.265379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:23.265379+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.265379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:33:19.790842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'397","reported_seq":1049,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.125931+0000","last_change":"2024-09-12T19:23:37.125931+0000","last_active":"2024-09-12T19:23:37.125931+0000","last_peered":"2024-09-12T19:23:37.125931+0000","last_clean":"2024-09-12T19:23:37.125931+0000","last_became_active":"2024-09-12T17:29:58.768310+0000","last_became_peered":"2024-09-12T17:29:58.768310+0000","last_unstale":"2024-09-12T19:23:37.125931+0000","last_undegraded":"2024-09-12T19:23:37.125931+0000","last_fullsized":"2024-09-12T19:23:37.125931+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'397","last_scrub_stamp":"2024-09-12T19:23:37.125646+0000","last_deep_scrub":"267'397","last_deep_scrub_stamp":"2024-09-12T19:23:37.125646+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.125646+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:23.227590+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51217,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":641,"num_read_kb":1226,"num_write":524,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.632862+0000","last_change":"2024-09-12T19:23:31.632862+0000","last_active":"2024-09-12T19:23:31.632862+0000","last_peered":"2024-09-12T19:23:31.632862+0000","last_clean":"2024-09-12T19:23:31.632862+0000","last_became_active":"2024-09-12T17:30:00.804655+0000","last_became_peered":"2024-09-12T17:30:00.804655+0000","last_unstale":"2024-09-12T19:23:31.632862+0000","last_undegraded":"2024-09-12T19:23:31.632862+0000","last_fullsized":"2024-09-12T19:23:31.632862+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:31.632687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:31.632687+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.632687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:20.780508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'196","reported_seq":1104,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.324814+0000","last_change":"2024-09-12T19:23:31.324814+0000","last_active":"2024-09-12T19:23:31.324814+0000","last_peered":"2024-09-12T19:23:31.324814+0000","last_clean":"2024-09-12T19:23:31.324814+0000","last_became_active":"2024-09-12T17:30:02.813027+0000","last_became_peered":"2024-09-12T17:30:02.813027+0000","last_unstale":"2024-09-12T19:23:31.324814+0000","last_undegraded":"2024-09-12T19:23:31.324814+0000","last_fullsized":"2024-09-12T19:23:31.324814+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'196","last_scrub_stamp":"2024-09-12T19:23:31.324602+0000","last_deep_scrub":"267'196","last_deep_scrub_stamp":"2024-09-12T19:23:31.324602+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.324602+0000","objects_scrubbed":7,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:38.755243+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2050,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":664,"num_read_kb":654,"num_write":538,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'392","reported_seq":1808,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.211401+0000","last_change":"2024-09-12T19:23:26.211401+0000","last_active":"2024-09-12T19:23:26.211401+0000","last_peered":"2024-09-12T19:23:26.211401+0000","last_clean":"2024-09-12T19:23:26.211401+0000","last_became_active":"2024-09-12T17:29:54.756800+0000","last_became_peered":"2024-09-12T17:29:54.756800+0000","last_unstale":"2024-09-12T19:23:26.211401+0000","last_undegraded":"2024-09-12T19:23:26.211401+0000","last_fullsized":"2024-09-12T19:23:26.211401+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'392","last_scrub_stamp":"2024-09-12T19:23:26.211201+0000","last_deep_scrub":"267'392","last_deep_scrub_stamp":"2024-09-12T19:23:26.211201+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.211201+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:17.864703+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1992,"num_read_kb":1877,"num_write":455,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'311","reported_seq":994,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.267339+0000","last_change":"2024-09-12T19:23:11.267339+0000","last_active":"2024-09-12T19:23:11.267339+0000","last_peered":"2024-09-12T19:23:11.267339+0000","last_clean":"2024-09-12T19:23:11.267339+0000","last_became_active":"2024-09-12T17:29:52.755401+0000","last_became_peered":"2024-09-12T17:29:52.755401+0000","last_unstale":"2024-09-12T19:23:11.267339+0000","last_undegraded":"2024-09-12T19:23:11.267339+0000","last_fullsized":"2024-09-12T19:23:11.267339+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-09-12T19:23:11.267078+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-09-12T19:23:11.267078+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.267078+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:12.277344+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2036176,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":3663,"num_write":1039,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.139454+0000","last_change":"2024-09-12T19:23:32.139454+0000","last_active":"2024-09-12T19:23:32.139454+0000","last_peered":"2024-09-12T19:23:32.139454+0000","last_clean":"2024-09-12T19:23:32.139454+0000","last_became_active":"2024-09-12T17:29:56.752172+0000","last_became_peered":"2024-09-12T17:29:56.752172+0000","last_unstale":"2024-09-12T19:23:32.139454+0000","last_undegraded":"2024-09-12T19:23:32.139454+0000","last_fullsized":"2024-09-12T19:23:32.139454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:32.139158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:32.139158+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.139158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:30.140657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'335","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.081102+0000","last_change":"2024-09-12T19:23:40.081102+0000","last_active":"2024-09-12T19:23:40.081102+0000","last_peered":"2024-09-12T19:23:40.081102+0000","last_clean":"2024-09-12T19:23:40.081102+0000","last_became_active":"2024-09-12T17:29:58.831574+0000","last_became_peered":"2024-09-12T17:29:58.831574+0000","last_unstale":"2024-09-12T19:23:40.081102+0000","last_undegraded":"2024-09-12T19:23:40.081102+0000","last_fullsized":"2024-09-12T19:23:40.081102+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-09-12T19:23:40.080862+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-09-12T19:23:40.080862+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.080862+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:42.439444+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49155,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":530,"num_read_kb":1074,"num_write":414,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.638818+0000","last_change":"2024-09-12T19:23:34.638818+0000","last_active":"2024-09-12T19:23:34.638818+0000","last_peered":"2024-09-12T19:23:34.638818+0000","last_clean":"2024-09-12T19:23:34.638818+0000","last_became_active":"2024-09-12T17:30:00.804705+0000","last_became_peered":"2024-09-12T17:30:00.804705+0000","last_unstale":"2024-09-12T19:23:34.638818+0000","last_undegraded":"2024-09-12T19:23:34.638818+0000","last_fullsized":"2024-09-12T19:23:34.638818+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:34.638602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:34.638602+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.638602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:55.950770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'116","reported_seq":635,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.299498+0000","last_change":"2024-09-12T19:23:42.299498+0000","last_active":"2024-09-12T19:23:42.299498+0000","last_peered":"2024-09-12T19:23:42.299498+0000","last_clean":"2024-09-12T19:23:42.299498+0000","last_became_active":"2024-09-12T17:30:02.787038+0000","last_became_peered":"2024-09-12T17:30:02.787038+0000","last_unstale":"2024-09-12T19:23:42.299498+0000","last_undegraded":"2024-09-12T19:23:42.299498+0000","last_fullsized":"2024-09-12T19:23:42.299498+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'116","last_scrub_stamp":"2024-09-12T19:23:42.299293+0000","last_deep_scrub":"267'116","last_deep_scrub_stamp":"2024-09-12T19:23:42.299293+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.299293+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:02.765312+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":121,"num_write":252,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'361","reported_seq":1899,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.987483+0000","last_change":"2024-09-12T19:23:14.987483+0000","last_active":"2024-09-12T19:23:14.987483+0000","last_peered":"2024-09-12T19:23:14.987483+0000","last_clean":"2024-09-12T19:23:14.987483+0000","last_became_active":"2024-09-12T17:29:54.741486+0000","last_became_peered":"2024-09-12T17:29:54.741486+0000","last_unstale":"2024-09-12T19:23:14.987483+0000","last_undegraded":"2024-09-12T19:23:14.987483+0000","last_fullsized":"2024-09-12T19:23:14.987483+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'361","last_scrub_stamp":"2024-09-12T19:23:14.987293+0000","last_deep_scrub":"267'361","last_deep_scrub_stamp":"2024-09-12T19:23:14.987293+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.987293+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:37.939163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1958,"num_read_kb":1901,"num_write":388,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'318","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.907394+0000","last_change":"2024-09-12T19:23:12.907394+0000","last_active":"2024-09-12T19:23:12.907394+0000","last_peered":"2024-09-12T19:23:12.907394+0000","last_clean":"2024-09-12T19:23:12.907394+0000","last_became_active":"2024-09-12T17:29:52.766141+0000","last_became_peered":"2024-09-12T17:29:52.766141+0000","last_unstale":"2024-09-12T19:23:12.907394+0000","last_undegraded":"2024-09-12T19:23:12.907394+0000","last_fullsized":"2024-09-12T19:23:12.907394+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'318","last_scrub_stamp":"2024-09-12T19:23:12.907122+0000","last_deep_scrub":"267'318","last_deep_scrub_stamp":"2024-09-12T19:23:12.907122+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.907122+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:49.071217+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7320708,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":562,"num_read_kb":101880,"num_write":1008,"num_write_kb":18651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"267'6","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.726938+0000","last_change":"2024-09-12T19:23:27.726938+0000","last_active":"2024-09-12T19:23:27.726938+0000","last_peered":"2024-09-12T19:23:27.726938+0000","last_clean":"2024-09-12T19:23:27.726938+0000","last_became_active":"2024-09-12T17:29:56.760505+0000","last_became_peered":"2024-09-12T17:29:56.760505+0000","last_unstale":"2024-09-12T19:23:27.726938+0000","last_undegraded":"2024-09-12T19:23:27.726938+0000","last_fullsized":"2024-09-12T19:23:27.726938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T19:23:27.726750+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T19:23:27.726750+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.726750+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:36.263576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'177","reported_seq":777,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.118490+0000","last_change":"2024-09-12T19:23:36.118490+0000","last_active":"2024-09-12T19:23:36.118490+0000","last_peered":"2024-09-12T19:23:36.118490+0000","last_clean":"2024-09-12T19:23:36.118490+0000","last_became_active":"2024-09-12T17:29:58.829023+0000","last_became_peered":"2024-09-12T17:29:58.829023+0000","last_unstale":"2024-09-12T19:23:36.118490+0000","last_undegraded":"2024-09-12T19:23:36.118490+0000","last_fullsized":"2024-09-12T19:23:36.118490+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'177","last_scrub_stamp":"2024-09-12T19:23:36.118299+0000","last_deep_scrub":"267'177","last_deep_scrub_stamp":"2024-09-12T19:23:36.118299+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.118299+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:05.647435+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":218,"num_write":206,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19254,"num_omap_keys":52,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'775","reported_seq":3300,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.237657+0000","last_change":"2024-09-12T19:23:29.237657+0000","last_active":"2024-09-12T19:23:29.237657+0000","last_peered":"2024-09-12T19:23:29.237657+0000","last_clean":"2024-09-12T19:23:29.237657+0000","last_became_active":"2024-09-12T17:30:00.786102+0000","last_became_peered":"2024-09-12T17:30:00.786102+0000","last_unstale":"2024-09-12T19:23:29.237657+0000","last_undegraded":"2024-09-12T19:23:29.237657+0000","last_fullsized":"2024-09-12T19:23:29.237657+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'775","last_scrub_stamp":"2024-09-12T19:23:29.237474+0000","last_deep_scrub":"267'775","last_deep_scrub_stamp":"2024-09-12T19:23:29.237474+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.237474+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:49.117833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'149","reported_seq":685,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.123673+0000","last_change":"2024-09-12T19:23:41.123673+0000","last_active":"2024-09-12T19:23:41.123673+0000","last_peered":"2024-09-12T19:23:41.123673+0000","last_clean":"2024-09-12T19:23:41.123673+0000","last_became_active":"2024-09-12T17:30:02.803612+0000","last_became_peered":"2024-09-12T17:30:02.803612+0000","last_unstale":"2024-09-12T19:23:41.123673+0000","last_undegraded":"2024-09-12T19:23:41.123673+0000","last_fullsized":"2024-09-12T19:23:41.123673+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'149","last_scrub_stamp":"2024-09-12T19:23:41.123471+0000","last_deep_scrub":"267'149","last_deep_scrub_stamp":"2024-09-12T19:23:41.123471+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.123471+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:28.596544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":232,"num_read_kb":219,"num_write":373,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'828","reported_seq":2559,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.291568+0000","last_change":"2024-09-12T19:23:22.291568+0000","last_active":"2024-09-12T19:23:22.291568+0000","last_peered":"2024-09-12T19:23:22.291568+0000","last_clean":"2024-09-12T19:23:22.291568+0000","last_became_active":"2024-09-12T17:30:21.696952+0000","last_became_peered":"2024-09-12T17:30:21.696952+0000","last_unstale":"2024-09-12T19:23:22.291568+0000","last_undegraded":"2024-09-12T19:23:22.291568+0000","last_fullsized":"2024-09-12T19:23:22.291568+0000","mapping_epoch":39,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'828","last_scrub_stamp":"2024-09-12T19:23:22.291363+0000","last_deep_scrub":"267'828","last_deep_scrub_stamp":"2024-09-12T19:23:22.291363+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.291363+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:50.049566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3950,"num_read_kb":3589,"num_write":1060,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'353","reported_seq":1080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.268016+0000","last_change":"2024-09-12T19:23:13.268016+0000","last_active":"2024-09-12T19:23:13.268016+0000","last_peered":"2024-09-12T19:23:13.268016+0000","last_clean":"2024-09-12T19:23:13.268016+0000","last_became_active":"2024-09-12T17:29:52.749735+0000","last_became_peered":"2024-09-12T17:29:52.749735+0000","last_unstale":"2024-09-12T19:23:13.268016+0000","last_undegraded":"2024-09-12T19:23:13.268016+0000","last_fullsized":"2024-09-12T19:23:13.268016+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'353","last_scrub_stamp":"2024-09-12T19:23:13.267796+0000","last_deep_scrub":"267'353","last_deep_scrub_stamp":"2024-09-12T19:23:13.267796+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.267796+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:59.721962+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437125,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":46392,"num_write":1072,"num_write_kb":51525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.090461+0000","last_change":"2024-09-12T19:23:28.090461+0000","last_active":"2024-09-12T19:23:28.090461+0000","last_peered":"2024-09-12T19:23:28.090461+0000","last_clean":"2024-09-12T19:23:28.090461+0000","last_became_active":"2024-09-12T17:29:56.765909+0000","last_became_peered":"2024-09-12T17:29:56.765909+0000","last_unstale":"2024-09-12T19:23:28.090461+0000","last_undegraded":"2024-09-12T19:23:28.090461+0000","last_fullsized":"2024-09-12T19:23:28.090461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:28.090285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:28.090285+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.090285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:57.757362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'395","reported_seq":1050,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.255478+0000","last_change":"2024-09-12T19:23:36.255290+0000","last_active":"2024-09-12T19:23:36.255478+0000","last_peered":"2024-09-12T19:23:36.255478+0000","last_clean":"2024-09-12T19:23:36.255478+0000","last_became_active":"2024-09-12T17:29:58.771522+0000","last_became_peered":"2024-09-12T17:29:58.771522+0000","last_unstale":"2024-09-12T19:23:36.255478+0000","last_undegraded":"2024-09-12T19:23:36.255478+0000","last_fullsized":"2024-09-12T19:23:36.255478+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'395","last_scrub_stamp":"2024-09-12T19:23:36.255087+0000","last_deep_scrub":"267'395","last_deep_scrub_stamp":"2024-09-12T19:23:36.255087+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.255087+0000","objects_scrubbed":9,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:56.975938+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46902,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":612,"num_read_kb":1188,"num_write":476,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.745370+0000","last_change":"2024-09-12T19:23:37.745186+0000","last_active":"2024-09-12T19:23:37.745370+0000","last_peered":"2024-09-12T19:23:37.745370+0000","last_clean":"2024-09-12T19:23:37.745370+0000","last_became_active":"2024-09-12T17:30:00.788559+0000","last_became_peered":"2024-09-12T17:30:00.788559+0000","last_unstale":"2024-09-12T19:23:37.745370+0000","last_undegraded":"2024-09-12T19:23:37.745370+0000","last_fullsized":"2024-09-12T19:23:37.745370+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:37.745001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:37.745001+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.745001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:17.916393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'119","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.130433+0000","last_change":"2024-09-12T19:23:43.130433+0000","last_active":"2024-09-12T19:23:43.130433+0000","last_peered":"2024-09-12T19:23:43.130433+0000","last_clean":"2024-09-12T19:23:43.130433+0000","last_became_active":"2024-09-12T17:30:02.807083+0000","last_became_peered":"2024-09-12T17:30:02.807083+0000","last_unstale":"2024-09-12T19:23:43.130433+0000","last_undegraded":"2024-09-12T19:23:43.130433+0000","last_fullsized":"2024-09-12T19:23:43.130433+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'119","last_scrub_stamp":"2024-09-12T19:23:43.130241+0000","last_deep_scrub":"267'119","last_deep_scrub_stamp":"2024-09-12T19:23:43.130241+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.130241+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:38.514554+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":147,"num_write":283,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'827","reported_seq":2508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.266912+0000","last_change":"2024-09-12T19:23:19.266912+0000","last_active":"2024-09-12T19:23:19.266912+0000","last_peered":"2024-09-12T19:23:19.266912+0000","last_clean":"2024-09-12T19:23:19.266912+0000","last_became_active":"2024-09-12T17:29:54.770569+0000","last_became_peered":"2024-09-12T17:29:54.770569+0000","last_unstale":"2024-09-12T19:23:19.266912+0000","last_undegraded":"2024-09-12T19:23:19.266912+0000","last_fullsized":"2024-09-12T19:23:19.266912+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'827","last_scrub_stamp":"2024-09-12T19:23:19.266750+0000","last_deep_scrub":"267'827","last_deep_scrub_stamp":"2024-09-12T19:23:19.266750+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.266750+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:38.162790+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4029,"num_read_kb":3656,"num_write":1088,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'392","reported_seq":1307,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.263333+0000","last_change":"2024-09-12T19:23:14.263333+0000","last_active":"2024-09-12T19:23:14.263333+0000","last_peered":"2024-09-12T19:23:14.263333+0000","last_clean":"2024-09-12T19:23:14.263333+0000","last_became_active":"2024-09-12T17:29:52.749566+0000","last_became_peered":"2024-09-12T17:29:52.749566+0000","last_unstale":"2024-09-12T19:23:14.263333+0000","last_undegraded":"2024-09-12T19:23:14.263333+0000","last_fullsized":"2024-09-12T19:23:14.263333+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'392","last_scrub_stamp":"2024-09-12T19:23:14.262990+0000","last_deep_scrub":"267'392","last_deep_scrub_stamp":"2024-09-12T19:23:14.262990+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.262990+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:34.154250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174738,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1171,"num_read_kb":8659,"num_write":1266,"num_write_kb":49806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.312529+0000","last_change":"2024-09-12T19:23:32.312529+0000","last_active":"2024-09-12T19:23:32.312529+0000","last_peered":"2024-09-12T19:23:32.312529+0000","last_clean":"2024-09-12T19:23:32.312529+0000","last_became_active":"2024-09-12T17:29:56.766952+0000","last_became_peered":"2024-09-12T17:29:56.766952+0000","last_unstale":"2024-09-12T19:23:32.312529+0000","last_undegraded":"2024-09-12T19:23:32.312529+0000","last_fullsized":"2024-09-12T19:23:32.312529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:32.312212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:32.312212+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.312212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:54.904863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'326","reported_seq":951,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.811618+0000","last_change":"2024-09-12T19:23:30.811448+0000","last_active":"2024-09-12T19:23:30.811618+0000","last_peered":"2024-09-12T19:23:30.811618+0000","last_clean":"2024-09-12T19:23:30.811618+0000","last_became_active":"2024-09-12T17:29:58.783105+0000","last_became_peered":"2024-09-12T17:29:58.783105+0000","last_unstale":"2024-09-12T19:23:30.811618+0000","last_undegraded":"2024-09-12T19:23:30.811618+0000","last_fullsized":"2024-09-12T19:23:30.811618+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'326","last_scrub_stamp":"2024-09-12T19:23:30.811250+0000","last_deep_scrub":"267'326","last_deep_scrub_stamp":"2024-09-12T19:23:30.811250+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.811250+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:03.247001+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50641,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":544,"num_read_kb":1206,"num_write":440,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.240857+0000","last_change":"2024-09-12T19:23:28.240737+0000","last_active":"2024-09-12T19:23:28.240857+0000","last_peered":"2024-09-12T19:23:28.240857+0000","last_clean":"2024-09-12T19:23:28.240857+0000","last_became_active":"2024-09-12T17:30:00.799680+0000","last_became_peered":"2024-09-12T17:30:00.799680+0000","last_unstale":"2024-09-12T19:23:28.240857+0000","last_undegraded":"2024-09-12T19:23:28.240857+0000","last_fullsized":"2024-09-12T19:23:28.240857+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:28.240549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:28.240549+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.240549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:11.520672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'131","reported_seq":694,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:50.005120+0000","last_change":"2024-09-12T19:23:50.005120+0000","last_active":"2024-09-12T19:23:50.005120+0000","last_peered":"2024-09-12T19:23:50.005120+0000","last_clean":"2024-09-12T19:23:50.005120+0000","last_became_active":"2024-09-12T17:30:02.786478+0000","last_became_peered":"2024-09-12T17:30:02.786478+0000","last_unstale":"2024-09-12T19:23:50.005120+0000","last_undegraded":"2024-09-12T19:23:50.005120+0000","last_fullsized":"2024-09-12T19:23:50.005120+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-09-12T19:23:50.004880+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-09-12T19:23:50.004880+0000","last_clean_scrub_stamp":"2024-09-12T19:23:50.004880+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:00.094824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":240,"num_read_kb":229,"num_write":300,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'980","reported_seq":2772,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.198669+0000","last_change":"2024-09-12T19:23:25.198525+0000","last_active":"2024-09-12T19:23:25.198669+0000","last_peered":"2024-09-12T19:23:25.198669+0000","last_clean":"2024-09-12T19:23:25.198669+0000","last_became_active":"2024-09-12T17:29:54.761902+0000","last_became_peered":"2024-09-12T17:29:54.761902+0000","last_unstale":"2024-09-12T19:23:25.198669+0000","last_undegraded":"2024-09-12T19:23:25.198669+0000","last_fullsized":"2024-09-12T19:23:25.198669+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'980","last_scrub_stamp":"2024-09-12T19:23:25.198333+0000","last_deep_scrub":"267'980","last_deep_scrub_stamp":"2024-09-12T19:23:25.198333+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.198333+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":900,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:20.662236+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4608,"num_read_kb":4133,"num_write":1300,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'320","reported_seq":985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.200680+0000","last_change":"2024-09-12T19:23:12.200680+0000","last_active":"2024-09-12T19:23:12.200680+0000","last_peered":"2024-09-12T19:23:12.200680+0000","last_clean":"2024-09-12T19:23:12.200680+0000","last_became_active":"2024-09-12T17:29:52.733119+0000","last_became_peered":"2024-09-12T17:29:52.733119+0000","last_unstale":"2024-09-12T19:23:12.200680+0000","last_undegraded":"2024-09-12T19:23:12.200680+0000","last_fullsized":"2024-09-12T19:23:12.200680+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'320","last_scrub_stamp":"2024-09-12T19:23:12.200496+0000","last_deep_scrub":"267'320","last_deep_scrub_stamp":"2024-09-12T19:23:12.200496+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.200496+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:12.257376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":457,"num_read_kb":1565,"num_write":1142,"num_write_kb":34702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.168583+0000","last_change":"2024-09-12T19:23:31.168431+0000","last_active":"2024-09-12T19:23:31.168583+0000","last_peered":"2024-09-12T19:23:31.168583+0000","last_clean":"2024-09-12T19:23:31.168583+0000","last_became_active":"2024-09-12T17:29:56.760142+0000","last_became_peered":"2024-09-12T17:29:56.760142+0000","last_unstale":"2024-09-12T19:23:31.168583+0000","last_undegraded":"2024-09-12T19:23:31.168583+0000","last_fullsized":"2024-09-12T19:23:31.168583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:31.168254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:31.168254+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.168254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:15.851026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'277","reported_seq":879,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.111704+0000","last_change":"2024-09-12T19:23:39.111704+0000","last_active":"2024-09-12T19:23:39.111704+0000","last_peered":"2024-09-12T19:23:39.111704+0000","last_clean":"2024-09-12T19:23:39.111704+0000","last_became_active":"2024-09-12T17:29:58.775284+0000","last_became_peered":"2024-09-12T17:29:58.775284+0000","last_unstale":"2024-09-12T19:23:39.111704+0000","last_undegraded":"2024-09-12T19:23:39.111704+0000","last_fullsized":"2024-09-12T19:23:39.111704+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'277","last_scrub_stamp":"2024-09-12T19:23:39.111503+0000","last_deep_scrub":"267'277","last_deep_scrub_stamp":"2024-09-12T19:23:39.111503+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.111503+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:22.116876+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44259,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":428,"num_read_kb":949,"num_write":354,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.041777+0000","last_change":"2024-09-12T19:23:39.041777+0000","last_active":"2024-09-12T19:23:39.041777+0000","last_peered":"2024-09-12T19:23:39.041777+0000","last_clean":"2024-09-12T19:23:39.041777+0000","last_became_active":"2024-09-12T17:30:00.790907+0000","last_became_peered":"2024-09-12T17:30:00.790907+0000","last_unstale":"2024-09-12T19:23:39.041777+0000","last_undegraded":"2024-09-12T19:23:39.041777+0000","last_fullsized":"2024-09-12T19:23:39.041777+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:39.041590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:39.041590+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.041590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:32.005106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'159","reported_seq":1282,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.098132+0000","last_change":"2024-09-12T19:23:42.098132+0000","last_active":"2024-09-12T19:23:42.098132+0000","last_peered":"2024-09-12T19:23:42.098132+0000","last_clean":"2024-09-12T19:23:42.098132+0000","last_became_active":"2024-09-12T17:30:02.812918+0000","last_became_peered":"2024-09-12T17:30:02.812918+0000","last_unstale":"2024-09-12T19:23:42.098132+0000","last_undegraded":"2024-09-12T19:23:42.098132+0000","last_fullsized":"2024-09-12T19:23:42.098132+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'159","last_scrub_stamp":"2024-09-12T19:23:42.097958+0000","last_deep_scrub":"267'159","last_deep_scrub_stamp":"2024-09-12T19:23:42.097958+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.097958+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:02.263716+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":804,"num_write":370,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'758","reported_seq":2297,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.236980+0000","last_change":"2024-09-12T19:23:20.236818+0000","last_active":"2024-09-12T19:23:20.236980+0000","last_peered":"2024-09-12T19:23:20.236980+0000","last_clean":"2024-09-12T19:23:20.236980+0000","last_became_active":"2024-09-12T17:29:54.767573+0000","last_became_peered":"2024-09-12T17:29:54.767573+0000","last_unstale":"2024-09-12T19:23:20.236980+0000","last_undegraded":"2024-09-12T19:23:20.236980+0000","last_fullsized":"2024-09-12T19:23:20.236980+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'758","last_scrub_stamp":"2024-09-12T19:23:20.236638+0000","last_deep_scrub":"267'758","last_deep_scrub_stamp":"2024-09-12T19:23:20.236638+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.236638+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:45.825300+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3552,"num_read_kb":3227,"num_write":976,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'365","reported_seq":1234,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:07.925988+0000","last_change":"2024-09-12T19:23:07.925988+0000","last_active":"2024-09-12T19:23:07.925988+0000","last_peered":"2024-09-12T19:23:07.925988+0000","last_clean":"2024-09-12T19:23:07.925988+0000","last_became_active":"2024-09-12T17:29:52.765692+0000","last_became_peered":"2024-09-12T17:29:52.765692+0000","last_unstale":"2024-09-12T19:23:07.925988+0000","last_undegraded":"2024-09-12T19:23:07.925988+0000","last_fullsized":"2024-09-12T19:23:07.925988+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'365","last_scrub_stamp":"2024-09-12T19:23:07.925864+0000","last_deep_scrub":"267'365","last_deep_scrub_stamp":"2024-09-12T19:23:07.925864+0000","last_clean_scrub_stamp":"2024-09-12T19:23:07.925864+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:17.489429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110874,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":771,"num_read_kb":82698,"num_write":1110,"num_write_kb":56258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"267'2","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.681416+0000","last_change":"2024-09-12T19:23:23.681287+0000","last_active":"2024-09-12T19:23:23.681416+0000","last_peered":"2024-09-12T19:23:23.681416+0000","last_clean":"2024-09-12T19:23:23.681416+0000","last_became_active":"2024-09-12T17:29:56.760345+0000","last_became_peered":"2024-09-12T17:29:56.760345+0000","last_unstale":"2024-09-12T19:23:23.681416+0000","last_undegraded":"2024-09-12T19:23:23.681416+0000","last_fullsized":"2024-09-12T19:23:23.681416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:23.681094+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:23.681094+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.681094+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:13.124487+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'348","reported_seq":991,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.088295+0000","last_change":"2024-09-12T19:23:38.088295+0000","last_active":"2024-09-12T19:23:38.088295+0000","last_peered":"2024-09-12T19:23:38.088295+0000","last_clean":"2024-09-12T19:23:38.088295+0000","last_became_active":"2024-09-12T17:29:58.768812+0000","last_became_peered":"2024-09-12T17:29:58.768812+0000","last_unstale":"2024-09-12T19:23:38.088295+0000","last_undegraded":"2024-09-12T19:23:38.088295+0000","last_fullsized":"2024-09-12T19:23:38.088295+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'348","last_scrub_stamp":"2024-09-12T19:23:38.088049+0000","last_deep_scrub":"267'348","last_deep_scrub_stamp":"2024-09-12T19:23:38.088049+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.088049+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:45.131291+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46003,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1072,"num_write":420,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.733889+0000","last_change":"2024-09-12T19:23:38.733889+0000","last_active":"2024-09-12T19:23:38.733889+0000","last_peered":"2024-09-12T19:23:38.733889+0000","last_clean":"2024-09-12T19:23:38.733889+0000","last_became_active":"2024-09-12T17:30:00.786100+0000","last_became_peered":"2024-09-12T17:30:00.786100+0000","last_unstale":"2024-09-12T19:23:38.733889+0000","last_undegraded":"2024-09-12T19:23:38.733889+0000","last_fullsized":"2024-09-12T19:23:38.733889+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:38.733659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:38.733659+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.733659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:13.838209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'141","reported_seq":682,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.038822+0000","last_change":"2024-09-12T19:23:41.038822+0000","last_active":"2024-09-12T19:23:41.038822+0000","last_peered":"2024-09-12T19:23:41.038822+0000","last_clean":"2024-09-12T19:23:41.038822+0000","last_became_active":"2024-09-12T17:30:02.807953+0000","last_became_peered":"2024-09-12T17:30:02.807953+0000","last_unstale":"2024-09-12T19:23:41.038822+0000","last_undegraded":"2024-09-12T19:23:41.038822+0000","last_fullsized":"2024-09-12T19:23:41.038822+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-09-12T19:23:41.038597+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-09-12T19:23:41.038597+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.038597+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:28.809543+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216,"num_read_kb":199,"num_write":346,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'853","reported_seq":2473,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.709674+0000","last_change":"2024-09-12T19:23:19.709674+0000","last_active":"2024-09-12T19:23:19.709674+0000","last_peered":"2024-09-12T19:23:19.709674+0000","last_clean":"2024-09-12T19:23:19.709674+0000","last_became_active":"2024-09-12T17:29:54.768439+0000","last_became_peered":"2024-09-12T17:29:54.768439+0000","last_unstale":"2024-09-12T19:23:19.709674+0000","last_undegraded":"2024-09-12T19:23:19.709674+0000","last_fullsized":"2024-09-12T19:23:19.709674+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'853","last_scrub_stamp":"2024-09-12T19:23:19.709485+0000","last_deep_scrub":"267'853","last_deep_scrub_stamp":"2024-09-12T19:23:19.709485+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.709485+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:38.560571+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3940,"num_read_kb":3539,"num_write":1104,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'384","reported_seq":1082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.154790+0000","last_change":"2024-09-12T19:23:12.154790+0000","last_active":"2024-09-12T19:23:12.154790+0000","last_peered":"2024-09-12T19:23:12.154790+0000","last_clean":"2024-09-12T19:23:12.154790+0000","last_became_active":"2024-09-12T17:29:52.732894+0000","last_became_peered":"2024-09-12T17:29:52.732894+0000","last_unstale":"2024-09-12T19:23:12.154790+0000","last_undegraded":"2024-09-12T19:23:12.154790+0000","last_fullsized":"2024-09-12T19:23:12.154790+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'384","last_scrub_stamp":"2024-09-12T19:23:12.154565+0000","last_deep_scrub":"267'384","last_deep_scrub_stamp":"2024-09-12T19:23:12.154565+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.154565+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:11.123992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":583,"num_read_kb":27715,"num_write":1278,"num_write_kb":46649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'496","reported_seq":1995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.698567+0000","last_change":"2024-09-12T19:23:21.698567+0000","last_active":"2024-09-12T19:23:21.698567+0000","last_peered":"2024-09-12T19:23:21.698567+0000","last_clean":"2024-09-12T19:23:21.698567+0000","last_became_active":"2024-09-12T17:29:54.745192+0000","last_became_peered":"2024-09-12T17:29:54.745192+0000","last_unstale":"2024-09-12T19:23:21.698567+0000","last_undegraded":"2024-09-12T19:23:21.698567+0000","last_fullsized":"2024-09-12T19:23:21.698567+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'496","last_scrub_stamp":"2024-09-12T19:23:21.698347+0000","last_deep_scrub":"267'496","last_deep_scrub_stamp":"2024-09-12T19:23:21.698347+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.698347+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:41.917668+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2446,"num_read_kb":2266,"num_write":619,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'407","reported_seq":1149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.950490+0000","last_change":"2024-09-12T19:23:15.950490+0000","last_active":"2024-09-12T19:23:15.950490+0000","last_peered":"2024-09-12T19:23:15.950490+0000","last_clean":"2024-09-12T19:23:15.950490+0000","last_became_active":"2024-09-12T17:29:52.727433+0000","last_became_peered":"2024-09-12T17:29:52.727433+0000","last_unstale":"2024-09-12T19:23:15.950490+0000","last_undegraded":"2024-09-12T19:23:15.950490+0000","last_fullsized":"2024-09-12T19:23:15.950490+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'407","last_scrub_stamp":"2024-09-12T19:23:15.950082+0000","last_deep_scrub":"267'407","last_deep_scrub_stamp":"2024-09-12T19:23:15.950082+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.950082+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:52.289398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":690,"num_read_kb":95087,"num_write":1289,"num_write_kb":35037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'394","reported_seq":1973,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.345761+0000","last_change":"2024-09-12T19:23:23.345761+0000","last_active":"2024-09-12T19:23:23.345761+0000","last_peered":"2024-09-12T19:23:23.345761+0000","last_clean":"2024-09-12T19:23:23.345761+0000","last_became_active":"2024-09-12T17:29:54.762400+0000","last_became_peered":"2024-09-12T17:29:54.762400+0000","last_unstale":"2024-09-12T19:23:23.345761+0000","last_undegraded":"2024-09-12T19:23:23.345761+0000","last_fullsized":"2024-09-12T19:23:23.345761+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'394","last_scrub_stamp":"2024-09-12T19:23:23.345516+0000","last_deep_scrub":"267'394","last_deep_scrub_stamp":"2024-09-12T19:23:23.345516+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.345516+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:40.023760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2164,"num_read_kb":2073,"num_write":429,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'404","reported_seq":1128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.285536+0000","last_change":"2024-09-12T19:23:16.285536+0000","last_active":"2024-09-12T19:23:16.285536+0000","last_peered":"2024-09-12T19:23:16.285536+0000","last_clean":"2024-09-12T19:23:16.285536+0000","last_became_active":"2024-09-12T17:29:52.756626+0000","last_became_peered":"2024-09-12T17:29:52.756626+0000","last_unstale":"2024-09-12T19:23:16.285536+0000","last_undegraded":"2024-09-12T19:23:16.285536+0000","last_fullsized":"2024-09-12T19:23:16.285536+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'404","last_scrub_stamp":"2024-09-12T19:23:16.285300+0000","last_deep_scrub":"267'404","last_deep_scrub_stamp":"2024-09-12T19:23:16.285300+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.285300+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:58.905956+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":688,"num_read_kb":25414,"num_write":1427,"num_write_kb":18603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'785","reported_seq":2463,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.706702+0000","last_change":"2024-09-12T19:23:22.706702+0000","last_active":"2024-09-12T19:23:22.706702+0000","last_peered":"2024-09-12T19:23:22.706702+0000","last_clean":"2024-09-12T19:23:22.706702+0000","last_became_active":"2024-09-12T17:29:54.749249+0000","last_became_peered":"2024-09-12T17:29:54.749249+0000","last_unstale":"2024-09-12T19:23:22.706702+0000","last_undegraded":"2024-09-12T19:23:22.706702+0000","last_fullsized":"2024-09-12T19:23:22.706702+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'785","last_scrub_stamp":"2024-09-12T19:23:22.706520+0000","last_deep_scrub":"267'785","last_deep_scrub_stamp":"2024-09-12T19:23:22.706520+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.706520+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:51.140029+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3916,"num_read_kb":3572,"num_write":1026,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2553,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'306","reported_seq":967,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.917382+0000","last_change":"2024-09-12T19:23:14.917382+0000","last_active":"2024-09-12T19:23:14.917382+0000","last_peered":"2024-09-12T19:23:14.917382+0000","last_clean":"2024-09-12T19:23:14.917382+0000","last_became_active":"2024-09-12T17:29:52.767047+0000","last_became_peered":"2024-09-12T17:29:52.767047+0000","last_unstale":"2024-09-12T19:23:14.917382+0000","last_undegraded":"2024-09-12T19:23:14.917382+0000","last_fullsized":"2024-09-12T19:23:14.917382+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'306","last_scrub_stamp":"2024-09-12T19:23:14.916990+0000","last_deep_scrub":"267'306","last_deep_scrub_stamp":"2024-09-12T19:23:14.916990+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.916990+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:55.549231+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900516,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":422,"num_read_kb":21273,"num_write":1050,"num_write_kb":35522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'495","reported_seq":2164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.149430+0000","last_change":"2024-09-12T19:23:28.149430+0000","last_active":"2024-09-12T19:23:28.149430+0000","last_peered":"2024-09-12T19:23:28.149430+0000","last_clean":"2024-09-12T19:23:28.149430+0000","last_became_active":"2024-09-12T17:29:54.762667+0000","last_became_peered":"2024-09-12T17:29:54.762667+0000","last_unstale":"2024-09-12T19:23:28.149430+0000","last_undegraded":"2024-09-12T19:23:28.149430+0000","last_fullsized":"2024-09-12T19:23:28.149430+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'495","last_scrub_stamp":"2024-09-12T19:23:28.149234+0000","last_deep_scrub":"267'495","last_deep_scrub_stamp":"2024-09-12T19:23:28.149234+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.149234+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:49.849143+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2506,"num_read_kb":2365,"num_write":559,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'353","reported_seq":1041,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.110866+0000","last_change":"2024-09-12T19:23:16.110866+0000","last_active":"2024-09-12T19:23:16.110866+0000","last_peered":"2024-09-12T19:23:16.110866+0000","last_clean":"2024-09-12T19:23:16.110866+0000","last_became_active":"2024-09-12T17:29:52.765692+0000","last_became_peered":"2024-09-12T17:29:52.765692+0000","last_unstale":"2024-09-12T19:23:16.110866+0000","last_undegraded":"2024-09-12T19:23:16.110866+0000","last_fullsized":"2024-09-12T19:23:16.110866+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'353","last_scrub_stamp":"2024-09-12T19:23:16.110496+0000","last_deep_scrub":"267'353","last_deep_scrub_stamp":"2024-09-12T19:23:16.110496+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.110496+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:11.327254+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992395,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":536,"num_read_kb":21751,"num_write":1010,"num_write_kb":25522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'962","reported_seq":2744,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.252068+0000","last_change":"2024-09-12T19:23:24.252068+0000","last_active":"2024-09-12T19:23:24.252068+0000","last_peered":"2024-09-12T19:23:24.252068+0000","last_clean":"2024-09-12T19:23:24.252068+0000","last_became_active":"2024-09-12T17:29:54.769223+0000","last_became_peered":"2024-09-12T17:29:54.769223+0000","last_unstale":"2024-09-12T19:23:24.252068+0000","last_undegraded":"2024-09-12T19:23:24.252068+0000","last_fullsized":"2024-09-12T19:23:24.252068+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'962","last_scrub_stamp":"2024-09-12T19:23:24.251880+0000","last_deep_scrub":"267'962","last_deep_scrub_stamp":"2024-09-12T19:23:24.251880+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.251880+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":900,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:09.231713+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4532,"num_read_kb":4067,"num_write":1265,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'312","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.658326+0000","last_change":"2024-09-12T19:23:09.658326+0000","last_active":"2024-09-12T19:23:09.658326+0000","last_peered":"2024-09-12T19:23:09.658326+0000","last_clean":"2024-09-12T19:23:09.658326+0000","last_became_active":"2024-09-12T17:29:52.728523+0000","last_became_peered":"2024-09-12T17:29:52.728523+0000","last_unstale":"2024-09-12T19:23:09.658326+0000","last_undegraded":"2024-09-12T19:23:09.658326+0000","last_fullsized":"2024-09-12T19:23:09.658326+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'312","last_scrub_stamp":"2024-09-12T19:23:09.658187+0000","last_deep_scrub":"267'312","last_deep_scrub_stamp":"2024-09-12T19:23:09.658187+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.658187+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:25.530411+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":2514,"num_write":1024,"num_write_kb":45573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'968","reported_seq":2668,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.193466+0000","last_change":"2024-09-12T19:23:27.193466+0000","last_active":"2024-09-12T19:23:27.193466+0000","last_peered":"2024-09-12T19:23:27.193466+0000","last_clean":"2024-09-12T19:23:27.193466+0000","last_became_active":"2024-09-12T17:29:54.758687+0000","last_became_peered":"2024-09-12T17:29:54.758687+0000","last_unstale":"2024-09-12T19:23:27.193466+0000","last_undegraded":"2024-09-12T19:23:27.193466+0000","last_fullsized":"2024-09-12T19:23:27.193466+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'968","last_scrub_stamp":"2024-09-12T19:23:27.193272+0000","last_deep_scrub":"267'968","last_deep_scrub_stamp":"2024-09-12T19:23:27.193272+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.193272+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":900,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:29.700297+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4571,"num_read_kb":4077,"num_write":1316,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'354","reported_seq":1040,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.196879+0000","last_change":"2024-09-12T19:23:13.196879+0000","last_active":"2024-09-12T19:23:13.196879+0000","last_peered":"2024-09-12T19:23:13.196879+0000","last_clean":"2024-09-12T19:23:13.196879+0000","last_became_active":"2024-09-12T17:29:52.718689+0000","last_became_peered":"2024-09-12T17:29:52.718689+0000","last_unstale":"2024-09-12T19:23:13.196879+0000","last_undegraded":"2024-09-12T19:23:13.196879+0000","last_fullsized":"2024-09-12T19:23:13.196879+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-09-12T19:23:13.196640+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-09-12T19:23:13.196640+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.196640+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:32:39.813132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":521,"num_read_kb":13386,"num_write":1097,"num_write_kb":27082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'1292","reported_seq":2911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.220616+0000","last_change":"2024-09-12T19:23:19.220616+0000","last_active":"2024-09-12T19:23:19.220616+0000","last_peered":"2024-09-12T19:23:19.220616+0000","last_clean":"2024-09-12T19:23:19.220616+0000","last_became_active":"2024-09-12T17:29:54.764876+0000","last_became_peered":"2024-09-12T17:29:54.764876+0000","last_unstale":"2024-09-12T19:23:19.220616+0000","last_undegraded":"2024-09-12T19:23:19.220616+0000","last_fullsized":"2024-09-12T19:23:19.220616+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1292","last_scrub_stamp":"2024-09-12T19:23:19.220421+0000","last_deep_scrub":"267'1292","last_deep_scrub_stamp":"2024-09-12T19:23:19.220421+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.220421+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":1200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:24.771326+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5917,"num_read_kb":5200,"num_write":1797,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'408","reported_seq":1091,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.128933+0000","last_change":"2024-09-12T19:23:15.128933+0000","last_active":"2024-09-12T19:23:15.128933+0000","last_peered":"2024-09-12T19:23:15.128933+0000","last_clean":"2024-09-12T19:23:15.128933+0000","last_became_active":"2024-09-12T17:29:52.769086+0000","last_became_peered":"2024-09-12T17:29:52.769086+0000","last_unstale":"2024-09-12T19:23:15.128933+0000","last_undegraded":"2024-09-12T19:23:15.128933+0000","last_fullsized":"2024-09-12T19:23:15.128933+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'408","last_scrub_stamp":"2024-09-12T19:23:15.128724+0000","last_deep_scrub":"267'408","last_deep_scrub_stamp":"2024-09-12T19:23:15.128724+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.128724+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:19.551998+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730154,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":563,"num_read_kb":7699,"num_write":1244,"num_write_kb":36052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"267'896","reported_seq":2492,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.943017+0000","last_change":"2024-09-12T19:23:15.943017+0000","last_active":"2024-09-12T19:23:15.943017+0000","last_peered":"2024-09-12T19:23:15.943017+0000","last_clean":"2024-09-12T19:23:15.943017+0000","last_became_active":"2024-09-12T17:29:54.759892+0000","last_became_peered":"2024-09-12T17:29:54.759892+0000","last_unstale":"2024-09-12T19:23:15.943017+0000","last_undegraded":"2024-09-12T19:23:15.943017+0000","last_fullsized":"2024-09-12T19:23:15.943017+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'896","last_scrub_stamp":"2024-09-12T19:23:15.942710+0000","last_deep_scrub":"267'896","last_deep_scrub_stamp":"2024-09-12T19:23:15.942710+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.942710+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:22.175169+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4227,"num_read_kb":3797,"num_write":1212,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":729,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'326","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.372677+0000","last_change":"2024-09-12T19:23:18.372677+0000","last_active":"2024-09-12T19:23:18.372677+0000","last_peered":"2024-09-12T19:23:18.372677+0000","last_clean":"2024-09-12T19:23:18.372677+0000","last_became_active":"2024-09-12T17:29:52.748790+0000","last_became_peered":"2024-09-12T17:29:52.748790+0000","last_unstale":"2024-09-12T19:23:18.372677+0000","last_undegraded":"2024-09-12T19:23:18.372677+0000","last_fullsized":"2024-09-12T19:23:18.372677+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'326","last_scrub_stamp":"2024-09-12T19:23:18.372450+0000","last_deep_scrub":"267'326","last_deep_scrub_stamp":"2024-09-12T19:23:18.372450+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.372450+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:49.825077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":434,"num_read_kb":14399,"num_write":1080,"num_write_kb":30402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'1656","reported_seq":3231,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.270886+0000","last_change":"2024-09-12T19:23:23.270886+0000","last_active":"2024-09-12T19:23:23.270886+0000","last_peered":"2024-09-12T19:23:23.270886+0000","last_clean":"2024-09-12T19:23:23.270886+0000","last_became_active":"2024-09-12T17:29:54.754702+0000","last_became_peered":"2024-09-12T17:29:54.754702+0000","last_unstale":"2024-09-12T19:23:23.270886+0000","last_undegraded":"2024-09-12T19:23:23.270886+0000","last_fullsized":"2024-09-12T19:23:23.270886+0000","mapping_epoch":28,"log_start":"267'1600","ondisk_log_start":"267'1600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1656","last_scrub_stamp":"2024-09-12T19:23:23.270692+0000","last_deep_scrub":"267'1656","last_deep_scrub_stamp":"2024-09-12T19:23:23.270692+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.270692+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":1600,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:49:05.709009+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7245,"num_read_kb":6284,"num_write":2371,"num_write_kb":1100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'306","reported_seq":980,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.172017+0000","last_change":"2024-09-12T19:23:14.172017+0000","last_active":"2024-09-12T19:23:14.172017+0000","last_peered":"2024-09-12T19:23:14.172017+0000","last_clean":"2024-09-12T19:23:14.172017+0000","last_became_active":"2024-09-12T17:29:52.767990+0000","last_became_peered":"2024-09-12T17:29:52.767990+0000","last_unstale":"2024-09-12T19:23:14.172017+0000","last_undegraded":"2024-09-12T19:23:14.172017+0000","last_fullsized":"2024-09-12T19:23:14.172017+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'306","last_scrub_stamp":"2024-09-12T19:23:14.171585+0000","last_deep_scrub":"267'306","last_deep_scrub_stamp":"2024-09-12T19:23:14.171585+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.171585+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:44.675581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":644,"num_write":1033,"num_write_kb":10844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'933","reported_seq":2514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.964877+0000","last_change":"2024-09-12T19:23:11.964877+0000","last_active":"2024-09-12T19:23:11.964877+0000","last_peered":"2024-09-12T19:23:11.964877+0000","last_clean":"2024-09-12T19:23:11.964877+0000","last_became_active":"2024-09-12T17:29:54.759169+0000","last_became_peered":"2024-09-12T17:29:54.759169+0000","last_unstale":"2024-09-12T19:23:11.964877+0000","last_undegraded":"2024-09-12T19:23:11.964877+0000","last_fullsized":"2024-09-12T19:23:11.964877+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'933","last_scrub_stamp":"2024-09-12T19:23:11.964699+0000","last_deep_scrub":"267'933","last_deep_scrub_stamp":"2024-09-12T19:23:11.964699+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.964699+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":900,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:21.605696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4504,"num_read_kb":3992,"num_write":1315,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'297","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.240869+0000","last_change":"2024-09-12T19:23:15.240869+0000","last_active":"2024-09-12T19:23:15.240869+0000","last_peered":"2024-09-12T19:23:15.240869+0000","last_clean":"2024-09-12T19:23:15.240869+0000","last_became_active":"2024-09-12T17:29:52.753935+0000","last_became_peered":"2024-09-12T17:29:52.753935+0000","last_unstale":"2024-09-12T19:23:15.240869+0000","last_undegraded":"2024-09-12T19:23:15.240869+0000","last_fullsized":"2024-09-12T19:23:15.240869+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'297","last_scrub_stamp":"2024-09-12T19:23:15.240643+0000","last_deep_scrub":"267'297","last_deep_scrub_stamp":"2024-09-12T19:23:15.240643+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.240643+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:02.060836+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340668,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":430,"num_read_kb":10673,"num_write":974,"num_write_kb":41601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'837","reported_seq":2507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.256275+0000","last_change":"2024-09-12T19:23:21.256275+0000","last_active":"2024-09-12T19:23:21.256275+0000","last_peered":"2024-09-12T19:23:21.256275+0000","last_clean":"2024-09-12T19:23:21.256275+0000","last_became_active":"2024-09-12T17:29:54.760784+0000","last_became_peered":"2024-09-12T17:29:54.760784+0000","last_unstale":"2024-09-12T19:23:21.256275+0000","last_undegraded":"2024-09-12T19:23:21.256275+0000","last_fullsized":"2024-09-12T19:23:21.256275+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'837","last_scrub_stamp":"2024-09-12T19:23:21.256101+0000","last_deep_scrub":"267'837","last_deep_scrub_stamp":"2024-09-12T19:23:21.256101+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.256101+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:33:40.828572+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4062,"num_read_kb":3682,"num_write":1062,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1008,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'490","reported_seq":1220,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.818268+0000","last_change":"2024-09-12T19:23:21.818268+0000","last_active":"2024-09-12T19:23:21.818268+0000","last_peered":"2024-09-12T19:23:21.818268+0000","last_clean":"2024-09-12T19:23:21.818268+0000","last_became_active":"2024-09-12T17:29:52.735333+0000","last_became_peered":"2024-09-12T17:29:52.735333+0000","last_unstale":"2024-09-12T19:23:21.818268+0000","last_undegraded":"2024-09-12T19:23:21.818268+0000","last_fullsized":"2024-09-12T19:23:21.818268+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'490","last_scrub_stamp":"2024-09-12T19:23:21.818028+0000","last_deep_scrub":"267'490","last_deep_scrub_stamp":"2024-09-12T19:23:21.818028+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.818028+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:20.819323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":869,"num_read_kb":5832,"num_write":1431,"num_write_kb":32355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'868","reported_seq":2455,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.061161+0000","last_change":"2024-09-12T19:23:23.061161+0000","last_active":"2024-09-12T19:23:23.061161+0000","last_peered":"2024-09-12T19:23:23.061161+0000","last_clean":"2024-09-12T19:23:23.061161+0000","last_became_active":"2024-09-12T17:29:54.753635+0000","last_became_peered":"2024-09-12T17:29:54.753635+0000","last_unstale":"2024-09-12T19:23:23.061161+0000","last_undegraded":"2024-09-12T19:23:23.061161+0000","last_fullsized":"2024-09-12T19:23:23.061161+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'868","last_scrub_stamp":"2024-09-12T19:23:23.060978+0000","last_deep_scrub":"267'868","last_deep_scrub_stamp":"2024-09-12T19:23:23.060978+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.060978+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:13.470283+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4079,"num_read_kb":3651,"num_write":1151,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'312","reported_seq":1076,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.225895+0000","last_change":"2024-09-12T19:23:15.225895+0000","last_active":"2024-09-12T19:23:15.225895+0000","last_peered":"2024-09-12T19:23:15.225895+0000","last_clean":"2024-09-12T19:23:15.225895+0000","last_became_active":"2024-09-12T17:29:52.744397+0000","last_became_peered":"2024-09-12T17:29:52.744397+0000","last_unstale":"2024-09-12T19:23:15.225895+0000","last_undegraded":"2024-09-12T19:23:15.225895+0000","last_fullsized":"2024-09-12T19:23:15.225895+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'312","last_scrub_stamp":"2024-09-12T19:23:15.225542+0000","last_deep_scrub":"267'312","last_deep_scrub_stamp":"2024-09-12T19:23:15.225542+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.225542+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:31.333562+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170396,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":764,"num_read_kb":16845,"num_write":1041,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'476","reported_seq":2110,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.887757+0000","last_change":"2024-09-12T19:23:18.887757+0000","last_active":"2024-09-12T19:23:18.887757+0000","last_peered":"2024-09-12T19:23:18.887757+0000","last_clean":"2024-09-12T19:23:18.887757+0000","last_became_active":"2024-09-12T17:29:54.751872+0000","last_became_peered":"2024-09-12T17:29:54.751872+0000","last_unstale":"2024-09-12T19:23:18.887757+0000","last_undegraded":"2024-09-12T19:23:18.887757+0000","last_fullsized":"2024-09-12T19:23:18.887757+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'476","last_scrub_stamp":"2024-09-12T19:23:18.887565+0000","last_deep_scrub":"267'476","last_deep_scrub_stamp":"2024-09-12T19:23:18.887565+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.887565+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:59.888303+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2533,"num_read_kb":2381,"num_write":539,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2539,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'294","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.102283+0000","last_change":"2024-09-12T19:23:18.102283+0000","last_active":"2024-09-12T19:23:18.102283+0000","last_peered":"2024-09-12T19:23:18.102283+0000","last_clean":"2024-09-12T19:23:18.102283+0000","last_became_active":"2024-09-12T17:29:52.747688+0000","last_became_peered":"2024-09-12T17:29:52.747688+0000","last_unstale":"2024-09-12T19:23:18.102283+0000","last_undegraded":"2024-09-12T19:23:18.102283+0000","last_fullsized":"2024-09-12T19:23:18.102283+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'294","last_scrub_stamp":"2024-09-12T19:23:18.102039+0000","last_deep_scrub":"267'294","last_deep_scrub_stamp":"2024-09-12T19:23:18.102039+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.102039+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:41.889385+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262281,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":403,"num_read_kb":6219,"num_write":990,"num_write_kb":21267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'430","reported_seq":1951,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.159013+0000","last_change":"2024-09-12T19:23:31.159013+0000","last_active":"2024-09-12T19:23:31.159013+0000","last_peered":"2024-09-12T19:23:31.159013+0000","last_clean":"2024-09-12T19:23:31.159013+0000","last_became_active":"2024-09-12T17:29:54.760373+0000","last_became_peered":"2024-09-12T17:29:54.760373+0000","last_unstale":"2024-09-12T19:23:31.159013+0000","last_undegraded":"2024-09-12T19:23:31.159013+0000","last_fullsized":"2024-09-12T19:23:31.159013+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'430","last_scrub_stamp":"2024-09-12T19:23:31.158824+0000","last_deep_scrub":"267'430","last_deep_scrub_stamp":"2024-09-12T19:23:31.158824+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.158824+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:32.246805+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2333,"num_read_kb":2181,"num_write":522,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'333","reported_seq":1036,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.012002+0000","last_change":"2024-09-12T19:23:11.012002+0000","last_active":"2024-09-12T19:23:11.012002+0000","last_peered":"2024-09-12T19:23:11.012002+0000","last_clean":"2024-09-12T19:23:11.012002+0000","last_became_active":"2024-09-12T17:29:52.746880+0000","last_became_peered":"2024-09-12T17:29:52.746880+0000","last_unstale":"2024-09-12T19:23:11.012002+0000","last_undegraded":"2024-09-12T19:23:11.012002+0000","last_fullsized":"2024-09-12T19:23:11.012002+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-09-12T19:23:11.011792+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-09-12T19:23:11.011792+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.011792+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:47.703391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399180,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":70822,"num_write":1091,"num_write_kb":52448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'788","reported_seq":2454,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.032535+0000","last_change":"2024-09-12T19:23:24.032535+0000","last_active":"2024-09-12T19:23:24.032535+0000","last_peered":"2024-09-12T19:23:24.032535+0000","last_clean":"2024-09-12T19:23:24.032535+0000","last_became_active":"2024-09-12T17:29:54.765197+0000","last_became_peered":"2024-09-12T17:29:54.765197+0000","last_unstale":"2024-09-12T19:23:24.032535+0000","last_undegraded":"2024-09-12T19:23:24.032535+0000","last_fullsized":"2024-09-12T19:23:24.032535+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'788","last_scrub_stamp":"2024-09-12T19:23:24.032353+0000","last_deep_scrub":"267'788","last_deep_scrub_stamp":"2024-09-12T19:23:24.032353+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.032353+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:14.118280+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3968,"num_read_kb":3617,"num_write":1032,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'309","reported_seq":971,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.332041+0000","last_change":"2024-09-12T19:23:17.332041+0000","last_active":"2024-09-12T19:23:17.332041+0000","last_peered":"2024-09-12T19:23:17.332041+0000","last_clean":"2024-09-12T19:23:17.332041+0000","last_became_active":"2024-09-12T17:29:52.749742+0000","last_became_peered":"2024-09-12T17:29:52.749742+0000","last_unstale":"2024-09-12T19:23:17.332041+0000","last_undegraded":"2024-09-12T19:23:17.332041+0000","last_fullsized":"2024-09-12T19:23:17.332041+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'309","last_scrub_stamp":"2024-09-12T19:23:17.331803+0000","last_deep_scrub":"267'309","last_deep_scrub_stamp":"2024-09-12T19:23:17.331803+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.331803+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:46.672373+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":13262,"num_write":1037,"num_write_kb":35239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'334","reported_seq":988,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.345593+0000","last_change":"2024-09-12T19:23:19.345593+0000","last_active":"2024-09-12T19:23:19.345593+0000","last_peered":"2024-09-12T19:23:19.345593+0000","last_clean":"2024-09-12T19:23:19.345593+0000","last_became_active":"2024-09-12T17:29:52.720918+0000","last_became_peered":"2024-09-12T17:29:52.720918+0000","last_unstale":"2024-09-12T19:23:19.345593+0000","last_undegraded":"2024-09-12T19:23:19.345593+0000","last_fullsized":"2024-09-12T19:23:19.345593+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'334","last_scrub_stamp":"2024-09-12T19:23:19.345352+0000","last_deep_scrub":"267'334","last_deep_scrub_stamp":"2024-09-12T19:23:19.345352+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.345352+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:34.000068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170702,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":3934,"num_write":1046,"num_write_kb":9633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'602","reported_seq":2196,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.928201+0000","last_change":"2024-09-12T19:23:16.928044+0000","last_active":"2024-09-12T19:23:16.928201+0000","last_peered":"2024-09-12T19:23:16.928201+0000","last_clean":"2024-09-12T19:23:16.928201+0000","last_became_active":"2024-09-12T17:29:54.752553+0000","last_became_peered":"2024-09-12T17:29:54.752553+0000","last_unstale":"2024-09-12T19:23:16.928201+0000","last_undegraded":"2024-09-12T19:23:16.928201+0000","last_fullsized":"2024-09-12T19:23:16.928201+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'602","last_scrub_stamp":"2024-09-12T19:23:16.927841+0000","last_deep_scrub":"267'602","last_deep_scrub_stamp":"2024-09-12T19:23:16.927841+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.927841+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":500,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:30.799294+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3060,"num_read_kb":2784,"num_write":774,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'400","reported_seq":1094,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.722510+0000","last_change":"2024-09-12T19:23:12.722510+0000","last_active":"2024-09-12T19:23:12.722510+0000","last_peered":"2024-09-12T19:23:12.722510+0000","last_clean":"2024-09-12T19:23:12.722510+0000","last_became_active":"2024-09-12T17:30:22.254863+0000","last_became_peered":"2024-09-12T17:30:22.254863+0000","last_unstale":"2024-09-12T19:23:12.722510+0000","last_undegraded":"2024-09-12T19:23:12.722510+0000","last_fullsized":"2024-09-12T19:23:12.722510+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'400","last_scrub_stamp":"2024-09-12T19:23:12.722194+0000","last_deep_scrub":"267'400","last_deep_scrub_stamp":"2024-09-12T19:23:12.722194+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.722194+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:23.077630+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992370,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":655,"num_read_kb":2597,"num_write":1307,"num_write_kb":14489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5,0],"acting":[1,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'448","reported_seq":1957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.408164+0000","last_change":"2024-09-12T19:23:25.408021+0000","last_active":"2024-09-12T19:23:25.408164+0000","last_peered":"2024-09-12T19:23:25.408164+0000","last_clean":"2024-09-12T19:23:25.408164+0000","last_became_active":"2024-09-12T17:29:54.763613+0000","last_became_peered":"2024-09-12T17:29:54.763613+0000","last_unstale":"2024-09-12T19:23:25.408164+0000","last_undegraded":"2024-09-12T19:23:25.408164+0000","last_fullsized":"2024-09-12T19:23:25.408164+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'448","last_scrub_stamp":"2024-09-12T19:23:25.407841+0000","last_deep_scrub":"267'448","last_deep_scrub_stamp":"2024-09-12T19:23:25.407841+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.407841+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:02.339912+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2478,"num_read_kb":2322,"num_write":560,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5989,"num_read_kb":4199,"num_write":1940,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7510,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1013,"ondisk_log_size":1013,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16341,"num_read_kb":15997,"num_write":16735,"num_write_kb":4892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2683,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1759,"ondisk_log_size":1759,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":476,"ondisk_log_size":476,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1542315,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":20962,"num_read_kb":40263,"num_write":17485,"num_write_kb":12367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685252,"num_omap_keys":1576,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1865,"ondisk_log_size":1865,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212845,"num_read_kb":194484,"num_write":55296,"num_write_kb":18842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43560,"num_omap_keys":175,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3868,"ondisk_log_size":3868,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":66041020,"num_objects":366,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":366,"num_whiteouts":0,"num_read":36181,"num_read_kb":1906096,"num_write":71498,"num_write_kb":2114280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90423296,"data_stored":90423296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3830,"ondisk_log_size":3830,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":168420,"num_write":154,"num_write_kb":116143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":174519,"num_write":154,"num_write_kb":116143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543525,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316644,"kb_used_data":14740,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94055196,"statfs":{"total":96636764160,"available":96312520704,"internally_reserved":0,"allocated":15093760,"data_stored":13085472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":309131722},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543531,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296832,"kb_used_data":12976,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94075008,"statfs":{"total":96636764160,"available":96332808192,"internally_reserved":0,"allocated":13287424,"data_stored":11310974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":290650566},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543524,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177144,"kb_used_data":11368,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94194696,"statfs":{"total":96636764160,"available":96455368704,"internally_reserved":0,"allocated":11640832,"data_stored":9617929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543526,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161488,"kb_used_data":17856,"kb_used_omap":1,"kb_used_meta":143614,"kb_avail":94210352,"statfs":{"total":96636764160,"available":96471400448,"internally_reserved":0,"allocated":18284544,"data_stored":16335473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":147061189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543525,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310864,"kb_used_data":18688,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":94060976,"statfs":{"total":96636764160,"available":96318439424,"internally_reserved":0,"allocated":19136512,"data_stored":17127576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":299170247},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543527,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126664,"kb_used_data":14968,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94245176,"statfs":{"total":96636764160,"available":96507060224,"internally_reserved":0,"allocated":15327232,"data_stored":13358682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543523,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200244,"kb_used_data":16420,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94171596,"statfs":{"total":96636764160,"available":96431714304,"internally_reserved":0,"allocated":16814080,"data_stored":14841351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543525,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299704,"kb_used_data":15912,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":94072136,"statfs":{"total":96636764160,"available":96329867264,"internally_reserved":0,"allocated":16293888,"data_stored":14257873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":290585029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11374592,"data_stored":11374592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12550144,"data_stored":12550144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11067392,"data_stored":11067392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14835712,"data_stored":14835712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14045184,"data_stored":14045184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7327744,"data_stored":7327744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9019392,"data_stored":9019392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10203136,"data_stored":10203136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":5848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:24:11.089 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T17:51:51.839814+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:24:11.089 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T18:19:21.610301+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=19, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:24:11.089 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:24:11.090 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T17:51:58.890347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=51, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=23, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:24:11.093 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T19:24:31.095 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:24:31.456 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-12T19:24:31.470 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-12T19:24:31.480 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":3710,"stamp":"2024-09-12T19:24:31.321941+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68190910,"num_objects":834,"num_object_clones":0,"num_object_copies":2400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":834,"num_whiteouts":0,"num_read":295061,"num_read_kb":2506908,"num_write":163405,"num_write_kb":2385161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":740133,"num_omap_keys":1795,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13108,"ondisk_log_size":13108,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1889584,"kb_used_data":122928,"kb_used_omap":12,"kb_used_meta":1766515,"kb_avail":753085136,"statfs":{"total":773094113280,"available":771159179264,"internally_reserved":0,"allocated":125878272,"data_stored":109935330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1808911920},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010045"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:55.317973+0000","last_change":"2024-09-12T19:23:55.317807+0000","last_active":"2024-09-12T19:23:55.317973+0000","last_peered":"2024-09-12T19:23:55.317973+0000","last_clean":"2024-09-12T19:23:55.317973+0000","last_became_active":"2024-09-12T18:19:22.658759+0000","last_became_peered":"2024-09-12T18:19:22.658759+0000","last_unstale":"2024-09-12T19:23:55.317973+0000","last_undegraded":"2024-09-12T19:23:55.317973+0000","last_fullsized":"2024-09-12T19:23:55.317973+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:55.317627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:55.317627+0000","last_clean_scrub_stamp":"2024-09-12T19:23:55.317627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:43.045483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:54.335021+0000","last_change":"2024-09-12T19:23:54.335021+0000","last_active":"2024-09-12T19:23:54.335021+0000","last_peered":"2024-09-12T19:23:54.335021+0000","last_clean":"2024-09-12T19:23:54.335021+0000","last_became_active":"2024-09-12T17:51:59.969612+0000","last_became_peered":"2024-09-12T17:51:59.969612+0000","last_unstale":"2024-09-12T19:23:54.335021+0000","last_undegraded":"2024-09-12T19:23:54.335021+0000","last_fullsized":"2024-09-12T19:23:54.335021+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:54.334833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:54.334833+0000","last_clean_scrub_stamp":"2024-09-12T19:23:54.334833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:58.509080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'6","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:08.858491+0000","last_change":"2024-09-12T19:24:08.858328+0000","last_active":"2024-09-12T19:24:08.858491+0000","last_peered":"2024-09-12T19:24:08.858491+0000","last_clean":"2024-09-12T19:24:08.858491+0000","last_became_active":"2024-09-12T17:51:52.890029+0000","last_became_peered":"2024-09-12T17:51:52.890029+0000","last_unstale":"2024-09-12T19:24:08.858491+0000","last_undegraded":"2024-09-12T19:24:08.858491+0000","last_fullsized":"2024-09-12T19:24:08.858491+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T19:24:08.858140+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T19:24:08.858140+0000","last_clean_scrub_stamp":"2024-09-12T19:24:08.858140+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:03.104693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'76","reported_seq":384,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:52.691579+0000","last_change":"2024-09-12T19:23:52.691579+0000","last_active":"2024-09-12T19:23:52.691579+0000","last_peered":"2024-09-12T19:23:52.691579+0000","last_clean":"2024-09-12T19:23:52.691579+0000","last_became_active":"2024-09-12T17:45:41.585012+0000","last_became_peered":"2024-09-12T17:45:41.585012+0000","last_unstale":"2024-09-12T19:23:52.691579+0000","last_undegraded":"2024-09-12T19:23:52.691579+0000","last_fullsized":"2024-09-12T19:23:52.691579+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'76","last_scrub_stamp":"2024-09-12T19:23:52.691397+0000","last_deep_scrub":"267'76","last_deep_scrub_stamp":"2024-09-12T19:23:52.691397+0000","last_clean_scrub_stamp":"2024-09-12T19:23:52.691397+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:27.011402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":580,"num_read_kb":395,"num_write":86,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5010,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.933633+0000","last_change":"2024-09-12T19:23:35.933499+0000","last_active":"2024-09-12T19:23:35.933633+0000","last_peered":"2024-09-12T19:23:35.933633+0000","last_clean":"2024-09-12T19:23:35.933633+0000","last_became_active":"2024-09-12T18:19:22.641172+0000","last_became_peered":"2024-09-12T18:19:22.641172+0000","last_unstale":"2024-09-12T19:23:35.933633+0000","last_undegraded":"2024-09-12T19:23:35.933633+0000","last_fullsized":"2024-09-12T19:23:35.933633+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:35.933324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:35.933324+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.933324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:07.656674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:57.117453+0000","last_change":"2024-09-12T19:23:57.117453+0000","last_active":"2024-09-12T19:23:57.117453+0000","last_peered":"2024-09-12T19:23:57.117453+0000","last_clean":"2024-09-12T19:23:57.117453+0000","last_became_active":"2024-09-12T17:51:59.957109+0000","last_became_peered":"2024-09-12T17:51:59.957109+0000","last_unstale":"2024-09-12T19:23:57.117453+0000","last_undegraded":"2024-09-12T19:23:57.117453+0000","last_fullsized":"2024-09-12T19:23:57.117453+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:23:57.117263+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:23:57.117263+0000","last_clean_scrub_stamp":"2024-09-12T19:23:57.117263+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:27.733737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'3","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:47.700825+0000","last_change":"2024-09-12T19:23:47.700672+0000","last_active":"2024-09-12T19:23:47.700825+0000","last_peered":"2024-09-12T19:23:47.700825+0000","last_clean":"2024-09-12T19:23:47.700825+0000","last_became_active":"2024-09-12T17:51:52.905220+0000","last_became_peered":"2024-09-12T17:51:52.905220+0000","last_unstale":"2024-09-12T19:23:47.700825+0000","last_undegraded":"2024-09-12T19:23:47.700825+0000","last_fullsized":"2024-09-12T19:23:47.700825+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:23:47.700481+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:23:47.700481+0000","last_clean_scrub_stamp":"2024-09-12T19:23:47.700481+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:24.745509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'123","reported_seq":497,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.967841+0000","last_change":"2024-09-12T19:23:27.967588+0000","last_active":"2024-09-12T19:23:27.967841+0000","last_peered":"2024-09-12T19:23:27.967841+0000","last_clean":"2024-09-12T19:23:27.967841+0000","last_became_active":"2024-09-12T17:45:41.572859+0000","last_became_peered":"2024-09-12T17:45:41.572859+0000","last_unstale":"2024-09-12T19:23:27.967841+0000","last_undegraded":"2024-09-12T19:23:27.967841+0000","last_fullsized":"2024-09-12T19:23:27.967841+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'123","last_scrub_stamp":"2024-09-12T19:23:27.967374+0000","last_deep_scrub":"267'123","last_deep_scrub_stamp":"2024-09-12T19:23:27.967374+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.967374+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:59.956709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":788,"num_read_kb":542,"num_write":175,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2500,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.278025+0000","last_change":"2024-09-12T19:23:42.278025+0000","last_active":"2024-09-12T19:23:42.278025+0000","last_peered":"2024-09-12T19:23:42.278025+0000","last_clean":"2024-09-12T19:23:42.278025+0000","last_became_active":"2024-09-12T18:19:22.652800+0000","last_became_peered":"2024-09-12T18:19:22.652800+0000","last_unstale":"2024-09-12T19:23:42.278025+0000","last_undegraded":"2024-09-12T19:23:42.278025+0000","last_fullsized":"2024-09-12T19:23:42.278025+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:42.277839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:42.277839+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.277839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:03.630377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:02.712018+0000","last_change":"2024-09-12T19:24:02.712018+0000","last_active":"2024-09-12T19:24:02.712018+0000","last_peered":"2024-09-12T19:24:02.712018+0000","last_clean":"2024-09-12T19:24:02.712018+0000","last_became_active":"2024-09-12T17:51:59.954517+0000","last_became_peered":"2024-09-12T17:51:59.954517+0000","last_unstale":"2024-09-12T19:24:02.712018+0000","last_undegraded":"2024-09-12T19:24:02.712018+0000","last_fullsized":"2024-09-12T19:24:02.712018+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:02.711827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:02.711827+0000","last_clean_scrub_stamp":"2024-09-12T19:24:02.711827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:46.831867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"267'2","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.928253+0000","last_change":"2024-09-12T19:23:31.928017+0000","last_active":"2024-09-12T19:23:31.928253+0000","last_peered":"2024-09-12T19:23:31.928253+0000","last_clean":"2024-09-12T19:23:31.928253+0000","last_became_active":"2024-09-12T17:51:52.885677+0000","last_became_peered":"2024-09-12T17:51:52.885677+0000","last_unstale":"2024-09-12T19:23:31.928253+0000","last_undegraded":"2024-09-12T19:23:31.928253+0000","last_fullsized":"2024-09-12T19:23:31.928253+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:31.927774+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:31.927774+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.927774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:39.909778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'26","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:49.739051+0000","last_change":"2024-09-12T19:23:49.739051+0000","last_active":"2024-09-12T19:23:49.739051+0000","last_peered":"2024-09-12T19:23:49.739051+0000","last_clean":"2024-09-12T19:23:49.739051+0000","last_became_active":"2024-09-12T17:45:41.575793+0000","last_became_peered":"2024-09-12T17:45:41.575793+0000","last_unstale":"2024-09-12T19:23:49.739051+0000","last_undegraded":"2024-09-12T19:23:49.739051+0000","last_fullsized":"2024-09-12T19:23:49.739051+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-09-12T19:23:49.738867+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-09-12T19:23:49.738867+0000","last_clean_scrub_stamp":"2024-09-12T19:23:49.738867+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:05.110011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":83,"num_write":51,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:09.848669+0000","last_change":"2024-09-12T19:24:09.848669+0000","last_active":"2024-09-12T19:24:09.848669+0000","last_peered":"2024-09-12T19:24:09.848669+0000","last_clean":"2024-09-12T19:24:09.848669+0000","last_became_active":"2024-09-12T18:19:22.655357+0000","last_became_peered":"2024-09-12T18:19:22.655357+0000","last_unstale":"2024-09-12T19:24:09.848669+0000","last_undegraded":"2024-09-12T19:24:09.848669+0000","last_fullsized":"2024-09-12T19:24:09.848669+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:09.848464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:09.848464+0000","last_clean_scrub_stamp":"2024-09-12T19:24:09.848464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:09.759840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"267'2","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:01.940254+0000","last_change":"2024-09-12T19:24:01.940088+0000","last_active":"2024-09-12T19:24:01.940254+0000","last_peered":"2024-09-12T19:24:01.940254+0000","last_clean":"2024-09-12T19:24:01.940254+0000","last_became_active":"2024-09-12T17:51:59.935185+0000","last_became_peered":"2024-09-12T17:51:59.935185+0000","last_unstale":"2024-09-12T19:24:01.940254+0000","last_undegraded":"2024-09-12T19:24:01.940254+0000","last_fullsized":"2024-09-12T19:24:01.940254+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:24:01.939906+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:24:01.939906+0000","last_clean_scrub_stamp":"2024-09-12T19:24:01.939906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:42.002676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"267'10","reported_seq":106,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:51.074797+0000","last_change":"2024-09-12T19:23:51.074797+0000","last_active":"2024-09-12T19:23:51.074797+0000","last_peered":"2024-09-12T19:23:51.074797+0000","last_clean":"2024-09-12T19:23:51.074797+0000","last_became_active":"2024-09-12T17:51:52.864951+0000","last_became_peered":"2024-09-12T17:51:52.864951+0000","last_unstale":"2024-09-12T19:23:51.074797+0000","last_undegraded":"2024-09-12T19:23:51.074797+0000","last_fullsized":"2024-09-12T19:23:51.074797+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'10","last_scrub_stamp":"2024-09-12T19:23:51.074625+0000","last_deep_scrub":"267'10","last_deep_scrub_stamp":"2024-09-12T19:23:51.074625+0000","last_clean_scrub_stamp":"2024-09-12T19:23:51.074625+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:03.402586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32810,"num_write":10,"num_write_kb":11304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'28","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:04.943714+0000","last_change":"2024-09-12T19:24:04.943714+0000","last_active":"2024-09-12T19:24:04.943714+0000","last_peered":"2024-09-12T19:24:04.943714+0000","last_clean":"2024-09-12T19:24:04.943714+0000","last_became_active":"2024-09-12T17:45:41.576714+0000","last_became_peered":"2024-09-12T17:45:41.576714+0000","last_unstale":"2024-09-12T19:24:04.943714+0000","last_undegraded":"2024-09-12T19:24:04.943714+0000","last_fullsized":"2024-09-12T19:24:04.943714+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'28","last_scrub_stamp":"2024-09-12T19:24:04.943524+0000","last_deep_scrub":"267'28","last_deep_scrub_stamp":"2024-09-12T19:24:04.943524+0000","last_clean_scrub_stamp":"2024-09-12T19:24:04.943524+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:47.839092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":94,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:07.874838+0000","last_change":"2024-09-12T19:24:07.874838+0000","last_active":"2024-09-12T19:24:07.874838+0000","last_peered":"2024-09-12T19:24:07.874838+0000","last_clean":"2024-09-12T19:24:07.874838+0000","last_became_active":"2024-09-12T18:19:22.665152+0000","last_became_peered":"2024-09-12T18:19:22.665152+0000","last_unstale":"2024-09-12T19:24:07.874838+0000","last_undegraded":"2024-09-12T19:24:07.874838+0000","last_fullsized":"2024-09-12T19:24:07.874838+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:07.874642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:07.874642+0000","last_clean_scrub_stamp":"2024-09-12T19:24:07.874642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:26.554640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:51.330597+0000","last_change":"2024-09-12T19:23:51.330322+0000","last_active":"2024-09-12T19:23:51.330597+0000","last_peered":"2024-09-12T19:23:51.330597+0000","last_clean":"2024-09-12T19:23:51.330597+0000","last_became_active":"2024-09-12T17:51:59.950595+0000","last_became_peered":"2024-09-12T17:51:59.950595+0000","last_unstale":"2024-09-12T19:23:51.330597+0000","last_undegraded":"2024-09-12T19:23:51.330597+0000","last_fullsized":"2024-09-12T19:23:51.330597+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:51.330052+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:51.330052+0000","last_clean_scrub_stamp":"2024-09-12T19:23:51.330052+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:56.771898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:55.668332+0000","last_change":"2024-09-12T19:23:55.668332+0000","last_active":"2024-09-12T19:23:55.668332+0000","last_peered":"2024-09-12T19:23:55.668332+0000","last_clean":"2024-09-12T19:23:55.668332+0000","last_became_active":"2024-09-12T17:51:52.907863+0000","last_became_peered":"2024-09-12T17:51:52.907863+0000","last_unstale":"2024-09-12T19:23:55.668332+0000","last_undegraded":"2024-09-12T19:23:55.668332+0000","last_fullsized":"2024-09-12T19:23:55.668332+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:23:55.668106+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:23:55.668106+0000","last_clean_scrub_stamp":"2024-09-12T19:23:55.668106+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:21:03.716051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"267'42","reported_seq":195,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:55.954073+0000","last_change":"2024-09-12T19:23:55.954073+0000","last_active":"2024-09-12T19:23:55.954073+0000","last_peered":"2024-09-12T19:23:55.954073+0000","last_clean":"2024-09-12T19:23:55.954073+0000","last_became_active":"2024-09-12T17:45:41.596133+0000","last_became_peered":"2024-09-12T17:45:41.596133+0000","last_unstale":"2024-09-12T19:23:55.954073+0000","last_undegraded":"2024-09-12T19:23:55.954073+0000","last_fullsized":"2024-09-12T19:23:55.954073+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'42","last_scrub_stamp":"2024-09-12T19:23:55.953882+0000","last_deep_scrub":"267'42","last_deep_scrub_stamp":"2024-09-12T19:23:55.953882+0000","last_clean_scrub_stamp":"2024-09-12T19:23:55.953882+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:22:04.152899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":80,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.757829+0000","last_change":"2024-09-12T19:23:45.757664+0000","last_active":"2024-09-12T19:23:45.757829+0000","last_peered":"2024-09-12T19:23:45.757829+0000","last_clean":"2024-09-12T19:23:45.757829+0000","last_became_active":"2024-09-12T18:19:22.652141+0000","last_became_peered":"2024-09-12T18:19:22.652141+0000","last_unstale":"2024-09-12T19:23:45.757829+0000","last_undegraded":"2024-09-12T19:23:45.757829+0000","last_fullsized":"2024-09-12T19:23:45.757829+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:45.757489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:45.757489+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.757489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:16:29.631747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"267'2","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.252057+0000","last_change":"2024-09-12T19:23:40.251781+0000","last_active":"2024-09-12T19:23:40.252057+0000","last_peered":"2024-09-12T19:23:40.252057+0000","last_clean":"2024-09-12T19:23:40.252057+0000","last_became_active":"2024-09-12T17:51:59.936941+0000","last_became_peered":"2024-09-12T17:51:59.936941+0000","last_unstale":"2024-09-12T19:23:40.252057+0000","last_undegraded":"2024-09-12T19:23:40.252057+0000","last_fullsized":"2024-09-12T19:23:40.252057+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:40.251559+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:40.251559+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.251559+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:26.712415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'2","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:49.056249+0000","last_change":"2024-09-12T19:23:49.055965+0000","last_active":"2024-09-12T19:23:49.056249+0000","last_peered":"2024-09-12T19:23:49.056249+0000","last_clean":"2024-09-12T19:23:49.056249+0000","last_became_active":"2024-09-12T17:51:52.882157+0000","last_became_peered":"2024-09-12T17:51:52.882157+0000","last_unstale":"2024-09-12T19:23:49.056249+0000","last_undegraded":"2024-09-12T19:23:49.056249+0000","last_fullsized":"2024-09-12T19:23:49.056249+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:49.055748+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:49.055748+0000","last_clean_scrub_stamp":"2024-09-12T19:23:49.055748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:23:34.198822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'16","reported_seq":122,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.307486+0000","last_change":"2024-09-12T19:23:37.307486+0000","last_active":"2024-09-12T19:23:37.307486+0000","last_peered":"2024-09-12T19:23:37.307486+0000","last_clean":"2024-09-12T19:23:37.307486+0000","last_became_active":"2024-09-12T17:45:41.586661+0000","last_became_peered":"2024-09-12T17:45:41.586661+0000","last_unstale":"2024-09-12T19:23:37.307486+0000","last_undegraded":"2024-09-12T19:23:37.307486+0000","last_fullsized":"2024-09-12T19:23:37.307486+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'16","last_scrub_stamp":"2024-09-12T19:23:37.307195+0000","last_deep_scrub":"267'16","last_deep_scrub_stamp":"2024-09-12T19:23:37.307195+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.307195+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:28.732335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":33,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:04.175540+0000","last_change":"2024-09-12T19:24:04.175194+0000","last_active":"2024-09-12T19:24:04.175540+0000","last_peered":"2024-09-12T19:24:04.175540+0000","last_clean":"2024-09-12T19:24:04.175540+0000","last_became_active":"2024-09-12T18:19:22.668945+0000","last_became_peered":"2024-09-12T18:19:22.668945+0000","last_unstale":"2024-09-12T19:24:04.175540+0000","last_undegraded":"2024-09-12T19:24:04.175540+0000","last_fullsized":"2024-09-12T19:24:04.175540+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:24:04.174979+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:24:04.174979+0000","last_clean_scrub_stamp":"2024-09-12T19:24:04.174979+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:23.961079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.310464+0000","last_change":"2024-09-12T19:23:45.310464+0000","last_active":"2024-09-12T19:23:45.310464+0000","last_peered":"2024-09-12T19:23:45.310464+0000","last_clean":"2024-09-12T19:23:45.310464+0000","last_became_active":"2024-09-12T17:51:59.936441+0000","last_became_peered":"2024-09-12T17:51:59.936441+0000","last_unstale":"2024-09-12T19:23:45.310464+0000","last_undegraded":"2024-09-12T19:23:45.310464+0000","last_fullsized":"2024-09-12T19:23:45.310464+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:45.310281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:45.310281+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.310281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:27.701105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'3","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:50.091730+0000","last_change":"2024-09-12T19:23:50.091569+0000","last_active":"2024-09-12T19:23:50.091730+0000","last_peered":"2024-09-12T19:23:50.091730+0000","last_clean":"2024-09-12T19:23:50.091730+0000","last_became_active":"2024-09-12T17:51:52.887962+0000","last_became_peered":"2024-09-12T17:51:52.887962+0000","last_unstale":"2024-09-12T19:23:50.091730+0000","last_undegraded":"2024-09-12T19:23:50.091730+0000","last_fullsized":"2024-09-12T19:23:50.091730+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:23:50.091407+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:23:50.091407+0000","last_clean_scrub_stamp":"2024-09-12T19:23:50.091407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:47.368613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'25","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:50.728965+0000","last_change":"2024-09-12T19:23:50.728965+0000","last_active":"2024-09-12T19:23:50.728965+0000","last_peered":"2024-09-12T19:23:50.728965+0000","last_clean":"2024-09-12T19:23:50.728965+0000","last_became_active":"2024-09-12T17:45:41.565956+0000","last_became_peered":"2024-09-12T17:45:41.565956+0000","last_unstale":"2024-09-12T19:23:50.728965+0000","last_undegraded":"2024-09-12T19:23:50.728965+0000","last_fullsized":"2024-09-12T19:23:50.728965+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'25","last_scrub_stamp":"2024-09-12T19:23:50.728773+0000","last_deep_scrub":"267'25","last_deep_scrub_stamp":"2024-09-12T19:23:50.728773+0000","last_clean_scrub_stamp":"2024-09-12T19:23:50.728773+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:45.890653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":46,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:06.196622+0000","last_change":"2024-09-12T19:24:06.196450+0000","last_active":"2024-09-12T19:24:06.196622+0000","last_peered":"2024-09-12T19:24:06.196622+0000","last_clean":"2024-09-12T19:24:06.196622+0000","last_became_active":"2024-09-12T18:19:22.677111+0000","last_became_peered":"2024-09-12T18:19:22.677111+0000","last_unstale":"2024-09-12T19:24:06.196622+0000","last_undegraded":"2024-09-12T19:24:06.196622+0000","last_fullsized":"2024-09-12T19:24:06.196622+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:06.196272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:06.196272+0000","last_clean_scrub_stamp":"2024-09-12T19:24:06.196272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:14.722236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"267'2","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:03.962458+0000","last_change":"2024-09-12T19:24:03.962458+0000","last_active":"2024-09-12T19:24:03.962458+0000","last_peered":"2024-09-12T19:24:03.962458+0000","last_clean":"2024-09-12T19:24:03.962458+0000","last_became_active":"2024-09-12T17:51:59.941825+0000","last_became_peered":"2024-09-12T17:51:59.941825+0000","last_unstale":"2024-09-12T19:24:03.962458+0000","last_undegraded":"2024-09-12T19:24:03.962458+0000","last_fullsized":"2024-09-12T19:24:03.962458+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:24:03.962271+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:24:03.962271+0000","last_clean_scrub_stamp":"2024-09-12T19:24:03.962271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:26.163805+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":10,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"267'3","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:58.705821+0000","last_change":"2024-09-12T19:23:58.705560+0000","last_active":"2024-09-12T19:23:58.705821+0000","last_peered":"2024-09-12T19:23:58.705821+0000","last_clean":"2024-09-12T19:23:58.705821+0000","last_became_active":"2024-09-12T17:51:52.899511+0000","last_became_peered":"2024-09-12T17:51:52.899511+0000","last_unstale":"2024-09-12T19:23:58.705821+0000","last_undegraded":"2024-09-12T19:23:58.705821+0000","last_fullsized":"2024-09-12T19:23:58.705821+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:58.705256+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:58.705256+0000","last_clean_scrub_stamp":"2024-09-12T19:23:58.705256+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:57.794920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'27","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.696922+0000","last_change":"2024-09-12T19:23:39.696922+0000","last_active":"2024-09-12T19:23:39.696922+0000","last_peered":"2024-09-12T19:23:39.696922+0000","last_clean":"2024-09-12T19:23:39.696922+0000","last_became_active":"2024-09-12T17:45:41.578021+0000","last_became_peered":"2024-09-12T17:45:41.578021+0000","last_unstale":"2024-09-12T19:23:39.696922+0000","last_undegraded":"2024-09-12T19:23:39.696922+0000","last_fullsized":"2024-09-12T19:23:39.696922+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'27","last_scrub_stamp":"2024-09-12T19:23:39.696712+0000","last_deep_scrub":"267'27","last_deep_scrub_stamp":"2024-09-12T19:23:39.696712+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.696712+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:17.945359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":97,"num_write":50,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:46.735693+0000","last_change":"2024-09-12T19:23:46.735693+0000","last_active":"2024-09-12T19:23:46.735693+0000","last_peered":"2024-09-12T19:23:46.735693+0000","last_clean":"2024-09-12T19:23:46.735693+0000","last_became_active":"2024-09-12T18:19:22.668802+0000","last_became_peered":"2024-09-12T18:19:22.668802+0000","last_unstale":"2024-09-12T19:23:46.735693+0000","last_undegraded":"2024-09-12T19:23:46.735693+0000","last_fullsized":"2024-09-12T19:23:46.735693+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:46.735517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:46.735517+0000","last_clean_scrub_stamp":"2024-09-12T19:23:46.735517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:47.277789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:59.951949+0000","last_change":"2024-09-12T19:23:59.951949+0000","last_active":"2024-09-12T19:23:59.951949+0000","last_peered":"2024-09-12T19:23:59.951949+0000","last_clean":"2024-09-12T19:23:59.951949+0000","last_became_active":"2024-09-12T17:51:59.939686+0000","last_became_peered":"2024-09-12T17:51:59.939686+0000","last_unstale":"2024-09-12T19:23:59.951949+0000","last_undegraded":"2024-09-12T19:23:59.951949+0000","last_fullsized":"2024-09-12T19:23:59.951949+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:59.951757+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:59.951757+0000","last_clean_scrub_stamp":"2024-09-12T19:23:59.951757+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:24.800825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:49.294040+0000","last_change":"2024-09-12T19:23:49.294040+0000","last_active":"2024-09-12T19:23:49.294040+0000","last_peered":"2024-09-12T19:23:49.294040+0000","last_clean":"2024-09-12T19:23:49.294040+0000","last_became_active":"2024-09-12T17:51:52.892953+0000","last_became_peered":"2024-09-12T17:51:52.892953+0000","last_unstale":"2024-09-12T19:23:49.294040+0000","last_undegraded":"2024-09-12T19:23:49.294040+0000","last_fullsized":"2024-09-12T19:23:49.294040+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:49.293859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:49.293859+0000","last_clean_scrub_stamp":"2024-09-12T19:23:49.293859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:44.997783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'51","reported_seq":222,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:48.717893+0000","last_change":"2024-09-12T19:23:48.717893+0000","last_active":"2024-09-12T19:23:48.717893+0000","last_peered":"2024-09-12T19:23:48.717893+0000","last_clean":"2024-09-12T19:23:48.717893+0000","last_became_active":"2024-09-12T17:45:41.572941+0000","last_became_peered":"2024-09-12T17:45:41.572941+0000","last_unstale":"2024-09-12T19:23:48.717893+0000","last_undegraded":"2024-09-12T19:23:48.717893+0000","last_fullsized":"2024-09-12T19:23:48.717893+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'51","last_scrub_stamp":"2024-09-12T19:23:48.717711+0000","last_deep_scrub":"267'51","last_deep_scrub_stamp":"2024-09-12T19:23:48.717711+0000","last_clean_scrub_stamp":"2024-09-12T19:23:48.717711+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:54.563072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":267,"num_read_kb":190,"num_write":83,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'2","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.930550+0000","last_change":"2024-09-12T19:23:32.930550+0000","last_active":"2024-09-12T19:23:32.930550+0000","last_peered":"2024-09-12T19:23:32.930550+0000","last_clean":"2024-09-12T19:23:32.930550+0000","last_became_active":"2024-09-12T18:19:22.651901+0000","last_became_peered":"2024-09-12T18:19:22.651901+0000","last_unstale":"2024-09-12T19:23:32.930550+0000","last_undegraded":"2024-09-12T19:23:32.930550+0000","last_fullsized":"2024-09-12T19:23:32.930550+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:32.930331+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:32.930331+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.930331+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:50.719199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:11.866301+0000","last_change":"2024-09-12T19:24:11.866301+0000","last_active":"2024-09-12T19:24:11.866301+0000","last_peered":"2024-09-12T19:24:11.866301+0000","last_clean":"2024-09-12T19:24:11.866301+0000","last_became_active":"2024-09-12T17:51:59.947392+0000","last_became_peered":"2024-09-12T17:51:59.947392+0000","last_unstale":"2024-09-12T19:24:11.866301+0000","last_undegraded":"2024-09-12T19:24:11.866301+0000","last_fullsized":"2024-09-12T19:24:11.866301+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:11.866103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:11.866103+0000","last_clean_scrub_stamp":"2024-09-12T19:24:11.866103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:49.790367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'5","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:52.990126+0000","last_change":"2024-09-12T19:23:52.990126+0000","last_active":"2024-09-12T19:23:52.990126+0000","last_peered":"2024-09-12T19:23:52.990126+0000","last_clean":"2024-09-12T19:23:52.990126+0000","last_became_active":"2024-09-12T17:51:52.886123+0000","last_became_peered":"2024-09-12T17:51:52.886123+0000","last_unstale":"2024-09-12T19:23:52.990126+0000","last_undegraded":"2024-09-12T19:23:52.990126+0000","last_fullsized":"2024-09-12T19:23:52.990126+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T19:23:52.989805+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T19:23:52.989805+0000","last_clean_scrub_stamp":"2024-09-12T19:23:52.989805+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:43.267916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'32","reported_seq":173,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:53.992122+0000","last_change":"2024-09-12T19:23:53.992122+0000","last_active":"2024-09-12T19:23:53.992122+0000","last_peered":"2024-09-12T19:23:53.992122+0000","last_clean":"2024-09-12T19:23:53.992122+0000","last_became_active":"2024-09-12T17:45:41.591637+0000","last_became_peered":"2024-09-12T17:45:41.591637+0000","last_unstale":"2024-09-12T19:23:53.992122+0000","last_undegraded":"2024-09-12T19:23:53.992122+0000","last_fullsized":"2024-09-12T19:23:53.992122+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'32","last_scrub_stamp":"2024-09-12T19:23:53.991922+0000","last_deep_scrub":"267'32","last_deep_scrub_stamp":"2024-09-12T19:23:53.991922+0000","last_clean_scrub_stamp":"2024-09-12T19:23:53.991922+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:24:07.256889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":117,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:05.221259+0000","last_change":"2024-09-12T19:24:05.221259+0000","last_active":"2024-09-12T19:24:05.221259+0000","last_peered":"2024-09-12T19:24:05.221259+0000","last_clean":"2024-09-12T19:24:05.221259+0000","last_became_active":"2024-09-12T18:19:22.645829+0000","last_became_peered":"2024-09-12T18:19:22.645829+0000","last_unstale":"2024-09-12T19:24:05.221259+0000","last_undegraded":"2024-09-12T19:24:05.221259+0000","last_fullsized":"2024-09-12T19:24:05.221259+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:05.221079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:05.221079+0000","last_clean_scrub_stamp":"2024-09-12T19:24:05.221079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:26.579169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"267'9","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:00.717067+0000","last_change":"2024-09-12T19:24:00.716887+0000","last_active":"2024-09-12T19:24:00.717067+0000","last_peered":"2024-09-12T19:24:00.717067+0000","last_clean":"2024-09-12T19:24:00.717067+0000","last_became_active":"2024-09-12T17:52:23.438623+0000","last_became_peered":"2024-09-12T17:52:23.438623+0000","last_unstale":"2024-09-12T19:24:00.717067+0000","last_undegraded":"2024-09-12T19:24:00.717067+0000","last_fullsized":"2024-09-12T19:24:00.717067+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'9","last_scrub_stamp":"2024-09-12T19:24:00.716707+0000","last_deep_scrub":"267'9","last_deep_scrub_stamp":"2024-09-12T19:24:00.716707+0000","last_clean_scrub_stamp":"2024-09-12T19:24:00.716707+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:48.867576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":19,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.16","version":"267'2","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.895617+0000","last_change":"2024-09-12T19:23:29.895553+0000","last_active":"2024-09-12T19:23:29.895617+0000","last_peered":"2024-09-12T19:23:29.895617+0000","last_clean":"2024-09-12T19:23:29.895617+0000","last_became_active":"2024-09-12T17:51:52.876542+0000","last_became_peered":"2024-09-12T17:51:52.876542+0000","last_unstale":"2024-09-12T19:23:29.895617+0000","last_undegraded":"2024-09-12T19:23:29.895617+0000","last_fullsized":"2024-09-12T19:23:29.895617+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:29.895459+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:29.895459+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.895459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:04.933465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"0'0","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.916967+0000","last_change":"2024-09-12T19:23:34.916967+0000","last_active":"2024-09-12T19:23:34.916967+0000","last_peered":"2024-09-12T19:23:34.916967+0000","last_clean":"2024-09-12T19:23:34.916967+0000","last_became_active":"2024-09-12T17:45:41.574953+0000","last_became_peered":"2024-09-12T17:45:41.574953+0000","last_unstale":"2024-09-12T19:23:34.916967+0000","last_undegraded":"2024-09-12T19:23:34.916967+0000","last_fullsized":"2024-09-12T19:23:34.916967+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:34.916775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:34.916775+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.916775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:23.463117+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:53.366419+0000","last_change":"2024-09-12T19:23:53.366419+0000","last_active":"2024-09-12T19:23:53.366419+0000","last_peered":"2024-09-12T19:23:53.366419+0000","last_clean":"2024-09-12T19:23:53.366419+0000","last_became_active":"2024-09-12T18:19:22.657731+0000","last_became_peered":"2024-09-12T18:19:22.657731+0000","last_unstale":"2024-09-12T19:23:53.366419+0000","last_undegraded":"2024-09-12T19:23:53.366419+0000","last_fullsized":"2024-09-12T19:23:53.366419+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:53.366205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:53.366205+0000","last_clean_scrub_stamp":"2024-09-12T19:23:53.366205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:31.776287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"267'5","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:55.083484+0000","last_change":"2024-09-12T19:23:55.083484+0000","last_active":"2024-09-12T19:23:55.083484+0000","last_peered":"2024-09-12T19:23:55.083484+0000","last_clean":"2024-09-12T19:23:55.083484+0000","last_became_active":"2024-09-12T17:51:59.937650+0000","last_became_peered":"2024-09-12T17:51:59.937650+0000","last_unstale":"2024-09-12T19:23:55.083484+0000","last_undegraded":"2024-09-12T19:23:55.083484+0000","last_fullsized":"2024-09-12T19:23:55.083484+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T19:23:55.083274+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T19:23:55.083274+0000","last_clean_scrub_stamp":"2024-09-12T19:23:55.083274+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:03.979226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'2","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:57.687769+0000","last_change":"2024-09-12T19:23:57.687769+0000","last_active":"2024-09-12T19:23:57.687769+0000","last_peered":"2024-09-12T19:23:57.687769+0000","last_clean":"2024-09-12T19:23:57.687769+0000","last_became_active":"2024-09-12T17:51:52.887964+0000","last_became_peered":"2024-09-12T17:51:52.887964+0000","last_unstale":"2024-09-12T19:23:57.687769+0000","last_undegraded":"2024-09-12T19:23:57.687769+0000","last_fullsized":"2024-09-12T19:23:57.687769+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:23:57.687566+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:23:57.687566+0000","last_clean_scrub_stamp":"2024-09-12T19:23:57.687566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:06.650397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'27","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:49.993657+0000","last_change":"2024-09-12T19:23:49.993413+0000","last_active":"2024-09-12T19:23:49.993657+0000","last_peered":"2024-09-12T19:23:49.993657+0000","last_clean":"2024-09-12T19:23:49.993657+0000","last_became_active":"2024-09-12T17:45:41.594619+0000","last_became_peered":"2024-09-12T17:45:41.594619+0000","last_unstale":"2024-09-12T19:23:49.993657+0000","last_undegraded":"2024-09-12T19:23:49.993657+0000","last_fullsized":"2024-09-12T19:23:49.993657+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'27","last_scrub_stamp":"2024-09-12T19:23:49.993192+0000","last_deep_scrub":"267'27","last_deep_scrub_stamp":"2024-09-12T19:23:49.993192+0000","last_clean_scrub_stamp":"2024-09-12T19:23:49.993192+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:33.742938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":94,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:06.877467+0000","last_change":"2024-09-12T19:24:06.877467+0000","last_active":"2024-09-12T19:24:06.877467+0000","last_peered":"2024-09-12T19:24:06.877467+0000","last_clean":"2024-09-12T19:24:06.877467+0000","last_became_active":"2024-09-12T18:19:22.646129+0000","last_became_peered":"2024-09-12T18:19:22.646129+0000","last_unstale":"2024-09-12T19:24:06.877467+0000","last_undegraded":"2024-09-12T19:24:06.877467+0000","last_fullsized":"2024-09-12T19:24:06.877467+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:06.877265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:06.877265+0000","last_clean_scrub_stamp":"2024-09-12T19:24:06.877265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:11:14.469545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'3","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:49.736288+0000","last_change":"2024-09-12T19:23:49.736288+0000","last_active":"2024-09-12T19:23:49.736288+0000","last_peered":"2024-09-12T19:23:49.736288+0000","last_clean":"2024-09-12T19:23:49.736288+0000","last_became_active":"2024-09-12T17:51:59.961892+0000","last_became_peered":"2024-09-12T17:51:59.961892+0000","last_unstale":"2024-09-12T19:23:49.736288+0000","last_undegraded":"2024-09-12T19:23:49.736288+0000","last_fullsized":"2024-09-12T19:23:49.736288+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:23:49.736089+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:23:49.736089+0000","last_clean_scrub_stamp":"2024-09-12T19:23:49.736089+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:17.250564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'5","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:48.084438+0000","last_change":"2024-09-12T19:23:48.084438+0000","last_active":"2024-09-12T19:23:48.084438+0000","last_peered":"2024-09-12T19:23:48.084438+0000","last_clean":"2024-09-12T19:23:48.084438+0000","last_became_active":"2024-09-12T17:51:52.865019+0000","last_became_peered":"2024-09-12T17:51:52.865019+0000","last_unstale":"2024-09-12T19:23:48.084438+0000","last_undegraded":"2024-09-12T19:23:48.084438+0000","last_fullsized":"2024-09-12T19:23:48.084438+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T19:23:48.084224+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T19:23:48.084224+0000","last_clean_scrub_stamp":"2024-09-12T19:23:48.084224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:29.411074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'30","reported_seq":162,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:47.108012+0000","last_change":"2024-09-12T19:23:47.108012+0000","last_active":"2024-09-12T19:23:47.108012+0000","last_peered":"2024-09-12T19:23:47.108012+0000","last_clean":"2024-09-12T19:23:47.108012+0000","last_became_active":"2024-09-12T17:45:41.594848+0000","last_became_peered":"2024-09-12T17:45:41.594848+0000","last_unstale":"2024-09-12T19:23:47.108012+0000","last_undegraded":"2024-09-12T19:23:47.108012+0000","last_fullsized":"2024-09-12T19:23:47.108012+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'30","last_scrub_stamp":"2024-09-12T19:23:47.107794+0000","last_deep_scrub":"267'30","last_deep_scrub_stamp":"2024-09-12T19:23:47.107794+0000","last_clean_scrub_stamp":"2024-09-12T19:23:47.107794+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:28.712598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":101,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:06.720379+0000","last_change":"2024-09-12T19:24:06.720379+0000","last_active":"2024-09-12T19:24:06.720379+0000","last_peered":"2024-09-12T19:24:06.720379+0000","last_clean":"2024-09-12T19:24:06.720379+0000","last_became_active":"2024-09-12T18:19:22.648818+0000","last_became_peered":"2024-09-12T18:19:22.648818+0000","last_unstale":"2024-09-12T19:24:06.720379+0000","last_undegraded":"2024-09-12T19:24:06.720379+0000","last_fullsized":"2024-09-12T19:24:06.720379+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:06.720188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:06.720188+0000","last_clean_scrub_stamp":"2024-09-12T19:24:06.720188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:03.808849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:50.700424+0000","last_change":"2024-09-12T19:23:50.700424+0000","last_active":"2024-09-12T19:23:50.700424+0000","last_peered":"2024-09-12T19:23:50.700424+0000","last_clean":"2024-09-12T19:23:50.700424+0000","last_became_active":"2024-09-12T17:51:59.953480+0000","last_became_peered":"2024-09-12T17:51:59.953480+0000","last_unstale":"2024-09-12T19:23:50.700424+0000","last_undegraded":"2024-09-12T19:23:50.700424+0000","last_fullsized":"2024-09-12T19:23:50.700424+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:50.700219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:50.700219+0000","last_clean_scrub_stamp":"2024-09-12T19:23:50.700219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:05:23.115721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:56.936643+0000","last_change":"2024-09-12T19:23:56.936643+0000","last_active":"2024-09-12T19:23:56.936643+0000","last_peered":"2024-09-12T19:23:56.936643+0000","last_clean":"2024-09-12T19:23:56.936643+0000","last_became_active":"2024-09-12T17:51:52.884758+0000","last_became_peered":"2024-09-12T17:51:52.884758+0000","last_unstale":"2024-09-12T19:23:56.936643+0000","last_undegraded":"2024-09-12T19:23:56.936643+0000","last_fullsized":"2024-09-12T19:23:56.936643+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:56.936452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:56.936452+0000","last_clean_scrub_stamp":"2024-09-12T19:23:56.936452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:11.472424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'17","reported_seq":130,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:46.694947+0000","last_change":"2024-09-12T19:23:46.694947+0000","last_active":"2024-09-12T19:23:46.694947+0000","last_peered":"2024-09-12T19:23:46.694947+0000","last_clean":"2024-09-12T19:23:46.694947+0000","last_became_active":"2024-09-12T17:45:41.585259+0000","last_became_peered":"2024-09-12T17:45:41.585259+0000","last_unstale":"2024-09-12T19:23:46.694947+0000","last_undegraded":"2024-09-12T19:23:46.694947+0000","last_fullsized":"2024-09-12T19:23:46.694947+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'17","last_scrub_stamp":"2024-09-12T19:23:46.694759+0000","last_deep_scrub":"267'17","last_deep_scrub_stamp":"2024-09-12T19:23:46.694759+0000","last_clean_scrub_stamp":"2024-09-12T19:23:46.694759+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:40.321282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":55,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'2","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:01.741501+0000","last_change":"2024-09-12T19:24:01.741501+0000","last_active":"2024-09-12T19:24:01.741501+0000","last_peered":"2024-09-12T19:24:01.741501+0000","last_clean":"2024-09-12T19:24:01.741501+0000","last_became_active":"2024-09-12T18:19:22.655117+0000","last_became_peered":"2024-09-12T18:19:22.655117+0000","last_unstale":"2024-09-12T19:24:01.741501+0000","last_undegraded":"2024-09-12T19:24:01.741501+0000","last_fullsized":"2024-09-12T19:24:01.741501+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:24:01.741310+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:24:01.741310+0000","last_clean_scrub_stamp":"2024-09-12T19:24:01.741310+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:13.379537+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:00.919479+0000","last_change":"2024-09-12T19:24:00.919479+0000","last_active":"2024-09-12T19:24:00.919479+0000","last_peered":"2024-09-12T19:24:00.919479+0000","last_clean":"2024-09-12T19:24:00.919479+0000","last_became_active":"2024-09-12T17:51:59.939751+0000","last_became_peered":"2024-09-12T17:51:59.939751+0000","last_unstale":"2024-09-12T19:24:00.919479+0000","last_undegraded":"2024-09-12T19:24:00.919479+0000","last_fullsized":"2024-09-12T19:24:00.919479+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T19:24:00.919277+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T19:24:00.919277+0000","last_clean_scrub_stamp":"2024-09-12T19:24:00.919277+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:55.233746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.227581+0000","last_change":"2024-09-12T19:23:39.227581+0000","last_active":"2024-09-12T19:23:39.227581+0000","last_peered":"2024-09-12T19:23:39.227581+0000","last_clean":"2024-09-12T19:23:39.227581+0000","last_became_active":"2024-09-12T17:51:52.897168+0000","last_became_peered":"2024-09-12T17:51:52.897168+0000","last_unstale":"2024-09-12T19:23:39.227581+0000","last_undegraded":"2024-09-12T19:23:39.227581+0000","last_fullsized":"2024-09-12T19:23:39.227581+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:39.227384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:39.227384+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.227384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:32.983284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'29","reported_seq":166,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:46.053233+0000","last_change":"2024-09-12T19:23:46.053233+0000","last_active":"2024-09-12T19:23:46.053233+0000","last_peered":"2024-09-12T19:23:46.053233+0000","last_clean":"2024-09-12T19:23:46.053233+0000","last_became_active":"2024-09-12T17:45:41.579765+0000","last_became_peered":"2024-09-12T17:45:41.579765+0000","last_unstale":"2024-09-12T19:23:46.053233+0000","last_undegraded":"2024-09-12T19:23:46.053233+0000","last_fullsized":"2024-09-12T19:23:46.053233+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-12T19:23:46.052945+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-12T19:23:46.052945+0000","last_clean_scrub_stamp":"2024-09-12T19:23:46.052945+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:31.279781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":115,"num_write":41,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:05.897209+0000","last_change":"2024-09-12T19:24:05.897209+0000","last_active":"2024-09-12T19:24:05.897209+0000","last_peered":"2024-09-12T19:24:05.897209+0000","last_clean":"2024-09-12T19:24:05.897209+0000","last_became_active":"2024-09-12T18:19:22.642415+0000","last_became_peered":"2024-09-12T18:19:22.642415+0000","last_unstale":"2024-09-12T19:24:05.897209+0000","last_undegraded":"2024-09-12T19:24:05.897209+0000","last_fullsized":"2024-09-12T19:24:05.897209+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:24:05.897008+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:24:05.897008+0000","last_clean_scrub_stamp":"2024-09-12T19:24:05.897008+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:41.494038+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.280529+0000","last_change":"2024-09-12T19:23:41.280529+0000","last_active":"2024-09-12T19:23:41.280529+0000","last_peered":"2024-09-12T19:23:41.280529+0000","last_clean":"2024-09-12T19:23:41.280529+0000","last_became_active":"2024-09-12T17:51:59.933679+0000","last_became_peered":"2024-09-12T17:51:59.933679+0000","last_unstale":"2024-09-12T19:23:41.280529+0000","last_undegraded":"2024-09-12T19:23:41.280529+0000","last_fullsized":"2024-09-12T19:23:41.280529+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:41.280350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:41.280350+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.280350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:18:06.704055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"267'3","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:47.296811+0000","last_change":"2024-09-12T19:23:47.296811+0000","last_active":"2024-09-12T19:23:47.296811+0000","last_peered":"2024-09-12T19:23:47.296811+0000","last_clean":"2024-09-12T19:23:47.296811+0000","last_became_active":"2024-09-12T17:51:52.891977+0000","last_became_peered":"2024-09-12T17:51:52.891977+0000","last_unstale":"2024-09-12T19:23:47.296811+0000","last_undegraded":"2024-09-12T19:23:47.296811+0000","last_fullsized":"2024-09-12T19:23:47.296811+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:47.296494+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:47.296494+0000","last_clean_scrub_stamp":"2024-09-12T19:23:47.296494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:52.443733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'38","reported_seq":184,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:54.947328+0000","last_change":"2024-09-12T19:23:54.947328+0000","last_active":"2024-09-12T19:23:54.947328+0000","last_peered":"2024-09-12T19:23:54.947328+0000","last_clean":"2024-09-12T19:23:54.947328+0000","last_became_active":"2024-09-12T17:45:41.579275+0000","last_became_peered":"2024-09-12T17:45:41.579275+0000","last_unstale":"2024-09-12T19:23:54.947328+0000","last_undegraded":"2024-09-12T19:23:54.947328+0000","last_fullsized":"2024-09-12T19:23:54.947328+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'38","last_scrub_stamp":"2024-09-12T19:23:54.947128+0000","last_deep_scrub":"267'38","last_deep_scrub_stamp":"2024-09-12T19:23:54.947128+0000","last_clean_scrub_stamp":"2024-09-12T19:23:54.947128+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:32.412515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":125,"num_write":71,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.942572+0000","last_change":"2024-09-12T19:23:30.942420+0000","last_active":"2024-09-12T19:23:30.942572+0000","last_peered":"2024-09-12T19:23:30.942572+0000","last_clean":"2024-09-12T19:23:30.942572+0000","last_became_active":"2024-09-12T18:19:22.656770+0000","last_became_peered":"2024-09-12T18:19:22.656770+0000","last_unstale":"2024-09-12T19:23:30.942572+0000","last_undegraded":"2024-09-12T19:23:30.942572+0000","last_fullsized":"2024-09-12T19:23:30.942572+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:30.942234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:30.942234+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.942234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:50.066937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"267'6","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:57.958680+0000","last_change":"2024-09-12T19:23:57.958536+0000","last_active":"2024-09-12T19:23:57.958680+0000","last_peered":"2024-09-12T19:23:57.958680+0000","last_clean":"2024-09-12T19:23:57.958680+0000","last_became_active":"2024-09-12T17:51:59.934972+0000","last_became_peered":"2024-09-12T17:51:59.934972+0000","last_unstale":"2024-09-12T19:23:57.958680+0000","last_undegraded":"2024-09-12T19:23:57.958680+0000","last_fullsized":"2024-09-12T19:23:57.958680+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T19:23:57.958340+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T19:23:57.958340+0000","last_clean_scrub_stamp":"2024-09-12T19:23:57.958340+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:07:20.528811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":18432,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:54.987740+0000","last_change":"2024-09-12T19:23:54.987593+0000","last_active":"2024-09-12T19:23:54.987740+0000","last_peered":"2024-09-12T19:23:54.987740+0000","last_clean":"2024-09-12T19:23:54.987740+0000","last_became_active":"2024-09-12T17:51:52.900002+0000","last_became_peered":"2024-09-12T17:51:52.900002+0000","last_unstale":"2024-09-12T19:23:54.987740+0000","last_undegraded":"2024-09-12T19:23:54.987740+0000","last_fullsized":"2024-09-12T19:23:54.987740+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:54.987414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:54.987414+0000","last_clean_scrub_stamp":"2024-09-12T19:23:54.987414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:16.396829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'34","reported_seq":182,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:51.027740+0000","last_change":"2024-09-12T19:23:51.027740+0000","last_active":"2024-09-12T19:23:51.027740+0000","last_peered":"2024-09-12T19:23:51.027740+0000","last_clean":"2024-09-12T19:23:51.027740+0000","last_became_active":"2024-09-12T17:45:41.580617+0000","last_became_peered":"2024-09-12T17:45:41.580617+0000","last_unstale":"2024-09-12T19:23:51.027740+0000","last_undegraded":"2024-09-12T19:23:51.027740+0000","last_fullsized":"2024-09-12T19:23:51.027740+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-09-12T19:23:51.027516+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-09-12T19:23:51.027516+0000","last_clean_scrub_stamp":"2024-09-12T19:23:51.027516+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:12.642726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":129,"num_write":59,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:00.093429+0000","last_change":"2024-09-12T19:24:00.093429+0000","last_active":"2024-09-12T19:24:00.093429+0000","last_peered":"2024-09-12T19:24:00.093429+0000","last_clean":"2024-09-12T19:24:00.093429+0000","last_became_active":"2024-09-12T18:19:22.664960+0000","last_became_peered":"2024-09-12T18:19:22.664960+0000","last_unstale":"2024-09-12T19:24:00.093429+0000","last_undegraded":"2024-09-12T19:24:00.093429+0000","last_fullsized":"2024-09-12T19:24:00.093429+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:00.093225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:00.093225+0000","last_clean_scrub_stamp":"2024-09-12T19:24:00.093225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:19.993465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'3","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:10.846126+0000","last_change":"2024-09-12T19:24:10.846027+0000","last_active":"2024-09-12T19:24:10.846126+0000","last_peered":"2024-09-12T19:24:10.846126+0000","last_clean":"2024-09-12T19:24:10.846126+0000","last_became_active":"2024-09-12T17:51:59.948733+0000","last_became_peered":"2024-09-12T17:51:59.948733+0000","last_unstale":"2024-09-12T19:24:10.846126+0000","last_undegraded":"2024-09-12T19:24:10.846126+0000","last_fullsized":"2024-09-12T19:24:10.846126+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:24:10.845907+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:24:10.845907+0000","last_clean_scrub_stamp":"2024-09-12T19:24:10.845907+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:18.647912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"267'5","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.905098+0000","last_change":"2024-09-12T19:23:36.904948+0000","last_active":"2024-09-12T19:23:36.905098+0000","last_peered":"2024-09-12T19:23:36.905098+0000","last_clean":"2024-09-12T19:23:36.905098+0000","last_became_active":"2024-09-12T17:51:52.904092+0000","last_became_peered":"2024-09-12T17:51:52.904092+0000","last_unstale":"2024-09-12T19:23:36.905098+0000","last_undegraded":"2024-09-12T19:23:36.905098+0000","last_fullsized":"2024-09-12T19:23:36.905098+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T19:23:36.904778+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T19:23:36.904778+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.904778+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:23.628020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'87","reported_seq":319,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:46.336227+0000","last_change":"2024-09-12T19:23:46.336227+0000","last_active":"2024-09-12T19:23:46.336227+0000","last_peered":"2024-09-12T19:23:46.336227+0000","last_clean":"2024-09-12T19:23:46.336227+0000","last_became_active":"2024-09-12T17:45:41.574884+0000","last_became_peered":"2024-09-12T17:45:41.574884+0000","last_unstale":"2024-09-12T19:23:46.336227+0000","last_undegraded":"2024-09-12T19:23:46.336227+0000","last_fullsized":"2024-09-12T19:23:46.336227+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'87","last_scrub_stamp":"2024-09-12T19:23:46.336046+0000","last_deep_scrub":"267'87","last_deep_scrub_stamp":"2024-09-12T19:23:46.336046+0000","last_clean_scrub_stamp":"2024-09-12T19:23:46.336046+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:28.767258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":442,"num_read_kb":315,"num_write":154,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.335208+0000","last_change":"2024-09-12T19:23:44.334929+0000","last_active":"2024-09-12T19:23:44.335208+0000","last_peered":"2024-09-12T19:23:44.335208+0000","last_clean":"2024-09-12T19:23:44.335208+0000","last_became_active":"2024-09-12T18:19:22.632360+0000","last_became_peered":"2024-09-12T18:19:22.632360+0000","last_unstale":"2024-09-12T19:23:44.335208+0000","last_undegraded":"2024-09-12T19:23:44.335208+0000","last_fullsized":"2024-09-12T19:23:44.335208+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:44.334714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:44.334714+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.334714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:34.896398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'7","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.771492+0000","last_change":"2024-09-12T19:23:41.771492+0000","last_active":"2024-09-12T19:23:41.771492+0000","last_peered":"2024-09-12T19:23:41.771492+0000","last_clean":"2024-09-12T19:23:41.771492+0000","last_became_active":"2024-09-12T17:51:59.945099+0000","last_became_peered":"2024-09-12T17:51:59.945099+0000","last_unstale":"2024-09-12T19:23:41.771492+0000","last_undegraded":"2024-09-12T19:23:41.771492+0000","last_fullsized":"2024-09-12T19:23:41.771492+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T19:23:41.771302+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T19:23:41.771302+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.771302+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:59.577235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24578,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"267'3","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:54.700052+0000","last_change":"2024-09-12T19:23:54.699867+0000","last_active":"2024-09-12T19:23:54.700052+0000","last_peered":"2024-09-12T19:23:54.700052+0000","last_clean":"2024-09-12T19:23:54.700052+0000","last_became_active":"2024-09-12T17:51:52.889772+0000","last_became_peered":"2024-09-12T17:51:52.889772+0000","last_unstale":"2024-09-12T19:23:54.700052+0000","last_undegraded":"2024-09-12T19:23:54.700052+0000","last_fullsized":"2024-09-12T19:23:54.700052+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:54.699675+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:54.699675+0000","last_clean_scrub_stamp":"2024-09-12T19:23:54.699675+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:20.027038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'27","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.320694+0000","last_change":"2024-09-12T19:23:35.320694+0000","last_active":"2024-09-12T19:23:35.320694+0000","last_peered":"2024-09-12T19:23:35.320694+0000","last_clean":"2024-09-12T19:23:35.320694+0000","last_became_active":"2024-09-12T17:45:41.590861+0000","last_became_peered":"2024-09-12T17:45:41.590861+0000","last_unstale":"2024-09-12T19:23:35.320694+0000","last_undegraded":"2024-09-12T19:23:35.320694+0000","last_fullsized":"2024-09-12T19:23:35.320694+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'27","last_scrub_stamp":"2024-09-12T19:23:35.320419+0000","last_deep_scrub":"267'27","last_deep_scrub_stamp":"2024-09-12T19:23:35.320419+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.320419+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:07.312095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":90,"num_write":55,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:58.064345+0000","last_change":"2024-09-12T19:23:58.064180+0000","last_active":"2024-09-12T19:23:58.064345+0000","last_peered":"2024-09-12T19:23:58.064345+0000","last_clean":"2024-09-12T19:23:58.064345+0000","last_became_active":"2024-09-12T18:19:22.655979+0000","last_became_peered":"2024-09-12T18:19:22.655979+0000","last_unstale":"2024-09-12T19:23:58.064345+0000","last_undegraded":"2024-09-12T19:23:58.064345+0000","last_fullsized":"2024-09-12T19:23:58.064345+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:58.063993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:58.063993+0000","last_clean_scrub_stamp":"2024-09-12T19:23:58.063993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:59.550885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"267'5","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:58.965278+0000","last_change":"2024-09-12T19:23:58.965140+0000","last_active":"2024-09-12T19:23:58.965278+0000","last_peered":"2024-09-12T19:23:58.965278+0000","last_clean":"2024-09-12T19:23:58.965278+0000","last_became_active":"2024-09-12T17:51:59.942431+0000","last_became_peered":"2024-09-12T17:51:59.942431+0000","last_unstale":"2024-09-12T19:23:58.965278+0000","last_undegraded":"2024-09-12T19:23:58.965278+0000","last_fullsized":"2024-09-12T19:23:58.965278+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-12T19:23:58.964946+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-12T19:23:58.964946+0000","last_clean_scrub_stamp":"2024-09-12T19:23:58.964946+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:41.794118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10320,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"267'3","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.648064+0000","last_change":"2024-09-12T19:23:38.648064+0000","last_active":"2024-09-12T19:23:38.648064+0000","last_peered":"2024-09-12T19:23:38.648064+0000","last_clean":"2024-09-12T19:23:38.648064+0000","last_became_active":"2024-09-12T17:51:52.900785+0000","last_became_peered":"2024-09-12T17:51:52.900785+0000","last_unstale":"2024-09-12T19:23:38.648064+0000","last_undegraded":"2024-09-12T19:23:38.648064+0000","last_fullsized":"2024-09-12T19:23:38.648064+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:38.647871+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:38.647871+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.647871+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:58:40.144934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'9","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.922578+0000","last_change":"2024-09-12T19:23:26.922578+0000","last_active":"2024-09-12T19:23:26.922578+0000","last_peered":"2024-09-12T19:23:26.922578+0000","last_clean":"2024-09-12T19:23:26.922578+0000","last_became_active":"2024-09-12T17:45:41.565793+0000","last_became_peered":"2024-09-12T17:45:41.565793+0000","last_unstale":"2024-09-12T19:23:26.922578+0000","last_undegraded":"2024-09-12T19:23:26.922578+0000","last_fullsized":"2024-09-12T19:23:26.922578+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'9","last_scrub_stamp":"2024-09-12T19:23:26.922376+0000","last_deep_scrub":"267'9","last_deep_scrub_stamp":"2024-09-12T19:23:26.922376+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.922376+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:01:57.354679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:02.968595+0000","last_change":"2024-09-12T19:24:02.968595+0000","last_active":"2024-09-12T19:24:02.968595+0000","last_peered":"2024-09-12T19:24:02.968595+0000","last_clean":"2024-09-12T19:24:02.968595+0000","last_became_active":"2024-09-12T18:19:22.663586+0000","last_became_peered":"2024-09-12T18:19:22.663586+0000","last_unstale":"2024-09-12T19:24:02.968595+0000","last_undegraded":"2024-09-12T19:24:02.968595+0000","last_fullsized":"2024-09-12T19:24:02.968595+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:02.968406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:02.968406+0000","last_clean_scrub_stamp":"2024-09-12T19:24:02.968406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:43.213049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:54.128867+0000","last_change":"2024-09-12T19:23:54.128867+0000","last_active":"2024-09-12T19:23:54.128867+0000","last_peered":"2024-09-12T19:23:54.128867+0000","last_clean":"2024-09-12T19:23:54.128867+0000","last_became_active":"2024-09-12T17:51:59.949437+0000","last_became_peered":"2024-09-12T17:51:59.949437+0000","last_unstale":"2024-09-12T19:23:54.128867+0000","last_undegraded":"2024-09-12T19:23:54.128867+0000","last_fullsized":"2024-09-12T19:23:54.128867+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:54.128666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:54.128666+0000","last_clean_scrub_stamp":"2024-09-12T19:23:54.128666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:12.016900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'6","reported_seq":88,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:53.689499+0000","last_change":"2024-09-12T19:23:53.689499+0000","last_active":"2024-09-12T19:23:53.689499+0000","last_peered":"2024-09-12T19:23:53.689499+0000","last_clean":"2024-09-12T19:23:53.689499+0000","last_became_active":"2024-09-12T17:51:52.898903+0000","last_became_peered":"2024-09-12T17:51:52.898903+0000","last_unstale":"2024-09-12T19:23:53.689499+0000","last_undegraded":"2024-09-12T19:23:53.689499+0000","last_fullsized":"2024-09-12T19:23:53.689499+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T19:23:53.689210+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T19:23:53.689210+0000","last_clean_scrub_stamp":"2024-09-12T19:23:53.689210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:24.019318+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'42","reported_seq":202,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.727948+0000","last_change":"2024-09-12T19:23:45.727948+0000","last_active":"2024-09-12T19:23:45.727948+0000","last_peered":"2024-09-12T19:23:45.727948+0000","last_clean":"2024-09-12T19:23:45.727948+0000","last_became_active":"2024-09-12T17:45:41.576921+0000","last_became_peered":"2024-09-12T17:45:41.576921+0000","last_unstale":"2024-09-12T19:23:45.727948+0000","last_undegraded":"2024-09-12T19:23:45.727948+0000","last_fullsized":"2024-09-12T19:23:45.727948+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'42","last_scrub_stamp":"2024-09-12T19:23:45.727767+0000","last_deep_scrub":"267'42","last_deep_scrub_stamp":"2024-09-12T19:23:45.727767+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.727767+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:24.431823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":172,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:03.127745+0000","last_change":"2024-09-12T19:24:03.127745+0000","last_active":"2024-09-12T19:24:03.127745+0000","last_peered":"2024-09-12T19:24:03.127745+0000","last_clean":"2024-09-12T19:24:03.127745+0000","last_became_active":"2024-09-12T18:19:22.669476+0000","last_became_peered":"2024-09-12T18:19:22.669476+0000","last_unstale":"2024-09-12T19:24:03.127745+0000","last_undegraded":"2024-09-12T19:24:03.127745+0000","last_fullsized":"2024-09-12T19:24:03.127745+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:03.127561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:03.127561+0000","last_clean_scrub_stamp":"2024-09-12T19:24:03.127561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:30:03.503233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:55.997801+0000","last_change":"2024-09-12T19:23:55.997801+0000","last_active":"2024-09-12T19:23:55.997801+0000","last_peered":"2024-09-12T19:23:55.997801+0000","last_clean":"2024-09-12T19:23:55.997801+0000","last_became_active":"2024-09-12T17:51:59.938736+0000","last_became_peered":"2024-09-12T17:51:59.938736+0000","last_unstale":"2024-09-12T19:23:55.997801+0000","last_undegraded":"2024-09-12T19:23:55.997801+0000","last_fullsized":"2024-09-12T19:23:55.997801+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:55.997619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:55.997619+0000","last_clean_scrub_stamp":"2024-09-12T19:23:55.997619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:54.134465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'2","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.741744+0000","last_change":"2024-09-12T19:23:42.741744+0000","last_active":"2024-09-12T19:23:42.741744+0000","last_peered":"2024-09-12T19:23:42.741744+0000","last_clean":"2024-09-12T19:23:42.741744+0000","last_became_active":"2024-09-12T17:51:52.900972+0000","last_became_peered":"2024-09-12T17:51:52.900972+0000","last_unstale":"2024-09-12T19:23:42.741744+0000","last_undegraded":"2024-09-12T19:23:42.741744+0000","last_fullsized":"2024-09-12T19:23:42.741744+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:42.741557+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:42.741557+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.741557+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:30.376497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'26","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:46.107274+0000","last_change":"2024-09-12T19:23:46.107274+0000","last_active":"2024-09-12T19:23:46.107274+0000","last_peered":"2024-09-12T19:23:46.107274+0000","last_clean":"2024-09-12T19:23:46.107274+0000","last_became_active":"2024-09-12T17:45:41.588013+0000","last_became_peered":"2024-09-12T17:45:41.588013+0000","last_unstale":"2024-09-12T19:23:46.107274+0000","last_undegraded":"2024-09-12T19:23:46.107274+0000","last_fullsized":"2024-09-12T19:23:46.107274+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'26","last_scrub_stamp":"2024-09-12T19:23:46.107067+0000","last_deep_scrub":"267'26","last_deep_scrub_stamp":"2024-09-12T19:23:46.107067+0000","last_clean_scrub_stamp":"2024-09-12T19:23:46.107067+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:10.161274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":89,"num_write":52,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'2","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:02.138565+0000","last_change":"2024-09-12T19:24:02.138565+0000","last_active":"2024-09-12T19:24:02.138565+0000","last_peered":"2024-09-12T19:24:02.138565+0000","last_clean":"2024-09-12T19:24:02.138565+0000","last_became_active":"2024-09-12T18:19:22.662685+0000","last_became_peered":"2024-09-12T18:19:22.662685+0000","last_unstale":"2024-09-12T19:24:02.138565+0000","last_undegraded":"2024-09-12T19:24:02.138565+0000","last_fullsized":"2024-09-12T19:24:02.138565+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:24:02.138375+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:24:02.138375+0000","last_clean_scrub_stamp":"2024-09-12T19:24:02.138375+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:00.682802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'10","reported_seq":95,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.747930+0000","last_change":"2024-09-12T19:23:44.747751+0000","last_active":"2024-09-12T19:23:44.747930+0000","last_peered":"2024-09-12T19:23:44.747930+0000","last_clean":"2024-09-12T19:23:44.747930+0000","last_became_active":"2024-09-12T17:51:59.942597+0000","last_became_peered":"2024-09-12T17:51:59.942597+0000","last_unstale":"2024-09-12T19:23:44.747930+0000","last_undegraded":"2024-09-12T19:23:44.747930+0000","last_fullsized":"2024-09-12T19:23:44.747930+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'10","last_scrub_stamp":"2024-09-12T19:23:44.747561+0000","last_deep_scrub":"267'10","last_deep_scrub_stamp":"2024-09-12T19:23:44.747561+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.747561+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:42:46.937016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":29698,"num_write":10,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"267'3","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:51.689991+0000","last_change":"2024-09-12T19:23:51.689991+0000","last_active":"2024-09-12T19:23:51.689991+0000","last_peered":"2024-09-12T19:23:51.689991+0000","last_clean":"2024-09-12T19:23:51.689991+0000","last_became_active":"2024-09-12T17:51:52.908200+0000","last_became_peered":"2024-09-12T17:51:52.908200+0000","last_unstale":"2024-09-12T19:23:51.689991+0000","last_undegraded":"2024-09-12T19:23:51.689991+0000","last_fullsized":"2024-09-12T19:23:51.689991+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:51.689767+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:51.689767+0000","last_clean_scrub_stamp":"2024-09-12T19:23:51.689767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:06.824645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'15","reported_seq":127,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:53.035436+0000","last_change":"2024-09-12T19:23:53.035436+0000","last_active":"2024-09-12T19:23:53.035436+0000","last_peered":"2024-09-12T19:23:53.035436+0000","last_clean":"2024-09-12T19:23:53.035436+0000","last_became_active":"2024-09-12T17:45:41.572067+0000","last_became_peered":"2024-09-12T17:45:41.572067+0000","last_unstale":"2024-09-12T19:23:53.035436+0000","last_undegraded":"2024-09-12T19:23:53.035436+0000","last_fullsized":"2024-09-12T19:23:53.035436+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'15","last_scrub_stamp":"2024-09-12T19:23:53.035204+0000","last_deep_scrub":"267'15","last_deep_scrub_stamp":"2024-09-12T19:23:53.035204+0000","last_clean_scrub_stamp":"2024-09-12T19:23:53.035204+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:17.920428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:05.684981+0000","last_change":"2024-09-12T19:24:05.684981+0000","last_active":"2024-09-12T19:24:05.684981+0000","last_peered":"2024-09-12T19:24:05.684981+0000","last_clean":"2024-09-12T19:24:05.684981+0000","last_became_active":"2024-09-12T18:19:22.648052+0000","last_became_peered":"2024-09-12T18:19:22.648052+0000","last_unstale":"2024-09-12T19:24:05.684981+0000","last_undegraded":"2024-09-12T19:24:05.684981+0000","last_fullsized":"2024-09-12T19:24:05.684981+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:05.684756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:05.684756+0000","last_clean_scrub_stamp":"2024-09-12T19:24:05.684756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:15.630683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"267'8","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:59.084781+0000","last_change":"2024-09-12T19:23:59.084781+0000","last_active":"2024-09-12T19:23:59.084781+0000","last_peered":"2024-09-12T19:23:59.084781+0000","last_clean":"2024-09-12T19:23:59.084781+0000","last_became_active":"2024-09-12T17:51:59.948873+0000","last_became_peered":"2024-09-12T17:51:59.948873+0000","last_unstale":"2024-09-12T19:23:59.084781+0000","last_undegraded":"2024-09-12T19:23:59.084781+0000","last_fullsized":"2024-09-12T19:23:59.084781+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-12T19:23:59.084600+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-12T19:23:59.084600+0000","last_clean_scrub_stamp":"2024-09-12T19:23:59.084600+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:06.458593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'2","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:47.040286+0000","last_change":"2024-09-12T19:23:47.040142+0000","last_active":"2024-09-12T19:23:47.040286+0000","last_peered":"2024-09-12T19:23:47.040286+0000","last_clean":"2024-09-12T19:23:47.040286+0000","last_became_active":"2024-09-12T17:51:52.889529+0000","last_became_peered":"2024-09-12T17:51:52.889529+0000","last_unstale":"2024-09-12T19:23:47.040286+0000","last_undegraded":"2024-09-12T19:23:47.040286+0000","last_fullsized":"2024-09-12T19:23:47.040286+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:23:47.039949+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:23:47.039949+0000","last_clean_scrub_stamp":"2024-09-12T19:23:47.039949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:13.335803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'21","reported_seq":144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.354478+0000","last_change":"2024-09-12T19:23:34.354478+0000","last_active":"2024-09-12T19:23:34.354478+0000","last_peered":"2024-09-12T19:23:34.354478+0000","last_clean":"2024-09-12T19:23:34.354478+0000","last_became_active":"2024-09-12T17:45:41.579580+0000","last_became_peered":"2024-09-12T17:45:41.579580+0000","last_unstale":"2024-09-12T19:23:34.354478+0000","last_undegraded":"2024-09-12T19:23:34.354478+0000","last_fullsized":"2024-09-12T19:23:34.354478+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'21","last_scrub_stamp":"2024-09-12T19:23:34.354300+0000","last_deep_scrub":"267'21","last_deep_scrub_stamp":"2024-09-12T19:23:34.354300+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.354300+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:11.810963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":77,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:01.092544+0000","last_change":"2024-09-12T19:24:01.092544+0000","last_active":"2024-09-12T19:24:01.092544+0000","last_peered":"2024-09-12T19:24:01.092544+0000","last_clean":"2024-09-12T19:24:01.092544+0000","last_became_active":"2024-09-12T18:19:22.669240+0000","last_became_peered":"2024-09-12T18:19:22.669240+0000","last_unstale":"2024-09-12T19:24:01.092544+0000","last_undegraded":"2024-09-12T19:24:01.092544+0000","last_fullsized":"2024-09-12T19:24:01.092544+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:01.092296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:01.092296+0000","last_clean_scrub_stamp":"2024-09-12T19:24:01.092296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:18.579811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"264'3","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:03.691386+0000","last_change":"2024-09-12T19:24:03.691386+0000","last_active":"2024-09-12T19:24:03.691386+0000","last_peered":"2024-09-12T19:24:03.691386+0000","last_clean":"2024-09-12T19:24:03.691386+0000","last_became_active":"2024-09-12T17:51:59.969706+0000","last_became_peered":"2024-09-12T17:51:59.969706+0000","last_unstale":"2024-09-12T19:24:03.691386+0000","last_undegraded":"2024-09-12T19:24:03.691386+0000","last_fullsized":"2024-09-12T19:24:03.691386+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:24:03.691158+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:24:03.691158+0000","last_clean_scrub_stamp":"2024-09-12T19:24:03.691158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:16.498999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'6","reported_seq":93,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:51.029466+0000","last_change":"2024-09-12T19:23:51.029466+0000","last_active":"2024-09-12T19:23:51.029466+0000","last_peered":"2024-09-12T19:23:51.029466+0000","last_clean":"2024-09-12T19:23:51.029466+0000","last_became_active":"2024-09-12T17:51:52.884061+0000","last_became_peered":"2024-09-12T17:51:52.884061+0000","last_unstale":"2024-09-12T19:23:51.029466+0000","last_undegraded":"2024-09-12T19:23:51.029466+0000","last_fullsized":"2024-09-12T19:23:51.029466+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-12T19:23:51.029250+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-12T19:23:51.029250+0000","last_clean_scrub_stamp":"2024-09-12T19:23:51.029250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:03.083907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'29","reported_seq":168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:47.731710+0000","last_change":"2024-09-12T19:23:47.731710+0000","last_active":"2024-09-12T19:23:47.731710+0000","last_peered":"2024-09-12T19:23:47.731710+0000","last_clean":"2024-09-12T19:23:47.731710+0000","last_became_active":"2024-09-12T17:45:41.572130+0000","last_became_peered":"2024-09-12T17:45:41.572130+0000","last_unstale":"2024-09-12T19:23:47.731710+0000","last_undegraded":"2024-09-12T19:23:47.731710+0000","last_fullsized":"2024-09-12T19:23:47.731710+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-12T19:23:47.731427+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-12T19:23:47.731427+0000","last_clean_scrub_stamp":"2024-09-12T19:23:47.731427+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:51.880356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":63,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:52.338841+0000","last_change":"2024-09-12T19:23:52.338657+0000","last_active":"2024-09-12T19:23:52.338841+0000","last_peered":"2024-09-12T19:23:52.338841+0000","last_clean":"2024-09-12T19:23:52.338841+0000","last_became_active":"2024-09-12T18:19:22.666608+0000","last_became_peered":"2024-09-12T18:19:22.666608+0000","last_unstale":"2024-09-12T19:23:52.338841+0000","last_undegraded":"2024-09-12T19:23:52.338841+0000","last_fullsized":"2024-09-12T19:23:52.338841+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:52.338465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:52.338465+0000","last_clean_scrub_stamp":"2024-09-12T19:23:52.338465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:14.954663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'2","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:56.648841+0000","last_change":"2024-09-12T19:23:56.648841+0000","last_active":"2024-09-12T19:23:56.648841+0000","last_peered":"2024-09-12T19:23:56.648841+0000","last_clean":"2024-09-12T19:23:56.648841+0000","last_became_active":"2024-09-12T17:51:59.956010+0000","last_became_peered":"2024-09-12T17:51:59.956010+0000","last_unstale":"2024-09-12T19:23:56.648841+0000","last_undegraded":"2024-09-12T19:23:56.648841+0000","last_fullsized":"2024-09-12T19:23:56.648841+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:23:56.648640+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:23:56.648640+0000","last_clean_scrub_stamp":"2024-09-12T19:23:56.648640+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:04.948132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'2","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.869054+0000","last_change":"2024-09-12T19:23:37.868902+0000","last_active":"2024-09-12T19:23:37.869054+0000","last_peered":"2024-09-12T19:23:37.869054+0000","last_clean":"2024-09-12T19:23:37.869054+0000","last_became_active":"2024-09-12T17:51:52.903355+0000","last_became_peered":"2024-09-12T17:51:52.903355+0000","last_unstale":"2024-09-12T19:23:37.869054+0000","last_undegraded":"2024-09-12T19:23:37.869054+0000","last_fullsized":"2024-09-12T19:23:37.869054+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-12T19:23:37.868720+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-12T19:23:37.868720+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.868720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:29.790506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'38","reported_seq":193,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.383832+0000","last_change":"2024-09-12T19:23:33.383832+0000","last_active":"2024-09-12T19:23:33.383832+0000","last_peered":"2024-09-12T19:23:33.383832+0000","last_clean":"2024-09-12T19:23:33.383832+0000","last_became_active":"2024-09-12T17:45:41.577322+0000","last_became_peered":"2024-09-12T17:45:41.577322+0000","last_unstale":"2024-09-12T19:23:33.383832+0000","last_undegraded":"2024-09-12T19:23:33.383832+0000","last_fullsized":"2024-09-12T19:23:33.383832+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'38","last_scrub_stamp":"2024-09-12T19:23:33.383649+0000","last_deep_scrub":"267'38","last_deep_scrub_stamp":"2024-09-12T19:23:33.383649+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.383649+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:12.349851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":139,"num_write":67,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.760559+0000","last_change":"2024-09-12T19:23:43.760559+0000","last_active":"2024-09-12T19:23:43.760559+0000","last_peered":"2024-09-12T19:23:43.760559+0000","last_clean":"2024-09-12T19:23:43.760559+0000","last_became_active":"2024-09-12T18:19:22.647003+0000","last_became_peered":"2024-09-12T18:19:22.647003+0000","last_unstale":"2024-09-12T19:23:43.760559+0000","last_undegraded":"2024-09-12T19:23:43.760559+0000","last_fullsized":"2024-09-12T19:23:43.760559+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:43.760345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:43.760345+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.760345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:43.242394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"267'3","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:54.000801+0000","last_change":"2024-09-12T19:23:54.000801+0000","last_active":"2024-09-12T19:23:54.000801+0000","last_peered":"2024-09-12T19:23:54.000801+0000","last_clean":"2024-09-12T19:23:54.000801+0000","last_became_active":"2024-09-12T17:51:59.939200+0000","last_became_peered":"2024-09-12T17:51:59.939200+0000","last_unstale":"2024-09-12T19:23:54.000801+0000","last_undegraded":"2024-09-12T19:23:54.000801+0000","last_fullsized":"2024-09-12T19:23:54.000801+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:54.000620+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:54.000620+0000","last_clean_scrub_stamp":"2024-09-12T19:23:54.000620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:34.220280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"267'6","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:48.324217+0000","last_change":"2024-09-12T19:23:48.324217+0000","last_active":"2024-09-12T19:23:48.324217+0000","last_peered":"2024-09-12T19:23:48.324217+0000","last_clean":"2024-09-12T19:23:48.324217+0000","last_became_active":"2024-09-12T17:51:52.896708+0000","last_became_peered":"2024-09-12T17:51:52.896708+0000","last_unstale":"2024-09-12T19:23:48.324217+0000","last_undegraded":"2024-09-12T19:23:48.324217+0000","last_fullsized":"2024-09-12T19:23:48.324217+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T19:23:48.324028+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T19:23:48.324028+0000","last_clean_scrub_stamp":"2024-09-12T19:23:48.324028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:29.992346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'29","reported_seq":168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.126563+0000","last_change":"2024-09-12T19:23:45.126393+0000","last_active":"2024-09-12T19:23:45.126563+0000","last_peered":"2024-09-12T19:23:45.126563+0000","last_clean":"2024-09-12T19:23:45.126563+0000","last_became_active":"2024-09-12T17:45:41.591866+0000","last_became_peered":"2024-09-12T17:45:41.591866+0000","last_unstale":"2024-09-12T19:23:45.126563+0000","last_undegraded":"2024-09-12T19:23:45.126563+0000","last_fullsized":"2024-09-12T19:23:45.126563+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-12T19:23:45.126211+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-12T19:23:45.126211+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.126211+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:17.439558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:56.094755+0000","last_change":"2024-09-12T19:23:56.094520+0000","last_active":"2024-09-12T19:23:56.094755+0000","last_peered":"2024-09-12T19:23:56.094755+0000","last_clean":"2024-09-12T19:23:56.094755+0000","last_became_active":"2024-09-12T18:19:22.660667+0000","last_became_peered":"2024-09-12T18:19:22.660667+0000","last_unstale":"2024-09-12T19:23:56.094755+0000","last_undegraded":"2024-09-12T19:23:56.094755+0000","last_fullsized":"2024-09-12T19:23:56.094755+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:56.094243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:56.094243+0000","last_clean_scrub_stamp":"2024-09-12T19:23:56.094243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:02.444570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:53.162224+0000","last_change":"2024-09-12T19:23:53.162224+0000","last_active":"2024-09-12T19:23:53.162224+0000","last_peered":"2024-09-12T19:23:53.162224+0000","last_clean":"2024-09-12T19:23:53.162224+0000","last_became_active":"2024-09-12T17:51:59.948786+0000","last_became_peered":"2024-09-12T17:51:59.948786+0000","last_unstale":"2024-09-12T19:23:53.162224+0000","last_undegraded":"2024-09-12T19:23:53.162224+0000","last_fullsized":"2024-09-12T19:23:53.162224+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:53.162038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:53.162038+0000","last_clean_scrub_stamp":"2024-09-12T19:23:53.162038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:15.606735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:52.007673+0000","last_change":"2024-09-12T19:23:52.007673+0000","last_active":"2024-09-12T19:23:52.007673+0000","last_peered":"2024-09-12T19:23:52.007673+0000","last_clean":"2024-09-12T19:23:52.007673+0000","last_became_active":"2024-09-12T17:51:52.895779+0000","last_became_peered":"2024-09-12T17:51:52.895779+0000","last_unstale":"2024-09-12T19:23:52.007673+0000","last_undegraded":"2024-09-12T19:23:52.007673+0000","last_fullsized":"2024-09-12T19:23:52.007673+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:52.007481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:52.007481+0000","last_clean_scrub_stamp":"2024-09-12T19:23:52.007481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:52.286786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'43","reported_seq":214,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.682157+0000","last_change":"2024-09-12T19:23:37.681979+0000","last_active":"2024-09-12T19:23:37.682157+0000","last_peered":"2024-09-12T19:23:37.682157+0000","last_clean":"2024-09-12T19:23:37.682157+0000","last_became_active":"2024-09-12T17:45:41.576707+0000","last_became_peered":"2024-09-12T17:45:41.576707+0000","last_unstale":"2024-09-12T19:23:37.682157+0000","last_undegraded":"2024-09-12T19:23:37.682157+0000","last_fullsized":"2024-09-12T19:23:37.682157+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'43","last_scrub_stamp":"2024-09-12T19:23:37.681798+0000","last_deep_scrub":"267'43","last_deep_scrub_stamp":"2024-09-12T19:23:37.681798+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.681798+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:08:07.348875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":167,"num_write":65,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'2","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.946187+0000","last_change":"2024-09-12T19:23:33.946038+0000","last_active":"2024-09-12T19:23:33.946187+0000","last_peered":"2024-09-12T19:23:33.946187+0000","last_clean":"2024-09-12T19:23:33.946187+0000","last_became_active":"2024-09-12T18:19:22.657891+0000","last_became_peered":"2024-09-12T18:19:22.657891+0000","last_unstale":"2024-09-12T19:23:33.946187+0000","last_undegraded":"2024-09-12T19:23:33.946187+0000","last_fullsized":"2024-09-12T19:23:33.946187+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:33.945861+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:33.945861+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.945861+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:53.760623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'3","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:48.727029+0000","last_change":"2024-09-12T19:23:48.727029+0000","last_active":"2024-09-12T19:23:48.727029+0000","last_peered":"2024-09-12T19:23:48.727029+0000","last_clean":"2024-09-12T19:23:48.727029+0000","last_became_active":"2024-09-12T17:51:59.962769+0000","last_became_peered":"2024-09-12T17:51:59.962769+0000","last_unstale":"2024-09-12T19:23:48.727029+0000","last_undegraded":"2024-09-12T19:23:48.727029+0000","last_fullsized":"2024-09-12T19:23:48.727029+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-12T19:23:48.726850+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-12T19:23:48.726850+0000","last_clean_scrub_stamp":"2024-09-12T19:23:48.726850+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:45.972951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'5","reported_seq":94,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:48.076458+0000","last_change":"2024-09-12T19:23:48.076280+0000","last_active":"2024-09-12T19:23:48.076458+0000","last_peered":"2024-09-12T19:23:48.076458+0000","last_clean":"2024-09-12T19:23:48.076458+0000","last_became_active":"2024-09-12T17:51:52.899987+0000","last_became_peered":"2024-09-12T17:51:52.899987+0000","last_unstale":"2024-09-12T19:23:48.076458+0000","last_undegraded":"2024-09-12T19:23:48.076458+0000","last_fullsized":"2024-09-12T19:23:48.076458+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-12T19:23:48.076083+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-12T19:23:48.076083+0000","last_clean_scrub_stamp":"2024-09-12T19:23:48.076083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:56.924020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'9","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.320833+0000","last_change":"2024-09-12T19:23:45.320833+0000","last_active":"2024-09-12T19:23:45.320833+0000","last_peered":"2024-09-12T19:23:45.320833+0000","last_clean":"2024-09-12T19:23:45.320833+0000","last_became_active":"2024-09-12T17:45:41.569871+0000","last_became_peered":"2024-09-12T17:45:41.569871+0000","last_unstale":"2024-09-12T19:23:45.320833+0000","last_undegraded":"2024-09-12T19:23:45.320833+0000","last_fullsized":"2024-09-12T19:23:45.320833+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'9","last_scrub_stamp":"2024-09-12T19:23:45.320654+0000","last_deep_scrub":"267'9","last_deep_scrub_stamp":"2024-09-12T19:23:45.320654+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.320654+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:45.364355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:24:04.732887+0000","last_change":"2024-09-12T19:24:04.732750+0000","last_active":"2024-09-12T19:24:04.732887+0000","last_peered":"2024-09-12T19:24:04.732887+0000","last_clean":"2024-09-12T19:24:04.732887+0000","last_became_active":"2024-09-12T18:19:22.648018+0000","last_became_peered":"2024-09-12T18:19:22.648018+0000","last_unstale":"2024-09-12T19:24:04.732887+0000","last_undegraded":"2024-09-12T19:24:04.732887+0000","last_fullsized":"2024-09-12T19:24:04.732887+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:24:04.732556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:24:04.732556+0000","last_clean_scrub_stamp":"2024-09-12T19:24:04.732556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:54:19.948021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'7","reported_seq":96,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:50.298138+0000","last_change":"2024-09-12T19:23:50.297973+0000","last_active":"2024-09-12T19:23:50.298138+0000","last_peered":"2024-09-12T19:23:50.298138+0000","last_clean":"2024-09-12T19:23:50.298138+0000","last_became_active":"2024-09-12T17:51:59.943764+0000","last_became_peered":"2024-09-12T17:51:59.943764+0000","last_unstale":"2024-09-12T19:23:50.298138+0000","last_undegraded":"2024-09-12T19:23:50.298138+0000","last_fullsized":"2024-09-12T19:23:50.298138+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-12T19:23:50.297769+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-12T19:23:50.297769+0000","last_clean_scrub_stamp":"2024-09-12T19:23:50.297769+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:50.481808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20800,"num_write":12,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:49.027509+0000","last_change":"2024-09-12T19:23:49.027509+0000","last_active":"2024-09-12T19:23:49.027509+0000","last_peered":"2024-09-12T19:23:49.027509+0000","last_clean":"2024-09-12T19:23:49.027509+0000","last_became_active":"2024-09-12T17:51:52.893764+0000","last_became_peered":"2024-09-12T17:51:52.893764+0000","last_unstale":"2024-09-12T19:23:49.027509+0000","last_undegraded":"2024-09-12T19:23:49.027509+0000","last_fullsized":"2024-09-12T19:23:49.027509+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:49.027310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:49.027310+0000","last_clean_scrub_stamp":"2024-09-12T19:23:49.027310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:39.413260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'85","reported_seq":322,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.009230+0000","last_change":"2024-09-12T19:23:44.009230+0000","last_active":"2024-09-12T19:23:44.009230+0000","last_peered":"2024-09-12T19:23:44.009230+0000","last_clean":"2024-09-12T19:23:44.009230+0000","last_became_active":"2024-09-12T17:45:41.576079+0000","last_became_peered":"2024-09-12T17:45:41.576079+0000","last_unstale":"2024-09-12T19:23:44.009230+0000","last_undegraded":"2024-09-12T19:23:44.009230+0000","last_fullsized":"2024-09-12T19:23:44.009230+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'85","last_scrub_stamp":"2024-09-12T19:23:44.009038+0000","last_deep_scrub":"267'85","last_deep_scrub_stamp":"2024-09-12T19:23:44.009038+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.009038+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:50.593899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":312,"num_write":160,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:59.722585+0000","last_change":"2024-09-12T19:23:59.722585+0000","last_active":"2024-09-12T19:23:59.722585+0000","last_peered":"2024-09-12T19:23:59.722585+0000","last_clean":"2024-09-12T19:23:59.722585+0000","last_became_active":"2024-09-12T18:19:22.662955+0000","last_became_peered":"2024-09-12T18:19:22.662955+0000","last_unstale":"2024-09-12T19:23:59.722585+0000","last_undegraded":"2024-09-12T19:23:59.722585+0000","last_fullsized":"2024-09-12T19:23:59.722585+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:59.722403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:59.722403+0000","last_clean_scrub_stamp":"2024-09-12T19:23:59.722403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:15.808500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.300955+0000","last_change":"2024-09-12T19:23:43.300831+0000","last_active":"2024-09-12T19:23:43.300955+0000","last_peered":"2024-09-12T19:23:43.300955+0000","last_clean":"2024-09-12T19:23:43.300955+0000","last_became_active":"2024-09-12T17:51:59.942275+0000","last_became_peered":"2024-09-12T17:51:59.942275+0000","last_unstale":"2024-09-12T19:23:43.300955+0000","last_undegraded":"2024-09-12T19:23:43.300955+0000","last_fullsized":"2024-09-12T19:23:43.300955+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:43.300653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:43.300653+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.300653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:31.246433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.725109+0000","last_change":"2024-09-12T19:23:40.725109+0000","last_active":"2024-09-12T19:23:40.725109+0000","last_peered":"2024-09-12T19:23:40.725109+0000","last_clean":"2024-09-12T19:23:40.725109+0000","last_became_active":"2024-09-12T17:51:52.895913+0000","last_became_peered":"2024-09-12T17:51:52.895913+0000","last_unstale":"2024-09-12T19:23:40.725109+0000","last_undegraded":"2024-09-12T19:23:40.725109+0000","last_fullsized":"2024-09-12T19:23:40.725109+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:40.724930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:40.724930+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.724930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:34.829056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'8","reported_seq":111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.342466+0000","last_change":"2024-09-12T19:23:36.342301+0000","last_active":"2024-09-12T19:23:36.342466+0000","last_peered":"2024-09-12T19:23:36.342466+0000","last_clean":"2024-09-12T19:23:36.342466+0000","last_became_active":"2024-09-12T17:45:41.576841+0000","last_became_peered":"2024-09-12T17:45:41.576841+0000","last_unstale":"2024-09-12T19:23:36.342466+0000","last_undegraded":"2024-09-12T19:23:36.342466+0000","last_fullsized":"2024-09-12T19:23:36.342466+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-12T19:23:36.342110+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-12T19:23:36.342110+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.342110+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:35.442446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:57.034677+0000","last_change":"2024-09-12T19:23:57.034536+0000","last_active":"2024-09-12T19:23:57.034677+0000","last_peered":"2024-09-12T19:23:57.034677+0000","last_clean":"2024-09-12T19:23:57.034677+0000","last_became_active":"2024-09-12T18:19:22.662633+0000","last_became_peered":"2024-09-12T18:19:22.662633+0000","last_unstale":"2024-09-12T19:23:57.034677+0000","last_undegraded":"2024-09-12T19:23:57.034677+0000","last_fullsized":"2024-09-12T19:23:57.034677+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:57.034350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:57.034350+0000","last_clean_scrub_stamp":"2024-09-12T19:23:57.034350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:38.160429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:52.117037+0000","last_change":"2024-09-12T19:23:52.117037+0000","last_active":"2024-09-12T19:23:52.117037+0000","last_peered":"2024-09-12T19:23:52.117037+0000","last_clean":"2024-09-12T19:23:52.117037+0000","last_became_active":"2024-09-12T17:51:59.929108+0000","last_became_peered":"2024-09-12T17:51:59.929108+0000","last_unstale":"2024-09-12T19:23:52.117037+0000","last_undegraded":"2024-09-12T19:23:52.117037+0000","last_fullsized":"2024-09-12T19:23:52.117037+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:52.116850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:52.116850+0000","last_clean_scrub_stamp":"2024-09-12T19:23:52.116850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:04.533236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"267'2","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.264589+0000","last_change":"2024-09-12T19:23:38.264589+0000","last_active":"2024-09-12T19:23:38.264589+0000","last_peered":"2024-09-12T19:23:38.264589+0000","last_clean":"2024-09-12T19:23:38.264589+0000","last_became_active":"2024-09-12T17:51:52.876809+0000","last_became_peered":"2024-09-12T17:51:52.876809+0000","last_unstale":"2024-09-12T19:23:38.264589+0000","last_undegraded":"2024-09-12T19:23:38.264589+0000","last_fullsized":"2024-09-12T19:23:38.264589+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:38.264407+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:38.264407+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.264407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:47.457682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":5,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"267'24","reported_seq":155,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.137543+0000","last_change":"2024-09-12T19:23:44.137407+0000","last_active":"2024-09-12T19:23:44.137543+0000","last_peered":"2024-09-12T19:23:44.137543+0000","last_clean":"2024-09-12T19:23:44.137543+0000","last_became_active":"2024-09-12T17:45:41.587464+0000","last_became_peered":"2024-09-12T17:45:41.587464+0000","last_unstale":"2024-09-12T19:23:44.137543+0000","last_undegraded":"2024-09-12T19:23:44.137543+0000","last_fullsized":"2024-09-12T19:23:44.137543+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'24","last_scrub_stamp":"2024-09-12T19:23:44.137217+0000","last_deep_scrub":"267'24","last_deep_scrub_stamp":"2024-09-12T19:23:44.137217+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.137217+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:46.257126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":80,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'298","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.108428+0000","last_change":"2024-09-12T19:23:21.108249+0000","last_active":"2024-09-12T19:23:21.108428+0000","last_peered":"2024-09-12T19:23:21.108428+0000","last_clean":"2024-09-12T19:23:21.108428+0000","last_became_active":"2024-09-12T17:29:52.754920+0000","last_became_peered":"2024-09-12T17:29:52.754920+0000","last_unstale":"2024-09-12T19:23:21.108428+0000","last_undegraded":"2024-09-12T19:23:21.108428+0000","last_fullsized":"2024-09-12T19:23:21.108428+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'298","last_scrub_stamp":"2024-09-12T19:23:21.108016+0000","last_deep_scrub":"267'298","last_deep_scrub_stamp":"2024-09-12T19:23:21.108016+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.108016+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:55.221859+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262253,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":453,"num_read_kb":663,"num_write":1055,"num_write_kb":22160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'507","reported_seq":2214,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.392030+0000","last_change":"2024-09-12T19:23:26.392030+0000","last_active":"2024-09-12T19:23:26.392030+0000","last_peered":"2024-09-12T19:23:26.392030+0000","last_clean":"2024-09-12T19:23:26.392030+0000","last_became_active":"2024-09-12T17:29:54.760892+0000","last_became_peered":"2024-09-12T17:29:54.760892+0000","last_unstale":"2024-09-12T19:23:26.392030+0000","last_undegraded":"2024-09-12T19:23:26.392030+0000","last_fullsized":"2024-09-12T19:23:26.392030+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'507","last_scrub_stamp":"2024-09-12T19:23:26.391829+0000","last_deep_scrub":"267'507","last_deep_scrub_stamp":"2024-09-12T19:23:26.391829+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.391829+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:48.210092+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2904,"num_read_kb":2740,"num_write":620,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'340","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.713777+0000","last_change":"2024-09-12T19:23:17.713604+0000","last_active":"2024-09-12T19:23:17.713777+0000","last_peered":"2024-09-12T19:23:17.713777+0000","last_clean":"2024-09-12T19:23:17.713777+0000","last_became_active":"2024-09-12T17:29:52.747481+0000","last_became_peered":"2024-09-12T17:29:52.747481+0000","last_unstale":"2024-09-12T19:23:17.713777+0000","last_undegraded":"2024-09-12T19:23:17.713777+0000","last_fullsized":"2024-09-12T19:23:17.713777+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'340","last_scrub_stamp":"2024-09-12T19:23:17.713262+0000","last_deep_scrub":"267'340","last_deep_scrub_stamp":"2024-09-12T19:23:17.713262+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.713262+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:02.653602+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306162,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":522,"num_read_kb":19278,"num_write":1123,"num_write_kb":29260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'431","reported_seq":1902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.096403+0000","last_change":"2024-09-12T19:23:30.096403+0000","last_active":"2024-09-12T19:23:30.096403+0000","last_peered":"2024-09-12T19:23:30.096403+0000","last_clean":"2024-09-12T19:23:30.096403+0000","last_became_active":"2024-09-12T17:29:54.753272+0000","last_became_peered":"2024-09-12T17:29:54.753272+0000","last_unstale":"2024-09-12T19:23:30.096403+0000","last_undegraded":"2024-09-12T19:23:30.096403+0000","last_fullsized":"2024-09-12T19:23:30.096403+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'431","last_scrub_stamp":"2024-09-12T19:23:30.096150+0000","last_deep_scrub":"267'431","last_deep_scrub_stamp":"2024-09-12T19:23:30.096150+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.096150+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:52.937689+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2129,"num_read_kb":2000,"num_write":496,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'342","reported_seq":1042,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:08.906198+0000","last_change":"2024-09-12T19:23:08.906121+0000","last_active":"2024-09-12T19:23:08.906198+0000","last_peered":"2024-09-12T19:23:08.906198+0000","last_clean":"2024-09-12T19:23:08.906198+0000","last_became_active":"2024-09-12T17:29:52.735978+0000","last_became_peered":"2024-09-12T17:29:52.735978+0000","last_unstale":"2024-09-12T19:23:08.906198+0000","last_undegraded":"2024-09-12T19:23:08.906198+0000","last_fullsized":"2024-09-12T19:23:08.906198+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'342","last_scrub_stamp":"2024-09-12T19:23:08.905981+0000","last_deep_scrub":"267'342","last_deep_scrub_stamp":"2024-09-12T19:23:08.905981+0000","last_clean_scrub_stamp":"2024-09-12T19:23:08.905981+0000","objects_scrubbed":10,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:12.305189+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2553570,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":504,"num_read_kb":35253,"num_write":1107,"num_write_kb":35855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'940","reported_seq":2615,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.215432+0000","last_change":"2024-09-12T19:23:27.215432+0000","last_active":"2024-09-12T19:23:27.215432+0000","last_peered":"2024-09-12T19:23:27.215432+0000","last_clean":"2024-09-12T19:23:27.215432+0000","last_became_active":"2024-09-12T17:29:54.770286+0000","last_became_peered":"2024-09-12T17:29:54.770286+0000","last_unstale":"2024-09-12T19:23:27.215432+0000","last_undegraded":"2024-09-12T19:23:27.215432+0000","last_fullsized":"2024-09-12T19:23:27.215432+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'940","last_scrub_stamp":"2024-09-12T19:23:27.215139+0000","last_deep_scrub":"267'940","last_deep_scrub_stamp":"2024-09-12T19:23:27.215139+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.215139+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":900,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:57.585678+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4498,"num_read_kb":4029,"num_write":1285,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2544,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'344","reported_seq":1095,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.682756+0000","last_change":"2024-09-12T19:23:15.682756+0000","last_active":"2024-09-12T19:23:15.682756+0000","last_peered":"2024-09-12T19:23:15.682756+0000","last_clean":"2024-09-12T19:23:15.682756+0000","last_became_active":"2024-09-12T17:30:21.689546+0000","last_became_peered":"2024-09-12T17:30:21.689546+0000","last_unstale":"2024-09-12T19:23:15.682756+0000","last_undegraded":"2024-09-12T19:23:15.682756+0000","last_fullsized":"2024-09-12T19:23:15.682756+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'344","last_scrub_stamp":"2024-09-12T19:23:15.682534+0000","last_deep_scrub":"267'344","last_deep_scrub_stamp":"2024-09-12T19:23:15.682534+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.682534+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:01.240340+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170253,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":648,"num_read_kb":124307,"num_write":1100,"num_write_kb":33866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7,2],"acting":[1,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"267'841","reported_seq":2488,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.786065+0000","last_change":"2024-09-12T19:23:27.786065+0000","last_active":"2024-09-12T19:23:27.786065+0000","last_peered":"2024-09-12T19:23:27.786065+0000","last_clean":"2024-09-12T19:23:27.786065+0000","last_became_active":"2024-09-12T17:29:54.760180+0000","last_became_peered":"2024-09-12T17:29:54.760180+0000","last_unstale":"2024-09-12T19:23:27.786065+0000","last_undegraded":"2024-09-12T19:23:27.786065+0000","last_fullsized":"2024-09-12T19:23:27.786065+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'841","last_scrub_stamp":"2024-09-12T19:23:27.785877+0000","last_deep_scrub":"267'841","last_deep_scrub_stamp":"2024-09-12T19:23:27.785877+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.785877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:05.230667+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3987,"num_read_kb":3603,"num_write":1097,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'364","reported_seq":1016,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.084038+0000","last_change":"2024-09-12T19:23:22.084038+0000","last_active":"2024-09-12T19:23:22.084038+0000","last_peered":"2024-09-12T19:23:22.084038+0000","last_clean":"2024-09-12T19:23:22.084038+0000","last_became_active":"2024-09-12T17:29:52.744115+0000","last_became_peered":"2024-09-12T17:29:52.744115+0000","last_unstale":"2024-09-12T19:23:22.084038+0000","last_undegraded":"2024-09-12T19:23:22.084038+0000","last_fullsized":"2024-09-12T19:23:22.084038+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'364","last_scrub_stamp":"2024-09-12T19:23:22.083674+0000","last_deep_scrub":"267'364","last_deep_scrub_stamp":"2024-09-12T19:23:22.083674+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.083674+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:33.271484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262269,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":11709,"num_write":1093,"num_write_kb":63153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'872","reported_seq":2514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.240743+0000","last_change":"2024-09-12T19:23:20.240607+0000","last_active":"2024-09-12T19:23:20.240743+0000","last_peered":"2024-09-12T19:23:20.240743+0000","last_clean":"2024-09-12T19:23:20.240743+0000","last_became_active":"2024-09-12T17:29:54.758552+0000","last_became_peered":"2024-09-12T17:29:54.758552+0000","last_unstale":"2024-09-12T19:23:20.240743+0000","last_undegraded":"2024-09-12T19:23:20.240743+0000","last_fullsized":"2024-09-12T19:23:20.240743+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'872","last_scrub_stamp":"2024-09-12T19:23:20.240387+0000","last_deep_scrub":"267'872","last_deep_scrub_stamp":"2024-09-12T19:23:20.240387+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.240387+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:09.305077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4049,"num_read_kb":3640,"num_write":1140,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'353","reported_seq":1025,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.337794+0000","last_change":"2024-09-12T19:23:20.337794+0000","last_active":"2024-09-12T19:23:20.337794+0000","last_peered":"2024-09-12T19:23:20.337794+0000","last_clean":"2024-09-12T19:23:20.337794+0000","last_became_active":"2024-09-12T17:29:52.756242+0000","last_became_peered":"2024-09-12T17:29:52.756242+0000","last_unstale":"2024-09-12T19:23:20.337794+0000","last_undegraded":"2024-09-12T19:23:20.337794+0000","last_fullsized":"2024-09-12T19:23:20.337794+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'353","last_scrub_stamp":"2024-09-12T19:23:20.337459+0000","last_deep_scrub":"267'353","last_deep_scrub_stamp":"2024-09-12T19:23:20.337459+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.337459+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:26.759309+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311546,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":527,"num_read_kb":10971,"num_write":1015,"num_write_kb":29590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'392","reported_seq":1990,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.168012+0000","last_change":"2024-09-12T19:23:28.168012+0000","last_active":"2024-09-12T19:23:28.168012+0000","last_peered":"2024-09-12T19:23:28.168012+0000","last_clean":"2024-09-12T19:23:28.168012+0000","last_became_active":"2024-09-12T17:29:54.770050+0000","last_became_peered":"2024-09-12T17:29:54.770050+0000","last_unstale":"2024-09-12T19:23:28.168012+0000","last_undegraded":"2024-09-12T19:23:28.168012+0000","last_fullsized":"2024-09-12T19:23:28.168012+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'392","last_scrub_stamp":"2024-09-12T19:23:28.167823+0000","last_deep_scrub":"267'392","last_deep_scrub_stamp":"2024-09-12T19:23:28.167823+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.167823+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:05:18.931144+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2225,"num_read_kb":2129,"num_write":425,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":667,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'366","reported_seq":1027,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.068967+0000","last_change":"2024-09-12T19:23:20.068967+0000","last_active":"2024-09-12T19:23:20.068967+0000","last_peered":"2024-09-12T19:23:20.068967+0000","last_clean":"2024-09-12T19:23:20.068967+0000","last_became_active":"2024-09-12T17:29:52.762473+0000","last_became_peered":"2024-09-12T17:29:52.762473+0000","last_unstale":"2024-09-12T19:23:20.068967+0000","last_undegraded":"2024-09-12T19:23:20.068967+0000","last_fullsized":"2024-09-12T19:23:20.068967+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'366","last_scrub_stamp":"2024-09-12T19:23:20.068679+0000","last_deep_scrub":"267'366","last_deep_scrub_stamp":"2024-09-12T19:23:20.068679+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.068679+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:19.139220+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25719,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":480,"num_read_kb":16012,"num_write":1030,"num_write_kb":47372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'481","reported_seq":2022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.360178+0000","last_change":"2024-09-12T19:23:27.360178+0000","last_active":"2024-09-12T19:23:27.360178+0000","last_peered":"2024-09-12T19:23:27.360178+0000","last_clean":"2024-09-12T19:23:27.360178+0000","last_became_active":"2024-09-12T17:29:54.745833+0000","last_became_peered":"2024-09-12T17:29:54.745833+0000","last_unstale":"2024-09-12T19:23:27.360178+0000","last_undegraded":"2024-09-12T19:23:27.360178+0000","last_fullsized":"2024-09-12T19:23:27.360178+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'481","last_scrub_stamp":"2024-09-12T19:23:27.359982+0000","last_deep_scrub":"267'481","last_deep_scrub_stamp":"2024-09-12T19:23:27.359982+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.359982+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:27.719917+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2543,"num_read_kb":2369,"num_write":601,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'339","reported_seq":1125,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.105983+0000","last_change":"2024-09-12T19:23:19.105983+0000","last_active":"2024-09-12T19:23:19.105983+0000","last_peered":"2024-09-12T19:23:19.105983+0000","last_clean":"2024-09-12T19:23:19.105983+0000","last_became_active":"2024-09-12T17:29:52.730010+0000","last_became_peered":"2024-09-12T17:29:52.730010+0000","last_unstale":"2024-09-12T19:23:19.105983+0000","last_undegraded":"2024-09-12T19:23:19.105983+0000","last_fullsized":"2024-09-12T19:23:19.105983+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'339","last_scrub_stamp":"2024-09-12T19:23:19.105777+0000","last_deep_scrub":"267'339","last_deep_scrub_stamp":"2024-09-12T19:23:19.105777+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.105777+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:17.217745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":580168,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":14958,"num_write":1088,"num_write_kb":34324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'424","reported_seq":2031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.913338+0000","last_change":"2024-09-12T19:23:16.913338+0000","last_active":"2024-09-12T19:23:16.913338+0000","last_peered":"2024-09-12T19:23:16.913338+0000","last_clean":"2024-09-12T19:23:16.913338+0000","last_became_active":"2024-09-12T17:29:54.755721+0000","last_became_peered":"2024-09-12T17:29:54.755721+0000","last_unstale":"2024-09-12T19:23:16.913338+0000","last_undegraded":"2024-09-12T19:23:16.913338+0000","last_fullsized":"2024-09-12T19:23:16.913338+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'424","last_scrub_stamp":"2024-09-12T19:23:16.913164+0000","last_deep_scrub":"267'424","last_deep_scrub_stamp":"2024-09-12T19:23:16.913164+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.913164+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:30.429196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2342,"num_read_kb":2221,"num_write":470,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1531,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'362","reported_seq":1941,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.211259+0000","last_change":"2024-09-12T19:23:25.211026+0000","last_active":"2024-09-12T19:23:25.211259+0000","last_peered":"2024-09-12T19:23:25.211259+0000","last_clean":"2024-09-12T19:23:25.211259+0000","last_became_active":"2024-09-12T17:29:54.753012+0000","last_became_peered":"2024-09-12T17:29:54.753012+0000","last_unstale":"2024-09-12T19:23:25.211259+0000","last_undegraded":"2024-09-12T19:23:25.211259+0000","last_fullsized":"2024-09-12T19:23:25.211259+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-09-12T19:23:25.210742+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-09-12T19:23:25.210742+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.210742+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:09.088143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2149,"num_read_kb":2071,"num_write":395,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'362","reported_seq":1055,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.094171+0000","last_change":"2024-09-12T19:23:19.093896+0000","last_active":"2024-09-12T19:23:19.094171+0000","last_peered":"2024-09-12T19:23:19.094171+0000","last_clean":"2024-09-12T19:23:19.094171+0000","last_became_active":"2024-09-12T17:29:52.747589+0000","last_became_peered":"2024-09-12T17:29:52.747589+0000","last_unstale":"2024-09-12T19:23:19.094171+0000","last_undegraded":"2024-09-12T19:23:19.094171+0000","last_fullsized":"2024-09-12T19:23:19.094171+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'362","last_scrub_stamp":"2024-09-12T19:23:19.093553+0000","last_deep_scrub":"267'362","last_deep_scrub_stamp":"2024-09-12T19:23:19.093553+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.093553+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:37.013602+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":507,"num_read_kb":50487,"num_write":1096,"num_write_kb":29653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'428","reported_seq":2002,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.061433+0000","last_change":"2024-09-12T19:23:25.061297+0000","last_active":"2024-09-12T19:23:25.061433+0000","last_peered":"2024-09-12T19:23:25.061433+0000","last_clean":"2024-09-12T19:23:25.061433+0000","last_became_active":"2024-09-12T17:29:54.752373+0000","last_became_peered":"2024-09-12T17:29:54.752373+0000","last_unstale":"2024-09-12T19:23:25.061433+0000","last_undegraded":"2024-09-12T19:23:25.061433+0000","last_fullsized":"2024-09-12T19:23:25.061433+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'428","last_scrub_stamp":"2024-09-12T19:23:25.061115+0000","last_deep_scrub":"267'428","last_deep_scrub_stamp":"2024-09-12T19:23:25.061115+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.061115+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:07.521489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2327,"num_read_kb":2222,"num_write":465,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'338","reported_seq":1117,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.130886+0000","last_change":"2024-09-12T19:23:18.130740+0000","last_active":"2024-09-12T19:23:18.130886+0000","last_peered":"2024-09-12T19:23:18.130886+0000","last_clean":"2024-09-12T19:23:18.130886+0000","last_became_active":"2024-09-12T17:30:22.255773+0000","last_became_peered":"2024-09-12T17:30:22.255773+0000","last_unstale":"2024-09-12T19:23:18.130886+0000","last_undegraded":"2024-09-12T19:23:18.130886+0000","last_fullsized":"2024-09-12T19:23:18.130886+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'338","last_scrub_stamp":"2024-09-12T19:23:18.130470+0000","last_deep_scrub":"267'338","last_deep_scrub_stamp":"2024-09-12T19:23:18.130470+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.130470+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:35.478105+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364459,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":843,"num_read_kb":51980,"num_write":1145,"num_write_kb":60983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2,1],"acting":[3,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.32","version":"267'529","reported_seq":2190,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.368130+0000","last_change":"2024-09-12T19:23:24.368130+0000","last_active":"2024-09-12T19:23:24.368130+0000","last_peered":"2024-09-12T19:23:24.368130+0000","last_clean":"2024-09-12T19:23:24.368130+0000","last_became_active":"2024-09-12T17:29:54.771786+0000","last_became_peered":"2024-09-12T17:29:54.771786+0000","last_unstale":"2024-09-12T19:23:24.368130+0000","last_undegraded":"2024-09-12T19:23:24.368130+0000","last_fullsized":"2024-09-12T19:23:24.368130+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'529","last_scrub_stamp":"2024-09-12T19:23:24.367953+0000","last_deep_scrub":"267'529","last_deep_scrub_stamp":"2024-09-12T19:23:24.367953+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.367953+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:57:53.562274+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2657,"num_read_kb":2482,"num_write":638,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'438","reported_seq":1252,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.224353+0000","last_change":"2024-09-12T19:23:14.224171+0000","last_active":"2024-09-12T19:23:14.224353+0000","last_peered":"2024-09-12T19:23:14.224353+0000","last_clean":"2024-09-12T19:23:14.224353+0000","last_became_active":"2024-09-12T17:29:52.725473+0000","last_became_peered":"2024-09-12T17:29:52.725473+0000","last_unstale":"2024-09-12T19:23:14.224353+0000","last_undegraded":"2024-09-12T19:23:14.224353+0000","last_fullsized":"2024-09-12T19:23:14.224353+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'438","last_scrub_stamp":"2024-09-12T19:23:14.223910+0000","last_deep_scrub":"267'438","last_deep_scrub_stamp":"2024-09-12T19:23:14.223910+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.223910+0000","objects_scrubbed":9,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:40.091598+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3634873,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":934,"num_read_kb":41903,"num_write":1412,"num_write_kb":44280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'658","reported_seq":2291,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.984732+0000","last_change":"2024-09-12T19:23:13.984600+0000","last_active":"2024-09-12T19:23:13.984732+0000","last_peered":"2024-09-12T19:23:13.984732+0000","last_clean":"2024-09-12T19:23:13.984732+0000","last_became_active":"2024-09-12T17:29:54.754119+0000","last_became_peered":"2024-09-12T17:29:54.754119+0000","last_unstale":"2024-09-12T19:23:13.984732+0000","last_undegraded":"2024-09-12T19:23:13.984732+0000","last_fullsized":"2024-09-12T19:23:13.984732+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'658","last_scrub_stamp":"2024-09-12T19:23:13.984417+0000","last_deep_scrub":"267'658","last_deep_scrub_stamp":"2024-09-12T19:23:13.984417+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.984417+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":600,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:23:49.226444+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3376,"num_read_kb":3085,"num_write":861,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3276,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'319","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.237886+0000","last_change":"2024-09-12T19:23:12.237745+0000","last_active":"2024-09-12T19:23:12.237886+0000","last_peered":"2024-09-12T19:23:12.237886+0000","last_clean":"2024-09-12T19:23:12.237886+0000","last_became_active":"2024-09-12T17:29:52.764052+0000","last_became_peered":"2024-09-12T17:29:52.764052+0000","last_unstale":"2024-09-12T19:23:12.237886+0000","last_undegraded":"2024-09-12T19:23:12.237886+0000","last_fullsized":"2024-09-12T19:23:12.237886+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'319","last_scrub_stamp":"2024-09-12T19:23:12.237529+0000","last_deep_scrub":"267'319","last_deep_scrub_stamp":"2024-09-12T19:23:12.237529+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.237529+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:41.845980+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":477,"num_read_kb":61037,"num_write":999,"num_write_kb":13603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'894","reported_seq":2465,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.024053+0000","last_change":"2024-09-12T19:23:22.023908+0000","last_active":"2024-09-12T19:23:22.024053+0000","last_peered":"2024-09-12T19:23:22.024053+0000","last_clean":"2024-09-12T19:23:22.024053+0000","last_became_active":"2024-09-12T17:29:54.760746+0000","last_became_peered":"2024-09-12T17:29:54.760746+0000","last_unstale":"2024-09-12T19:23:22.024053+0000","last_undegraded":"2024-09-12T19:23:22.024053+0000","last_fullsized":"2024-09-12T19:23:22.024053+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'894","last_scrub_stamp":"2024-09-12T19:23:22.023716+0000","last_deep_scrub":"267'894","last_deep_scrub_stamp":"2024-09-12T19:23:22.023716+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.023716+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":800,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:38:10.198893+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4106,"num_read_kb":3659,"num_write":1202,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'393","reported_seq":1091,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.121327+0000","last_change":"2024-09-12T19:23:17.121182+0000","last_active":"2024-09-12T19:23:17.121327+0000","last_peered":"2024-09-12T19:23:17.121327+0000","last_clean":"2024-09-12T19:23:17.121327+0000","last_became_active":"2024-09-12T17:29:52.720974+0000","last_became_peered":"2024-09-12T17:29:52.720974+0000","last_unstale":"2024-09-12T19:23:17.121327+0000","last_undegraded":"2024-09-12T19:23:17.121327+0000","last_fullsized":"2024-09-12T19:23:17.121327+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'393","last_scrub_stamp":"2024-09-12T19:23:17.120877+0000","last_deep_scrub":"267'393","last_deep_scrub_stamp":"2024-09-12T19:23:17.120877+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.120877+0000","objects_scrubbed":6,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:23.312770+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730141,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":597,"num_read_kb":19633,"num_write":1232,"num_write_kb":34097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'745","reported_seq":2343,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.258153+0000","last_change":"2024-09-12T19:23:26.257990+0000","last_active":"2024-09-12T19:23:26.258153+0000","last_peered":"2024-09-12T19:23:26.258153+0000","last_clean":"2024-09-12T19:23:26.258153+0000","last_became_active":"2024-09-12T17:29:54.756675+0000","last_became_peered":"2024-09-12T17:29:54.756675+0000","last_unstale":"2024-09-12T19:23:26.258153+0000","last_undegraded":"2024-09-12T19:23:26.258153+0000","last_fullsized":"2024-09-12T19:23:26.258153+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'745","last_scrub_stamp":"2024-09-12T19:23:26.257807+0000","last_deep_scrub":"267'745","last_deep_scrub_stamp":"2024-09-12T19:23:26.257807+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.257807+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:41.842768+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3670,"num_read_kb":3349,"num_write":979,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'350","reported_seq":1005,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.882345+0000","last_change":"2024-09-12T19:23:11.882345+0000","last_active":"2024-09-12T19:23:11.882345+0000","last_peered":"2024-09-12T19:23:11.882345+0000","last_clean":"2024-09-12T19:23:11.882345+0000","last_became_active":"2024-09-12T17:29:52.766959+0000","last_became_peered":"2024-09-12T17:29:52.766959+0000","last_unstale":"2024-09-12T19:23:11.882345+0000","last_undegraded":"2024-09-12T19:23:11.882345+0000","last_fullsized":"2024-09-12T19:23:11.882345+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'350","last_scrub_stamp":"2024-09-12T19:23:11.882126+0000","last_deep_scrub":"267'350","last_deep_scrub_stamp":"2024-09-12T19:23:11.882126+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.882126+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:02.282493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":468,"num_read_kb":494,"num_write":1113,"num_write_kb":20716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'131","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.037145+0000","last_change":"2024-09-12T19:23:42.037145+0000","last_active":"2024-09-12T19:23:42.037145+0000","last_peered":"2024-09-12T19:23:42.037145+0000","last_clean":"2024-09-12T19:23:42.037145+0000","last_became_active":"2024-09-12T17:30:02.802659+0000","last_became_peered":"2024-09-12T17:30:02.802659+0000","last_unstale":"2024-09-12T19:23:42.037145+0000","last_undegraded":"2024-09-12T19:23:42.037145+0000","last_fullsized":"2024-09-12T19:23:42.037145+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-09-12T19:23:42.036925+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-09-12T19:23:42.036925+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.036925+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:36:38.006162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":169,"num_write":297,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'432","reported_seq":2026,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.153150+0000","last_change":"2024-09-12T19:23:24.153150+0000","last_active":"2024-09-12T19:23:24.153150+0000","last_peered":"2024-09-12T19:23:24.153150+0000","last_clean":"2024-09-12T19:23:24.153150+0000","last_became_active":"2024-09-12T17:29:54.758303+0000","last_became_peered":"2024-09-12T17:29:54.758303+0000","last_unstale":"2024-09-12T19:23:24.153150+0000","last_undegraded":"2024-09-12T19:23:24.153150+0000","last_fullsized":"2024-09-12T19:23:24.153150+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'432","last_scrub_stamp":"2024-09-12T19:23:24.152868+0000","last_deep_scrub":"267'432","last_deep_scrub_stamp":"2024-09-12T19:23:24.152868+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.152868+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:50.955827+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2323,"num_read_kb":2196,"num_write":494,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'401","reported_seq":1121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.070634+0000","last_change":"2024-09-12T19:23:14.070452+0000","last_active":"2024-09-12T19:23:14.070634+0000","last_peered":"2024-09-12T19:23:14.070634+0000","last_clean":"2024-09-12T19:23:14.070634+0000","last_became_active":"2024-09-12T17:29:52.755103+0000","last_became_peered":"2024-09-12T17:29:52.755103+0000","last_unstale":"2024-09-12T19:23:14.070634+0000","last_undegraded":"2024-09-12T19:23:14.070634+0000","last_fullsized":"2024-09-12T19:23:14.070634+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'401","last_scrub_stamp":"2024-09-12T19:23:14.070224+0000","last_deep_scrub":"267'401","last_deep_scrub_stamp":"2024-09-12T19:23:14.070224+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.070224+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:12:15.519300+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524450,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":671,"num_read_kb":34526,"num_write":1327,"num_write_kb":26646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.319765+0000","last_change":"2024-09-12T19:23:30.319587+0000","last_active":"2024-09-12T19:23:30.319765+0000","last_peered":"2024-09-12T19:23:30.319765+0000","last_clean":"2024-09-12T19:23:30.319765+0000","last_became_active":"2024-09-12T17:29:56.763547+0000","last_became_peered":"2024-09-12T17:29:56.763547+0000","last_unstale":"2024-09-12T19:23:30.319765+0000","last_undegraded":"2024-09-12T19:23:30.319765+0000","last_fullsized":"2024-09-12T19:23:30.319765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:30.319381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:30.319381+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.319381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:11.796126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'391","reported_seq":1050,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.766076+0000","last_change":"2024-09-12T19:23:28.765866+0000","last_active":"2024-09-12T19:23:28.766076+0000","last_peered":"2024-09-12T19:23:28.766076+0000","last_clean":"2024-09-12T19:23:28.766076+0000","last_became_active":"2024-09-12T17:29:58.777554+0000","last_became_peered":"2024-09-12T17:29:58.777554+0000","last_unstale":"2024-09-12T19:23:28.766076+0000","last_undegraded":"2024-09-12T19:23:28.766076+0000","last_fullsized":"2024-09-12T19:23:28.766076+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'391","last_scrub_stamp":"2024-09-12T19:23:28.765622+0000","last_deep_scrub":"267'391","last_deep_scrub_stamp":"2024-09-12T19:23:28.765622+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.765622+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:18.062130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45863,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":1229,"num_write":480,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.039838+0000","last_change":"2024-09-12T19:23:39.039838+0000","last_active":"2024-09-12T19:23:39.039838+0000","last_peered":"2024-09-12T19:23:39.039838+0000","last_clean":"2024-09-12T19:23:39.039838+0000","last_became_active":"2024-09-12T17:30:00.805568+0000","last_became_peered":"2024-09-12T17:30:00.805568+0000","last_unstale":"2024-09-12T19:23:39.039838+0000","last_undegraded":"2024-09-12T19:23:39.039838+0000","last_fullsized":"2024-09-12T19:23:39.039838+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:39.039604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:39.039604+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.039604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:39:42.434322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'147","reported_seq":735,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.340517+0000","last_change":"2024-09-12T19:23:43.340340+0000","last_active":"2024-09-12T19:23:43.340517+0000","last_peered":"2024-09-12T19:23:43.340517+0000","last_clean":"2024-09-12T19:23:43.340517+0000","last_became_active":"2024-09-12T17:30:02.785212+0000","last_became_peered":"2024-09-12T17:30:02.785212+0000","last_unstale":"2024-09-12T19:23:43.340517+0000","last_undegraded":"2024-09-12T19:23:43.340517+0000","last_fullsized":"2024-09-12T19:23:43.340517+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'147","last_scrub_stamp":"2024-09-12T19:23:43.340126+0000","last_deep_scrub":"267'147","last_deep_scrub_stamp":"2024-09-12T19:23:43.340126+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.340126+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:34:42.490361+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":252,"num_read_kb":243,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'686","reported_seq":2561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.304352+0000","last_change":"2024-09-12T19:23:22.304212+0000","last_active":"2024-09-12T19:23:22.304352+0000","last_peered":"2024-09-12T19:23:22.304352+0000","last_clean":"2024-09-12T19:23:22.304352+0000","last_became_active":"2024-09-12T17:29:54.761497+0000","last_became_peered":"2024-09-12T17:29:54.761497+0000","last_unstale":"2024-09-12T19:23:22.304352+0000","last_undegraded":"2024-09-12T19:23:22.304352+0000","last_fullsized":"2024-09-12T19:23:22.304352+0000","mapping_epoch":28,"log_start":"267'600","ondisk_log_start":"267'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'686","last_scrub_stamp":"2024-09-12T19:23:22.303998+0000","last_deep_scrub":"267'686","last_deep_scrub_stamp":"2024-09-12T19:23:22.303998+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.303998+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":600,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:35.218804+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3854,"num_read_kb":3534,"num_write":981,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2484,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'373","reported_seq":1055,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.894236+0000","last_change":"2024-09-12T19:23:10.894094+0000","last_active":"2024-09-12T19:23:10.894236+0000","last_peered":"2024-09-12T19:23:10.894236+0000","last_clean":"2024-09-12T19:23:10.894236+0000","last_became_active":"2024-09-12T17:29:52.713938+0000","last_became_peered":"2024-09-12T17:29:52.713938+0000","last_unstale":"2024-09-12T19:23:10.894236+0000","last_undegraded":"2024-09-12T19:23:10.894236+0000","last_fullsized":"2024-09-12T19:23:10.894236+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'373","last_scrub_stamp":"2024-09-12T19:23:10.893784+0000","last_deep_scrub":"267'373","last_deep_scrub_stamp":"2024-09-12T19:23:10.893784+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.893784+0000","objects_scrubbed":7,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:26:17.828171+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460272,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":10309,"num_write":1260,"num_write_kb":32712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.117064+0000","last_change":"2024-09-12T19:23:33.117064+0000","last_active":"2024-09-12T19:23:33.117064+0000","last_peered":"2024-09-12T19:23:33.117064+0000","last_clean":"2024-09-12T19:23:33.117064+0000","last_became_active":"2024-09-12T17:29:56.776335+0000","last_became_peered":"2024-09-12T17:29:56.776335+0000","last_unstale":"2024-09-12T19:23:33.117064+0000","last_undegraded":"2024-09-12T19:23:33.117064+0000","last_fullsized":"2024-09-12T19:23:33.117064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:33.116805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:33.116805+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.116805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:05.221499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'123","reported_seq":706,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.097443+0000","last_change":"2024-09-12T19:23:35.097315+0000","last_active":"2024-09-12T19:23:35.097443+0000","last_peered":"2024-09-12T19:23:35.097443+0000","last_clean":"2024-09-12T19:23:35.097443+0000","last_became_active":"2024-09-12T17:29:58.777883+0000","last_became_peered":"2024-09-12T17:29:58.777883+0000","last_unstale":"2024-09-12T19:23:35.097443+0000","last_undegraded":"2024-09-12T19:23:35.097443+0000","last_fullsized":"2024-09-12T19:23:35.097443+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'123","last_scrub_stamp":"2024-09-12T19:23:35.097136+0000","last_deep_scrub":"267'123","last_deep_scrub_stamp":"2024-09-12T19:23:35.097136+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.097136+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:49:45.936503+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.005166+0000","last_change":"2024-09-12T19:23:40.005166+0000","last_active":"2024-09-12T19:23:40.005166+0000","last_peered":"2024-09-12T19:23:40.005166+0000","last_clean":"2024-09-12T19:23:40.005166+0000","last_became_active":"2024-09-12T17:30:00.781554+0000","last_became_peered":"2024-09-12T17:30:00.781554+0000","last_unstale":"2024-09-12T19:23:40.005166+0000","last_undegraded":"2024-09-12T19:23:40.005166+0000","last_fullsized":"2024-09-12T19:23:40.005166+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:40.004991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:40.004991+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.004991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:11.814607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'124","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.677123+0000","last_change":"2024-09-12T19:23:41.677123+0000","last_active":"2024-09-12T19:23:41.677123+0000","last_peered":"2024-09-12T19:23:41.677123+0000","last_clean":"2024-09-12T19:23:41.677123+0000","last_became_active":"2024-09-12T17:30:02.805556+0000","last_became_peered":"2024-09-12T17:30:02.805556+0000","last_unstale":"2024-09-12T19:23:41.677123+0000","last_undegraded":"2024-09-12T19:23:41.677123+0000","last_fullsized":"2024-09-12T19:23:41.677123+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'124","last_scrub_stamp":"2024-09-12T19:23:41.676926+0000","last_deep_scrub":"267'124","last_deep_scrub_stamp":"2024-09-12T19:23:41.676926+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.676926+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:02:35.359271+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":196,"num_read_kb":177,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'910","reported_seq":2546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.925925+0000","last_change":"2024-09-12T19:23:17.925790+0000","last_active":"2024-09-12T19:23:17.925925+0000","last_peered":"2024-09-12T19:23:17.925925+0000","last_clean":"2024-09-12T19:23:17.925925+0000","last_became_active":"2024-09-12T17:29:54.751997+0000","last_became_peered":"2024-09-12T17:29:54.751997+0000","last_unstale":"2024-09-12T19:23:17.925925+0000","last_undegraded":"2024-09-12T19:23:17.925925+0000","last_fullsized":"2024-09-12T19:23:17.925925+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'910","last_scrub_stamp":"2024-09-12T19:23:17.925604+0000","last_deep_scrub":"267'910","last_deep_scrub_stamp":"2024-09-12T19:23:17.925604+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.925604+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":800,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:18.238141+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4250,"num_read_kb":3802,"num_write":1203,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":496,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'368","reported_seq":1094,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.024916+0000","last_change":"2024-09-12T19:23:13.024733+0000","last_active":"2024-09-12T19:23:13.024916+0000","last_peered":"2024-09-12T19:23:13.024916+0000","last_clean":"2024-09-12T19:23:13.024916+0000","last_became_active":"2024-09-12T17:29:52.762149+0000","last_became_peered":"2024-09-12T17:29:52.762149+0000","last_unstale":"2024-09-12T19:23:13.024916+0000","last_undegraded":"2024-09-12T19:23:13.024916+0000","last_fullsized":"2024-09-12T19:23:13.024916+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'368","last_scrub_stamp":"2024-09-12T19:23:13.024462+0000","last_deep_scrub":"267'368","last_deep_scrub_stamp":"2024-09-12T19:23:13.024462+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.024462+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:06.503899+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":626,"num_read_kb":63082,"num_write":1322,"num_write_kb":27819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.144641+0000","last_change":"2024-09-12T19:23:32.144463+0000","last_active":"2024-09-12T19:23:32.144641+0000","last_peered":"2024-09-12T19:23:32.144641+0000","last_clean":"2024-09-12T19:23:32.144641+0000","last_became_active":"2024-09-12T17:29:56.761027+0000","last_became_peered":"2024-09-12T17:29:56.761027+0000","last_unstale":"2024-09-12T19:23:32.144641+0000","last_undegraded":"2024-09-12T19:23:32.144641+0000","last_fullsized":"2024-09-12T19:23:32.144641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:32.144189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:32.144189+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.144189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:33.492487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'178","reported_seq":789,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.980218+0000","last_change":"2024-09-12T19:23:23.980218+0000","last_active":"2024-09-12T19:23:23.980218+0000","last_peered":"2024-09-12T19:23:23.980218+0000","last_clean":"2024-09-12T19:23:23.980218+0000","last_became_active":"2024-09-12T17:29:58.769889+0000","last_became_peered":"2024-09-12T17:29:58.769889+0000","last_unstale":"2024-09-12T19:23:23.980218+0000","last_undegraded":"2024-09-12T19:23:23.980218+0000","last_fullsized":"2024-09-12T19:23:23.980218+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'178","last_scrub_stamp":"2024-09-12T19:23:23.980018+0000","last_deep_scrub":"267'178","last_deep_scrub_stamp":"2024-09-12T19:23:23.980018+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.980018+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:07.667832+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":222,"num_write":154,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'757","reported_seq":3334,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.082479+0000","last_change":"2024-09-12T19:23:40.082479+0000","last_active":"2024-09-12T19:23:40.082479+0000","last_peered":"2024-09-12T19:23:40.082479+0000","last_clean":"2024-09-12T19:23:40.082479+0000","last_became_active":"2024-09-12T17:30:00.810030+0000","last_became_peered":"2024-09-12T17:30:00.810030+0000","last_unstale":"2024-09-12T19:23:40.082479+0000","last_undegraded":"2024-09-12T19:23:40.082479+0000","last_fullsized":"2024-09-12T19:23:40.082479+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'757","last_scrub_stamp":"2024-09-12T19:23:40.082255+0000","last_deep_scrub":"267'757","last_deep_scrub_stamp":"2024-09-12T19:23:40.082255+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.082255+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:00.429097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'210","reported_seq":1076,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.034245+0000","last_change":"2024-09-12T19:23:45.034245+0000","last_active":"2024-09-12T19:23:45.034245+0000","last_peered":"2024-09-12T19:23:45.034245+0000","last_clean":"2024-09-12T19:23:45.034245+0000","last_became_active":"2024-09-12T17:30:02.803144+0000","last_became_peered":"2024-09-12T17:30:02.803144+0000","last_unstale":"2024-09-12T19:23:45.034245+0000","last_undegraded":"2024-09-12T19:23:45.034245+0000","last_fullsized":"2024-09-12T19:23:45.034245+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'210","last_scrub_stamp":"2024-09-12T19:23:45.034025+0000","last_deep_scrub":"267'210","last_deep_scrub_stamp":"2024-09-12T19:23:45.034025+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.034025+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:07.379679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":674,"num_read_kb":661,"num_write":463,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'416","reported_seq":2082,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.176672+0000","last_change":"2024-09-12T19:23:23.176544+0000","last_active":"2024-09-12T19:23:23.176672+0000","last_peered":"2024-09-12T19:23:23.176672+0000","last_clean":"2024-09-12T19:23:23.176672+0000","last_became_active":"2024-09-12T17:29:54.762448+0000","last_became_peered":"2024-09-12T17:29:54.762448+0000","last_unstale":"2024-09-12T19:23:23.176672+0000","last_undegraded":"2024-09-12T19:23:23.176672+0000","last_fullsized":"2024-09-12T19:23:23.176672+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'416","last_scrub_stamp":"2024-09-12T19:23:23.176364+0000","last_deep_scrub":"267'416","last_deep_scrub_stamp":"2024-09-12T19:23:23.176364+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.176364+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:27.592188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2329,"num_read_kb":2238,"num_write":469,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"267'341","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.139044+0000","last_change":"2024-09-12T19:23:11.138789+0000","last_active":"2024-09-12T19:23:11.139044+0000","last_peered":"2024-09-12T19:23:11.139044+0000","last_clean":"2024-09-12T19:23:11.139044+0000","last_became_active":"2024-09-12T17:29:52.738957+0000","last_became_peered":"2024-09-12T17:29:52.738957+0000","last_unstale":"2024-09-12T19:23:11.139044+0000","last_undegraded":"2024-09-12T19:23:11.139044+0000","last_fullsized":"2024-09-12T19:23:11.139044+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'341","last_scrub_stamp":"2024-09-12T19:23:11.138465+0000","last_deep_scrub":"267'341","last_deep_scrub_stamp":"2024-09-12T19:23:11.138465+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.138465+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:25.950750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":517,"num_read_kb":16175,"num_write":1150,"num_write_kb":26946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.312490+0000","last_change":"2024-09-12T19:23:29.312344+0000","last_active":"2024-09-12T19:23:29.312490+0000","last_peered":"2024-09-12T19:23:29.312490+0000","last_clean":"2024-09-12T19:23:29.312490+0000","last_became_active":"2024-09-12T17:29:56.755730+0000","last_became_peered":"2024-09-12T17:29:56.755730+0000","last_unstale":"2024-09-12T19:23:29.312490+0000","last_undegraded":"2024-09-12T19:23:29.312490+0000","last_fullsized":"2024-09-12T19:23:29.312490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:29.312160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:29.312160+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.312160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:47.556257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'327","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.149102+0000","last_change":"2024-09-12T19:23:35.148955+0000","last_active":"2024-09-12T19:23:35.149102+0000","last_peered":"2024-09-12T19:23:35.149102+0000","last_clean":"2024-09-12T19:23:35.149102+0000","last_became_active":"2024-09-12T17:29:58.829021+0000","last_became_peered":"2024-09-12T17:29:58.829021+0000","last_unstale":"2024-09-12T19:23:35.149102+0000","last_undegraded":"2024-09-12T19:23:35.149102+0000","last_fullsized":"2024-09-12T19:23:35.149102+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'327","last_scrub_stamp":"2024-09-12T19:23:35.148750+0000","last_deep_scrub":"267'327","last_deep_scrub_stamp":"2024-09-12T19:23:35.148750+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.148750+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:02:26.287034+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49018,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":1196,"num_write":438,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'814","reported_seq":3032,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:45.093076+0000","last_change":"2024-09-12T19:23:45.093076+0000","last_active":"2024-09-12T19:23:45.093076+0000","last_peered":"2024-09-12T19:23:45.093076+0000","last_clean":"2024-09-12T19:23:45.093076+0000","last_became_active":"2024-09-12T17:30:00.793067+0000","last_became_peered":"2024-09-12T17:30:00.793067+0000","last_unstale":"2024-09-12T19:23:45.093076+0000","last_undegraded":"2024-09-12T19:23:45.093076+0000","last_fullsized":"2024-09-12T19:23:45.093076+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'814","last_scrub_stamp":"2024-09-12T19:23:45.092843+0000","last_deep_scrub":"267'814","last_deep_scrub_stamp":"2024-09-12T19:23:45.092843+0000","last_clean_scrub_stamp":"2024-09-12T19:23:45.092843+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:39.919209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'526","reported_seq":2074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.298840+0000","last_change":"2024-09-12T19:23:21.298840+0000","last_active":"2024-09-12T19:23:21.298840+0000","last_peered":"2024-09-12T19:23:21.298840+0000","last_clean":"2024-09-12T19:23:21.298840+0000","last_became_active":"2024-09-12T17:29:54.766092+0000","last_became_peered":"2024-09-12T17:29:54.766092+0000","last_unstale":"2024-09-12T19:23:21.298840+0000","last_undegraded":"2024-09-12T19:23:21.298840+0000","last_fullsized":"2024-09-12T19:23:21.298840+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'526","last_scrub_stamp":"2024-09-12T19:23:21.298622+0000","last_deep_scrub":"267'526","last_deep_scrub_stamp":"2024-09-12T19:23:21.298622+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.298622+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:56.252493+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2636,"num_read_kb":2418,"num_write":649,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'353","reported_seq":1047,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.059198+0000","last_change":"2024-09-12T19:23:15.059198+0000","last_active":"2024-09-12T19:23:15.059198+0000","last_peered":"2024-09-12T19:23:15.059198+0000","last_clean":"2024-09-12T19:23:15.059198+0000","last_became_active":"2024-09-12T17:29:52.757326+0000","last_became_peered":"2024-09-12T17:29:52.757326+0000","last_unstale":"2024-09-12T19:23:15.059198+0000","last_undegraded":"2024-09-12T19:23:15.059198+0000","last_fullsized":"2024-09-12T19:23:15.059198+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'353","last_scrub_stamp":"2024-09-12T19:23:15.058913+0000","last_deep_scrub":"267'353","last_deep_scrub_stamp":"2024-09-12T19:23:15.058913+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.058913+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:10.734098+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730145,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":565,"num_read_kb":12520,"num_write":1100,"num_write_kb":32977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.109066+0000","last_change":"2024-09-12T19:23:33.109066+0000","last_active":"2024-09-12T19:23:33.109066+0000","last_peered":"2024-09-12T19:23:33.109066+0000","last_clean":"2024-09-12T19:23:33.109066+0000","last_became_active":"2024-09-12T17:29:56.768267+0000","last_became_peered":"2024-09-12T17:29:56.768267+0000","last_unstale":"2024-09-12T19:23:33.109066+0000","last_undegraded":"2024-09-12T19:23:33.109066+0000","last_fullsized":"2024-09-12T19:23:33.109066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:33.108858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:33.108858+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.108858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:40.490165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'461","reported_seq":1161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.296203+0000","last_change":"2024-09-12T19:23:34.296203+0000","last_active":"2024-09-12T19:23:34.296203+0000","last_peered":"2024-09-12T19:23:34.296203+0000","last_clean":"2024-09-12T19:23:34.296203+0000","last_became_active":"2024-09-12T17:29:58.833291+0000","last_became_peered":"2024-09-12T17:29:58.833291+0000","last_unstale":"2024-09-12T19:23:34.296203+0000","last_undegraded":"2024-09-12T19:23:34.296203+0000","last_fullsized":"2024-09-12T19:23:34.296203+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'461","last_scrub_stamp":"2024-09-12T19:23:34.295959+0000","last_deep_scrub":"267'461","last_deep_scrub_stamp":"2024-09-12T19:23:34.295959+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.295959+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:24.206523+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60505,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":721,"num_read_kb":1312,"num_write":540,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.640178+0000","last_change":"2024-09-12T19:23:29.640178+0000","last_active":"2024-09-12T19:23:29.640178+0000","last_peered":"2024-09-12T19:23:29.640178+0000","last_clean":"2024-09-12T19:23:29.640178+0000","last_became_active":"2024-09-12T17:30:00.809914+0000","last_became_peered":"2024-09-12T17:30:00.809914+0000","last_unstale":"2024-09-12T19:23:29.640178+0000","last_undegraded":"2024-09-12T19:23:29.640178+0000","last_fullsized":"2024-09-12T19:23:29.640178+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:29.639987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:29.639987+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.639987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:49:34.064980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'551","reported_seq":1415,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.282843+0000","last_change":"2024-09-12T19:23:39.282843+0000","last_active":"2024-09-12T19:23:39.282843+0000","last_peered":"2024-09-12T19:23:39.282843+0000","last_clean":"2024-09-12T19:23:39.282843+0000","last_became_active":"2024-09-12T17:30:02.797046+0000","last_became_peered":"2024-09-12T17:30:02.797046+0000","last_unstale":"2024-09-12T19:23:39.282843+0000","last_undegraded":"2024-09-12T19:23:39.282843+0000","last_fullsized":"2024-09-12T19:23:39.282843+0000","mapping_epoch":36,"log_start":"267'500","ondisk_log_start":"267'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'551","last_scrub_stamp":"2024-09-12T19:23:39.282658+0000","last_deep_scrub":"267'551","last_deep_scrub_stamp":"2024-09-12T19:23:39.282658+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.282658+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:04.085433+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1413,"num_read_kb":1390,"num_write":1179,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'484","reported_seq":2168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.213752+0000","last_change":"2024-09-12T19:23:14.213752+0000","last_active":"2024-09-12T19:23:14.213752+0000","last_peered":"2024-09-12T19:23:14.213752+0000","last_clean":"2024-09-12T19:23:14.213752+0000","last_became_active":"2024-09-12T17:29:54.754517+0000","last_became_peered":"2024-09-12T17:29:54.754517+0000","last_unstale":"2024-09-12T19:23:14.213752+0000","last_undegraded":"2024-09-12T19:23:14.213752+0000","last_fullsized":"2024-09-12T19:23:14.213752+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'484","last_scrub_stamp":"2024-09-12T19:23:14.213543+0000","last_deep_scrub":"267'484","last_deep_scrub_stamp":"2024-09-12T19:23:14.213543+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.213543+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:45.018822+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2565,"num_read_kb":2417,"num_write":558,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'317","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.054850+0000","last_change":"2024-09-12T19:23:16.054850+0000","last_active":"2024-09-12T19:23:16.054850+0000","last_peered":"2024-09-12T19:23:16.054850+0000","last_clean":"2024-09-12T19:23:16.054850+0000","last_became_active":"2024-09-12T17:29:52.760711+0000","last_became_peered":"2024-09-12T17:29:52.760711+0000","last_unstale":"2024-09-12T19:23:16.054850+0000","last_undegraded":"2024-09-12T19:23:16.054850+0000","last_fullsized":"2024-09-12T19:23:16.054850+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-12T19:23:16.054566+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-12T19:23:16.054566+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.054566+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:14.486166+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2759519,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":447,"num_read_kb":40999,"num_write":1044,"num_write_kb":42394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.974544+0000","last_change":"2024-09-12T19:23:18.974544+0000","last_active":"2024-09-12T19:23:18.974544+0000","last_peered":"2024-09-12T19:23:18.974544+0000","last_clean":"2024-09-12T19:23:18.974544+0000","last_became_active":"2024-09-12T17:29:56.757805+0000","last_became_peered":"2024-09-12T17:29:56.757805+0000","last_unstale":"2024-09-12T19:23:18.974544+0000","last_undegraded":"2024-09-12T19:23:18.974544+0000","last_fullsized":"2024-09-12T19:23:18.974544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:18.974369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:18.974369+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.974369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:12.714029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'308","reported_seq":939,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.093350+0000","last_change":"2024-09-12T19:23:34.093350+0000","last_active":"2024-09-12T19:23:34.093350+0000","last_peered":"2024-09-12T19:23:34.093350+0000","last_clean":"2024-09-12T19:23:34.093350+0000","last_became_active":"2024-09-12T17:29:58.773959+0000","last_became_peered":"2024-09-12T17:29:58.773959+0000","last_unstale":"2024-09-12T19:23:34.093350+0000","last_undegraded":"2024-09-12T19:23:34.093350+0000","last_fullsized":"2024-09-12T19:23:34.093350+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'308","last_scrub_stamp":"2024-09-12T19:23:34.093156+0000","last_deep_scrub":"267'308","last_deep_scrub_stamp":"2024-09-12T19:23:34.093156+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.093156+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:21.646685+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47390,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":1092,"num_write":400,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.108233+0000","last_change":"2024-09-12T19:23:44.108233+0000","last_active":"2024-09-12T19:23:44.108233+0000","last_peered":"2024-09-12T19:23:44.108233+0000","last_clean":"2024-09-12T19:23:44.108233+0000","last_became_active":"2024-09-12T17:30:00.792138+0000","last_became_peered":"2024-09-12T17:30:00.792138+0000","last_unstale":"2024-09-12T19:23:44.108233+0000","last_undegraded":"2024-09-12T19:23:44.108233+0000","last_fullsized":"2024-09-12T19:23:44.108233+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:44.108013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:44.108013+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.108013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:42.196467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2478","reported_seq":4401,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.288441+0000","last_change":"2024-09-12T19:23:30.288441+0000","last_active":"2024-09-12T19:23:30.288441+0000","last_peered":"2024-09-12T19:23:30.288441+0000","last_clean":"2024-09-12T19:23:30.288441+0000","last_became_active":"2024-09-12T17:30:02.800860+0000","last_became_peered":"2024-09-12T17:30:02.800860+0000","last_unstale":"2024-09-12T19:23:30.288441+0000","last_undegraded":"2024-09-12T19:23:30.288441+0000","last_fullsized":"2024-09-12T19:23:30.288441+0000","mapping_epoch":36,"log_start":"267'2400","ondisk_log_start":"267'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2478","last_scrub_stamp":"2024-09-12T19:23:30.288237+0000","last_deep_scrub":"267'2478","last_deep_scrub_stamp":"2024-09-12T19:23:30.288237+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.288237+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":2400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:18.820569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6373,"num_read_kb":6312,"num_write":5027,"num_write_kb":1835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'434","reported_seq":2080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.214501+0000","last_change":"2024-09-12T19:23:17.214501+0000","last_active":"2024-09-12T19:23:17.214501+0000","last_peered":"2024-09-12T19:23:17.214501+0000","last_clean":"2024-09-12T19:23:17.214501+0000","last_became_active":"2024-09-12T17:29:54.769541+0000","last_became_peered":"2024-09-12T17:29:54.769541+0000","last_unstale":"2024-09-12T19:23:17.214501+0000","last_undegraded":"2024-09-12T19:23:17.214501+0000","last_fullsized":"2024-09-12T19:23:17.214501+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'434","last_scrub_stamp":"2024-09-12T19:23:17.214333+0000","last_deep_scrub":"267'434","last_deep_scrub_stamp":"2024-09-12T19:23:17.214333+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.214333+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:25.717262+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2445,"num_read_kb":2340,"num_write":496,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'333","reported_seq":1016,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.024545+0000","last_change":"2024-09-12T19:23:09.024545+0000","last_active":"2024-09-12T19:23:09.024545+0000","last_peered":"2024-09-12T19:23:09.024545+0000","last_clean":"2024-09-12T19:23:09.024545+0000","last_became_active":"2024-09-12T17:30:21.793950+0000","last_became_peered":"2024-09-12T17:30:21.793950+0000","last_unstale":"2024-09-12T19:23:09.024545+0000","last_undegraded":"2024-09-12T19:23:09.024545+0000","last_fullsized":"2024-09-12T19:23:09.024545+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-09-12T19:23:09.024422+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-09-12T19:23:09.024422+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.024422+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:49.775219+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12448261,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":526,"num_read_kb":65282,"num_write":1071,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,6],"acting":[2,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.001307+0000","last_change":"2024-09-12T19:23:20.001307+0000","last_active":"2024-09-12T19:23:20.001307+0000","last_peered":"2024-09-12T19:23:20.001307+0000","last_clean":"2024-09-12T19:23:20.001307+0000","last_became_active":"2024-09-12T17:29:56.770222+0000","last_became_peered":"2024-09-12T17:29:56.770222+0000","last_unstale":"2024-09-12T19:23:20.001307+0000","last_undegraded":"2024-09-12T19:23:20.001307+0000","last_fullsized":"2024-09-12T19:23:20.001307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:20.001094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:20.001094+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.001094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:34.611973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'401","reported_seq":1060,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.149777+0000","last_change":"2024-09-12T19:23:32.149777+0000","last_active":"2024-09-12T19:23:32.149777+0000","last_peered":"2024-09-12T19:23:32.149777+0000","last_clean":"2024-09-12T19:23:32.149777+0000","last_became_active":"2024-09-12T17:29:58.754613+0000","last_became_peered":"2024-09-12T17:29:58.754613+0000","last_unstale":"2024-09-12T19:23:32.149777+0000","last_undegraded":"2024-09-12T19:23:32.149777+0000","last_fullsized":"2024-09-12T19:23:32.149777+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'401","last_scrub_stamp":"2024-09-12T19:23:32.149559+0000","last_deep_scrub":"267'401","last_deep_scrub_stamp":"2024-09-12T19:23:32.149559+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.149559+0000","objects_scrubbed":7,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:31:40.743834+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50732,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":653,"num_read_kb":1328,"num_write":512,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'797","reported_seq":3216,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.757194+0000","last_change":"2024-09-12T19:23:32.757194+0000","last_active":"2024-09-12T19:23:32.757194+0000","last_peered":"2024-09-12T19:23:32.757194+0000","last_clean":"2024-09-12T19:23:32.757194+0000","last_became_active":"2024-09-12T17:30:00.805428+0000","last_became_peered":"2024-09-12T17:30:00.805428+0000","last_unstale":"2024-09-12T19:23:32.757194+0000","last_undegraded":"2024-09-12T19:23:32.757194+0000","last_fullsized":"2024-09-12T19:23:32.757194+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'797","last_scrub_stamp":"2024-09-12T19:23:32.757019+0000","last_deep_scrub":"267'797","last_deep_scrub_stamp":"2024-09-12T19:23:32.757019+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.757019+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:36:55.355736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'113","reported_seq":668,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.753686+0000","last_change":"2024-09-12T19:23:39.753686+0000","last_active":"2024-09-12T19:23:39.753686+0000","last_peered":"2024-09-12T19:23:39.753686+0000","last_clean":"2024-09-12T19:23:39.753686+0000","last_became_active":"2024-09-12T17:30:02.816983+0000","last_became_peered":"2024-09-12T17:30:02.816983+0000","last_unstale":"2024-09-12T19:23:39.753686+0000","last_undegraded":"2024-09-12T19:23:39.753686+0000","last_fullsized":"2024-09-12T19:23:39.753686+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'113","last_scrub_stamp":"2024-09-12T19:23:39.753494+0000","last_deep_scrub":"267'113","last_deep_scrub_stamp":"2024-09-12T19:23:39.753494+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.753494+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:47.021198+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":220,"num_read_kb":194,"num_write":254,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'875","reported_seq":2511,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.846463+0000","last_change":"2024-09-12T19:23:25.846463+0000","last_active":"2024-09-12T19:23:25.846463+0000","last_peered":"2024-09-12T19:23:25.846463+0000","last_clean":"2024-09-12T19:23:25.846463+0000","last_became_active":"2024-09-12T17:29:54.744926+0000","last_became_peered":"2024-09-12T17:29:54.744926+0000","last_unstale":"2024-09-12T19:23:25.846463+0000","last_undegraded":"2024-09-12T19:23:25.846463+0000","last_fullsized":"2024-09-12T19:23:25.846463+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'875","last_scrub_stamp":"2024-09-12T19:23:25.846277+0000","last_deep_scrub":"267'875","last_deep_scrub_stamp":"2024-09-12T19:23:25.846277+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.846277+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:32.763858+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4186,"num_read_kb":3781,"num_write":1194,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'377","reported_seq":1075,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.256060+0000","last_change":"2024-09-12T19:23:11.256060+0000","last_active":"2024-09-12T19:23:11.256060+0000","last_peered":"2024-09-12T19:23:11.256060+0000","last_clean":"2024-09-12T19:23:11.256060+0000","last_became_active":"2024-09-12T17:29:52.748439+0000","last_became_peered":"2024-09-12T17:29:52.748439+0000","last_unstale":"2024-09-12T19:23:11.256060+0000","last_undegraded":"2024-09-12T19:23:11.256060+0000","last_fullsized":"2024-09-12T19:23:11.256060+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'377","last_scrub_stamp":"2024-09-12T19:23:11.255752+0000","last_deep_scrub":"267'377","last_deep_scrub_stamp":"2024-09-12T19:23:11.255752+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.255752+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:44.862051+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992343,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":628,"num_read_kb":40400,"num_write":1240,"num_write_kb":24508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.008450+0000","last_change":"2024-09-12T19:23:21.008450+0000","last_active":"2024-09-12T19:23:21.008450+0000","last_peered":"2024-09-12T19:23:21.008450+0000","last_clean":"2024-09-12T19:23:21.008450+0000","last_became_active":"2024-09-12T17:29:56.742361+0000","last_became_peered":"2024-09-12T17:29:56.742361+0000","last_unstale":"2024-09-12T19:23:21.008450+0000","last_undegraded":"2024-09-12T19:23:21.008450+0000","last_fullsized":"2024-09-12T19:23:21.008450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:21.008185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:21.008185+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.008185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:29.516729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'518","reported_seq":1210,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.807529+0000","last_change":"2024-09-12T19:23:26.807529+0000","last_active":"2024-09-12T19:23:26.807529+0000","last_peered":"2024-09-12T19:23:26.807529+0000","last_clean":"2024-09-12T19:23:26.807529+0000","last_became_active":"2024-09-12T17:29:58.777576+0000","last_became_peered":"2024-09-12T17:29:58.777576+0000","last_unstale":"2024-09-12T19:23:26.807529+0000","last_undegraded":"2024-09-12T19:23:26.807529+0000","last_fullsized":"2024-09-12T19:23:26.807529+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'518","last_scrub_stamp":"2024-09-12T19:23:26.807330+0000","last_deep_scrub":"267'518","last_deep_scrub_stamp":"2024-09-12T19:23:26.807330+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.807330+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:56:29.286764+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94518,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":881,"num_read_kb":2010,"num_write":710,"num_write_kb":562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.933893+0000","last_change":"2024-09-12T19:23:28.933893+0000","last_active":"2024-09-12T19:23:28.933893+0000","last_peered":"2024-09-12T19:23:28.933893+0000","last_clean":"2024-09-12T19:23:28.933893+0000","last_became_active":"2024-09-12T17:30:00.780193+0000","last_became_peered":"2024-09-12T17:30:00.780193+0000","last_unstale":"2024-09-12T19:23:28.933893+0000","last_undegraded":"2024-09-12T19:23:28.933893+0000","last_fullsized":"2024-09-12T19:23:28.933893+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:28.933682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:28.933682+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.933682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:18:40.568216+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'168","reported_seq":728,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.655622+0000","last_change":"2024-09-12T19:23:35.655622+0000","last_active":"2024-09-12T19:23:35.655622+0000","last_peered":"2024-09-12T19:23:35.655622+0000","last_clean":"2024-09-12T19:23:35.655622+0000","last_became_active":"2024-09-12T17:30:02.809357+0000","last_became_peered":"2024-09-12T17:30:02.809357+0000","last_unstale":"2024-09-12T19:23:35.655622+0000","last_undegraded":"2024-09-12T19:23:35.655622+0000","last_fullsized":"2024-09-12T19:23:35.655622+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'168","last_scrub_stamp":"2024-09-12T19:23:35.655394+0000","last_deep_scrub":"267'168","last_deep_scrub_stamp":"2024-09-12T19:23:35.655394+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.655394+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:49.193802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":287,"num_read_kb":265,"num_write":391,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'1307","reported_seq":2993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.254001+0000","last_change":"2024-09-12T19:23:15.254001+0000","last_active":"2024-09-12T19:23:15.254001+0000","last_peered":"2024-09-12T19:23:15.254001+0000","last_clean":"2024-09-12T19:23:15.254001+0000","last_became_active":"2024-09-12T17:29:54.758550+0000","last_became_peered":"2024-09-12T17:29:54.758550+0000","last_unstale":"2024-09-12T19:23:15.254001+0000","last_undegraded":"2024-09-12T19:23:15.254001+0000","last_fullsized":"2024-09-12T19:23:15.254001+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1307","last_scrub_stamp":"2024-09-12T19:23:15.253774+0000","last_deep_scrub":"267'1307","last_deep_scrub_stamp":"2024-09-12T19:23:15.253774+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.253774+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":1200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:02:53.604695+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6018,"num_read_kb":5333,"num_write":1857,"num_write_kb":791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'317","reported_seq":984,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.187666+0000","last_change":"2024-09-12T19:23:10.187666+0000","last_active":"2024-09-12T19:23:10.187666+0000","last_peered":"2024-09-12T19:23:10.187666+0000","last_clean":"2024-09-12T19:23:10.187666+0000","last_became_active":"2024-09-12T17:29:52.765603+0000","last_became_peered":"2024-09-12T17:29:52.765603+0000","last_unstale":"2024-09-12T19:23:10.187666+0000","last_undegraded":"2024-09-12T19:23:10.187666+0000","last_fullsized":"2024-09-12T19:23:10.187666+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-12T19:23:10.187423+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-12T19:23:10.187423+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.187423+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:25.588115+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1911305,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":437,"num_read_kb":36052,"num_write":1059,"num_write_kb":37263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.020465+0000","last_change":"2024-09-12T19:23:23.020465+0000","last_active":"2024-09-12T19:23:23.020465+0000","last_peered":"2024-09-12T19:23:23.020465+0000","last_clean":"2024-09-12T19:23:23.020465+0000","last_became_active":"2024-09-12T17:29:56.772580+0000","last_became_peered":"2024-09-12T17:29:56.772580+0000","last_unstale":"2024-09-12T19:23:23.020465+0000","last_undegraded":"2024-09-12T19:23:23.020465+0000","last_fullsized":"2024-09-12T19:23:23.020465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:23.020268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:23.020268+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.020268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:35.030994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'338","reported_seq":983,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.088674+0000","last_change":"2024-09-12T19:23:34.088674+0000","last_active":"2024-09-12T19:23:34.088674+0000","last_peered":"2024-09-12T19:23:34.088674+0000","last_clean":"2024-09-12T19:23:34.088674+0000","last_became_active":"2024-09-12T17:29:58.773869+0000","last_became_peered":"2024-09-12T17:29:58.773869+0000","last_unstale":"2024-09-12T19:23:34.088674+0000","last_undegraded":"2024-09-12T19:23:34.088674+0000","last_fullsized":"2024-09-12T19:23:34.088674+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'338","last_scrub_stamp":"2024-09-12T19:23:34.088466+0000","last_deep_scrub":"267'338","last_deep_scrub_stamp":"2024-09-12T19:23:34.088466+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.088466+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:47.300557+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47005,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":1116,"num_write":486,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.794503+0000","last_change":"2024-09-12T19:23:33.794503+0000","last_active":"2024-09-12T19:23:33.794503+0000","last_peered":"2024-09-12T19:23:33.794503+0000","last_clean":"2024-09-12T19:23:33.794503+0000","last_became_active":"2024-09-12T17:30:00.778642+0000","last_became_peered":"2024-09-12T17:30:00.778642+0000","last_unstale":"2024-09-12T19:23:33.794503+0000","last_undegraded":"2024-09-12T19:23:33.794503+0000","last_fullsized":"2024-09-12T19:23:33.794503+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:33.794328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:33.794328+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.794328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:23:41.179489+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'110","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:47.057004+0000","last_change":"2024-09-12T19:23:47.056825+0000","last_active":"2024-09-12T19:23:47.057004+0000","last_peered":"2024-09-12T19:23:47.057004+0000","last_clean":"2024-09-12T19:23:47.057004+0000","last_became_active":"2024-09-12T17:30:02.788612+0000","last_became_peered":"2024-09-12T17:30:02.788612+0000","last_unstale":"2024-09-12T19:23:47.057004+0000","last_undegraded":"2024-09-12T19:23:47.057004+0000","last_fullsized":"2024-09-12T19:23:47.057004+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'110","last_scrub_stamp":"2024-09-12T19:23:47.056643+0000","last_deep_scrub":"267'110","last_deep_scrub_stamp":"2024-09-12T19:23:47.056643+0000","last_clean_scrub_stamp":"2024-09-12T19:23:47.056643+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:04:16.784374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":252,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'363","reported_seq":1826,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.266919+0000","last_change":"2024-09-12T19:23:16.266919+0000","last_active":"2024-09-12T19:23:16.266919+0000","last_peered":"2024-09-12T19:23:16.266919+0000","last_clean":"2024-09-12T19:23:16.266919+0000","last_became_active":"2024-09-12T17:29:54.758311+0000","last_became_peered":"2024-09-12T17:29:54.758311+0000","last_unstale":"2024-09-12T19:23:16.266919+0000","last_undegraded":"2024-09-12T19:23:16.266919+0000","last_fullsized":"2024-09-12T19:23:16.266919+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'363","last_scrub_stamp":"2024-09-12T19:23:16.266739+0000","last_deep_scrub":"267'363","last_deep_scrub_stamp":"2024-09-12T19:23:16.266739+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.266739+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:18.541808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1918,"num_read_kb":1833,"num_write":390,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'336","reported_seq":1020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.171645+0000","last_change":"2024-09-12T19:23:10.171645+0000","last_active":"2024-09-12T19:23:10.171645+0000","last_peered":"2024-09-12T19:23:10.171645+0000","last_clean":"2024-09-12T19:23:10.171645+0000","last_became_active":"2024-09-12T17:29:52.716965+0000","last_became_peered":"2024-09-12T17:29:52.716965+0000","last_unstale":"2024-09-12T19:23:10.171645+0000","last_undegraded":"2024-09-12T19:23:10.171645+0000","last_fullsized":"2024-09-12T19:23:10.171645+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-12T19:23:10.171401+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-12T19:23:10.171401+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.171401+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:15.438323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262277,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":1122,"num_write":1102,"num_write_kb":14973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.669689+0000","last_change":"2024-09-12T19:23:25.669689+0000","last_active":"2024-09-12T19:23:25.669689+0000","last_peered":"2024-09-12T19:23:25.669689+0000","last_clean":"2024-09-12T19:23:25.669689+0000","last_became_active":"2024-09-12T17:29:56.765057+0000","last_became_peered":"2024-09-12T17:29:56.765057+0000","last_unstale":"2024-09-12T19:23:25.669689+0000","last_undegraded":"2024-09-12T19:23:25.669689+0000","last_fullsized":"2024-09-12T19:23:25.669689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:25.669504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:25.669504+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.669504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:14.220999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'375","reported_seq":1046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.977622+0000","last_change":"2024-09-12T19:23:24.977622+0000","last_active":"2024-09-12T19:23:24.977622+0000","last_peered":"2024-09-12T19:23:24.977622+0000","last_clean":"2024-09-12T19:23:24.977622+0000","last_became_active":"2024-09-12T17:29:58.771991+0000","last_became_peered":"2024-09-12T17:29:58.771991+0000","last_unstale":"2024-09-12T19:23:24.977622+0000","last_undegraded":"2024-09-12T19:23:24.977622+0000","last_fullsized":"2024-09-12T19:23:24.977622+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'375","last_scrub_stamp":"2024-09-12T19:23:24.977409+0000","last_deep_scrub":"267'375","last_deep_scrub_stamp":"2024-09-12T19:23:24.977409+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.977409+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:34.466039+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43575,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":600,"num_read_kb":1164,"num_write":460,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'753","reported_seq":5264,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.923677+0000","last_change":"2024-09-12T19:23:25.923677+0000","last_active":"2024-09-12T19:23:25.923677+0000","last_peered":"2024-09-12T19:23:25.923677+0000","last_clean":"2024-09-12T19:23:25.923677+0000","last_became_active":"2024-09-12T17:30:00.802950+0000","last_became_peered":"2024-09-12T17:30:00.802950+0000","last_unstale":"2024-09-12T19:23:25.923677+0000","last_undegraded":"2024-09-12T19:23:25.923677+0000","last_fullsized":"2024-09-12T19:23:25.923677+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'753","last_scrub_stamp":"2024-09-12T19:23:25.923495+0000","last_deep_scrub":"267'753","last_deep_scrub_stamp":"2024-09-12T19:23:25.923495+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.923495+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":701,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:31.579440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'114","reported_seq":648,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.672695+0000","last_change":"2024-09-12T19:23:32.672695+0000","last_active":"2024-09-12T19:23:32.672695+0000","last_peered":"2024-09-12T19:23:32.672695+0000","last_clean":"2024-09-12T19:23:32.672695+0000","last_became_active":"2024-09-12T17:30:02.806621+0000","last_became_peered":"2024-09-12T17:30:02.806621+0000","last_unstale":"2024-09-12T19:23:32.672695+0000","last_undegraded":"2024-09-12T19:23:32.672695+0000","last_fullsized":"2024-09-12T19:23:32.672695+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'114","last_scrub_stamp":"2024-09-12T19:23:32.672521+0000","last_deep_scrub":"267'114","last_deep_scrub_stamp":"2024-09-12T19:23:32.672521+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.672521+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:12.425992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":276,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'779","reported_seq":2461,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.251063+0000","last_change":"2024-09-12T19:23:17.251063+0000","last_active":"2024-09-12T19:23:17.251063+0000","last_peered":"2024-09-12T19:23:17.251063+0000","last_clean":"2024-09-12T19:23:17.251063+0000","last_became_active":"2024-09-12T17:29:54.763348+0000","last_became_peered":"2024-09-12T17:29:54.763348+0000","last_unstale":"2024-09-12T19:23:17.251063+0000","last_undegraded":"2024-09-12T19:23:17.251063+0000","last_fullsized":"2024-09-12T19:23:17.251063+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'779","last_scrub_stamp":"2024-09-12T19:23:17.250871+0000","last_deep_scrub":"267'779","last_deep_scrub_stamp":"2024-09-12T19:23:17.250871+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.250871+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:17.003332+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4009,"num_read_kb":3654,"num_write":1024,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3240,"num_omap_keys":13,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'307","reported_seq":984,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.186027+0000","last_change":"2024-09-12T19:23:09.186027+0000","last_active":"2024-09-12T19:23:09.186027+0000","last_peered":"2024-09-12T19:23:09.186027+0000","last_clean":"2024-09-12T19:23:09.186027+0000","last_became_active":"2024-09-12T17:29:52.744356+0000","last_became_peered":"2024-09-12T17:29:52.744356+0000","last_unstale":"2024-09-12T19:23:09.186027+0000","last_undegraded":"2024-09-12T19:23:09.186027+0000","last_fullsized":"2024-09-12T19:23:09.186027+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'307","last_scrub_stamp":"2024-09-12T19:23:09.185810+0000","last_deep_scrub":"267'307","last_deep_scrub_stamp":"2024-09-12T19:23:09.185810+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.185810+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:50.544329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":48689,"num_write":1045,"num_write_kb":32373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"267'4","reported_seq":1484,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.275059+0000","last_change":"2024-09-12T19:23:31.275059+0000","last_active":"2024-09-12T19:23:31.275059+0000","last_peered":"2024-09-12T19:23:31.275059+0000","last_clean":"2024-09-12T19:23:31.275059+0000","last_became_active":"2024-09-12T17:29:56.750915+0000","last_became_peered":"2024-09-12T17:29:56.750915+0000","last_unstale":"2024-09-12T19:23:31.275059+0000","last_undegraded":"2024-09-12T19:23:31.275059+0000","last_fullsized":"2024-09-12T19:23:31.275059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T19:23:31.274847+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T19:23:31.274847+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.274847+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:25.056431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'151","reported_seq":744,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.041887+0000","last_change":"2024-09-12T19:23:37.041887+0000","last_active":"2024-09-12T19:23:37.041887+0000","last_peered":"2024-09-12T19:23:37.041887+0000","last_clean":"2024-09-12T19:23:37.041887+0000","last_became_active":"2024-09-12T17:29:58.831628+0000","last_became_peered":"2024-09-12T17:29:58.831628+0000","last_unstale":"2024-09-12T19:23:37.041887+0000","last_undegraded":"2024-09-12T19:23:37.041887+0000","last_fullsized":"2024-09-12T19:23:37.041887+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'151","last_scrub_stamp":"2024-09-12T19:23:37.041661+0000","last_deep_scrub":"267'151","last_deep_scrub_stamp":"2024-09-12T19:23:37.041661+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.041661+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:39.506865+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'773","reported_seq":3254,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.215663+0000","last_change":"2024-09-12T19:23:26.215663+0000","last_active":"2024-09-12T19:23:26.215663+0000","last_peered":"2024-09-12T19:23:26.215663+0000","last_clean":"2024-09-12T19:23:26.215663+0000","last_became_active":"2024-09-12T17:30:00.806681+0000","last_became_peered":"2024-09-12T17:30:00.806681+0000","last_unstale":"2024-09-12T19:23:26.215663+0000","last_undegraded":"2024-09-12T19:23:26.215663+0000","last_fullsized":"2024-09-12T19:23:26.215663+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'773","last_scrub_stamp":"2024-09-12T19:23:26.215444+0000","last_deep_scrub":"267'773","last_deep_scrub_stamp":"2024-09-12T19:23:26.215444+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.215444+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":701,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:50.424909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'120","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.056467+0000","last_change":"2024-09-12T19:23:43.056467+0000","last_active":"2024-09-12T19:23:43.056467+0000","last_peered":"2024-09-12T19:23:43.056467+0000","last_clean":"2024-09-12T19:23:43.056467+0000","last_became_active":"2024-09-12T17:30:02.805954+0000","last_became_peered":"2024-09-12T17:30:02.805954+0000","last_unstale":"2024-09-12T19:23:43.056467+0000","last_undegraded":"2024-09-12T19:23:43.056467+0000","last_fullsized":"2024-09-12T19:23:43.056467+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'120","last_scrub_stamp":"2024-09-12T19:23:43.056284+0000","last_deep_scrub":"267'120","last_deep_scrub_stamp":"2024-09-12T19:23:43.056284+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.056284+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:11.535350+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":135,"num_write":268,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'521","reported_seq":2066,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.716900+0000","last_change":"2024-09-12T19:23:18.716900+0000","last_active":"2024-09-12T19:23:18.716900+0000","last_peered":"2024-09-12T19:23:18.716900+0000","last_clean":"2024-09-12T19:23:18.716900+0000","last_became_active":"2024-09-12T17:29:54.755550+0000","last_became_peered":"2024-09-12T17:29:54.755550+0000","last_unstale":"2024-09-12T19:23:18.716900+0000","last_undegraded":"2024-09-12T19:23:18.716900+0000","last_fullsized":"2024-09-12T19:23:18.716900+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'521","last_scrub_stamp":"2024-09-12T19:23:18.716720+0000","last_deep_scrub":"267'521","last_deep_scrub_stamp":"2024-09-12T19:23:18.716720+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.716720+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:37.752618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2775,"num_read_kb":2556,"num_write":676,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'376","reported_seq":1080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.210414+0000","last_change":"2024-09-12T19:23:09.210414+0000","last_active":"2024-09-12T19:23:09.210414+0000","last_peered":"2024-09-12T19:23:09.210414+0000","last_clean":"2024-09-12T19:23:09.210414+0000","last_became_active":"2024-09-12T17:30:21.696077+0000","last_became_peered":"2024-09-12T17:30:21.696077+0000","last_unstale":"2024-09-12T19:23:09.210414+0000","last_undegraded":"2024-09-12T19:23:09.210414+0000","last_fullsized":"2024-09-12T19:23:09.210414+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'376","last_scrub_stamp":"2024-09-12T19:23:09.210184+0000","last_deep_scrub":"267'376","last_deep_scrub_stamp":"2024-09-12T19:23:09.210184+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.210184+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:47.241745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":12866,"num_write":1197,"num_write_kb":34720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.184206+0000","last_change":"2024-09-12T19:23:30.184206+0000","last_active":"2024-09-12T19:23:30.184206+0000","last_peered":"2024-09-12T19:23:30.184206+0000","last_clean":"2024-09-12T19:23:30.184206+0000","last_became_active":"2024-09-12T17:29:56.757728+0000","last_became_peered":"2024-09-12T17:29:56.757728+0000","last_unstale":"2024-09-12T19:23:30.184206+0000","last_undegraded":"2024-09-12T19:23:30.184206+0000","last_fullsized":"2024-09-12T19:23:30.184206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:30.184021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:30.184021+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.184021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:39.958678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'425","reported_seq":1111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.253848+0000","last_change":"2024-09-12T19:23:35.253848+0000","last_active":"2024-09-12T19:23:35.253848+0000","last_peered":"2024-09-12T19:23:35.253848+0000","last_clean":"2024-09-12T19:23:35.253848+0000","last_became_active":"2024-09-12T17:29:58.776033+0000","last_became_peered":"2024-09-12T17:29:58.776033+0000","last_unstale":"2024-09-12T19:23:35.253848+0000","last_undegraded":"2024-09-12T19:23:35.253848+0000","last_fullsized":"2024-09-12T19:23:35.253848+0000","mapping_epoch":32,"log_start":"267'400","ondisk_log_start":"267'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'425","last_scrub_stamp":"2024-09-12T19:23:35.253485+0000","last_deep_scrub":"267'425","last_deep_scrub_stamp":"2024-09-12T19:23:35.253485+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.253485+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:26.115780+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47722,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":665,"num_read_kb":1193,"num_write":496,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.210780+0000","last_change":"2024-09-12T19:23:25.210780+0000","last_active":"2024-09-12T19:23:25.210780+0000","last_peered":"2024-09-12T19:23:25.210780+0000","last_clean":"2024-09-12T19:23:25.210780+0000","last_became_active":"2024-09-12T17:30:00.792687+0000","last_became_peered":"2024-09-12T17:30:00.792687+0000","last_unstale":"2024-09-12T19:23:25.210780+0000","last_undegraded":"2024-09-12T19:23:25.210780+0000","last_fullsized":"2024-09-12T19:23:25.210780+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:25.210462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:25.210462+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.210462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:31.054537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'167","reported_seq":706,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.651594+0000","last_change":"2024-09-12T19:23:33.651594+0000","last_active":"2024-09-12T19:23:33.651594+0000","last_peered":"2024-09-12T19:23:33.651594+0000","last_clean":"2024-09-12T19:23:33.651594+0000","last_became_active":"2024-09-12T17:30:02.809252+0000","last_became_peered":"2024-09-12T17:30:02.809252+0000","last_unstale":"2024-09-12T19:23:33.651594+0000","last_undegraded":"2024-09-12T19:23:33.651594+0000","last_fullsized":"2024-09-12T19:23:33.651594+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'167","last_scrub_stamp":"2024-09-12T19:23:33.651391+0000","last_deep_scrub":"267'167","last_deep_scrub_stamp":"2024-09-12T19:23:33.651391+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.651391+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:24.162865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":242,"num_read_kb":230,"num_write":407,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'457","reported_seq":1891,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.227830+0000","last_change":"2024-09-12T19:23:16.227830+0000","last_active":"2024-09-12T19:23:16.227830+0000","last_peered":"2024-09-12T19:23:16.227830+0000","last_clean":"2024-09-12T19:23:16.227830+0000","last_became_active":"2024-09-12T17:29:54.771538+0000","last_became_peered":"2024-09-12T17:29:54.771538+0000","last_unstale":"2024-09-12T19:23:16.227830+0000","last_undegraded":"2024-09-12T19:23:16.227830+0000","last_fullsized":"2024-09-12T19:23:16.227830+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'457","last_scrub_stamp":"2024-09-12T19:23:16.227601+0000","last_deep_scrub":"267'457","last_deep_scrub_stamp":"2024-09-12T19:23:16.227601+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.227601+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:42.639886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2249,"num_read_kb":2075,"num_write":554,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.928597+0000","last_change":"2024-09-12T19:23:09.928447+0000","last_active":"2024-09-12T19:23:09.928597+0000","last_peered":"2024-09-12T19:23:09.928597+0000","last_clean":"2024-09-12T19:23:09.928597+0000","last_became_active":"2024-09-12T17:29:30.601518+0000","last_became_peered":"2024-09-12T17:29:30.601518+0000","last_unstale":"2024-09-12T19:23:09.928597+0000","last_undegraded":"2024-09-12T19:23:09.928597+0000","last_fullsized":"2024-09-12T19:23:09.928597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-12T19:23:09.928248+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-12T19:23:09.928248+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.928248+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:35:35.888829+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":562,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.260029+0000","last_change":"2024-09-12T19:23:10.259855+0000","last_active":"2024-09-12T19:23:10.260029+0000","last_peered":"2024-09-12T19:23:10.260029+0000","last_clean":"2024-09-12T19:23:10.260029+0000","last_became_active":"2024-09-12T17:29:35.340342+0000","last_became_peered":"2024-09-12T17:29:35.340342+0000","last_unstale":"2024-09-12T19:23:10.260029+0000","last_undegraded":"2024-09-12T19:23:10.260029+0000","last_fullsized":"2024-09-12T19:23:10.260029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:10.259670+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:10.259670+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.259670+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:38.403829+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.00097602599999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'336","reported_seq":1027,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:08.205030+0000","last_change":"2024-09-12T19:23:08.204936+0000","last_active":"2024-09-12T19:23:08.205030+0000","last_peered":"2024-09-12T19:23:08.205030+0000","last_clean":"2024-09-12T19:23:08.205030+0000","last_became_active":"2024-09-12T17:29:52.765497+0000","last_became_peered":"2024-09-12T17:29:52.765497+0000","last_unstale":"2024-09-12T19:23:08.205030+0000","last_undegraded":"2024-09-12T19:23:08.205030+0000","last_fullsized":"2024-09-12T19:23:08.205030+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-12T19:23:08.204778+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-12T19:23:08.204778+0000","last_clean_scrub_stamp":"2024-09-12T19:23:08.204778+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:46.017915+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2167098,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":533,"num_read_kb":15769,"num_write":1043,"num_write_kb":23964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.078540+0000","last_change":"2024-09-12T19:23:26.078540+0000","last_active":"2024-09-12T19:23:26.078540+0000","last_peered":"2024-09-12T19:23:26.078540+0000","last_clean":"2024-09-12T19:23:26.078540+0000","last_became_active":"2024-09-12T17:29:56.749938+0000","last_became_peered":"2024-09-12T17:29:56.749938+0000","last_unstale":"2024-09-12T19:23:26.078540+0000","last_undegraded":"2024-09-12T19:23:26.078540+0000","last_fullsized":"2024-09-12T19:23:26.078540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:26.078358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:26.078358+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.078358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:45.805777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'804","reported_seq":1556,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.284313+0000","last_change":"2024-09-12T19:23:33.284313+0000","last_active":"2024-09-12T19:23:33.284313+0000","last_peered":"2024-09-12T19:23:33.284313+0000","last_clean":"2024-09-12T19:23:33.284313+0000","last_became_active":"2024-09-12T17:29:58.769277+0000","last_became_peered":"2024-09-12T17:29:58.769277+0000","last_unstale":"2024-09-12T19:23:33.284313+0000","last_undegraded":"2024-09-12T19:23:33.284313+0000","last_fullsized":"2024-09-12T19:23:33.284313+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'804","last_scrub_stamp":"2024-09-12T19:23:33.284129+0000","last_deep_scrub":"267'804","last_deep_scrub_stamp":"2024-09-12T19:23:33.284129+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.284129+0000","objects_scrubbed":6,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:19.887143+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159898,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1560,"num_read_kb":3538,"num_write":1488,"num_write_kb":1318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89338,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.804403+0000","last_change":"2024-09-12T19:23:35.804403+0000","last_active":"2024-09-12T19:23:35.804403+0000","last_peered":"2024-09-12T19:23:35.804403+0000","last_clean":"2024-09-12T19:23:35.804403+0000","last_became_active":"2024-09-12T17:30:00.799883+0000","last_became_peered":"2024-09-12T17:30:00.799883+0000","last_unstale":"2024-09-12T19:23:35.804403+0000","last_undegraded":"2024-09-12T19:23:35.804403+0000","last_fullsized":"2024-09-12T19:23:35.804403+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:35.804163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:35.804163+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.804163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:13.337181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'201","reported_seq":936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.358243+0000","last_change":"2024-09-12T19:23:32.358243+0000","last_active":"2024-09-12T19:23:32.358243+0000","last_peered":"2024-09-12T19:23:32.358243+0000","last_clean":"2024-09-12T19:23:32.358243+0000","last_became_active":"2024-09-12T17:30:02.799307+0000","last_became_peered":"2024-09-12T17:30:02.799307+0000","last_unstale":"2024-09-12T19:23:32.358243+0000","last_undegraded":"2024-09-12T19:23:32.358243+0000","last_fullsized":"2024-09-12T19:23:32.358243+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-12T19:23:32.358039+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-12T19:23:32.358039+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.358039+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:54.479773+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1000,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":469,"num_read_kb":467,"num_write":393,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'477","reported_seq":2046,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.883431+0000","last_change":"2024-09-12T19:23:13.883431+0000","last_active":"2024-09-12T19:23:13.883431+0000","last_peered":"2024-09-12T19:23:13.883431+0000","last_clean":"2024-09-12T19:23:13.883431+0000","last_became_active":"2024-09-12T17:29:54.758196+0000","last_became_peered":"2024-09-12T17:29:54.758196+0000","last_unstale":"2024-09-12T19:23:13.883431+0000","last_undegraded":"2024-09-12T19:23:13.883431+0000","last_fullsized":"2024-09-12T19:23:13.883431+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'477","last_scrub_stamp":"2024-09-12T19:23:13.883243+0000","last_deep_scrub":"267'477","last_deep_scrub_stamp":"2024-09-12T19:23:13.883243+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.883243+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:38.406363+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2778,"num_read_kb":2582,"num_write":658,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.930844+0000","last_change":"2024-09-12T19:23:10.930668+0000","last_active":"2024-09-12T19:23:10.930844+0000","last_peered":"2024-09-12T19:23:10.930844+0000","last_clean":"2024-09-12T19:23:10.930844+0000","last_became_active":"2024-09-12T17:29:35.336475+0000","last_became_peered":"2024-09-12T17:29:35.336475+0000","last_unstale":"2024-09-12T19:23:10.930844+0000","last_undegraded":"2024-09-12T19:23:10.930844+0000","last_fullsized":"2024-09-12T19:23:10.930844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:10.930485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:10.930485+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.930485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:54.374314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012883599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'346","reported_seq":1080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.866345+0000","last_change":"2024-09-12T19:23:09.866118+0000","last_active":"2024-09-12T19:23:09.866345+0000","last_peered":"2024-09-12T19:23:09.866345+0000","last_clean":"2024-09-12T19:23:09.866345+0000","last_became_active":"2024-09-12T17:29:52.766251+0000","last_became_peered":"2024-09-12T17:29:52.766251+0000","last_unstale":"2024-09-12T19:23:09.866345+0000","last_undegraded":"2024-09-12T19:23:09.866345+0000","last_fullsized":"2024-09-12T19:23:09.866345+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-09-12T19:23:09.865739+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-09-12T19:23:09.865739+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.865739+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:30.064297+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730134,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":595,"num_read_kb":84420,"num_write":1189,"num_write_kb":23129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.361544+0000","last_change":"2024-09-12T19:23:28.361544+0000","last_active":"2024-09-12T19:23:28.361544+0000","last_peered":"2024-09-12T19:23:28.361544+0000","last_clean":"2024-09-12T19:23:28.361544+0000","last_became_active":"2024-09-12T17:29:56.762451+0000","last_became_peered":"2024-09-12T17:29:56.762451+0000","last_unstale":"2024-09-12T19:23:28.361544+0000","last_undegraded":"2024-09-12T19:23:28.361544+0000","last_fullsized":"2024-09-12T19:23:28.361544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:28.361367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:28.361367+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.361367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:29.878422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1467","reported_seq":3824,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.687095+0000","last_change":"2024-09-12T19:23:28.687095+0000","last_active":"2024-09-12T19:23:28.687095+0000","last_peered":"2024-09-12T19:23:28.687095+0000","last_clean":"2024-09-12T19:23:28.687095+0000","last_became_active":"2024-09-12T17:29:58.771561+0000","last_became_peered":"2024-09-12T17:29:58.771561+0000","last_unstale":"2024-09-12T19:23:28.687095+0000","last_undegraded":"2024-09-12T19:23:28.687095+0000","last_fullsized":"2024-09-12T19:23:28.687095+0000","mapping_epoch":32,"log_start":"267'1400","ondisk_log_start":"267'1400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1467","last_scrub_stamp":"2024-09-12T19:23:28.686903+0000","last_deep_scrub":"267'1467","last_deep_scrub_stamp":"2024-09-12T19:23:28.686903+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.686903+0000","objects_scrubbed":11,"log_size":67,"log_dups_size":1400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:38.779259+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146977,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2279,"num_read_kb":4182,"num_write":1388,"num_write_kb":1130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.107674+0000","last_change":"2024-09-12T19:23:36.107674+0000","last_active":"2024-09-12T19:23:36.107674+0000","last_peered":"2024-09-12T19:23:36.107674+0000","last_clean":"2024-09-12T19:23:36.107674+0000","last_became_active":"2024-09-12T17:30:00.806030+0000","last_became_peered":"2024-09-12T17:30:00.806030+0000","last_unstale":"2024-09-12T19:23:36.107674+0000","last_undegraded":"2024-09-12T19:23:36.107674+0000","last_fullsized":"2024-09-12T19:23:36.107674+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:36.107355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:36.107355+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.107355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:31.839594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'219","reported_seq":771,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.671259+0000","last_change":"2024-09-12T19:23:36.671259+0000","last_active":"2024-09-12T19:23:36.671259+0000","last_peered":"2024-09-12T19:23:36.671259+0000","last_clean":"2024-09-12T19:23:36.671259+0000","last_became_active":"2024-09-12T17:30:02.809372+0000","last_became_peered":"2024-09-12T17:30:02.809372+0000","last_unstale":"2024-09-12T19:23:36.671259+0000","last_undegraded":"2024-09-12T19:23:36.671259+0000","last_fullsized":"2024-09-12T19:23:36.671259+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'219","last_scrub_stamp":"2024-09-12T19:23:36.671063+0000","last_deep_scrub":"267'219","last_deep_scrub_stamp":"2024-09-12T19:23:36.671063+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.671063+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:43.095477+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":353,"num_read_kb":353,"num_write":469,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'467","reported_seq":2059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.685511+0000","last_change":"2024-09-12T19:23:14.685511+0000","last_active":"2024-09-12T19:23:14.685511+0000","last_peered":"2024-09-12T19:23:14.685511+0000","last_clean":"2024-09-12T19:23:14.685511+0000","last_became_active":"2024-09-12T17:29:54.747270+0000","last_became_peered":"2024-09-12T17:29:54.747270+0000","last_unstale":"2024-09-12T19:23:14.685511+0000","last_undegraded":"2024-09-12T19:23:14.685511+0000","last_fullsized":"2024-09-12T19:23:14.685511+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'467","last_scrub_stamp":"2024-09-12T19:23:14.685322+0000","last_deep_scrub":"267'467","last_deep_scrub_stamp":"2024-09-12T19:23:14.685322+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.685322+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:35.304389+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2522,"num_read_kb":2358,"num_write":589,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":573,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.974835+0000","last_change":"2024-09-12T19:23:09.974668+0000","last_active":"2024-09-12T19:23:09.974835+0000","last_peered":"2024-09-12T19:23:09.974835+0000","last_clean":"2024-09-12T19:23:09.974835+0000","last_became_active":"2024-09-12T17:29:35.331504+0000","last_became_peered":"2024-09-12T17:29:35.331504+0000","last_unstale":"2024-09-12T19:23:09.974835+0000","last_undegraded":"2024-09-12T19:23:09.974835+0000","last_fullsized":"2024-09-12T19:23:09.974835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:09.974482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:09.974482+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.974482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:21.285772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001034428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'347","reported_seq":992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:07.691834+0000","last_change":"2024-09-12T19:23:07.691765+0000","last_active":"2024-09-12T19:23:07.691834+0000","last_peered":"2024-09-12T19:23:07.691834+0000","last_clean":"2024-09-12T19:23:07.691834+0000","last_became_active":"2024-09-12T17:29:52.741209+0000","last_became_peered":"2024-09-12T17:29:52.741209+0000","last_unstale":"2024-09-12T19:23:07.691834+0000","last_undegraded":"2024-09-12T19:23:07.691834+0000","last_fullsized":"2024-09-12T19:23:07.691834+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'347","last_scrub_stamp":"2024-09-12T19:23:07.691644+0000","last_deep_scrub":"267'347","last_deep_scrub_stamp":"2024-09-12T19:23:07.691644+0000","last_clean_scrub_stamp":"2024-09-12T19:23:07.691644+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:20.196315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":451,"num_read_kb":5499,"num_write":979,"num_write_kb":15070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":545,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.942556+0000","last_change":"2024-09-12T19:23:17.942556+0000","last_active":"2024-09-12T19:23:17.942556+0000","last_peered":"2024-09-12T19:23:17.942556+0000","last_clean":"2024-09-12T19:23:17.942556+0000","last_became_active":"2024-09-12T17:29:56.753063+0000","last_became_peered":"2024-09-12T17:29:56.753063+0000","last_unstale":"2024-09-12T19:23:17.942556+0000","last_undegraded":"2024-09-12T19:23:17.942556+0000","last_fullsized":"2024-09-12T19:23:17.942556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:17.942378+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:17.942378+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.942378+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:50.587264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'376","reported_seq":2333,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.109008+0000","last_change":"2024-09-12T19:23:34.109008+0000","last_active":"2024-09-12T19:23:34.109008+0000","last_peered":"2024-09-12T19:23:34.109008+0000","last_clean":"2024-09-12T19:23:34.109008+0000","last_became_active":"2024-09-12T17:29:58.834447+0000","last_became_peered":"2024-09-12T17:29:58.834447+0000","last_unstale":"2024-09-12T19:23:34.109008+0000","last_undegraded":"2024-09-12T19:23:34.109008+0000","last_fullsized":"2024-09-12T19:23:34.109008+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'376","last_scrub_stamp":"2024-09-12T19:23:34.108814+0000","last_deep_scrub":"267'376","last_deep_scrub_stamp":"2024-09-12T19:23:34.108814+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.108814+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:43.158205+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":368,"num_read_kb":360,"num_write":359,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.795321+0000","last_change":"2024-09-12T19:23:34.795321+0000","last_active":"2024-09-12T19:23:34.795321+0000","last_peered":"2024-09-12T19:23:34.795321+0000","last_clean":"2024-09-12T19:23:34.795321+0000","last_became_active":"2024-09-12T17:30:00.778134+0000","last_became_peered":"2024-09-12T17:30:00.778134+0000","last_unstale":"2024-09-12T19:23:34.795321+0000","last_undegraded":"2024-09-12T19:23:34.795321+0000","last_fullsized":"2024-09-12T19:23:34.795321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:34.795145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:34.795145+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.795145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:05.761948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'272","reported_seq":923,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:46.097251+0000","last_change":"2024-09-12T19:23:46.097251+0000","last_active":"2024-09-12T19:23:46.097251+0000","last_peered":"2024-09-12T19:23:46.097251+0000","last_clean":"2024-09-12T19:23:46.097251+0000","last_became_active":"2024-09-12T17:30:02.805090+0000","last_became_peered":"2024-09-12T17:30:02.805090+0000","last_unstale":"2024-09-12T19:23:46.097251+0000","last_undegraded":"2024-09-12T19:23:46.097251+0000","last_fullsized":"2024-09-12T19:23:46.097251+0000","mapping_epoch":36,"log_start":"267'200","ondisk_log_start":"267'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'272","last_scrub_stamp":"2024-09-12T19:23:46.097005+0000","last_deep_scrub":"267'272","last_deep_scrub_stamp":"2024-09-12T19:23:46.097005+0000","last_clean_scrub_stamp":"2024-09-12T19:23:46.097005+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:07.690681+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":596,"num_read_kb":605,"num_write":610,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'411","reported_seq":1966,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.669552+0000","last_change":"2024-09-12T19:23:20.669552+0000","last_active":"2024-09-12T19:23:20.669552+0000","last_peered":"2024-09-12T19:23:20.669552+0000","last_clean":"2024-09-12T19:23:20.669552+0000","last_became_active":"2024-09-12T17:29:54.745423+0000","last_became_peered":"2024-09-12T17:29:54.745423+0000","last_unstale":"2024-09-12T19:23:20.669552+0000","last_undegraded":"2024-09-12T19:23:20.669552+0000","last_fullsized":"2024-09-12T19:23:20.669552+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'411","last_scrub_stamp":"2024-09-12T19:23:20.669299+0000","last_deep_scrub":"267'411","last_deep_scrub_stamp":"2024-09-12T19:23:20.669299+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.669299+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:50.595760+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2154,"num_read_kb":2073,"num_write":474,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":563,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.236004+0000","last_change":"2024-09-12T19:23:12.235866+0000","last_active":"2024-09-12T19:23:12.236004+0000","last_peered":"2024-09-12T19:23:12.236004+0000","last_clean":"2024-09-12T19:23:12.236004+0000","last_became_active":"2024-09-12T17:29:35.340113+0000","last_became_peered":"2024-09-12T17:29:35.340113+0000","last_unstale":"2024-09-12T19:23:12.236004+0000","last_undegraded":"2024-09-12T19:23:12.236004+0000","last_fullsized":"2024-09-12T19:23:12.236004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-12T19:23:12.235689+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-12T19:23:12.235689+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.235689+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:20.303471+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0020086050000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'366","reported_seq":1123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:08.226087+0000","last_change":"2024-09-12T19:23:08.225908+0000","last_active":"2024-09-12T19:23:08.226087+0000","last_peered":"2024-09-12T19:23:08.226087+0000","last_clean":"2024-09-12T19:23:08.226087+0000","last_became_active":"2024-09-12T17:29:52.759957+0000","last_became_peered":"2024-09-12T17:29:52.759957+0000","last_unstale":"2024-09-12T19:23:08.226087+0000","last_undegraded":"2024-09-12T19:23:08.226087+0000","last_fullsized":"2024-09-12T19:23:08.226087+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'366","last_scrub_stamp":"2024-09-12T19:23:08.225657+0000","last_deep_scrub":"267'366","last_deep_scrub_stamp":"2024-09-12T19:23:08.225657+0000","last_clean_scrub_stamp":"2024-09-12T19:23:08.225657+0000","objects_scrubbed":10,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:08.296014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":279708,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":651,"num_read_kb":39253,"num_write":1178,"num_write_kb":45869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.816409+0000","last_change":"2024-09-12T19:23:20.816409+0000","last_active":"2024-09-12T19:23:20.816409+0000","last_peered":"2024-09-12T19:23:20.816409+0000","last_clean":"2024-09-12T19:23:20.816409+0000","last_became_active":"2024-09-12T17:29:56.765361+0000","last_became_peered":"2024-09-12T17:29:56.765361+0000","last_unstale":"2024-09-12T19:23:20.816409+0000","last_undegraded":"2024-09-12T19:23:20.816409+0000","last_fullsized":"2024-09-12T19:23:20.816409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:20.816187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:20.816187+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.816187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:19:00.594416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'217","reported_seq":840,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:35.055445+0000","last_change":"2024-09-12T19:23:35.055445+0000","last_active":"2024-09-12T19:23:35.055445+0000","last_peered":"2024-09-12T19:23:35.055445+0000","last_clean":"2024-09-12T19:23:35.055445+0000","last_became_active":"2024-09-12T17:29:58.768596+0000","last_became_peered":"2024-09-12T17:29:58.768596+0000","last_unstale":"2024-09-12T19:23:35.055445+0000","last_undegraded":"2024-09-12T19:23:35.055445+0000","last_fullsized":"2024-09-12T19:23:35.055445+0000","mapping_epoch":32,"log_start":"267'201","ondisk_log_start":"267'201","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'217","last_scrub_stamp":"2024-09-12T19:23:35.055130+0000","last_deep_scrub":"267'217","last_deep_scrub_stamp":"2024-09-12T19:23:35.055130+0000","last_clean_scrub_stamp":"2024-09-12T19:23:35.055130+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":201,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:05.111750+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.237039+0000","last_change":"2024-09-12T19:23:24.237039+0000","last_active":"2024-09-12T19:23:24.237039+0000","last_peered":"2024-09-12T19:23:24.237039+0000","last_clean":"2024-09-12T19:23:24.237039+0000","last_became_active":"2024-09-12T17:30:00.788505+0000","last_became_peered":"2024-09-12T17:30:00.788505+0000","last_unstale":"2024-09-12T19:23:24.237039+0000","last_undegraded":"2024-09-12T19:23:24.237039+0000","last_fullsized":"2024-09-12T19:23:24.237039+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:24.236855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:24.236855+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.236855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:04:51.530055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'157","reported_seq":745,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.323482+0000","last_change":"2024-09-12T19:23:40.323482+0000","last_active":"2024-09-12T19:23:40.323482+0000","last_peered":"2024-09-12T19:23:40.323482+0000","last_clean":"2024-09-12T19:23:40.323482+0000","last_became_active":"2024-09-12T17:30:02.794703+0000","last_became_peered":"2024-09-12T17:30:02.794703+0000","last_unstale":"2024-09-12T19:23:40.323482+0000","last_undegraded":"2024-09-12T19:23:40.323482+0000","last_fullsized":"2024-09-12T19:23:40.323482+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'157","last_scrub_stamp":"2024-09-12T19:23:40.323277+0000","last_deep_scrub":"267'157","last_deep_scrub_stamp":"2024-09-12T19:23:40.323277+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.323277+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:18.158223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":268,"num_read_kb":254,"num_write":347,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'419","reported_seq":2024,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.689299+0000","last_change":"2024-09-12T19:23:11.689299+0000","last_active":"2024-09-12T19:23:11.689299+0000","last_peered":"2024-09-12T19:23:11.689299+0000","last_clean":"2024-09-12T19:23:11.689299+0000","last_became_active":"2024-09-12T17:29:54.766275+0000","last_became_peered":"2024-09-12T17:29:54.766275+0000","last_unstale":"2024-09-12T19:23:11.689299+0000","last_undegraded":"2024-09-12T19:23:11.689299+0000","last_fullsized":"2024-09-12T19:23:11.689299+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'419","last_scrub_stamp":"2024-09-12T19:23:11.689112+0000","last_deep_scrub":"267'419","last_deep_scrub_stamp":"2024-09-12T19:23:11.689112+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.689112+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:41.829755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2280,"num_read_kb":2171,"num_write":482,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'349","reported_seq":1034,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.235471+0000","last_change":"2024-09-12T19:23:09.235471+0000","last_active":"2024-09-12T19:23:09.235471+0000","last_peered":"2024-09-12T19:23:09.235471+0000","last_clean":"2024-09-12T19:23:09.235471+0000","last_became_active":"2024-09-12T17:29:52.740544+0000","last_became_peered":"2024-09-12T17:29:52.740544+0000","last_unstale":"2024-09-12T19:23:09.235471+0000","last_undegraded":"2024-09-12T19:23:09.235471+0000","last_fullsized":"2024-09-12T19:23:09.235471+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'349","last_scrub_stamp":"2024-09-12T19:23:09.235171+0000","last_deep_scrub":"267'349","last_deep_scrub_stamp":"2024-09-12T19:23:09.235171+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.235171+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:19.968121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":6019,"num_write":1130,"num_write_kb":22769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":563,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:08.639560+0000","last_change":"2024-09-12T19:23:08.639498+0000","last_active":"2024-09-12T19:23:08.639560+0000","last_peered":"2024-09-12T19:23:08.639560+0000","last_clean":"2024-09-12T19:23:08.639560+0000","last_became_active":"2024-09-12T17:29:35.407492+0000","last_became_peered":"2024-09-12T17:29:35.407492+0000","last_unstale":"2024-09-12T19:23:08.639560+0000","last_undegraded":"2024-09-12T19:23:08.639560+0000","last_fullsized":"2024-09-12T19:23:08.639560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:08.639425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:08.639425+0000","last_clean_scrub_stamp":"2024-09-12T19:23:08.639425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:59.907415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098134900000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.803905+0000","last_change":"2024-09-12T19:23:31.803905+0000","last_active":"2024-09-12T19:23:31.803905+0000","last_peered":"2024-09-12T19:23:31.803905+0000","last_clean":"2024-09-12T19:23:31.803905+0000","last_became_active":"2024-09-12T17:29:56.769344+0000","last_became_peered":"2024-09-12T17:29:56.769344+0000","last_unstale":"2024-09-12T19:23:31.803905+0000","last_undegraded":"2024-09-12T19:23:31.803905+0000","last_fullsized":"2024-09-12T19:23:31.803905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:31.803722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:31.803722+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.803722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:17:40.239034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'771","reported_seq":1520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.838847+0000","last_change":"2024-09-12T19:23:24.838550+0000","last_active":"2024-09-12T19:23:24.838847+0000","last_peered":"2024-09-12T19:23:24.838847+0000","last_clean":"2024-09-12T19:23:24.838847+0000","last_became_active":"2024-09-12T17:29:58.766353+0000","last_became_peered":"2024-09-12T17:29:58.766353+0000","last_unstale":"2024-09-12T19:23:24.838847+0000","last_undegraded":"2024-09-12T19:23:24.838847+0000","last_fullsized":"2024-09-12T19:23:24.838847+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'771","last_scrub_stamp":"2024-09-12T19:23:24.838217+0000","last_deep_scrub":"267'771","last_deep_scrub_stamp":"2024-09-12T19:23:24.838217+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.838217+0000","objects_scrubbed":10,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:03:30.026559+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88446,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1874,"num_read_kb":3148,"num_write":2424,"num_write_kb":2173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":501744,"num_omap_keys":1138,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.128408+0000","last_change":"2024-09-12T19:23:37.128408+0000","last_active":"2024-09-12T19:23:37.128408+0000","last_peered":"2024-09-12T19:23:37.128408+0000","last_clean":"2024-09-12T19:23:37.128408+0000","last_became_active":"2024-09-12T17:30:00.783385+0000","last_became_peered":"2024-09-12T17:30:00.783385+0000","last_unstale":"2024-09-12T19:23:37.128408+0000","last_undegraded":"2024-09-12T19:23:37.128408+0000","last_fullsized":"2024-09-12T19:23:37.128408+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:37.128205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:37.128205+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.128205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:10:07.825249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'149","reported_seq":685,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.722077+0000","last_change":"2024-09-12T19:23:40.722077+0000","last_active":"2024-09-12T19:23:40.722077+0000","last_peered":"2024-09-12T19:23:40.722077+0000","last_clean":"2024-09-12T19:23:40.722077+0000","last_became_active":"2024-09-12T17:30:02.805684+0000","last_became_peered":"2024-09-12T17:30:02.805684+0000","last_unstale":"2024-09-12T19:23:40.722077+0000","last_undegraded":"2024-09-12T19:23:40.722077+0000","last_fullsized":"2024-09-12T19:23:40.722077+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'149","last_scrub_stamp":"2024-09-12T19:23:40.721838+0000","last_deep_scrub":"267'149","last_deep_scrub_stamp":"2024-09-12T19:23:40.721838+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.721838+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:59.142442+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":165,"num_read_kb":163,"num_write":341,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'407","reported_seq":1916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.843610+0000","last_change":"2024-09-12T19:23:23.843610+0000","last_active":"2024-09-12T19:23:23.843610+0000","last_peered":"2024-09-12T19:23:23.843610+0000","last_clean":"2024-09-12T19:23:23.843610+0000","last_became_active":"2024-09-12T17:29:54.758047+0000","last_became_peered":"2024-09-12T17:29:54.758047+0000","last_unstale":"2024-09-12T19:23:23.843610+0000","last_undegraded":"2024-09-12T19:23:23.843610+0000","last_fullsized":"2024-09-12T19:23:23.843610+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'407","last_scrub_stamp":"2024-09-12T19:23:23.843421+0000","last_deep_scrub":"267'407","last_deep_scrub_stamp":"2024-09-12T19:23:23.843421+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.843421+0000","objects_scrubbed":3,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:01:49.696068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2269,"num_read_kb":2144,"num_write":466,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1732,"num_omap_keys":7,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'307","reported_seq":1194,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.655482+0000","last_change":"2024-09-12T19:23:10.655275+0000","last_active":"2024-09-12T19:23:10.655482+0000","last_peered":"2024-09-12T19:23:10.655482+0000","last_clean":"2024-09-12T19:23:10.655482+0000","last_became_active":"2024-09-12T17:29:52.727635+0000","last_became_peered":"2024-09-12T17:29:52.727635+0000","last_unstale":"2024-09-12T19:23:10.655482+0000","last_undegraded":"2024-09-12T19:23:10.655482+0000","last_fullsized":"2024-09-12T19:23:10.655482+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'307","last_scrub_stamp":"2024-09-12T19:23:10.655045+0000","last_deep_scrub":"267'307","last_deep_scrub_stamp":"2024-09-12T19:23:10.655045+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.655045+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:43.716739+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109709,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":897,"num_read_kb":32569,"num_write":1024,"num_write_kb":39553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":558,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.972190+0000","last_change":"2024-09-12T19:23:11.972190+0000","last_active":"2024-09-12T19:23:11.972190+0000","last_peered":"2024-09-12T19:23:11.972190+0000","last_clean":"2024-09-12T19:23:11.972190+0000","last_became_active":"2024-09-12T17:29:35.406653+0000","last_became_peered":"2024-09-12T17:29:35.406653+0000","last_unstale":"2024-09-12T19:23:11.972190+0000","last_undegraded":"2024-09-12T19:23:11.972190+0000","last_fullsized":"2024-09-12T19:23:11.972190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:11.972019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:11.972019+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.972019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:02.613400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001315566,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.209747+0000","last_change":"2024-09-12T19:23:21.209747+0000","last_active":"2024-09-12T19:23:21.209747+0000","last_peered":"2024-09-12T19:23:21.209747+0000","last_clean":"2024-09-12T19:23:21.209747+0000","last_became_active":"2024-09-12T17:29:56.769576+0000","last_became_peered":"2024-09-12T17:29:56.769576+0000","last_unstale":"2024-09-12T19:23:21.209747+0000","last_undegraded":"2024-09-12T19:23:21.209747+0000","last_fullsized":"2024-09-12T19:23:21.209747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:21.209539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:21.209539+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.209539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:37:58.220864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'345","reported_seq":992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.684786+0000","last_change":"2024-09-12T19:23:26.684786+0000","last_active":"2024-09-12T19:23:26.684786+0000","last_peered":"2024-09-12T19:23:26.684786+0000","last_clean":"2024-09-12T19:23:26.684786+0000","last_became_active":"2024-09-12T17:29:58.830993+0000","last_became_peered":"2024-09-12T17:29:58.830993+0000","last_unstale":"2024-09-12T19:23:26.684786+0000","last_undegraded":"2024-09-12T19:23:26.684786+0000","last_fullsized":"2024-09-12T19:23:26.684786+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'345","last_scrub_stamp":"2024-09-12T19:23:26.684582+0000","last_deep_scrub":"267'345","last_deep_scrub_stamp":"2024-09-12T19:23:26.684582+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.684582+0000","objects_scrubbed":8,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:39.601631+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":439,"num_read_kb":430,"num_write":418,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'792","reported_seq":3382,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.285075+0000","last_change":"2024-09-12T19:23:37.285075+0000","last_active":"2024-09-12T19:23:37.285075+0000","last_peered":"2024-09-12T19:23:37.285075+0000","last_clean":"2024-09-12T19:23:37.285075+0000","last_became_active":"2024-09-12T17:30:00.805059+0000","last_became_peered":"2024-09-12T17:30:00.805059+0000","last_unstale":"2024-09-12T19:23:37.285075+0000","last_undegraded":"2024-09-12T19:23:37.285075+0000","last_fullsized":"2024-09-12T19:23:37.285075+0000","mapping_epoch":34,"log_start":"267'701","ondisk_log_start":"267'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'792","last_scrub_stamp":"2024-09-12T19:23:37.284894+0000","last_deep_scrub":"267'792","last_deep_scrub_stamp":"2024-09-12T19:23:37.284894+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.284894+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":701,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:14.596435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'140","reported_seq":688,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:49.038175+0000","last_change":"2024-09-12T19:23:49.038175+0000","last_active":"2024-09-12T19:23:49.038175+0000","last_peered":"2024-09-12T19:23:49.038175+0000","last_clean":"2024-09-12T19:23:49.038175+0000","last_became_active":"2024-09-12T17:30:02.803051+0000","last_became_peered":"2024-09-12T17:30:02.803051+0000","last_unstale":"2024-09-12T19:23:49.038175+0000","last_undegraded":"2024-09-12T19:23:49.038175+0000","last_fullsized":"2024-09-12T19:23:49.038175+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'140","last_scrub_stamp":"2024-09-12T19:23:49.037910+0000","last_deep_scrub":"267'140","last_deep_scrub_stamp":"2024-09-12T19:23:49.037910+0000","last_clean_scrub_stamp":"2024-09-12T19:23:49.037910+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:08.347288+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":726,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":188,"num_read_kb":177,"num_write":312,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'429","reported_seq":1978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.137346+0000","last_change":"2024-09-12T19:23:20.137194+0000","last_active":"2024-09-12T19:23:20.137346+0000","last_peered":"2024-09-12T19:23:20.137346+0000","last_clean":"2024-09-12T19:23:20.137346+0000","last_became_active":"2024-09-12T17:29:54.762522+0000","last_became_peered":"2024-09-12T17:29:54.762522+0000","last_unstale":"2024-09-12T19:23:20.137346+0000","last_undegraded":"2024-09-12T19:23:20.137346+0000","last_fullsized":"2024-09-12T19:23:20.137346+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'429","last_scrub_stamp":"2024-09-12T19:23:20.136990+0000","last_deep_scrub":"267'429","last_deep_scrub_stamp":"2024-09-12T19:23:20.136990+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.136990+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:28.426663+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2273,"num_read_kb":2141,"num_write":510,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'293","reported_seq":929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.212947+0000","last_change":"2024-09-12T19:23:11.212947+0000","last_active":"2024-09-12T19:23:11.212947+0000","last_peered":"2024-09-12T19:23:11.212947+0000","last_clean":"2024-09-12T19:23:11.212947+0000","last_became_active":"2024-09-12T17:29:52.716210+0000","last_became_peered":"2024-09-12T17:29:52.716210+0000","last_unstale":"2024-09-12T19:23:11.212947+0000","last_undegraded":"2024-09-12T19:23:11.212947+0000","last_fullsized":"2024-09-12T19:23:11.212947+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'293","last_scrub_stamp":"2024-09-12T19:23:11.212651+0000","last_deep_scrub":"267'293","last_deep_scrub_stamp":"2024-09-12T19:23:11.212651+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.212651+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:55.274163+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":379,"num_read_kb":381,"num_write":923,"num_write_kb":30307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:06.731506+0000","last_change":"2024-09-12T19:23:06.731459+0000","last_active":"2024-09-12T19:23:06.731506+0000","last_peered":"2024-09-12T19:23:06.731506+0000","last_clean":"2024-09-12T19:23:06.731506+0000","last_became_active":"2024-09-12T17:29:35.337987+0000","last_became_peered":"2024-09-12T17:29:35.337987+0000","last_unstale":"2024-09-12T19:23:06.731506+0000","last_undegraded":"2024-09-12T19:23:06.731506+0000","last_fullsized":"2024-09-12T19:23:06.731506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:06.731386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:06.731386+0000","last_clean_scrub_stamp":"2024-09-12T19:23:06.731386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:59.862051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011496340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"267'4","reported_seq":1023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.171871+0000","last_change":"2024-09-12T19:23:29.171871+0000","last_active":"2024-09-12T19:23:29.171871+0000","last_peered":"2024-09-12T19:23:29.171871+0000","last_clean":"2024-09-12T19:23:29.171871+0000","last_became_active":"2024-09-12T17:29:56.754415+0000","last_became_peered":"2024-09-12T17:29:56.754415+0000","last_unstale":"2024-09-12T19:23:29.171871+0000","last_undegraded":"2024-09-12T19:23:29.171871+0000","last_fullsized":"2024-09-12T19:23:29.171871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-12T19:23:29.171658+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-12T19:23:29.171658+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.171658+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:29.471306+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'181","reported_seq":795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:33.101183+0000","last_change":"2024-09-12T19:23:33.101183+0000","last_active":"2024-09-12T19:23:33.101183+0000","last_peered":"2024-09-12T19:23:33.101183+0000","last_clean":"2024-09-12T19:23:33.101183+0000","last_became_active":"2024-09-12T17:29:58.766420+0000","last_became_peered":"2024-09-12T17:29:58.766420+0000","last_unstale":"2024-09-12T19:23:33.101183+0000","last_undegraded":"2024-09-12T19:23:33.101183+0000","last_fullsized":"2024-09-12T19:23:33.101183+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-12T19:23:33.100998+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-12T19:23:33.100998+0000","last_clean_scrub_stamp":"2024-09-12T19:23:33.100998+0000","objects_scrubbed":6,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:29.936445+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":231,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'818","reported_seq":5013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.087415+0000","last_change":"2024-09-12T19:23:41.087415+0000","last_active":"2024-09-12T19:23:41.087415+0000","last_peered":"2024-09-12T19:23:41.087415+0000","last_clean":"2024-09-12T19:23:41.087415+0000","last_became_active":"2024-09-12T17:30:00.793234+0000","last_became_peered":"2024-09-12T17:30:00.793234+0000","last_unstale":"2024-09-12T19:23:41.087415+0000","last_undegraded":"2024-09-12T19:23:41.087415+0000","last_fullsized":"2024-09-12T19:23:41.087415+0000","mapping_epoch":34,"log_start":"267'800","ondisk_log_start":"267'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'818","last_scrub_stamp":"2024-09-12T19:23:41.087229+0000","last_deep_scrub":"267'818","last_deep_scrub_stamp":"2024-09-12T19:23:41.087229+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.087229+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:59.784247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'190","reported_seq":735,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.713817+0000","last_change":"2024-09-12T19:23:42.713817+0000","last_active":"2024-09-12T19:23:42.713817+0000","last_peered":"2024-09-12T19:23:42.713817+0000","last_clean":"2024-09-12T19:23:42.713817+0000","last_became_active":"2024-09-12T17:30:02.799944+0000","last_became_peered":"2024-09-12T17:30:02.799944+0000","last_unstale":"2024-09-12T19:23:42.713817+0000","last_undegraded":"2024-09-12T19:23:42.713817+0000","last_fullsized":"2024-09-12T19:23:42.713817+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'190","last_scrub_stamp":"2024-09-12T19:23:42.713627+0000","last_deep_scrub":"267'190","last_deep_scrub_stamp":"2024-09-12T19:23:42.713627+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.713627+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:01.551556+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":199,"num_read_kb":188,"num_write":423,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'1237","reported_seq":2862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.247365+0000","last_change":"2024-09-12T19:23:13.247365+0000","last_active":"2024-09-12T19:23:13.247365+0000","last_peered":"2024-09-12T19:23:13.247365+0000","last_clean":"2024-09-12T19:23:13.247365+0000","last_became_active":"2024-09-12T17:29:54.751931+0000","last_became_peered":"2024-09-12T17:29:54.751931+0000","last_unstale":"2024-09-12T19:23:13.247365+0000","last_undegraded":"2024-09-12T19:23:13.247365+0000","last_fullsized":"2024-09-12T19:23:13.247365+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1237","last_scrub_stamp":"2024-09-12T19:23:13.247189+0000","last_deep_scrub":"267'1237","last_deep_scrub_stamp":"2024-09-12T19:23:13.247189+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.247189+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":1200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:52.825946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5667,"num_read_kb":5016,"num_write":1745,"num_write_kb":765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'336","reported_seq":969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:07.977004+0000","last_change":"2024-09-12T19:23:07.977004+0000","last_active":"2024-09-12T19:23:07.977004+0000","last_peered":"2024-09-12T19:23:07.977004+0000","last_clean":"2024-09-12T19:23:07.977004+0000","last_became_active":"2024-09-12T17:30:21.697470+0000","last_became_peered":"2024-09-12T17:30:21.697470+0000","last_unstale":"2024-09-12T19:23:07.977004+0000","last_undegraded":"2024-09-12T19:23:07.977004+0000","last_fullsized":"2024-09-12T19:23:07.977004+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'336","last_scrub_stamp":"2024-09-12T19:23:07.976758+0000","last_deep_scrub":"267'336","last_deep_scrub_stamp":"2024-09-12T19:23:07.976758+0000","last_clean_scrub_stamp":"2024-09-12T19:23:07.976758+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:24.268288+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":2583,"num_write":1054,"num_write_kb":28824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.146985+0000","last_change":"2024-09-12T19:23:09.146828+0000","last_active":"2024-09-12T19:23:09.146985+0000","last_peered":"2024-09-12T19:23:09.146985+0000","last_clean":"2024-09-12T19:23:09.146985+0000","last_became_active":"2024-09-12T17:29:35.337998+0000","last_became_peered":"2024-09-12T17:29:35.337998+0000","last_unstale":"2024-09-12T19:23:09.146985+0000","last_undegraded":"2024-09-12T19:23:09.146985+0000","last_fullsized":"2024-09-12T19:23:09.146985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:09.146655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:09.146655+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.146655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:56.445997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011850280000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":544,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.138811+0000","last_change":"2024-09-12T19:23:29.138679+0000","last_active":"2024-09-12T19:23:29.138811+0000","last_peered":"2024-09-12T19:23:29.138811+0000","last_clean":"2024-09-12T19:23:29.138811+0000","last_became_active":"2024-09-12T17:29:56.760822+0000","last_became_peered":"2024-09-12T17:29:56.760822+0000","last_unstale":"2024-09-12T19:23:29.138811+0000","last_undegraded":"2024-09-12T19:23:29.138811+0000","last_fullsized":"2024-09-12T19:23:29.138811+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:29.138471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:29.138471+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.138471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:58.898874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'813","reported_seq":1602,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.136516+0000","last_change":"2024-09-12T19:23:29.136516+0000","last_active":"2024-09-12T19:23:29.136516+0000","last_peered":"2024-09-12T19:23:29.136516+0000","last_clean":"2024-09-12T19:23:29.136516+0000","last_became_active":"2024-09-12T17:29:58.830605+0000","last_became_peered":"2024-09-12T17:29:58.830605+0000","last_unstale":"2024-09-12T19:23:29.136516+0000","last_undegraded":"2024-09-12T19:23:29.136516+0000","last_fullsized":"2024-09-12T19:23:29.136516+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'813","last_scrub_stamp":"2024-09-12T19:23:29.136309+0000","last_deep_scrub":"267'813","last_deep_scrub_stamp":"2024-09-12T19:23:29.136309+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.136309+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":800,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:15.488966+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138319,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1432,"num_read_kb":3265,"num_write":1150,"num_write_kb":898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.128144+0000","last_change":"2024-09-12T19:23:42.128144+0000","last_active":"2024-09-12T19:23:42.128144+0000","last_peered":"2024-09-12T19:23:42.128144+0000","last_clean":"2024-09-12T19:23:42.128144+0000","last_became_active":"2024-09-12T17:30:00.810341+0000","last_became_peered":"2024-09-12T17:30:00.810341+0000","last_unstale":"2024-09-12T19:23:42.128144+0000","last_undegraded":"2024-09-12T19:23:42.128144+0000","last_fullsized":"2024-09-12T19:23:42.128144+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:42.127960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:42.127960+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.127960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:30.104619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'164","reported_seq":728,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.325599+0000","last_change":"2024-09-12T19:23:41.325599+0000","last_active":"2024-09-12T19:23:41.325599+0000","last_peered":"2024-09-12T19:23:41.325599+0000","last_clean":"2024-09-12T19:23:41.325599+0000","last_became_active":"2024-09-12T17:30:02.786443+0000","last_became_peered":"2024-09-12T17:30:02.786443+0000","last_unstale":"2024-09-12T19:23:41.325599+0000","last_undegraded":"2024-09-12T19:23:41.325599+0000","last_fullsized":"2024-09-12T19:23:41.325599+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'164","last_scrub_stamp":"2024-09-12T19:23:41.325403+0000","last_deep_scrub":"267'164","last_deep_scrub_stamp":"2024-09-12T19:23:41.325403+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.325403+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:23.794999+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":311,"num_read_kb":271,"num_write":310,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'113","reported_seq":707,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.727465+0000","last_change":"2024-09-12T19:23:44.727465+0000","last_active":"2024-09-12T19:23:44.727465+0000","last_peered":"2024-09-12T19:23:44.727465+0000","last_clean":"2024-09-12T19:23:44.727465+0000","last_became_active":"2024-09-12T17:30:02.801038+0000","last_became_peered":"2024-09-12T17:30:02.801038+0000","last_unstale":"2024-09-12T19:23:44.727465+0000","last_undegraded":"2024-09-12T19:23:44.727465+0000","last_fullsized":"2024-09-12T19:23:44.727465+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'113","last_scrub_stamp":"2024-09-12T19:23:44.727277+0000","last_deep_scrub":"267'113","last_deep_scrub_stamp":"2024-09-12T19:23:44.727277+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.727277+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:19.039842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":212,"num_write":265,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'456","reported_seq":2048,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.222431+0000","last_change":"2024-09-12T19:23:18.222255+0000","last_active":"2024-09-12T19:23:18.222431+0000","last_peered":"2024-09-12T19:23:18.222431+0000","last_clean":"2024-09-12T19:23:18.222431+0000","last_became_active":"2024-09-12T17:29:54.760809+0000","last_became_peered":"2024-09-12T17:29:54.760809+0000","last_unstale":"2024-09-12T19:23:18.222431+0000","last_undegraded":"2024-09-12T19:23:18.222431+0000","last_fullsized":"2024-09-12T19:23:18.222431+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'456","last_scrub_stamp":"2024-09-12T19:23:18.222068+0000","last_deep_scrub":"267'456","last_deep_scrub_stamp":"2024-09-12T19:23:18.222068+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.222068+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:12.516436+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2369,"num_read_kb":2229,"num_write":528,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'332","reported_seq":1042,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:10.234197+0000","last_change":"2024-09-12T19:23:10.234197+0000","last_active":"2024-09-12T19:23:10.234197+0000","last_peered":"2024-09-12T19:23:10.234197+0000","last_clean":"2024-09-12T19:23:10.234197+0000","last_became_active":"2024-09-12T17:29:52.760432+0000","last_became_peered":"2024-09-12T17:29:52.760432+0000","last_unstale":"2024-09-12T19:23:10.234197+0000","last_undegraded":"2024-09-12T19:23:10.234197+0000","last_fullsized":"2024-09-12T19:23:10.234197+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'332","last_scrub_stamp":"2024-09-12T19:23:10.233909+0000","last_deep_scrub":"267'332","last_deep_scrub_stamp":"2024-09-12T19:23:10.233909+0000","last_clean_scrub_stamp":"2024-09-12T19:23:10.233909+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:23.059087+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":31499,"num_write":1138,"num_write_kb":37455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.648762+0000","last_change":"2024-09-12T19:23:24.648629+0000","last_active":"2024-09-12T19:23:24.648762+0000","last_peered":"2024-09-12T19:23:24.648762+0000","last_clean":"2024-09-12T19:23:24.648762+0000","last_became_active":"2024-09-12T17:29:56.765656+0000","last_became_peered":"2024-09-12T17:29:56.765656+0000","last_unstale":"2024-09-12T19:23:24.648762+0000","last_undegraded":"2024-09-12T19:23:24.648762+0000","last_fullsized":"2024-09-12T19:23:24.648762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:24.648446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:24.648446+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.648446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:56.698094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'317","reported_seq":959,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.013813+0000","last_change":"2024-09-12T19:23:36.013530+0000","last_active":"2024-09-12T19:23:36.013813+0000","last_peered":"2024-09-12T19:23:36.013813+0000","last_clean":"2024-09-12T19:23:36.013813+0000","last_became_active":"2024-09-12T17:29:58.777997+0000","last_became_peered":"2024-09-12T17:29:58.777997+0000","last_unstale":"2024-09-12T19:23:36.013813+0000","last_undegraded":"2024-09-12T19:23:36.013813+0000","last_fullsized":"2024-09-12T19:23:36.013813+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'317","last_scrub_stamp":"2024-09-12T19:23:36.013221+0000","last_deep_scrub":"267'317","last_deep_scrub_stamp":"2024-09-12T19:23:36.013221+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.013221+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:00.778670+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47243,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":493,"num_read_kb":996,"num_write":376,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.092111+0000","last_change":"2024-09-12T19:23:43.091988+0000","last_active":"2024-09-12T19:23:43.092111+0000","last_peered":"2024-09-12T19:23:43.092111+0000","last_clean":"2024-09-12T19:23:43.092111+0000","last_became_active":"2024-09-12T17:30:00.793204+0000","last_became_peered":"2024-09-12T17:30:00.793204+0000","last_unstale":"2024-09-12T19:23:43.092111+0000","last_undegraded":"2024-09-12T19:23:43.092111+0000","last_fullsized":"2024-09-12T19:23:43.092111+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:43.091801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:43.091801+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.091801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:44.767133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'109","reported_seq":648,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:52.051208+0000","last_change":"2024-09-12T19:23:52.051051+0000","last_active":"2024-09-12T19:23:52.051208+0000","last_peered":"2024-09-12T19:23:52.051208+0000","last_clean":"2024-09-12T19:23:52.051208+0000","last_became_active":"2024-09-12T17:30:02.789511+0000","last_became_peered":"2024-09-12T17:30:02.789511+0000","last_unstale":"2024-09-12T19:23:52.051208+0000","last_undegraded":"2024-09-12T19:23:52.051208+0000","last_fullsized":"2024-09-12T19:23:52.051208+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'109","last_scrub_stamp":"2024-09-12T19:23:52.050868+0000","last_deep_scrub":"267'109","last_deep_scrub_stamp":"2024-09-12T19:23:52.050868+0000","last_clean_scrub_stamp":"2024-09-12T19:23:52.050868+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:10.396312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":267,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'1081","reported_seq":2638,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.698138+0000","last_change":"2024-09-12T19:23:16.697979+0000","last_active":"2024-09-12T19:23:16.698138+0000","last_peered":"2024-09-12T19:23:16.698138+0000","last_clean":"2024-09-12T19:23:16.698138+0000","last_became_active":"2024-09-12T17:29:54.774337+0000","last_became_peered":"2024-09-12T17:29:54.774337+0000","last_unstale":"2024-09-12T19:23:16.698138+0000","last_undegraded":"2024-09-12T19:23:16.698138+0000","last_fullsized":"2024-09-12T19:23:16.698138+0000","mapping_epoch":28,"log_start":"267'1000","ondisk_log_start":"267'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1081","last_scrub_stamp":"2024-09-12T19:23:16.697790+0000","last_deep_scrub":"267'1081","last_deep_scrub_stamp":"2024-09-12T19:23:16.697790+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.697790+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":1000,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:19.478713+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5006,"num_read_kb":4447,"num_write":1496,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'343","reported_seq":1047,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.093187+0000","last_change":"2024-09-12T19:23:17.093038+0000","last_active":"2024-09-12T19:23:17.093187+0000","last_peered":"2024-09-12T19:23:17.093187+0000","last_clean":"2024-09-12T19:23:17.093187+0000","last_became_active":"2024-09-12T17:29:52.757775+0000","last_became_peered":"2024-09-12T17:29:52.757775+0000","last_unstale":"2024-09-12T19:23:17.093187+0000","last_undegraded":"2024-09-12T19:23:17.093187+0000","last_fullsized":"2024-09-12T19:23:17.093187+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'343","last_scrub_stamp":"2024-09-12T19:23:17.092815+0000","last_deep_scrub":"267'343","last_deep_scrub_stamp":"2024-09-12T19:23:17.092815+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.092815+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:09.547140+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399166,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":510,"num_read_kb":111933,"num_write":1035,"num_write_kb":43950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.113824+0000","last_change":"2024-09-12T19:23:30.113656+0000","last_active":"2024-09-12T19:23:30.113824+0000","last_peered":"2024-09-12T19:23:30.113824+0000","last_clean":"2024-09-12T19:23:30.113824+0000","last_became_active":"2024-09-12T17:29:56.770639+0000","last_became_peered":"2024-09-12T17:29:56.770639+0000","last_unstale":"2024-09-12T19:23:30.113824+0000","last_undegraded":"2024-09-12T19:23:30.113824+0000","last_fullsized":"2024-09-12T19:23:30.113824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:30.113470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:30.113470+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.113470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:33.724815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'81","reported_seq":634,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.762768+0000","last_change":"2024-09-12T19:23:29.762633+0000","last_active":"2024-09-12T19:23:29.762768+0000","last_peered":"2024-09-12T19:23:29.762768+0000","last_clean":"2024-09-12T19:23:29.762768+0000","last_became_active":"2024-09-12T17:29:58.781731+0000","last_became_peered":"2024-09-12T17:29:58.781731+0000","last_unstale":"2024-09-12T19:23:29.762768+0000","last_undegraded":"2024-09-12T19:23:29.762768+0000","last_fullsized":"2024-09-12T19:23:29.762768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'81","last_scrub_stamp":"2024-09-12T19:23:29.762445+0000","last_deep_scrub":"267'81","last_deep_scrub_stamp":"2024-09-12T19:23:29.762445+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.762445+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:16:26.707930+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":73,"num_write":54,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.064919+0000","last_change":"2024-09-12T19:23:38.064753+0000","last_active":"2024-09-12T19:23:38.064919+0000","last_peered":"2024-09-12T19:23:38.064919+0000","last_clean":"2024-09-12T19:23:38.064919+0000","last_became_active":"2024-09-12T17:30:00.799588+0000","last_became_peered":"2024-09-12T17:30:00.799588+0000","last_unstale":"2024-09-12T19:23:38.064919+0000","last_undegraded":"2024-09-12T19:23:38.064919+0000","last_fullsized":"2024-09-12T19:23:38.064919+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:38.064571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:38.064571+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.064571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:37.484945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'193","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.697614+0000","last_change":"2024-09-12T19:23:43.697614+0000","last_active":"2024-09-12T19:23:43.697614+0000","last_peered":"2024-09-12T19:23:43.697614+0000","last_clean":"2024-09-12T19:23:43.697614+0000","last_became_active":"2024-09-12T17:30:02.813284+0000","last_became_peered":"2024-09-12T17:30:02.813284+0000","last_unstale":"2024-09-12T19:23:43.697614+0000","last_undegraded":"2024-09-12T19:23:43.697614+0000","last_fullsized":"2024-09-12T19:23:43.697614+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'193","last_scrub_stamp":"2024-09-12T19:23:43.697424+0000","last_deep_scrub":"267'193","last_deep_scrub_stamp":"2024-09-12T19:23:43.697424+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.697424+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:41.448750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":312,"num_read_kb":310,"num_write":442,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'826","reported_seq":2447,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.189232+0000","last_change":"2024-09-12T19:23:22.189050+0000","last_active":"2024-09-12T19:23:22.189232+0000","last_peered":"2024-09-12T19:23:22.189232+0000","last_clean":"2024-09-12T19:23:22.189232+0000","last_became_active":"2024-09-12T17:29:54.762793+0000","last_became_peered":"2024-09-12T17:29:54.762793+0000","last_unstale":"2024-09-12T19:23:22.189232+0000","last_undegraded":"2024-09-12T19:23:22.189232+0000","last_fullsized":"2024-09-12T19:23:22.189232+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'826","last_scrub_stamp":"2024-09-12T19:23:22.188867+0000","last_deep_scrub":"267'826","last_deep_scrub_stamp":"2024-09-12T19:23:22.188867+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.188867+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:07.821462+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3973,"num_read_kb":3581,"num_write":1093,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":695,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'357","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.012095+0000","last_change":"2024-09-12T19:23:13.011911+0000","last_active":"2024-09-12T19:23:13.012095+0000","last_peered":"2024-09-12T19:23:13.012095+0000","last_clean":"2024-09-12T19:23:13.012095+0000","last_became_active":"2024-09-12T17:30:21.692338+0000","last_became_peered":"2024-09-12T17:30:21.692338+0000","last_unstale":"2024-09-12T19:23:13.012095+0000","last_undegraded":"2024-09-12T19:23:13.012095+0000","last_fullsized":"2024-09-12T19:23:13.012095+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'357","last_scrub_stamp":"2024-09-12T19:23:13.011577+0000","last_deep_scrub":"267'357","last_deep_scrub_stamp":"2024-09-12T19:23:13.011577+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.011577+0000","objects_scrubbed":10,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:00.683791+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2254600,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":475,"num_read_kb":2106,"num_write":1042,"num_write_kb":33078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,1,3],"acting":[2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.100778+0000","last_change":"2024-09-12T19:23:27.100650+0000","last_active":"2024-09-12T19:23:27.100778+0000","last_peered":"2024-09-12T19:23:27.100778+0000","last_clean":"2024-09-12T19:23:27.100778+0000","last_became_active":"2024-09-12T17:29:56.771923+0000","last_became_peered":"2024-09-12T17:29:56.771923+0000","last_unstale":"2024-09-12T19:23:27.100778+0000","last_undegraded":"2024-09-12T19:23:27.100778+0000","last_fullsized":"2024-09-12T19:23:27.100778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:27.100463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:27.100463+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.100463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:27.173988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'358","reported_seq":1016,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.082818+0000","last_change":"2024-09-12T19:23:38.082680+0000","last_active":"2024-09-12T19:23:38.082818+0000","last_peered":"2024-09-12T19:23:38.082818+0000","last_clean":"2024-09-12T19:23:38.082818+0000","last_became_active":"2024-09-12T17:29:58.781756+0000","last_became_peered":"2024-09-12T17:29:58.781756+0000","last_unstale":"2024-09-12T19:23:38.082818+0000","last_undegraded":"2024-09-12T19:23:38.082818+0000","last_fullsized":"2024-09-12T19:23:38.082818+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'358","last_scrub_stamp":"2024-09-12T19:23:38.082469+0000","last_deep_scrub":"267'358","last_deep_scrub_stamp":"2024-09-12T19:23:38.082469+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.082469+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:05.093797+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44606,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":574,"num_read_kb":1122,"num_write":442,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.263541+0000","last_change":"2024-09-12T19:23:27.263372+0000","last_active":"2024-09-12T19:23:27.263541+0000","last_peered":"2024-09-12T19:23:27.263541+0000","last_clean":"2024-09-12T19:23:27.263541+0000","last_became_active":"2024-09-12T17:30:00.787872+0000","last_became_peered":"2024-09-12T17:30:00.787872+0000","last_unstale":"2024-09-12T19:23:27.263541+0000","last_undegraded":"2024-09-12T19:23:27.263541+0000","last_fullsized":"2024-09-12T19:23:27.263541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:27.263189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:27.263189+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.263189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:00.496808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'138","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:44.372146+0000","last_change":"2024-09-12T19:23:44.372146+0000","last_active":"2024-09-12T19:23:44.372146+0000","last_peered":"2024-09-12T19:23:44.372146+0000","last_clean":"2024-09-12T19:23:44.372146+0000","last_became_active":"2024-09-12T17:30:02.790246+0000","last_became_peered":"2024-09-12T17:30:02.790246+0000","last_unstale":"2024-09-12T19:23:44.372146+0000","last_undegraded":"2024-09-12T19:23:44.372146+0000","last_fullsized":"2024-09-12T19:23:44.372146+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'138","last_scrub_stamp":"2024-09-12T19:23:44.371962+0000","last_deep_scrub":"267'138","last_deep_scrub_stamp":"2024-09-12T19:23:44.371962+0000","last_clean_scrub_stamp":"2024-09-12T19:23:44.371962+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:30.261994+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":190,"num_read_kb":190,"num_write":334,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'498","reported_seq":2177,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.156189+0000","last_change":"2024-09-12T19:23:21.155966+0000","last_active":"2024-09-12T19:23:21.156189+0000","last_peered":"2024-09-12T19:23:21.156189+0000","last_clean":"2024-09-12T19:23:21.156189+0000","last_became_active":"2024-09-12T17:30:22.255871+0000","last_became_peered":"2024-09-12T17:30:22.255871+0000","last_unstale":"2024-09-12T19:23:21.156189+0000","last_undegraded":"2024-09-12T19:23:21.156189+0000","last_fullsized":"2024-09-12T19:23:21.156189+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'498","last_scrub_stamp":"2024-09-12T19:23:21.155552+0000","last_deep_scrub":"267'498","last_deep_scrub_stamp":"2024-09-12T19:23:21.155552+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.155552+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:38.758690+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2849,"num_read_kb":2646,"num_write":616,"num_write_kb":185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4203,"num_omap_keys":17,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'330","reported_seq":1080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:06.908774+0000","last_change":"2024-09-12T19:23:06.908628+0000","last_active":"2024-09-12T19:23:06.908774+0000","last_peered":"2024-09-12T19:23:06.908774+0000","last_clean":"2024-09-12T19:23:06.908774+0000","last_became_active":"2024-09-12T17:29:52.725672+0000","last_became_peered":"2024-09-12T17:29:52.725672+0000","last_unstale":"2024-09-12T19:23:06.908774+0000","last_undegraded":"2024-09-12T19:23:06.908774+0000","last_fullsized":"2024-09-12T19:23:06.908774+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'330","last_scrub_stamp":"2024-09-12T19:23:06.908405+0000","last_deep_scrub":"267'330","last_deep_scrub_stamp":"2024-09-12T19:23:06.908405+0000","last_clean_scrub_stamp":"2024-09-12T19:23:06.908405+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:18.850583+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524466,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":607,"num_read_kb":120165,"num_write":1109,"num_write_kb":47030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.221678+0000","last_change":"2024-09-12T19:23:22.221546+0000","last_active":"2024-09-12T19:23:22.221678+0000","last_peered":"2024-09-12T19:23:22.221678+0000","last_clean":"2024-09-12T19:23:22.221678+0000","last_became_active":"2024-09-12T17:29:56.761442+0000","last_became_peered":"2024-09-12T17:29:56.761442+0000","last_unstale":"2024-09-12T19:23:22.221678+0000","last_undegraded":"2024-09-12T19:23:22.221678+0000","last_fullsized":"2024-09-12T19:23:22.221678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:22.221361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:22.221361+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.221361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:34.450653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'327","reported_seq":947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.101527+0000","last_change":"2024-09-12T19:23:31.101276+0000","last_active":"2024-09-12T19:23:31.101527+0000","last_peered":"2024-09-12T19:23:31.101527+0000","last_clean":"2024-09-12T19:23:31.101527+0000","last_became_active":"2024-09-12T17:29:58.758050+0000","last_became_peered":"2024-09-12T17:29:58.758050+0000","last_unstale":"2024-09-12T19:23:31.101527+0000","last_undegraded":"2024-09-12T19:23:31.101527+0000","last_fullsized":"2024-09-12T19:23:31.101527+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'327","last_scrub_stamp":"2024-09-12T19:23:31.101035+0000","last_deep_scrub":"267'327","last_deep_scrub_stamp":"2024-09-12T19:23:31.101035+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.101035+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:54.851659+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47374,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":545,"num_read_kb":1211,"num_write":440,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.774433+0000","last_change":"2024-09-12T19:23:36.774303+0000","last_active":"2024-09-12T19:23:36.774433+0000","last_peered":"2024-09-12T19:23:36.774433+0000","last_clean":"2024-09-12T19:23:36.774433+0000","last_became_active":"2024-09-12T17:30:00.780216+0000","last_became_peered":"2024-09-12T17:30:00.780216+0000","last_unstale":"2024-09-12T19:23:36.774433+0000","last_undegraded":"2024-09-12T19:23:36.774433+0000","last_fullsized":"2024-09-12T19:23:36.774433+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:36.774122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:36.774122+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.774122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:01.600530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'415","reported_seq":1862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.193904+0000","last_change":"2024-09-12T19:23:18.193904+0000","last_active":"2024-09-12T19:23:18.193904+0000","last_peered":"2024-09-12T19:23:18.193904+0000","last_clean":"2024-09-12T19:23:18.193904+0000","last_became_active":"2024-09-12T17:29:54.776503+0000","last_became_peered":"2024-09-12T17:29:54.776503+0000","last_unstale":"2024-09-12T19:23:18.193904+0000","last_undegraded":"2024-09-12T19:23:18.193904+0000","last_fullsized":"2024-09-12T19:23:18.193904+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'415","last_scrub_stamp":"2024-09-12T19:23:18.193704+0000","last_deep_scrub":"267'415","last_deep_scrub_stamp":"2024-09-12T19:23:18.193704+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.193704+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:14:23.257855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2157,"num_read_kb":2011,"num_write":494,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'346","reported_seq":1057,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.194650+0000","last_change":"2024-09-12T19:23:13.194506+0000","last_active":"2024-09-12T19:23:13.194650+0000","last_peered":"2024-09-12T19:23:13.194650+0000","last_clean":"2024-09-12T19:23:13.194650+0000","last_became_active":"2024-09-12T17:29:52.716376+0000","last_became_peered":"2024-09-12T17:29:52.716376+0000","last_unstale":"2024-09-12T19:23:13.194650+0000","last_undegraded":"2024-09-12T19:23:13.194650+0000","last_fullsized":"2024-09-12T19:23:13.194650+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'346","last_scrub_stamp":"2024-09-12T19:23:13.194237+0000","last_deep_scrub":"267'346","last_deep_scrub_stamp":"2024-09-12T19:23:13.194237+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.194237+0000","objects_scrubbed":9,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:44.170037+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730157,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":576,"num_read_kb":2668,"num_write":1130,"num_write_kb":45238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.853314+0000","last_change":"2024-09-12T19:23:22.853164+0000","last_active":"2024-09-12T19:23:22.853314+0000","last_peered":"2024-09-12T19:23:22.853314+0000","last_clean":"2024-09-12T19:23:22.853314+0000","last_became_active":"2024-09-12T17:29:56.773239+0000","last_became_peered":"2024-09-12T17:29:56.773239+0000","last_unstale":"2024-09-12T19:23:22.853314+0000","last_undegraded":"2024-09-12T19:23:22.853314+0000","last_fullsized":"2024-09-12T19:23:22.853314+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:22.852967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:22.852967+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.852967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:06.983644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'558","reported_seq":1240,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.683657+0000","last_change":"2024-09-12T19:23:30.683657+0000","last_active":"2024-09-12T19:23:30.683657+0000","last_peered":"2024-09-12T19:23:30.683657+0000","last_clean":"2024-09-12T19:23:30.683657+0000","last_became_active":"2024-09-12T17:29:58.778931+0000","last_became_peered":"2024-09-12T17:29:58.778931+0000","last_unstale":"2024-09-12T19:23:30.683657+0000","last_undegraded":"2024-09-12T19:23:30.683657+0000","last_fullsized":"2024-09-12T19:23:30.683657+0000","mapping_epoch":32,"log_start":"267'500","ondisk_log_start":"267'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'558","last_scrub_stamp":"2024-09-12T19:23:30.683533+0000","last_deep_scrub":"267'558","last_deep_scrub_stamp":"2024-09-12T19:23:30.683533+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.683533+0000","objects_scrubbed":6,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:58.234136+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":998,"num_read_kb":2327,"num_write":858,"num_write_kb":737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":515,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.304254+0000","last_change":"2024-09-12T19:23:38.304254+0000","last_active":"2024-09-12T19:23:38.304254+0000","last_peered":"2024-09-12T19:23:38.304254+0000","last_clean":"2024-09-12T19:23:38.304254+0000","last_became_active":"2024-09-12T17:30:00.802021+0000","last_became_peered":"2024-09-12T17:30:00.802021+0000","last_unstale":"2024-09-12T19:23:38.304254+0000","last_undegraded":"2024-09-12T19:23:38.304254+0000","last_fullsized":"2024-09-12T19:23:38.304254+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:38.304053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:38.304053+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.304053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:15.422600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'170","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:48.083731+0000","last_change":"2024-09-12T19:23:48.083441+0000","last_active":"2024-09-12T19:23:48.083731+0000","last_peered":"2024-09-12T19:23:48.083731+0000","last_clean":"2024-09-12T19:23:48.083731+0000","last_became_active":"2024-09-12T17:30:02.794353+0000","last_became_peered":"2024-09-12T17:30:02.794353+0000","last_unstale":"2024-09-12T19:23:48.083731+0000","last_undegraded":"2024-09-12T19:23:48.083731+0000","last_fullsized":"2024-09-12T19:23:48.083731+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'170","last_scrub_stamp":"2024-09-12T19:23:48.083116+0000","last_deep_scrub":"267'170","last_deep_scrub_stamp":"2024-09-12T19:23:48.083116+0000","last_clean_scrub_stamp":"2024-09-12T19:23:48.083116+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:59.342902+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":277,"num_read_kb":276,"num_write":376,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'726","reported_seq":2328,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.864233+0000","last_change":"2024-09-12T19:23:19.864092+0000","last_active":"2024-09-12T19:23:19.864233+0000","last_peered":"2024-09-12T19:23:19.864233+0000","last_clean":"2024-09-12T19:23:19.864233+0000","last_became_active":"2024-09-12T17:29:54.761144+0000","last_became_peered":"2024-09-12T17:29:54.761144+0000","last_unstale":"2024-09-12T19:23:19.864233+0000","last_undegraded":"2024-09-12T19:23:19.864233+0000","last_fullsized":"2024-09-12T19:23:19.864233+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'726","last_scrub_stamp":"2024-09-12T19:23:19.863911+0000","last_deep_scrub":"267'726","last_deep_scrub_stamp":"2024-09-12T19:23:19.863911+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.863911+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":700,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:39.862307+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3459,"num_read_kb":3076,"num_write":1006,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":514,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'309","reported_seq":936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.681801+0000","last_change":"2024-09-12T19:23:13.681650+0000","last_active":"2024-09-12T19:23:13.681801+0000","last_peered":"2024-09-12T19:23:13.681801+0000","last_clean":"2024-09-12T19:23:13.681801+0000","last_became_active":"2024-09-12T17:29:52.741594+0000","last_became_peered":"2024-09-12T17:29:52.741594+0000","last_unstale":"2024-09-12T19:23:13.681801+0000","last_undegraded":"2024-09-12T19:23:13.681801+0000","last_fullsized":"2024-09-12T19:23:13.681801+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'309","last_scrub_stamp":"2024-09-12T19:23:13.681397+0000","last_deep_scrub":"267'309","last_deep_scrub_stamp":"2024-09-12T19:23:13.681397+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.681397+0000","objects_scrubbed":9,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:35.606108+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262349,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":376,"num_read_kb":5602,"num_write":913,"num_write_kb":46297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.265670+0000","last_change":"2024-09-12T19:23:23.265670+0000","last_active":"2024-09-12T19:23:23.265670+0000","last_peered":"2024-09-12T19:23:23.265670+0000","last_clean":"2024-09-12T19:23:23.265670+0000","last_became_active":"2024-09-12T17:29:56.761256+0000","last_became_peered":"2024-09-12T17:29:56.761256+0000","last_unstale":"2024-09-12T19:23:23.265670+0000","last_undegraded":"2024-09-12T19:23:23.265670+0000","last_fullsized":"2024-09-12T19:23:23.265670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:23.265379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:23.265379+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.265379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:33:19.790842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'397","reported_seq":1049,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.125931+0000","last_change":"2024-09-12T19:23:37.125931+0000","last_active":"2024-09-12T19:23:37.125931+0000","last_peered":"2024-09-12T19:23:37.125931+0000","last_clean":"2024-09-12T19:23:37.125931+0000","last_became_active":"2024-09-12T17:29:58.768310+0000","last_became_peered":"2024-09-12T17:29:58.768310+0000","last_unstale":"2024-09-12T19:23:37.125931+0000","last_undegraded":"2024-09-12T19:23:37.125931+0000","last_fullsized":"2024-09-12T19:23:37.125931+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'397","last_scrub_stamp":"2024-09-12T19:23:37.125646+0000","last_deep_scrub":"267'397","last_deep_scrub_stamp":"2024-09-12T19:23:37.125646+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.125646+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:47:23.227590+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51217,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":641,"num_read_kb":1226,"num_write":524,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.632862+0000","last_change":"2024-09-12T19:23:31.632862+0000","last_active":"2024-09-12T19:23:31.632862+0000","last_peered":"2024-09-12T19:23:31.632862+0000","last_clean":"2024-09-12T19:23:31.632862+0000","last_became_active":"2024-09-12T17:30:00.804655+0000","last_became_peered":"2024-09-12T17:30:00.804655+0000","last_unstale":"2024-09-12T19:23:31.632862+0000","last_undegraded":"2024-09-12T19:23:31.632862+0000","last_fullsized":"2024-09-12T19:23:31.632862+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:31.632687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:31.632687+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.632687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:20.780508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'196","reported_seq":1105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.324949+0000","last_change":"2024-09-12T19:23:31.324814+0000","last_active":"2024-09-12T19:23:31.324949+0000","last_peered":"2024-09-12T19:23:31.324949+0000","last_clean":"2024-09-12T19:23:31.324949+0000","last_became_active":"2024-09-12T17:30:02.813027+0000","last_became_peered":"2024-09-12T17:30:02.813027+0000","last_unstale":"2024-09-12T19:23:31.324949+0000","last_undegraded":"2024-09-12T19:23:31.324949+0000","last_fullsized":"2024-09-12T19:23:31.324949+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'196","last_scrub_stamp":"2024-09-12T19:23:31.324602+0000","last_deep_scrub":"267'196","last_deep_scrub_stamp":"2024-09-12T19:23:31.324602+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.324602+0000","objects_scrubbed":7,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:38.755243+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2050,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":664,"num_read_kb":654,"num_write":538,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'392","reported_seq":1808,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:26.211401+0000","last_change":"2024-09-12T19:23:26.211401+0000","last_active":"2024-09-12T19:23:26.211401+0000","last_peered":"2024-09-12T19:23:26.211401+0000","last_clean":"2024-09-12T19:23:26.211401+0000","last_became_active":"2024-09-12T17:29:54.756800+0000","last_became_peered":"2024-09-12T17:29:54.756800+0000","last_unstale":"2024-09-12T19:23:26.211401+0000","last_undegraded":"2024-09-12T19:23:26.211401+0000","last_fullsized":"2024-09-12T19:23:26.211401+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'392","last_scrub_stamp":"2024-09-12T19:23:26.211201+0000","last_deep_scrub":"267'392","last_deep_scrub_stamp":"2024-09-12T19:23:26.211201+0000","last_clean_scrub_stamp":"2024-09-12T19:23:26.211201+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:17.864703+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1992,"num_read_kb":1877,"num_write":455,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'311","reported_seq":994,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.267339+0000","last_change":"2024-09-12T19:23:11.267339+0000","last_active":"2024-09-12T19:23:11.267339+0000","last_peered":"2024-09-12T19:23:11.267339+0000","last_clean":"2024-09-12T19:23:11.267339+0000","last_became_active":"2024-09-12T17:29:52.755401+0000","last_became_peered":"2024-09-12T17:29:52.755401+0000","last_unstale":"2024-09-12T19:23:11.267339+0000","last_undegraded":"2024-09-12T19:23:11.267339+0000","last_fullsized":"2024-09-12T19:23:11.267339+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'311","last_scrub_stamp":"2024-09-12T19:23:11.267078+0000","last_deep_scrub":"267'311","last_deep_scrub_stamp":"2024-09-12T19:23:11.267078+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.267078+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:12.277344+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2036176,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":3663,"num_write":1039,"num_write_kb":8455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.139454+0000","last_change":"2024-09-12T19:23:32.139454+0000","last_active":"2024-09-12T19:23:32.139454+0000","last_peered":"2024-09-12T19:23:32.139454+0000","last_clean":"2024-09-12T19:23:32.139454+0000","last_became_active":"2024-09-12T17:29:56.752172+0000","last_became_peered":"2024-09-12T17:29:56.752172+0000","last_unstale":"2024-09-12T19:23:32.139454+0000","last_undegraded":"2024-09-12T19:23:32.139454+0000","last_fullsized":"2024-09-12T19:23:32.139454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:32.139158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:32.139158+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.139158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:43:30.140657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'335","reported_seq":982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:40.081102+0000","last_change":"2024-09-12T19:23:40.081102+0000","last_active":"2024-09-12T19:23:40.081102+0000","last_peered":"2024-09-12T19:23:40.081102+0000","last_clean":"2024-09-12T19:23:40.081102+0000","last_became_active":"2024-09-12T17:29:58.831574+0000","last_became_peered":"2024-09-12T17:29:58.831574+0000","last_unstale":"2024-09-12T19:23:40.081102+0000","last_undegraded":"2024-09-12T19:23:40.081102+0000","last_fullsized":"2024-09-12T19:23:40.081102+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'335","last_scrub_stamp":"2024-09-12T19:23:40.080862+0000","last_deep_scrub":"267'335","last_deep_scrub_stamp":"2024-09-12T19:23:40.080862+0000","last_clean_scrub_stamp":"2024-09-12T19:23:40.080862+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:42.439444+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49155,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":530,"num_read_kb":1074,"num_write":414,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:34.638818+0000","last_change":"2024-09-12T19:23:34.638818+0000","last_active":"2024-09-12T19:23:34.638818+0000","last_peered":"2024-09-12T19:23:34.638818+0000","last_clean":"2024-09-12T19:23:34.638818+0000","last_became_active":"2024-09-12T17:30:00.804705+0000","last_became_peered":"2024-09-12T17:30:00.804705+0000","last_unstale":"2024-09-12T19:23:34.638818+0000","last_undegraded":"2024-09-12T19:23:34.638818+0000","last_fullsized":"2024-09-12T19:23:34.638818+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:34.638602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:34.638602+0000","last_clean_scrub_stamp":"2024-09-12T19:23:34.638602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:55.950770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'116","reported_seq":636,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.299661+0000","last_change":"2024-09-12T19:23:42.299498+0000","last_active":"2024-09-12T19:23:42.299661+0000","last_peered":"2024-09-12T19:23:42.299661+0000","last_clean":"2024-09-12T19:23:42.299661+0000","last_became_active":"2024-09-12T17:30:02.787038+0000","last_became_peered":"2024-09-12T17:30:02.787038+0000","last_unstale":"2024-09-12T19:23:42.299661+0000","last_undegraded":"2024-09-12T19:23:42.299661+0000","last_fullsized":"2024-09-12T19:23:42.299661+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'116","last_scrub_stamp":"2024-09-12T19:23:42.299293+0000","last_deep_scrub":"267'116","last_deep_scrub_stamp":"2024-09-12T19:23:42.299293+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.299293+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:02.765312+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":121,"num_write":252,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'361","reported_seq":1899,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.987483+0000","last_change":"2024-09-12T19:23:14.987483+0000","last_active":"2024-09-12T19:23:14.987483+0000","last_peered":"2024-09-12T19:23:14.987483+0000","last_clean":"2024-09-12T19:23:14.987483+0000","last_became_active":"2024-09-12T17:29:54.741486+0000","last_became_peered":"2024-09-12T17:29:54.741486+0000","last_unstale":"2024-09-12T19:23:14.987483+0000","last_undegraded":"2024-09-12T19:23:14.987483+0000","last_fullsized":"2024-09-12T19:23:14.987483+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'361","last_scrub_stamp":"2024-09-12T19:23:14.987293+0000","last_deep_scrub":"267'361","last_deep_scrub_stamp":"2024-09-12T19:23:14.987293+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.987293+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:37.939163+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1958,"num_read_kb":1901,"num_write":388,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'318","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.907394+0000","last_change":"2024-09-12T19:23:12.907394+0000","last_active":"2024-09-12T19:23:12.907394+0000","last_peered":"2024-09-12T19:23:12.907394+0000","last_clean":"2024-09-12T19:23:12.907394+0000","last_became_active":"2024-09-12T17:29:52.766141+0000","last_became_peered":"2024-09-12T17:29:52.766141+0000","last_unstale":"2024-09-12T19:23:12.907394+0000","last_undegraded":"2024-09-12T19:23:12.907394+0000","last_fullsized":"2024-09-12T19:23:12.907394+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'318","last_scrub_stamp":"2024-09-12T19:23:12.907122+0000","last_deep_scrub":"267'318","last_deep_scrub_stamp":"2024-09-12T19:23:12.907122+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.907122+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:49.071217+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7320708,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":562,"num_read_kb":101880,"num_write":1008,"num_write_kb":18651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"267'6","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.726938+0000","last_change":"2024-09-12T19:23:27.726938+0000","last_active":"2024-09-12T19:23:27.726938+0000","last_peered":"2024-09-12T19:23:27.726938+0000","last_clean":"2024-09-12T19:23:27.726938+0000","last_became_active":"2024-09-12T17:29:56.760505+0000","last_became_peered":"2024-09-12T17:29:56.760505+0000","last_unstale":"2024-09-12T19:23:27.726938+0000","last_undegraded":"2024-09-12T19:23:27.726938+0000","last_fullsized":"2024-09-12T19:23:27.726938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-12T19:23:27.726750+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-12T19:23:27.726750+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.726750+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:36.263576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'177","reported_seq":778,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.118628+0000","last_change":"2024-09-12T19:23:36.118490+0000","last_active":"2024-09-12T19:23:36.118628+0000","last_peered":"2024-09-12T19:23:36.118628+0000","last_clean":"2024-09-12T19:23:36.118628+0000","last_became_active":"2024-09-12T17:29:58.829023+0000","last_became_peered":"2024-09-12T17:29:58.829023+0000","last_unstale":"2024-09-12T19:23:36.118628+0000","last_undegraded":"2024-09-12T19:23:36.118628+0000","last_fullsized":"2024-09-12T19:23:36.118628+0000","mapping_epoch":32,"log_start":"267'100","ondisk_log_start":"267'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'177","last_scrub_stamp":"2024-09-12T19:23:36.118299+0000","last_deep_scrub":"267'177","last_deep_scrub_stamp":"2024-09-12T19:23:36.118299+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.118299+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:05.647435+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":225,"num_read_kb":218,"num_write":206,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19254,"num_omap_keys":52,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'775","reported_seq":3300,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:29.237657+0000","last_change":"2024-09-12T19:23:29.237657+0000","last_active":"2024-09-12T19:23:29.237657+0000","last_peered":"2024-09-12T19:23:29.237657+0000","last_clean":"2024-09-12T19:23:29.237657+0000","last_became_active":"2024-09-12T17:30:00.786102+0000","last_became_peered":"2024-09-12T17:30:00.786102+0000","last_unstale":"2024-09-12T19:23:29.237657+0000","last_undegraded":"2024-09-12T19:23:29.237657+0000","last_fullsized":"2024-09-12T19:23:29.237657+0000","mapping_epoch":34,"log_start":"267'700","ondisk_log_start":"267'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'775","last_scrub_stamp":"2024-09-12T19:23:29.237474+0000","last_deep_scrub":"267'775","last_deep_scrub_stamp":"2024-09-12T19:23:29.237474+0000","last_clean_scrub_stamp":"2024-09-12T19:23:29.237474+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:49.117833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'149","reported_seq":686,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.123811+0000","last_change":"2024-09-12T19:23:41.123673+0000","last_active":"2024-09-12T19:23:41.123811+0000","last_peered":"2024-09-12T19:23:41.123811+0000","last_clean":"2024-09-12T19:23:41.123811+0000","last_became_active":"2024-09-12T17:30:02.803612+0000","last_became_peered":"2024-09-12T17:30:02.803612+0000","last_unstale":"2024-09-12T19:23:41.123811+0000","last_undegraded":"2024-09-12T19:23:41.123811+0000","last_fullsized":"2024-09-12T19:23:41.123811+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'149","last_scrub_stamp":"2024-09-12T19:23:41.123471+0000","last_deep_scrub":"267'149","last_deep_scrub_stamp":"2024-09-12T19:23:41.123471+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.123471+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:28.596544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":232,"num_read_kb":219,"num_write":373,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'828","reported_seq":2559,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.291568+0000","last_change":"2024-09-12T19:23:22.291568+0000","last_active":"2024-09-12T19:23:22.291568+0000","last_peered":"2024-09-12T19:23:22.291568+0000","last_clean":"2024-09-12T19:23:22.291568+0000","last_became_active":"2024-09-12T17:30:21.696952+0000","last_became_peered":"2024-09-12T17:30:21.696952+0000","last_unstale":"2024-09-12T19:23:22.291568+0000","last_undegraded":"2024-09-12T19:23:22.291568+0000","last_fullsized":"2024-09-12T19:23:22.291568+0000","mapping_epoch":39,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'828","last_scrub_stamp":"2024-09-12T19:23:22.291363+0000","last_deep_scrub":"267'828","last_deep_scrub_stamp":"2024-09-12T19:23:22.291363+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.291363+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:50.049566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3950,"num_read_kb":3589,"num_write":1060,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'353","reported_seq":1080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.268016+0000","last_change":"2024-09-12T19:23:13.268016+0000","last_active":"2024-09-12T19:23:13.268016+0000","last_peered":"2024-09-12T19:23:13.268016+0000","last_clean":"2024-09-12T19:23:13.268016+0000","last_became_active":"2024-09-12T17:29:52.749735+0000","last_became_peered":"2024-09-12T17:29:52.749735+0000","last_unstale":"2024-09-12T19:23:13.268016+0000","last_undegraded":"2024-09-12T19:23:13.268016+0000","last_fullsized":"2024-09-12T19:23:13.268016+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'353","last_scrub_stamp":"2024-09-12T19:23:13.267796+0000","last_deep_scrub":"267'353","last_deep_scrub_stamp":"2024-09-12T19:23:13.267796+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.267796+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:59.721962+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":437125,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":613,"num_read_kb":46392,"num_write":1072,"num_write_kb":51525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.090461+0000","last_change":"2024-09-12T19:23:28.090461+0000","last_active":"2024-09-12T19:23:28.090461+0000","last_peered":"2024-09-12T19:23:28.090461+0000","last_clean":"2024-09-12T19:23:28.090461+0000","last_became_active":"2024-09-12T17:29:56.765909+0000","last_became_peered":"2024-09-12T17:29:56.765909+0000","last_unstale":"2024-09-12T19:23:28.090461+0000","last_undegraded":"2024-09-12T19:23:28.090461+0000","last_fullsized":"2024-09-12T19:23:28.090461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:28.090285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:28.090285+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.090285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:57.757362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'395","reported_seq":1050,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:36.255478+0000","last_change":"2024-09-12T19:23:36.255290+0000","last_active":"2024-09-12T19:23:36.255478+0000","last_peered":"2024-09-12T19:23:36.255478+0000","last_clean":"2024-09-12T19:23:36.255478+0000","last_became_active":"2024-09-12T17:29:58.771522+0000","last_became_peered":"2024-09-12T17:29:58.771522+0000","last_unstale":"2024-09-12T19:23:36.255478+0000","last_undegraded":"2024-09-12T19:23:36.255478+0000","last_fullsized":"2024-09-12T19:23:36.255478+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'395","last_scrub_stamp":"2024-09-12T19:23:36.255087+0000","last_deep_scrub":"267'395","last_deep_scrub_stamp":"2024-09-12T19:23:36.255087+0000","last_clean_scrub_stamp":"2024-09-12T19:23:36.255087+0000","objects_scrubbed":9,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:57:56.975938+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46902,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":612,"num_read_kb":1188,"num_write":476,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:37.745370+0000","last_change":"2024-09-12T19:23:37.745186+0000","last_active":"2024-09-12T19:23:37.745370+0000","last_peered":"2024-09-12T19:23:37.745370+0000","last_clean":"2024-09-12T19:23:37.745370+0000","last_became_active":"2024-09-12T17:30:00.788559+0000","last_became_peered":"2024-09-12T17:30:00.788559+0000","last_unstale":"2024-09-12T19:23:37.745370+0000","last_undegraded":"2024-09-12T19:23:37.745370+0000","last_fullsized":"2024-09-12T19:23:37.745370+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:37.745001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:37.745001+0000","last_clean_scrub_stamp":"2024-09-12T19:23:37.745001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:17.916393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'119","reported_seq":643,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:43.130433+0000","last_change":"2024-09-12T19:23:43.130433+0000","last_active":"2024-09-12T19:23:43.130433+0000","last_peered":"2024-09-12T19:23:43.130433+0000","last_clean":"2024-09-12T19:23:43.130433+0000","last_became_active":"2024-09-12T17:30:02.807083+0000","last_became_peered":"2024-09-12T17:30:02.807083+0000","last_unstale":"2024-09-12T19:23:43.130433+0000","last_undegraded":"2024-09-12T19:23:43.130433+0000","last_fullsized":"2024-09-12T19:23:43.130433+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'119","last_scrub_stamp":"2024-09-12T19:23:43.130241+0000","last_deep_scrub":"267'119","last_deep_scrub_stamp":"2024-09-12T19:23:43.130241+0000","last_clean_scrub_stamp":"2024-09-12T19:23:43.130241+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:38.514554+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":147,"num_write":283,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'827","reported_seq":2508,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.266912+0000","last_change":"2024-09-12T19:23:19.266912+0000","last_active":"2024-09-12T19:23:19.266912+0000","last_peered":"2024-09-12T19:23:19.266912+0000","last_clean":"2024-09-12T19:23:19.266912+0000","last_became_active":"2024-09-12T17:29:54.770569+0000","last_became_peered":"2024-09-12T17:29:54.770569+0000","last_unstale":"2024-09-12T19:23:19.266912+0000","last_undegraded":"2024-09-12T19:23:19.266912+0000","last_fullsized":"2024-09-12T19:23:19.266912+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'827","last_scrub_stamp":"2024-09-12T19:23:19.266750+0000","last_deep_scrub":"267'827","last_deep_scrub_stamp":"2024-09-12T19:23:19.266750+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.266750+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":800,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:38.162790+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4029,"num_read_kb":3656,"num_write":1088,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'392","reported_seq":1307,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.263333+0000","last_change":"2024-09-12T19:23:14.263333+0000","last_active":"2024-09-12T19:23:14.263333+0000","last_peered":"2024-09-12T19:23:14.263333+0000","last_clean":"2024-09-12T19:23:14.263333+0000","last_became_active":"2024-09-12T17:29:52.749566+0000","last_became_peered":"2024-09-12T17:29:52.749566+0000","last_unstale":"2024-09-12T19:23:14.263333+0000","last_undegraded":"2024-09-12T19:23:14.263333+0000","last_fullsized":"2024-09-12T19:23:14.263333+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'392","last_scrub_stamp":"2024-09-12T19:23:14.262990+0000","last_deep_scrub":"267'392","last_deep_scrub_stamp":"2024-09-12T19:23:14.262990+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.262990+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:34.154250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174738,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1171,"num_read_kb":8659,"num_write":1266,"num_write_kb":49806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:32.312529+0000","last_change":"2024-09-12T19:23:32.312529+0000","last_active":"2024-09-12T19:23:32.312529+0000","last_peered":"2024-09-12T19:23:32.312529+0000","last_clean":"2024-09-12T19:23:32.312529+0000","last_became_active":"2024-09-12T17:29:56.766952+0000","last_became_peered":"2024-09-12T17:29:56.766952+0000","last_unstale":"2024-09-12T19:23:32.312529+0000","last_undegraded":"2024-09-12T19:23:32.312529+0000","last_fullsized":"2024-09-12T19:23:32.312529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:32.312212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:32.312212+0000","last_clean_scrub_stamp":"2024-09-12T19:23:32.312212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:54.904863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'326","reported_seq":951,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:30.811618+0000","last_change":"2024-09-12T19:23:30.811448+0000","last_active":"2024-09-12T19:23:30.811618+0000","last_peered":"2024-09-12T19:23:30.811618+0000","last_clean":"2024-09-12T19:23:30.811618+0000","last_became_active":"2024-09-12T17:29:58.783105+0000","last_became_peered":"2024-09-12T17:29:58.783105+0000","last_unstale":"2024-09-12T19:23:30.811618+0000","last_undegraded":"2024-09-12T19:23:30.811618+0000","last_fullsized":"2024-09-12T19:23:30.811618+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'326","last_scrub_stamp":"2024-09-12T19:23:30.811250+0000","last_deep_scrub":"267'326","last_deep_scrub_stamp":"2024-09-12T19:23:30.811250+0000","last_clean_scrub_stamp":"2024-09-12T19:23:30.811250+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:03.247001+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50641,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":544,"num_read_kb":1206,"num_write":440,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.240857+0000","last_change":"2024-09-12T19:23:28.240737+0000","last_active":"2024-09-12T19:23:28.240857+0000","last_peered":"2024-09-12T19:23:28.240857+0000","last_clean":"2024-09-12T19:23:28.240857+0000","last_became_active":"2024-09-12T17:30:00.799680+0000","last_became_peered":"2024-09-12T17:30:00.799680+0000","last_unstale":"2024-09-12T19:23:28.240857+0000","last_undegraded":"2024-09-12T19:23:28.240857+0000","last_fullsized":"2024-09-12T19:23:28.240857+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:28.240549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:28.240549+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.240549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:11.520672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'131","reported_seq":694,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:50.005120+0000","last_change":"2024-09-12T19:23:50.005120+0000","last_active":"2024-09-12T19:23:50.005120+0000","last_peered":"2024-09-12T19:23:50.005120+0000","last_clean":"2024-09-12T19:23:50.005120+0000","last_became_active":"2024-09-12T17:30:02.786478+0000","last_became_peered":"2024-09-12T17:30:02.786478+0000","last_unstale":"2024-09-12T19:23:50.005120+0000","last_undegraded":"2024-09-12T19:23:50.005120+0000","last_fullsized":"2024-09-12T19:23:50.005120+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'131","last_scrub_stamp":"2024-09-12T19:23:50.004880+0000","last_deep_scrub":"267'131","last_deep_scrub_stamp":"2024-09-12T19:23:50.004880+0000","last_clean_scrub_stamp":"2024-09-12T19:23:50.004880+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:00.094824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":240,"num_read_kb":229,"num_write":300,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'980","reported_seq":2772,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.198669+0000","last_change":"2024-09-12T19:23:25.198525+0000","last_active":"2024-09-12T19:23:25.198669+0000","last_peered":"2024-09-12T19:23:25.198669+0000","last_clean":"2024-09-12T19:23:25.198669+0000","last_became_active":"2024-09-12T17:29:54.761902+0000","last_became_peered":"2024-09-12T17:29:54.761902+0000","last_unstale":"2024-09-12T19:23:25.198669+0000","last_undegraded":"2024-09-12T19:23:25.198669+0000","last_fullsized":"2024-09-12T19:23:25.198669+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'980","last_scrub_stamp":"2024-09-12T19:23:25.198333+0000","last_deep_scrub":"267'980","last_deep_scrub_stamp":"2024-09-12T19:23:25.198333+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.198333+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":900,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:20.662236+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4608,"num_read_kb":4133,"num_write":1300,"num_write_kb":487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'320","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.200845+0000","last_change":"2024-09-12T19:23:12.200680+0000","last_active":"2024-09-12T19:23:12.200845+0000","last_peered":"2024-09-12T19:23:12.200845+0000","last_clean":"2024-09-12T19:23:12.200845+0000","last_became_active":"2024-09-12T17:29:52.733119+0000","last_became_peered":"2024-09-12T17:29:52.733119+0000","last_unstale":"2024-09-12T19:23:12.200845+0000","last_undegraded":"2024-09-12T19:23:12.200845+0000","last_fullsized":"2024-09-12T19:23:12.200845+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'320","last_scrub_stamp":"2024-09-12T19:23:12.200496+0000","last_deep_scrub":"267'320","last_deep_scrub_stamp":"2024-09-12T19:23:12.200496+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.200496+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:46:12.257376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":457,"num_read_kb":1565,"num_write":1142,"num_write_kb":34702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.168583+0000","last_change":"2024-09-12T19:23:31.168431+0000","last_active":"2024-09-12T19:23:31.168583+0000","last_peered":"2024-09-12T19:23:31.168583+0000","last_clean":"2024-09-12T19:23:31.168583+0000","last_became_active":"2024-09-12T17:29:56.760142+0000","last_became_peered":"2024-09-12T17:29:56.760142+0000","last_unstale":"2024-09-12T19:23:31.168583+0000","last_undegraded":"2024-09-12T19:23:31.168583+0000","last_fullsized":"2024-09-12T19:23:31.168583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:31.168254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:31.168254+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.168254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:15.851026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'277","reported_seq":879,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.111704+0000","last_change":"2024-09-12T19:23:39.111704+0000","last_active":"2024-09-12T19:23:39.111704+0000","last_peered":"2024-09-12T19:23:39.111704+0000","last_clean":"2024-09-12T19:23:39.111704+0000","last_became_active":"2024-09-12T17:29:58.775284+0000","last_became_peered":"2024-09-12T17:29:58.775284+0000","last_unstale":"2024-09-12T19:23:39.111704+0000","last_undegraded":"2024-09-12T19:23:39.111704+0000","last_fullsized":"2024-09-12T19:23:39.111704+0000","mapping_epoch":32,"log_start":"267'200","ondisk_log_start":"267'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'277","last_scrub_stamp":"2024-09-12T19:23:39.111503+0000","last_deep_scrub":"267'277","last_deep_scrub_stamp":"2024-09-12T19:23:39.111503+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.111503+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:22.116876+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44259,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":428,"num_read_kb":949,"num_write":354,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:39.041777+0000","last_change":"2024-09-12T19:23:39.041777+0000","last_active":"2024-09-12T19:23:39.041777+0000","last_peered":"2024-09-12T19:23:39.041777+0000","last_clean":"2024-09-12T19:23:39.041777+0000","last_became_active":"2024-09-12T17:30:00.790907+0000","last_became_peered":"2024-09-12T17:30:00.790907+0000","last_unstale":"2024-09-12T19:23:39.041777+0000","last_undegraded":"2024-09-12T19:23:39.041777+0000","last_fullsized":"2024-09-12T19:23:39.041777+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:39.041590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:39.041590+0000","last_clean_scrub_stamp":"2024-09-12T19:23:39.041590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:32.005106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'159","reported_seq":1282,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:42.098132+0000","last_change":"2024-09-12T19:23:42.098132+0000","last_active":"2024-09-12T19:23:42.098132+0000","last_peered":"2024-09-12T19:23:42.098132+0000","last_clean":"2024-09-12T19:23:42.098132+0000","last_became_active":"2024-09-12T17:30:02.812918+0000","last_became_peered":"2024-09-12T17:30:02.812918+0000","last_unstale":"2024-09-12T19:23:42.098132+0000","last_undegraded":"2024-09-12T19:23:42.098132+0000","last_fullsized":"2024-09-12T19:23:42.098132+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'159","last_scrub_stamp":"2024-09-12T19:23:42.097958+0000","last_deep_scrub":"267'159","last_deep_scrub_stamp":"2024-09-12T19:23:42.097958+0000","last_clean_scrub_stamp":"2024-09-12T19:23:42.097958+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:02.263716+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":804,"num_read_kb":804,"num_write":370,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'758","reported_seq":2297,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:20.236980+0000","last_change":"2024-09-12T19:23:20.236818+0000","last_active":"2024-09-12T19:23:20.236980+0000","last_peered":"2024-09-12T19:23:20.236980+0000","last_clean":"2024-09-12T19:23:20.236980+0000","last_became_active":"2024-09-12T17:29:54.767573+0000","last_became_peered":"2024-09-12T17:29:54.767573+0000","last_unstale":"2024-09-12T19:23:20.236980+0000","last_undegraded":"2024-09-12T19:23:20.236980+0000","last_fullsized":"2024-09-12T19:23:20.236980+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'758","last_scrub_stamp":"2024-09-12T19:23:20.236638+0000","last_deep_scrub":"267'758","last_deep_scrub_stamp":"2024-09-12T19:23:20.236638+0000","last_clean_scrub_stamp":"2024-09-12T19:23:20.236638+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:45.825300+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3552,"num_read_kb":3227,"num_write":976,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'365","reported_seq":1235,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:07.926075+0000","last_change":"2024-09-12T19:23:07.925988+0000","last_active":"2024-09-12T19:23:07.926075+0000","last_peered":"2024-09-12T19:23:07.926075+0000","last_clean":"2024-09-12T19:23:07.926075+0000","last_became_active":"2024-09-12T17:29:52.765692+0000","last_became_peered":"2024-09-12T17:29:52.765692+0000","last_unstale":"2024-09-12T19:23:07.926075+0000","last_undegraded":"2024-09-12T19:23:07.926075+0000","last_fullsized":"2024-09-12T19:23:07.926075+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'365","last_scrub_stamp":"2024-09-12T19:23:07.925864+0000","last_deep_scrub":"267'365","last_deep_scrub_stamp":"2024-09-12T19:23:07.925864+0000","last_clean_scrub_stamp":"2024-09-12T19:23:07.925864+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:17.489429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110874,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":771,"num_read_kb":82698,"num_write":1110,"num_write_kb":56258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"267'2","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.681416+0000","last_change":"2024-09-12T19:23:23.681287+0000","last_active":"2024-09-12T19:23:23.681416+0000","last_peered":"2024-09-12T19:23:23.681416+0000","last_clean":"2024-09-12T19:23:23.681416+0000","last_became_active":"2024-09-12T17:29:56.760345+0000","last_became_peered":"2024-09-12T17:29:56.760345+0000","last_unstale":"2024-09-12T19:23:23.681416+0000","last_undegraded":"2024-09-12T19:23:23.681416+0000","last_fullsized":"2024-09-12T19:23:23.681416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-12T19:23:23.681094+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-12T19:23:23.681094+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.681094+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:25:13.124487+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'348","reported_seq":991,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.088295+0000","last_change":"2024-09-12T19:23:38.088295+0000","last_active":"2024-09-12T19:23:38.088295+0000","last_peered":"2024-09-12T19:23:38.088295+0000","last_clean":"2024-09-12T19:23:38.088295+0000","last_became_active":"2024-09-12T17:29:58.768812+0000","last_became_peered":"2024-09-12T17:29:58.768812+0000","last_unstale":"2024-09-12T19:23:38.088295+0000","last_undegraded":"2024-09-12T19:23:38.088295+0000","last_fullsized":"2024-09-12T19:23:38.088295+0000","mapping_epoch":32,"log_start":"267'300","ondisk_log_start":"267'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'348","last_scrub_stamp":"2024-09-12T19:23:38.088049+0000","last_deep_scrub":"267'348","last_deep_scrub_stamp":"2024-09-12T19:23:38.088049+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.088049+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:45.131291+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46003,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1072,"num_write":420,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:38.733889+0000","last_change":"2024-09-12T19:23:38.733889+0000","last_active":"2024-09-12T19:23:38.733889+0000","last_peered":"2024-09-12T19:23:38.733889+0000","last_clean":"2024-09-12T19:23:38.733889+0000","last_became_active":"2024-09-12T17:30:00.786100+0000","last_became_peered":"2024-09-12T17:30:00.786100+0000","last_unstale":"2024-09-12T19:23:38.733889+0000","last_undegraded":"2024-09-12T19:23:38.733889+0000","last_fullsized":"2024-09-12T19:23:38.733889+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:23:38.733659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:23:38.733659+0000","last_clean_scrub_stamp":"2024-09-12T19:23:38.733659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:13.838209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'141","reported_seq":682,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:41.038822+0000","last_change":"2024-09-12T19:23:41.038822+0000","last_active":"2024-09-12T19:23:41.038822+0000","last_peered":"2024-09-12T19:23:41.038822+0000","last_clean":"2024-09-12T19:23:41.038822+0000","last_became_active":"2024-09-12T17:30:02.807953+0000","last_became_peered":"2024-09-12T17:30:02.807953+0000","last_unstale":"2024-09-12T19:23:41.038822+0000","last_undegraded":"2024-09-12T19:23:41.038822+0000","last_fullsized":"2024-09-12T19:23:41.038822+0000","mapping_epoch":36,"log_start":"267'100","ondisk_log_start":"267'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-09-12T19:23:41.038597+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-09-12T19:23:41.038597+0000","last_clean_scrub_stamp":"2024-09-12T19:23:41.038597+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:28.809543+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216,"num_read_kb":199,"num_write":346,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'853","reported_seq":2473,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.709674+0000","last_change":"2024-09-12T19:23:19.709674+0000","last_active":"2024-09-12T19:23:19.709674+0000","last_peered":"2024-09-12T19:23:19.709674+0000","last_clean":"2024-09-12T19:23:19.709674+0000","last_became_active":"2024-09-12T17:29:54.768439+0000","last_became_peered":"2024-09-12T17:29:54.768439+0000","last_unstale":"2024-09-12T19:23:19.709674+0000","last_undegraded":"2024-09-12T19:23:19.709674+0000","last_fullsized":"2024-09-12T19:23:19.709674+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'853","last_scrub_stamp":"2024-09-12T19:23:19.709485+0000","last_deep_scrub":"267'853","last_deep_scrub_stamp":"2024-09-12T19:23:19.709485+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.709485+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:38.560571+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3940,"num_read_kb":3539,"num_write":1104,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'384","reported_seq":1083,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.154939+0000","last_change":"2024-09-12T19:23:12.154790+0000","last_active":"2024-09-12T19:23:12.154939+0000","last_peered":"2024-09-12T19:23:12.154939+0000","last_clean":"2024-09-12T19:23:12.154939+0000","last_became_active":"2024-09-12T17:29:52.732894+0000","last_became_peered":"2024-09-12T17:29:52.732894+0000","last_unstale":"2024-09-12T19:23:12.154939+0000","last_undegraded":"2024-09-12T19:23:12.154939+0000","last_fullsized":"2024-09-12T19:23:12.154939+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'384","last_scrub_stamp":"2024-09-12T19:23:12.154565+0000","last_deep_scrub":"267'384","last_deep_scrub_stamp":"2024-09-12T19:23:12.154565+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.154565+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:40:11.123992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":583,"num_read_kb":27715,"num_write":1278,"num_write_kb":46649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'496","reported_seq":1995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.698567+0000","last_change":"2024-09-12T19:23:21.698567+0000","last_active":"2024-09-12T19:23:21.698567+0000","last_peered":"2024-09-12T19:23:21.698567+0000","last_clean":"2024-09-12T19:23:21.698567+0000","last_became_active":"2024-09-12T17:29:54.745192+0000","last_became_peered":"2024-09-12T17:29:54.745192+0000","last_unstale":"2024-09-12T19:23:21.698567+0000","last_undegraded":"2024-09-12T19:23:21.698567+0000","last_fullsized":"2024-09-12T19:23:21.698567+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'496","last_scrub_stamp":"2024-09-12T19:23:21.698347+0000","last_deep_scrub":"267'496","last_deep_scrub_stamp":"2024-09-12T19:23:21.698347+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.698347+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:41.917668+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2446,"num_read_kb":2266,"num_write":619,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'407","reported_seq":1150,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.950803+0000","last_change":"2024-09-12T19:23:15.950490+0000","last_active":"2024-09-12T19:23:15.950803+0000","last_peered":"2024-09-12T19:23:15.950803+0000","last_clean":"2024-09-12T19:23:15.950803+0000","last_became_active":"2024-09-12T17:29:52.727433+0000","last_became_peered":"2024-09-12T17:29:52.727433+0000","last_unstale":"2024-09-12T19:23:15.950803+0000","last_undegraded":"2024-09-12T19:23:15.950803+0000","last_fullsized":"2024-09-12T19:23:15.950803+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'407","last_scrub_stamp":"2024-09-12T19:23:15.950082+0000","last_deep_scrub":"267'407","last_deep_scrub_stamp":"2024-09-12T19:23:15.950082+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.950082+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:52.289398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":690,"num_read_kb":95087,"num_write":1289,"num_write_kb":35037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'394","reported_seq":1973,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.345761+0000","last_change":"2024-09-12T19:23:23.345761+0000","last_active":"2024-09-12T19:23:23.345761+0000","last_peered":"2024-09-12T19:23:23.345761+0000","last_clean":"2024-09-12T19:23:23.345761+0000","last_became_active":"2024-09-12T17:29:54.762400+0000","last_became_peered":"2024-09-12T17:29:54.762400+0000","last_unstale":"2024-09-12T19:23:23.345761+0000","last_undegraded":"2024-09-12T19:23:23.345761+0000","last_fullsized":"2024-09-12T19:23:23.345761+0000","mapping_epoch":28,"log_start":"267'300","ondisk_log_start":"267'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'394","last_scrub_stamp":"2024-09-12T19:23:23.345516+0000","last_deep_scrub":"267'394","last_deep_scrub_stamp":"2024-09-12T19:23:23.345516+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.345516+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:40.023760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2164,"num_read_kb":2073,"num_write":429,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'404","reported_seq":1129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.285697+0000","last_change":"2024-09-12T19:23:16.285536+0000","last_active":"2024-09-12T19:23:16.285697+0000","last_peered":"2024-09-12T19:23:16.285697+0000","last_clean":"2024-09-12T19:23:16.285697+0000","last_became_active":"2024-09-12T17:29:52.756626+0000","last_became_peered":"2024-09-12T17:29:52.756626+0000","last_unstale":"2024-09-12T19:23:16.285697+0000","last_undegraded":"2024-09-12T19:23:16.285697+0000","last_fullsized":"2024-09-12T19:23:16.285697+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'404","last_scrub_stamp":"2024-09-12T19:23:16.285300+0000","last_deep_scrub":"267'404","last_deep_scrub_stamp":"2024-09-12T19:23:16.285300+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.285300+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:58.905956+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":688,"num_read_kb":25414,"num_write":1427,"num_write_kb":18603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'785","reported_seq":2463,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:22.706702+0000","last_change":"2024-09-12T19:23:22.706702+0000","last_active":"2024-09-12T19:23:22.706702+0000","last_peered":"2024-09-12T19:23:22.706702+0000","last_clean":"2024-09-12T19:23:22.706702+0000","last_became_active":"2024-09-12T17:29:54.749249+0000","last_became_peered":"2024-09-12T17:29:54.749249+0000","last_unstale":"2024-09-12T19:23:22.706702+0000","last_undegraded":"2024-09-12T19:23:22.706702+0000","last_fullsized":"2024-09-12T19:23:22.706702+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'785","last_scrub_stamp":"2024-09-12T19:23:22.706520+0000","last_deep_scrub":"267'785","last_deep_scrub_stamp":"2024-09-12T19:23:22.706520+0000","last_clean_scrub_stamp":"2024-09-12T19:23:22.706520+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:51.140029+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3916,"num_read_kb":3572,"num_write":1026,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2553,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'306","reported_seq":967,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.917382+0000","last_change":"2024-09-12T19:23:14.917382+0000","last_active":"2024-09-12T19:23:14.917382+0000","last_peered":"2024-09-12T19:23:14.917382+0000","last_clean":"2024-09-12T19:23:14.917382+0000","last_became_active":"2024-09-12T17:29:52.767047+0000","last_became_peered":"2024-09-12T17:29:52.767047+0000","last_unstale":"2024-09-12T19:23:14.917382+0000","last_undegraded":"2024-09-12T19:23:14.917382+0000","last_fullsized":"2024-09-12T19:23:14.917382+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'306","last_scrub_stamp":"2024-09-12T19:23:14.916990+0000","last_deep_scrub":"267'306","last_deep_scrub_stamp":"2024-09-12T19:23:14.916990+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.916990+0000","objects_scrubbed":7,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:55.549231+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1900516,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":422,"num_read_kb":21273,"num_write":1050,"num_write_kb":35522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'495","reported_seq":2164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:28.149430+0000","last_change":"2024-09-12T19:23:28.149430+0000","last_active":"2024-09-12T19:23:28.149430+0000","last_peered":"2024-09-12T19:23:28.149430+0000","last_clean":"2024-09-12T19:23:28.149430+0000","last_became_active":"2024-09-12T17:29:54.762667+0000","last_became_peered":"2024-09-12T17:29:54.762667+0000","last_unstale":"2024-09-12T19:23:28.149430+0000","last_undegraded":"2024-09-12T19:23:28.149430+0000","last_fullsized":"2024-09-12T19:23:28.149430+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'495","last_scrub_stamp":"2024-09-12T19:23:28.149234+0000","last_deep_scrub":"267'495","last_deep_scrub_stamp":"2024-09-12T19:23:28.149234+0000","last_clean_scrub_stamp":"2024-09-12T19:23:28.149234+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:49.849143+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2506,"num_read_kb":2365,"num_write":559,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'353","reported_seq":1041,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.110866+0000","last_change":"2024-09-12T19:23:16.110866+0000","last_active":"2024-09-12T19:23:16.110866+0000","last_peered":"2024-09-12T19:23:16.110866+0000","last_clean":"2024-09-12T19:23:16.110866+0000","last_became_active":"2024-09-12T17:29:52.765692+0000","last_became_peered":"2024-09-12T17:29:52.765692+0000","last_unstale":"2024-09-12T19:23:16.110866+0000","last_undegraded":"2024-09-12T19:23:16.110866+0000","last_fullsized":"2024-09-12T19:23:16.110866+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'353","last_scrub_stamp":"2024-09-12T19:23:16.110496+0000","last_deep_scrub":"267'353","last_deep_scrub_stamp":"2024-09-12T19:23:16.110496+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.110496+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:11.327254+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992395,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":536,"num_read_kb":21751,"num_write":1010,"num_write_kb":25522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'962","reported_seq":2744,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.252068+0000","last_change":"2024-09-12T19:23:24.252068+0000","last_active":"2024-09-12T19:23:24.252068+0000","last_peered":"2024-09-12T19:23:24.252068+0000","last_clean":"2024-09-12T19:23:24.252068+0000","last_became_active":"2024-09-12T17:29:54.769223+0000","last_became_peered":"2024-09-12T17:29:54.769223+0000","last_unstale":"2024-09-12T19:23:24.252068+0000","last_undegraded":"2024-09-12T19:23:24.252068+0000","last_fullsized":"2024-09-12T19:23:24.252068+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'962","last_scrub_stamp":"2024-09-12T19:23:24.251880+0000","last_deep_scrub":"267'962","last_deep_scrub_stamp":"2024-09-12T19:23:24.251880+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.251880+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":900,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:59:09.231713+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4532,"num_read_kb":4067,"num_write":1265,"num_write_kb":473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'312","reported_seq":986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:09.658326+0000","last_change":"2024-09-12T19:23:09.658326+0000","last_active":"2024-09-12T19:23:09.658326+0000","last_peered":"2024-09-12T19:23:09.658326+0000","last_clean":"2024-09-12T19:23:09.658326+0000","last_became_active":"2024-09-12T17:29:52.728523+0000","last_became_peered":"2024-09-12T17:29:52.728523+0000","last_unstale":"2024-09-12T19:23:09.658326+0000","last_undegraded":"2024-09-12T19:23:09.658326+0000","last_fullsized":"2024-09-12T19:23:09.658326+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'312","last_scrub_stamp":"2024-09-12T19:23:09.658187+0000","last_deep_scrub":"267'312","last_deep_scrub_stamp":"2024-09-12T19:23:09.658187+0000","last_clean_scrub_stamp":"2024-09-12T19:23:09.658187+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:25.530411+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":2514,"num_write":1024,"num_write_kb":45573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'968","reported_seq":2668,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:27.193466+0000","last_change":"2024-09-12T19:23:27.193466+0000","last_active":"2024-09-12T19:23:27.193466+0000","last_peered":"2024-09-12T19:23:27.193466+0000","last_clean":"2024-09-12T19:23:27.193466+0000","last_became_active":"2024-09-12T17:29:54.758687+0000","last_became_peered":"2024-09-12T17:29:54.758687+0000","last_unstale":"2024-09-12T19:23:27.193466+0000","last_undegraded":"2024-09-12T19:23:27.193466+0000","last_fullsized":"2024-09-12T19:23:27.193466+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'968","last_scrub_stamp":"2024-09-12T19:23:27.193272+0000","last_deep_scrub":"267'968","last_deep_scrub_stamp":"2024-09-12T19:23:27.193272+0000","last_clean_scrub_stamp":"2024-09-12T19:23:27.193272+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":900,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:29.700297+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4571,"num_read_kb":4077,"num_write":1316,"num_write_kb":537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'354","reported_seq":1040,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:13.196879+0000","last_change":"2024-09-12T19:23:13.196879+0000","last_active":"2024-09-12T19:23:13.196879+0000","last_peered":"2024-09-12T19:23:13.196879+0000","last_clean":"2024-09-12T19:23:13.196879+0000","last_became_active":"2024-09-12T17:29:52.718689+0000","last_became_peered":"2024-09-12T17:29:52.718689+0000","last_unstale":"2024-09-12T19:23:13.196879+0000","last_undegraded":"2024-09-12T19:23:13.196879+0000","last_fullsized":"2024-09-12T19:23:13.196879+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-09-12T19:23:13.196640+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-09-12T19:23:13.196640+0000","last_clean_scrub_stamp":"2024-09-12T19:23:13.196640+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:32:39.813132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":521,"num_read_kb":13386,"num_write":1097,"num_write_kb":27082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'1292","reported_seq":2911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.220616+0000","last_change":"2024-09-12T19:23:19.220616+0000","last_active":"2024-09-12T19:23:19.220616+0000","last_peered":"2024-09-12T19:23:19.220616+0000","last_clean":"2024-09-12T19:23:19.220616+0000","last_became_active":"2024-09-12T17:29:54.764876+0000","last_became_peered":"2024-09-12T17:29:54.764876+0000","last_unstale":"2024-09-12T19:23:19.220616+0000","last_undegraded":"2024-09-12T19:23:19.220616+0000","last_fullsized":"2024-09-12T19:23:19.220616+0000","mapping_epoch":28,"log_start":"267'1200","ondisk_log_start":"267'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1292","last_scrub_stamp":"2024-09-12T19:23:19.220421+0000","last_deep_scrub":"267'1292","last_deep_scrub_stamp":"2024-09-12T19:23:19.220421+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.220421+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":1200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:24.771326+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5917,"num_read_kb":5200,"num_write":1797,"num_write_kb":764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'408","reported_seq":1091,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.128933+0000","last_change":"2024-09-12T19:23:15.128933+0000","last_active":"2024-09-12T19:23:15.128933+0000","last_peered":"2024-09-12T19:23:15.128933+0000","last_clean":"2024-09-12T19:23:15.128933+0000","last_became_active":"2024-09-12T17:29:52.769086+0000","last_became_peered":"2024-09-12T17:29:52.769086+0000","last_unstale":"2024-09-12T19:23:15.128933+0000","last_undegraded":"2024-09-12T19:23:15.128933+0000","last_fullsized":"2024-09-12T19:23:15.128933+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'408","last_scrub_stamp":"2024-09-12T19:23:15.128724+0000","last_deep_scrub":"267'408","last_deep_scrub_stamp":"2024-09-12T19:23:15.128724+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.128724+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:19.551998+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730154,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":563,"num_read_kb":7699,"num_write":1244,"num_write_kb":36052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"267'896","reported_seq":2493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.943303+0000","last_change":"2024-09-12T19:23:15.943017+0000","last_active":"2024-09-12T19:23:15.943303+0000","last_peered":"2024-09-12T19:23:15.943303+0000","last_clean":"2024-09-12T19:23:15.943303+0000","last_became_active":"2024-09-12T17:29:54.759892+0000","last_became_peered":"2024-09-12T17:29:54.759892+0000","last_unstale":"2024-09-12T19:23:15.943303+0000","last_undegraded":"2024-09-12T19:23:15.943303+0000","last_fullsized":"2024-09-12T19:23:15.943303+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'896","last_scrub_stamp":"2024-09-12T19:23:15.942710+0000","last_deep_scrub":"267'896","last_deep_scrub_stamp":"2024-09-12T19:23:15.942710+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.942710+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:22.175169+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4227,"num_read_kb":3797,"num_write":1212,"num_write_kb":490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":729,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'326","reported_seq":974,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.372677+0000","last_change":"2024-09-12T19:23:18.372677+0000","last_active":"2024-09-12T19:23:18.372677+0000","last_peered":"2024-09-12T19:23:18.372677+0000","last_clean":"2024-09-12T19:23:18.372677+0000","last_became_active":"2024-09-12T17:29:52.748790+0000","last_became_peered":"2024-09-12T17:29:52.748790+0000","last_unstale":"2024-09-12T19:23:18.372677+0000","last_undegraded":"2024-09-12T19:23:18.372677+0000","last_fullsized":"2024-09-12T19:23:18.372677+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'326","last_scrub_stamp":"2024-09-12T19:23:18.372450+0000","last_deep_scrub":"267'326","last_deep_scrub_stamp":"2024-09-12T19:23:18.372450+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.372450+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:49.825077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":434,"num_read_kb":14399,"num_write":1080,"num_write_kb":30402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'1656","reported_seq":3232,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.271039+0000","last_change":"2024-09-12T19:23:23.270886+0000","last_active":"2024-09-12T19:23:23.271039+0000","last_peered":"2024-09-12T19:23:23.271039+0000","last_clean":"2024-09-12T19:23:23.271039+0000","last_became_active":"2024-09-12T17:29:54.754702+0000","last_became_peered":"2024-09-12T17:29:54.754702+0000","last_unstale":"2024-09-12T19:23:23.271039+0000","last_undegraded":"2024-09-12T19:23:23.271039+0000","last_fullsized":"2024-09-12T19:23:23.271039+0000","mapping_epoch":28,"log_start":"267'1600","ondisk_log_start":"267'1600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1656","last_scrub_stamp":"2024-09-12T19:23:23.270692+0000","last_deep_scrub":"267'1656","last_deep_scrub_stamp":"2024-09-12T19:23:23.270692+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.270692+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":1600,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:49:05.709009+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7245,"num_read_kb":6284,"num_write":2371,"num_write_kb":1100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'306","reported_seq":980,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:14.172017+0000","last_change":"2024-09-12T19:23:14.172017+0000","last_active":"2024-09-12T19:23:14.172017+0000","last_peered":"2024-09-12T19:23:14.172017+0000","last_clean":"2024-09-12T19:23:14.172017+0000","last_became_active":"2024-09-12T17:29:52.767990+0000","last_became_peered":"2024-09-12T17:29:52.767990+0000","last_unstale":"2024-09-12T19:23:14.172017+0000","last_undegraded":"2024-09-12T19:23:14.172017+0000","last_fullsized":"2024-09-12T19:23:14.172017+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'306","last_scrub_stamp":"2024-09-12T19:23:14.171585+0000","last_deep_scrub":"267'306","last_deep_scrub_stamp":"2024-09-12T19:23:14.171585+0000","last_clean_scrub_stamp":"2024-09-12T19:23:14.171585+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:44.675581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":644,"num_write":1033,"num_write_kb":10844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"267'933","reported_seq":2514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.964877+0000","last_change":"2024-09-12T19:23:11.964877+0000","last_active":"2024-09-12T19:23:11.964877+0000","last_peered":"2024-09-12T19:23:11.964877+0000","last_clean":"2024-09-12T19:23:11.964877+0000","last_became_active":"2024-09-12T17:29:54.759169+0000","last_became_peered":"2024-09-12T17:29:54.759169+0000","last_unstale":"2024-09-12T19:23:11.964877+0000","last_undegraded":"2024-09-12T19:23:11.964877+0000","last_fullsized":"2024-09-12T19:23:11.964877+0000","mapping_epoch":28,"log_start":"267'900","ondisk_log_start":"267'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'933","last_scrub_stamp":"2024-09-12T19:23:11.964699+0000","last_deep_scrub":"267'933","last_deep_scrub_stamp":"2024-09-12T19:23:11.964699+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.964699+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":900,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:21.605696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4504,"num_read_kb":3992,"num_write":1315,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'297","reported_seq":961,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.240869+0000","last_change":"2024-09-12T19:23:15.240869+0000","last_active":"2024-09-12T19:23:15.240869+0000","last_peered":"2024-09-12T19:23:15.240869+0000","last_clean":"2024-09-12T19:23:15.240869+0000","last_became_active":"2024-09-12T17:29:52.753935+0000","last_became_peered":"2024-09-12T17:29:52.753935+0000","last_unstale":"2024-09-12T19:23:15.240869+0000","last_undegraded":"2024-09-12T19:23:15.240869+0000","last_fullsized":"2024-09-12T19:23:15.240869+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'297","last_scrub_stamp":"2024-09-12T19:23:15.240643+0000","last_deep_scrub":"267'297","last_deep_scrub_stamp":"2024-09-12T19:23:15.240643+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.240643+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:02.060836+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340668,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":430,"num_read_kb":10673,"num_write":974,"num_write_kb":41601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'837","reported_seq":2507,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.256275+0000","last_change":"2024-09-12T19:23:21.256275+0000","last_active":"2024-09-12T19:23:21.256275+0000","last_peered":"2024-09-12T19:23:21.256275+0000","last_clean":"2024-09-12T19:23:21.256275+0000","last_became_active":"2024-09-12T17:29:54.760784+0000","last_became_peered":"2024-09-12T17:29:54.760784+0000","last_unstale":"2024-09-12T19:23:21.256275+0000","last_undegraded":"2024-09-12T19:23:21.256275+0000","last_fullsized":"2024-09-12T19:23:21.256275+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'837","last_scrub_stamp":"2024-09-12T19:23:21.256101+0000","last_deep_scrub":"267'837","last_deep_scrub_stamp":"2024-09-12T19:23:21.256101+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.256101+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:33:40.828572+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4062,"num_read_kb":3682,"num_write":1062,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1008,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'490","reported_seq":1220,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:21.818268+0000","last_change":"2024-09-12T19:23:21.818268+0000","last_active":"2024-09-12T19:23:21.818268+0000","last_peered":"2024-09-12T19:23:21.818268+0000","last_clean":"2024-09-12T19:23:21.818268+0000","last_became_active":"2024-09-12T17:29:52.735333+0000","last_became_peered":"2024-09-12T17:29:52.735333+0000","last_unstale":"2024-09-12T19:23:21.818268+0000","last_undegraded":"2024-09-12T19:23:21.818268+0000","last_fullsized":"2024-09-12T19:23:21.818268+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'490","last_scrub_stamp":"2024-09-12T19:23:21.818028+0000","last_deep_scrub":"267'490","last_deep_scrub_stamp":"2024-09-12T19:23:21.818028+0000","last_clean_scrub_stamp":"2024-09-12T19:23:21.818028+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:20.819323+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":869,"num_read_kb":5832,"num_write":1431,"num_write_kb":32355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'868","reported_seq":2455,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:23.061161+0000","last_change":"2024-09-12T19:23:23.061161+0000","last_active":"2024-09-12T19:23:23.061161+0000","last_peered":"2024-09-12T19:23:23.061161+0000","last_clean":"2024-09-12T19:23:23.061161+0000","last_became_active":"2024-09-12T17:29:54.753635+0000","last_became_peered":"2024-09-12T17:29:54.753635+0000","last_unstale":"2024-09-12T19:23:23.061161+0000","last_undegraded":"2024-09-12T19:23:23.061161+0000","last_fullsized":"2024-09-12T19:23:23.061161+0000","mapping_epoch":28,"log_start":"267'800","ondisk_log_start":"267'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'868","last_scrub_stamp":"2024-09-12T19:23:23.060978+0000","last_deep_scrub":"267'868","last_deep_scrub_stamp":"2024-09-12T19:23:23.060978+0000","last_clean_scrub_stamp":"2024-09-12T19:23:23.060978+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:13.470283+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4079,"num_read_kb":3651,"num_write":1151,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'312","reported_seq":1076,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:15.225895+0000","last_change":"2024-09-12T19:23:15.225895+0000","last_active":"2024-09-12T19:23:15.225895+0000","last_peered":"2024-09-12T19:23:15.225895+0000","last_clean":"2024-09-12T19:23:15.225895+0000","last_became_active":"2024-09-12T17:29:52.744397+0000","last_became_peered":"2024-09-12T17:29:52.744397+0000","last_unstale":"2024-09-12T19:23:15.225895+0000","last_undegraded":"2024-09-12T19:23:15.225895+0000","last_fullsized":"2024-09-12T19:23:15.225895+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'312","last_scrub_stamp":"2024-09-12T19:23:15.225542+0000","last_deep_scrub":"267'312","last_deep_scrub_stamp":"2024-09-12T19:23:15.225542+0000","last_clean_scrub_stamp":"2024-09-12T19:23:15.225542+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:31.333562+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170396,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":764,"num_read_kb":16845,"num_write":1041,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'476","reported_seq":2110,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.887757+0000","last_change":"2024-09-12T19:23:18.887757+0000","last_active":"2024-09-12T19:23:18.887757+0000","last_peered":"2024-09-12T19:23:18.887757+0000","last_clean":"2024-09-12T19:23:18.887757+0000","last_became_active":"2024-09-12T17:29:54.751872+0000","last_became_peered":"2024-09-12T17:29:54.751872+0000","last_unstale":"2024-09-12T19:23:18.887757+0000","last_undegraded":"2024-09-12T19:23:18.887757+0000","last_fullsized":"2024-09-12T19:23:18.887757+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'476","last_scrub_stamp":"2024-09-12T19:23:18.887565+0000","last_deep_scrub":"267'476","last_deep_scrub_stamp":"2024-09-12T19:23:18.887565+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.887565+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:59.888303+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2533,"num_read_kb":2381,"num_write":539,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2539,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'294","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:18.102283+0000","last_change":"2024-09-12T19:23:18.102283+0000","last_active":"2024-09-12T19:23:18.102283+0000","last_peered":"2024-09-12T19:23:18.102283+0000","last_clean":"2024-09-12T19:23:18.102283+0000","last_became_active":"2024-09-12T17:29:52.747688+0000","last_became_peered":"2024-09-12T17:29:52.747688+0000","last_unstale":"2024-09-12T19:23:18.102283+0000","last_undegraded":"2024-09-12T19:23:18.102283+0000","last_fullsized":"2024-09-12T19:23:18.102283+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'294","last_scrub_stamp":"2024-09-12T19:23:18.102039+0000","last_deep_scrub":"267'294","last_deep_scrub_stamp":"2024-09-12T19:23:18.102039+0000","last_clean_scrub_stamp":"2024-09-12T19:23:18.102039+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:41.889385+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262281,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":403,"num_read_kb":6219,"num_write":990,"num_write_kb":21267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'430","reported_seq":1951,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:31.159013+0000","last_change":"2024-09-12T19:23:31.159013+0000","last_active":"2024-09-12T19:23:31.159013+0000","last_peered":"2024-09-12T19:23:31.159013+0000","last_clean":"2024-09-12T19:23:31.159013+0000","last_became_active":"2024-09-12T17:29:54.760373+0000","last_became_peered":"2024-09-12T17:29:54.760373+0000","last_unstale":"2024-09-12T19:23:31.159013+0000","last_undegraded":"2024-09-12T19:23:31.159013+0000","last_fullsized":"2024-09-12T19:23:31.159013+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'430","last_scrub_stamp":"2024-09-12T19:23:31.158824+0000","last_deep_scrub":"267'430","last_deep_scrub_stamp":"2024-09-12T19:23:31.158824+0000","last_clean_scrub_stamp":"2024-09-12T19:23:31.158824+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:32.246805+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2333,"num_read_kb":2181,"num_write":522,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'333","reported_seq":1037,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:11.012158+0000","last_change":"2024-09-12T19:23:11.012002+0000","last_active":"2024-09-12T19:23:11.012158+0000","last_peered":"2024-09-12T19:23:11.012158+0000","last_clean":"2024-09-12T19:23:11.012158+0000","last_became_active":"2024-09-12T17:29:52.746880+0000","last_became_peered":"2024-09-12T17:29:52.746880+0000","last_unstale":"2024-09-12T19:23:11.012158+0000","last_undegraded":"2024-09-12T19:23:11.012158+0000","last_fullsized":"2024-09-12T19:23:11.012158+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'333","last_scrub_stamp":"2024-09-12T19:23:11.011792+0000","last_deep_scrub":"267'333","last_deep_scrub_stamp":"2024-09-12T19:23:11.011792+0000","last_clean_scrub_stamp":"2024-09-12T19:23:11.011792+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:47.703391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399180,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":70822,"num_write":1091,"num_write_kb":52448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'788","reported_seq":2454,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:24.032535+0000","last_change":"2024-09-12T19:23:24.032535+0000","last_active":"2024-09-12T19:23:24.032535+0000","last_peered":"2024-09-12T19:23:24.032535+0000","last_clean":"2024-09-12T19:23:24.032535+0000","last_became_active":"2024-09-12T17:29:54.765197+0000","last_became_peered":"2024-09-12T17:29:54.765197+0000","last_unstale":"2024-09-12T19:23:24.032535+0000","last_undegraded":"2024-09-12T19:23:24.032535+0000","last_fullsized":"2024-09-12T19:23:24.032535+0000","mapping_epoch":28,"log_start":"267'700","ondisk_log_start":"267'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'788","last_scrub_stamp":"2024-09-12T19:23:24.032353+0000","last_deep_scrub":"267'788","last_deep_scrub_stamp":"2024-09-12T19:23:24.032353+0000","last_clean_scrub_stamp":"2024-09-12T19:23:24.032353+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:14.118280+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3968,"num_read_kb":3617,"num_write":1032,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'309","reported_seq":972,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:17.332186+0000","last_change":"2024-09-12T19:23:17.332041+0000","last_active":"2024-09-12T19:23:17.332186+0000","last_peered":"2024-09-12T19:23:17.332186+0000","last_clean":"2024-09-12T19:23:17.332186+0000","last_became_active":"2024-09-12T17:29:52.749742+0000","last_became_peered":"2024-09-12T17:29:52.749742+0000","last_unstale":"2024-09-12T19:23:17.332186+0000","last_undegraded":"2024-09-12T19:23:17.332186+0000","last_fullsized":"2024-09-12T19:23:17.332186+0000","mapping_epoch":26,"log_start":"267'200","ondisk_log_start":"267'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'309","last_scrub_stamp":"2024-09-12T19:23:17.331803+0000","last_deep_scrub":"267'309","last_deep_scrub_stamp":"2024-09-12T19:23:17.331803+0000","last_clean_scrub_stamp":"2024-09-12T19:23:17.331803+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:55:46.672373+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":13262,"num_write":1037,"num_write_kb":35239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'334","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:19.345859+0000","last_change":"2024-09-12T19:23:19.345593+0000","last_active":"2024-09-12T19:23:19.345859+0000","last_peered":"2024-09-12T19:23:19.345859+0000","last_clean":"2024-09-12T19:23:19.345859+0000","last_became_active":"2024-09-12T17:29:52.720918+0000","last_became_peered":"2024-09-12T17:29:52.720918+0000","last_unstale":"2024-09-12T19:23:19.345859+0000","last_undegraded":"2024-09-12T19:23:19.345859+0000","last_fullsized":"2024-09-12T19:23:19.345859+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'334","last_scrub_stamp":"2024-09-12T19:23:19.345352+0000","last_deep_scrub":"267'334","last_deep_scrub_stamp":"2024-09-12T19:23:19.345352+0000","last_clean_scrub_stamp":"2024-09-12T19:23:19.345352+0000","objects_scrubbed":3,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:34.000068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170702,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":3934,"num_write":1046,"num_write_kb":9633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'602","reported_seq":2196,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:16.928201+0000","last_change":"2024-09-12T19:23:16.928044+0000","last_active":"2024-09-12T19:23:16.928201+0000","last_peered":"2024-09-12T19:23:16.928201+0000","last_clean":"2024-09-12T19:23:16.928201+0000","last_became_active":"2024-09-12T17:29:54.752553+0000","last_became_peered":"2024-09-12T17:29:54.752553+0000","last_unstale":"2024-09-12T19:23:16.928201+0000","last_undegraded":"2024-09-12T19:23:16.928201+0000","last_fullsized":"2024-09-12T19:23:16.928201+0000","mapping_epoch":28,"log_start":"267'500","ondisk_log_start":"267'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'602","last_scrub_stamp":"2024-09-12T19:23:16.927841+0000","last_deep_scrub":"267'602","last_deep_scrub_stamp":"2024-09-12T19:23:16.927841+0000","last_clean_scrub_stamp":"2024-09-12T19:23:16.927841+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":500,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:30.799294+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3060,"num_read_kb":2784,"num_write":774,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":757,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'400","reported_seq":1095,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:12.722656+0000","last_change":"2024-09-12T19:23:12.722510+0000","last_active":"2024-09-12T19:23:12.722656+0000","last_peered":"2024-09-12T19:23:12.722656+0000","last_clean":"2024-09-12T19:23:12.722656+0000","last_became_active":"2024-09-12T17:30:22.254863+0000","last_became_peered":"2024-09-12T17:30:22.254863+0000","last_unstale":"2024-09-12T19:23:12.722656+0000","last_undegraded":"2024-09-12T19:23:12.722656+0000","last_fullsized":"2024-09-12T19:23:12.722656+0000","mapping_epoch":39,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'400","last_scrub_stamp":"2024-09-12T19:23:12.722194+0000","last_deep_scrub":"267'400","last_deep_scrub_stamp":"2024-09-12T19:23:12.722194+0000","last_clean_scrub_stamp":"2024-09-12T19:23:12.722194+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:23.077630+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992370,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":655,"num_read_kb":2597,"num_write":1307,"num_write_kb":14489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5,0],"acting":[1,2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'448","reported_seq":1957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-12T19:23:25.408164+0000","last_change":"2024-09-12T19:23:25.408021+0000","last_active":"2024-09-12T19:23:25.408164+0000","last_peered":"2024-09-12T19:23:25.408164+0000","last_clean":"2024-09-12T19:23:25.408164+0000","last_became_active":"2024-09-12T17:29:54.763613+0000","last_became_peered":"2024-09-12T17:29:54.763613+0000","last_unstale":"2024-09-12T19:23:25.408164+0000","last_undegraded":"2024-09-12T19:23:25.408164+0000","last_fullsized":"2024-09-12T19:23:25.408164+0000","mapping_epoch":28,"log_start":"267'400","ondisk_log_start":"267'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'448","last_scrub_stamp":"2024-09-12T19:23:25.407841+0000","last_deep_scrub":"267'448","last_deep_scrub_stamp":"2024-09-12T19:23:25.407841+0000","last_clean_scrub_stamp":"2024-09-12T19:23:25.407841+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:02.339912+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2478,"num_read_kb":2322,"num_write":560,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5989,"num_read_kb":4199,"num_write":1940,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7510,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1013,"ondisk_log_size":1013,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":16341,"num_read_kb":15997,"num_write":16735,"num_write_kb":4892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2683,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1759,"ondisk_log_size":1759,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":476,"ondisk_log_size":476,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1542315,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":20962,"num_read_kb":40263,"num_write":17485,"num_write_kb":12367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685252,"num_omap_keys":1576,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1865,"ondisk_log_size":1865,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212845,"num_read_kb":194484,"num_write":55296,"num_write_kb":18842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43560,"num_omap_keys":175,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3868,"ondisk_log_size":3868,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":66041020,"num_objects":366,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":366,"num_whiteouts":0,"num_read":36181,"num_read_kb":1906096,"num_write":71498,"num_write_kb":2114280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90423296,"data_stored":90423296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3830,"ondisk_log_size":3830,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":168420,"num_write":154,"num_write_kb":116143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":174519,"num_write":154,"num_write_kb":116143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543529,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316644,"kb_used_data":14740,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94055196,"statfs":{"total":96636764160,"available":96312520704,"internally_reserved":0,"allocated":15093760,"data_stored":13085472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":309131722},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543535,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296832,"kb_used_data":12976,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94075008,"statfs":{"total":96636764160,"available":96332808192,"internally_reserved":0,"allocated":13287424,"data_stored":11310974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":290650566},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543528,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177144,"kb_used_data":11368,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94194696,"statfs":{"total":96636764160,"available":96455368704,"internally_reserved":0,"allocated":11640832,"data_stored":9617929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543530,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161488,"kb_used_data":17856,"kb_used_omap":1,"kb_used_meta":143614,"kb_avail":94210352,"statfs":{"total":96636764160,"available":96471400448,"internally_reserved":0,"allocated":18284544,"data_stored":16335473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":147061189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543529,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310864,"kb_used_data":18688,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":94060976,"statfs":{"total":96636764160,"available":96318439424,"internally_reserved":0,"allocated":19136512,"data_stored":17127576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":299170247},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543531,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126664,"kb_used_data":14968,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94245176,"statfs":{"total":96636764160,"available":96507060224,"internally_reserved":0,"allocated":15327232,"data_stored":13358682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543527,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200244,"kb_used_data":16420,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94171596,"statfs":{"total":96636764160,"available":96431714304,"internally_reserved":0,"allocated":16814080,"data_stored":14841351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543529,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299704,"kb_used_data":15912,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":94072136,"statfs":{"total":96636764160,"available":96329867264,"internally_reserved":0,"allocated":16293888,"data_stored":14257873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":290585029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11374592,"data_stored":11374592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12550144,"data_stored":12550144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11067392,"data_stored":11067392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14835712,"data_stored":14835712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14045184,"data_stored":14045184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7327744,"data_stored":7327744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9019392,"data_stored":9019392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10203136,"data_stored":10203136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":5848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:24:31.502 DEBUG:teuthology.orchestra.run.smithi098:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T19:24:31.839 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T19:24:31.839 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T19:24:31.839 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T19:24:31.839 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:24:35.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-12T19:24:37.941 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T19:24:37.942 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T19:24:37.942 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:24:38.037 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T19:24:38.037 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T19:24:38.038 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:24:41.784 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-12T19:24:41.784 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-12T19:24:44.140 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T19:24:44.140 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T19:24:44.140 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:24:44.238 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T19:24:44.238 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T19:24:44.238 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:24:44.338 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T19:24:44.338 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T19:24:44.338 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:24:47.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-12T19:24:47.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-12T19:24:50.440 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T19:24:50.441 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T19:24:50.441 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:24:50.533 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T19:24:50.533 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T19:24:50.533 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:24:52.993 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-12T19:24:52.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-12T19:24:56.634 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T19:24:56.634 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T19:24:56.635 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T19:24:56.635 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:24:56.664 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T19:24:56.664 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T19:24:56.664 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:24:56.695 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T19:24:56.695 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T19:24:56.696 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T19:24:56.696 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:24:56.736 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T19:24:56.736 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T19:24:56.736 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:24:56.798 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T19:24:56.798 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T19:24:56.799 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:24:56.823 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T19:24:56.823 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T19:24:56.823 DEBUG:teuthology.orchestra.run.smithi098:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T19:24:56.858 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-12T19:24:56.858 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T19:24:57.220 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-12T19:24:57.220 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T19:24:57.437 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-12T19:24:57.437 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T19:24:57.605 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-12T19:24:57.606 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T19:24:57.800 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T19:24:57.800 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T19:24:57.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-12T19:24:58.074 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T19:24:58.075 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T19:24:58.266 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T19:24:58.267 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T19:24:58.474 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T19:24:58.474 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T19:24:58.660 INFO:tasks.ceph:Archiving mon data... 2024-09-12T19:24:58.661 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902728/data/mon.a.tgz 2024-09-12T19:24:58.661 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2024-09-12T19:24:58.669 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.9yjfj6foum 2024-09-12T19:24:58.669 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.9yjfj6foum 2024-09-12T19:24:58.860 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.9yjfj6foum 2024-09-12T19:24:58.921 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.9yjfj6foum is 588KB 2024-09-12T19:24:58.985 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.9yjfj6foum 2024-09-12T19:24:58.990 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902728/data/mon.c.tgz 2024-09-12T19:24:58.990 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2024-09-12T19:24:59.038 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.YKpGM17hoz 2024-09-12T19:24:59.039 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.YKpGM17hoz 2024-09-12T19:24:59.240 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.YKpGM17hoz 2024-09-12T19:24:59.302 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.YKpGM17hoz is 616KB 2024-09-12T19:24:59.364 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.YKpGM17hoz 2024-09-12T19:24:59.369 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902728/data/mon.b.tgz 2024-09-12T19:24:59.370 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2024-09-12T19:24:59.375 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.iEcUoR5pAB 2024-09-12T19:24:59.376 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.iEcUoR5pAB 2024-09-12T19:24:59.575 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.iEcUoR5pAB 2024-09-12T19:24:59.636 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.iEcUoR5pAB is 616KB 2024-09-12T19:24:59.703 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.iEcUoR5pAB 2024-09-12T19:24:59.709 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T19:24:59.710 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T19:24:59.712 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T19:24:59.824 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T19:24:59.830 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T19:24:59.830 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T19:24:59.832 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902728/remote/smithi098/crash 2024-09-12T19:24:59.833 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T19:24:59.847 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902728/remote/smithi187/crash 2024-09-12T19:24:59.848 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T19:24:59.885 INFO:tasks.ceph:Compressing logs... 2024-09-12T19:24:59.885 DEBUG:teuthology.orchestra.run.smithi098:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T19:24:59.895 DEBUG:teuthology.orchestra.run.smithi187:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T19:24:59.920 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85130.log 2024-09-12T19:24:59.921 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106961.log 2024-09-12T19:24:59.921 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.85130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69645.log 2024-09-12T19:24:59.921 INFO:teuthology.orchestra.run.smithi098.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.85130.log.gz 2024-09-12T19:24:59.922 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.106961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32594.log 2024-09-12T19:24:59.923 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.69645.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.106961.log.gz 2024-09-12T19:24:59.923 INFO:teuthology.orchestra.run.smithi098.stderr: 52.4% -- replaced with /var/log/ceph/ceph-client.admin.69645.log.gz 2024-09-12T19:24:59.923 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172001.log 2024-09-12T19:24:59.925 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182737.log 2024-09-12T19:24:59.925 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32594.log.gz 2024-09-12T19:24:59.925 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.172001.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T19:24:59.925 INFO:teuthology.orchestra.run.smithi098.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.0.172001.log.gz 2024-09-12T19:24:59.925 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182737.log.gz 2024-09-12T19:24:59.925 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180131.log 2024-09-12T19:24:59.925 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173771.log 2024-09-12T19:24:59.925 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.180131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32579.log 2024-09-12T19:24:59.926 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180131.log.gz 2024-09-12T19:24:59.926 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.173771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35127.log 2024-09-12T19:24:59.926 INFO:teuthology.orchestra.run.smithi098.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.173771.log.gz 2024-09-12T19:24:59.933 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50742.log 2024-09-12T19:24:59.933 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32579.log.gz 2024-09-12T19:24:59.933 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.35127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141773.log 2024-09-12T19:24:59.933 INFO:teuthology.orchestra.run.smithi098.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.0.35127.log.gz 2024-09-12T19:24:59.933 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140593.log 2024-09-12T19:24:59.933 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50742.log.gz 2024-09-12T19:24:59.933 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.141773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44792.log 2024-09-12T19:24:59.933 INFO:teuthology.orchestra.run.smithi098.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.141773.log.gz 2024-09-12T19:24:59.933 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.140593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65411.log 2024-09-12T19:24:59.933 INFO:teuthology.orchestra.run.smithi098.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.140593.log.gz 2024-09-12T19:24:59.934 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145313.log 2024-09-12T19:24:59.934 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44792.log.gz 2024-09-12T19:24:59.934 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.65411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113452.log 2024-09-12T19:24:59.934 INFO:teuthology.orchestra.run.smithi098.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.65411.log.gz 2024-09-12T19:24:59.934 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.145313.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T19:24:59.934 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.113452.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.145313.log.gz 2024-09-12T19:24:59.934 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114632.log 2024-09-12T19:24:59.934 INFO:teuthology.orchestra.run.smithi098.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.113452.log.gz 2024-09-12T19:24:59.934 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135873.log 2024-09-12T19:24:59.934 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.114632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180106.log 2024-09-12T19:24:59.934 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.135873.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.114632.log.gz 2024-09-12T19:24:59.934 INFO:teuthology.orchestra.run.smithi098.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.135873.log.gz 2024-09-12T19:24:59.934 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.159314.log 2024-09-12T19:24:59.934 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.180106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32775.log 2024-09-12T19:24:59.935 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180106.log.gz 2024-09-12T19:24:59.935 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.159314.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.159314.log.gz 2024-09-12T19:24:59.935 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83358.log 2024-09-12T19:24:59.935 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42382.log 2024-09-12T19:24:59.935 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32775.log.gz 2024-09-12T19:24:59.935 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.83358.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.83358.log.gz 2024-09-12T19:24:59.935 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183337.log 2024-09-12T19:24:59.935 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.42382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134103.log 2024-09-12T19:24:59.935 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42382.log.gz 2024-09-12T19:24:59.935 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.183337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183337.log.gz 2024-09-12T19:24:59.935 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55635.log 2024-09-12T19:24:59.935 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33832.log 2024-09-12T19:24:59.948 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.134103.log: /var/log/ceph/ceph-client.admin.55635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67183.log 2024-09-12T19:24:59.948 INFO:teuthology.orchestra.run.smithi098.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.134103.log.gz 2024-09-12T19:24:59.948 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.33832.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.55635.log.gz 2024-09-12T19:24:59.948 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33832.log.gz 2024-09-12T19:24:59.948 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183075.log 2024-09-12T19:24:59.948 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.67183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116403.log 2024-09-12T19:24:59.948 INFO:teuthology.orchestra.run.smithi098.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.67183.log.gz 2024-09-12T19:24:59.948 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.183075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183075.log.gzgzip 2024-09-12T19:24:59.948 INFO:teuthology.orchestra.run.smithi098.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.67774.log 2024-09-12T19:24:59.948 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.116403.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T19:24:59.949 INFO:teuthology.orchestra.run.smithi098.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.116403.log.gz 2024-09-12T19:24:59.949 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.67774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78638.log 2024-09-12T19:24:59.949 INFO:teuthology.orchestra.run.smithi098.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.67774.log.gz 2024-09-12T19:24:59.949 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157211.log 2024-09-12T19:24:59.949 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.78638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152416.log 2024-09-12T19:24:59.949 INFO:teuthology.orchestra.run.smithi098.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.78638.log.gz 2024-09-12T19:24:59.949 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.157211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38059.log 2024-09-12T19:24:59.949 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157211.log.gz 2024-09-12T19:24:59.949 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.152416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73328.log 2024-09-12T19:24:59.949 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.152416.log.gz 2024-09-12T19:24:59.949 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.38059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96341.log 2024-09-12T19:24:59.949 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.73328.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.38059.log.gz 2024-09-12T19:24:59.949 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32359.log 2024-09-12T19:24:59.950 INFO:teuthology.orchestra.run.smithi098.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.73328.log.gz 2024-09-12T19:24:59.950 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103421.log 2024-09-12T19:24:59.950 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.96341.log: /var/log/ceph/ceph-client.admin.32359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32359.log.gz 2024-09-12T19:24:59.950 INFO:teuthology.orchestra.run.smithi098.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.96341.log.gz 2024-09-12T19:24:59.950 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121123.log 2024-09-12T19:24:59.950 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31968.log 2024-09-12T19:24:59.950 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.103421.log: /var/log/ceph/ceph-client.admin.121123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143543.log 2024-09-12T19:24:59.950 INFO:teuthology.orchestra.run.smithi098.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.103421.log.gz 2024-09-12T19:24:59.950 INFO:teuthology.orchestra.run.smithi098.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.121123.log.gz 2024-09-12T19:24:59.950 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31968.log.gz 2024-09-12T19:24:59.950 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79818.log 2024-09-12T19:24:59.950 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52562.log 2024-09-12T19:24:59.950 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.143543.log: /var/log/ceph/ceph-client.admin.79818.log: gzip -5 --verbose 80.8% -- /var/log/ceph/ceph-client.admin.42432.log -- replaced with /var/log/ceph/ceph-client.admin.143543.log.gz 2024-09-12T19:24:59.951 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-12T19:24:59.951 INFO:teuthology.orchestra.run.smithi098.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.79818.log.gz 2024-09-12T19:24:59.951 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.52562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182815.log 2024-09-12T19:24:59.951 INFO:teuthology.orchestra.run.smithi098.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.52562.log.gz 2024-09-12T19:24:59.951 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.42432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99291.log 2024-09-12T19:24:59.951 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182815.log.gz 2024-09-12T19:24:59.951 INFO:teuthology.orchestra.run.smithi098.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.42432.log.gz 2024-09-12T19:24:59.951 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47202.log 2024-09-12T19:24:59.951 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183258.log 2024-09-12T19:24:59.951 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.99291.log: /var/log/ceph/ceph-client.admin.47202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139413.log 2024-09-12T19:24:59.951 INFO:teuthology.orchestra.run.smithi098.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.47202.log.gz 2024-09-12T19:24:59.951 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183205.log 2024-09-12T19:24:59.951 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.183258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183258.log.gz 2024-09-12T19:24:59.952 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.139413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83948.log 82.6% -- replaced with /var/log/ceph/ceph-client.admin.139413.log.gz 2024-09-12T19:24:59.952 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-12T19:24:59.952 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.183205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183205.log.gz 2024-09-12T19:24:59.952 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40022.log 2024-09-12T19:24:59.952 INFO:teuthology.orchestra.run.smithi098.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.99291.log.gz 2024-09-12T19:24:59.952 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.83948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71558.log 2024-09-12T19:24:59.952 INFO:teuthology.orchestra.run.smithi098.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.83948.log.gz 2024-09-12T19:24:59.952 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105191.log 2024-09-12T19:24:59.952 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.40022.log: /var/log/ceph/ceph-client.admin.71558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33856.log 2024-09-12T19:24:59.952 INFO:teuthology.orchestra.run.smithi098.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.40022.log.gz 2024-09-12T19:24:59.952 INFO:teuthology.orchestra.run.smithi098.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.71558.log.gz 2024-09-12T19:24:59.952 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.105191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117583.log 2024-09-12T19:24:59.953 INFO:teuthology.orchestra.run.smithi098.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.105191.log.gz 2024-09-12T19:24:59.953 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.33856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147673.log 2024-09-12T19:24:59.953 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33856.log.gz 2024-09-12T19:24:59.953 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.117583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32801.log 2024-09-12T19:24:59.961 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26725.log 2024-09-12T19:24:59.961 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T19:24:59.963 INFO:teuthology.orchestra.run.smithi098.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.117583.log.gz 2024-09-12T19:24:59.964 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.147673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91620.log 2024-09-12T19:24:59.964 INFO:teuthology.orchestra.run.smithi098.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.147673.log.gz 2024-09-12T19:24:59.964 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108732.log 2024-09-12T19:24:59.964 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32801.log.gz 2024-09-12T19:24:59.964 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.91620.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.91620.log.gz 2024-09-12T19:24:59.964 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101061.log 2024-09-12T19:24:59.964 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93391.log 2024-09-12T19:24:59.964 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.108732.log: /var/log/ceph/ceph-client.admin.101061.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.108732.log.gz 2024-09-12T19:24:59.964 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140003.log 2024-09-12T19:24:59.964 INFO:teuthology.orchestra.run.smithi098.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.101061.log.gz 2024-09-12T19:24:59.964 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.93391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73918.log 2024-09-12T19:24:59.964 INFO:teuthology.orchestra.run.smithi098.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.93391.log.gz 2024-09-12T19:24:59.964 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.140003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137053.log 2024-09-12T19:24:59.964 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.73918.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.140003.log.gz 2024-09-12T19:24:59.965 INFO:teuthology.orchestra.run.smithi098.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.73918.log.gz 2024-09-12T19:24:59.965 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107552.log 2024-09-12T19:24:59.965 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135283.log 2024-09-12T19:24:59.965 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.137053.log: /var/log/ceph/ceph-client.admin.107552.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.137053.log.gz 2024-09-12T19:24:59.965 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150034.log 2024-09-12T19:24:59.965 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.135283.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.107552.log.gz 2024-09-12T19:24:59.965 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183023.log 2024-09-12T19:24:59.965 INFO:teuthology.orchestra.run.smithi098.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.135283.log.gz 2024-09-12T19:24:59.965 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.150034.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T19:24:59.965 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.183023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183023.log.gz 2024-09-12T19:24:59.965 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 89.1% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.150034.log.gz /var/log/ceph/ceph-client.admin.32152.log 2024-09-12T19:24:59.965 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-12T19:24:59.965 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56128.log 2024-09-12T19:24:59.966 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.32152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32152.log.gz 2024-09-12T19:24:59.966 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104011.log 2024-09-12T19:24:59.966 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93981.log 2024-09-12T19:24:59.966 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.56128.log: 20.3% -- replaced with /var/log/ceph/ceph-client.admin.56128.log.gz 2024-09-12T19:24:59.966 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.104011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157186.log 2024-09-12T19:24:59.966 INFO:teuthology.orchestra.run.smithi098.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.104011.log.gz 2024-09-12T19:24:59.966 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.93981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182971.log 2024-09-12T19:24:59.966 INFO:teuthology.orchestra.run.smithi098.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.93981.log.gz 2024-09-12T19:24:59.966 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31964.log 2024-09-12T19:24:59.966 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.157186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157186.log.gz 2024-09-12T19:24:59.966 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173181.log 2024-09-12T19:24:59.966 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182971.log.gz 2024-09-12T19:24:59.966 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72148.log 2024-09-12T19:24:59.966 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31964.log.gz 2024-09-12T19:24:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.173181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182867.log 2024-09-12T19:24:59.967 INFO:teuthology.orchestra.run.smithi098.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.173181.log.gz 2024-09-12T19:24:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.72148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85720.log 2024-09-12T19:24:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182867.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.72148.log.gz 2024-09-12T19:24:59.967 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78048.log 2024-09-12T19:24:59.967 INFO:teuthology.orchestra.run.smithi098.stderr: -- replaced with /var/log/ceph/ceph-client.admin.182867.log.gz 2024-09-12T19:24:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42407.log 2024-09-12T19:24:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.85720.log: /var/log/ceph/ceph-client.admin.78048.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.85720.log.gz 2024-09-12T19:24:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183049.log 2024-09-12T19:24:59.967 INFO:teuthology.orchestra.run.smithi098.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.78048.log.gz 2024-09-12T19:24:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.42407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32163.log 2024-09-12T19:24:59.967 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42407.log.gz 2024-09-12T19:24:59.967 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.183049.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T19:24:59.967 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183049.log.gz 2024-09-12T19:24:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118763.log 2024-09-12T19:24:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32163.log.gz 2024-09-12T19:24:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70965.log 2024-09-12T19:24:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.118763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156596.log 2024-09-12T19:24:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.70965.log: gzip -5 82.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.118763.log.gz /var/log/ceph/ceph-client.admin.32378.log 2024-09-12T19:24:59.968 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-12T19:24:59.968 INFO:teuthology.orchestra.run.smithi098.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.70965.log.gz 2024-09-12T19:24:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.156596.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.156596.log.gz 2024-09-12T19:24:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90440.log 2024-09-12T19:24:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55564.log 2024-09-12T19:24:59.968 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32378.log.gz 2024-09-12T19:24:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.90440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72738.log 2024-09-12T19:24:59.968 INFO:teuthology.orchestra.run.smithi098.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.90440.log.gz 2024-09-12T19:24:59.968 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.55564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178830.log 2024-09-12T19:24:59.969 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55564.log.gz 2024-09-12T19:24:59.969 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125843.log 2024-09-12T19:24:59.979 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.26725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26797.log 2024-09-12T19:24:59.979 INFO:teuthology.orchestra.run.smithi187.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26725.log.gz 2024-09-12T19:24:59.979 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T19:24:59.979 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26845.log 2024-09-12T19:24:59.979 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.26797.log: /var/log/ceph/ceph-osd.6.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.26797.log.gz --verbose 2024-09-12T19:24:59.979 INFO:teuthology.orchestra.run.smithi187.stderr: -- /var/log/ceph/ceph-client.admin.26773.log 2024-09-12T19:24:59.979 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.26845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26821.log 2024-09-12T19:24:59.979 INFO:teuthology.orchestra.run.smithi187.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26845.log.gz 2024-09-12T19:24:59.979 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.26773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26773.log.gz 2024-09-12T19:24:59.979 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26749.log 2024-09-12T19:24:59.979 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.26821.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T19:24:59.979 INFO:teuthology.orchestra.run.smithi187.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26821.log.gz 2024-09-12T19:24:59.980 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.26749.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T19:24:59.980 INFO:teuthology.orchestra.run.smithi187.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26749.log.gz 2024-09-12T19:24:59.980 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T19:24:59.980 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26701.log 2024-09-12T19:24:59.980 INFO:teuthology.orchestra.run.smithi187.stderr:gzip/var/log/ceph/ceph.log: -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T19:24:59.980 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.26701.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26701.log.gz 2024-09-12T19:24:59.980 INFO:teuthology.orchestra.run.smithi187.stderr: -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T19:24:59.980 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T19:24:59.980 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26677.log 2024-09-12T19:24:59.980 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.4.log: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T19:24:59.980 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.26677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26677.log.gz 2024-09-12T19:24:59.989 INFO:teuthology.orchestra.run.smithi187.stderr: 88.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T19:24:59.993 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.72738.log: 81.0%/var/log/ceph/ceph-client.admin.178830.log: -- replaced with /var/log/ceph/ceph-client.admin.72738.log.gz 2024-09-12T19:24:59.993 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46612.log 2024-09-12T19:24:59.993 INFO:teuthology.orchestra.run.smithi098.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.178830.log.gz 2024-09-12T19:24:59.993 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.125843.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.125843.log.gz 2024-09-12T19:24:59.994 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21897.log 2024-09-12T19:24:59.994 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26689.log 2024-09-12T19:24:59.994 INFO:teuthology.orchestra.run.smithi098.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.46612.log.gz/var/log/ceph/ceph.tmp-client.admin.21897.log: 2024-09-12T19:24:59.994 INFO:teuthology.orchestra.run.smithi098.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21897.log.gz -5 2024-09-12T19:24:59.994 INFO:teuthology.orchestra.run.smithi098.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31969.log 2024-09-12T19:24:59.994 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161767.log 2024-09-12T19:24:59.994 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.26689.log: 0.0%/var/log/ceph/ceph-client.admin.31969.log: -- replaced with /var/log/ceph/ceph-client.admin.26689.log.gz 2024-09-12T19:24:59.994 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31965.log 2024-09-12T19:24:59.994 INFO:teuthology.orchestra.run.smithi098.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31969.log.gz 2024-09-12T19:24:59.994 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.161767.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.161767.log.gz 2024-09-12T19:24:59.994 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35717.log 2024-09-12T19:24:59.994 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105781.log 2024-09-12T19:24:59.994 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31965.log.gz 2024-09-12T19:24:59.994 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.35717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180156.log 2024-09-12T19:24:59.995 INFO:teuthology.orchestra.run.smithi098.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.35717.log.gz 2024-09-12T19:24:59.995 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.105781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180083.log 2024-09-12T19:24:59.995 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32379.log 2024-09-12T19:24:59.995 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.180156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180156.log.gz 2024-09-12T19:24:59.995 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.180083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148264.log 2024-09-12T19:24:59.995 INFO:teuthology.orchestra.run.smithi098.stderr: 25.0% -- replaced with /var/log/ceph/ceph-client.admin.180083.log.gz 2024-09-12T19:24:59.995 INFO:teuthology.orchestra.run.smithi098.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105781.log.gz 2024-09-12T19:24:59.995 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32379.log.gz 2024-09-12T19:24:59.995 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60648.log 2024-09-12T19:24:59.995 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.148264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174361.log 2024-09-12T19:24:59.995 INFO:teuthology.orchestra.run.smithi098.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.148264.log.gz 2024-09-12T19:24:59.995 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.60648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100471.log 2024-09-12T19:24:59.996 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54382.log 2024-09-12T19:24:59.996 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.174361.log: /var/log/ceph/ceph-client.admin.100471.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.174361.log.gz 2024-09-12T19:24:59.996 INFO:teuthology.orchestra.run.smithi098.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.100471.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182919.log 2024-09-12T19:24:59.996 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-12T19:24:59.996 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.54382.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.54382.log.gz 2024-09-12T19:24:59.996 INFO:teuthology.orchestra.run.smithi098.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60648.log.gz 2024-09-12T19:24:59.996 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155366.log 2024-09-12T19:24:59.996 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68365.log 2024-09-12T19:24:59.996 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182919.log.gz 2024-09-12T19:24:59.996 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.155366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31971.log 2024-09-12T19:24:59.996 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155366.log.gz 2024-09-12T19:24:59.996 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.68365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128793.log 2024-09-12T19:24:59.996 INFO:teuthology.orchestra.run.smithi098.stderr: 25.0% -- replaced with /var/log/ceph/ceph-client.admin.68365.log.gz 2024-09-12T19:24:59.997 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31971.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31971.log.gz -5 2024-09-12T19:24:59.997 INFO:teuthology.orchestra.run.smithi098.stderr: --verbose -- /var/log/ceph/ceph-client.admin.88080.log 2024-09-12T19:24:59.997 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33880.log 2024-09-12T19:24:59.997 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.128793.log: /var/log/ceph/ceph-client.admin.88080.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.128793.log.gz 2024-09-12T19:24:59.997 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32179.log 2024-09-12T19:24:59.997 INFO:teuthology.orchestra.run.smithi098.stderr: 82.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.88080.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.31796.log 2024-09-12T19:24:59.997 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-12T19:24:59.997 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.33880.log: /var/log/ceph/ceph-client.admin.32179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33880.log.gz 2024-09-12T19:24:59.997 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32179.log.gz 2024-09-12T19:24:59.997 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111092.log 2024-09-12T19:24:59.997 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180207.log 2024-09-12T19:24:59.997 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31796.log.gz 2024-09-12T19:24:59.997 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.111092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150624.log 2024-09-12T19:24:59.998 INFO:teuthology.orchestra.run.smithi098.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.111092.log.gz 2024-09-12T19:24:59.998 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.180207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166031.log 2024-09-12T19:24:59.998 INFO:teuthology.orchestra.run.smithi098.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.180207.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119943.log 2024-09-12T19:24:59.998 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-12T19:24:59.998 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.150624.log: /var/log/ceph/ceph-client.admin.166031.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.150624.log.gz 2024-09-12T19:24:59.998 INFO:teuthology.orchestra.run.smithi098.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.166031.log.gz 2024-09-12T19:24:59.998 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74508.log 2024-09-12T19:24:59.998 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.119943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82768.log 2024-09-12T19:24:59.998 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.74508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179493.log 2024-09-12T19:24:59.998 INFO:teuthology.orchestra.run.smithi098.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.74508.log.gz 2024-09-12T19:24:59.998 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.82768.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.119943.log.gz 2024-09-12T19:24:59.998 INFO:teuthology.orchestra.run.smithi098.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.82768.log.gz 2024-09-12T19:24:59.998 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56153.log 2024-09-12T19:24:59.998 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.179493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55281.log 2024-09-12T19:24:59.999 INFO:teuthology.orchestra.run.smithi098.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.179493.log.gz/var/log/ceph/ceph-client.admin.56153.log: 2024-09-12T19:24:59.999 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32567.log 2024-09-12T19:24:59.999 INFO:teuthology.orchestra.run.smithi098.stderr: 22.0% -- replaced with /var/log/ceph/ceph-client.admin.56153.log.gz 2024-09-12T19:24:59.999 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.55281.log: 58.3% -- replaced with /var/log/ceph/ceph-client.admin.55281.log.gz 2024-09-12T19:24:59.999 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179420.log 2024-09-12T19:24:59.999 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183153.log 2024-09-12T19:24:59.999 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32567.log.gz 2024-09-12T19:24:59.999 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.179420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151214.log 2024-09-12T19:24:59.999 INFO:teuthology.orchestra.run.smithi098.stderr: 24.0% -- replaced with /var/log/ceph/ceph-client.admin.179420.log.gz 2024-09-12T19:25:00.000 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55066.log 2024-09-12T19:25:00.000 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.183153.log: /var/log/ceph/ceph-client.admin.151214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131743.log 2024-09-12T19:25:00.000 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183153.log.gz 2024-09-12T19:25:00.000 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.55066.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.151214.log.gz 2024-09-12T19:25:00.000 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171411.log 2024-09-12T19:25:00.000 INFO:teuthology.orchestra.run.smithi098.stderr: 61.5% -- replaced with /var/log/ceph/ceph-client.admin.55066.log.gz 2024-09-12T19:25:00.000 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.131743.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.131743.log.gz 2024-09-12T19:25:00.000 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50152.log 2024-09-12T19:25:00.000 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.171411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32387.log 2024-09-12T19:25:00.000 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50152.log: 84.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127023.log 2024-09-12T19:25:00.000 INFO:teuthology.orchestra.run.smithi098.stderr: -- replaced with /var/log/ceph/ceph-client.0.171411.log.gz 2024-09-12T19:25:00.000 INFO:teuthology.orchestra.run.smithi098.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.50152.log.gz 2024-09-12T19:25:00.001 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32387.log.gz 2024-09-12T19:25:00.001 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32576.log 2024-09-12T19:25:00.001 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106371.log 2024-09-12T19:25:00.001 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.127023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50792.log 2024-09-12T19:25:00.001 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32576.log.gz 2024-09-12T19:25:00.001 INFO:teuthology.orchestra.run.smithi098.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.127023.log.gz 2024-09-12T19:25:00.001 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.106371.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.106371.log.gz 2024-09-12T19:25:00.001 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119353.log 2024-09-12T19:25:00.001 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169641.log 2024-09-12T19:25:00.001 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50792.log: /var/log/ceph/ceph-client.admin.119353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32376.log 2024-09-12T19:25:00.001 INFO:teuthology.orchestra.run.smithi098.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.50792.log.gz 2024-09-12T19:25:00.001 INFO:teuthology.orchestra.run.smithi098.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.119353.log.gz 2024-09-12T19:25:00.007 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.169641.log: 80.9% -- replaced with /var/log/ceph/ceph-client.0.169641.log.gz 2024-09-12T19:25:00.007 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153596.log 2024-09-12T19:25:00.007 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178240.log 2024-09-12T19:25:00.007 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32376.log.gz 2024-09-12T19:25:00.007 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.153596.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T19:25:00.007 INFO:teuthology.orchestra.run.smithi098.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.153596.log.gz 2024-09-12T19:25:00.008 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.178240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31865.log 2024-09-12T19:25:00.008 INFO:teuthology.orchestra.run.smithi098.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.178240.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.176131.log 2024-09-12T19:25:00.008 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-12T19:25:00.008 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.31865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31865.log.gz 2024-09-12T19:25:00.008 INFO:teuthology.orchestra.run.smithi098.stderr: 95.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T19:25:00.008 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163534.log 2024-09-12T19:25:00.008 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.176131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79228.log 2024-09-12T19:25:00.008 INFO:teuthology.orchestra.run.smithi098.stderr: 84.4%/var/log/ceph/ceph-client.admin.163534.log: -- replaced with /var/log/ceph/ceph-client.0.176131.log.gz 2024-09-12T19:25:00.008 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136463.log 2024-09-12T19:25:00.008 INFO:teuthology.orchestra.run.smithi098.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.163534.log.gz 2024-09-12T19:25:00.008 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.79228.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.79228.log.gz 2024-09-12T19:25:00.008 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76868.log 2024-09-12T19:25:00.008 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.136463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182841.log 2024-09-12T19:25:00.009 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.76868.log: gzip 89.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.136463.log.gz 2024-09-12T19:25:00.009 INFO:teuthology.orchestra.run.smithi098.stderr: -- /var/log/ceph/ceph-client.0.170821.log 2024-09-12T19:25:00.009 INFO:teuthology.orchestra.run.smithi098.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.76868.log.gz 2024-09-12T19:25:00.009 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182841.log.gz 2024-09-12T19:25:00.009 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172591.log 2024-09-12T19:25:00.009 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.170821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144723.log 2024-09-12T19:25:00.009 INFO:teuthology.orchestra.run.smithi098.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.170821.log.gz 2024-09-12T19:25:00.009 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.172591.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.172591.log.gz 2024-09-12T19:25:00.009 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108142.log 2024-09-12T19:25:00.009 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.144723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33904.log 2024-09-12T19:25:00.009 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.108142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124663.log 2024-09-12T19:25:00.009 INFO:teuthology.orchestra.run.smithi098.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.108142.log.gz 2024-09-12T19:25:00.009 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.33904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33904.log.gz 2024-09-12T19:25:00.009 INFO:teuthology.orchestra.run.smithi098.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.144723.log.gz 2024-09-12T19:25:00.016 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95161.log 2024-09-12T19:25:00.016 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112862.log 2024-09-12T19:25:00.016 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.124663.log: /var/log/ceph/ceph-client.admin.95161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115813.log 2024-09-12T19:25:00.016 INFO:teuthology.orchestra.run.smithi098.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.124663.log.gz 2024-09-12T19:25:00.016 INFO:teuthology.orchestra.run.smithi098.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.95161.log.gz 2024-09-12T19:25:00.016 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.112862.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.112862.log.gz 2024-09-12T19:25:00.017 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145903.log 2024-09-12T19:25:00.017 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.115813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69007.log 2024-09-12T19:25:00.017 INFO:teuthology.orchestra.run.smithi098.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.115813.log.gz 2024-09-12T19:25:00.017 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.145903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174951.log 2024-09-12T19:25:00.017 INFO:teuthology.orchestra.run.smithi098.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.145903.log.gz/var/log/ceph/ceph-client.0.69007.log: 2024-09-12T19:25:00.017 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50767.log 2024-09-12T19:25:00.017 INFO:teuthology.orchestra.run.smithi098.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.0.69007.log.gz 2024-09-12T19:25:00.017 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.174951.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.174951.log.gz 2024-09-12T19:25:00.017 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32592.log 2024-09-12T19:25:00.017 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.50767.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76278.log 2024-09-12T19:25:00.017 INFO:teuthology.orchestra.run.smithi098.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50767.log.gz 2024-09-12T19:25:00.017 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130563.log 2024-09-12T19:25:00.017 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32592.log.gz 2024-09-12T19:25:00.017 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.76278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179468.log 2024-09-12T19:25:00.017 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T19:25:00.018 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.130563.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.76278.log.gz 2024-09-12T19:25:00.018 INFO:teuthology.orchestra.run.smithi098.stderr: 82.4%/var/log/ceph/ceph-client.admin.179468.log: -- replaced with /var/log/ceph/ceph-client.admin.130563.log.gz 2024-09-12T19:25:00.018 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179468.log.gz 2024-09-12T19:25:00.018 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66000.log 2024-09-12T19:25:00.018 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180182.log 2024-09-12T19:25:00.018 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.66000.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T19:25:00.018 INFO:teuthology.orchestra.run.smithi098.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.66000.log.gz 2024-09-12T19:25:00.018 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.180182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180182.log.gz 2024-09-12T19:25:00.018 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114042.log 2024-09-12T19:25:00.018 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51972.log 2024-09-12T19:25:00.019 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.114042.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.114042.log.gz 2024-09-12T19:25:00.019 INFO:teuthology.orchestra.run.smithi098.stderr: 94.1% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T19:25:00.030 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169051.log 2024-09-12T19:25:00.030 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.51972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48972.log 2024-09-12T19:25:00.032 INFO:teuthology.orchestra.run.smithi098.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.51972.log.gz/var/log/ceph/ceph-client.0.169051.log: 2024-09-12T19:25:00.033 INFO:teuthology.orchestra.run.smithi098.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.0.169051.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31963.log 2024-09-12T19:25:00.033 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-12T19:25:00.033 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122303.log 2024-09-12T19:25:00.033 INFO:teuthology.orchestra.run.smithi098.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.48972.log.gz 2024-09-12T19:25:00.033 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31963.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44202.log 2024-09-12T19:25:00.033 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-12T19:25:00.034 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.122303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155416.log 2024-09-12T19:25:00.034 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44202.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.122303.log.gz 2024-09-12T19:25:00.035 INFO:teuthology.orchestra.run.smithi098.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.44202.log.gz 2024-09-12T19:25:00.035 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87490.log 2024-09-12T19:25:00.035 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158416.log 2024-09-12T19:25:00.035 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.155416.log: /var/log/ceph/ceph-client.admin.87490.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.155416.log.gz 2024-09-12T19:25:00.036 INFO:teuthology.orchestra.run.smithi098.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177311.log 2024-09-12T19:25:00.036 INFO:teuthology.orchestra.run.smithi098.stderr: -- replaced with /var/log/ceph/ceph-client.admin.87490.log.gz 2024-09-12T19:25:00.036 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.158416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31891.log 2024-09-12T19:25:00.037 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.177311.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.158416.log.gz 2024-09-12T19:25:00.037 INFO:teuthology.orchestra.run.smithi098.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.0.177311.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61939.log 2024-09-12T19:25:00.037 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-12T19:25:00.038 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32155.log 2024-09-12T19:25:00.038 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0%/var/log/ceph/ceph-client.admin.61939.log: -- replaced with /var/log/ceph/ceph-client.admin.31891.log.gz 2024-09-12T19:25:00.038 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94571.log 2024-09-12T19:25:00.038 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32155.log.gz 2024-09-12T19:25:00.039 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95751.log 2024-09-12T19:25:00.040 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.94571.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.61939.log.gz 2024-09-12T19:25:00.040 INFO:teuthology.orchestra.run.smithi098.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.94571.log.gz 2024-09-12T19:25:00.040 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81588.log 2024-09-12T19:25:00.040 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.95751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182711.log 2024-09-12T19:25:00.042 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.81588.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.95751.log.gz 2024-09-12T19:25:00.042 INFO:teuthology.orchestra.run.smithi098.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.81588.log.gz 2024-09-12T19:25:00.042 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183101.log 2024-09-12T19:25:00.042 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133513.log 2024-09-12T19:25:00.042 INFO:teuthology.orchestra.run.smithi098.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182711.log.gz 2024-09-12T19:25:00.043 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.183101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183101.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55352.log 2024-09-12T19:25:00.043 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-12T19:25:00.043 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.133513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61294.log 2024-09-12T19:25:00.043 INFO:teuthology.orchestra.run.smithi098.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.133513.log.gz 2024-09-12T19:25:00.044 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154776.log 2024-09-12T19:25:00.044 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.55352.log: /var/log/ceph/ceph-client.admin.61294.log: 49.9% -- replaced with /var/log/ceph/ceph-client.admin.55352.log.gz 2024-09-12T19:25:00.044 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31917.log 2024-09-12T19:25:00.045 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.154776.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.154776.log.gz 2024-09-12T19:25:00.045 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91030.log 2024-09-12T19:25:00.046 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31917.log.gz 2024-09-12T19:25:00.046 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170231.log 2024-09-12T19:25:00.048 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.91030.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.91030.log.gz 2024-09-12T19:25:00.049 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36891.log 2024-09-12T19:25:00.049 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.170231.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.170231.log.gz 2024-09-12T19:25:00.050 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92210.log 2024-09-12T19:25:00.050 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.36891.log: 44.6% -- replaced with /var/log/ceph/ceph-client.0.36891.log.gz 2024-09-12T19:25:00.051 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96931.log 2024-09-12T19:25:00.052 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.92210.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.92210.log.gz 2024-09-12T19:25:00.052 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33951.log 2024-09-12T19:25:00.053 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.96931.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.96931.log.gz 2024-09-12T19:25:00.053 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99881.log 2024-09-12T19:25:00.055 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.33951.log: 95.9% -- replaced with /var/log/ceph/ceph-client.0.33951.log.gz 2024-09-12T19:25:00.055 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64528.log 2024-09-12T19:25:00.056 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.99881.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.99881.log.gz 2024-09-12T19:25:00.056 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141183.log 2024-09-12T19:25:00.057 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.64528.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.64528.log.gz 2024-09-12T19:25:00.058 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88670.log 2024-09-12T19:25:00.059 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.141183.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.141183.log.gz 2024-09-12T19:25:00.059 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26934.log 2024-09-12T19:25:00.060 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.88670.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.88670.log.gz 2024-09-12T19:25:00.060 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57421.log 2024-09-12T19:25:00.061 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.26934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26934.log.gz 2024-09-12T19:25:00.061 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109912.log 2024-09-12T19:25:00.062 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.57421.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.57421.log.gz 2024-09-12T19:25:00.063 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T19:25:00.064 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.109912.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.109912.log.gz 2024-09-12T19:25:00.064 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68417.log 2024-09-12T19:25:00.070 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph.log: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.61294.log.gz 2024-09-12T19:25:00.071 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82178.log 2024-09-12T19:25:00.071 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.68417.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.68417.log.gz 2024-09-12T19:25:00.072 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47792.log 2024-09-12T19:25:00.073 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.82178.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.82178.log.gz 2024-09-12T19:25:00.073 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183361.log 2024-09-12T19:25:00.074 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.47792.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.47792.log.gz 2024-09-12T19:25:00.074 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32377.log 2024-09-12T19:25:00.075 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.183361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183361.log.gz 2024-09-12T19:25:00.075 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59358.log 2024-09-12T19:25:00.076 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32377.log.gz 2024-09-12T19:25:00.076 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66593.log 2024-09-12T19:25:00.082 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.59358.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.59358.log.gz 2024-09-12T19:25:00.082 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131153.log 2024-09-12T19:25:00.084 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.66593.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66593.log.gz 2024-09-12T19:25:00.084 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128203.log 2024-09-12T19:25:00.085 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.131153.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.131153.log.gz 2024-09-12T19:25:00.085 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182997.log 2024-09-12T19:25:00.086 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.128203.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.128203.log.gz 2024-09-12T19:25:00.087 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58713.log 2024-09-12T19:25:00.087 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182997.log.gz 2024-09-12T19:25:00.087 INFO:teuthology.orchestra.run.smithi098.stderr: 93.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T19:25:00.088 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121713.log 2024-09-12T19:25:00.088 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.58713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165442.log 2024-09-12T19:25:00.089 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.121713.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.121713.log.gz 2024-09-12T19:25:00.089 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62584.log 2024-09-12T19:25:00.090 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.165442.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.165442.log.gz 2024-09-12T19:25:00.091 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32162.log 2024-09-12T19:25:00.092 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.62584.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62584.log.gz 2024-09-12T19:25:00.093 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162945.log 2024-09-12T19:25:00.093 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32162.log.gz 2024-09-12T19:25:00.094 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181400.log 2024-09-12T19:25:00.094 INFO:teuthology.orchestra.run.smithi098.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.58713.log.gz 2024-09-12T19:25:00.094 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.162945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31819.log 2024-09-12T19:25:00.095 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.181400.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.162945.log.gz 2024-09-12T19:25:00.095 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132923.log 2024-09-12T19:25:00.096 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31819.log.gz 2024-09-12T19:25:00.096 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164264.log 2024-09-12T19:25:00.097 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.132923.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.132923.log.gz 2024-09-12T19:25:00.097 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182763.log 2024-09-12T19:25:00.098 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.164264.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.164264.log.gz 2024-09-12T19:25:00.098 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89850.log 2024-09-12T19:25:00.099 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182763.log.gz 2024-09-12T19:25:00.099 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98111.log 2024-09-12T19:25:00.100 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.89850.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.89850.log.gz 2024-09-12T19:25:00.100 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153006.log 2024-09-12T19:25:00.101 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.98111.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.98111.log.gz 2024-09-12T19:25:00.101 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32386.log 2024-09-12T19:25:00.102 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.153006.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.153006.log.gz 2024-09-12T19:25:00.103 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148854.log 2024-09-12T19:25:00.103 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32386.log.gz 2024-09-12T19:25:00.103 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144133.log 2024-09-12T19:25:00.104 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.148854.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.148854.log.gz 2024-09-12T19:25:00.105 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129383.log 2024-09-12T19:25:00.105 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.144133.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.144133.log.gz 2024-09-12T19:25:00.106 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31967.log 2024-09-12T19:25:00.106 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.129383.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.129383.log.gz 2024-09-12T19:25:00.107 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111682.log 2024-09-12T19:25:00.107 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31967.log.gz 2024-09-12T19:25:00.108 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T19:25:00.108 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.111682.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.111682.log.gz 2024-09-12T19:25:00.109 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112272.log 2024-09-12T19:25:00.118 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180804.log 2024-09-12T19:25:00.119 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.112272.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.112272.log.gz 2024-09-12T19:25:00.127 INFO:teuthology.orchestra.run.smithi098.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.0.181400.log.gz 2024-09-12T19:25:00.128 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41792.log 2024-09-12T19:25:00.129 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.180804.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.180804.log.gz 2024-09-12T19:25:00.129 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56187.log 2024-09-12T19:25:00.130 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.41792.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.41792.log.gz 2024-09-12T19:25:00.130 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69679.log 2024-09-12T19:25:00.131 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.56187.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.56187.log.gz 2024-09-12T19:25:00.132 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37475.log 2024-09-12T19:25:00.135 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.69679.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.69679.log.gz 2024-09-12T19:25:00.135 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80408.log 2024-09-12T19:25:00.136 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.37475.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.37475.log.gz 2024-09-12T19:25:00.137 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120533.log 2024-09-12T19:25:00.137 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.80408.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.80408.log.gz 2024-09-12T19:25:00.138 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48382.log 2024-09-12T19:25:00.139 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.120533.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.120533.log.gz 2024-09-12T19:25:00.139 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175541.log 2024-09-12T19:25:00.140 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.48382.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.48382.log.gz 2024-09-12T19:25:00.140 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132333.log 2024-09-12T19:25:00.141 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.175541.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.175541.log.gz 2024-09-12T19:25:00.142 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44817.log 2024-09-12T19:25:00.142 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.132333.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.132333.log.gz 2024-09-12T19:25:00.143 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58067.log 2024-09-12T19:25:00.143 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44817.log.gz 2024-09-12T19:25:00.144 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51382.log 2024-09-12T19:25:00.151 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.58067.log: 93.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70269.log 2024-09-12T19:25:00.152 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.51382.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.51382.log.gz 2024-09-12T19:25:00.153 INFO:teuthology.orchestra.run.smithi098.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58067.log.gz 2024-09-12T19:25:00.153 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157826.log 2024-09-12T19:25:00.154 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.70269.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.70269.log.gz 2024-09-12T19:25:00.154 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55612.log 2024-09-12T19:25:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.157826.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.157826.log.gz 2024-09-12T19:25:00.155 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86900.log 2024-09-12T19:25:00.156 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.55612.log: 52.4% -- replaced with /var/log/ceph/ceph-client.admin.55612.log.gz 2024-09-12T19:25:00.156 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152394.log 2024-09-12T19:25:00.157 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.86900.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.86900.log.gz 2024-09-12T19:25:00.158 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124073.log 2024-09-12T19:25:00.158 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.152394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152394.log.gz 2024-09-12T19:25:00.159 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53202.log 2024-09-12T19:25:00.160 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.124073.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.124073.log.gz 2024-09-12T19:25:00.160 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102241.log 2024-09-12T19:25:00.161 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.53202.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.53202.log.gz 2024-09-12T19:25:00.161 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T19:25:00.162 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.102241.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.102241.log.gz 2024-09-12T19:25:00.162 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151804.log 2024-09-12T19:25:00.174 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182945.log 2024-09-12T19:25:00.175 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.151804.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.151804.log.gz 2024-09-12T19:25:00.175 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159906.log 2024-09-12T19:25:00.186 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182945.log.gz 2024-09-12T19:25:00.186 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183231.log 2024-09-12T19:25:00.191 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.159906.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.159906.log.gz 2024-09-12T19:25:00.192 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43612.log 2024-09-12T19:25:00.198 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.183231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183231.log.gz 2024-09-12T19:25:00.198 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86310.log 2024-09-12T19:25:00.199 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43612.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.43612.log.gz 2024-09-12T19:25:00.214 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T19:25:00.215 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.86310.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.86310.log.gz 2024-09-12T19:25:00.230 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104601.log 2024-09-12T19:25:00.234 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph.audit.log: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T19:25:00.250 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75098.log 2024-09-12T19:25:00.251 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.104601.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.104601.log.gz 2024-09-12T19:25:00.258 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53177.log 2024-09-12T19:25:00.258 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.75098.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.75098.log.gz 2024-09-12T19:25:00.266 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44842.log 2024-09-12T19:25:00.266 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.53177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53177.log.gz 2024-09-12T19:25:00.274 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84540.log 2024-09-12T19:25:00.274 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.44842.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.44842.log.gz 2024-09-12T19:25:00.282 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63874.log 2024-09-12T19:25:00.282 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.84540.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.84540.log.gz 2024-09-12T19:25:00.290 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98701.log 2024-09-12T19:25:00.298 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.63874.log: 92.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77458.log 2024-09-12T19:25:00.298 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.98701.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.98701.log.gz 2024-09-12T19:25:00.301 INFO:teuthology.orchestra.run.smithi098.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63874.log.gz 2024-09-12T19:25:00.306 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149444.log 2024-09-12T19:25:00.306 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.77458.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.77458.log.gz 2024-09-12T19:25:00.310 INFO:teuthology.orchestra.run.smithi098.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T19:25:00.311 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55587.log 2024-09-12T19:25:00.312 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.149444.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.149444.log.gz 2024-09-12T19:25:00.312 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32178.log 2024-09-12T19:25:00.326 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.55587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118173.log 2024-09-12T19:25:00.327 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32178.log.gz 2024-09-12T19:25:00.329 INFO:teuthology.orchestra.run.smithi098.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55587.log.gz 2024-09-12T19:25:00.329 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155391.log 2024-09-12T19:25:00.330 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.118173.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.118173.log.gz 2024-09-12T19:25:00.331 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36301.log 2024-09-12T19:25:00.331 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.155391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155391.log.gz 2024-09-12T19:25:00.332 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-12T19:25:00.333 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.36301.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.36301.log.gz 2024-09-12T19:25:00.333 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33928.log 2024-09-12T19:25:00.334 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/valgrind/ceph.client.0.log: 63.0% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-12T19:25:00.334 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56776.log 2024-09-12T19:25:00.335 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.33928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33928.log.gz 2024-09-12T19:25:00.335 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53152.log 2024-09-12T19:25:00.350 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.56776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115223.log 2024-09-12T19:25:00.350 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.53152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53152.log.gz 2024-09-12T19:25:00.352 INFO:teuthology.orchestra.run.smithi098.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.56776.log.gz 2024-09-12T19:25:00.352 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45432.log 2024-09-12T19:25:00.353 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.115223.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.115223.log.gz 2024-09-12T19:25:00.353 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125253.log 2024-09-12T19:25:00.354 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.45432.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.45432.log.gz 2024-09-12T19:25:00.355 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138233.log 2024-09-12T19:25:00.355 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.125253.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.125253.log.gz 2024-09-12T19:25:00.356 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160495.log 2024-09-12T19:25:00.361 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.138233.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.138233.log.gz 2024-09-12T19:25:00.361 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167860.log 2024-09-12T19:25:00.361 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.160495.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.160495.log.gz 2024-09-12T19:25:00.362 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147083.log 2024-09-12T19:25:00.362 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.167860.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.167860.log.gz 2024-09-12T19:25:00.362 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183284.log 2024-09-12T19:25:00.362 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.147083.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.147083.log.gz 2024-09-12T19:25:00.362 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176721.log 2024-09-12T19:25:00.366 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.183284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183284.log.gz 2024-09-12T19:25:00.366 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43022.log 2024-09-12T19:25:00.367 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.176721.log: 84.6% -- replaced with /var/log/ceph/ceph-client.0.176721.log.gz 2024-09-12T19:25:00.367 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157236.log 2024-09-12T19:25:00.367 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.43022.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.43022.log.gz 2024-09-12T19:25:00.367 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134693.log 2024-09-12T19:25:00.367 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.157236.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.157236.log.gz 2024-09-12T19:25:00.368 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183311.log 2024-09-12T19:25:00.369 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.134693.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.134693.log.gz 2024-09-12T19:25:00.370 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31669.log 2024-09-12T19:25:00.370 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.183311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183311.log.gz 2024-09-12T19:25:00.370 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31771.log 2024-09-12T19:25:00.370 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31669.log.gz 2024-09-12T19:25:00.371 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142953.log 2024-09-12T19:25:00.371 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31771.log.gz 2024-09-12T19:25:00.371 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127613.log 2024-09-12T19:25:00.373 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.142953.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.142953.log.gz 2024-09-12T19:25:00.373 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38643.log 2024-09-12T19:25:00.374 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.127613.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.127613.log.gz 2024-09-12T19:25:00.374 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109322.log 2024-09-12T19:25:00.375 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.38643.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.38643.log.gz 2024-09-12T19:25:00.375 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34543.log 2024-09-12T19:25:00.376 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.109322.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109322.log.gz 2024-09-12T19:25:00.377 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92801.log 2024-09-12T19:25:00.377 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.34543.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.34543.log.gz 2024-09-12T19:25:00.378 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123483.log 2024-09-12T19:25:00.379 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.92801.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.92801.log.gz 2024-09-12T19:25:00.379 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32827.log 2024-09-12T19:25:00.380 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.123483.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.123483.log.gz 2024-09-12T19:25:00.380 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154186.log 2024-09-12T19:25:00.381 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32827.log.gz 2024-09-12T19:25:00.381 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138823.log 2024-09-12T19:25:00.382 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.154186.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.154186.log.gz 2024-09-12T19:25:00.382 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32368.log 2024-09-12T19:25:00.384 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.138823.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.138823.log.gz 2024-09-12T19:25:00.385 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168461.log 2024-09-12T19:25:00.385 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32368.log.gz 2024-09-12T19:25:00.385 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46022.log 2024-09-12T19:25:00.386 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.0.168461.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.168461.log.gz 2024-09-12T19:25:00.387 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32593.log 2024-09-12T19:25:00.387 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.46022.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.46022.log.gz 2024-09-12T19:25:00.388 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32171.log 2024-09-12T19:25:00.388 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32593.log.gz 2024-09-12T19:25:00.389 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80998.log 2024-09-12T19:25:00.390 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32171.log.gz 2024-09-12T19:25:00.390 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129973.log 2024-09-12T19:25:00.391 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.80998.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.80998.log.gz 2024-09-12T19:25:00.391 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167271.log 2024-09-12T19:25:00.392 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.129973.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.129973.log.gz 2024-09-12T19:25:00.392 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31839.log 2024-09-12T19:25:00.395 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.167271.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.167271.log.gz 2024-09-12T19:25:00.395 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49562.log 2024-09-12T19:25:00.396 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31839.log.gz 2024-09-12T19:25:00.396 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179443.log 2024-09-12T19:25:00.397 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.49562.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.49562.log.gz 2024-09-12T19:25:00.397 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26836.log 2024-09-12T19:25:00.398 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.179443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179443.log.gz 2024-09-12T19:25:00.398 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183127.log 2024-09-12T19:25:00.399 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.26836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26836.log.gz 2024-09-12T19:25:00.399 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63229.log 2024-09-12T19:25:00.400 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.183127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183127.log.gz 2024-09-12T19:25:00.400 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89260.log 2024-09-12T19:25:00.402 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.63229.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63229.log.gz 2024-09-12T19:25:00.402 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116993.log 2024-09-12T19:25:00.403 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.89260.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.89260.log.gz 2024-09-12T19:25:00.403 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183179.log 2024-09-12T19:25:00.404 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.116993.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.116993.log.gz 2024-09-12T19:25:00.405 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102831.log 2024-09-12T19:25:00.405 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.183179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183179.log.gz 2024-09-12T19:25:00.406 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31970.log 2024-09-12T19:25:00.406 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.102831.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102831.log.gz 2024-09-12T19:25:00.407 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101651.log 2024-09-12T19:25:00.408 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.31970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31970.log.gz 2024-09-12T19:25:00.408 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137643.log 2024-09-12T19:25:00.409 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.101651.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.101651.log.gz 2024-09-12T19:25:00.409 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142363.log 2024-09-12T19:25:00.410 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.137643.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.137643.log.gz 2024-09-12T19:25:00.410 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126433.log 2024-09-12T19:25:00.411 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.142363.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.142363.log.gz 2024-09-12T19:25:00.411 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162356.log 2024-09-12T19:25:00.413 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.126433.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.126433.log.gz 2024-09-12T19:25:00.414 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53792.log 2024-09-12T19:25:00.415 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.162356.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.162356.log.gz 2024-09-12T19:25:00.415 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182893.log 2024-09-12T19:25:00.416 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.53792.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.53792.log.gz 2024-09-12T19:25:00.416 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32170.log 2024-09-12T19:25:00.417 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182893.log.gz 2024-09-12T19:25:00.417 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40612.log 2024-09-12T19:25:00.418 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32170.log.gz 2024-09-12T19:25:00.418 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182789.log 2024-09-12T19:25:00.419 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.40612.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.40612.log.gz 2024-09-12T19:25:00.419 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122893.log 2024-09-12T19:25:00.420 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.182789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182789.log.gz 2024-09-12T19:25:00.420 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55526.log 2024-09-12T19:25:00.421 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.122893.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.122893.log.gz 2024-09-12T19:25:00.421 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146493.log 2024-09-12T19:25:00.422 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.55526.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55526.log.gz 2024-09-12T19:25:00.423 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97521.log 2024-09-12T19:25:00.425 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.146493.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.146493.log.gz 2024-09-12T19:25:00.425 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156006.log 2024-09-12T19:25:00.426 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.97521.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.97521.log.gz 2024-09-12T19:25:00.426 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60003.log 2024-09-12T19:25:00.427 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.156006.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.156006.log.gz 2024-09-12T19:25:00.428 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32595.log 2024-09-12T19:25:00.430 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.60003.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.60003.log.gz 2024-09-12T19:25:00.430 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164853.log 2024-09-12T19:25:00.431 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32595.log.gz 2024-09-12T19:25:00.431 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41202.log 2024-09-12T19:25:00.432 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.164853.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.164853.log.gz 2024-09-12T19:25:00.433 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75688.log 2024-09-12T19:25:00.433 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.41202.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.41202.log.gz 2024-09-12T19:25:00.434 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32575.log 2024-09-12T19:25:00.435 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.75688.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.75688.log.gz 2024-09-12T19:25:00.435 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110502.log 2024-09-12T19:25:00.435 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.32575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32575.log.gz 2024-09-12T19:25:00.437 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-client.admin.110502.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110502.log.gz 2024-09-12T19:25:01.012 INFO:teuthology.orchestra.run.smithi187.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T19:25:01.305 INFO:teuthology.orchestra.run.smithi098.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T19:25:02.139 INFO:teuthology.orchestra.run.smithi187.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T19:25:04.092 INFO:teuthology.orchestra.run.smithi098.stderr: 92.5% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T19:25:04.983 INFO:teuthology.orchestra.run.smithi098.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T19:25:10.558 INFO:teuthology.orchestra.run.smithi098.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T19:25:12.018 INFO:teuthology.orchestra.run.smithi187.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T19:25:12.520 INFO:teuthology.orchestra.run.smithi098.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T19:25:12.691 INFO:teuthology.orchestra.run.smithi187.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T19:25:13.442 INFO:teuthology.orchestra.run.smithi187.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T19:25:17.937 INFO:teuthology.orchestra.run.smithi098.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T19:25:18.210 INFO:teuthology.orchestra.run.smithi187.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T19:25:18.210 INFO:teuthology.orchestra.run.smithi187.stderr: 2024-09-12T19:25:18.211 INFO:teuthology.orchestra.run.smithi187.stderr:real 0m18.276s 2024-09-12T19:25:18.211 INFO:teuthology.orchestra.run.smithi187.stderr:user 0m57.545s 2024-09-12T19:25:18.211 INFO:teuthology.orchestra.run.smithi187.stderr:sys 0m2.234s 2024-09-12T19:25:22.200 INFO:teuthology.orchestra.run.smithi098.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T19:25:22.205 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-12T19:25:22.205 INFO:teuthology.orchestra.run.smithi098.stderr:real 0m22.304s 2024-09-12T19:25:22.205 INFO:teuthology.orchestra.run.smithi098.stderr:user 1m11.707s 2024-09-12T19:25:22.205 INFO:teuthology.orchestra.run.smithi098.stderr:sys 0m2.746s 2024-09-12T19:25:22.206 INFO:tasks.ceph:Archiving logs... 2024-09-12T19:25:22.206 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902728/remote/smithi098/log 2024-09-12T19:25:22.207 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T19:25:30.728 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902728/remote/smithi187/log 2024-09-12T19:25:30.729 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T19:25:37.758 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T19:25:37.769 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T19:25:37.769 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T19:25:37.772 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T19:25:37.841 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T19:25:37.852 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T19:25:37.852 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T19:25:37.855 DEBUG:teuthology.orchestra.run.smithi187:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T19:25:37.870 INFO:teuthology.orchestra.run.smithi098.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T19:25:37.870 INFO:teuthology.orchestra.run.smithi098.stdout:============================================================================== 2024-09-12T19:25:37.870 INFO:teuthology.orchestra.run.smithi098.stdout:*hv01.front.sepi 67.205.162.81 3 u 113 256 377 0.120 -0.262 0.211 2024-09-12T19:25:37.870 INFO:teuthology.orchestra.run.smithi098.stdout:+hv02.front.sepi 96.245.170.99 3 u 125 256 377 0.176 -2.129 0.328 2024-09-12T19:25:37.870 INFO:teuthology.orchestra.run.smithi098.stdout:+hv03.front.sepi 74.6.168.72 3 u 147 256 377 0.182 +0.790 0.041 2024-09-12T19:25:37.870 INFO:teuthology.orchestra.run.smithi098.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T19:25:37.872 INFO:teuthology.orchestra.run.smithi187.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T19:25:37.872 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================== 2024-09-12T19:25:37.872 INFO:teuthology.orchestra.run.smithi187.stdout:*hv01.front.sepi 67.205.162.81 3 u 128 128 377 0.194 -0.288 0.097 2024-09-12T19:25:37.872 INFO:teuthology.orchestra.run.smithi187.stdout:+hv02.front.sepi 96.245.170.99 3 u 46 128 377 0.192 -3.073 0.462 2024-09-12T19:25:37.872 INFO:teuthology.orchestra.run.smithi187.stdout:+hv03.front.sepi 74.6.168.72 3 u 49 128 377 0.208 +0.589 0.087 2024-09-12T19:25:37.872 INFO:teuthology.orchestra.run.smithi187.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T19:25:37.872 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T19:25:37.895 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T19:25:37.895 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T19:25:37.904 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T19:25:37.914 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T19:25:37.924 INFO:teuthology.task.internal:Duration was 7610.281249 seconds 2024-09-12T19:25:37.924 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T19:25:37.934 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T19:25:37.935 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T19:25:37.937 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T19:25:37.974 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T19:25:37.974 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2024-09-12T19:25:37.975 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T19:25:38.023 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi187.front.sepia.ceph.com 2024-09-12T19:25:38.024 DEBUG:teuthology.orchestra.run.smithi187:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T19:25:38.034 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T19:25:38.034 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T19:25:38.067 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T19:25:38.102 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T19:25:38.103 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T19:25:38.135 DEBUG:teuthology.orchestra.run.smithi187:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T19:25:38.201 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T19:25:38.212 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T19:25:38.212 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T19:25:38.224 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T19:25:38.236 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T19:25:38.248 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T19:25:38.267 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T19:25:38.275 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2024-09-12T19:25:38.291 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = core 2024-09-12T19:25:38.319 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T19:25:38.339 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T19:25:38.340 DEBUG:teuthology.orchestra.run.smithi187:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T19:25:38.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T19:25:38.364 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T19:25:38.375 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T19:25:38.376 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902728/remote/smithi098 2024-09-12T19:25:38.376 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T19:25:38.403 DEBUG:teuthology.misc:Transferring archived files from smithi187:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902728/remote/smithi187 2024-09-12T19:25:38.403 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T19:25:38.428 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T19:25:38.429 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T19:25:38.439 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T19:25:38.473 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T19:25:38.485 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T19:25:38.485 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T19:25:38.496 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T19:25:38.496 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T19:25:38.498 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T19:25:38.502 INFO:teuthology.orchestra.run.smithi098.stdout: 658624 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 19:25 /home/ubuntu/cephtest 2024-09-12T19:25:38.521 INFO:teuthology.orchestra.run.smithi187.stdout: 658466 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 19:25 /home/ubuntu/cephtest 2024-09-12T19:25:38.523 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T19:25:38.533 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T19:25:38.560 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 7610.281249284744 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T19:25:38.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T19:25:38.644 INFO:teuthology.run:pass